Oracle RAC 12.2 Administration

CRS Service Administration

Start CRS Service
# systemctl start ohasd
Stop CRS Service
# systemctl stop ohasd
Check CRS Service Status
# systemctl status ohasd ohasd.service - (null) Loaded: loaded (/etc/rc.d/init.d/ohasd; bad; vendor preset: disabled) Active: active (exited) since Sun 2021-06-06 18:27:37 EDT; 3h 26min ago Docs: man:systemd-sysv-generator(8) Process: 3698 ExecStart=/etc/rc.d/init.d/ohasd start (code=exited, status=0/SUCCESS) Tasks: 2 Jun 06 18:26:23 rac12.linuxtechspace.com systemd[1]: Starting (null)... Jun 06 18:26:23 rac12.linuxtechspace.com ohasd[3698]: Starting ohasd: Jun 06 18:26:25 rac12.linuxtechspace.com root[3878]: Oracle HA daemon is enabled for autostart. Jun 06 18:27:36 rac12.linuxtechspace.com ohasd[3698]: CRS-4123: Oracle High Availability Services has been started. Jun 06 18:27:37 rac12.linuxtechspace.com systemd[1]: Started (null).
Check the help menu for all available options
# /u01/app/12.2.0.1/grid/bin/crsctl -help Usage: crsctl add - add a resource, type or other entity crsctl check - check the state or operating status of a service, resource, or other entity crsctl config - display automatic startup configuration crsctl create - display entity creation options crsctl debug - display or modify debug state crsctl delete - delete a resource, type or other entity crsctl disable - disable automatic startup crsctl discover - discover DHCP server crsctl enable - enable automatic startup crsctl eval - evaluate operations on resource or other entity without performing them crsctl export - export entities crsctl get - get an entity value crsctl getperm - get entity permissions crsctl lsmodules - list debug modules crsctl modify - modify a resource, type or other entity crsctl pin - make the leases of specified nodes immutable crsctl query - query service state crsctl release - release a DHCP lease crsctl relocate - relocate a resource, server or other entity crsctl replace - change the location of voting files crsctl request - request a DHCP lease or an action entry point crsctl set - set an entity value crsctl setperm - set entity permissions crsctl start - start a resource, server or other entity crsctl status - get status of a resource or other entity crsctl stop - stop a resource, server or other entity crsctl unpin - make the leases of previously pinned nodes mutable crsctl unset - unset an entity value, restoring its default
Check help menu for all available options for a command
# /u01/app/12.2.0.1/grid/bin/crsctl check -help Usage: crsctl check crs Check status of OHAS and CRS stack crsctl check cluster [[-all]|[-n [...]]] Check status of CRS stack crsctl check ctss Check status of Cluster Time Synchronization Services crsctl check resource { [...]|-w } [-n ] [-k ] [-d ] Check status of resources crsctl check resourcegroup { [...]|-w } [-n ] [-k ] Check status of resource groups crsctl check css Check status of Cluster Synchronization Services crsctl check evm Check status of Event Manager
Check CRS Service Status
# /u01/app/12.2.0.1/grid/bin/crsctl check crs CRS-4638: Oracle High Availability Services is online CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online
Check Status of Resources
# /u01/app/12.2.0.1/grid/bin/crsctl status res -t -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE rac11 STABLE ONLINE ONLINE rac12 STABLE ora.DATA.dg ONLINE ONLINE rac11 STABLE ONLINE ONLINE rac12 STABLE ora.LISTENER.lsnr ONLINE ONLINE rac11 STABLE ONLINE ONLINE rac12 STABLE ora.net1.network ONLINE ONLINE rac11 STABLE ONLINE ONLINE rac12 STABLE ora.ons ONLINE ONLINE rac11 STABLE ONLINE ONLINE rac12 STABLE -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE rac11 STABLE ora.LISTENER_SCAN2.lsnr 1 ONLINE ONLINE rac12 STABLE ora.LISTENER_SCAN3.lsnr 1 ONLINE ONLINE rac12 STABLE ora.MGMTLSNR 1 OFFLINE OFFLINE STABLE ora.asm 1 ONLINE ONLINE rac11 Started,STABLE 2 ONLINE ONLINE rac12 Started,STABLE 3 OFFLINE OFFLINE STABLE ora.cdbrac.db 1 ONLINE ONLINE rac11 Open,HOME=/u01/app/o racle/product/12.2.0 .1/db_1,STABLE 2 ONLINE ONLINE rac12 Open,HOME=/u01/app/o racle/product/12.2.0 .1/db_1,STABLE ora.cvu 1 ONLINE ONLINE rac12 STABLE ora.qosmserver 1 ONLINE ONLINE rac12 STABLE ora.rac11.vip 1 ONLINE ONLINE rac11 STABLE ora.rac12.vip 1 ONLINE ONLINE rac12 STABLE ora.scan1.vip 1 ONLINE ONLINE rac11 STABLE ora.scan2.vip 1 ONLINE ONLINE rac12 STABLE ora.scan3.vip 1 ONLINE ONLINE rac12 STABLE --------------------------------------------------------------------------------
Check the CRS node role
# /u01/app/12.2.0.1/grid/bin/crsctl get node role config Node 'rac11' configured role is 'hub'
Stop crs service
# /u01/app/12.2.0.1/grid/bin/crsctl stop crs -f CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac12' CRS-2673: Attempting to stop 'ora.crsd' on 'rac12' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'rac12' CRS-2673: Attempting to stop 'ora.qosmserver' on 'rac12' CRS-2673: Attempting to stop 'ora.cdbrac.db' on 'rac12' CRS-2677: Stop of 'ora.cdbrac.db' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac12' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac12' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac12' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac12' CRS-2673: Attempting to stop 'ora.cvu' on 'rac12' CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac12' succeeded CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac12' succeeded CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac12' succeeded CRS-2677: Stop of 'ora.DATA.dg' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'rac12' CRS-2673: Attempting to stop 'ora.rac12.vip' on 'rac12' CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac12' CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac12' CRS-2677: Stop of 'ora.asm' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac12' CRS-2677: Stop of 'ora.rac12.vip' on 'rac12' succeeded CRS-2677: Stop of 'ora.scan2.vip' on 'rac12' succeeded CRS-2677: Stop of 'ora.scan3.vip' on 'rac12' succeeded CRS-2677: Stop of 'ora.cvu' on 'rac12' succeeded CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac12' succeeded CRS-2677: Stop of 'ora.qosmserver' on 'rac12' succeeded CRS-2672: Attempting to start 'ora.qosmserver' on 'rac11' CRS-2672: Attempting to start 'ora.scan2.vip' on 'rac11' CRS-2672: Attempting to start 'ora.scan3.vip' on 'rac11' CRS-2672: Attempting to start 'ora.cvu' on 'rac11' CRS-2672: Attempting to start 'ora.rac12.vip' on 'rac11' CRS-2676: Start of 'ora.scan3.vip' on 'rac11' succeeded CRS-2676: Start of 'ora.scan2.vip' on 'rac11' succeeded CRS-2676: Start of 'ora.rac12.vip' on 'rac11' succeeded CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'rac11' CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'rac11' CRS-2676: Start of 'ora.cvu' on 'rac11' succeeded CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'rac11' succeeded CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'rac11' succeeded CRS-2676: Start of 'ora.qosmserver' on 'rac11' succeeded CRS-2673: Attempting to stop 'ora.ons' on 'rac12' CRS-2677: Stop of 'ora.ons' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'rac12' CRS-2677: Stop of 'ora.net1.network' on 'rac12' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac12' has completed CRS-2677: Stop of 'ora.crsd' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'rac12' CRS-2673: Attempting to stop 'ora.crf' on 'rac12' CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac12' CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac12' CRS-2677: Stop of 'ora.gpnpd' on 'rac12' succeeded CRS-2677: Stop of 'ora.crf' on 'rac12' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'rac12' succeeded CRS-2677: Stop of 'ora.asm' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac12' CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'rac12' CRS-2673: Attempting to stop 'ora.evmd' on 'rac12' CRS-2677: Stop of 'ora.ctssd' on 'rac12' succeeded CRS-2677: Stop of 'ora.evmd' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'rac12' CRS-2677: Stop of 'ora.cssd' on 'rac12' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'rac12' CRS-2677: Stop of 'ora.gipcd' on 'rac12' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac12' has completed CRS-4133: Oracle High Availability Services has been stopped.

CRS Resource Administration

Status Check for VIP Resource

Check status using Node parameter

# /u01/app/12.2.0.1/grid/bin/srvctl status vip -node rac11 VIP 192.168.50.157 is enabled VIP 192.168.50.157 is running on node: rac11

Check status using VIP parameter

# /u01/app/12.2.0.1/grid/bin/srvctl status vip -vip 192.168.50.157 VIP 192.168.50.157 is enabled VIP 192.168.50.157 is running on node: rac11
Status Check for DISKGROUP
# /u01/app/12.2.0.1/grid/bin/srvctl status diskgroup -diskgroup DATA Disk Group DATA is running on rac11,rac12
Status Check for NODEAPP
# /u01/app/12.2.0.1/grid/bin/srvctl status nodeapps VIP 192.168.50.157 is enabled VIP 192.168.50.157 is running on node: rac11 VIP 192.168.50.158 is enabled VIP 192.168.50.158 is running on node: rac12 Network is enabled Network is running on node: rac11 Network is running on node: rac12 ONS is enabled ONS daemon is running on node: rac11 ONS daemon is running on node: rac12
Status Check for DATABASE
# /u01/app/12.2.0.1/grid/bin/srvctl status database -thisversion Database unique name: cdbrac Instance cdbrac1 is running on node rac11 Instance cdbrac2 is running on node rac12
# /u01/app/12.2.0.1/grid/bin/srvctl status database -database cdbrac Instance cdbrac1 is running on node rac11 Instance cdbrac2 is running on node rac12
Status Check for LISTENER
# /u01/app/12.2.0.1/grid/bin/srvctl status listener Listener LISTENER is enabled Listener LISTENER is running on node(s): rac11,rac12
Status Check for ASM
# /u01/app/12.2.0.1/grid/bin/srvctl status asm ASM is running on rac11,rac12
# /u01/app/12.2.0.1/grid/bin/srvctl status asm -detail ASM is running on rac11,rac12 ASM is enabled. ASM instance +ASM1 is running on node rac11 Number of connected clients: 2 Client names: cdbrac1:cdbrac:PCD1122 rac11.linuxtechspace.com:_OCR:PCD1122 ASM instance +ASM2 is running on node rac12 Number of connected clients: 2 Client names: cdbrac2:cdbrac:PCD1122 rac12.linuxtechspace.com:_OCR:PCD1122
Status Check for SERVER
# /u01/app/12.2.0.1/grid/bin/srvctl status server -servers "rac11,rac12" Server name: rac11 Server state: ONLINE Server name: rac12 Server state: ONLINE
Relocate VIP Resource to Another Node
# /u01/app/12.2.0.1/grid/bin/srvctl relocate vip -vip 192.168.50.157 -node rac12

ASM Administration

List ASM DG Information
# /u01/app/12.2.0.1/grid/bin/asmcmd lsdg State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name MOUNTED EXTERN N 512 512 4096 4194304 40944 36644 0 36644 0 Y DATA/
List Oracle ASM disks
# /u01/app/12.2.0.1/grid/bin/asmcmd lsdsk Path /dev/oracleasm/asm-disk1 /dev/oracleasm/asm-disk2 /dev/oracleasm/asm-disk3 /dev/oracleasm/asm-disk4
Lists the contents of an Oracle ASM directory
# /u01/app/12.2.0.1/grid/bin/asmcmd ls DATA/
List ASM Cluster Mode
# /u01/app/12.2.0.1/grid/bin/asmcmd showclustermode ASM cluster : Flex mode enabled
List ASM Cluster State
# /u01/app/12.2.0.1/grid/bin/asmcmd showclusterstate Normal
Show ASM Disks IO Status
# /u01/app/12.2.0.1/grid/bin/asmcmd iostat Group_Name Dsk_Name Reads Writes DATA DATA_0000 497026560 40753664 DATA DATA_0001 92524544 37780480 DATA DATA_0002 325236224 163880448 DATA DATA_0003 381268992 42040320
Lists the open ASM disks
# /u01/app/12.2.0.1/grid/bin/asmcmd lsod Instance Process OSPID Path 1 oracle@rac11.linuxtechspace.com (DBW0) 18117 /dev/oracleasm/asm-disk1 1 oracle@rac11.linuxtechspace.com (DBW0) 18117 /dev/oracleasm/asm-disk2 1 oracle@rac11.linuxtechspace.com (DBW0) 18117 /dev/oracleasm/asm-disk3 1 oracle@rac11.linuxtechspace.com (DBW0) 18117 /dev/oracleasm/asm-disk4 1 oracle@rac11.linuxtechspace.com (GMON) 18131 /dev/oracleasm/asm-disk1 1 oracle@rac11.linuxtechspace.com (GMON) 18131 /dev/oracleasm/asm-disk2 1 oracle@rac11.linuxtechspace.com (GMON) 18131 /dev/oracleasm/asm-disk3 1 oracle@rac11.linuxtechspace.com (GMON) 18131 /dev/oracleasm/asm-disk4 1 oracle@rac11.linuxtechspace.com (LGWR) 18119 /dev/oracleasm/asm-disk3 1 oracle@rac11.linuxtechspace.com (LGWR) 18119 /dev/oracleasm/asm-disk4 1 oracle@rac11.linuxtechspace.com (RBAL) 18129 /dev/oracleasm/asm-disk1 1 oracle@rac11.linuxtechspace.com (RBAL) 18129 /dev/oracleasm/asm-disk1 1 oracle@rac11.linuxtechspace.com (RBAL) 18129 /dev/oracleasm/asm-disk2 1 oracle@rac11.linuxtechspace.com (RBAL) 18129 /dev/oracleasm/asm-disk2 1 oracle@rac11.linuxtechspace.com (RBAL) 18129 /dev/oracleasm/asm-disk3 1 oracle@rac11.linuxtechspace.com (RBAL) 18129 /dev/oracleasm/asm-disk3 1 oracle@rac11.linuxtechspace.com (RBAL) 18129 /dev/oracleasm/asm-disk4 1 oracle@rac11.linuxtechspace.com (RBAL) 18129 /dev/oracleasm/asm-disk4 1 oracle@rac11.linuxtechspace.com (SMON) 18123 /dev/oracleasm/asm-disk1 1 oracle@rac11.linuxtechspace.com (SMON) 18123 /dev/oracleasm/asm-disk2 1 oracle@rac11.linuxtechspace.com (SMON) 18123 /dev/oracleasm/asm-disk3 1 oracle@rac11.linuxtechspace.com (SMON) 18123 /dev/oracleasm/asm-disk4 1 oracle@rac11.linuxtechspace.com (TNS V1-V3) 29138 /dev/oracleasm/asm-disk2 1 oracle@rac11.linuxtechspace.com (TNS V1-V3) 9962 /dev/oracleasm/asm-disk3 1 oracle@rac11.linuxtechspace.com (TNS V1-V3) 30168 /dev/oracleasm/asm-disk4
Lists information about current Oracle ASM clients
# /u01/app/12.2.0.1/grid/bin/asmcmd lsct DB_Name Status Software_Version Compatible_version Instance_Name Disk_Group +ASM CONNECTED 12.2.0.1.0 12.2.0.1.0 +ASM1 DATA cdbrac CONNECTED 12.2.0.1.0 12.2.0.0.0 cdbrac1 DATA _OCR CONNECTED - - rac11.linuxtechspace.com DATA