tarbots: check

Showing posts with label check. Show all posts

EXALOGIC: INFINIBAND: "perfquery" command to check Symbol Errors and Other details of Compute Nodes Ports (How To Doc)

Following perfquery command can be executed on Compute node to check the Symbol Errors and Other details of Compute Nodes Ports.

perfquery <Baselid> <Port>

We can get Base lid and Port details from "ibstat" command of the Compute Node. Below is example snippet of "ibstat" command.

CA 'mlx4_0' 
CA type: MT26428 
Number of ports: 2 
Firmware version: 2.11.2010 
Hardware version: b0 
Node GUID: XXXXXXXXXXXXX 
System image GUID: XXXXXXXXXXXXX 

Port 1: 
State: Active 
Physical state: LinkUp 
Rate: 40 
Base lid: 7 
LMC: 0 
SM lid: 41 
Capability mask: 0x02510868 
Port GUID: XXXXXXXXXXXXX 
Link layer: IB 

Port 2: 
State: Active 
Physical state: LinkUp 
Rate: 40 
Base lid: 9 
LMC: 0 
]SM lid: 41 
Capability mask: 0x02510868 
Port GUID: XXXXXXXXXXXXX 
Link layer: IB

From above output we can see Base lid for Ports 1 and 2 of Compute Nodes. Now if we want to run perfquery on Port 1 on lid 7 command will look as follows:

perfquery 7 1

Below is example snippet of above command. If we notice Symbol Errors increasing in above command output, then it indicates that there is an issue with Compute node IB Port (bad cable, loose cable or other issues).

 # Port counters: Lid 7 port 1 (CapMask: 0x1400) 
PortSelect:......................1 
CounterSelect:...................0x0000 
SymbolErrorCounter:..............0 
LinkErrorRecoveryCounter:........0 
LinkDownedCounter:...............0 
PortRcvErrors:...................0 
PortRcvRemotePhysicalErrors:.....0 
PortRcvSwitchRelayErrors:........0 
PortXmitDiscards:................2 
PortXmitConstraintErrors:........0 
PortRcvConstraintErrors:.........0 
CounterSelect2:..................0x00 
LocalLinkIntegrityErrors:........0 
ExcessiveBufferOverrunErrors:....0 
VL15Dropped:.....................0 
PortXmitData:....................4294967295 
PortRcvData:.....................4294967295 
PortXmitPkts:....................4294967295 
PortRcvPkts:.....................1088593887 
PortXmitWait:....................65418428

Products to which Article Applies
Exalogic racks using Infiniband Switches

Article Author: Tarun Boyella

Oracle VM Manager: How to check/validate if "weblogic" domain user password is correct for OVM Manager?

Following are steps to validate/check if “weblogic” domain user password is correct in OVM Manager (OVMM).

1. Change to directory to bin directory inside OVM Manager Domain directory. Use below commands depending on OVM Manager version you are using.

OVM 3.2.X
cd /u01/app/oracle/ovm-manager-3/machine1/base_adf_domain/bin 


OVM 3.3.X, 3.4.X & later versions
cd /u01/app/oracle/ovm-manager-3/domains/ovm_domain/bin

2. Set WebLogic environment variable as follows

. ./setDomainEnv.sh

3. Run below java weblogic.Admin command. Replace password in below command will the password of “weblogic” OVMM domain user.

java weblogic.Admin -url localhost:7001 -username weblogic -password <password> GETSTATE

If you get the Server status as RUNNING then the password is correct

# java weblogic.Admin -url localhost:7001 -username weblogic -password welcome1 GETSTATE

Current state of "AdminServer" : RUNNING

If you get authentication errors when running above command, then that means that the “weblogic” user password is incorrect.

Alternate Method

Instead of above steps alternatively below command can be used to check/validate “weblogic domain user password.

OVM 3.2.X

source /u01/app/oracle/ovm-manager-3/machine1/base_adf_domain/bin/setDomainEnv.sh && java weblogic.Admin -url localhost:7001 -username weblogic -password welcome1 GETSTATE

OVM 3.3.X, 3.4.X & later versions

source /u01/app/oracle/ovm-manager-3/domains/ovm_domain/bin/setDomainEnv.sh && java weblogic.Admin -url localhost:7001 -username weblogic -password welcome1 GETSTAT

Products to which Article Applies

Oracle VM Manager - All versions.

Article Author: Tarun Boyella

INFINIBAND: "ibstat" Command To Check Infiniband (IB) HCA Ports Status, Node/Port GUIDs, Firmware Version, LID's etc. (How To Doc)

ibstat command can be used on host to check IB HCA ports status, Node/Port GUIDs, Firmware Version, LID's etc.

Below is example output of "ibstat" command.

# ibstat
CA 'mlx4_0'
        CA type: MT4099
        Number of ports: 2
        Firmware version: 2.11.1282
        Hardware version: 0
        Node GUID: 0x00ZZZZZ001432c50
        System image GUID: 0x00ZZZZZ001432c53
        Port 1:
                State: Active
                Physical state: LinkUp
                Rate: 40
                Base lid: 15
                LMC: 0
                SM lid: 109
                Capability mask: 0x02514868
                Port GUID: 0x00ZZZZZ001432c51
                Link layer: IB
        Port 2:
                State: Active
                Physical state: LinkUp
                Rate: 40
                Base lid: 16
                LMC: 0
                SM lid: 109
                Capability mask: 0x02514868
                Port GUID: 0x00ZZZZZ001432c52
                Link layer: IB

Products to which Article Applies

All Operating systems using Infiniband Fabric.

Additional Reference

https://docs.oracle.com/cd/E26698_01/html/E26434/z400000b1569074.html

Oracle VM Manager (OVMM): How To Check/Verify If There Is Corruption In OVM Manager Database (DB) From OVM CLI?

Below are steps to check/verify of there is corruption in OVM Manager Database (DB) from OVM CLI

1. Login to Host running Oracle VM Manager as "root" user.

2. Login to OVM shell prompt by running below command.

/usr/bin/ovm_shell.sh -u admin -p <password>

In above command replace <[password> with the OVMM "admin" user password. After successful login you will be logged into ">>>" OVMM shell prompt.

3. Run below commands in same order in OVMM shell prompt.

om = OvmClient.getOvmManager()

f = om.getFoundryContext()

f.fixupScan()

If there is corruption in OVM Manager DB, you will see outputs like ONF, inconsistencies etc. once you run "f.fixupScan()". If there is no corruption the output will be empty.

Products to which Article Applies

Oracle VM Manager (Versions 3.3.X & Above)

Exalogic: ZFS: Healthcheck Commands to Verify the Storage Appliance Health (How To Doc)

Below are the commands which can be used for verifying the health status of Oracle ZFS Storage Appliance.

1. Check the ZFS Cluster status using below command. Both the heads should be seen in cluster.

configuration cluster show

Below is sample output of above command. In below sample command the ZFS Storage heads are configured in owner/stripped cluster configuration.

Properties:state = AKCS_OWNER
description = Active (takeover completed)
peer_asn = ZZZZZ-ZZZZ-ZZZZ
peer_hostname = storagehead2
peer_state = AKCS_STRIPPED
peer_description = Ready (waiting for failback)

2. Check if there are any active problems using below command. There should be no faults in healthy ZFS heads.

maintenance problems show

3. Check if the ZFS head has pool active or in exported status using below command. Pool should not be in degraded or failed state.

configuration storage show

Below is sample output of above command.

pool = <poolname>                        
status = online                        
errors = 0                        
owner = storagehead1                      
profile = mirror                  
log_profile = log_stripe                
cache_profile = cache_stripe

4. Check the network interfaces status of head using below command. Network interfaces should be UP.

configuration net interfaces ls

Below is sample output of above command.

INTERFACE   STATE    CLASS LINKS       ADDRS                  LABEL
ixgbe0      up       ip    ixgbe0      10.141.135.84/23       ixgbe0

5. Check the status of Infiniband IB Ports on ZFS Storage Appliance using below command. Both the IB Ports should be UP and Active.

confirm shell ibstat

6. Check if there are any Hardware problems using below command. There should be no hardware problems in a a healthy system.

maintenance hardware show

Below is sample output of above command.

Chassis:

             NAME         STATE    
 MANUFACTURER                   MODEL                                   
                   SERIAL                                      RPM    
TYPE

chassis-000 
 storagehead2  ok        Oracle                         Oracle ZFS 
Storage ZS5-ES                                  ZZZZZZZZ                 
                 --     system

cpu-000 
     CPU 0        ok        Intel                          Intel(r) 
Xeon(r) CPU E5-2699 v3 @ 2.30GHz                  unknown               
             
cpu-001 
     CPU 1        ok        Intel                          Intel(r) 
Xeon(r) CPU E5-2699 v3 @ 2.30GHz                  unknown

Products to which Article Applies

Exalogic rack ZFS Storage Appliance.

OVS: How to Validate If Dom0 Oracle Virtual Server Hypervisor Is Healthy?

Below are commands which can be executed to check the health status of Dom0 Oracle Virtual Server Hypervisor is healthy.
Verify Xend Status

service xend status

xend should be shown as running in above command output as shown below.

xend daemon (pid 11702) is running...

Verify ovs-agent Status

service ovs-agent status

ovs-agent service should be UP as shown below.

log server (pid 12222) is running...
notification server (pid 12549) is running...
remaster server (pid 12581) is running...
monitor server (pid 12583) is running...
ha server (pid 12585) is running...
stats server (pid 12586) is running...
xmlrpc server (pid 12589) is running...

Verify O2CB Status

service o2cb status

O2CB Cluster status should be shown as Online and O2CB heartbeat status should be "Active" as seen below.

Driver for "configfs": LoadedFilesystem "configfs": Mounted
Stack glue driver: Loaded
Stack plugin "o2cb": Loaded
Driver for "ocfs2_dlmfs": Loaded
Filesystem "ocfs2_dlmfs": Mounted
Checking O2CB cluster "ZZZZZZZZZZZ": Online
  Heartbeat dead threshold: 43201
  Network idle timeout: 150000
  Network keepalive delay: 2000
  Network reconnect delay: 2000
  Heartbeat mode: Global
Checking O2CB heartbeat: Active
  0004ZZZZZZZZZZZZZZZZ /dev/dm-0
Nodes in O2CB cluster: 0 1 2 3 4 5 6 7
Active userdlm domains:  ovm

Verify OCFS2 Status

service ocfs2 status

OVS Repository and poolfs mount should be seen from this command as seen below.

Configured OCFS2 mountpoints:  /OVS
Active OCFS2 mountpoints:  /OVS /poolfsmnt/ZZZZZZZZZZZZZZZZZZZZZZZZ

Verify the NFS mounts

df -H

OVS Repository and poolfs mount should be seen from df command output.

/dev/mapper/ovspoolfs
                       10G  369M  9.7G   12% /poolfsmnt/ZZZZZZZZZZZZZZZZZZZZZZ
192.ZZ.ZZ.ZZ:/export/OVSRepo
                       31T  1.5T   29T   6% /OVS/Repositories/000ZZZZZZZZZZZZZZ

Products to which Article Applies

Oracle VM Manager.

Additional Reference

https://docs.oracle.com/cd/E64076_01/E64083/html/vmadm-preface.html

Main Menu

Search

EXALOGIC: INFINIBAND: "perfquery" command to check Symbol Errors and Other details of Compute Nodes Ports (How To Doc)

Oracle VM Manager: How to check/validate if "weblogic" domain user password is correct for OVM Manager?

INFINIBAND: "ibstat" Command To Check Infiniband (IB) HCA Ports Status, Node/Port GUIDs, Firmware Version, LID's etc. (How To Doc)

Oracle VM Manager (OVMM): How To Check/Verify If There Is Corruption In OVM Manager Database (DB) From OVM CLI?

Products to which Article Applies

Exalogic: ZFS: Healthcheck Commands to Verify the Storage Appliance Health (How To Doc)

Products to which Article Applies

OVS: How to Validate If Dom0 Oracle Virtual Server Hypervisor Is Healthy?

Products to which Article Applies

Additional Reference