SSB LSI Raid Card Information and Troubleshooting (4236050)

Replacing the RAID card

Please run the following command after replacing the RAID card within the SSB

storcli /c0/bbu set bbuMode=1

There are different battery configurations and the Syslog-ng Store Box uses number 1. This is set at install, however, after the replacement the RAID card needs to be re-configured.

Collecting RAID card data manually (Standalone and HA Master Node)

Please run the following command to collect RAID card information when requested by One Identity support.

NOTE - Please run this command from the boot shell

mkdir /tmp/lsi && cp /opt/lsi/lsi_get/* /tmp/lsi/ && cd /tmp/lsi/ && bash ./lsigetlunix.sh -QD

Collecting RAID card data manually (HA Slave Node)

Please follow the steps below to collect the information necessary.

NOTE - If the slave node if in a read-only state, please create a RAM-disk. See step 1a, then proceed to step 2. If a RAM-disk is not needed, please start with step 1b, then proceed to step 2.

Step 1a - (For read-only state):

ssh 1.2.4.2 'mount -t tmpfs -o rw,size=128M /tmp/lsi'

Step 1b - (For normal data collection without RAM-disk):

ssh 1.2.4.2 'mkdir -pv /tmp/lsi'

Step 2 - Copy the lsi information to the Slave node:

scp /mnt/firmware/opt/lsi/lsi_get/* 1.2.4.2:/tmp/lsi/

Step 3 - SSH to the Slave node:

ssh 1.2.4.2

Step 4 - Change directories to the /tmp/lsi directory:

cd /tmp/lsi

Step 5 - Run the following to collect the data necesary:

bash ./lsigetlunix.sh -Q -D

Step 6 - Zip the files and move them to the /tmp/lsi directory:

tar -cvzf /tmp/raid.tar.gz /tmp/lsi

Step 7 - Exit from the slave node:

exit

Step 8 - From the Master node's boot shell copy the tar.gz file from the Slave node to the Master node:

scp 1.2.4.2:/tmp/raid.tar.gz /tmp/

Step 9 - Copy the file from the Master node (SSB) to another host and upload that file for One Identity support.

Run S.M.A.R.T. on all disks

Please follow the steps below to run S.M.A.R.T. on the disk in the RAID.

Step 1 - Find the number of all of the disks:

storcli /c0 /eall /sall show

NOTE - The DID (Device ID) column shows the disk numbering

Step 2 - Query S.M.A.R.T. on the disks replacing N with the number of drives queried from Step 1 above:

smartctl -T permissive -x -d megaraid,N /dev/sda

NOTE - The N is usually 3 to 15 on a T10 SSB Appliance, and 4 to 7 on a T4 appliance.

To query S.M.A.R.T on all drives on a T4 or T10 appliance, and write that information to /tmp/smart.log, please run the following command:

for N in $(storcli /c0 /eall /sall show|awk '/^[0-9].*(Onln|UGood)/ {print $2}');do echo "========  Disk Device ID#: ${N}  ========" ;smartctl -s on -S on -T permissive -x -d megaraid,${N} /dev/sda;done >/tmp/smart.log

Locate disk by using a blinking light

Please follow the steps below to locate a disk using the lights on the front of the physical SSB appliance.

Step 1 - Find the number of all of the disks:

storcli /c0 /eall /sall show

NOTE - The DID (Device ID) column shows the disk numbering

Step 2 - Run the following command to blink the light for the drive in question:

NOTE - Replace the X in /c0/eall/sX with the number of the drive in question queried using the command from Step 1 above.

storcli /c0/eall/sX start locate

Step 3 - Run the following command to stop blinking the light for the drive in question:

NOTE - Please replace the X in /c0/eall/sX with the number of the drive used in Step 2 above.

storcli /c0/eall/sX stop locate

Silence the alarm from a failed harddrive

Please run the command below to silence the alarm from a failed harddrive. This can also be used to silence the alarm while the RAID array is rebuilding after a drive has been replaced following a harddrive failure.

storcli /c0 set alarm=off

Start a consistency check

Please run the command below to start a consistency check operation for a virtual drive. Typically, a consistency check is run on an initialized virtual drive.
NOTE - Use the force option to run a consistency check on an uninitialized drive, remove the "force" string from the command below when running on an initialized 

storcli /c0/vall start cc force

Enable Patrol Read

Please run the command below to turn on the patrol read scheduling and to set the mode of the patrol read to automatic:

storcli /c0 set patrolread=on mode=auto

Continuous Rebuild Issue

Consistency checks may finish after the time of the following check which causes the initiation of another check. Please follow the steps below to mitigate the issue.

Step 1 - Query the delay between the start of the two consistency checks by running the following command:

storcli /c0 show all|grep Reoccurrence|head -1

Step 2 - Set the delay correctly by running the following command where YYYY=year, MM=month, DD=day, hh=hour, and DELAY is the time between the two checks in hours:

storcli /c0 set cc starttime=YYYY/MM/DD hh delay=DELAY

Show rebuild status

Please run the following command to check the rebuild status of a drive after replacement.

storcli /c0 /eall /sall show rebuild

Downgrade firmware

Please run the following command to downgrade the firmware of the RAID card replacing \PATH\TO\FW with the path and file name of the firmware.

NOTE - Do not run this command without advisement from One Identity support.

megacli -adpfwflash -f \PATH\TO\FW -noverchk -a0

Factory Reset Controller

Please run the following command to factory reset the RAID card.

NOTE - Do not run this command without advisement from One Identity support.

megacli -facdefset -a0

Failed Read S.M.A.R.T. Self Test Log Issue

The failed read S.M.A.R.T. self test log issue is caused by a non-spinning, hot-spare disk on an SSB T10 appliance.

Smartctl tries to read the disk, however, the card does not give access to the disk as it is not spinning which causes smartctl to reply with the error FailedReadSmartSelfTestLog.

Reassessing the disk as a dedicated hot-spare stops the alerts.

Please run the following commands to reassess the disk as a dedicated hot-spare.

NOTE - Do not run these commands without advisement from One Identity support.

storcli /c0/fall import
storcli /c0 /e4 /s12 delete hotsparedrive
storcli /c0 /e4 /s12 add hotsparedrive dgs=0