Using a backup to restore a clustered appliance
In a clustered environment, the objective of a cluster backup is to preserve and allow the restoration of all operational data, including access request workflow, users/accounts, audit logs, and so on. All appliances in a cluster (primary and replicas) can be backed up. However, a backup should only be restored to an appliance in the worst-case scenario where no appliance can be restored using the failover operation.
When a backup is restored to an appliance, the restore on the primary clears the primary's cluster configuration but does not change the replicas' cluster configuration. To avoid issues:
- If possible, unjoin the replicas from the cluster prior to a backup restore.
-
Restore the backup on the appliance that will be the primary.
- If you did not unjoin the replicas prior to the backup restore, perform a cluster reset on each replica so they become standalones then join the replicas back into the cluster.
The appliance is restored as a stand-alone primary appliance in Read-only mode with no replicas. However, all the access request workflow, user/account, and audit log data that existed when the backup was taken is retained. This primary appliance can then be activated and replicas can be joined to recreate a cluster.
To take a backup of a physical appliance
- log in to the appliance as an Appliance Administrator.
- In Administrative Tools, select Settings | Backup and Restore.
-
Click Run Now to create a copy of the data currently on the primary appliance.
For more information, see Run Now.
Or you can click Backup Settings, in the upper-right corner of the Backups page, to configure an automatic backup schedule.
For more information, see Backup settings.
To restore a physical appliance from a backup
An Appliance Administrator can restore backups as far back as Safeguard for Privileged Passwords version 2.2.0.6958. Only the data is restored; the running version is not changed.
If the administrator attempts to restore a version earlier than 2.2.0.6958, a message like the following displays: Restore failed because the backup version '[version]' is older than the minimum supported version '2.2.0.6958' for restore.
You cannot restore a backup from a version newer than the one running on the appliance. The restore will fail and a message like the following displays: Restore failed because backup version [version] is newer then the one currently running [version].
The backup version and the running version display in the Activity Center logs that are generated when Safeguard starts, completes, or fails a restore.
NOTE: If you want to use a backup file taken on a different appliance, that backup file must first be downloaded on the appliance where the backup was taken. The downloaded backup file will then need to be uploaded to the appliance that wants to use it before you can use the Restore option.
- Log in to the appliance to be restored as an Appliance Administrator.
- In Administrative Tools, select Settings | Backup and Restore.
-
Select the backup to be used and click Restore.
-
When the Restore dialog displays, enter the word Restore and click OK.
For more information, see Restore.
The appliance is restored as a stand-alone primary appliance in Read-only mode with no replicas.
To rebuild a cluster
- Log in to the primary appliance as an Appliance Administrator.
- Activate the Read-only primary appliance.
- In Administrative Tools, navigate to Settings | Cluster | Cluster Management.
- Select the node to be activated from the cluster view (left pane).
- Click Activate.
-
Confirm the activate operation.
For more information, see Activating a read-only appliance.
- One at a time, enroll the replica appliances to rebuild your cluster.
- In Administrative Tools, select Settings | Cluster.
-
Click Add Replica to join a replica appliance to the cluster.
Once the enroll operation completes, repeat to add your appliances back into the cluster as replicas.
NOTE: Enrolling a replica can take up to 24 hours depending on the amount of data to be replicated and your network.
For more information, see Enrolling replicas into a cluster.
Related Topics
Backup and restore
Backup and restore
Resetting a cluster that has lost consensus
Resetting the cluster configuration allows you to recover a cluster that has lost consensus. If the cluster regains consensus after connectivity is restored, the primary will return to Read-Write mode and password check and change will be reenabled. However, if it does not regain consensus, the Appliance Administrator must perform a cluster reset to force-remove nodes from the cluster.
If you are concerned about network issues, reset the cluster with only the new primary appliance. Once the cluster reset operation is complete, enroll appliances one by one to create a new cluster.
|
Caution: Resetting a cluster should be your last resort. It is recommended that you restore from a backup rather than reset a cluster. |
Cautions
To avoid issues, consider the following cautions.
- Only reset the cluster if you are certain that consensus has been lost; otherwise, you could introduce a split-brain scenario. (Split-brain scenario is where a cluster gets divided into smaller clusters. Each of these smaller clusters believes it is the only active cluster and may then access the same data which could lead to data corruption.)
- Ensure that no cluster member has Offline Workflow Mode enabled. For more information, see Offline Workflow (automatic).
To reset a cluster
- Navigate to Administrative Tools | Settings and select Cluster.
-
Click the Reset Cluster button.
The Reset Cluster dialog displays, listing the appliances (primary and replicas) in the cluster.
-
In the Reset Cluster dialog, select the nodes to be included in the reset operation and use the Set Primary button to designate the primary appliance in the cluster.
NOTE: Nodes must have an appliance state of Online or Online Read-only and be able to communicate to be included in the reset operation. If you select a node that is not online or not available, you will get an error and the reset operation will fail.
- Click Reset Cluster.
-
In the confirmation dialog, enter the words Reset Cluster and click OK.
When connected to the new primary appliance, the Configuring Safeguard for Privileged Passwords Appliance progress page displays, showing the steps being performed as part of the maintenance task to reset the cluster.
- Once the maintenance tasks have completed, click Restart Desktop Client.
- If an appliance is cluster reset as a standalone appliance, it will be placed in StandaloneReadonly mode (not online) and will require activation to avoid a split-brain scenario. For more information, see Activating a read-only appliance.
Once reset, the cluster only contains the appliances that were included in the reset operation.
Performing a factory reset
As an Appliance Administrator, you can use the Factory Reset feature to reset a Safeguard for Privileged Passwords Appliance to recover from major problems or to clear the data and configuration settings on the appliance. A factory reset of a physical appliance may be initiated from the Appliance Information settings page in the desktop client, from the Recovery Kiosk, from the virtual appliance Support Kiosk, or using the API.
A Safeguard for Privileged Passwords virtual appliance is reset by the recovery steps to redeploy and not a factory reset. For more information, see Virtual appliance backup and recovery.
|
Caution: Care should be taken when performing a factory reset against a physical appliance, because this operation removes all data and audit history, returning it to its original state when it first came from the factory. The appliance must go through configuration again as if it had just come from the factory. For more information, see Setting up Safeguard for Privileged Passwords for the first time.
In addition, performing a factory reset may change the default SSL certificate and default SSH host key. |
Factory reset on a clustered appliance
Performing a factory reset on a clustered hardware appliance will not automatically remove the appliance from a cluster. The recommended best practice is to unjoin an appliance from the cluster before performing a factory reset on the appliance. After the unjoin and factory reset, the appliance must be configured again. For more information, see Setting up Safeguard for Privileged Passwords for the first time.
To perform a factory reset from the desktop client
- Navigate to Administrative Tools | Settings | Appliance | Factory Reset.
- Click Factory Reset.
-
In the Factory Reset confirmation dialog, enter the words Factory Reset and click OK.
The appliance will go into Maintenance mode to revert the appliance. Once completed, you will be prompted to restart the desktop client. If the appliance was in a cluster, you may need to unjoin the factory reset appliance. The factory reset appliance must be configured again. For more information, see Setting up Safeguard for Privileged Passwords for the first time. In addition, when you log in to the appliance, you will be prompted to add your Safeguard for Privileged Passwords licenses.
To perform a factory reset from the Recovery Kiosk
- To perform a hardware factory reset, go to the Recovery Kiosk. For more information, see Recovery Kiosk (Serial Kiosk).
-
Select Factory Reset.
-
Press the right arrow.
-
At id, enter your email or name and press the Tab key (or down arrow).
-
At Get Challenge, press the Enter key. Safeguard for Privileged Passwords produces a challenge.
-
Copy and paste the challenge and send it to One Identity Support.
- When you get the response from One Identity Support, copy and paste the response into the kiosk screen and select Factory Reset.
To perform a factory reset from the Support Kiosk
- To perform a hardware factory reset, gon the web management console, click Support Kiosk. For more information, see Support Kiosk.
- Select Factory Reset. (This option is not available if you are attached to the console of a virtual machine. The options is only available for hardware.)
-
Complete the challenge/response process:
- In Full Name or Email, enter your name or email to receive the challenge question.
- Click Get Challenge.
- To get the challenge response, perform one of the following (see the illustration that follows).
- Click Copy Challenge. The challenge is copied to the clipboard. Send that challenge to Safeguard support. Support will send back a challenge response that is good for 48 hours. Do not refresh your screen.
- Screenshot the QR code and send it to Support. Support will send back a challenge response that is good for 48 hours. Do not refresh your screen.
- When you get the response from One Identity Support, copy and paste the response into the kiosk screen and select Factory Reset.
Unlocking a locked cluster
In order to maintain consistency and stability, only one cluster operation can run at a time. To ensure this, Safeguard for Privileged Passwords locks the cluster while a cluster operation is running, such as enroll, unjoin, failover, patch, reset, and routine maintenance. The Cluster view shows that the cluster is locked and that any changes to the cluster configuration are not allowed until the operation completes. The banner that appears at the top of the screen explains the operation in progress and a red lock icon () next to an appliance indicates that the appliance is locking the cluster.
To unlock a locked cluster
- Click the lock icon in the upper right corner of the warning banner.
-
In the Unlock Cluster confirmation dialog, enter Unlock Cluster and click OK.
This will release the cluster lock that was placed on all of the appliances in the cluster and terminate the operation.
IMPORTANT: Care should be taken when unlocking a locked cluster. It should only be used when you are sure that one or more appliances in the cluster are offline and will not finish the current operation. If you force the cluster unlock, you may cause instability on an appliance, requiring a factory reset and possibly the need to rebuild the cluster. If you are unsure about the operation in progress, do NOT unlock the cluster. Most often, it will eventually time out and unlock on its own.