Archive and Restore

Archive and Restore Overview

Archive and purge operations should be run on a scheduled basis. There are two archive operations available on the Administration Console, in the Data Management section of the menu:

In an aggregation environment, data can be archived from the collector, from the aggregator, or from both locations. Most commonly, the data is archived only once, and the location from where it is archived varies depending on the customer's requirements.

Archive files can be sent using SCP or FTP protocol, or to an EMC Centera or TSM storage system (if configured). You can define a single archiving configuration for each Guardium appliance.

Guardium’s archive function creates signed, encrypted files that cannot be tampered with. DO NOT change the names of the generated archive files. The archive and restore operations depend on the file names created during the archiving process.

Archive and export activities use the system shared secret to create encrypted data files. Before information encrypted on one system can be restored on another, the restoring system must have the shared secret that was used on the archiving system when the file was created.

About the Catalog

Regardless of the destination for the archived data, the Guardium catalog tracks where every archive file is sent, so that it can be retrieved and restored on the system with minimal effort, at any point in the future.

A separate catalog is maintained on each appliance, and a new record is added to the catalog whenever the appliance archives data or results. Catalog entries can be transferred between appliances by one of the following methods:

When catalog entries are imported from another system, those entries will point to files that have been encrypted by that system. Before restoring or importing any such file, the system shared secret of the system that encrypted the file must be available on the importing system. See the description of the aggregator backup keys file and aggregator restore keys file commands in the CLI Reference, for instructions on how to get the shared secrets from one appliance to another.

Several commands are provided on the Administration Console for catalog maintenance:

Configure Data Archive and Purge

  1. Select Administration Console > Data Archive.

  2. If it is not already checked, mark the Archive checkbox. Additional fields will appear in the Configuration panel.

  3. In the boxes following Archive data older than, specify a starting day for the archive operation as a number of days, weeks, or months prior to the current day, which is day zero. These are calendar measurements, so if today is April 24, all data captured on April 23 is one day old, regardless of the time when the operation is performed. To archive data starting with yesterday’s data, enter the value 1, and select Day(s) from the list.

  4. Optionally, use the boxes following Ignore data older than to control how many days of data will be archived. Any value specified here must be greater than the Archive data older than value.

  5. Mark the Archive Values box to include values (from SQL strings) in the archived data. If this box is cleared, values will be replaced with question mark characters on the archive (and hence the values will not be available following a restore operation).

  6. Select storage method radio button from the list below. Depending on how the appliance has been configured, one or more of these buttons may not be available. For a description of how to configure the archive and backup storage methods, see the description of the show and store storage-system commands in the CLI Appendix.

  7. Perform the appropriate procedure (below), depending on the storage method selected:

  8. Optionally mark the Purge box to define a purge operation. When this box is marked, additional fields display.

  9. If purging data, use the Purge data older than fields to specify a starting day for the purge operation as a number of days, weeks, or months prior to the current day, which is day zero. All data from the specified day and all older days will be purged, except as noted below. Any value specified for the starting purge date must be greater than the value specified for the Archive data older than value. In addition, if data exporting is active, the starting purge date specified here must be greater than the Export data older than value. See the IMPORTANT note above.

  10. Click Apply to verify and save the configuration changes. The system will attempt to verify the configuration by sending a test data file to that location.

  11. To run or schedule the archive and purge operation, do one of the following:

  12. Click Done when you are finished.

  13. Back to top

Configure SCP or FTP Archive or Backup

After selecting SCP or FTP in an archive or backup configuration panel, the following information must be provided:

  1. In the Host box, enter the IP address or host name of the host to receive the archived data.

  2. In the Directory box, identify the directory in which the data is to be stored. How you specify this depends on whether the file transfer method used is FTP or SCP.

  3. In the Username box, enter the user name for logging onto the SCP or FTP server. This user must have write/execute permissions for the directory specified in the Directory box (above).

  4. In the Password box, enter the password for the above user, then enter it again in the Re-enter Password box.

  5. Return to the archiving or backup procedure to complete the configuration.

Configure EMC Centera Archive or Backup

After selecting EMC Centera in an archive or backup configuration panel, the following information must be provided:

  1. In the Retention box, enter the number of days to retain the data. The maximum is 24855 (68 years). If you want to save it for longer, you can restore the data later and save it again.

  2. In the Centera Pool Address box, enter the Centera Pool Connection String; for example:

    10.2.3.4,10.6.7.8?/var/centera/profile1_rwe.pea

  3. Click the Upload PEA File button to upload a Centera PEA file to be used for the connection string.

  4. Click the Apply button to save the configuration. The system will attempt to verify the Centera address by opening a pool using the connection string specified. If the operation fails, you will be informed and the configuration will not be saved.

  5. Return to the archiving or backup procedure to complete the configuration.

Configure TSM Archive or Backup

Before archiving to a TSM server, a dsm.sys configuration file must be uploaded to the Guardium appliance, via the CLI. See import tsm config in the CLI Reference Appendix.

After selecting TSM in an archive or backup configuration panel, the following information must be provided:

  1. In the Password box, enter the TSM password that this Guardium appliance will use to request TSM services, and re-enter it in the Re-enter Password box.

  2. Optionally enter a Server name matching a servername entry in your dsm.sys file.

  3. Optionally enter an As Host name.

  4. Click the Apply button to save the configuration. When you click the Apply button, the system attempts to verify the TSM destination by sending a test file to the server using the dsmc archive command. If the operation fails, you will be informed and the configuration will not be saved.

  5. Return to the archiving or backup procedure to complete the configuration.

Configure Results Archive

  1. Select Administration Console > Results Archive.

  2. In the boxes following Archive results older than, specify a starting day for the archive operation as a number of days, weeks, or months prior to the current day, which is day zero. These are calendar measurements, so if today is April 24, all results created on April 23 are one day old, regardless of the time when the operation is performed. To archive results starting with yesterday’s data, enter the value 1, and select Day(s) from the list.

  3. Optionally, use the boxes following Ignore results older than to control how many days of results will be archived. Any value specified here must be greater than the Archive results older than value.

  4. Select storage method radio button from the list below. Depending on how the appliance has been configured, one or more of these buttons may not be available. For a description of how to configure the archive and backup storage methods, see the description of the show and store storage-system commands in the CLI Appendix.

  5. Perform the appropriate procedure (below), depending on the storage method selected:

  6. In the Comment box, optionally enter comments to be stored with the configuration.

  7. Click Apply to verify and save the configuration changes. The system will attempt to verify the configuration by sending a test data file to that location.

  8. To run or schedule the archive and purge operation, do one of the following:

  9. Click Done when you are finished.

Restore Data

Before Restoring Data:

To restore data:

  1. Select Administration Console > Data Restore.

  2. Enter a date in the From box, to specify the earliest date for which you want data.

  3. Enter a date in the To box, to specify the latest date for which you want data.

  4. In the Host Name box, optionally enter the name of the Guardium appliance from which the archive originated.

  5. Click the Search button.

  6. In the Search Results panel, mark the Select box for each archive you want to restore.

  7. In the Don't purge restored data for at least box, enter the number of days that you want to retain the restored data on the appliance.

  8. Click the Restore button.

  9. Click Done when you are finished.

Archive Catalog

  1. Select Administration Console > Archive Catalog.

  2. Do one of the following:

  3. Click Done when you are finished.

Export Catalog

  1. Select Administration Console > Export Catalog.

  2. From the Type list, select the type of catalog to export: Data Catalog or Results Catalog.

  3. Select all of the definitions of this type to be exported.

  1. Click the Export button. Depending on your browser security settings, you may receive a warning message asking if you want to save the file or to open it using an editor.

  2. Save the exported file in an appropriate location.

  3. Click the Done button when you are finished.

Import Catalog

  1. Select Administration Console > Import Catalog.

  2. Enter the name of the file containing the exported catalog entries, or click the Browse button to locate and select that file.

  3. Click the Upload button. You are notified when the operation completes and the definitions contained in the file will be displayed.

  4. Optionally repeat the previous two steps to upload additional files.

  5. Click (Import this set of Definitions) to import a set of definitions, or click (Remove this set of Definitions without Importing) to remove the uploaded file without importing the definitions.

  6. You will be prompted to confirm either action.

  7. Click the Done button when you have finished importing or removing all uploaded files.