Copy Export
This chapter explains the Copy Export and Copy Export Recovery functions and how to use them.
This chapter includes the following sections:
12.1 Copy Export overview and considerations
Copy Export provides a function to enable a copy of selected logical volumes that is written to the IBM TS7700 to be removed and taken offsite for disaster recovery purposes. In addition, because the data is a copy of the logical volumes, the volumes remain intact and are still accessible by the production system.
12.1.1 Control of Copy Export
Storage Group (SG) and Management Class (MC) constructs are defined to use separate pools for the primary and secondary copies of the logical volume. The existing MC construct, which is part of Advanced Policy Management (APM), is used to create a secondary copy of the data to be Copy Exported. The MC actions are configured through the TS7700 Management Interface (MI).
An option on the MI window enables designation of a secondary pool as a Copy Export pool. As logical volumes are written, the secondary copy of the data is written to stacked volumes in the Copy Export pool.
12.1.2 Workflow of a Copy Export process
Typically, you run the Copy Export operation on a periodic basis. Because the purpose is to get a copy of the data offsite for disaster recovery (DR) purposes, performing it soon after the data is created minimizes the time for the recovery point objective (RPO). When the time comes to initiate a Copy Export, a Copy Export job is run from the production host.
The TS7700 pre-migrates any logical volumes in the Copy Export pool that have not been pre-migrated. Any new logical volumes that are written after the Copy Export operation is initiated are not included in the Copy Export set of physical volumes. These volumes will be copy exported in the next run, because the Copy Export is an incremental process. Therefore you need all Copy Export physical volumes from all Copy Export operations to do a full recovery. In each Copy Export session, the TS7700 writes a complete TS7700 database to each of the physical volumes in the Copy Export set. It is possible to select to write the database backup to all of the physical volumes, or to limited number of physical volumes. For recovery, you should use the database from the last Copy Export session.
During a Copy Export operation, all of the physical volumes with active data on them in a specified secondary pool are candidates to be exported. Only the logical volumes that are valid on that TS7700 are considered during the running of the operation. Logical volumes that are currently mounted during a Copy Export operation are excluded from the export set, as are any volumes that are not currently in the Tape Volume Cache (TVC) of the export cluster.
The host that initiates the Copy Export operation first creates a dedicated export list volume on the TS7700 that runs the operation. The export list volume contains instructions about the execution of the operation, and a reserved file that the TS7700 uses to provide completion status and export operation information.
As part of the Copy Export operation, the TS7700 creates response records in the reserved file. These records list the logical volumes that are exported and the physical volumes on which they are located. This information can be used as a record for the data that is offsite. The TS7700 also writes records in the reserved file on the export list volume that provide the status for all physical volumes with a state of Copy Exported.
The Copy Export job can specify whether the stacked volumes in the Copy Export set must be ejected immediately or placed into the export-hold category. When Copy Export is used with the export-hold category, you need to manually request the ejection of the export-hold volumes.
The choice to eject as part of the Copy Export job or to eject them later from the export-hold category is based on your operational procedures. The ejected Copy Export set is then transported to a disaster recovery site or vault. Your RPO determines the frequency of the Copy Export operation.
In heterogeneous drive configurations, the previous generation of drives is normally used for read-only operations. However, the Copy Export operation uses previous generation of 3592 tape drives to append the DB backup to physical volumes so that previous generation of cartridges can also be exported.
Copy Export Merge
If the copy-exported tapes are used for recovery, basically the recovery TS7700 cannot contain any previous data and the recovery process cannot merge data from more than one source TS7700 together. However, for the customers running R2.1 or later code level on an existing TS7700, there is an available service offering called Copy Export Merge where a customer can merge data from a copy export backup tape into an existing TS7700 (either stand-alone or grid).
12.1.3 General considerations for Copy Export
Consider the following information when you are planning to use the Copy Export function for disaster recovery:
•Both TS7740 and TS7700T support the Copy Export function. If a Copy Export Recovery is needed, the Copy Export sets can be used to restore data at a location that has equal or newer TS7700 microcode with physical tape drives that can read a Copy Export set of physical volumes. A TS7700T Copy Export set can be restored into both TS7740 and TS7700T. A TS7740 Copy Export set can also be restored into both TS7740 and TS7700T.
•When using the Copy Export acceleration (LMTDBPVL) option, the database backup is appended only to the first two and the last two in ascending order of name of volumes that are exported. These corresponding tapes with the database backup are selected and listed in the alphabetical order of the physical tape VOLSER. If the LMTDBPVL option was set, and there is a failure appending the DB backup, a different physical volume is selected to contain the database backup so that four physical volumes have the DB backup. The LMTDBPVL option can be specified through either of the following JCL:
 – OPTIONS1,COPY,LMTDBPVL (volumes will be marked as export hold)
 – OPTIONS1,COPY,EJECT,LMTDBPVL or OPTIONS1,COPY,LMTDBPVL,EJECT (volumes will be ejected from the library)
•The Copy Export operation might fail depending on the combination of installed tape drives, media types, or recording formats of physical volumes in the secondary pool, and the existence of LMTDBPVL option. Exportable physical volumes are explained in detail in Table 12-1 on page 740. If unexportable physical volumes are included in the Copy Export set physical volumes, the Copy Export operation fails and returns message CBR3856I.
•Specific logical volumes are not specified as part of a Copy Export operation. Instead, all valid logical volumes on the physical volumes in the specified secondary pool are considered for export. After the first time that Copy Export is performed for a pool, the logical volumes that will be exported are the ones for that pool that have been newly written or modified since the last export began.
Previously exported volumes that have not been changed are not exported. For recovery, all exported physical volumes that still contain active data from a source TS7700 need to be included because not all of the logical volumes that are created are going to be on the last set exported.
•The primary copy of the logical volumes that is exported remains in the inventory of the TS7700 grid. Exported volumes are always copies of volumes still in the TS7700.
•Only those logical volumes that are assigned to the secondary pool that is specified in the export list volume that is resident on a physical volume of the pool or in the cache of the TS7700 performing the export operation are considered for export.
•Logical volumes to be exported that are resident only in the cache, and not mounted when the Copy Export operation is initiated, are copied to stacked volumes in the secondary pool as part of the Copy Export operation.
•Logical volumes compressed by new Compression Method (LZ4 or ZSTD) can be exported in the same manner as they could previously.
•If the logical volumes are assigned to CP0 in TS7700T, they are resident only and never copied to any physical volumes. Therefore, logical volumes in CP0 cannot be exported.
•Any logical volume that is assigned to the specified secondary pool in the TS7700 after the Copy Export operation is initiated is not part of the export, and is written to a physical volume in the pool but is not exported. This includes host-sourced and copy-sourced data.
•Logical volumes that are being mounted when the Copy Export operation is initiated cannot be exported.
•Only one Copy Export operation can be performed at a time.
•Only one secondary physical volume pool can be specified per export operation, and it must have been previously defined as a Copy Export pool.
•The export list volume cannot be assigned to the secondary pool that is specified for the operation. If it is, the Copy Export operation fails.
•During the execution of a Copy Export operation, if the TS7700 cannot access the primary copy and the secondary copy exists in a pool that is defined for the Copy Export, that secondary version is made inaccessible and the mount fails. This occurs regardless of whether that secondary pool is involved in the current Copy Export operation.
The library that is associated with the TS7700 running the Copy Export operation must have an I/O station feature for the operation to be accepted. Empty the I/O station before running Copy Export and prevent it from going to the full state.
•A minimum of four physical tape drives must be available to the TS7700 for the Copy Export operation to be performed. The operation is terminated by the TS7700 when fewer than four physical tape drives are available. In heterogeneous drive configurations, the operation is terminated when fewer than four 3592-E08 drives are available. Processing for the physical stacked volume in progress when the condition occurred is completed, and the export status file records reflect what was completed before the operation was terminated.
•Copy Export and the insertion of logical volumes are mutually exclusive functions in a TS7700 or grid.
•If a scratch physical volume is needed during a Copy Export operation, the secondary physical volume pool must have an available scratch volume or access to borrow one for the operation to continue. If a scratch volume is not available, the TS7700 indicates this through a console message, and waits for up to 60 minutes. If a scratch volume is not made available to the secondary physical volume pool within 60 minutes, the Copy Export operation is ended.
•During execution, if the TS7700 determines that a physical volume that is assigned to the specified secondary pool contains one or more primary logical volumes, that physical volume and any secondary logical volumes on it are excluded from the Copy Export operation.
•To minimize the number of physical volumes that are used for Copy Export, use the highest capacity media and physical drive format that is compatible with the recovery TS7700. You might also want to reduce the number of concurrent tape devices that the TS7700 uses when copying data from cache to the physical volumes in secondary pool used for Copy Export. You can change it using the Maximum Devices in Pool Properties in the MI.
•All copy-exported volumes that are exported from a source TS7700 must be placed in a library for recovery. The source TS7700 limits the number of physical volumes that can be Copy Exported. The default limit is 2000 per TS7700 to ensure that they all fit into the receiving library. This value can be adjusted to a maximum of 10,000 volumes by using Copy Export Settings in MI.
•The recovery TS7700 must have physical tape drives that can read the physical volumes from a source TS7700. If a source TS7700 writes the volumes by using the native E08 format, the recovery TS7700 must also have 3592-E08 drives running in native format mode. If a source TS7700 writes the JB volumes by using the native E07 format, the recovery TS7700 must also have 3592-E07 drives. If a source TS7700 writes the JC or JK volumes by using the native E07 format, the recovery TS7700 must have 3592-E07 or E08 drives.
If the exporting pool on the source TS7700 is set up to encrypt the data, the recovery TS7700 must also be set up to handle encrypted volumes and have access to the IBM Encryption Key Manager with replicated keys from the production site. If the source TS7700 writes the volumes in J1A or emulated J1A mode, the recovery TS7700 must have 3592-E07 or the previous generations 3592 model drives.
•An available service offering called Copy Export Merge allows a customer to merge data from more than one source TS7700 Copy Export backup. However, basically, the recovery TS7700 cannot contain any previous data, and a client-initiated recovery process cannot merge data from more than one source TS7700 together. As a part of the Copy Export Recovery, an option is provided to erase any previous data on the TS7700. This enables a TS7700 that is used for disaster recovery testing to be reused for testing of a different source TS7700’s data.
•For the secondary pool that is used for Copy Export, the designated reclaim pool must not be the same pool as the primary pool or its reclaim pool.
 
Note: If the reclaim pool for the Copy Export pool is the same as either the Copy Export primary pool or its reclaim pool, the primary and backup copies of a logical volume can exist on the same physical tape.
Table 12-1 shows the exportable physical volumes based on tape drives, export format, and the LMTDBPVL option.
Table 12-1 Exportable physical volumes based on tape drives, export format, and LMTDBPVL option
Installed tape drives
Export format of copy export pool
LMTDBPVL enabled?
Exportable physical volumes
E08 only
Default
Yes or no
JC/JK in E07 format and
JC/JK/JD/JL in E08 format
E08
JC/JK/JD/JL in E08 format
E07
JC/JK in E07 format
E08 and E07
Default
Yes
Any media types in any recording format
E08
JC/JK/JD/JL in E08 format
E07
JB/JC/JK in E07 format
Default
No
JB in E06 format,
JB/JC/JK in E07 format, and
JC/JK/JD/JL in E08 format
E08
JC/JK/JD/JL in E08 format
E07
JB/JC/JK in E07 format
E08 and E06
Default
Yes
JA/JJ in J1A format,
JA/JJ/JB in E05/E06 format,
JC/JK in E07 format, and
JC/JK/JD/JL in E08 format
E08
JC/JK/JD/JL in E08 format
E07
JC/JK in E07 format
Default
No
JA/JJ/JB in E05/E06 format,
JC/JK in E07 format, and
JC/JK/JD/JL in E08 format
E08
JC/JK/JD/JL in E08 format
E07
JC/JK in E07 format
E08 and E05
Default
Yes or no
JA/JJ in J1A format,
JA/JJ/JB in E05 format,
JC/JK in E07 format, and
JC/JK/JD/JL in E08 format
E08
JC/JK/JD/JL in E08 format
E07
JC/JK in E07 format
E08 and J1A
 
Default
Yes or no
JA/JJ in J1A format,
JC/JK in E07 format, and
JC/JK/JD/JL in E08 format
E08
JC/JK/JD/JL in E08 format
E07
JC/JK in E07 format
E07 only
Default
Yes or no
JB in E06 format and
JB/JC/JK in E07 format
E07
JB/JC/JK in E07 format
E06
JB in E06 format
E06 only
Default
Yes or no
JA/JJ/JB in E05/E06 format
E05 only
Default
Yes or no
JA/JJ in J1A format and
JA/JJ/JB in E05 format
J1A only
Default
Yes or no
JA/JJ in J1A format
12.1.4 Copy Export grid considerations
Copy Export is supported in both grid and stand-alone environments. You need to remember several considerations that are unique to the grid environment.
Performing Copy Export
The first consideration relates to performing Copy Export. In a grid configuration, a Copy Export operation is performed against an individual TS7700, not across all TS7700 clusters. Set up Copy Export in a grid plan based on the following guidelines:
•Decide which TS7700 in a grid configuration is going to be used to export a specific set of data. Although you can set up more than one TS7700 to export data, only the data from a single source TS7700 can be used in the recovery process. There is an available service offering called Copy Export Merge, but basically you cannot merge copy-exported volumes from more than one source TS7700 in the recovery TS7700.
•For each specific set of data to export, define an MC name. On the TS7700 that is used to export that data, define a secondary physical volume pool for that MC name and also ensure that you indicate that it is an export pool. Although you need to define the MC name on all TS7700s in the grid configuration, specify only the secondary physical volume pool on the one TS7700 that is to perform the export operation.
Specifying it on the other TS7700s in the grid configuration does not interfere with the Copy Export operation, but it is a waste of physical volumes. The exceptional useful case of this approach is if you want one of the TS7700s in the grid configuration to have a secondary copy of the data for the case the primary copies on other TS7700s are inaccessible.
•While you are defining the MC name for the data, ensure that the TS7700 to perform the Copy Export operation has a copy policy that specifies that it is to have a copy.
•If a logical volume is to be copied to the TS7700 that is performing the Copy Export operation and that copy had not yet completed when the export is initiated, it is not included in the current export operation.
•When the Copy Export operation is run, the export list volume must be valid only on the TS7700 that is performing the operation. You must define a unique MC name to be used for the export list volume. For that MC name, you must define its copy policy so that a copy is only on the TS7700 that is to perform the export operation. If the VOLSER that is specified for the export list volume when the export operation is initiated is on more than one TS7700, the Copy Export operation fails.
 
Tip: If the MC specified for export list volume is defined to have copies on more than one cluster, the Copy Export fails and the following CBR message is displayed:
CBR3726I FUNCTION INCOMPATIBLE ERROR CODE 32 FROM LIBRARY XXX FOR VOLUME xxxxxx.
 
X'32' There is more than one valid copy of the specified export list volume in the TS7700 grid configuration.
Consider this Copy Export example in 3-way grid environment:
a. A Copy Export with the export list volume EXP000 is initiated from a host that is connected to the C0, and the Copy Export runs on the C2.
b. The copy mode of EXP000 must be [N,N,D] or [N,N,R], indicating that the only copy of EXP000 exists on C2.
c. If Copy Policy Override is activated on the C0 and the Copy Export is initiated from the host that is attached to C0, a copy of EXP000 is created both on the C0 and C2.
d. The grid detects that a copy of EXP000 exists on two clusters (C0 and C2) and does not start the Copy Export.
e. Copy Export fails.
In the following example, assume that the TS7700 that is to perform the Copy Export operation is Cluster 1 in 2-way grid environment. The pool on that cluster to export is pool 8. You need to set up an MC for the data that is to be exported so that it has a copy on Cluster 1 and a secondary copy in pool 8. To ensure that the data is on that cluster and is consistent with the close of the logical volume, you want to have a copy policy of Rewind Unload (RUN). You define the following information:
•Define an MC, for example, MCCEDATA, on Cluster 1:
Secondary Pool 8
Cluster 0 Copy Policy RUN
Cluster 1 Copy Policy RUN
•Define this same MC on Cluster 0 without specifying a secondary pool.
•To ensure that the export list volume is written to Cluster 1 and exists only there, define an MC, for example, MCELFVOL, on Cluster 1:
Cluster 0 Copy Policy No Copy
Cluster 1 Copy Policy RUN
•Define this MC on Cluster 0:
Cluster 0 Copy Policy No Copy
Cluster 1 Copy Policy RUN
A Copy Export operation can be initiated through any virtual tape drive in the TS7700 grid configuration. It does not have to be initiated on a virtual drive address in the TS7700 that is to perform the Copy Export operation. The operation is internally routed to the TS7700 that has the valid copy of the specified export list volume. Operational and completion status is broadcast to all hosts attached to all of the TS7700s in the grid configuration.
It is assumed that Copy Export is performed regularly, and logical volumes whose copies were not complete when a Copy Export was initiated will be exported the next time that Copy Export is initiated. You can check the copy status of the logical volumes on the TS7700 that is to perform the Copy Export operation before initiating the operation by using the Volume Status function of the Bulk Volume Information Retrieval (BVIR) facility. You can then be sure that all critical volumes are exported during the operation.
Performing Copy Export Recovery
The next consideration relates to how Copy Export Recovery is performed. Although there is an available service offering called Copy Export Merge where a customer can merge data from more than one source TS7700 Copy Export backup, Copy Export Recovery is basically to a stand-alone empty TS7700. As part of a client-initiated recovery process, the recovery TS7700 processes all grid-related information in the database, converting it to look like a single TS7700. This conversion means that the recovery TS7700 has volume ownership of all volumes.
It is possible that one or more logical volumes might become inaccessible because they were modified on a TS7700 other than the one that performed the Copy Export operation, and the copy did not complete before the start of the operation. Each copy-exported physical volume remains under the management of the TS7700 from which it was exported.
Normally, you return the empty physical volumes to the library I/O station that associated with the source TS7700. They are then reused by that TS7700. If you want to move them to another TS7700, whether in the same grid configuration or another, consider two important points:
•Ensure that the VOLSER ranges you define for that TS7700 match the VOLSERs of the physical volumes that you want to move.
•Have the original TS7700 stop managing the copy-exported volumes by entering the following command from the host:
LIBRARY REQUEST,libname,COPYEXP,volser,DELETE
12.1.5 Reclaim process for Copy Export physical volumes
The physical volumes that are exported during a Copy Export operation continue to be managed by the source TS7700 regarding space management. As logical volumes that are resident on the exported physical volumes expire, are rewritten, or otherwise invalidated, the amount of valid data on a physical volume decreases until the physical volume becomes eligible for reclamation based on your provided criteria for its pool.
Figure 12-1 on page 744 shows how the Reclaim Threshold Percentage is set in Physical Volume Pool Properties. If the ratio between active data size and total bytes written to the physical volume is lower than the Reclaim Threshold Percentage, the physical volume becomes eligible for reclamation. The ratio between active data size and media capacity is not used for the comparison with Reclaim Threshold Percentage.
Exported physical volumes that are to be reclaimed are not brought back to the source TS7700 for processing. Instead, a new secondary copy of the remaining valid logical volumes is made by using the primary logical volume copy as a source. It is called Offsite Reclaim. Offsite Reclaim does not start while Copy Export is running, and follows Inhibit Reclaim Schedule. If there is more than one volume eligible for Offsite Reclaim, it tries to make the exported physical volumes EMPTY one by one in the ascending order of their active data size.
There is another kind of Offsite Reclaim called Priority Offsite Reclaim. It is Offsite Reclaim for user-specified exported physical volumes. Users can make an exported physical volume eligible for Priority Offsite Reclaim by issuing the following library request from the host: LIBRARY REQUEST,libname,COPYEXP,volser,RECLAIM. Priority Offsite Reclaim processing is the same as for normal Offsite Reclaim, but it runs in priority over normal Offsite Reclaim, and does not follow Inhibit Offsite Reclaim Schedule.
Figure 12-1 shows the Reclaim Threshold Percentage for a normal Offsite Reclaim.
Figure 12-1 Reclaim Threshold Percentage is set in Physical Volume Pool Properties
The next time that the Copy Export operation is performed, the physical volumes with the new copies are also exported. After the Copy Export completes, the physical volumes that were reclaimed (which are offsite) are no longer considered to have valid data (empty), and can be returned to the source TS7700 to be used as new scratch volumes.
 
Tip: If a physical volume is in Copy Export hold state and becomes empty, it is automatically moved back to the common scratch pool (or the defined reclamation pool) when the next Copy Export operation completes.
Monitoring for Copy Export data
The BVIR function can also be used to obtain a current list of exported physical volumes for a secondary pool. For each exported physical volume, information is available on the amount of active data that each cartridge contains.
12.1.6 Copy Export process messages
During the execution of the Copy Export operation, the TS7700 sends informational messages to its attached hosts. These messages are in the syslog and are shown in Table 12-2.
 
Note: All messages are prefaced with CBR3750I.
Table 12-2 SYSLOG messages from the library
Message description
Action needed
E0000 EXPORT OPERATION STARTED FOR EXPORT LIST VOLUME XXXXXX
This message is generated when the TS7700 begins the Copy Export operation.
None.
E0002 OPENING EXPORT LIST VOLUME XXXXXX FAILED
This message is generated when opening the export list volume failed during the Copy Export operation.
Check whether the export list volume or cache file system is in a bad state.
E0005 ALL EXPORT PROCESSING COMPLETED FOR EXPORT LIST VOLUME XXXXXX
This message is generated when the TS7700 completes an export operation.
None.
E0006 STACKED VOLUME YYYYYY FROM LLLLLLLL IN EXPORT-HOLD
This message is generated during Copy Export operations when an exported stacked volume ‘YYYYYY’ has been assigned to the export-hold category. The ‘LLLLLLLL’ field is replaced with the distributed library name of the TS7700 performing the export operation.
None.
E0006 STACKED VOLUME YYYYYY FROM LLLLLLLL IN EJECT
This message is generated during Copy Export operations when an exported stacked volume ‘YYYYYY’ has been assigned to the eject category at R3.1 or earlier code level. The physical volume is placed in the convenience I/O station. The ‘LLLLLLLL’ field is replaced with the distributed library name of the TS7700 performing the export operation.
Remove ejected volumes from the convenience I/O station.
E0006 STACKED VOLUME YYYYYY FROM LLLLLLLL QUEUED FOR EJECT
This message is generated during Copy Export operations when an exported stacked volume ‘YYYYYY’ has been assigned to the eject category at code level from R3.2 to R4.1.1. The physical volume is placed in the convenience I/O station. The ‘LLLLLLLL’ field is replaced with the distributed library name of the TS7700 performing the export operation.
Remove ejected volumes from the convenience I/O station.
E0006 STACKED VOLUME YYYYYY FROM LLLLLLLL IN EJECT-QUEUE
This message is generated during Copy Export operations when an exported stacked volume ‘YYYYYY’ has been assigned to the eject category at R4.1.2 or later code level. The physical volume is placed in the convenience I/O station. The ‘LLLLLLLL’ field is replaced with the distributed library name of the TS7700 performing the export operation.
Remove ejected volumes from the convenience I/O station.
E0013 EXPORT PROCESSING SUSPENDED, WAITING FOR SCRATCH VOLUME
This message is generated every 5 minutes when the TS7700 needs a scratch stacked volume to continue export processing and there are none available.
Make one or more physical scratch volumes available to the TS7700 performing the export operation. If the TS7700 does not get access to a scratch stacked volume in 60 minutes, the operation is ended.
E0014 EXPORT PROCESSING RESUMED, SCRATCH VOLUME MADE AVAILABLE
This message is generated when, after the export operation was suspended because no scratch stacked volumes were available, scratch stacked volumes are again available and the export operation can continue.
None.
E0015 EXPORT PROCESSING TERMINATED, WAITING FOR SCRATCH VOLUME
This message is generated when the TS7700 ends the export operation because scratch stacked volumes were not made available to the TS7700 within 60 minutes of the first E0013 message.
The operator must make more TS7700 stacked volumes available, perform an analysis of the export status file on the export list volume, and reissue the export operation.
E0016 COPYING LOGICAL EXPORT VOLUMES FROM CACHE TO STACKED VOLUMES
This message is generated when the TS7700 begins, and every 10 minutes during, the process of copying logical volumes that are only resident in the TVC to physical volumes in the specified secondary physical volume pool.
None.
E0017 COMPLETED COPY OF LOGICAL EXPORT VOLUMES TO STACKED VOLUMES
This message is generated when the TS7700 completes the copy of all needed logical volumes from cache to physical volumes in the specified secondary physical volume pool.
None.
E0018 EXPORT TERMINATED, EXCESSIVE TIME FOR COPY TO STACKED VOLUMES
The export process has been ended because one or more cache resident-only logical volumes that are needed for the export were unable to be copied to physical volumes in the specified secondary physical volume pool within a 10-hour period from the beginning of the export operation.
Call for IBM support.
E0019 EXPORT PROCESSING STARTED FOR POOL XX
This message is generated when the TS7700 export processing for the specified secondary physical volume pool XX.
None.
E0020 EXPORT PROCESSING COMPLETED FOR POOL XX
This message is generated when the TS7700 completes processing for the specified secondary physical volume pool XX.
None.
E0021 DB BACKUP WRITTEN TO STACKED VOLUMES, PVOL01, PVOL02, PVOL03, PVOL04
 
(Where PVOL01, PVOL02, PVOL03, and PVOL04 are the physical volumes to which the database backup was appended).
This message is generated if the Copy Export acceleration (LMTDBPVL) option was selected on the export.
None.
E0022 EXPORT RECOVERY STARTED
The export operation has been interrupted by a TS7700 error or a power off condition. When the TS7700 is restarted, it attempts recovery of the operation.
None.
E0023 EXPORT RECOVERY COMPLETED
The recovery attempt for interruption of an export operation has been completed.
Perform an analysis of the export status file on the export list volume and reissue the export operation, if necessary.
E0024 XXXXXX LOGICAL VOLUME WITH INVALID COPY ON LLLLLLLL
This message is generated when the TS7700 performing the export operation has determined that one or more (XXXXXX) logical volumes that are associated with the auxiliary storage pool that is specified in the export list file do not have a valid copy resident on the TS7700. The ‘LLLLLLLL’ field is replaced by the distributed library name of the TS7700 performing the export operation. The export operation continues with the valid copies.
When the export operation completes, perform an analysis of the export status file on the export list volume to determine the logical volumes that were not exported. Ensure that they have completed their copy operations and then perform another export operation.
E0025 PHYSICAL VOLUME XXXXXX NOT EXPORTED, PRIMARY COPY FOR YYYYYY UNAVAILABLE
This message is generated when the TS7700 detected a migrated-state logical volume ‘YYYYYY’ with an unavailable primary copy. The physical volume ‘XXXXXX’ on which the secondary copy of the logical volume ‘YYYYYY’ is stored was not exported.
This message is added at code level R1.7.
The logical volume and the physical volume will be eligible for the next Copy Export operation after the logical volume is mounted and unmounted from the host. An operator intervention is also posted.
E0026 DB BACKUP WRITTEN TO ALL OF STACKED VOLUMES
This message is generated when the Copy Export acceleration (LMTDBPVL) option is not selected.
None.
R0000 RECLAIM SUCCESSFUL FOR EXPORTED STACKED VOLUME YYYYYY
This message is generated when the TS7700 has successfully completed reclaim processing for an exported stacked volume that was exported during a previous copy export operation.
Note: A copy exported physical volume can become eligible for reclaim based on the reclaim policies that are defined for its secondary physical volume pool, or through the host console request command.
The exported physical volume no longer contains active data and can be returned from its offsite location for reuse. If it is placed in export-hold, it should be returned when the next copy export is completed.
When a stacked volume that is associated with a Copy Export operation is ejected from a library (placed in export-hold or is physically ejected from the library), you see status message E0006, which is sent by the library (see Table 12-2 on page 745). Removable Media Management (RMM) intercepts this message and performs one of these actions:
•If the stacked volume is predefined to RMM, RMM marks the volume as ejected or in-transit and sets the movement/store date that is associated with the stacked volume.
•If the stacked volume is not predefined to RMM and the STACKEDVOLUME(YES) option in RMM is specified, RMM automatically adds the stacked volume to its control data set (CDS).
To have DFSMSrmm policy management manage the retention and movement for volumes that are created by Copy Export processing, you must define one or more volume vital record specifications (VRSs). For example, assume that all Copy Exports are targeted to a range of volumes STE000 - STE999. You can define a VRS as shown in Example 12-1.
Example 12-1 VRS definition
RMM AS VOLUME(STE*) COUNT(99999) LOCATION(location)
As a result, all matching stacked volumes that are set in AUTOMOVE have their destination set to the required location, and your existing movement procedures can be used to move and track them.
In addition to the support listed, a copy-exported stacked volume can become eligible for reclamation based on the reclaim policies that are defined for its secondary physical volume pool or through the Host Console Request function (LIBRARY REQUEST). When it becomes eligible for reclamation, the exported stacked volume no longer contains active data and can be returned from its offsite location for reuse.
For users that use DFSMSrmm, when you have stacked volume support that is enabled, DFSMSrmm automatically handles and tracks the stacked volumes that are created by Copy Export. However, there is no way to track which logical volume copies are on the stacked volume. Retain the updated export list file, which you created and the library updated, so that you have a record of the logical volumes that were exported, and on what exported stacked volume they are.
For more information and error messages that are related to the Copy Export function in RMM, see the z/OS DFSMSrmm Implementation and Customization Guide, SC23-6874.
12.2 Implementing and running Copy Export
Implementing and running Copy Export are described. For more information and error messages that relate to the Copy Export function, see the IBM TS7700 Series Copy Export Function User’s Guide, which is available at:
12.2.1 Setting up data management definitions
To set up the data management definitions, perform the following steps:
1. Decide the MC construct name (or names).
As part of the plan for using the Copy Export function, you must decide on at least one MC construct name. A preferred practice is to make the name meaningful and relate to the type of data to be on the pool or the location where the data is sent.
For example, if the pool is used to send data to the primary disaster recovery site in Atlanta, a name like MCPRIATL can be used. “MC” indicates MC, “PRI” indicates that it is for the primary recovery site, and “ATL” indicates Atlanta. Up to an eight-character name can be defined.
2. Define the MC names to DFSMS.
After the MC names are selected, the names must be defined to DFSMS and to the TS7700. For details about defining the MC in DFSMS, see z/OS DFSMSdfp Storage Administration, SC23-6868.
None of the settings are used for system-managed tape. All settings that are associated with an MC name are defined through the TS7700, not the DFSMS windows.
3. Define the MC names to the TS7700.
You must also define the MC names on the TS7700 because you are not using the Default MC settings for Copy Export volumes. Define a Secondary Pool for the copies to be exported.
For details about how to add an MC, see “Management Classes window” on page 456.
4. Define the VOLSER ranges for the 3592 media.
You must define the VOLSER range (or ranges) for the physical volumes to use for Copy Export if you plan to use a specific VOLSER range. Ensure that you define the same pool that you used in the MC definition as the Home Pool for this VOLSER range.
 
Tip: For the physical volumes that you use for Copy Export, defining a specific VOLSER range to be associated with a secondary pool on a source TS7700 can simplify the task of knowing the volumes to use in recovery, and of returning a volume that no longer has active data on it to the TS7700 that manages it.
For details about how to define the VOLSER ranges, see “Defining VOLSER ranges for physical volumes” on page 539.
5. Define the characteristics of the physical volume pools used for Copy Export.
For the pool or pools that you plan to use for Copy Export and that you have specified previously in the MC definition, and, optionally, in the VOLSER range definition, select Copy Export in the Export Pool field.
For more information about how to change the physical volume pool properties, see “Defining physical volume pools in the TS7700T” on page 540.
6. Code or modify the MC automatic class selection (ACS) routine.
Add selection logic to the MC ACS routine to assign the new MC name, or names.
7. Activate the new construct names and ACS routines.
Before new allocations are assigned to the new MC, the Source Control Data Set (SCDS) with the new MC definitions and ACS routines must be activated by using the SETSMS SCDS command.
12.2.2 Validating before activating the Copy Export function
Before the logical volumes are exported, you must perform several general validations. Before you initiate the operation, check that the TS7700 has the required physical drives and scratch physical volume resources. Verify that the TS7700 is not near the limit of the number of physical volumes that can have a status of Copy Exported and modify the value, if required. Depending on your production environment, you might want to automate these validation steps.
Follow these validation steps:
1. Check whether data is in an older format. If you migrated from a B10 or B20 VTS to the TS7700 by using the outboard migration method, you might have data that is still in the older VTS format. The TS7700 cannot export data in the old format, so you must check whether any of the data to export was written with the old format.
2. Validate that the TS7700 has at least four available physical tape drives. You can use the Library Request host console command that specifies the PDRIVE request. This returns the status of all physical drives that are attached to the TS7700. If fewer than the required numbers of physical drives are available, you must call for service to repair drives before you perform the Copy Export operation.
See Example 12-2 for the output of the PDRIVE request. This command is only valid when run against a distributed library.
Example 12-2 Data that is returned by the PDRIVE request
LI REQ,BARR03A,PDRIVE
CBR1020I PROCESSING LIBRARY COMMAND: REQ,BARR03A,PDRIVE.
CBR1280I LIBRARY BARR03A REQUEST. 768
KEYWORDS: PDRIVE
---------------------------------------------------------------
PHYSICAL DRIVES V2 .1
SERIAL NUM TYPE MODE AVAIL ROLE POOL PVOL LVOL
0000078DAD6A 3592E07 Y IDLE 00
0000078DAD9B 3592E07 Y IDLE 00
0000078DBA58 3592E08 E08 Y MIGR 01 JD0402 SO0006
0000078DB88A 3592E08 E08 Y MIGR 02 JC0863 SO0102
0000078DB887 3592E08 Y IDLE 00
0000078DB89C 3592E08 Y IDLE 00
In the response that is shown in Example 12-2, you can see the following information:
 – Four E08 drives and two E07 drives are defined.
 – All nine drives are available (AVAIL=Y).
 – The ROLE column describes which drive is performing. The following values can
be indicated:
 • IDLE: The drive is not in use for another role or is not mounted.
 • SECE: The drive is being used to erase a physical volume.
 • MIGR: The drive is being used to copy a logical volume from the TVC to a physical volume. In this display, logical volume SO0006 is being copied to physical volume JD0402.
 • RECA: The drive is being used to recall a logical volume from a physical volume to the TVC.
 • RCLS: The drive is being used as the source of a reclaim operation.
 • RCLT: The drive is being used as the target of a reclaim operation.
3. Check that the pool to be exported has sufficient scratch physical volumes and that the TS7700 is under the volume limit for copy-exported volumes in all pools. The limit by default is a total of 2,000 volumes, but this limit can be modified in the SETTINGS option of the TS7000 MI with a maximum of 10,000 volumes. You can use the Library Request host console command that specifies the POOLCNT request. See Example 12-3 for the response to the LI REQ, <library-ID>, POOLCNT command.
Example 12-3 Data that is returned from the POOLCNT command
LI REQ,BARR68A,POOLCNT
CBR1020I PROCESSING LIBRARY COMMAND: REQ,BARR68A,POOLCNT.
CBR1280I LIBRARY BARR68A REQUEST. 919
KEYWORDS: POOLCNT
--------------------------------------------------------------------
PHYSICAL MEDIA COUNTS V2 .0
    POOL MEDIA EMPTY FILLING FULL ERASE ROR UNAVAIL CXPT
   0 JA 164
   0 JJ 38
   1 JA 2 6     12 0 0 1     0
   9    JJ 0 4     22      0 0 0    45
Pool 0 is the Common Scratch Pool. Pool 9 is the pool that is used for Copy Export in this example. Example 12-3 shows the command POOLCNT. The response is listed per pool:
 – The media type used for each pool
 – The number of empty physical volumes that are available for Scratch processing
 – The number of physical volumes in the filling state
 – The number of full volumes
 – The number of physical volumes that have been reclaimed, but need to be erased
 – The number of physical volumes in read-only recovery (ROR) state
 – The number of volumes unavailable or in a destroyed state (1 in Pool 1)
 – The number of physical volumes in the copy-exported state (45 in Pool 9)
Use the MI to modify the maximum-allowed number of volumes in the copy-exported state (Figure 12-2).
Figure 12-2 Maximum allowable number of volumes in copy-exported state
You must determine when you usually want to start the Copy Export operation. Thresholds might be the number of physical scratch volumes or other values that you define. These thresholds can even be automated by creating a program that interprets the output from the Library Request commands PDRIVE and POOLCNT, and acts based on the required numbers.
For more information about the Library Request command, see 10.1.3, “Host Console Request function” on page 588.
12.2.3 Running the Copy Export operation
To begin the Copy Export process, create an export list volume that provides the TS7700 with information about which data to export and the options to use during the operation (Figure 12-3 on page 754).
If you use a multi-cluster grid, be sure to create the export list volume only on the same TS7700 that is used for Copy Export, but not on the same physical volume pool that is used for Copy Export. If more than one TS7700 in a multi-cluster grid configuration contains the export list volume, the Copy Export operation fails.
Ensure that all volumes that are subject for copy export are in the TVC of the TS7700 where the copy export will be run. If there are copies from other clusters that have not been processed, you can promote them in the copy queue. Use a host console request (HCR) command with the COPY,KICK option to do so:
LI REQ,distributed library,LVOL,A08760,COPY,KICK
Complete these steps to run the Copy Export operation:
1. Create the export list volume JCL (Example 12-4).
Example 12-4 Sample JCL to create an export list volume of Pool 9
//****************************************
//* FILE 1: EXPORT LIST
//****************************************
//STEP1 EXEC PGM=IEBGENER
//SYSPRINT DD SYSOUT=*
//SYSIN DD DUMMY
//SYSUT2 DD DSN=HILEVELQ.EXPLIST,
// UNIT=VTS1,DISP=(NEW,KEEP),LABEL=(1,SL),
// VOL=(,RETAIN),
// DCB=(RECFM=FB,BLKSIZE=80,LRECL=80,TRTCH=NOCOMP)
//SYSUT1 DD *
EXPORT LIST 03
EXPORT PARAMETERS PHYSICAL POOL TO EXPORT:09
OPTIONS1,COPY,EJECT,LMTDBPVL
/*
//* Remove LMTDBPVL to not use accelerate
 
//****************************************
//* FILE 2: RESERVED FILE
//****************************************
//STEP2 EXEC PGM=IEBGENER,COND=(4,LT)
//SYSPRINT DD SYSOUT=*
//SYSIN DD DUMMY
//SYSUT2 DD DSN=HILEVELQ.RESERVED,MGMTCLAS=MCNOCOPY,
// UNIT=VTS1,DISP=(NEW,KEEP),LABEL=(2,SL),
// VOL=(,RETAIN,REF=*.STEP1.SYSUT2),
// DCB=*.STEP1.SYSUT2
//SYSUT1 DD *
RESERVED FILE
/*
//****************************************
//* FILE 3: EXPORT STATUS FILE
//****************************************
//STEP3 EXEC PGM=IEBGENER,COND=(4,LT)
//SYSPRINT DD SYSOUT=*
//SYSIN DD DUMMY
//SYSUT2 DD DSN=HILEVELQ.EXPSTATS,
// UNIT=VTS1,DISP=(NEW,CATLG),LABEL=(3,SL),
// VOL=(,,REF=*.STEP1.SYSUT2),
// DCB=*.STEP1.SYSUT2
//SYSUT1 DD *
EXPORT STATUS 01
/*
The information that is required in the export list file is, as for BVIR, provided by writing a logical volume that fulfills the following requirements:
 – That logical volume must have a standard label and contain three files:
 • An export list file, as created in step 1 in Example 12-4 on page 752. In this example, you are exporting Pool 09. Option EJECT in record 2 tells the TS7700 to eject the stacked volumes upon completion.
With only OPTIONS1,COPY (without EJECT), the physical volumes are placed in the export-hold category for later handling and left in the library by an operator.
 • A reserved file, as created in step 2 in Example 12-4 on page 752. This file is reserved for future use.
 • An export status file, as created in step 3 in Example 12-4 on page 752. In this file, the information is stored from the Copy Export operation. You must keep this file because it contains information related to the result of the Export process and must be reviewed carefully.
 – All records must be 80 bytes.
 – The export list file must be written without compression. Therefore, you must assign a Data Class (DC) that specifies COMPACTION=NO or you can overwrite the DC specification by coding TRTCH=NOCOMP in the JCL.
 
Important: Ensure that the files are assigned an MC that specifies that only the local TS7700 has a copy of the logical volume. You can either have the ACS routines assign this MC, or you can specify it in the JCL. These files need to have the same expiration dates as the longest of the logical volumes you export because they must be kept for reference.
Figure 12-3 shows the setting of an MC on the MI for the export list volume in a multi-cluster grid configuration. RN means one copy locally at RUN (R) and no copy (NN) on the other cluster.
Figure 12-3 Management Class settings for the export list volume
2. The Copy Export operation is initiated by running the LIBRARY EXPORT command. In this command, logical VOLSER is a variable, and is the logical volume that is used in creating the export list file.
The command syntax is shown in Example 12-5.
Example 12-5 Library export command
LIBRARY EXPORT,logical VOLSER
3. The host sends a command to the composite library. From there, it is routed to the TS7700 where the export list volume is.
4. The running TS7700 validates the request, checking for required resources, and if all is acceptable, the Copy Export continues.
5. Logical volumes that are related to the exported pool that still are only in cache can delay the process. They are copied to physical volumes in the pool as part of the Copy Export run.
6. Messages about the progress are sent to the system console. All messages are in the format that is shown in Example 12-6. See Table 12-2 on page 745 for an explanation of Library Message Text.
Example 12-6 Library message format
CBR3750I Message from library library-name: message text.
After a successful completion, all physical tapes that are related to the export pool are ejected if the EJECT option was specified. The operator can empty the I/O station and transport the tapes to another location.
To obtain a list of the virtual volumes that were exported during the COPY EXPORT operation, use the Physical Volumes Details selection in the MI. Specify the volume or volumes that were written to during the EXPORT. Those VOLSERs are listed in the CBR3750I messages on the syslog. Click Download List of Virtual Volumes.
Figure 12-4 shows the physical volume details.
Figure 12-4 Physical volume details selection for list of exported volumes
 
Note: The copy export can also be initiated through JCL using the CBRXLCS FUNC=EXPORT programming interface. See SAMPLE members CBRSPLCS and CBRSPX03, provided in SYS1.SAMPLIB, and documented in the OAM Planning, Installation, and Storage Administration Guide for Tape Libraries:
The same information is available in pdf format:
Sample member CBRSPX03, writes the three required files on the export list volume using a private volume and export list format 03 and has a 4th step (STEP4) that starts CBRSPLCS to initiate the copy export. CBRSPLCS is an example program that starts the CBRXLCS programming interface and would need to be modified to suit your business needs. When modified, it would need to be assembled and link-edited on your system, for it to be usable through JCL.
12.2.4 Canceling a Copy Export operation
Examine the export status file records to see what has been processed before the cancellation request. Any physical volumes that completed the export process must be processed as though the export operation had completed.
Many reasons exist for canceling a Copy Export operation:
•After initiating a Copy Export operation, you might realize that the pool being processed for export is incorrect.
•Other, more critical workloads must be run on the TS7700 and the extra effect of running the export operation is undesirable.
•A problem is encountered with the export that cannot be quickly resolved, for example, there are no physical scratch volumes available to add to the library.
•A problem is encountered with the library that requires it to be taken offline for service.
A request to cancel an export operation can be initiated from any host that is attached to the TS7700 subsystem by using one of the following methods:
•Use the host console command LIBRARY EXPORT,XXXXXX,CANCEL, where XXXXXX is the volume serial number of the export list volume.
•Use the Program Interface of the Library Control System (LCS) external services CBRXLCS.
If an export operation must be canceled and there is no host that is attached to the TS7700 that can run the CANCEL command, you can cancel the operation through the TS7700 MI. After confirming the selection, a cancel request is sent to the TS7700 that is processing the Copy Export operation.
Regardless of whether the cancellation originates from a host or the MI, the TS7700 can process it in the following manner:
•If the processing of a physical volume has reached the point where it has been mounted to receive a database backup, the backup completes and the volume is placed in the export-hold or eject category before the cancel processing can continue. The export status file records are written for all logical and physical volumes that completed export processing.
•All physical resources (drives, stacked volumes, and exported stacked volumes) are made available for normal TS7700 subsystem processing.
•A completion message is sent to all hosts that are attached to the TS7700 indicating that the export was canceled by a host request. The message contains information about how much export processing completed before the execution of the cancellation request.
12.2.5 Host completion message
At the completion of the Copy Export operation, a completion message is broadcast to all hosts that are attached to the TS7700. For z/OS, console messages are generated that provide information about the overall execution status of the operation.
Messages differ depending on what the TS7700 encountered during the execution of the operation:
•If no errors or exceptions were encountered during the operation, message CBR3855I is generated. The message has the format that is shown in Example 12-7.
Example 12-7 CBR3855I message format
CBR3855I Export operation for logical list volume ‘volser’ in library ‘library-name’ completed successfully. Requested: ‘requested-number’ Exportable: ‘exportable-number’ Exported: ‘exported-number’ Stacked volumes: ‘stacked-number’ MBytes Exported: ‘MBytes-exported’ MBytes Moved: ‘MBytes-moved’
•If error or exceptions were encountered during the operation, message CBR3856I is generated. The message has the format that is shown in Example 12-8.
Example 12-8 CBR3856I message format
CBR3856I Export operation for logical list volume ‘volser’ in library ‘library-name’ completed with exceptions or errors. Requested: ‘requested-number’ Exportable: ‘exportable-number’ Exported: ‘exported-number’ Stacked volumes: ‘stacked-number’ MBytes Exported: ‘MBytes-exported’ MBytes Moved: ‘MBytes-moved’
If message CBR3856I is generated, examine the export status file to determine what errors or exceptions were encountered.
Either of the completion messages provides statistics about what was processed during the operation. The following statistics are reported:
•Requested-number: This is the number of logical volumes that are associated with the secondary volume pool that is specified in the export list file. Logical volumes that are associated with the specified secondary volume pool that were previously exported are not considered part of this count.
•Exportable-number: This is the number of logical volumes that are considered exportable. A logical volume is exportable if it is associated with the secondary volume pool that is specified in the export list file and it has a valid copy on the TS7700 performing the export. Logical volumes that are associated with the specified secondary volume pool that were previously exported are not considered to be resident in the TS7700.
•Exported-number: This is the number of logical volumes that were successfully exported.
•Stacked-number: This is the number of physical volumes that were successfully exported.
•MBytes Exported: This is the number of MB contained in the logical volumes that were successfully exported. If the data on the logical volumes is compressed, the number includes the effect of compression.
 
Clarification: The number of megabytes (MB) exported is the sum of the MB integer values of the data that is stored on each Exported Stacked Volume. The MB integer value for each Exported Stacked Volume is the full count by bytes divided by 1,048,576 bytes. If the result is less than 1, the MB integer becomes 1, and if greater than 1 MB, the result is truncated to the integer value (rounded down).
•MBytes Moved: For Copy Export at code release level R1.4 and later, this value is 0.
It is possible that multiple physical cartridges are written to during the COPY EXPORT even if a small amount of data was exported. This effect is primarily due to the optimization of the operation by using multiple available drives that are configured by Maximum Devices in Pool Properties in the MI for the Copy Export pool.
12.3 Using Copy Export Recovery
The recovery process can be done in a test mode for DR testing purposes. This enables a test restore without compromising the contents of the Copy Export sets. This section provides an example of how to use a Copy Export Recovery process.
 
Consideration: Clients can run a Copy Export Recovery process only in a stand-alone cluster. After the recovery process completes, you can create a multi-cluster grid by joining the grid with another stand-alone cluster. However, there is an IBM service offering to recover to an existing grid.
The following instructions for how to implement and run Copy Export Recovery also apply if you are running a DR test. If it is a test, it is specified in each step.
12.3.1 Planning and considerations for testing Copy Export Recovery
You must consider several factors when you prepare a recovery TS7700 for the Copy Export volumes. Copy Export Recovery can be run in various ways. The planning considerations for Copy Export Recovery are described.
Copy Export Recovery can be used to restore previously created and copy-exported tapes to a new, empty TS7700 cluster. The same subset of tapes can be used to restore a TS7700 in an existing grid if the new empty restore cluster replaces the source cluster that is no longer present.
This enables data that might have existed only within a TS7740 or TS7700T in a hybrid configuration to be restored while maintaining access to the still existing TS7720 clusters. This form of extended recovery must be carried out by IBM support personnel.
Client-initiated Copy Export Recovery
Client-initiated recovery restores copy-exported tapes to a stand-alone TS7700 for DR testing or as a recovery site. The considerations for Copy Export Recovery to a stand-alone TS7700 cluster, which can be prepared in advance, are described. The TS7700 and associated library that are to be used for recovery of the copy-exported logical volumes must meet the following requirements:
•The recovery TS7700 must have physical tape drives that match the capabilities of the source TS7700, including encryption capability if the copy-exported physical volumes are encrypted.
•If the source copy-exported volumes are encrypted, the recovery TS7700 must have access to a key manager that has the EKs for the data.
•There must be enough library storage slots in the library that is associated with the recovery TS7700 to hold all of the copy-exported physical volumes from the source TS7700.
•Only the copy-exported volumes from a single source TS7700 can be used in the recovery process.
•The recovery TS7700 cannot be part of a grid configuration.
•The recovery TS7700 must be configured as Cluster 0.
•The recovery TS7700 and its associated MI must be configured, have code that is loaded, and be in an online state to start the recovery.
•The code levels on the recovery TS7700 must be at the same or later code level as the source TS7700.
•Because the code levels on the recovery TS7700 must be at the same or later code level as the source TS7700, you do not need to care about whether logical volumes on copy-exported physical volumes are compressed by new Compression Method (LZ4 or ZSTD) or not. The recovery TS7700 must be able to read compressed logical volumes.
•If the recovery TS7700 is not empty of data (in the cache or the database), the Copy Export volumes must not be loaded into the attached library until the system is emptied of data.
•If another TS7700 or native drives are on another partition of the TS3500 Tape Library, the other partition must not have any VOLSERs that overlap with the VOLSERs to be recovered (including both logical and physical volumes). If any conflicts are encountered during the recovery process, the following results occur:
 – The VOLSERs that conflict cannot be recovered.
 – A warning message is displayed in the recovery status window on the recovery TS7700 MI.
 – You cannot use the same library for both the source and recovery TS7700.
•Other than the physical drive compatibility requirements listed, the source and recovery TS7700 can have different configuration features, such as different cache capabilities and performance enablement features.
•You must add scratch physical volumes to the recovery TS7700 even if you are going to be only reading data. A minimum of two scratch volumes per defined pool in the recovery TS7700 are needed to prevent the recovery TS7700 from entering the out-of-scratch state. In the out-of-scratch state, logical volume mounts are not allowed.
When adding scratch physical volumes to the recovery TS7700, do so only after the recovery has been run and the recovery TS7700 is ready to be brought online to its attached hosts. Otherwise, their inventory records are erased during the recovery process.
Physical volumes that are part of the Copy Export set and are now empty cannot be counted as scratch. After the Copy Export Recovery is complete, and the recovery TS7700 is online to its hosts, you must insert logical volumes to be used as scratch volumes before you can write new data.
•If the recovery is for a real disaster (rather than only a test), verify that the actions that are defined for the storage management constructs that were restored during the recovery are the actions that you want to continue to use.
12.3.2 Performing Copy Export Recovery
Perform the following steps:
1. With the TS7700 and library in an online state, log in to the MI and select Service → Copy Export Recovery.
You see only the Copy Export Recovery menu item if you have been given Administrator-level or Manager-level access by the overall system administrator on the TS7700. The Copy Export Recovery menu item is not displayed if the TS7700 is configured in a grid configuration. Contact your IBM Service Support Representative
(IBM SSR) if you must recover a TS7700 that is a member of a grid.
2. If the TS7700 determines that data or database entries exist in the cache, Copy Export Recovery cannot be performed until the TS7700 is empty.
Figure 12-5 shows the window that opens to inform you that the TS7700 contains data that must be erased.
Figure 12-5 Copy Export Recovery window with erase volume option
3. Ensure that you are logged in to the correct TS7700. Then, select Erase all existing volumes before the recovery and click Submit. A window opens that provides you with the option to confirm and continue the erasure of data on the recovery TS7700 or to abandon the recovery process. It describes the data records that are going to be erased and informs you of the next action to be taken.
To erase the data, enter your login password and click Yes. The TS7700 begins the process of erasing the data and all database records. As part of this step, you are logged off from the MI.
4. After waiting about 1 minute, log in to the MI. Select Settings → Copy Export Recovery Status to follow the progress of the Copy Export Recovery.
The following tasks are listed in the task detail window as the erasure steps are being performed:
a. Taking the TS7700 offline.
b. The existing data in the TS7700 database is being removed.
c. The existing data in the TS7700 cache is being removed.
d. Cleanup (removal) of existing data.
e. Requesting the TS7700 go online.
f. Copy Export Recovery database cleanup is complete. After the erasure process is complete, the TS7700 returns to its online state.
 
Note: If an error occurs during the erasure process, the task detail window provides a list of errors that occurred and indicates the reason and any action that needs to be taken.
5. Starting with an empty TS7700, you must perform several setup tasks by using the MI that is associated with the recovery TS7700. For many of these tasks, you might have to verify only that the settings are correct because the settings are not deleted as part of the erasure step:
a. Verify or define the VOLSER range or ranges for the physical volumes that are to be used for and after the recovery. The recovery TS7700 must know the VOLSER ranges that it owns. This step is done through the MI that is associated with the recovery TS7700.
b. If the copy-exported physical volumes were encrypted, set up the recovery TS7700 for encryption support and have it connected to an external key manager that has access to the keys used to encrypt the physical volumes. If you write data to the recovery TS7700, you must also define the pools to be encrypted and set up their key label or labels or define to use default keys.
c. If you are running the Copy Export Recovery operations to be used as a test of your disaster recovery plans and have kept the Disaster Recovery Test Mode check box selected, the recovery TS7700 does not perform reclamation.
If you are running Copy Export Recovery because of a real disaster, verify or define the reclamation policies through the MI.
6. With the TS7700 in its online state, but with all virtual tape drives varied offline to any attached hosts, log in to the MI and select Service → Copy Export Recovery.
The TS7700 determines that it is empty and enables the operation to proceed. Load the copy-exported physical volumes into the library. Multiple sets of physical volumes have likely been exported from the source TS7700 over time. All of the exported stacked volumes from the source TS7700 must be loaded into the library. If multiple pools were exported and you want to recover with the volumes from these pools, load all sets of the volumes from these pools.
 
Important:
•Before continuing the recovery process, be sure that all of the copy-exported physical volumes have been added. Any volumes that are not known to the TS7700 when the recovery process continues will not be included, and can lead to errors or problems. You can use the Physical Volume Search window from the MI to verify that all inserted physical volumes are known to the TS7700.
•Do not add any physical scratch cartridges now. You can do that after the Copy Export Recovery operation has completed and you are ready to bring the recovery TS7700 online to the hosts.
7. After you add all of the physical volumes into the library and they are now known to the TS7700, enter the volume serial number of one of the copy-exported volumes from the last set that was exported from the source TS7700. It contains the last database backup copy, which is used to restore the recovery TS7700 database. The easiest place to find a volume to enter is from the export status file on the export list volume from the current Copy Export operation.
 
Remember: If you specified the LMTDBPVL option when performing the export, only a subset of the tapes that were exported have a valid database backup that can be used for recovery. If a tape that is selected for recovery does not have the backup, the user gets the following error: “The database backup could not be found on the specified recovery volume”.
If you are using the Copy Export Recovery operation to perform a disaster recovery test, keep the Disaster Recovery Test Mode check box selected. The normal behavior of the TS7700 storage management function, when a logical volume in the cache is unloaded, is to examine the definitions of the storage management constructs associated with the volume. If the volume was written to while it was mounted, the actions defined by the storage management constructs are taken.
If the volume was not modified, actions are only taken if there has been a change in the definition of the storage management constructs since the last time that the volume was unloaded. For example, suppose that a logical volume is assigned to an SG, which had last had the volume written to pool 4. Furthermore, either the SG was not explicitly defined on the recovery TS7700 or it specified a different pool.
In this case, on the unload of the volume, a new copy of it is written to the pool determined by the new SG definition, even though the volume was only read. If you are merely accessing the data on the recovery TS7700 for a test, you do not want the TS7700 to recopy the data. Keeping the check box selected causes the TS7700 to bypass its checking for a change in storage management constructs.
Another consideration with merely running a test is reclamation. Running reclamation while performing a test will require scratch physical volumes and enable the copy-exported volumes to being reused after they are reclaimed. By keeping the Disaster Recovery Test Mode check box selected, the reclaim operation is not performed.
With the Disaster Recovery Test Mode check box selected, the physical volumes that are used for recovery maintain their status of Copy Exported so that they cannot be reused or used in a subsequent Copy Export operation. If you are using Copy Export Recovery because of a real disaster, clear the check box.
Enter the volume serial number, select the check box, and then click Submit.
8. A window opens and indicates the volume that will be used to restore the database. If you want to continue with the recovery process, click Yes. To abandon the recovery process, click No.
9. The TS7700 begins the recovery process. As part of this step, you are logged off from the MI.
10. After waiting about 1 minute, log in to the MI and select Settings → Copy Export Recovery Status to follow the progress of the recovery process.
The window provides information about the process, including the total number of steps required, the current step, when the operation was initiated, the run duration, and the overall status.
The following tasks are listed in the task detail window as the Copy Export Recovery steps are performed:
a. The TS7700 is taken offline.
b. The requested recovery tape XXXXXX is being mounted on device YYY.
c. The database backup is being retrieved from the specified recovery tape XXXXXX.
d. The requested recovery tape is being unmounted following the retrieval of the database backup.
e. The database backup that is retrieved from tape is being restored on the TS7700.
f. The restored database is being updated for this hardware.
g. The restored database volumes are being filtered to contain the set of logical volumes that were Copy Exported.
h. Token ownership is being set to this cluster from the previous cluster.
i. The restored database is being reconciled with the contents of cache, XX of YY complete.
j. Logical volumes are being restored on the Library Manager, XX of YY complete.
k. Copy Export Recovery is complete.
l. Copy Export Recovery from physical volume XXXXXX.
m. The request is made for the TS7700 to go online.
n. The recovered data is loaded into the active database.
o. The process is in progress.
After the Copy Export Recovery process completes successfully, the MI returns to its full selection of tasks.
11. Now, add scratch physical volumes to the library. At least two scratch volumes are required for each active pool. Define the VOLSER range (or ranges) for the physical scratch volumes that are to be used for and after the recovery. The recovery TS7700 must know the VOLSER ranges that it owns. The steps are described in“Defining VOLSER ranges for physical volumes” on page 539.
12. If you ran Copy Export Recovery because of a real disaster (you cleared the Disaster Recovery Test Mode check box), verify that the defined storage management construct actions will manage the logical and physical volumes in the manner that is needed.
During Copy Export Recovery, the storage management constructs and their actions are restored to the storage management constructs, and their actions are defined on the source TS7700. If you want the actions to be different, change them through the MI that is associated with the recovery TS7700.
You can now view the completed results of the Copy Export Recovery in Figure 12-6.
Figure 12-6 Copy Export Recovery Status
If an error occurs, various possible error texts with detailed error descriptions can help you solve the problem. For more information and error messages that are related to the Copy Export Recovery function, see the IBM TS7700 Series Copy Export Function User’s Guide white paper, which is available at the following URL:
If everything is completed, you can vary the virtual devices online, and the tapes are ready to read.
 
Tip: For more general considerations about DR testing, see Chapter 5, “Disaster recovery” on page 201.
12.3.3 Restoring the host and library environments
Before you can use the recovered logical volumes, you must restore the host environment also. The following steps are the minimum steps that you need to continue the recovery process of your applications:
1. Restore the tape management system (TMS) CDS.
2. Restore the DFSMS data catalogs, including the tape configuration database (TCDB).
3. Define the I/O gen by using the Library ID of the recovery TS7700.
4. Update the library definitions in the source SCDS with the Library IDs for the recovery TS7700 in the composite library and distributed library definition windows.
5. Activate the I/O gen and the SCDS.
You might also want to update the library nicknames that are defined through the MI for the grid and cluster to match the library names defined to DFSMS. That way, the names that are shown on the MI windows match those names that are used at the host for the composite library and distributed library.
To set up the composite name that is used by the host to be the grid name, complete the following steps:
1. Select Configuration → Grid Identification Properties.
2. In the window that opens, enter the composite library name that is used by the host in the grid nickname field.
3. You can optionally provide a description.
Similarly, to set up the distributed name, complete the following steps:
1. Select Configuration → Cluster Identification Properties.
2. In the window that opens, enter the distributed library name that is used by the host in the Cluster nickname field.
3. You can optionally provide a description.
These names can be updated at any time.
..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.19.75.133