0%

This IBM® Redbooks® publication helps you with the planning, installation, and configuration of the new IBM Spectrum® Archive Enterprise Edition (EE) Version 1.3.1.2 for the IBM TS4500, IBM TS3500, IBM TS4300, and IBM TS3310 tape libraries. IBM Spectrum Archive Enterprise Edition enables the use of the LTFS for the policy management of tape as a storage tier in an IBM Spectrum Scale based environment. It helps encourage the use of tape as a critical tier in the storage environment. This is the ninth edition of IBM Spectrum Archive Installation and Configuration Guide.

IBM Spectrum Archive EE can run any application that is designed for disk files on a physical tape media. IBM Spectrum Archive EE supports the IBM Linear Tape-Open (LTO) Ultrium 8, 7, 6, and 5 tape drives in IBM® TS3310, TS3500, TS4300, and TS4500 tape libraries. In addition, IBM TS1160, TS1155, TS1150, and TS1140 tape drives are supported in TS3500 and TS4500 tape library configurations.

IBM Spectrum Archive EE can play a major role in reducing the cost of storage for data that does not need the access performance of primary disk. The use of IBM Spectrum Archive EE to replace disks with physical tape in tier 2 and tier 3 storage can improve data access over other storage solutions because it improves efficiency and streamlines management for files on tape. IBM Spectrum Archive EE simplifies the use of tape by making it transparent to the user and manageable by the administrator under a single infrastructure.

This publication is intended for anyone who wants to understand more about IBM Spectrum Archive EE planning and implementation. This book is suitable for IBM customers, IBM Business Partners, IBM specialist sales representatives, and technical specialists.

Table of Contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. Authors
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Summary of changes
    1. June 2021, Ninth Edition Version 1.3.1.2
    2. February 2020, Eighth Edition Version 1.3.0.6
    3. April 2019, Seventh Edition Version 1.3.0
    4. June 2018, Sixth Edition Version 1.2.6
    5. January 2018, Fifth Edition Version 1.2.5.1
    6. August 2017, Fourth Edition Version 1.2.4
    7. February 2017, Third Edition Version 1.2.2 minor update
    8. January 2017, Third Edition Version 1.2.2
    9. August 2016, Second Edition Version 1.2.1
    10. June 2016, First Edition, Version 1.2
    11. January 2015, Third Edition Version 1.1.1.2
    12. November 2014, Second Edition Version 1.1.1.1
  5. Chapter 1. IBM Spectrum Archive Enterprise Edition
    1. 1.1 Introduction
    2. 1.1.1 Operational storage
    3. 1.1.2 Active archive
    4. 1.2 IBM Spectrum Archive EE functions
    5. 1.2.1 User Task Reporting
    6. 1.3 IBM Spectrum Archive EE components
    7. 1.3.1 IBM Spectrum Archive EE terms
    8. 1.3.2 Hierarchical Storage Manager
    9. 1.3.3 Multi-Tape Management Module
    10. 1.3.4 IBM Spectrum Archive Library Edition component
    11. 1.4 IBM Spectrum Archive EE cluster configuration introduction
  6. Chapter 2. IBM Spectrum Archive overview
    1. 2.1 Introduction to IBM Spectrum Archive and LTFS
    2. 2.1.1 Tape media capacity with IBM Spectrum Archive
    3. 2.1.2 Comparison of the IBM Spectrum Archive products
    4. 2.1.3 IBM Spectrum Archive Single Drive Edition
    5. 2.1.4 IBM Spectrum Archive Library Edition
    6. 2.1.5 IBM Spectrum Archive Enterprise Edition
    7. 2.2 IBM Spectrum Scale
    8. 2.2.1 Overview
    9. 2.2.2 Storage pools
    10. 2.2.3 Policies and policy rules
    11. 2.2.4 Migration or premigration
    12. 2.2.5 Active File Management
    13. 2.3 OpenStack SwiftHLM
    14. 2.4 IBM Spectrum Archive EE dashboard
    15. 2.5 IBM Spectrum Archive EE REST API
    16. 2.6 Types of archiving
  7. Chapter 3. Planning
    1. 3.1 IBM Spectrum Archive EE deployment options
    2. 3.1.1 On IBM Spectrum Scale Servers
    3. 3.1.2 As an IBM Spectrum Scale Client
    4. 3.1.3 As an IBM Elastic Storage Systems IBM Spectrum Scale Client
    5. 3.1.4 As an IBM Spectrum Scale stretched cluster
    6. 3.2 Data-access methods
    7. 3.2.1 Data access using application or users on IBM Spectrum Scale Clients
    8. 3.2.2 Data access using Protocol Nodes on IBM Spectrum Scale Server Nodes with IBM Spectrum Archive EE
    9. 3.2.3 Data access using Protocol Nodes integrated with the IBM ESS
    10. 3.3 System requirements
    11. 3.3.1 Limitations
    12. 3.4 Required software
    13. 3.5 Hardware and software setup
    14. 3.6 IBM Spectrum Archive deployment examples
    15. 3.6.1 Deploying on Lenovo servers
    16. 3.6.2 Deploying on Versastack converged infrastructure
    17. 3.7 Sizing and settings
    18. 3.7.1 Redundant copies
    19. 3.7.2 IBM Spectrum Archive EE Sizing Tool
    20. 3.7.3 Performance
    21. 3.7.4 Ports that are used by IBM Spectrum Archive EE
  8. Chapter 4. Installation
    1. 4.1 Installing IBM Spectrum Archive EE on a Linux system
    2. 4.2 Installation prerequisites for IBM Spectrum Archive EE
    3. 4.2.1 Installing the host bus adapter and device driver
    4. 4.3 Installing IBM Spectrum Archive EE
    5. 4.3.1 Extracting binary rpm files from an installation package
    6. 4.3.2 Installing, upgrading, or uninstalling IBM Spectrum Archive EE
    7. 4.4 Installing a RESTful server
    8. 4.5 Quick installation guide for IBM Spectrum Archive EE
    9. 4.6 Library replacement
    10. 4.6.1 Library replacement procedure
    11. 4.6.2 Pool relocation procedure
  9. Chapter 5. Configuration
    1. 5.1 Configuration prerequisites
    2. 5.1.1 Configuration worksheet tables
    3. 5.1.2 Obtaining configuration information
    4. 5.1.3 Configuring key-based login with OpenSSH
    5. 5.1.4 Preparing the IBM Spectrum Scale file system for IBM Spectrum Archive EE
    6. 5.2 Configuring IBM Spectrum Archive EE
    7. 5.2.1 The ltfsee_config utility
    8. 5.2.2 Configuring a single node cluster
    9. 5.2.3 Configuring a multiple-node cluster
    10. 5.2.4 Configuring a multiple-node cluster with two tape libraries
    11. 5.2.5 Modifying a multiple-node configuration for control node redundancy
    12. 5.3 First-time start of IBM Spectrum Archive EE
    13. 5.3.1 Configuring a Centralized Archive Repository solution
    14. 5.3.2 Configuring an Asynchronous Archive Replication solution
  10. Chapter 6. Operations
    1. 6.1 Overview
    2. 6.1.1 IBM Spectrum Archive EE command summaries
    3. 6.1.2 Using the command-line interface
    4. 6.2 Status information
    5. 6.2.1 IBM Spectrum Scale
    6. 6.2.2 IBM Spectrum Archive Library Edition component
    7. 6.2.3 Hierarchical Space Management
    8. 6.2.4 IBM Spectrum Archive EE
    9. 6.3 Upgrading components
    10. 6.3.1 IBM Spectrum Scale
    11. 6.3.2 IBM Spectrum Archive LE component
    12. 6.3.3 Hierarchical Storage Management
    13. 6.3.4 IBM Spectrum Archive EE
    14. 6.4 Starting and stopping IBM Spectrum Archive EE
    15. 6.4.1 Starting IBM Spectrum Archive EE
    16. 6.4.2 Stopping IBM Spectrum Archive EE
    17. 6.5 Task command summaries
    18. 6.5.1 eeadm task list
    19. 6.5.2 eeadm task show
    20. 6.6 IBM Spectrum Archive EE database backup
    21. 6.7 IBM Spectrum Archive EE automatic node failover
    22. 6.7.1 IBM Spectrum Archive EE monitoring daemon
    23. 6.8 Tape library management
    24. 6.8.1 Adding tape cartridges
    25. 6.8.2 Moving tape cartridges
    26. 6.8.3 Formatting tape cartridges
    27. 6.8.4 Removing tape drives
    28. 6.8.5 Adding tape drives
    29. 6.9 Tape storage pool management
    30. 6.9.1 Creating tape cartridge pools
    31. 6.9.2 Deleting tape cartridge pools
    32. 6.10 Pool capacity monitoring
    33. 6.11 Migration
    34. 6.11.1 Managing file migration pools
    35. 6.11.2 Threshold-based migration
    36. 6.11.3 Manual migration
    37. 6.11.4 Replicas and redundant copies
    38. 6.11.5 Data Migration
    39. 6.11.6 Migration hints and tips
    40. 6.12 Premigration
    41. 6.12.1 Premigration with the eeadm premigrate command
    42. 6.12.2 Premigration running the mmapplypolicy command
    43. 6.13 Preserving file system objects on tape
    44. 6.13.1 Saving file system objects with the eeadm save command
    45. 6.13.2 Saving file system objects with policies
    46. 6.14 Recall
    47. 6.14.1 Transparent recall
    48. 6.14.2 Selective recall using the eeadm recall command
    49. 6.14.3 Read Starts Recalls: Early trigger for recalling a migrated file
    50. 6.15 Recalling files to their resident state
    51. 6.16 Reconciliation
    52. 6.17 Reclamation
    53. 6.17.1 Reclamation considerations
    54. 6.18 Checking and repairing tapes
    55. 6.19 Importing and exporting
    56. 6.19.1 Importing
    57. 6.19.2 Exporting tape cartridges
    58. 6.19.3 Offlining tape cartridges
    59. 6.20 Drive Role settings for task assignment control
    60. 6.21 Tape drive intermix support
    61. 6.21.1 Objective for WORM tape support
    62. 6.21.2 Function overview for WORM tape support
    63. 6.21.3 The effects of file operations on immutable and appendOnly files
    64. 6.22 Obtaining the location of files and data
    65. 6.23 Obtaining system resources, and tasks information
    66. 6.24 Monitoring the system with SNMP
    67. 6.25 Configuring Net-SNMP
    68. 6.25.1 Starting and stopping the snmpd daemon
    69. 6.25.2 Example of an SNMP trap
    70. 6.26 IBM Spectrum Archive REST API
    71. 6.26.1 Pools endpoint
    72. 6.26.2 Tapes endpoint
    73. 6.26.3 Libraries endpoint
    74. 6.26.4 Nodegroups endpoint
    75. 6.26.5 Nodes endpoint
    76. 6.26.6 Drives endpoint
    77. 6.26.7 Task endpoint
  11. Chapter 7. Hints, tips, and preferred practices
    1. 7.1 Preventing migration of the .SPACEMAN and metadata directories
    2. 7.2 Maximizing migration performance with redundant copies
    3. 7.3 Changing the SSH daemon settings
    4. 7.4 Setting mmapplypolicy options for increased performance
    5. 7.5 Preferred inode size for IBM Spectrum Scale file systems
    6. 7.6 Determining the file states for all files within the GPFS file system
    7. 7.7 Memory considerations on the GPFS file system for increased performance
    8. 7.8 Increasing the default maximum number of inodes in IBM Spectrum Scale
    9. 7.9 Configuring IBM Spectrum Scale settings for performance improvement
    10. 7.10 Real world use cases for mmapplypolicy
    11. 7.10.1 Creating a traditional archive system policy
    12. 7.10.2 Creating active archive system policies
    13. 7.10.3 IBM Spectrum Archive EE migration policy with AFM
    14. 7.11 Capturing a core file on Red Hat Enterprise Linux with the Automatic Bug Reporting Tool
    15. 7.12 Antivirus considerations
    16. 7.13 Automatic email notification with rsyslog
    17. 7.14 Overlapping IBM Spectrum Scale policy rules
    18. 7.15 Storage pool assignment
    19. 7.16 Tape cartridge removal
    20. 7.16.1 Reclaiming tape cartridges before you remove or export them
    21. 7.16.2 Exporting tape cartridges before physically removing them from the library
    22. 7.17 Reusing LTFS formatted tape cartridges
    23. 7.17.1 Reformatting LTFS tape cartridges through eeadm commands
    24. 7.18 Reusing non-LTFS tape cartridges
    25. 7.19 Moving tape cartridges between pools
    26. 7.19.1 Avoiding changing assignments for tape cartridges that contain files
    27. 7.19.2 Reclaiming a tape cartridge and changing its assignment
    28. 7.20 Offline tape cartridges
    29. 7.20.1 Do not modify the files of offline tape cartridges
    30. 7.20.2 Solving problems
    31. 7.21 Scheduling reconciliation and reclamation
    32. 7.22 License Expiration Handling
    33. 7.23 Disaster recovery
    34. 7.23.1 Tiers of disaster recovery
    35. 7.23.2 Preparing IBM Spectrum Archive EE for a tier 1 disaster recovery strategy (offsite vaulting)
    36. 7.23.3 IBM Spectrum Archive EE tier 1 DR procedure
    37. 7.24 IBM Spectrum Archive EE problem determination
    38. 7.24.1 Rsyslog log suppression by rate-limiting
    39. 7.25 Collecting IBM Spectrum Archive EE logs for support
    40. 7.26 Backing up files within file systems that are managed by IBM Spectrum Archive EE
    41. 7.26.1 Considerations
    42. 7.26.2 Backing up a GPFS or IBM Spectrum Scale environment
    43. 7.27 IBM TS4500 Automated Media Verification with IBM Spectrum Archive EE
    44. 7.28 How to disable transparent recall and IBM Spectrum Archive EE commands
  12. Chapter 8. Use cases
    1. 8.1 Overview of use cases
    2. 8.1.1 Use case for archive
    3. 8.1.2 Use case for tiered and scalable storage
    4. 8.1.3 Use case data exchange
    5. 8.2 Media and Entertainment
    6. 8.3 Media and Entertainment
    7. 8.4 High-Performance Computing
    8. 8.5 Healthcare
    9. 8.6 Genomics
    10. 8.7 Archive of Research/Scientific Data for Long Periods of Time
    11. 8.8 University Scientific Data Archive
    12. 8.9 Oil and Gas
    13. 8.10 S3 Object Interface
    14. 8.11 AFM use cases
    15. 8.11.1 Centralized Archive Repository
    16. 8.11.2 Asynchronous Archive Replication
  13. Chapter 9. Troubleshooting
    1. 9.1 Overview
    2. 9.1.1 Quick health check
    3. 9.1.2 Common startup errors
    4. 9.2 Hardware
    5. 9.2.1 Tape library
    6. 9.2.2 Tape drives
    7. 9.3 Recovering data from a write failure tape
    8. 9.4 Recovering data from a read failure tape
    9. 9.5 Software
    10. 9.5.1 Linux
    11. 9.5.2 IBM Spectrum Scale
    12. 9.5.3 IBM Spectrum Archive LE component
    13. 9.5.4 Hierarchical storage management
    14. 9.5.5 IBM Spectrum Archive EE logs
    15. 9.6 Recovering from system failures
    16. 9.6.1 Power failure
    17. 9.6.2 Mechanical failure
    18. 9.6.3 Inventory failure
    19. 9.6.4 Abnormal termination
  14. Chapter 10. Reference
    1. 10.1 Command-line reference
    2. 10.1.1 IBM Spectrum Archive EE help guide for commands
    3. 10.1.2 Drive status and state codes
    4. 10.1.3 Node status codes
    5. 10.1.4 Tape status codes
    6. 10.1.5 IBM Spectrum Scale commands
    7. 10.1.6 IBM Spectrum Protect for Space Management commands
    8. 10.2 Formats for IBM Spectrum Scale to IBM Spectrum Archive EE migration
    9. 10.3 System calls and IBM tools
    10. 10.3.1 Downloading the IBM Tape Diagnostic Tool
    11. 10.3.2 Using the IBM LTFS Format Verifier
    12. 10.4 IBM Spectrum Archive EE interoperability with IBM Spectrum Archive products
  15. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  16. Back cover
3.236.217.172