CONTENTS
Acknowledgements
Introduction
Chapter 1 Information, Data, and Video
Data Structure
Information
Storing the Moving Image
Digital Video Recording
Analog Component Video
Colorimetry and Conversion
A Digital Media World: Going Forward
Further Readings
Chapter 2 Digital Disk Recording
Recording Moving Images
Dawn of the Video Disk
Fundamentals of Digital Disk Recording
Core Technologies for Digital Disk Recording
DDR, DVR, or Videoserver
Comparing DDRs to Videoservers
Clip Servers
DVR Marketplaces
Home Media Network Disk Recorders
Audio
Further Readings
Chapter 3 Video Media Servers
Carrying Over from the DDR
Universal Server Approach
Videoservers as Media Servers
The Future of Videoservers
Communications Protocols Used in Video Serving Platforms
Further Readings
Chapter 4 Hard Drive Anatomy
Magnetic Recording History
Drive Components
Disk Performance Optimization
Disk Scheduling
Access Time Components
Servicing and Scheduling Criteria
Capacity Factors, Transfer Time and Obstacles
Read—Write Heads
Advanced Format Sector Technology
Superparamagnetic Limit
Heat-Assisted Magnetic Recording
Further Reading
Chapter 5 Buses, Ports, and Interfaces
Carrying and Transferring Data
Bus Types
Storage Bus Standards
Storage Module Device
Serial Storage Architecture
High-Performance Parallel Interface
IDE
Parallel ATA
SCSI
Further Readings
Chapter 6 SATA, SAS, and RAID
Transitioning from Parallel to Serial Technologies
Serial Attached SCSI (SAS)
SATA
RAID
Alternative Disk Sets and Configurations
Error Prevention Methods
Conclusions
Further Readings
Chapter 7 Solid State Disks
Solid State Storage Evolution
Dynamic Random Access Memory
Flash Memory
Flash Memory Functionality
Portability and Green Perspectives
Supplementing Video on Demand with SSD
Further Readings
Chapter 8 Optical Storage Media
Defining Removable Media
Optical Media Definitions
Blu-ray Disc
Holographic Storage
Care and Handling
Further Readings
Chapter 9 Interchange, Transcoding, and Wrappers
Moving Toward Non-Real Time
Compressed Video
Issues with Interchange
Media File Vocabularies and Terminologies
Content
Material eXchange Format (MXF)
Task Force for MXF
Operational Patterns
Specialized Operational Pattern Atom
Items and Packages
Essence Container
Conversion and Transcoding
Converting Audio and Video Essence
Transcode Pipeline
Multiplatform Conversion and Distribution
Examples and Conclusions
Further Readings
Chapter 10 IP Storage
Internet Protocol
Delivering Packets by IP
Connected or Connectionless
IP Address Classes
Addresses
Domain Naming
Ethernet
Internet Engineering Task Force
IP Storage
iSCSI
iSCSI RFCs
iSCSI Protocol
Initiator—Target Messages
Transfer Directions
Network Address Authority (NAA)
iFCP
Gateway Protocol to TCP/IP
Provisions
Fabric
iFCP Services
Transport Services
Other
Security
Fibre Channel Over IP (FCIP)
Complementary
Nominal Distances
FCIP Link
Clarification
Internet Storage Name Service (iSNS)
iSNS Architectural Components
iSNS Protocol (iSNSP)
iSNS Client
iSNS servers
iSNS Database
What iSNS Does
Unified Discovery and Management
Fiber Channel Discovery
Zoning
Using SCN Functions
Distributed Intelligence
IP Storage Support
Quality of Service for IP Storage Networks
Class of Service (CoS)
Traffic Prioritization
TOS Precedence
Differentiated Services
Performance Predictability
Traffic Shaping
Theory and Research
Variable Delay
Throttling Decisions
Resource Reservation Protocol (RSVP)
Multiprotocol Label Switching (MPLS)
MPLS Transport Profile
InfiniBand
IP Storage Considerations
IP Switches and Routers
Determining the Need
Logical Separation Points
Security Considerations
Ports and Connectivity
Other Features
Management Tools
Acceleration and Compression
Security
Authentication
Fibre Channel—Security Protocol (FC-SP)
Device Identity
Authorization
Encryption
Auditing
Integrity Checking
Quality of Service (QoS)
Further Readings
Chapter 11 Object-Based Storage
Introduction: Objects
Storage Categories
Storage Interface Progression
Parallel Heading
Applications of OSD
Further Readings
Chapter 12 Archives, Backups, and Linear Tape
Organizational Requirements for Data
Legal Requirements for Archive or Backup
Repacking and Repurposing
Added Operational Requirements
Backup or Archive: There are Differences
Backups
Acting like Archives
Data Backups—Not Archives
Internal Application-Specifi c Backups
Archive and Transfer Management—Nonlinear Editing
Differentiation
Archiving for Discovery
Data Archiving
Tape or Disk
Pros and Cons
Self-Protecting Storage Systems
Disk Archiving Pluses
Tape Archiving Pluses
Storage Retention Period
Disadvantages of Tape
Legacy Tape Archive Problems
Standards-Based Archive Approaches
Common Backup Formats
Determining the Right Archiving Method
Cloud Data Protection
Cloud Benefits
Scaling
Services Provided
Holographic Storage for the Archive
RAIT
Mirroring—Level 1 RAIT
Data Striping—Level 3 RAIT
Data Striping—Level 5 RAIT
Not for Random Access
Automated Tape Libraries (ATL)
Stackers, Autoloaders, or Libraries
Server and Archive Components
Evolution in Digital Tape Archives
Tape Technology Basics
Tape Metrics
Linear Serpentine
Helical Scan Recording
Historical Development of Data Tape
QIC and DAT
Travan
8 mm Recording Technologies
Tape Error Detection
Tape Media Formats and Fabrication Parameters
Metal Particle to Advanced Metal Evaporated
Advanced Intelligent Tape (AIT)
Super and Turbo AIT
Digital Data Storage (DDS)
Data Storage Technology (DST)
Digital Tape Format (DTF)
Advanced Tape Materials
Digital Linear Tape (DLT)
Error Detection
Adaptive Cache Buffering
Compression Algorithms
Duty Cycle
DLT1 Drive
Super DLT
Roadmaps for SDLT
Linear Tape Open (LTO)
Genealogy
Ultrium—First Generation
LTO Generation 1
LTO Generation 2
LTO Generation 3
LTO Generation 4
LTO Generation 5
LTFS
LTO Program Roadmap
Security WORM
Why Use Tape?
Data Archiving and Tape Storage
Preparing for the Archive
Future Standards
Chapter 13 Metadata and Media Asset Management
Media Management Systems
Media Assets and Content
Content Management System
Web-Based CMS
Digital Asset Management
Asset Management System
Media Asset Management
Tape-Based MAM
Drawbacks to Tape-Based Systems
MAM for Videoserver Implementations
Lack of Media Asset Integration
Collaboration Issues
Metadata
Media-Centric Metadata
Structural Metadata
Descriptive Metadata
Interoperability
Dublin Core
PBCore
Usage Metadata
Schemas
Standards, Practices, and Policies for Metadata
Storing Metadata
Metadata Services
Media Application Services
Messaging Services for MAM
Intelligent Integrated MAM
Workflow Management
Collaboration among Multiple Users
Tool Set Integration
Centralized Database
Multi-Tier Architecture
Scalability
Storage for MAM
Latency
Interfacing with Production Storage
Archive
Further Readings
Chapter 14 Clustering
Why Use Clusters?
Physical Components
Capabilities and Types of Clustering
Cluster Scaling Characteristics
Shared Structures
Managing Storage Clusters for Scalability
Grid Computing
Summary
Further Readings
Chapter 15 Networked Storage
Networked Storage—Fundamentals
Networks
Network-Attached Storage
Direct Access File System
Storage Area Network
Fibre Channel SAN Components
Next Generation SANs
Further Readings
Chapter 16 High-Performance and Shared Storage
Applications for High-Performance Storage
Size Matters
Intelligent Adaptive Storage
Storage Accelerators
Storage Appliance Technologies
Real-World Performance
Shared Storage Implementations
Storage Scaling and Management
Further Readings
Chapter 17 Scalability, Extensibility, and Interoperability
Scalability
Flexibility
Reliability
Accessibility and Availability
Extensibility
Interoperability
Science and Technology
Further Readings
Chapter 18 Storage Management
Storage System Dependencies
Storage Management Concepts
Electronic Media Management
Fragmentation
SAN Management
NAS Management
Snapshots
Data Deduplication
Further Readings
Chapter 19 Resilience, Fault Tolerance, and Virtualization
Resilience
Storage Tiering
Protecting Data and Storage
Virtualization in File-Based Storage
Fault Tolerance
Conclusion
Further Readings
Index