Chapter 7. Using Globus Toolkit for data management

There are two major components for data management in the Globus Toolkit:

• Data transfer and access

• Data replication and management

For basic data transfer and access, the toolkit provides the Globus Access to Secondary Storage (GASS) module, which allows applications to access remote data by specifying a URL.

For high-performance and third-party data transfer and access, Globus Toolkit Version 2 implements the GridFTP protocol. This protocol is based on the IETF FTP protocol, and adds extensions for partial file transfer, striped/parallel file segment transfer, TCP buffer control, progress monitoring, and extended restart.

Figure 7-1 provides a view of the various modules associated with data management in the Globus Toolkit and how they relate to one another. These modules are described in more detail throughout this chapter.