Data Staging Script Introduction Sample Clauses
Data Staging Script Introduction. The Data Staging script is part of the Data Stating service and can be used to transfer data between two GridFTP endpoints using the Globus Online (GO) service. To some extent, it is similar to a traditional command line interface transfer tool as it simply takes two input arguments: the source (a server and a list of files) and the destination (a server and a directory). More precisely, the script can be used to move transfer data between an EUDAT data node (equipped with ▇▇▇▇▇▇▇ or GridFTP DSI) and an external GridFTP server (stage-in, stage-out). As a result of recent developments, mainly requested during the e- infrastructures collaboration activity, the Data Staging script has been extended to support data transfers using PIDs along with the iRODS URI. Basically, the script is able to handle data that is qualified through its iRODS physical path or via PIDs. Additionally multiple iRODS paths or multiple PIDs can be provided as input in order to transfer directories or collections. As mentioned previously, the script makes use of the GO service (via Python API) to manage transfers "in the cloud": this means that, once a transfer has been initiated, it is managed (restarted in case of failure, controlled, tuned, etc.) by GO without any user intervention. Of course, in order to use the script, the user needs to have a GO account and enable GO endpoints (the GridFTP servers that he/she intends to use, including the EUDAT ones). The authentication is based on GSI which requires that each user has a personal x509 certificate for transferring data.
