Additional Considerations
Globus
When you use Globus for a data transfer, the speed will be the same whether you are using the web Globus GUI or the Command Line Interface (CLI). You should feel free to choose the interface that is most comfortable or best suited to your application (for example, the CLI is better for scripted access).
Cross-Platform Issues
Spaces, case and slashes are treated differently across computing platforms.
- spaces
- Spaces in file names can cause trouble in Linux, so insert a backslash (\) as an escape before each space, or put single or double quotes around the entire filename. In general, it is better not to use spaces in filenames or directory names.
- case sensitivity
- Remember that Linux is case sensitive, but Windows is not. It is often best to avoid filenames and directory names which only differ by capitalization.
- slashes
- Always be mindful that forward slashes are used as path separators in Linux, while backslashes are used in Windows.
Resource Usage
Transferring data can be resource intensive. Stampede2 and Frontera request that you have no more than three SCP, SFTP or rsync transfers active at one time. If you are using Globus, there should only be one transfer active at a time.
Other Factors
There are many variables that can affect transfer speeds. Most of them are not under user control, including:
- Disk speed
- Node connectivity
- Network bandwidth and latency
- Load on the system at the time of the transfer
Often, the limiting factor is the node connectivity at the user end, or at higher speeds, I/O from and to storage media. However, employing the tips outlined in this topic can help you attain the fastest transfer speeds possible, given your local environment.