This page contains additional speed-related information that may be specific to a certain transfer tool or computing environment.
Globus

When you use Globus for a data transfer, the speed will be the same whether you are using the web Globus GUI or the Command Line Interface (CLI). You should feel free to choose the interface that is most comfortable or best suited to your application (for example, the CLI is better for scripted access).

Cross-Platform Issues
Caution: Beware of cross platform issues with paths and filenames.

Spaces, case and slashes are treated differently across computing platforms.

spaces
Spaces in file names can cause trouble in Linux, so insert a backslash (\) as an escape before each space, or put single or double quotes around the entire filename. In general, it is better not to use spaces in filenames or directory names.
case sensitivity
Remember that Linux is case sensitive, but Windows is not. It is often best to avoid filenames and directory names which only differ by capitalization.
slashes
Always be mindful that forward slashes are used as path separators in Linux, while backslashes are used in Windows.
Resource Usage

Transferring data can be resource intensive. Stampede2 and Frontera request that you have no more than three SCP, SFTP or rsync transfers active at one time. If you are using Globus, there should only be one transfer active at a time.

Other Factors

There are many variables that can affect transfer speeds. Most of them are not under user control, including:

  • Disk speed
  • Node connectivity
  • Network bandwidth and latency
  • Load on the system at the time of the transfer

Often, the limiting factor is the node connectivity at the user end, or at higher speeds, I/O from and to storage media. However, employing the tips outlined in this topic can help you attain the fastest transfer speeds possible, given your local environment.

 
©  |   Cornell University    |   Center for Advanced Computing    |   Copyright Statement    |   Access Statement