Some of the coming pages on data transfer tools include exercises that you may wish to perform. These exercises all expect you to have certain data in place before starting. This page describes how you can create that data before performing the exercises and how to clean up the data when you are done.

Creating the Test Data

To create test data for the coming exercises, log on to the Stampede2 or Frontera login node (or whatever system you will use) and create a directory for the exercise files (it is also fine to use the top level of your home directory). The code in bigfile.c will generate a moderate size file (~500MB). You can use wget to download this file:

login$ wget https://cvw.cac.cornell.edu/datatransfer/clients/bigfile.c

Compile and run this short program, directing the output to a file called bigfile.txt.

Now create two more files via concatenation:

You now have three files of increasing size to use in the transfer exercises.

Cleanup

When you have completed all the exercises you wish to perform, remember to free up disk space by removing the big*.txt files, both from the source system and any destination systems (Stampede2, Frontera, Ranch or some other system).