File System Commands
Properties of Lustre files and directories can be controlled or queried through a command-line interface. Among these Lustre File System (lfs
) commands, perhaps the most useful is lfs quota
, which simply tells you your storage limit on a given Lustre system. Relevant file systems to query at TACC are $HOME and $WORK:
Typical user limits for these partitions on TACC systems are 10-25 GB and 1 TB, respectively.
If you work with extra-large files, say over 100 GB in size, then lfs setstripe
is another good command to know. It takes four arguments:
- File or directory for which to set the stripe.
- Size in bytes on each OST, with k for KB, m or M for MB, g or G for GB.
- OST index of the first stripe (-1 for filesystem default).
- Count or number of OSTs to stripe over.
As a general guideline, you should consider setting a stripe for every 100 GB in the file. For example, to stripe an intended 200 GB file across two OSTs, create the file by calling:
When you omit the -S
argument in the above, you are setting the stripe size to be the system default, which is 1 MB at TACC.
You needn't set it any lower than that (and you can't set it lower than 64k).
But if your application uses parallel I/O with large files, you might obtain better performance if you set a larger stripe size on your new output file(s).
For example:
To see Lustre's default striping properties, try creating a small file and then using lfs getstripe
to get its stripe information.
The listing at the end of the results shows which OSTs have parts of the file.