Skip to content

File Management

The cluster home directory provides short term storage for your scripts, job data, and job output. This storage system is shared across the login node and all compute nodes.

Warning

Files stored in your cluster home directory are not backed up. For long term storage, we recommend transferring your files to the U Drive, which is automatically backed up.

Storage Limits

Two limits are enforced to prevent overuse from impacting cluster performance. These limits are set very high: normal cluster storage usage should be much lower than these limits:

  • Maximum number of files: 3,000,000 files
  • Maximum home directory size: 2TB

If these limits are exceeded, your home directory will automatically be set to read-only.

Transferring Files to the Cluster

sftp/scp/rsync

Files can be transferred using sftp, scp or rsync by connecting to your_netid@cluster.stat.washington.edu. See Transferring Files with SFTP for details.

Connecting from off campus requires using either the Husky OnNet VPN, or relaying the connection through ssh.stat.washington.edu in ~/.ssh/config (Automatically Relaying SSH Connections Off Campus)

Git version control

If you're managing your cluster code in a git repository, using git clone and git pull is the recommended method to transfer and update your code on the cluster. Note that any compilation of code needs to be run with srun in a slurm interactive session