Storage
Whether its datasets, input files, output files, or scripts, jobs typically require data to run. This page highlights the different locations where data can be stored, how each are used, and how you can access them.
Backing Up Data
The Blugold Center for High-Performance Computing does not currently back up any user, group, or class data on our clusters. To prevent any potential data loss, we recommend frequently backing up your most important files to locations off the cluster. See our file transfers guide on different ways you can copy your files.
User Data
Also known as your 'home directory', user data is where you can find your own personal files that typically only you have access to. This is the default starting directory for most users when the log into the cluster.
Location: /data/users/<username>
Instead of typing the full path, in many cases you can use the $HOME environment variable or ~ to refer to your home directory. Note that not all scripts will support one or both of these aliases.
[myuser@bose ~]$ echo $HOME
/data/users/myuser
[myuser@bose somedirectory]$ cd ~/myfolder/ # Change directory starting from home directory "~"
[myuser@bose myfolder]$ pwd # Print working directory
/data/users/myuser/myfolder
Group Data
Group data is the primary location for all shared files amongst members in the same group, such as a research group. We recommend most users utilize the shared space for all of their research files so each member can access the scripts, datasets, programs, and job results from each other.
Typically this is based off the faculty advisor's username that is leading the research group. Multiple project folders can also be created with more granular permissions if you have different group members for each project.
Single Folder:
/data/groups/<username>
Multiple Projects:
/data/groups/<username>/projectA <-- Group A Members Only
/data/groups/<username>/projectB <-- Group B Members Only
Requesting A Folder:
You can request a folder to be set up, or changed at any time, just let us know:
- What you want your group to be called (if have multiple projects)
- Who is in each group (include usernames place)
Class Data
If requested, classes are provided a shared space for faculty and students to use for coursework. By default, students are given their own individual directory to work from, however the structure is flexible to accommodate group projects or any other setup required.
Faculty members are given full access to any files under their class folder.
Location: /data/classes/<year>/<term>/<class>
Example: /data/classes/2024/spring/cs146
Accessing Files:
When setting up a class folder, we have it set up to automatically create a symbolic link / shortcut to a student's personal folder from their own home directory. This is only accessible by the student and their professor.
Course files are typically made available by faculty under the course_files directory. This is accessible by each student, but files can only be viewed and not changed.
New Format:
Old Format: