Skip to content

File Transfers

For any project to be successful, you must be able to upload files and download results. This guide shows you different methods of transferring files between your computer and the cluster.

Choosing a method

Transfer Method Recommended Size Limits Supported Campuses
(By Default)		 BOSE BGSC
Open OnDemand < 5 GB All Supported ✅ -
Globus All Sizes All Supported ✅ -
SSH File Transfer Protocol (SFTP) < 500GB UW-Eau Claire ✅ ✅
rsync < 1TB UW-Eau Claire ✅ ✅
Secure Copy Protocol (SCP) < 500GB UW-Eau Claire ✅ ✅

Graphical Interfaces

Open OnDemand - Web Browser

Supported Campuses: All Supported
Supported Clusters: BOSE

Available on our BOSE cluster is the ability to transfer files right from your web browser through our Open OnDemand application platform.

  1. Log into Open OnDemand (button below)
  2. Click on "Home Directory" on the home page or "Files" at the top
  3. Navigation to where you want to upload or download files

Upload:

Click on the "Upload" button in the top right.

Download:

Click on the three dots next to any file/folder and click "Download".

Go To Open OnDemand

Globus - Desktop Program + Web Browser

Supported Campuses: All Supported - With Caveats
Supported Clusters: BOSE

BOSE supports data transfers through the Globus Research Data Network. By downloading the Globus Connect Personal program on your computer, or connecting to another instutition with a cluster that supports Globus, you'll be able to transfer files of all sizes between devices from the Globus website.

This option is a recommended for research that involves massive data sets, as Globus will transfer files in the background and will continue where it left off if your computer is turned off or network is interrupted.

Globus User Guide | Globus Website

Via SFTP - Desktop Program

Supported Campuses: UW-Eau Claire only unless coordinated with HPC team
Supported Clusters: BOSE, BGSC

SFTP, also known as "Secure File Transfer Protocol", is a popular way to upload files using the same information as what you would use when connecting to the cluster using SSH in the command line.

Available for each operating system is a variety of programs you can use to transfer files to/from servers using a similar file browser than what you already use for managing your own files. Best part is that you can simply drag-and-drop files right between your computer and a server!

Operating System:

Connection Info
Protocol SFTP
Hostname bose.hpc.uwec.edu
Port 50022
Username UWEC Username - all lowercase
Password UWEC Password
Password w/ Okta Hardware Token UWEC Password,TokenNumber

Note: If you are on campus and not connected to GlobalProtect, you'll also need to authenticate with Okta Verify.

Using a hardware token with Okta?

By default, when you connect to our BOSE cluster over SSH, a push notification will be sent to the Okta Verify app on your phone for you to approve.

If you are unable to use your phone and are using a hardware token, you'll have to put the number you receive on the device directly after your password separated with a comma before you can log in.

Example:

Username: myuser
Password: mypass,123456
Protocol SFTP
Hostname bgsc.hpc.uwec.edu
Port 22
Username UWEC Username - all lowercase
Password UWEC Password

Command Line

Transferring files using rsync

Supported Campuses: UW-Eau Claire only unless coordinated with HPC team
Supported Clusters: BOSE, BGSC

Using the rsync command allows users to securely copy and transfer only new and changed files between a cluster and computer. This method is recommended when transferring a lot of files.

Local Computer → Cluster

Transferring Files

When transferring files between the cluster and your computer, you must run the commands on your computer.

rsync -avze 'ssh -p 50022' /path/to/local-folder user@bose.hpc.uwec.edu:~/remote-folder

rsync -avze 'ssh' /path/to/local-folder user@bgsc.hpc.uwec.edu:~/remote-folder
Cluster → Local Computer

Transferring Files

When transferring files between the cluster and your computer, you must run the commands on your computer.

scp -P 50022 -r user@bose.hpc.uwec.edu:~/remote-folder /path/to/local-folder

scp -r user@bgsc.hpc.uwec.edu:~/remote-folder /path/to/local-folder
Cluster → Cluster

Transferring Files

When transferring files between BOSE and BGSC, you must run the commands on BGSC.

scp -P 50022 -r user@bose.hpc.uwec.edu:~/files-to-copy ./

scp -P 50022 -r ./files-to-copy user@bose.hpc.uwec.edu:~/

Secure Copy (SCP)

Supported Campuses: UW-Eau Claire only unless coordinated with HPC team
Supported Clusters: BOSE, BGSC

Using the scp command allows users to securely copy and transfer files between a cluster and computer.

Local Computer → Cluster

Transferring Files

When transferring files between the cluster and your computer, you must run the commands on your computer.

scp -P 50022 -r /path/to/local-folder user@bose.hpc.uwec.edu:~/remote-folder

scp -r /path/to/local-folder user@bgsc.hpc.uwec.edu:~/remote-folder
Cluster → Local Computer

Transferring Files

When transferring files between the cluster and your computer, you must run the commands on your computer.

scp -P 50022 -r user@bose.hpc.uwec.edu:~/remote-folder /path/to/local-folder

scp -r user@bgsc.hpc.uwec.edu:~/remote-folder /path/to/local-folder
Cluster → Cluster

Transferring Files

When transferring files between BOSE and BGSC, you must run the commands on BGSC.

scp -P 50022 -r user@bose.hpc.uwec.edu:~/files-to-copy ./

scp -P 50022 -r ./files-to-copy user@bose.hpc.uwec.edu:~/