Along with the Swift and S3 APIs, Horizon, and DuraCloud, there are additional tools that can be used to manage your content in the OLRC.

RClone

RClone is a command-line tool that can be used to transfer data to the OLRC. One of the major benefits of rclone is its ability to synchronize data (similar to a tool like rsync), meaning that only data that has changed will be uploaded. RClone is our recommended tool for uploading/downloading large volumes of data, as it has proven to be fast and reliable.

To use rclone with the OLRC:

Download and install rclone

In your terminal, set up your endpoint with:

rclone config

Note that you may need to specify the full path to the binary, depending on how you installed RClone. E.g. on Windows you might need something like:

%homepath%\Downloads\rclone-v1.57.0-windows-amd64\rclone.exe config

Follow the prompts to set up your configuration, setting your storage type as “OpenStack Swift”. Additional setup values can be found in the OpenRC file available in Horizon. See the rclone swift documentation for additional setup help and commands.

If you are following the prompts from start to finish, you would type these values in this order, replacing endpoint-name, username, password, domain and project with your setup values.

e/n/d/r/c/s/q> n
name> endpoint-name
Storage> swift
env_auth> <press return>
user> username
key> password
auth> https://olrc2auth.scholarsportal.info/v3
user_id> <press return>
domain> domain
tenant> project
tenant_id> <press return>
tenant_domain> domain
region> RegionOne
<press return for all additional prompts>

Once you have setup your endpoint, test it with:

rclone lsd endpoint-name:

This should output a list of your containers.

Now you’re setup, you can begin to explore everything that RClone can do. The copy and sync commands are probably a good place to start. Here is an example that copies the contents of a local directory “path/to/files” to a container called “container-name”.

rclone copy --progress /path/to/files endpoint-name:container-name

Cyberduck

Cyberduck is a free software GUI client that supports OpenStack Swift operations, including bulk uploads and downloads, and runs on Windows and macOS.

These instructions have been written using macOS, but the steps should be similar in a Windows environment.

When uploading large volumes of data with Cyberduck, we strongly recommend verifying the data was uploaded via another method (e.g. with Horizon or the command-line) as some users have had issues with failed uploads when uploading large amounts of data using Cyberduck.

To use the Cyberduck GUI:

1. Download Cyberduck and follow the installation instructions.
2. After you have installed and opened Cyberduck, open a new connection and enter your credentials:
   • Server: olrc2auth.scholarsportal.info
   • Port: 443
   • Project/Domain/Username: Enter the name of your project, domain (e.g. your institution domain), and your account name, formatted as “project:domain:username”. For example, “general:scholarsportal:kaitlin”. You can find these details in the Horizon dashboard as well.
   • Enter your password (the same password you use to login to Horizon or use the Swift CLI).
   • Click “Connect”.
3. Once you have connected, you will see a list of the containers in the project. You can now create or delete containers and upload or download data from your local machine.
   

S3 Browser

S3 Browser is a Windows client that can be used to upload data to the OLRC via the S3 API.