User Tools

Site Tools


moving_data

**This is an old revision of the document!**

Data Transfer to and from AHPCC Clusters

Small files (up to few 100MB)

There data transfer protocols are allowed to move data to the main storage on the AHPCC clusters:

  • scp (secure copy)
    • sftp (secure ftp)
      * rsync

    Linux and MacOS

To upload a data file from the current directory on your local desktop machine to your /storage directory on pinnacle:

pawel@localdesktop$# scp localfile.dat pwolinsk@pinnacle.uark.edu:/storage/pwolinsk/

To download a data file from your /storage directory on pinnacle to the current directory on your local desktop machine:

pawel@localdesktop$# scp pwolinsk@pinnacle.uark.edu:/storage/pwolinsk/remotefile.dat .

Windows

Windows OS does not include Secure Copy or Secure FTP tools. There are multiple file transfer clients available for download. The most popular command line client is pscp.exe available here:

https://the.earth.li/~sgtatham/putty/latest/x86/pscp.exe

To transfer files using pscp.exe download and save pscp.exe to your Windows machine. Then open a terminal (i.e. Command Prompt, under “Start→All Programs→Accessories→Command Prompt”) and specify the full path to the location of the downloaded pscp.exe file followed by two arguments <source> and <destination>. Either one or both could specify a file a on remote machine (user@host:pathtofile) or a local file (pathtofile). For example:

C:\Users\Pawel> c:\Users\Pawel\Downloads\pscp.exe filetoupload.txt pwolinsk@pinnacle.uark.edu:

The code above uses secure copy protocol to upload a file “filetoupload.txt” to the home directory of user pwolinsk on pinnacle.uark.edu.

Another popular windows transfer client (GUI) is WinSCP:

https://winscp.net/eng/download.php

NOTE: Pinnacle, Trestles and Razor clusters all share the same main AHPCC storage. So transferring files to any one of the 3 clusters will make those files available on all clusters.

moving_data.1615381514.txt.gz · Last modified: 2021/03/10 13:05 by pwolinsk