User Tools

Site Tools


This is an old revision of the document!

Data Transfer to and from AHPCC Clusters

A special data mover node named should be used for moving data to and from the clusters. tgv is configured with a 10Gb/s network connection and a dedicated 21TB storage system mounted at /local_storage. Regular logins shells are blocked on tgv. The allowed protocols are

  • scp (secure copy)
  • sftp (secure ftp)
  • rsync

To upload a data file from the current directory on your local desktop machine to your home directory on razor:

pawel@localdesktop$# scp localfile.dat

To download a data file from your home directory on razor to the current directory on your local desktop machine:

pawel@localdesktop$# scp .

Data Transfer between Razor & Trestles Clusters

A special node named bridge is set aside for the purpose of moving data between storage systems of the Razor and Trestles clusters. The bridge node has home, storage and scratch file systems from both Razor and Trestles nodes mounted under these directories:

Trestles file systems

These are also mounted at:

When you login to bridge, you will be located in your Trestles home.

Razor file systems


Although a direct secure copy to bridge node from either Razor or Trestles cluster nodes or front ends is available, to achieve best performance we recommend logging into bridge node directly and using the cp command to move files between the cluster file systems:

tres-l1:pwolinsk:$ ssh bridge
Last login: Fri Feb 19 14:03:31 2016 from tres-l1
No Modulefiles Currently Loaded.
bridge:pwolinsk:$ cp /trestles/home/pwolinsk/memusage /razor/home/pwolinsk/
bridge:pwolinsk:$ exit
Connection to bridge closed.

cp directly on bridge is faster because it uses 40Gb/s Infiniband while scp uses 1Gb/s ethernet.

moving_data.1456343762.txt.gz · Last modified: 2016/02/24 19:56 by root