User Tools

Site Tools


moving_data

This is an old revision of the document!


Data Transfer to and from AHPCC Clusters

A special data mover node named tgv.uark.edu should be used for moving data to and from the clusters. tgv is configured with a 10Gb/s network connection and a dedicated 21TB storage system mounted at /local_storage. Regular logins shells are blocked on tgv. The allowed protocols are

* scp (secure copy) * sftp (secure ftp) * rsync

Data Transfer between Razor & Trestles Clusters

A special node named bridge is set aside for the purpose of moving data between storage systems of the Razor and Trestles clusters. The bridge node has home, storage and scratch file systems from both Razor and Trestles nodes mounted under these directories:

Trestles file systems

/trestles/home/
/trestles/storage/
/trestles/scratch/

Razor file systems

/razor/home/
/razor/storage/
/razor/scratch/

Although a direct secure copy to bridge node from either Razor or Trestles cluster nodes or front ends is available, to achieve best performance we recommend logging into bridge node directly and using the cp command to move files between the cluster file systems:

tres-l1:pwolinsk:$ ssh bridge
Last login: Fri Feb 19 14:03:31 2016 from tres-l1
No Modulefiles Currently Loaded.
bridge:pwolinsk:$ cp /trestles/home/pwolinsk/memusage /razor/home/pwolinsk/
bridge:pwolinsk:$ exit
logout
Connection to bridge closed.
tres-l1:pwolinsk:$ 
moving_data.1456167188.txt.gz · Last modified: 2016/02/22 18:53 by pwolinsk