User Tools

Site Tools


moving_data

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
moving_data [2016/11/10 20:38]
root
moving_data [2017/02/21 19:54]
root
Line 67: Line 67:
 </​code>​ </​code>​
  
-Although **''​scp''​** to the bridge node is possible from either cluster, we recommend logging into **bridge** node directly and using the **''​cp''​** or **''​mv''​** commands to move files , thus using 40Gb/s Infiniband instead of **''​scp''​** using 1Gb/s ethernet:+Although **''​scp''​** to the bridge node is possible from either cluster, we recommend logging into **bridge** node directly and using the **''​cp''​** or **''​mv''​** commands to move files, thus using 40Gb/s Infiniband instead of **''​scp''​** using 1Gb/s ethernet:
  
 <​code>​tres-l1:​pwolinsk:​$ ssh bridge <​code>​tres-l1:​pwolinsk:​$ ssh bridge
Line 78: Line 78:
 tres-l1:​pwolinsk:​$ ​ tres-l1:​pwolinsk:​$ ​
 </​code>​ </​code>​
 +**''​rsync''​** is better for copying whole directories:​
 +<​code>​
 +bridge:​pwolinsk:​$ cd /​razor/​home/​pwolinsk
 +bridge:​pwolinsk:/​razor$ rsync -av XSEDE /​home/​pwolinsk/​
 +sending incremental file list
 +XSEDE/
 +XSEDE/​xsede13/​
 +...omitted every file listed with -v option...
 +XSEDE/​xsede14/​OpenMP_Exercise/​heat.c
 +
 +sent 185047 bytes  received 1258 bytes  124203.33 bytes/sec
 +total size is 180459 ​ speedup is 0.97
 +</​code>​
 +
 +On **bridge**, **''/​home/​username''​** and **''/​trestles/​home/​username''​** are equivalent.
 +
 **bridge** is not reachable from outside the clusters, please use **tgv**/​**dm**. ​ A data transfer node to the Trestles file systems is planned. **bridge** is not reachable from outside the clusters, please use **tgv**/​**dm**. ​ A data transfer node to the Trestles file systems is planned.
moving_data.txt · Last modified: 2017/02/21 19:54 by root