Dedicated Data Transfer Node (DTN)
To improve the data transfer experience of our supercluster users a separate dedicated data transfer server is available.
lrc-xfer.lbl.gov mounts all the cluster file systems such that users can transfer data into/from any cluster filesystem. Also NERSC HPSS data transfer utilities like hsi and htar are configured to work on this server.
Data Transfer Examples
- On Linux: scp/rsync
# Transfer data from a local machine to Lawrencium
scp file-xxx $USER@lrc-xfer.lbl.gov:/global/home/users/$USER
scp -r dir-xxx $USER@lrc-xfer.lbl.gov:/global/scratch/$USER
# Transfer from Lawrencium to a local machine
scp $USER@lrc-xfer.lbl.gov:/global/scratch/$USER/file-xxx ~/Desktop
# Transfer from Lawrencium to Another Institute
ssh $USER@lrc-xfer.lbl.gov # DTN
scp -r $USER@lrc-xfer.lbl.gov:/file-on-lawrencium $USER@other-institute:/destination/path/$USER
rsync: data transfer tool and a backup tool
rsync -avpz file-at-local $USER@lrc-xfer.lbl.gov:/global/home/user/$USER - On Window
WinSCP: SFTP client and FTP client for Microsoft Windows
FileZella: multi-platform program via SFTPGlobus
Globus for data transfers is highly recommended. Globus is available as a free service for any user to sign up. Please follow the instructions for access setup.
Additional Globus Features (ONLY for Berkeley Lab Users)
All Berkeley Lab users can use Globus to access and transfer files in/out of their Berkeley Lab Google drive also. Details on how to access LBL Google drive via Globus please refer to this instructions (LBL Only).
in the bottom right or navigate to