Moving Data & Transfer Methods
1. Globus Data Transfer
Section titled “1. Globus Data Transfer”Berkelium operates a dedicated Globus Connect Server endpoint connected directly to the ESnet Science DMZ at 100 Gbps.
- Endpoint Name:
LBNL ScienceIT Berkelium Storage - Authentication: LBNL OneID Single Sign-On
- Target Path:
/berkelium/namespaces/<your-namespace>/
Initiate transfers through the web UI at app.globus.org or using the Globus CLI:
globus transfer <nersc-endpoint>:<path> <berkelium-endpoint>:<path> --label "ALS Run 24 Sync"2. Moving Data via kubectl cp
Section titled “2. Moving Data via kubectl cp”For smaller scripts, configuration files, and checkpoint weights (< 5 GB):
# Copy local file into container PVCkubectl cp ./dataset.tar.gz sci-myproject/analysis-worker:/mnt/shared/dataset.tar.gz
# Copy trained weights back to local workstationkubectl cp sci-myproject/analysis-worker:/mnt/shared/checkpoint.pt ./checkpoint.pt3. High-Speed Beamline POSIX Bridge
Section titled “3. High-Speed Beamline POSIX Bridge”Beamlines at the Advanced Light Source (ALS) and Molecular Foundry stream raw detector frames directly into Berkelium CephFS via dedicated 100GbE fiber uplinks. Contact Science IT Support to configure an automated instrument mount for your beamline.
