Overview
Every Lawrencium user has a 30 GB home directory with regular backups. Research groups can request shared group directories, and all users can work with non-persistent data on the high-performance Lustre scratch file system. For quotas and backup details, see Storage and Backup.
Condo Storage adds to these by letting a research group buy dedicated, persistent storage inside the Lawrencium storage infrastructure. It is a cost-effective option for groups that need to keep large data sets for a long time to support their work on Lawrencium or on supported research clusters.
Program Details
Condo Storage works like the Condo Computing program. A PI buys a 448 TB block of storage on the DDN Lustre file system for a one-time cost of about $25,000. The cost covers the storage and its support for the life of the hardware. You pay only for the storage itself: Science IT provides the storage servers and controllers, and there are no ongoing support fees.
Storage is sold only in 448 TB blocks. Smaller increments are not available on Lawrencium.
Storage is bought and maintained on a 5-year lifecycle. At the end of the lifecycle, owners who want to keep participating will be offered one or both of these options:
- buy new storage, or
- pay the annual vendor hardware maintenance on their existing storage.
Which options are available depends on when the storage was bought and when Science IT upgrades the storage infrastructure.
Access
Condo Storage is available only on Lawrencium and on supported research clusters within the Science IT HPC infrastructure. It is not mounted on Savio, on systems elsewhere at the Lab, or on any system outside the HPC infrastructure. To move data in or out, use Globus; see Globus for Lawrencium.
Some earlier Condo Storage directories under /clusterfs are on a different storage system; contact us for details.
Backups
Condo Storage is not backed up by default. Backups are the storage owner’s responsibility. PIs can work with Science IT to set up regular backups or file system snapshots.
Testing and Performance
To test performance before buying, run your tests in your scratch directory (/global/scratch/users/$USER), which uses the same Lustre hardware. For computation, especially I/O-heavy work, copy data to scratch rather than running directly on Condo Storage.
Purchasing
To buy Condo Storage, submit an HPC Storage Condo request on Freshservice. For other questions, email scienceithelp@lbl.gov. Science IT will help enter the purchase requisition and start the procurement. The process from request to production usually takes about 6 weeks.
Eligibility
Condo Storage is available to Berkeley Lab researchers who contribute to the Lawrencium Condo Computing program.