The XMAS cluster is part of the LBNL Supercluster and shares the same Supercluster infrastructure. This includes the system management software, software module farm, scheduler, storage, and backend network management.
Login and Data Transfer:
Each compute node has dual-socket 14-core INTEL Xeon E5-2680 v4 @ 2.40 GHz processors (28 cores in total), 64 GB of physical memory. Compute nodes are connected with each other through a high performance Mellanox 56 Gbps FDR Infiniband fabric.
|xmas||20||n0[000-019].xmas0||INTEL XEON E5-2680 v4||28||64GB|
Storage and Backup:
XMAS cluster users are entitled to access the following storage systems so please get familiar with them.
|HOME||/global/home/users/$USER||12GB||Yes||Per User||HOME directory for permanent data storage|
|SCRATCH||/global/scratch/$USER||none||No||Per User||SCRATCH directory with Lustre high performance parallel file system over Ethernet|
|CLUSTERFS||/clusterfs/xmas/$USER||none||No||Per User||Private storage|
NOTE: HOME and CLUSTERFS directories are located on a highly reliable enterprise level BlueArc storage device. Since this appliance also provides storage for many other mission critical file systems, and it is not designed for high performance applications, running large I/O dependent jobs on these file systems could greatly degrade the performance of all the file systems that are hosted on this device and affect hundreds of users, thus this behavior is explicitly prohibited. HPCS reserves the right to kill these jobs without notification once discovered. Jobs that have I/O requirement should use the SCRATCH file system which are designed specifically for that purpose.
XMAS cluster uses SLURM as the scheduler to manage jobs on the cluster. To use the XMAS resource the partition “xmas” must be used (“–partition=xmas”) along with account “xmas” (“–account=xmas”). Currently there is no special limitation introduced to the “xmas” partition thus no QoS configuration is required to use the XMAS resources (a default “normal” QoS will be applied automatically). A standard fair-share policy with a decay half life value of 14 days (2 weeks) is enforced.
|PARTITION||ACCOUNT||NODES||NODE LIST||NODE FEATURES||SHARED||QOS||QOS LIMIT|
XMAS uses Environment Modules to manage the cluster-wide software installation.
Please visit here for the live status of XMAS cluster.