Docker, Singularity, and HPC.

Containers Containers are environments that are intended to be lightweight and standalone software, with isolation from the host machine, which ensures that containers work uniformly across different staging and development instances. Containers share the host OS’s kernel and do not require an OS per application, which is a key difference between containers and virtual machines, which otherwise share a lot of similarities. A very basic overview of container architecture. ...

June 17, 2023 · 7 min · Naveen Kannan

SLURM and HPC.

SLURM Workload Manager SLURM (formerly known as Simple Linux Utility for Resource Management) is an open-source job scheduling system for Linux clusters. It does not require kernel modification and is relatively self contained. It has three key functions: Allocation of access to resources (compute nodes) to users for a defined period of time. Providing a framework that allows for starting and executing jobs, including parallel computing processes. Queue management to arbitrate resource contention. ...

June 15, 2023 · 5 min · Naveen Kannan