ColdSnap documentation

ColdSnap is a manager-driven snapshot and memory-lifecycle system for distributed vLLM and SGLang inference. These docs cover the supported path from a first capture through operator integration and low-level formats.

Pre-release qualification boundary

ColdSnap is pre-release research software. Compatibility is limited to explicitly qualified engine, model, CUDA, driver, hardware, and topology combinations. Start with the current benchmark and qualification boundary.

Start with Sparkrun

Follow the quickstart to capture and restore a placed workload with the reference manager.

Understand the system

Read the architecture overview for the manager, controller, engine, and runtime boundaries.

Operate it safely

Review configuration and recovery-aware operations.

Integrate a manager

Implement the operator integration contract and host-provider protocol.

Choose your path

Running a workload

Use the five-minute quickstart first, then move to the complete capture, publish, and restore guide.

Operating ColdSnap

Start with the build and distribution model, supported configuration, and the operational checks in the usage guide.

Building an integration

Read the operator contract, execution topology, and host-provider protocol together.

Current public surface

• Engines: vLLM and SGLang.
• Reference manager: Sparkrun.
• Artifacts: driver-qualified OCI capsules with large model weights kept separate.
• Snapshot drivers: n580 and n610, subject to their individual admission and qualification rules.
• License: AGPL-3.0-only.