ai-kraken
A NixOS live USB that boots a Windows workstation into a headless AI mode.
What it is
- Target hardware: Windows machine with RTX 3080 Ti, 128 GB RAM
- Boot medium: USB stick (UEFI, Secure Boot off)
- Runtime: NixOS live environment, headless, SSH-only
- Workload: Ollama (CUDA) serving 7B-class models
- Storage model: MinIO on the LAN is the source of truth; models land in
tmpfs during a session
Design
See the design document in the main repo: docs/specs/2026-04-19-nixos-ai-live-usb-design.md.
Wiki sections (planned)
- Runbook — how to boot, SSH in, pull a model, recover from common failures
- MinIO bucket layout — conventions for
models/<name>/model.gguf + Modelfile
- BIOS prerequisites — Secure Boot, BitLocker suspension, boot order
- Build & flash — from scratch on a new laptop
- Model catalog — which 7B quants are known to work well on the 3080 Ti
These get filled in as the project takes shape.