Initial wiki landing page
commit
b9c4199bb5
1 changed files with 25 additions and 0 deletions
25
Home.md
Normal file
25
Home.md
Normal file
|
|
@ -0,0 +1,25 @@
|
|||
# ai-kraken
|
||||
|
||||
A NixOS live USB that boots a Windows workstation into a headless **AI mode**.
|
||||
|
||||
## What it is
|
||||
|
||||
- Target hardware: Windows machine with RTX 3080 Ti, 128 GB RAM
|
||||
- Boot medium: USB stick (UEFI, Secure Boot off)
|
||||
- Runtime: NixOS live environment, headless, SSH-only
|
||||
- Workload: Ollama (CUDA) serving 7B-class models
|
||||
- Storage model: MinIO on the LAN is the source of truth; models land in `tmpfs` during a session
|
||||
|
||||
## Design
|
||||
|
||||
See the design document in the main repo: `docs/specs/2026-04-19-nixos-ai-live-usb-design.md`.
|
||||
|
||||
## Wiki sections (planned)
|
||||
|
||||
- **Runbook** — how to boot, SSH in, pull a model, recover from common failures
|
||||
- **MinIO bucket layout** — conventions for `models/<name>/model.gguf` + `Modelfile`
|
||||
- **BIOS prerequisites** — Secure Boot, BitLocker suspension, boot order
|
||||
- **Build & flash** — from scratch on a new laptop
|
||||
- **Model catalog** — which 7B quants are known to work well on the 3080 Ti
|
||||
|
||||
These get filled in as the project takes shape.
|
||||
Loading…
Reference in a new issue