nix world
- Nix 99.9%
- Just 0.1%
Catalogue (lib/ai-models.nix), 41 -> 61 models:
- general: gpt-oss-20b (native mxfp4 + unsloth UD), granite-4.1-8b
- edge/on-device: qwen3.5-4b, gemma4-e4b, smollm3-3b, granite-4.1-3b,
lfm2.5-8b-a1b
- reasoning: nemotron-3-nano-4b, olmo-3-7b-think
- coding: seed-coder-8b
- vision: minicpm-v-4.6
- embedding: qwen3-embedding 0.6b/4b, embeddinggemma-300m
- reranker (new category): qwen3-reranker-0.6b, bge-reranker-v2-m3
- roleplay: cydonia-24b, rocinante-x-12b, gemmasutra-mini-2b
All pinned to real HF revs with SRI hashes sourced from LFS pointers.
Module (profiles/features/ai.nix):
- mkCmd branches by serving mode (chat/embedding/reranker) and passes
--mmproj for vision models. Mode is derived from catalogue category;
embedding -> --embeddings, reranker -> --reranking --pooling rank.
- New optional catalogue field `mmproj = { file; hash; }`, fetched as a
second derivation from the model's repo/rev. Wired into all 7 multimodal
models (the 3 pre-existing vision ones were silently text-only before).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
|
||
|---|---|---|
| assets | ||
| hosts/live | ||
| lib | ||
| pkgs | ||
| profiles | ||
| .gitignore | ||
| flake.lock | ||
| flake.nix | ||
| justfile | ||
| README.md | ||
| renovate.json | ||
myverse
A complete, opinionated Nix ecosystem. The premise: Nix everywhere — every device, every app, every container, every piece of infrastructure. Declared, reproducible, yours.
Opinionated defaults, clean override points. Import a device class, layer on features, get a working system.
Structure
- Device classes & feature modules — composable NixOS profiles
- Library — Nix abstractions, system builders, and beyond
- Packages — curated packages not in nixpkgs
💿 Live ISO
nix-shell -p nixos-generators --run "nixos-generate --format iso --flake .#live -o result"