≪ View Page

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
infrastructure:llama-cpp-on-dreamflasher [2026/10/10 22:21] – diamondinfrastructure:llama-cpp-on-dreamflasher [2026/10/10 22:32] (current) – diamond
Line 2: Line 2:
  
 - admin: @diamond - admin: @diamond
-- address: https://llama-cpp.dreamflasher.dma.space/+- addresses: 
 +  - external: https://llama-cpp.dreamflasher.dma.space/ (login required) 
 +  - internal: http://dreamflasher.int.dma.computer:12345/
 - deployment: https://codeberg.org/dma/infra/src/commit/main/nixos/machines/dreamflasher/_llama-server.nix - deployment: https://codeberg.org/dma/infra/src/commit/main/nixos/machines/dreamflasher/_llama-server.nix
  
Line 8: Line 10:
  
 - tool: llama.cpp - tool: llama.cpp
-- model name: Qwen/Qwen3.6-35B-A3B+- model name: Qwen/Qwen3.6-35B-A3B (`Qwen3.6-35B-A3B-UD-IQ2_XXS.gguf`)
 - model size: 10.01 GB - model size: 10.01 GB
 - context size: 131,072 tokens - context size: 131,072 tokens
Line 26: Line 28:
  
 > **Note**: We don't store chat history. Inference is done completely offline. > **Note**: We don't store chat history. Inference is done completely offline.
 +
 +