This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong. # llama.cpp on dreamflasher - admin: @diamond - addresses: - external: https://llama-cpp.dreamflasher.dma.space/ (login required) - internal: http://dreamflasher.int.dma.computer:12345/ - deployment: https://codeberg.org/dma/infra/src/commit/main/nixos/machines/dreamflasher/_llama-server.nix ## Inference Engine - tool: llama.cpp - model name: Qwen/Qwen3.6-35B-A3B (`Qwen3.6-35B-A3B-UD-IQ2_XXS.gguf`) - model size: 10.01 GB - context size: 131,072 tokens - training context: 262,144 tokens - parameters: 34.66B - embedding size: 2,048 - vocabulary size: 248,320 tokens - parallel slots: 4 ## Usage Guidelines - Do not use this for illegal stuff! (If you did, no you didn't.) - Use AI ethically: don't generate infinite slop, don't create/distribute AI art (eww), etc. etc. - TODO: expand I'm hosting this to allow people to have something to play and learn with, without needing the money to pay for an AI subscription service. When using this, please keep that in mind! It is a **shared** service, so don't hog all of its resources for yourself. > **Note**: We don't store chat history. Inference is done completely offline.