simcop2387/llama-swap-infra
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages 8 Wiki Activity Actions
No description
709 commits 3 branches 3 tags 1.4 MiB
Find a file
Exact
Ryan Voots bbd397bb21
Some checks failed
/ deploy-litellm (push) Failing after 2m44s
Details
Some clean up and also additional work on the qwen3.5 122b models
2026-03-02 20:17:04 -05:00
.forgejo/workflows Add some cleanup stuff here 2026-02-26 11:04:24 -05:00
ComfyUI@dfbf99a061 Auto updated submodule references 2026-03-02 05:31:16 +00:00
config-gen
ik_llama.cpp@a568e12c8f Auto updated submodule references 2026-03-02 05:31:16 +00:00
litellm-llama-swap-terraform@7ab7f9354d bring in fixed orphan script 2026-02-26 15:33:50 -05:00
llama-swap@cc77139ff8 Ugh, stupid me, upgrade the llama-swap properly for once 2026-03-02 05:16:19 -05:00
llama.cpp@319146247e Auto updated submodule references 2026-03-02 05:31:16 +00:00
prompt-templates Attempt at this with chatml template bits 2026-02-04 15:35:40 -05:00
swap-configs Some clean up and also additional work on the qwen3.5 122b models 2026-03-02 20:17:04 -05:00
vllm-mirror@7e9149d9a9 Update vllm-mirror, gonna attempt adding some vllm-omni stuff after this 2026-03-02 09:56:31 -05:00
.gitmodules Ugh, stupid me, upgrade the llama-swap properly for once 2026-03-02 05:16:19 -05:00
.yamllint.yml Fixup some linting stuff and continue adding comfyui 2026-02-21 09:16:00 -05:00
AGENTS.md
base-image.Containerfile
combined.Containerfile
comfyui-image.Containerfile remove the gallery, no user isolation right now; 2026-02-24 12:06:40 -05:00
compose-base.yml no v 2026-03-02 09:12:00 -05:00
compose-brainiac.yml setup ulimit for core files, ugh 2026-02-26 07:47:39 -05:00
compose-manchester.yml
data.json
ik-llama-server.Containerfile
llama-server.Containerfile
llama-swap.Containerfile
notes_for_comfyui-qwen3-tts.txt
qwen3-tts-server.sh
README.md
run-comfy.sh
send_komodo_webhook.sh
vllm-image.Containerfile

README.md

A set of configs and container builds for llama-swap on my custom infrastructure. Soon to add sdome arm64 stuff for a jetson xavier but not ready yet for that.