simcop2387/llama-swap-infra
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages 8 Wiki Activity Actions 1
No description
835 commits 3 branches 11 tags 808 KiB
  • Jinja 61.2%
  • Dockerfile 26.2%
  • Perl 11.4%
  • Shell 1.2%
Find a file
Exact
Git bot cf219b393b
Some checks are pending
/ Clean up stuff (push) Blocked by required conditions
Details
/ build-vllm (push) Successful in 23m32s
Details
/ build-swap (push) Successful in 21m8s
Details
/ build-comfyui (push) Successful in 27m50s
Details
/ build-llama-server (push) Successful in 1h28m33s
Details
/ build-ik-llama-server (push) Successful in 2h16m26s
Details
/ build-combined (push) Has started running
Details
Auto updated submodule references
2026-04-18 05:31:38 +00:00
.forgejo/workflows Add the python venv bits i need 2026-04-11 19:29:38 -04:00
ComfyUI@3086026401 Auto updated submodule references 2026-04-18 05:31:38 +00:00
config-gen Generates what looks like a working config now 2025-05-24 19:20:57 -04:00
ik_llama.cpp@52efa12fda Auto updated submodule references 2026-04-18 05:31:38 +00:00
litellm-llama-swap-terraform@c7af62dba6 Add the python venv bits i need 2026-04-11 19:29:38 -04:00
llama-swap@c3f0d43e6e Auto updated submodule references 2026-04-18 05:31:38 +00:00
llama.cpp@45cac7ca70 Auto updated submodule references 2026-04-18 05:31:38 +00:00
prompt-templates Attempt at this with chatml template bits 2026-02-04 15:35:40 -05:00
swap-configs not happy with the way that other way, do it this way 2026-04-02 15:07:37 -04:00
vllm-mirror@bcc6f67447 upgrade vllm bits to 0.18.X for jina embed v5 2026-04-01 09:06:44 -04:00
.gitmodules try swapping to https? 2026-03-29 10:58:24 -04:00
.yamllint.yml Fixup some linting stuff and continue adding comfyui 2026-02-21 09:16:00 -05:00
AGENTS.md chore: add agents configuration documentation 2026-01-16 09:10:54 -05:00
base-image.Containerfile mostly rework the python stuff, not building proper combined image yet 2026-03-03 17:51:01 -05:00
combined.Containerfile ugh wrong one 2026-03-12 11:21:54 -04:00
comfyui-image.Containerfile Redo the fucking comfyui bits because theyve changed stuff that makes it impossible to build the old way. need to investigate how to otherwise build it from my local copy still 2026-03-30 09:55:42 -04:00
compose-base.yml Try switching... 2026-03-30 19:08:30 -04:00
compose-brainiac.yml Revert "disable these two temporarily for safety" 2026-03-30 19:45:44 -04:00
compose-manchester.yml update manchester a bit again 2026-03-31 11:09:01 -04:00
data.json small changes, see how this helps 2025-08-13 10:39:41 -04:00
ik-llama-server.Containerfile fix accidental comfy dep 2026-03-06 18:47:00 -05:00
llama-server.Containerfile fix accidental comfy dep 2026-03-06 18:47:00 -05:00
llama-swap.Containerfile separated base image piece 2025-11-30 13:29:37 -05:00
notes_for_comfyui-qwen3-tts.txt Temporary notes and changes for qwen3tts comfy 2026-01-26 19:26:52 -05:00
qwen3-tts-server.sh Doh! use exec to make unloading work more reliably! 2026-01-26 12:45:42 -05:00
README.md add readme to see what happens with actions 2025-08-14 14:03:26 -04:00
run-comfy.sh mostly rework the python stuff, not building proper combined image yet 2026-03-03 17:51:01 -05:00
send_komodo_webhook.sh Add automatic deploy webhook also 2025-08-14 14:16:58 -04:00
vllm-image.Containerfile fix version here 2026-04-01 09:52:48 -04:00

README.md

A set of configs and container builds for llama-swap on my custom infrastructure. Soon to add sdome arm64 stuff for a jetson xavier but not ready yet for that.