simcop2387/llama-swap-infra
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages 7 Wiki Activity Actions 1
No description
327 commits 3 branches 0 tags 499 KiB
Find a file
Exact
Git bot 86f6939784
Some checks are pending
/ build-llama-server (push) Blocked by required conditions
Details
/ build-swap (push) Successful in 59s
Details
/ build-combined (push) Blocked by required conditions
Details
/ build-vllm (push) Successful in 1m1s
Details
/ build-comfyui (push) Has started running
Details
Auto updated submodule references
2025-12-01 17:33:52 +00:00
.forgejo/workflows separated base image piece 2025-11-30 13:29:37 -05:00
ComfyUI@f8b981ae9a Add comfyui submodule 2025-11-30 12:49:12 -05:00
config-gen Generates what looks like a working config now 2025-05-24 19:20:57 -04:00
llama-swap@dea98733c3 Auto updated submodule references 2025-12-01 05:31:40 +00:00
llama.cpp@7733409734 Auto updated submodule references 2025-12-01 17:33:52 +00:00
swap-configs Add vl models to a6000 for testing, might move the 4b to an a16 once i see performance 2025-11-13 16:43:36 -05:00
vllm-mirror@092bb73b8a Auto updated submodule references 2025-12-01 17:33:52 +00:00
.gitmodules Add comfyui submodule 2025-11-30 12:49:12 -05:00
base-image.Containerfile some clean up 2025-11-30 08:14:01 -05:00
combined.Containerfile separated base image piece 2025-11-30 13:29:37 -05:00
comfyui-image.Containerfile separated base image piece 2025-11-30 13:29:37 -05:00
compose-base.yml Move to today for more features, allow for Qwen3-vl in particular 2025-11-13 16:27:19 -05:00
compose-brainiac.yml Fix interpolation 2025-11-06 11:07:58 -05:00
compose-manchester.yml Add to manchester 2025-08-19 07:59:27 -04:00
data.json small changes, see how this helps 2025-08-13 10:39:41 -04:00
llama-server.Containerfile separated base image piece 2025-11-30 13:29:37 -05:00
llama-swap.Containerfile separated base image piece 2025-11-30 13:29:37 -05:00
README.md add readme to see what happens with actions 2025-08-14 14:03:26 -04:00
send_komodo_webhook.sh Add automatic deploy webhook also 2025-08-14 14:16:58 -04:00
vllm-image.Containerfile separated base image piece 2025-11-30 13:29:37 -05:00

README.md

A set of configs and container builds for llama-swap on my custom infrastructure. Soon to add sdome arm64 stuff for a jetson xavier but not ready yet for that.