1613 commits

Author	SHA1	Message	Date
oobabooga	1dd4aedbe1	Fix the streaming_llm UI checkbox not being interactive	2025-04-29 05:28:46 -07:00
oobabooga	d10bded7f8	UI: Add an enable_thinking option to enable/disable Qwen3 thinking	2025-04-28 22:37:01 -07:00
oobabooga	1ee0acc852	llama.cpp: Make --verbose print the llama-server command	2025-04-28 15:56:25 -07:00
oobabooga	15a29e99f8	Lint	2025-04-27 21:41:34 -07:00
oobabooga	be13f5199b	UI: Add an info message about how to use Speculative Decoding	2025-04-27 21:40:38 -07:00
oobabooga	c6c2855c80	llama.cpp: Remove the timeout while loading models (closes #6907)	2025-04-27 21:22:21 -07:00
oobabooga	ee0592473c	Fix ExLlamaV3_HF leaking memory (attempt)	2025-04-27 21:04:02 -07:00
oobabooga	70952553c7	Lint	2025-04-26 19:29:08 -07:00
oobabooga	7b80acd524	Fix parsing --extra-flags	2025-04-26 18:40:03 -07:00
oobabooga	943451284f	Fix the Notebook tab not loading its default prompt	2025-04-26 18:25:06 -07:00
oobabooga	511eb6aa94	Fix saving settings to settings.yaml	2025-04-26 18:20:00 -07:00
oobabooga	8b83e6f843	Prevent Gradio from saying 'Thank you for being a Gradio user!'	2025-04-26 18:14:57 -07:00
oobabooga	4a32e1f80c	UI: show draft_max for ExLlamaV2	2025-04-26 18:01:44 -07:00
oobabooga	0fe3b033d0	Fix parsing of --n_ctx and --max_seq_len (2nd attempt)	2025-04-26 17:52:21 -07:00
oobabooga	c4afc0421d	Fix parsing of --n_ctx and --max_seq_len	2025-04-26 17:43:53 -07:00
oobabooga	234aba1c50	llama.cpp: Simplify the prompt processing progress indicator ... The progress bar was unreliable	2025-04-26 17:33:47 -07:00
oobabooga	4ff91b6588	Better default settings for Speculative Decoding	2025-04-26 17:24:40 -07:00
oobabooga	bc55feaf3e	Improve host header validation in local mode	2025-04-26 15:42:17 -07:00
oobabooga	3a207e7a57	Improve the --help formatting a bit	2025-04-26 07:31:04 -07:00
oobabooga	6acb0e1bee	Change a UI description	2025-04-26 05:13:08 -07:00
oobabooga	cbd4d967cc	Update a --help message	2025-04-26 05:09:52 -07:00
oobabooga	763a7011c0	Remove an ancient/obsolete migration check	2025-04-26 04:59:05 -07:00
oobabooga	d9de14d1f7	Restructure the repository (#6904)	2025-04-26 08:56:54 -03:00
oobabooga	d4017fbb6d	ExLlamaV3: Add kv cache quantization (#6903)	2025-04-25 21:32:00 -03:00
oobabooga	d4b1e31c49	Use --ctx-size to specify the context size for all loaders ... Old flags are still recognized as alternatives.	2025-04-25 16:59:03 -07:00
oobabooga	faababc4ea	llama.cpp: Add a prompt processing progress bar	2025-04-25 16:42:30 -07:00
oobabooga	877cf44c08	llama.cpp: Add StreamingLLM (--streaming-llm)	2025-04-25 16:21:41 -07:00
oobabooga	d35818f4e1	UI: Add a collapsible thinking block to messages with <think> steps (#6902)	2025-04-25 18:02:02 -03:00
oobabooga	98f4c694b9	llama.cpp: Add --extra-flags parameter for passing additional flags to llama-server	2025-04-25 07:32:51 -07:00
oobabooga	5861013e68	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2025-04-24 20:36:20 -07:00
oobabooga	a90df27ff5	UI: Add a greeting when the chat history is empty	2025-04-24 20:33:40 -07:00
oobabooga	ae1fe87365	ExLlamaV2: Add speculative decoding (#6899)	2025-04-25 00:11:04 -03:00
Matthew Jenkins	8f2493cc60	Prevent llamacpp defaults from locking up consumer hardware (#6870)	2025-04-24 23:38:57 -03:00
oobabooga	93fd4ad25d	llama.cpp: Document the --device-draft syntax	2025-04-24 09:20:11 -07:00
oobabooga	f1b64df8dd	EXL2: add another torch.cuda.synchronize() call to prevent errors	2025-04-24 09:03:49 -07:00
oobabooga	c71a2af5ab	Handle CMD_FLAGS.txt in the main code (closes #6896)	2025-04-24 08:21:06 -07:00
oobabooga	bfbde73409	Make 'instruct' the default chat mode	2025-04-24 07:08:49 -07:00
oobabooga	e99c20bcb0	llama.cpp: Add speculative decoding (#6891)	2025-04-23 20:10:16 -03:00
oobabooga	9424ba17c8	UI: show only part 00001 of multipart GGUF models in the model menu	2025-04-22 19:56:42 -07:00
oobabooga	25cf3600aa	Lint	2025-04-22 08:04:02 -07:00
oobabooga	39cbb5fee0	Lint	2025-04-22 08:03:25 -07:00
oobabooga	008c6dd682	Lint	2025-04-22 08:02:37 -07:00
oobabooga	78aeabca89	Fix the transformers loader	2025-04-21 18:33:14 -07:00
oobabooga	8320190184	Fix the exllamav2_HF and exllamav3_HF loaders	2025-04-21 18:32:23 -07:00
oobabooga	15989c2ed8	Make llama.cpp the default loader	2025-04-21 16:36:35 -07:00
oobabooga	86c3ed3218	Small change to the unload_model() function	2025-04-20 20:00:56 -07:00
oobabooga	fe8e80e04a	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2025-04-20 19:09:27 -07:00
oobabooga	ff1c00bdd9	llama.cpp: set the random seed manually	2025-04-20 19:08:44 -07:00
Matthew Jenkins	d3e7c655e5	Add support for llama-cpp builds from https://github.com/ggml-org/llama.cpp (#6862)	2025-04-20 23:06:24 -03:00
oobabooga	e243424ba1	Fix an import	2025-04-20 17:51:28 -07:00