79 commits

Author	SHA1	Message	Date
oobabooga	83bfd5c64b	Fix API issues	2025-05-18 12:45:01 -07:00
oobabooga	076aa67963	Fix API issues	2025-05-17 22:22:18 -07:00
oobabooga	470c822f44	API: Hide the uvicorn access logs from the terminal	2025-05-16 12:54:39 -07:00
oobabooga	c375b69413	API: Fix llama.cpp generating after disconnect, improve disconnect detection, fix deadlock on simultaneous requests	2025-05-13 11:23:33 -07:00
oobabooga	0c5fa3728e	Revert "Fix API failing to cancel streams (attempt), closes #6966" ... This reverts commit 006a866079.	2025-05-10 19:12:40 -07:00
oobabooga	006a866079	Fix API failing to cancel streams (attempt), closes #6966	2025-05-10 17:55:48 -07:00
oobabooga	bbcaec75b4	API: Find a new port if the default one is taken (closes #6918)	2025-04-27 21:13:16 -07:00
oobabooga	35717a088c	API: Add an /v1/internal/health endpoint	2025-04-26 15:42:27 -07:00
oobabooga	bc55feaf3e	Improve host header validation in local mode	2025-04-26 15:42:17 -07:00
oobabooga	d5e1bccef9	Remove the SpeechRecognition requirement	2025-04-20 11:47:28 -07:00
oobabooga	ae02ffc605	Refactor the transformers loader (#6859)	2025-04-20 13:33:47 -03:00
BPplays	619265b32c	add ipv6 support to the API (#6559)	2025-01-09 10:23:44 -03:00
oobabooga	f27e1ba302	Add a /v1/internal/chat-prompt endpoint (#5879)	2024-04-19 00:24:46 -03:00
oobabooga	6247eafcc5	API: better handle temperature = 0	2024-01-22 04:12:23 -08:00
Stefan Daniel Schwarz	232c07bf1f	API: set do_sample=false when temperature=0 (#5275)	2024-01-17 23:58:11 -03:00
Philipp Claßen	3eca20c015	Typo fixed in variable names (#5184)	2024-01-06 03:05:03 -03:00
oobabooga	23818dc098	Better logger ... Credits: vladmandic/automatic	2023-12-19 20:38:33 -08:00
oobabooga	b6d16a35b1	Minor API fix	2023-11-21 17:56:28 -08:00
oobabooga	771e62e476	Add /v1/internal/lora endpoints (#4652)	2023-11-19 00:35:22 -03:00
oobabooga	ef6feedeb2	Add --nowebui flag for pure API mode (#4651)	2023-11-18 23:38:39 -03:00
oobabooga	0fa1af296c	Add /v1/internal/logits endpoint (#4650)	2023-11-18 23:19:31 -03:00
oobabooga	8f4f4daf8b	Add --admin-key flag for API (#4649)	2023-11-18 22:33:27 -03:00
oobabooga	e0a7cc5e0f	Simplify CORS code	2023-11-16 20:11:55 -08:00
oobabooga	c0233bb9d3	Minor message change	2023-11-16 18:36:57 -08:00
oobabooga	510a01ef46	Lint	2023-11-16 18:03:06 -08:00
oobabooga	a475aa7816	Improve API documentation	2023-11-15 18:39:08 -08:00
oobabooga	a85ce5f055	Add more info messages for truncation / instruction template	2023-11-15 16:20:31 -08:00
oobabooga	be125e2708	Add /v1/internal/model/unload endpoint	2023-11-15 15:48:33 -08:00
oobabooga	c5be3f7acb	Make /v1/embeddings functional, add request/response types	2023-11-10 07:34:27 -08:00
oobabooga	4aabff3728	Remove old API, launch OpenAI API with --api	2023-11-10 06:39:08 -08:00
oobabooga	d86f1fd2c3	OpenAI API: stop streaming on client disconnect (closes #4521)	2023-11-09 06:37:32 -08:00
oobabooga	effb3aef42	Prevent deadlocks in OpenAI API with simultaneous requests	2023-11-08 20:55:39 -08:00
oobabooga	678fd73aef	Document /v1/internal/model/load and fix a bug	2023-11-08 17:41:12 -08:00
oobabooga	050ff36bd6	Revert "Add a comment to /v1/models" ... This reverts commit 38b07493a0.	2023-11-07 21:09:47 -08:00
oobabooga	38b07493a0	Add a comment to /v1/models	2023-11-07 21:07:12 -08:00
oobabooga	2358706453	Add /v1/internal/model/load endpoint (tentative)	2023-11-07 20:58:06 -08:00
oobabooga	43c53a7820	Refactor the /v1/models endpoint	2023-11-07 19:59:27 -08:00
oobabooga	1b69694fe9	Add types to the encode/decode/token-count endpoints	2023-11-07 19:32:14 -08:00
oobabooga	f6ca9cfcdc	Add /v1/internal/model-info endpoint	2023-11-07 18:59:02 -08:00
oobabooga	79b3f5a546	Add /v1/internal/stop-generation to OpenAI API (#4498)	2023-11-07 00:10:42 -03:00
oobabooga	b87c6213ae	Remove obsolete endpoint	2023-11-06 05:45:45 -08:00
oobabooga	ec17a5d2b7	Make OpenAI API the default API (#4430)	2023-11-06 02:38:29 -03:00
hronoas	db7ecdd274	openai: fix empty models list on query present in url (#4139)	2023-10-16 17:02:47 -03:00
Jesus Alvarez	ed66ca3cdf	Add HTTPS support to APIs (openai and default) (#4270) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-10-13 01:31:13 -03:00
Chenxiao Wang	347aed4254	extensions/openai: load extension settings via settings.yaml (#3953)	2023-09-17 22:39:29 -03:00
wizd	cc7f345c29	add whisper api to openai plugin (#3958)	2023-09-16 12:04:04 -03:00
oobabooga	8f97e87cac	Lint the openai extension	2023-09-15 20:11:16 -07:00
Chang Chi, Meng	b61d9aef19	openai API: add support for chunked transfer encoding in POST requests (#3870)	2023-09-12 15:54:42 -03:00
matatonic	8f98268252	extensions/openai: include content-length for json replies (#3416)	2023-08-03 16:10:49 -03:00
matatonic	9ae0eab989	extensions/openai: +Array input (batched) , +Fixes (#3309)	2023-08-01 22:26:00 -03:00