17 Commits

Author SHA1 Message Date
4e50d1f7c4 Use Vulkan 2026-01-10 19:52:41 +01:00
d4a4902b94 New web interface, move llm engine to separate process 2025-05-20 09:43:17 +02:00
ff82173f2a Removed auto enable for QwQ 2025-04-13 09:56:01 +02:00
130afbdd92 Updates after testing 2025-04-01 11:49:21 +00:00
Niels Geens
d5a5fd1071 Simplified bootstrapping 2025-03-14 15:53:27 +01:00
Niels Geens
2e66020f8e Replaced deepseek with qwq 2025-03-14 11:22:30 +01:00
b64f8d7d33 wip deepseek r1 2025-03-02 22:01:24 +01:00
b7e95d7398 Added restart script and fixed dockerfile and run to match docs 2025-03-01 13:29:17 +01:00
da8583ab28 ITP WiP 2024-12-04 17:19:46 +01:00
e71bd7e9eb Allow stopping of inference 2024-11-30 12:44:13 +01:00
Niels Geens
8766a945c0 Enable multiple llms 2024-11-22 15:05:54 +01:00
Niels Geens
03cf69d272 Added iteration_logger 2024-11-19 20:24:21 +01:00
Niels Geens
4ce421bbce Fixed context usage calculation 2024-11-14 18:23:33 +01:00
Niels Geens
aa37182614 Added temperature argument 2024-11-13 11:51:02 +01:00
babc1c44b9 Renamed hf-api-token to api-token 2024-11-11 13:25:39 +01:00
Niels Geens
970414e56d Basic web loop works 2024-11-07 15:10:17 +01:00
Niels Geens
70ed16f8ab Added hf_llm_engine and config 2024-11-04 17:08:52 +01:00