Commit Graph

8 Commits

Author SHA1 Message Date
e71bd7e9eb Allow stopping of inference 2024-11-30 12:44:13 +01:00
Niels Geens
8766a945c0 Enable multiple llms 2024-11-22 15:05:54 +01:00
Niels Geens
03cf69d272 Added iteration_logger 2024-11-19 20:24:21 +01:00
Niels Geens
4ce421bbce Fixed context usage calculation 2024-11-14 18:23:33 +01:00
Niels Geens
aa37182614 Added temperature argument 2024-11-13 11:51:02 +01:00
babc1c44b9 Renamed hf-api-token to api-token 2024-11-11 13:25:39 +01:00
Niels Geens
970414e56d Basic web loop works 2024-11-07 15:10:17 +01:00
Niels Geens
70ed16f8ab Added hf_llm_engine and config 2024-11-04 17:08:52 +01:00