6 Commits

Author	SHA1	Message	Date
geens	e71bd7e9eb	Allow stopping of inference	2024-11-30 12:44:13 +01:00
geens	ef94d0d1a0	Added mistral llm engine	2024-11-17 16:53:44 +01:00
geens	506bc91639	Added api token for local llm	2024-11-16 22:09:04 +01:00
geens	c44d0ffbdf	Fixes for runpod test	2024-11-16 21:51:18 +01:00
Niels Geens	4ce421bbce	Fixed context usage calculation	2024-11-14 18:23:33 +01:00
Niels Geens	70ed16f8ab	Added hf_llm_engine and config	2024-11-04 17:08:52 +01:00