Niels Geens bf94a0838a Enable 2x faster inference with unsloth

2025-04-22 11:47:27 +02:00

..

__init__.py

Shared response buffer backend

2025-04-17 18:32:23 +02:00

hf_llm_engine.py

Fixed auto approver and inference continuation

2025-04-18 11:36:17 +02:00

local_llm_engine.py

Fixed auto approver and inference continuation

2025-04-18 11:36:17 +02:00

mistral_llm_engine.py

Shared response buffer backend

2025-04-17 18:32:23 +02:00

openai_llm_engine.py

Fixed auto approver and inference continuation

2025-04-18 11:36:17 +02:00

qwq_llm_engine.ipynb

Use Unsloth for QwQ inference

2025-04-21 10:42:35 +00:00

qwq_llm_engine.py

Enable 2x faster inference with unsloth

2025-04-22 11:47:27 +02:00