Niels Geens 9b2c2ece70 Flash attention in notebook

2025-04-23 19:38:56 +00:00

..

__init__.py

Shared response buffer backend

2025-04-17 18:32:23 +02:00

hf_llm_engine.py

Fixed auto approver and inference continuation

2025-04-18 11:36:17 +02:00

local_llm_engine.py

Fixed auto approver and inference continuation

2025-04-18 11:36:17 +02:00

mistral_llm_engine.py

Shared response buffer backend

2025-04-17 18:32:23 +02:00

openai_llm_engine.py

Fixed auto approver and inference continuation

2025-04-18 11:36:17 +02:00

qwq_llm_engine.ipynb

Flash attention in notebook

2025-04-23 19:38:56 +00:00

qwq_llm_engine.py

Implement 4-bit quant for train script and inference

2025-04-23 16:43:55 +00:00