Commit Graph

19 Commits

Author SHA1 Message Date
41c336165f Updated notebooks to support 4-bit quantization 2025-04-23 16:37:10 +00:00
d7c340a937 Updated notebooks wip 2025-04-23 10:32:33 +00:00
3e471eced3 Use Unsloth for QwQ inference 2025-04-21 10:42:35 +00:00
64fc621d44 Fix error print in dataset 2025-04-18 12:42:24 +00:00
5e47200ece Fixes for QwQ llm engine 2025-04-18 12:30:47 +00:00
0e2cca2e4f Fixed QwQ tokenizer 2025-04-04 08:54:06 +00:00
156d3aa7d3 Bootstrapping QwQ works!! 2025-04-02 16:37:17 +00:00
Niels Geens
e573b9ebe7 Removed flash-attn as dependency because it's hard to install properly 2025-04-02 14:42:35 +02:00
Niels Geens
6f3d414d17 Converted QwQ notebooks to .py files 2025-04-01 10:42:54 +02:00
642c5181bb Fixed inference notebook 2025-03-30 08:52:17 +00:00
290c718187 Added qwq inference notebook 2025-03-30 09:26:18 +02:00
30eb5c419d Updated QwQ train notebook 2025-03-29 11:03:53 +00:00
56242496bb Add support for jupyter notebooks for training 2025-03-28 16:10:43 +00:00
8975a54d58 WIP QwQ train 2025-03-24 15:46:54 +00:00
1ef32ed33e WIP manual implementation of QwQ finetune 2025-03-24 12:05:43 +00:00
3594c8150a WIP Simplify training 2025-03-24 10:53:51 +00:00
Niels Geens
2e66020f8e Replaced deepseek with qwq 2025-03-14 11:22:30 +01:00
Niels Geens
3ea3239a9b wip deepseek train 2025-03-03 16:57:04 +01:00
b64f8d7d33 wip deepseek r1 2025-03-02 22:01:24 +01:00