|
|
36d718d326
|
Test train qwen 3
|
2025-04-29 10:17:03 +00:00 |
|
|
|
e2e346d134
|
Implement 4-bit quant for train script and inference
|
2025-04-23 16:43:55 +00:00 |
|
|
|
41c336165f
|
Updated notebooks to support 4-bit quantization
|
2025-04-23 16:37:10 +00:00 |
|
|
|
d7c340a937
|
Updated notebooks wip
|
2025-04-23 10:32:33 +00:00 |
|
|
|
3e471eced3
|
Use Unsloth for QwQ inference
|
2025-04-21 10:42:35 +00:00 |
|
|
|
64fc621d44
|
Fix error print in dataset
|
2025-04-18 12:42:24 +00:00 |
|
|
|
5e47200ece
|
Fixes for QwQ llm engine
|
2025-04-18 12:30:47 +00:00 |
|
Niels Geens
|
faf78b7948
|
Lock vllm version to avoid bug
|
2025-04-07 12:17:56 +02:00 |
|
|
|
0e2cca2e4f
|
Fixed QwQ tokenizer
|
2025-04-04 08:54:06 +00:00 |
|
|
|
156d3aa7d3
|
Bootstrapping QwQ works!!
|
2025-04-02 16:37:17 +00:00 |
|
Niels Geens
|
e573b9ebe7
|
Removed flash-attn as dependency because it's hard to install properly
|
2025-04-02 14:42:35 +02:00 |
|
|
|
130afbdd92
|
Updates after testing
|
2025-04-01 11:49:21 +00:00 |
|
Niels Geens
|
6f3d414d17
|
Converted QwQ notebooks to .py files
|
2025-04-01 10:42:54 +02:00 |
|
|
|
642c5181bb
|
Fixed inference notebook
|
2025-03-30 08:52:17 +00:00 |
|
|
|
290c718187
|
Added qwq inference notebook
|
2025-03-30 09:26:18 +02:00 |
|
|
|
30eb5c419d
|
Updated QwQ train notebook
|
2025-03-29 11:03:53 +00:00 |
|
|
|
56242496bb
|
Add support for jupyter notebooks for training
|
2025-03-28 16:10:43 +00:00 |
|
|
|
8975a54d58
|
WIP QwQ train
|
2025-03-24 15:46:54 +00:00 |
|
|
|
1ef32ed33e
|
WIP manual implementation of QwQ finetune
|
2025-03-24 12:05:43 +00:00 |
|
|
|
3594c8150a
|
WIP Simplify training
|
2025-03-24 10:53:51 +00:00 |
|
|
|
9a171ab622
|
Fixes for QwQ training
|
2025-03-20 09:41:02 +01:00 |
|
Niels Geens
|
3ea5ba87a9
|
Fix venv add to path
|
2025-03-18 09:46:16 +01:00 |
|
Niels Geens
|
2e66020f8e
|
Replaced deepseek with qwq
|
2025-03-14 11:22:30 +01:00 |
|
Niels Geens
|
3ea3239a9b
|
wip deepseek train
|
2025-03-03 16:57:04 +01:00 |
|
|
|
b64f8d7d33
|
wip deepseek r1
|
2025-03-02 22:01:24 +01:00 |
|
|
|
b7e95d7398
|
Added restart script and fixed dockerfile and run to match docs
|
2025-03-01 13:29:17 +01:00 |
|
Niels Geens
|
4fcb32e6a1
|
Added tool for finetuning mistral model based on training config
|
2025-01-24 11:05:23 +01:00 |
|
