Commit Graph

171 Commits

Author SHA1 Message Date
Niels Geens
8fb30c8ed0 Optimized hot-loop for logits processor 2025-04-09 11:59:26 +02:00
654c32c7ac wip logits processor in ruuuuuuust 2025-04-08 06:34:03 +00:00
3826c45240 Made xml schema validator send 2025-04-07 19:27:03 +02:00
Niels Geens
2d4a57a706 Changed standard output of collect.sh to collect.txt 2025-04-07 16:52:12 +02:00
2e08be4b75 Validator works for start 2025-04-07 14:31:56 +00:00
Niels Geens
50539f6d03 Integrate logits processor with qwq (untested) 2025-04-07 13:35:20 +02:00
Niels Geens
023fc75aac Merge branch 'master' of https://git.nielsgeens.be/llm/SIA 2025-04-07 12:19:26 +02:00
Niels Geens
faf78b7948 Lock vllm version to avoid bug 2025-04-07 12:17:56 +02:00
Niels Geens
f4a17ad01e Lock vllm version to avoid bug 2025-04-07 11:57:15 +02:00
Niels Geens
cda067eb07 Removed jupyter venvs for all but train 2025-04-07 11:43:20 +02:00
Niels Geens
9c2d38e1a6 Fix install script, use correct venvs for jupyter 2025-04-07 11:36:41 +02:00
ead5c35a09 Added rust dependency to docker build 2025-04-06 22:41:34 +02:00
192ade72ee Fixed build on cloud 2025-04-06 14:46:42 +00:00
ea93adc4c8 Fix dockerfile for xml schema validator 2025-04-06 16:11:36 +02:00
55a920414d Begin XML Schema Validator 2025-04-05 23:15:39 +02:00
0e2cca2e4f Fixed QwQ tokenizer 2025-04-04 08:54:06 +00:00
156d3aa7d3 Bootstrapping QwQ works!! 2025-04-02 16:37:17 +00:00
Niels Geens
b4c08586ee Applied add_venvs_to_path.sh script to local runs 2025-04-02 18:05:48 +02:00
ed37792b62 Better path fix 2025-04-02 15:58:30 +00:00
ea22e1527e Fix bug where runpod environment file overwrites PATH 2025-04-02 14:47:33 +00:00
Niels Geens
e573b9ebe7 Removed flash-attn as dependency because it's hard to install properly 2025-04-02 14:42:35 +02:00
78c71ab8b4 Improved install experience 2025-04-01 15:26:50 +00:00
Niels Geens
c00256f723 Clean up install script 2025-04-01 16:30:42 +02:00
130afbdd92 Updates after testing 2025-04-01 11:49:21 +00:00
Niels Geens
6f3d414d17 Converted QwQ notebooks to .py files 2025-04-01 10:42:54 +02:00
642c5181bb Fixed inference notebook 2025-03-30 08:52:17 +00:00
290c718187 Added qwq inference notebook 2025-03-30 09:26:18 +02:00
30eb5c419d Updated QwQ train notebook 2025-03-29 11:03:53 +00:00
585f655ad3 Better error handling when sourcing bootstrap script 2025-03-29 10:38:25 +01:00
56242496bb Add support for jupyter notebooks for training 2025-03-28 16:10:43 +00:00
468ef2ae1f configure git username and email in bootstrap script 2025-03-28 15:09:37 +00:00
Niels Geens
4ce27f6798 Switched to vscode server image 2025-03-28 15:43:54 +01:00
Niels Geens
606611d3ad Merge branch 'master' of https://git.nielsgeens.be/llm/SIA 2025-03-28 15:31:20 +01:00
Niels Geens
dd6fec8391 Switched to larger gpu 2025-03-28 15:31:00 +01:00
8975a54d58 WIP QwQ train 2025-03-24 15:46:54 +00:00
1ef32ed33e WIP manual implementation of QwQ finetune 2025-03-24 12:05:43 +00:00
3594c8150a WIP Simplify training 2025-03-24 10:53:51 +00:00
Niels Geens
8d9d3ca576 Use PAT to authenticate 2025-03-20 14:42:42 +01:00
9a171ab622 Fixes for QwQ training 2025-03-20 09:41:02 +01:00
Niels Geens
92b0ff3aa0 Increased runpod volume size 2025-03-18 09:53:15 +01:00
Niels Geens
3ea5ba87a9 Fix venv add to path 2025-03-18 09:46:16 +01:00
Niels Geens
5c1ef4d9e7 More improvements to bootstrap 2025-03-17 10:38:36 +01:00
Niels Geens
2d655781c8 Fixed github_keys and deploy scripts 2025-03-17 10:14:41 +01:00
Niels Geens
d5a5fd1071 Simplified bootstrapping 2025-03-14 15:53:27 +01:00
Niels Geens
5c95a8482f Added script to start runpod 2025-03-14 11:22:45 +01:00
Niels Geens
2e66020f8e Replaced deepseek with qwq 2025-03-14 11:22:30 +01:00
Niels Geens
3ea3239a9b wip deepseek train 2025-03-03 16:57:04 +01:00
b64f8d7d33 wip deepseek r1 2025-03-02 22:01:24 +01:00
b7e95d7398 Added restart script and fixed dockerfile and run to match docs 2025-03-01 13:29:17 +01:00
Niels Geens
1d5b687e00 Improved collect script with better filtering 2025-02-27 17:09:38 +01:00