Commit Graph

49 Commits

Author SHA1 Message Date
d4a4902b94 New web interface, move llm engine to separate process 2025-05-20 09:43:17 +02:00
f8365ef698 Fixes from runpod 2025-05-06 20:35:30 +02:00
c41a86a00a Gemma inference with llama.cpp and logits processor 2025-05-06 20:31:42 +02:00
f61c9ab15f Add inference in notebook 2025-05-02 19:32:03 +00:00
f1f1a42fb3 Fixes after local testing 2025-05-02 18:28:07 +02:00
e78fca8233 Gemma notebook working on runpod 2025-05-02 17:05:28 +02:00
Niels Geens
ff6a6ab135 Add bitsandbytes to gemma notebook 2025-05-01 10:46:33 +02:00
Niels Geens
95546208e8 Gemma notebook 2025-04-30 13:36:24 +02:00
8544f12d41 Added example notebook 2025-04-29 14:58:27 +00:00
36d718d326 Test train qwen 3 2025-04-29 10:17:03 +00:00
e2e346d134 Implement 4-bit quant for train script and inference 2025-04-23 16:43:55 +00:00
41c336165f Updated notebooks to support 4-bit quantization 2025-04-23 16:37:10 +00:00
d7c340a937 Updated notebooks wip 2025-04-23 10:32:33 +00:00
3e471eced3 Use Unsloth for QwQ inference 2025-04-21 10:42:35 +00:00
64fc621d44 Fix error print in dataset 2025-04-18 12:42:24 +00:00
5e47200ece Fixes for QwQ llm engine 2025-04-18 12:30:47 +00:00
Niels Geens
faf78b7948 Lock vllm version to avoid bug 2025-04-07 12:17:56 +02:00
0e2cca2e4f Fixed QwQ tokenizer 2025-04-04 08:54:06 +00:00
156d3aa7d3 Bootstrapping QwQ works!! 2025-04-02 16:37:17 +00:00
Niels Geens
e573b9ebe7 Removed flash-attn as dependency because it's hard to install properly 2025-04-02 14:42:35 +02:00
130afbdd92 Updates after testing 2025-04-01 11:49:21 +00:00
Niels Geens
6f3d414d17 Converted QwQ notebooks to .py files 2025-04-01 10:42:54 +02:00
642c5181bb Fixed inference notebook 2025-03-30 08:52:17 +00:00
290c718187 Added qwq inference notebook 2025-03-30 09:26:18 +02:00
30eb5c419d Updated QwQ train notebook 2025-03-29 11:03:53 +00:00
56242496bb Add support for jupyter notebooks for training 2025-03-28 16:10:43 +00:00
8975a54d58 WIP QwQ train 2025-03-24 15:46:54 +00:00
1ef32ed33e WIP manual implementation of QwQ finetune 2025-03-24 12:05:43 +00:00
3594c8150a WIP Simplify training 2025-03-24 10:53:51 +00:00
9a171ab622 Fixes for QwQ training 2025-03-20 09:41:02 +01:00
Niels Geens
3ea5ba87a9 Fix venv add to path 2025-03-18 09:46:16 +01:00
Niels Geens
2e66020f8e Replaced deepseek with qwq 2025-03-14 11:22:30 +01:00
Niels Geens
3ea3239a9b wip deepseek train 2025-03-03 16:57:04 +01:00
b64f8d7d33 wip deepseek r1 2025-03-02 22:01:24 +01:00
b7e95d7398 Added restart script and fixed dockerfile and run to match docs 2025-03-01 13:29:17 +01:00
Niels Geens
4fcb32e6a1 Added tool for finetuning mistral model based on training config 2025-01-24 11:05:23 +01:00
3058820668 Merge branch 'master' of https://git.nielsgeens.be/llm/SIA 2025-01-16 14:37:10 +01:00
fffdefcd92 More updates to itb (wip) 2025-01-16 14:36:37 +01:00
Niels Geens
6669b7a682 Fixed timestamp timezone for entry id's 2025-01-02 16:52:43 +01:00
e0bc7a7159 Update to itb_screenshot and friends 2024-12-27 17:07:19 +01:00
fe72969b4f Cleanup of itb readme 2024-12-26 18:19:27 +01:00
63d1264f5a Continue work on itb 2024-12-26 17:36:59 +01:00
eadd4eeabe Merge branch 'master' of https://git.nielsgeens.be/llm/SIA 2024-12-18 15:49:26 +01:00
Niels Geens
cdd0c701f9 WIP itb_click 2024-12-13 10:33:52 +01:00
2499d7b83f Added itb_scroll 2024-12-08 10:54:37 +01:00
928c1e14b9 First version of itb_screenshot 2024-12-08 10:40:28 +01:00
Niels Geens
6ab61ed384 ITB WIP 2024-12-08 09:51:43 +01:00
da8583ab28 ITP WiP 2024-12-04 17:19:46 +01:00
bad926089d Start work on ITB and webbrowsing 2024-12-01 15:07:23 +01:00