|
|
c22917e3c9
|
Fixes for 12B
|
2025-05-22 18:51:07 +00:00 |
|
Niels Geens
|
19dd9fa2ee
|
Fixes for saving the gemma tokenizer
|
2025-05-22 18:22:15 +02:00 |
|
Niels Geens
|
29b35ffccf
|
Fix download bootstrap for deploy
|
2025-05-22 10:35:38 +02:00 |
|
|
|
61f8b506bc
|
Download bootstrap file in deploy script
|
2025-05-21 14:32:47 +00:00 |
|
|
|
6c9d5f542b
|
Fix node install and make mock_llm script executable
|
2025-05-21 07:37:14 +02:00 |
|
|
|
cad8e17afd
|
Git ignore web build
|
2025-05-20 19:28:04 +00:00 |
|
|
|
db9dfdb1a5
|
Merge branch 'master' of https://git.nielsgeens.be/llm/SIA
|
2025-05-20 19:27:05 +00:00 |
|
|
|
dd3c809789
|
Fix train script
|
2025-05-20 19:26:33 +00:00 |
|
Niels Geens
|
f9117a8e5a
|
Add recursive flag to git clone in bootstrap
|
2025-05-20 21:25:25 +02:00 |
|
Niels Geens
|
f0c1d7732a
|
Switch to gemma 12
|
2025-05-20 20:47:57 +02:00 |
|
Niels Geens
|
f2c70cd05d
|
Gemma training script
|
2025-05-20 20:46:16 +02:00 |
|
|
|
d4a4902b94
|
New web interface, move llm engine to separate process
|
2025-05-20 09:43:17 +02:00 |
|
Niels Geens
|
895a533e01
|
Update readme for separate llm engine executables
|
2025-05-10 17:09:29 +02:00 |
|
|
|
f8365ef698
|
Fixes from runpod
|
2025-05-06 20:35:30 +02:00 |
|
|
|
c41a86a00a
|
Gemma inference with llama.cpp and logits processor
|
2025-05-06 20:31:42 +02:00 |
|
|
|
44fd60a6be
|
Added schema validator for llama.cpp
|
2025-05-06 18:46:28 +02:00 |
|
|
|
f61c9ab15f
|
Add inference in notebook
|
2025-05-02 19:32:03 +00:00 |
|
|
|
f1f1a42fb3
|
Fixes after local testing
|
2025-05-02 18:28:07 +02:00 |
|
|
|
e78fca8233
|
Gemma notebook working on runpod
|
2025-05-02 17:05:28 +02:00 |
|
|
|
f63e5db996
|
Move models directory
|
2025-05-01 17:28:59 +02:00 |
|
|
|
d022d41a5d
|
Update docker image
|
2025-05-01 17:28:33 +02:00 |
|
Niels Geens
|
ff6a6ab135
|
Add bitsandbytes to gemma notebook
|
2025-05-01 10:46:33 +02:00 |
|
|
|
72b902117c
|
Simplified bootstrap even more
|
2025-05-01 09:26:29 +02:00 |
|
Niels Geens
|
95546208e8
|
Gemma notebook
|
2025-04-30 13:36:24 +02:00 |
|
|
|
8544f12d41
|
Added example notebook
|
2025-04-29 14:58:27 +00:00 |
|
|
|
e07a62d488
|
Simplified bootstrap
|
2025-04-29 14:57:15 +00:00 |
|
Niels Geens
|
3557270c89
|
Merge branch 'master' of https://git.nielsgeens.be/llm/SIA
|
2025-04-29 16:50:13 +02:00 |
|
Niels Geens
|
2179bbe00d
|
Create separate venv for running notebooks
|
2025-04-29 16:49:24 +02:00 |
|
Niels Geens
|
07aa80fa75
|
Create separate venv for running notebooks
|
2025-04-29 16:24:19 +02:00 |
|
|
|
36d718d326
|
Test train qwen 3
|
2025-04-29 10:17:03 +00:00 |
|
|
|
725bd4cacd
|
wip vllm
|
2025-04-25 19:39:18 +00:00 |
|
|
|
9b2c2ece70
|
Flash attention in notebook
|
2025-04-23 19:38:56 +00:00 |
|
Niels Geens
|
4b124fa3ed
|
Prefer previous generation gpu
|
2025-04-23 18:47:01 +02:00 |
|
|
|
e2e346d134
|
Implement 4-bit quant for train script and inference
|
2025-04-23 16:43:55 +00:00 |
|
|
|
2c4b254bb0
|
Merge branch 'master' of https://git.nielsgeens.be/llm/SIA
|
2025-04-23 16:38:05 +00:00 |
|
|
|
41c336165f
|
Updated notebooks to support 4-bit quantization
|
2025-04-23 16:37:10 +00:00 |
|
Niels Geens
|
47491fc20e
|
Redo jupyter install
|
2025-04-23 17:27:38 +02:00 |
|
Niels Geens
|
1760532e7f
|
Merge branch 'master' of https://git.nielsgeens.be/llm/SIA
|
2025-04-23 15:18:39 +02:00 |
|
Niels Geens
|
c834141ead
|
Retry deploy if not available
|
2025-04-23 15:16:41 +02:00 |
|
|
|
d7c340a937
|
Updated notebooks wip
|
2025-04-23 10:32:33 +00:00 |
|
Niels Geens
|
bf94a0838a
|
Enable 2x faster inference with unsloth
|
2025-04-22 11:47:27 +02:00 |
|
|
|
3e471eced3
|
Use Unsloth for QwQ inference
|
2025-04-21 10:42:35 +00:00 |
|
|
|
568ec4b66d
|
Improved docker build speed
|
2025-04-20 16:06:47 +02:00 |
|
|
|
def822d61f
|
Load response when loading iteration
|
2025-04-20 12:31:55 +02:00 |
|
|
|
7a4028085f
|
Simplified dockerfile
|
2025-04-20 12:08:57 +02:00 |
|
|
|
243e4177cb
|
Reject whitespace in iteration parser
|
2025-04-20 12:08:43 +02:00 |
|
|
|
a165772411
|
Updated user_communication flowchart
|
2025-04-19 20:55:04 +02:00 |
|
|
|
c1cef08941
|
Speed up inference
|
2025-04-19 14:12:00 +00:00 |
|
|
|
9315f87f53
|
Fix stop bug
|
2025-04-19 12:15:23 +00:00 |
|
|
|
5ac701316e
|
Fix char_trie to store all token ids
|
2025-04-19 11:49:09 +00:00 |
|
