Niels Geens
|
3557270c89
|
Merge branch 'master' of https://git.nielsgeens.be/llm/SIA
|
2025-04-29 16:50:13 +02:00 |
|
Niels Geens
|
2179bbe00d
|
Create separate venv for running notebooks
|
2025-04-29 16:49:24 +02:00 |
|
Niels Geens
|
07aa80fa75
|
Create separate venv for running notebooks
|
2025-04-29 16:24:19 +02:00 |
|
|
|
36d718d326
|
Test train qwen 3
|
2025-04-29 10:17:03 +00:00 |
|
|
|
725bd4cacd
|
wip vllm
|
2025-04-25 19:39:18 +00:00 |
|
|
|
9b2c2ece70
|
Flash attention in notebook
|
2025-04-23 19:38:56 +00:00 |
|
Niels Geens
|
4b124fa3ed
|
Prefer previous generation gpu
|
2025-04-23 18:47:01 +02:00 |
|
|
|
e2e346d134
|
Implement 4-bit quant for train script and inference
|
2025-04-23 16:43:55 +00:00 |
|
|
|
2c4b254bb0
|
Merge branch 'master' of https://git.nielsgeens.be/llm/SIA
|
2025-04-23 16:38:05 +00:00 |
|
|
|
41c336165f
|
Updated notebooks to support 4-bit quantization
|
2025-04-23 16:37:10 +00:00 |
|
Niels Geens
|
47491fc20e
|
Redo jupyter install
|
2025-04-23 17:27:38 +02:00 |
|
Niels Geens
|
1760532e7f
|
Merge branch 'master' of https://git.nielsgeens.be/llm/SIA
|
2025-04-23 15:18:39 +02:00 |
|
Niels Geens
|
c834141ead
|
Retry deploy if not available
|
2025-04-23 15:16:41 +02:00 |
|
|
|
d7c340a937
|
Updated notebooks wip
|
2025-04-23 10:32:33 +00:00 |
|
Niels Geens
|
bf94a0838a
|
Enable 2x faster inference with unsloth
|
2025-04-22 11:47:27 +02:00 |
|
|
|
3e471eced3
|
Use Unsloth for QwQ inference
|
2025-04-21 10:42:35 +00:00 |
|
|
|
568ec4b66d
|
Improved docker build speed
|
2025-04-20 16:06:47 +02:00 |
|
|
|
def822d61f
|
Load response when loading iteration
|
2025-04-20 12:31:55 +02:00 |
|
|
|
7a4028085f
|
Simplified dockerfile
|
2025-04-20 12:08:57 +02:00 |
|
|
|
243e4177cb
|
Reject whitespace in iteration parser
|
2025-04-20 12:08:43 +02:00 |
|
|
|
a165772411
|
Updated user_communication flowchart
|
2025-04-19 20:55:04 +02:00 |
|
|
|
c1cef08941
|
Speed up inference
|
2025-04-19 14:12:00 +00:00 |
|
|
|
9315f87f53
|
Fix stop bug
|
2025-04-19 12:15:23 +00:00 |
|
|
|
5ac701316e
|
Fix char_trie to store all token ids
|
2025-04-19 11:49:09 +00:00 |
|
|
|
33aaaf4455
|
Fix start of assistant message detection
|
2025-04-18 17:46:49 +00:00 |
|
|
|
23b8c3c54d
|
Fix CharTie multi-threading
|
2025-04-18 18:10:05 +02:00 |
|
|
|
64fc621d44
|
Fix error print in dataset
|
2025-04-18 12:42:24 +00:00 |
|
|
|
5e47200ece
|
Fixes for QwQ llm engine
|
2025-04-18 12:30:47 +00:00 |
|
Niels Geens
|
c09f0766c1
|
Fixed auto approver and inference continuation
|
2025-04-18 11:36:17 +02:00 |
|
Niels Geens
|
023f6bba9a
|
Wip web interface
|
2025-04-17 22:09:15 +02:00 |
|
Niels Geens
|
813c6a3f8f
|
Update unit tests
|
2025-04-17 18:32:44 +02:00 |
|
Niels Geens
|
34fb5d814f
|
Shared response buffer backend
|
2025-04-17 18:32:23 +02:00 |
|
Niels Geens
|
9477575421
|
Multi-thread chartie
|
2025-04-17 09:48:04 +02:00 |
|
|
|
51fed5dfd3
|
Implemented commend and cdata
|
2025-04-14 21:32:36 +02:00 |
|
|
|
bfe03dbdc2
|
WIP cdata and comment tokens
|
2025-04-13 22:02:29 +02:00 |
|
|
|
773134e65b
|
Improved tests for tokens
|
2025-04-13 19:05:10 +02:00 |
|
|
|
ac2c1ae08b
|
Added lib to clean-python in Makefile
|
2025-04-13 18:19:32 +02:00 |
|
|
|
5bcfe89cb9
|
Disabled community cloud
|
2025-04-13 18:15:19 +02:00 |
|
|
|
be48130a8f
|
Use CharTrie and fix multi-byte char issue
|
2025-04-13 16:05:27 +02:00 |
|
|
|
f4de9e7571
|
Fixed token cache for whitespace bug
|
2025-04-13 10:03:14 +02:00 |
|
|
|
ff82173f2a
|
Removed auto enable for QwQ
|
2025-04-13 09:56:01 +02:00 |
|
|
|
c2bf422363
|
Fixed whitespace processing
|
2025-04-12 19:59:25 +02:00 |
|
|
|
9564879edc
|
Fixed attribute parsing
|
2025-04-12 18:02:55 +02:00 |
|
|
|
bd3adf78e6
|
Fix attributes in self-closing tags
|
2025-04-11 19:26:05 +02:00 |
|
|
|
7e254b7f7e
|
Fixed qwq token limit
|
2025-04-11 18:03:17 +02:00 |
|
Niels Geens
|
e9f5bcc519
|
remove debug print
|
2025-04-10 22:10:29 +02:00 |
|
Niels Geens
|
ba9d69b414
|
Added char trie
|
2025-04-10 21:46:24 +02:00 |
|
Niels Geens
|
10df42c3a6
|
Added small optimization to logits processor core
|
2025-04-10 19:11:59 +02:00 |
|
Niels Geens
|
d81ae09f67
|
Fix nested elements
|
2025-04-10 18:37:00 +02:00 |
|
Niels Geens
|
2f0fd21b0a
|
Fix missing attribut
|
2025-04-10 18:14:25 +02:00 |
|
