|
|
e2e346d134
|
Implement 4-bit quant for train script and inference
|
2025-04-23 16:43:55 +00:00 |
|
|
|
41c336165f
|
Updated notebooks to support 4-bit quantization
|
2025-04-23 16:37:10 +00:00 |
|
|
|
d7c340a937
|
Updated notebooks wip
|
2025-04-23 10:32:33 +00:00 |
|
Niels Geens
|
bf94a0838a
|
Enable 2x faster inference with unsloth
|
2025-04-22 11:47:27 +02:00 |
|
|
|
3e471eced3
|
Use Unsloth for QwQ inference
|
2025-04-21 10:42:35 +00:00 |
|
|
|
def822d61f
|
Load response when loading iteration
|
2025-04-20 12:31:55 +02:00 |
|
|
|
243e4177cb
|
Reject whitespace in iteration parser
|
2025-04-20 12:08:43 +02:00 |
|
|
|
c1cef08941
|
Speed up inference
|
2025-04-19 14:12:00 +00:00 |
|
|
|
9315f87f53
|
Fix stop bug
|
2025-04-19 12:15:23 +00:00 |
|
|
|
5ac701316e
|
Fix char_trie to store all token ids
|
2025-04-19 11:49:09 +00:00 |
|
|
|
33aaaf4455
|
Fix start of assistant message detection
|
2025-04-18 17:46:49 +00:00 |
|
|
|
5e47200ece
|
Fixes for QwQ llm engine
|
2025-04-18 12:30:47 +00:00 |
|
Niels Geens
|
c09f0766c1
|
Fixed auto approver and inference continuation
|
2025-04-18 11:36:17 +02:00 |
|
Niels Geens
|
023f6bba9a
|
Wip web interface
|
2025-04-17 22:09:15 +02:00 |
|
Niels Geens
|
34fb5d814f
|
Shared response buffer backend
|
2025-04-17 18:32:23 +02:00 |
|
|
|
ff82173f2a
|
Removed auto enable for QwQ
|
2025-04-13 09:56:01 +02:00 |
|
|
|
7e254b7f7e
|
Fixed qwq token limit
|
2025-04-11 18:03:17 +02:00 |
|
Niels Geens
|
5b8f04be81
|
fix copy bug
|
2025-04-09 16:43:27 +02:00 |
|
Niels Geens
|
8fb30c8ed0
|
Optimized hot-loop for logits processor
|
2025-04-09 11:59:26 +02:00 |
|
|
|
2e08be4b75
|
Validator works for start
|
2025-04-07 14:31:56 +00:00 |
|
Niels Geens
|
50539f6d03
|
Integrate logits processor with qwq (untested)
|
2025-04-07 13:35:20 +02:00 |
|
Niels Geens
|
faf78b7948
|
Lock vllm version to avoid bug
|
2025-04-07 12:17:56 +02:00 |
|
|
|
0e2cca2e4f
|
Fixed QwQ tokenizer
|
2025-04-04 08:54:06 +00:00 |
|
Niels Geens
|
e573b9ebe7
|
Removed flash-attn as dependency because it's hard to install properly
|
2025-04-02 14:42:35 +02:00 |
|
|
|
130afbdd92
|
Updates after testing
|
2025-04-01 11:49:21 +00:00 |
|
Niels Geens
|
6f3d414d17
|
Converted QwQ notebooks to .py files
|
2025-04-01 10:42:54 +02:00 |
|
Niels Geens
|
d5a5fd1071
|
Simplified bootstrapping
|
2025-03-14 15:53:27 +01:00 |
|
Niels Geens
|
2e66020f8e
|
Replaced deepseek with qwq
|
2025-03-14 11:22:30 +01:00 |
|
Niels Geens
|
3ea3239a9b
|
wip deepseek train
|
2025-03-03 16:57:04 +01:00 |
|
|
|
b64f8d7d33
|
wip deepseek r1
|
2025-03-02 22:01:24 +01:00 |
|
|
|
b7e95d7398
|
Added restart script and fixed dockerfile and run to match docs
|
2025-03-01 13:29:17 +01:00 |
|
|
|
3ab726f961
|
Properly close mistral response
|
2025-01-09 20:01:32 +01:00 |
|
Niels Geens
|
e730eba58c
|
Fix error in "fixed" timestamps
|
2025-01-06 14:15:32 +01:00 |
|
Niels Geens
|
6669b7a682
|
Fixed timestamp timezone for entry id's
|
2025-01-02 16:52:43 +01:00 |
|
|
|
e0bc7a7159
|
Update to itb_screenshot and friends
|
2024-12-27 17:07:19 +01:00 |
|
|
|
da8583ab28
|
ITP WiP
|
2024-12-04 17:19:46 +01:00 |
|
|
|
e71bd7e9eb
|
Allow stopping of inference
|
2024-11-30 12:44:13 +01:00 |
|
|
|
a9e70f0a22
|
Added iteration loading
|
2024-11-24 20:35:28 +01:00 |
|
|
|
b6c1a95abd
|
Added memory editing functionality
|
2024-11-24 18:00:27 +01:00 |
|
|
|
2c820f6ead
|
WIP memory editor
|
2024-11-23 21:36:50 +01:00 |
|
|
|
dbc0068a82
|
Server side implementation for interactive entry edits
|
2024-11-23 15:34:33 +01:00 |
|
|
|
bb74fd3621
|
Added output length on truncated scripts
|
2024-11-23 09:36:34 +01:00 |
|
Niels Geens
|
69f4f8a6fc
|
Fixed auto approver
|
2024-11-22 17:11:06 +01:00 |
|
Niels Geens
|
8766a945c0
|
Enable multiple llms
|
2024-11-22 15:05:54 +01:00 |
|
Niels Geens
|
bbb88f39e8
|
Added another set of iterations
|
2024-11-20 16:06:33 +01:00 |
|
Niels Geens
|
03cf69d272
|
Added iteration_logger
|
2024-11-19 20:24:21 +01:00 |
|
|
|
ef94d0d1a0
|
Added mistral llm engine
|
2024-11-17 16:53:44 +01:00 |
|
|
|
506bc91639
|
Added api token for local llm
|
2024-11-16 22:09:04 +01:00 |
|
|
|
410e2b56f9
|
Fix timeout printing
|
2024-11-16 21:57:15 +01:00 |
|
|
|
c44d0ffbdf
|
Fixes for runpod test
|
2024-11-16 21:51:18 +01:00 |
|
