|
|
4e50d1f7c4
|
Use Vulkan
|
2026-01-10 19:52:41 +01:00 |
|
|
|
b89cb9cfe1
|
Switch to Vulkan
|
2026-01-07 19:32:50 +01:00 |
|
|
|
6c9d5f542b
|
Fix node install and make mock_llm script executable
|
2025-05-21 07:37:14 +02:00 |
|
Niels Geens
|
f2c70cd05d
|
Gemma training script
|
2025-05-20 20:46:16 +02:00 |
|
|
|
d4a4902b94
|
New web interface, move llm engine to separate process
|
2025-05-20 09:43:17 +02:00 |
|
|
|
c41a86a00a
|
Gemma inference with llama.cpp and logits processor
|
2025-05-06 20:31:42 +02:00 |
|
|
|
f1f1a42fb3
|
Fixes after local testing
|
2025-05-02 18:28:07 +02:00 |
|
|
|
e78fca8233
|
Gemma notebook working on runpod
|
2025-05-02 17:05:28 +02:00 |
|
|
|
d022d41a5d
|
Update docker image
|
2025-05-01 17:28:33 +02:00 |
|
|
|
568ec4b66d
|
Improved docker build speed
|
2025-04-20 16:06:47 +02:00 |
|
|
|
7a4028085f
|
Simplified dockerfile
|
2025-04-20 12:08:57 +02:00 |
|
Niels Geens
|
8fb30c8ed0
|
Optimized hot-loop for logits processor
|
2025-04-09 11:59:26 +02:00 |
|
|
|
ead5c35a09
|
Added rust dependency to docker build
|
2025-04-06 22:41:34 +02:00 |
|
|
|
ea93adc4c8
|
Fix dockerfile for xml schema validator
|
2025-04-06 16:11:36 +02:00 |
|
Niels Geens
|
b4c08586ee
|
Applied add_venvs_to_path.sh script to local runs
|
2025-04-02 18:05:48 +02:00 |
|
Niels Geens
|
e573b9ebe7
|
Removed flash-attn as dependency because it's hard to install properly
|
2025-04-02 14:42:35 +02:00 |
|
Niels Geens
|
3ea5ba87a9
|
Fix venv add to path
|
2025-03-18 09:46:16 +01:00 |
|
Niels Geens
|
d5a5fd1071
|
Simplified bootstrapping
|
2025-03-14 15:53:27 +01:00 |
|
Niels Geens
|
3ea3239a9b
|
wip deepseek train
|
2025-03-03 16:57:04 +01:00 |
|
|
|
b64f8d7d33
|
wip deepseek r1
|
2025-03-02 22:01:24 +01:00 |
|
|
|
b7e95d7398
|
Added restart script and fixed dockerfile and run to match docs
|
2025-03-01 13:29:17 +01:00 |
|
Niels Geens
|
6669b7a682
|
Fixed timestamp timezone for entry id's
|
2025-01-02 16:52:43 +01:00 |
|
|
|
da8583ab28
|
ITP WiP
|
2024-12-04 17:19:46 +01:00 |
|
Niels Geens
|
70ed16f8ab
|
Added hf_llm_engine and config
|
2024-11-04 17:08:52 +01:00 |
|
|
|
e243c6ac3b
|
Separate and tested web_socket_manager
|
2024-11-03 22:26:12 +01:00 |
|
|
|
092a05c3aa
|
Stub web project
|
2024-11-02 11:55:03 +01:00 |
|
|
|
165279ecc7
|
Updated docker image and requirements
|
2024-11-01 10:21:06 +01:00 |
|
|
|
2c1e134c6e
|
start implementation on new architecture
|
2024-11-01 09:56:30 +01:00 |
|
Niels Geens
|
a2f9e9c1c5
|
wip docker module
|
2024-10-24 17:26:34 +02:00 |
|
|
|
4bbe636f0e
|
Start work on docker module
|
2024-10-24 08:39:31 +02:00 |
|
Niels Geens
|
4629e751dc
|
Added text streaming
|
2024-10-22 15:29:45 +02:00 |
|
|
|
20429616f7
|
Begin implementation, basic inferenece
|
2024-10-21 22:23:48 +02:00 |
|
|
|
006db518f2
|
Start work on llm_engine
|
2024-10-20 19:05:47 +02:00 |
|
