Commit Graph

Select branches

Hide Pull Requests

master

Mono Color

• 1e4dbcea61 Renamed mistral tool to mistral_api master Niels Geens 2026-01-11 18:11:01 +01:00
• 560b523cb2 Train on example_interaction Niels Geens 2026-01-11 16:25:55 +01:00
• aee72e65ec Improved gemma training Niels Geens 2026-01-11 16:25:40 +01:00
• 289a52d6ce Fix typo Niels Geens 2026-01-11 16:25:16 +01:00
• 4e50d1f7c4 Use Vulkan Niels Geens 2026-01-10 19:52:41 +01:00
• 7014bba178 Add context info in ui Niels Geens 2026-01-10 19:13:08 +01:00
• 5821391309 Fix continue from prefix Niels Geens 2026-01-10 13:50:57 +01:00
• 39e0c81ef1 Better stop token handling Niels Geens 2026-01-10 13:41:32 +01:00
• b89cb9cfe1 Switch to Vulkan Niels Geens 2026-01-07 19:32:50 +01:00
• ab349993ba Larger context and WiP fix to prefix handling Niels Geens 2025-05-22 20:24:29 +00:00
• 41079c8ba1 Fix install script comments Niels Geens 2025-05-22 19:27:57 +00:00
• c22917e3c9 Fixes for 12B Niels Geens 2025-05-22 18:51:07 +00:00
• 19dd9fa2ee Fixes for saving the gemma tokenizer Niels Geens 2025-05-22 18:22:15 +02:00
• 29b35ffccf Fix download bootstrap for deploy Niels Geens 2025-05-22 10:35:38 +02:00
• 61f8b506bc Download bootstrap file in deploy script Niels Geens 2025-05-21 14:32:47 +00:00
• 6c9d5f542b Fix node install and make mock_llm script executable geens 2025-05-21 07:37:14 +02:00
• cad8e17afd Git ignore web build Niels Geens 2025-05-20 19:28:04 +00:00
• db9dfdb1a5 Merge branch 'master' of https://git.nielsgeens.be/llm/SIA Niels Geens 2025-05-20 19:27:05 +00:00
• dd3c809789 Fix train script Niels Geens 2025-05-20 19:26:33 +00:00
• f9117a8e5a Add recursive flag to git clone in bootstrap Niels Geens 2025-05-20 21:25:25 +02:00
• f0c1d7732a Switch to gemma 12 Niels Geens 2025-05-20 20:47:57 +02:00
• f2c70cd05d Gemma training script Niels Geens 2025-05-20 20:46:16 +02:00
• d4a4902b94 New web interface, move llm engine to separate process geens 2025-05-20 09:43:17 +02:00
• 895a533e01 Update readme for separate llm engine executables Niels Geens 2025-05-10 17:09:29 +02:00
• f8365ef698 Fixes from runpod geens 2025-05-06 20:35:30 +02:00
• c41a86a00a Gemma inference with llama.cpp and logits processor geens 2025-05-06 20:31:42 +02:00
• 44fd60a6be Added schema validator for llama.cpp geens 2025-05-06 18:46:28 +02:00
• f61c9ab15f Add inference in notebook Niels Geens 2025-05-02 19:32:03 +00:00
• f1f1a42fb3 Fixes after local testing geens 2025-05-02 18:28:07 +02:00
• e78fca8233 Gemma notebook working on runpod Geens 2025-05-02 17:05:28 +02:00
• f63e5db996 Move models directory Geens 2025-05-01 17:28:59 +02:00
• d022d41a5d Update docker image Geens 2025-05-01 17:28:33 +02:00
• ff6a6ab135 Add bitsandbytes to gemma notebook Niels Geens 2025-05-01 10:46:33 +02:00
• 72b902117c Simplified bootstrap even more Geens 2025-05-01 09:26:29 +02:00
• 95546208e8 Gemma notebook Niels Geens 2025-04-30 13:36:24 +02:00
• 8544f12d41 Added example notebook Niels Geens 2025-04-29 14:58:27 +00:00
• e07a62d488 Simplified bootstrap Niels Geens 2025-04-29 14:56:52 +00:00
• 3557270c89 Merge branch 'master' of https://git.nielsgeens.be/llm/SIA Niels Geens 2025-04-29 16:50:13 +02:00
• 2179bbe00d Create separate venv for running notebooks Niels Geens 2025-04-29 16:17:46 +02:00
• 07aa80fa75 Create separate venv for running notebooks Niels Geens 2025-04-29 16:17:46 +02:00
• 36d718d326 Test train qwen 3 Niels Geens 2025-04-29 10:17:03 +00:00
• 725bd4cacd wip vllm Niels Geens 2025-04-25 19:39:18 +00:00
• 9b2c2ece70 Flash attention in notebook Niels Geens 2025-04-23 19:38:56 +00:00
• 4b124fa3ed Prefer previous generation gpu Niels Geens 2025-04-23 18:47:01 +02:00
• e2e346d134 Implement 4-bit quant for train script and inference Niels Geens 2025-04-23 16:43:55 +00:00
• 2c4b254bb0 Merge branch 'master' of https://git.nielsgeens.be/llm/SIA Niels Geens 2025-04-23 16:38:05 +00:00
• 41c336165f Updated notebooks to support 4-bit quantization Niels Geens 2025-04-23 16:37:10 +00:00
• 47491fc20e Redo jupyter install Niels Geens 2025-04-23 17:27:38 +02:00
• 1760532e7f Merge branch 'master' of https://git.nielsgeens.be/llm/SIA Niels Geens 2025-04-23 15:18:39 +02:00
• c834141ead Retry deploy if not available Niels Geens 2025-04-23 15:16:41 +02:00
• d7c340a937 Updated notebooks wip Niels Geens 2025-04-23 10:32:33 +00:00
• bf94a0838a Enable 2x faster inference with unsloth Niels Geens 2025-04-22 11:47:27 +02:00
• 3e471eced3 Use Unsloth for QwQ inference Niels Geens 2025-04-21 10:42:35 +00:00
• 568ec4b66d Improved docker build speed Geens 2025-04-20 16:06:47 +02:00
• def822d61f Load response when loading iteration Geens 2025-04-20 12:31:55 +02:00
• 7a4028085f Simplified dockerfile Geens 2025-04-20 12:08:57 +02:00
• 243e4177cb Reject whitespace in iteration parser Geens 2025-04-20 12:08:43 +02:00
• a165772411 Updated user_communication flowchart Geens 2025-04-19 20:55:04 +02:00
• c1cef08941 Speed up inference Niels Geens 2025-04-19 14:12:00 +00:00
• 9315f87f53 Fix stop bug Niels Geens 2025-04-19 12:15:23 +00:00
• 5ac701316e Fix char_trie to store all token ids Niels Geens 2025-04-19 11:49:09 +00:00
• 33aaaf4455 Fix start of assistant message detection Niels Geens 2025-04-18 17:46:49 +00:00
• 23b8c3c54d Fix CharTie multi-threading Geens 2025-04-18 18:10:05 +02:00
• 64fc621d44 Fix error print in dataset Niels Geens 2025-04-18 12:42:24 +00:00
• 5e47200ece Fixes for QwQ llm engine Niels Geens 2025-04-18 12:30:47 +00:00
• c09f0766c1 Fixed auto approver and inference continuation Niels Geens 2025-04-18 11:36:17 +02:00
• 023f6bba9a Wip web interface Niels Geens 2025-04-17 22:09:15 +02:00
• 813c6a3f8f Update unit tests Niels Geens 2025-04-17 18:32:44 +02:00
• 34fb5d814f Shared response buffer backend Niels Geens 2025-04-17 18:32:23 +02:00
• 9477575421 Multi-thread chartie Niels Geens 2025-04-17 09:48:04 +02:00
• 51fed5dfd3 Implemented commend and cdata Geens 2025-04-14 21:32:36 +02:00
• bfe03dbdc2 WIP cdata and comment tokens Geens 2025-04-13 22:02:29 +02:00
• 773134e65b Improved tests for tokens Geens 2025-04-13 19:05:10 +02:00
• ac2c1ae08b Added lib to clean-python in Makefile Geens 2025-04-13 18:19:32 +02:00
• 5bcfe89cb9 Disabled community cloud Geens 2025-04-13 18:15:19 +02:00
• be48130a8f Use CharTrie and fix multi-byte char issue Geens 2025-04-13 16:05:27 +02:00
• f4de9e7571 Fixed token cache for whitespace bug Geens 2025-04-13 10:03:14 +02:00
• ff82173f2a Removed auto enable for QwQ Geens 2025-04-13 09:56:01 +02:00
• c2bf422363 Fixed whitespace processing Geens 2025-04-12 19:59:25 +02:00
• 9564879edc Fixed attribute parsing Geens 2025-04-12 18:02:55 +02:00
• bd3adf78e6 Fix attributes in self-closing tags Geens 2025-04-11 19:26:05 +02:00
• 7e254b7f7e Fixed qwq token limit Geens 2025-04-11 18:03:17 +02:00
• e9f5bcc519 remove debug print Niels Geens 2025-04-10 22:10:29 +02:00
• ba9d69b414 Added char trie Niels Geens 2025-04-10 21:46:24 +02:00
• 10df42c3a6 Added small optimization to logits processor core Niels Geens 2025-04-10 19:11:59 +02:00
• d81ae09f67 Fix nested elements Niels Geens 2025-04-10 18:37:00 +02:00
• 2f0fd21b0a Fix missing attribut Niels Geens 2025-04-10 18:14:25 +02:00
• cfb65ee710 Handle attributes and self-closing tags Niels Geens 2025-04-10 14:35:14 +02:00
• 5b8f04be81 fix copy bug Niels Geens 2025-04-09 16:43:27 +02:00
• e1da61fd71 Fix import for xml_schema_validator Niels Geens 2025-04-09 10:56:20 +00:00
• 8fb30c8ed0 Optimized hot-loop for logits processor Niels Geens 2025-04-09 11:59:26 +02:00
• 654c32c7ac wip logits processor in ruuuuuuust Niels Geens 2025-04-08 06:34:03 +00:00
• 3826c45240 Made xml schema validator send Geens 2025-04-07 19:27:03 +02:00
• 2d4a57a706 Changed standard output of collect.sh to collect.txt Niels Geens 2025-04-07 16:52:12 +02:00
• 2e08be4b75 Validator works for start Niels Geens 2025-04-07 14:31:56 +00:00
• 50539f6d03 Integrate logits processor with qwq (untested) Niels Geens 2025-04-07 13:35:20 +02:00
• 023fc75aac Merge branch 'master' of https://git.nielsgeens.be/llm/SIA Niels Geens 2025-04-07 12:19:26 +02:00
• faf78b7948 Lock vllm version to avoid bug Niels Geens 2025-04-07 11:57:15 +02:00
• f4a17ad01e Lock vllm version to avoid bug Niels Geens 2025-04-07 11:57:15 +02:00
• cda067eb07 Removed jupyter venvs for all but train Niels Geens 2025-04-07 11:43:20 +02:00