Added tool for finetuning mistral model based on training config

This commit is contained in:
Niels Geens
2025-01-24 11:05:23 +01:00
parent 1ee8cbc75c
commit 4fcb32e6a1
3 changed files with 276 additions and 148 deletions

View File

@@ -299,21 +299,13 @@ The training configuration is defined in `/training/config.yaml`, which specifie
model:
system_prompt_path: "system_prompt.md"
action_schema: "action_schema.xsd"
training_data:
conversations:
- path: "training/data/general/basic_interactions/"
description: "General user interactions"
hash: "abc123"
tasks:
- path: "training/data/code_generation/"
description: "Code writing examples"
hash: "def456"
training_params:
batch_size: 32
params:
learning_rate: 1e-5
epochs: 3
data:
- "training/clean_start/"
- "training/delete_indicated_entries/"
- "training/list_entries_to_delete/"
```
## Continuous Operation
@@ -341,4 +333,14 @@ This requires:
- Balance improvement with responsiveness
- Monitor system resource usage
- Prevent training impact on user tasks
- Clean up old data regularly
- Clean up old data regularly
# TODO
- Fix training config
- Write training script
- implement stdio + auto mode
- Write setup script
- Explain challenge report card
- Document report card tool
- Write report card tool