Added tool for finetuning mistral model based on training config
This commit is contained in:
@@ -299,21 +299,13 @@ The training configuration is defined in `/training/config.yaml`, which specifie
|
||||
model:
|
||||
system_prompt_path: "system_prompt.md"
|
||||
action_schema: "action_schema.xsd"
|
||||
|
||||
training_data:
|
||||
conversations:
|
||||
- path: "training/data/general/basic_interactions/"
|
||||
description: "General user interactions"
|
||||
hash: "abc123"
|
||||
tasks:
|
||||
- path: "training/data/code_generation/"
|
||||
description: "Code writing examples"
|
||||
hash: "def456"
|
||||
|
||||
training_params:
|
||||
batch_size: 32
|
||||
params:
|
||||
learning_rate: 1e-5
|
||||
epochs: 3
|
||||
data:
|
||||
- "training/clean_start/"
|
||||
- "training/delete_indicated_entries/"
|
||||
- "training/list_entries_to_delete/"
|
||||
```
|
||||
|
||||
## Continuous Operation
|
||||
@@ -341,4 +333,14 @@ This requires:
|
||||
- Balance improvement with responsiveness
|
||||
- Monitor system resource usage
|
||||
- Prevent training impact on user tasks
|
||||
- Clean up old data regularly
|
||||
- Clean up old data regularly
|
||||
|
||||
# TODO
|
||||
|
||||
- Fix training config
|
||||
- Write training script
|
||||
- implement stdio + auto mode
|
||||
- Write setup script
|
||||
- Explain challenge report card
|
||||
- Document report card tool
|
||||
- Write report card tool
|
||||
Reference in New Issue
Block a user