llm/SIA
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Fixes for saving the gemma tokenizer

Browse Source
This commit is contained in:
Niels Geens
2025-05-22 18:22:15 +02:00
parent 29b35ffccf
commit 19dd9fa2ee
5 changed files with 25 additions and 66 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
scripts/train.sh
View File

@@ -14,4 +14,6 @@ fi
mkdir -p "$OUTPUT_DIR"
gemma_train --model "google/gemma-3-12b-it" --output-dir "$OUTPUT_DIR"
gemma_train --model "google/gemma-3-12b-it" --output-dir "$OUTPUT_DIR"
cp "$OUTPUT_DIR"/tokenizer/* "$OUTPUT_DIR"/merged/
llama-convert-hf-to-gguf --outfile "$OUTPUT_DIR/model.gguf" --outtype q8_0 "$OUTPUT_DIR/merged"