|
|
5ac701316e
|
Fix char_trie to store all token ids
|
2025-04-19 11:49:09 +00:00 |
|
|
|
23b8c3c54d
|
Fix CharTie multi-threading
|
2025-04-18 18:10:05 +02:00 |
|
|
|
be48130a8f
|
Use CharTrie and fix multi-byte char issue
|
2025-04-13 16:05:27 +02:00 |
|
|
|
c2bf422363
|
Fixed whitespace processing
|
2025-04-12 19:59:25 +02:00 |
|
|
|
9564879edc
|
Fixed attribute parsing
|
2025-04-12 18:02:55 +02:00 |
|
Niels Geens
|
cfb65ee710
|
Handle attributes and self-closing tags
|
2025-04-10 14:35:14 +02:00 |
|
Niels Geens
|
8fb30c8ed0
|
Optimized hot-loop for logits processor
|
2025-04-09 11:59:26 +02:00 |
|
