Jonathan Tow
|
ca32832c44
|
fix: add default special tokens
|
2024-01-19 22:52:04 +00:00 |
|
Jonathan Tow
|
192936bf86
|
fix: revert zephyr tokenizer config change
|
2024-01-19 22:43:56 +00:00 |
|
Max
|
507254d7bd
|
fix: add chat template to tokenizer config
|
2024-01-19 22:01:18 +00:00 |
|
jon-tow
|
e6185e1580
|
feat: add LICENSE
|
2024-01-19 14:11:14 -05:00 |
|
Jonathan Tow
|
a8f2f2862b
|
feat(tokenizer): expose merge ranks and special tokens for GGUF
|
2024-01-19 18:22:13 +00:00 |
|
jon-tow
|
3aeae29673
|
init: release
|
2024-01-18 23:46:52 +00:00 |
|
Jonathan Tow
|
a3cceb4c4c
|
initial commit
|
2024-01-18 15:49:16 +00:00 |
|