Jonathan Tow
|
1909ae19b3
|
fix(modeling): use correct base_model_prefix name
|
2024-01-29 19:49:03 +00:00 |
|
Jonathan Tow
|
21ee10d32c
|
fix(tokenizer): expose errors
|
2024-01-25 16:17:34 +00:00 |
|
jon-tow
|
810b45c00e
|
feat: add dropout support
|
2024-01-23 18:49:25 +00:00 |
|
jon-tow
|
4c846d7114
|
fix: make eos_token/pad_token overridable and add pickle support
|
2024-01-22 23:45:51 -05:00 |
|
Jonathan Tow
|
720763ede4
|
update(README): add extra lang tags
|
2024-01-20 18:32:37 +00:00 |
|
Jonathan Tow
|
9f2def929c
|
fix: add default special tokens
|
2024-01-19 22:54:48 +00:00 |
|
Jonathan Tow
|
ca32832c44
|
fix: add default special tokens
|
2024-01-19 22:52:04 +00:00 |
|
Jonathan Tow
|
192936bf86
|
fix: revert zephyr tokenizer config change
|
2024-01-19 22:43:56 +00:00 |
|
Max
|
507254d7bd
|
fix: add chat template to tokenizer config
|
2024-01-19 22:01:18 +00:00 |
|
jon-tow
|
e6185e1580
|
feat: add LICENSE
|
2024-01-19 14:11:14 -05:00 |
|
Jonathan Tow
|
a8f2f2862b
|
feat(tokenizer): expose merge ranks and special tokens for GGUF
|
2024-01-19 18:22:13 +00:00 |
|
jon-tow
|
3aeae29673
|
init: release
|
2024-01-18 23:46:52 +00:00 |
|
Jonathan Tow
|
a3cceb4c4c
|
initial commit
|
2024-01-18 15:49:16 +00:00 |
|