Commit Graph

1 Commits

Author SHA1 Message Date
Jonathan Tow
a7a1fb8a83
update(tokenizer): convert to GPT2Tokenizer (#7)
- update(tokenizer): convert to `GPT2Tokenizer` (85625532dc8753c206eecc8a76323783a7b64744)
2024-03-01 07:31:02 +00:00