groupuser/distilgpt2
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Adds the tokenizer configuration file (#11)

Browse Source 
- Adds tokenizer_config.json file (224ef41937cdc7356116ead4957486726c164585)
This commit is contained in:
Lysandre 2024-02-19 11:09:53 +00:00 committed by system
parent 38cc92ec43
commit 2290a62682
No known key found for this signature in database
GPG Key ID: 6A528E38E0733467
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
tokenizer_config.json Normal file
View File

@ -0,0 +1 @@
{"model_max_length": 1024}