groupuser/Llama-3.2-1B-Instruct
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update config.json (#2)

Browse Source 
- Update config.json (77454b7f1dcbf58a47cbdc056a3800c8acc4940e)


Co-authored-by: Sanyam Bhutani <Sanyam@users.noreply.huggingface.co>
This commit is contained in:
Kai Wu 2024-09-24 00:22:38 +00:00 committed by system
parent d0a2081ed4
commit c4219cc9e6
No known key found for this signature in database
GPG Key ID: 6A528E38E0733467
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
config.json
View File

@ -24,7 +24,7 @@
"pretraining_tp": 1, "pretraining_tp": 1,
"rms_norm_eps": 1e-05, "rms_norm_eps": 1e-05,
"rope_scaling": { "rope_scaling": {
"factor": 8.0, "factor": 32.0,
"high_freq_factor": 4.0, "high_freq_factor": 4.0,
"low_freq_factor": 1.0, "low_freq_factor": 1.0,
"original_max_position_embeddings": 8192, "original_max_position_embeddings": 8192,