groupuser/Qwen2.5-1.5B-Instruct-GPTQ-Int8
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
jklj077 2024-09-18 12:39:05 +00:00 committed by system
parent ae0196f679
commit 4bb441e876
No known key found for this signature in database
GPG Key ID: 6A528E38E0733467
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -19,7 +19,7 @@ Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we rele
- **Long-context Support** up to 128K tokens and can generate up to 8K tokens. - **Long-context Support** up to 128K tokens and can generate up to 8K tokens.
- **Multilingual support** for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more. - **Multilingual support** for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
**This repo contains the GPTQ-quantized 4-bit instruction-tuned 1.5B Qwen2.5 model**, which has the following features: **This repo contains the GPTQ-quantized 8-bit instruction-tuned 1.5B Qwen2.5 model**, which has the following features:
- Type: Causal Language Models - Type: Causal Language Models
- Training Stage: Pretraining & Post-training - Training Stage: Pretraining & Post-training
- Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied word embeddings - Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied word embeddings