groupuser/TinyLlama-1.1B-Chat-v1.0
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add link to Neuron-optimized version

Browse Source 
🤖 Neuron Export Bot: Adding link to Neuron-optimized version.

A Neuron-optimized version of this model has been created at [badaoui/TinyLlama-TinyLlama-1.1B-Chat-v1.0-neuron](https://huggingface.co/badaoui/TinyLlama-TinyLlama-1.1B-Chat-v1.0-neuron).

The optimized version provides improved performance on AWS Inferentia/Trainium instances with pre-compiled artifacts.

Generated by: [badaoui](https://huggingface.co/badaoui)
Generated using: [Optimum Neuron Compiler Space](https://huggingface.co/spaces/optimum/neuron-export)
This commit is contained in:
ABDENNACER BADAOUI 2025-09-16 13:58:49 +00:00 committed by system
parent fe8a4ea1ff
commit 3761afd63f
No known key found for this signature in database
GPG Key ID: 6A528E38E0733467
1 changed files with 13 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
README.md
View File

@ -63,4 +63,16 @@ print(outputs[0]["generated_text"])
# How many helicopters can a human eat in one sitting?</s> # How many helicopters can a human eat in one sitting?</s>
# <|assistant|> # <|assistant|>
# ... # ...
``` ```
---
## 🚀 AWS Neuron Optimized Version Available
A Neuron-optimized version of this model is available for improved performance on AWS Inferentia/Trainium instances:
**[badaoui/TinyLlama-TinyLlama-1.1B-Chat-v1.0-neuron](https://huggingface.co/badaoui/TinyLlama-TinyLlama-1.1B-Chat-v1.0-neuron)**
The Neuron-optimized version provides:
- Pre-compiled artifacts for faster loading
- Optimized performance on AWS Neuron devices
- Same model capabilities with improved inference speed