Add minor reference to transformers (#7)
- Add minor reference to transformers (6d09a724d62369e03273260e91471f90885a3626) - Update README.md (28ef5dc97e80c593a11786c42a287da995ff6c87) Co-authored-by: Omar Sanseviero <osanseviero@users.noreply.huggingface.co>
This commit is contained in:
parent
adb7468dc0
commit
83e9aa141f
17
README.md
17
README.md
@ -13,7 +13,7 @@ Mistral-7B-v0.3 has the following changes compared to [Mistral-7B-v0.2](https://
|
|||||||
|
|
||||||
## Installation
|
## Installation
|
||||||
|
|
||||||
It is recommended to use `mistralai/Mistral-7B-Instruct-v0.3` with [mistral-inference](https://github.com/mistralai/mistral-inference)
|
It is recommended to use `mistralai/Mistral-7B-Instruct-v0.3` with [mistral-inference](https://github.com/mistralai/mistral-inference). For HF transformers code snippets, please keep scrolling.
|
||||||
|
|
||||||
```
|
```
|
||||||
pip install mistral_inference
|
pip install mistral_inference
|
||||||
@ -115,6 +115,21 @@ result = tokenizer.instruct_tokenizer.tokenizer.decode(out_tokens[0])
|
|||||||
print(result)
|
print(result)
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## Generate with `transformers`
|
||||||
|
|
||||||
|
If you want to use Hugging Face `transformers` to generate text, you can do something like this.
|
||||||
|
|
||||||
|
```py
|
||||||
|
from transformers import pipeline
|
||||||
|
|
||||||
|
messages = [
|
||||||
|
{"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
|
||||||
|
{"role": "user", "content": "Who are you?"},
|
||||||
|
]
|
||||||
|
chatbot = pipeline("text-generation", model="mistralai/Mistral-7B-Instruct-v0.3")
|
||||||
|
chatbot(messages)
|
||||||
|
```
|
||||||
|
|
||||||
## Limitations
|
## Limitations
|
||||||
|
|
||||||
The Mistral 7B Instruct model is a quick demonstration that the base model can be easily fine-tuned to achieve compelling performance.
|
The Mistral 7B Instruct model is a quick demonstration that the base model can be easily fine-tuned to achieve compelling performance.
|
||||||
|
|||||||
Loading…
Reference in New Issue
Block a user