soosoo/bge-reranker-v2-m3
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Upload README.md with huggingface_hub

Browse Source
This commit is contained in:
Xiao 2024-03-19 09:26:24 +00:00 committed by system
parent 995ec6ee29
commit 12e974610b
No known key found for this signature in database
GPG Key ID: 6A528E38E0733467
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -325,7 +325,8 @@ torchrun --nproc_per_node {number of gpus} \
--target_modules q_proj k_proj v_proj o_proj \ --target_modules q_proj k_proj v_proj o_proj \
--start_layer 8 \ --start_layer 8 \
--head_multi True \ --head_multi True \
--head_type simple --head_type simple \
--lora_extra_parameters linear_head
``` ```
Our rerankers are initialized from [google/gemma-2b](https://huggingface.co/google/gemma-2b) (for llm-based reranker) and [openbmb/MiniCPM-2B-dpo-bf16](https://huggingface.co/openbmb/MiniCPM-2B-dpo-bf16) (for llm-based layerwise reranker), and we train it on a mixture of multilingual datasets: Our rerankers are initialized from [google/gemma-2b](https://huggingface.co/google/gemma-2b) (for llm-based reranker) and [openbmb/MiniCPM-2B-dpo-bf16](https://huggingface.co/openbmb/MiniCPM-2B-dpo-bf16) (for llm-based layerwise reranker), and we train it on a mixture of multilingual datasets: