Instructions to use cool9203/Llama3.2-11B-Vision-Instruct-iii_finance-Peft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use cool9203/Llama3.2-11B-Vision-Instruct-iii_finance-Peft with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit") model = PeftModel.from_pretrained(base_model, "cool9203/Llama3.2-11B-Vision-Instruct-iii_finance-Peft") - Notebooks
- Google Colab
- Kaggle
learning_rate: 7e-6
epoch: 3
context_length: 4096
RAG setting:
search method: bm25
not answering proportion: 0.0
max document length: 5
extra bm25 data: false
prompt:
[
{“role”: “system”, “content”: “從<Document>裡找到答案並利用該答案回答<Query>所敘述的問題”},
{“role”: “system”, “content”: “<Document>{Q}{A}</Document>”},
{“role”: “user”, “content”: “<Query>{Q}</Query>”},
{“role”: “assistant”, “content”: {A}},
]
- PEFT 0.13.2
- Downloads last month
- 4
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for cool9203/Llama3.2-11B-Vision-Instruct-iii_finance-Peft
Base model
meta-llama/Llama-3.2-11B-Vision-Instruct