turboderp
/

c4ai-command-r7b-12-2024-exl3

Model card Files Files and versions

c4ai-command-r7b-12-2024-exl3 / README.md

turboderp's picture

Update README.md

b1e1c35 verified 11 months ago

|

Raw History Blame Contribute Delete

1.1 kB

license: cc-by-nc-4.0
base_model: CohereLabs/c4ai-command-r7b-12-2024
base_model_relation: quantized
quantized_by: turboderp
tags:
  - exl3

EXL3 quants of C4AI Command R7B 12-2024

2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight / H8