Lorbus/Qwen3.6-27B-int4-AutoRound
Image-Text-to-Text • 6B • Updated • 185k • 60
Edit Models filters
Apps
Inference Providers
Active filters: w4a16
MJPansa/MiniMax-M2.7-REAP-172B-A10B-AutoRound-W4A16
Text Generation • 24B • Updated • 3.67k • 9
alonsoko/gemma-4-31b-it-abliterated-heretic-ara-AWQ
Image-Text-to-Text • 32B • Updated • 6.12k • 5
atbender/Qwen3.6-VL-REAP-26B-A3B-W4A16
Text Generation • 1B • Updated • 1.17k • 4
LibertAIDAI/Qwen3.6-27B-W4A16-G128
Image-Text-to-Text • 28B • Updated • 2.63k • 6
lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound
Image-Text-to-Text • 3B • Updated • 259 • 2
ebircak/gemma-4-31B-it-4bit-W4A16-GPTQ
Text Generation • 32B • Updated • 20.9k • 1
Lasimeri/MiniMax-M2.7-int4-AutoRound
Text Generation • 32B • Updated • 2.34k • 1
alonsoko/MiniMax-M2.7-abliterated-heretic-ara-AWQ
Text Generation • 31B • Updated • 647 • 1
Mohaaxa/Qwen2.5-VL-3B-Instruct-W4A16-generic
Image-Text-to-Text • 4B • Updated • 167 • 1
abhinand/Qwen3.6-35B-A3B-int4-AutoRound
Image-Text-to-Text • 6B • Updated • 193 • 1
groxaxo/octen-embedding-4b-w4a16
Text Generation • 0.9B • Updated • 213 • 1
groxaxo/octen-embedding-8b-w4a16
Text Generation • 1B • Updated • 194 • 1
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text • 73B • Updated • 73
RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16
18B • Updated • 10
RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16
6B • Updated • 7
RedHatAI/QwQ-32B-Preview-quantized.w4a16
6B • Updated • 8
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16
Text Generation • 11B • Updated • 11
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation • 1B • Updated • 1.07k • 1
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation • 0.5B • Updated • 65.5k
RedHatAI/DeepSeek-V2.5-1210-quantized.w4a16
Text Generation • 32B • Updated • 5
RedHatAI/DeepSeek-Coder-V2-Instruct-0724-quantized.w4a16
Text Generation • 32B • Updated • 117 • 1
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation • 0.5B • Updated • 22
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation • 1B • Updated • 39 • 1
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 13B • Updated • 9
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16
Text Generation • 4B • Updated • 4.72k • 1
RedHatAI/Phi-3-vision-128k-instruct-W4A16-G128
Text Generation • 1B • Updated • 15 • 1
RedHatAI/whisper-large-v2-W4A16-G128
Automatic Speech Recognition • 0.3B • Updated • 16 • 1
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 19B • Updated • 32
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text • 3B • Updated • 1.94k • 8