Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

compressed-tensors

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

10,149

Base only

Active filters: compressed-tensors

chieunq/Qwen3-1.7B-W4A16-all_gsm8k2048

2B • Updated Oct 28, 2025 • 12

chieunq/Qwen3-0.6B-GPTQ-W8A8_gsm8k2048

0.8B • Updated Oct 28, 2025 • 8

chieunq/Qwen3-0.6B-AWQ-W4A16_ASYM_ultrachat_200k2048

0.8B • Updated Oct 28, 2025 • 11

chieunq/Qwen3-0.6B-GPTQ-W4A16_gsm8k2048

0.8B • Updated Oct 28, 2025 • 10

chieunq/Qwen3-0.6B-GPTQ-W4A16_ultrachat_200k2048

0.8B • Updated Oct 28, 2025 • 6

chieunq/Qwen3-0.6B-AWQ-W4A16_ASYM_gsm8k2048

0.8B • Updated Oct 28, 2025 • 7

chieunq/Qwen3-0.6B-W4A16-all_gsm8k2048

0.8B • Updated Oct 28, 2025 • 5

dicta-il/DictaLM-3.0-24B-Base-W4A16

Text Generation • 4B • Updated May 4 • 29

ludis/MS3.2-24B-Magnum-Diamond-W4A16

4B • Updated Oct 29, 2025 • 13

BaoLocTown/thanh-hug-qwen7B

2B • Updated Oct 29, 2025 • 12

BaoLocTown/thanh-hug-7B-lora-awq

2B • Updated Oct 29, 2025 • 5

BaoLocTown/thanh-hug-7B-gptq

2B • Updated Oct 29, 2025 • 8

dazipe/Qwen3-Next-80B-A3B-Instruct-GPTQ-Int4A16

14B • Updated Oct 29, 2025 • 157 • 5

cyankiwi/JanusCoder-14B-AWQ-4bit

Text Generation • 4B • Updated Jul 21 • 22

cyankiwi/JanusCoder-14B-AWQ-8bit

Text Generation • 5B • Updated Jul 21 • 15

cyankiwi/JanusCoder-8B-AWQ-8bit

Text Generation • 3B • Updated Jul 21 • 25

cyankiwi/JanusCoder-8B-AWQ-4bit

Text Generation • 2B • Updated Jul 21 • 29

RedHatAI/Qwen3-235B-A22B-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 425 • 2

RedHatAI/Qwen3-235B-A22B-Instruct-2507-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 545 • 4

moficodes/gemma-3-1b-it-W4A16-G128

Text Generation • 1B • Updated Oct 29, 2025 • 14

tanushm/voxtts-lite-FP8-Dynamic

0.6B • Updated Oct 29, 2025 • 9

moficodes/Meta-Llama-3-8B-Instruct-W4A16-G128

Text Generation • 2B • Updated Oct 31, 2025 • 14

jiangchengchengNLP/L3.3-MS-Nevoria-70b-NVFP4

41B • Updated Oct 30, 2025 • 10

ig1/Qwen3-30B-A3B-Instruct-2507-NVFP4

17B • Updated Oct 30, 2025 • 18

flymyd/fine-lightning-14b-FP8-Dynamic

Text Generation • 15B • Updated Oct 30, 2025 • 12

cyankiwi/Qwen3-Nemotron-32B-RLBFF-AWQ-4bit

Text Generation • 6B • Updated Jul 21 • 20

cyankiwi/Qwen3-Nemotron-32B-RLBFF-AWQ-8bit

Text Generation • 10B • Updated Jul 21 • 24

cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit

Text Generation • 9B • Updated Jul 21 • 2.1k • 18

TheHouseOfTheDude/Legion-V2.1-LLaMa-70B_CompressedTensors

Text Generation • Updated Oct 31, 2025 • 7

iproskurina/gemma-3-1b-pt-awq-int4

1B • Updated Oct 31, 2025 • 6