Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

local-inference

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

399

Base only

Active filters: local-inference

continuum-ai/qwen3.5-4b-code-forged

Text Generation • 4B • Updated Apr 11 • 207 • 1

continuum-ai/qwen3.5-27b-code-forged

Text Generation • 27B • Updated Apr 11 • 69

continuum-ai/qwen3.5-27b-code-forged-mlx-4bit

Text Generation • 14B • Updated Apr 11 • 235

continuum-ai/qwen3.5-4b-code-forged-defragged

Text Generation • 4B • Updated Apr 11 • 71

continuum-ai/qwen3.5-27b-code-forged-defragged

Text Generation • 26B • Updated Apr 11 • 38

continuum-ai/qwen3.5-4b-code-forged-GGUF

Text Generation • 4B • Updated Apr 11 • 1.03k • 6

matrixdose/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

Text Generation • 12B • Updated Mar 30 • 496 • 2

continuum-ai/qwen3.5-4b-code-128k-forged

Text Generation • 4B • Updated Apr 11 • 74 • 1

continuum-ai/qwen3.5-4b-general-forged

Text Generation • 4B • Updated Apr 9 • 25

continuum-ai/qwen3.5-0.8b-general-forged

Text Generation • 0.8B • Updated Apr 9 • 41 • 1

continuum-ai/qwen3.5-2b-general-forged

Text Generation • 2B • Updated Apr 9 • 28

continuum-ai/qwen3.5-9b-general-forged

Text Generation • 9B • Updated Apr 9 • 26

continuum-ai/qwen2.5-coder-7b-compacted

Text Generation • 8B • Updated Apr 11 • 51

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 4.05k • 16

continuum-ai/olmoe-1b-7b-compacted-5b

Text Generation • 5B • Updated Apr 11 • 128 • 1

TxemAI/Qwen3-53B-A3B-2507-TOTAL-RECALL-v2-MLX-6bit

53B • Updated Apr 9 • 22

TxemAI/Qwen3-53B-A3B-2507-TOTAL-RECALL-v2-MLX-8bit

53B • Updated Apr 9 • 14

continuum-ai/mixtral-8x7b-instruct-compacted-conservative

Text Generation • 35B • Updated Apr 11 • 237

patronus-studio/wolf-defender-prompt-injection-small

Text Classification • 0.1B • Updated 6 days ago • 4.78k • • 11

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1

Image-Text-to-Text • 10B • Updated Apr 18 • 2.36k • 70

worthdoing/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 17 • 109

worthdoing/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Apr 17 • 124

worthdoing/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Apr 17 • 139

worthdoing/Phi-4-mini-GGUF

Text Generation • 4B • Updated Apr 17 • 262

worthdoing/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Apr 17 • 146

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Image-Text-to-Text • 9B • Updated Jul 9 • 10.1k • 115

worthdoing/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 17 • 191

worthdoing/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • 8B • Updated Apr 17 • 265

worthdoing/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Apr 17 • 54

worthdoing/Stablelm-2-Zephyr-1.6B-GGUF

Text Generation • 2B • Updated Apr 17 • 148