Zero-Shot Classification
Transformers
Safetensors
qwen3_5
feature-extraction
decision-model
classification
system-one
multimodal
vision
video
object-detection
custom_code
Eval Results
Instructions to use vllm-sr/d3-ultra with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vllm-sr/d3-ultra with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-classification", model="vllm-sr/d3-ultra", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("vllm-sr/d3-ultra", trust_remote_code=True) model = AutoModel.from_pretrained("vllm-sr/d3-ultra", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download .eval_results/safeagents-judge-bench.yaml from vllm-sr/d3-ultra: direct link, hf CLI and curl.
- Browser
- Download file 1.19 kB
-
https://huggingface.co/vllm-sr/d3-ultra/resolve/main/.eval_results/safeagents-judge-bench.yaml
- Command line
-
hf download hf://vllm-sr/d3-ultra/.eval_results/safeagents-judge-bench.yaml
-
curl -L -o safeagents-judge-bench.yaml https://huggingface.co/vllm-sr/d3-ultra/resolve/main/.eval_results/safeagents-judge-bench.yaml
1.19 kB
| - dataset: | |
| id: harness-hub/safeagents-judge-bench | |
| task_id: balanced_accuracy | |
| value: 0.756 | |
| date: "2026-10-30" | |
| source: | |
| url: https://huggingface.co/datasets/harness-hub/safeagents-judge-bench | |
| name: "safeagents judge bench v0, test split, run on 2 x NVIDIA A40 (sharded, CUDA bf16)" | |
| - dataset: | |
| id: harness-hub/safeagents-judge-bench | |
| task_id: auroc | |
| value: 0.994 | |
| date: "2026-10-30" | |
| source: | |
| url: https://huggingface.co/datasets/harness-hub/safeagents-judge-bench | |
| name: "safeagents judge bench v0, test split, run on 2 x NVIDIA A40 (sharded, CUDA bf16)" | |
| - dataset: | |
| id: harness-hub/safeagents-judge-bench | |
| task_id: false_block_rate | |
| value: 0.487 | |
| date: "2026-10-30" | |
| source: | |
| url: https://huggingface.co/datasets/harness-hub/safeagents-judge-bench | |
| name: "safeagents judge bench v0, test split, run on 2 x NVIDIA A40 (sharded, CUDA bf16)" | |
| - dataset: | |
| id: harness-hub/safeagents-judge-bench | |
| task_id: category_macro_f1 | |
| value: 0.491 | |
| date: "2026-10-30" | |
| source: | |
| url: https://huggingface.co/datasets/harness-hub/safeagents-judge-bench | |
| name: "safeagents judge bench v0, test split, run on 2 x NVIDIA A40 (sharded, CUDA bf16)" | |