Image-Text-to-Text
GGUF
llama.cpp
qwen
amd
rocm
gfx1151
strix-halo
iu4
mtp
long-context
vision
conversational
Instructions to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0 # Run inference directly in the terminal: llama cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0 # Run inference directly in the terminal: llama cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
Use Docker
docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
- Llama new
- LM Studio
- Jan
- vLLM
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
- Ollama
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Ollama:
ollama run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
- Unsloth Desktop
- Pi
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Docker Model Runner:
docker model run hf.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
- Lemonade
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
Run and chat with the model
lemonade run user.Qwen3.8-Flash-CIRU-STRIX-IU4-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download speed-grid.csv from jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4: direct link, hf CLI and curl.
- Browser
- Download file 11.9 kB
-
https://huggingface.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4/resolve/main/speed-grid.csv
- Command line
-
hf download hf://jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4/speed-grid.csv
-
curl -L -o speed-grid.csv https://huggingface.co/jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4/resolve/main/speed-grid.csv
11.9 kB
| stack,prompt,depth,pp,tg,generated,wall_ms,ttfp_ms,replay,drafted,accepted,cache_snapshot_ms | |
| CIRU v4.4.1,512,0,331.54394576148263,59.236109219329514,512,10303.878784179688,1675.0361919403076,0,383,383, | |
| CIRU v4.4.1,512,32000,520.871483100162,45.60444542495489,512,12218.343019485474,1009.3860626220703,4,383,383, | |
| CIRU v4.4.1,512,64000,473.75955037257665,42.40502726120451,512,13187.570810317993,1130.6560039520264,4,383,383, | |
| CIRU v4.4.1,512,120000,367.2159365978734,38.02085596479522,512,14940.75870513916,1491.0471439361572,4,383,383, | |
| CIRU v4.4.1,512,192000,324.0131048112782,35.22593091760655,512,16251.597881317139,1730.2141189575195,4,383,383, | |
| CIRU v4.4.1,512,256000,288.9041616870197,33.07923603407278,512,17436.919927597046,1969.8150157928467,4,383,383, | |
| CIRU v4.4.1,2048,0,840.3130330171629,55.07380644499333,512,11848.309993743896,2567.8536891937256,0,383,383, | |
| CIRU v4.4.1,2048,32000,749.444412119775,45.78913360238706,512,13923.51222038269,2760.2946758270264,4,390,380, | |
| CIRU v4.4.1,2048,64000,716.5158298218927,42.910417994496385,512,14824.497699737549,2909.8033905029297,4,383,383, | |
| CIRU v4.4.1,2048,120000,603.382595829707,38.574570722021605,512,16747.152090072632,3490.286350250244,4,383,383, | |
| CIRU v4.4.1,2048,192000,509.5339829062296,35.050580869063715,512,18762.099504470825,4168.815135955811,4,383,383, | |
| CIRU v4.4.1,2048,256000,453.77600127624504,32.57700493136803,512,20417.866468429565,4713.1757736206055,4,383,383, | |
| CIRU v4.4.1,4096,0,863.95894845059,53.77802745562997,512,14374.980688095093,4870.24450302124,0,383,383, | |
| CIRU v4.4.1,4096,32000,808.2911411014665,45.15058426711545,512,16418.69354248047,5096.902370452881,4,383,383, | |
| CIRU v4.4.1,4096,64000,745.2686087439877,41.783021342538355,512,17786.27920150757,5550.0946044921875,4,383,383, | |
| CIRU v4.4.1,4096,120000,627.4055204027037,37.42954949398691,512,20293.144464492798,6631.675243377686,4,390,380, | |
| CIRU v4.4.1,4096,192000,536.9674422848489,34.244420320706034,512,22720.27564048767,7783.368349075317,4,383,383, | |
| CIRU v4.4.1,4096,256000,487.37541793096517,32.7082955150334,512,24267.12942123413,8625.438928604126,4,383,383, | |
| CIRU v5.0,512,0,394.60136014156325,61.48849322868497,512,9722.432851791382,1410.9890460968018,0,383,383, | |
| CIRU v5.0,512,32000,596.9724634791602,56.11556423925305,512,9991.8532371521,883.5148811340332,4,383,383, | |
| CIRU v5.0,512,64000,573.6231923026938,55.48133916100923,512,10161.758184432983,944.7851181030273,4,383,383, | |
| CIRU v5.0,512,120000,533.1550596102761,54.227385508850794,512,10485.380411148071,1051.6726970672607,4,383,383, | |
| CIRU v5.0,512,192000,478.94467534192626,52.4774598526893,512,10975.682020187378,1223.6833572387695,4,383,383, | |
| CIRU v5.0,512,256000,422.4628096582259,50.50940364505905,512,11573.116064071655,1436.6161823272705,4,383,383, | |
| CIRU v5.0,2048,0,918.6822651259598,58.16034613942207,512,11122.03574180603,2333.4946632385254,0,383,383, | |
| CIRU v5.0,2048,32000,938.9017050601667,55.78206786636319,512,11377.791166305542,2214.202880859375,4,383,383, | |
| CIRU v5.0,2048,64000,881.6717322610918,54.88484225655968,512,11698.787450790405,2382.0600509643555,4,383,383, | |
| CIRU v5.0,2048,120000,746.4644991981338,52.93725081420806,512,12502.119541168213,2838.467836380005,4,383,383, | |
| CIRU v5.0,2048,192000,645.7436883126384,51.86570902200456,512,13208.627223968506,3341.637372970581,4,383,383, | |
| CIRU v5.0,2048,256000,571.4379784711858,50.482009338085035,512,13923.275232315063,3780.832290649414,4,383,383, | |
| CIRU v5.0,4096,0,1064.3807427122013,56.956177181638935,512,12933.534860610962,3959.336042404175,0,383,383, | |
| CIRU v5.0,4096,32000,1023.5268747021689,55.894556832732206,512,13180.27138710022,4033.9958667755127,4,383,383, | |
| CIRU v5.0,4096,64000,954.9390468654522,54.98026520500215,512,13643.908977508545,4343.171119689941,4,383,383, | |
| CIRU v5.0,4096,120000,838.5495304143102,53.08596175504474,512,14616.721153259277,4980.382204055786,4,383,383, | |
| CIRU v5.0,4096,192000,720.088970367706,50.95236552090318,512,15881.921291351318,5838.159561157227,4,383,383, | |
| CIRU v5.0,4096,256000,606.8674099903474,50.65735602307042,512,17231.42647743225,7124.891757965088,4,383,383, | |
| HaloBox,512,0,292.66273934610456,54.214831841187674,512,11308.061950840056,1880.8604287914932,0,446,445, | |
| HaloBox,2048,0,1046.3334646359215,54.59572612689692,512,11385.032947640866,2018.3455627411604,0,446,445, | |
| HaloBox,4096,0,1088.748412463405,51.140493042390965,512,13826.553323306143,3833.359511103481,0,447,444, | |
| HaloBox,512,32000,403.6552878448513,52.899443334292286,512,10957.196310162544,1295.0735609047115,0,446,445, | |
| HaloBox,2048,32000,803.6758753219314,52.65870287084737,512,12330.867217853665,2583.443340845406,0,446,445, | |
| HaloBox,4096,32000,993.1329319097781,52.58155362953178,512,13879.615106154233,4153.942130040377,0,446,445, | |
| HaloBox,512,64000,394.5627404848344,52.15978246002275,512,11149.618910159916,1350.1565740443766,0,446,445, | |
| HaloBox,2048,64000,836.4919618350542,50.80524322040816,512,12574.275255203247,2509.4964210875332,0,446,445, | |
| HaloBox,4096,64000,958.4445493263158,54.347681582145036,512,13732.603465206921,4326.65704889223,0,446,445, | |
| HaloBox,512,120000,330.9509604364933,49.66758196924867,512,11938.611637800932,1647.0399349927902,0,451,443, | |
| HaloBox,2048,120000,752.7394312333203,51.07477416903791,512,12833.813751116395,2822.2222169861197,0,446,445, | |
| HaloBox,4096,120000,821.1773951675635,50.111240088442905,512,15294.451863039285,5093.094673939049,0,446,445, | |
| HaloBox,512,192000,240.40098132431828,29.859507801950475,512,19406.5950200893,2287.1488546952605,0,446,445, | |
| HaloBox,2048,192000,439.8750136387028,34.77919262316309,512,19516.922291833907,4818.676698021591,0,446,445, | |
| HaloBox,4096,192000,558.0179246910126,37.90195824064598,512,20995.181169826537,7507.264185231179,0,446,445, | |
| HaloBox,512,256000,310.16223544584915,48.33476792690194,512,12433.68375999853,1854.7212332487106,0,446,445, | |
| HaloBox,2048,256000,579.0574595776612,48.44543711768041,512,14340.761093888432,3758.7033729068935,0,446,445, | |
| HaloBox,4096,256000,618.8494657739682,48.278329577354874,512,17413.7956276536,6822.31169892475,0,446,445, | |
| Gufo,512,0,973.0135638280839,73.7992092748339,512,7472.0710520632565,530.475,0,447,447,14.823201 | |
| Gufo,2048,0,1488.659008245861,71.07903130046516,512,8600.619587115943,1382.614,0,447,447,19.056171 | |
| Gufo,4096,0,1455.5928657798734,70.3997147966754,512,10112.633641809225,2823.712,0,447,447,23.20864 | |
| Gufo,512,32000,816.4442993179267,67.51944212723453,512,8266.879054252058,635.496,0,447,447,53.851659 | |
| Gufo,2048,32000,1277.1881975430304,62.830181240029326,512,9823.876908048987,1619.014,0,452,432,60.307147 | |
| Gufo,4096,32000,1297.0861420259632,66.20594336770449,512,10967.151255346835,3174.019,0,442,438,60.073193 | |
| Gufo,512,64000,784.4720367059491,58.64660363984269,512,9477.574034594,668.968,0,470,432,85.570474 | |
| Gufo,2048,64000,1227.872972850145,58.65526790692431,512,10505.643940065056,1687.564,0,463,436,85.360535 | |
| Gufo,4096,64000,1239.9041005375852,58.15815353250869,512,12212.575640995055,3324.882,0,468,431,86.542717 | |
| Gufo,512,120000,733.0541745633387,54.506584834113966,512,10302.171841263771,729.591,0,460,431,187.248606 | |
| Gufo,2048,120000,1160.2746241544023,55.798765387956124,512,25092.757657635957,1809.473,0,464,437,14097.798462 | |
| Gufo,4096,120000,1179.8890072246445,58.38321129039949,512,12896.048582158983,3504.282,0,453,445,514.004389 | |
| Gufo,512,192000,384.2564422785887,41.16284961886637,512,28986.67538492009,1384.152,0,447,447,15176.567735 | |
| Gufo,2048,192000,873.7043263469682,54.215183621412834,512,31037.77246689424,2397.62,0,447,447,19014.760418 | |
| Gufo,4096,192000,1119.279211470244,55.96786239472794,512,28555.184632074088,3709.738,0,450,446,15532.878223 | |
| Gufo,512,256000,532.5724326749339,55.52112697594514,512,36514.62246198207,1028.189,0,447,447,26271.168609 | |
| Gufo,2048,256000,1046.1243072246095,55.01678029940671,512,34204.3453627266,2065.874,0,447,447,22627.017739 | |
| Gufo,4096,256000,1061.6991744684715,55.554730019998516,512,34820.51781285554,3925.588,0,447,447,21479.898747 | |
| AgentionAI AP,512,0,518.8025388899247,54.203456865239076,512,10539.607584942132,1111.024911981076,0,446,445, | |
| AgentionAI AP,2048,0,706.0569203231314,54.44600075478566,512,12391.1278299056,2962.681748904288,0,446,445, | |
| AgentionAI AP,4096,0,795.9215240031743,53.159837378751874,512,14819.972226861864,5206.089067272842,0,448,444, | |
| AgentionAI AP,512,32000,464.82576296791245,52.47964796118108,512,10870.928771793842,1132.141328882426,0,446,445, | |
| AgentionAI AP,2048,32000,633.1344483259653,52.83709341804915,512,12947.907766327262,3269.470406230539,0,446,445, | |
| AgentionAI AP,4096,32000,744.4032542925861,52.67891346596736,512,15287.396343890578,5543.901495169848,0,446,445, | |
| AgentionAI AP,512,64000,457.25594633672796,52.04375627185825,512,10998.074672184885,1176.6864769160748,0,446,445, | |
| AgentionAI AP,2048,64000,596.9072161943726,52.137760410768,512,13341.900657862425,3496.5051538310945,0,446,445, | |
| AgentionAI AP,4096,64000,702.6493104052824,52.01486342535689,512,15728.50894369185,5897.366807796061,0,446,445, | |
| AgentionAI AP,512,120000,249.54696503125675,27.182224633691597,512,20953.99982202798,2152.542396914214,0,448,444, | |
| AgentionAI AP,2048,120000,370.9374157217694,27.267951864114032,512,24373.612767085433,5630.726309958845,0,446,445, | |
| AgentionAI AP,4096,120000,418.7350826904669,26.520036640207177,512,29158.386066090316,9885.772222653031,0,448,444, | |
| AgentionAI AP,512,192000,366.54004807974536,44.92510299585379,512,12948.3776348643,1568.735996261239,0,446,445, | |
| AgentionAI AP,2048,192000,449.3901744612529,42.674329228023886,512,16710.729227866977,4731.061259750277,0,446,445, | |
| AgentionAI AP,4096,192000,516.3651574037573,41.234860612856544,512,20509.752467740327,8111.728406045586,0,446,445, | |
| AgentionAI AP,512,256000,340.50250721572695,45.699522864785926,512,12896.977172233164,1708.678477909416,0,446,445, | |
| AgentionAI AP,2048,256000,438.97431764464557,45.85653455617425,512,16025.545499753207,4875.405575614423,0,446,445, | |
| AgentionAI AP,4096,256000,471.3905307125432,47.46815453476007,512,19693.076997995377,8921.45977402106,0,446,445, | |
| Halogen,512,0,908.9295224569502,58.40801024140454,512,9321.570644155145,571.4546218514442,0,254,329, | |
| Halogen,2048,0,1335.4199269692228,57.53403064728599,512,10430.638550780714,1543.0290619842708,0,254,329, | |
| Halogen,4096,0,1435.329572134422,56.670733059775976,512,11888.231843709946,2865.556343924254,0,254,329, | |
| Halogen,512,32000,884.7416623466389,57.01470555419186,512,9586.436036974192,621.5932667255402,0,254,329, | |
| Halogen,2048,32000,1256.0564244096902,57.36738703339882,512,10585.345536004752,1675.8685917593539,0,254,329, | |
| Halogen,4096,32000,1357.0552960275652,57.264526250910514,512,11989.071492105722,3063.2934868335724,0,254,329, | |
| Halogen,512,64000,847.1211118464594,,1,682.5256980955601,,0,0,0, | |
| Halogen,2048,64000,1196.5412479551298,56.75318473106099,512,10797.551415860653,1790.5809828080237,0,254,329, | |
| Halogen,4096,64000,1297.5575759495678,56.811864896715804,512,12236.42246099189,3238.4339845739305,0,254,329, | |
| Halogen,512,120000,778.233774129807,,121,2780.4787470959127,817.6730112172663,0,40,80, | |
| Halogen,2048,120000,1145.157682845001,44.918733133499174,512,13335.074136033654,1954.6609758399427,0,254,329, | |
| Halogen,4096,120000,1212.5159113110922,48.78048780487805,512,14024.181939661503,3544.1357628442347,0,254,329, | |
| Halogen,512,192000,684.0347361389446,55.22951050009188,512,10280.038055963814,1020.6890711560845,0,254,329, | |
| Halogen,2048,192000,1045.8050349793189,55.19371806919197,512,11509.540366008878,2244.3008008413017,0,254,329, | |
| Halogen,4096,192000,1144.8696089666546,55.30542447725009,512,13115.547508001328,3869.284935761243,0,254,329, | |
| Halogen,512,256000,687.9871002418704,55.07889971544365,512,10411.285666748881,1125.2922560088336,0,254,329, | |
| Halogen,2048,256000,1025.7951414976208,54.82656137677972,512,11704.694330692291,2376.162129919976,0,254,329, | |
| Halogen,4096,256000,1122.4377945851145,,121,6072.142546996474,4042.4109580926597,0,40,80, | |