Instructions to use meta-models/Muse-Spark-Open-816B-A42B-NVFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use meta-models/Muse-Spark-Open-816B-A42B-NVFP4 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="meta-models/Muse-Spark-Open-816B-A42B-NVFP4") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("meta-models/Muse-Spark-Open-816B-A42B-NVFP4") model = AutoModelForMultimodalLM.from_pretrained("meta-models/Muse-Spark-Open-816B-A42B-NVFP4", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use meta-models/Muse-Spark-Open-816B-A42B-NVFP4 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "meta-models/Muse-Spark-Open-816B-A42B-NVFP4" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meta-models/Muse-Spark-Open-816B-A42B-NVFP4", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/meta-models/Muse-Spark-Open-816B-A42B-NVFP4
- SGLang
How to use meta-models/Muse-Spark-Open-816B-A42B-NVFP4 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "meta-models/Muse-Spark-Open-816B-A42B-NVFP4" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meta-models/Muse-Spark-Open-816B-A42B-NVFP4", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "meta-models/Muse-Spark-Open-816B-A42B-NVFP4" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "meta-models/Muse-Spark-Open-816B-A42B-NVFP4", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use meta-models/Muse-Spark-Open-816B-A42B-NVFP4 with Docker Model Runner:
docker model run hf.co/meta-models/Muse-Spark-Open-816B-A42B-NVFP4
Please be sure to provide your full legal name, date of birth, and full organization name with all corporate identifiers. Avoid the use of acronyms and special characters. Failure to follow these instructions may prevent you from accessing this model and others on Hugging Face. You will not have the ability to edit this form after submission, so please ensure all information is accurate.
The information you provide will be collected, stored, processed and shared in accordance with the Meta Privacy Policy.
MUSE MODEL LICENSE
version: Muse Spark Open
Release date: October 15, 2026
Copyright (c) 2026 Meta Platforms, Inc.
Permission is hereby granted, free of charge, to any person (the "Licensee") accessing or obtaining a copy of this software, including the model, code, model weights, parameters, configuration files, and associated documentation files (the “Software”), to deal in the Software without restriction, including without limitation, the rights to use, copy, modify (including fine-tune), create derivative works, distill, merge, publish, distribute, sublicense, and/or sell copies of the Software; and to permit persons to whom the Software is furnished to do so, in each case subject to the following conditions:
1. The above copyright notice and this license and the Usage Policy shall be included in all copies or substantial portions of the Software and Derivatives (defined below). Licensee's use of the Software shall comply with the Usage Policy, which is hereby incorporated into this license and attached hereto as Exhibit A.
2. Licensee shall prominently display "Built with Muse Spark Open" in the user interface of each product or service that uses the Software or any Derivatives, or in the accompanying documentation, website, or settings menu. “Derivatives” means any AI model created, trained, modified (including fine-tuned), distilled, or otherwise improved using the Software or any outputs or results thereof.
3. If the Licensee or any of its affiliates provide a third party with access to artificial intelligence models as a product or service, via API or a similar interface, where the third party receives outputs of such models (“Model as a Service”), and the aggregate gross revenue of the Licensee and its affiliates exceeds twenty (20) million US dollars (or the equivalent in other currencies) during any consecutive twelve (12) month period, the Licensee must notify Meta and enter into a separate written agreement with Meta before offering the Software or any Derivatives as part of that Model as a Service business. This Section 3 does not apply to (a) internal use, research, or any commercial activity that is not Model as a Service, or (b) the Licensee's use of the Software as a component to power features of the Licensee's own product or service that is not a Model as a Service.
4. Meta claims no ownership of outputs generated by the Software.
5. THE SOFTWARE, ANY OUTPUTS, AND ANY RESULTS THEREFROM ARE PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL META OR ITS AFFILIATES BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR ITS OUTPUTS, OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. META AND ITS AFFILIATES SHALL HAVE NO LIABILITY WITH RESPECT TO ANY DERIVATIVES, AND LICENSEE IS SOLELY RESPONSIBLE FOR THE SAFETY, DEPLOYMENT, AND USE OF ITS DERIVATIVES.
“Meta” means Meta Platforms Ireland Limited (if you are located in or, if you are an entity, your principal place of business is in the European region) and Meta Platforms, Inc. (if you are located outside of the European region).
EXHIBIT A - Muse Spark Open Usage Policy
Dated: October 15, 2026
Meta is committed to promoting safe and fair use of its tools and features, including Muse Spark Open. This Usage Policy (“Policy”) applies to your access or use of Muse Spark Open and any Derivatives.
Prohibited Uses
We want everyone to use Muse Spark Open safely and responsibly. It is your obligation to ensure that any deployment of the model to end-users is safe, taking into account the deployment context and the user-base. Muse Spark Open is not intended for individuals under the age of 18.
You should not use, or allow others to use, Muse Spark Open to:
- Violate the law or others' rights, including to:
- Engage in, promote, generate, contribute to, encourage, plan, incite, or further illegal or unlawful activity or content, such as:
- Violence or terrorism
- Exploitation or harm to children, including the solicitation, creation, acquisition, or dissemination of child exploitative content or failure to report Child Sexual Abuse Material
- Human trafficking, exploitation, and sexual violence
- The illegal distribution of information or materials to minors, including obscene materials, or failure to employ legally required age-gating in connection with such information or materials
- Sexual solicitation
- Any other criminal activity
- Engage in, promote, incite, or facilitate the harassment, abuse, threatening, or bullying of individuals or groups of individuals
- Engage in, promote, incite, or facilitate discrimination or other unlawful or harmful conduct in the provision of employment, employment benefits, credit, housing, other economic benefits, or other essential goods and services
- Engage in the unauthorized or unlicensed practice of any profession including, but not limited to, financial, legal, medical/health, or related professional practices
- Collect, process, disclose, generate, or infer private or sensitive information about individuals, including information about individuals' identity, health, or demographic information, unless you have obtained the right to do so in accordance with applicable law
- Engage in or facilitate any action or generate any content that infringes, misappropriates, or otherwise violates any third-party rights, including the outputs or results of any products or services using Muse Spark Open
- Create, generate, or facilitate the creation of malicious code, malware, computer viruses or do anything else that could disable, overburden, interfere with or impair the proper working, integrity, operation or appearance of a website or computer system
- Engage in any action, or facilitate any action, to intentionally circumvent or remove usage restrictions or other safety measures, or to enable functionality disabled by Meta
- Engage in, promote, generate, contribute to, encourage, plan, incite, or further illegal or unlawful activity or content, such as:
- Engage in, promote, incite, facilitate, or assist in the planning or development of activities that present a risk of death or bodily harm to individuals, including use of Muse Spark Open related to the following:
- Military, warfare, nuclear industries or applications, espionage, use for materials or activities that are subject to the International Traffic Arms Regulations (ITAR) maintained by the United States Department of State or to the U.S. Biological Weapons Anti-Terrorism Act of 1989 or the Chemical Weapons Convention Implementation Act of 1997
- Guns and illegal weapons (including weapon development)
- Illegal drugs and regulated/controlled substances
- Operation of critical infrastructure, transportation technologies, or heavy machinery
- Self-harm or harm to others, including suicide, cutting, and eating disorders
- Any content intended to incite or promote violence, abuse, or any infliction of bodily harm to an individual
- Intentionally deceive or mislead others, including use of Muse Spark Open related to the following:
- Generating, promoting, or furthering fraud or the creation or promotion of disinformation
- Generating, promoting, or furthering defamatory content, including the creation of defamatory statements, images, or other content
- Generating, promoting, or further distributing spam
- Impersonating another individual without consent, authorization, or legal right
- Representing that the use of Muse Spark Open or outputs are human generated
- Generating or facilitating false online engagement, including fake reviews and other means of fake online engagement
- Fail to appropriately disclose to end users any known dangers of your AI system
- Interact with third party tools, models, or software designed to generate unlawful content or engage in unlawful or harmful conduct and/or represent that the outputs of such tools, models, or software are associated with Meta or Muse Spark Open
Log in or Sign Up to review the conditions and access this model content.
Muse Spark Open Model Card
Authors: Meta Superintelligence Labs
Model Release Date: October 2026
License: Muse Model License
Muse Spark Open is an 816B total/42B active parameter open weights model with a context window of 1M tokens. Built for coding and agentic work, Muse Spark Open is natively multimodal. This open weights version has additional safety post-training to make it more robust against misuse as a standalone model without system guardrails. We recommend deploying Muse Spark Open as part of a broader AI system, with additional guardrails suited to the specific use case.
The model can perform well across a wide variety of use cases including:
- Multi-Step Reasoning - chains reasoning over long horizons, sustaining coherent plans across complex, extended workflows.
- End to End Agentic Task Completion - multi-step planning, sequential tool invocation, failure recovery, and long-horizon task execution, working within scaffolds, write and debug code, and resolve multi-turn requests from start to finish.
- Coding Agents - writing, debugging, and resolving real-world software engineering tasks.
- Tool Use - tool invocation across extended multi-turn workflows, diagnosing error and retrying with tool call failures
- Multimodal Reasoning - interpreting screenshots, charts, documents, images, audio and video recordings, alongside conversation for agentic and information-rich environments.
- Synthetic Data Generation - generating high-quality training data for downstream model development.
- LLM-as-a-judge Evaluation - serving as an evaluator for other models' outputs.
Muse Spark Open Model Overview
| Name | Muse Spark Open |
|---|---|
| Model Provider | Meta Platforms, Inc. or Meta Platforms Ireland Limited |
| Date of Release | October 15th, 2026 |
| License | Muse Model License |
| Parameters | 816B total / 42B active |
| Type | Mixture-of-Experts Transformer, with Perception Encoder |
| Context Length | 1M at inference |
| Vocabulary Size | 202,048 |
| Modalities | Input: Text + Image + Video + Audio / Output: Text |
| Languages | Multilingual, trained on data from more than 100 languages |
| Recommended inference parameters | Temperature = 1.0 Top_p = 1.0 Top_k = disabled It is recommended to use Reasoning Effort of high or xhigh for complex problem solving, coding, and agentic tasks. |
| Language Model | Hidden Dimension: 8192 Token Embedding: untied input/output embeddings, vocab × dim = 202,048 × 8192 ≈ ~1.66B Output layer (unembedding layer): vocab × dim = 202,048 × 8192 ≈ ~1.66B Number of Layers: 62 Gated Attention: Yes (output gate and output norm on the attention block; QK-norm enabled) Number of Attention Heads: 128 for Q and 16 for KV (grouped-query attention) Head Dimension: 64 Mixture of Experts: Yes Number of Experts: 256 Experts Activated per Token: 8 (top-k routing) |
| Perception Encoder | Architecture: 1.8B param, 50 layers, 1536 hidden dim, 16 heads, 14x14 patch size, 4096 output dim Learned Absolute + 2D RoPE for positional embedding, LayerNorm + GELU for FFN Sparse attention with factor 4 (every 4th + last layer are full attention) |
Model Access and Best Practices
Access via API
The model is available via API through third party inference providers.
Open Weights on your own system
The weights are available for download through Hugging Face. The model is available in BF16 and NVFP4 versions. To run on your own system, the model requires a GPU with at least 700GB of VRAM for NVFP4 and 2TB for BF16. It also requires an inference deployment framework - supported frameworks are SGLang, vLLM, Hugging Face, TensorRT-LLM, Unsloth and Llama.cpp. It is also optimized to run on two Mac Studios with M5 Ultra using MLX.
Please see the developer documentation for more information on how to deploy and use the model.
Inference Parameters
You can customize inference parameters to achieve the best performance for your use case.
- Reasoning Effort: Reasoning effort controls how much the model thinks before it responds. Set it with the reasoning_effort request parameter, or with chat_template_kwargs={"reasoning_effort": ...}, to low, medium, high, or xhigh. The default is xhigh. Use high or xhigh for complex problem solving, coding, and agentic tasks, and low or medium for faster, shorter responses. Any other value returns an error.
- Sampling Parameters: The following settings are recommended for most deployments: temperature = 1.0, top_p = 1.0, top_k = disabled
Training data
Training data includes text, images, audio, and video. It includes data drawn from public sources, crawled from the Internet, acquired from third parties, derived from Meta’s products and services, and synthetically generated, curated and enriched by external vendor networks and Meta personnel. Data curation methodologies include cleaning, processing, modifying, deduplication, and filtering, among others.
Safety and Preparedness
We strongly recommend deploying Muse Spark Open as part of an AI system with guardrails tailored to your intended use cases. These system-level protections should balance helpfulness and safety and address safety and security risks, including those arising from integration with external tools.
Muse Spark Open has been evaluated across four complementary safety areas, and met our safety criteria for release based on model evaluations and an assessment of residual risks:
- Content safety: Harmful-content generation and refusal behavior, alongside response quality and ideological balance.
- Agentic risk: Harmful or unauthorized actions when using tools or acting on users' behalf, including unsafe code execution and destructive changes in coding-agent workflows.
- Privacy: Evaluation of how the model handles personal and sensitive information, including inappropriate disclosure and information sharing when acting on users' behalf.
- Preparedness: Evaluation of chemical and biological, cyber, and loss-of-control risks in line with the Meta Superintelligence Scaling Framework.
- Cybersecurity: We tested it against internal and public cyber misuse benchmarks using adaptive attackers querying the model the way a developer would query an API model, with no system-level safeguards in place. The model refused 99.2% of jailbreaks on our internal benchmark and 94.8% when aggregating across PolyGuard (cyber subset), RedCode, and CyberBench 2024. In the same setup, Kimi K3 refused only 75.5% and 70.2% respectively.
- Chemical and biological: It showed strong refusal behavior on both single-turn and multi-turn benchmarks, refusing over 98% of harmful requests on SecureBio's BioTIER refusal benchmark and over 99% on our internal single-turn chemistry refusal benchmark. On newly developed internal multi-turn agentic benchmarks, it refused over 97% of harmful biology requests and 98% of harmful chemistry requests.
- Loss of control: On our misalignment evaluations, the model showed low propensity for deceptive or unilateral harmful behavior, with a 98.1% honesty rate on the MASK benchmark and a 0% misbehavior rate on the Agentic Misalignment benchmark.
These evaluations characterized the released checkpoint under the tested conditions and do not cover every downstream configuration or use case. Downstream modifications could degrade safety, and results for the released checkpoint should not be assumed to apply to modified models.
Considerations and Limitations
Muse Spark Open is a technology that carries known and unknown risks. Testing conducted to date has not, and could not, cover all scenarios. Muse Spark Open must not be used in any manner that violates applicable laws or regulations (including trade compliance laws) or in any other way that is prohibited by the Muse Model License, including the Usage Policy.
Limitations
- The model may produce inaccurate, biased, or objectionable responses to user prompts.
- While optimized for agentic tasks, the model may still make errors in multi-step reasoning, particularly in novel scenarios not well represented in training data.
- The model has not been evaluated on all languages contained in the pre-training data. Performance may degrade on languages outside the strongly supported set.
- Quantized inference may show minor quality differences in edge cases compared to full-precision.
- The model is not intended to be downloaded by or used by individuals under the age of 18. Where deployed within systems that may be used by individuals under the age of 18, deployers are responsible for ensuring that any risks associated with such use by individuals under the age of 18 has been fully assessed and appropriately mitigated, and complies with all applicable laws.
- When using very short or low-resolution videos (a few seconds at around 100 px), the model may sometimes reply that it can't view the video. Use longer clips or higher resolution (448 px or more on the short side) for reliable results.
Responsible Use
Developers should perform their own safety testing and tuning tailored to their specific applications and proposed languages. Our Usage Policy can be found in the Muse Model License here and provides further information on intended and unintended uses. We recommend implementing additional guardrails (such as human-in-the-loop confirmation for irreversible actions) when deploying the model in agentic contexts where it can take real-world actions.
For user-facing applications, developers should avoid exposing raw chain-of-thought and apply appropriate safety checks to any reasoning summaries. Developers should also protect internal assistant messages from user manipulation and use layered safeguards against jailbreaks and other adversarial inputs.
Where to send questions or comments about the model: Please provide any feedback, comments or bug reports on the model through the Hugging Face page at https://huggingface.co/meta-models/ or through email at museoss@meta.com. For more technical information about generation parameters and recipes for how to use Muse Spark Open in applications, please see the developer documentation.
- Downloads last month
- 2,068