Duplicate from nif0/MOSS-Image-SFT-ComfyUI

Co-authored-by: Nif <nif0@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,38 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+assets/compare_anime.jpg filter=lfs diff=lfs merge=lfs -text
+assets/compare_noir_photo.jpg filter=lfs diff=lfs merge=lfs -text
+assets/compare_popup_book.jpg filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,108 @@
+---
+license: apache-2.0
+base_model: OpenMOSS-Team/MOSS-Image-SFT
+base_model_relation: quantized
+language:
+- en
+- zh
+pipeline_tag: text-to-image
+library_name: comfyui
+tags:
+- moss-image
+- comfyui
+- text-to-image
+- quantized
+- int8
+- w4a8
+- gptq
+- convrot
+---
+
+# MOSS-Image-SFT — INT8 / W4A8 ConvRot (ComfyUI)
+
+Single-file, ComfyUI-ready quantization of
+[**OpenMOSS-Team/MOSS-Image-SFT**](https://huggingface.co/OpenMOSS-Team/MOSS-Image-SFT)
+(code and docs: [OpenMOSS/MOSS-Image](https://github.com/OpenMOSS/MOSS-Image)).
+All credit for the model goes to OpenMOSS; this repo only re-packages the weights.
+
+| Component | Format | Size | Original |
+|---|---|---|---|
+| Diffusion model (DiT, 42 blocks) | **INT8 ConvRot** | 5.41 GB | 10.16 GB (bf16) |
+| Text encoder (Qwen3.5-9B) | **W4A8 GPTQ ConvRot** | 5.43 GB | 16.79 GB (bf16) |
+| VAE (`AutoencoderKLFlux2`) | **bf16** | 125 MB | 250 MB (fp32) |
+
+## File layout
+
+```
+MOSS-Image-SFT-INT8-W4A8-ConvRot/
+├── diffusion_models/
+│   └── moss_image_sft_int8_convrot.safetensors        # 5.41 GB
+├── text_encoders/
+│   └── qwen3.5_9b_moss_image_sft_w4a8_gptq.safetensors # 5.43 GB
+├── vae/
+│   └── moss_image_vae_bf16.safetensors                # 125 MB
+└── assets/                                            # comparison images
+```
+
+Drop each file into the matching folder of your ComfyUI `models/` directory.
+
+## Usage (ComfyUI)
+
+1. Install the official node pack from the
+   [MOSS-Image ComfyUI guide](https://github.com/OpenMOSS/MOSS-Image/blob/main/comfyui/README.md)
+   (copy `comfyui/moss-image` into `custom_nodes/`). ComfyUI needs
+   [comfy-kitchen](https://github.com/Comfy-Org/comfy-kitchen) quantized-op support; the
+   quantization type is auto-detected from the files.
+2. Load with the plugin's single-file loaders:
+   - **MOSSImageUNETLoader** → `moss_image_sft_int8_convrot.safetensors`
+   - **MOSSImageCLIPLoader** → `qwen3.5_9b_moss_image_sft_w4a8_gptq.safetensors`
+   - **VAELoader** → `moss_image_vae_bf16.safetensors`
+3. Use the official SFT sampling settings: **Euler**, 50 steps, **CFG 3**, `ModelSamplingSD3` shift **5**,
+   uncond skip-layer **22**.
+
+Tested end-to-end in stock ComfyUI on an 8 GB RTX 3060 Ti (≈210 s for 1024×1536, 50 steps).
+
+## How it was made
+
+- **DiT:** all 252 block linears (`layers.N.proj.{q,k,v,o,ffn_up_gate,ffn_down}`) quantized to INT8 with a
+  group-Hadamard (size 256) ConvRot rotation and per-output-channel scales. Embedders, modulation,
+  final layers and norms are kept in original precision.
+- **Text encoder:** the 200 body linears (attention / linear-attention / MLP) quantized to 4-bit weights
+  (group 16, fp8 relative scales) with 8-bit activations, using GPTQ run in the rotated basis. Calibration used
+  the model's real chat template on the official example prompts and negatives plus public prompt datasets.
+  Embeddings and the vision tower are INT8 ConvRot; everything else is unchanged.
+- **VAE:** plain fp32 → bf16 cast.
+
+## Quality check
+
+50 steps, official sizes, same seed, cfg 3. Left → right in each strip: original bf16 pipeline ·
+bf16 VAE · INT8 DiT · everything quantized (INT8 DiT + W4A8 text encoder + bf16 VAE).
+
+![anime](assets/compare_anime.jpg)
+![pop-up book](assets/compare_popup_book.jpg)
+![noir photo](assets/compare_noir_photo.jpg)
+
+- bf16 VAE vs. fp32 decode: **~54 dB PSNR** (visually identical).
+- Quantized DiT / full stack diverge in fine detail over the 50-step trajectory (PSNR 19–27 dB vs. the
+  original output), but composition, identity, style, lighting and rendered text are preserved.
+- Text-encoder `last_hidden_state` cosine vs. bf16: ≈ 0.996 (mean over tokens, first example prompt).
+
+Limitations: only three prompts were compared visually; the original model card recommends an fp32 VAE, which
+is the safest choice if you see banding. Results in ComfyUI's sampler will not match the diffusers pipeline
+pixel for pixel.
+
+## Checksums (SHA-256)
+
+```
+ffd98820ac8f0f57c48386bd98852720de50c3acb502f73fd641d0cd9df6d0af  moss_image_sft_int8_convrot.safetensors
+b5f31a430e4912decb152f3a0761350f52282176823b597edd43b2e3f6403da4  qwen3.5_9b_moss_image_sft_w4a8_gptq.safetensors
+81a27c7135775f149648fa35a58eec6d78a3e6a9bb9273885b51895cbc212d5d  moss_image_vae_bf16.safetensors
+```
+
+## License & attribution
+
+Apache-2.0, same as the original. Original model, architecture and pipeline © OpenMOSS-Team
+([MOSS-Image-Base](https://huggingface.co/OpenMOSS-Team/MOSS-Image-Base),
+[MOSS-Image-SFT](https://huggingface.co/OpenMOSS-Team/MOSS-Image-SFT),
+[technical report](https://github.com/OpenMOSS/MOSS-Image/blob/main/paper/MOSS_Image_Technical_Report.pdf)).
+This repo is an unofficial community quantization and is not affiliated with OpenMOSS.

diffusion_models/moss_image_sft_int8_convrot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ffd98820ac8f0f57c48386bd98852720de50c3acb502f73fd641d0cd9df6d0af
+size 5413724040

text_encoders/qwen3.5_9b_moss_image_sft_w4a8_gptq.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b5f31a430e4912decb152f3a0761350f52282176823b597edd43b2e3f6403da4
+size 5428937108

vae/moss_image_vae_bf16.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:81a27c7135775f149648fa35a58eec6d78a3e6a9bb9273885b51895cbc212d5d
+size 124774710