ngquocvinh/Humanizer-12B-GGUF

Humanizer 12B GGUF

Community GGUF quantizations of jialinyyzz/humanizer.

☕ If this GGUF made your day easier, a coffee would make mine.
Send a coffee ☕
I build and test these releases myself. Your coffee helps keep me going.
Thank you for supporting this work.

About Humanizer

Humanizer is an English and Chinese text-completion model for rewriting drafts. See the upstream model card for the model description and examples. Build the exact prompt as instr + "\n\n" + draft.strip() + sep and send it to /completion; the original prompt_format.json is included here. Upstream notes that GGUF chat templates are available but untested by the authors.

Artifact measurements

Sizes are measured from the local files in decimal GB (bytes / 1,000,000,000). Peak build RSS + cache is the observed cgroup estimate (process RSS plus charged file cache), in GiB. The BF16 row links to the upstream reference and was not quantized locally.

File	Size (GB)	Peak build RSS + cache (GiB)
humanizer-12b-bf16.gguf (upstream reference)	23.832050	N/A
humanizer-12b-Q8_0.gguf	12.669631	12.156696
humanizer-12b-Q6_K.gguf	9.786006	13.775974
humanizer-12b-Q5_K_M.gguf	8.547252	12.997784
humanizer-12b-Q4_K_M.gguf	7.381367	11.978336
humanizer-12b-Q3_K_M.gguf	6.087072	10.795521
humanizer-12b-Q2_K.gguf	4.830132	9.681194
humanizer-12b-IQ2_XS.gguf	3.887827	8.917431
humanizer-12b-IQ1_M.gguf	3.202833	14.173813
humanizer-12b-Q1_0.gguf	2.377448	13.498875
humanizer-12b-Q5_K_S.gguf	8.338356	18.925488
humanizer-12b-Q4_K_S.gguf	7.024032	17.732090
humanizer-12b-Q3_K_S.gguf	5.528214	16.260834
humanizer-12b-Q3_K_L.gguf	6.566304	17.284103
humanizer-12b-IQ4_XS.gguf	6.635240	17.493828
humanizer-12b-IQ3_XXS.gguf	4.849179	15.862881
humanizer-12b-IQ2_XXS.gguf	3.568093	14.703056
humanizer-12b-TQ2_0.gguf	3.654785	14.486164

Peak build memory and file size describe artifact/build footprint, not inference speed or output fidelity. Each listed file passed a bilingual CPU smoke test with a non-empty generation for one English and one Chinese draft. No hold-out fidelity scores are published.

Quick start

Start llama.cpp with a published GGUF:

./llama-server \
  -m humanizer-12b-Q8_0.gguf \
  --host 127.0.0.1 --port 8080 --no-webui \
  -ngl 0 -c 8192 -np 1

Humanizer is a text-completion model. For a reproducible request, build the prompt from the included prompt_format.json and use /completion. Upstream notes that GGUF chat templates are available but untested by the authors. This example submits an English draft:

import json
import requests

with open("prompt_format.json", encoding="utf-8") as f:
    prompt_format = json.load(f)
draft = "The team moved the review to Friday because the shipment arrives on Thursday."
prompt = prompt_format["instr"] + "\n\n" + draft.strip() + prompt_format["sep"]
response = requests.post("http://127.0.0.1:8080/completion", json={
    "prompt": prompt,
    "n_predict": 2048,
    "temperature": 1.0,
    "top_p": 0.95,
    "top_k": 0,
    "min_p": 0.0,
    "repeat_penalty": 1.0,
})
response.raise_for_status()
print(response.json()["content"])

For short English drafts, upstream notes that a Chinese reply can occasionally occur. If the output language is wrong, retry with the same settings up to three times.

Reproducibility and validation

• Artifact measurements report exact bytes and decimal GB.
• Build measurements report per-format peak RSS-plus-file-cache.
• Reproducibility manifest records the source revision, BF16 and prompt hashes, calibration split, imatrix, quantization commands, and runtime checks.
• SHA256 checksums cover the published GGUF files, prompt format, and license.

The quantizations are built directly from the pinned BF16 GGUF with this model's own imatrix. Build and runtime logs remain local and are not included here.

License and attribution

The upstream model is licensed under Apache-2.0; see LICENSE. These are community GGUF quantizations, not an official jialinyyzz release or endorsement.