sssebastian commited on
Commit
b2795ed
·
verified ·
1 Parent(s): 18a1ed4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -34,7 +34,7 @@ model-index:
34
 
35
  # Cantonese Stanza ELECTRA dependency parser (LoRA r=8)
36
 
37
- This is a **Cantonese-adapted Transformer dependency parser**, not a standalone LLM and not an off-the-shelf Cantonese Stanza model. We started from Stanza 1.14.0's Mandarin Chinese `zh-hans/gsdsimp_electra-large` dependency checkpoint and performed the adaptation ourselves.
38
 
39
  The ELECTRA base Transformer was adapted with LoRA (`r=8`, `alpha=16`, dropout `0.1`), while the Stanza parsing layers were fully fine-tuned. The base Transformer weights were frozen. Mandarin POS and lemma processors were also frozen, and their predictions were cached so that the upstream input condition stayed identical before and after parser adaptation.
40
 
 
34
 
35
  # Cantonese Stanza ELECTRA dependency parser (LoRA r=8)
36
 
37
+ This is a **Cantonese-adapted Transformer dependency parser**. We started from Stanza 1.14.0's Mandarin Chinese `zh-hans/gsdsimp_electra-large` dependency checkpoint and performed the adaptation ourselves.
38
 
39
  The ELECTRA base Transformer was adapted with LoRA (`r=8`, `alpha=16`, dropout `0.1`), while the Stanza parsing layers were fully fine-tuned. The base Transformer weights were frozen. Mandarin POS and lemma processors were also frozen, and their predictions were cached so that the upstream input condition stayed identical before and after parser adaptation.
40