07 · PROTOCOL
VerifiedChat Template Mismatch
The same semantic dataset does not mean forcing the same rendered token sequence on every model.
Store role/content records independently, then render with each model's own tokenizer and chat template. Preserve one validated template through training, evaluation, and inference.
If response-only masking delimiters do not match the real rendering, assistant answers can fall outside the loss or prompt tokens can be trained accidentally.
01
First thought
QLoRA repairs the wrong template while adapting.
02
Correction
QLoRA changes memory and optimization; it cannot fix incorrect control tokens or mask boundaries.
03
Decision rule
Inspect BOS/EOS and role boundaries in at least one rendered example.