Correct post-bias degeneration attribution

Cannot isolate instruct tuning vs architecture (sliding window,
KV sharing, logit softcapping) with current test matrix.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
2026-04-06 19:44:42 +07:00
parent 0448e96bc9
commit eeada7810a
5 changed files with 15 additions and 9 deletions

View File

@@ -138,7 +138,9 @@ Gemma 4 E4B-it & Repetition loops & No \\
Gemma 4 E2B-it & Repetition loops & No \\
\bottomrule
\end{tabular}
\caption{Post-bias degeneration is caused by instruct tuning, not model size.}
\caption{Post-bias degeneration correlates with both instruct tuning and
architectural complexity (sliding window attention, KV sharing, logit
softcapping). Confounded in current test matrix.}
\label{tab:postbias}
\end{table}