Correct post-bias degeneration attribution
Cannot isolate instruct tuning vs architecture (sliding window, KV sharing, logit softcapping) with current test matrix. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -138,7 +138,9 @@ Gemma 4 E4B-it & Repetition loops & No \\
|
||||
Gemma 4 E2B-it & Repetition loops & No \\
|
||||
\bottomrule
|
||||
\end{tabular}
|
||||
\caption{Post-bias degeneration is caused by instruct tuning, not model size.}
|
||||
\caption{Post-bias degeneration correlates with both instruct tuning and
|
||||
architectural complexity (sliding window attention, KV sharing, logit
|
||||
softcapping). Confounded in current test matrix.}
|
||||
\label{tab:postbias}
|
||||
\end{table}
|
||||
|
||||
|
||||
Reference in New Issue
Block a user