Add Hopfield (1982) — mathematical bridge between Pavlov and CRI
Dot-product pattern completion is the same operation at biological, theoretical, and computational abstraction levels. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
11
paper.tex
11
paper.tex
@@ -363,6 +363,13 @@ operating in the model's internal space.
|
||||
CRI implements the Pavlovian mechanism on transformers: activation pattern (CS)
|
||||
paired with logit biases (US) produces token sequence (CR).
|
||||
|
||||
\subsection{Associative Memory}
|
||||
|
||||
\textbf{Hopfield}~\citep{hopfield1982}: formalized associative memory as
|
||||
pattern completion via dot-product similarity---store patterns as attractors,
|
||||
retrieve by nearest match. CRI's cosine similarity matching is the same
|
||||
computation at a different abstraction level.
|
||||
|
||||
\subsection{Training-Free External Memory}
|
||||
|
||||
\begin{itemize}
|
||||
@@ -415,6 +422,10 @@ Das, P. et~al. Larimar. \emph{ICML}, 2024. arXiv:2403.11901.
|
||||
\bibitem[Fountas et~al.(2024)]{fountas2024emllm}
|
||||
Fountas, Z. et~al. EM-LLM. arXiv:2407.09450, 2024.
|
||||
|
||||
\bibitem[Hopfield(1982)]{hopfield1982}
|
||||
Hopfield, J.~J. Neural networks and physical systems with emergent collective
|
||||
computational abilities. \emph{PNAS}, 79(8):2554--2558, 1982.
|
||||
|
||||
\bibitem[Jang et~al.(2024)]{jang2024camelot}
|
||||
Jang, J. et~al. CAMELoT. arXiv:2402.13449, 2024.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user