Tag: Transformer Architecture

Princeton proposal loops decoder state across every token

A technical report argues that letting each token see the previous one's final hidden state, rather than only…