Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch

i14 trained and served the Laplace 3B linear attention model on AWS Trainium2 using native PyTorch. The model maintains a fixed recurrent state of 29.5 MB per sequence, avoiding the growing key-value cache of transformer models and ensuring predictable memory usage.