توجه خطی (Linear Attention)
Definitions are in Persian for now. Read in Persian
Articles with this concept
- Advanced (300)
Build a semantic layer for agentic AI on AWS with Denodo and Amazon Bedrock AgentCore
AWS, in collaboration with Denodo and Amazon Bedrock AgentCore, has developed a governed semantic layer for agentic AI. This layer federates data from Amazon Aurora, Amazon Redshift, and an on-premises PostgreSQL database into a unified customer 360 view, enabling queries via VQL with identity propagation and access control.
- Advanced (300)
Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod
The AWS blog post discusses fine-tuning the GPT-OSS-20B model for multilingual reasoning using Amazon SageMaker HyperPod. It highlights the use of supervised fine-tuning (SFT) and reinforcement learning with GRPO, with SFT improving reasoning-language accuracy from 22% to 100%.
- Advanced (300)
Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch
i14 trained and served the Laplace 3B linear attention model on AWS Trainium2 using native PyTorch. The model maintains a fixed recurrent state of 29.5 MB per sequence, avoiding the growing key-value cache of transformer models and ensuring predictable memory usage.