Blog
A step-by-step walk through what a GPT-style model actually does to a single token, and which of those steps your team can control.
Inside a Decoder-Only Transformer: Following One Token Through the Stack Read More »
Two-thirds of a transformer block’s parameters sit in the feed-forward path. Here is how SwiGLU gates them, why the 8/3 width rule keeps compute flat, and where it fails.
SwiGLU Explained: Why Modern LLMs Replaced GELU in the Feed-Forward Block Read More »
Attention is limited by memory bandwidth, not arithmetic. Here is how tiling, online softmax and recomputation make FlashAttention exact and fast.
Why Attention Is Memory-Bound: Inside FlashAttention and IO-Aware Kernels Read More »
How reasoning models are trained with verifiable rewards and GRPO, why the critic network disappeared, and what can still go wrong.
How Reasoning LLMs Are Trained: Verifiable Rewards and GRPO Read More »
How constrained decoding makes a language model return valid JSON every time, and what it still cannot guarantee in a business process.
How LLMs Are Forced to Return Valid JSON: Constrained Decoding Explained Read More »
How quantization shrinks large language models to fit on fewer GPUs, makes them faster, and makes fine-tuning on your own data practical.
LLM Quantization Explained: Running Bigger Models on Fewer GPUs Read More »
The KV cache, PagedAttention and speculative decoding decide how fast a model answers and how many users your own GPUs can serve.
Serving LLMs on Your Own GPUs: KV Cache, PagedAttention and Speculative Decoding Read More »
Why the newest long-context language models keep full attention in only a few layers, and what it means for teams training models on their own GPUs.
Hybrid Attention: Why 2026’s Long-Context LLMs Use Less Full Attention Read More »
Great news for messaging and SMS enthusiasts! AMD Telecom has confirmed its participation in the upcoming CAPACITY Messaging & SMS World 2023 Expo taking place in London from June 19-20. The event is set to bring together over 300 senior-level decision-makers in the messaging and SMS community from across the globe. Attendees will have the
AMD Telecom participating In Capacity Messaging & SMS World 2023 Read More »
AMD is excited to announce its participation in the CARRIER COMMUNITY-Mobile Messaging Summit 2023, which will be held in Berlin from June 26-27. This summit is the sixth annual hybrid event organized by Carrier Community (CC), designed for Telco Wholesale players and Enterprise companies. It brings together mobile network operators (MNOs), A2P players, aggregators, wholesale
AMD Telecom participating in CARRIER COMMUNITY- Mobile Messaging Summit 2023 Read More »
