Notes
Notes on LLM Infra.
LLM Infra 笔记。
-
OCT 2026
The Logic Chain of LLM Infra
Starting from the LLM itself, one causal chain through the main designs of training and inference systems: the problem behind each step, how it is solved, which cost it improves and which it sacrifices.
-
2026.10
LLM Infra 的逻辑链
从 LLM 本身出发,沿一条因果链贯穿训练与推理系统的主要设计:每一步遇到什么问题,怎么解决,优化了哪种开销,牺牲了哪种开销。
-
OCT 2026
The Roofline Model, Starting from Measured Data
Arithmetic intensity, measuring hardware peaks, reading a roofline plot, and where LLM prefill and decode land, using measurements from eight GPUs.
-
2026.10
Roofline 模型:从实测数据出发
用八种 GPU 上的实测数据讲 arithmetic intensity、硬件峰值怎么测、roofline 图怎么读,以及 LLM 推理的 prefill 与 decode 落在哪里。