‹ Sitong Zhang

Notes

Notes on LLM Infra.

LLM Infra 笔记。

  • OCT 2026 The Logic Chain of LLM Infra

    Starting from the LLM itself, one causal chain through the main designs of training and inference systems: the problem behind each step, how it is solved, which cost it improves and which it sacrifices.

  • 2026.10 LLM Infra 的逻辑链

    从 LLM 本身出发,沿一条因果链贯穿训练与推理系统的主要设计:每一步遇到什么问题,怎么解决,优化了哪种开销,牺牲了哪种开销。

  • OCT 2026 The Roofline Model, Starting from Measured Data

    Arithmetic intensity, measuring hardware peaks, reading a roofline plot, and where LLM prefill and decode land, using measurements from eight GPUs.

  • 2026.10 Roofline 模型:从实测数据出发

    用八种 GPU 上的实测数据讲 arithmetic intensity、硬件峰值怎么测、roofline 图怎么读,以及 LLM 推理的 prefill 与 decode 落在哪里。