Chapter 6.
Performance basics

Now that we understand parallel computing, memory, and how a GPU is organized, we can ask what makes an op fast or slow. In this chapter, we cover pipelining to keep the hardware busy, the memory-bound and compute-bound distinction, how to optimize memory access, arithmetic intensity as a measure of compute efficiency, and the roofline model to reason about where the bottleneck lies.