Chapter 6.
Performance basics

Now that we understand parallel computing, memory, and how a GPU is organized, we can ask what makes an op fast or slow. In this chapter, we cover pipelining to keep the hardware busy, the memory-bound and compute-bound distinction, and op fusion as a way to optimize memory access.