Chapter 5.
GPU architecture

In the previous chapters, we introduced parallel computing and memory. Now, we will see how these concepts come together in actual GPU hardware. We will look at the hardware hierarchy first, then at the programming model that maps onto it. We use NVIDIA GPUs as our example throughout, but the concepts apply to other AI accelerators as well.