ML Reading #:34 Touching the Elephant - TPUs

​What are TPUs (Tensor Processing Units)?

​We are reading Reed Olivers article for understanding TPUs.

​This week’s reading group focuses on Reed Oliver’s "Touching the Elephant," a deep dive into the history and architecture of Google’s Tensor Processing Units. The article explores how Google moved away from general-purpose chips to build custom, "monastic" hardware that now powers the world’s most advanced AI models.

• ​Why did Google decide to build its own hardware from scratch rather than sticking with industry-standard GPUs?

• ​What are TPUs and what makes them different from GPUs, what are the use cases for the/industry impact?
  

​link to reading -> https://considerthebulldog.com/tte-tpu/

​Discussion at 20:00, (optional) quiet reading from 19:00