SoC 101 - Lecture 6b: Cache Organization

System-on-Chip 101
or
"Everything you wanted to know about a computer but were afraid to ask"

This is Lecture 6 of my "SoC 101" course at Bar-Ilan University. In this course, I provide an overview of computer hardware engineering and SoC design, covering the full stack from the basic terminology, through computer architecture, and up to low-level software and design methodologies. The purpose of this course is to methodologically tell you about all those things that you may not have heard during your engineering studies and "fill the gaps" between the parts that you learned in-depth. It is in no way intended to provide a full, detailed description of every concept introduced, but following the course will give you a good idea about how a computer or any embedded system actually works.

Lecture 6 is all about the memory hierarchy, focusing on caches and virtual memory. The lecture starts with the motivation for having a memory hierarchy and the principles of locality (spatial and temporal). It then dives into caches, explaining how they operate, the parameters that affect their performance, and tradeoffs in cache design. After that, the concept of virtual memory is introduced, going into the details of how it works, its challenges and how they are dealt with. The lecture finishes with the introduction of the TLB, how it all fits together within the CPU pipeline, and the various addressing possibilities of caches with TLBs (PIPT, VIVT, VIPT).


Lecture slides can be found on the EnICS Labs web site at:
https://enicslabs.com/academic-course...


All rights reserved:
Prof. Adam Teman ‪@AdiTeman‬
Emerging nanoscaled Integrated Circuits and Systems (EnICS) Labs
Faculty of Engineering, Bar-Ilan University