Last month, the Stanford Institute for Human-Centered Artificial Intelligence (HAI) introduced the Center for Research on Foundation Models. Most of these models are typically known as large language models such as GPT-3 and BERT. Today I gave a lecture at SPL on the technological foundations which is the fifth section of this report. This section is quite long to read but I have summarised the key points. You can find the slides from here.