Go over this excellent explanation of the GPT architecture. We will go over this in class, but I want you to have seen it before we take it up in class.
In class, we will go over the transformer code.