Previous Post

Next transformer chapter (final version)

Next Post
Next transformer chapter (final version)
DESCRIPTION

Here's the final version of Chapter 7 of the neural net series, about the multilayer perception blocks in transformers, as motivated by the question of how LLMs may store facts. The plan is to make it public tomorrow, let me know if you catch any little errors in the meantime.

3blue1brown PATREON 16 favs
VIEWS1
FILES1 file
POSTEDAug 30, 2024
ARCHIVEDJun 10, 2026