The Evolution of LLM Architecture: Every Stage Solved One Problem and Created the Next
How LLM architecture evolved from RNNs to Transformers to Mixture of Experts, told as a chain of problems and fixes, with one example sentence carried through every stage.