"Sam Altman won't tell you that GPT-4 has 220 billion parameters and is a 16 weight mixture-model with 8 sets of weights."
January 1, 1970
https://en.wikiquote.org/wiki/George_Hotz