"Sam Altman won't tell you that GPT-4 has 220 billion parameters and is a 16 weight mixture-model with 8 sets of weights."
George Hotz

January 1, 1970