GPT-3 was the largest language model when OpenAI released it last year. Now, Google Brain’s 1.6 trillion parameters language model (as opposed to GPT-3’s 175 billion parameters) has replaced GPT-3 as the largest language model. Both GPT-3 and Google Brain model are transformer-based neural networks.
Developers across the world were waiting for the arrival of GPT-3 with bated breath. But much to their disappointment, and a departure from their earlier signals, OpenAI exclusively sold the source code of GPT-3 to Microsoft. Interestingly, GPT and GPT-2 were open-source projects.