Article: GPT-Neo: The Open-Source Cure For GPT-3 FOMO

Code, Language, Open Data, Open Software, Open Source

GPT-Neo: The Open-Source Cure For GPT-3 FOMO

GPT-3 was the largest language model when OpenAI released it last year. Now, Google Brain’s 1.6 trillion parameters language model (as opposed to GPT-3’s 175 billion parameters) has replaced GPT-3 as the largest language model. Both GPT-3 and Google Brain model are transformer-based neural networks.

Developers across the world were waiting for the arrival of GPT-3 with bated breath. But much to their disappointment, and a departure from their earlier signals, OpenAI exclusively sold the source code of GPT-3 to Microsoft. Interestingly, GPT and GPT-2 were open-source projects.

Read Full Article

Article: This AI Can Generate Convincing Text—and Anyone Can Use It

Code, Open Software, Open Source

This AI Can Generate Convincing Text—and Anyone Can Use It

Some of the most dazzling recent advances in artificial intelligence have come thanks to resources only available at big tech companies, where thousands of powerful computers and terabytes of data can be as copious as free granola bars and nap pods.

A new project aims to show this needn’t be the case, by cobbling together the code, data, and computer power needed to reproduce one of the most epic—and potentially useful—AI algorithms developed in recent years.

Read Full Article