Article: Chatbots and GPT-3: Using human knowledge and relevant context for better chatbot experiences

API, Innovation, Language, Open Data, Open Infrastructure, Open Space

Chatbots and GPT-3: Using human knowledge and relevant context for better chatbot experiences

GPT, or Generative Pre-trained Transformer, is an autoregressive language model that uses deep learning to produce human-like texts. GPT-3 is the third generation of the GPT series launched by OpenAI, an innovative company co-founded by the famous tech-prodigy Elon Musk. OpenAI started giving selective access to the technology starting July 2020 to stimulate the use of GPT-3 to build language based solutions.

Such language comprehension in AI comes at a much-needed time, with many of us now operating in a disparate digital landscape. By the end of 2021, 80% of businesses are expected to have some sort of chatbot automation, however the user experience with chatbots to date has been a rocky one.

Read Full Article

Article: GPT-Neo: The Open-Source Cure For GPT-3 FOMO

Code, Language, Open Data, Open Software, Open Source

GPT-Neo: The Open-Source Cure For GPT-3 FOMO

GPT-3 was the largest language model when OpenAI released it last year. Now, Google Brain’s 1.6 trillion parameters language model (as opposed to GPT-3’s 175 billion parameters) has replaced GPT-3 as the largest language model. Both GPT-3 and Google Brain model are transformer-based neural networks.

Developers across the world were waiting for the arrival of GPT-3 with bated breath. But much to their disappointment, and a departure from their earlier signals, OpenAI exclusively sold the source code of GPT-3 to Microsoft. Interestingly, GPT and GPT-2 were open-source projects.

Read Full Article