In this moment, excerpted from the Generative AI Digital Summit event, which took place on May 25, Laurence Moroney, Lead AI Advocate, Google, breaks down the “GPT” in ChatGPT.
Highlights
00:08 — Artificial intelligence (AI) is a lot more than just ChatGPT and large language models. But in the hype cycle, there’s a peak of inflated expectations and a trough of disillusionment. One gets to the trough by really understanding the technology and its limitations.
00:48 —Moroney explains GPT, the favorite three-letter acronym at the moment. The “T” stands for “transformers.” Transformers are machine learning algorithms used to understand text.
01:10 — The “GP” stands for “generative pre-trained.” The “P” in “pre-trained” refers to getting lots of text and figuring out the patterns, or programming a computer to figure out the patterns in that text for whatever comes next.
01:26 — The “generative” part of it is now as simple as giving it a piece of text, a prompt. The idea is that someone gives a computer a piece of text, which is a prompt, and it completes that prompt. And that’s the generative side of it. The computer is creating new content.
