What Comes Next?

 

The world of tech (and text) has been talking about “GPT-3” by OpenAI. GPT-3 is a system that generates information such as text sequences.

GPT-3’s results are impressive in part because it has been ‘trained’ on a large dataset and has what is said to be the largest ever ‘language model’. 


Language models are ways to answer "what should come next in this sequence?".

We recommend you get curious about them as a way of understanding GPT-3. Here’s a video you can use: