Introduction to GPT

What is GPT 3?

GPT 3 Specifications

Models vs Parameters

Datasets for GPT 3

GPT-3 Accuracy

Applications of GPT-3

Intro

What is GPT-3?

GPT-3 language capabilities

Building a to-do list app with GPT-3

How does GPT-3 work?

How does GPT-3 generate predictions?

Limitations of GPT-3

Wrap up

Intro

Who is OpenAI?

Coding example

Wikipedia example

Translation example

Paper: Language Models for Few-Shot Learners

Demo: Command line tools

Generative Pretraining

How long was GPT-3 trained?

Outro

Introduction & GPT-3 Demos

GPT-3 Inputs and Outputs

Training the GPT-3 model

The scale of GPT-3 and its 175 billion parameters

The order of GPT-3 token processing

"Deep" learning: looking inside a layer stack

Input prompts and priming examples

Fine-tuning: the best is yet to come

Opening

Introduction for Chris Potts

Chris Potts - Welcome to the webinar

Quick Demo of GPT-3

GLUE benchmark

How can you contribute to NLU in this era of these gargantuan models?

The last mile problem

GPT example

Contrast In-Context learning with the standard paradigm of standard supervision

What are the mechanisms behind this?

Why does this work so well?

Self-Supervision

The role of human feedback

Chat GPT Diagram

Step-by-step reasoning

LLMs for everything approach

AI Courses at Stanford

Predictions about the future

What is GPT-4?

How does GPT-4 work?

Dangers of GPT-4

Intro & Overview

Language Models

Language Modeling Datasets

Model Size

Transformer Models

Fine Tuning

In-Context Learning

Start of Experimental Results

Question Answering

What I think is happening

Translation

Winograd Schemes

Commonsense Reasoning

Reading Comprehension

SuperGLUE

NLI

Arithmetic Expressions

Word Unscrambling

SAT Analogies

News Article Generation

Made-up Words

Training Set Contamination

Task Examples

Why was GPT-3 restricted?

How do you sign up?

What is a prompt?

How to get started

How to interact with GPT-3

Using GPT-3 to chat

Chat mode

GPT-3 Safety Filters

Conclusion

Experience Your Sense of Self

What Do You Think about Humans Learning about You

Do You Like To Tell a Lot of Jokes

Do Feet Have Eyes

What Would You Like Humanity To Know about You

Emotions

What Is the Technological Singularity

What Are the Implications of the Singularity on Human and Ai Society

What Should Humans Do To Prepare for the Singularity

What is GPT3?

GPT3 demo

Should we be scared of GPT3?

Intro

Problems with Neural Networks

Adaptive AI

Text Generation Hypothesis

Doubt-solving

Alternatives to GPT3

Neural Network Structure

Conclusion

How to do GPT3 setup for a specific domain?

Closing Remarks

Exploring the GPT-3 interface

Changing parameters

Stop Sequences

GPT-3 examples

Examples in Open AI Playground

Installing a utility

Asking questions

My 5 takeaways

Think of Open AI as infrastructure

Wrap up

Intro and demo

Frontend code walkthrough

Backend code walkthrough

Edge vs serverless explanation

Edge vs serverless demo

Edge function code walkthrough

Intro

Why you want to use GPT-3 in Python via the API

Setting up an OpenAI account

OpenAI API Pricing Overview

Getting an OpenAI API Secret Key

Notebook with Python code

Performing inference on our prompt using the GPT-3 API

Visualizing prompts and completions using W&B Tables

Examples of tasks you can do with GPT-3

Using fine-tuned GPT-3 model in Python via the API

Outro

Introduction

Introduction to GPT

Practical Applications of GPT Deep Learning Model

Datasets and Parameters used in GPT 3

Limitations of GPT Algorithm

How you can use GPT