Crafting Token Specifications Programming Languages

Summary

This video is part of an online course, You hit send. A reply starts typing itself. But what is the model actually doing? Not searching a database. Not looking up a fact ... I once removed a draft from a model's context and left a placeholder note in its place. On the next step it wrote that note into a file ... What actually happens when you type a prompt into ChatGPT? You see words. The model doesn't. Before a single neural network ... Every answer of a language model is written one token at a time. What a token is, why a long German word falls apart into six ... How text becomes numbers a model can read. Study guide for this lesson (PDF): ... Table of Contents: 00:33 - Specifying Syntax 01:10 - You use ChatGPT, Claude, or another LLM every day. But do you know what a