HarshShah.CodesBlogAboutSaturday Byte Archive
Github
Twitter

transformers


  • How LLMs Actually Generate Text: From Tokens to the Next Word

    LLM Transformers Tokenization Machine Learning Deep Learning AI
    LLMs don't think in words. I break down what happens between your prompt and the next token: tokenization, embeddings, attention, logits, and sampling. With the math, tables, and interactive demos, no math degree required.
    Published On
    September 25, 2026
    Estimated Reading Time
    A minutes read
    Read More

Tags

react (7)Machine Learning (4)React (3)Javascript (3)Hackathon (2)System Design (2)CSS (2)Python (2)React Hooks (2)Graph databases (1)FalkorDB (1)Cypher (1)AI agents (1)LangGraph (1)Gemma (1)LangChain (1)FastAPI (1)Multimodal AI (1)small language models (1)AI models (1)on-device AI (1)LLM inference (1)LLM (1)Transformers (1)Tokenization (1)Deep Learning (1)AI (1)MCP (1)Tutorial (1)Model Context Protocol (1)Node.js (1)JSON-RPC (1)Claude Desktop (1)Cursor (1)AI Integration (1)MLOps (1)Real World ML (1)Cheatsheets (1)Roadmaps (1)Authentication (1)Web Security (1)Backend (1)Developer Basics (1)Applied Systems (1)Recommender Systems (1)Practical AI (1)PWA (1)Vite (1)Dark Mode (1)Web Design (1)Frontend Development (1)Web Development (1)Tailwind CSS (1)Leetcode (1)Data Structures (1)Algorithms (1)Interview Prep (1)Web Developement (1)Responsive Designs (1)Pandas (1)Data Science (1)rehype (1)prettier (1)Markdown (1)MDX (1)Github (1)
MailTwitterGithub
Harsh Shah