Skip to content

ilopezluna/blog

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

2 Commits
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿง  Large Language Model Process

Visual schemas showing how LLMs are trained and how they work


๐ŸŽ“ Training Process

๐Ÿ“Š Data Collection โ†’ ๐Ÿ”ค Tokenization โ†’ ๐Ÿ”ข Embeddings โ†’ ๐Ÿ“š Pretraining โ†’ ๐ŸŽฏ Fine-tuning โ†’ ๐Ÿง  Reinforcement Learning โ†’ ๐Ÿš€ Trained Model


๐Ÿ”ฎ Inference Process

๐Ÿ“ User Input โ†’ ๐Ÿ”ค Tokenization โ†’ ๐Ÿ”ข Embeddings โ†’ ๐ŸŽฏ Attention โ†’ ๐Ÿงฎ Feed Forward โ†’ ๐Ÿ”„ Layer Processing โ†’ ๐Ÿ“Š Output Probabilities โ†’ ๐ŸŽฒ Token Selection โ†’ ๐Ÿ”ค Detokenization โ†’ ๐Ÿ’ฌ Response


๐Ÿ‘จโ€๐Ÿ’ป Author

Ignacio Lรณpez Luna

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published