Understanding how LLMs work – A 101 guide

How much have language models improved over the last few years? Here is an analogy

“If air travel had improved at the same rate as LLMs, average flight speed would have improved from 600mph in 2018 to 900,000mph in 2020—a 1,500x increase in two years.

Instead of taking eight hours to travel from London to New York, it would take just 19 seconds (!).”

Explaining how LLMs work is hard.

Including transformers and why the seminal paper around Attention made a huge difference

Here is a good simple to understand 101 guide

Worth the time you invest in it

https://arstechnica.com/science/2023/07/a-jargon-free-explanation-of-how-ai-large-language-models-work/?

****************************

Ranjani Mani

#reviewswithranjani #GenerativeAIandI

#Technology | #Books | #BeingBetter

Leave a Comment

Your email address will not be published. Required fields are marked *