Liigu peamise sisu juurde

Üks postitus sildistatud "artificial intelligence"

Vaata Kõiki Silte

What is a Token in an LLM?

· 3 min lugemine

Tokens are fundamental elements to understand how large language models (LLMs) work. If you have ever used a tool based on an LLM, such as a chatbot or a voice assistant, it is likely that these tools process your requests by breaking them down into "tokens." But what exactly is a token, and why is it essential?