Machine Learning: the fundamentals
Text· 11 minMembers-only lesson
Tokens, n-grams and context
A language model does not read text letter by letter, nor necessarily word by word: it splits it into tokens, units that can be a whole word, a fragment of a word, or even a single character. This splitting is…
access denied :: authentication required
The rest is for members
Create an account to open the full course, save your progress and take the graded quizzes.
The first 2 lessons of this course are open to everyone.