Majid Al-RaimiPhD notes / KFUPM

ICS 582/Lecture 03N-gram language models

Overview
Full guide
Glossary
Reference
Practice quiz

Parts10

Why language models predict words5 concepts, slides 1-9
N-grams, the chain rule and the Markov assumption6 concepts, slides 10-16
Estimating n-gram probabilities with maximum likelihood5 concepts, slides 17-28
Evaluating language models with perplexity5 concepts, slides 29-41
Sampling sentences from a language model5 concepts, slides 42-53
Generalization, overfitting and add-one smoothing6 concepts, slides 54-67
Interpolation, backoff and absolute discounting6 concepts, slides 68-80
Kneser-Ney smoothing for bigrams6 concepts, slides 81-94
Recursive and modified Kneser-Ney6 concepts, slides 95-101
Entropy, cross-entropy and chapter summary4 concepts, slides 102-105

Majid Al-RaimiPractice quiz

ICS 582Lecture 03Practice quiz

Practice quiz

There are no practice questions for this lecture yet.