Segmentation
- tokenization
- lemma(tization)
- stem(ming)
- sentence segmentation
- word type
- word token
Regular Expressions
- range
- Kleene *
- Kleene +
- anchor
- disjunction
- (non)-greedy
- (non-)capturing group
Language Models
- unknown word
- n-gram
- Markov assumption
- maximum likelihood estimate
- normalizing (for counts)
- relative frequency
- log probability
- perplexity
- zero counts
- smoothing
- discounting
- backoff
- interpolation
- Laplace smoothing
Encodings
Evaluation
- corpus
- false positives
- false negatives
- extrinsic evaluation
- intrinsic evaluation
- training set
- development set
- test set
- cross-validation
- precision
- recall
- f-measure
Edit Distance
- minimum (weighted) edit distance
- alignment
- backtrace
Vector Semantics
- embedding
- term-document matrix
- vector space model
- term-term matrix / word-word matrix / term-context matrix
- cosine similarity
- tf-idf
Lexical Semantics
- unsupervised learning
- supervised learning
- log odds ratio