Chapter 2: Text properties, operations and preprocessing — Information Retrieval (CSC423) Notes
Tokenization, Text Normalization, Stop-word removal, Morphological Analysis, Word Stemming (Porter Algorithm), Case folding, Lemmatization, Word statistics (Zipf's law, Heaps' Law).
Notes Arriving Soon
Handwritten chapter notes for this subject are currently being digitized. Help your fellow students by contributing your notes!
Topics & Key Objectives in Chapter 2
TokenizationText NormalizationStop-word removalMorphological AnalysisWord Stemming (Porter Algorithm)Case foldingLemmatizationWord statistics (Zipf's lawHeaps' Law).