Chapter 2: Text properties, operations and preprocessing — Information Retrieval (CSC423) Notes

Tokenization, Text Normalization, Stop-word removal, Morphological Analysis, Word Stemming (Porter Algorithm), Case folding, Lemmatization, Word statistics (Zipf's law, Heaps' Law).

Elective Course
Ch. 2: Text properties, operations and preprocessing

Notes Arriving Soon

Handwritten chapter notes for this subject are currently being digitized. Help your fellow students by contributing your notes!

Topics & Key Objectives in Chapter 2

TokenizationText NormalizationStop-word removalMorphological AnalysisWord Stemming (Porter Algorithm)Case foldingLemmatizationWord statistics (Zipf's lawHeaps' Law).