Workshop#3: Part-of-Speech Tagging Using Natural Language Toolkit (Hour 5–6)
摘要
In Chap. 3 , we covered the basic concepts and theories related to Part-of-Speech (POS) tagging and the various techniques used for POS tagging. This workshop builds on that foundation by exploring how to implement POS tagging using NLTK. The workshop begins with a brief recap of tokenization techniques, followed by two fundamental processes in word-level text processing: stemming and stop-word removal. We will introduce two types of stemming techniques—Porter Stemmer and Snowball Stemmer—and demonstrate how these can be integrated with WordCloud for data visualization. The main focus of this workshop is on the PENN Treebank Tagset, and by the end, you will have the skills to create your own custom POS tagger.