Graph-Directed Topic Models of Text Documents
摘要
The analysis of large corpus of text documents requires automated tools to structure the database. In its many forms, topic modeling is a well-studied concept to automatically find a sparse set of topics that can summarize the entire corpus. Topic modeling assumes that the documents are a simple linear combination of certain topics and that no other information is present. In this work, we assume that information in the form of an undirected graph is available and regularize a statistical topic model with this information. We derive a Gibbs sampling technique that employs a Hamiltonian Monte Carlo computational strategy and demonstrate that the graphical structure can qualitatively improve the topic models derived from the Enron email data set.