Skip to main content

Topic Modeling Tool

 

The next tool I moved to on my corpus analysis journey was the topic modelling tool.

 

The Topic Modeling Tool is an interesting innovation because it utilizes MALLET (Machine Learning for Language Toolkit) to perform LDA (Latent Dirichlet Allocation) topic modeling but also incorporates a user friendly interface allowing individuals like myself who can learn basic coding but just don’t understand how to troubleshoot when things go wrong.

 

The tool was created by David Newman, part of the Research Faculty of Computer Science at the University of California Irvine, and Arun Balagopalan and further developed by Jonathan Scott Enderle, a Digital Humanities Specialist at the Penn Library at the University of Pennsylvania.[1] Unfortunately Enderle has since passed and therefore development of the tool has stalled until someone else decides to take up cause.

 

Regardless the tool was still incredibly useful for my purposes.

 

It allows users to upload a stopwords list to exclude them from the analysis. The interface also allows users to select how many topics it would like to tool to run, how many topic words to print, as well as whether or not the analysis should dissect the corpus into n -word chunks. 

 


 

 

For my analysis I ran analyses with both N-word and without n-word chunks ranging from 4-12 topics in increases of 2.

 

And there were some interesting results in the data… which I will be writing about in my thesis.

 

If you would like to download the topic modeling tool and try it out you can find it here

 

https://github.com/senderle/topic-modeling-tool

 

Also, I realize that I never really explained how I chose my corpus… or what my corpus is so… next time!


[1]Jonathan Scott Enderle. “GitHub - Senderle/Topic-Modeling-Tool: A Point-And-Click Tool for

Creating and Analyzing Topic Models Produced by MALLET.” GitHub, 10 Apr. 2017,

github.com/senderle/topic-modeling-tool. Accessed 6 Feb. 2025 ; “Department of English.”

Upenn.edu, 2021, www.english.upenn.edu/people/jonathan-scott-enderle. Accessed 6 Feb.

2025.; “David Newman.” Google.com, 2020, scholar.google.com/citations?user=3z

mSpYAAAAJ&hl=en. Accessed 6 Feb. 2025.

 

Comments

Post a Comment

Popular posts from this blog

DATA DATA DATA!

I have finally published the data sets from the corpus on Zenodo. The following citations contain the links to the data.  Have at it!  Amato, Natalie. “Corpus”. Zenodo , March 27, 2025. https://doi.org/10.5281/zenodo.15098565 . Amato, Natalie. “Voyant Files”. Zenodo, March 27, 2025. https://doi.org/10.5281/zenodo.14871765.  Amato, Natalie. “Voyant Files”. Zenodo, March 27, 2025. https://doi.org/10.5281/zenodo.14871765 . Amato, Natalie. “Stopwords”. Zenodo , March 28, 2025. https://doi.org/10.5281/zenodo.15103566 . Amato, Natalie. “Nvivo Files”. Zenodo , March 28, 2025. https://doi.org/10.5281/zenodo.15103555 . Amato, Natalie. “Antconc Collocate Files”. Zenodo, March 28, 2025. https://doi.org/10.5281/zenodo.15103493 .   Amato, Natalie. “Antconc Cluster Files”. Zenodo , March 28, 2025. https://doi.org/10.5281/zenodo.15103462 .   Amato, Natalie. “Antconc KWIC Files”. Zenodo, March 27, 2025. https://doi.org/10.5281/zenodo.15098553 .    Amato, Nata...
Post a Comment
Read more

Why are Two Columns such a Burden?? WHY?

          I apologize for the extended delay in posting. After my last post I attempted to create a work-around to convert my two column text files into one column. This proved insanely difficult. My thought process was that if I could create OCRed readable pdf files (which I thought I had done) with Foxit then I could export them to editable word documents and then convert them from two column to one column files and then export them to txt files. Did it feel like there must be an easier way to do this? Yes. But I could not find it, at least not without hitting a pay wall. Therefore, I surmised that I would have to one-by-one open files in Foxit PDF Editor, go to the “Convert” tab and then select “To MS Office” in the menu and select “To Word”. This would bring up a new “save” window where I would need to select “settings” beside the file format. Then that would bring up another window and here is where I run into another roadblock. In t...
Post a Comment
Read more