Assesses the vocabulary of our beloved, greatest president.

Théophile Bastian 4c9540afc5 Detail a bit methodology 5 months ago
trump_tweet_data_archive @ 4398599156 7e0f0271d5 Initial commit 5 months ago
.gitignore 7e0f0271d5 Initial commit 5 months ago
.gitmodules 7e0f0271d5 Initial commit 5 months ago
LICENSE 9efd01daf2 Initial commit 5 months ago
README.md 4c9540afc5 Detail a bit methodology 5 months ago
__init__.py 7e0f0271d5 Initial commit 5 months ago
bootstrap.py 7e0f0271d5 Initial commit 5 months ago
count_words.py 7e0f0271d5 Initial commit 5 months ago
generate_list.py 7e0f0271d5 Initial commit 5 months ago

README.md

Trump vocabulary

NOTE: this was written in a few minutes without bothering with clean and robust code.

This code goes through the tweets of Donald Trump and produces a ranked list of words used.

The result (not much updated, though) can be found here.

Methodology

A word is considered to be a contiguous sequence of letters and quotes (') only. Words that have less than four occurrences are removed (considered irrelevant — probably some random name).

Install

Clone this reopsitory with submodules: git clone --recurse-submodules

Alternatively, if you already cloned the repo, you can run

git submodule update --init --depth 1

Get a shell

You can explore the data in a shell by using count_words.py as an init script for your favorite shell, eg.

ipython -i count_words.py

The following will be available to you as variables:

  • tweets: the list of all tweets ever,
  • occur: python dictionary of occurrences of words in Trump's tweets
  • ranked: ranked list of occurrences of words in Trump's tweets

Generating the list

Simply run

python ./generate_list.py [OUTPUT_FILE]

If you omit OUTPUT_FILE, the list will be generated to trumprank.txt.