Data sets are now cached to minimize loading times (#2, @richfitz)
Data files are always read in UTF-8 Encoding now (#3, #5, @isteves)
New data sets:
animals/cats
, animals/donkeys
, animals/horses
, animals/ponies
List of cat, donkey, horse, and pony breeds sourced from wikipedia.
animals/collateral_adjectives
list of animals plus collateral
adjectives.
animals/dog_names
list of dog names.
colors/dulux
Dulux colors.
colors/google_material_colors
Material Design Style Color Palette.
colors/palettes
The top 200 most popular palettes on colourlovers.com.
colors/xkcd
The 954 most common RGB monitor colors, as defined by
several hundred thousand participants in the xkcd color name survey.
divination/zodiac
Zodiac signs and associated information, both Western
and Eastern.
film-tv/game-of-thrones-houses
Game of Thrones Houses.
film-tv/iab_categories
Categories from Interactive Advertising Bureau.
film-tv/netflix-categories
Netflix Movie Categories.
film-tv/popular-movies
A bunch of movies, mostly Best Picture winners
or nominees, scraped from the web.
foods/bad_beers
Beers with the 100 lowest scores on BeerAdvocate,
adapted from https://www.beeradvocate.com/lists/bottom/
foods/iba_cocktails
Cocktails recognized by the International
Bartenders Association for use in the World Cocktail Competition.
foods/sausages
A list of sausages.
foods/scotch_whiskey
A list of scotch whiskies.
games/zelda
List of Zelda characters by game.
geography/canadian_municipalities
Top 100 Canadian municipalities by
2011 population.
geography/countries_with_capitals
A list of countries and its
respective capitals.
geography/japanese_prefectures
Japanese regions and prefectures.
geography/nationalities
A list of nationalities.
geography/norwegian_cities
Top Norwegian Cities by 2017 population.
geography/nyc_neighborhood_zips
Neighborhoods of New York City and
their corresponding ZIP codes.
geography/sf_neighborhoods
San Francisco neighborhoods and their
locations.
geography/us_airport_codes
IATA and ICAO airport codes for the primary
commercial airports in each state.
geography/us_counties
U.S. Counties by State.
geography/us_metropolitan_areas
U.S. Metropolitan, Micropolitan and
Combined Statistical Areas with 2016 population estimates.
geography/us_state_capitals
U.S. State Capitals.
geography/winds
A list of regional and local winds and weather
phenomena.
governments/mass-surveillance-project-names
This is a list of
government surveillance projects and related databases throughout the
world.
humans/2016_us_presidential_candidates
All individuals who filed a
Statement of Candidacy with the FEC to register as a presidential
candidate in the 2016 United States election.
humans/atus_activities
Activity category codes used by the US Bureau of
Labor Statistics in its American Time Use Survey.
humans/celebrities
Celebrities.
humans/descriptions
A list of adjectives for describing people, taken
from www.enchantedlearning.com/wordlist/adjectivesforpeople.shtml.
humans/norwayFirstNamesBoys
First names of boys, pulled from Statistics
Norway 2015.
humans/norwayFirstNamesGirls
First names of girls, pulled from
Statistics Norway 2015.
humans/norwayLastNames
Last names of people, pulled from Statistics
Norway 2015.
humans/thirdPersonPronouns
Third person personal pronouns with case.
humans/tolkienCharacterNames
Character names from Tolkien's Middle
Earth, from https://en.wikipedia.org/wiki/List_of_Middle-earth_characters
mathematics/primes_binary
The first 1000 prime numbers in binary.
medicine/hospitals
A partial list of the hospitals in the United States.
music/a_list_of_guitar_manufacturers
A list of guitar manufacturers.
music/female_classical_guitarists
A list of women classical guitarists.
music/hamilton_musical_obcrecording_actors_characters
Actors and the
named characters played by them in the Original Broadway Cast recording
of Hamilton: An American Musical.
music/instruments
Musical Instruments.
music/xxl_freshman
Every rapper that's ever made the XXL Annual
Freshman Cover.
mythology/greek_myths_master
Greek Myths Actors.
objects/clothing
List of clothing types.
objects/corpora_winners
Winners in the Corpora Brackets.
science/weather_conditions
A list of phrases describing weather
conditions.
plants/plants
List of plants by common name.
sports/football/epl_teams
Current (as of November 2016) teams in the
EPL (English Premier League) and where they play.
sports/football/laliga_teams
Teams in the Spanish Primera División, La
Liga(2017-18) with their details.
sports/football/serieA
Teams in the Italian First División, Serie
A(2017-18) with their details.
sports/mlb_teams
Current (as of 2016) Major League Baseball teams and
where they play.
sports/nba_mvps
NBA MVP award winners 1956-2017.
sports/nba_teams
Current (as of 2016) teams in the NBA and where they
play.
sports/nhl_teams
Current (as of 2016) teams in the NHL and where they
play.
sports/olympics
Olympic Games summary data.
transportation/commercial-aircraft
List of aircraft manufacturers and
some of their aircraft types currently in use.
travel/lcc
A list of low cost air carriers.
words/compounds
A partial list of English compound words.
words/emoji/emoji
All the Unicode emoji.
words/ergative_verbs
'Ergative' verbs in English can be used both
transitively and intransitively.
words/expletives
Common expletives and spelling variants used in
internet comments.
words/harvard_sentences
The Harvard sentences are a collection of
sample phrases that are used for standardized testing of Voice over IP,
cellular, and other telephone systems.
words/infinitive_verbs
Infinitive verbs.
words/literature/infinitejest
List of names from the novel Infinite
Jest by David Foster Wallace.
words/literature/lovecraft_words
H.P Lovecraft favorite words.
words/literature/technology_quotes
Edited passages from public domain
works. These quotes are intended as standard propaganda in
science-fiction stories.
words/personal_pronouns
Personal pronouns.
words/possessive_pronouns
Possessive pronouns.
words/prepositions
A list of English prepositions.
words/state_verbs
State verbs.
words/strange_words
Some strange sounding words.
words/units_of_time
A list of units of time ordered by magnitude.
words/verbs_with_conjugations
Verbs with conjugations.
Updated data sets:
animals/birds_north_america
Birds of North America,
Update per ABA Checklist Version 7.9.0 – July 2016.
Updates: animals/dogs
, divination/tarot_interpretations
,
film-tv/tv_shows
, foods/fruits
, foods/sandwiches
, foods/tea
,
foods/vegetables
, geography/countries
, geography/us_cities
,
geography/venues
, humans/occupations
, humans/prefixes
,
mathematics/primes
, music/genres
, mythology/lovecraft
,
objects/objects
, religion/christian_saints
, science/elements
,
sports/nfl_teams
, technology/computer_sciences
,
technology/new_technologies
, technology/programming_languages
,
words/adjs
, words/stopwords/bg
.
Deleted data sets:
animals/birds_uk
Birds of the United Kingdom, source (RSPB) copyright
notice does not clearly allow for file's inclusion in corpora project.
words/emoji/positive_emoji
and words/emoji/sea_emoji
, see
words/emoji/emoji
instead.
categories()
lists subcategories as wellNew data sets:
animals/birds_north_america
Birds of North America, grouped by
family. Source: http://listing.aba.org/aba-checklist/
architecture/passages
Ways to enter or exit a place.
corporations/industries
A list of all industries on LinkedIn, as
of May 21, 2013 Source: http://robertwdempsey.com/liindustries
divination/tarot_interpretations
Tarot card interpretations, from
Mark McElroy's A Guide to Tarot Meanings
(http://www.madebymark.com/a-guide-to-tarot-card-meanings/)
film-tv/tv_shows
1000 entries from the list of TV shows at
http://en.wikipedia.org/wiki/List_of_television_programs_by_name
foods/apple_cultivars
The 1000 most popular apple cultivars in
the USDA's Pomological Watercolor collection.
foods/combine
A list of recipe instructions.
foods/tea
Types of tea.
foods/vegetable_cooking_times
Approximate cooking times for
various vegetables Source:
http://recipes.howstuffworks.com/tools-and-techniques/how-to-cook-vegetables24.htm
foods/wine_descriptions
A list of words commonly used to describe
wine.
games/bannedGames/argentina/bannedList
A list of video games
banned in Argentina.
games/bannedGames/brazil/bannedList
A list of video games
banned in Brazil.
games/bannedGames/china/bannedList
A list of video games
banned in China.
games/bannedGames/denmark/bannedList
A list of video games
banned in Denmark.
games/dark_souls_iii_messages
Organized components from the Dark
Souls III message system.
games/wrestling_moves
A list of professional wrestling moves.
humans/englishHonorifics
English honorifics.
humans/famousDuos
Famous duos.
humans/lastNames
Last names of people, pulled from the US Census
for the 2000s.
materials/gemstones
A list of the names of materials commonly
used as gemstones Source:
https://en.wikipedia.org/wiki/List_of_gemstone_species
mathematics/fibonnaciSequence
The first 1000 numbers in the
Fibonnaci Sequence.
mathematics/primes
The first 1000 prime numbers.
mathematics/trigonometry
A list of trigonometric functions,
formulas, equations, etc..
medicine/diagnoses
International Statistical Classification of
Diseases and Related Health Problems, 10th revision Source:
http://www.cdc.gov/nchs/icd/icd10cm.htm
medicine/drugNameStems
A list of generic pharmaceutical drug name
stems. Hypens indicate whether a stem appears at the
beginning, middle, or end of the name. Source:
http://druginfo.nlm.nih.gov/drugportal/jsp/drugportal/DrugNameGenericStems.jsp
medicine/drugs
A list of pharmaceutical drug names Source: The
United States National Library of Medicine,
http://druginfo.nlm.nih.gov/drugportal/
music/bands_that_have_opened_for_tool
Bands that have opened for
Tool. You must be really dedicated to your music if you are
willing to play before Tool fans.
music/rock_hall_of_fame
Artists who have been added to the Rock
N' Roll Hall of Fame along with their year of induction
Source:
https://en.wikipedia.org/wiki/List_of_Rock_and_Roll_Hall_of_Fame_inductees
mythology/greek_gods
Gods and goddesses from Greek myth.
mythology/greek_monsters
Monsters from Greek myth.
mythology/greek_titans
Titans from Greek myth.
mythology/hebrew_god
Hebrew names of God used in the Old
Testament Bible.
mythology/monsters
A list of monsters and other mythic creatures.
mythology/norse_gods
Gods and goddesses of norse and germanic myth.
plants/cannabis
420 popular strains of cannabis.
religion/christian_saints
religion/fictional_religions
religion/parody_religions
religion/religions
science/minor_planets
List of names of the first 1000 numbered
minor planets.
societies_and_groups/animal_welfare
societies_and_groups/designated_terrorist_groups/australia
societies_and_groups/designated_terrorist_groups/canada
societies_and_groups/designated_terrorist_groups/china
societies_and_groups/designated_terrorist_groups/egypt
societies_and_groups/designated_terrorist_groups/european_union
societies_and_groups/designated_terrorist_groups/india
societies_and_groups/designated_terrorist_groups/iran
societies_and_groups/designated_terrorist_groups/israel
societies_and_groups/designated_terrorist_groups/kazakhstan
societies_and_groups/designated_terrorist_groups/russia
societies_and_groups/designated_terrorist_groups/saudi_arabia
societies_and_groups/designated_terrorist_groups/tunisia
societies_and_groups/designated_terrorist_groups/turkey
societies_and_groups/designated_terrorist_groups/ukraine
societies_and_groups/designated_terrorist_groups/uae
societies_and_groups/designated_terrorist_groups/united_kingdom
societies_and_groups/designated_terrorist_groups/united_nations
societies_and_groups/designated_terrorist_groups/united_states
societies_and_groups/fraternities/coeducational_fraternities
societies_and_groups/fraternities/defunct
societies_and_groups/fraternities/fraternities
societies_and_groups/fraternities/professional
societies_and_groups/fraternities/service
societies_and_groups/fraternities/sororities
societies_and_groups/semi_secret
sports/nfl_teams
Current (as of 2015) teams in the NFL and where
they play.
technology/lisp
A list of LISP dialects.
technology/new_technologies
New or emerging technologies.
technology/photo_sharing_websites
Photo sharing websites.
technology/programming_languages
technology/social_networking_websites
Social networking websites.
technology/video_hosting_websites
Video hosting websites.
words/closed_pairs
Closed pairs in English i.e both words rhyme
with each other and only with each other. from
https://en.wikipedia.org/wiki/List_of_closed_pairs_of_English_rhyming_words
words/emoji/cute_kaomoji
A general corpus of cute kaomoji.
words/emoji/positive_emoji
A general corpus of positive emoji.
words/emoji/sea_emoji
A general corpus of emoji of sea/water creatures.
words/encouraging_words
A list of encouraging words to tell
someone about something they created.
words/interjections
a list of exclamatory words and expression from
http://www.enchantedlearning.com/wordlist/interjections.shtml
words/literature/mr_men_little_miss
Mr Men and Little Miss
characters Source: http://www.mrmen.com
words/literature/shakespeare_phrases
Phrasess coined by
Shakespeare, from http://www.pathguy.com/shakeswo.htm
words/literature/shakespeare_sonnets
Shakespeare's sonnets.
words/literature/shakespeare_words
Words coined by Shakespeare,
from http://www.pathguy.com/shakeswo.htm
words/personal_nouns
List of personal nouns in the 1890 Webster's
Unabridged Dictionary. Assembled by Cory Taylor from Project
Gutenberg's HTML edition of the dictionary:
http://www.gutenberg.org/ebooks/673 Source:
https://github.com/coryandrewtaylor/Personal-Nouns
words/resume_action_words
Resume action words. Source:
http://careercenter.umich.edu/article/resume-action-words
words/rhymeless_words
English words for which there is no perfect
rhyme, taken from
https://en.wikipedia.org/wiki/List_of_English_words_without_rhymes
words/spells
A list of Harry Potter spells and descriptions.
words/stopwords/ar
Arabic stop words.
words/stopwords/bg
Bulgarian stop words.
words/stopwords/cs
Chech stop words.
words/stopwords/da
Danish stop words.
words/stopwords/de
German stop words.
words/stopwords/en
English stop words.
words/stopwords/es
Spanish stop words.
words/stopwords/fi
Finnish stop words.
words/stopwords/fr
French stop words.
words/stopwords/gr
Greek stop words.
words/stopwords/it
Italian stop words.
words/stopwords/jp
Japanese stop words.
words/stopwords/lv
Latvian stop words.
words/stopwords/nl
Dutch stop words.
words/stopwords/no
Norwegian stop words.
words/stopwords/pl
Polish stop words.
words/stopwords/pt
Portugese stop words.
words/stopwords/ru
Russian stop words.
words/stopwords/sk
Slovakian stop words.
words/stopwords/sv
Swedish stop words.
words/stopwords/tr
Turkish stop words.
R CMD check
notes.New data sets:
architecture/rooms
Different kinds of rooms.
art/isms
A list of modernist art isms.
corporations/fortune500
The 2014 Fortune 500 list.
foods/breads_and_pastries
A list of classic breads and sweet pastries.
foods/condiments
A list of condiments.
foods/curds
A list of curds, cheeses, and other fermented dairy
products.
games/street_fighter_ii
Street Fighter II fighting moves.
governments/uk_political_parties
A list of uk political parties.
Source: http://www.electoralcommission.org.uk/ export on 8th
May 2015.
humans/moods
A list of words that naturally complete the phrase
'They were feeling...'.
materials/abridged-body-fluids
Abridged body fluids.
materials/building-materials
Building materials.
materials/carbon-allotropes
Carbon allotropes.
materials/decorative-stones
Decorative stones.
materials/fabrics
Fabrics.
materials/fibers
Fibers.
materials/layperson-metals
Layperson metals.
materials/natural-materials
Natural materials.
materials/packaging
Packaging.
materials/plastic-brands
Plastic brands.
materials/sculpture-materials
Sculpture materials.
materials/technical-fabrics
Technical fabrics.
music/genres
A list of musical genres taken from wikipedia
article titles.
music/mtv_day_one
Music videos broadcast on MTV's first day
Source: https://en.wikipedia.org/wiki/First_music_videos_aired_on_MTV
mythology/lovecraft
Deities and supernatural creatures from the
works of Lovecraft and the Cthulhu mythos.
technology/appliances
A list of home appliances.
First release.