Adding part-of-speech information to the SUBTLEX-US word frequencies

Marc Brysbaert*, Boris New, Emmanuel Keuleers

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

Abstract

The SUBTLEX-US corpus has been parsed with the CLAWS tagger, so that researchers have information about the possible word classes (parts-of-speech, or PoSs) of the entries. Five new columns have been added to the SUBTLEX-US word frequency list: the dominant (most frequent) PoS for the entry, the frequency of the dominant PoS, the frequency of the dominant PoS relative to the entry's total frequency, all PoSs observed for the entry, and the respective frequencies of these PoSs. Because the current definition of lemma frequency does not seem to provide word recognition researchers with useful information (as illustrated by a comparison of the lemma frequencies and the word form frequencies from the Corpus of Contemporary American English), we have not provided a column with this variable. Instead, we hope that the full list of PoS frequencies will help researchers to collectively determine which combination of frequencies is the most informative.

Original languageEnglish
Pages (from-to)991-997
Number of pages7
JournalBehavior Research Methods
Volume44
Issue number4
DOIs
Publication statusPublished - Dec 2012
Externally publishedYes

Keywords

  • SUBTLEX
  • Word frequency
  • Part-of-speech information
  • Subtitles
  • Lexical decision
  • FILM SUBTITLES
  • LEXICON PROJECT
  • ENGLISH
  • NOUNS

Cite this