JOURNAL ARTICLE

Assessing word commonness: Adding dispersion to frequency.

  • Published In: International Journal of Corpus Linguistics, 2023, v. 28, n. 3. P. 318 1 of 3

  • Database: Academic Search Ultimate 2 of 3

  • Authored By: Ekeland Paulsen, Mikkel 3 of 3

Abstract

The article investigates the two main corpus indicators of word commonness, frequency and dispersion, through a cross-validation analysis of frequency and four dispersion measures ('Range', 'Chi-squared', 'Deviation of Proportions' and 'Juilland's D'). The approach provides an estimation of the capacity of the named measures to predict the distribution of corpus items in an extracted language sample. Based on a dataset of 273 Norwegian compounds, the results show that especially Deviation of Proportions is a robust measure of dispersion that can be used in conjunction with frequency to substantiate assertions of word commonness based on corpus data. In addition, dispersion measures do not only reflect what sort of distribution the frequency statistic is generated from, but also how reliable the frequency estimation in the corpus sample is in terms of giving an accurate representation of frequency in the language variety that the corpus is sampled from. [ABSTRACT FROM AUTHOR]

Additional Information

  • Source:International Journal of Corpus Linguistics. 2023/07, Vol. 28, Issue 3, p318
  • Document Type:Article
  • Subject Area:Science
  • Publication Date:2023
  • ISSN:1384-6655
  • DOI:10.1075/ijcl.21037.eke
  • Accession Number:165044591
  • Copyright Statement:Copyright of International Journal of Corpus Linguistics is the property of John Benjamins Publishing Co. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Looking to go deeper into this topic? Look for more articles on EBSCOhost.