Fitting Ranked Linguistic Data with Two-Parameter Functions
AbstractIt is well known that many ranked linguistic data can fit well with one-parameter models such as Zipf’s law for ranked word frequencies. However, in cases where discrepancies from the one-parameter model occur (these will come at the two extremes of the rank), it is natural to use one more parameter in the fitting model. In this paper, we compare several two-parameter models, including Beta function, Yule function, Weibull function—all can be framed as a multiple regression in the logarithmic scale—in their fitting performance of several ranked linguistic data, such as letter frequencies, word-spacings, and word frequencies. We observed that Beta function fits the ranked letter frequency the best, Yule function fits the ranked word-spacing distribution the best, and Altmann, Beta, Yule functions all slightly outperform the Zipf’s power-law function in word ranked- frequency distribution.
Scifeed alert for new publicationsNever miss any articles matching your research from any publisher
- Get alerts for new papers matching your research
- Find out the new papers from selected authors
- Updated daily for 49'000+ journals and 6000+ publishers
- Define your Scifeed now
Li, W.; Miramontes, P.; Cocho, G. Fitting Ranked Linguistic Data with Two-Parameter Functions. Entropy 2010, 12, 1743-1764.
Li W, Miramontes P, Cocho G. Fitting Ranked Linguistic Data with Two-Parameter Functions. Entropy. 2010; 12(7):1743-1764.Chicago/Turabian Style
Li, Wentian; Miramontes, Pedro; Cocho, Germinal. 2010. "Fitting Ranked Linguistic Data with Two-Parameter Functions." Entropy 12, no. 7: 1743-1764.