Next Article in Journal
Spencer-Brown vs. Probability and Statistics: Entropy’s Testimony on Subjective and Objective Randomness
Previous Article in Journal
Designing Data Protection Safeguards Ethically
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Distribution of “Characteristic” Terms in MEDLINE Literatures

1
Department of Psychiatry, MC912, University of Illinois at Chicago, 1601 W. Taylor Street, Chicago, IL 60612, USA
2
Ingenuity Systems, Inc., 1700 Seaport Blvd. Third Floor, Redwood City, CA 94063, USA
3
Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign, 501 E. Daniel St., Champaign, IL 61820, USA
*
Author to whom correspondence should be addressed.
Information 2011, 2(2), 266-276; https://doi.org/10.3390/info2020266
Submission received: 3 March 2011 / Accepted: 28 March 2011 / Published: 30 March 2011
(This article belongs to the Section Information Applications)

Abstract

: Given the occurrence frequency of any term within any set of articles within MEDLINE, we define “characteristic” terms as words and phrases that occur in that literature more frequently than expected by chance (at p < 0.001 or better). In this report, we studied how the cut-off criterion varied as a function of literature size and term frequency in MEDLINE as a whole, and have compared the distribution of characteristic terms within a number of journal-defined, affiliation-defined and random literatures. We also investigated how the characteristic terms were distributed among MEDLINE titles, abstracts, and last sentence of abstracts, including “regularized” terms that appear both in the title and abstract of the same paper for at least one paper in the literature. For a set of 10 disciplinary journals, the characteristic terms comprised 18% of the total terms on average. Characteristic terms are utilized in several of our web-based services (Anne O'Tate and Arrowsmith), and should be useful for a variety of other information-processing tasks designed to improve text mining in MEDLINE.

1. Introduction

Terms occurring in a given set of articles (i.e., a literature) more than expected by chance form a literature-specific vocabulary that is similar to the concept of a domain “sublanguage” [1-3]. They differ from the keywords extracted from a particular literature [4,5], insofar as keywords occur frequently relative to other terms in that literature, whereas a literature-specific term may occur only a few times (as long as it is more frequent in that literature than in MEDLINE as a whole).

In the present paper, we have computed empirical occurrence frequencies of terms within a number of journal-defined, affiliation-defined and random literatures. We derived statistical criteria for asserting that a single term occurs more often within any given literature than expected by chance, and denote the set of terms that occur more than expected by chance (at p < 0.001) as the “characteristic” terms for that literature. Finally, we have studied their distribution across MEDLINE titles, abstracts, and last sentences of abstracts, including “regularized” characteristic terms that appear both in the title and abstract of the same paper for at least one paper in the literature. These studies set the stage for utilizing characteristic terms as features in text mining models, and in creating thumbnail annotations of the literatures.

2. Results

2.1. Delineating Characteristic Terms

We examined 10 different disciplinary journals published in English, containing abstracts, which comprised 2,000-10,000 papers each (average 5,132 papers), and characterized the distribution of term frequencies within the journal set vs. within MEDLINE as a whole. This distribution was compared with the distribution of terms in an affiliation-defined literature consisting of all articles published in 2000 having the word “California” in the affiliation field, and with a set of 5,000 articles chosen at random within MEDLINE. In each case, the Poisson approximation was used to define the distribution of term occurrence that would be expected by chance.

Figure 1 shows the raw distribution of term occurrence frequencies in the text fields (i.e., title or abstract) for Journal of Biomedical Materials Research compared to a random literature of similar size. Term occurrence frequency was almost exactly linear for the journal when plotted on a log-log scale, indicating that frequencies followed a regular Zipf distribution. The frequencies for the random set followed a parallel curve and were significantly different from that of the journal.

To identify individual terms that were significantly more frequent than expected by chance, we computed p-value scores for each term across 10 disciplinary journals and plotted the average p-value scores in comparison to the California set and to a random set of 5,000 articles (Figure 2). Although terms associated with p-values < 0.05 are nominally significant, that does not take into account the fact that multiple tests are carried out. Figure 2 emphasizes that the difference between journal-defined sets and random sets is most striking at p-values below 0.001. Thus, we have chosen p < 0.001 as our preferred cut-off value, and the set of terms in a literature with p-values below 0.001 will be called the characteristic terms of that literature.

For the set of 10 disciplinary journals, the set of characteristic terms comprise, on average, 18% of the total terms in that literature. The cut-off criteria for deeming a term as “characteristic” vary systematically as functions both of literature size and term frequency within MEDLINE (Figure 3). Among the entire set of characteristic terms for the 10 disciplinary journals, average term occurrence is 23 times within the set of journal articles, which is 88 times more frequent in that literature than in MEDLINE.

To illustrate the types of terms that are characteristic for a specific literature, we show results from International Journal of Food Microbiology. Table 1 shows the 10 characteristic terms with the lowest p-values, 10 having moderate p-values and 10 having p-values near 0.001. Clearly, the top ten terms are closely related to the journal topic (food, listeria, meat, etc.), as are the moderate set (ethanol, shigella, mold, etc.), whereas those at the margin of significance are still relevant but less specific (tbg, gene coding, fever vomiting, sandwich, etc.).

2.2. Distribution of Characteristic Terms within Individual Article Records

Several previous studies have emphasized that specific terms or MeSH concepts may be enriched in particular sections of scientific papers [6,7]. We examined how the set of characteristic terms are distributed among 8 different sections of papers encoded in MEDLINE fields for each of 10 disciplinary journals, the California literature and the random literature: text (comprising title and abstract fields); ti (title); ab (abstract); lastsen (last sentence of the abstract); ti + ab (present both in the title and in the abstract of at least one paper in the literature, though not necessarily the same paper); tiab (in the title and the abstract of the same paper, for at least one paper in the literature); ti + lastsen (in title and last sentence of the abstract, for at least one paper in the literature, though not necessarily the same paper); and tiab + lastsen (in tiab and in last sentence of the abstract for at least one paper in the literature).

One basic measure is the “density”—this is the percentage of all terms in each section that are comprised of characteristic terms. Those sections that are high in density are relatively rich in characteristic terms. Another measure is the “coverage”—defined as the number of characteristic terms found in each section, as a percentage of the total characteristic terms for that journal. Those sections that are high in coverage have the most characteristic terms overall.

The average density value varied significantly from journal to journal within our set of 10 disciplinary journals (Table 2), presumably due to different journal policies such as limits on abstract length and structured vs. unstructured abstracts. However, after normalizing the density values for each journal, one could readily observe systematic section-related differences in density and coverage that were similar across journals (Figure 4). Title and last sentence of the abstract had significantly more density than the abstract field, whereas terms that appeared in multiple sections had significantly more density than those appearing in a single section (Figure 4). Not only were these fields progressively richer in characteristic terms, but the characteristic terms that they contained had higher average frequency of occurrence than the overall set of characteristic terms, and were more specific insofar as they had lower average p-values (Figure 5). Interestingly, the set of “regularized” characteristic terms (tiab) appearing in the title and abstract of the same paper had significantly higher average frequency and lower p-values than terms which appeared in titles and abstract of different papers (ti + ab) (Figure 5) (each parameter significantly different at p < 0.00001, using paired t-test).

Regularized terms (tiab) that also appeared in the last sentence of at least one paper (tiab + lastsen) had the highest average frequency and lowest average p-value of all (Figure 5), suggesting that this subset of characteristic terms comprises, in some sense, the most important terms associated with the journal. Of the 20 characteristic terms having the lowest p-values overall in one journal, International Journal of Food Microbiology, all were found in the tiab + l astsen set as well. Thus, two independent methods—lowest p-value vs. presence in multiple sections of papers—agree in giving the most “important” characteristic terms.

We also considered whether, given two characteristic terms with equal p-values, the term appearing in the greater number of papers in the literature should be considered the more important. For the characteristic terms in International Journal of Food Microbiology, we calculated a “corrected” p-value score by dividing the raw p-value by the fraction of papers in the journal containing the term; however, this correction did not alter the top 20 characteristic terms and had only a very minor effect on their relative ranking (Table 3). Thus, at least for the task of choosing the few most important characteristic terms, it does not seem to be necessary to take this factor into account as a separate variable.

3. Experimental Methods

The universe of terms was defined in the following manner, consistent with the larger aims of the Arrowsmith Project [8]. Specifically, the titles of all papers in MEDLINE were extracted, stemmed and stoplisted using the short PubMed 364-word stoplist [9]. Words were kept only if they appeared in the abstract of at least three papers in MEDLINE, and up to three word phrases were kept only if they appeared in at least 10 abstracts. Finally, terms were mapped through the NIH MetaMap program keeping only those terms that mapped to at least one UMLS semantic category. (This removes most of the nonsensical phrases but includes many that do not correspond exactly to UMLS concepts.) After filtering, the total number of words = 52,997, two word phrases = 747,484, and three word phrases = 429,566. (Note that if a term occurred at all within an abstract, it was scored as 1 occurrence regardless of how many times the term occurred within the same abstract.) For each occurrence of a term within a MEDLINE record, we noted its location within title, abstract, or last sentence in abstract. Sentence boundaries were identified using the Sentence Splitter [10].

Modeling the expected term occurrence in a literature

Think of all the N papers in MEDLINE as a collection of N balls in an urn, where f1 black balls correspond to papers that contain a certain term, and the remaining Nf1 balls are white (do not contain the term.) In constructing a random literature of f2 papers, we randomly select f2 distinct balls from the urn. The number of black balls selected, X, is a random variable that follows a hypergeometric distribution defined by:

Pr { X = x } = ( f 1 x ) ( N f 1 f 2 x ) ( N x ) , for x = 0 , 1 , 2 , , min { f 1 , f 2 }

In other words, if a literature and a given term are independent of each other, then the number of papers within that literature that contain the term should follow the hypergeometric distribution.

The Poisson distribution is a good approximation when N is large relative to f1 and f2:

Pr { X = x } e λ λ x x ! , for x = 0 , 1 , 2 ,

Where λ = f1f2/N is the expected value of X. We have verified that the Poisson distribution is an extremely close approximation for the hypergeometric distribution in the full range of literature sizes and term frequencies considered in this paper.

4. Conclusions

In the present paper, we have calculated and empirically validated statistical criteria for saying that a term occurs in a given literature more often than by chance, and have analyzed the resulting set of “characteristic” terms (having p-values < 0.001) in some detail. Note that the characteristic terms for a literature are not necessarily the most frequent in that literature. Nor, for topically-defined literatures, do they need to have any semantic relation to the query term that generated the literature.

Characteristic terms of a literature have proven useful for different information-processing tasks. In the Anne O'Tate tool [11] that combines PubMed literature retrieval with additional post-retrieval analyses, the set of characteristic terms gives a thumbnail annotation of any retrieved literature. For example, in the case of papers describing diabetes research, the set of characteristic terms (restricted to the semantic category of gene names) gives a thumbnail annotation of the genes that have been studied in this field. In the Author-ity author name disambiguation tool [12], characteristic terms provide a thumbnail annotation of any given author's research output. Other possible uses for characteristic terms occur in post-processing of a PubMed query, to replace or supplement other language resources such as Medical Subject Headings, UMLS concepts or keyword thesauri, e.g., to expand the query automatically to include highly related papers [13,14], to cluster the retrieved papers by theme [15], or to reformulate the query in a manner that permits cross-disciplinary retrieval [16]. For example, to expand an original query automatically, one could replace the original terms used in the search with a new Boolean query made up of a small number of characteristic terms. These would not necessarily be the terms with the lowest p-values, but rather would be the set of the terms that (when combined with appropriate AND and OR operations) cover the original literature most accurately and with least redundancy.

The characteristic terms with the lowest p-values are likely to be most useful for annotation; this is similar to the log-entropy term weighting approach taken by Homayouni et al. [17]. Other annotation methods are possible—for example, Erkan and Radev [18] used a graph theoretic-approach to obtain the “most important” terms within document sets—but this is far more computationally complex than the method proposed here, and would not scale well to large literatures. The terms with lowest p-values are likely to be the most important as well, especially since these terms appeared in multiple sections of the papers.

Finally, characteristic terms have been useful for assisting in literature-based discovery. In the Arrowsmith two-node search tool [19,20], the user seeks to assess a possible relationship between literatures A and C; the computer interface presents a list of terms (the “B-list”) in common between the literatures to serve as a conceptual bridge. However, not all B-terms are likely to be of equal value in discovering significant implicit links. Characteristic terms expressed in each literature are computed as a feature in the quantitative model that allows us to rank the B-terms in order of predicted relevance to linking the two literatures in a meaningful way [19]. Moreover, B-terms that are not characteristic in either literature A or C are unlikely to indicate important concepts in either literature, whereas B-terms that are characteristic in both A and C may represent concepts that are already well known. Thus, we are currently exploring the hypothesis that the B-terms most likely to point to new discoveries in two node searches are those that are characteristic in one literature, but not both.

Figure 1. Distribution of term occurrence frequencies in text fields for a journal literature (Journal of Biomedical Materials Research, 1967–2002, 4,824 articles) vs. a randomly selected literature (5,000 articles chosen across MEDLINE). Error bars show 95% confidence intervals around the regression curves. The journal literature contains more highly frequent terms, and therefore its curve extends beyond that of the random curve.
Figure 1. Distribution of term occurrence frequencies in text fields for a journal literature (Journal of Biomedical Materials Research, 1967–2002, 4,824 articles) vs. a randomly selected literature (5,000 articles chosen across MEDLINE). Error bars show 95% confidence intervals around the regression curves. The journal literature contains more highly frequent terms, and therefore its curve extends beyond that of the random curve.
Information 02 00266f1 1024
Figure 2. Distribution of p-value scores determined using the Poisson distribution. The p-value score was computed with the formula p-value = P(Xfrq-lit), where frq-lit is the number of times a term occurs within the literature. The affiliation-defined literature was chosen as the set of articles published in 2000 having the word “California” in the affiliation field.
Figure 2. Distribution of p-value scores determined using the Poisson distribution. The p-value score was computed with the formula p-value = P(Xfrq-lit), where frq-lit is the number of times a term occurs within the literature. The affiliation-defined literature was chosen as the set of articles published in 2000 having the word “California” in the affiliation field.
Information 02 00266f2 1024
Figure 3. (a) The minimum number of occurrences of a term within a literature (for a given term frequency F within MEDLINE and a given literature size) needed to call the term “characteristic” of that literature; (b) The minimum ratio of occurrences in a literature vs. MEDLINE needed to call the term “characteristic”.
Figure 3. (a) The minimum number of occurrences of a term within a literature (for a given term frequency F within MEDLINE and a given literature size) needed to call the term “characteristic” of that literature; (b) The minimum ratio of occurrences in a literature vs. MEDLINE needed to call the term “characteristic”.
Information 02 00266f3 1024
Figure 4. Density and coverage of characteristic terms in 8 different sections of articles averaged over 10 disciplinary journals. Ellipses show one standard error around the mean values.
Figure 4. Density and coverage of characteristic terms in 8 different sections of articles averaged over 10 disciplinary journals. Ellipses show one standard error around the mean values.
Information 02 00266f4 1024
Figure 5. Average frequency and p-value for characteristic terms in 8 different sections of articles averaged over 10 disciplinary journals; (a) Average frequencies; error bars indicate 1 standard error of the mean; (b) Average p-value scores.
Figure 5. Average frequency and p-value for characteristic terms in 8 different sections of articles averaged over 10 disciplinary journals; (a) Average frequencies; error bars indicate 1 standard error of the mean; (b) Average p-value scores.
Information 02 00266f5 1024
Table 1. Characteristic terms extracted from the International Journal of Food Microbiology showing those with the 10 lowest p-value scores, 10 having moderate scores (∼8.6 × 10−5) and 10 having p-values near 0.001.
Table 1. Characteristic terms extracted from the International Journal of Food Microbiology showing those with the 10 lowest p-value scores, 10 having moderate scores (∼8.6 × 10−5) and 10 having p-values near 0.001.
Terms (lowest p-value)Terms (moderate p-value)Terms (p-value near 0.001)
1foodph ethanolstrain x
2listeriarecurrent neural networktbg
3strainshigella yersiniaor h
4listeria monocytogenedisinfection ormytilus galloprovincialis
5degree cgrowth environmentalgene coding
6meatmold growthfever vomiting
7l monocytogenestaphylococcal strain isolatedsandwich
8lactic acidyeast highgrowth effect
9lactobacilluslongitudinallydensity nm
10lactic acid bacteriapathogen humanreliable method
Table 2. Density and coverage of the characteristic terms in 8 different article fields across 10 disciplinary journals, an affiliation-defined literature and a random literature (see text). Jrn1: Acta. Physiol. Scand.; 2: Clin. Obstet Gynecol.; 3: Int. J. Dermatol.; 4: J. Biomed. Mater. Res.; 5: JPEN. J. Parenter Enteral Nutr.; 6: Am. J. Med. Genet; 7: Int. J. Food Microbiol.; 8: Cytometry; 9: J. Am. Coll. Cardiol.; 10: Int. Arch. Allergy Immunol.
Table 2. Density and coverage of the characteristic terms in 8 different article fields across 10 disciplinary journals, an affiliation-defined literature and a random literature (see text). Jrn1: Acta. Physiol. Scand.; 2: Clin. Obstet Gynecol.; 3: Int. J. Dermatol.; 4: J. Biomed. Mater. Res.; 5: JPEN. J. Parenter Enteral Nutr.; 6: Am. J. Med. Genet; 7: Int. J. Food Microbiol.; 8: Cytometry; 9: J. Am. Coll. Cardiol.; 10: Int. Arch. Allergy Immunol.
Density (%)
Jrn1Jrn2Jrn3Jrn4Jrn5Jrn6Jrn7Jrn8Jrn9Jrn10Average of 10 JrnsCalifornia literatureRandom literature
Text18.319.0111.8220.7415.5419.9424.6517.2629.2919.0118.557.390.37
Ab19.949.1412.7121.6516.4120.8225.6518.1430.6820.1919.537.870.40
Lastsen34.9218.6121.7939.6931.6838.2143.9935.2653.2737.2735.4619.710.48
Ti34.0821.523.1444.7634.1143.5251.6137.0253.8938.0238.1618.530.60
Ti + Ab48.5433.7434.7355.5745.8151.9862.3348.0163.7950.4349.4924.870.93
Ti + Lastsen57.1136.9437.5164.4953.8460.4569.0658.7672.1959.8257.0136.510.65
Tiab47.6937.0636.4154.8744.8450.0859.6443.6162.3145.5948.2125.660.42
Tiab + Lastsen57.8942.5741.9765.1155.1559.9268.8357.6272.1957.8557.9137.340.37
Coverage (%)
Jrn1Jrn2Jrn3Jrn4Jrn5Jrn6Jrn7Jrn8Jrn9Jrn10Average of 10 JrnsCalifornia literatureRandom literature
Text100100100100100100100100100100100100100
Ab95.3385.5189.8998.3798.3898.4798.8798.6398.6498.7996.0899.0193.83
Lastsen48.4641.7641.749.350.155.9949.350.1852.7547.2148.6759.9827.01
Ti66.7377.4775.7757.0153.668.3455.2952.961.7152.8362.1666.2353.55
Ti + Ab62.0762.9865.6755.3951.9966.8162.3348.0163.7950.4358.9465.2447.39
Ti + Lastsen34.633.4833.5333.3233.9342.2830.6631.5236.8929.7533.9945.5715.16
Tiab38.0427.8938.4939.0736.7944.9439.3935.0439.434.1237.3150.3816.11
Tiab + Lastsen25.5919.7724.7626.4928.0831.8425.324.6728.2122.7825.7438.147.10
Table 3. Top 20 characteristic terms extracted from the International Journal of Food Microbiology, ranked by raw p-value vs. by corrected p-value (see text for details). F is the number of times the term occurs within text fields in MEDLINE and f is the number of occurrences in the journal.
Table 3. Top 20 characteristic terms extracted from the International Journal of Food Microbiology, ranked by raw p-value vs. by corrected p-value (see text for details). F is the number of times the term occurs within text fields in MEDLINE and f is the number of occurrences in the journal.
Top 20 ranked by raw p-value scoreTop 20 ranked by corrected p-value score

TermfFraw p-value scoreTermfFcorrected p-value score
food718102,8051.04 × 10−847food718102,8053.01 × 10−847
listeria3846,8792.11 × 10−797listeria3846,8791.14 × 10−796
strain775246,9586.76 × 10−656strain775246,9581.81 × 10−655
listeria monocytogene3105,6486.90 × 10−642listeria monocytogene3105,6484.62 × 10−641
degree c625139,6943.84 × 10−621degree c625139,6941.28 × 10−620
meat30911,5821.81 × 10−543meat30911,5821.22 × 10−542
l monocytogene2312,5142.05 × 10−530l monocytogene2312,5141.84 × 10−529
lactic acid2577,0081.11 × 10−487lactic acid2577,0089.03 × 100−487
lactobacillus2385,4416.39 × 10−470lactobacillus2385,4415.57 × 10−469
lactic acid bacteria1881,3241.52 × 10−467lactic acid bacteria1881,3241.67 × 10−466
lactic27013,4901.07 × 10−441lactic27013,4908.22 × 10−441
temperature467156,2358.00 × 10−387temperature467156,2353.56 × 10−386
degree661405,9793.17 × 10−386degree661405,9799.95 × 10−386
salmonella29432,1996.87 × 10−382salmonella29432,1994.85 × 10−381
spp24515,6735.88 × 10−375growth662426,4103.91 × 10−374
growth662426,4101.25 × 10−374spp24515,6734.98 × 10−374
ph413157,6923.99 × 10−320ph413157,6922.00 × 10−319
isolate33181,1272.75 × 10−317isolate33181,1271.73 × 10−316
storage26547,3381.63 × 10−289storage26547,3381.28 × 10−288
foodborne1131,1988.98 × 10−262foodborne1131,1981.65 × 10−260

Acknowledgments

This Human Brain Project/Neuroinformatics research (LM007292 and LM08364) is funded jointly by the National Library of Medicine and the National Institute of Mental Health. The Medline database and the MMTx program (a Java implementation of the MetaMap algorithm) were graciously provided by the National Library of Medicine.

References and Notes

  1. Grishman, R.; Kittredge, R. Analyzing Language in Restricted Domains: Sublanguage Description and Processing; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 1986; pp. 19–38. [Google Scholar]
  2. Liu, Y.; Brandon, M.; Navathe, S.; Dingledine, R.; Ciliax, B.J. Text Mining Functional Keywords Associated with Genes. Medinfo 2004, 107, 292–296. [Google Scholar]
  3. Tudor, C.O.; Vijay-Shanker, K.; Schmidt, C.J. Mining the Biomedical Literature for Genic Information. Proceedings of BioNLP Workshop in Conjunction with ACL-2008, Columbus Ohio, 28-29 June 2008.
  4. Andrade, M.A.; Valencia, A. Automatic Extraction of Keywords from Scientific Text: Application to the Knowledge Domain of Protein Families. BMC Bioinform. 1998, 14, 600–607. [Google Scholar]
  5. Kostoff, R.N.; Block, J.A.; Stump, J.A.; Pfeil, K.M. Information content in Medline record fields. Int. J. Med. Inform. 2004, 73, 515–527. [Google Scholar]
  6. Schuemie, M.J.; Weeber, M.; Schijvenaars, B.J.; van Mulligen, E.M.; van der Eijk, C.C.; Jelier, R.; Mons, B.; Kors, J.A. Distribution of Information in Biomedical Abstracts and Full-text Publications. Bioinformation 2004, 20, 2597–2604. [Google Scholar]
  7. Shah, P.K.; Perez-Iratxeta, C.; Bork, P.; Andrade, M.A. Information Extraction from Full Text Scientific Articles: Where Are the Keywords? BMC Bioinform. 2003, 4, 20. [Google Scholar]
  8. Smalheiser, N.R.; Torvik, V.I.; Bischoff-Grethe, A.; Burhans, L.B.; Gabriel, M.; Homayouni, R.; Kashef, A.; Martone, M.E.; Perkins, G.A.; Price, D.L.; Talk, A.C.; West, R. Collaborative Development of the Arrowsmith Two Node Search Interface Designed For Laboratory Investigators. J. Biomed. Discov. Collab. 2006, 1, 8. [Google Scholar]
  9. http://www.ncbi.nlm.nih.gov/books/NBK3827/table/pubmedhelp.T43/.
  10. http://l2r.cs.uiuc.edu/∼cogcomp/tools.php.
  11. Smalheiser, N.R.; Zhou, W.; Torvik, V.I. Anne O'Tate: A Tool to Support User-Driven Summarization, Drill-Down And Browsing Of Pubmed Search Results. J. Biomed. Discov. Collab. 2008, 3, 2. [Google Scholar]
  12. Torvik, V.I.; Smalheiser, N.R. Author Name Disambiguation in MEDLINE. ACM Trans. Knowl. Discov. Data 2009, 3, 11. [Google Scholar]
  13. Hersh, W.; Price, S.; Donohoe, L. Assessing Thesaurus-based Query Expansion Using the UMLS Metathesaurus. Proc. AMIA Symp. 2000, 73, 344–348. [Google Scholar]
  14. Wilbur, W.J.; Yang, Y. An Analysis of Statistical Term Strength and Its Use in the Indexing and Retrieval of Molecular Biology Texts. Comput. Biol. Med. 1996, 26, 209–222. [Google Scholar]
  15. Wilbur, W.J. A Thematic Analysis of the AIDS Literature. Pac. Symp. Biocomput. 2002, 73, 386–397. [Google Scholar]
  16. Chen, H.; Ng, T.D.; Martinez, J.; Schatz, B.R. A Concept Space Approach to Addressing the Vocabulary Problem in Scientific Information Retrieval: an Experiment on the Worm Community System. J. Am. Soc. Inf. Sci. 1997, 48, 17–31. [Google Scholar]
  17. Homayouni, R.; Heinrich, K.; Wei, L.; Berry, M.W. Gene Clustering By Latent Semantic Indexing of MEDLINE Abstracts. Bioinformatics 2004, 73, 515–527. [Google Scholar]
  18. Erkan, G.; Radev, D.R. LexRank: Graph-based Centrality as Salience in Text Summarization. J. Artif. Intell. Res. 2004, 22, 457–479. [Google Scholar]
  19. Torvik, V.I.; Smalheiser, N.R. A Quantitative Model for Linking Two Disparate Sets of Articles in MEDLINE. Bioinformatics 2007, 23, 1658–1565. [Google Scholar]
  20. http://arrowsmith.psych.uic.edu.

Share and Cite

MDPI and ACS Style

Smalheiser, N.R.; Zhou, W.; Torvik, V.I. Distribution of “Characteristic” Terms in MEDLINE Literatures. Information 2011, 2, 266-276. https://doi.org/10.3390/info2020266

AMA Style

Smalheiser NR, Zhou W, Torvik VI. Distribution of “Characteristic” Terms in MEDLINE Literatures. Information. 2011; 2(2):266-276. https://doi.org/10.3390/info2020266

Chicago/Turabian Style

Smalheiser, Neil R., Wei Zhou, and Vetle I. Torvik. 2011. "Distribution of “Characteristic” Terms in MEDLINE Literatures" Information 2, no. 2: 266-276. https://doi.org/10.3390/info2020266

Article Metrics

Back to TopTop