Identifying data sharing in biomedical literature.

TitleIdentifying data sharing in biomedical literature.
Publication TypeJournal Article
Year of Publication2008
AuthorsPiwowar, HA, Chapman, WW, Chapman, W
JournalAMIA Annu Symp Proc
Date Published2008
KeywordsAlgorithms, Artificial Intelligence, Cooperative Behavior, Information Dissemination, Information Storage and Retrieval, Natural Language Processing, Pattern Recognition, Automated, Periodicals as Topic, Subject Headings

Many policies and projects now encourage investigators to share their raw research data with other scientists. Unfortunately, it is difficult to measure the effectiveness of these initiatives because data can be shared in such a variety of mechanisms and locations. We propose a novel approach to finding shared datasets: using NLP techniques to identify declarations of dataset sharing within the full text of primary research articles. Using regular expression patterns and machine learning algorithms on open access biomedical literature, our system was able to identify 61% of articles with shared datasets with 80% precision. A simpler version of our classifier achieved higher recall (86%), though lower precision (49%). We believe our results demonstrate the feasibility of this approach and hope to inspire further study of dataset retrieval techniques and policy evaluation.

Alternate JournalAMIA Annu Symp Proc
PubMed ID18998887