Phenotate: crowdsourcing phenotype annotations as exercises in undergraduate classes.

Genet Med 2020 Aug 5;22(8):1391-1400. Epub 2020 May 5.

Centre for Computational Medicine, The Hospital For Sick Children, Toronto, ON, Canada.

Purpose: Computational documentation of genetic disorders is highly reliant on structured data for differential diagnosis, pathogenic variant identification, and patient matchmaking. However, most information on rare diseases (RDs) exists in freeform text, such as academic literature. To increase availability of structured RD data, we developed a crowdsourcing approach for collecting phenotype information using student assignments.

Methods: We developed Phenotate, a web application for crowdsourcing disease phenotype annotations through assignments for undergraduate genetics students. Using student-collected data, we generated composite annotations for each disease through a machine learning approach. These annotations were compared with those from clinical practitioners and gold standard curated data.

Results: Deploying Phenotate in five undergraduate genetics courses, we collected annotations for 22 diseases. Student-sourced annotations showed strong similarity to gold standards, with F-measures ranging from 0.584 to 0.868. Furthermore, clinicians used Phenotate annotations to identify diseases with comparable accuracy to other annotation sources and gold standards. For six disorders, no gold standards were available, allowing us to create some of the first structured annotations for them, while students demonstrated ability to research RDs.

Conclusion: Phenotate enables crowdsourcing RD phenotypic annotations through educational assignments. Presented as an intuitive web-based tool, it offers pedagogical benefits and augments the computable RD knowledgebase.

Download full-text PDF

Source
http://dx.doi.org/10.1038/s41436-020-0812-7DOI Listing
August 2020

Publication Analysis

Top Keywords

gold standards
12
annotations
9
structured data
8
undergraduate genetics
8
phenotype annotations
8
phenotate
5
disease machine
4
generated composite
4
composite annotations
4
demonstrated ability
4
annotations disease
4
learning approach
4
clinical practitioners
4
gold
4
practitioners gold
4
compared clinical
4
students demonstrated
4
data generated
4
approach annotations
4
annotations compared
4

Similar Publications