Systematic evaluation of spliced alignment programs for RNA-seq data

Nat Methods. 2013 Dec;10(12):1185-91. doi: 10.1038/nmeth.2722. Epub 2013 Nov 3.

Abstract

High-throughput RNA sequencing is an increasingly accessible method for studying gene structure and activity on a genome-wide scale. A critical step in RNA-seq data analysis is the alignment of partial transcript reads to a reference genome sequence. To assess the performance of current mapping software, we invited developers of RNA-seq aligners to process four large human and mouse RNA-seq data sets. In total, we compared 26 mapping protocols based on 11 programs and pipelines and found major performance differences between methods on numerous benchmarks, including alignment yield, basewise accuracy, mismatch and gap placement, exon junction discovery and suitability of alignments for transcript reconstruction. We observed concordant results on real and simulated RNA-seq data, confirming the relevance of the metrics employed. Future developments in RNA-seq alignment methods would benefit from improved placement of multimapped reads, balanced utilization of existing gene annotation and a reduced false discovery rate for splice junctions.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Animals
  • Chromosome Mapping / methods
  • Computational Biology / methods
  • Exons
  • False Positive Reactions
  • High-Throughput Nucleotide Sequencing / methods
  • Humans
  • K562 Cells
  • Mice
  • RNA Splicing*
  • RNA, Messenger / metabolism
  • Reproducibility of Results
  • Sequence Alignment / methods*
  • Sequence Analysis, RNA / methods*
  • Software

Substances

  • RNA, Messenger