Systematic evaluation of computational tools for multitype RNA modification detection using nanopore direct RNA sequencing.

Nanopore direct RNA sequencing offers a versatile approach for detecting multiple types of RNA modifications at a single-base resolution. In this study, we systematically evaluate 86 computational tools for detecting six RNA modifications (m6A, Ψ, m5C, A-to-I editing, m7G and m1A) using direct RNA sequencing data from both RNA002 and RNA004 chemistries. We demonstrate that retraining tools with a combination of in vitro transcription and real biological samples notably enhances both accuracy and generalizability over their original implementations, especially for Ψ, m5C and A-to-I. Evaluations on real biological samples reveal that while m6A detection tools generally achieve high accuracy, non-m6A tools struggle with precision-recall balance, quantification accuracy and biological validity. Our findings highlight the importance of incorporating diverse training data and stress the need for tools capable of reliably distinguishing between modification types at single-base resolution. These insights provide a foundation for advancing RNA modification detection.