# Multi-purpose RNA language modelling with motif-aware pretraining and type-guided fine-tuning

*PRI Rank #14 · Topics and Trends in Most Cited RNA Research and Splicing Papers, Class of 2026*

*Canonical URL: https://pri.pepkio.com/top-papers/rna-research-and-splicing/2026/rank-14*

| Field | Value |
| --- | --- |
| Rank | #14 |
| 18m citations | 69 |
| Journal | Nature Machine Intelligence |
| Year | 2024 |
| DOI | 10.1038/s42256-024-00836-4 |
| Corresponding authors | Linghe Kong, Haoyi Xiong |
| Institution | Baidu Inc., China |

**Ranking page:** [Topics and Trends in Most Cited RNA Research and Splicing Papers, Class of 2026](https://pri.pepkio.com/top-papers/rna-research-and-splicing/2026)

**Paper link:** [10.1038/s42256-024-00836-4](https://doi.org/10.1038/s42256-024-00836-4)

## Topics

RNAErnie · RNA language model · transformer architecture · motif-aware pretraining · RNA motifs · motif-level random masking · masked language modeling · RNA type tokenization · miRNA · Long non-coding RNA · type-guided fine-tuning · out-of-distribution generalization · RNA type prediction · post hoc feature embedding refinement · RNA sequence classification · RNA interaction prediction · RNA structure prediction · nucleotide sequence analysis · biological priors in pretraining

## Cite this ranking

```
Pepkio Research Index (PRI). Topics and Trends in Most Cited RNA Research and Splicing Papers, Class of 2026. https://pri.pepkio.com/top-papers/rna-research-and-splicing/2026. Accessed 2026-07-21.

Zheng Su, Tinsley Li, Thematic Shifts in Early-High-Impact Cancer Genomics and Diagnostics Research: A Bibliometric and Semantic Analysis. bioRxiv 2026.07.04.736459; doi: https://doi.org/10.64898/2026.07.04.736459
```