Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data
NeurIPS 2026
BibTeX
@inproceedings{guo2026synthetic,
title = {Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data},
author = {Guo, Xu and Peng, Runyu and Tong, Jian and Zhou, Yunhua and Lv, Haijun and Lu, Zhihui and Guo, Qipeng},
booktitle = {Advances in Neural Information Processing Systems},
year = {2026},
}