Benjamin Thérien, Charles-Étienne Joseph, Zain Sarwar, Ashwinee Panda, Anirban Das, Shi-Xiong Zhang, Stephen Rawls, Sambit Sahu, Eugene Belilovsky, Irina Rish: Continual Pre-training of MoEs: How robust is your router? Trans. Mach. Learn. Res. 2025 (2025)