Publications

* indicates equal contribution.

2026

RMNP: Row-Momentum Normalized Preconditioning for Scalable Matrix-Based Optimization.”

Shenyang Deng*, Zhuoli Ouyang*, Tianyu Pang, Zihang Liu, Ruochen Jin, Shuhua Yu, Yaoqing Yang.

The 43rd International Conference on Machine Learning (ICML 2026).

Balancing Learning Rates Across Layers: Exact Two-Step Dynamics and Optimal Scaling in Linear Neural Networks.”

Tianyu Pang, Vignesh Kothapalli, Shenyang Deng, Haohui Wang, Dawei Zhou, Yaoqing Yang.

The 43rd International Conference on Machine Learning (ICML 2026).

Suspicious Alignment of SGD: A Fine-Grained Step Size Condition Analysis.”

Shenyang Deng, Boyao Liao, Zhuoli Ouyang, Tianyu Pang, Minhak Song, Yaoqing Yang.

The 37th International Conference on Algorithmic Learning Theory (ALT 2026) [Best Student Paper Award].

Depth, Not Data: An Analysis of Hessian Spectral Bifurcation.”

Shenyang Deng*, Boyao Liao*, Zhuoli Ouyang*, Tianyu Pang, Yaoqing Yang.

2026 IEEE International Symposium on Information Theory (ISIT 2026) (Extended version in preparation for IEEE Transactions on Information Theory).

HTMuon: Improving Muon via Heavy-Tailed Spectral Correction.”

Tianyu Pang, Yujie Fang, Zihang Liu, Shenyang Deng, Lei Hsiung, Shuhua Yu, Yaoqing Yang.

Findings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026).

2025

KCES: Training-Free Defense for Robust Graph Neural Networks via Kernel Complexity.”

Yaning Jia, Shenyang Deng, Chiyu Ma, Yaoqing Yang, Soroush Vosoughi.

arXiv preprint.

From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks.”

Vignesh Kothapalli, Tianyu Pang, Shenyang Deng, Zongmin Liu, Yaoqing Yang.

Transactions on Machine Learning Research (TMLR).

2024

A Statistical Estimator for the Topological Dimension of Compact Submanifolds in High-Dimensional Euclidean Spaces.”

Shenyang Deng.

Undergraduate Thesis (in Chinese) [Outstanding Graduation Thesis Award].

A Mathematics Framework of Artificial Shifted Population Risk and Its Further Understanding Related to Consistency Regularization.”

Xiliang Yang, Shenyang Deng, Shicong Liu, Yuanchi Suo, Wing. WY NG, Jianjun Zhang.

European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases 2024 (ECML 2024).

Google Scholar