Journal of Machine Learning

We are launching a new journal: Journal of Machine Learning (JML, Editor-in-Chief: Weinan E). Welcome to submit papers to JML.

Overview paper of frequency principle

The overview paper of frequency principle is now in: ArXiv 2201.07395

Accepted by NeurIPS 2021 Spotlight:

Yaoyu Zhang*, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu*, Embedding Principle of Loss Landscape of Deep Neural Networks. NeurIPS 2021 spotlight, arxiv 2105.14573 (2021) pdf, Talk on Bilibili

Accepted by CSIAM Trans. Appl. Math.:

1) (Alphabetic order) Tao Luo, Zheng Ma, Zhi-Qin John Xu, Yaoyu Zhang, Theory of the frequency principle for general deep neural networks, CSIAM Trans. Appl. Math., in web

2) (Alphabetic order) Jihong Wang, Zhi-Qin John Xu*, Jiwei Zhang*, Yaoyu Zhang, Implicit bias in understanding deep learning for solving PDEs beyond Ritz-Galerkin method, CSIAM Trans. Appl. Math., arxiv 2002.07989 (2020). pdf

2021, 人工智能青年科学家俱乐部(青源会)会员。

Member of Qingyuan Club for outstanding contribution to the mathematical foundations of AI. Certificate


Zhi-Qin John Xu* , Yaoyu Zhang, Tao Luo, Yanyang Xiao, Zheng Ma, Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks, pdf, and in web.

Accepted by Journal of Machine Learning Research (2021)

Phase diagram for two-layer ReLU neural networks at infinite-width limit, arxiv 2007.07497 (2020), pdf, and in arxiv

MscaleDNN works are selected in the cover of a special issue on Machine Learning for Scientific Computing.

See the Cover and the paper MscaleDNN for non-linear elliptic equations. The MscaleDNN is original proposed in MscaleDNN.pdf. The third work on the Cover is also an application of MscaleDNN.

Accepted by AAAI-2021

Deep frequency principle towards understanding why deeper learning is faster, pdf, and in arxiv