Title: Regression and doubly robust off-policy learning on low-dimensional manifolds by neural networks
Authors: Wenjing Liao - Georgia Institute of Technology (United States) [presenting]
Abstract: Many data in real-world applications are in a high-dimensional space but exhibit low-dimensional structures. In mathematics, these data can be modeled as random samples on a low-dimensional manifold. The goal is to estimate a target function or learn an optimal policy using neural networks. The basis is an efficient approximation theory of deep ReLU networks for functions supported on a low-dimensional manifold. We further establish the sample complexity for regression and off-policy learning with finite samples of data. When data are sampled on a low-dimensional manifold, the sample complexity crucially depends on the intrinsic dimension of the manifold instead of the ambient dimension of the data. These results demonstrate that deep neural networks are adaptive to low-dimensional geometric structures of data sets.