Linear Partition in the Input Space
摘要
Recent research has demonstrated that the input space of a rectified linear unit (ReLU) network, which exclusively uses ReLU-like (two-piece linear) activation functions, is divided into linear regions by the nonlinear activations.