<p>Fully-connected tensor network (FCTN) decomposition is a generalization of the popular tensor train and tensor ring decompositions. Based on this decomposition, we propose a general multi-linear tensor-on-tensor regression model. The alternating least squares (ALS) method is employed to obtain the ridge estimate, and the explicit structures of the coefficient matrices of the ALS subproblems are also explored. To figure out the structures, we adopt a tensor product called subnetwork product and adjust the sizes of the FCTN factors appropriately. Further, the above structures are utilized to accelerate the computation of Gramians and other terms needed in the ALS method, where the latter also invokes the leverage sampling. Extensive experiments on synthetic and real data are provided to illustrate the superior performances of our model and methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Low-Rank Fully-Connected Tensor Network Learning for Tensor-on-Tensor Regression

  • Mengyu Wang,
  • Fukang Li,
  • Hanyu Li

摘要

Fully-connected tensor network (FCTN) decomposition is a generalization of the popular tensor train and tensor ring decompositions. Based on this decomposition, we propose a general multi-linear tensor-on-tensor regression model. The alternating least squares (ALS) method is employed to obtain the ridge estimate, and the explicit structures of the coefficient matrices of the ALS subproblems are also explored. To figure out the structures, we adopt a tensor product called subnetwork product and adjust the sizes of the FCTN factors appropriately. Further, the above structures are utilized to accelerate the computation of Gramians and other terms needed in the ALS method, where the latter also invokes the leverage sampling. Extensive experiments on synthetic and real data are provided to illustrate the superior performances of our model and methods.