Opened 14 months ago

Last modified 5 months ago

#31991 new enhancement

Efficient numerical computations with tensor trains — at Version 3

Reported by: gh-honglizhaobob Owned by:
Priority: major Milestone: sage-9.7
Component: linear algebra Keywords:
Cc: mkoeppe, egourgoulhon, dimpase Merged in:
Authors: Reviewers:
Report Upstream: N/A Work issues:
Branch: Commit:
Dependencies: Stopgaps:

Status badges

Description (last modified by gh-honglizhaobob)

Following the progress with Ticket #30307, we propose to add computational functionalities with tensors via the tensor train decomposition, which is an idea originally named "Density Matrix Renormalization Group (DMRG)" and later popularized by Prof. Ivan Oseledets.

This functionality is especially useful for high dimensional tasks to prevent the curse of dimensionality (such as in Riemannian optimization), currently supported in MATLAB, Python, and C++. The MATLAB version is currently most versatile and robust.

We may consider internalizing this computational library for Sage, as an effort to formalize the currently available implementations. This addition can either be an additional child class under tensor, and overwrite the arithmetics; or a separate module. The backend is currently proposed to be TensorFlow?, however this may change / be flexible based on how the refactoring of Components progresses.

One can look at this github page for an example implementation (https://github.com/oseledets/ttpy).

Ideally after the implementation of this ticket, users can specify a fixed rank tensor for a general manifold using tensor.modules, specify a ring and a frame, and perform useful and normally computationally intractable tasks using tensor train as a backend. Based on the progress of this ticket, one may also consider implementing other backends for storing a numerical tensor such as tensor rings and quantized tensor train.

For alternative tensor decomposition formats, please see the following survey papers:

For the theory behind why one can reduce a normally exponential (in the number of dimensions) task to a linear task, see (https://epubs.siam.org/doi/abs/10.1137/090752286?journalCode=sjoce3).

Change History (3)

comment:1 Changed 14 months ago by gh-honglizhaobob

  • Description modified (diff)

comment:2 Changed 14 months ago by mkoeppe

  • Cc egourgoulhon added

comment:3 Changed 14 months ago by gh-honglizhaobob

  • Cc egourgoulhon removed
  • Description modified (diff)
Note: See TracTickets for help on using tickets.