aiqbench analysis
Composing insight from the full article — this may take a moment.
Factorized approximate inverse preconditioners in the tensor train format
arXiv:2611.03859v1 Announce Type: cross Abstract: We present a preconditioning pipeline that accelerates Tensor Train (TT) linear solvers for symmetric positive-definite problems. Extending the Factorized Sparse Approximate Inverse framework to tensor networks, we construct a preconditioner as the product of a TT operator and its transpose. This formulation is positive semidefinite for any bond dimension and truncation, and definite whenever the factor is non-singular, satisfying the mathematical requirements of the Conjugate Gradient method. We detail the construction of this preconditioner and its integration into Density Matrix Renormalization Group (DMRG)-like linear solvers. Performance evaluations show consistent iteration reductions for anisotropic diffusion and Poisson problems across various configurations, leading to net speedups of up to 25% in ill-conditioned settings of time stepping schemes that can reuse the approximate inverses. These benchmarks were performed with the open-source Julia library DifferenTT.jl, which we also introduce in this work to provide out-of-the-box access to these preconditioned pipelines.
Read the full article at arXivRelated coverage
BLOKS: Scaling Kernel Solvers with Sketched Block Preconditioning
arXiv · Oct 12, 2026
How Does Orthogonalization Adapt to the Neural Network Hessian Structure? A Gradient Self Outer-Product Analysis at Initialization
arXiv · Oct 22, 2026
CAST: Canonical Approximate Schur Tree for Approximate Cholesky on Graphs
arXiv · Sep 10, 2026
Clean: Second-order LLM Training at Linear Memory Cost via Nystr\"om Sketching
arXiv · Oct 7, 2026