analiza aiqbench
I-SplineFlow introduces integrated monotone splines to optimize sampling trajectories in diffusion and flow models, offering a more efficient alternative to traditional polynomial bases for few-step generation. By decoupling polynomial degree from mixture weights and ensuring strictly monotone signal-to-noise ratios by construction, this method achieves better-conditioned Jacobians and improved performance at low inference steps without requiring network retraining.
I-SplineFlow: Learning Monotone Spline Stochastic Interpolant Schedulers for Few-Step Generation
arXiv:2609.27963v1 Announce Type: new Abstract: Few-step generation with pretrained diffusion and flow models can be accelerated by lightweight training that optimizes the sampling trajectory rather than the network. A recent approach parameterizes the stochastic interpolant (SI) scheduler as a smooth curve whose control points enforce the three properties an SI scheduler must satisfy: fixed boundary conditions, a monotone signal-to-noise ratio (SNR), and differentiability. Existing parameterizations use globally supported polynomial bases, where every control point moves the whole curve and higher expressiveness needs a higher degree, which couples distant regions of the schedule during optimization. We introduce \emph{I-SplineFlow}, which parameterizes the scheduler with integrated monotone splines (I-splines). I-splines decouple the polynomial degree from the number of mixture weights, so support width and smoothness can be chosen per model at a fixed weight count, and the compactly supported derivative basis makes the scheduler Jacobian orders of magnitude better conditioned than a B\'ezier basis. Boundary conditions and a strictly monotone SNR hold by construction, with no ordering constraint on the parameters and closed-form velocity derivatives. Across diffusion (EDM) and flow (ReFlow, Simple ReFlow) models, I-SplineFlow improves few-step FID over B\'ezier scheduling in most settings, most clearly at the lowest NFEs, and trains in minutes. Ablations show that both the degree freedom and the monotonicity constraint are needed. The code will be released upon acceptance.
Abstract:Few-step generation with pretrained diffusion and flow models can be accelerated by lightweight training that optimizes the sampling trajectory rather than the network. A recent approach parameterizes the stochastic interpolant (SI) scheduler as a smooth curve whose control points enforce the three properties an SI scheduler must satisfy: fixed boundary conditions, a monotone signal-to-noise ratio (SNR), and differentiability. Existing parameterizations use globally supported polynomial bases, where every control point moves the whole curve and higher expressiveness needs a higher degree, which couples distant regions of the schedule during optimization. We introduce \emph{I-SplineFlow}, which parameterizes the scheduler with integrated monotone splines (I-splines). I-splines decouple the polynomial degree from the number of mixture weights, so support width and smoothness can be chosen per model at a fixed weight count, and the compactly supported derivative basis makes the scheduler Jacobian orders of magnitude better conditioned than a Bézier basis. Boundary conditions and a strictly monotone SNR hold by construction, with no ordering constraint on the parameters and closed-form velocity derivatives. Across diffusion (EDM) and flow (ReFlow, Simple ReFlow) models, I-SplineFlow improves few-step FID over Bézier scheduling in most settings, most clearly at the lowest NFEs, and trains in minutes. Ablations show that both the degree freedom and the monotonicity constraint are needed. The code will be released upon acceptance.
Machine Learning (cs.LG)
arXiv:2609.27963 [cs.LG]
(or arXiv:2609.27963v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2609.27963 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 310 cuvinte
Subiecte conexe
AIGS: Adaptive Incremental Gating System for Online Representation Learning in Non-Stationary Data Streams
arXiv · 5 oct. 2026
Adapt or Forget: Provable Tradeoffs Between Adam and SGD in Nonstationary Optimization
arXiv · 14 sept. 2026
The Loss Does Not See the Basis, but Adam Does
arXiv · 6 aug. 2026
I trained GPT-2 with full-batch gradient descent so you don't have to
LessWrong · 14 oct. 2026