analiza aiqbench
This research introduces Equivariant Poincaré ResNets to address optimization challenges and parameter redundancy in hyperbolic deep learning by integrating discrete symmetry groups with specific geometric tensor operations. The approach significantly enhances sample efficiency and convergence speed while maintaining spatial group equivariance within the constraints of the Poincaré ball model.
Group-Equivariant Poincar\'e Convolutional Networks
arXiv:2607.00556v2 Announce Type: replace-cross Abstract: While recent methods like that of the Poincar\'e ResNet have demonstrated the ability to learning visual representations directly in hyperbolic space, their optimisation remains a challenge, primarily due to the parameter redundancy of learning distinct orientation filters. In addition, hyperbolic learning exhibits distinct computational overheads that limit their wide use, where efforts to improve their efficiency via optimisation have seen good success, there has been limited exploration into structural priors that enable stronger sample efficiency at training. To address this, we propose Equivariant Poincar\'e ResNets, combining hyperbolic geometry with discrete symmetry groups ($C_4$ and $D_4$). We identify critical roadblocks in applying Euclidean equivariance to hyperbolic space and propose geometrically safe tensor reshaping, left-regular permutations for hyperbolic group convolutions, and joint-orientation Poincar\'e Midpoint Batch normalisation. Empirical evaluations show that embedding equivariance significantly improves the sample efficiency during training which in-turn accelerates convergence while respecting the boundary constraints of the Poincar\'e ball and retaining spatial group equivariance.
Abstract:While recent methods like that of the Poincaré ResNet have demonstrated the ability to learning visual representations directly in hyperbolic space, their optimisation remains a challenge, primarily due to the parameter redundancy of learning distinct orientation filters. In addition, hyperbolic learning exhibits distinct computational overheads that limit their wide use, where efforts to improve their efficiency via optimisation have seen good success, there has been limited exploration into structural priors that enable stronger sample efficiency at training. To address this, we propose Equivariant Poincaré ResNets, combining hyperbolic geometry with discrete symmetry groups ($C_4$ and $D_4$). We identify critical roadblocks in applying Euclidean equivariance to hyperbolic space and propose geometrically safe tensor reshaping, left-regular permutations for hyperbolic group convolutions, and joint-orientation Poincaré Midpoint Batch normalisation. Empirical evaluations show that embedding equivariance significantly improves the sample efficiency during training which in-turn accelerates convergence while respecting the boundary constraints of the Poincaré ball and retaining spatial group equivariance.
Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
arXiv:2607.00556 [cs.LG]
(or arXiv:2607.00556v2 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2607.00556 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 250 cuvinte
Subiecte conexe
Moment kernels: a simple and scalable approach for equivariance to rotations and reflections in deep convolutional networks
arXiv · 3 aug. 2026
Theoretical Aspects of Lie Groupoid and Lie Algebroid Equivariant Convolutional Neural Networks
arXiv · 24 iul. 2026
Theoretical Aspects of Lie Groupoid and Lie Algebroid Equivariant Convolutional Neural Networks
arXiv · 3 iun. 2026
On Making $\mathrm{SE}(2)$-Invariant Networks Optimal
arXiv · 15 oct. 2026