aiqbench analysis
This research presents bFaaaP, an assistive system that enables pianists with lower-limb impairments to control the sustain pedal via head-tracking augmented reality. The core technical contribution lies in its quantitative, user-tunable control law and a specific engineering trick that decouples high-frequency AR sampling from slower BLE command rates to ensure expressive fidelity. By achieving statistical parity between foot-operated and head-controlled pedalling, this work advances accessibility through novel human-computer interaction techniques grounded in robotics and sensor fusion.
bFaaaP: An Inclusive, Head-Angle Piano-Pedal Interaction that Quantitatively Reproduces a Pianist's Intended Pedalling -- Foot-Free, for Acoustic and Electronic Pianos
arXiv:2608.00633v1 Announce Type: cross Abstract: Expressive piano performance depends on the sustain (damper) pedal, operated by foot, excluding players who cannot readily use their feet: wheelchair users and others with lower-limb impairments, small children, and some elderly or disabled players. We present bFaaaP (barrier-Free assist as a Pedal), an inclusive, foot-free interaction that operates the pedal from the angle of the player's head: a smartphone tracks head pose with on-device augmented-reality (AR) face tracking and streams a compact command over Bluetooth Low Energy (BLE) to a pedal device. Supported by patent examination, our central claim is not the head-to-pedal architecture (anticipated by prior art) but a quantitative, user-tunable control law -- the patentable "key" to a natural, expressive result: the player presets a small angular dead-zone (offset 3-10 degrees) and a multiplier (10-50), which together fix a secondary, pre-adjustable response speed that reproduces the pianist's intended pedalling. An engineering trick decouples the fast AR sampling from the slower BLE rate. Two co-equal realizations share one controller: a non-destructive robotic actuator for acoustic pianos (Pro), anchored by a pneumatic "airback" (our coined term for an inflatable air-braced anchor) that absorbs the reaction force without modifying the instrument; and an electronic sustain switch for digital pianos (Switch). In a human-subject Auxiliary Pedal Effect Evaluation (APEE) with 15 participants, bFaaaP significantly increased sustained-tone energy (p0.05), with no significant difference across classes; one participant with a leg disability and a tracheostomy performed successfully. With nothing worn on the face and fast setup, bFaaaP has run in formal public concerts (2018-2025). We release the full hardware and software as open source.
Authors:Tomoyuki Shishido (1 and 2), Masahiro Ootaki (3), Hiroyuki Narusawa (4) ((1) Shishido & Associates, Hachioji, Tokyo, Japan, (2) SeemeData Labs, Inc., Nakano-ku, Tokyo, Japan, (3) Ootaki & Architects, Sayama, Saitama, Japan, (4) Naru Science Software, Fujimi-shi, Saitama, Japan)
Abstract:Expressive piano performance depends on the sustain (damper) pedal, operated by foot, excluding players who cannot readily use their feet: wheelchair users and others with lower-limb impairments, small children, and some elderly or disabled players. We present bFaaaP (barrier-Free assist as a Pedal), an inclusive, foot-free interaction that operates the pedal from the angle of the player's head: a smartphone tracks head pose with on-device augmented-reality (AR) face tracking and streams a compact command over Bluetooth Low Energy (BLE) to a pedal device. Supported by patent examination, our central claim is not the head-to-pedal architecture (anticipated by prior art) but a quantitative, user-tunable control law -- the patentable "key" to a natural, expressive result: the player presets a small angular dead-zone (offset 3-10 degrees) and a multiplier (10-50), which together fix a secondary, pre-adjustable response speed that reproduces the pianist's intended pedalling. An engineering trick decouples the fast AR sampling from the slower BLE rate. Two co-equal realizations share one controller: a non-destructive robotic actuator for acoustic pianos (Pro), anchored by a pneumatic "airback" (our coined term for an inflatable air-braced anchor) that absorbs the reaction force without modifying the instrument; and an electronic sustain switch for digital pianos (Switch). In a human-subject Auxiliary Pedal Effect Evaluation (APEE) with 15 participants, bFaaaP significantly increased sustained-tone energy (p<0.01) and was statistically indistinguishable from a player's own foot (p>0.05), with no significant difference across classes; one participant with a leg disability and a tracheostomy performed successfully. With nothing worn on the face and fast setup, bFaaaP has run in formal public concerts (2018-2025). We release the full hardware and software as open source.
28 pages, 10 figures, 9 tables. Open hardware/software release. Preprint
Human-Computer Interaction (cs.HC); Robotics (cs.RO)
H.5.2; K.4.2; I.2.9; J.5
arXiv:2608.00633 [cs.HC]
(or arXiv:2608.00633v1 [cs.HC] for this version)
https://doi.org/10.48550/arXiv.2608.00633 arXiv-issued DOI via DataCite (pending registration)
Full text under the publisher's open licence · 344 words
