MiXR

Music in Mixed Reality


Shalva Kohen, Carmine Elvezio, Steve Feiner

Interacting with Music in AR

2019-2021

MiXR is a novel interactive system that combines an AR headset, a smartphone, and a tablet to allow performers to intuitively and efficiently manage and annotate virtual sheet music in their physical environment.


Presented at IEEE ISMAR 2020.

Media

Publications


MiXR: A Hybrid AR Sheet Music Interface for Live Performance

Shalva Kohen, Carmine Elveizo, Steven Feiner
IEEE ISMAR 2020, Online
[IEEE Xplore] []
Musicians face a number of issues when performing live, including organizing and annotating sheet music. This can be an unwieldy process, as musicians need to simultaneously read and manipulate sheet music and interact with the conductor and other musicians. Augmented Reality can provide a way to ease some of the more cumbersome aspects of live performance and practice. We present MiXR, a novel interactive system that combines an AR headset, a smartphone, and a tablet to allow performers to intuitively and efficiently manage and annotate virtual sheet music in their physical environment. We discuss our underlying motivation, the interaction techniques supported, and the system architecture.