Spotify in AR

Hybrid UIs for Music Exploration in AR and VR

Carmine Elvezio, Pierre Amelot, Robert Boyle, Catherine Ilona Wes, Steve Feiner

Hybrid Interfaces for Music Exploration

2016-2019

A hybrid user interface that facilitates interaction with music content in 3D, using a combination of 2D and 3D input and display devices. The world's music is presented in XR, supporting AR or VR head-worn displays in conjunction with touch screens, hand tracking, and voice input.

Presented at the IEEE ISMAR 2018.

Media

Publications

Hybrid UIs for Music Exploration in AR and VR

Carmine Elvezio, Pierre Amelot, Robert Boyle, Catherine Ilona Wes, Steven Feiner

IEEE ISMAR 2018

[IEEE Xplore] [Abstract]

We present hybrid user interfaces that facilitate interaction with music content in 3D, using a combination of 2D and 3D input and display devices. Participants will explore an online music library, some wearing AR or VR head-worn displays used alone or in conjunction with touch screens, and others using only touch screens. They will select genres, artists, albums and songs, interacting through a combination of 3D hand-tracking and 2D multi-touch technologies.