From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields

Authors

DOI:

https://doi.org/10.4108/eai.12-5-2021.169913

Keywords:

user interface, toolkit, interface builder, audiovisual, cross-modal interaction

Abstract

INTRODUCTION: We propose AudioVisual User Interfaces (AVUI), a novel type of UI linking interaction, sound and image. It extends the concept of Graphical User Interface (GUI) by adding interconnected sound and image.

OBJECTIVES: We aim to situate AVUIs in relation to identified relevant fields: Human-Computer Interaction (HCI), sonic interaction design, cognitive psychology and audiovisual art, and to identify benefits of AVUIs inthe context of those fields.

METHODS: In this research, we combine literature review of related concepts with a user-centered design methodology, involving a community of audiovisual artists and performers.

RESULTS: We contextualize AVUI within the identified fields and identify benefits for the implementation of AVUIs in relation to those fields.

CONCLUSION: These results can contribute to the further adoption of AVUIs by the HCI community, particularly those interested in multisensory experience involving sound and image.

Downloads

Published

12-05-2021

How to Cite

1.
Correia NN, Tanaka A. From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields. EAI Endorsed Trans Creat Tech [Internet]. 2021 May 12 [cited 2024 Dec. 12];8(27):e5. Available from: https://publications.eai.eu/index.php/ct/article/view/1425