Musicians Auditory Perception

Presented during the IRCAM Forum @NYU 2022 Co-authored by Berk Schneider (University of California, San Diego) [Co-First Author], Florian Grond (McGill University) [Co-First Author], Jeanne Côté (McGill University), Pedram Diba (McGill University), Min Seok Peter Ko (UCSD), Sang Song (UCSD), Tiange Zhou (UCSD), Shahrokh Yadegari (UCSD) [Principal Investigator].

https://www.actorproject.org/project-reports/musicians-auditory-perception?fbclid=IwAR30zyXCV5KYD_xAIW1n9GKWzD6opyuEsIVwsNv4pwvJinHbYB87Ds193jc

The purpose of the Musician Auditory Perception (MAP) project is to collect quantitative data via sonic ethnography in order to promote and analyze, both literally and metaphorically, (a) sonic collaboration between auditory learners, (b) modes of sound information gathering, and (c) the creative expression of musicians, while disrupting common pedagogic practices that reinforce hierarchical education. Auditory learning is not necessarily a linear process, but a dynamic one — a skillset synergistic and deeply connected with creation. Therefore, MAP will enable three student composer-performer duos from two Analysis, Creation, and Teaching of Orchestration (ACTOR) partner institutions, UC San Diego (UCSD) and McGill University (McGill), to document their creation processes with binaural recording devices and first-person vision — captured by earpiece microphones and wearable HD cameras — effectively mapping audiovisual boundary objects. The outcome being that these sonic and visual boundary objects promote skill sharing between all participants by bridging differences in perception during the creation and reproduction of musical timbres, allowing a digital transfer of knowledge via an individual perspective in the time of the Covid-19 pandemic.

Through analyzation of boundary objects, MAP’s interdisciplinary-participatory research design seeks to understand how musicians balance cognitive and technical dimensions within their practice in order to produce timbres that cannot necessarily be measured in totality, especially when it comes to unearthing tacit knowledge, where typical interviews and text-based case studies are only partially successful. How does ACTOR’s developing ontological classification of timbre, including its descriptors, interact with tacit knowledge and the epistemic authority of each participating musician, e.g., gut feeling with know-how, creativity with problem-solving, intuition with skills, and perceptions or judgements with lessons learned? In addition, a cross-referencing of thematic analysis through quantitative thick descriptions and signal processing of binaural audio will provide more objective constructs for evaluation. For example, If a sound is deemed “bright” by the majority of participants the term will be measured in conjunction with its spectral centroid.