Skip links

The Future is Here: Listening to Space

Abstract

Explores the intricate relationship between sound, technology and our environment, offering insights into the evolution of immersive sound narratives. It delves into the historical and cultural aspects of the technology, drawing parallels between ancient milestones such as the mastery of fire and contemporary immersive experiences. The text explores how immersive technologies reshape our perception of space and time, analyzing the impact of next-generation audio innovations such as spatial audio and object-based sound. Emphasizes the socioeconomic factors that drive the desire for immersive experiences and addresses their implications on society. Additionally, it reflects on ancient immersive practices such as the temazcal ceremony and its relevance to contemporary discussions of immersive audio. The summary addresses the evolution of immersive audio, taking into consideration not only the forms of production of these new narratives, but also the experience on the part of the user, highlighting the role of independent artists in the configuration of immersive sound narratives. It emphasizes the convergence of art and technology, envisioning immersive audio as a conduit to deepen the deepest connections with our environments.

Introduction

“The future is there, Cayce hears herself say, looking back at us. Trying to make sense of the fiction we will have become. And from where they are, the past behind us will look nothing at all like the past we imagine behind us now.” William Gibson.[1]

Have you ever closed your eyes and experienced the feeling of sound enveloping you, immersing you in a unique sensory experience? Exploring the ever-evolving relationship between sound, technology, and our environment provides precise insights into the future landscape of immersive sonic narratives.

When we talk about technology, we refer to a specific combination of knowledge, tools, and techniques that emerge within a particular social context. Now, as we explore the historical and cultural aspects, it’s essential to recognize how these technologies have evolved over time.

Ancient practices, rooted in early human experiences, serve as an unexpected mirror to our modern immersion encounters. Around 2.0 million years ago, humans succeeded in mastering fire, marking a significant milestone in our technological evolution. This transformative milestone ushered in a new way of understanding and interacting with our environment. Fire, once a focal point for community gatherings and illumination, altered perceptions of time and space.

Technologies bring about significant transformations in our lives, each with varying degrees of impact. Let’s consider the adoption of fire: a double-edged sword. While it brought light and warmth, it also led to an increase in respiratory infections due to daily exposure to smoke, an unprecedented phenomenon in human history. Research suggests that the controlled use of fire among early humans created favorable conditions for the transmission of tuberculosis.[2]

Similarly, immersive technologies, much like fire, reshape our perception of time and space, fostering new patterns of behavior. In contemporary terms, our connection with diverse and constant sound sources has reached an unprecedented level. A multitude of auditory stimuli rhythmically punctuate our daily lives, with our minds, like a switch, toggling us in and out of the acoustic environment that simultaneously links us to physical and virtual spaces.

This toggling effect shapes our experience of spaces; at times, we’re wholly present within the acoustic realm, feeling connected to our surroundings through sound. Other times, our thoughts take precedence, momentarily disconnecting us from the auditory world around us. This dynamic interplay between mental engagement and detachment underscores the intricate ways our minds interact with acoustic environments, influencing our perception of space and our experiences within it.

Let’s consider the parallels between mastering fire, which transformed how early humans experienced their environment, and the contemporary changes in our immersion experiences. Whether it’s fire in the past or immersive audio in the present, these technologies possess the profound ability to shape our sensory experiences and redefine our relationship with space and time.

Advancements in spatial audio technology redefine how we perceive sound within a three-dimensional space, altering our understanding of directionality and depth.
These innovations not only transform how we relate to sound but also revolutionize our connection with the environments we inhabit, fundamentally reshaping our sensory experiences of space.

Inundare

“The echo of footsteps on a paved street carries emotional weight because the sound reverberating off the surrounding walls places us in direct relation to space; sound measures space and renders its scale understandable. With our ears, we caress the boundaries of space.” Juhani Pallasmaa.[3]

The concept of ‘immersive’ shares its etymological roots with the words ‘immerse’ and ‘inundate’. These three notions are used to convey the sensation of being absorbed or deeply involved in an experience.

The term ‘inundate’ has its roots in the ancient Latin word ‘inundāre’, vividly evoking the act of saturating a space with water or some other fluid substance.[4]

“To fill a territory with elements, beings, or people that were not there before or were not from there.”[5]

“Next-generation audio” is a term that encapsulates the forefront of audio technology alongside innovations in audiovisual productions, enabling a deeply immersive and interactive auditory experience. This term, next-generation audio, represents a convergence of technological
advancements and innovative techniques in content creation, fostering an environment where users are transported to a three-dimensional sonic landscape.

It encompasses advancements in various domains, including audio processing, spatial audio, immersive soundscapes, object-based audio, personalized audio, and interactive audio technologies.

Spatial audio is a central element of these new technologies, employing sophisticated techniques to create a three-dimensional audio experience, enriching how listeners perceive the direction, distance, and depth of sound. Through precise placement and movement of audio sources, it enhances immersion and spatial realism, transporting the audience to realistic sonic spaces. This technology impeccably replicates the behavior of sound in the real world.

Object-based audio has revolutionized sound design and consumption. It allows sound designers to treat individual audio components as discrete “objects,” each with unique metadata encompassing position, movement, and audio characteristics. This approach completely transforms production methods and offers adaptive capabilities where content dynamically adjusts to various playback systems and listener preferences. Object-based audio intensifies the sense of immersion by providing personalized auditory experiences precisely tailored to user environments.

These innovations extend across a wide range of fields, including virtual reality (VR) and augmented reality (AR), immersive installations, applications in gaming and gamification, live performances, concerts, cinema, educational simulations, healthcare applications, broadcasting, and podcasting.

Most technologies associated with immersive audio are far from innovative, just as the fundamental human inclination to immerse ourselves in immersive narratives isn’t innovative either.

This inclination has been a constant throughout human history, whether within the dancing shadows of an illuminated cave or through modern devices that expand the boundaries of our sensory experiences.

Yet, in the last five years, the longing for immersion, the desire to be completely absorbed by an experience that surpasses the limits of reality and plunges us into an alternative space, has become insatiable.

What socio-economic factors contribute to this expansion and inclination to move away from reality and immerse ourselves in a parallel one? Why is immersive audio gaining importance in this era and how does it influence sound production methods? Additionally, what impact do independent and experimental artists have on shaping immersive sonic narratives?

Current immersive experiences mark the beginning of a new technological dimension that carries profound political, economic, and social implications. They represent the pinnacle of technical advancement, submerging us in a vast sea of data.

As content producers, we should not overlook the historical and social backdrop in which these changes unfold, as immersive productions are fundamentally geared towards meeting the need to be absorbed by potential parallel realities.

“Immersion is often just another word for enclosure. Once the claims of immediacy and presence made for virtual reality are stripped away, what remains is a device that blocks perceptual access to the immediate world. Most critical discourse and industry talk about virtual reality focus on the vivid worlds created inside the headset. But what if the key to the cultural significance of virtual reality isn’t the seemingly three-dimensional spaces eventually loaded, but this initial move to voluntarily sever sensory connections with the local environment? Understanding the cultural politics of virtual reality means grasping the politics of perceptual enclosure. What draws people to stay alone in a room with a brick-sized monitor strapped to their face? Why stare at glass and plastic for deeper meaning? What leads people to surrender nearly all spatial cues about their physical place in the world to a computer?” Paul Roquet.[6]

At the edge of the precipice, amid the intersection of dreams with sheep and augmented realities, it’s evident that in need of new sensory experiences, the ways of listening are radically transforming our connection between sound and the environment. Deep listening, as proposed by Pauline Oliveros, is being redefined.
Amidst this labyrinth of audio data, this perceptual redefinition of space, at the heart of the digital era, what truly defines the essence of sonic immersion? And why are we so in need of immersing ourselves in it?

Surrounded by ‘something’ or ‘someone’

Psychological immersion represents a state where we are absorbed by an activity; our attention becomes captivated to the extent that we temporarily lose awareness of the surroundings..

This cognitive state involves temporarily suspending disbelief and directing consciousness toward the immediate experience. The result is an emotional connection that enhances enjoyment.

In the book “Immersion and Distance: Aesthetic Illusion in Literature and Other Media” Werner Wolf intertwines the concept of aesthetic illusion with the concept of immersion. He defines aesthetic illusion as a particular imaginative response triggered by various forms of artwork, such as movies, texts, images, sculptures, performances, and more.

This type of illusion involves a mental state where we immerse ourselves emotionally and mentally in a world created or suggested by the artwork. This mental state goes beyond merely appreciating the aesthetic quality of the work or being emotionally affected by it. It implies a strong connection between the experience and the content.

“The most important qualification of the particular state of mind which is termed ‘aesthetic illusion’ is in fact an activation of the imagination…This means that one must have the impression of being confronted with (or be surrounded by) at least ‘something’ or ‘somebody’ – which is more than merely feeling a mood, an emotion, or a deep appreciation.”[7]

This is how a relationship with the artwork is established, demanding our cognitive contribution to the experience, and the extent of that aesthetic illusion significantly depends on our mental interaction. Within the state of ‘aesthetic illusion’, we perceive and encounter the represented world as if it were real.

However, we can question the nature of this world. Is it limited solely to what is represented? How does this illusion intersect with the reality from which we experience? In virtual spaces, what is reality?

At this point, it’s worth highlighting the concept of being “surrounded by at least something or someone,” emphasizing the importance of spatial context. This leads us to reflect on the meaning of spatial perception and the sense of presence within an immersive sonic encounter.

Ancestral Virtualities: The temazcal Ceremony

While the term ‘immersive’ often conjures images of virtual reality devices and digital simulations, the essence of immersion extends far beyond the boundaries of the virtual realm. In fact, some of the most immersive encounters with sound have deep historical roots that transcend the electronic and digital realms.

Let’s immerse ourselves in the ancestral immersive experience of the temazcal ceremony in Mexico.

In the temazcal, spatial perception is everything. The architectural space of the temazcal resembles a small dome-shaped structure made of adobe, often located in a natural setting. The rounded structure symbolizes the womb of Mother Earth and is intentionally small to retain heat during the ritual.

The temazcal holds profound cultural significance in Mexican traditions, rooted in the ancient practices of indigenous civilizations. It’s considered a sacred space to connect with the spiritual realm, purify the body and soul, and honor the elements of nature. The ritual use of heat, steam, herbs, and sound makes this experience a symbolic journey of renewal.

As the heat envelops the bodies, the echoes of chants and rattles grow deeper, transporting participants to an environment where time seems to blur alongside the increasing warmth. The immersive qualities of sound within this enclosed space amplify the transformative nature of the ritual, enhancing the sensory experience by creating an atmosphere that blurs the boundaries between the physical and spiritual realms.

The temazcal is a testament to the profound influence of sound on our perception of space, an ancient precursor to modern immersive audio technologies.

Within its walls of earth, sound becomes a transformative force. The singing of traditional songs, the rhythmic percussion of drums, and the crackling of hot stones conspire to create an immersive experience that transcends time and space. An experience that engages all the senses.

This historical context illustrates how sound has played a fundamental role in shaping our perception of space and creating immersive experiences long before the advent of digital technologies. The temazcal ceremony serves as an archetype for understanding the profound impact of sound on our spatial awareness and its ability to transcend temporal and physical boundaries.

Incorporating these insights into contemporary discussions on immersive audio allows us to appreciate that the power of sound to transform our understanding of space isn’t a recent development. Sound has been interwoven into the tapestry of human culture for centuries, deeply influencing our relationship with the

environments we inhabit. This ancient ceremony reminds us that the roots of immersive audio experiences are deeply embedded in our cultural history and offer valuable perspectives for exploring the role of sound in contemporary immersive technologies.

Moreover, this historical perspective offers an alternative approach to sound narratives and the creation of immersive productions that bring the audience closer and connect them with the physical environment, bridging the gap between the virtual and physical worlds.

Data: the key to the future of immersive audio

The popularity of immersive audio experiences is the result of the convergence of various technologies, including virtual and augmented reality, along with the advancement of increasingly sophisticated algorithms. This, in turn, has led to the creation of high-quality audio equipment.

These advancements encompass not only state-of-the-art sound reproduction but also interactive and personalized audio that responds to user movements and choices; this significantly influences audience attitudes and consumption patterns where dynamic and interactive experiences that can be easily shared are sought after. All of this has accelerated the growth of immersive experiences.

This convergence space concerns us not only as users, viewers, or audience but also as content producers, storytellers.
The evolution of immersive audio experiences spans an increasingly broad horizon, starting from traditional surround sound and binaural technologies to cutting-edge innovations in spatial audio. It goes beyond audio systems and encompasses physical spaces, such as the development of sophisticated domes designed to create fully immersive audiovisual environments.

Furthermore, the adoption of next-generation audio production tools by artists, producers, and engineers has a profound impact on traditional workflows. These tools introduce increasing complexity and precision, and in some cases, even possess decision-making capabilities, automating tasks and significantly accelerating production times.

Just as audiences lose spatial signals of their physical location and immerse themselves in a parallel reality, algorithms seamlessly infiltrate our creative space, reshaping the landscape of production and composition. They transform our sonic works and redefine our relationship with sound, space, and the artistic process.

Simultaneously, a growing demand for consuming immersive experiences calls for a deeper understanding of the user and the space where the experience will be projected. Factors such as the number of speakers, types of headphones, listening moments, preferences, and tastes play a crucial role in tailoring the experience to the user. As consumers, we share a significant amount of data to make our experiences increasingly immersive.

As we delve deeper into the future of immersive sound, it becomes imperative to address complex issues related to access, privacy, and data inclusion. Generating debates about access and data distribution in immersive audio experiences, involving both users and producers, is crucial. Simultaneously, fostering privacy through industry regulations to create a secure and inclusive environment benefits both creators and users.

The future of immersive audio marks the beginning of a paradigm shift that extends far beyond technological innovation. On one hand, it empowers independent creators, granting them access to sophisticated tools that were once exclusive to industry giants. This democratization fosters a diverse narrative landscape, enriching the global storytelling fabric. However, this increased accessibility can also lead to a content overflow, saturating the audience with a plethora of immersive experiences. While this content inundation reflects the positive impact of accessibility, it poses the risk of overwhelming audiences, potentially diluting the quality of engagement and reaching a saturation point where the sheer volume becomes daunting to navigate and interact with effectively.

At the same time, the potential of immersive audio in education and development, especially in countries and sectors outside the first world, signifies a gateway to democratizing knowledge. These technologies offer transformative educational tools, fostering innovation and creativity. However, the pronounced digital divide could hinder widespread access, creating disparities in skill development and impeding the realization of the full potential of these new tools across all sectors of audiovisual production.

In this context, independent and experimental artists play a crucial role in shaping immersive sonic narratives. Their inclination to push boundaries and explore unconventional soundscapes fosters innovation within the field. They challenge established norms and experiment with new technologies and techniques to create unique immersive experiences that transcend boundaries. Their influence fosters diversity, creativity, and the evolution of immersive soundscapes, contributing significantly to the exploration and expansion of narrative possibilities.

Between the physical and virtual space and sound

Recognizing how sound shapes our understanding of space, whether in a digital landscape or sitting in a centuries-old cabin, brings us closer to understanding the profound transformations within the realm of next-generation audio and immersive technologies.
The power of immersive sound intertwines technology, history, and culture, reshaping our perception and interaction with surrounding spaces. It transcends screens and headphones, urging us to explore spatial perceptions and the fundamental role of sound within them.

The future of immersive audio involves not only navigating the search for technological innovation but also understanding the reasons behind our immersion in the vast sea of data, perceptions, and human understanding. Here, art and technology converge to create narratives that not necessarily distance us from the real world but foster a deeper human connection with the environment around us.

Diving deeper into these concepts reveals intricate layers of the essence of sound. It emerges not merely as an auditory experience but as a conduit intertwining historical narratives, cultural meanings, and

technological advancements. Immersive audio becomes a means to capture the evolving perceptual landscape and our immersive engagement with these transformations.

This exploration presents a unique opportunity: a chance to redefine our relationship with both tangible and virtual environments. It paves the way to reimagine our connection with space, uniting our past, present, and future. It opens doors to a profound understanding of how we relate to our surroundings.

References
[1] William Gibson, Pattern recognition (Penguin, 2003),48.
[2] Chisholm, R. H., Trauer, J. M., Curnoe, D., & Tanaka, M. M. (2016). Controlled fire use in early humans might have triggered the evolutionary emergence of tuberculosis. Proceedings of the National Academy of Sciences of the United States of America, 113(32), 9051-9056. https://doi.org/10.1073/pnas.1603224113
[3] Juhani Pallasmaa, Los ojos de la piel : la arquitectura y los sentidos (Gustavo Gili, 2012), 62.
[4] Janet H. Murray, Hamlet on the Holodeck, updated edition: The Future of Narrative in Cyberspace (MIT Press, s. f.).
[5] Real Academia Española, Diccionario de la Lengua Española, 2001.
[6] Paul Roquet, The immersive enclosure: Virtual Reality in Japan (Columbia University Press, 2022), 02.
[7] Werner Wolf, Walter Bernhart, y Andreas Mahler, Immersion and distance.: Aesthetic Illusion in Literature and Other Media. (Rodopi, 2013), 08.

 

Bibliography
Dennis Baxter, Immersive Sound Production: A Practical Guide (CRC Press, 2022).
Karen Collins, Bill Kapralos, y Holly Tessler, The Oxford Handbook of Interactive Audio (Oxford Handbooks, 2014).
Peter H. Diamandis y Steven Kotler, The future is faster than you think: How Converging Technologies Are Transforming Business, Industries, and Our Lives (Simon and Schuster, 2020).
David Dowling, Immersive longform storytelling: Media, Technology, Audience (Routledge, 2019).
Karmen Franinovic y Stefania Serafin, Sonic interaction design (MIT Press, 2013).
Michele Geronazzo y Stefania Serafin, Sonic interactions in virtual environments (Springer Nature, 2022).
Juhani Pallasmaa, Los ojos de la piel : la arquitectura y los sentidos (Gustavo Gili, 2012)
Florian Freitag et al., Immersivity: an interdisciplinary approach to spaces of immersion, Ambiances, 11 de diciembre de 2020, https://doi.org/10.4000/ambiances.3233.
William Gibson, Pattern recognition (Penguin, 2003)
Mark Grimshaw y Tom Alexander Garner, Sonic virtuality: Sound as Emergent Perception (Oxford University Press, USA, 2015).
Janet H. Murray, Hamlet on the Holodeck, updated edition: The Future of Narrative in Cyberspace (MIT Press, s. f.).
Real Academia Española, Diccionario de la Lengua Española, 2001.
Frank Rose, The Art of Immersion: how the digital generation is remaking Hollywood, Madison Avenue, and the way we tell stories (W. W. Norton & Company, 2011).
Paul Roquet, The immersive enclosure: Virtual Reality in Japan (Columbia University Press, 2022)
Paul Roquet, Ambient media: Japanese Atmospheres of Self (U of Minnesota Press, 2016).
Chisholm, R. H., Trauer, J. M., Curnoe, D., & Tanaka, M. M. (2016). Controlled fire use in early humans might have triggered the evolutionary emergence of tuberculosis. Proceedings of the National Academy of Sciences of the United States of America, 113(32), 9051-9056. https://doi.org/10.1073/pnas.1603224113
Werner Wolf, Walter Bernhart, y Andreas Mahler, Immersion and distance.: Aesthetic Illusion in Literature and Other Media. (Rodopi, 2013).

Leave a comment

This website uses cookies to improve your web experience.
English
Explore
Drag