The University of Southampton

Project: Creating Augmented Reality Soundscape Experiences on Edge Devices

Key information:

Student Mark Saunders
Academic Supervisors Jennifer Williams, Sebastian Stein, Steve Gunn, Shuo Zhang (External Supervisor)
Cohort  4
Pure Link  Active Project

Abstract: 

Augmented reality involves technology that aims to blend digital information into the real, physical world. A soundscape is a multi-disciplinary concept that is more than our acoustic environment.  It encompasses a complex interplay of auditory sensations, interpretations of these sensations, and emotional or behavioural responses. The project aims to use edge devices, like smart phones, to identify and enhance sounds that purposefully contribute to a person’s aural experience or well-being. 

By way of example, imaging trying to hear a friend in a busy cafe where there are lots of competing sounds and distractions and instead of reducing or eliminating all sounds, you can choose which sounds you want to focus on and not hear the others.

 This project will involve identifying sounds from audio scenes and developing methods that can amplify target sounds while also minimising non-target sounds under the constraint of low computational resources.