Low-Order Spherical Harmonic HRTF Restoration Using a Neural Network Approach
1
AudioLab, Communications Technologies Research Group, Department of Electronic Engineering, University of York, York YO10 5DD, UK
2
Computer Vision and Pattern Recognition (CVPR) Research Group in the Department of Computer Science, University of York, York YO10 5GH, UK
*
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(17), 5764; https://doi.org/10.3390/app10175764
Received: 8 July 2020 / Revised: 12 August 2020 / Accepted: 15 August 2020 / Published: 20 August 2020
(This article belongs to the Special Issue Deep Learning for Applications in Acoustics: Modeling, Synthesis, and Listening)
Spherical harmonic (SH) interpolation is a commonly used method to spatially up-sample sparse head related transfer function (HRTF) datasets to denser HRTF datasets. However, depending on the number of sparse HRTF measurements and SH order, this process can introduce distortions into high frequency representations of the HRTFs. This paper investigates whether it is possible to restore some of the distorted high frequency HRTF components using machine learning algorithms. A combination of convolutional auto-encoder (CAE) and denoising auto-encoder (DAE) models is proposed to restore the high frequency distortion in SH-interpolated HRTFs. Results were evaluated using both perceptual spectral difference (PSD) and localisation prediction models, both of which demonstrated significant improvement after the restoration process.
View Full-Text
Keywords:
deep learning; head related transfer function (HRTF); restoration; ambisonics; spatial audio; spherical harmonic; audio signal processing; denoising; auto-encoder; neural network
▼
Show Figures
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited
MDPI and ACS Style
Tsui, B.; Smith, W.A.P.; Kearney, G. Low-Order Spherical Harmonic HRTF Restoration Using a Neural Network Approach. Appl. Sci. 2020, 10, 5764. https://doi.org/10.3390/app10175764
AMA Style
Tsui B, Smith WAP, Kearney G. Low-Order Spherical Harmonic HRTF Restoration Using a Neural Network Approach. Applied Sciences. 2020; 10(17):5764. https://doi.org/10.3390/app10175764
Chicago/Turabian StyleTsui, Benjamin; Smith, William A.P.; Kearney, Gavin. 2020. "Low-Order Spherical Harmonic HRTF Restoration Using a Neural Network Approach" Appl. Sci. 10, no. 17: 5764. https://doi.org/10.3390/app10175764
Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.
Search more from Scilit