Real-time considerations for a source-time dominant auralization scheme

A well-designed recording system can capture a moving source without risk of distortions, knowledge of the source or path, or transmission of information back to the source (i.e., a smartphone can reasonably record a plane flying overhead). This necessarily happens in real time. It would be good if signal processing schemes for auralization possessed these properties. Recent work on the NoTAP method of auralization proposed an asynchronous sample rate conversion scheme that keeps track of the (nonuniform) rate of incoming samples to formulate an effective incoming sampling frequency. This value allows the method to predict what frequency regions at the receiver are vulnerable to aliasing or imaging artifacts. Strategies of oversampling and filtering can be used to eliminate these problem regions while preserving as much of the original content as possible given the desired receiver sampling frequency. This approach creates a situation where the receiver processing can run independently of the source/path processing making it attractive for real-time implementation. This presentation discusses the challenges associated with producing a truly real-time scheme. A three-way tradeoff emerges between an interpolation mechanism that generates decorrelated noise, the computational burden, and the nearness to absolute real-time with which one wants the scheme to run.