Unlocking Advanced Audio Processing: Leveraging HiFi DSP and SOF on the MediaTek Genio Platform

Opening: The Audio Challenge in Modern IoT Applications

With the rapid advancement of technology, audio capabilities are moving from luxury to necessity in IoT devices. From voice assistants to smart home systems, clear and responsive audio processing is crucial for the user experience. Yet, as applications demand features like always-on voice wakeup and accurate speech-to-text, the challenges of processing complex audio streams on resource-constrained devices continue to grow. This is where specialized solutions like Audio Digital Signal Processors (ADSP) and the open-source Sound Open Firmware (SOF) framework come into play, enabling the next generation of smart audio applications.  

ADSP and SOF: A Brief Introduction

Audio Digital Signal Processors (ADSP) 

An ADSP is a dedicated hardware core optimized for audio-specific computations. Unlike general-purpose CPUs, an ADSP can efficiently handle tasks like filtering, noise suppression, and acoustic echo cancellation, all while consuming minimal power. 

Sound Open Firmware (SOF) 

SOF is an open-source project that delivers a flexible and modular firmware framework for audio DSPs. SOF abstracts the complexity of DSP hardware, enabling easier and more portable development across different platforms. SOF provides infrastructure, real-time control components, audio drivers, and aims to democratize audio processing firmware and its development within the community. 

Genio Platform: HiFi DSP & SOF support 

MediaTek’s Genio Platforms provides support for an ADSP. The Genio 1200 and Genio 350 are equipped with a Cadence® Tensilica® HiFi 4 DSP, while the Genio 700 and Genio 510 are equipped with a Cadence® Tensilica® HiFi 5 DSP. 

Below are the supported platforms and ADSP specification: 

The SOF drivers have been fully integrated into the aforementioned Genio platforms with ADSP support, ensuring seamless compatibility with Linux subsystems such as ALSA (Advanced Linux Sound Architecture). For SOF firmware, MediaTek provides pre-built firmware binaries and corresponding topology files, allowing developers to validate basic functions out-of-the-box. Additionally, comprehensive documentation is available to guide developers through the process of customizing, extending, and building SOF firmware tailored to specific requirements. 

ADSP interconnection 

Application Scenarios

ADSP technologies have already enabled a wide range of innovative audio solutions in modern smart devices. Here are several common application cases: 

• Voice Wakeup 
  Voice wakeup allows devices to remain in a low-power state until the specific keywords or wake phrases ("Hey, Google", "Alexa") are detected. This allows hands-free use of smart speakers, IoT devices, and voice assistants, improving convenience while preserving battery life. 
• Voice Recognition 
  ADSP plays a crucial role in processing and interpreting complex speech and patterns. In voice recognition applications, ADSP is used to process and analyze voice input in real-time. It helps filter out background noise, enhance speech quality, and extract important features from the audio signal. 
• Speech to Text 
  Converting speech to text needs advanced signal analysis and noise filtering, which DSPs handle efficiently. This capability is widely adopted in voice note applications and real-time transcription services. 
• Acoustic Echo Cancelling 
  Echoes can severely impact the quality of voice calls and conferences. ADSP-based echo cancellation eliminates audio feedback, ensuring clear calls even in echo-prone environments. This technology is crucial for teleconferencing and hands-free car systems. 
• Automatic Noise Suppression 
  This feature reduces background noise and filters out ambient sounds, so only your voice comes through clearly. Automatic Noise Suppression is essential for mobile phones and wearable devices used in noisy environments. 

Conclusion

MediaTek Genio platforms support Audio DSP and SOF, unlocking new opportunities for advanced audio processing in IoT and smart devices. By leveraging HiFi DSPs across Genio SoCs and the flexible software framework, developers can build feature-rich audio solutions. 

Learn More

For hands-on experience and details about ADSP and SOF with Genio Platforms, please visit: 

• Audio DSP User Guide 
• SOF Porting Guide