Posts

The Challenges of Testing Voice-Controlled Audio Systems

Smart devices that are voice-controlled such as smart speakers, hearables, and vehicle infotainment systems are notoriously complex to test. They have numerous connections from wired to wireless and contain much signal processing, both on the record and the playback side. This means that their characteristics change according to ‘real world’ conditions of the environment that they are used in, such as background noise, playback levels, and room acoustics. Furthermore, their multifunctional nature means that there are many aspects of the device that may need to be tested, ranging from voice recognition to music playback, operation as a hands-free telephone, and in the case of hearables, hearing assistance. Due to their complex non-linear use cases, these devices often need to be tested at different levels and different environmental conditions. This paper focuses on tools and techniques to accurately measure the audio performance of such devices under the many various real-world conditions in which they are used.

 

语音控制的智能设备(例如智能扬声器、听觉设备和车辆信息娱乐系统)非常难以测试。它们具有从有线到无线的多样连接方式,并且在接收端和重放端使用了诸多信号处理技术。这意味着它们的特性会随着使用环境的“现实世界”条件(例如背景噪声、播放级别和室内声学条件)的不同而变化。 此外,它们的多功能特性意味着可能需要测试该设备的许多方面,包括语音识别、音乐播放、作为免提电话或听觉设备或助听器使用时的性能。由于其复杂的非线性使用情况,这些设备通常需要在不同级别和不同环境条件下进行测试。本文重点介绍在各种实际条件下准确测量此类设备的音频性能的工具和技术。

Author: Steve Temme, Listen, Inc.
Presented at ISEAT 2019, Shenzhen, China.

Full Paper – English Version
Full Paper – Chinese Version

ISEAT- Shenzhen, China – Nov 9-10, 2019

We will be participating in China’s leading electroacoustics event, ISEAT on November 9-10 with our exclusive China distributor, S&V Samford.

Steve Temme will be presenting a paper on ‘The Challenges of Testing Voice Controlled Audio Systems’. In this paper, he highlights the common factors in testing smart speakers, hearables, and automotive infotainment systems, such as open loop testing, measuring speech recognition, and testing in the presence of background noise, and explains how to correctly measure such devices.

On display will be our SoundCheck audio test system and associated hardware for testing a range of audio devices including smart speakers, headphones & smart hearables, automotive audio, microspeakers, microphones, smartphones, tablets and more.

 

Paper Abstract:

Smart devices that are voice-controlled such as smart speakers, hearables vehicle infotainment systems are notoriously complex to test. They have numerous connections from wired to wireless and contain much signal processing, both on the record and on the playback side. This means that their characteristics change according to ‘real world’ conditions of the environment that they are used in, such as background noise, playback levels, and room acoustics. Furthermore, their multifunctional nature means that there are many aspects of the device that may need to be tested, ranging from voice recognition to music playback and operation as a hands-free telephone, and in the case of hearables, hearing assistance. Due to their complex non-linear use cases, these devices often need to be tested at different levels and different environmental conditions. This paper focuses on tools and techniques to accurately measure the audio performance of such devices under the many various real-world conditions they are used in.

ISEAT web site

ISEAT- Shenzhen, China – Nov 4-5, 2017

iseat_logoWe will be exhibiting at ISEAT in Shenzhen on Nov 4-5, 2107. On display will be our SoundCheck audio test system and associated hardware for testing a range of audio devices including speakers, microspeakers, headphones, microphones, smartphones, tablets and more.

Listen president, Steve Temme, will also be presenting a technical paper written with Viktor Dobos of Harman Automotive on production line loudspeaker measurements. In this paper, he addresses the different measurements that can be made at the end of a production line, and which ones offer comprehensive product QC while maintaining high speed and throughput.

ISEAT web site