Registration required

The content you have requested is available only to registered visitors. Please complete the short form below (all fields are required).

  • 简体中文 简体中文 Chinese (Simplified) zh-hans
  • English English English en
Listen, Inc.
  • Products
    • AUDIO MEASUREMENT
    • System Overview
      • What Soundcheck Measures
      • SoundCheck for R&D
      • SoundCheck for Production
      • Innovation
    • SoundCheck Software
      • Making Measurements
      • Algorithm Highlights
      • Integration
      • What’s New?
      • Packages, Modules & Pricing
      • Support Contracts
    • Audio Measurement Interfaces
      • AudioConnect 2 (2 channel))
      • AmpConnect 621 (6/2 channels)
      • AudioConnect 8×8 (8 channel)
      • AudioConnect 6×2 (6/2 channel)
      • AmpConnect ISC (2 channel)
      • 3rd Party Audio Interfaces
    • Audio Testing Hardware
      • Microphones & Amplifiers
        • Measurement Microphones
        • Microphone Power
        • Audio Test Amplifier
      • Specialist Test Interfaces
        • Bluetooth Audio Measurement Interfaces
        • MEMS microphone Interfaces
        • DC Connect
      • Audio Test Accessories
        • Turntables
        • Halo Automotive 6-Mic Array
        • Automotive Audio Test Kit
        • The SCC-1 Ear Coupler
        • Other Measurement Transducers
        • Impedance Box
        • Calibrators
    • NOISE & VIBRATION MEASUREMENT
    • System Overview
    • NoiseCheck Software
    • Noise & Vibration Interfaces
    • Noise and Vibration Testing Hardware
  • Applications
    • Headphones & Headsets
    • Loudspeakers & Microspeakers
    • Microphones
    • Automotive
    • Communications
    • Smart Devices
    • Hearing Aids
    • Audio Electronics
  • Support
    • Get Support
    • User Documentation
    • Knowledgebase
    • Training
    • Sequences & Resources
    • Drivers
    • Register Product
    • Report a Bug / Request a Feature
  • Resources
    • ‘Sound Matters’ Blog: Audio Measurement Expertise
    • Test Sequences
    • Article Reprints
    • Published Papers
    • Technical Notes
    • Measurement Services
    • Useful References
  • News & Events
    • News
    • Events
  • About Listen
    • Listen, Inc.
    • Contact
    • Distributors & Reps
    • Careers
    • Privacy Policy
  • Menu Menu

Practical Testing of Voice Controlled Devices

January 13, 2020/in Article Reprints, Smart Device Article Reprints/by Zarina

This article discusses tools and techniques that are available to accurately measure the audio performance of voice controlled devices under the many various real-world conditions they may be used. It covers basic acoustic measurements such as frequency and distortion response, which have always been carried out on conventional wired systems, and the more complex real-world tests that apply specifically to voice-activated devices, along with the techniques and standards that may be used.

Author: Steve Temme. Reprinted from the Jan 2020 issue of AudioXpress.

Full Article

Voice Controlled Devices – Audio Testing and Key Considerations

This briefing document reviews key themes and important takeaways from the provided excerpts of “Practical Testing of Voice-Controlled Audio Devices” (ax, January 2020). The document focuses on the complexities of testing voice-controlled audio devices, including smart speakers, hearables, and automotive infotainment systems, and highlights relevant industry standards and test system recommendations.

Main Themes:

  1. Complexity of Testing: Unlike traditional audio devices, voice-controlled devices present unique testing challenges due to:
    • Diverse interfaces (Bluetooth, cloud, voice assistants)
    • Extensive signal processing (beamforming, noise cancellation)
    • Multifunctional nature (voice recognition, music playback, communication)
    • Real-world condition dependence (background noise, playback levels)
  2. Importance of Real-World Testing: The article emphasizes the need to test devices under various real-world conditions. Factors like background noise, playback levels, and user interaction significantly impact performance and should be considered during testing.
  3. Leveraging Existing Standards: While specific standards for smart device testing are limited, the article recommends adopting guidelines from similar devices like speakers, headphones, hearing aids, and telephones (IEC, EN, IEEE, TIA, ITU, ANSI, ETSI).
  4. Open-Loop Measurement Challenges: Open-loop systems, characteristic of smart devices, lack a synchronous signal path, leading to sampling rate errors. The article explains how algorithms utilizing triggers and heterodyne filtering correct these errors for accurate analysis.
  5. Cloud-Based Measurement Complexities: Testing involves interacting with devices like a real user, utilizing cloud services for playback and recording. The article describes the setup and intricacies of testing via the cloud, including voice commands, signal routing, and manufacturer-specific ecosystems.

Important Ideas/Facts:

  • Basic Acoustic Tests: Essential for measuring frequency response, distortion, and stereo tracking in both wired and wireless modes. Requires calibrated equipment like mouth simulators, measurement microphones, and ear simulators (HATS recommended for hearables and infotainment systems).
  • Open-Loop Measurements: A technique to correct sampling rate errors inherent in open-loop systems. The article details the process of using trigger signals, heterodyne filtering, and resampling for accurate frequency and distortion analysis.
  • Measurements via the Cloud: This involves using voice commands, proprietary voice services, and cloud platforms for signal injection and extraction. The article explains the setup and challenges of testing various smart device functionalities through the cloud.
  • Nonlinear Behavior: The performance of smart devices varies based on factors like background noise type and volume, music playback, and voice communication. The article highlights the need to account for this nonlinearity during testing.
  • Speech Recognition Testing: Evaluating the accuracy of voice command understanding is crucial. The article recommends using “Harvard Sentences,” a phonetically balanced sentence set, as track titles for testing different voices, accents, and background noise conditions.
  • Background Noise Simulation: Crucial for testing voice recognition, SNR optimization, and beamforming. The article recommends using ETSI standard ES 202 396-1, which provides binaural recordings of various noise environments, to create realistic test scenarios.
  • Voice Quality Evaluation: For devices functioning as hands-free communication tools, the article suggests using telephone test sequences like TIA standard TIA920, which covers both hands-free and headset devices.
  • Noise Cancellation Assessment: Especially relevant for hearables and infotainment systems. The article outlines the procedure for measuring passive isolation, active attenuation, and total attenuation using a calibrated background noise system.
  • Hearing Assistance Measurement: For hearables with hearing enhancement features, the article recommends testing amplification and compression algorithms according to ANSI/IEC hearing aid standards using anechoic test boxes and artificial ears.

Test System Recommendations:

The article concludes with a checklist of functionalities to consider when selecting a test system for voice-controlled audio devices:

  • Input and output component testing
  • Open-loop testing capabilities
  • Speech and music signal support
  • Background noise generation
  • Cloud signal routing (virtual audio cable)
  • Pre-written test sequences (TIA)
  • Flexible test programming
  • Calibrated Bluetooth interface
  • Automotive bus compatibility (e.g., A2B)

By understanding the complexities and utilizing appropriate testing methodologies, manufacturers can ensure optimal audio performance and user experience in voice-controlled audio devices.

Full Article

Share
  • Share on Facebook
  • Share on Twitter
  • Share on WhatsApp
  • Share on LinkedIn
  • Share by Mail
https://www.listeninc.com/wp/media/2020/01/Practical_testing_of_voice_controlled_devices_AX-January-2020_Page_01-scaled.png 2560 1678 Zarina https://www.listeninc.com/wp/media/logo.png Zarina2020-01-13 16:58:262025-09-04 16:35:50Practical Testing of Voice Controlled Devices

Audio Measurement Expertise


How Changing Industry Needs are Shaping Audio Test and Measurement

Smarter SoundCheck Sequences with Loops and Logic

Audio Basics: Polarity

How to Measure: Haptics

The Value of Big Data

Audio Basics: Phase Response

view all

Latest News


2026 End Of Year Promotions

Celebrating 30 years: Listening – The Secret Of Our Success

Automotive Test Sequence Including BSR, Max SPL and Frequency Response

Listen Introduces AudioConnect 2, a New Portable Dual-Channel Audio Interface

SoundCheck 21 Brings Enhanced Loose Particle Detection, Multichannel FFT, Metadata, Sequence Protection and more


Audio Measurement Expertise – Delivered Monthly

 

ABOUT LISTEN INC

Listen is a global leader in audio measurement and analysis, with over 30 years’ experience developing innovative test methods and algorithms. SoundCheck, our powerful software-based audio analyzer, pairs with our test interfaces, precision microphones, and accessories to offer a complete solution for testing loudspeakers, headphones, microphones, smart devices, communication systems, hearing aids, automotive audio, and more. Trusted by engineers worldwide, Listen delivers the accuracy and flexibility essential for modern audio testing, from the R&D lab to the production line.

PRODUCTS
APPLICATIONS
SUPPORT
RESOURCES
NEWS & EVENTS
ABOUT

CONNECT

YouTube
LinkedIn
LinkedIn
Share
Instagram

Copyright © Listen, Inc.   |   Privacy Policy   |   AI Disclosure
  • Instagram
  • LinkedIn
  • Youtube
  • Mail
The Challenges of Testing Voice-Controlled Audio SystemsExternal Control of SoundCheck via TCP/IP
Scroll to top