WO2021010884A1 - Plate-forme de commande audio intelligente - Google Patents

Plate-forme de commande audio intelligente Download PDF

Info

Publication number
WO2021010884A1
WO2021010884A1 PCT/SE2020/050714 SE2020050714W WO2021010884A1 WO 2021010884 A1 WO2021010884 A1 WO 2021010884A1 SE 2020050714 W SE2020050714 W SE 2020050714W WO 2021010884 A1 WO2021010884 A1 WO 2021010884A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
control platform
room
audio control
measurements
Prior art date
Application number
PCT/SE2020/050714
Other languages
English (en)
Inventor
Armin Prommersberger
Original Assignee
Dirac Research Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dirac Research Ab filed Critical Dirac Research Ab
Publication of WO2021010884A1 publication Critical patent/WO2021010884A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2227/00—Details of public address [PA] systems covered by H04R27/00 but not provided for in any of its subgroups
    • H04R2227/007—Electronic adaptation of audio signals to reverberation of the listening space for PA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/04—Circuits for transducers, loudspeakers or microphones for correcting frequency response

Definitions

  • the invention generally relates to audio and/or video technologies, and more specifically concerns an audio control platform or system for analyzing and/or optimizing audio devices/systems including considering, analyzing and/or optimizing room acoustics, and/or providing technical recommendations for system optimization.
  • the invention concerns a method and system for measuring, analyzing and/or compensating for impact of room acoustics to perceived quality of an audio system, and may involve a backend server solution for interacting with one or more edge audio devices.
  • the proposed technology also relates to corresponding computer programs and computer-program products.
  • FIG. 1 is a schematic representation illustrating an example of a conference audio/video system located in a conference room with a number of participants. The inventor has realized that the underlying problem is dependent on the rooms and their acoustic properties that dominate capturing and playback performance, and/or in combination with the location of the audio capturing and playback devices in the room in relation to the user(s).
  • the same may also apply to other locations such as homes, cars and other types audio listening/capturing environments.
  • Another objective is to provide a corresponding computer program and computer- program product.
  • an audio control platform for analyzing and/or optimizing an audio device/system.
  • the audio control platform is configured to receive, from at least one audio device and/or audio system connected to the audio control platform, audio measurements made within an audio listening/capturing environment.
  • the audio control platform is further configured to perform audio system identification for said at least one audio device and/or audio system and the associated audio listening/capturing environment based on the audio measurements including analyzing room acoustics of the audio listening/capturing environment.
  • the audio control platform is also configured to enable compensation for the impact of room acoustics and/or providing technical recommendations for i) audio system optimization/changes and/or ii) room acoustic treatment, based on the audio system identification and/or the audio measurements.
  • a method for measuring, analyzing and/or compensating for impact of room acoustics to perceived quality of an audio system comprises:
  • a system for measuring, analyzing and/or compensating for impact of room acoustics to perceived quality of an audio system wherein the system for measuring, analyzing and/or compensating for impact of room acoustics is configured to perform the method of the second aspect.
  • a computer program for analyzing and/or optimizing audio devices/systems, when executed by a processor.
  • the computer program comprises instructions, which when executed by the processor, cause the processor to:
  • a computer-program product comprising a non-transitory computer-readable medium having stored thereon such a computer program.
  • an audio device and/or audio system for sound reproduction.
  • the audio device and/or audio system is configured to perform audio measurements within an audio listening/capturing environment.
  • the audio device and/or audio system is further configured to send data representative of said audio measurements to an audio control platform for analysis to thereby enable audio system identification for the audio device and/or audio system and the associated audio listening/capturing environment including analyzing room acoustics of the audio listening/capturing environment.
  • the audio device and/or audio system is also configured to receive control data, generated by the audio control platform based on the audio system identification and/or the audio measurements, from the audio control platform for enabling compensation for the impact of room acoustics and/or obtaining technical recommendations for i) audio system optimization/changes and/or ii) room acoustic treatment.
  • an audio control platform adapted to perform one or more of the following technical functions and/or procedures: initiating and/or performing audio system identification and/or measurements, • analyzing audio measurements and providing summarized measurement results,
  • the proposed technology provides an audio control platform or a sub-system thereof for audio system identification, where system identification data for an audio system and the associated room/environment may be collected and stored, preferably together with related successful and/or unsuccessful improvement measures.
  • system identification and/or measurements may be performed in an automated and/or semi-automated manner.
  • the proposed technology provides an audio control platform or a sub-system thereof for room comparison from an audio perspective, e.g. where i) rooms in the same facility are compared to each other, ii) audio representations of the same room at different occasions are compared (historical data), and/or iii) a given room is compared to a (global) database of rooms.
  • the proposed technology provides an audio control platform or a sub-system thereof for providing technical recommendations for system optimization based on audio measurement results.
  • the proposed technology may be recommending room acoustic treatment and/or changes or double-check of the system set-up.
  • the audio control platform may be adapted for operation based on an at least partly interactive procedure with the user/operator of the audio device/system.
  • the terms“room”,“room acoustics” and “room acoustic treatment” are not limited to conference rooms or rooms in an apartment or house but may e.g. be related to a confined space of a car or any other definable audio listening/capturing environment.
  • the proposed technology relates to audio devices and/or systems in consumer or professional applications that are used to play back and/or capture audio events in a room.
  • the invention is targeted to improve the perceived quality like intelligibility during conference calls.
  • the proposed technology may provide improvements for the targeted audio devices/systems based on system optimizations/changes and/or technical recommendations for such system optimizations/changes.
  • the audio control platform may be considered as a backend server solution, that is configured for interaction with one or more edge devices used for audio capturing and/or playback.
  • the audio control platform may thus be interconnected to the edge devices via cables (if located on premise), and/or via one or more communication networks, including wireless and/or wired networks.
  • the proposed technology may employ machine learning techniques such as supervised learning, unsupervised learning, reinforcement learning and so forth for identifying and providing relevant system optimizations/changes and/or recommendations for such system optimizations/changes.
  • the invention provides an intelligent audio control platform for conference systems, but the invention is not limited thereto, and may be used with many other audio devices/systems.
  • FIG. 1 is a schematic representation illustrating an example of a modern conference audio/video system located in a conference room with a number of participants.
  • FIG. 2A is a schematic diagram illustrating an example of an audio control platform interacting with one or more edge devices deployed in a room used for audio capturing and/or playback.
  • FIG. 2B is a schematic diagram illustrating an example of an audio control platform communicating with one or more edge devices via intermediate cloud(s).
  • FIG. 3 is a schematic diagram illustrating an example of a measurement setting and/or measurement results.
  • FIG. 4 is a schematic diagram illustrating an example of a user-adjustable response target, alongside an ideal impulse response, uncorrected real impulse response and a corrected impulse response.
  • FIG. 5 is a schematic diagram illustrating an example of a technical audio quality review as presented to a user or operator.
  • FIG. 6 is a schematic diagram illustrating an example of a physical design for room acoustic treatment.
  • FIG. 7 is a schematic diagram illustrating an example of a computer-implementation according to an embodiment.
  • FIG. 8 is a schematic flow diagram illustrating an example of a method for measuring, analyzing and/or compensating for impact of room acoustics to perceived quality of an audio system according to an embodiment. DETAILED DESCRIPTION
  • the proposed technology relates to an audio control platform or corresponding system for analyzing and/or optimizing audio devices/systems including considering, analyzing and/or compensating for the impact of room acoustics by the means of advanced signal processing, and/or providing technical recommendations for system optimization and/or room acoustic treatment.
  • the invention provides a method and system for measuring, analyzing and/or compensating for impact of room acoustics to perceived quality of an audio system, and may involve a backend server solution interacting with one or more edge audio devices/systems.
  • Such audio devices and/or systems in consumer or professional applications may be used to play back and/or capture audio events in a room.
  • the invention may be targeted to improve the perceived quality like intelligibility during conference calls and the like.
  • an audio control platform 100; 300 for analyzing and/or optimizing an audio device/system 200.
  • the audio control platform 100; 300 is configured to receive, from at least one audio device and/or audio system 200 connected to the audio control platform, audio measurements made within an audio listening/capturing environment.
  • the audio control platform 100; 300 is further configured to perform audio system identification for said at least one audio device and/or audio system and the associated audio listening/capturing environment based on the audio measurements including analyzing room acoustics of the audio listening/capturing environment.
  • the audio control platform 100; 300 is also configured to enable compensation for the impact of room acoustics and/or providing technical recommendations for i) audio system optimization/changes and/or ii) room acoustic treatment, based on the audio system identification and/or the audio measurements.
  • the audio control platform 100; 300 may be a remote audio control platform connected to at least one edge audio device/system.
  • the audio control platform 100; 300 may include a backend server solution interacting with at least one edge audio device/system.
  • the at least one edge audio device/system 200 may include one or more hardware audio devices connected via an IP-based signal path to the backend server solution.
  • the audio control platform 100; 300 as part of a backend server solution may for example be implemented as a cloud architecture of services.
  • the at least one edge audio device/system 200 may incorporate integrated audio features, and the backend server solution may be configured to control said integrated audio features in real-time or via updates of one or more audio filter sets of said at least one edge audio device/system.
  • the audio control platform 100; 300 may be configured to receive a microphone recording signal of a known audio file from said at least one edge audio device/system, which has gone through a certification process, and perform an analysis based on the microphone recording signal and an expected microphone signal assuming knowledge of said known audio file and expected behavior of said at least one edge audio device/system according to a certification process.
  • the audio control platform 100; 300 may be configured to provide educated guesses regarding how the audio listening/capturing environment looks like, and interactively request confirmation of those educated guesses, to enable the audio control platform to work its way through to a final proposal for system changes and/or room acoustic treatment.
  • the audio control platform 100; 300 may be configured to build a database of system identification data like room acoustic properties, target and device related transfer functions or distortion patterns and/or related successful and unsuccessful improvement measures.
  • the audio control platform 100; 300 may be configured to analyze the measurement data in regard to audio quality such as:
  • the audio control platform 100; 300 may be configured to perform room comparison, where i) rooms in the same facility or belonging to the same company are compared to each other, ii) audio representations of the same room at different occasions are compared, also referred to as historical data, and/or iii) a given room is compared to a global or local database of rooms.
  • the audio control platform 100; 300 may be configured to provide information enabling an understanding of how a given room compares or rates against other rooms in a given facility or in a company.
  • the audio control platform 100; 300 may be configured to enable an understanding of whether a given room has improved due to certain changes of the audio system and/or the room, stayed the same or deteriorated over time.
  • the audio control platform 100; 300 may be configured to provide anonymized comparison of a given room versus a database that includes data related to a set of rooms, wherein said database is associated with said audio control platform.
  • the database of rooms includes data representing room acoustic properties and/or room identification data related to each of a multitude of different rooms.
  • the audio control platform 100; 300 may be configured to perform analysis and computations, based on said audio system identification and said audio measurements, for optimizing the system performance by applying features to the playback path of said at least one audio device/system.
  • the audio control platform 100; 300 may be configured for updating audio filter parameters by transferring new updated filter coefficients for implementation into one or more audio filters in said at least one audio device/system.
  • the audio control platform 100; 300 may be implemented on premise as a computer-based audio control system.
  • the audio device/system 200 may be a conference system, a home audio system, car audio system, or cinema audio system.
  • the audio control platform 100; 300 may be adapted for an audio conference system.
  • the audio device/system 200 may include any consumer or professional audio device including a communication soundbar, video device, stand-alone audio processor for install, soundbar for TV, stereo setup and audio/video receiver, headphone, smartphone and/or mobile device.
  • the audio control platform 100; 300 may be adapted for operation based on an at least partly interactive procedure with a user/operator of the audio device/system.
  • the audio control platform may comprise at least one processor configured to perform the operations of the audio control platform.
  • the audio control platform may include one or more processors and memory comprising instructions, which, when executed by the processor(s) cause the audio control platform to operate as described herein.
  • the proposed technology may, if desirable, provide improvements for the targeted audio devices/systems based on system optimizations/changes and/or technical recommendations for such system optimizations/changes.
  • improvements for the targeted audio devices/systems based on system optimizations/changes and/or technical recommendations for such system optimizations/changes.
  • various aspects of the proposed technology will be illustrated with reference to non-limiting examples.
  • FIG. 2A is a schematic diagram illustrating an example of an audio control platform 100 interacting with one or more audio (edge) devices 200 used for audio capturing and/or playback.
  • the backend service (executed on or off premise) is communicating more or less directly with the audio (edge) device(s) 200.
  • FIG. 2B is a schematic diagram illustrating an example of an audio control platform 100 communicating with one or more audio (edge) devices 200 via a cloud-to-cloud connection. This might be relevant if the audio (edge) devices 200 are administered through a specialized cloud service.
  • the audio control platform 100 may be considered as a backend server solution, that is configured for interaction with one or more audio (edge) devices 200 used for audio capturing and/or playback.
  • the physical hardware hosting the audio control platform 100 may thus be interconnected to the (edge) devices via cables (if located on premise), and/or one or more communication networks, including wireless and/or wired networks. While IP based communication layers will be the dominant application setup, the audio control platform could as well communicate with the edge device via other topologies/technologies like USB or Firewire.
  • the backend server solution may include one or more computer-based servers, and possibly associated databases. It is also possible for the backend server solution to be running in a data center as a cloud-based service.
  • a backend software solution i.e. software running microservices on a general purpose server on or off premise
  • a number n > 1 of edge devices i.e. devices used for audio capture and playback in a room connected to the backend
  • edge devices i.e. devices used for audio capture and playback in a room connected to the backend
  • transfer this measurement to the backend where it is received and analyzed, and based on the drawn conclusions either directly compensate the system to achieve a better perceived experience or provide guidance to the user via a dashboard how to improve the acoustic environment of the edge device to meet certain criteria like intelligibility.
  • the platform or system may use a combination of state-of-the- art signal processing methods, possibly combined with targeted machine learning methods to continuously improve its effectiveness.
  • the system may build a database of system identification data like room acoustic properties, target and device related transfer functions or distortion patterns and the related successful and unsuccessful improvement measures.
  • the system may compute an easy to understand quality index and/or allow the user to compare all the rooms that he is administering that employ the use of this system.
  • the edge devices are typically hardware audio devices connected via an (IP-based) signal path to the backend service.
  • the edge device may incorporate a varying amount of integrated audio features that the backend service can control in real-time or via updates of e.g. audio filter sets.
  • These devices should preferably go through a certification process.
  • An example could be a conferencing sound bar or other audio system with or without video capabilities, where the loudspeakers, microphones may be used for audio measurements and internet connectivity may act as the transport layer.
  • the audio devices and/or systems may include any consumer or professional audio devices including communication soundbars and video devices, stand-alone audio processors for install, soundbars for TV, stereo setups and audio/video receivers, headphones, smartphones and/or mobile devices.
  • the edge device is normally the physical device in the user’s environment. By way of example, it may have connectivity capabilities, either directly via WiFi, LAN or 3G/4G/5G, or tethered via Bluetooth or by other means to a device that offers Internet access (smartphones, routers,..).
  • the edge device from a platform perspective resembles a known combination of sensors (e.g. microphones, cameras, ... ) and/or audio playback hardware (e.g.
  • the audio control platform as part of a backend server solution may be implemented as a cloud architecture of services, i.e. a general purpose server hardware in some data center that runs audio control platform software in a way that it can be configured to the needs of the use case with the compliant latency.
  • This cloud instantiation can talk to edge devices directly or to other cloud services/devices.
  • the audio control platform is implemented on premise, i.e. close to the audio device/system, e.g. as a computer-based audio control system.
  • the following communication links may be relevant:
  • MICROPHONE UPLINK Used for identification of presence and as measurement sensor during room acoustics/system identification.
  • PLAYBACK DOWNLINK Used to play back stimuli for room acoustics/system identification and user notification.
  • CONTROL DATA LINK Used to send and receive status, device control and additional sensor data and to send updated audio compensation filters.
  • the backend audio control platform may be based on one or more computer servers, and possibly associated databases.
  • the functionality of the audio control platform may include one or more of the following:
  • DATA REPOSITORY 1 to n for specific context (RIR, Stimuli, User data, Device data, and so forth).
  • DASHBOARD 1 to n user/use-case specific context.
  • DECISION ENGINE fed from and feeding into DATA REPOSITORIES and DASHBOARDS.
  • DSP ENGINE for UPLINK Signal Analysis, DOWNLINK Stimulus
  • Processing/Playback and audio compensation filter computation fed from and feeding into DATA REPOSITORIES and DASHBOARDS, yet optionally also directly from audio UPLINK and DOWNLINK.
  • certain control, processing and/or data storage may be performed by third party cloud-services.
  • System identification data for an audio system and the associated room/environment may be collected and stored in a database associated with the audio control platform.
  • system identification is typically meant capturing and/or collecting information about the system, including here also audio/sound measurement results.
  • the edge device(s) can be used as sensors for the system identification.
  • An edge device such as a conference sound bar may register itself edge-to-platform or cloud-to-platform.
  • the audio control platform such as a backend server based platform, may be configured to identify, e.g. via predefined schedule, provided edge device status and potentially occupancy sensors available in the room, those periods in time when the device(s) and the room are not in use, or this may be triggered by installer/admin on device/control backend/app.
  • the audio control platform may be configured to set the edge device(s) into active mode and set relevant parameters like volume, audio mode and so forth.
  • the audio control platform may then send measurement stimulus and pull the microphone data from the edge device(s).
  • the microphone of any of the edge devices may be used as an audio/sound sensor to provide measurement data, which may be transferred from the edge device to the backend audio control platform.
  • the audio control platform may be configured to analyze the measurement data in regard to audio quality such as:
  • the system may use any well-accepted standard technology for audio analysis, including analysis of the performance of the audio device/system and/or the room acoustics. It is possible to stream an audio signal directly through the edge device (like streaming music) to provide the stimulus for the measurements. Alternatively, an audio file can be sent as a whole to the edge and the edge device then uses a built- in local player to decode and play back the file, or it would be possible to trigger the playback of a locally stored or created audio file.
  • the system identification can be performed in an automated and/or semi-automated manner, or even triggered manually.
  • the system identification procedure may be triggered on demand, e.g. triggered from the edge device (using a hardware button) or via device management software or a local dashboard for the audio control platform. After installation, this process may run automatically in the background, and/or on-demand if necessary.
  • the system may preferably detect by itself when the room is not occupied/used and initiate system identification and the relevant measurements. For example, any of the following inputs can be used:
  • FIG. 3 is a schematic diagram illustrating an example of a measurement setting and/or measurement results.
  • FIG. 4 is a schematic diagram illustrating an example of a user-adjustable response target, alongside an ideal impulse response, uncorrected real impulse response and a corrected impulse response.
  • the audio control platform may optionally be configured to provide feedback of technical data and analysis results. This may for example involve a quality score, a summary of measurement results and/or a graphical representation of one or more measurements, as schematically indicated in FIG. 5.
  • the audio control platform may also optionally be configured to perform so-called room comparison, where i) rooms in the same facility or belonging to the same company are compared to each other, ii) audio representations of the same room at different occasions are compared (historical data), and/or iii) a given room is compared to a (global or local) database of rooms.
  • the database of rooms may include, e.g. data representing room acoustic properties and/or room identification data related to each of a multitude of different rooms.
  • the database may continuously grow as more rooms are successively added to the database, and the database may also be used as training data for machine learning purposes.
  • the audio control platform may be configured to provide improvements for the targeted audio devices/systems based on system optimizations/changes.
  • the backend audio control platform may perform suitable analysis and computations for optimizing system performance and/or enabling controlled system performance by applying features to the playback path in the edge device(s).
  • processing-based system optimization examples include: ⁇ Boundary gain compensation filter
  • the system may use any well-accepted standard technology for processing-based system optimization, including updating audio filter parameters by transferring new updated filter coefficients for implementation into one or more audio filters in the audio devices/systems.
  • the audio control platform may be configured to provide technical recommendations for system optimization based on audio measurement results. This may be regarded as a technical decision-support system.
  • the backend audio control platform may provide recommendations for room acoustic treatment and/or changes or double-check of the system set-up.
  • the backend audio control platform may be adapted for operation based on an at least partly interactive procedure with the user/operator of the edge device(s).
  • room As previously mentioned, it should be understood that the terms“room”, “room acoustics” and“room acoustic treatment” are not limited to conference rooms or rooms in an apartment or house but may e.g. be related to a confined space of a car or any other definable audio listening/capturing environment.
  • FIG. 6 is a schematic diagram illustrating an example of a physical design for room acoustic treatment.
  • the backend audio control platform may recommend room acoustic treatment, e.g. because there has been an extreme amount of early reflection or echoes and long reverb tails have been identified.
  • the backend audio control platform may recommend to double-check the system set up because distortion is above a certain threshold.
  • the proposed technology may employ machine learning techniques such as supervised learning, unsupervised learning, reinforcement learning and so forth for providing relevant system optimizations/changes and/or recommendations for such system optimizations/changes.
  • This type of Artificial- intelligence-driven technology may provide a decision engine that operates based on measurement conclusions.
  • the audio control platform may provide educated guesses regarding how the room looks like, and interactively requesting confirmation of those educated guesses. It could be a yes/no survey for the user to respond to.
  • the audio control platform may provide feedback to the user of the edge device such as“Extreme amounts of echo and a reverb tail have been identified. Is it correct that all walls in the room are flat and smooth? Yes/No”, and so on with possibly further questions to enable the system to work its way through to a final proposal for system changes and/or room acoustic treatment.
  • the audio control platform may generate and send control data, based on the audio system identification and/or the received audio measurements, for transfer to the audio device and/or system.
  • control data may be representative of:
  • audio signal processing processing/filter modes and/or filter sets/parameters for room acoustic compensation to be performed for the audio device and/or system;
  • control data may be representative of preprocessed audio data, e.g. preprocessed streaming audio, which may be sent from the audio control platform to the audio device and/or system, which may then render the preprocessed audio data for play-out on one or more speakers.
  • the audio control platform may perform the compensation and generate a preprocessed audio stream ready for play-out by the (edge) audio device/system.
  • the (edge) audio device/system may thus be configured to send audio measurements to the audio control platform, which performs the actual processing and generates processed audio data, and the (edge) audio device/system may be configured to receive the preprocessed audio data for play- out.
  • the preprocessed audio data may be processed and/or controlled in such a way so as to enable compensation for the impact of room acoustics and/or enable system optimization.
  • the control data may thus be regarded as being embedded in the preprocessed audio data.
  • FIG. 8 is a schematic flow diagram illustrating an example of a method for measuring, analyzing and/or compensating for impact of room acoustics to perceived quality of an audio system according to an embodiment.
  • the method comprises:
  • step S1 receiving, in step S1 , audio measurements of said audio system made within an audio listening/capturing environment
  • step S2 audio system identification for said audio system and the associated audio listening/capturing environment based on the audio measurements including analyzing room acoustics of the audio listening/capturing environment; and enabling, in step S3, compensation for the impact of room acoustics and/or providing technical recommendations for i) system optimization and/or ii) room acoustic treatment, based on the audio system identification and/or the audio measurements.
  • a system for measuring, analyzing and/or compensating for impact of room acoustics to perceived quality of an audio system wherein said system for measuring, analyzing and/or compensating for impact of room acoustics is configured to perform such a method.
  • an audio device and/or audio system for sound reproduction.
  • the audio device and/or audio system is configured to perform audio measurements within an audio listening/capturing environment.
  • the audio device and/or audio system is further configured to send data representative of said audio measurements to an audio control platform for analysis to thereby enable audio system identification for the audio device and/or audio system and the associated audio listening/capturing environment including analyzing room acoustics of the audio listening/capturing environment.
  • the audio device and/or audio system is also configured to receive control data, generated by the audio control platform based on the audio system identification and/or the audio measurements, from the audio control platform for enabling compensation for the impact of room acoustics and/or obtaining technical recommendations for i) audio system optimization/changes and/or ii) room acoustic treatment.
  • control data may be representative of:
  • audio signal processing for room acoustic compensation to be performed for the audio device and/or system and/or technical recommendations for i) audio system optimization/changes and/or ii) room acoustic treatment; and/or
  • the audio device and/or audio system may be configured to apply audio signal processing for room acoustic compensation based on the control data.
  • the audio device and/or audio system may be configured to present technical recommendations for i) audio system optimization/changes and/or ii) room acoustic treatment, as previously described.
  • control data may also be representative of preprocessed audio data, e.g. preprocessed streaming audio, which may be sent from the audio control platform to the audio device and/or system, which may then render the preprocessed audio data for play-out on one or more speakers.
  • preprocessed streaming audio e.g. preprocessed streaming audio
  • steps, functions, procedures and/or blocks described above may be implemented in hardware using any conventional technology, such as discrete circuit or integrated circuit technology, including both general-purpose electronic circuitry and application-specific circuitry.
  • a suitable computer or processing device such as a microprocessor, Digital Signal Processor (DSP) or Application Specific Integrated Circuitry (ASIC) and/or any suitable programmable logic device such as a Field Programmable Gate Array (FPGA) device and a Programmable Logic Controller (PLC) device.
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuitry
  • FPGA Field Programmable Gate Array
  • PLC Programmable Logic Controller
  • FIG. 7 is a schematic diagram illustrating an example of a computer-implementation according to an embodiment.
  • a computer program 325; 335 which is loaded into the memory 320 for execution by processing circuitry including one or more processors 310.
  • the processor(s) 310 and memory 320 are interconnected to each other to enable normal software execution.
  • An optional input/output device 340 may also be interconnected to the processor(s) 310 and/or the memory 320 to enable input and/or output of relevant data such as input parameter(s) and/or resulting output parameter(s).
  • processor should be interpreted in a general sense as any system or device capable of executing program code or computer program instructions to perform a particular processing, determining or computing task.
  • the processing circuitry including one or more processors 310 is thus configured to perform, when executing the computer program 325, well-defined processing tasks such as those described herein.
  • the processing circuitry does not have to be dedicated to only execute the above- described steps, functions, procedure and/or blocks, but may also execute other tasks.
  • a computer program 325; 335 comprising instructions, which when executed by at least one processor 310, cause the at least one processor to perform at least part of the steps and/or tasks described herein.
  • a computer program for analyzing and/or optimizing audio devices/systems when executed by a processor.
  • the computer program 325; 335 comprises instructions, which when executed by the processor 310, cause the processor 310 to:
  • the enablement of compensation for the impact of room acoustics may be effectuated by instructions, which when executed, cause the processor to prepare commands for effectuating such compensation. These commands may subsequently be transferred to the relevant audio device/system and/or associated control module thereof for actually performing the compensation according to the commands.
  • this invention can additionally be considered to be embodied entirely within any form of computer-readable storage medium having stored therein an appropriate set of instructions for use by or in connection with an instruction- execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch instructions from a medium and execute the instructions.
  • the software may be realized as a computer program product, which is normally carried on a non-transitory computer-readable medium, for example a CD, DVD, USB memory, hard drive or any other conventional memory device.
  • the software may thus be loaded into the operating memory of a computer or equivalent processing system for execution by a processor.
  • the computer/processor does not have to be dedicated to only execute the above-described steps, functions, procedure and/or blocks, but may also execute other software tasks.
  • the flow diagram or diagrams presented herein may be regarded as a computer flow diagram or diagrams, when performed by one or more processors.
  • a corresponding apparatus may be defined as a group of function modules, where each step performed by the processor corresponds to a function module.
  • the function modules are implemented as a computer program running on the processor.
  • the computer program residing in memory may thus be organized as appropriate function modules configured to perform, when executed by the processor, at least part of the steps and/or tasks described herein. Any appropriate steps, methods, features, functions, or benefits disclosed herein may be performed through one or more functional units or modules of one or more virtual apparatuses. Each virtual apparatus may comprise a number of these functional units. These functional units may be implemented via processing circuitry, which may include one or more microprocessor or microcontrollers, as well as other digital hardware, which may include digital signal processors (DSPs), special- purpose digital logic, and the like.
  • DSPs digital signal processors
  • the processing circuitry may be configured to execute program code stored in memory, which may include one or several types of memory such as read-only memory (ROM), random-access memory (RAM), cache memory, flash memory devices, optical storage devices, and so forth.
  • Program code stored in memory may include program instructions for executing one or more telecommunications and/or data communications protocols as well as instructions for carrying out one or more of the techniques described herein.
  • the processing circuitry may be used to cause the respective functional unit to perform corresponding functions according to one or more embodiments of the present disclosure.
  • module(s) it is possible to realize such module(s) predominantly by hardware modules, or alternatively by hardware, with suitable interconnections between relevant modules.
  • Particular examples include one or more suitably configured digital signal processors and other known electronic circuits, e.g. discrete logic gates interconnected to perform a specialized function, and/or Application Specific Integrated Circuits (ASICs) as previously mentioned.
  • Other examples of usable hardware include input/output (I/O) circuitry and/or circuitry for receiving and/or sending signals.
  • I/O input/output
  • module or unit may have conventional meaning in the field of electronics, electrical devices and/or electronic devices and may include, for example, electrical and/or electronic circuitry, devices, modules, processors, memories, logic solid state and/or discrete devices, computer programs or instructions for carrying out respective tasks, procedures, computations, outputs, and/or displaying functions, and so on, as such as those that are described herein.
  • computing services can be located, distributed or re-located to one or more separate physical nodes or servers.
  • the functionality may be re-located or distributed to one or more jointly acting physical and/or virtual apparatuses or machines that can be positioned in separate physical node(s), i.e. in the so-called cloud.
  • cloud computing is a model for enabling ubiquitous on-demand network access to a pool of configurable computing resources such as networks, servers, storage, applications and general or customized services.
  • a virtual apparatus or machine may be a software implementation of a physical machine that runs programs as if they were executing on a physical, non-virtualized machine; and applications generally do not know they are running on a virtual machine as opposed to running on a“bare metal” host electronic device, though some systems provide para-virtualization which allows an operating system or application to be aware of the presence of virtualization for optimization purposes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

L'invention concerne une plate-forme de commande audio (100; 300) servant à analyser et/ou optimiser un dispositif/système audio (200). La plate-forme de commande audio (100; 300) est configurée pour recevoir, en provenance d'au moins un dispositif audio et/ou d'un système audio (200) connecté à la plate-forme de commande audio, des mesures audio effectuées au sein d'un environnement d'écoute/de capture audio. La plate-forme de commande audio (100; 300) est en outre configurée pour réaliser une identification de système audio dudit au moins un dispositif audio et/ou système audio et de l'environnement d'écoute/capture audio associé sur la base des mesures audio, dont l'analyse de l'acoustique de la pièce de l'environnement d'écoute/de capture audio. La plate-forme de commande audio (100; 300) est également configurée pour activer une compensation de l'impact de l'acoustique d'une pièce et/ou pour fournir des recommandations techniques visant à i) optimiser/modifier le système audio et/ou ii) effectuer un traitement acoustique de la pièce, sur la base de l'identification de système audio et/ou des mesures audio.
PCT/SE2020/050714 2019-07-18 2020-07-07 Plate-forme de commande audio intelligente WO2021010884A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962875765P 2019-07-18 2019-07-18
US62/875,765 2019-07-18

Publications (1)

Publication Number Publication Date
WO2021010884A1 true WO2021010884A1 (fr) 2021-01-21

Family

ID=74209967

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2020/050714 WO2021010884A1 (fr) 2019-07-18 2020-07-07 Plate-forme de commande audio intelligente

Country Status (1)

Country Link
WO (1) WO2021010884A1 (fr)

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050195984A1 (en) * 2004-03-02 2005-09-08 Masayoshi Miura Sound reproducing method and apparatus
US20060060070A1 (en) * 2004-08-27 2006-03-23 Sony Corporation Reproduction apparatus and reproduction system
US20060093128A1 (en) * 2004-10-15 2006-05-04 Oxford William V Speakerphone
US20130216071A1 (en) * 2012-02-21 2013-08-22 Intertrust Technologies Corporation Audio reproduction systems and methods
WO2014032709A1 (fr) * 2012-08-29 2014-03-06 Huawei Technologies Co., Ltd. Système de rendu audio
US20140294211A1 (en) * 2011-09-27 2014-10-02 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for listening room equalization using a scalable filtering structure in the wave domain
US20170055097A1 (en) * 2015-08-21 2017-02-23 Broadcom Corporation Methods for determining relative locations of wireless loudspeakers
US20170084294A1 (en) * 2015-09-17 2017-03-23 Sonos, Inc. Device Impairment Detection
WO2017049169A1 (fr) * 2015-09-17 2017-03-23 Sonos, Inc. Faciliter l'étalonnage d'un dispositif de lecture audio
US20170242655A1 (en) * 2016-02-22 2017-08-24 Sonos, Inc. Room-Corrected Voice Detection
US9763018B1 (en) * 2016-04-12 2017-09-12 Sonos, Inc. Calibration of audio playback devices
US20180018984A1 (en) * 2016-07-12 2018-01-18 Dolby Laboratories Licensing Corporation Assessment and Adjustment of Audio Installation
US20180262175A1 (en) * 2017-03-10 2018-09-13 Samsung Electronics Co., Ltd. Auto-equalization, in-room low-frequency sound power optimization
WO2019025789A1 (fr) * 2017-08-02 2019-02-07 Audio Analytic Ltd Améliorations apportées à la reproduction sonore
US20190103848A1 (en) * 2017-10-04 2019-04-04 Google Llc Methods and Systems for Automatically Equalizing Audio Output based on Room Characteristics
US10299061B1 (en) * 2018-08-28 2019-05-21 Sonos, Inc. Playback device calibration
WO2019136460A1 (fr) * 2018-01-08 2019-07-11 Polk Audio, Llc Module de commande vocale synchronisé, système de haut-parleur et procédé pour incorporer une fonctionnalité vc dans un système de haut-parleur séparé

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050195984A1 (en) * 2004-03-02 2005-09-08 Masayoshi Miura Sound reproducing method and apparatus
US20060060070A1 (en) * 2004-08-27 2006-03-23 Sony Corporation Reproduction apparatus and reproduction system
US20060093128A1 (en) * 2004-10-15 2006-05-04 Oxford William V Speakerphone
US20140294211A1 (en) * 2011-09-27 2014-10-02 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus and method for listening room equalization using a scalable filtering structure in the wave domain
US20130216071A1 (en) * 2012-02-21 2013-08-22 Intertrust Technologies Corporation Audio reproduction systems and methods
WO2014032709A1 (fr) * 2012-08-29 2014-03-06 Huawei Technologies Co., Ltd. Système de rendu audio
US20170055097A1 (en) * 2015-08-21 2017-02-23 Broadcom Corporation Methods for determining relative locations of wireless loudspeakers
WO2017049169A1 (fr) * 2015-09-17 2017-03-23 Sonos, Inc. Faciliter l'étalonnage d'un dispositif de lecture audio
US20170084294A1 (en) * 2015-09-17 2017-03-23 Sonos, Inc. Device Impairment Detection
US20170242655A1 (en) * 2016-02-22 2017-08-24 Sonos, Inc. Room-Corrected Voice Detection
US9763018B1 (en) * 2016-04-12 2017-09-12 Sonos, Inc. Calibration of audio playback devices
US20180018984A1 (en) * 2016-07-12 2018-01-18 Dolby Laboratories Licensing Corporation Assessment and Adjustment of Audio Installation
US20180262175A1 (en) * 2017-03-10 2018-09-13 Samsung Electronics Co., Ltd. Auto-equalization, in-room low-frequency sound power optimization
WO2019025789A1 (fr) * 2017-08-02 2019-02-07 Audio Analytic Ltd Améliorations apportées à la reproduction sonore
US20190103848A1 (en) * 2017-10-04 2019-04-04 Google Llc Methods and Systems for Automatically Equalizing Audio Output based on Room Characteristics
WO2019136460A1 (fr) * 2018-01-08 2019-07-11 Polk Audio, Llc Module de commande vocale synchronisé, système de haut-parleur et procédé pour incorporer une fonctionnalité vc dans un système de haut-parleur séparé
US10299061B1 (en) * 2018-08-28 2019-05-21 Sonos, Inc. Playback device calibration

Similar Documents

Publication Publication Date Title
EP3128767B1 (fr) Système et procédé pour améliorer des haut-parleurs connectés à des dispositifs avec des microphones
US11929088B2 (en) Input/output mode control for audio processing
KR101970370B1 (ko) 오디오 신호의 처리 기법
JP5882552B2 (ja) 協調的サウンドシステム
CN105794231A (zh) 免提波束方向图配置
GB2495472B (en) Processing audio signals
DE112015003945T5 (de) Mehrquellen-Rauschunterdrückung
US11516614B2 (en) Generating sound zones using variable span filters
US20220345820A1 (en) Coordination of audio devices
CN110769352B (zh) 一种信号处理方法、装置以及计算机存储介质
US20230361739A1 (en) Analyzing and determining conference audio gain levels
JP2022552815A (ja) 音響システムにおけるスピーチのオーディオ品質の改善
US20200028970A1 (en) Pre-distortion system for cancellation of nonlinear distortion in mobile devices
US20230079741A1 (en) Automated audio tuning launch procedure and report
US10389323B2 (en) Context-aware loudness control
EP3900399A1 (fr) Séparation source dans des dispositifs auditifs et procédés associés
WO2021010884A1 (fr) Plate-forme de commande audio intelligente
US11985488B2 (en) System and method for automatically tuning digital signal processing configurations for an audio system
US20230146772A1 (en) Automated audio tuning and compensation procedure
US9516413B1 (en) Location based storage and upload of acoustic environment related information
CN112788489B (zh) 控制方法、装置和电子设备
US20220095009A1 (en) Method and apparatus for controlling audio sound quality in terminal using network
CN110910892A (zh) 会议系统终端、音频数据处理方法和远程会议系统
RU2818982C2 (ru) Управление акустической эхокомпенсацией для распределенных аудиоустройств
US20220295204A1 (en) Real-Time Adaptation of Audio Playback

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20840558

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20840558

Country of ref document: EP

Kind code of ref document: A1