US11863710B2 - Audio device and method for detecting device status of audio device in audio/video conference - Google Patents
Audio device and method for detecting device status of audio device in audio/video conference Download PDFInfo
- Publication number
- US11863710B2 US11863710B2 US17/515,909 US202117515909A US11863710B2 US 11863710 B2 US11863710 B2 US 11863710B2 US 202117515909 A US202117515909 A US 202117515909A US 11863710 B2 US11863710 B2 US 11863710B2
- Authority
- US
- United States
- Prior art keywords
- status
- loudspeaker
- microphone
- filter coefficients
- audio device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000003044 adaptive effect Effects 0.000 claims abstract description 64
- 238000012545 processing Methods 0.000 claims abstract description 53
- 230000004044 response Effects 0.000 claims description 14
- 238000004519 manufacturing process Methods 0.000 claims description 5
- 238000010408 sweeping Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 description 23
- 238000012546 transfer Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 8
- 239000011159 matrix material Substances 0.000 description 5
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1785—Methods, e.g. algorithms; Devices
- G10K11/17853—Methods, e.g. algorithms; Devices of the filter
- G10K11/17854—Methods, e.g. algorithms; Devices of the filter the filter being an adaptive filter
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
- G10K11/17879—General system configurations using both a reference signal and an error signal
- G10K11/17881—General system configurations using both a reference signal and an error signal the reference signal being an acoustic signal, e.g. recorded with a microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/085—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using digital techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Definitions
- the invention relates to video conferences, and, in particular, to an audio device and a method for detecting device status of an audio device in an audio/video conference.
- an audio device in an exemplary embodiment, includes processing circuitry which is connected to a loudspeaker and a microphone.
- the processing circuitry is configured to play an echo reference signal from a far end on the loudspeaker, and perform an acoustic echo cancellation (AEC) process using the echo reference signal and an acoustic signal received by the microphone using an AEC adaptive filter.
- the processing circuitry repeatedly determines a first status of the loudspeaker according to a relation between the played echo reference signal and the received acoustic signal, and transmits a first status signal indicating the first status of the loudspeaker to the far end through a cloud network.
- AEC acoustic echo cancellation
- the processing circuitry determines the microphone being muted. In response to the processing circuitry determining that the signal level of the microphone is higher than the threshold, the processing circuitry determines a second status of the microphone being working normally, sends a second status signal indicating the second status of the microphone to the far end through the cloud network, obtains the filter coefficients from the AEC adaptive filter, and calculates similarity between the obtained filter coefficients and the reference filter coefficients.
- the processing circuitry determines that the first status of the loudspeaker is that it is not working. In response to the processing circuitry determining that the calculated similarity is higher than or equal to the preset threshold, the processing circuitry determines that the first status of the loudspeaker is that the loudspeaker is working normally.
- the reference filter coefficients are calculated using the AEC adaptive filter by playing white noise and sweeping tones on the loudspeaker for a first predetermined period of time, and the calculated reference filter coefficients are pre-stored in a nonvolatile memory of the audio device during a process of manufacturing the audio device in a factory.
- the processing circuitry initializes the filter coefficients of the AEC adaptive filter to zero, and obtains the filter coefficients from the AEC adaptive filter at runtime as the reference filter coefficients by calculating an average of the filter coefficients of the AEC adaptive filter within a second predetermined period of time.
- the processing circuitry calculates cosine similarity between the filter coefficients and the reference filter coefficients as the similarity.
- the processing circuitry receives a third status signal and a fourth status signal respectively indicating a third status of a loudspeaker of another audio device and a fourth status of a microphone of the another audio device at the far end through the cloud network, and displays icons corresponding to the third status and the fourth status on a graphical user interface of a video-conferencing application running on a video device in which the audio device is disposed.
- a method for use in an audio device is provided.
- the audio device is connected to a loudspeaker and a microphone.
- the method includes the following steps: playing an echo reference signal from a far end on the loudspeaker; performing an acoustic echo cancellation (AEC) process on the echo reference signal and an acoustic signal received by the microphone using an AEC adaptive filter; determining a first status of the loudspeaker according to a relation between the played echo reference signal and the received acoustic signal; and transmitting a first status signal indicating the first status of the loudspeaker to the far end through a cloud network.
- AEC acoustic echo cancellation
- FIG. 1 is a block diagram of a video-conferencing system in accordance with an embodiment of the invention.
- FIG. 2 is a block diagram of the audio device in accordance with an embodiment of the invention.
- FIG. 3 is a diagram of the flow of an acoustic echo cancellation (AEC) process in accordance with an embodiment of the invention
- FIG. 4 is a flow chart of a method for detecting a device status of an audio device in an audio/video conference in accordance with an embodiment of the invention.
- FIGS. 5 A- 5 B are diagrams showing the graphical user interface with icons of different device statuses of the audio device in accordance with an embodiment of the invention.
- FIG. 1 is a block diagram of a video-conferencing system in accordance with an embodiment of the invention.
- the video-conferencing system 10 may include two or more video-conferencing apparatuses 100 connecting to each other through a cloud network 20 .
- Each video device 100 may be an electronic device that include a display function, a web-camera function, a loudspeaker function, and a microphone function, such as a desktop computer equipped with a loudspeaker and a microphone, a laptop computer, a smartphone, or a tablet PC, but the invention is not limited thereto.
- the loudspeaker function and microphone function in each video device 100 may be implemented by an audio device 200 .
- each video device 100 may execute a video-conferencing application that renders a graphical user interface on its display.
- the user of each video device 100 can see the device status (e.g., including the statuses of the microphone and loudspeaker) of the audio device 200 of other participants in the video conference via the graphical user interface.
- the audio device 200 may include an acoustic echo cancellation (AEC) function so as to provide high-quality acoustic signal for everyone in the audio/video conference.
- the audio device 200 may be an electronic device that handles both the loudspeaker and microphone functions, such as a desktop audio device, a tabletop audio device, a soundbar with a microphone array, a smartphone, a tablet PC, a laptop computer, or a personal computer equipped with a standalone microphone (e.g., may be a microphone with a 3.5 mm jack, a USB microphone, or a Bluetooth microphone) and a standalone loudspeaker, but the invention is not limited thereto.
- the audio device 200 may be disposed in the video device 100 .
- the audio device 200 is electrically connected to the video device 100 , and the audio device 200 and video device 100 are standalone devices.
- FIG. 2 is a block diagram of the audio device 200 in accordance with an embodiment of the invention.
- the audio device 200 may include processing circuitry 210 , a memory 215 , digital-to-analog converter (DAC) 220 , an amplifier (AMP) 230 , one or more loudspeakers 240 , and one or more microphones 250 .
- the processing circuitry 210 , buffer memory 215 , DAC 220 , and amplifier 230 may be implemented by an integrated circuit (or system-on-chip) 270 .
- the processing circuitry 210 may be implemented by a central processing unit (CPU), a digital-signal processor (DSP), or an application-specific integrated circuit (ASIC), multiple processors and/or a processor having multiple cores, but the invention is not limited thereto.
- the memory 215 may be a type of computer storage media and may include volatile memory and non-volatile memory.
- the memory 215 may include, but is not limited to, random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory, or other memory technology.
- the loudspeaker 240 may be configured to emit a speaker signal from other audio device 200 in the video-conferencing system 10 .
- the loudspeaker 240 may also emit an echo reference signal 212
- the microphone 250 may receive a local speech signal and other sounds from the user environment in addition to the echo reference signal.
- the microphone 250 may include an analog-to-digital converter (ADC) (not shown in FIG. 2 ) to convert the received analog acoustic signal into a discrete acoustic signal for subsequent AEC processing.
- ADC analog-to-digital converter
- the processing circuitry 210 may perform an AEC process on the acoustic signal (i.e., including the echo reference signal, local speech signal, and other environment sounds) received by the microphone 250 so as to estimate the status of the echo path from the loudspeaker 240 to the microphone 250 .
- the AEC process may be implemented by an AEC adaptive filter such as an LMS (least mean squares) filter, an NLMS (normalized least mean squares) adaptive filter, or an adaptive filter of other types with a predetermined number of taps, but the invention is not limited thereto.
- the positions of the loudspeaker 240 and microphone 250 are generally fixed, and the distance between the loudspeaker 240 and microphone 250 are also fixed.
- the loudspeaker 240 and microphone 250 are working normally, it indicates that the echo path from the loudspeaker 240 to the microphone 250 is valid, the coefficients of the AEC adaptive filter will converge, and they will be close to predefined coefficients.
- the coefficients of the AEC adaptive filter will diverge. The details of the AEC process will be described in the following section.
- FIG. 3 is a diagram of the flow of an acoustic echo cancellation (AEC) process in accordance with an embodiment of the invention.
- AEC acoustic echo cancellation
- the processing circuitry 210 may store a predetermined number of input samples from the far end (e.g., other audio device 200 in the video-conferencing system 10 ) in the memory 215 , where the predetermined number of input samples may be equal to the number of taps of the AEC adaptive filter 214 .
- the NLMS (normalized least mean square) algorithm is used in the AEC adaptive filter 214 of the processing circuitry 210 , and the AEC adaptive filter 214 may find the filter coefficients that relate to producing the least normalized mean square of the error signal (e.g., difference between the desired and the actual signal).
- the echo path is an unknown system that has a transfer function h(n) to be identified, and the AEC adaptive filter 214 attempts to adapt its transfer function h(n) to make it as close as possible to the transfer function h(n) of the echo path.
- n is the number of the current input sample
- p is the number of filter taps
- the AEC adaptive filter 214 may calculate the inner product of the Hermitian transpose of the transfer function ⁇ (n) and the echo reference signal x(n) to obtain an output signal ⁇ (n).
- the subtracter 216 may subtract the output signal ⁇ (n) from the acoustic signal d(n) to obtain a residual echo signal e(n) that is sent to the far end (e.g., other audio devices 200 in the video-conferencing system 10 ).
- the transfer function ⁇ (n) of the AEC adaptive filter 214 may be regarded as a matrix of filter coefficients of the AEC adaptive filter 214 .
- the residual echo signal e(n) is fed back to the AEC adaptive filter 214 . If the residual echo signal e(n) is large, the AEC adaptive filter 214 may adjust its filter coefficients significantly so as to fit the transfer function h(n) of the echo path. If the residual echo signal e(n) is small, it may indicate that the currently used filter coefficients of the AEC adaptive filter 214 is close to the transfer function h(n) of the echo path, and the AEC adaptive filter 214 may adjust its filter coefficients slightly to fit the transfer function h(n) of the echo path.
- the AEC adaptive filter 214 may calculate its transfer function at time n+1, where
- the distance between the loudspeaker 240 and microphone 250 is also fixed.
- the filter coefficients of the AEC adaptive filter 214 will converge, and it indicates that the residual echo signal e(n) may be very close to 0.
- a smartphone is used as the audio device 200 , it is inherent that the positions of the loudspeaker 240 and microphone 250 are fixed and the distance between the loudspeaker 240 and microphone 250 is fixed.
- the filter coefficients of the AEC adaptive filter 214 may converge and be close to reference filter coefficients that were previously tested and calibrated in the factory.
- the echo path may be invalid.
- the microphone 250 works normally and the loudspeaker 240 is turned off or does not work normally, the microphone 250 will not receive the echo reference signal emitted from the loudspeaker 240 .
- the AEC adaptive filter 214 still generates the output signal ⁇ (n) using the echo reference signal x(n). Since the component y(n) is absent in the acoustic signal d(n), the difference between the acoustic signal d(n) and the output signal ⁇ (n), which is regarded as the residual echo signal e(n) will be large. As a result, the AEC adaptive filter 214 may erroneously estimate the transfer function (i.e., matrix of filter coefficients) of the echo path, and it will cause the estimated filter coefficients to diverge.
- the transfer function i.e., matrix of filter coefficients
- the loudspeaker 240 may emit the echo reference signal x(n), but the microphone 250 will not receive any acoustic signal.
- the acoustic signal d (n) is approximately close to 0.
- the AEC adaptive filter 214 still generates the output signal ⁇ (n) using the echo reference signal x(n). Since the acoustic signal d(n) is approximately close to 0, the difference between the acoustic signal d (n) and the output signal ⁇ (n), which is regarded as the residual echo signal e(n) will be large.
- the AEC adaptive filter 214 may erroneously estimate the transfer function (i.e., matrix of filter coefficients) of the echo path, and it will cause the estimated filter coefficients to diverge.
- the reference filter coefficients for use in the AEC adaptive filter 214 may be generated in the manufacturing process for the audio device 200 with fixed locations of loudspeakers 240 and microphones 250 (e.g., a smartphone, laptop computer, tablet PC, desktop audio device, etc.). For example, during the manufacturing process in the factory, white noise or sweeping tone can be played on the audio device 200 , and the processing circuitry 210 of the audio device 200 may perform the AEC process simultaneously.
- the reference filter coefficients for the AEC adaptive filter 214 can be obtained after performing the AEC process for a predetermined period of time, and the obtained reference filter coefficients can be stored in a non-volatile memory of the audio device 200 .
- the reference filter coefficient for use in the AEC adaptive filter 214 may be calculated at runtime.
- the processing circuitry 210 of the audio device 200 may automatically run the AEC process to obtain the reference filter coefficients for the AEC adaptive filter 214 .
- the user environment may be different from the test environment in the factory, and thus the echo path and interference in the user environment may be different from those in the factory.
- the processing circuitry 210 may automatically run the AEC process to obtain the reference filter coefficients in response to detecting that the audio device 200 is being used in an audio conference or a video conference.
- the nonvolatile memory of the audio device 200 may store preset reference filter coefficients that have been tested and calibrated in the factory. However, the preset reference filter coefficients may be not suitable for the user environment in some cases.
- the processing circuitry 210 may load the preset reference filter coefficients from the nonvolatile memory as the initial filter coefficients for the AEC adaptive filter 214 . The processing circuitry 210 may then perform the AEC process and determine whether the preset reference filter coefficients are suitable for the user environment.
- FIG. 4 is a flow chart of a method for detecting a device status of an audio device in an audio/video conference in accordance with an embodiment of the invention. Please refer to FIG. 2 and FIG. 4 .
- step S 410 it is determined whether the signal level of the microphone 250 is higher than a threshold. If it is determined that the signal level of the microphone 250 is higher than the threshold, step S 420 is performed. If it is determined that the signal level of the microphone 250 is not higher than the threshold, it indicates that the microphone 250 is muted (step S 415 ), and the flow ends. Meanwhile, the audio device 200 or the video device 100 at the local end may transmit an indication signal to the cloud network 20 so as to inform the audio devices 200 or video-conferencing apparatuses 100 at the far end that the microphone 250 of the local user is muted, such as showing an icon of a muted microphone on the graphical user interface of the video-conferencing application running on each video device 100 in the video-conferencing system 10 .
- step S 420 the filter coefficients of the AEC adaptive filter 214 are obtained.
- the AEC adaptive filter 214 may update its filter coefficients at runtime, and the processing circuitry 210 may repeatedly obtain the filter coefficients of the AEC adaptive filter 214 every predetermined period of time.
- step S 430 the similarity between the obtained filter coefficients and a plurality of reference filter coefficients are calculated.
- the processing circuitry 210 may calculate cosine similarity between the obtained filter coefficients and the reference filter coefficients.
- the cosine similarity between two vectors a and b can be expressed using equation (1):
- AdaptSim cos sim( h adapt ,h ref ) (2)
- step S 440 it is determined whether the similarity is greater than or equal to a preset threshold. If it is determined that the similarity is less than the preset threshold, it indicates that the loudspeaker 240 is not working (step S 450 ), and the flow ends. If it is determined that the similarity is greater than or equal to the preset threshold, it indicates that the loudspeaker 240 and microphone 250 are working normally (step S 460 ), and the flow goes back to step S 410 .
- steps S 415 , S 450 , and S 460 in FIG. 4 may represent different device statuses of the audio device 200 during the audio or video conference.
- the processing circuitry 210 of the audio device 200 of the local end may transmit a status signal to the cloud network 20 to indicate the current device status of the audio device 200 , and the cloud network 20 may forward the status signal to each video device 100 in the video-conferencing system 10 .
- each video device 100 in the video-conferencing system 10 may show a status icon of the audio device 200 of user A on the graphical user interface of the video-conferencing application running on each video device 100 . If user A is speaking during the video conference, user A can know whether users B and C can hear what he or she is saying from the graphical user interface.
- the device status of the audio device 200 indicates that the microphone 250 is muted. If the flow in FIG. 4 proceeds to step S 450 , the device status of the audio device 200 indicates that the loudspeaker 240 is not working. If the flow in FIG. 4 proceeds to step S 460 , the device status of the audio device 200 indicates that the loudspeaker 240 and microphone 250 are working normally.
- the processing circuitry 210 may repeatedly determine a first status of the loudspeaker 240 according to a relation between the played echo reference signal and the received acoustic signal, and transmit the first status signal indicating the first status of the loudspeaker 240 to the far end through the cloud network 20 .
- the relation between the played echo reference signal and the received acoustic signal may be represented using filter coefficients and reference filter coefficients of the AEC adaptive filter.
- the relation between the played echo reference signal and the received acoustic signal may be represented using some other coefficients determined from the played echo reference signal and the received acoustic signal.
- FIGS. 5 A- 5 B are diagrams showing the graphical user interface with icons of different device statuses of the audio device in accordance with an embodiment of the invention. Please refer to FIG. 2 , FIG. 4 , and FIGS. 5 A- 5 B .
- the video device 100 of user A may show a graphical user interface 500 that includes blocks 510 , 520 , and 530 , as shown in FIG. 5 A .
- block 510 may contain the username 511 (e.g., user B), video screen 512 , and blocks 513 and 514 of the audio device 200 of user B, where block 513 shows the status of the microphone 250 of the audio device 200 of user B, and block 514 shows the status of the loudspeaker 240 of the audio device 200 of user B.
- Block 520 may contain the username 521 (e.g., user C), video screen 522 , and blocks 523 and 524 of the audio device 200 of user C, where block 523 shows the status of the microphone 250 of the audio device 200 of user C, and block 524 shows the status of the loudspeaker 240 of the audio device 200 of user C.
- Block 530 may show the video screen of user A (i.e., the local user).
- FIG. 5 A it is assumed that the loudspeakers 240 and microphones 250 of the audio devices 200 of users B and C are working normally, and thus blocks 513 and 523 may show a microphone pattern with a specific color (e.g., green), and the loudspeaker-status icons 514 and 524 may show a loudspeaker pattern with a specific color (e.g., green). Accordingly, user A can know that the loudspeakers 240 and microphones 250 of the audio devices 200 of users B and C are working normally via the microphone-status icons 513 and 523 and the loudspeaker-status icons 514 and 524 .
- a specific color e.g., green
- the audio device 200 of user B may send the first status signal of user B indicating that the microphone 250 is muted to the cloud network 20 , and the audio device 200 of user A can receive the status signal from the cloud network 20 .
- the video-conferencing application running on the video device 100 of user A may show a microphone pattern covered with a red-color X mark on block 513 .
- the audio device 200 of user B may determine that its loudspeaker 240 is working normally, and send the second status signal of user B indicating that the loudspeaker 240 is working normally to the cloud network 20 .
- the audio device 200 of user A can receive the second status signal from the cloud network 20
- the video-conferencing application running on the video device 100 of user A may show a loudspeaker pattern in green color.
- the audio device 200 of user C may send the second status signal of user C indicating that the loudspeaker 240 is not working to the cloud network 20 , and the audio device 200 of user A can receive the second status signal of user C from the cloud network 20 , and the video-conferencing application running on the video device 100 of user A may show a loudspeaker pattern covered with a cross in red color.
- the audio device 200 of user C may determine that its microphone 250 works normally, and send the first status signal indicating that the microphone 250 is working normally to the cloud network 20 .
- the audio device 200 of user A can receive the first status signal of user C from the cloud network, and the video-conferencing application running on the video device 100 of user A may show a loudspeaker pattern covered with a cross in red color.
- the processing circuitry 210 of audio device 200 at the far end may determine that its loudspeaker 240 and/or microphone 250 are not working, and the video device 100 of the local user (e.g., user A) can know the device status of the audio device 200 at the far end by viewing the icons in the corresponding blocks of the graphical user interface.
- the local user e.g., user A
- the local user needs not to ask the question “did you hear me?” during the audio or video conference.
- an audio device and a method of detecting a device status during an audio/video conference are provided, which are capable of detecting whether the loudspeaker or microphone of the audio device at the local end are working normally, and then providing the detected device status of the loudspeaker and microphone to other audio devices or video devices in the video-conferencing system. Accordingly, the user at the far end can know the device status of the loudspeaker and microphone of the audio device at the local end as well as the user at the local end can also know the device status of the loudspeaker and microphone of the audio device at the far end, thereby improving user experience during the audio or video conference.
Abstract
Description
In some other embodiments, the AEC
AdaptSim=cos sim(h adapt ,h ref) (2)
Claims (16)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/515,909 US11863710B2 (en) | 2021-11-01 | 2021-11-01 | Audio device and method for detecting device status of audio device in audio/video conference |
CN202111405666.1A CN116074489A (en) | 2021-11-01 | 2021-11-24 | Method for detecting device status of audio device in audio/video conference and audio device |
TW110144096A TWI797850B (en) | 2021-11-01 | 2021-11-26 | Audio device and method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/515,909 US11863710B2 (en) | 2021-11-01 | 2021-11-01 | Audio device and method for detecting device status of audio device in audio/video conference |
Publications (2)
Publication Number | Publication Date |
---|---|
US20230133061A1 US20230133061A1 (en) | 2023-05-04 |
US11863710B2 true US11863710B2 (en) | 2024-01-02 |
Family
ID=86144725
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/515,909 Active 2042-06-25 US11863710B2 (en) | 2021-11-01 | 2021-11-01 | Audio device and method for detecting device status of audio device in audio/video conference |
Country Status (3)
Country | Link |
---|---|
US (1) | US11863710B2 (en) |
CN (1) | CN116074489A (en) |
TW (1) | TWI797850B (en) |
Citations (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7003099B1 (en) * | 2002-11-15 | 2006-02-21 | Fortmedia, Inc. | Small array microphone for acoustic echo cancellation and noise suppression |
US7672445B1 (en) * | 2002-11-15 | 2010-03-02 | Fortemedia, Inc. | Method and system for nonlinear echo suppression |
US8085947B2 (en) | 2006-05-10 | 2011-12-27 | Nuance Communications, Inc. | Multi-channel echo compensation system |
US9916840B1 (en) | 2016-12-06 | 2018-03-13 | Amazon Technologies, Inc. | Delay estimation for acoustic echo cancellation |
CN104778950B (en) | 2014-01-15 | 2018-03-27 | 华平信息技术股份有限公司 | A kind of microphone signal delay compensation control method based on echo cancellor |
US9967661B1 (en) | 2016-02-09 | 2018-05-08 | Amazon Technologies, Inc. | Multichannel acoustic echo cancellation |
US20190066654A1 (en) * | 2016-02-02 | 2019-02-28 | Dolby Laboratories Licensing Corporation | Adaptive suppression for removing nuisance audio |
TW201933335A (en) | 2018-01-25 | 2019-08-16 | 南韓商三星電子股份有限公司 | Application processor supporting low power echo cancellation, electronic device including the same and method of operating the same |
CN110310654A (en) | 2019-07-26 | 2019-10-08 | 歌尔科技有限公司 | Echo cancel method and device, electronic equipment, readable storage medium storing program for executing |
US10636435B1 (en) * | 2018-12-22 | 2020-04-28 | Microsemi Semiconductor (U.S.) Inc. | Acoustic echo cancellation using low-frequency double talk detection |
CN111128210A (en) | 2018-10-30 | 2020-05-08 | 哈曼贝克自动系统股份有限公司 | Audio signal processing with acoustic echo cancellation |
US10650840B1 (en) * | 2018-07-11 | 2020-05-12 | Amazon Technologies, Inc. | Echo latency estimation |
CN111418011A (en) | 2017-09-28 | 2020-07-14 | 搜诺思公司 | Multi-channel acoustic echo cancellation |
CN111640449A (en) | 2020-06-09 | 2020-09-08 | 北京大米科技有限公司 | Echo cancellation method, computer readable storage medium and electronic device |
US10937441B1 (en) * | 2019-01-04 | 2021-03-02 | Amazon Technologies, Inc. | Beam level based adaptive target selection |
US20220053268A1 (en) * | 2020-08-12 | 2022-02-17 | Auzdsp Co., Ltd. | Adaptive delay diversity filter and echo cancellation apparatus and method using the same |
US11404073B1 (en) * | 2018-12-13 | 2022-08-02 | Amazon Technologies, Inc. | Methods for detecting double-talk |
US11451905B1 (en) * | 2019-10-30 | 2022-09-20 | Social Microphone, Inc. | System and method for multi-channel acoustic echo and feedback compensation |
US20220310106A1 (en) * | 2021-03-29 | 2022-09-29 | Semiconductor Components Industries, Llc | Echo canceller with variable step-size control |
US11552611B2 (en) * | 2020-02-07 | 2023-01-10 | Shure Acquisition Holdings, Inc. | System and method for automatic adjustment of reference gain |
US20230171346A1 (en) * | 2020-04-15 | 2023-06-01 | Hewlett-Packard Development Company, L.P. | Double talk detectors |
-
2021
- 2021-11-01 US US17/515,909 patent/US11863710B2/en active Active
- 2021-11-24 CN CN202111405666.1A patent/CN116074489A/en active Pending
- 2021-11-26 TW TW110144096A patent/TWI797850B/en active
Patent Citations (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7003099B1 (en) * | 2002-11-15 | 2006-02-21 | Fortmedia, Inc. | Small array microphone for acoustic echo cancellation and noise suppression |
US7672445B1 (en) * | 2002-11-15 | 2010-03-02 | Fortemedia, Inc. | Method and system for nonlinear echo suppression |
US8085947B2 (en) | 2006-05-10 | 2011-12-27 | Nuance Communications, Inc. | Multi-channel echo compensation system |
JP5288723B2 (en) | 2006-05-10 | 2013-09-11 | ニュアンス コミュニケーションズ, インコーポレイテッド | Multi-channel echo compensation |
CN104778950B (en) | 2014-01-15 | 2018-03-27 | 华平信息技术股份有限公司 | A kind of microphone signal delay compensation control method based on echo cancellor |
US20190066654A1 (en) * | 2016-02-02 | 2019-02-28 | Dolby Laboratories Licensing Corporation | Adaptive suppression for removing nuisance audio |
US9967661B1 (en) | 2016-02-09 | 2018-05-08 | Amazon Technologies, Inc. | Multichannel acoustic echo cancellation |
US9916840B1 (en) | 2016-12-06 | 2018-03-13 | Amazon Technologies, Inc. | Delay estimation for acoustic echo cancellation |
US11538451B2 (en) | 2017-09-28 | 2022-12-27 | Sonos, Inc. | Multi-channel acoustic echo cancellation |
CN111418011A (en) | 2017-09-28 | 2020-07-14 | 搜诺思公司 | Multi-channel acoustic echo cancellation |
TW201933335A (en) | 2018-01-25 | 2019-08-16 | 南韓商三星電子股份有限公司 | Application processor supporting low power echo cancellation, electronic device including the same and method of operating the same |
US11044368B2 (en) | 2018-01-25 | 2021-06-22 | Samsung Electronics Co., Ltd. | Application processor supporting low power echo cancellation, electronic device including the same and method of operating the same |
US10650840B1 (en) * | 2018-07-11 | 2020-05-12 | Amazon Technologies, Inc. | Echo latency estimation |
CN111128210A (en) | 2018-10-30 | 2020-05-08 | 哈曼贝克自动系统股份有限公司 | Audio signal processing with acoustic echo cancellation |
US10979100B2 (en) | 2018-10-30 | 2021-04-13 | Harman Becker Automotive Systems Gmbh | Audio signal processing with acoustic echo cancellation |
US11404073B1 (en) * | 2018-12-13 | 2022-08-02 | Amazon Technologies, Inc. | Methods for detecting double-talk |
US10636435B1 (en) * | 2018-12-22 | 2020-04-28 | Microsemi Semiconductor (U.S.) Inc. | Acoustic echo cancellation using low-frequency double talk detection |
US10937441B1 (en) * | 2019-01-04 | 2021-03-02 | Amazon Technologies, Inc. | Beam level based adaptive target selection |
CN110310654A (en) | 2019-07-26 | 2019-10-08 | 歌尔科技有限公司 | Echo cancel method and device, electronic equipment, readable storage medium storing program for executing |
US11451905B1 (en) * | 2019-10-30 | 2022-09-20 | Social Microphone, Inc. | System and method for multi-channel acoustic echo and feedback compensation |
US11552611B2 (en) * | 2020-02-07 | 2023-01-10 | Shure Acquisition Holdings, Inc. | System and method for automatic adjustment of reference gain |
US20230171346A1 (en) * | 2020-04-15 | 2023-06-01 | Hewlett-Packard Development Company, L.P. | Double talk detectors |
CN111640449A (en) | 2020-06-09 | 2020-09-08 | 北京大米科技有限公司 | Echo cancellation method, computer readable storage medium and electronic device |
US20220053268A1 (en) * | 2020-08-12 | 2022-02-17 | Auzdsp Co., Ltd. | Adaptive delay diversity filter and echo cancellation apparatus and method using the same |
US20220310106A1 (en) * | 2021-03-29 | 2022-09-29 | Semiconductor Components Industries, Llc | Echo canceller with variable step-size control |
Non-Patent Citations (1)
Title |
---|
Chinese language office action dated Nov. 8, 2022, issued in application No. TW 110144096. |
Also Published As
Publication number | Publication date |
---|---|
CN116074489A (en) | 2023-05-05 |
US20230133061A1 (en) | 2023-05-04 |
TW202320059A (en) | 2023-05-16 |
TWI797850B (en) | 2023-04-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230164274A1 (en) | Post-mixing acoustic echo cancellation systems and methods | |
US8842851B2 (en) | Audio source localization system and method | |
US8503669B2 (en) | Integrated latency detection and echo cancellation | |
US9111543B2 (en) | Processing signals | |
CN105794189B (en) | Device and method for echo cancellor | |
EP2987316B1 (en) | Echo cancellation | |
GB2495472B (en) | Processing audio signals | |
US20090253418A1 (en) | System for conference call and corresponding devices, method and program products | |
US20090046866A1 (en) | Apparatus capable of performing acoustic echo cancellation and a method thereof | |
US20130148821A1 (en) | Processing audio signals | |
CN106663447B (en) | Audio system with noise interference suppression | |
JP6903884B2 (en) | Signal processing equipment, programs and methods, and communication equipment | |
US20210020188A1 (en) | Echo Cancellation Using A Subset of Multiple Microphones As Reference Channels | |
CN105324981B (en) | Method, equipment, medium and the device of echo suppressing | |
US9508357B1 (en) | System and method of optimizing a beamformer for echo control | |
CN106961509B (en) | Call parameter processing method and device and electronic equipment | |
US20150086006A1 (en) | Echo suppressor using past echo path characteristics for updating | |
US11902758B2 (en) | Method of compensating a processed audio signal | |
CN104871520A (en) | Echo suppression | |
US11741984B2 (en) | Method and apparatus and telephonic system for acoustic scene conversion | |
US11863710B2 (en) | Audio device and method for detecting device status of audio device in audio/video conference | |
US10366701B1 (en) | Adaptive multi-microphone beamforming | |
CN102970638B (en) | Processing signals | |
US10389325B1 (en) | Automatic microphone equalization | |
CN111292760B (en) | Sounding state detection method and user equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: MEDIATEK INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEI, SHAW-MIN;CHENG, YIOU-WEN;SUN, LIANG-CHE;REEL/FRAME:058178/0140 Effective date: 20211108 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |