CN116828352A

CN116828352A - Radio reception device and control method thereof

Info

Publication number: CN116828352A
Application number: CN202210284421.6A
Authority: CN
Inventors: 袁上元; 黄宏斌
Original assignee: Chicony Electronics Co Ltd
Current assignee: Chicony Electronics Co Ltd
Priority date: 2022-03-22
Filing date: 2022-03-22
Publication date: 2023-09-29

Abstract

A sound receiving device and a control method thereof are provided. The radio reception device comprises: microphone apparatus, object detection apparatus, and processor. The microphone device is used for providing an audio signal. The object detection device is used for detecting the position information of at least one object. The processor is coupled to the microphone device and the object detection device. The processor judges the position information of the sounding source according to the audio signal and the position information of the at least one object, and adjusts the gain of each microphone in the microphone equipment so as to sound the sounding source.

Description

Radio reception device and control method thereof

Technical Field

The present invention relates to a radio receiving technology, and more particularly, to a radio receiving device and a control method thereof.

Background

In video conferencing or radio technology in related contexts, it is desirable to be able to accurately receive the speaker's voice through a microphone and reject other environmental noise. However, if the sound source is simply determined by the sound wave reception technique, the direction and distance determination of the sound source is often misaligned due to reflection, scattering or other noise sources of the sound wave, and it is not easy to quickly determine the sound source.

Therefore, it is necessary to provide a new sound receiving technology, which can accurately receive sound from the sound source.

Disclosure of Invention

The invention provides a sound receiving device and a method for controlling the sound receiving device, which utilize the sound wave receiving technology in combination with the object detection technology to accurately receive sound.

The embodiment of the invention provides a radio receiving device. The radio receiver includes a microphone device, an object detection device, and a processor. The microphone device is used for providing an audio signal. The object detection device is used for detecting the position information of at least one object. The processor is coupled to the microphone device and the object detection device. The processor judges the position information of the sound source according to the audio signal and the position information of the at least one object, and adjusts the gain of each microphone in the microphone equipment so as to carry out sound reception aiming at the sound source.

The embodiment of the invention also provides a control method of the radio receiver. The radio method comprises the following steps. Obtaining an audio signal from a microphone device; detecting position information of at least one object according to the object detection equipment; judging the position information of a sound source according to the audio signal and the position information of the at least one object; and adjusting the gain of each microphone in the microphone device to sound the sound source.

Based on the above, the sound receiving device and the method for controlling the sound receiving device according to the embodiments of the present invention use the sound receiving technology in combination with the object detection technology (such as radar sensor, camera, optical radar sensor) to comprehensively determine the coordinates of the sound source. Then, the sound pickup device selectively adjusts the gains corresponding to the microphones for pickup, for example, to strengthen the microphone gain for the sound source and reduce the microphone gain for the non-sound source, so as to perform accurate sound pickup.

Drawings

FIG. 1 is a block diagram of a radio receiver according to an embodiment of the present invention.

FIG. 2 is a flow chart of a control method of the radio receiving device according to an embodiment of the invention.

Fig. 3 is a schematic diagram of a microphone device implemented by a first directional microphone and a second directional microphone in a sound pickup apparatus according to a first embodiment of the present invention.

Fig. 4A, fig. 4B, fig. 5A, and fig. 5B are schematic diagrams illustrating an example of the radio receiving device of fig. 3 according to the first embodiment of the invention.

Fig. 6 is a schematic diagram of a microphone device implemented as an omni-directional microphone in a sound pickup apparatus according to a second embodiment of the present invention.

Wherein, the reference numerals are as follows:

100. radio receiver

110. Microphone apparatus

120. Processor and method for controlling the same

122. Audio codec

130. Object detection apparatus

110-1 first directional microphone

110-2 second directional microphone

130. Object detection apparatus

S210 to S280 steps

310-1 first radio reception area

310-2 second radio reception area

320. Overlapping region

410. Hair source

420. Echo source

430. Noise source

AnS audio signal

OPS object position signal

Gn1, gn2 microphone gain

EAnS1, EAnS2 audio energy

Detailed Description

Fig. 1 is a block diagram of a radio receiver 100 according to an embodiment of the invention. The radio receiving apparatus 100 mainly includes: microphone apparatus 110, object detection apparatus 130, and processor 120.

The microphone device 110 is used for capturing audio to provide an audio signal AnS. The microphone apparatus 110 of the present embodiment may be composed of a plurality of directional microphones (as described in the first embodiment of the present invention), may be implemented by a single omni-directional microphone (as described in the second embodiment of the present invention), or may be composed of one or more directional microphones and an omni-directional microphone. The microphone device 110 can be composed of different microphone types according to the requirements of the embodiment, and the accurate sound reception can be performed according to the description of the embodiments of the present invention.

The object detection device 130 is configured to detect position information of at least one object in the object detection area to generate an object position signal OPS. The microphone apparatus 110 of the present embodiment also receives sound in the object detection area. The object detection device 130 of the present embodiment may be a radar sensor, a camera, an optical radar sensor …, or the like, or a corresponding device that can detect the position information of a physical object and is not used for sensing with sound waves.

The processor 120 is coupled to the microphone apparatus 110 and the object detection apparatus 130. The processor 120 determines the position information of the sound source according to the audio signal Ans provided by the microphone device 110 and the position information of the object provided by the object detecting device 130. That is, the processor 120 determines the preliminary position of the sound source through the audio signal captured by the microphone device 110 and the corresponding sound wave object detection technology, and combines the position information of the object provided by the object detection device 130 to determine the accurate position information of the sound source. And, the processor 120 determines the distance between the microphone device 110 and the sound source through the accurate position information of the sound source, or whether the position information of the sound source is located in a specific sound pickup area of the microphone device 110, so as to appropriately adjust the gain of each microphone in the microphone device 110 to accurately pick up the sound source.

Regarding how to moderately adjust the gain of each microphone in the microphone apparatus 110 for accurate sound reception, the present embodiment is adaptively adjusted according to the type and number of microphones in the microphone apparatus 110 and the difference of the audio codec (codec) 122 used in the processor 120, and the present embodiment may be implemented by moderately referencing the embodiments of the present invention. The audio codec 122 may be stored within the processor 120 or in a memory coupled to the processor 120, and the processor 120 executes the audio codec 122. The audio codec 122 may be presented in software or firmware.

Fig. 2 is a flowchart of a control method of the radio receiving device 100 according to an embodiment of the invention. The control method of the present embodiment can be applied to the radio receiving device 100 of fig. 1 and the following fig. 3 to 6 according to the embodiments of the present invention, and includes steps S210 to S280. The steps of fig. 2 will be described with reference to the first embodiment including fig. 3, fig. 4A to fig. 4B, and fig. 5A to fig. 5B.

Fig. 3 is a schematic diagram of a microphone device 110 implemented by a first directional microphone 110-1 and a second directional microphone 110-2 in a sound pickup apparatus 100 according to a first embodiment of the present invention. Fig. 4A, fig. 4B, fig. 5A, and fig. 5B are schematic diagrams illustrating an exemplary sound receiving device 100 of fig. 3 according to a first embodiment of the present invention. Fig. 4A and fig. 4B are diagrams showing one case of adjusting the microphone gain of the microphone device 110 in the first embodiment, and fig. 5A and fig. 5B are diagrams showing another case of adjusting the microphone gain of the microphone device 110 in the first embodiment.

In fig. 3, 4A, 4B, 5A and 5B, the radio receiver 100 mainly includes: microphone apparatus 110, object detection apparatus 130, and processor 120.

The microphone apparatus 110 in the first embodiment of the present invention includes: a first directional microphone 110-1 and a second directional microphone 110-2. The first directional microphone 110-1 is configured to sound the first sound receiving area 310-1 to generate a first audio signal, and the second directional microphone 110-2 is configured to sound the second sound receiving area 310-2 to generate a second audio signal. An overlap region 320 is provided between the first and second sound pickup regions 310-1 and 310-2. In other words, the microphone apparatus 110 of the first embodiment uses a plurality of directional microphones to sound in an oblique manner for a plurality of different angles.

The microphone gains Gn1 and Gn2 in fig. 4A, 4B, 5A and 5B represent the microphone gains for receiving sound in the first directional microphone 110-1 and the second directional microphone 110-2, respectively. The audio energy EAnS1 and EAnS2 represent the audio energy of the first audio signal and the second audio signal captured by the first directional microphone 110-1 and the second directional microphone 110-2, respectively.

Referring to fig. 2, fig. 4A and fig. 4B, in step S210, the processor 120 of fig. 1 controls the radio receiving device 100 to be in a standby state. At this time, the processor 120 of FIG. 1 sets the microphone gains Gn1, gn2 of the directional microphones 110-1, 110-2 to 100%.

In step S220, the processor 120 of fig. 1 obtains an audio signal according to the microphone apparatus 110. In the first embodiment, the first directional microphone 110-1 is configured to sound the first sound receiving area 310-1 to generate a first audio signal, and the second directional microphone 110-2 is configured to sound the second sound receiving area 310-2 to generate a second audio signal. The processor 120 of fig. 1 receives the first audio signal and the second audio signal, respectively. As shown in fig. 4A, in the first embodiment, it is assumed that the audio energy EAnS1 of the first audio signal is 45dB, and the audio energy EAnS2 of the second audio signal is 55dB. In step S230, the processor 120 of fig. 1 obtains the position information of at least one object according to the object detection apparatus 130.

In step S240, the processor 120 of fig. 1 determines the position information of the sound source (e.g., the sound source 410 of fig. 4A) according to the audio signals (e.g., the first audio signal and the second audio signal) and the position information of the object. In detail, the processor 120 of fig. 1 determines the position information of at least one estimated audio source according to the first audio signal and the second audio signal, and compares the position information of the estimated audio source with the position information of the object to determine the position information of the sound source 410. The processor 120 of the present embodiment can obtain the position information of the estimated audio sources (e.g., the sounding source 410, the echo source 420, the noise source 430) through the acoustic object detection technology by using the first audio signal and the second audio signal, but the estimated audio sources are not all the sounding source 410, and may cause misjudgment of the estimated audio sources due to environmental noise, acoustic echo, etc., such as the echo source 420, the noise source 430 …, etc. Therefore, in addition to the estimated audio source obtained by the acoustic object detection technique, the present embodiment combines the position information of the object provided by the object detection device 130 to further determine the accurate position information of the sound source 410.

It is assumed that the first embodiment is an office environment in a teleconference, and the sound source 410 is mainly a user, however, other sound sources such as the sound source 420 (e.g. the echo region formed by the wall reflection), the noise source 430 (e.g. the electric fan) …, etc. may be formed in the office environment. These sound sources can be eliminated by comparing the position information of the object provided by the object detection device 130. For example, in one example, the object detection device 130 may be configured to treat a human body as an object detected by the object detection device 130, and an object having a smaller volume than a normal human body may not be considered as an object detected by the object detection device 130. In another example, the object detection device 130 may also be configured to utilize the radar reflection information to estimate the width and height of the object, thereby masking objects that are less than a predetermined height or a predetermined width. Thereby, the position information of the sound source 410 can be obtained efficiently and accurately.

In step S250, the processor 120 of fig. 1 adjusts the microphone gains of the microphone apparatus 110 to sound the sound source 410. In the first embodiment, the processor 120 of fig. 1 determines the relationship among the position information of the sound source 410, the first sound receiving area 310-1, the second sound receiving area 310-2 and the overlapping area 320 to adjust the microphone gain Gn1 of the first directional microphone 110-1 and the microphone gain Gn2 of the second directional microphone 110-2.

In detail, when it is determined that the position information of the sound source 410 is located in one of the first sound receiving area 310-1 and the second sound receiving area 310-2 (in this embodiment, the position information of the sound source 410 is located in the first sound receiving area 310-1) and is not located in the other of the first sound receiving area 310-1 and the second sound receiving area 310-2 (in this embodiment, the second sound receiving area 310-2), the processor 120 of fig. 1 adjusts up or maintains the microphone gain Gn1 of the first directional microphone 110-1 corresponding to the one of the first sound receiving area 310-1 and the second sound receiving area 310-2 (in this embodiment, the first sound receiving area 310-1) as shown in fig. 4B), and adjusts down the microphone gain Gn2 of the second directional microphone 110-2 corresponding to the other of the first sound receiving area 310-1 and the second sound receiving area 310-2 (in this embodiment, the second sound receiving area 310-2) as shown in fig. 4B, the microphone gain Gn1 is maintained as shown in fig. 4B.

In other embodiments consistent with the present invention, if it is determined that the position information of the sound source is located in the second sound receiving area 310-2 and not located in the first sound receiving area 310-1, the processor 120 of fig. 1 increases or maintains the microphone gain of the second directional microphone corresponding to the second sound receiving area 310-2, and decreases the microphone gain of the second directional microphone corresponding to the second sound receiving area 310-2.

Fig. 4B is a schematic diagram of fig. 4A after the microphone gains of the first directional microphone 110-1 and the second directional microphone 110-2 are adjusted in step S250. As shown in fig. 4B, the microphone gain Gn1 is maintained at 100%. Also, since the microphone gain Gn2 is adjusted to be 0%, the audio energy EAnS2 of the second audio signal captured by the second directional microphone 110-2 is 0dB. In other embodiments consistent with the present invention, the unadjusted microphone gains Gn1, gn2 in fig. 4A may be 90% and 90%, respectively, and the adjusted microphone gains Gn1, gn2 in fig. 4B may be 100% and 10%, respectively, such that the microphone gain Gn1 is adjusted from 90% to 100% and the microphone gain Gn2 is adjusted from 90% to 10%. The microphone gains Gn1 and Gn2 in fig. 4A and 4B can be adjusted according to the requirements of the user applying the present embodiment. Thus, the processor 110 of FIG. 1 can utilize the acoustic wave reception technique in combination with the object detection technique to perform accurate reception.

In step S260, the processor 120 in fig. 1 dynamically adjusts the gain of each microphone in the microphone device 110 according to the audio signal received by the microphone device 110, so as to dynamically and automatically obtain a better receiving effect. The corresponding step of "dynamically adjusting the microphone gain" in step S260 is the same as or similar to the corresponding step of step S250, fig. 4A and fig. 4B, and the user can dynamically adjust each microphone gain in the microphone apparatus 110 according to the requirement and the above description.

In step S270, the processor 120 of fig. 1 determines whether the sound source 410 is moving according to the object detection device 130. In detail, the processor 120 continuously detects whether the sound source 410 is moving through the object detecting device 130 after confirming the position information. If the processor 120 in fig. 1 determines that the moving distance of the sound source 410 exceeds the preset threshold value through the object detection device 130, it indicates that the sound source 410 is moving, and then step S270 returns to step S220 to reconfirm the position information of the sound source 410, so as to automatically perform accurate sound reception. In contrast, if the processor 120 in fig. 1 determines that the distance traveled by the sound source 410 does not exceed the preset threshold through the object detection device 130, it indicates that the sound source 410 is not moved, and then step S270 proceeds to step S280.

In step S280, the processor 120 of fig. 1 determines whether the energy in the audio signal after the sound reception is too small, for example, whether the energy in the audio signal after the sound reception is smaller than a preset energy value. If the energy in the audio signal after sound reception is not too small (not smaller than the preset energy value), which indicates that the sound source 410 is not moving and still continues to sound, the process returns from step S270 to step S250 to continue sound reception and dynamically obtain better sound reception effect. In contrast, if the energy in the audio signal after receiving the sound is too small, which indicates that the sound source 410 does not continue to sound, the process returns from step S270 to step S210, so that the sound receiving apparatus 100 returns to the standby state until the sound source 410 is detected in step S220, and the corresponding steps in fig. 2 are continued.

Referring to step S250 of fig. 2 and fig. 5A and 5B, when determining that the position information of the sound source 410 is located in the overlapping area 320 of fig. 5A, the processor 110 of fig. 1 determines which of the first audio signal received by the first directional microphone 110-1 and the second audio signal received by the second directional microphone 110-2 has larger audio energy. Assuming that the audio energy EAnS1 (48 dB) of the first audio signal is smaller than the audio energy EAnS2 (52 dB) of the second audio signal, this indicates that the audio energy in the second audio signal is larger. Thus, as shown in FIG. 5B, the processor 110 of FIG. 1 increases or maintains the microphone gain of the second directional microphone 110-2 corresponding to the second audio signal (e.g., maintains the microphone gain Gn2 as 100%) and decreases the microphone gain of the first directional microphone 110-1 corresponding to the first audio signal (e.g., decreases the microphone gain Gn1 as 0%).

In other embodiments consistent with the present invention, it is assumed that the audio energy in the first audio signal is larger. Thus, the processor 110 of FIG. 1 increases or maintains the microphone gain of the first directional microphone 110-1 corresponding to the first audio signal and decreases the microphone gain of the second directional microphone 110-2 corresponding to the second audio signal.

The first embodiment described above is implemented by using a plurality of directional microphones to form the microphone apparatus 110. Here, another embodiment (second embodiment) is proposed to implement the microphone apparatus 110 as an omni-directional microphone, and to perform the control method of fig. 2 through the audio codec 122 of fig. 1.

Fig. 6 is a schematic diagram of a microphone apparatus 110 implemented as an omni-directional microphone in a sound pickup device 100 according to a second embodiment of the present invention. In the second embodiment, when the processor 110 of fig. 1 executes step S240 of fig. 2, the audio signal AnS of fig. 1 can be used to primarily determine which direction the sound source is located, and the position information of the sound source can be determined by matching with the position information of the object.

In a second embodiment, the processor 110 of fig. 1 executes the audio codec 122 when executing step S250 of fig. 2. The audio codec 122 uses a plurality of distances as parameters, thereby adjusting the gain of each microphone in the microphone apparatus 110 and receiving sound. For example, the audio codec 122 takes distances of 5 meters (5 m), 10 meters (10 m), 100 meters (100 m), 200 meters (200 m) as parameters, thereby adjusting the respective microphone gains in the microphone apparatus 110, and thereby obtaining audio signals extracted based on four different distances. The processor 110 of fig. 1 executes the audio codec 122 to determine a specific distance from the audio signals, so as to determine which distance is the best and highest in energy of the obtained audio signals. For example, in fig. 6, the audio codec 122 sets the specific distance to 100 meters, so that the microphone gains of the microphone apparatus 110 are adjusted by using the parameters of 100 meters, and accurate sound reception is performed. The implementation of the other steps of fig. 2 in the second embodiment is described with reference to the first embodiment.

It is also known that the embodiment of the present invention can combine the directional microphones of the first embodiment with the microphone gain adjustment technique of the audio side decoder 122 of the second embodiment, which uses the distance as a parameter, thereby realizing another embodiment.

In summary, the sound pickup apparatus and the method for controlling the sound pickup apparatus according to the embodiments of the present invention use the sound pickup technology in combination with the object detection technology (e.g., radar sensor, camera, optical radar sensor) to comprehensively determine the coordinates of the sound source. Then, the sound pickup device selectively adjusts the gains corresponding to the microphones for pickup, for example, to strengthen the microphone gain for the sound source and reduce the microphone gain for the non-sound source, so as to perform accurate sound pickup.

Claims

1. A radio reception apparatus comprising:

a microphone device for providing an audio signal;

an object detection device for detecting position information of at least one object; and

a processor coupled to the microphone apparatus and the object detection apparatus,

the processor judges the position information of the sound source according to the audio signal and the position information of the at least one object, and adjusts the gain of each microphone in the microphone equipment so as to sound the sound source.

2. The radio reception apparatus of claim 1 where the microphone device comprises:

a first directional microphone for receiving sound from the first sound receiving area to generate a first audio signal; and

a second directional microphone for receiving a second sound receiving area to generate a second audio signal, wherein an overlapping area is arranged between the first sound receiving area and the second sound receiving area,

the processor judges the position information of at least one estimated audio source according to the first audio signal and the second audio signal, and compares the position information of the at least one estimated audio source with the position information of the at least one object to judge the position information of the sound source.

3. The sound pickup apparatus of claim 2, wherein the processor determines a relationship among the position information of the sound source, the first sound pickup area, the second sound pickup area, and the overlapping area to adjust a first microphone gain of the first directional microphone and a second microphone gain of the second directional microphone.

4. The sound pickup apparatus as claimed in claim 3, wherein when it is determined that the position information of the sound pickup source is located in one of the first sound pickup region and the second sound pickup region and is not located in the other of the first sound pickup region and the second sound pickup region, the processor adjusts up or maintains the first microphone gain of the first directional microphone corresponding to one of the first sound pickup region and the second directional microphone corresponding to the other of the first sound pickup region and the second sound pickup region or the second microphone gain of the second directional microphone corresponding to the other of the first sound pickup region and the second sound pickup region.

5. The sound pickup apparatus as claimed in claim 3, wherein the processor determines that the audio energy of the first audio signal received by the first directional microphone and the audio energy of the second audio signal received by the second directional microphone is greater, increases or maintains the first microphone gain of the first directional microphone or the second microphone gain of the second directional microphone corresponding to the greater of the audio energy of the first audio signal and the second audio signal, and decreases the first microphone gain of the first directional microphone or the second microphone gain of the second directional microphone corresponding to the non-greater of the audio energy of the first audio signal and the second audio signal when determining that the position information of the sound source is located in the overlapping region.

6. The sound pickup apparatus of claim 1, wherein the processor executes an audio codec that adjusts the gain of each microphone in the microphone device and picks up sound based on a plurality of distances, and the audio codec determines a specific distance based on the plurality of audio signals after picking up sound,

wherein the processor adjusts the individual microphone gains in the microphone apparatus in accordance with the particular distance.

7. The radio reception apparatus of claim 1 where the object detection device is a radar detector.

8. The sound pickup apparatus of claim 1, wherein the processor further dynamically adjusts the respective microphone gains in the microphone device in accordance with the audio signal picked up by the microphone device.

9. The radio reception apparatus according to claim 1, wherein the processor further determines whether the sound source is moving based on the object detection device,

when judging that the sounding source moves, the processor judges the position information of the sounding source and adjusts the gains of all microphones in the microphone equipment to sound the sounding source,

when judging that the sound source does not move, the processor judges whether the energy in the audio signal after sound reception is smaller than a preset energy value,

when the energy in the audio signal is not less than the preset energy value, the processor continuously and dynamically adjusts the gain of each microphone in the microphone equipment,

when the energy in the audio signal is less than the preset energy value, the processor enables the radio receiving device to return to a standby state.

10. A control method of a radio device comprises the following steps:

obtaining an audio signal from a microphone device;

detecting position information of at least one object according to the object detection equipment;

judging the position information of a sound source according to the audio signal and the position information of the at least one object; and

and adjusting the gain of each microphone in the microphone equipment to sound the sounding source.

11. The control method according to claim 10, wherein the microphone apparatus includes:

wherein the step of judging the position information of the sound source according to the audio signal and the position information of the at least one object comprises the following steps:

judging the position information of at least one estimated audio source according to the first audio signal and the second audio signal; and

comparing the position information of the at least one estimated audio source with the position information of the at least one object to judge the position information of the sound source.

12. The control method of claim 11, the step of adjusting individual microphone gains in the microphone apparatus to sound the sound source comprising:

and judging the relation among the position information of the sound source, the first sound receiving area, the second sound receiving area and the overlapping area so as to adjust the first microphone gain of the first directional microphone and the second microphone gain of the second directional microphone.

13. The control method of claim 10, the step of adjusting individual microphone gains in the microphone apparatus to sound the sound source comprising:

executing an audio codec, wherein the audio codec adjusts the gain of each microphone in the microphone equipment by taking a plurality of distances as parameters and performs sound reception, and the audio codec determines a specific distance by taking a plurality of audio signals after sound reception; and

and adjusting each microphone gain in the microphone equipment according to the specific distance.

14. The control method according to claim 10, further comprising:

and dynamically adjusting each microphone gain in the microphone equipment according to the audio signal received by the microphone equipment.

15. The control method according to claim 10, further comprising:

judging whether the sounding source moves or not according to the object detection equipment;

when the sounding source is judged to move, judging the position information of the sounding source, and adjusting the gain of each microphone in the microphone equipment to sound the sounding source;

when the sound source is judged not to move, judging whether the energy in the audio signal after sound reception is smaller than a preset energy value or not;

continuously and dynamically adjusting each microphone gain in the microphone device when the energy in the audio signal is not less than the preset energy value; and

and returning to a standby state when the energy in the audio signal is judged to be smaller than the preset energy value.