CN114422933A - Electronic equipment, sound field processing method thereof and sound field processing equipment - Google Patents
Electronic equipment, sound field processing method thereof and sound field processing equipment Download PDFInfo
- Publication number
- CN114422933A CN114422933A CN202111674719.XA CN202111674719A CN114422933A CN 114422933 A CN114422933 A CN 114422933A CN 202111674719 A CN202111674719 A CN 202111674719A CN 114422933 A CN114422933 A CN 114422933A
- Authority
- CN
- China
- Prior art keywords
- sound
- signal
- loudspeaker
- microphone
- speaker
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 53
- 238000003672 processing method Methods 0.000 title claims abstract description 20
- 230000005236 sound signal Effects 0.000 claims abstract description 65
- 238000012360 testing method Methods 0.000 claims abstract description 33
- 230000005540 biological transmission Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 9
- 238000000034 method Methods 0.000 claims description 8
- 230000000694 effects Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 7
- 210000005069 ears Anatomy 0.000 description 5
- 230000003111 delayed effect Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 230000001965 increasing effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000011358 absorbing material Substances 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 239000007769 metal material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 230000003238 somatosensory effect Effects 0.000 description 1
- 238000012956 testing procedure Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Stereophonic System (AREA)
Abstract
The present disclosure provides a sound field processing method of an electronic apparatus, a sound field processing apparatus, and an electronic apparatus. The processing method comprises the following steps: the left loudspeaker plays sound, the left microphone receives the sound and forms a main test signal M of the left loudspeakerLThe right microphone receives the sound and forms a left loudspeaker auxiliary test signal CLLeft acoustic conductance G of the left speaker at the right microphoneLRIs CL/ML(ii) a The right loudspeaker plays sound, the right microphone receives the sound and forms a main test signal M of the right loudspeakerRThe left microphone receives sound and forms a right loudspeaker auxiliary test signal CRRight acoustic conductance G of the right speaker at the left microphoneRLIs CR/MR(ii) a According to the left sound signal and the left sound conduction coefficient G of the left loudspeakerLRObtaining a right offset signal, and superposing the right offset signal on a right sound signal of a right loudspeaker to obtain a right output signal; obtaining a left cancellation signal according to the right sound signal and the right sound conduction coefficient of the right loudspeaker, and outputting the left cancellation signal to the left loudspeakerAnd superposing the left cancellation signal on the left sound signal of the device to obtain a left output signal.
Description
Technical Field
The disclosed embodiments relate to the field of sound field processing technologies, and more particularly, to a sound field processing method for an electronic device, and a sound field processing device.
Background
In recent years, electronic devices have been rapidly developed, and products such as VR head-mounted devices, AR glasses, smart glasses, and shoulder speakers have been favored by consumers. These electronic devices are generally capable of providing a user experience in terms of vision and hearing.
The human ear typically locates the sound source position by the time difference and intensity difference of sound arrival to the left and right ears. The electronic equipment can provide stereo effect for users by utilizing the characteristics of human ears and the characteristics of different sound intensity, sound production time and the like. However, taking VR headsets and shoulder strap speakers as examples, sound is projected to the space around the user during playback. This causes the user's ears to receive sounds from different speakers, and the difference between these sounds is attenuated. The difference in the auditory sensation is not apparent from the perspective of the user.
Therefore, there is a need for an improved electronic device that improves the stereo effect.
Disclosure of Invention
An object of the present disclosure is to provide a sound field processing method of an electronic apparatus, and a new technical solution of a sound field processing apparatus.
According to an aspect of the present disclosure, there is disclosed a sound field processing method of an electronic apparatus, including:
the left loudspeaker plays sound, the left microphone receives the sound and forms a main test signal M of the left loudspeakerLThe right microphone receives the sound and forms a left loudspeaker auxiliary test signal CLLeft acoustic conductance G of the left speaker at the right microphoneLRIs CL/ML；
The right loudspeaker plays sound, the right microphone receives the sound and forms a main test signal M of the right loudspeakerRThe left microphone receives sound and forms a right loudspeaker auxiliary test signal CRRight acoustic conductance G of the right speaker at the left microphoneRLIs CR/MR；
According to the left sound signal SL and the left sound conduction coefficient G of the left loudspeakerLRObtaining a right cancellation signalORSuperimposing a right cancellation signal O on the right sound signal SR of the right loudspeakerRObtaining a right Output signal Output R;
according to the right sound signal SR and the right sound transmission coefficient G of the right loudspeakerRLObtaining a left cancellation signal OLSuperimposing a left cancellation signal O on the left sound signal SL of the left loudspeakerLAnd a left Output signal Output L is obtained.
Optionally, the right cancellation signal ORIs the left sound signal SL and the left sound transmission coefficient GLRThe product of (a);
the left cancellation signal OLIs the right sound signal SR and the right sound transmission coefficient GRLThe product of (a).
Optionally, the right cancellation signal ORAnd the left sound signal SL is an inverted signal;
and/or, the left cancellation signal OLAnd the right sound signal SR is an inverted signal.
Optionally, the left main sound receiving time T of the left microphone is detected when the left speaker plays soundLLDetecting the time T for the right side auxiliary receiving of the right microphoneLRObtaining the right reception delay TR；
Detecting the right main sound receiving time T of the right microphone when the right loudspeaker plays soundRRDetecting the time T for left side auxiliary receiving of the left microphoneRLObtaining the left receiving delay TL；
For the right cancellation signal ORSuperimposed right receive delay TR；
For the left cancellation signal OLSuperposition left receiving delay TL。
Optionally, the right receive delay TRTime T for right side auxiliary receiving soundLRTime T for main receiving sound on left sideLLA difference of (d);
the left sound receiving delay TLTime T for left side auxiliary receiving soundRLTime T for receiving sound with right sideRRThe difference of (a).
According to a second aspect of the present invention, there is provided an electronic apparatus comprising:
a left sound channel processing module and a left loudspeaker, wherein the left sound channel processing module is used for superposing a left cancellation signal O on a left sound signal SL of the left loudspeakerLAnd outputting the obtained left Output signal Output L to a left loudspeaker;
a right sound channel processing module and a right loudspeaker, wherein the right sound channel processing module is used for superposing a right cancellation signal O on a right sound signal SR of the right loudspeakerRAnd outputting the obtained right Output signal Output R to a right loudspeaker;
a left microphone and a right microphone for receiving sound;
the electronic device is configured to perform the sound field processing method described above.
Optionally, the electronic device is configured to be worn on a head of a user, the electronic device having a left fixing part and a right fixing part, the left speaker and the left microphone being disposed at a position close to the left fixing part, and the right speaker and the right microphone being disposed at a position close to the right fixing part.
Optionally, the right channel processing module includes a right channel delay module, and the right channel delay module is configured to offset the right cancellation signal ORCarrying out time delay treatment;
the left sound channel processing module comprises a left sound channel delay module, and the left sound channel delay module is used for cancelling a signal O to the leftLAnd performing time delay processing.
Optionally, the left and/or right microphone is used for voice pickup.
According to a third aspect of the present disclosure, there is also provided a sound field processing apparatus including:
a memory for storing an executable computer program;
a left speaker, a right speaker, a left microphone, and a right microphone;
a processor for performing the method as described above according to the computer program.
One beneficial effect of the disclosed embodiment is that the sound field processing method can make the left and right speakers mutually offset the sound transmitted to the position of the other side, and increase the sound difference of the two speakers in the user's hearing sense.
Other features of the present description and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the specification and together with the description, serve to explain the principles of the specification.
Fig. 1 is a schematic diagram of steps of a sound field processing method provided by the present scheme;
fig. 2 is a schematic diagram of a sound field processing module in the electronic device according to the present invention.
Detailed Description
Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
The present disclosure provides a sound field processing method for an electronic device, which may be a VR headset, AR glasses, a shoulder speaker, or the like. For the electronic equipment which is worn on the head of a user or worn on the body of the user and can play sound externally, the technical scheme provided by the disclosure can provide optimization processing for the sound field of the electronic equipment, and the difference that the sound played by the left and right different sound generating devices reaches human ears is enhanced. The difference of the played sound of the left and right sound generating devices is increased, so that the sound field can be increased in sense, and the stereo effect is better provided for a user.
The electronic equipment corresponding to the sound field processing method disclosed by the invention is provided with a left loudspeaker, a right loudspeaker, a left microphone and a right microphone.
< method examples >
The sound field processing method includes the following steps. First, the transmission coefficients of the loudspeakers on the different sides to the other side can be determined in order to compensate the acoustic signals in practical use.
Left acoustic conductance G to the left speaker to the right microphoneLRAnd (6) carrying out testing. And enabling a left loudspeaker of the electronic equipment to play sound, and respectively receiving the sound played by the left loudspeaker by using the left microphone and the right microphone.
The left microphone is relatively close to the left loudspeaker, receives sound and is capable of forming a left loudspeaker main test signal MLThe signal represents the sound state when the sound generated from the left speaker propagates to the left microphone at a short distance.
The right microphone is relatively far from the left speaker, which may be spaced from the left speaker by other obstructions. For example, when the user wears the VR headset, there is a head block of the user between the left speaker and the right microphone. The right microphone receives the sound of the left loudspeaker and can form a left loudspeaker auxiliary test signal CLThe signal represents the sound state when the sound generated from the left speaker propagates to the far-away right microphone.
According to the test signals, obtaining the left sound conduction coefficient G of the left loudspeaker at the right microphoneLRLeft acoustic conductivity coefficient GLRIs CL/MLI.e. the ratio of the left loudspeaker auxiliary test signal to the left loudspeaker main test signal. Left acoustic conductance GLRRepresenting the attenuation, distortion ratio of the sound conducted by the left speaker to the right speaker relative to the sound conducted to the left speaker. By the left acoustic conductance GLRThe sound condition when the left speaker is propagated to the right side can be judged.
Right acoustic conductance G to the right speaker to the left microphoneRLAnd (6) carrying out testing. And enabling a right loudspeaker of the electronic equipment to play sound, and respectively receiving the sound played by the right loudspeaker by using a right microphone and a left microphone.
The right microphone, which is relatively closer to the right speaker, receives the sound and is capable of forming a right speaker main test signal MRThe signal represents a sound state when a sound generated from the right speaker propagates to the right microphone at a close distance.
The left microphone is relatively far from the right speaker and receives sound representing the sound state as it is reflected by the right speaker when the sound is conducted to the left. The left microphone receives the sound of the right loudspeaker and can form a right loudspeaker auxiliary test signal CR. The signal contains information on attenuation and distortion of sound transmitted from the right side to the left side.
From the above test signals, the right acoustic conductance G of the right speaker at the left microphone can be obtainedRLRight acoustic conductance GRLIs CR/MRI.e. the ratio of the right loudspeaker secondary test signal to the right loudspeaker primary test signal. Right sound transmission coefficient GRLRepresenting the attenuation, distortion ratio of the sound conducted by the right speaker to the left speaker relative to the sound conducted to the right speaker. By the right acoustic conductance GRLThe sound condition when the right speaker is propagated to the left side can be judged.
The technical scheme provided by the disclosure firstly compares the left sound conduction coefficient GLRAnd right acoustic conductance GRLAnd testing to obtain the coefficient in the current application state. The practical application scenarios of the electronic device are different, for example, different sound wave blocking effects are formed when different users wear the electronic device, and the user wearing or placing the electronic device at different positions causes the electronic device to be supposed to be worn or placedWith a change in the environment. Accordingly, the left acoustic conductance GLRAnd right acoustic conductance GRLBut also changes with the change of the actual application environment. Therefore, the technical scheme provided by the disclosure can test the conduction coefficient each time under the condition of starting the sound field enhancement function.
In practical applications, the left speaker and the right speaker are output formal sound signals to form sound waves. The sound signal for output to the left speaker is the left sound signal SL and the sound signal for output to the right speaker is the right sound signal SR.
Further, the left sound signal SL and the left sound conduction coefficient G of the left speaker may be based onLRObtaining a right cancellation signal ORThe right cancellation signal is intended to be superimposed on the right sound signal SR. The left sound signal SL passes through a left sound conduction coefficient GLRThe processing of (3) can form a signal corresponding to the sound transmitted to the right microphone, and use this signal as a cancellation signal to make the right speaker emit a specific sound to cancel the sound transmitted from the left side. Thus, the signals output to the right speaker include a right sound signal SR for generating a right sound, and a right cancel signal O for canceling a sound transmitted from the left speakerR. That is, the Output signal right outputs the signal Output R. The sound emitted for the right speaker can cancel the sound coming from the left speaker. The design mode can reduce the sound of the left loudspeaker heard by the user at the right ear side, thereby increasing the difference of the listening sound of the ears at the two sides, improving the stereo effect and increasing the sound field.
Accordingly, the right sound signal SR and the right sound transmission coefficient G of the right speaker can be determinedRLObtaining a left cancellation signal ORThe left cancellation signal OLFor superimposing on the left sound signal SL. The right sound signal SR passes through the right sound transmission coefficient GRLThe processing of (3) can form a signal corresponding to the sound transmitted to the left microphone, and use this signal as a cancellation signal to make the left speaker emit a specific sound to cancel the sound transmitted from the right side. Thus, the signal output to the left speaker includes a left sound signal SL for generating a left sound, anLeft cancelling signal O for cancelling sound from right loudspeakerL. That is, the Output signal is the left Output signal Output L. The sound emitted by the left speaker can cancel the sound transmitted from the right speaker to the left.
According to the technical scheme, the left sound conduction coefficient G is obtained through testing in practical applicationLRAnd right acoustic conductance GRLThereby enabling the speakers on the left and right sides to emit sound for canceling the sound transmitted to the speaker on the other side on the side. Therefore, the mutual crosstalk of the sound of the left loudspeaker and the sound of the right loudspeaker in the sound amplification function can be effectively reduced, the sound field amplification effect in the sense of hearing is realized, and the enhanced stereo function is provided.
Optionally, the right cancellation signal ORIs the left sound signal SL and the left sound transmission coefficient GLRThe product of the left cancellation signal OLIs the right sound signal SR and the right sound transmission coefficient GRLThe product of (a). In this alternative embodiment, because of the left acoustic conductance GLRThe ratio of the sound from the left speaker to the right and left microphones is represented, and the coefficient reflects the intensity characteristic of the sound. Therefore, the left sound signal SL and the left sound transmission coefficient G are combinedLRThe multiplication results in the intensity of the sound received by the sound signal at the right microphone. Thereby, the sound signal is used as the right cancellation signal ORThe sound transmitted to the right side by the left loudspeaker can be well offset in strength. Same principle, left cancellation signal OLThe right acoustic signal SR and the right acoustic conductance G may also be usedRLThe product of (a).
In other embodiments, the left sound signal SL and the left sound transmission coefficient G can also be usedLRAnd other attenuation coefficients, to obtain right offset signal OR。
Optionally, the right cancellation signal ORAnd the left sound signal SL is an inverted signal. Optionally, the left cancellation signal OLAnd the right sound signal SR is an inverted signal.
In order to raise the right loudspeaker according to the right offset signal ORThe sound produced being of the left loudspeakerCancellation effect, right cancellation signal O can be obtainedRIs configured as an inverted signal 180 ° out of phase with the left sound signal SL. Thus, the right speaker is based on the right cancellation signal ORThe generated sound has the same vibration frequency and amplitude as the signal generated by the left loudspeaker, but the vibration phases are opposite, so that the sound is easier to cancel after the air vibration propagates. Correspondingly, the left cancellation signal OLThe right sound signal SR may be an inverted signal.
The technical scheme does not limit that the cancellation signal must be an opposite-phase signal with the sound signal on the other side, the phase difference of the two signals can be less than 180 degrees, and the cancellation effect can be achieved. Due to different practical application situations, signal matching forms with phase differences of 90 degrees, 120 degrees, 60 degrees and the like can also be adopted. For example, different signal phase differences may be used in the case of irregularities in the shield between the left and right sides, clothing in addition to the wearer's head, metal accessories, and the like. In a preferred embodiment, if the shape of the shielding object is regular and there is no shielding object made of other metal materials, the technical solution can use the cancellation signal and the sound signal with a phase difference of 180 degrees through the test of the transmission coefficient.
In practical applications, since the distance between the left speaker and the right microphone is greater than the distance between the left speaker and the left microphone, there is a time difference when the sound generated by the left speaker propagates to the right microphone and the left microphone. Such a time difference may cause a sound generated according to the cancellation signal to not accurately cancel the sound transmitted from the other side.
The technical scheme also provides an improved method for dealing with the time difference.
Optionally, the left loudspeaker main test signal M is obtainedLAnd left loudspeaker auxiliary test signal CLThe time for the left microphone to receive the sound of the left loudspeaker is measured, and the time duration is the time T for the left main sound receivingLL. At this stage, the time taken for the right microphone to receive the sound of the left speaker is measured, and the time duration is the time T for the right sub-receivingLR. According to the left main sound receiving time TLLTime T for right side auxiliary receivingLRCalculating and obtaining the right receiving delay TR。
The same principle, optionally, is used to obtain the main test signal M for the right speakerRAnd the auxiliary test signal C of the right loudspeakerRThe time for the right microphone to receive the sound of the right loudspeaker is measured, and the time duration is the time T for the right main receivingRR. Similarly, the time period when the left microphone receives the sound of the right speaker is measured, and the time period is the time period T for the left sub-receivingRL. According to the right main sound receiving time TRRAnd time T for left side auxiliary receivingRLCalculating and obtaining the left receiving delay TL。
When the sound field is adjusted, the signal O can be cancelled at the rightRUpper superimposed right receiving delay TR. Thus, when the right speaker emits sound, the sound emitted by the right speaker to cancel the sound coming from the other side is delayed from the sound emitted by the right speaker itself according to the right sound signal SR by a time period which is exactly equivalent to the time period during which the sound emitted by the speaker on the other side is transmitted to the right side. The sound emitted by the right loudspeaker for cancellation and the cancelled sound cross near the right microphone at substantially the same time, and better cancellation can be achieved.
By the same principle, the signal O can be cancelled at the leftLUpper superimposed left receiving delay TL. In this way, the sound emitted by the left loudspeaker for cancellation and the sound of the other loudspeaker reach the left side at a time close to each other, and the cancellation effect is improved.
Optionally, the right receive delay TRTime T for right side auxiliary receiving soundLRTime T for main receiving sound on left sideLLThe difference of (a). Optionally, the left receive delay TLTime T for left side auxiliary receiving soundRLTime T for receiving sound with right sideRRThe difference of (a).
This alternative directly uses the time of sound delivered to the opposite side microphone minus the time of sound delivered to the side microphone to obtain the time duration of the opposite side reception delay. The method has simple operation logic and can clearly enable the cancellation sound and the sound to be cancelled to reach the corresponding position at the same time. In the case where no special shielding and sound absorbing material is present in the actual application environment, it is preferable to obtain the right and left sound collecting delays in the above manner.
< apparatus embodiment >
The present disclosure also provides an electronic device, as shown in fig. 2, including a left channel processing module 12 and a left speaker 11, and a right channel processing module 22 and a right speaker 21.
The left channel processing module 12 is configured to superimpose a left cancellation signal O on the left sound signal SL of the left speaker 11LAnd outputs the obtained left Output signal Output L to the left speaker 11.
The right channel processing module 22 is configured to superimpose the right cancellation signal O on the right sound signal SR of the right speaker 21RAnd outputs the obtained right Output signal Output R to the right speaker 21.
The electronic device further includes a left microphone and a right microphone for receiving sound, respectively. In the left acoustic conductivity coefficient GLRAnd right acoustic conductance GRLWhen the test is carried out, the left microphone and the right microphone play a role in assisting the test. Optionally, the left microphone and the right microphone may also be used as a voice pickup device, a call device, and the like of the electronic device.
The electronic device is used for executing the sound field processing method.
As shown in fig. 2, the channel of the left loudspeaker 11 combines the left sound signal SL and the left cancellation signal OL. Left cancellation signal OLFrom the processing of the left channel processing module 12. The left channel processing module 12 may store therein a right sound conduction coefficient GRLThe left channel processing module 12 receives the right sound signal SR and generates a right sound signal according to the right sound signal SR and the right sound transmission coefficient GRLCalculating to obtain a left cancellation signal OL。
Optionally, an inverse filter may be disposed in the left channel processing module 12, and the left cancellation signal O may be disposed in the left channel processing moduleLAfter being processed by the inverting filter, the signal which is in the opposite phase with the original right sound signal SR can be formed. The design mode is more favorable for left offset signalOLThe sound coming from the right speaker 21 is cancelled.
Optionally, the left channel processing module 12 further includes a left channel delay module 13, as shown in fig. 2, the left channel delay module 13 is a left cancellation signal OLAdding a delay, delayed left-hand cancellation signal OLSo that the sound generated by the left speaker 11 for cancellation is delayed and can be better cancelled with the sound coming from the right side.
As shown in FIG. 2, the left cancellation signal O is processed by the left channel processing block 12 and its inverse filter 4 and left channel delay block 13LIs combined to the left channel, is superimposed with the left sound signal SL, and is output to the left speaker 11.
Similarly, as shown in FIG. 2, the channel of the right speaker 21 combines the right sound signal SR and the right cancellation signal OR. Right cancellation signal ORFrom the processing of the right channel processing module 22. The right channel processing module 22 may store therein a left sound conduction coefficient GLRThe right channel processing module 22 receives the left sound signal SL and generates a left sound conduction coefficient G according to the left sound signal SLLRCalculating to obtain right offset signal OR。
Optionally, an inverse filter may be disposed in the right channel processing module 22 to cancel the signal ORAfter being processed by the inverse filter, a signal with an inverse phase to the original left sound signal SL can be formed. This design is more favorable for right cancellation signal ORThe sound coming from the left loudspeaker 11 is cancelled.
Optionally, the right channel processing module 22 further includes a right channel delay module 23, as shown in fig. 2, the right channel delay module 23 is a right cancellation signal ORAdding a delay, delayed right cancellation signal ORSo that the right speaker 21 produces the sound for cancellation with a delay, and can better cancel the sound coming from the left side.
As shown in FIG. 2, the right cancellation signal O is processed by the right channel processing block 22 and its inverse filter 4 and right channel delay block 23RIs incorporated into the right channel, is superimposed with the right sound signal SR, and is output to the right speaker 21.
This technical scheme provides preferred actual output signal:
the right Output signal Output R is preferably: SR-OR＝SR+(-180degree)*(SL*GLR)；
The left Output signal Output L is preferably: SL-OL＝SL+(-180degree)*(SR*GRL)。
Wherein G isLR＝CL/ML，GRL＝CR/MR。
In practical application, after a user wears an electronic device, such as a VR head-mounted display device, through a testing procedure, G can be obtainedLRAnd GRL. Furthermore, the user formally uses the VR head-mounted display device, the sound of the speakers at the left side and the right side can be combined with the compensation effect of the left channel processing module and the right channel processing module, the sound field enhancement effect is effectively improved, and the mutual crosstalk and the sound image localization interference between the speakers at the two sides are eliminated. Thereby enhancing the auditory sound field, being beneficial to positioning sound field information and improving the stereo effect.
< hardware configuration >
The present disclosure also provides a sound field processing device, which may be an intelligent VR head-mounted display device, an intelligent AR glasses, a shoulder-mounted speaker, a bluetooth headset, a smart phone, a laptop, a desktop computer, a tablet computer, etc., and is not limited herein.
The sound field processing apparatus may include, but is not limited to, a processor, memory, interface devices, communication devices, display devices, input devices, speakers, microphones, and so forth. The processor may be a central processing unit CPU, a graphics processing unit GPU, a microprocessor MCU, or the like, and is configured to execute a computer program, where the computer program may be written by using an instruction set of architectures such as x86, Arm, RISC, MIPS, and SSE. The memory includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface means includes, for example, a USB interface, a serial interface, a parallel interface, and the like. The communication means can perform wired communication using an optical fiber or a cable, or wireless communication, for example, and specifically may include WiFi communication, bluetooth communication, 2G/3G/4G/5G communication, and the like. The display device is, for example, a liquid crystal display panel, a touch panel, or the like. The input means may include, for example, a touch screen, a keyboard, a somatosensory input, and the like. The speaker is used for outputting audio signals. The microphone is used for collecting audio signals.
Applied to the disclosed embodiments, the memory of the sound field processing apparatus is used to store a computer program for controlling the processor to operate to implement the method according to the disclosed embodiments. The skilled person can design the computer program according to the solution disclosed in the present disclosure. How the computer program controls the processor to operate is well known in the art and will not be described in detail here. The sound field processing device may be installed with an intelligent operating system (e.g., Windows, Linux, android, IOS, etc. systems) and application software.
The foregoing description of the embodiments of the present specification has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the application is defined by the appended claims.
Claims (10)
1. A sound field processing method of an electronic apparatus, comprising:
the left loudspeaker plays sound, the left microphone receives the sound and forms a main test signal M of the left loudspeakerLThe right microphone receives the sound and forms a left loudspeaker auxiliary test signal CLLeft acoustic conductance G of the left speaker at the right microphoneLRIs CL/ML；
The right loudspeaker plays sound, the right microphone receives the sound and forms a main test signal M of the right loudspeakerRThe left microphone receives sound and forms the right loudspeaker side testTest signal CRRight acoustic conductance G of the right speaker at the left microphoneRLIs CR/MR；
According to the left sound signal SL and the left sound conduction coefficient G of the left loudspeakerLRObtaining a right cancellation signal ORSuperimposing a right cancellation signal O on the right sound signal SR of the right loudspeakerRObtaining a right Output signal Output R;
according to the right sound signal SR and the right sound transmission coefficient G of the right loudspeakerRLObtaining a left cancellation signal OLSuperimposing a left cancellation signal O on the left sound signal SL of the left loudspeakerLAnd a left Output signal Output L is obtained.
2. The sound field processing method according to claim 1,
the right cancellation signal ORIs the left sound signal SL and the left sound transmission coefficient GLRThe product of (a);
the left cancellation signal OLIs the right sound signal SR and the right sound transmission coefficient GRLThe product of (a).
3. The sound field processing method of claim 1, wherein the right cancellation signal ORAnd the left sound signal SL is an inverted signal;
and/or, the left cancellation signal OLAnd the right sound signal SR is an inverted signal.
4. The sound field processing method according to claim 1, characterized by comprising:
detecting a left main sound-receiving time T of a left microphone when a left speaker plays soundLLDetecting the time T for the right side auxiliary receiving of the right microphoneLRObtaining the right reception delay TR；
Detecting the right main sound receiving time T of the right microphone when the right loudspeaker plays soundRRDetecting the time T for left side auxiliary receiving of the left microphoneRLObtaining the left receiving delay TL；
To the right supportEliminating signal ORSuperimposed right receive delay TR；
For the left cancellation signal OLSuperposition left receiving delay TL。
5. The sound field processing method according to claim 4, wherein the right receive delay TRTime T for right side auxiliary receiving soundLRTime T for main receiving sound on left sideLLA difference of (d);
the left sound receiving delay TLTime T for left side auxiliary receiving soundRLTime T for receiving sound with right sideRRThe difference of (a).
6. An electronic device, comprising:
a left sound channel processing module and a left loudspeaker, wherein the left sound channel processing module is used for superposing a left cancellation signal O on a left sound signal SL of the left loudspeakerLAnd outputting the obtained left Output signal Output L to a left loudspeaker;
a right sound channel processing module and a right loudspeaker, wherein the right sound channel processing module is used for superposing a right cancellation signal O on a right sound signal SR of the right loudspeakerRAnd outputting the obtained right Output signal Output R to a right loudspeaker;
a left microphone and a right microphone for receiving sound;
the electronic device is configured to perform the sound field processing method of any one of claims 1 to 5.
7. The electronic device of claim 6, wherein the electronic device is configured to be worn on a head of a user, the electronic device having a left fastening portion and a right fastening portion, the left speaker and the left microphone being disposed proximate the left fastening portion, the right speaker and the right microphone being disposed proximate the right fastening portion.
8. The electronic device of claim 6, wherein the electronic device is configured to receive a command from a userThe right sound channel processing module comprises a right sound channel delay module which is used for offsetting the right signal ORCarrying out time delay treatment;
the left sound channel processing module comprises a left sound channel delay module, and the left sound channel delay module is used for cancelling a signal O to the leftLAnd performing time delay processing.
9. Electronic device according to claim 6, characterized in that the left and/or right microphone is used for voice pick-up.
10. An apparatus for sound field processing, comprising:
a memory for storing an executable computer program;
a left speaker, a right speaker, a left microphone, and a right microphone;
a processor for performing the method of any one of claims 1 to 5 in accordance with the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111674719.XA CN114422933B (en) | 2021-12-31 | 2021-12-31 | Electronic equipment, sound field processing method thereof and sound field processing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111674719.XA CN114422933B (en) | 2021-12-31 | 2021-12-31 | Electronic equipment, sound field processing method thereof and sound field processing equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114422933A true CN114422933A (en) | 2022-04-29 |
| CN114422933B CN114422933B (en) | 2024-04-26 |
Family
ID=81272144
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111674719.XA Active CN114422933B (en) | 2021-12-31 | 2021-12-31 | Electronic equipment, sound field processing method thereof and sound field processing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114422933B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024046031A1 (en) * | 2022-09-02 | 2024-03-07 | 湖北星纪魅族科技有限公司 | Smart head-mounted apparatus and wearable system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007119419A1 (en) * | 2006-03-30 | 2007-10-25 | Pioneer Corporation | Sound field control method, sound field control device, sound collection device, speaker device, and sound field control program |
| CN101065991A (en) * | 2004-11-19 | 2007-10-31 | 日本胜利株式会社 | Video-audio recording apparatus and method, and video-audio reproducing apparatus and method |
| CN101878657A (en) * | 2007-11-30 | 2010-11-03 | 株式会社坦姆科日本 | Voice input/output automatic switching circuit used in hand-held microphone with speaker of communication device such as transceiver |
| CN106034272A (en) * | 2015-03-17 | 2016-10-19 | 钰太芯微电子科技（上海）有限公司 | Loudspeaker compensation system and portable mobile terminal |
| JP2017028365A (en) * | 2015-07-16 | 2017-02-02 | 株式会社Ｊｖｃケンウッド | Sound field reproduction device, sound field reproduction method, and program |
| CN210168176U (en) * | 2019-01-21 | 2020-03-20 | 深圳市魅鸟科技有限公司 | Sound microphone |
| US20200136675A1 (en) * | 2018-10-30 | 2020-04-30 | Harman Becker Automotive Systems Gmbh | Audio signal processing with acoustic echo cancellation |
| CN113709644A (en) * | 2020-05-20 | 2021-11-26 | 西万拓私人有限公司 | Method for operating a hearing device and hearing device |
-
2021
- 2021-12-31 CN CN202111674719.XA patent/CN114422933B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101065991A (en) * | 2004-11-19 | 2007-10-31 | 日本胜利株式会社 | Video-audio recording apparatus and method, and video-audio reproducing apparatus and method |
| WO2007119419A1 (en) * | 2006-03-30 | 2007-10-25 | Pioneer Corporation | Sound field control method, sound field control device, sound collection device, speaker device, and sound field control program |
| CN101878657A (en) * | 2007-11-30 | 2010-11-03 | 株式会社坦姆科日本 | Voice input/output automatic switching circuit used in hand-held microphone with speaker of communication device such as transceiver |
| CN106034272A (en) * | 2015-03-17 | 2016-10-19 | 钰太芯微电子科技（上海）有限公司 | Loudspeaker compensation system and portable mobile terminal |
| JP2017028365A (en) * | 2015-07-16 | 2017-02-02 | 株式会社Ｊｖｃケンウッド | Sound field reproduction device, sound field reproduction method, and program |
| US20200136675A1 (en) * | 2018-10-30 | 2020-04-30 | Harman Becker Automotive Systems Gmbh | Audio signal processing with acoustic echo cancellation |
| CN210168176U (en) * | 2019-01-21 | 2020-03-20 | 深圳市魅鸟科技有限公司 | Sound microphone |
| CN113709644A (en) * | 2020-05-20 | 2021-11-26 | 西万拓私人有限公司 | Method for operating a hearing device and hearing device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024046031A1 (en) * | 2022-09-02 | 2024-03-07 | 湖北星纪魅族科技有限公司 | Smart head-mounted apparatus and wearable system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114422933B (en) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180182370A1 (en) | Active cancellation of noise in temporal bones | |
| US9516407B2 (en) | Active noise control with compensation for error sensing at the eardrum | |
| US9706288B2 (en) | Apparatus and method of active noise cancellation in a personal listening device | |
| JP6066335B2 (en) | Silencer | |
| EP2202998B1 (en) | A device for and a method of processing audio data | |
| JP6150988B2 (en) | Audio device including means for denoising audio signals by fractional delay filtering, especially for "hands free" telephone systems | |
| US7889872B2 (en) | Device and method for integrating sound effect processing and active noise control | |
| KR20170027780A (en) | Driving parametric speakers as a function of tracked user location | |
| JP2017521902A (en) | Circuit device system for acquired acoustic signals and associated computer-executable code | |
| EP3298801A1 (en) | Systems and methods for audio creation and delivery | |
| US11115775B2 (en) | Method and apparatus for acoustic crosstalk cancellation | |
| JP2009512232A (en) | Shielded communication converter | |
| US9257113B2 (en) | Method and system for active noise cancellation | |
| CN106851460A (en) | Earphone, audio adjustment control method | |
| JP2023551556A (en) | Audio signal processing method and system for echo suppression | |
| CN114422933A (en) | Electronic equipment, sound field processing method thereof and sound field processing equipment | |
| KR102347626B1 (en) | Method and apparatus for generating personal sound zone according to distance | |
| JP2010050532A (en) | Wearable noise canceling directional speaker | |
| US20230254630A1 (en) | Acoustic output device and method of controlling acoustic output device | |
| WO2017081733A1 (en) | Sound reproduction device | |
| JP2006352728A (en) | Audio apparatus | |
| KR20160118156A (en) | Noise reducing device using active noise control and method for the same | |
| JP2016522444A (en) | Acoustic device with active noise reduction processing capability | |
| US11996074B2 (en) | Signal processing device and signal processing device, and sound device | |
| US20230377554A1 (en) | Adaptive noise cancellation and speech filtering for electronic devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221124 Address after: No. 500, Songling Road, Laoshan District, Qingdao, Shandong 266101 Applicant after: GOERTEK TECHNOLOGY Co.,Ltd. Address before: 261061 workshop 1, phase III, Geer Photoelectric Industrial Park, 3999 Huixian Road, Yongchun community, Qingchi street, high tech Zone, Weifang City, Shandong Province Applicant before: GoerTek Optical Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |