CN108769883B - Head-mounted electronic device and sound collection method - Google Patents
Head-mounted electronic device and sound collection method Download PDFInfo
- Publication number
- CN108769883B CN108769883B CN201810652016.9A CN201810652016A CN108769883B CN 108769883 B CN108769883 B CN 108769883B CN 201810652016 A CN201810652016 A CN 201810652016A CN 108769883 B CN108769883 B CN 108769883B
- Authority
- CN
- China
- Prior art keywords
- electronic device
- acquisition
- audio
- unit
- modules
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The embodiment of the invention provides electronic equipment and a sound acquisition method. An electronic device according to an embodiment of the present invention includes: a first acquisition unit comprising: the first acquisition unit is provided with a first acquisition state and a second acquisition state, the adjustment module adjusts the audio acquisition modules in the first acquisition state, so that the first acquisition unit can acquire the sound emitted by an object in a first space region relative to the electronic equipment through the audio acquisition modules and generate a corresponding first audio signal, and the adjustment module adjusts the audio acquisition modules in the second acquisition state, so that the first acquisition unit can acquire the sound emitted by the object in a second space region relative to the electronic equipment through the audio acquisition modules and generate a corresponding second audio signal; and a processing unit.
Description
The application is a divisional application of an invention patent application with an application date of 2012, 12 and 17, an application number of 201210549520.9, and an invention name of "electronic equipment and sound collection method".
Technical Field
Embodiments of the present invention relate to an electronic device and a corresponding sound collection method.
Background
In recent years, with the development of technology, various electronic devices, such as desktop computers, notebook computers, tablet computers, smart phones, game machines, portable multimedia players, and the like, have been widely used. Many electronic devices today include sound pickup components, such as microphones, to facilitate the collection of sounds emitted around the electronic device to enable a user to conduct operations such as voice/video calls.
On the other hand, as the performance of terminal devices continues to improve, the operations that users can perform through the terminal devices continue to increase. For example, many current smartphones are equipped with image capture components. Therefore, in addition to voice/video calls, the user can take video shots of the object of interest thereof through the image pickup section and the sound pickup section.
However, since the omnidirectional-type sound pickup section is employed in many of the electronic devices at present, at the time of sound collection, the obtained audio signal includes many sounds that the user does not wish to acquire in addition to the sound of the target collection object. In response to this problem, sound pickup sections provided for a predetermined collection purpose have been proposed. For example, in a mobile phone, a sound pickup component may be provided for the location of the user, usually relative to the mobile phone, when making a call. However, in the case of performing sound collection using a sound pickup section for a non-predetermined collection purpose, for example, when performing video collection for the surrounding environment using a mobile phone in the above-described example, excessive noise in the collected audio signal and degradation in signal quality are easily caused.
Disclosure of Invention
An object of an embodiment of the present invention is to provide an electronic device and a sound collection method, so as to solve the above problems.
One embodiment of the present invention provides an electronic device having at least a first acquisition state, the electronic device comprising: a first acquisition unit comprising: the first acquisition unit is provided with a first acquisition state and a second acquisition state, the adjustment module adjusts the audio acquisition modules in the first acquisition state, so that the first acquisition unit can acquire the sound emitted by an object in a first space region relative to the electronic equipment through the audio acquisition modules and generate a corresponding first audio signal, and the adjustment module adjusts the audio acquisition modules in the second acquisition state, so that the first acquisition unit can acquire the sound emitted by the object in a second space region relative to the electronic equipment through the audio acquisition modules and generate a corresponding second audio signal; and a processing unit configured to receive the first audio signal or the second audio signal and perform a first signal processing on the first audio signal or the second audio signal.
Another embodiment of the present invention further provides a sound collection method applied to an electronic device, where the electronic device includes a plurality of audio collection modules disposed at different positions of the electronic device, and the electronic device has a first collection state and a second collection state. The method comprises the following steps: in a first acquisition state, adjusting the plurality of audio acquisition modules, so that the first acquisition unit can acquire sounds emitted by an object located in a first space region relative to the electronic equipment through the plurality of audio acquisition modules, acquire the sounds emitted by the object in the first space region through the first acquisition unit, generate corresponding first audio signals, and perform first signal processing on the first audio signals; and under the second acquisition state, adjusting the plurality of audio acquisition modules, so that the first acquisition unit can acquire the sound emitted by the object located in the second space region relative to the electronic equipment through the plurality of audio acquisition modules, acquire the sound emitted by the object in the second space region through the first acquisition unit, generate a corresponding second audio signal, and perform first signal processing on the second audio signal.
In the electronic device and the sound collection method according to the embodiments of the present invention, the sound collection unit may include a plurality of audio collection modules disposed at different positions of the electronic device, so that sound collection may be performed by using different audio collection modules of the plurality of audio collection modules for different spatial regions with respect to the electronic device, thereby improving quality of audio collection.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are required to be used in the description of the embodiments of the present invention will be briefly described below.
FIG. 1 is an exemplary block diagram illustrating an electronic device according to one embodiment of the invention.
Fig. 2 is an explanatory diagram showing one example scenario of the electronic apparatus shown in fig. 1.
Fig. 3 is an explanatory diagram showing a modified example situation of the electronic apparatus shown in fig. 2.
Fig. 4 is an explanatory diagram showing another exemplary situation of the electronic apparatus shown in fig. 1.
Fig. 5 is an exemplary block diagram illustrating a display unit according to one example of the present invention.
Fig. 6 is an explanatory diagram showing one schematic situation of the display unit shown in fig. 5.
Fig. 7 is a flowchart describing a sound collection method according to an embodiment of the present invention.
Detailed Description
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that in the present specification and the drawings, steps and elements having substantially the same structure are denoted by the same reference numerals, and repeated explanation of the steps and elements will be omitted.
Next, an electronic apparatus of one embodiment of the present invention will be described with reference to fig. 1. FIG. 1 shows an exemplary block diagram of an electronic device 100 according to one embodiment of the invention. As shown in fig. 1, the electronic device 100 includes a first capturing unit 110 and a processing unit 120, wherein the first capturing unit 110 includes a plurality of audio capturing modules 111, 112, 113, and 114 disposed at different positions of the electronic device, and an adjusting module 115. It should be noted that although in the example shown in fig. 1, the description has been made taking an example in which the first capture unit 110 includes four audio capture modules (i.e., the audio capture modules 111, 112, 113, and 114), the present invention is not limited thereto. In alternative examples, the first capture unit 110 may further include more audio capture modules, and furthermore, the first capture unit 110 may also include only two or three audio capture modules.
The first acquisition unit 110 has a first acquisition state and a second acquisition state. In the first capture state, the adjustment module 115 adjusts the audio capture modules 111, 112, 113, and 114 such that the first capture unit 110 is capable of capturing sounds emitted by objects located in a first spatial region relative to the electronic device via the audio capture modules 111, 112, 113, and 114 and generating corresponding first audio signals. In the second capture state, the adjustment module 115 adjusts the audio capture modules 111, 112, 113, and 114 such that the first capture unit 110 is capable of capturing sounds emitted by objects located in a second spatial region relative to the electronic device via the audio capture modules 111, 112, 113, and 114 and generating corresponding second audio signals.
According to an example of the present invention, the first spatial region may be a spatial region toward which a surface of the electronic apparatus 100 close to the user faces when the electronic apparatus 100 is normally used, and the second spatial region may be a spatial region toward which a surface of the electronic apparatus 100 away from the user faces when the electronic apparatus 100 is normally used. For example, when the electronic apparatus 100 is a personal computer, the first spatial region may be a spatial region where a surface on which a display screen of the electronic apparatus 100 is located is oriented, that is, a spatial region where a user is generally located when using the personal computer, so that in the first collecting state, when the user uses the personal computer, the first collecting unit 110 can collect sounds emitted by the user located in the first spatial region through the audio collecting modules 111, 112, 113, and 114 and generate corresponding first audio signals. And the second spatial region may be a surface-oriented spatial region of the electronic device 100 opposite to the surface on which its main display screen is located, i.e. a spatial region that is generally oriented towards the user when the user is using the personal computer, so that in the second capturing state, when the user is using the personal computer, the first capturing unit 110 is able to capture sounds made by objects located in the second spatial region towards the user through the audio capturing modules 111, 112, 113 and 114 and generate corresponding second audio signals.
According to an example of the present invention, the user may manually control the adjustment module 115 as needed in order to switch the first acquisition unit 110 into the first acquisition state or the second acquisition state. Alternatively, according to another example of the present invention, the processing unit 120 may determine that the electronic device should be in the first acquisition state or the second acquisition state according to a currently running application, and output the determination result. And the adjustment module 115 may perform adjustment according to the determination result. For example, assuming that the electronic device 110 is a smartphone, the processing unit 120 may determine that the electronic device should be in the first capture state if the electronic device 110 is currently running a video voice call application, and output the determination result. The adjustment module 115 may adjust the first acquisition unit 110 to a first acquisition state according to the determination result. And the processing unit 120 may determine that the electronic device should be in the second capture state if the electronic device 110 is currently running the video capture application, and output the determination result. The adjustment module 115 may adjust the first acquisition unit 110 to the second acquisition state according to the determination result.
Further, according to an example of the present invention, the audio capture modules may be previously divided into a first module group for a first spatial region and a second module group for a second spatial region. In the first acquisition state, the adjusting module performs second signal processing on the sound acquired by the audio acquisition module included in the first module group to generate a first audio signal. And in the second acquisition state, the adjusting module performs third signal processing on the sound acquired by the audio acquisition module included in the second module group to generate a second audio signal.
For example, the audio capture modules 111 and 112 may be disposed on a first surface of the electronic device 100 to facilitate capturing sounds emitted by objects proximate to the first surface of the electronic device 100. The audio capturing modules 113 and 114 may be disposed on the second surface of the electronic device 100 to facilitate capturing sounds emitted by objects proximate to the second surface of the electronic device 100. The audio capturing modules 111, 112, 113, and 114 may be divided in advance into a first module group including the audio capturing modules 111 and 112, and a second module group including the audio capturing modules 113 and 114. In the first capture state, the adjustment module 115 performs second signal processing on the sounds captured by the audio capture modules 111 and 112 included in the first module group to generate a first audio signal. And in the second capture state, the adjustment module performs third signal processing on the sounds captured by the audio capture modules 113 and 114 included in the second module group to generate a second audio signal. For example, in the first capture state, the adjustment module 115 performs signal synthesis processing on the sounds captured by the audio capture modules 111 and 112 included in the first module group to generate a first audio signal. In the second capture state, the adjustment module 115 may perform signal synthesis processing on the sounds captured by the audio capture modules 113 and 114 included in the second module group to generate a second audio signal.
Preferably, in the first capture state, the adjusting module 115 turns on the audio capture module included in the first module group and turns off the audio capture module included in the second module group; in the second capture state, the adjusting module 115 turns on the audio capture module included in the second module group and turns off the audio capture module included in the first module group. Thereby saving power consumption of the electronic device.
According to another example of the present invention, a first module group for a first direction may be predetermined in the audio capturing modules 111, 112, 113, and 114. In the first acquisition state, the adjusting module performs second signal processing on the sound acquired by the audio acquisition module included in the first module group to generate a first audio signal. Further, in this example, the electronic device 100 may further include: and a second acquisition unit. The second acquisition unit may obtain a third acquisition signal. Alternatively, the second acquisition unit may include an image acquisition module and/or a proximity sensing module. The processing unit 120 may determine whether a collection object near the electronic device exists according to the third collection signal in the second collection state, and determine an object position of the collection object relative to the electronic device according to the third collection signal when it is determined that the collection object exists. The adjusting module 115 determines a third module group for the object position among the audio capturing modules 111, 112, 113, and 114 according to the object position determined by the processing unit 120 in the second capturing state, and performs fourth signal processing on the sound captured by the audio capturing modules included in the third module group to generate a second audio signal. In the present example, the signal quality of the audio signal regarding the capture object obtained by the audio capture module included in the third module group is superior to the signal quality of the audio signal regarding the capture object obtained by the other audio capture modules.
For example, the electronic device 100 further comprises a second acquisition unit comprising an image acquisition module. When the first capturing unit 110 is in the second capturing state, the image capturing module obtains the image capturing signal as a third capturing signal. Then, the processing unit 120 may analyze the image capture signal obtained by the image capture module according to features such as a human face shown in the image capture signal, a size of the specific object, a position of the specific object in the screen, and the like, to determine whether a capture object close to the electronic device exists, and when it is determined that the capture object exists, further determine an object position of the capture object relative to the electronic device. According to an example of the present invention, the acquisition object may be a person or animal or the like of interest to a user of the electronic device 100. In the second capture state, the adjustment module 115 determines a third module group for the object position among the plurality of audio capture modules according to the object position determined by the processing unit 120, for example, the audio capture module 111 may be disposed on the first surface of the electronic device 100 so as to capture the sound emitted by an object close to the first surface of the electronic device 100. The audio capturing modules 112, 113, and 114 may be disposed on the second surface of the electronic device 100 to facilitate capturing sounds emitted by objects proximate to the second surface of the electronic device 100. When the adjustment module 115 determines that the object is located closer to the second surface of the electronic device 100 and the distance from the acquisition modules 112 and 113 is less than the predetermined value, the acquisition modules 112 and 113 may be regarded as a third module group. Then, the adjusting module 115 may perform fourth signal processing on the sounds collected by the collecting modules 112 and 113 to generate a second audio signal.
Further, in the case where the electronic device 100 further includes a second acquisition unit including an image acquisition module, according to another example of the present invention, after the processing unit 120 determines that there is an acquisition object close to the electronic device according to the image acquisition signal, the processing unit 120 may further determine whether a position of the acquisition object is changed according to an image acquisition signal photographed next, and when the position of the acquisition object is changed, the adjustment module 115 may re-determine an audio acquisition module included in the third module group. Therefore, the electronic device can automatically adjust the first acquisition unit 110 according to the position of the acquisition object, and the pertinence of the acquired audio signal is enhanced.
The processing unit 120 may receive the first audio signal or the second audio signal from the first acquisition unit 110 and perform first signal processing, such as audio encoding/decoding, on the first audio signal or the second audio signal.
Through the electronic equipment provided by the embodiment of the invention, the sound acquisition unit can comprise a plurality of audio acquisition modules arranged at different positions of the electronic equipment, so that sound can be picked up by using different audio acquisition modules in the plurality of audio acquisition modules aiming at different spatial regions relative to the electronic equipment, and the quality of audio acquisition is improved.
In embodiments of the present invention, the electronic device may be a personal computer, a notebook computer, a tablet computer, a mobile phone, a portable multimedia player, and the like. In addition, in order to liberate the two hands of the user, change the operation posture of the user and bring better use experience to the user while reducing the occupied space, the electronic equipment according to the embodiment of the invention can also be head-mounted electronic equipment. Specifically, the electronic apparatus according to an embodiment of the present invention may further include a fixing unit, wherein the electronic apparatus can be worn on the head by the fixing unit.
For example, the fixing unit may include a headband member. In addition, the electronic apparatus according to the embodiment of the present invention further includes a first housing provided at the first end of the headband member, and a second housing provided at the second end of the headband member. When the headband member is worn on the head, the headband member can be flexibly deformed such that the first and second housings are pressed against the left and right ears, respectively. The processing unit is disposed in the first housing and the plurality of audio capture modules are disposed on the headband assembly, the first housing, and/or the second housing.
Furthermore, according to another embodiment of the present invention, the electronic apparatus may further include a connection unit and a display unit, wherein the connection unit connects the fixing unit and the display unit. In this case, the processing unit may also obtain a first image to be displayed. The electronic device may transmit the first image to the display unit via wired or wireless transmission. Thus, the display unit may display the first image. The connection unit may have a first connection state and a second connection state. At least a first portion of the display unit is located within a viewable area of a user and facing the user when the connection unit is in the first connection state. And in the second connection state of the connection unit, the display unit is positioned in the first shell and/or the second shell. The plurality of audio capture modules may also be disposed on the connection unit and/or the non-display area of the display unit.
Fig. 2 is an explanatory diagram showing one example scenario of the electronic apparatus shown in fig. 1. As shown in fig. 2, the electronic device 200 includes a headband part 210, a connection unit including a first sub-connection unit 221 and a second sub-connection unit 222, and a display unit including a first sub-display unit 231 and a second sub-display unit 232.
The headband part 210 is an example of the fixing unit described above. The first sub-coupling unit 221 couples the first end of the head band part 210 and the first sub-display unit 231, and the second sub-coupling unit 222 couples the second end of the head band part 210 and the second sub-display unit 232.
Specifically, when the headband component 210 is worn on the head, the headband component 210 can be flexibly deformed. The first and second sub-connection units 221 and 222 may have a first connection state. In the first connection state, the first sub-connection unit 221 and the second sub-connection unit 222 may support the first sub-display unit 231 and the second sub-display unit 232 such that the first sub-display unit 231 and the second sub-display unit 232 are located within a visible region of a user and face the user.
Further, according to another example of the present invention, the first sub-connection unit 221 and the second sub-connection unit 222 may also have a second connection state. In the second connection state, the first sub-connection unit 221 and the second sub-connection unit 222 may be in a folded state such that the first sub-display unit 231 is pressed against the left ear of the user and the second sub-display unit 232 is pressed against the right ear of the user, so that the first sub-display unit 231 and the second sub-display unit 232 may be moved away from the user's visible area.
In addition, as shown in fig. 2, the electronic device 200 further includes a first housing 240 disposed at a first end of the headband component 210 and a second housing 250 disposed at a second end of the headband component. For example, in the second connection state, the first sub-connection unit 221 and the first sub-display unit 231 may be received in the first housing 240, and the second sub-connection unit 222 and the second sub-display unit 232 may be received in the second housing 250.
In addition, the electronic device 200 further includes a first acquisition unit. As shown in fig. 2, the first capture unit includes an adjustment module and first and second audio capture modules 261 and 262 provided on the headband part 210, third and fourth audio capture modules 263 and 264 provided on the first housing 240, fifth and sixth audio capture modules 265 and 266 provided on the second housing 250, a seventh audio capture module 267 provided on the first sub-connection unit 221, an eighth audio capture module 268 provided on the second sub-connection unit 222, a ninth audio capture module 269 provided on the side of the first sub-display unit 231 remote from the user, and a tenth audio capture module 270 provided on the side of the second sub-display unit 232 remote from the user.
As described above, the audio capture modules may be previously divided into a first module group for a first spatial region and a second module group for a second spatial region. For example, in the example shown in fig. 2, the first to tenth audio collecting modules may be divided into a first module group for collecting an object focused by a user wearing the electronic device 200 and a second module group for collecting an object focused by the user wearing the electronic device 200, wherein the first module group includes a fourth audio collecting module 264 and a fifth audio collecting module 265 provided on the first casing 240 and the second casing 250, which are close to the mouth of the user when the electronic device 200 is worn on the head of the user, and the second module group may include the remaining audio collecting modules. In the first capture state, the adjusting module in the first capture unit performs signal synthesis processing on the sounds captured by the fourth audio capture module 264 and the fifth audio capture module 265 included in the first module group to generate a first audio signal. In the second capture state, the adjusting module in the first capture unit may perform signal synthesis processing on the sounds captured by the audio capture modules 261, 263 and 266 to 270 included in the second module group to generate a second audio signal.
Further alternatively, in the second capture state, a third module group for the position of the object may be determined in the audio capture module 261 and 270 according to the position of the capture object relative to the electronic device, and the sound captured by the audio capture module included in the third module group may be signal-processed to generate the second audio signal.
Specifically, fig. 3 is an explanatory diagram showing a modified example situation of the electronic apparatus shown in fig. 2. In the example shown in fig. 3, the electronic device 200' includes various units and modules included in the electronic device 200 shown in fig. 2, and thus, detailed description thereof is omitted. In addition, the electronic device 200' further comprises a second acquisition unit 310. As shown in fig. 3, the second acquisition unit 310 may be provided on the headband component 210. Alternatively, the second collecting unit 310 may also be provided on the connecting unit, the display unit, the first housing or the second housing.
In the example shown in fig. 3, the second acquisition unit is an image acquisition unit for obtaining an image acquisition signal. In the second acquisition state of the electronic device 200', the processing unit in the electronic device may determine whether an acquisition object close to the electronic device exists according to the image acquisition signal, and when it is determined that the acquisition object exists, determine an object position of the acquisition object relative to the electronic device according to the third acquisition signal. In the second capture state, the adjustment module determines a third module group for the object position in the audio capture module 261 and 270 according to the object position determined by the processing unit, and performs a fourth signal processing on the sound captured by the audio capture module included in the third module group to generate a second audio signal. For example, when the processing unit determines that the capture object exists in the region B shown in fig. 3 according to the image capture signal, the adjustment module may determine that the third module group includes the third audio capture module 263 and the fourth audio capture module 264 for the region B. When the processing unit determines from the image capture signal that the capture object exists in the region C shown in fig. 3, the adjustment module may determine that the third module group includes the first audio capture module 261, the second audio capture module 262, the seventh audio capture module 267, the eighth audio capture module 268, the ninth audio capture module 269, and the tenth audio capture module 270 for the region C. When the processing unit may determine from the image acquisition signal that an acquisition object exists in the region D shown in fig. 3, the adjustment module may determine that the third module group includes the fifth and sixth audio acquisition modules 265 and 266 for the region D. Further, when the processing unit determines that the capture object exists in the area a shown in fig. 3 according to the image capture signal, the adjustment module may determine that the third module group includes a third audio capture module 263 and a fourth audio capture module 264, wherein the area B for which the third audio capture module 263 and the fourth audio capture module 264 are located is closest to the area a. And when the processing unit determines from the image acquisition signal that the acquisition object exists in the region E shown in fig. 3, the adjustment module may determine that the third module group includes the fifth audio acquisition module 265 and the sixth audio acquisition module 266, wherein the region D for which the fifth audio acquisition module 265 and the sixth audio acquisition module 266 are located is closest to the region E. Therefore, the plurality of audio acquisition modules in the first acquisition unit can be set according to the position of the object which is expected to be acquired by the user, so as to improve the quality of the acquired audio signal.
Alternatively, in the example shown in fig. 3, when the processing unit determines that the capture object is located in the zone B according to the image capture signal after the processing unit determines that the capture object moves from the zone B into the zone C according to the image capture signal next obtained by the second capture unit 310, the adjustment module may change the third module group including the audio capture module from the third audio capture module 263 and the fourth audio capture module 264 to the first audio capture module 261, the second audio capture module 262, the seventh audio capture module 267, the eighth audio capture module 268, the ninth audio capture module 269, and the tenth audio capture module 270 so as to perform sound capture with respect to the position of the object.
The above description has been made in conjunction with fig. 2, taking as an example that the fixing unit includes the headband means. The head-mounted electronic device according to the embodiment of the present invention is not limited thereto. According to another example of the present invention, the electronic device may also be a glasses type electronic device.
Fig. 4 is an explanatory diagram showing another exemplary situation of the electronic apparatus shown in fig. 1. As shown in fig. 4, the electronic device 400 includes a frame member 410, a lens member 420 coupled to the frame member 410, a fixing unit including a first support arm, a second support arm, and a third holding portion (not shown), a processing unit, and a first collecting unit.
As shown in fig. 4, the first support arm includes a first connection portion 431 (shown in phantom in fig. 4) and a first holding portion 432. The first connecting portion 431 connects the frame member 410 and the first holding portion 432. The second support arm includes a second connecting portion 441 (shown in phantom in fig. 4) and a second retaining portion 442. The second connecting portion 441 connects the frame member 410 and the second holding portion 442. The third holding portion is provided on the frame member 410. Specifically, the third retaining portion may be provided at a location where the frame member 410 is located between the two lens members. The electronic device 400 is held on the head of the user by the first holding portion 432, the second holding portion 442, and the third holding portion. In particular, the first and second holding portions 432, 442 can be used to support the first and second support arms at the user's ears, while the third holding portion can be used to support the frame member 410 at the user's nose bridge.
Further, according to still another embodiment of the present invention, the electronic device 400 may further include a first data transmission line and a display unit. In particular, the first data transmission line may be provided in the fixed unit and the frame member. The first data transmission line may transmit the first video signal to the display unit. The display unit may display to a user according to the first video signal. In the present embodiment, the first video signal may be a video signal corresponding to the first audio signal. For example, when the user watches a movie through the electronic device 400, the first video signal may be an image signal of the movie, and the first audio signal may be an audio signal of the movie corresponding to the image signal. For another example, when the user makes a video call through the electronic device 400, the first video signal may be an image signal from the communication party, and the first audio signal may be an audio signal from the communication party. Alternatively, the first video signal is independent of the first audio signal. For example, the first video signal may be an image signal regarding a picture, a video image, text, a combination of a picture, text, and a picture, and the like. A separate storage unit may be provided in the electronic device 400 to store the image files. Alternatively, the electronic device 400 may also receive an image file to be displayed from an electronic device such as a computer, a smart phone, a multimedia player, and the like connected thereto by wire or wirelessly. For example, the electronic device 400 may further include a communication unit to receive an image file to be displayed from an electronic device such as a computer, a smart phone, a multimedia player, and the like. Further, although the description has been made taking the data transmission line as an example in the present embodiment, the present invention is not limited thereto, and for example, according to another example of the present invention, the first video signal may also be transmitted to the display unit by wireless transmission.
Fig. 5 is an exemplary block diagram illustrating a display unit according to one example of the present invention. As shown in fig. 5, the display unit 500 may include a first display module 510, a first optical system 520, a first light guide member 530, and a second light guide member 540. Fig. 6 is an explanatory diagram showing one schematic situation of the display unit 500 shown in fig. 5.
The first display module 510 may be provided in the frame member 410 and connected with the first data transmission line. The first display module 510 can display a first image according to the first video signal transmitted by the first data transmission line. According to an example of the present invention, the first display module 510 may be a display module of a micro display screen having a small size.
The first optical system 520 may also be provided in the frame member 410. The first optical system 520 may receive light emitted from the first display module and perform optical path conversion on the light emitted from the first display module to form a first enlarged virtual image. That is, the first optical system 520 has a positive refractive power. So that the user can clearly view the first image and the size of the image viewed by the user is not limited by the size of the display unit.
For example, the optical system may include a convex lens. Alternatively, the optical system may also form a lens assembly from a plurality of lenses including convex and concave lenses in order to reduce aberrations, avoid interference with imaging by chromatic dispersion, etc., resulting in a better visual experience for the user. Further, according to an example of the present invention, the first display module 510 and the first optical system 520 may be disposed correspondingly along an optical axis of the optical system. Alternatively, according to another example of the present invention, the display unit may further include a fifth light guide member to transmit the light emitted from the first display module 510 to the first optical system 520.
As shown in fig. 6, after the first optical system 520 receives the light emitted from the first display module 510 and performs optical path conversion on the light emitted from the first display module 510, the first light guide member 530 may transmit the light passing through the first optical system to the second light guide member 540. The second light guide member 540 may be disposed in the lens member 420. And the second light guide member may receive the light transmitted through the first light guide member 530 and reflect the light transmitted through the first light guide member 530 toward the eyes of the user wearing the electronic device.
Returning to fig. 4, optionally, the lens part 420 satisfies a first predetermined light transmittance in a direction from the inner side to the outer side so that the user can view the surrounding environment while viewing the first magnified virtual image. On the other hand, the lens satisfies a second predetermined light transmittance in a direction from the outer side to the inner side. So that part of the light can be refracted or reflected when the light in the surrounding environment is strong.
Further, as shown in fig. 4, according to one example of the present invention, the frame member 410 may include a first stub portion 411 connected to the first support arm and a first stub portion 412 connected to the second support arm (a portion of the frame member shown in a circle in fig. 4).
Furthermore, the electronic device 400 further comprises a first acquisition unit. As shown in fig. 4, the first capturing unit includes an adjusting module and first, second, third and fourth audio capturing modules 451, 452, 453 and 454 provided on the frame member 410 and the fixing unit. The first collecting unit in the electronic device according to the embodiment of the invention has been described in detail with reference to fig. 1 to 3, and therefore, the description thereof is omitted here.
Next, a sound collection method according to an embodiment of the present invention will be described with reference to fig. 7. Fig. 7 is a flow chart depicting a sound collection method 700 in accordance with an embodiment of the present invention. The sound collection method 700 is used with the electronic device described above in connection with fig. 1-4. As described above, an electronic device according to an embodiment of the present invention includes a plurality of audio capture modules disposed at different locations of the electronic device, and the electronic device has a first capture state and a second capture state. The electronic device according to the embodiment of the present invention has been described in detail above with reference to the accompanying drawings. Therefore, for brevity of description, no further description is provided.
As shown in fig. 7, in step S710, it is determined whether the electronic device is in the first capture state. According to an example of the present invention, the user may manually switch the first acquisition unit to the first acquisition state or the second acquisition state as desired. In step S710, it may be determined whether the electronic device is in the first capture state according to a result of the manual switching by the user. Alternatively, according to another example of the present invention, it may be determined in step S710 that the electronic device should be in the first acquisition state or the second acquisition state according to a currently running application, and the determination result may be output.
When the electronic device is in the first capture state, in step S720, the plurality of audio capture modules are adjusted so that the first capture unit can capture sounds emitted by objects located in the first spatial region relative to the electronic device through the plurality of audio capture modules. Then, in step S730, the sound emitted by the object in the first spatial region is collected by the first collecting unit, and a corresponding first audio signal is generated. Finally, in step S740, the first audio signal is subjected to first signal processing.
On the other hand, when the electronic device is not in the first capture state, i.e., when the electronic device is in the second capture state, in step S750, the plurality of audio capture modules are adjusted such that the first capture unit is able to capture sounds emitted by objects located in the second spatial region with respect to the electronic device through the plurality of audio capture modules. Then, in step S760, sounds emitted by objects in the second spatial region are captured by the first capturing unit and corresponding second audio signals are generated. Finally, the second audio signal is subjected to the first signal processing at step S770.
Further, according to an example of the present invention, the audio capture modules may be previously divided into a first module group for a first spatial region and a second module group for a second spatial region. In step S720, the plurality of audio capture modules are adjusted such that the first capture unit is capable of capturing sounds emitted by objects located in a first spatial region relative to the electronic device through the audio capture modules included in the first module group. In step S730, second signal processing is performed on the sound collected by the audio collection module included in the first module group to generate a first audio signal. On the other hand, in step S750, the plurality of audio capture modules are adjusted such that the first capture unit is capable of capturing sounds emitted by objects located in a second spatial region with respect to the electronic device through the audio capture modules included in the second module group. In step S760, third signal processing is performed on the sound collected by the audio collection module included in the second module group to generate a second audio signal.
Preferably, in step S720, the audio capture module included in the first module group may be turned on, and the audio capture module included in the second module group may be turned off; and the audio collection module included in the second module group may be turned on and the audio collection module included in the first module group may be turned off in step S750. Thereby saving power consumption of the electronic device.
According to another example of the present invention, a first module group for a first direction may be predetermined among a plurality of audio capturing modules. In step S720, the plurality of audio capture modules are adjusted such that the first capture unit is capable of capturing sounds emitted by objects located in a first spatial region relative to the electronic device through the audio capture modules included in the first module group. And in step S730, second signal processing is performed on the sound collected by the audio collection module included in the first module group to generate a first audio signal. Further, in this example, the electronic device may further include: and a second acquisition unit. The second acquisition unit may obtain a third acquisition signal. Alternatively, the second acquisition unit may include an image acquisition module and/or a proximity sensing module. It may be determined whether a capture object close to the electronic device exists according to the third capture signal in step S750, and when it is determined that the capture object exists, an object position of the capture object with respect to the electronic device is determined according to the third capture signal, and a third module group for the object position is determined among the plurality of audio capture modules according to the determined object position. Then, fourth signal processing is performed on the sound collected by the audio collection module included in the third module group to generate a second audio signal in step S760. Therefore, the first acquisition unit can be automatically adjusted according to the position of the acquisition object, and the pertinence of the acquired audio signal is enhanced.
In steps S740 and S770, the first audio signal or the second audio signal from the first capture unit may be received and subjected to first signal processing, e.g., audio encoding/decoding.
According to the sound collection method provided by the embodiment of the invention, the sound collection unit can comprise a plurality of audio collection modules arranged at different positions of the electronic equipment, so that sound collection can be carried out by utilizing different audio collection modules in the plurality of audio collection modules aiming at different spatial regions relative to the electronic equipment, and the quality of audio collection is improved.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It should be understood by those skilled in the art that various modifications, combinations, partial combinations and substitutions may be made in the present invention depending on design requirements and other factors as long as they are within the scope of the appended claims and their equivalents.
Claims (9)
1. A head-mounted electronic device having at least a first acquisition state, the electronic device comprising:
a first acquisition unit comprising:
a plurality of audio acquisition modules disposed at different locations of the electronic device, an
The adjustment module is used for adjusting the position of the movable part,
wherein the first acquisition unit has a first acquisition state and a second acquisition state,
in the first capture state, the adjustment module adjusts the plurality of audio capture modules such that the first capture unit is capable of capturing sounds emitted by objects located in a first spatial region relative to the electronic device via the plurality of audio capture modules and generating corresponding first audio signals,
in the second acquisition state, the adjusting module adjusts the plurality of audio acquisition modules so that the first acquisition unit can acquire sounds emitted by objects located in a second spatial region relative to the electronic device through the plurality of audio acquisition modules and generate corresponding second audio signals; and
a processing unit configured to receive the first audio signal or the second audio signal and perform a first signal processing on the first audio signal or the second audio signal, wherein
The electronic device further comprises a fixing unit, wherein the electronic device can be worn on the head by the fixing unit, wherein
The processing unit is further configured to determine, from a currently running application, that the electronic device worn on the head should be in the first acquisition state or the second acquisition state, and to output a determination result,
and the adjusting module adjusts according to the determination result.
2. The electronic device of claim 1, wherein
A first set of modules for a first direction is predetermined among the plurality of audio acquisition modules,
in the first acquisition state, the adjusting module performs second signal processing on the sound acquired by the audio acquisition module included in the first module group to generate the first audio signal;
the electronic device further includes:
a second acquisition unit configured to obtain a third acquisition signal,
the processing unit is further configured to determine, in the second acquisition state, from the third acquisition signal, whether an acquisition object is present near the electronic device, and when it is determined that the acquisition object is present, determine an object position of the acquisition object relative to the electronic device from the third acquisition signal;
the adjusting module determines, in the second acquisition state, a third module group for the object position among the plurality of audio acquisition modules according to the object position determined by the processing unit, and performs fourth signal processing on sound acquired by the audio acquisition modules included in the third module group to generate the second audio signal.
3. The electronic device of claim 2, wherein
The second acquisition unit comprises an image acquisition module and/or a close sensing module.
4. The electronic device of claim 1, wherein
The fixing unit includes:
a headband component which is provided with a headband part,
the electronic device further includes:
a first housing disposed at a first end of the headband component; and
a second housing disposed at a second end of the headband component,
wherein the headband member is flexibly deformable such that the first and second housings are pressed against the left and right ears, respectively, when the headband member is worn on the head,
the processing unit is disposed in the first housing,
the plurality of audio capture modules are disposed on the headband assembly, the first shell, and/or the second shell.
5. The electronic device of claim 4, wherein
The processing unit is further configured to obtain a first image to be displayed;
the electronic device further includes:
a display unit configured to display the obtained first image;
a connection unit configured to connect the fixing unit and the display unit,
wherein the connection unit has a first connection state and a second connection state,
at least a first portion of the display unit is located within a user's viewable area and facing the user when the connection unit is in a first connection state,
the display unit is located in the first housing and/or the second housing in the second connection state of the connection unit, an
The plurality of audio acquisition modules are further arranged on the connection unit and/or a non-display area of the display unit.
6. The electronic device of claim 1, further comprising:
a frame member;
a lens member connected to the frame member;
the fixing unit includes:
a first support arm comprising a first connecting portion and a first holding portion, wherein the first connecting portion is configured to connect the frame member and the first holding portion;
a second support arm including a second connecting portion and a second holding portion, wherein the second connecting portion is configured to connect the frame member and the second holding portion; and
a third holding portion provided on the frame member, the third holding portion being in contact with a bridge of a nose of a user when the electronic apparatus is worn on the head of the user;
wherein the first retaining portion, the second retaining portion, and the third retaining portion are configured to retain the electronic device on a user's head,
wherein the plurality of audio capture modules are disposed on the frame member and/or the fixed unit.
7. The electronic device of claim 6, wherein
The processing unit is further configured to perform video processing and output a first video signal;
the electronic device further includes:
a first data transmission line provided in the fixing unit and the mirror frame member, configured to transmit the first video signal to a display unit;
the display unit includes:
a first display module, disposed in the frame member, configured to display a first image according to a first video signal transmitted by the first data transmission line;
a first optical system provided in the frame member, configured to receive light emitted from the first display module and perform optical path conversion on the light emitted from the first display module to form a first enlarged virtual image;
a first light guide member configured to transmit light passing through the first optical system to a second light guide member;
the second light guide component is arranged in the lens component and is configured to reflect the light transmitted by the first light guide component to the eyes of a user wearing the electronic equipment.
8. The electronic device of claim 7, wherein
The frame member includes:
a first pile head portion connected to the first support arm;
a second pile head portion connected to the second support arm;
the first display module and the first optical system are disposed in the first stub head portion.
9. A sound collection method applied to a head-mounted electronic device, wherein the electronic device comprises a plurality of audio collection modules arranged at different positions of the electronic device, the electronic device has a first collection state and a second collection state, and the method comprises the following steps:
in the first acquisition state of the image data,
adjusting the plurality of audio capture modules such that a first capture unit is capable of capturing sounds emitted by objects located in a first spatial region relative to the electronic device through the plurality of audio capture modules,
acquiring, by the first acquisition unit, sounds emitted by objects in a first spatial region and generating corresponding first audio signals,
performing first signal processing on the first audio signal; and
in the second acquisition state of the system, the first acquisition state,
adjusting the plurality of audio capture modules such that the first capture unit is capable of capturing sounds emitted by objects located in a second spatial region relative to the electronic device through the plurality of audio capture modules,
collecting, by the first collecting unit, sounds emitted by objects in a second spatial region and generating corresponding second audio signals,
performing a first signal processing on the second audio signal,
wherein the electronic device is wearable on the head by a fixing unit, the method further comprising:
determining that the electronic device worn on the head should be in the first acquisition state or the second acquisition state according to a currently running application, and outputting a determination result,
and adjusting the plurality of audio acquisition modules according to the determination result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810652016.9A CN108769883B (en) | 2012-12-17 | 2012-12-17 | Head-mounted electronic device and sound collection method |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810652016.9A CN108769883B (en) | 2012-12-17 | 2012-12-17 | Head-mounted electronic device and sound collection method |
| CN201210549520.9A CN103873998B (en) | 2012-12-17 | 2012-12-17 | Electronic equipment and sound collection method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210549520.9A Division CN103873998B (en) | 2012-12-17 | 2012-12-17 | Electronic equipment and sound collection method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108769883A CN108769883A (en) | 2018-11-06 |
| CN108769883B true CN108769883B (en) | 2021-09-14 |
Family
ID=50912055
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210549520.9A Active CN103873998B (en) | 2012-12-17 | 2012-12-17 | Electronic equipment and sound collection method |
| CN201810652016.9A Active CN108769883B (en) | 2012-12-17 | 2012-12-17 | Head-mounted electronic device and sound collection method |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210549520.9A Active CN103873998B (en) | 2012-12-17 | 2012-12-17 | Electronic equipment and sound collection method |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN103873998B (en) |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1547434B8 (en) * | 2002-07-26 | 2012-03-07 | Oakley, Inc. | Wireless interactive headset |
| KR100565309B1 (en) * | 2003-11-25 | 2006-03-30 | 엘지전자 주식회사 | Mic switching apparatus and method for mobile communication terminal having camcorder function |
| CN101174028B (en) * | 2004-03-29 | 2015-05-20 | 索尼株式会社 | Optical device and virtual image display device |
| JP4893146B2 (en) * | 2006-08-07 | 2012-03-07 | ヤマハ株式会社 | Sound collector |
| JP4961914B2 (en) * | 2006-09-08 | 2012-06-27 | ソニー株式会社 | Imaging display device and imaging display method |
| JP5401760B2 (en) * | 2007-02-05 | 2014-01-29 | ソニー株式会社 | Headphone device, audio reproduction system, and audio reproduction method |
| CN101753221A (en) * | 2008-11-28 | 2010-06-23 | 新兴盛科技股份有限公司 | Butterfly temporal bone conductive communication and/or hear-assisting device |
| US8212855B2 (en) * | 2009-04-29 | 2012-07-03 | Embarq Holdings Company, Llc | Video conferencing eyewear |
| CN102137318B (en) * | 2010-01-22 | 2014-08-20 | 华为终端有限公司 | Method and device for controlling adapterization |
| CN201639751U (en) * | 2010-03-11 | 2010-11-17 | 成都丹玛尼科技有限公司 | Fixed-direction and fixed-distance voice collecting system based on multi-microphone array |
-
2012
- 2012-12-17 CN CN201210549520.9A patent/CN103873998B/en active Active
- 2012-12-17 CN CN201810652016.9A patent/CN108769883B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN103873998B (en) | 2018-07-03 |
| CN103873998A (en) | 2014-06-18 |
| CN108769883A (en) | 2018-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9900676B2 (en) | Wearable computing device with indirect bone-conduction speaker | |
| US9316835B2 (en) | Head worn display device | |
| US9245389B2 (en) | Information processing apparatus and recording medium | |
| US8573866B2 (en) | Head-mounted face image capturing devices and systems | |
| US9542958B2 (en) | Display device, head-mount type display device, method of controlling display device, and method of controlling head-mount type display device | |
| CN202735594U (en) | Display device | |
| US20160313973A1 (en) | Display device, control method for display device, and computer program | |
| WO2015125626A1 (en) | Display control device, display control method, and computer program | |
| CN109407757B (en) | Display system | |
| US20060203998A1 (en) | Eyeglass-attached video display based on wireless transmission from a cell phone | |
| US9578423B2 (en) | Electronic device and sound capturing method | |
| JP2009232133A (en) | Portable terminal | |
| KR20180105963A (en) | Mobile terminal | |
| JP6364735B2 (en) | Display device, head-mounted display device, display device control method, and head-mounted display device control method | |
| KR20170112898A (en) | Wareable device | |
| US10306142B2 (en) | Headset | |
| KR20160004129A (en) | Glass type terminal | |
| CN107203046B (en) | Head-mounted electronic device and audio processing method | |
| CN103364950A (en) | Display device and display method | |
| KR20130067902A (en) | Mobile communication terminal in form of spectacles | |
| CN108769883B (en) | Head-mounted electronic device and sound collection method | |
| JP2016033763A (en) | Display device, method for controlling display device, and program | |
| WO2017218263A1 (en) | Hands-free headset for use with mobile communication device | |
| KR20150084603A (en) | Near to eye display and wearable device having the same | |
| US11323664B1 (en) | Wearable electronic device for providing audio output and capturing visual media |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |