CN111429928A - Hearing aid system with radio scene switching function - Google Patents
Hearing aid system with radio scene switching function Download PDFInfo
- Publication number
- CN111429928A CN111429928A CN201911233217.6A CN201911233217A CN111429928A CN 111429928 A CN111429928 A CN 111429928A CN 201911233217 A CN201911233217 A CN 201911233217A CN 111429928 A CN111429928 A CN 111429928A
- Authority
- CN
- China
- Prior art keywords
- scene
- sound
- radio
- image
- reception
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000006870 function Effects 0.000 title claims abstract description 30
- 230000005236 sound signal Effects 0.000 claims abstract description 47
- 238000004458 analytical method Methods 0.000 claims abstract description 23
- 230000000007 visual effect Effects 0.000 claims abstract description 9
- 238000012545 processing Methods 0.000 claims description 32
- 238000000034 method Methods 0.000 claims description 11
- 230000001960 triggered effect Effects 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 claims description 7
- 239000011521 glass Substances 0.000 claims description 5
- 239000004973 liquid crystal related substance Substances 0.000 claims description 3
- 230000011664 signaling Effects 0.000 claims description 2
- 238000013461 design Methods 0.000 abstract description 3
- 238000004891 communication Methods 0.000 description 5
- 238000000605 extraction Methods 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 230000003213 activating effect Effects 0.000 description 3
- 238000007635 classification algorithm Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 235000013311 vegetables Nutrition 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 238000003066 decision tree Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/02—Casings; Cabinets ; Supports therefor; Mountings therein
- H04R1/028—Casings; Cabinets ; Supports therefor; Mountings therein associated with devices performing functions other than acoustics, e.g. electric candles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
- H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
- H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
- H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02087—Noise filtering the noise being separate speech, e.g. cocktail party
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
- H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
- H04R2201/401—2D or 3D arrays of transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2203/00—Details of circuits for transducers, loudspeakers or microphones covered by H04R3/00 but not provided for in any of its subgroups
- H04R2203/12—Beamforming aspects for stereophonic sound reproduction with loudspeaker arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
- H04R2430/25—Array processing for suppression of unwanted side-lobes in directivity characteristics, e.g. a blocking matrix
Abstract
A hearing aid system with radio scene switching function comprises an image acquisition device, a microphone array unit, a radio control device and a sound output device. The sound receiving control device can receive the visual field image acquired by the analysis image acquisition device to judge a matched scene image text, control and start the microphone array unit to receive sound according to a sound receiving strategy corresponding to the scene image text, and output a processed sound signal by the sound output device. The sound reception control device can analyze the view images to screen out the matched scene image texts and the design of the sound reception strategy, so that the started sound reception strategy can be more suitable for the sound reception scene type of the environment where the user is located, and the sound reception control device is a quite innovative creation.
Description
Technical Field
The invention relates to a hearing aid, in particular to a hearing aid system capable of switching reception scenes.
Background
At present, hearing aids can effectively distinguish voices (speech) and noises (noise) by using different characteristics of sound signals to filter noise signals, and can reduce the sound signals from the back and the side of a user by the design of directional microphones, however, the sound sources in daily life environments are various, and the sound signals from the front of the user, except for the voice of a talking object, may still be full of the speaking voice of other people, and most of the voice signals are not wanted by the user, such as environment of vegetable market, restaurant, speech and conference, etc., the speaker sound sources are various and different, but the audio processing chip of the existing microphone cannot recognize these sound scenes to adjust and adopt a proper microphone strategy, and only has a simple function of simply analyzing audio signals to decide to start omnidirectional reception or directional reception, so that there are still many inconveniences in use.
Although more advanced hearing aids can locate the direction of sound through binaural communication and beamforming techniques, when facing forward with multiple speech signals, it is usually impossible to know which direction speech signal is intended by the brain, so that only the most positive speech signal of the user can be retained, so that when facing a scene with one-to-two speech, one-to-three speech, or when there are many people in front of the user speaking, the desired speech signal is often not successfully obtained.
Disclosure of Invention
The present invention is directed to a hearing aid system with a sound scene switching function that can overcome at least one of the disadvantages of the prior art.
The invention relates to a hearing aid system with a radio scene switching function, which is suitable for being worn and used by a user. The hearing aid system comprises an image capturer, a microphone array unit, a sound receiving control device and at least one sound output device, wherein the image capturer can capture a visual field image in front of a user, the sound receiving control device is connected with the image capturer and the microphone array unit through signals, and the sound output device is connected with the sound receiving control device through signals. The microphone array unit comprises a plurality of spaced microphones, and each microphone can be independently controlled to be activated to acquire a sound signal. The radio reception control device comprises a scene analysis module, a radio reception strategy control module and an audio processing module. The scene analysis module is internally provided with a plurality of scene image texts which respectively represent a plurality of scene environments, the view image can be analyzed to obtain at least one corresponding scene image text, the reception strategy control module is internally provided with a plurality of reception strategies which respectively correspond to the scene image texts, the corresponding reception strategies can be started according to the at least one scene image text which is obtained by the analysis of the scene analysis module, so as to control and start a specific number of microphones to receive sound, the audio processing module is internally provided with a plurality of audio processing modes which respectively correspond to the reception strategies, and the audio processing module can receive and process the sound signals picked up by all the started microphones in the corresponding audio processing modes to obtain processed sound signals. The at least one sound output device can output the processed sound signal for the user to listen.
The hearing aid system with the radio reception scene switching function further comprises a display device in signal connection with the radio reception control device, the scene analysis module can analyze the visual field image according to the scene image text to obtain the coincidence degree of each scene image text and the visual field image, each scene image text with the coincidence degree larger than a preset value is transmitted to the display device to be displayed for selection, and the radio reception strategy control module starts a corresponding radio reception strategy according to the selected scene image text to control and start a specific number of microphones to receive the sound.
According to the hearing aid system with the radio scene switching function, the scene analysis module is internally provided with a manual scene mode and an automatic scene mode which can be selected to be started, when the manual scene mode is started, the display equipment is controlled to display all scene image texts for selection, when the automatic scene mode is started, the view images are analyzed according to the scene image texts, and a plurality of scene image texts with the coincidence degree larger than the preset value are transmitted to the display equipment to be displayed for selection.
The hearing aid system with the radio scene switching function further comprises a starting control module, wherein the starting control module can control and start at least one microphone to carry out radio reception so as to obtain the sound signal and can trigger the audio signal processing module to analyze whether the sound signal has voice, and the starting control module can control and start the image capturer and trigger and start the scene analysis module when the audio signal processing module analyzes that the sound signal has voice.
The hearing aid system with the radio scene switching function further comprises a carrier which can be worn on the user, and the image capturer and the microphones of the microphone array units are arranged on the carrier.
The hearing aid system with the radio reception scene switching function is characterized in that the carrier is glasses and is provided with a lens positioned in front of the eyes of the user, and the display equipment is arranged on the carrier and can project and image the scene image text and the view image on the lens through a micro-projection technology for selection.
The hearing aid system with the radio scene switching function is characterized in that the carrier is glasses, and the display equipment is transparent liquid crystal display equipment which is arranged on the carrier and is positioned in front of the eyes of the user.
The hearing aid system with the radio scene switching function comprises a remote control module and a touch display module, wherein a scene radio mode capable of being started is built in the remote control module, when the scene radio mode is started, the remote control module controls the touch display module to display a scene image text for click selection, a scene click signal is generated and transmitted to a radio control device corresponding to the clicked scene image text, and the radio strategy control module is triggered by the scene click signal to start a corresponding radio strategy.
The hearing aid system with the radio scene switching function of the invention also comprises a direction radio control module, the remote control module is internally provided with the scene radio receiving mode and the direction radio receiving mode which can be switched and started, when the remote control module switches and starts the direction sound receiving mode, the touch control display module is controlled to synchronously display the view image for selection, and the direction of the selected image area in the view image is selected, correspondingly generating and transmitting an orientation point selection signal to the radio reception control device, wherein the orientation radio reception control module is triggered by the orientation point selection signal, and controlling to start a specific number of microphones at the set position for receiving sound, the audio signal processing module will use the beam forming method to filter the sound signal picked up by the microphones, so as to obtain the processed sound signal corresponding to the direction in the visual field image represented by the direction point selection signal.
The invention has the following effects: the radio reception control device is internally provided with the scene image text and the radio reception strategy, and the design of screening out the matched scene image text by analyzing the view image can more accurately identify the radio reception scene type of the environment where the user is located, so that the proper radio reception strategy is started, and the radio reception control device is a quite innovative creation.
Drawings
Other features and effects of the present invention will become apparent from the following detailed description of the embodiments with reference to the accompanying drawings, in which:
FIG. 1 is a schematic diagram of an embodiment of a hearing assistance system with radio scene switching function according to the present invention; and
fig. 2 is a functional block diagram of the embodiment.
Detailed Description
Before the present invention is described in detail, it should be noted that in the following description, similar components are denoted by the same reference numerals.
Referring to fig. 1 and 2, an embodiment of a hearing aid system 200 with a function of receiving sound and switching scenes according to the present invention includes a carrier 3 for a user to wear, an image capturing device 4 integrated with the carrier 3, a microphone array unit 5, a sound receiving control device 6, two sound output devices 7, and a display device 8, wherein the sound receiving control device 6 is in signal connection with the image capturing device 4, the microphone array unit 5, and the sound output devices 7. The display device 8 can be designed to be a handheld mobile phone or a tablet, or a wearable or suspended bracelet, watch or necklace, and is connected to the radio control device 6 via wired communication technology and/or wireless communication technology. Since wireless communication technology is of many types and is not the focus of the present improvements, it will not be described in detail.
In the present embodiment, the carrier 3 is designed in the form of glasses, which can be worn on the head of the user, and has a front carrier 31 located in front of the eyes of the user and mounted with lenses 32, and two temple-shaped side carriers 33 respectively mounted on the left and right sides of the front carrier 31 and configured to be hung on the ears.
The image capturing device 4 is installed at the middle section of the front carrier 31, and can capture the image of the front view of the user to obtain a view image.
The microphone array unit 5 includes a plurality of microphones 51, and the microphones 51 are disposed on the front carrier 31 at left and right intervals and disposed on the side carrier 33 at front and rear intervals. Each microphone 51 may be activated to sense ambient sound to obtain an acoustic signal.
The radio reception control device 6 comprises a starting control module 61, a scene analysis module 62, a radio reception strategy control module 63, a direction radio reception control module 64 and an audio processing module 65.
The start control module 61 controls to start one of the microphones 51 to receive sound to obtain a sound signal, controls the audio processing module 65 to analyze whether the sound signal has a voice component, triggers the image capturing device 4 to start capturing images when the audio processing module 65 analyzes that the sound signal has the voice component, and controls the scene analysis module 62 to start receiving and analyzing the view image.
The scene analysis module 62 has a plurality of scene image texts, and a manual scene mode 621 and an automatic scene mode 622 for selectable activation. The scene image text is established by classifying, identifying and learning various parameters through a specific classification algorithm by a classification model according to the number of possible characters in the environment images of various occasions, the facing direction, distance, direction and moving/moving mode of each character relative to a user, various scene images and other parameters.
Such as, but not limited to, lecture/class occasions, conference occasions, outdoor/park greenfield occasions, party occasions, vegetable market occasions, supermarket/convenience store occasions, city street occasions, riding occasions, bank counter occasions, etc., scene images such as, but not limited to, conference tables, whiteboards, blackboards, lecture tables, projectors/projection screens, trees/plants/greenfields, sky, walkways, various vehicles, shelves, cash registers, etc. Such as, but not limited to, deep learning (deep belief network), Complex decision tree algorithm (Complex tree), Cosine nearest neighbor algorithm (Cosine KNN), convolutional neural network algorithm (CNN), Quadratic support vector machine algorithm (Quadratic SVM), and the like. Since there are many ways for various classification algorithms to establish the scene image text according to various environment image training and there are specific modes thereof, detailed description is omitted.
When the manual scene mode 621 is activated, the scene analysis module 62 controls the display device 8 to display all scene image texts for the user to select. When the automatic scene mode 622 is started, various scene image types of the view image are analyzed through a computer vision analysis technology, classification calculation of the view image is performed according to the various scene image types through a specific classification algorithm, the matching degree of each scene image text and the view image is obtained, a plurality of scene image texts with matching degrees reaching more than a preset value are screened out, a scene comparison result is generated and transmitted to the display device 8 corresponding to the screened scene image texts, and the display device 8 is controlled to display all the screened scene image texts for selection.
The sound reception strategy control module 63 is built-in with a plurality of sound reception strategies, which are methods for controlling and activating the microphones 51 to receive sound, such as controlling which microphone 51 is activated to perform omnidirectional sound reception, or controlling and activating certain microphones 51 to cooperate with directional sound reception. The sound reception strategy control module 63 is triggered by a scene selection signal transmitted by the display device 8 for a certain scene image text, and selects and starts the sound reception strategy corresponding to the scene image text, thereby controlling and starting the specific microphone 51 to receive sound.
The direction sound reception control module 64 is triggered by a direction selection signal transmitted by the display device 8 for a certain image area in the view image, and according to the direction of the image area in the view image, a specific position and a number of microphones 51 are activated to cooperate with each other to generate a digital microphone sound reception function.
The audio processing module 65 is built with a plurality of audio processing modes respectively corresponding to the sound reception strategies, and performs audio processing on the sound signals received by the microphone array unit 5 in the corresponding audio processing modes according to the sound reception strategies started by the sound reception strategy control module 63, wherein the audio processing contents are, for example but not limited to, performing simulation/digital conversion, noise reduction processing, voice extraction processing, and the like, and reduces and filters unnecessary noise from the sound signals, and filters, amplifies and outputs the voice signals to obtain processed sound signals with better signal-to-noise ratio (signal-to-noise ratio), and outputs the processed sound signals through the sound output device 7. In addition, when the direction sound reception control module 64 is triggered and activated to activate the microphones 51 at specific positions and numbers to cooperate with each other to generate a digital microphone sound reception function, the audio processing module 65 not only performs analog/digital conversion and noise reduction on the audio signal, but also performs filtering processing on the audio signal by a beam forming method and performs voice extraction processing, so as to filter and obtain a processed audio signal corresponding to the direction in the view image represented by the direction pointing signal.
Since the noise reduction and filtering process and the voice extraction process performed by the audio processing module 65 on the audio signal and the filtering of the audio signal in a specific direction by the beam forming method are the prior art, and the methods are quite numerous and are not the improvement focus of the present invention, they will not be described in detail.
The display device 8 includes a remote control module 81 and a touch display module 82. The remote control module 81 has a scene radio mode 811 and a direction radio mode 812 that can be switched on. When the scene radio mode 811 is activated by the remote control module 81, it is triggered by the scene analysis module 62 of the radio control device 6 to control the touch display module 82 to display all scene image texts for selection, or display the scene image texts corresponding to the scene comparison result for selection. And the remote control module 81 correspondingly generates and transmits the scene selection signal to the radio reception control device 6 when one of the scene image texts is selected.
When the remote control module 81 starts the direction sound receiving mode 812, the touch display module 82 is controlled to synchronously receive and display the view image captured by the image capturing device 4, and when one of the image areas of the view image displayed by the touch display module 82 is clicked, the direction click signal is correspondingly generated and transmitted to the sound receiving control device 6.
When the hearing aid system 200 of the present invention is used, the user wears the carrier 3 on the head, attaches the sound output devices 7 to both ears, and holds the display device 8. After the system is started, the image capturing device 4 will not start the image capturing function immediately, the sound reception control device 6 will first control to start a microphone 51 for omnidirectional sound reception, and only when there is a voice signal in the sound signal obtained by sound reception, will control to start the image capturing device 4 for capturing the view image. The sound reception control device 6 analyzes one or more scene image texts whose degree of conformity with the view image is above a predetermined value, and further compares the sound reception strategy corresponding to each scene image text.
When the display device 8 activates the scene radio mode 811 and the scene analysis module 62 of the radio control apparatus 6 activates the manual scene mode 621, the radio control apparatus 6 controls the display device 8 to display all scene image texts for selection. When the scene analysis module 62 activates the auto scene mode 622, the sound reception control device 6 will transmit all the screened scene image texts to the display device 8 for displaying. At this time, the user can operate the display device 8 to click the scene image text that best meets the requirement according to the field situation, and correspondingly return a scene click signal to the sound reception control device 6, the sound reception control device 6 will start the corresponding sound reception strategy according to the scene click signal, and control and start the microphones 51 with specific positions and numbers to start sound reception, and perform voice extraction processing on the sound signals obtained by all the activated microphones 51, and transmit the processed sound signals to the sound output device 7 for the user to listen.
When the display device 8 starts the orientation sound receiving mode 812, the sound receiving control device 6 will synchronously transmit the view image captured by the image capturing device 4 to the display device 8. At this time, the user can operate the display device 8 to click the image area predetermined to be listened to in the view image, and the display device 8 correspondingly transmits an orientation click signal back to the sound reception control device 6. The sound receiving control device 6 will control and activate the microphones 51 with specific positions and numbers according to the direction corresponding to the direction pointing signal, and filter the sound signals corresponding to the direction by the beam forming method, and perform the voice extraction processing on the sound signals, and then transmit the processed sound signals to the sound output device 7 for outputting, so as to be listened by the user.
In the embodiment, the sound reception control device 6 is integrally disposed on the vehicle 3 and is in signal connection with the display device 8 held by the user through a wireless communication technology, but in another implementation aspect of the present invention, the sound reception control device 6 is not disposed on the vehicle 3, but instead is integrally disposed on the display device 8, so as to reduce the number of electronic components disposed on the vehicle 3 and reduce the wearing weight.
In another aspect of the present invention, the display device 8 may be a device with micro-projection function, and is integrated in the vehicle 3, and can perform micro-projection on the lens 32 of the vehicle 3 to display the scene image text and the view image on the lens 32, so that the user can click the scene image text and click the image area of the view image through a visual control or other input means. In yet another embodiment of the invention, the display device 8 may be modified to a transparent liquid crystal display device and mounted on the carrier 3 in front of the eyes of the user for use as a lens of the carrier in the form of spectacles.
Furthermore, in another embodiment of the present invention, the display device 8 is not necessary, and the sound reception control device 6 can analyze the view image to obtain the scene image text with the highest matching degree, and directly start the corresponding sound reception strategy to control the microphone array unit 5 to perform sound reception without clicking through the display device 8.
In summary, by designing various scene image texts and a plurality of sound receiving strategies respectively corresponding to the scene image texts in the sound receiving control device 6 and by analyzing the view image obtained by the image capturing device 4, a scene image text with a holding degree above a specific value is screened out for selection by a user, so that the sound receiving scene type of the environment where the user is located can be identified more accurately, and the user can select the most suitable scene image text by himself by operating the display device 8. In addition, the user can also select the direction sound receiving mode 812 for activating the display device 8, and control the sound receiving control device 6 to receive sound at a specific direction in the view image by using the beam forming technique by directly clicking a certain image area in the view image displayed by the display device 8, which is quite convenient. Therefore, the hearing aid system 200 with the function of switching sound receiving scenes is really a relatively innovative creation and can really achieve the purpose of the present invention.
The above description is only an example of the present invention, and the scope of the present invention should not be limited thereby, and all the simple equivalent changes and modifications made according to the claims and the contents of the specification should be included in the scope of the present invention.
Claims (9)
1. A hearing aid system with radio reception scene switching function, suitable for being worn by a user and comprising an image capturing device capable of capturing a visual field image in front of the user, a microphone array unit and at least one sound output device, wherein the microphone array unit comprises a plurality of spaced microphones, each microphone can be controlled and activated independently to capture a sound signal, and the hearing aid system is characterized in that: the hearing aid system also comprises a reception control device which is connected with the image capturer, the microphones and the sound output device through signals and comprises a scene analysis module, a reception strategy control module and an audio signal processing module, wherein a plurality of scene image texts respectively representing various scene environments are built in the scene analysis module, the view images can be analyzed to obtain at least one corresponding scene image text, a plurality of reception strategies respectively corresponding to the scene image texts are built in the reception strategy control module, the corresponding reception strategies are started according to the at least one scene image text obtained through analysis of the scene analysis module, a specific number of microphones are controlled to be started for reception, a plurality of audio processing modes respectively corresponding to the reception strategies are built in the audio signal processing module, and the sound signals captured by all the started microphones are received and processed in the corresponding audio processing modes to obtain the positions A processed sound signal and outputting the processed sound signal via the sound output for listening by the user.
2. The hearing aid system with radio scene switching function according to claim 1, wherein: the scene analysis module can analyze the view images according to the scene image texts to obtain the conformity degree of each scene image text with the view images, and can transmit each scene image text with the conformity degree larger than a preset value to the display equipment for selection, and the sound reception strategy control module can start a corresponding sound reception strategy according to the selected scene image text to control and start a specific number of microphones to receive sound.
3. The hearing aid system with radio scene switching function according to claim 2, wherein: the scene analysis module is internally provided with a manual scene mode and an automatic scene mode which can be selected to be started, when the manual scene mode is started, the display equipment is controlled to display all scene image texts for selection, when the automatic scene mode is started, the view image is analyzed according to the scene image texts, and a plurality of scene image texts with the coincidence degree larger than the preset value are transmitted to the display equipment to be displayed for selection.
4. A hearing aid system with radio scene switching function according to claim 2 or 3, wherein: the radio control device also comprises a starting control module, the starting control module can control and start at least one microphone to carry out radio so as to obtain the sound signal, and can trigger the audio processing module to analyze whether the sound signal has voice, and the starting control module can control and start the image capturer and trigger and start the scene analysis module when the audio processing module analyzes that the sound signal has voice.
5. A hearing aid system with radio scene switching function according to claim 2 or 3, wherein: the device also comprises a carrier which can be worn on the user, and the image capturer and the microphones of the microphone array units are arranged on the carrier.
6. The hearing aid system with radio scene switching function according to claim 5, wherein: the carrier is glasses and is provided with a lens positioned in front of the eyes of the user, the display equipment is installed on the carrier, and the scene image text and the visual field image can be projected and imaged on the lens through a micro-projection technology for selection.
7. The hearing aid system with radio scene switching function according to claim 5, wherein: the carrier is glasses, and the display device is a transparent liquid crystal display device which is installed on the carrier and is positioned in front of the eyes of the user.
8. The hearing aid system with radio scene switching function according to claim 5, wherein: the display equipment comprises a remote control module and a touch control display module, wherein a scene radio receiving mode capable of being started is built in the remote control module, when the scene radio receiving mode is started, the remote control module controls the touch control display module to display a scene image text for clicking, a scene clicking signal is generated and transmitted to the radio receiving control device corresponding to the clicked scene image text, and the radio receiving strategy control module is triggered by the scene clicking signal to start a corresponding radio receiving strategy.
9. A hearing assistance system with radio reception scene switching function as claimed in claim 8, wherein: the radio reception control device also comprises a direction radio reception control module, the remote control module is internally provided with the scene radio reception mode and the direction radio reception mode which can be switched and started, when the remote control module switches and starts the direction sound receiving mode, the touch control display module is controlled to synchronously display the view image for selection, and the direction of the selected image area in the view image is selected, correspondingly generating and transmitting an orientation point selection signal to the radio reception control device, wherein the orientation radio reception control module is triggered by the orientation point selection signal, and controlling to start a specific number of microphones at the set position for receiving sound, the audio signal processing module will use the beam forming method to filter the sound signal picked up by the microphones, so as to obtain the processed sound signal corresponding to the direction in the visual field image represented by the direction point selection signal.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW108100992A TWI768175B (en) | 2019-01-10 | 2019-01-10 | Hearing aid system with radio scene switching function |
| TW108100992 | 2019-01-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111429928A true CN111429928A (en) | 2020-07-17 |
Family
ID=71517150
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911233217.6A Pending CN111429928A (en) | 2019-01-10 | 2019-12-05 | Hearing aid system with radio scene switching function |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US10827260B2 (en) |
| JP (1) | JP2020113981A (en) |
| CN (1) | CN111429928A (en) |
| TW (1) | TWI768175B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023001195A1 (en) * | 2021-07-22 | 2023-01-26 | 所乐思(深圳)科技有限公司 | Smart glasses and control method therefor, and system |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022234871A1 (en) * | 2021-05-04 | 2022-11-10 | 엘지전자 주식회사 | Sound field control device and method |
| CN114615609B (en) * | 2022-03-15 | 2024-01-30 | 深圳市昂思科技有限公司 | Hearing aid control method, hearing aid device, apparatus, device and computer medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1229518A1 (en) * | 2001-01-31 | 2002-08-07 | Alcatel | Speech recognition system, and terminal, and system unit, and method |
| EP1375084A1 (en) * | 2001-03-09 | 2004-01-02 | Japan Science and Technology Corporation | Robot audiovisual system |
| CN104735598A (en) * | 2013-12-18 | 2015-06-24 | 刘璟锋 | Hearing aid system and voice acquisition method of hearing aid system |
| CN104982041A (en) * | 2013-02-15 | 2015-10-14 | 三星电子株式会社 | Portable terminal for controlling hearing aid and method therefor |
| CN105532017A (en) * | 2013-03-12 | 2016-04-27 | 谷歌技术控股有限责任公司 | Apparatus and method for beamforming to obtain voice and noise signals |
| US20160277850A1 (en) * | 2015-03-18 | 2016-09-22 | Lenovo (Singapore) Pte. Ltd. | Presentation of audio based on source |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9153195B2 (en) * | 2011-08-17 | 2015-10-06 | Microsoft Technology Licensing, Llc | Providing contextual personal information by a mixed reality device |
| US10282057B1 (en) * | 2014-07-29 | 2019-05-07 | Google Llc | Image editing on a wearable device |
| JP6290827B2 (en) * | 2015-06-05 | 2018-03-07 | リウ チン フォンＣｈｉｎｇ−Ｆｅｎｇ ＬＩＵ | Method for processing an audio signal and a hearing aid system |
| CA2927046A1 (en) * | 2016-04-12 | 2017-10-12 | 11 Motion Pictures Limited | Method and system for 360 degree head-mounted display monitoring between software program modules using video or image texture sharing |
| CN110084087A (en) * | 2016-10-26 | 2019-08-02 | 奥康科技有限公司 | For analyzing image and providing the wearable device and method of feedback |
| US10362270B2 (en) * | 2016-12-12 | 2019-07-23 | Dolby Laboratories Licensing Corporation | Multimodal spatial registration of devices for congruent multimedia communications |
| US10599950B2 (en) * | 2017-05-30 | 2020-03-24 | Google Llc | Systems and methods for person recognition data management |
| US10452923B2 (en) * | 2017-11-28 | 2019-10-22 | Visual Semantics, Inc. | Method and apparatus for integration of detected object identifiers and semantic scene graph networks for captured visual scene behavior estimation |
-
2019
- 2019-01-10 TW TW108100992A patent/TWI768175B/en active
- 2019-12-05 CN CN201911233217.6A patent/CN111429928A/en active Pending
-
2020
- 2020-01-06 US US16/734,671 patent/US10827260B2/en active Active
- 2020-01-08 JP JP2020001123A patent/JP2020113981A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1229518A1 (en) * | 2001-01-31 | 2002-08-07 | Alcatel | Speech recognition system, and terminal, and system unit, and method |
| EP1375084A1 (en) * | 2001-03-09 | 2004-01-02 | Japan Science and Technology Corporation | Robot audiovisual system |
| CN104982041A (en) * | 2013-02-15 | 2015-10-14 | 三星电子株式会社 | Portable terminal for controlling hearing aid and method therefor |
| CN105532017A (en) * | 2013-03-12 | 2016-04-27 | 谷歌技术控股有限责任公司 | Apparatus and method for beamforming to obtain voice and noise signals |
| CN104735598A (en) * | 2013-12-18 | 2015-06-24 | 刘璟锋 | Hearing aid system and voice acquisition method of hearing aid system |
| US20160277850A1 (en) * | 2015-03-18 | 2016-09-22 | Lenovo (Singapore) Pte. Ltd. | Presentation of audio based on source |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023001195A1 (en) * | 2021-07-22 | 2023-01-26 | 所乐思(深圳)科技有限公司 | Smart glasses and control method therefor, and system |
Also Published As
| Publication number | Publication date |
|---|---|
| US20200228894A1 (en) | 2020-07-16 |
| TWI768175B (en) | 2022-06-21 |
| TW202027520A (en) | 2020-07-16 |
| US10827260B2 (en) | 2020-11-03 |
| JP2020113981A (en) | 2020-07-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2887697B1 (en) | Method of audio signal processing and hearing aid system for implementing the same | |
| CN111429928A (en) | Hearing aid system with radio scene switching function | |
| JP6094190B2 (en) | Information processing apparatus and recording medium | |
| US10499156B2 (en) | Method and device of optimizing sound signal | |
| US20170303052A1 (en) | Wearable auditory feedback device | |
| US20190028817A1 (en) | System and method for a directional speaker selection | |
| US20230045237A1 (en) | Wearable apparatus for active substitution | |
| US20200227067A1 (en) | Communication aid system | |
| WO2022199500A1 (en) | Model training method, scene recognition method, and related device | |
| DK1848245T3 (en) | Hearing aid with source separation and corresponding method | |
| TW200411627A (en) | Robottic vision-audition system | |
| EP1705911A1 (en) | Video conference system | |
| JP6290827B2 (en) | Method for processing an audio signal and a hearing aid system | |
| CN112995846A (en) | Attention focusing auxiliary system | |
| CN111128180A (en) | Auxiliary dialogue system for hearing-impaired people | |
| WO2019119290A1 (en) | Method and apparatus for determining prompt information, and electronic device and computer program product | |
| JP2021197658A (en) | Sound collecting device, sound collecting system, and sound collecting method | |
| CA2297344A1 (en) | Look direction microphone system with visual aiming aid | |
| JP2019096220A (en) | Text information providing device and method | |
| CN116913328B (en) | Audio processing method, electronic device and storage medium | |
| EP4178220A1 (en) | Voice-input device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200717 |