CN111462747B - Hearing assistance device and setting method thereof - Google Patents
Hearing assistance device and setting method thereof Download PDFInfo
- Publication number
- CN111462747B CN111462747B CN202010323344.1A CN202010323344A CN111462747B CN 111462747 B CN111462747 B CN 111462747B CN 202010323344 A CN202010323344 A CN 202010323344A CN 111462747 B CN111462747 B CN 111462747B
- Authority
- CN
- China
- Prior art keywords
- hearing assistance
- voice assistant
- sound
- assistance device
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000012544 monitoring process Methods 0.000 claims abstract description 26
- 230000003213 activating effect Effects 0.000 claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 10
- 230000005236 sound signal Effects 0.000 claims description 55
- 230000001960 triggered effect Effects 0.000 claims description 12
- 230000036541 health Effects 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 9
- 230000007613 environmental effect Effects 0.000 claims description 9
- 230000005856 abnormality Effects 0.000 claims description 7
- 238000005070 sampling Methods 0.000 claims description 7
- 208000032041 Hearing impaired Diseases 0.000 abstract description 3
- 241000238558 Eucarida Species 0.000 description 6
- 230000002159 abnormal effect Effects 0.000 description 6
- 244000062793 Sorghum vulgare Species 0.000 description 5
- 230000003993 interaction Effects 0.000 description 5
- 235000019713 millet Nutrition 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 230000036772 blood pressure Effects 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012074 hearing test Methods 0.000 description 2
- 210000001503 joint Anatomy 0.000 description 2
- 206010047924 Wheezing Diseases 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000009978 visual deterioration Effects 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/016—Personal emergency signalling and security systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computing Systems (AREA)
- Computer Security & Cryptography (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a hearing assistance device and a setting method thereof. The device comprises a sound collection module, a sound production module, a connection module used for being connected with the intelligent device, and a signal processing module respectively coupled with the sound collection module, the sound production module and the connection module, wherein the signal processing module is configured to execute the following steps: monitoring whether the current setting of the hearing assistance device meets the user requirement, and if not, activating a voice assistant of the intelligent device; sending a setting update request to a cloud service platform through a voice assistant of the intelligent equipment; and receiving setting updating information sent by the cloud service platform, and updating the setting according to the setting updating information. When the current setting of the auxiliary equipment is monitored to not meet the user requirement, the voice assistant of the intelligent equipment is used for updating the setting information from the cloud service platform, and the user does not need to call the voice assistant, so that the aims of assisting the old user or the hearing impaired user and realizing effective hearing assistance or hearing assistance are fulfilled.
Description
Technical Field
The invention relates to the technical field of providing hearing assistance for users, in particular to hearing assistance equipment and a setting method thereof.
Background
Currently, a voice assistant has become a standard configuration of an intelligent device, and overseas is represented by voice Alexa of amazon company and Siri of apple company, and intelligent devices such as domestic mobile phones and internet service providers have disputed to provide the voice assistant as one of the portals for user interaction for consumers. Because different equipment providers preset different voice assistants, in actual use, a user needs to trigger the voice assistant service first to perform a voice service channel and dock the voice service of the cloud; if the user uses the millet mobile phone, the user needs to call the college first, if the hundred-degree intelligent sound box is used, the user needs to call the college, and if the user uses the Goldnavigation software voice assistant, the user needs to click a voice call button on an application program interface, and then voice semantic recognition is started and fed back.
In addition, with the increasing degree of aging of the whole society, more and more aged users and disabled users become users of smart phones and smart devices, and due to objective factors such as visual deterioration, voice has become an increasingly important entrance for user interaction, and important user experience is borne. However, the old people have difficulty in remembering the brands and specific models of the various intelligent devices they use, so that today, voice services for the old people still cannot be developed on a large scale. Meanwhile, the hearing of the aged is generally damaged, so that earphone equipment with hearing aid or auxiliary hearing is required to be used for matching with daily use of the intelligent equipment.
Hearing aid or hearing aid equipment in the existing market generally adopts a service mode of presetting a hearing aid mode according to a hearing test result by completing hearing test by a doctor, a professional audiologist or a user in a self-service mode when worn for the first time. Because the environment of the user is complex and changeable, various possible situations can not be fully simulated through simple hearing detection, the user is often uncomfortable in actual use, and especially in some special scenes, hearing-aid and hearing-aid equipment can not reasonably reduce noise, dynamically compress and amplify, and can not realize enough signal to noise ratio to assist the user in realizing hearing assistance under the complex environment.
In summary, the existing hearing aid and hearing aid devices cannot flexibly adapt to various scenes used by users, and meanwhile, due to the complexity of starting a voice assistant, the use of voice assistant services by users, particularly old users, is hindered. These limitations make it impossible for elderly or hearing-impaired users to obtain good-quality hearing aid and hearing aid services, and also make full use of voice assistants, and use various services provided by the voice assistant platform to improve the quality of service for such users.
Disclosure of Invention
The invention aims to provide a hearing assistance device and a setting method, which can conveniently update the setting of the hearing assistance device when the setting does not meet the needs of a user.
In order to solve the above technical problems, the present invention provides a hearing assistance device, including a sound collecting module, a sound generating module, and a connection module for connecting with an intelligent device, and a signal processing module respectively coupled with the sound collecting module, the sound generating module, and the connection module, the signal processing module being configured to perform the following steps:
monitoring whether the current setting of the hearing assistance device meets the user requirement, and if not, activating a voice assistant of the intelligent device;
sending a setting update request to a cloud service platform through a voice assistant of the intelligent equipment;
and receiving setting updating information sent by the cloud service platform, and updating the setting according to the setting updating information.
Further, monitoring whether the current setting of the hearing assistance device meets the user's requirements is achieved by one of the following methods:
configuring a virtual or physical button, and if the button is triggered by a user, judging that the current setting does not meet the user requirement;
monitoring speaking and/or environmental sound of a user through the sound collection module, and judging that the current setting does not meet the user requirement when a preset word or a preset sound characteristic value is monitored;
and monitoring the sound through the sound collection module, and judging that the current setting does not meet the user requirement when the sound exceeding the preset sound pressure value is monitored.
Further, the method for activating the voice assistant of the intelligent device comprises the following steps:
and sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device.
And sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment.
Further, sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device is achieved by one of the following methods:
presetting a plurality of audio data containing voice assistant wake-up words in the hearing auxiliary equipment, and sequentially reading the audio data containing the voice assistant wake-up words when the voice assistant needs to be activated, and playing and sending the audio data to the intelligent equipment until feedback of the intelligent equipment is received;
presetting a plurality of audio data containing voice assistant wake-up words in the hearing assistance device, acquiring corresponding voice assistant information from the intelligent device when the hearing assistance device is connected to the intelligent device, selecting the audio data containing the corresponding voice assistant wake-up words according to the voice assistant information when the voice assistant needs to be activated, and sending the audio data to the intelligent device.
Further, the sound signal containing the wake-up word of the voice assistant of the intelligent device is only sent to the intelligent device and is not played through the sounding module.
Further, the setting update request sent to the cloud service platform includes one or any combination of a user instruction, a locally collected noise characteristic value and local sound sampling data.
Further, the setting update information takes a sound signal as a carrier.
Further, the sound signal uses frequencies outside the range of the human hearing range or the hearing assistance device play frequency band.
Further, after the hearing assistance device receives the sound signal, the setting update information is parsed from the sound signal without playing the sound signal through the sound emitting module.
Further, the setting update information includes one or any combination of configuration information, algorithm information, and service information.
Further, the intelligent device further comprises one or more health sensors, and the hearing assistance device sends an alarm signal to the intelligent device and/or the cloud service platform through the voice assistant when detecting that the data detected by the health sensors are abnormal, or when detecting that a user speaks a preset word related to the abnormal body of the user, or when detecting a preset sound characteristic value.
The invention also provides a setting method of the hearing assistance device, which comprises the following steps:
connecting the hearing assistance device with an intelligent device which is connected to the internet;
monitoring whether the current setting of the hearing assistance device meets the user requirement, and if not, activating a voice assistant of the intelligent device;
sending a setting update request to a cloud service platform through a voice assistant of the intelligent equipment;
the cloud service platform sends setting update information to the hearing assistance device according to the setting request;
the hearing assistance device updates a setting according to the setting update information.
Further, monitoring whether the current setting of the hearing assistance device meets the user's requirements is achieved by one of the following methods:
configuring a virtual or physical button, and if the button is triggered by a user, judging that the current setting does not meet the user requirement;
monitoring speaking and/or environmental sound of a user through the sound collection module, and judging that the current setting does not meet the user requirement when a preset word or a preset sound characteristic value is monitored;
and monitoring the sound through the sound collection module, and judging that the current setting does not meet the user requirement when the sound exceeding the preset sound pressure value is monitored.
Further, the method for activating the voice assistant of the intelligent device comprises the following steps:
and sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device.
And sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment.
Further, sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device is achieved by one of the following methods:
presetting a plurality of audio data containing voice assistant wake-up words in the hearing auxiliary equipment, and sequentially reading the audio data containing the voice assistant wake-up words when the voice assistant needs to be activated, and playing and sending the audio data to the intelligent equipment until feedback of the intelligent equipment is received;
presetting a plurality of audio data containing voice assistant wake-up words in the hearing assistance device, acquiring corresponding voice assistant information from the intelligent device when the hearing assistance device is connected to the intelligent device, selecting the audio data containing the corresponding voice assistant wake-up words according to the voice assistant information when the voice assistant needs to be activated, and sending the audio data to the intelligent device.
Further, the sound signal containing the wake-up word of the voice assistant of the intelligent device is only sent to the intelligent device and not played.
Further, the setting update request sent to the cloud service platform includes one or any combination of a user instruction, a locally collected noise characteristic value and local sound sampling data.
Further, the setting update information takes a sound signal as a carrier.
Further, the sound signal uses frequencies outside the range of the human hearing range or the hearing assistance device play frequency band.
Further, after the hearing assistance device receives the sound signal, the setting update information is parsed from the sound signal without playing the sound signal.
Further, the setting update information includes one or any combination of configuration information, algorithm information, and service information.
Further, health information of the user is also monitored, and when the physical health abnormality of the user is monitored or the user is monitored to speak a preset word related to the physical abnormality of the user or a preset sound characteristic value is monitored, an alarm signal is sent to the intelligent device and/or the cloud service platform through the voice assistant.
According to the hearing assistance device and the setting method thereof, when the current setting of the assistance device is monitored to not meet the user requirement, the setting information is updated from the cloud service platform by using the voice assistant of the intelligent device, hearing assistance and hearing assistance algorithms and configurations can be dynamically selected according to the environment of the user, the hearing assistance device is skillfully utilized to have the capability of processing sound signals, the user does not need to call the voice assistant, so that the aims of assisting the elderly user or hearing impaired user, realizing effective hearing assistance or hearing assistance, providing personalized hearing assistance service, health detection service and voice service are fulfilled.
Drawings
Fig. 1 is a block diagram of one embodiment of a hearing assistance device of the present invention.
Fig. 2 is a functional block diagram of an embodiment of a hearing assistance device setting method of the present invention.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and specific examples, which are not intended to be limiting, so that those skilled in the art will better understand the invention and practice it.
As shown in fig. 1, as an embodiment of the hearing assistance device of the present invention, the hearing assistance device comprises a sound collection module, a sound generation module, and a connection module for connecting with a smart device, and a signal processing module coupled with the sound collection module, the sound generation module, and the connection module, respectively, the signal processing module being configured to perform the steps of:
the hearing assistance device initiates connection with the intelligent device, and determines a setting for activating a voice assistant according to the related information of the intelligent device;
monitoring whether the current setting of the hearing assistance device meets the user requirement, and if not, activating a voice assistant of the intelligent device;
sending a setting update request to a cloud service platform through a voice assistant of the intelligent equipment;
and receiving setting updating information sent by the cloud service platform, and updating the setting according to the setting updating information.
The sound collection module in this embodiment is typically a microphone, the sound emitting module is typically an earphone, and the connection module may be a wireless connection module such as bluetooth, wifi, or a 3.5mm universal audio interface, a USB Type C interface, or a lightning interface. In order to complete the above steps, the hearing assistance device may be configured with corresponding hardware, such as a CPU, a memory, etc., and then the above steps may be performed by software preset on the hearing assistance device; it is also possible to configure the hearing aid device with simple software and hardware, such as a DSP (Digital Signal Processing ) chip, and the above steps are done in cooperation by an application (App) installed on the smart device.
For example, the invention takes the form of headphones and installs an App on a smart phone, tablet, computer or other smart device that is used with the headphones. Taking a mobile phone as an example, when the App is installed, the voice assistant service or application which is registered and used by the mobile phone can be scanned and identified at one time or periodically, including the voice assistant service (such as a millet handset preset "college of love") provided by the mobile phone local system and the voice assistant service (such as a hundred-degree voice assistant, an Alexa voice assistant and the like) carried by the App installed on the mobile phone, and if necessary, user guidance is provided to determine that the headset activates the setting of the voice assistant service of the mobile phone. In this embodiment, the handset used is a millet handset, while the use Alexa voice assistant application is installed.
The mobile phone App reports the voice assistant information registered by the mobile phone to the cloud service platform, the cloud service platform is in butt joint with each voice assistant platform, and the newly-appearing voice assistant platform or the butt joint between the newly-appearing voice assistant platform and the existing voice assistant platform can be accessed according to the voice assistant information reported by the mobile phone App, so that the user can enjoy the service provided by the cloud service platform by using the commonly-used voice assistant platform. In this embodiment, the cloud service platform registers the voice assistant service used by the earphone-handset combination as a millet voice assistant and an Alexa voice assistant according to the information reported by the handset App.
The current setting of the hearing assistance device does not meet the user requirement, and is generally reflected in that the local hearing assistance effect cannot reach the preset hearing assistance effect and the corresponding hearing assistance index requirement, including but not limited to signal-to-noise ratio, environmental noise reduction, hearing compensation for different hearing frequency bands, and the like.
For example, when the user wears the headset, steps into a relatively noisy bar environment from an open street environment, during which the headset itself is switched and tried according to preset environmental noise reduction and hearing aid algorithms, during which the user is prandially, or speaks with other people (either as a matter of speaking or by any one of the headset and the other person speaking) after all the algorithms preset by the handset have been combined, or during the switching or trying process: the language "how much this is done", "what i hear is unclear to say" here, then the current settings of the hearing assistance device are considered to be insufficient for the user's needs, triggering reporting conditions.
Wherein monitoring whether the current setting of the hearing assistance device meets the user's requirements is achieved by one of the following methods:
(1) And configuring a virtual or physical button, monitoring whether the button is triggered or not in real time, and judging that the current setting does not meet the user requirement when the button is triggered by the user. Under this solution, the buttons of the entity are usually required to be actively triggered by the user, i.e. when the user feels that the current settings of the hearing assistance device do not meet his needs. The physical buttons may be either push buttons or touch buttons. While virtual buttons are typically configured in an area on the touch screen that is repositionable depending on the configuration to increase its flexibility. Because the virtual buttons are implemented by software configuration, they can be triggered automatically when certain conditions are met, in addition to being triggered manually by the user.
(2) And monitoring the speaking and/or the environmental sound of the user through the sound collection module, identifying the common voice information related to the hearing effect of the user, and judging that the current setting does not meet the user requirement when the preset word is monitored. For example, the user repeatedly speaks "feed", "you loud", "listen unclear", etc., and after performing the semantic analysis, the current setting of the hearing assistance device may be considered as not meeting the user's requirements. Or the preset sound characteristic value is monitored in the environment sound, and the situation that the specific environment is entered at the moment is judged, the hearing assistance device needs to be switched to a specific mode, and the setting of the hearing assistance device also needs to be updated at the moment.
(3) And monitoring the sound through the sound collection module, and judging that the current setting does not meet the user requirement when the sound exceeding the preset sound pressure value is monitored.
In this embodiment, the method for activating the voice assistant of the intelligent device includes: and sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device. Alternatively, the voice assistant of the smart device may be activated by: according to the communication protocol agreed with the intelligent equipment, a protocol instruction for activating the voice assistant is sent to the intelligent equipment, in the embodiment, the specific model of the mobile phone can be obtained when the Bluetooth is established to be connected with the mobile phone, the corresponding voice assistant protocol instruction is known on the mobile phone App or through the service of the cloud platform, and the communication protocol with the mobile phone can be verified through a user bootstrap program, so that the voice assistant is ensured to be activated.
For example, when the hearing assistance device is first connected to the smart device, an App installed on the smart device starts a bootstrap program, the App may obtain a specific model of the smart device through hardware or an operating system of the smart device, and match a corresponding voice assistant according to the model of the smart device, and then establish a connection, and guide a user to verify the established connection. The App may also present the user with a list of supported voice assistants, the user selecting the voice assistant supported by the smart device used, and then directing the user to operate, establish a connection with the voice assistant, and verify the established connection.
The voice signal containing the wake-up word of the voice assistant of the intelligent device can be spoken by a user, collected by the hearing assistance device and converted into the voice signal to be sent to the intelligent device. It can also be realized by one of the following methods:
the audio data containing the wake-up words of the voice assistant of the intelligent equipment are preset and stored in the hearing assistance equipment, and when the voice assistant needs to be activated, the audio data containing the wake-up words of the voice assistant are read and played and sent to the intelligent equipment. In order to be applicable to different intelligent devices, a plurality of audio data containing wake-up words of the voice assistant of the intelligent device can be preset and stored in the hearing assistance device, and when the voice assistant needs to be activated, the audio data containing the wake-up words of the voice assistant are sequentially read and played and sent to the intelligent device until feedback of the intelligent device is received. For example, audio data including words such as "little college", "little degree", "Hey, siri" and the like are preset and stored in the hearing assistance device, and when the voice assistant needs to be activated, the audio data are sequentially read and played and sent to the intelligent device until feedback of the voice assistant on the intelligent device is received. For example, when the hearing assistance device is connected to a millet mobile phone, the feedback can be received when audio data including "little college" is read and played for the first time and sent to the mobile phone; when the hearing assistance device is connected to the iPhone mobile phone of apple company, feedback is not received when audio data comprising ' little college and ' little degree ' are read and played and sent to the mobile phone; when audio data including "Hey, siri" is read and played, feedback is received.
In addition, when the hearing assistance device is connected to the intelligent device, corresponding voice assistant information can be acquired from the intelligent device, and when the voice assistant needs to be activated, a corresponding wake-up word is selected according to the voice assistant information and sent to the intelligent device. For example, when the hearing assistance device is connected to an iPhone phone of apple, the hearing assistance device obtains from the iPhone phone that the connection is an apple smart device, and the hearing assistance device sets audio data containing "Hey, siri" as the first read file. Thus, when the voice assistant needs to be activated, the audio data containing 'Hey, siri' can be directly read and played, so that the Siri of the iPhone mobile phone is awakened.
Of course, the voice signal including the wake-up word of the voice assistant can also be synthesized by the voice synthesis technology and sent to the intelligent device.
In order to reduce the interference to the user, only the sound signal containing the wake-up word of the voice assistant of the intelligent device can be sent to the intelligent device, and is not played to the user through the sounding module. Likewise, for the feedback sounds of the smart device voice assistant, the hearing assistance device only receives and recognizes and does not play. That is, the user cannot hear the voice command of the wake-up voice assistant sent by the hearing assistance device to the intelligent device, and cannot hear the feedback voice after the mobile phone voice assistant is activated.
And the protocol instruction for activating the voice assistant can be sent to the intelligent equipment according to the communication protocol agreed with the intelligent equipment, and the intelligent equipment automatically opens the voice assistant.
In this embodiment, the setting update request sent to the cloud service platform includes one or any combination of a user instruction, a locally collected sound feature value, a noise feature value, and local sound sampling data of each path.
The update request sent to the cloud service platform can take the sound signal as a carrier, namely, the update request is converted into a sound signal file and sent to the intelligent equipment, and then the sound signal file is sent to the cloud service platform by a voice assistant of the intelligent equipment. In order not to disturb the user, the hearing assistance device does not play the update requested sound signal to the user via the sound emitting module.
In particular, a hearing assistance device in the form of a headset is exemplified. When the current setting is monitored to not meet the user requirement, the earphone activates 'little college' through a communication protocol; or the earphone drives a signal processor arranged in the earphone to send a voice command of 'little college' to the mobile phone, and meanwhile, the voice command is not played back to a loudspeaker part of the earphone. At this time, the preset voice assistant of "little lover" of the mobile phone is activated, the mobile phone feedback sounds "on the ground", the feedback sounds are usually sent out within a period of time (such as 5 seconds) after the earphone sends a voice command to the mobile phone, and the signal processor built in the earphone feeds back the voice of "on the ground" to the loudspeaker, that is, the user cannot hear the feedback provided by the voice assistant of the mobile phone. After receiving the feedback of "on the road" from the mobile phone voice assistant, the signal processor sends a voice command connected with the server, where the voice command is a voice command of a start service registered by the cloud service platform on the college voice assistant platform (a similar example is that the user says "i want to listen to music", and is connected to the cloud server registered on the college voice assistant platform and playing music), such as "intelligent hearing aid".
At this time, the voice assistant colleague can return a feedback voice such as "looking for intelligent hearing aid content" which is usually sent out within a period of time (e.g. 5 seconds) after the earphone sends a voice command to the mobile phone, and the signal processor built in the earphone automatically shields the voice of "looking for intelligent hearing aid content" to the speaker, that is, the user does not hear the feedback provided by the mobile phone voice assistant. After receiving feedback from "look for intelligent hearing aid content for you", the signal processor sends the voice information of the user, the characteristic value of the voice information of the surrounding environment or the voice information sampled at a previous period or on site to the cloud service platform through the voice assistant.
After receiving a setting update request sent by the hearing assistance device, the cloud service platform selects information and/or service information such as applicable hearing aid or hearing aid configuration, algorithm and the like according to a user instruction, a locally acquired sound characteristic value, a locally acquired noise characteristic value, local sound sampling data and the like contained in the request, generates setting update information and sends the setting update information to the intelligent device, and then the intelligent device sends the setting update information to the hearing assistance device.
The core function of the cloud service platform is to obtain voice instructions of a user, which are directly reported to the cloud service platform by the earphone through the smart phone or through the voice assistant platforms, or locally collected voice characteristic values or noise characteristic values of the earphone, or locally collected local voice sampling data of each path of the earphone, and push suggested instructions to the earphone according to the obtained information, wherein the voice instructions comprise different hearing aid algorithms, dynamic compression algorithms, environment noise reduction algorithms and the like, and the algorithms can be independent algorithms or combinations of the algorithms.
In order to achieve connection of the cloud service platform and the hearing assistance device through a voice assistant of the intelligent device, usability is improved, and setting update information generated by the cloud service platform takes a sound signal as a carrier. That is, the setting update information is converted into a sound signal, one of the possible schemes is: binary 0 is represented by a high-frequency sound and binary 1 is represented by a low-frequency sound, so that binary setting update information can be converted into a sound file composed of high frequencies and low frequencies. The cloud service platform sends the sound file to a voice assistant of the intelligent device, the voice assistant plays the sound file, converts the sound file into sound, transmits the sound to the hearing assistance device, analyzes high-frequency sound into binary 0, analyzes low-frequency sound into binary 1, and accordingly restores sound signals into binary setting update information, and locally executes instructions, configures, replaces algorithms or serves users according to the setting update information. In other embodiments, the setting update information may be carried by the audio signal in other ways.
Preferably, the sound signal uses frequencies outside the range of the human hearing or the range of the frequency band played by the hearing assistance device, so that when the hearing assistance device receives the sound signal and parses the update settings, the user does not hear the piece of audio, avoiding interference to the user. Of course, the audio may be masked by the hearing aid to avoid interference with the user, and the sound signal may also use frequencies within the range of the person's hearing or within the range of the frequency band played by the hearing aid.
Of course, in other embodiments, in order for the user to know that the hearing assistance device is being updated, an alert tone may be played for the user. The alert tone may be either a verbal alert or a specific sound, such as a "beep, beep" sound, or the like.
When multiple voice assistants (for example, a little college and an Alexa voice assistant exist on the intelligent device at the same time), after the interaction is finished temporarily or an interruption occurs through one of the voice assistants (for example, the little college) and the other voice assistants (for example, the Alexa voice assistant) can execute the interaction process for one time, so that the effect of service robustness can be improved (for example, the situation that the network between the little college voice server and the cloud server is unstable in the interaction process of the user) can be improved. In addition, the cloud service platform can receive reports and feedback from the same earphone-mobile phone combination from a plurality of voice assistants, so that the cloud service platform can perform comprehensive comparison and push an algorithm or an algorithm combination which is most suitable for the current use of the user.
The process can be continuously optimized along with the use of the user, for example, the user can check the environment sound every time the user expresses that the user is not clear, different algorithms or algorithm combinations are provided, and the self-adaption of the use habit of the user is completed through the feedback history of the user.
In addition, the hearing assistance device can be automatically connected with the voice assistant cloud platform of the mobile phone when the user is detected to be in an abnormal state, and abnormal information is sent to the voice assistant cloud platform so as to obtain remote assistance. The hearing assistance device can also carry other health sensor devices, such as a heart rate sensor, a blood pressure sensor, a body temperature sensor, a gyroscope and the like, so that the trigger mechanism can also increase information carried by the sensor, and the condition of a user can be judged more accurately. Even in some extreme cases, a call for help mechanism may be triggered. If it is detected that the physical characteristic values such as heart rate, blood pressure and body temperature of the user are abnormal, or if it is detected that the user falls down through the gyroscope, or if the user speaks self or mentions information such as "i am uncomfortable", "i am hard to feel", "a little wheeze, or if it is detected that the preset sound characteristic values appear in the environment, special sound information such as sound of an ambulance appearing for a long time can also be adopted, through voice service, a calling mechanism is triggered, and a medical unit or a preset emergency contact of the user is called to assist the user in solving the problem.
Similarly, an embodiment of a method for setting a hearing assistance device of the present invention includes:
connecting the hearing assistance device with an intelligent device which is connected to the internet;
monitoring whether the current setting of the hearing assistance device meets the user requirement, and if not, activating a voice assistant of the intelligent device;
sending a setting update request to a cloud service platform through a voice assistant of the intelligent equipment;
the cloud service platform sends setting update information to the hearing assistance device according to the setting request;
the hearing assistance device updates a setting according to the setting update information.
Wherein monitoring whether the current setting of the hearing assistance device meets the user's requirements is achieved by one of the following methods:
configuring a virtual or physical button, and if the button is triggered by a user, judging that the current setting does not meet the user requirement;
monitoring speaking and/or environmental sound of a user through the sound collection module, and judging that the current setting does not meet the user requirement when a preset word or a preset sound characteristic value is monitored;
and monitoring the sound through the sound collection module, and judging that the current setting does not meet the user requirement when the sound exceeding a preset sound pressure value is monitored.
The method for activating the voice assistant of the intelligent device comprises the following steps: transmitting a sound signal containing a wake-up word of the intelligent device voice assistant to the intelligent device; or sending a protocol instruction for activating the voice assistant to the intelligent equipment according to a communication protocol agreed with the intelligent equipment. Preferably, the sending of the sound signal containing the wake-up word of the voice assistant of the smart device to the smart device is achieved by one of the following methods:
presetting a plurality of audio data containing voice assistant wake-up words in the hearing auxiliary equipment, and sequentially reading the audio data containing the voice assistant wake-up words when the voice assistant needs to be activated, and playing and sending the audio data to the intelligent equipment until feedback of the intelligent equipment is received;
presetting a plurality of audio data containing voice assistant wake-up words in the hearing assistance device, acquiring corresponding voice assistant information from the intelligent device when the hearing assistance device is connected to the intelligent device, selecting the audio data containing the corresponding voice assistant wake-up words according to the voice assistant information when the voice assistant needs to be activated, and sending the audio data to the intelligent device.
Further preferably, the sound signal containing the wake-up word of the smart device voice assistant is only sent to the smart device and not played to the user.
The setting update request sent to the cloud service platform comprises one or any combination of a user instruction, a locally collected sound characteristic value, a noise characteristic value and local sound sampling data. The setting update information generated by the cloud service platform is carried by a sound signal, which preferably uses frequencies outside the range of the human hearing or the hearing assistance device playing frequency band. After receiving the sound signal, the hearing assistance device parses the setting update information from the sound signal without playing the sound signal. The setting update information includes one or any combination of configuration information, algorithm information, and service information.
In addition, the invention can also monitor the health information of the user at the same time, and send an alarm signal to the intelligent device and/or the cloud service platform through the voice assistant when the health of the user is monitored to be abnormal, or when the user is monitored to speak a preset word related to the physical abnormality of the user, or when a preset sound characteristic value appears in the environment sound.
The above-described embodiments are merely preferred embodiments for fully explaining the present invention, and the scope of the present invention is not limited thereto. Equivalent substitutions and modifications will occur to those skilled in the art based on the present invention, and are intended to be within the scope of the present invention. The protection scope of the invention is subject to the claims.
Claims (22)
1. A hearing assistance device comprising a sound collection module, a sound emitting module and a connection module for connection with an intelligent device, and a signal processing module coupled to the sound collection module, the sound emitting module and the connection module, respectively, the signal processing module being configured to perform the steps of:
monitoring whether the current setting of the hearing assistance device meets the user requirement, and if not, activating a voice assistant of the intelligent device;
sending a setting update request to a cloud service platform through a voice assistant of the intelligent equipment;
receiving setting update information sent by the cloud service platform, and updating setting according to the setting update information;
wherein the setting update information takes a sound signal of a frequency outside a human hearing range or a hearing assistance device playing frequency range as a carrier.
2. The hearing assistance device of claim 1, wherein monitoring whether the current settings of the hearing assistance device meet the user's requirements is accomplished by one of:
configuring a virtual or physical button, and if the button is triggered by a user, judging that the current setting does not meet the user requirement;
monitoring speaking and/or environmental sound of a user through the sound collection module, and judging that the current setting does not meet the user requirement when a preset word or a preset sound characteristic value is monitored;
and monitoring the sound through the sound collection module, and judging that the current setting does not meet the user requirement when the sound exceeding the preset sound pressure value is monitored.
3. The hearing assistance device of claim 1, wherein the method of activating the voice assistant of the smart device comprises:
and sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device.
4. A hearing assistance device as claimed in claim 3, wherein transmitting a sound signal to the smart device containing a wake word of the smart device voice assistant is achieved by one of the following methods:
presetting a plurality of audio data containing voice assistant wake-up words in the hearing auxiliary equipment, and sequentially reading the audio data containing the voice assistant wake-up words when the voice assistant needs to be activated, and playing and sending the audio data to the intelligent equipment until feedback of the intelligent equipment is received;
presetting a plurality of audio data containing voice assistant wake-up words in the hearing assistance device, acquiring corresponding voice assistant information from the intelligent device when the hearing assistance device is connected to the intelligent device, selecting the audio data containing the corresponding voice assistant wake-up words according to the voice assistant information when the voice assistant needs to be activated, and sending the audio data to the intelligent device.
5. The hearing assistance device of claim 3 or 4, wherein the sound signal containing the wake word of the smart device voice assistant is sent only to the smart device and not played to the user through the sound module.
6. The hearing assistance device of claim 1, wherein the update request sent to the cloud service platform is carried by a sound signal, the hearing assistance device not playing the update requested sound signal to the user through the sound module.
7. The hearing assistance device of claim 1 or 6, wherein the setting update request sent to the cloud service platform includes one or any combination of a user instruction, a locally collected sound feature value, a noise feature value, and local sound sample data.
8. The hearing assistance device of claim 1, wherein the hearing assistance device, upon receiving the sound signal, parses setup update information from the sound signal without playing the sound signal through the sound emitting module.
9. The hearing assistance device of any one of claims 1, 8, wherein the setting update information comprises one or any combination of configuration information, algorithm information, and service information.
10. The hearing assistance device of claim 1, further comprising one or more health-class sensors, wherein the hearing assistance device sends an alarm signal to the smart device and/or the cloud service platform via the voice assistant when detecting an abnormality in the data detected by the health-class sensors, or when detecting a user speaking a preset word associated with an abnormality in the user's body, or when detecting the occurrence of a preset sound characteristic value in the ambient sound.
11. The hearing assistance device of claim 1, wherein the method of activating the voice assistant of the smart device comprises:
and sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment.
12. A method of setting a hearing assistance device, comprising:
connecting the hearing assistance device with an intelligent device which is connected to the internet;
monitoring whether the current setting of the hearing assistance device meets the user requirement, and if not, activating a voice assistant of the intelligent device;
sending a setting update request to a cloud service platform through a voice assistant of the intelligent equipment;
the cloud service platform sends setting update information to the hearing assistance device according to the setting update request;
the hearing assistance device updates a setting according to the setting update information;
wherein the setting update information takes a sound signal of a frequency outside a human hearing range or a hearing assistance device playing frequency range as a carrier.
13. The method of setting a hearing assistance device of claim 12, wherein monitoring whether the current setting of the hearing assistance device meets the user's requirements is accomplished by one of:
configuring a virtual or physical button, and if the button is triggered by a user, judging that the current setting does not meet the user requirement;
monitoring speaking and/or environmental sound of a user through a sound collection module, and judging that the current setting does not meet the user requirement when a preset word or a preset sound characteristic value is monitored;
and monitoring the sound through the sound collection module, and judging that the current setting does not meet the user requirement when the sound exceeding the preset sound pressure value is monitored.
14. The method of setting up a hearing assistance device of claim 12, wherein the method of activating a voice assistant of the smart device comprises:
and sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device.
15. The method of setting a hearing assistance device of claim 12, wherein transmitting a sound signal to the smart device containing a wake-up word of the smart device voice assistant is accomplished by one of:
presetting a plurality of audio data containing voice assistant wake-up words in the hearing auxiliary equipment, and sequentially reading the audio data containing the voice assistant wake-up words when the voice assistant needs to be activated, and playing and sending the audio data to the intelligent equipment until feedback of the intelligent equipment is received;
presetting a plurality of audio data containing voice assistant wake-up words in the hearing assistance device, acquiring corresponding voice assistant information from the intelligent device when the hearing assistance device is connected to the intelligent device, selecting the audio data containing the corresponding voice assistant wake-up words according to the voice assistant information when the voice assistant needs to be activated, and sending the audio data to the intelligent device.
16. The method of setting a hearing assistance device of claim 14 or 15, wherein the sound signal containing the wake-up word of the smart device voice assistant is sent only to the smart device and not played to the user.
17. The method for setting a hearing assistance device of claim 12, wherein the update request sent to the cloud service platform is carried by a sound signal, and the hearing assistance device does not play the sound signal of the update request to the user.
18. The method for setting hearing assistance devices according to claim 12 or 17, wherein the setting update request sent to the cloud service platform includes one or any combination of a user instruction, a locally collected sound feature value, a noise feature value, and local sound sampling data.
19. The method of setting a hearing assistance device of claim 12, wherein the hearing assistance device, upon receiving the sound signal, parses setting update information from the sound signal without playing the sound signal.
20. The method of setting a hearing assistance device of any one of claims 12, 19, wherein the setting update information comprises one or any combination of configuration information, algorithm information and service information.
21. The method for setting a hearing assistance device according to claim 12, characterized in that health information of the user is also monitored, and when a physical health abnormality of the user is monitored or when a user is monitored to speak a preset word related to the physical abnormality of the user or when a preset sound characteristic value appears in an environmental sound is monitored, an alarm signal is sent to the intelligent device and/or the cloud service platform through the voice assistant.
22. The method of setting up a hearing assistance device of claim 12, wherein the method of activating a voice assistant of the smart device comprises:
and sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010323344.1A CN111462747B (en) | 2020-04-22 | 2020-04-22 | Hearing assistance device and setting method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010323344.1A CN111462747B (en) | 2020-04-22 | 2020-04-22 | Hearing assistance device and setting method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111462747A CN111462747A (en) | 2020-07-28 |
| CN111462747B true CN111462747B (en) | 2024-04-05 |
Family
ID=71678602
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010323344.1A Active CN111462747B (en) | 2020-04-22 | 2020-04-22 | Hearing assistance device and setting method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111462747B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104023302A (en) * | 2014-05-19 | 2014-09-03 | 周电 | Programmable digital hearing aid system and method thereof |
| CN206210062U (en) * | 2016-11-30 | 2017-05-31 | 赵紫瑜 | A kind of old man falls down calling for help Intelligent bracelet |
| CN106921926A (en) * | 2017-04-17 | 2017-07-04 | 西安音悦电子科技有限公司 | A kind of High-efficiency self-service is tested with hearing aid device system |
| CN107134279A (en) * | 2017-06-30 | 2017-09-05 | 百度在线网络技术（北京）有限公司 | A kind of voice awakening method, device, terminal and storage medium |
| CN108712566A (en) * | 2018-04-27 | 2018-10-26 | 维沃移动通信有限公司 | A kind of voice assistant awakening method and mobile terminal |
| CN108810175A (en) * | 2018-08-14 | 2018-11-13 | 陕西科技大学 | A kind of life of elderly person nursing intelligent interactive system and its operating method |
| CN110322880A (en) * | 2018-03-28 | 2019-10-11 | 上海博泰悦臻网络技术服务有限公司 | Vehicle-mounted terminal equipment and the method for waking up its multiple interactive voice program |
| WO2019227370A1 (en) * | 2018-05-31 | 2019-12-05 | Dong Xuezhang | Method, apparatus and system for controlling multiple voice assistants, and computer-readable storage medium |
| CN110650421A (en) * | 2018-06-26 | 2020-01-03 | 深圳市智汇声科技有限公司 | Hearing assistance system and host and slave thereof |
| CN110853645A (en) * | 2019-12-02 | 2020-02-28 | 三星电子（中国）研发中心 | Method and device for recognizing voice command |
-
2020
- 2020-04-22 CN CN202010323344.1A patent/CN111462747B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104023302A (en) * | 2014-05-19 | 2014-09-03 | 周电 | Programmable digital hearing aid system and method thereof |
| CN206210062U (en) * | 2016-11-30 | 2017-05-31 | 赵紫瑜 | A kind of old man falls down calling for help Intelligent bracelet |
| CN106921926A (en) * | 2017-04-17 | 2017-07-04 | 西安音悦电子科技有限公司 | A kind of High-efficiency self-service is tested with hearing aid device system |
| CN107134279A (en) * | 2017-06-30 | 2017-09-05 | 百度在线网络技术（北京）有限公司 | A kind of voice awakening method, device, terminal and storage medium |
| CN110322880A (en) * | 2018-03-28 | 2019-10-11 | 上海博泰悦臻网络技术服务有限公司 | Vehicle-mounted terminal equipment and the method for waking up its multiple interactive voice program |
| CN108712566A (en) * | 2018-04-27 | 2018-10-26 | 维沃移动通信有限公司 | A kind of voice assistant awakening method and mobile terminal |
| WO2019227370A1 (en) * | 2018-05-31 | 2019-12-05 | Dong Xuezhang | Method, apparatus and system for controlling multiple voice assistants, and computer-readable storage medium |
| CN110650421A (en) * | 2018-06-26 | 2020-01-03 | 深圳市智汇声科技有限公司 | Hearing assistance system and host and slave thereof |
| CN108810175A (en) * | 2018-08-14 | 2018-11-13 | 陕西科技大学 | A kind of life of elderly person nursing intelligent interactive system and its operating method |
| CN110853645A (en) * | 2019-12-02 | 2020-02-28 | 三星电子（中国）研发中心 | Method and device for recognizing voice command |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111462747A (en) | 2020-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111447539B (en) | Fitting method and device for hearing earphones | |
| US11671773B2 (en) | Hearing aid device for hands free communication | |
| US10582312B2 (en) | Hearing aid and a method for audio streaming | |
| US20130343584A1 (en) | Hearing assist device with external operational support | |
| US20230290333A1 (en) | Hearing apparatus with bone conduction sensor | |
| CN106416299A (en) | Personal communication device having application software for controlling the operation of at least one hearing aid | |
| EP3979666A2 (en) | A hearing device comprising an own voice processor | |
| US11589173B2 (en) | Hearing aid comprising a record and replay function | |
| EP2876899A1 (en) | Adjustable hearing aid device | |
| CN114640938A (en) | Hearing aid function implementation method based on Bluetooth headset chip and Bluetooth headset | |
| US20220295191A1 (en) | Hearing aid determining talkers of interest | |
| JP4114392B2 (en) | Inspection center device, terminal device, hearing compensation method, hearing compensation method program recording medium, hearing compensation method program | |
| EP2876902A1 (en) | Adjustable hearing aid device | |
| CN111462747B (en) | Hearing assistance device and setting method thereof | |
| CN106254991B (en) | Noise cancelling headphone and its noise-reduction method | |
| CN110166863B (en) | In-ear voice device | |
| JP2012194295A (en) | Speech output system | |
| KR20170071364A (en) | Self fitting method of hearing aid and output power of sound device | |
| CN115767358A (en) | Hearing protection method and system, TWS earphone and intelligent terminal device | |
| JP2013127536A (en) | Voice output device, communication terminal and hearing aid equipped with the same, program for controlling voice output device, method of providing individualized voice to voice output device users, and system for updating conversion data of voice output device | |
| CN117082422A (en) | Hearing loss detection method, device, hearing aid and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |