CN111462747A - Hearing assistance device and setting method thereof - Google Patents
Hearing assistance device and setting method thereof Download PDFInfo
- Publication number
- CN111462747A CN111462747A CN202010323344.1A CN202010323344A CN111462747A CN 111462747 A CN111462747 A CN 111462747A CN 202010323344 A CN202010323344 A CN 202010323344A CN 111462747 A CN111462747 A CN 111462747A
- Authority
- CN
- China
- Prior art keywords
- voice assistant
- user
- sound
- setting
- hearing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000003213 activating effect Effects 0.000 claims abstract description 21
- 238000012544 monitoring process Methods 0.000 claims abstract description 18
- 230000005236 sound signal Effects 0.000 claims description 45
- 230000001960 triggered effect Effects 0.000 claims description 11
- 230000007613 environmental effect Effects 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 9
- 238000004519 manufacturing process Methods 0.000 abstract description 5
- 208000032041 Hearing impaired Diseases 0.000 abstract description 3
- 230000036541 health Effects 0.000 description 8
- 230000003993 interaction Effects 0.000 description 6
- 238000005070 sampling Methods 0.000 description 6
- 244000062793 Sorghum vulgare Species 0.000 description 5
- 230000002159 abnormal effect Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- 235000019713 millet Nutrition 0.000 description 5
- 230000005856 abnormality Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 241000238558 Eucarida Species 0.000 description 2
- 230000036772 blood pressure Effects 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 210000001503 joint Anatomy 0.000 description 2
- 230000032683 aging Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000009429 distress Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000009978 visual deterioration Effects 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/016—Personal emergency signalling and security systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The invention discloses hearing assistance equipment and a setting method thereof. The device comprises a sound collection module, a sound production module, a connection module used for being connected with the intelligent device, and a signal processing module respectively coupled with the sound collection module, the sound production module and the connection module, wherein the signal processing module is configured to execute the following steps: monitoring whether the current setting of the hearing assistance equipment meets the requirements of a user, and if not, activating a voice assistant of the intelligent equipment; sending a setting updating request to a cloud service platform through a voice assistant of the intelligent equipment; and receiving the setting updating information sent by the cloud service platform, and updating the setting according to the setting updating information. According to the method and the device, when the situation that the current setting of the auxiliary equipment does not meet the requirements of the user is monitored, the voice assistant of the intelligent equipment is used for updating the setting information from the cloud service platform, and the user does not need to call the voice assistant, so that the purposes of assisting the old user or the hearing-impaired user and effectively assisting hearing or assisting hearing are achieved.
Description
Technical Field
The invention relates to the technical field of providing hearing assistance for users, in particular to hearing assistance equipment and a setting method thereof.
Background
Currently, voice assistants have become standard configurations of intelligent devices, represented by voice Alexa of amazon corporation and Siri of apple corporation, and domestic intelligent devices such as mobile phones and internet service providers have been provided with voice assistants as one of the entrances of user interaction for consumers to use. Different voice assistants are preset by different equipment providers, so that a user can perform a voice service channel and connect the voice service of a cloud end by triggering the voice assistant service at first in actual use; if the user uses the millet mobile phone, the user needs to call the Xiao-ai classmates first, if the Baidu smart sound box is used, the Xiao-ai classmates need to be called, and if the voice assistant of the God navigation software is used, the user needs to click a voice call button on an application program interface to start voice semantic recognition and feed back the voice semantic recognition.
In addition, with the increasing aging degree of the whole society, more and more old users and disabled users become users of smart phones and smart devices, and due to objective factors such as visual deterioration, voice becomes an important entrance of user interaction increasingly, and important user experience is carried. The old people cannot remember the brands and specific models of various intelligent devices used by the old people, so that the voice service for the old people still cannot be developed on a large scale today. Meanwhile, the hearing of the elderly is generally impaired, so that it is necessary to use an earphone device with hearing aid or hearing assistance power to cooperate with the daily use of the smart device.
Hearing assistance or auxiliary hearing equipment in the existing market generally adopts a service mode that when the equipment is worn for the first time, a doctor, a professional auditor or a user completes hearing detection in a self-service mode, and a hearing assistance mode is preset according to the result of the hearing detection. Because the environment of the user is complex and changeable, and various possible conditions cannot be fully simulated through simple hearing detection, the user often is uncomfortable in actual use, especially in some special scenes, the hearing aid and the auxiliary hearing device cannot reasonably reduce noise, dynamically compress and amplify, and cannot realize enough signal-to-noise ratio, so that the user is assisted in realizing hearing assistance in a complex environment.
In summary, the conventional hearing aid and auxiliary hearing device cannot flexibly adapt to various scenes used by the user, and meanwhile, due to the complexity of starting the voice assistant, the use of the voice assistant service by the user, especially the elderly user, is hindered. These limitations make it impossible for elderly or hearing-impaired users to obtain high-quality hearing assistance and auxiliary listening services, and also to fully utilize voice assistants, and to improve the quality of service for such users by using various services provided by the voice assistant platform.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a hearing assistance device and a setting method, which can conveniently update the setting of the hearing assistance device when the setting does not meet the requirements of users.
In order to solve the above technical problem, the present invention provides a hearing assistance device, including a sound collection module, a sound generation module, and a connection module for connecting with a smart device, and a signal processing module respectively coupled to the sound collection module, the sound generation module, and the connection module, wherein the signal processing module is configured to perform the following steps:
monitoring whether the current setting of the hearing assistance equipment meets the requirements of a user, and if not, activating a voice assistant of the intelligent equipment;
sending a setting updating request to a cloud service platform through a voice assistant of the intelligent equipment;
and receiving the setting updating information sent by the cloud service platform, and updating the setting according to the setting updating information.
Further, monitoring whether the current settings of the hearing assistance device meet the user requirements is achieved by one of the following methods:
configuring a virtual or physical button, and if the button is monitored to be triggered by a user, judging that the current setting does not meet the requirements of the user;
the method comprises the steps that the speaking and/or environmental sounds of a user are monitored through a sound collection module, and when preset words or preset sound characteristic values are monitored, the current setting is judged to be not met with the user requirements;
the sound collection module monitors sound, and when the sound exceeding a preset sound pressure value is monitored, the current setting is judged to be not satisfied with the user requirement.
Further, the method for activating the voice assistant of the intelligent device comprises the following steps:
and sending a sound signal containing the awakening words of the voice assistant of the intelligent device to the intelligent device.
And sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment.
Further, sending the sound signal containing the wake-up word of the voice assistant of the intelligent device to the intelligent device is realized by one of the following methods:
presetting a plurality of audio data containing voice assistant awakening words in the hearing auxiliary equipment, sequentially reading the audio data containing the voice assistant awakening words when the voice assistant is required to be activated, playing and sending the audio data to the intelligent equipment until the feedback of the intelligent equipment is received;
the method comprises the steps that a plurality of audio data containing voice assistant awakening words are preset in the hearing auxiliary equipment, corresponding voice assistant information is obtained from the intelligent equipment when the hearing auxiliary equipment is connected to the intelligent equipment, and when the voice assistant is required to be activated, the audio data containing the corresponding voice assistant awakening words are selected according to the voice assistant information and sent to the intelligent equipment.
Further, the sound signal containing the wake-up word of the voice assistant of the intelligent device is only sent to the intelligent device and is not played through the sound production module.
Further, the setting update request sent to the cloud service platform includes one or any combination of a user instruction, a locally acquired noise characteristic value, and local sound sampling data of each path.
Further, the setting update information takes a sound signal as a carrier.
Further, the sound signal uses the range of human hearing or the range of frequencies played by the hearing assistance device.
Further, after receiving the sound signal, the hearing assistance device analyzes the setting update information from the sound signal without playing the sound signal through the sound generation module.
Further, the setting update information includes one or any combination of configuration information, algorithm information, and service information.
The hearing assistance device further comprises one or more health sensors, and when monitoring that the detection data of the health sensors are abnormal, or when monitoring that a user speaks a preset word related to the body abnormality of the user, or when monitoring a preset sound characteristic value, the hearing assistance device sends an alarm signal to the intelligent device and/or the cloud service platform through the voice assistant.
The invention also provides a method for setting the hearing auxiliary equipment, which comprises the following steps:
connecting the hearing auxiliary equipment with intelligent equipment which is accessed to the Internet;
monitoring whether the current setting of the hearing assistance equipment meets the requirements of a user, and if not, activating a voice assistant of the intelligent equipment;
sending a setting updating request to a cloud service platform through a voice assistant of the intelligent equipment;
the cloud service platform sends setting updating information to the hearing auxiliary equipment according to the setting request;
and the hearing assistance equipment updates the settings according to the setting updating information.
Further, monitoring whether the current settings of the hearing assistance device meet the user requirements is achieved by one of the following methods:
configuring a virtual or physical button, and if the button is monitored to be triggered by a user, judging that the current setting does not meet the requirements of the user;
the method comprises the steps that the speaking and/or environmental sounds of a user are monitored through a sound collection module, and when preset words or preset sound characteristic values are monitored, the current setting is judged to be not met with the user requirements;
the sound collection module monitors sound, and when the sound exceeding a preset sound pressure value is monitored, the current setting is judged to be not satisfied with the user requirement.
Further, the method for activating the voice assistant of the intelligent device comprises the following steps:
and sending a sound signal containing the awakening words of the voice assistant of the intelligent device to the intelligent device.
And sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment.
Further, sending the sound signal containing the wake-up word of the voice assistant of the intelligent device to the intelligent device is realized by one of the following methods:
presetting a plurality of audio data containing voice assistant awakening words in the hearing auxiliary equipment, sequentially reading the audio data containing the voice assistant awakening words when the voice assistant is required to be activated, playing and sending the audio data to the intelligent equipment until the feedback of the intelligent equipment is received;
the method comprises the steps that a plurality of audio data containing voice assistant awakening words are preset in the hearing auxiliary equipment, corresponding voice assistant information is obtained from the intelligent equipment when the hearing auxiliary equipment is connected to the intelligent equipment, and when the voice assistant is required to be activated, the audio data containing the corresponding voice assistant awakening words are selected according to the voice assistant information and sent to the intelligent equipment.
Further, the sound signal containing the awakening word of the voice assistant of the intelligent device is only sent to the intelligent device and is not played.
Further, the setting update request sent to the cloud service platform includes one or any combination of a user instruction, a locally acquired noise characteristic value, and local sound sampling data of each path.
Further, the setting update information takes a sound signal as a carrier.
Further, the sound signal uses the range of human hearing or the range of frequencies played by the hearing assistance device.
Further, after receiving the sound signal, the hearing assistance device analyzes the setting update information from the sound signal without playing the sound signal.
Further, the setting update information includes one or any combination of configuration information, algorithm information, and service information.
Further, health information of the user is monitored, and when the body health of the user is monitored to be abnormal, or when the user is monitored to speak a preset word related to the body abnormality of the user, or when a preset sound characteristic value is monitored, an alarm signal is sent to the intelligent device and/or the cloud service platform through the voice assistant.
According to the hearing assistance equipment and the setting method thereof, when the current setting of the assistance equipment is monitored not to meet the requirements of the user, the voice assistant of the intelligent equipment is used for updating the setting information from the cloud service platform, hearing assistance and hearing assistance algorithms and configuration can be dynamically selected according to the environment where the user is located, the capability of the hearing assistance equipment for processing sound signals is ingeniously utilized, the user does not need to call the voice assistant, and the purposes of assisting the old user or the hearing-impaired user, realizing effective hearing assistance or hearing assistance, providing personalized hearing assistance service, health detection service and voice service are achieved.
Drawings
FIG. 1 is a schematic block diagram of the architecture of one embodiment of a hearing assistance device of the present invention.
Fig. 2 is a schematic block diagram of an embodiment of a hearing assistance device setting method of the present invention.
Detailed Description
The present invention is further described below in conjunction with the following figures and specific examples so that those skilled in the art may better understand the present invention and practice it, but the examples are not intended to limit the present invention.
As shown in fig. 1, as an embodiment of the hearing assistance device of the present invention, the hearing assistance device includes a sound collection module, a sound generation module, and a connection module for connecting with a smart device, and a signal processing module respectively coupled to the sound collection module, the sound generation module, and the connection module, and configured to perform the following steps:
the hearing assistance equipment initializes the connection with the intelligent equipment and determines the setting for activating the voice assistant according to the related information of the intelligent equipment;
monitoring whether the current setting of the hearing assistance equipment meets the requirements of a user, and if not, activating a voice assistant of the intelligent equipment;
sending a setting updating request to a cloud service platform through a voice assistant of the intelligent equipment;
and receiving the setting updating information sent by the cloud service platform, and updating the setting according to the setting updating information.
Wherein, the sound collection module in this embodiment is the microphone usually, and the sound production module is the earphone usually, and the connection module both can be wireless connection module such as bluetooth, Wifi, also can be 3.5mm general audio interface, USB Type C interface or lightning interface etc.. In order to complete the above steps, the hearing assistance device may be configured with corresponding hardware, such as a CPU, a memory, etc., and then the above steps are performed by software preset on the hearing assistance device; it is also possible to configure the hearing assistance device with simple software and hardware, such as a DSP (Digital Signal Processing) chip, and the above steps are performed by an application program (App) installed on the smart device.
For example, the invention takes the form of a headset and installs an App on a smartphone, tablet, computer or other smart device for use with the headset. Taking a mobile phone as an example, when installing the App, the App can be scanned and identified once or periodically for voice assistant services or applications that have been registered and used by the mobile phone local system, including voice assistant services provided by the mobile phone local system (such as "favorites classmates" preset by a millet mobile phone) and voice assistant services carried by the App installed on the mobile phone (such as a hundredth voice assistant, an Alexa voice assistant, and the like), and if necessary, user guidance is provided to determine the setting that the headset activates the mobile phone voice assistant services. In this embodiment, the mobile phone used is a millet mobile phone, and an Alexa voice assistant application is installed.
The mobile phone App reports the registered voice assistant information of the mobile phone to the cloud service platform, the cloud service platform is in butt joint with each voice assistant platform, and can access a new voice assistant platform or update the butt joint with the existing voice assistant platform according to the voice assistant information reported by the mobile phone App, so that a user can enjoy the service provided by the cloud service platform by using a common voice assistant platform. In this embodiment, the cloud service platform registers, as a millet voice assistant and an Alexa voice assistant, voice assistant services used by the headset-mobile phone combination according to information reported by the mobile phone App.
The current setting of the hearing assistance device does not meet the user requirements, and usually represents that the local hearing assistance effect cannot reach the preset hearing assistance effect and the corresponding hearing assistance index requirements, including but not limited to signal-to-noise ratio, environmental noise reduction, hearing compensation for different hearing frequency bands, and the like.
For example, when the user wears the headset, steps into a relatively noisy bar environment from an open street environment, during which the headset itself is switched and tried according to preset ambient noise reduction and hearing aid algorithms, during the switching or trying process, or after trying all algorithm combinations preset by the handset, the user speaks himself, or says it with others (either in-person or by talking with them): "how to do so here", "i hear something unclear what you say", etc., the current setting of the hearing assistance device is considered to be unable to meet the user's requirements, thereby triggering the reporting condition.
Wherein monitoring whether the current setting of the hearing assistance device meets the user requirements is achieved by one of the following methods:
(1) and configuring a virtual or physical button, monitoring whether the button is triggered or not in real time, and judging that the current setting does not meet the requirements of the user when the button is monitored to be triggered by the user. In this scenario, the configuration of the physical buttons typically requires the user to activate the physical buttons actively, i.e. when the user feels that the current settings of the hearing assistance device do not meet his needs. The physical buttons may be either push-button or touch buttons. The virtual button is usually a region disposed on the touch screen, and the region can be switched according to the configuration to improve the flexibility. Since the virtual button is implemented by software configuration, it can be triggered automatically when a certain condition is satisfied, in addition to being triggered manually by a user.
(2) The method comprises the steps of monitoring the speaking and/or environmental sounds of a user through the sound collection module, identifying voice information which is frequently used by the user and is related to the hearing effect, and judging that the current setting does not meet the requirements of the user when preset words are monitored. For example, the user may repeatedly say "feed, feed", "you click" or "hear unclear", and after performing semantic analysis, the current setting of the hearing assistance device may be considered to be not satisfactory for the user. Or a preset sound characteristic value is monitored in the environmental sound, and the hearing assistance device needs to be switched to a specific mode when the specific environment is judged to enter the specific environment, and the setting of the hearing assistance device also needs to be updated at the moment.
(3) The sound collection module monitors sound, and when the sound exceeding a preset sound pressure value is monitored, the current setting is judged to be not satisfied with the user requirement.
In this embodiment, the method for activating the voice assistant of the smart device includes: and sending a sound signal containing the awakening words of the voice assistant of the intelligent device to the intelligent device. Alternatively, the voice assistant of the smart device may also be activated by: according to a communication protocol agreed with the intelligent device, a protocol instruction for activating the voice assistant is sent to the intelligent device, in this embodiment, when the mobile phone is connected through establishing the bluetooth, a specific model of the mobile phone is obtained, a corresponding voice assistant protocol instruction is known on a mobile phone App or through a service of a cloud platform, and a communication protocol with the mobile phone can be verified through a user bootstrap program, so that the voice assistant is ensured to be activated.
For example, when the hearing assistance device is connected with the intelligent device for the first time, the App installed on the intelligent device starts a bootstrap program, and the App can acquire a specific model of the intelligent device through hardware or an operating system of the intelligent device, match a corresponding voice assistant according to the model of the intelligent device, establish a connection, and guide a user to verify the established connection. The App may also present a list of supported voice assistants to the user, select a voice assistant supported by the smart device to be used, and then direct the user to operate, establish a connection with the voice assistant for the hearing assistance device, and authenticate the established connection.
The voice signal containing the awakening word of the intelligent device voice assistant can be spoken by the user, collected by the hearing assistant device and converted into a voice signal to be sent to the intelligent device. This can also be achieved by one of the following methods:
and presetting and storing audio data containing the awakening words of the voice assistant of the intelligent equipment in the hearing assistance equipment, and reading the audio data containing the awakening words of the voice assistant and playing and sending the audio data to the intelligent equipment when the voice assistant needs to be activated. In order to be applicable to different intelligent devices, a plurality of audio data containing the awakening words of the voice assistant of the intelligent device can be preset and stored in the hearing assistance device, and when the voice assistant needs to be activated, the audio data containing the awakening words of the voice assistant are sequentially read, played and sent to the intelligent device until the feedback of the intelligent device is received. For example, audio data containing words such as "love classmates", "degree of smallness", "Hey, Siri" and the like are preset and stored in the hearing assistance device, and when the voice assistant needs to be activated, the audio data are sequentially read, played and sent to the intelligent device until feedback of the voice assistant on the intelligent device is received. For example, when the hearing assistance device is connected to a millet mobile phone, the feedback can be received when audio data containing 'love classmates' is read and played for the first time and sent to the mobile phone; when the hearing auxiliary equipment is connected to the iPhone mobile phone of apple Inc., no feedback is received when audio data containing 'love classmates' and 'small degree' is read and played and sent to the mobile phone; when audio data containing "Hey, Siri" is read and played, feedback can be received.
In addition, when the hearing assistance device is connected to the intelligent device, corresponding voice assistant information can be acquired from the intelligent device, and when the voice assistant needs to be activated, a corresponding wake-up word is selected according to the voice assistant information and is sent to the intelligent device. For example, when connecting a hearing assistance device to an apple iPhone, the hearing assistance device obtains from the iPhone that the connection is an apple Smart device, and the hearing assistance device sets audio data containing "Hey, Siri" as the first read file. Therefore, when the voice assistant needs to be activated, the voice assistant can directly read and play the audio data containing the "Hey, Siri", so that Siri of the iPhone mobile phone is awakened.
Of course, the voice signal containing the voice assistant wake word may also be synthesized by a voice synthesis technique and sent to the smart device.
In order to reduce interference to the user, only the sound signal containing the wake-up word of the voice assistant of the intelligent device can be sent to the intelligent device, and is not played to the user through the sound production module. Similarly, the hearing assistance device only receives and recognizes the feedback sound of the voice assistant of the intelligent device and does not play the feedback sound. That is, the user cannot hear the voice instruction for waking up the voice assistant sent by the hearing assistance device to the smart device, and cannot hear the feedback voice activated by the mobile phone voice assistant.
And a protocol instruction for activating the voice assistant can be sent to the intelligent equipment according to the communication protocol agreed with the intelligent equipment, and the intelligent equipment automatically opens the voice assistant.
In this embodiment, the setting update request sent to the cloud service platform includes one or any combination of a user instruction, a locally acquired sound characteristic value, a noise characteristic value, and local sound sampling data of each path.
The update request sent to the cloud service platform may use a sound signal as a carrier, that is, the update request is converted into a sound signal file and sent to the intelligent device, and then the sound signal file is sent to the cloud service platform by a voice assistant of the intelligent device. In order not to disturb the user, the hearing assistance device does not play the sound signal of the update request to the user through the sound generation module.
In particular, a hearing assistance device in the form of an earpiece is exemplified. When the current setting is monitored to be incapable of meeting the requirements of the user, the earphone activates 'love classmates' through a communication protocol; or the earphone drives a signal processor arranged in the earphone to send a 'love classmate' voice instruction to the mobile phone, and simultaneously the voice instruction is not played back to a loudspeaker part of the earphone. At this time, a preset voice assistant for 'love classmates' of the mobile phone is activated, the mobile phone feeds back a sound 'on the woolen', the feedback sound is usually sent within a period of time (for example, 5 seconds) after the earphone sends a voice instruction to the mobile phone, and a signal processor arranged in the earphone feeds back the voice which is automatically shielded 'on the woolen' to the loudspeaker, namely, a user cannot hear the feedback provided by the voice assistant of the mobile phone. After receiving the feedback of the 'in-the-loop' from the mobile phone voice assistant, the signal processor sends a voice instruction for connecting the server, wherein the voice instruction is a voice instruction for starting the service registered by the cloud service platform on the favorite voice assistant platform (a similar example is that a user says that the user wants to listen to music, and the user is connected to a cloud server for playing music registered on the favorite voice assistant platform), such as 'intelligent hearing aid'.
At this time, the voice assistant lovely student can return feedback voice such as "searching for the intelligent hearing aid content for you", the feedback voice is usually sent within a period of time (for example, 5 seconds) after the earphone sends a voice instruction to the mobile phone, and the signal processor arranged in the earphone feeds back the voice for automatically shielding the "searching for the intelligent hearing aid content for you" to the loudspeaker, that is, the user cannot hear the feedback provided by the mobile phone voice assistant. After receiving the feedback from the intelligent hearing aid content being searched for, the signal processor sends the voice information of the user, the sound information characteristic value of the surrounding environment or the sound information sampled in the previous period or on site to the cloud service platform through the voice assistant.
After receiving a setting updating request sent by the hearing assistance equipment, the cloud service platform selects information and/or service information such as applicable hearing assistance or auxiliary hearing configuration, algorithm and the like according to information such as a user instruction, a locally acquired sound characteristic value, a noise characteristic value, local sound sampling data and the like contained in the request, generates setting updating information and sends the setting updating information to the intelligent equipment, and then the intelligent equipment sends the setting updating information to the hearing assistance equipment.
The cloud service platform has the core functions that through each voice assistant platform, a user voice instruction which is directly reported to the cloud service platform by the earphone through the smart phone or is obtained, or a sound characteristic value or a noise characteristic value which is locally collected by the earphone, or local sound sampling data which is locally collected by the earphone is obtained, and according to the obtained information, a suggested instruction is pushed to the earphone, wherein the suggested instruction comprises different hearing aid algorithms, dynamic compression algorithms, environment noise reduction algorithms and the like, and the algorithms can be independent algorithms or combinations among the algorithms.
In order to realize the connection between the cloud service platform and the hearing assistance device through the voice assistant of the intelligent device and improve the usability, the setting update information generated by the cloud service platform takes a sound signal as a carrier. That is, the setting update information is converted into a sound signal, and one possible scheme is: the binary 0 is represented by a high frequency sound and the binary 1 is represented by a low frequency sound, so that the binary setting update information can be converted into a sound file composed of high and low frequencies. The cloud service platform sends the sound file to a voice assistant of the intelligent device, the voice assistant plays the sound file, the sound file is converted into sound, the sound is transmitted to the hearing assistance device to be received, the high-frequency sound is analyzed into binary 0, the low-frequency sound is analyzed into binary 1, accordingly, the sound signal is restored into binary set updating information, and instructions, configuration and alternative algorithms are executed locally or services are carried out on the user according to the set updating information. In other embodiments, the setting update information may be carried by the sound signal in other manners.
Preferably, the sound signal uses a frequency outside a human hearing range or a frequency outside a frequency band range played by the hearing assistance device, so that when the hearing assistance device receives the sound signal and analyzes the updated setting, the user does not hear the audio, and interference to the user is avoided. Of course, the audio signal may be shielded by the hearing assistance device to avoid interference to the user, and the sound signal may also be played at a frequency within the range of the user's hearing range or the hearing assistance device.
Of course, in other embodiments, an alert tone may be played for the user in order to let the user know that the hearing assistance device is being updated. The alert tone may be a voice prompt or may be a specific sound such as a "beep, beep" or the like.
When a plurality of voice assistants (such as the lesser classmate and the Alexa voice assistant) exist on the intelligent device at the same time, after the interaction is finished by one of the voice assistants (such as the lesser classmate) for a while or the interaction is interrupted, the interaction process can be executed by the other voice assistant (such as the Alexa voice assistant), so that the effect of the service robustness can be improved (for example, the situation that the network between the lesser classmate voice server and the cloud server is unstable during the interaction process of the user). In addition, the cloud service platform can receive reports and feedbacks from the same earphone-mobile phone combination from a plurality of voice assistants, and the cloud service platform can perform comprehensive comparison and push the algorithm or algorithm combination which is most suitable for the current use of the user.
The above process can be continuously optimized along with the use of the user, for example, when the user expresses that the hearing is unclear, the environmental sound is checked, different algorithms or algorithm combinations are provided, and the self-adaption of the use habits of the user is completed through the feedback history of the user.
In addition, the hearing assistance equipment can be automatically connected with a voice assistant cloud platform of the mobile phone when detecting that the user is in an abnormal state, and sends abnormal information to the voice assistant cloud platform to obtain remote assistance. That is, the hearing assistance device may also carry other health sensor devices, such as a heart rate sensor, a blood pressure sensor, a body temperature sensor, a gyroscope, etc., so that the above-mentioned trigger mechanism may also add information carried by the sensor, and more accurately determine the condition of the user. Even in some extreme cases, a distress mechanism may be triggered. If the body characteristic values of the user such as the heart rate, the blood pressure and the body temperature are detected to be abnormal, or the user falls down through a gyroscope, or the user speaks himself or mentions information such as 'i is not comfortable', 'i is heart uncomfortable', and 'a person has a little breath over', or special sound information such as a long-time ambulance sound appears when the preset sound characteristic values are detected to appear in the environment, the above method can be adopted, a call-for-help mechanism is triggered through voice service, a medical unit or an emergency contact person preset by the user is called, and the problem is solved for the user.
Similarly, an embodiment of the method for setting a hearing assistance device of the present invention includes:
connecting the hearing auxiliary equipment with intelligent equipment which is accessed to the Internet;
monitoring whether the current setting of the hearing assistance equipment meets the requirements of a user, and if not, activating a voice assistant of the intelligent equipment;
sending a setting updating request to a cloud service platform through a voice assistant of the intelligent equipment;
the cloud service platform sends setting updating information to the hearing auxiliary equipment according to the setting request;
and the hearing assistance equipment updates the settings according to the setting updating information.
Wherein monitoring whether the current setting of the hearing assistance device meets the user requirements is achieved by one of the following methods:
configuring a virtual or physical button, and if the button is monitored to be triggered by a user, judging that the current setting does not meet the requirements of the user;
the method comprises the steps that the speaking and/or environmental sounds of a user are monitored through a sound collection module, and when preset words or preset sound characteristic values are monitored, the current setting is judged to be not met with the user requirements;
the sound is monitored through the sound collection module, and when the sound exceeding a preset sound pressure value is monitored, the current setting is judged to be not satisfied with the user requirements.
The method for activating the voice assistant of the intelligent device comprises the following steps: sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device; or sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment. Preferably, sending the sound signal containing the wake-up word of the voice assistant of the intelligent device to the intelligent device is realized by one of the following methods:
presetting a plurality of audio data containing voice assistant awakening words in the hearing auxiliary equipment, sequentially reading the audio data containing the voice assistant awakening words when the voice assistant is required to be activated, playing and sending the audio data to the intelligent equipment until the feedback of the intelligent equipment is received;
the method comprises the steps that a plurality of audio data containing voice assistant awakening words are preset in the hearing auxiliary equipment, corresponding voice assistant information is obtained from the intelligent equipment when the hearing auxiliary equipment is connected to the intelligent equipment, and when the voice assistant is required to be activated, the audio data containing the corresponding voice assistant awakening words are selected according to the voice assistant information and sent to the intelligent equipment.
Further preferably, the sound signal containing the wake-up word of the voice assistant of the intelligent device is only sent to the intelligent device and is not played to the user.
The setting updating request sent to the cloud service platform comprises one or any combination of a user instruction, a locally acquired sound characteristic value, a locally acquired noise characteristic value and locally acquired sound sampling data. The setting update information generated by the cloud service platform takes a sound signal as a carrier, and the sound signal preferably uses a frequency outside a human hearing range or a hearing auxiliary device playing frequency range. After the hearing auxiliary equipment receives the sound signal, the set updating information is analyzed from the sound signal, and the sound signal is not played. The setting update information includes one or any combination of configuration information, algorithm information, and service information.
In addition, the health information of the user can be monitored simultaneously, and when the body health abnormality of the user is monitored, or when the user speaks a preset word related to the body abnormality of the user is monitored, or when a preset sound characteristic value appears in environmental sound, an alarm signal is sent to the intelligent device and/or the cloud service platform through the voice assistant.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (10)
1. A hearing assistance device comprising a sound collection module, a sound generation module, and a connection module for connecting to a smart device, and a signal processing module coupled to the sound collection module, the sound generation module, and the connection module, respectively, the signal processing module being configured to perform the steps of:
monitoring whether the current setting of the hearing assistance equipment meets the requirements of a user, and if not, activating a voice assistant of the intelligent equipment;
sending a setting updating request to a cloud service platform through a voice assistant of the intelligent equipment;
and receiving the setting updating information sent by the cloud service platform, and updating the setting according to the setting updating information.
2. A hearing assistance device as claimed in claim 1, wherein monitoring whether the current setting of the hearing assistance device meets the user's requirements is achieved by one of:
configuring a virtual or physical button, and if the button is monitored to be triggered by a user, judging that the current setting does not meet the requirements of the user;
the method comprises the steps that the speaking and/or environmental sounds of a user are monitored through a sound collection module, and when preset words or preset sound characteristic values are monitored, the current setting is judged to be not met with the user requirements;
the sound collection module monitors sound, and when the sound exceeding a preset sound pressure value is monitored, the current setting is judged to be not satisfied with the user requirement.
3. A hearing assistance device as claimed in claim 1, wherein the method of activating the voice assistant of the smart device comprises:
sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device; alternatively, the first and second electrodes may be,
and sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment.
4. A hearing assistance device as claimed in claim 3, wherein sending a sound signal containing a wake-up word for the smart device voice assistant to the smart device is accomplished by one of:
presetting a plurality of audio data containing voice assistant awakening words in the hearing auxiliary equipment, sequentially reading the audio data containing the voice assistant awakening words when the voice assistant is required to be activated, playing and sending the audio data to the intelligent equipment until the feedback of the intelligent equipment is received;
the method comprises the steps that a plurality of audio data containing voice assistant awakening words are preset in the hearing auxiliary equipment, corresponding voice assistant information is obtained from the intelligent equipment when the hearing auxiliary equipment is connected to the intelligent equipment, and when the voice assistant is required to be activated, the audio data containing the corresponding voice assistant awakening words are selected according to the voice assistant information and sent to the intelligent equipment.
5. A hearing assistance device as claimed in claim 3 or 4, wherein the sound signal containing the wake-up word of the smart device voice assistant is sent only to the smart device and not played to the user through the sound generation module.
6. A method of setting a hearing assistance device, comprising:
connecting the hearing auxiliary equipment with intelligent equipment which is accessed to the Internet;
monitoring whether the current setting of the hearing assistance equipment meets the requirements of a user, and if not, activating a voice assistant of the intelligent equipment;
sending a setting updating request to a cloud service platform through a voice assistant of the intelligent equipment;
the cloud service platform sends setting updating information to the hearing auxiliary equipment according to the setting request;
and the hearing assistance equipment updates the settings according to the setting updating information.
7. A method of setting a hearing assistance device as claimed in claim 6, wherein monitoring whether the current setting of the hearing assistance device meets the user's requirements is achieved by one of:
configuring a virtual or physical button, and if the button is monitored to be triggered by a user, judging that the current setting does not meet the requirements of the user;
the method comprises the steps that the speaking and/or environmental sounds of a user are monitored through a sound collection module, and when preset words or preset sound characteristic values are monitored, the current setting is judged to be not met with the user requirements;
the sound collection module monitors sound, and when the sound exceeding a preset sound pressure value is monitored, the current setting is judged to be not satisfied with the user requirement.
8. A method of setting up a hearing assistance device as claimed in claim 6, wherein the method of activating the voice assistant of the smart device comprises:
sending a sound signal containing a wake-up word of the voice assistant of the intelligent device to the intelligent device; alternatively, the first and second electrodes may be,
and sending a protocol instruction for activating the voice assistant to the intelligent equipment according to the communication protocol agreed with the intelligent equipment.
9. A method as set forth in claim 6, wherein sending a sound signal containing a wake-up word of the smart device voice assistant to the smart device is accomplished by one of:
presetting a plurality of audio data containing voice assistant awakening words in the hearing auxiliary equipment, sequentially reading the audio data containing the voice assistant awakening words when the voice assistant is required to be activated, playing and sending the audio data to the intelligent equipment until the feedback of the intelligent equipment is received;
the method comprises the steps that a plurality of audio data containing voice assistant awakening words are preset in the hearing auxiliary equipment, corresponding voice assistant information is obtained from the intelligent equipment when the hearing auxiliary equipment is connected to the intelligent equipment, and when the voice assistant is required to be activated, the audio data containing the corresponding voice assistant awakening words are selected according to the voice assistant information and sent to the intelligent equipment.
10. A hearing assistance device as claimed in claim 8 or 9 wherein the audio signal containing the wake up word of the smart device voice assistant is sent only to the smart device and not played to the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010323344.1A CN111462747B (en) | 2020-04-22 | 2020-04-22 | Hearing assistance device and setting method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010323344.1A CN111462747B (en) | 2020-04-22 | 2020-04-22 | Hearing assistance device and setting method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111462747A true CN111462747A (en) | 2020-07-28 |
| CN111462747B CN111462747B (en) | 2024-04-05 |
Family
ID=71678602
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010323344.1A Active CN111462747B (en) | 2020-04-22 | 2020-04-22 | Hearing assistance device and setting method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111462747B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104023302A (en) * | 2014-05-19 | 2014-09-03 | 周电 | Programmable digital hearing aid system and method thereof |
| CN206210062U (en) * | 2016-11-30 | 2017-05-31 | 赵紫瑜 | A kind of old man falls down calling for help Intelligent bracelet |
| CN106921926A (en) * | 2017-04-17 | 2017-07-04 | 西安音悦电子科技有限公司 | A kind of High-efficiency self-service is tested with hearing aid device system |
| CN107134279A (en) * | 2017-06-30 | 2017-09-05 | 百度在线网络技术（北京）有限公司 | A kind of voice awakening method, device, terminal and storage medium |
| CN108712566A (en) * | 2018-04-27 | 2018-10-26 | 维沃移动通信有限公司 | A kind of voice assistant awakening method and mobile terminal |
| CN108810175A (en) * | 2018-08-14 | 2018-11-13 | 陕西科技大学 | A kind of life of elderly person nursing intelligent interactive system and its operating method |
| CN110322880A (en) * | 2018-03-28 | 2019-10-11 | 上海博泰悦臻网络技术服务有限公司 | Vehicle-mounted terminal equipment and the method for waking up its multiple interactive voice program |
| WO2019227370A1 (en) * | 2018-05-31 | 2019-12-05 | Dong Xuezhang | Method, apparatus and system for controlling multiple voice assistants, and computer-readable storage medium |
| CN110650421A (en) * | 2018-06-26 | 2020-01-03 | 深圳市智汇声科技有限公司 | Hearing assistance system and host and slave thereof |
| CN110853645A (en) * | 2019-12-02 | 2020-02-28 | 三星电子（中国）研发中心 | Method and device for recognizing voice command |
-
2020
- 2020-04-22 CN CN202010323344.1A patent/CN111462747B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104023302A (en) * | 2014-05-19 | 2014-09-03 | 周电 | Programmable digital hearing aid system and method thereof |
| CN206210062U (en) * | 2016-11-30 | 2017-05-31 | 赵紫瑜 | A kind of old man falls down calling for help Intelligent bracelet |
| CN106921926A (en) * | 2017-04-17 | 2017-07-04 | 西安音悦电子科技有限公司 | A kind of High-efficiency self-service is tested with hearing aid device system |
| CN107134279A (en) * | 2017-06-30 | 2017-09-05 | 百度在线网络技术（北京）有限公司 | A kind of voice awakening method, device, terminal and storage medium |
| CN110322880A (en) * | 2018-03-28 | 2019-10-11 | 上海博泰悦臻网络技术服务有限公司 | Vehicle-mounted terminal equipment and the method for waking up its multiple interactive voice program |
| CN108712566A (en) * | 2018-04-27 | 2018-10-26 | 维沃移动通信有限公司 | A kind of voice assistant awakening method and mobile terminal |
| WO2019227370A1 (en) * | 2018-05-31 | 2019-12-05 | Dong Xuezhang | Method, apparatus and system for controlling multiple voice assistants, and computer-readable storage medium |
| CN110650421A (en) * | 2018-06-26 | 2020-01-03 | 深圳市智汇声科技有限公司 | Hearing assistance system and host and slave thereof |
| CN108810175A (en) * | 2018-08-14 | 2018-11-13 | 陕西科技大学 | A kind of life of elderly person nursing intelligent interactive system and its operating method |
| CN110853645A (en) * | 2019-12-02 | 2020-02-28 | 三星电子（中国）研发中心 | Method and device for recognizing voice command |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111462747B (en) | 2024-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11251763B2 (en) | Audio signal adjustment method, storage medium, and terminal | |
| US20220295194A1 (en) | Interactive system for hearing devices | |
| DK2882204T3 (en) | Hearing aid device for hands-free communication | |
| CN107509153B (en) | Detection method and device of sound playing device, storage medium and terminal | |
| US20130343584A1 (en) | Hearing assist device with external operational support | |
| CN111447539A (en) | Fitting method and device for hearing earphones | |
| US20200128317A1 (en) | Throat microphone system and method | |
| WO2012151997A1 (en) | Call voice recording method and device for mobile terminal and mobile terminal | |
| CN106416299A (en) | Personal communication device having application software for controlling the operation of at least one hearing aid | |
| EP3979666A2 (en) | A hearing device comprising an own voice processor | |
| CN112911441A (en) | Noise reduction method, apparatus, audio device, and computer-readable storage medium | |
| CN108810778B (en) | Method for operating a hearing device and hearing device | |
| EP4132010A2 (en) | A hearing system and a method for personalizing a hearing aid | |
| US11589173B2 (en) | Hearing aid comprising a record and replay function | |
| US20220295191A1 (en) | Hearing aid determining talkers of interest | |
| JP4114392B2 (en) | Inspection center device, terminal device, hearing compensation method, hearing compensation method program recording medium, hearing compensation method program | |
| EP2876902A1 (en) | Adjustable hearing aid device | |
| CN111462747A (en) | Hearing assistance device and setting method thereof | |
| CN107493376A (en) | A kind of ringing volume adjusting method and device | |
| CN109218875B (en) | Intelligent earphone device personalization system with directional conversation function and use method | |
| KR102609206B1 (en) | Self-fitting hearing aid system having the cradle and fitting method using the same | |
| US20230396938A1 (en) | Capture of context statistics in hearing instruments | |
| CN113495713B (en) | Method and device for adjusting earphone audio parameters, earphone and storage medium | |
| US11615801B1 (en) | System and method of enhancing intelligibility of audio playback | |
| CN117093182B (en) | Audio playing method, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |