CN113746983B - Hearing aid method and device, storage medium and intelligent terminal - Google Patents

Hearing aid method and device, storage medium and intelligent terminal Download PDF

Info

Publication number
CN113746983B
CN113746983B CN202111039829.9A CN202111039829A CN113746983B CN 113746983 B CN113746983 B CN 113746983B CN 202111039829 A CN202111039829 A CN 202111039829A CN 113746983 B CN113746983 B CN 113746983B
Authority
CN
China
Prior art keywords
hearing
hearing aid
parameters
intelligent terminal
earphone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111039829.9A
Other languages
Chinese (zh)
Other versions
CN113746983A (en
Inventor
周恪睿
周波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202111039829.9A priority Critical patent/CN113746983B/en
Publication of CN113746983A publication Critical patent/CN113746983A/en
Application granted granted Critical
Publication of CN113746983B publication Critical patent/CN113746983B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Telephone Function (AREA)
  • Headphones And Earphones (AREA)

Abstract

A hearing aid method and device, a storage medium, and an intelligent terminal, wherein the method is executed by the intelligent terminal, and the method comprises the following steps: detecting whether an earphone is connected with the intelligent terminal or not when a hearing-aid starting instruction is acquired, and receiving sound signals of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal; processing the sound signal through a selected set of hearing aid parameters, wherein the selected set of hearing aid parameters selects a hearing aid parameter set; and sending the processed sound signal to the earphone so that the earphone plays the processed sound signal. Through the scheme, the user can realize the effective hearing aid effect with lower cost, and the user can configure and debug various parameters of the hearing aid device by self, so that the use convenience of the user is improved.

Description

Hearing aid method and device, storage medium and intelligent terminal
Technical Field
The invention relates to the field of hearing aid equipment development and debugging, in particular to a hearing aid method and device, a storage medium and an intelligent terminal.
Background
Traditional hearing aid methods are implemented with specialized hearing aids, which are small loudspeakers that amplify the otherwise inaudible sound and then utilize the hearing aids' residual hearing to allow the sound to be delivered to the brain auditory center for perception.
However, specialized hearing aids are generally expensive, and require users to go to hospitals or fitting centers, and a doctor or a professional fitter performs hearing tests, hearing aid fitting, etc. to realize fitting and configuration of parameters of each item in the hearing aid, so that requirements on sites and personnel are high, and users are inconvenient to use.
Disclosure of Invention
The invention solves the technical problem of how to provide a hearing aid method, so that a user can realize an effective hearing aid effect with lower cost, and the user can configure and debug various parameters of hearing aid equipment by self, thereby improving the use convenience of the user.
To solve the above problems, an embodiment of the present invention provides a hearing assistance method, which is executed by an intelligent terminal, including: detecting whether an earphone is connected with the intelligent terminal or not when a hearing-aid starting instruction is acquired, and receiving sound signals of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal; processing the sound signal through a selected set of hearing aid parameters, wherein the selected set of hearing aid parameters selects a hearing aid parameter set; and sending the processed sound signal to the earphone so that the earphone plays the processed sound signal.
Optionally, a plurality of groups of hearing aid parameters for different scenes are preconfigured in the hearing aid parameter set, and each group of hearing aid parameters at least comprises one or more of the following: frequency adjustment parameters, volume adjustment parameters, and noise reduction parameters; the frequency adjusting parameter is used for adjusting the frequency of the sound signal, the volume adjusting parameter is used for adjusting the amplitude of the sound signal, and the noise reducing parameter is used for suppressing noise in the sound signal.
Optionally, the processing the sound signal by the selected set of hearing assistance parameters includes: and judging a scene corresponding to the external environment according to the sound signal, and selecting hearing aid parameters of the scene corresponding to the external environment.
Optionally, the method further comprises: step A, when a parameter calibration instruction is received, a test audio signal is sent to the earphone, so that the earphone plays the test audio signal; step B, when an adjustment instruction for one or more hearing aid parameters in a group of hearing aid parameters is received, adjusting the corresponding hearing aid parameters according to the received adjustment instruction; step C, processing the test audio signal through the adjusted set of hearing aid parameters, and sending the processed test audio signal to the earphone so that the earphone plays the processed test audio signal; jumping to the step B, and repeatedly executing the step B and the step C until a calibration ending instruction is received; and D, storing the current hearing aid parameters when the calibration ending instruction is received.
Optionally, after step D, the method further includes: generating a corresponding hearing defect curve according to the current hearing assistance parameters; and according to the hearing defect curve, automatically calibrating hearing aid parameters of other uncalibrated scenes.
Optionally, after generating the corresponding hearing defect curve according to the current hearing assistance parameters, the method further includes: transmitting the hearing impairment curve to a server; and receiving hearing analysis and/or recommended hearing aid parameter configuration sent by the server and corresponding to the hearing deficiency curve.
Optionally, after receiving the sound signal of the external environment through the microphone of the intelligent terminal, the method further includes: performing a sound source analysis on the sound signal and outputting characteristics of one or more sound sources, each sound source characteristic comprising at least one of: the distance between the sound source and the intelligent terminal, the relative position between the sound source and the intelligent terminal and the type of the sound source.
Optionally, the outputting the characteristics of the one or more sound sources includes: determining the orientation of the reference vector of the intelligent terminal according to the current gesture of the terminal; and outputting the characteristics of the reference vector of the intelligent terminal, which is directed to the sound source.
The embodiment of the invention also provides a hearing device, which is arranged in or coupled with the intelligent terminal, and comprises: the starting module is used for detecting whether the earphone is connected with the intelligent terminal or not when a hearing-aid starting instruction is acquired, and receiving sound signals of the external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal; the sound signal processing module is used for processing the sound signal through a selected group of hearing aid parameters, and the selected group of hearing aid parameters select a hearing aid parameter set; and the playing module is used for sending the processed sound signals to the earphone so that the earphone plays the processed sound signals.
The embodiment of the invention also provides a storage medium, on which a computer program is stored, which, when being executed by a processor, performs the steps of any of the hearing aid methods.
The embodiment of the invention also provides an intelligent terminal, which comprises a memory and a processor, wherein the memory stores a computer program which can be run on the processor, and the processor executes any step of the hearing aid method when running the computer program.
Compared with the prior art, the technical scheme of the embodiment of the application has the following beneficial effects:
according to the hearing aid method, the hearing aid effect can be achieved by matching the intelligent terminal with the earphone instead of a traditional hearing aid, and therefore the cost of hearing aid equipment can be reduced. And the intelligent terminal can manage a self-help hearing parameter set comprising a plurality of hearing aid parameters, and a user can select proper hearing aid parameters from the self-help hearing parameter set to change hearing aid effects, so that self-help configuration and debugging of various parameters of hearing aid equipment are realized, and the use convenience of the user is improved.
Further, the intelligent terminal can judge the scene corresponding to the external environment according to the sound signal of the external environment collected by the microphone, automatically select the hearing aid parameters applicable to the external environment for the user, and can automatically switch the hearing aid parameters when the scene corresponding to the external environment is monitored to be changed, so that the hearing aid parameters with the best hearing aid effect can be selected for the user in real time.
Furthermore, the user can realize self-service calibration of hearing aid parameters of hearing aid equipment through the intelligent terminal, and the user does not need to go to a hospital or a fitting center to calibrate various parameters of the hearing aid, so that the convenience of the user in use can be improved.
Furthermore, the intelligent terminal can also perform sound source analysis on the collected external sound signals to obtain the characteristics of all or part of sound sources near the intelligent terminal, and the characteristics can be used as hearing aid information to be output and displayed on a screen so as to better help a user to understand the external sound signals.
Drawings
Fig. 1 is a schematic flow chart of a hearing aid method according to an embodiment of the invention;
fig. 2 is a schematic structural diagram of a hearing aid system according to an embodiment of the present invention;
FIG. 3 is a flow chart of a parameter calibration method according to an embodiment of the invention;
fig. 4 is a schematic diagram of reference vectors of an intelligent terminal according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a hearing aid device according to an embodiment of the present invention.
Detailed Description
As background art, conventional hearing aids are expensive, and the parameter configuration and adjustment of hearing aids are required to be performed on sites and personnel, which is inconvenient for users.
In order to solve the above problems, embodiments of the present invention provide a hearing assistance method and apparatus, a storage medium, and an intelligent terminal, where the hearing assistance method is executed by the intelligent terminal, and the hearing assistance method includes: detecting whether an earphone is connected with the intelligent terminal or not when a hearing-aid starting instruction is acquired, and receiving sound signals of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal; processing the sound signal through a selected set of hearing aid parameters, wherein the selected set of hearing aid parameters selects a hearing aid parameter set; and sending the processed sound signal to the earphone so that the earphone plays the processed sound signal. According to the scheme provided by the embodiment of the invention, the hearing aid effect can be realized through the cooperation of the intelligent terminal and the earphone, so that the cost of hearing aid equipment can be reduced. And the intelligent terminal can manage a self-help hearing parameter set comprising a plurality of hearing aid parameters, and a user can select proper hearing aid parameters from the self-help hearing parameter set to change hearing aid effects, so that self-help configuration and debugging of various parameters of hearing aid equipment are realized, and the use convenience of the user is improved.
In order to make the above objects, features and advantages of the present invention more comprehensible, embodiments accompanied with figures are described in detail below.
Referring to fig. 1, fig. 1 is a flowchart of a hearing assistance method provided by an embodiment of the present invention, where the hearing assistance method is performed by an intelligent terminal, and the intelligent terminal may include a smart phone, a computer, a tablet computer, or a smart watch, and the method includes the following steps S101 to S103, which are described in detail below.
Step S101, detecting whether an earphone is connected with the intelligent terminal or not when a hearing aid starting instruction is acquired, and receiving sound signals of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal.
The hearing aid starting instruction is an instruction for starting the hearing aid method, the hearing aid starting instruction can be an instruction input by the user in an input device (such as a screen of a smart phone input through a touch screen) of the smart terminal, and the hearing aid starting instruction can also be an instruction sent by other devices received by the smart terminal.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a hearing aid system according to an embodiment of the present invention, where the hearing aid system may include a smart terminal 201 and a headset 202. The headset 202 and the smart terminal 201 may be connected by a circuit connection, a bluetooth connection or other means. Existing intelligent terminals (such as mobile phones and the like) can automatically detect that an earphone is connected with the intelligent terminal, the intelligent terminal is provided with a microphone, when the hearing aid method is started, the microphone collects sound signals of the external environment where the terminal is located, the collected sound signals are played by the earphone after being processed (such as amplified, noise reduced and the like), and the user hears the sound signals through hearing (such as residual hearing) of the user.
Step S102, processing the sound signal through a selected set of hearing assistance parameters, where the selected set of hearing assistance parameters selects a set of hearing assistance parameters.
The intelligent terminal is configured with a hearing aid parameter set comprising a plurality of groups of hearing aid parameters, each group of hearing aid parameters can comprise one or more parameters, and the types of the hearing aid parameters can comprise parameters for adjusting the volume or frequency of a sound signal, a filter coefficient, a noise reduction coefficient and the like. Optionally, the types of hearing aid parameters are the same as the types of the plurality of hearing aid parameters configured in the conventional hearing aid, and the values of the respective hearing aid parameters correspond to the hearing situation of the user. The intelligent terminal can filter the sound signal based on the filter coefficient so as to realize noise reduction and other processing.
Step S103, sending the processed sound signal to the earphone, so that the earphone plays the processed sound signal.
The intelligent terminal processes the sound signals of the external environment based on a group of hearing aid parameters selected by the user, adjusts the sound signals to sound signals which can be heard by the residual hearing of the user, and sends the sound signals to the earphone to be played to the user.
The method shown in fig. 1 can replace the traditional hearing aid to realize hearing aid effect through the cooperation of the intelligent terminal and the earphone, so that the cost of hearing aid equipment can be reduced. And the intelligent terminal can manage a self-help hearing parameter set comprising a plurality of hearing aid parameters, and a user can select proper hearing aid parameters from the self-help hearing parameter set to change hearing aid effects, so that self-help configuration and debugging of various parameters of hearing aid equipment are realized, and the use convenience of the user is improved.
In one embodiment, the earphone may be a bone conduction earphone, and one or more hearing assistance parameters in the hearing assistance parameter set are bone conduction related parameters, where the bone conduction related parameters may include parameters such as response frequency, sensitivity, signal to noise ratio, transient response, and distortion degree. Wherein the bone conduction related parameter varies with the brand and/or model of the headset. The method further comprises the steps of: the brand and/or model of the earphone are obtained to judge contact information between the earphone and the human ear after the earphone is worn on the human ear, wherein the contact information at least comprises the contact position of the earphone and the human ear and the tightness of the earphone when the earphone is worn on the human ear; and determining the parameters related to bone conduction according to the contact information.
The hearing defect condition of the hearing impaired user is usually determined by air conduction hearing and bone conduction hearing, and the condition that the sound signal is transmitted to the brain of the user through bone conduction of the human ear when the earphone plays the sound signal can be predicted by the position of the earphone contacted with the human ear when the earphone is correctly worn and the tightness of a cavity formed between the earphone and the human ear. The bone conduction related parameters and wearing conditions of the headphones of different brands and/or models are different, and the intelligent terminal can acquire the brands and/or models of the headphones to select the corresponding bone conduction related parameters for the user.
In a specific embodiment, referring to fig. 1 and fig. 2 again, the method described in fig. 1 may be implemented by an Application (APP) or system software installed on the intelligent terminal 201, and the user opens the APP or system software on the intelligent terminal 201 and issues a hearing aid start instruction. The hearing aid parameter set comprises a plurality of groups of hearing aid parameters, each group of hearing aid parameters can comprise a plurality of numerical values corresponding to different types of hearing aid parameters, and if a user needs to change the hearing aid parameters selected currently, the hearing aid parameters can be modified through an APP or a parameter modification page in system software. The APP or system software is further configured to perform sound analysis and processing on the sound signal collected by the microphone of the smart terminal 201. With continued reference to fig. 2, the hearing aid system may further include a server 203, where the server 203 is connected to one or more intelligent terminals 201 through a network connection or other connection manner, so as to enable software upgrade or problem collection of APP or system software on each intelligent terminal 201. Optionally, the APP or the system software further includes a question feedback page, configured to collect questions and comments of the user, where the collected questions and comments are sent by the intelligent terminal 201 to the server 203, so as to enable interaction between the user and a remote manufacturer.
In one embodiment, a plurality of groups of hearing aid parameters for different scenes are preconfigured in the hearing aid parameter set, and each group of hearing aid parameters at least comprises one or more of the following: frequency adjustment parameters, volume adjustment parameters, and noise reduction parameters; the frequency adjusting parameter is used for adjusting the frequency of the sound signal, the volume adjusting parameter is used for adjusting the amplitude of the sound signal, and the noise reducing parameter is used for suppressing noise in the sound signal.
The different scenes may include an indoor scene, an outdoor scene, a high noise scene (such as a scene with higher environmental noise in a factory, a decoration place, etc.), etc. Hearing aid parameters of different scenes are also different for the hearing condition of the same user. For example, the noise in the indoor scene is minimum, the noise in the outdoor scene is next highest, the noise in the high noise scene is maximum, the corresponding noise reduction coefficient for the indoor scene should be minimum, the noise reduction coefficient in the outdoor scene is next highest, and the noise reduction coefficient in the high noise scene is highest.
It should be noted that, each scenario may be set according to requirements of a large number of users using the hearing aid method, and the values of a set of hearing aid parameters corresponding to each scenario may also be determined according to actual requirements, which includes but is not limited to the above examples.
In one embodiment, the processing of the sound signal by the selected set of hearing assistance parameters in step S102 of fig. 1 may include: and judging a scene corresponding to the external environment according to the sound signal, and selecting hearing aid parameters of the scene corresponding to the external environment.
After the intelligent terminal collects the sound signals of the external environment through the microphone, the scene of the external environment can be judged according to the volume of noise (such as wind sound, engine sound and the like) contained in the collected sound signals and the volume of effective sound signals (such as speaking sound, music sound and the like), so that hearing aid parameters corresponding to the scene can be automatically selected according to the scene corresponding to the external environment.
Optionally, when the intelligent terminal and the earphone are continuously used as the hearing aid, the scene corresponding to the external environment is judged at intervals (for example, every 10 minutes or half an hour), and if the scene corresponding to the external environment is found to change, the selected hearing aid parameters are switched to hearing aid parameters corresponding to the changed scene.
In this embodiment, the intelligent terminal can judge the scene corresponding to the external environment according to the sound signal of the external environment collected by the microphone, automatically select the hearing aid parameters applicable to the external environment for the user, and when the scene corresponding to the external environment is monitored to change, can automatically switch the hearing aid parameters, thereby being capable of selecting the hearing aid parameters with the best hearing aid effect for the user in real time.
In an embodiment, please refer to fig. 3, fig. 3 is a flowchart of a parameter calibration method according to an embodiment of the present invention, where the parameter calibration method is used for calibrating one or more hearing aid parameters in the hearing aid parameter set, and the parameter calibration method may include the following steps a to D, which are described in detail below.
And step A, when a parameter calibration instruction is received, sending a test audio signal to the earphone so that the earphone plays the test audio signal.
The parameter calibration instruction is an instruction for starting to calibrate one or more parameters in the hearing aid parameter set, the parameter calibration instruction may be an instruction input by the user in an input device of the intelligent terminal, and the parameter calibration instruction may also be an instruction sent by other devices received by the intelligent terminal.
After calibration starts, the intelligent terminal sends a test audio signal to the earphone, wherein the test audio signal can be an audio signal acquired from the external environment or an audio signal acquired by downloading, such as a piece of music or a section of dialogue, and the like. Alternatively, the user may select a played test audio signal on the intelligent terminal. Optionally, the test audio signal corresponds to a scene of the hearing aid parameter to be calibrated currently, for example, if the user needs to calibrate the hearing aid parameter of the outdoor scene, the played test audio signal is a piece of audio recorded outdoors.
And B, when an adjustment instruction for one or more hearing assistance parameters in the group of hearing assistance parameters is received, adjusting the corresponding hearing assistance parameters according to the received adjustment instruction.
The adjustment instruction is an instruction for adjusting one or more parameters in the hearing aid parameter set, and optionally, the adjustment instruction may be an instruction input by a user or received by an intelligent terminal. If the hearing aid method is executed by APP or system software installed on the intelligent terminal, the APP or system software may provide a separate page or a region of the page for the user to input adjustment instructions and adjust the values of the respective hearing aid parameters. Optionally, values corresponding to one or more hearing aid parameters are displayed in the page, and the user can change the values displayed by each hearing aid parameter on the page through the input adjustment instruction to adjust the values of the hearing aid parameters, so that the hearing aid parameters corresponding to one or more scenes are adjusted.
And C, processing the test audio signal through the adjusted set of hearing aid parameters, and sending the processed test audio signal to the earphone so that the earphone plays the processed test audio signal. And then jumping to the step B, and repeatedly executing the step B and the step C until a calibration ending instruction is received.
Optionally, after the user adjusts the hearing aid parameters each time, the test audio signal is processed according to the adjusted hearing aid parameters, and the test audio signal played by the earphone is updated to the processed test audio signal, so that the user can feel the hearing aid effect of the adjusted hearing aid parameters in real time, and if the user is not satisfied with the hearing aid effect of the current hearing aid parameters, the user can continue to adjust the hearing aid parameters.
And D, storing the current hearing aid parameters when the calibration ending instruction is received.
After the user obtains a satisfactory hearing aid effect, a calibration ending instruction can be issued to the intelligent terminal to end the parameter calibration process, the intelligent terminal stores all the hearing aid parameters after adjustment, and when the user uses the hearing aid method later, the hearing aid parameters stored after calibration can be used for processing the acquired sound signals. Alternatively, if the APP or system software provides a separate page or a specific area of the page for adjusting the value of each hearing aid parameter, the separate page or the specific area of the page may be closed when the calibration end instruction is received.
In this embodiment, the user can implement self-service calibration of hearing aid parameters of the hearing aid device through the intelligent terminal, and does not need to go to a hospital or a test and match center to calibrate various parameters of the hearing aid, so that the convenience of use of the user can be improved.
In one embodiment, referring again to the figure, after step D, the hearing assistance method further comprises: generating a corresponding hearing defect curve according to the current hearing assistance parameters; and according to the hearing defect curve, automatically calibrating hearing aid parameters of other uncalibrated scenes.
The hearing impairment curve, also called hearing curve, is used to represent the hearing impairment of the user. Conventionally, a user needs to go to a hospital or a fitting center to perform a hearing test to measure the hearing deficiency of the user. In clinical hearing test, a tester responds to a threshold value of sound of each frequency, records the threshold value on the same audiogram, and connects each point to draw an air-conduction hearing curve and a bone-conduction hearing curve to obtain the hearing defect curve. The doctor or fitter compares and analyzes the two curves to determine the normal hearing range of the tester, the degree of hearing loss (including mild, moderate, severe, or extremely severe, etc.), the nature and location of the hearing impairment, etc.
The contact position of the earphone and the ear of the user and the tightness between the earphone and the ear can be determined through the brand and the model of the earphone, optionally, the intelligent terminal can acquire the brand and the model of the earphone, and the hearing defect condition of the user can be determined by combining the hearing aid parameters stored by the intelligent terminal after calibration so as to generate a hearing defect curve of the user.
Further, the hearing defect curve generated in a certain scene can be used for automatically calibrating various hearing assistance parameters corresponding to other scenes. Normally, hearing aid parameters related to noise reduction in each scene are changed according to the scene, and relevant hearing aid parameters for compensating the hearing defect of a user are not limited by the scene, so that the intelligent terminal can automatically calibrate each group of hearing aid parameters in other scenes according to the hearing defect curve of the user by one key, the user is not required to calibrate the hearing aid parameters in the scenes one by one, and the use convenience of the user is improved.
In one embodiment, after the generating the corresponding hearing deficiency curve according to the current hearing assistance parameters, the method further includes: transmitting the hearing impairment curve to a server; and receiving hearing analysis and/or recommended hearing aid parameter configuration sent by the server and corresponding to the hearing deficiency curve.
After the intelligent terminal generates the hearing deficiency curve of the user, the hearing deficiency curve can be sent to a server to serve as feedback of the hearing situation of the user. The server can send the hearing defect curves of the users to a terminal such as a computer or a mobile phone of a doctor or an expert, and the doctor or the expert can remotely perform hearing diagnosis for the users based on the hearing defect curves of the users and recommend hearing aid parameter configuration for the users.
Optionally, after receiving the hearing defect curves of one or more users, the server may determine, according to the hearing defect curves, whether the current scenario/hearing aid parameter configuration provided by the APP or system software for the users can meet the calibration requirement of the users, and if not, issue an instruction for updating the APP or system software to the user terminal, so as to remotely update the APP or system software of the user terminal.
In one embodiment, referring to fig. 1, after step S101 of receiving a sound signal of an external environment through a microphone of the smart terminal, the hearing assistance method further includes: performing a sound source analysis on the sound signal and outputting characteristics of one or more sound sources, each sound source characteristic comprising at least one of: the distance between the sound source and the intelligent terminal, the relative position between the sound source and the intelligent terminal and the type of the sound source.
The sound source is a source of sound, and the collected sound signals may or may not come from a plurality of sound sources, i.e., a pure noise environment. The intelligent terminal can judge the sound source of each sound in the sound signal based on the factors such as the tone color, the frequency and the like of each sound in the collected sound signal. Further, the intelligent terminal divides the collected sound signals according to the frequency bands and analyzes each frequency band respectively, so that the type of the sound source corresponding to the sound signals of each frequency band is judged. For example, if the external sound signal includes a sound uttered by a person, the sound source of the sound is the person; if the external sound signal contains the sound of the automobile whistle, the corresponding sound source is an automobile and the like.
Optionally, a plurality of factors such as tone color, frequency and the like corresponding to sound generated by different sound sources can be stored on the intelligent terminal. The intelligent terminal compares a plurality of factors of each sound in the collected sound signals with the stored factors of different sound sources so as to determine the sound corresponding to the sound contained in the collected sound signals. Further, the factors such as tone color, frequency and the like corresponding to sound generated by a plurality of different sound sources stored on the intelligent terminal can be acquired from the server side through the APP or system software.
After the smart terminal determines the sound sources corresponding to the respective sounds, the characteristics of the respective sound sources may be output on a screen of the smart terminal (e.g., displayed on the screen) as hearing aid information. The intelligent terminal can judge the distance between the sound source and the intelligent terminal according to the volume of the sound signal corresponding to each sound source, and judge the relative position between the sound source and the intelligent terminal through the echo or the spatial sense of the sound signal corresponding to each sound source, wherein the type of the sound source can be people, automobiles and the like.
In a specific embodiment, when a user opens APP or system software for implementing a hearing aid method and performs hearing aid on sounds of an external environment through headphones, a schematic diagram of one or more sound sources contained in currently collected sound signals of the external environment, and distances and relative positions between each sound source and the intelligent terminal may be further output on a display page of the APP or system software. For example, output may be on a display page of the APP or system software: a sound source automobile exists in the position 50 m in front of the left, and at the moment, the collected sound signals of the external environment can be played simultaneously in the earphone, wherein the sound signals comprise whistling sounds of the automobile. Further, the map around the current position of the intelligent terminal can be output in the display page of the APP or the system software, and each sound source is displayed at the corresponding position on the output map according to the relative position and the distance between the sound source and the intelligent terminal, so that the user can understand the map more conveniently.
Optionally, the outputting the characteristics of the one or more sound sources includes: determining the orientation of the reference vector of the intelligent terminal according to the current gesture of the terminal; and outputting the characteristics of the reference vector of the intelligent terminal, which is directed to the sound source.
The gesture of the intelligent terminal is an included angle of a display area (namely a terminal screen) of the terminal deviating from a horizontal plane and/or an included angle of the display area deviating from a gravity direction. And monitoring the gesture of the terminal, and collecting the gesture of the terminal at each moment in real time as the current gesture of the terminal. Optionally, the current gesture of the intelligent terminal is obtained through a gesture sensor on the intelligent terminal, where the gesture sensor is a high-performance three-dimensional motion gesture measurement system based on Micro-Electro-Mechanical System (MEMS for short), and may include motion sensors such as a three-axis gyroscope, a three-axis accelerometer, a three-axis electronic compass, and the like.
The reference vector of the smart terminal is a vector for determining the orientation of the smart terminal, and may be determined according to factors such as the habit of using the smart terminal by a user, for example, when the smart terminal is a smart phone, the reference vector may be a vector pointing to the top from the bottom of the screen of the smart phone, please refer to fig. 4, and fig. 4 is a schematic diagram of the reference vector of the smart terminal.
When a plurality of sound sources exist in the collected sound signals of the external environment, if the characteristics of the plurality of sound sources are output at the same time, the output information may be excessive, and the user can not check conveniently. At this time, the user can change the orientation of the reference vector of the intelligent terminal, so that the intelligent terminal only outputs the characteristics of the sound source existing in the direction. For example, the user changes the posture of the smartphone so that the reference vector of fig. 4 is oriented at a left 45 degree angle right in front of the user, and only the characteristics of sound sources existing in the left 45 degree angle direction in front of the user are displayed in the display page of the APP or system software of the smartphone.
In this embodiment, the intelligent terminal may further perform sound source analysis on the collected external sound signal, so as to obtain characteristics of all or part of sound sources near the intelligent terminal, where the characteristics may be used as hearing aid information to be output and displayed on a screen, so as to better help a user understand the external sound signal.
Referring to fig. 5, an embodiment of the present invention further provides a hearing aid device 50, where the hearing aid device 50 is disposed in the smart terminal, or the hearing aid device 50 is disposed separately from the smart terminal and coupled with the smart terminal, and the hearing aid device 50 includes: the starting module 501 is configured to detect whether an earphone is connected to the intelligent terminal when a hearing-aid starting instruction is acquired, and receive a sound signal of an external environment through a microphone of the intelligent terminal when the earphone is connected to the intelligent terminal; a sound signal processing module 502, configured to process the sound signal through a selected set of hearing assistance parameters, where the selected set of hearing assistance parameters selects a hearing assistance parameter set; and the playing module 503 is configured to send the processed sound signal to the earphone, so that the earphone plays the processed sound signal.
In one embodiment, a plurality of groups of hearing aid parameters for different scenes are preconfigured in the hearing aid parameter set, and each group of hearing aid parameters at least comprises one or more of the following: frequency adjustment parameters, volume adjustment parameters, and noise reduction parameters; the frequency adjusting parameter is used for adjusting the frequency of the sound signal, the volume adjusting parameter is used for adjusting the amplitude of the sound signal, and the noise reducing parameter is used for suppressing noise in the sound signal.
In an embodiment, the sound signal processing module 502 may be further configured to determine a scene corresponding to an external environment according to the sound signal, and select a hearing aid parameter of the scene corresponding to the external environment.
In one embodiment, the hearing device 50 may further include: the calibration starting module is used for executing the step A, and sending a test audio signal to the earphone when a parameter calibration instruction is received, so that the earphone plays the test audio signal; the parameter adjustment module is used for executing the step B, and when an adjustment instruction for one or more hearing parameters in a group of hearing parameters is received, the corresponding hearing parameters are adjusted according to the received needle adjustment instruction; the test module is used for executing the step C, processing the test audio signal through the adjusted set of hearing aid parameters, and sending the processed test audio signal to the earphone so that the earphone plays the processed test audio signal; the circulation module is used for jumping to the step B, and repeatedly executing the step B and the step C until a calibration ending instruction is received; and D, the calibration ending module is used for executing the step D and storing the current hearing aid parameters when the calibration ending instruction is received.
In one embodiment, after the calibration end module, the hearing device 50 may further include: the hearing defect curve generation module is used for generating a corresponding hearing defect curve according to the current hearing aid parameters; and the automatic calibration module is used for automatically calibrating hearing-aid parameters of other uncalibrated scenes according to the hearing defect curve.
In one embodiment, after the automatic calibration module, the hearing device 50 may further include: the sending module is used for sending the hearing defect curve to a server; and the remote assistance module is used for receiving hearing analysis and/or recommended hearing aid parameter configuration which is sent by the server and is based on the hearing defect curve.
In one embodiment, after the receiving, by the microphone of the smart terminal, the sound signal of the external environment is performed, the start module 501 may be further configured to: performing a sound source analysis on the sound signal and outputting characteristics of one or more sound sources, each sound source characteristic comprising at least one of: the distance between the sound source and the intelligent terminal, the relative position between the sound source and the intelligent terminal and the type of the sound source.
In one embodiment, the start module 501 may include: the orientation determining unit is used for determining the orientation of the reference vector of the intelligent terminal according to the current gesture of the terminal; and the sound source characteristic output unit is used for outputting the characteristic of the sound source aimed at by the reference vector of the intelligent terminal.
For more details on the working principle and the working manner of the hearing aid device 50, reference may be made to fig. 1 to 4 for a description of the hearing aid method, which is not repeated here.
The embodiments of the present invention also provide a storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the hearing aid method described in fig. 1 to 4. The storage medium may be a computer readable storage medium, and may include, for example, a non-volatile memory (non-volatile) or a non-transitory memory (non-transitory) and may also include an optical disc, a mechanical hard disc, a solid state hard disc, and the like.
The embodiment of the invention also provides an intelligent terminal. The intelligent terminal may comprise a memory and a processor, the memory having stored thereon a computer program executable on the processor, the processor executing the steps of the hearing aid method described in fig. 1 to 4 when the computer program is executed.
Specifically, in the embodiment of the present invention, the processor may be a central processing unit (central processing unit, abbreviated as CPU), and the processor may also be other general purpose processors, digital signal processors (digital signal processor, abbreviated as DSP), application specific integrated circuits (application specific integrated circuit, abbreviated as ASIC), off-the-shelf programmable gate arrays (field programmable gate array, abbreviated as FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and so on. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
It should also be appreciated that the memory in embodiments of the present application may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically erasable ROM (electrically EPROM, EEPROM), or a flash memory. The volatile memory may be a random access memory (random access memory, RAM for short) which acts as an external cache. By way of example but not limitation, many forms of random access memory (random access memory, abbreviated as RAM) are available, such as static random access memory (static RAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, abbreviated as DDR SDRAM), enhanced Synchronous Dynamic Random Access Memory (ESDRAM), synchronous Link DRAM (SLDRAM), and direct memory bus random access memory (direct rambus RAM, abbreviated as DR RAM).
It should be understood that the term "and/or" is merely an association relationship describing the associated object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In this context, the character "/" indicates that the front and rear associated objects are an "or" relationship.
The term "plurality" as used in the embodiments herein refers to two or more.
The first, second, etc. descriptions in the embodiments of the present application are only used for illustrating and distinguishing the description objects, and no order division is used, nor does it indicate that the number of the devices in the embodiments of the present application is particularly limited, and no limitation on the embodiments of the present application should be construed.
The "connection" in the embodiments of the present application refers to various connection manners such as direct connection or indirect connection, so as to implement communication between devices, which is not limited in any way in the embodiments of the present application.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be made by one skilled in the art without departing from the spirit and scope of the invention, and the scope of the invention should be assessed accordingly to that of the appended claims.

Claims (9)

1. A hearing assistance method, wherein the method is performed by an intelligent terminal, the method comprising: detecting whether an earphone is connected with the intelligent terminal or not when a hearing-aid starting instruction is acquired, and receiving sound signals of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal;
processing the sound signal through a selected set of hearing aid parameters, wherein the selected set of hearing aid parameters selects a hearing aid parameter set;
transmitting the processed sound signal to the earphone so that the earphone plays the processed sound signal;
the method further comprises the steps of:
step A, when a parameter calibration instruction is received, a test audio signal is sent to the earphone, so that the earphone plays the test audio signal;
step B, when an adjustment instruction for one or more hearing aid parameters in a group of hearing aid parameters is received, adjusting the corresponding hearing aid parameters according to the received adjustment instruction;
step C, processing the test audio signal through the adjusted set of hearing aid parameters, and sending the processed test audio signal to the earphone so that the earphone plays the processed test audio signal;
jumping to the step B, and repeatedly executing the step B and the step C until a calibration ending instruction is received;
step D, saving the current hearing aid parameters when the calibration ending instruction is received;
generating a corresponding hearing defect curve according to the current hearing aid parameters, wherein the current hearing aid parameters are used for compensating the hearing defect of a user and are not limited by scenes;
and according to the hearing defect curve, carrying out one-key automatic calibration on hearing aid parameters of other uncalibrated scenes.
2. The method according to claim 1, wherein a plurality of sets of hearing assistance parameters for different scenes are preconfigured in the set of hearing assistance parameters, each set of hearing assistance parameters comprising at least one or more of: frequency adjustment parameters, volume adjustment parameters, and noise reduction parameters;
the frequency adjusting parameter is used for adjusting the frequency of the sound signal, the volume adjusting parameter is used for adjusting the amplitude of the sound signal, and the noise reducing parameter is used for suppressing noise in the sound signal.
3. The method of claim 2, wherein the processing the sound signal with the selected set of hearing assistance parameters comprises:
and judging a scene corresponding to the external environment according to the sound signal, and selecting hearing aid parameters of the scene corresponding to the external environment.
4. The method of claim 1, wherein after generating the corresponding hearing impairment curve from the current hearing assistance parameters, further comprising:
transmitting the hearing impairment curve to a server;
and receiving hearing analysis and/or recommended hearing aid parameter configuration sent by the server and corresponding to the hearing deficiency curve.
5. The method of claim 1, wherein after receiving the sound signal of the external environment through the microphone of the smart terminal, the method further comprises:
performing a sound source analysis on the sound signal and outputting characteristics of one or more sound sources, each sound source characteristic comprising at least one of: the distance between the sound source and the intelligent terminal, the relative position between the sound source and the intelligent terminal and the type of the sound source.
6. The method of claim 5, wherein outputting characteristics of one or more sound sources comprises:
determining the orientation of the reference vector of the intelligent terminal according to the current gesture of the terminal;
and outputting the characteristics of the reference vector of the intelligent terminal, which is directed to the sound source.
7. A hearing device, wherein the hearing device is disposed within or coupled with a smart terminal, the hearing device comprising:
the starting module is used for detecting whether the earphone is connected with the intelligent terminal or not when a hearing-aid starting instruction is acquired, and receiving sound signals of the external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal;
the sound signal processing module is used for processing the sound signal through a selected group of hearing aid parameters, and the selected group of hearing aid parameters select a hearing aid parameter set;
the playing module is used for sending the processed sound signals to the earphone so that the earphone plays the processed sound signals;
the hearing aid device further includes:
the calibration starting module is used for executing the step A, and sending a test audio signal to the earphone when a parameter calibration instruction is received, so that the earphone plays the test audio signal;
the parameter adjustment module is used for executing the step B, and when an adjustment instruction for one or more hearing parameters in a group of hearing parameters is received, the corresponding hearing parameters are adjusted according to the received needle adjustment instruction; the test module is used for executing the step C, processing the test audio signal through the adjusted set of hearing aid parameters, and sending the processed test audio signal to the earphone so that the earphone plays the processed test audio signal;
the circulation module is used for jumping to the step B, and repeatedly executing the step B and the step C until a calibration ending instruction is received;
the calibration ending module is used for executing the step D and storing the current hearing aid parameters when the calibration ending instruction is received;
the hearing defect curve generation module is used for generating a corresponding hearing defect curve according to the current hearing aid parameters, wherein the current hearing aid parameters are used for compensating the hearing defect of a user and are not limited by scenes; and the automatic calibration module is used for carrying out one-key automatic calibration on hearing aid parameters of other uncalibrated scenes according to the hearing defect curve.
8. A storage medium having stored thereon a computer program, which when executed by a processor performs the steps of the method according to any of claims 1 to 6.
9. A smart terminal comprising a memory and a processor, said memory having stored thereon a computer program executable on said processor, characterized in that said processor executes the steps of the method according to any of claims 1 to 6 when said computer program is executed by said processor.
CN202111039829.9A 2021-09-06 2021-09-06 Hearing aid method and device, storage medium and intelligent terminal Active CN113746983B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111039829.9A CN113746983B (en) 2021-09-06 2021-09-06 Hearing aid method and device, storage medium and intelligent terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111039829.9A CN113746983B (en) 2021-09-06 2021-09-06 Hearing aid method and device, storage medium and intelligent terminal

Publications (2)

Publication Number Publication Date
CN113746983A CN113746983A (en) 2021-12-03
CN113746983B true CN113746983B (en) 2023-05-12

Family

ID=78736200

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111039829.9A Active CN113746983B (en) 2021-09-06 2021-09-06 Hearing aid method and device, storage medium and intelligent terminal

Country Status (1)

Country Link
CN (1) CN113746983B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114205724B (en) * 2021-12-09 2024-02-13 科大讯飞股份有限公司 Hearing aid earphone debugging method, device and equipment
CN114430523A (en) * 2022-01-20 2022-05-03 唐拥军 Method and system for realizing wireless hearing aid
CN115278353A (en) * 2022-07-27 2022-11-01 三星电子（中国）研发中心 Playing information adjusting method and device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112468947A (en) * 2020-11-27 2021-03-09 江苏爱谛科技研究院有限公司 Mobile phone hearing aid system capable of enhancing voice in real time

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105721973B (en) * 2016-01-26 2019-04-05 王泽玲 A kind of bone conduction earphone and its audio-frequency processing method
CN109121057B (en) * 2018-08-30 2020-11-06 北京聆通科技有限公司 Intelligent hearing aid method and system
CN111148271B (en) * 2018-11-05 2024-04-12 华为终端有限公司 Method and terminal for controlling hearing aid
CN110740413B (en) * 2019-09-12 2022-01-28 广东思派康电子科技有限公司 Environmental sound monitoring parameter calibration system and method
CN111901737A (en) * 2020-08-07 2020-11-06 浙江大学 Hearing aid parameter self-adaption method based on intelligent terminal

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112468947A (en) * 2020-11-27 2021-03-09 江苏爱谛科技研究院有限公司 Mobile phone hearing aid system capable of enhancing voice in real time

Also Published As

Publication number Publication date
CN113746983A (en) 2021-12-03

Similar Documents

Publication Publication Date Title
CN113746983B (en) Hearing aid method and device, storage medium and intelligent terminal
US10412493B2 (en) Ambient volume modification through environmental microphone feedback loop system and method
CN104284286B (en) The determination of individual HRTF
US20230111715A1 (en) Fitting method and apparatus for hearing earphone
EP2640095B2 (en) Method for fitting a hearing aid device with active occlusion control to a user
US20210266684A1 (en) Auditory device assembly
US9445754B2 (en) Method and system for fitting hearing aids, for training individuals in hearing with hearing aids and/or for diagnostic hearing tests of individuals wearing hearing aids
US8213627B2 (en) Method and apparatus for monitoring a hearing aid
CN106686507B (en) A kind of hearing aid fitting method based on mobile terminal
US20120183165A1 (en) Remotely updating a hearing aid profile
US11818545B2 (en) Method to acquire preferred dynamic range function for speech enhancement
CN208691496U (en) Headphone calibration structure and its earphone
US20220225039A1 (en) Self-fitting hearing aid having built-in pure tone signal generator
US12101604B2 (en) Systems, devices and methods for fitting hearing assistance devices
CN109218885A (en) Headphone calibration structure, earphone and its calibration method, computer program memory medium
CN114727212B (en) Audio processing method and electronic equipment
WO2015117343A1 (en) Method and system for improving tone quality of voice, and mobile terminal
WO2016071221A1 (en) Method for calibrating headphones
US11991499B2 (en) Hearing aid system comprising a database of acoustic transfer functions
KR101175724B1 (en) Hearing aids having function of hearing correction for environment
US9930454B2 (en) Method and system for testing a mould shape quality of a user-customized ear mould
KR101458998B1 (en) Method for Implementing Function of a Hearing aid Relating to a Mobile Device
US20170325033A1 (en) Method for operating a hearing device, hearing device and computer program product
CN112911477A (en) Hearing system comprising a personalized beamformer
CN113613121A (en) Method and device for obtaining sound pressure level of earphone and earphone

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant