WO2021159369A1 - 一种用于降噪的助听方法、装置、芯片、耳机及存储介质 - Google Patents

一种用于降噪的助听方法、装置、芯片、耳机及存储介质 Download PDF

Info

Publication number
WO2021159369A1
WO2021159369A1 PCT/CN2020/075014 CN2020075014W WO2021159369A1 WO 2021159369 A1 WO2021159369 A1 WO 2021159369A1 CN 2020075014 W CN2020075014 W CN 2020075014W WO 2021159369 A1 WO2021159369 A1 WO 2021159369A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
sample
scene
noise reduction
hearing aid
Prior art date
Application number
PCT/CN2020/075014
Other languages
English (en)
French (fr)
Inventor
郭红敬
王乐临
李国梁
王鑫山
韩文凯
Original Assignee
深圳市汇顶科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市汇顶科技股份有限公司 filed Critical 深圳市汇顶科技股份有限公司
Priority to CN202080001642.7A priority Critical patent/CN111886878A/zh
Priority to PCT/CN2020/075014 priority patent/WO2021159369A1/zh
Publication of WO2021159369A1 publication Critical patent/WO2021159369A1/zh
Priority to US17/709,893 priority patent/US20220225035A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17873—General system configurations using a reference signal without an error signal, e.g. pure feedforward
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17885—General system configurations additionally using a desired external signal, e.g. pass-through audio such as music or speech
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083—Reduction of ambient noise
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/43—Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
    • H04R25/505—Customised settings for obtaining desired overall acoustical characteristics using digital signal processing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10—Applications
    • G10K2210/108—Communication systems, e.g. where useful sound is kept and noise is cancelled
    • G10K2210/1081—Earphones, e.g. for telephones, ear protectors or headsets
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/30—Means
    • G10K2210/301—Computational
    • G10K2210/3027—Feedforward
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
    • H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/01—Aspects of volume control, not necessarily automatic, in sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/01—Hearing devices using active noise cancellation

Definitions

  • This application relates to the field of signal processing, and in particular to a hearing aid method, device, chip, earphone and storage medium for noise reduction.
  • the triggering conditions of the hearing aid mode may cause the user to enter the hearing aid mode when not expecting to enter the hearing aid mode, and not enter the hearing aid mode when the user expects to enter the hearing aid mode.
  • the user may be interested in different sounds in different scenes. In the sleep scene, the user may not want to be disturbed. Even if someone calls his name, he does not want the "name" keyword to be transmitted to the ear by the earphone. In other scenes, such as office scenes, users still want to hear the keywords of "name".
  • the hearing aid technology in the prior art is not suitable for multiple application scenarios or scenarios where the scenarios change.
  • the present application provides a hearing aid method, device, chip, earphone and storage medium for noise reduction.
  • the first aspect of the embodiments of the present application provides a hearing aid method for noise reduction, including: identifying a scene where a user is located; if the detection data includes sample data in a sample database corresponding to the scene, enter the hearing aid mode , In the hearing aid mode, all or part of the external sound is played, and the external sound is collected by the reference microphone.
  • the detection data is an external sound
  • the sample database is a sample sound database
  • the sample data is a sample sound
  • the detection data is a heart rate signal
  • the sample database is a sample heart rate library
  • the sample data is a sample heart rate.
  • different scenes correspond to different sample sound libraries; or, different scenes correspond to different sample heart rate libraries.
  • the sample sounds in the sample sound library are configured with priorities
  • the priority of the sample sounds in the sample sound library corresponding to different scenes is different.
  • playing part of external sounds includes:
  • the method before playing the target sound corresponding to the sample sound in the external sound, the method further includes:
  • the target voices include:
  • playing a target sound corresponding to a sample sound of a plurality of external sounds includes:
  • the target sound corresponding to the first sample sound is selected according to the priority of the first sample sound and the second sample sound. Play; the priority of the first sample sound is higher than the priority of the second sample sound.
  • the sample sound includes one or more of environmental sounds, keywords, and voiceprint information
  • the keywords include character titles or One or two of the greeting idioms
  • Environmental sounds include one or more of siren, impact, explosion, building collapse, car whistle, and radio announcement.
  • the scene includes one or more of an office scene, a home scene, an outdoor scene, and a travel scene, or the scene includes a static scene Or one or two of the sports scenes;
  • the ambient sound in the sample sound library corresponding to the office scene is one or more of alarm sound, explosion sound, building collapse sound and broadcast sound;
  • the environmental sounds in the sample sound library corresponding to outdoor scenes and travel scenes are one or more of alarm sounds, impact sounds, explosion sounds, building collapse sounds, car whistle sounds, and radio broadcast sounds;
  • the ambient sound in the sample sound library corresponding to the home scene is one or more of alarm sound, explosion sound and building collapse sound;
  • the sample heart rate in the sample heart rate library corresponding to the sports scene is a heart rate signal that is higher than 200 beats/min or lower than 60 beats/min;
  • the sample heart rate in the sample heart rate library corresponding to the stationary scene is a heart rate signal that is higher than 120 beats/min or lower than 50 beats/min.
  • the priority of the environmental sounds in the sample sounds in the sample sound library corresponding to the scene is higher than that in the keywords and voiceprint information.
  • the identifying the scene where the user is located it further includes determining whether the external sound includes the sample sound in the sample sound library corresponding to the scene, Or it is judged whether the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene.
  • weights are assigned to the sample sounds according to the priority of the sample sounds. The higher the priority of the sample sounds, the greater the weight of the sample sounds. ;
  • it further includes establishing a sample sound library corresponding to the scene or establishing a sample heart rate library corresponding to the scene;
  • To establish a sample sound library corresponding to the scene includes:
  • the sample heart rate database corresponding to the established scene includes:
  • the playback volume of all or part of the external sounds is increased to the preset volume value within the preset time period.
  • the noise reduction intensity of the noise reduction mode is maintained or the noise reduction intensity of the noise reduction mode is reduced;
  • active noise reduction technology is used to offset external sounds.
  • the second aspect of the embodiments of the present application provides a hearing aid device for noise reduction, including:
  • the scene recognition module is used to identify the scene the user is in
  • the hearing aid module if the detection data includes sample data in the sample database corresponding to the scene, is used to enter the hearing aid mode;
  • the playback module in the hearing aid mode, is used to play all or part of the external sound, which is collected by the reference microphone.
  • the detection data is external sound
  • the sample database is a sample sound database
  • the sample data is a sample sound
  • the detection data is a heart rate signal
  • the sample database is a sample heart rate library
  • the sample data is a sample heart rate.
  • different scenes correspond to different sample sound libraries; or, different scenes correspond to different sample heart rate libraries.
  • it further includes a priority configuration module, which is used to configure priorities for the sample sounds in the sample sound library; corresponding to different scenarios The sample sounds in the sample sound library have different priorities.
  • the playback module when the playback module plays part of the external sound, it plays the target sound corresponding to the sample sound in the external sound.
  • the separation module and the enhancement module are connected with the playback module
  • the separation module is used to separate the target sound corresponding to the sample sound from the external sound
  • the enhancement module is used to increase the gain of the target sound.
  • the playback module plays the and sample sounds in the external sound.
  • the target sound corresponds to the sound
  • the target sound corresponding to one of the multiple sample sounds is played.
  • the playback module when the playback module plays a target sound corresponding to a sample sound among multiple external sounds, if the external sound contains the scene corresponding For the first sample sound and the second sample sound in the sample sound library, the playback module selects the target sound corresponding to the first sample sound for playback according to the priority of the first sample sound and the second sample sound; The priority of this sound is higher than the priority of the second sample sound.
  • the sample sound includes one or more of environmental sounds, keywords, and voiceprint information
  • the keywords include character titles or One or two of the greeting idioms
  • Environmental sounds include one or more of siren, impact, explosion, building collapse, car whistle, and radio announcement.
  • the scene includes one or more of office scenes, home scenes, outdoor scenes, and travel scenes, or the scenes include static scenes Or one or two of the sports scenes;
  • the ambient sound in the sample sound library corresponding to the office scene is one or more of alarm sound, explosion sound, building collapse sound and broadcast sound;
  • the ambient sounds in the sample sound library corresponding to outdoor scenes and travel scenes are one or more of alarm sound, impact sound, explosion sound, building collapse sound, car whistle sound and broadcast sound;
  • the ambient sound in the sample sound library corresponding to the home scene is one or more of alarm sound, explosion sound and building collapse sound;
  • the sample heart rate in the sample heart rate library corresponding to the sports scene is a heart rate signal that is higher than 200 beats/min or lower than 60 beats/min;
  • the sample heart rate in the sample heart rate library corresponding to the stationary scene is a heart rate signal that is higher than 120 beats/min or lower than 50 beats/min.
  • the priority configuration module is also used to set the environment sound in the sample sound library corresponding to the scene to have a high priority. Priority of one or both of keywords and voiceprint information.
  • a judgment module is further included;
  • the judgment module is connected with the scene recognition module
  • the judgment module is used to judge whether the external sound includes the sample sound in the sample sound library corresponding to the scene, or is used to judge whether the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene.
  • the priority configuration module is also used to configure weights for the sample sounds according to the priority of the sample sounds, the higher the priority of the sample sounds , The greater the weight of the sample sound;
  • the judgment module determines that the external sound contains the sample sound in the sample sound library corresponding to the scene.
  • it further includes a library building module for establishing a sample sound library corresponding to the scene or for establishing a sample heart rate library corresponding to the scene;
  • the library building module also includes one or more of the input module, the delete module or the adjustment module;
  • the input module, the delete module and the adjustment module respectively enter the sample sound, delete the sample sound and adjust the priority of the sample sound in the sample sound library according to the scene, or
  • the input module and the deletion module are respectively used to input the sample heart rate or delete the sample heart rate to the sample heart rate library according to the scene.
  • the playback volume of all or part of the external sound played by the playback module is increased to a preset volume value within a preset time period.
  • the noise reduction module in another implementation manner of the second aspect, it further includes a noise reduction module.
  • the noise reduction module In the hearing aid mode, the noise reduction module is used to maintain the noise reduction strength of the noise reduction mode or The noise reduction intensity of the noise reduction mode is reduced; in the noise reduction mode, the noise reduction module is also used to use active noise reduction technology to offset external sounds.
  • a third aspect of the embodiments of the present application provides a chip for executing the hearing aid method for noise reduction in the first aspect, including a memory and a processor;
  • the memory is coupled to the processor
  • Memory used to store program instructions
  • the processor is configured to call the program instructions stored in the memory, so that the chip executes the hearing aid method for noise reduction in the first aspect described above.
  • a fourth aspect of the embodiments of the present application provides a headset, including the chip of the third aspect.
  • the fifth aspect of the embodiments of the present application provides a computer-readable storage medium, including: a computer program is stored thereon, wherein the computer program is characterized in that, when the computer program is executed by a processor, the method for noise reduction in the first aspect is implemented.
  • Hearing aid method is stored thereon, wherein the computer program is characterized in that, when the computer program is executed by a processor, the method for noise reduction in the first aspect is implemented.
  • the beneficial effect of the embodiments of the present application is that: the embodiments of the application provide a hearing aid method for noise reduction, by identifying the scene where the user is, if the detection data contains the sample database corresponding to the scene The sample data of, then enter the hearing aid mode to adapt to the changing situation of the user's scene, and also improve the user experience.
  • Fig. 1 is a flowchart of a hearing aid method for noise reduction according to an embodiment of the application
  • FIG. 2 is a flowchart of another hearing aid method for noise reduction according to an embodiment of the application.
  • FIG. 3 is a flowchart of yet another hearing aid method for noise reduction according to an embodiment of the application.
  • 3A is a flowchart of yet another hearing aid method for noise reduction according to an embodiment of the application.
  • FIG. 4 is a flowchart of yet another hearing aid method for noise reduction according to an embodiment of the application.
  • FIG. 5 is a flowchart of yet another hearing aid method for noise reduction according to an embodiment of the application.
  • Fig. 6 is a flowchart of yet another hearing aid method for noise reduction according to an embodiment of the application.
  • FIG. 7 is a flowchart of yet another hearing aid method for noise reduction according to an embodiment of the application.
  • FIG. 8 is a schematic structural diagram of a hearing aid device for noise reduction according to an embodiment of the application.
  • FIG. 8A is a schematic structural diagram of another hearing aid device for noise reduction according to an embodiment of the application.
  • FIG. 8B is a schematic structural diagram of yet another hearing aid device for noise reduction according to an embodiment of the application.
  • 8C is a schematic structural diagram of still another hearing aid device for noise reduction according to an embodiment of the application.
  • 8D is a schematic structural diagram of still another hearing aid device for noise reduction according to an embodiment of the application.
  • FIG. 8E is a schematic structural diagram of yet another hearing aid device for noise reduction according to an embodiment of the application.
  • FIG. 9 is a schematic structural diagram of a chip according to an embodiment of the application.
  • FIG. 10 is a schematic structural diagram of a headset according to an embodiment of the application.
  • FIG. 1 is a flowchart of a hearing aid method for noise reduction according to an embodiment of the present application. The method includes the following steps:
  • S102 If the detected data includes sample data in the sample database corresponding to the scene, enter the hearing aid mode. In the hearing aid mode, all or part of the external sound is played, and the external sound is collected by the reference microphone.
  • the scene where the user is located is identified.
  • the scene may include an indoor scene or an outdoor scene.
  • GPS Global Positioning System
  • the indoor scene can include a home scene or an office scene.
  • the user can be identified as an office scene by the user's check-in information, or the user can be identified by opening the door lock on the APP.
  • indoor scenes can also include travel scenes, for example, in an airport or subway station, for example, it can be confirmed by the user swiping the subway card or the ticket information in the APP, of course, it can also be confirmed by the smart assistant (inside (Include user schedule management, itinerary, alarm clock, etc.) to determine user status.
  • the scene can include a moving scene or a static scene.
  • a speed sensor, a temperature sensor, an air pressure sensor, and a heart rate sensor can be used to identify the scene where the user is located.
  • GPS, machine learning, and computer vision can also be used.
  • One or more technologies are used to realize scene recognition. This embodiment does not limit the specific technology for identifying the scene in which the user is located. It can be selected according to needs, and the number of scenes is not limited. It can be one or more, and the user can Customize various scenarios according to your needs.
  • the function of the reference microphone is to collect external sound, which can be understood as the sound in the user's surrounding environment, and external sound can also be understood as external noise.
  • the external noise may contain useful information.
  • the reference microphone in this embodiment may be set on the earphone, for example, set at a position far away from the user's mouth, so as to avoid collecting the user's own sound.
  • each scene has a corresponding sample database, and sample data is stored in the sample database.
  • the sample database corresponding to the scene is also determined. Therefore, the scene of the user is determined. Later, the conditions for starting the hearing aid mode are also determined. For example, in the first time period, if it is recognized that the user is in the first scene, if the sample data in the sample database corresponding to the scene includes the first sample data, if If the detection data contains the first sample data, the hearing aid mode is entered. During the second time period, the user is in the second scene.
  • the sample sound library corresponding to the scene does not include the first sample data
  • the detection data contains The first sample data
  • This kind of scene change happens from time to time, and in different scenes, users often have different requirements for entering the hearing aid mode. For example, if the user is interested in the sample data a1 for scene A, you can set scene A The sample data in the corresponding sample database includes a1. If the detected data includes a1 in the sample database corresponding to the A scene, the hearing aid mode is entered. If the user is interested in sample data b1 for scene B, the sample data in the sample database corresponding to scene B can be set to include b1.
  • the detection data includes b1 in the sample database corresponding to scene B, the hearing aid mode is entered. Therefore, each scene has a corresponding sample sound library, which can adapt to the changing needs of users, and can also adapt to the needs of different users.
  • the detection data in this embodiment can be understood as detected data, that is, collected data, which may be detected audio data, or biometric data, and so on.
  • the user can obtain external sounds in the hearing aid mode. All external sounds can be played, or part of external sounds can be played. Part of external sounds can be separated from all external sounds, and this part of external sounds can be sounds of interest to the user. In this embodiment, playing all or part of the external sounds can be achieved through a microphone in the ear, for example, through a music playback channel, that is, playing all or part of the external sounds while playing music.
  • the music playback when entering the hearing aid mode, the music playback can be stopped, the music playback volume can be maintained, or the music playback volume can be reduced. When the music playback volume is reduced or the music playback is stopped, the user can be more concerned All or part of the external sound played by the speaker can improve the warning effect.
  • the application embodiment provides a hearing aid method for noise reduction.
  • identifying the scene the user is in if the detection data contains sample data in the sample database corresponding to the scene, the hearing aid mode is entered to adapt to the user’s situation.
  • the change of the scene also improves the user experience.
  • the detection data is external sound
  • the sample database is a sample sound database
  • the sample data is sample sound.
  • Figure 2 is a flowchart of a hearing aid method for noise reduction according to an embodiment of the present application. The method includes the following steps:
  • Step 201 is the same as or similar to the above step 101.
  • the scenes include indoor scenes, outdoor scenes, and travel scenes.
  • Indoor scenes can include office scenes, home scenes, etc., home scenes can also include sleeping scenes, and travel scenes can include airplanes, trains, and subways.
  • transportation vehicles such as buses, buses, and other vehicles
  • the purpose of identifying user scenes is to meet the different needs of users in various scenes, so that each scene can have its own sample sound library.
  • speed sensors, temperature sensors, air pressure sensors, and heart rate sensors can be used to identify the scene the user is in, and other technologies can also be used to realize scene recognition, such as GPS, machine learning, computer vision, etc. This embodiment is useful for identifying users
  • the specific technology of the scene is not limited, and can be selected according to needs.
  • each scene has a corresponding sample sound library, and the sample sound library is stored in the sample sound library.
  • the sample sound library corresponding to the scene is also determined.
  • the conditions for starting the hearing aid mode are also determined. For example, in the first time period, the user is in an outdoor scene. If the sample sound in the sample sound library corresponding to the scene includes the car whistle sound, if the external The sound contains the car whistle sound and enters the hearing aid mode.
  • the second time period the user is in a home scene.
  • the sample sound library corresponding to the scene does not include the car whistle sound
  • the external sound contains the car whistle sound, for example
  • the toy plays the car whistle sound, or the car whistle sound on the street is transmitted to the room. In this case, it will not enter the hearing aid mode, so that the user can avoid hearing uninteresting sounds.
  • This kind of scene change happens from time to time, and in different scenes, the sounds that users are interested in are often different. For example, in a sleep scene, various keywords may not be the sounds of interest to the user. Next, the sounds of interest can include various alarm sounds.
  • the corresponding sample sound libraries in different scenarios may be the same or different.
  • the sample sound in the sample sound library corresponding to the sleep scene can be the same as the sample sound in the sample sound library corresponding to the office scene, and can include the same keywords, that is, two Each scene can correspond to the same sample sound library. If the user does not want to be disturbed in the sleep scene, the corresponding sample sound library in the sleep scene may not include various keywords. Each scene has a corresponding sample sound library, which can adapt to changing needs. Can adapt to the needs of different users.
  • the hearing aid mode is entered. For example, if it is recognized that the user's scene is an office scene, suppose the sample sounds in the sample sound library have alarm sounds, and the external sounds contain alarm sounds, such as fire alarm sounds, enter the hearing aid mode so that the user can obtain To outside sounds. In this hearing aid mode, all external sounds can be played.
  • all the sounds collected by the reference microphone can be played, which may also include calls for help or between colleagues Talking sound; in this hearing aid mode, part of the external sound can also be played, for example, the fire alarm sound can be played only to play a sufficient warning effect.
  • the detection data is a heart rate signal
  • the sample database is a sample heart rate database
  • the sample data is a sample heart rate.
  • Figure 3 it includes:
  • the detection data can be detected by a heart rate sensor.
  • the abnormal range may be a range that is generally believed to be a medically possible range of the user's body. If the user's heart rate is only in the normal range to determine whether to enter the hearing aid mode, there may be inaccurate problems. For example, during strenuous exercise, the heart rate value is too high and may be in the abnormal range. If the hearing aid is turned on at this time The mode will cause the user to be disturbed by external sounds during vigorous exercise. Therefore, it is necessary to determine the sample heart rate library corresponding to the scene according to the scene.
  • the scene may include a sports scene or a static scene, etc.
  • identifying whether the user is in a sports scene or a static scene can be realized according to the step count data on the APP or in other ways, for example, if the number of steps is When the increased speed exceeds the predetermined speed, it can be determined that the user is in a sports scene. When the speed of the increase in steps is lower than the predetermined speed, it can be determined that the user is in a static scene.
  • each scene can be configured with a corresponding sample heart rate library. In this embodiment, it is necessary to identify the scene in which the user is located, such as a sports scene or a static scene.
  • other scenes can also be set according to user needs, or the scene can be further subdivided, for example, the sports scene is subdivided It is a scene with a small amount of exercise, a scene with a medium amount of exercise, or a scene with a large amount of exercise.
  • identifying the scene the user is in can be achieved by one or more sensors such as a speed sensor, an acceleration sensor, a pedometer, or GPS.
  • the GPS can identify whether the user is in the gym, at home, or at the company to identify Whether the user is in a motion state or a static state, if one recognition method is not sufficient to recognize the scene where the user is located, a combination of multiple recognition methods can also be used, and this embodiment does not limit the recognition method.
  • the user when judging whether the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene, multiple judgments can be made, that is, if it is detected that the heart rate signal belongs to the sample heart rate in the sample heart rate library more than a preset number of times If the number of times the heart rate signal belongs to the sample heart rate in the sample heart rate library does not exceed the preset number of times, the user can choose whether to turn on the hearing aid mode.
  • This multiple detection setting is for Avoid false detections to further improve the user experience.
  • S3011 is the same as or similar to step S301 in the foregoing embodiment, which is not repeated in this embodiment.
  • S3012 Determine whether the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene. If the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene, you can directly execute step S3015 to turn on the hearing aid mode. If the heart rate signal does not belong to the scene
  • the preset mode can be turned on or the mode can be selected by the user.
  • the preset mode can be the noise reduction mode or the hearing aid mode, or the noise reduction mode and the hearing aid mode can be turned on at the same time.
  • step S3013 can also be executed: counting times, which is the number of times the heart rate signal is judged to belong to the sample heart rate in the sample heart rate library corresponding to the scene. After the number of times is calculated, Perform S3014, if the number of times is greater than or equal to the preset number, then perform S3015 to turn on the hearing aid mode.
  • the number of calculations can also be understood as calculating the duration of the heart rate belonging to the sample heart rate in the sample heart rate library corresponding to the scene. If the duration exceeds or equals the preset duration, the hearing aid can also be turned on model. If the number of times is less than the preset number, the preset mode can be turned on or the mode can be selected by the user. After receiving the reminder to select the mode, the user can select the hearing aid mode or the noise reduction mode according to the needs, or choose to turn on the hearing aid mode and the reduction mode at the same time.
  • step S3018 can be performed to adjust the noise reduction intensity or hearing aid intensity. For example, you can change the hearing aid gain or algorithm parameters or noise reduction intensity, or use different hearing aid gains in different frequency bands to bring better results. User experience.
  • step S3016 can also be performed: gradually increase the volume of the external sound being played to realize the fade-in and fade-out function, so that the user is comfortable during the mode switching process, and will not stop when entering the hearing aid mode at the beginning. A loud external sound is heard.
  • the embodiment of the application provides a hearing aid method for noise reduction.
  • identifying the scene where the user is if the external sound contains the sample sound in the sample sound library corresponding to the scene or the heart rate signal belongs to the sample corresponding to the scene
  • the sample heart rate in the heart rate library enters the hearing aid mode to adapt to the changing situation of the user's scene, which also improves the user experience.
  • the sample sound libraries corresponding to different scenes are different.
  • the user is interested in different sounds in different scenes.
  • the car whistle sound is not the sound of interest to the user, because the car whistle sound is likely to come from a TV or a toy. Yes, or because of the poor sound insulation of the house, the car whistling sound on the road can still be collected by the reference microphone.
  • the sample sound library corresponding to the indoor scene does not contain the car whistle sound, even if the car on the road The whistle sound is collected by the reference microphone, and it is impossible to enter the hearing aid mode to prevent the user from hearing uninterested sounds.
  • the car whistle sound is the sound of interest to the user. Therefore, the sample corresponding to the outdoor scene
  • the sample sound of the sound library may include the car whistle sound.
  • the heart rate of a normal person in a quiet state is 60-100 beats/min, and the heart rate during exercise is generally 120-180 beats/min.
  • Sports scenes can be subdivided into small exercises 120-140 beats/min.
  • the amount of exercise is 141-160 times/min, and the amount of large-scale exercise is 161-180 times/min. Therefore, in different scenarios, the sample heart rate library can be set differently, and the triggering conditions of the hearing aid mode are different in different scenarios.
  • the difference in sample sound libraries corresponding to different scenes includes: the number of sample sounds in the sample sound libraries corresponding to different scenes is different.
  • the number of sounds that users are interested in is generally different. For example, for outdoor scenes, there are more sample sounds in the sample sound library, while for home scenes, the number of sample sounds in the sample sound library is less. For sleep scenes, the number of sample sounds in the sample sound library may be even less.
  • the sample sounds in the sample sound library are configured with priorities.
  • priority is configured for each sample sound to distinguish the user's degree of interest in different sample sounds.
  • the priorities for multiple sample sounds may be the same, and the priorities for multiple sample sounds may also be different, which is not limited in this embodiment.
  • the priority of the sample sounds in the sample sound library corresponding to different scenes may be different.
  • the sample sounds in the sample sound library corresponding to office scenes and outdoor scenes may include the user name, but the sample sound of the user name may have a higher priority in the office scene than the user name in the sample sound library corresponding to the outdoor scene.
  • Priority can be embodied by weight, or can be realized by setting the number of levels, which is not limited in this embodiment.
  • playing part of the external sound includes: playing the target sound corresponding to the sample sound in the external sound.
  • step S401 is the same as or similar to step S201 disclosed in the foregoing embodiment, which is not described in detail in this embodiment.
  • step S401 After identifying the scene the user is in, step S402 is executed. If the external sound contains the sample sound in the sample sound library corresponding to the scene, enter the hearing aid mode. In the hearing aid mode, play the external sound and the sample sound The corresponding target sound.
  • the sample sound in the sample sound library has an alarm sound, for example, a fire alarm sound
  • the external sound contains a fire alarm sound
  • enter the hearing aid mode so that the user can obtain
  • the hearing aid mode only the fire alarm sound in the external sound can be played.
  • playing the target sound corresponding to the sample sound in the external sound can enable the user to obtain only the sound of interest, so as to prevent the user from obtaining other sounds other than the sound of interest.
  • the target sound in this embodiment is a sound corresponding to a sample sound among external sounds.
  • the sample sound in the sample sound library is relatively standard, and if the external sound contains the sample sound in the sample sound library corresponding to the scene, the detected external sound may be the same as the sample sound in the sample sound library Or similar. Therefore, playing the target sound corresponding to the sample sound in the external sound can make the sound heard by the user closer to the sound transmitted in the real environment, which can improve the user's perception, compared with playing the sample sound in the sample sound library.
  • the sample sound in the sample sound library includes the car whistle sound
  • the external sound includes the car whistle sound, but the car whistle sound of the external sound and the sample sound library The car whistle sound is different.
  • the car whistle sound in the external sound also contains information about the distance between the car and the user, or whether the car is a public bus or a private car. Therefore, the external sound and the sample sound are played
  • the target sound corresponding to the sample sound in the library can retain the multi-dimensional information of the target sound in the external sound, so as to improve the authenticity of the user's perception of the sound and improve the user experience.
  • the method before playing the target sound corresponding to the sample sound in the external sound, the method further includes:
  • step 503 is the same or similar to the target sound corresponding to the sample sound in the external sound playing in step S402 disclosed in the foregoing embodiment, which is not repeated in this embodiment.
  • the voice separation technology in order to play the target sound corresponding to the sample sound in the external sound, the voice separation technology can be used to separate the target sound corresponding to the sample sound from the external sound, and then play the separated target sound.
  • step S502 may be performed to increase the gain of the target sound to increase the volume of the target sound, so that the user can clearly hear the target sound.
  • step S502 can be implemented by technologies such as voice enhancement.
  • playing the target sound corresponding to the sample sound in the external sound includes: playing the multiple sample sounds The target sound corresponding to a sample sound in.
  • the external sound contains multiple sample sounds in the sample sound library corresponding to the scene
  • the target sound corresponding to the multiple sample sounds is played, the user hears multiple target sounds, which may cause the user to Each target sound is distracted to make the user ignore the more important target sound.
  • the scene where the user is located is an outdoor scene
  • the sample sound in the sample sound library corresponding to the outdoor scene includes the user’s name and car Whistle sound
  • the external sound contains both the user name and the car whistle sound at this time
  • the user name and the car whistle sound are played at the same time, the user may not be able to hear the user name or the user may not be able to hear it.
  • the car whistle when the external sound contains multiple sample sounds in the sample sound library corresponding to the scene, the target sound corresponding to one of the multiple sample sounds can be played, so that the user can hear at least one target sound clearly, so that The user focuses on a target voice.
  • the playing the target sound corresponding to a sample sound of the multiple external sounds includes: if the external sound includes the first sample sound in the sample sound library corresponding to the scene and For the second sample sound, select the target sound corresponding to the first sample sound for playback according to the priority of the first sample sound and the second sample sound; the priority of the first sample sound is higher than the priority of the second sample sound class.
  • the target sound corresponding to a sample sound of the multiple external sounds it can be determined according to the priority of the sample sound which sample sound corresponds to the target sound to be played.
  • the target sound corresponding to the sample sound with the highest priority among the multiple sample sounds is selected for playback. For example, if the sample sound in the sample sound library corresponding to the scene contained in the external sound includes the first sample sound and the second sample sound, the priority can be selected according to the priority of the first sample sound and the second sample sound. The target sound corresponding to the high sample sound is played. If the priority of the first sample sound is higher than the priority of the second sample sound, the target sound corresponding to the first sample sound is selected for playback.
  • the sample sound in the sample sound library corresponding to the outdoor scene includes the user's name and car whistle sound
  • the target sound corresponding to the higher priority car whistle sound can be selected for playback, so that the user can hear the car whistle sound clearly and cause sufficient alertness. Therefore, when the external sound contains multiple sample sounds in the sample sound library corresponding to the scene, the target sound corresponding to the sample sound with the highest priority among the multiple sample sounds can be played, so that the user only knows one target sound. , Allowing users to focus on the target voice.
  • the sample sound includes one or more of environmental sounds, keywords, and voiceprint information, and the keywords include one or two of character titles or greeting idioms.
  • environmental sounds include: one or more of alarm sounds, impact sounds, explosion sounds, building collapse sounds, car whistle sounds, and radio broadcast sounds.
  • the alarm sounds listed in the environmental sound include a variety of alarm sounds, such as fire alarm, also called fire alarm, and another example of earthquake warning.
  • the broadcast sound can also include a variety of broadcast sounds, such as airport broadcast sound. , Subway radio broadcast sound, etc. This embodiment does not limit the specific content of sirens, impact sounds, explosion sounds, building collapse sounds, car whistle sounds, and radio broadcast sounds.
  • the title of the person in this embodiment can be a specific job title or nickname, such as boss, president, principal, lawyer, Lao Wang, Xiao Zhang, etc.
  • the idiom for greetings can be hello, hi, etc.
  • the sample The voice can also be the title of the character plus the greeting idiom, such as: hi, Xiao Zhang.
  • the language type of the sample sound is not limited, and it may be one or more of multiple languages.
  • the voiceprint information in this embodiment is a sound wave spectrum carrying speech information that can be displayed by an electroacoustic instrument. Generally speaking, each person’s voiceprint information is different. In some scenarios, the user may need to pay special attention to a certain person.
  • the hearing aid when accompanying a patient in a ward, you need to pay special attention to the patient’s voice. If the sample sound in the sample sound library contains the patient’s voiceprint information, it can be realized that the hearing aid will only be turned on when the patient speaks Mode, and other people’s voices cannot trigger the hearing aid mode to prevent the user from being disturbed by other patients.
  • the scenes may include one or more of office scenes, home scenes, outdoor scenes, or travel scenes.
  • this embodiment is not limited to the listed scenes, and can also be a system Customize other scenes or users can add other scenes according to their needs.
  • the environmental sounds in the sample sound library corresponding to this scene are one or more of alarm sounds, explosions, building collapse sounds, and radio broadcast sounds.
  • the office scene does not include car whistle sounds, which can avoid users Hear uninteresting sounds. For example, some users’ office locations are on busy streets. If the floor is low, the external voice collected by the reference microphone may include car horns or impact sounds. At this time, the user is in office.
  • the sample sound library corresponding to the office scene does not include the car whistle sound, which can effectively improve the user experience.
  • the ambient sound in the sample sound library corresponding to the outdoor scene or travel scene is one of alarm sound, impact sound, explosion sound, building collapse sound, car whistle sound, and broadcast sound.
  • the environmental sound in the target sample library needs to include Various types of sample sounds.
  • the ambient sound in the sample sound library corresponding to the home scene is one or more of alarm sound, explosion sound and building collapse sound.
  • the sample sounds in the sample sound library corresponding to the home scenes may not include impact sound, car whistle sound, and radio broadcast sound. At home, if someone is watching TV or playing games, they may also hear this type of sound.
  • the sample sounds in the sample sound library do not include these environmental sounds, so as to prevent the user from entering the hearing aid mode when the hearing aid mode is not expected to be activated, so as to improve the user experience.
  • other scenes can also be included, and for other scenes, sample sounds in the corresponding sample sound library can also be set.
  • the priority of the sample sound can also be set to the lowest. For example, the weight of the sample sound or The parameter that expresses the priority is set to zero. The lower the priority, the smaller the parameter. In this way, even if the external sound contains the sample sound, the hearing aid mode will not be activated because the sample sound has the lowest priority or the weight is zero.
  • the scene may also include one or two of a static scene or a sports scene. If it is recognized that the scene the user is in is a sports scene, the sample heart rate in the sample heart rate library corresponding to the scene can be set. If the heart rate signal is higher than 200 beats/minute or lower than 60 beats/minute, if in a sports scene, the user’s heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene, that is, higher than 200 beats/minute or lower than 60 times/min, you can turn on the hearing aid mode to facilitate the user to communicate with people around when calling for help.
  • the sample sound in the sample sound library corresponding to the stationary scene can be higher than 120 times/min or lower than 50 times/min.
  • the hearing aid mode can be turned on to facilitate the user to call for help with Communicate with people around.
  • the priority of environmental sounds in the sample sounds in the sample sound library corresponding to the scene is higher than the priority of one or both of keywords and voiceprint information. For example, if the sample sound contains ambient sound, you can set the priority of the ambient sound to be higher than the keyword or voiceprint information. This setting can make the user pay enough attention to the sound that may cause danger around, for example, when the external sound
  • the car whistle and the user’s name in the sample sound library are included in the sample sound library, the environmental sound has a higher priority. Therefore, after entering the hearing aid mode, the car whistle in the external sound will be played instead of the user’s name, so that The user is concerned about environmental sounds that may cause danger.
  • the priority of the car’s whistle can be set to be the lowest, and it can even be removed from the sample sound library; in this embodiment, the priority of multiple environmental sounds can be the same or different.
  • the priority of the sample sound is not limited. The system can default to the priority of the sample sound that belongs to the environmental sound, and the priority of the sample sound that also belongs to the environmental sound can also be adjusted by the user.
  • step S601 after identifying the scene in which the user is located, it further includes determining whether the external sound includes the sample sound in the sample sound library corresponding to the scene. As shown in FIG. 6, after step S601, step S602 is executed: determining whether the external sound includes the sample sound in the sample sound library corresponding to the scene. Step S601 is the same as or similar to step S201 in the foregoing embodiment, and will not be repeated here. In this embodiment, when judging whether the external sound includes the sample sound in the sample sound library corresponding to the scene, the judgment accuracy can be selected according to the actual environment or user needs, and this embodiment does not limit the judgment accuracy.
  • step S603 is executed: entering the hearing aid mode, and in the hearing aid mode, all or part of the external sound is played.
  • Step S603 in this embodiment is the same as or similar to step S202 in the foregoing embodiment. This embodiment will not repeat this description.
  • step S604 is performed: keep down. Noise mode, so that the user is still in a quieter environment.
  • step S701 after identifying the scene where the user is located, it may further include determining whether the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene. As shown in FIG. 7, after step S701, step S702 is executed: determining whether the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene. Step S701 is the same as or similar to step S301 in the foregoing embodiment, and will not be repeated here. In this embodiment, when judging whether the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene, the judgment accuracy can be selected according to the actual environment or user needs, and this embodiment does not limit the judgment accuracy.
  • step S703 is executed: entering the hearing aid mode, and in the hearing aid mode, all or part of external sounds are played.
  • Step S703 in this embodiment is the same as or similar to step S302 in the foregoing embodiment, which is not repeated in this embodiment.
  • step S704 is performed: maintaining the noise reduction mode, so that the user is still in a relatively quiet environment.
  • the sample sound is configured with weight according to the priority of the sample sound. The higher the priority of the sample sound, the greater the weight of the sample sound;
  • the priority of the sample sound needs to be considered, and a weight can be configured for each priority. For example, if there are three sample sounds in the sample sound library. Sample sounds, the highest priority can be configured with a weight of 1.0, the second priority can be configured with a weight of 0.5, and the lowest priority can be configured with a weight of 0.3.
  • the configuration of this priority can be defaulted by the system, that is, it can be defaulted to the initial
  • the value can also be set or adjusted by the user, which is not limited in this embodiment.
  • the intensity of the sample sound with the highest priority may be weak, so that it may be judged that the external sound does not contain the sample sound in the sample sound library corresponding to the scene, which may cause the user to miss the sound.
  • Important information For example, when accompanying a patient, if the patient’s voiceprint information is set as the highest priority in the sample sound library, but because the patient’s voice is small, its intensity may exceed the preset value, and the hearing aid mode cannot be triggered.
  • the strength of the patient’s voice multiplied by the weight may exceed the preset value to turn on the hearing aid mode, or the patient’s voiceprint information
  • the weight of the keyword is set to 1, the weight of the keyword is set to 0.5, and the person next to you speaks the keyword in the sample voice to remind the user that the patient is asking for help, then the strength of the keyword is multiplied by the weight corresponding to the keyword and The intensity of the sound emitted by the patient is multiplied by the weight corresponding to the sound emitted by the patient, and it is possible to determine that the external sound contains the sample sound in the sample sound library corresponding to the scene, so as to enter the hearing aid mode.
  • the cumulative sum in this embodiment refers to the sum of the intensity of all the sample sounds contained in the external sound multiplied by the corresponding weight.
  • the highest priority can also be configured with a weight of 1.5, and the second priority A weight of 1.0 can be configured, and the specific weight value is not limited in this embodiment.
  • the weight of the sample sound can also be set, for example, set to 1.5 or 0.5 to adjust the sensitivity of judgment and adapt to different users. Or the user needs of the same user in different scenarios.
  • the hearing aid method for noise reduction further includes establishing a sample sound library corresponding to the scene or establishing a sample heart rate library corresponding to the scene.
  • the sample sound library corresponding to the default scene or the sample heart rate library corresponding to the scene can be set before the headset leaves the factory, or it can be set by the user.
  • Set the default sample sound library corresponding to each scene and the sample heart rate library of each scene before the headset leaves the factory that is, before the headset leaves the factory, you can have an initial setting for the sample sound library corresponding to the scene and the scene, and the headset can also correspond to the scene and the scene before the headset leaves the factory.
  • the sample heart rate library has an initial setting, and the user can adjust it during use.
  • the user can be reminded to set it when the headset is paired with the mobile phone for the first time, or when the scene where the user is identified, the user is reminded to set the scene Set the sample sound library corresponding to the scene.
  • the user can also actively set the sample sound library corresponding to the scene and the scene on the mobile phone system or APP.
  • establishing a sample sound library corresponding to a scene includes one or more of: recording sample sounds into the sample sound library according to the scene, deleting the sample sounds, and adjusting the priority of the sample sounds.
  • scenes can also be added or deleted.
  • the user can record sample sounds. For example, the user can enter a keyword as a sample sound. For example, the user can customize the key The words are called Lao Zhang, Xiao Ming, etc.
  • the user can also input the audio of a specific user to extract the voiceprint information as a sample sound, and the user can also download various alarm sounds on the Internet as sample sounds. This embodiment does not limit the input method .
  • the deleted sample sounds can be stored in the deleted sample sound library, so that the user will not need to use these deleted sample sounds in the future, avoiding the trouble of re-entering, and simplifying the operation.
  • the user can adjust the priority. For example, the first ranked priority can be moved to the second ranked priority.
  • the weight can also be set. For adjusting the priority, this embodiment does not limit the specific manner of adjusting the priority.
  • identifying the scene where the user is located includes: identifying the user's location based on one or more of an acceleration sensor, a temperature sensor, an air pressure sensor, a heart rate sensor, GPS, or computer vision.
  • Scenes Take GPS as an example. If the user turns on the GPS, it can easily identify whether the user is in a home scene, an office scene, or an outdoor scene; taking a temperature sensor as an example, the indoor and outdoor temperature difference can be used to identify whether it is an outdoor scene or an indoor scene; In the embodiment, if one method cannot accurately identify the scene, multiple identification methods can also be combined to complete the scene identification.
  • the playback volume of all or part of the external sounds is increased to the preset volume value within a preset time period.
  • the hearing aid mode if all or part of the external sounds are suddenly played, the user's eardrums may be suddenly stimulated, and the user may suddenly hear all or part of the external sounds with a louder volume, which will also bring a poor user experience.
  • the playback volume of all or part of the external sounds can be set to gradually increase, that is, within a preset time, the playback volume increases to a preset volume value, and the preset time period can be 1s or Longer or shorter, this embodiment does not limit the length of the preset time period.
  • the preset volume value can be set according to user needs, for example, it can be set to the same level as the actual volume of external sounds. Or in order to protect the user's hearing, it can be set to be smaller than the actual volume of the external sound, or in order to play a prominent role, it can be set to be greater than the actual volume of the external sound. This embodiment does not limit this.
  • the noise reduction intensity of the noise reduction mode is maintained or the noise reduction intensity of the noise reduction mode is reduced; in the noise reduction mode, the active noise reduction technology is used To cancel the external sound.
  • the noise reduction mode when entering the hearing aid mode, the noise reduction mode is still turned on, and the noise reduction intensity in the noise reduction mode can be unchanged or reduced.
  • the reduction of the noise reduction intensity in the noise reduction mode can be understood as a reduction in the volume of the signal that is played in the ear and the phase of the external sound is opposite to that of the external sound.
  • the embodiment of the present application may also provide a hearing aid device for noise reduction, which is used to implement the hearing aid method for noise reduction proposed in the foregoing embodiment.
  • FIG. 8 is a noise reduction device provided by this embodiment.
  • the structure diagram of the hearing aid device of, the hearing aid device 80 for noise reduction includes:
  • the scene recognition module 81 is used to identify the scene where the user is located;
  • the hearing aid module 82 if the detection data includes sample data in the sample database corresponding to the scene, is used to enter the hearing aid mode;
  • the playing module 83 in the hearing aid mode, is used to play all or part of the external sound, and the external sound is collected by the reference microphone.
  • the detection data is an external sound
  • the sample database is a sample sound library
  • the sample data is a sample sound
  • the detection data is a heart rate signal
  • the sample database is a sample heart rate library
  • the sample data is a sample heart rate.
  • different scenes correspond to different sample sound libraries; or, different scenes correspond to different sample heart rate libraries.
  • the hearing aid device 80 for noise reduction further includes a priority configuration module 84 for configuring priorities for the sample sounds in the sample sound library; The priority of the sample sounds is different.
  • the playback module plays part of the external sound, it plays the target sound corresponding to the sample sound in the external sound.
  • the hearing aid device 80 for noise reduction further includes a separation module 85 and an enhancement module 86;
  • the separation module 85 and the enhancement module 86 are connected to the playback module 83;
  • the separation module 85 is used to separate the target sound corresponding to the sample sound from the external sound
  • the enhancement module 86 is used to increase the gain of the target sound.
  • the playback module 83 plays the target sound corresponding to the sample sound in the external sound, it plays a sample sound corresponding to one of the multiple sample sounds.
  • Target voice the playback module 83 plays the target sound corresponding to the sample sound in the external sound.
  • the playing module 83 plays the target sound corresponding to one sample sound among the multiple external sounds, if the external sound contains the first sample sound and the second sample sound in the sample sound library corresponding to the scene, the playing module According to the priority of the first sample sound and the second sample sound, select the target sound corresponding to the first sample sound to play; the priority of the first sample sound is higher than the priority of the second sample sound.
  • the sample sound includes one or more of environmental sounds, keywords, and voiceprint information, and the keywords include one or two of character titles or greeting idioms;
  • Environmental sounds include one or more of siren, impact, explosion, building collapse, car whistle, and radio announcement.
  • the scene includes one or more of an office scene, a home scene, an outdoor scene, and a travel scene, or the scene includes one or two of a static scene or a sports scene;
  • the ambient sound in the sample sound library corresponding to the office scene is one or more of alarm sound, explosion sound, building collapse sound and broadcast sound;
  • the environmental sounds in the sample sound library corresponding to outdoor scenes and travel scenes are one or more of alarm sounds, impact sounds, explosion sounds, building collapse sounds, car whistle sounds, and radio broadcast sounds;
  • the ambient sound in the sample sound library corresponding to the home scene is one or more of alarm sound, explosion sound and building collapse sound;
  • the sample heart rate in the sample heart rate library corresponding to the sports scene is a heart rate signal that is higher than 200 beats/min or lower than 60 beats/min;
  • the sample heart rate in the sample heart rate library corresponding to the stationary scene is a heart rate signal that is higher than 120 beats/min or lower than 50 beats/min.
  • the priority configuration module is also used to set the priority of environmental sounds in the sample sounds in the sample sound library corresponding to the scene to be higher than the priority of one or both of keywords and voiceprint information.
  • the hearing aid device 80 for noise reduction further includes a judgment module 87;
  • the judgment module 87 is connected to the scene recognition module 81;
  • the judging module 87 is used to judge whether the external sound includes the sample sound in the sample sound library corresponding to the scene, or is used to judge whether the heart rate signal belongs to the sample heart rate in the sample heart rate library corresponding to the scene.
  • the priority configuration module is also used to configure weights for the sample sounds according to the priority of the sample sounds, the higher the priority of the sample sounds, the greater the weight of the sample sounds;
  • the judgment module determines that the external sound contains the sample sound in the sample sound library corresponding to the scene.
  • the hearing aid device 80 for noise reduction further includes a library building module 88, which is used to establish a sample sound library corresponding to the scene or a sample heart rate library corresponding to the scene;
  • the library building module 88 also includes one or more of an input module, a deletion module, or an adjustment module;
  • the input module, the delete module and the adjustment module respectively enter the sample sound, delete the sample sound and adjust the priority of the sample sound in the sample sound library according to the scene, or
  • the input module and the deletion module are respectively used to input the sample heart rate or delete the sample heart rate to the sample heart rate library according to the scene.
  • the playback volume of all or part of the external sounds played by the playback module is increased to a preset volume value within a preset time period.
  • the hearing aid device 80 for noise reduction further includes a noise reduction module 89.
  • the noise reduction module 89 is used to maintain the noise reduction strength of the noise reduction mode or the noise reduction mode.
  • the intensity of noise reduction is reduced; in the noise reduction mode, the noise reduction module 89 is also used to use active noise reduction technology to offset external sounds.
  • the application embodiment provides a hearing aid device for noise reduction.
  • identifying the scene the user is in if the detection data contains sample data in the sample database corresponding to the scene, the hearing aid mode is entered to adapt to the user's situation.
  • the change of the scene also improves the user experience.
  • An embodiment of the present application may also provide a chip for executing a hearing aid method for noise reduction proposed in the foregoing embodiment; as shown in FIG. 9, the chip 90 includes a memory 91 and a processor 92;
  • the memory 91 is coupled with the processor 92;
  • the memory 91 is used to store program instructions
  • the processor 92 is configured to call program instructions stored in the memory, so that the chip executes the hearing aid method for noise reduction proposed in any of the above embodiments.
  • the embodiments of the present application may also provide a headset, which includes the chip provided in any of the above-mentioned embodiments.
  • a headset which includes the chip provided in any of the above-mentioned embodiments.
  • the specific implementation process and beneficial effects refer to the above, and will not be repeated here.
  • FIG. 10 in this embodiment, there is a reference microphone ref outside the headset, and the collected data is used in the active noise reduction module 10 for active noise reduction processing, and the other is transmitted to the target sound extraction module 12 for signal processing and processing. Later, it is sent to the music playing module 13 and played on the internal speakers of the earphone through the music channel.
  • the control center 11 is used to control each module to implement the hearing aid method for noise reduction mentioned in the above-mentioned embodiment, and the control center 11 can control each Module switching and parameter adjustment, for example, selecting or adjusting the noise reduction method or filter parameter of the active noise reduction module 10.
  • the control center is on the earphone side as an example, but the control center 11 can be on the earphone side or the mobile phone side.
  • the target sound extraction module 12 completes the extraction of the target sound through techniques such as signal separation, filtering, and speech enhancement, and transmits the target sound to the music playback module, so that the target sound and music are played at the same time. Play, or only play external sounds.
  • the target sound can be understood as the external sound to be played, that is, all or part of the external sound in the foregoing embodiment, or it can be the target in the external sound corresponding to the sample sound sound.
  • the active noise reduction module can use feedforward (FF), feedback (Feedback, FB), and hybrid (Hybird) structures.
  • the music playing module 13 is mainly used to transmit audio signals sent by mobile phones.
  • the earphone may also have an error microphone error, and both the error microphone and the speaker are in the ear environment.
  • An embodiment of the present application may also provide a computer-readable storage medium, including: a computer program stored thereon, which when executed by a processor implements the hearing aid method for noise reduction in any one of the foregoing embodiments, For its specific implementation process and beneficial effects, refer to the above, which will not be repeated here.
  • the foregoing method embodiments of the present application may be applied to a processor or implemented by a processor.
  • the processor may be an integrated circuit chip with signal processing capabilities.
  • the steps of the foregoing method embodiments may be completed by hardware integrated logic circuits in the processor or instructions in the form of software.
  • the above-mentioned processor may be a general-purpose processor, a digital signal processor (digital signal processor, DSP), an application specific integrated circuit (ASIC), a ready-made programmable gate array (field programmable gate array, FPGA) or other Programming logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • Programming logic devices discrete gates or transistor logic devices, discrete hardware components.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers.
  • the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
  • the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electrically accessible memory. Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • static random access memory static random access memory
  • dynamic RAM dynamic RAM
  • DRAM dynamic random access memory
  • synchronous dynamic random access memory synchronous DRAM, SDRAM
  • double data rate synchronous dynamic random access memory double data rate SDRAM, DDR SDRAM
  • enhanced synchronous dynamic random access memory enhanced SDRAM, ESDRAM
  • synchronous connection dynamic random access memory serial DRAM, SLDRAM
  • direct rambus RAM direct rambus RAM
  • B corresponding to A means that B is associated with A, and B can be determined according to A.
  • determining B based on A does not mean that B is determined only based on A, and B can also be determined based on A and/or other information.
  • the disclosed system, device, and method can be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of the present application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disks or optical disks and other media that can store program codes. .

Abstract

本申请涉及信号处理领域，尤其涉及一种用于降噪的助听方法、装置、芯片、耳机及存储介质。一种用于降噪的助听方法，包括：识别用户所处的场景；若检测数据包含场景对应的样本数据库中的样本数据，则进入助听模式，在助听模式下，播放全部或部分外部声音，外部声音由参考麦克风采集。解决了现有技术中用于降噪的助听方法不能适用多种应用场景的问题，也提升了用户体验。

Description

一种用于降噪的助听方法、装置、芯片、耳机及存储介质 技术领域
本申请涉及信号处理领域，尤其涉及一种用于降噪的助听方法、装置、芯片、耳机及存储介质。
背景技术
当用户在噪杂的街道时，外界的噪声会极大的影响电子设备的使用体验。国内外各大厂商和公司为了减小噪声的干扰提出了各种解决方案，主要通过两种途径：第一，设计耳机结构，例如使用隔音材料物理上隔离噪声，比如使用耳罩、耳塞或者将耳朵包裹起来；第二，使用信号处理技术通过多个麦克风在耳机内部声场空间产生一个与外部噪声信号反向的语音以消除噪声的影响，即主动降噪技术。以上提到的降噪技术同时也带来了一定的问题，比如，当在马路上带着降噪耳机欣赏音乐，用户就没办法听到马路上喇叭声或者警报声等，或者当别人与你交谈时，用户必须要将耳机取下才能交谈，这使得用户可能忽视这些感兴趣的声音。现有技术为了解决该问题，检测到感兴趣的声音时，就会播放感兴趣的声音，以使得用户即使佩戴了降噪耳机也可以听到感兴趣的声音，可以称之为语音直通(Monitor/talk through/hear through)或者助听，但是这种方法并不能适用多种应用场景。若对于所有的场景，助听模式的触发条件都一样，则可能导致用户在不期望进入助听模式时进入了助听模式，在用户期望进入助听模式时，没有进入助听模式。例如，用户在不同的场景，所感兴趣的声音可能不同，在睡眠场景下，用户可能不愿意被被人打扰，即使有人叫自己的名字，也不想该“名字”的关键词被耳机传输到耳内，而用户在其他场景下，例如办公场景，对于“名字”的关键词，还是希望听到。而现有技术的助听技术并不能适用于多种应用场景或者场景变化的情况。
发明内容
针对现有技术中用于降噪的助听方法不能适用多种应用场景的问题，本申请提供了一种用于降噪的助听方法、装置、芯片、耳机及存储介质。
本申请的实施例的第一方面提供了一种用于降噪的助听方法，包括：识别用户所处的场景；若检测数据包含场景对应的样本数据库中的样本数据，则进入助听模式，在助听模式下，播放全部或部分外部声音，外部声音由参考麦克风采集。
另外，结合第一方面，在第一方面的一种实现方式中，检测数据为外部声音，样本数据库为样本声音库，样本数据为样本声音；或者
检测数据为心率信号，样本数据库为样本心率库，样本数据为样本心率。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，不同的场景对应的样本声音库不同；或者，不同的场景对应的样本心率库不同。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，样本声音库中的样本声音配置有优先级；
不同的场景对应的样本声音库中的样本声音的优先级不同。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，播放部分外部声音包括：
播放外部声音中的与样本声音对应的目标声音。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，播放外部声音中的与样本声音对应的目标声音之前，还包括：
从外部声音中分离样本声音对应的目标声音；
增大目标声音的增益。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，若外部声音包含场景对应的样本声音库中的多个样本声音，播放外部声音中的与样本声音对应的目标声音包括：
播放与多个样本声音中的一个样本声音对应的目标声音。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，播放与多个外部声音中的一个样本声音对应的目标声音包括：
若外部声音包含场景对应的样本声音库中的第一样本声音和第二样本声音， 则根据第一样本声音和第二样本声音的优先级，选择第一样本声音对应的目标声音进行播放；第一样本声音的优先级高于第二样本声音的优先级。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，样本声音包括环境声、关键词和声纹信息中的一种或多种，关键词包括人物称谓或打招呼惯用语中的一种或两种；
环境声包括：警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，场景包括办公场景、居家场景、室外场景和出行场景中的一种或多种，或者场景包括静止场景或运动场景中的一种或两种；
办公场景对应的样本声音库中的环境声为警报声、爆炸声、建筑坍塌声和广播播报声中的一种或多种；
室外场景和出行场景对应的样本声音库中的环境声为警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种；
居家场景对应的样本声音库中的环境声为警报声、爆炸声和建筑坍塌声中的一种或多种；
运动场景对应的样本心率库中的样本心率为高于200次/分或者低于60次/分的心率信号；
静止场景对应的样本心率库中的样本心率为高于120次/分或者低于50次/分的心率信号。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，场景对应的样本声音库中的样本声音中的环境声的优先级高于关键词和声纹信息中的一种或两种的优先级。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，识别用户所处的场景之后，还包括判断外部声音是否包含场景对应的样本声音库中的样本声音，或者判断心率信号是否属于场景对应的样本心率库中的样本心率。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，根据样本声音的优先级给样本声音配置权重，样本声音的优先级越高，样本声音的权重越大；
判断外部声音是否包含场景对应的样本声音库中的样本声音包括：
若外部声音包含的样本声音的强度乘以权重的累加和大于预设值，则判断外部声音包含场景对应的样本声音库中的样本声音。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，还包括建立场景对应的样本声音库或者建立场景对应的样本心率库；
建立场景对应的样本声音库包括：
根据场景对样本声音库录入样本声音、删除样本声音和调整样本声音的优先级中的一种或多种；
建立场景对应的样本心率库包括：
根据场景对样本心率库录入样本心率或者删除样本心率。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，包括：
若进入助听模式，播放全部或部分外部声音时，全部或部分外部声音的播放音量在预设时间段内增加到预设音量值。
另外，结合第一方面及其上述实现方式，在第一方面的另一种实现方式中，在助听模式下，保持降噪模式的降噪强度或者降噪模式的降噪强度降低；在降噪模式下，使用主动降噪技术以抵消外部声音。
本申请的实施例的第二方面提供了一种用于降噪的助听装置，包括：
场景识别模块，用于识别用户所处的场景；
助听模块，若检测数据包含场景对应的样本数据库中的样本数据，用于进入助听模式；
播放模块，在助听模式下，用于播放全部或部分外部声音，外部声音由参考麦克风采集。
另外，结合第二方面，在第二方面的一种实现方式中，检测数据为外部声音，样本数据库为样本声音库，样本数据为样本声音；或者
检测数据为心率信号，样本数据库为样本心率库，样本数据为样本心率。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，不同的场景对应的样本声音库不同；或者，不同的场景对应的样本心率库不同。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，还 包括优先级配置模块，用于给样本声音库中的样本声音配置优先级；不同的场景对应的样本声音库中的样本声音的优先级不同。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，播放模块播放部分外部声音时，播放外部声音中的与样本声音对应的目标声音。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，还包括分离模块和增强模块；
分离模块和增强模块与播放模块连接；
分离模块用于从外部声音中分离样本声音对应的目标声音；
增强模块用于增大目标声音的增益。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，若外部声音包含场景对应的样本声音库中的多个样本声音，播放模块播放外部声音中的与样本声音对应的目标声音时，播放与多个样本声音中的一个样本声音对应的目标声音。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，播放模块播放与多个外部声音中的一个样本声音对应的目标声音时，若外部声音包含场景对应的样本声音库中的第一样本声音和第二样本声音，则播放模块根据第一样本声音和第二样本声音的优先级，选择第一样本声音对应的目标声音进行播放；第一样本声音的优先级高于第二样本声音的优先级。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，样本声音包括环境声、关键词和声纹信息中的一种或多种，关键词包括人物称谓或打招呼惯用语中的一种或两种；
环境声包括：警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，场景包括办公场景、居家场景、室外场景和出行场景中的一种或多种，或者场景包括静止场景或运动场景中的一种或两种；
办公场景对应的样本声音库中的环境声为警报声、爆炸声、建筑坍塌声和广播播报声中的一种或多种；
室外场景和出行场景对应的样本声音库中的环境声为警报声、撞击声、爆炸声、 建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种；
居家场景对应的样本声音库中的环境声为警报声、爆炸声和建筑坍塌声中的一种或多种；
运动场景对应的样本心率库中的样本心率为高于200次/分或者低于60次/分的心率信号；
静止场景对应的样本心率库中的样本心率为高于120次/分或者低于50次/分的心率信号。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，优先级配置模块还用于设置场景对应的样本声音库中的样本声音中的环境声的优先级高于关键词和声纹信息中的一种或两种的优先级。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，还包括判断模块；
判断模块与场景识别模块连接；
判断模块用于判断外部声音是否包含场景对应的样本声音库中的样本声音，或者用于判断心率信号是否属于场景对应的样本心率库中的样本心率。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，优先级配置模块还用于根据样本声音的优先级给样本声音配置权重，样本声音的优先级越高，样本声音的权重越大；
若外部声音包含的样本声音的强度乘以权重的累加和大于预设值，则判断模块判断外部声音包含场景对应的样本声音库中的样本声音。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，还包括建库模块，用于建立场景对应的样本声音库或者用于建立场景对应的样本心率库；
建库模块还包括录入模块、删除模块或者调整模块中的一个或多个；
录入模块、删除模块和调整模块分别根据场景对样本声音库录入样本声音、删除样本声音和调整样本声音的优先级，或者
录入模块、删除模块分别用于根据场景对样本心率库录入样本心率或者删除样本心率。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，播 放模块播放的全部或部分外部声音的播放音量在预设时间段内增加到预设音量值。
另外，结合第二方面及其上述实现方式，在第二方面的另一种实现方式中，还包括降噪模块，在助听模式下，降噪模块用于保持降噪模式的降噪强度或者降噪模式的降噪强度降低；在降噪模式下，降噪模块还用于使用主动降噪技术以抵消外部声音。
本申请的实施例的第三方面提供了一种芯片，用于执行上述第一方面的用于降噪的助听方法，包括存储器和处理器；
存储器与处理器耦合；
存储器，用于存储程序指令；
处理器，用于调用存储器存储的程序指令，使得芯片执行上述第一方面的用于降噪的助听方法。
本申请的实施例的第四方面提供了一种耳机，包括上述第三方面的芯片。
本申请的实施例的第五方面提供了一种计算机可读存储介质，包括：其上存储有计算机程序，其特征在于，计算机程序被处理器执行时实现上述第一方面的用于降噪的助听方法
与现有技术相比，本申请实施例的有益效果在于：申请实施例提供了一种用于降噪的助听方法，通过识别用户所处的场景，若检测数据包含场景对应的样本数据库中的样本数据，则进入助听模式，以适应用户所处的场景改变的情况，也提升了用户体验。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例的用于降噪的助听方法的流程图；
图2为本申请实施例的又一用于降噪的助听方法的流程图；
图3为本申请实施例的再一用于降噪的助听方法的流程图；
图3A为本申请实施例的再一用于降噪的助听方法的流程图；
图4为本申请实施例的再一用于降噪的助听方法的流程图；
图5为本申请实施例的再一用于降噪的助听方法的流程图；
图6为本申请实施例的再一用于降噪的助听方法的流程图；
图7为本申请实施例的再一用于降噪的助听方法的流程图；
图8为本申请实施例的一种用于降噪的助听装置的结构示意图；
图8A为本申请实施例的又一用于降噪的助听装置的结构示意图；
图8B为本申请实施例的再一用于降噪的助听装置的结构示意图；
图8C为本申请实施例的再一用于降噪的助听装置的结构示意图；
图8D为本申请实施例的再一用于降噪的助听装置的结构示意图；
图8E为本申请实施例的再一用于降噪的助听装置的结构示意图；
图9为本申请实施例的一种芯片的结构示意图；
图10为本申请实施例的一种耳机的结构示意图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请的部分实施例采用举例的方式进行详细的阐述。然而，本领域的普通技术人员可以理解，在各例子中，为了使读者更好地理解本申请而提出了许多技术细节。但是，即使没有这些技术细节和基于以下各实施例的种种变化和修改，也可以实现本申请所要求保护的技术方案。
本申请实施例提供了一种用于降噪的助听方法，该助听方法可以用于各种类型的降噪耳机中，例如耳戴式耳机、头戴式耳机、入耳式耳机和半入耳式耳机等。耳机可以通过有线或者无线方式与手机、平板、电脑、电视等电子设备进行通信。请参考图1，图1是本申请实施例的用于降噪的助听方法的流程图，该方法包括以下步骤：
S101：识别用户所处的场景；
S102：若检测数据包含场景对应的样本数据库中的样本数据，则进入助听模式，在助听模式下，播放全部或部分外部声音，外部声音由参考麦克风采集。
在步骤S101中，识别用户所处的场景，按照用户所处的地理位置，该场景可以包括室内场景或者室外场景，例如，可以用全球定位系统(Global Positioning  System，GPS)定位识别用户处在室内还是室外场景，进一步地，室内场景又可以包括居家场景或者办公场景，例如，可以通过用户上班打卡信息确定识别用户所处的为办公场景，或者通过用户在APP上打开门锁来识别用户所处的为居家场景；另外，室内场景还可以包括出行场景，例如，在机场或者地铁站内，比如可以通过用户刷地铁卡或者APP中的机票信息确定，当然也可以通过手机自带的智能助手(里面含有用户日程管理、行程安排、闹钟等)判断用户状态。按照用户的运动状态，场景可以包括运动场景或静止场景，本实施例中，可以使用速度传感器、温度传感器、气压传感器、心率传感器识别用户所处的场景，也可以使用GPS、机器学习、计算机视觉等一种或者多种技术实现场景识别，本实施例对识别用户所处的场景的具体技术不做限制，可以根据需求选择，对场景的数量也不做限制，可以一个或者多个，用户可以根据需求自定义各种场景。
在步骤102中，参考麦克风的作用是为了采集外部声音，可以理解为用户周围环境中的声音，外部声音也可以理解为外部噪声，但是在某些场景下，外部噪声中有可能包含有用信息，比如，汽车鸣笛声，或者是地铁报站声，都是用户感兴趣的声音。本实施例中的参考麦克风可以设置在耳机上，例如，设置在远离用户口腔的位置，以避免采集到用户自己发出的声音。
本实施例中，每个场景都有对应的样本数据库，样本数据库中存储有样本数据，一般来说，场景确定后，该场景对应的样本数据库也确定了，由此，用户所处的场景确定后，助听模式启动的条件也随之确定，例如，在第一时间段，若识别出用户处于第一场景，若该场景对应的样本数据库中的样本数据包括第一样本数据，则若检测数据包含第一样本数据，则进入助听模式，在第二时间段，用户处于第二场景，若该场景对应的样本声音库中不包括该第一样本数据，则若检测数据包含第一样本数据，这种情况下也不会进入助听模式，以使得用户避免听到不感兴趣的声音。这种场景改变的情况时有发生，而在不同场景下，用户对进入助听模式的条件要求往往有所差别，例如，若对于场景A，用户对样本数据a1感兴趣，则可以设置场景A对应的样本数据库中的样本数据包括a1，若检测数据包含该A场景对应的样本数据库中的a1，则进入助听模式。若对于场景B，用户对样本数据b1感兴趣，则可以设置场景B对应的样本数据库中的样本数据包括b1，若检测数据包含该B场景对应的样本数据库中的b1，则进入助听模式，由此，每种场景都有对应的样 本声音库，可以适应用户多变的需求，也可以适应不同用户的需求。本实施例中的检测数据可以理解为检测到的数据，即采集到的数据，可以为检测到的音频数据，也可以为生物特征数据等。
若进入助听模式，在该助听模式下，用户可以获取到外界声音。可以播放全部外部声音，也可以播放部分外部声音，部分外部声音可以为从全部外部声音中分离得到，该部分外部声音可以是用户感兴趣的声音。本实施例中，播放全部或部分外部声音可以通过耳内的麦克风实现，例如，可以通过音乐播放通道实现，即在播放音乐的同时，播放全部或部分外部声音。本实施例中，在进入助听模式时，可以停止音乐播放，也可以维持音乐播放的音量，也可以降低音乐播放的音量，当降低音乐播放的音量或者停止音乐播放时，可以使得用户更加关注扬声器播放的全部或者部分外部声音，能提高警示作用。
申请实施例提供了一种用于降噪的助听方法，通过识别用户所处的场景，若检测数据包含场景对应的样本数据库中的样本数据，则进入助听模式，以适应用户所处的场景改变的情况，也提升了用户体验。
基于上述实施例公开的内容，本实施例中，检测数据为外部声音，样本数据库为样本声音库，样本数据为样本声音。
请参考图2，图2是本申请实施例的用于降噪的助听方法的流程图，该方法包括以下步骤：
S201：识别用户所处的场景；
S202：若外部声音包含场景对应的样本声音库中的样本声音，则进入助听模式，在助听模式下，播放全部或部分外部声音，外部声音由参考麦克风采集。
步骤201与上述步骤101相同或近似，场景包括室内场景、室外场景、出行场景，室内场景可以包括办公场景、居家场景等，居家场景还可以包括睡眠场景，出行场景可以包括乘坐飞机、火车、地铁、巴士等交通工具，识别用户场景是为了满足用户在各种场景下的不同需求，以使得在各个场景下可以有各自的样本声音库。本实施例中，可以使用速度传感器、温度传感器、气压传感器、心率传感器识别用户所处的场景，也可以配合其他技术实现场景识别，例如GPS、机器学习、计算机视觉等，本实施例对识别用户所处的场景的具体技术不做限制，可以根据需求选择。
本实施例中，每个场景都有对应的样本声音库，样本声音库中存储有样本声音， 一般来说，场景确定后，该场景对应的样本声音库也确定了，由此，用户所处的场景确定后，助听模式启动的条件也随之确定，例如，在第一时间段，用户处于室外场景，若该场景对应的样本声音库中的样本声音包括汽车鸣笛声，则若外部声音包含汽车鸣笛声，进入助听模式，在第二时间段，用户处于居家场景，若该场景对应的样本声音库中不包括汽车鸣笛声，则若外部声音包含汽车鸣笛声，例如，玩具播放了汽车鸣笛声，或者是街道上的汽车鸣笛声传到了房间内，这种情况下也不会进入助听模式，以使得用户避免听到不感兴趣的声音。这种场景改变的情况时有发生，而在不同场景下，用户感兴趣的声音往往有所差别，例如，在睡眠场景下，各种关键词也可能都不是用户感兴趣的声音，在睡眠场景下，感兴趣的声音可以包括各种警报声。本实施例中，不同场景下对应的样本声音库可以相同，也可以不同。例如，若用户在睡眠场景下，不介意被人打扰，睡眠场景对应的样本声音库中的样本声音可以跟办公场景对应的样本声音库中的样本声音相同，可以包括相同的关键词，即两个场景可以对应同一个样本声音库。若用户在睡眠场景下，不愿意被人打扰，则睡眠场景下对应的样本声音库中可以不包括各种关键词，每种场景都有对应的样本声音库，可以适应多变的需求，也可以适应不同用户的需求。
识别出用户所处的场景之后，如果外部声音包含该场景对应的样本声音库中的样本声音，则进入助听模式。例如，如果识别出用户所处的场景为办公场景，假设样本声音库中的样本声音有警报声，而外部声音中包含警报声，例如，火警声，则进入助听模式，以使得用户可以获取到外界声音。在该助听模式下，可以播放全部外部声音，例如，如果用户处于办公场景，如果外部声音中有火警声，可以播放参考麦克风采集到的全部声音，其中可能也包含呼救声或者同事之间的谈话声；在该助听模式下，也可以播放部分外部声音，例如，可以仅仅播放该火警声，以起到足够的警示作用。
基于上述实施例公开的内容，本实施例中，检测数据为心率信号，样本数据库为样本心率库，样本数据为样本心率。如图3所示，包括：
S301：识别用户所处的场景；
S302：若心率信号属于场景对应的样本心率库中的样本心率，则进入助听模式，在助听模式下，播放全部或部分外部声音，外部声音由参考麦克风采集。
本实施例中，检测数据可以通过心率传感器检测得到，在用户心率处于非正常 范围时，进入助听模式，非正常范围可以为医学上普遍认为的用户身体可能出现病变的范围。如仅仅以用户的心率是否处于正常范围来判断是否进入助听模式，则可能有不准确的问题，例如，在剧烈运动时，心率值偏高，可能处于非正常范围，若此时开启助听模式，将使得用户在剧烈运动时被外界声音打扰，由此，需要根据场景来确定该场景对应的样本心率库。在步骤301中，场景可以包括运动场景或静止场景等，本实施例中，识别用户所处的是运动场景还是静止场景可以根据APP上的计步数据实现或者其他方式时间，例如，若步数增加的速度超过预定速度，可以确定用户处于运动场景，当步数增加的速度低于预定速度，则可以确定用户处于静止场景，当用户可能处于危险状态时，例如，用户的心率信号不正常时，需要开启助听模式，以使得用户与外界的沟通通道保持畅通，但是在不同的场景下，用户心率值是不同的，例如在运动场景下，在跑步或者骑车时，心率值一般比较快，而在静止场景下，心率值一般较慢，为了适应不同的场景，每个场景可以配置对应的样本心率库。本实施例中，需要识别用户所处的场景，例如运动场景或者静止场景，在其他实施例中，也可以根据用户需求设置其他场景，或者是将场景进一步细分，例如，将运动场景细分为小运动量场景、中运动量场景或者大运动量场景。本实施例中，识别用户所处的场景可以通过速度传感器、加速度传感器、计步器或者GPS等一种或者多种传感器实现，通过GPS可以识别出用户在健身房、在家还是在公司，以识别出用户处于运动状态还是静止状态，如一种识别方式不足以完成识别出用户所处场景，也可以使用多种识别方式相结合的方式，本实施例对识别方式不作限制。本实施例中，在判断心率信号是否属于所述场景对应的样本心率库中的样本心率时，可以进行多次判断，即若检测到心率信号属于样本心率库中的样本心率的次数超过预设次数，则可以进入助听模式，若检测到心率信号属于样本心率库中的样本心率的次数未超过预设次数，则可以由用户选择是否开启助听模式，这种多次检测的设置是为了避免误检测，以进一步改善用户体验感。本实施例中，在进入助听模式后，也可以默认或者由用户选择是否关闭降噪模式或者是调节降噪模式下的降噪强度。
请参考图3A，本实施例中，S3011与前述实施例中的步骤S301相同或相似，本实施例对此不做赘述。S3012：判断心率信号是否属于场景对应的样本心率库中的样本心率，若心率信号属于场景对应的样本心率库中的样本心率，则可以直接执 行步骤S3015开启助听模式，若心率信号不属于场景对应的样本心率库中的样本心率，则可以开启预设模式或者由用户选择模式，预设模式可以为降噪模式或者助听模式，也可以为同时开启降噪模式和助听模式。另外，若心率信号属于场景对应的样本心率库中的样本心率，也可以执行步骤S3013：计算次数，该次数为判断心率信号属于场景对应的样本心率库中的样本心率的次数，计算次数之后，执行S3014，若次数大于或者等于预设次数，则执行S3015开启助听模式，本实施例中，计算次数并且判断次数是否大于或等于预设次数，可以避免虚警，即避免因误检测导致开启了助听模式，本实施例中，计算次数也可以理解为计算心率属于场景对应的样本心率库中的样本心率的持续时间，若该持续时间超过或者等于预设持续时间，也可以开启助听模式。若次数少于预设次数，可以开启预设模式或者由用户选择模式，用户在收到选择模式的提醒后，可以根据需求选择助听模式或者降噪模式，或者选择同时开启助听模式和降噪模式，实现助听和降噪的协调，在实现降噪的同时，还可以听到外界的有用信息。步骤S3017之后，还可以执行步骤S3018调整降噪强度或助听强度，例如，可以通过改变助听的增益或者算法参数或者降噪强度，或者在不同频段使用不同的助听增益，带来更佳的用户体验。本实施例中，步骤S3015之后，还可以执行步骤S3016：逐渐增大播放的外部声音的音量，实现淡入淡出功能，使得用户在模式切换过程中舒适，不至于在一开始进入助听模式时就听到较大音量的外部声音。
本申请实施例提供了一种用于降噪的助听方法，通过识别用户所处的场景，若外部声音包含该场景对应的样本声音库中的样本声音或者是心率信号属于该场景对应的样本心率库中的样本心率，则进入助听模式，以适应用户所处的场景改变的情况，也提升了用户体验。
基于上述实施例公开的内容，本实施例中，不同的场景对应的所述样本声音库不同。本实施例中，用户在不同场景下，感兴趣的声音有所不同，例如，在室内场景，汽车鸣笛声不是用户感兴趣的声音，因为该汽车鸣笛声大概率是电视或者玩具发出来的，或者是由于房子隔音效果不好，马路上的汽车鸣笛声还是可以被参考麦克风采集到，但是，若室内场景对应的样本声音库中不包含汽车鸣笛声，则即使马路上的汽车鸣笛声被参考麦克风采集到，也不可能进入助听模式，以避免用户听到不感兴趣的声音，而对于室外场景，汽车鸣笛声是用户感兴趣的声音，因此，室外 场景对应的样本声音库的样本声音可以包括该汽车鸣笛声。
一般来说，正常人安静状态下的心率为60-100次/分，在运动时的心率一般为120-180次/分，运动场景又可以细分为小运动量120-140次/分，中运动量为141-160次/分，大运动量为161-180次/分。因此，在不同的场景下，样本心率库可以设置不同，则在不同场景下，助听模式的触发条件不同。
基于上述实施例公开的内容，本实施例中，不同的场景对应的样本声音库不同包括：不同的场景对应的样本声音库中的样本声音的数量不同。不同场景下，用户感兴趣声音的数量一般是不同的，例如，对于室外场景，样本声音库中的样本声音的数量较多，而对于居家场景，样本声音库中的样本声音的数量较少，对于睡眠场景，样本声音库中的样本声音的数量可能就更少了。
基于上述实施例公开的内容，本实施例中，样本声音库中的样本声音配置有优先级。本实施例中，样本声音库中的样本声音不止一个，当样本声音库中的样本声音有多个时，对每个样本声音配置优先级，以区分用户对不同的样本声音的感兴趣的程度，当然，在对样本声音库中的样本配置优先级时，对多个样本声音配置的优先级可以相同，对多个样本声音配置的优先级也可以不同，本实施例对此不作限制。本实施例中，不同的场景对应的样本声音库中的样本声音的优先级可以不同。例如，办公场景和室外场景对应的样本声音库中的样本声音都可以包括用户姓名，但是用户姓名这种样本声音在办公场景的优先级可能高于用户姓名在室外场景对应的样本声音库中的优先级，本实施例中，优先级可以通过权重来体现，也可以通过设置级数来实现，本实施例对此不作限制。
基于上述实施例公开的内容，本实施例中，播放部分外部声音包括：播放外部声音中的与样本声音对应的目标声音。如图4所示，本实施例中，步骤S401与前述实施例公开的步骤S201相同或相似，本实施例对此不做赘述。步骤S401识别用户所处的场景之后，执行步骤S402，如果外部声音包含该场景对应的样本声音库中的样本声音，则进入助听模式，在助听模式下，播放外部声音中的与样本声音对应的目标声音。例如，如果识别出用户所处的场景为办公场景，假设样本声音库中的样本声音有警报声，例如，火警声，而外部声音中包含火警声，则进入助听模式，以使得用户可以获取到外界声音，在该助听模式下，可以仅仅播放该外部声音中的火警声。在助听模式下，播放外部声音中的与样本声音对应的目标声音，可以 使得用户仅仅获取到感兴趣的声音，以免用户获取到感兴趣的声音之外的其他声音，在一定程度上，可以突出重点，使得用户可以很快地对该感兴趣的声音做出反应。本实施例中的目标声音是外部声音中的与样本声音对应的声音。可以理解的是，样本声音库中的样本声音是比较标准的，而若外部声音包含场景对应的样本声音库中的样本声音，该外部声音中检测到的可能与样本声音库中的样本声音相同或者近似，因此，播放外部声音中与样本声音对应的目标声音，相比较于播放样本声音库中的样本声音，可以使得用户听到的声音更接近在真实环境中传输的声音，可以提高用户感知的声音的真实性，以提升用户体验，例如，若样本声音库中的样本声音包括汽车鸣笛声，外部声音包含该汽车鸣笛声，但是外部声音的汽车鸣笛声与样本声音库中的汽车鸣笛声有所差异，例如，外部声音中的汽车鸣笛声还包含汽车距离用户的远近信息，或者是该汽车属于公交还是私家车等信息，由此，播放外部声音中与该样本声音库中的样本声音对应的目标声音，可以保留外部声音中该目标声音的多维度的信息，以提高用户感知声音的真实性，提升用户体验。
基于上述实施例公开的内容，本实施例中，播放外部声音中的与样本声音对应的目标声音之前，还包括：
S501：从外部声音中分离样本声音对应的目标声音；
S502：增大目标声音的增益。
如图5，步骤503与前述实施例公开的步骤S402中的播放外部声音中的与样本声音对应的目标声音相同或相似，本实施例对此不做赘述。本实施例中，为了播放外部声音中的与样本声音对应的目标声音，可以通过语音分离技术实现，从外部声音中分离样本声音对应的目标声音，进而播放已经分离出来的目标声音。另外，本实施例中，对于已经分离出来的目标声音，还可以执行步骤S502，增大该目标声音的增益，以增大该目标声音的音量，使得用户可以清晰的听到该目标声音，以引起用户足够的重视，步骤S502可以通过语音增强等技术实现。
基于上述实施例公开的内容，本实施例中，若外部声音包含场景对应的样本声音库中的多个样本声音，播放外部声音中的与样本声音对应的目标声音包括：播放与多个样本声音中的一个样本声音对应的目标声音。本实施例中，当外部声音包含场景对应的样本声音库中的多个样本声音时，若播放与该多个样本声音对应的目标声音，则用户听到多个目标声音，这可能使得用户在每个目标声音上分散注意力， 以使得用户忽视更重要的目标声音，例如，若识别到用户所处的场景为室外场景，而室外场景对应的样本声音库中的样本声音包括用户姓名和汽车鸣笛声，若此时外部声音既包含用户姓名，又包含汽车鸣笛声，则如果同时播放用户姓名和汽车鸣笛声，可能会使得用户听不清楚用户姓名，或者是使得用户听不清楚汽车鸣笛声。由此，当外部声音包含场景对应的样本声音库中的多个样本声音时，可以播放与该多个样本声音中的一个样本声音对应的目标声音，以使得用户至少听清楚一个目标声音，使得用户把关注重点放在一个目标声音上。
基于上述实施例公开的内容，本实施例中，所述播放与多个外部声音中的一个样本声音对应的目标声音包括：若外部声音包含场景对应的样本声音库中的第一样本声音和第二样本声音，则根据第一样本声音和第二样本声音的优先级，选择第一样本声音对应的目标声音进行播放；第一样本声音的优先级高于第二样本声音的优先级。本实施例中，播放与多个外部声音中的一个样本声音对应的目标声音时，可以根据样本声音的优先级确定播放哪一个样本声音对应的目标声音，当外部声音包含场景对应的样本声音库中的多个样本声音时，选择与该多个样本声音中优先级最高的样本声音对应的目标声音进行播放。例如，若外部声音包含的场景对应的样本声音库中的样本声音包括第一样本声音和第二样本声音，则可以根据第一样本声音和第二样本声音的优先级，选择优先级较高的样本声音对应的目标声音进行播放，若第一样本声音的优先级高于第二样本声音的优先级，则选择第一样本声音对应的目标声音进行播放。在具体的应用场景中，若识别到用户所处的场景为室外场景，而室外场景对应的样本声音库中的样本声音包括用户姓名和汽车鸣笛声，若此时外部声音既包含用户姓名，又包含汽车鸣笛声，则可以选择优先级较高的汽车鸣笛声对应的目标声音进行播放，以使得用户听清楚汽车鸣笛声，引起足够的警觉。由此，当外部声音包含场景对应的样本声音库中的多个样本声音时，可以播放与该多个样本声音中的优先级最高的样本声音对应的目标声音，以使得用户仅清楚一个目标声音，使得用户把关注重点放在该目标声音上。
基于上述实施例公开的内容，本实施例中，所述样本声音包括环境声、关键词和声纹信息中的一种或多种，关键词包括人物称谓或打招呼惯用语中的一种或两种；环境声包括：警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种。本实施例中，环境声中列举的警报声包括多种警报声，例如火 警，也称之为消防警报，再例如地震预警，广播播放声也可以包括多种广播播放声，例如机场广播播报声、地铁广播播报声等，本实施例对警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声的具体内容不作限制。本实施例中的人物称谓可以是具体的职称或者外号，例如老板、社长、校长、律师、老王、小张等，打招呼惯用语可以是您好、嗨等，本实施例中，样本声音也可以是人物称谓加上打招呼惯用语，例如：嗨，小张。本实施例中，对样本声音的语言种类不作限制，可以是多国语言中的一种或多种。本实施例中的声纹信息是可以用电声学仪器显示的携带言语信息的声波频谱，一般来说，每个人的声纹信息都不同，在某些场景下，用户可能需要格外关注某一个人的声音，例如，在病房陪伴病人时，需要格外注意该病人的语音，若样本声音库中的样本声音包含该病人的声纹信息，则可以实现在该病人发出语音时，才会开启助听模式，而其他人的声音并不能触发进入助听模式，以避免用户被其他病人打扰到。
基于上述实施例公开的内容，本实施例中，场景可以包括办公场景、居家场景、室外场景或出行场景中的一种或多种，但是本实施例并不限于列举出来的场景，还可以系统自定义其他场景或者是用户可以根据需求增加其他场景。对于办公场景，该场景对应的样本声音库中的环境声为警报声、爆炸声、建筑坍塌声和广播播报声中的一种或多种，办公场景中不包含汽车鸣笛声，可以避免用户听到不感兴趣的声音，例如，有些用户的办公地点在繁华的街道，如果楼层低，参考麦克风采集的外部语音中可能会包含汽车鸣笛声或者是撞击声，而此时，用户在办公时，是不愿意进入助听模式而听到该汽车鸣笛声或者撞击声的，因此，在办公场景对应的样本声音库中不包含汽车鸣笛声，可以有效提升用户体验。对于室外场景和出行场景，室外场景或出行场景对应的所述样本声音库中的环境声为警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种，用户处于室外场景或出行场景时，接触到的外部声音的种类更多，而需要进入助听模式的情况也就更多，为了保证用户安全，目标样本库中的环境声中需要包括多种类型的样本声音。居家场景对应的样本声音库中的环境声为警报声、爆炸声和建筑坍塌声中的一种或多种。对于居家场景，居家场景对应的样本声音库中的样本声音也可以不包含撞击声、汽车鸣笛声和广播播报声，在家里的时候，如果有人看电视或者玩游戏，也可能听到此类的环境声，而样本声音库中的样本声音不包含这些环境声，以避免用户在不期 望启动助听模式时进入了助听模式，以提升用户体验。本实施例中，还可以包括其他场景，对于其他场景，也可以设置对应的样本声音库中的样本声音。本实施例中，若样本声音库不包含某种样本声音，除了将其不设置在样本声音库中，还可以将该样本声音的优先级设置为最低，例如，可以将该样本声音的权重或者表达优先级的参数设置为零，优先级越低，参数越小，这样即使外部声音包含该样本声音，由于该样本声音的优先级最低或者权重为零，也不会启动助听模式。
本实施例中，该场景也可以包括静止场景或者运动场景中的一种或两种，若识别用户所处的场景为运动场景，则可以设置该场景对应的样本心率库中的样本心率为心率高于200次/分或者低于60次/分的心率信号，若在运动场景下，用户的心率信号属于该场景对应的样本心率库中的样本心率，即高于200次/分或者低于60次/分，则可以开启助听模式，以方便用户呼救时与周围的人沟通。若识别到用户处于静止场景，例如，用户坐在位置上办公或者在家睡觉，则静止场景对应的样本声音库中的样本声音可以为高于120次/分或者低于50次/分，在静止的场景下，若用户的心率信号属于该场景对应的样本心率库中的样本心率，即高于120次/分或者低于50次/分，则可以开启助听模式，以方便用户呼救时与周围的人沟通。
基于上述实施例公开的内容，本实施例中，场景对应的样本声音库中的样本声音中的环境声的优先级高于关键词和声纹信息中的一种或两种的优先级。例如，如果样本声音中包含环境声，则可以设置该环境声的优先级高于关键词或声纹信息，这样设置可以使得用户对身边可能引起危险的声音有足够的关注，例如，当外部声音中包含样本声音库中的汽车鸣笛声和用户姓名时，环境声的优先级更高，由此，进入助听模式后播放外部声音中的汽车鸣笛声，而不是播放用户姓名，以使得用户关注可能引起危险的环境声。若用户处于出行场景，例如在高铁或者飞机上，广播信息的重要程度比较高，则可以设置广播播报声为优先级最高，其次是交谈说话的声音，而汽车鸣笛声发生的可能性也比较小，因此可以设置汽车鸣笛声的优先级最低，甚至可以将其移除出样本声音库；本实施例中，多种环境声的优先级可以相同或不同，本实施对同属于环境声的样本声音的优先级不作限制，系统可以默认同属于环境声的样本声音的优先级，该同属于环境声的样本声音的优先级也可以由用户调整。
基于上述实施例公开的内容，本实施例中，识别用户所处的场景之后，还包括 判断外部声音是否包含场景对应的样本声音库中的样本声音。如图6所示，在步骤S601之后，执行步骤S602：判断外部声音是否包含场景对应的样本声音库中的样本声音。步骤S601与前述实施例中的步骤S201相同或相似，在此处不做赘述。本实施例中，判断外部声音是否包含场景对应的样本声音库中的样本声音时，可以根据实际环境或者用户需求选择判断精度，本实施例对判断精度不做限制。判断外部声音是否包含场景对应的样本声音库中的样本声音采用的技术可以是语音识别或者关键词识别技术，本实施例对此不作限制。当外部声音包含场景对应的样本声音库中的样本声音时，执行步骤S603:进入助听模式，在助听模式下，播放全部或部分外部声音。本实施例中的步骤S603与前述实施例中的步骤S202相同或者近似，本实施例对此不作赘述，当外部声音不包含场景对应的样本声音库中的样本声音时，执行步骤S604：保持降噪模式，以使得用户仍然处于较安静的环境中。
本实施例中，识别用户所处的场景之后，还可以包括判断心率信号是否属于场景对应的样本心率库中的样本心率。如图7所示，在步骤S701之后，执行步骤S702：判断心率信号是否属于场景对应的样本心率库中的样本心率。步骤S701与前述实施例中的步骤S301相同或相似，在此处不做赘述。本实施例中，判断心率信号是否属于场景对应的样本心率库中的样本心率时，可以根据实际环境或者用户需求选择判断精度，本实施例对判断精度不做限制。当心率信号属于场景对应的样本心率库中的样本心率时，执行步骤S703:进入助听模式，在助听模式下，播放全部或部分外部声音。本实施例中的步骤S703与前述实施例中的步骤S302相同或者近似，本实施例对此不作赘述。当心率信号不属于场景对应的样本心率库中的样本心率时，执行步骤S704：保持降噪模式，以使得用户仍然处于较安静的环境中。
基于上述实施例公开的内容，本实施例中，根据样本声音的优先级给样本声音配置权重，样本声音的优先级越高，样本声音的权重越大；
判断外部声音是否包含场景对应的样本声音库中的样本声音包括：
若外部声音包含的样本声音的强度乘以权重的累加和大于预设值，则判断外部声音包含场景对应的样本声音库中的样本声音。
本实施例中，在判断外部声音是否包含场景对应的样本声音库中的样本声音时，还需要考虑到样本声音的优先级，可以给每个优先级配置权重，例如，若样本 声音库中有三个样本声音，优先级最高的可以配置1.0的权重，优先级次之的可以配置0.5的权重，优先级最低的可以配置0.3的权重，该优先级的配置可以由系统默认，即可以默认为初始值，也可以由用户设置或者调整，本实施例对此不作限定。在某些应用场景下，优先级最高的样本声音的强度可能较弱，以至于可能出现判断外部声音不包含场景对应的样本声音库中的样本声音的情况，由此，可能会使得用户错过较重要的信息。例如，在陪护病人时，若设置该病人的声纹信息为样本声音库中优先级最高的，但是由于该病人声音较小，可能其强度超过不能达到预设值，而不能触发进入助听模式，若此时将该样本声音的权重设置为1.5或者2，则该病人的声音的强度乘以该权重可能就会超过预设值，以开启助听模式，或者，将该病人的声纹信息的权重设置为1，将关键词的权重设置为0.5，旁边的人说出了样本声音中的关键词以提醒用户该病人在求助，则该关键词的强度乘以该关键词对应的权重与该病人发出的声音的强度乘以该病人发出的声音对应的权重相加，就可能判断得到外部声音包含场景对应的样本声音库中的样本声音，以使得进入助听模式。本实施例中的累加和指的是外部声音包含的全部所述样本声音的强度乘以对应权重之后加和，本实施例中，优先级最高的也可以配置1.5的权重，优先级次之的可以配置1.0的权重，本实施例对具体的权重数值不作限定。在某些实施例中，当场景对应的样本声音库中仅包含一个样本声音时，也可以对该样本声音设置权重，例如，设置为1.5或者0.5，以调整判断的敏感度，适应不同的用户或者相同的用户在不同场景下的用户需求。
基于上述实施例公开的内容，本实施例中，用于降噪的助听方法还包括建立场景对应的样本声音库或者建立场景对应的样本心率库。本实施例中，可以在耳机出厂前设置默认的场景对应的样本声音库或者场景对应的样本心率库，也可以由用户自己设置。在耳机出厂前设置默认的各个场景对应的样本声音库以及各个场景样本心率库，即耳机出厂前可以对场景和场景对应的样本声音库有一个初始设置，耳机出厂前也可以对场景和场景对应的样本心率库有一个初始设置，另外用户可以在使用的过程中可以对其进行调整。对于用户设置各个场景以及对应的样本声音库的时间不做限制，例如，可以提醒用户在耳机与手机的第一次配对时设置，或者是当识别出用户所处场景时，提醒用户进行场景设置和该场景对应的样本声音库的设置，另外，用户也可以主动在手机的系统或者APP上对场景和场景对应的 样本声音库进行设置。
基于上述实施例公开的内容，本实施例中，建立场景对应的样本声音库包括：根据场景对样本声音库录入样本声音、删除样本声音和调整样本声音的优先级中的一种或多种。本实施例中，场景也可以进行增加或者删除，用户在建立该场景对应的样本声音库时，可以录入样本声音，例如，用户可以输入一段关键词作为一个样本声音，例如，用户可以自定义关键词为老张、小明等称呼，用户也可以录入特定用户的音频以提取声纹信息作为一个样本声音，用户也可以在网上下载各种警报声作为样本声音，本实施例对录入的方式不作限制。本实施例中，删除的样本声音可以保存在已删除样本声音库中，以免日后用户还需要使用这些已经被删除的样本声音，避免了再次录入的麻烦，可以简化操作。本实施例中，若样本声音有设置优先级，则用户可以对该优先级进行调整，例如，可以将排名优先级第一的移动到排名优先级第二，另外，也可以通过设置权重的方式调整优先级，本实施例对调整优先级的具体方式不做限定。
基于上述实施例公开的内容，本实施例中，识别用户所处的场景包括：根据加速度传感器、温度传感器、气压传感器、心率传感器、GPS或者计算机视觉中的一种或多种识别用户所处的场景。以GPS为例进行说明，若用户打开了GPS，则可以方便的识别用户是在居家场景还是办公场景还是室外场景；以温度传感器为例，利用室内外温差可以识别是室外场景还是室内场景；本实施例中，若一种方式并不能精确识别出场景，也可以多种识别方式相结合完成场景识别。
基于上述实施例公开的内容，本实施例中，若进入助听模式，播放全部或部分外部声音时，全部或部分外部声音的播放音量在预设时间段内增加到预设音量值。在助听模式下，若突然播放全部或部分外部声音，可能会使得用户耳膜突然受到刺激，而用户突然听到音量较大的全部或部分外部声音，也会带来较差的用户体验。因此，在进入助听模式时，全部或部分外部声音的播放的音量可以设置为逐渐增大，即在预设时间内，播放音量增加到预设音量值，该预设时间段可以为1s或者更长或者更短，本实施例对预设时间段的长度不作限定，本实施例中，预设音量值可以根据用户需求来设置，例如，可以设置为与外部声音的实际音量相同的大小，或者为了保护用户听力，可以设置为小于外部声音的实际音量的大小，或者为了起到突出强调作用，可以设置为大于外部声音的实际音量大小。本实施例对此不作限定。
基于上述实施例公开的内容，本实施例中，在助听模式下，保持降噪模式的降噪强度或者降噪模式的降噪强度降低；在所述降噪模式下，使用主动降噪技术以抵消所述外部声音。本实施例中，当进入助听模式时，降噪模式依然开启，该降噪模式下的降噪强度可以不变或者降低。降噪模式下的降噪强度降低可以理解为耳内播放的与外部声音相位相反的信号的音量降低。
本申请实施例还可提供一种用于降噪的助听装置，用于执行前述实施例中提出的用于降噪的助听方法，图8为本实施例提供的一种用于降噪的助听装置的结构示意图，用于降噪的助听装置80包括：
场景识别模块81，用于识别用户所处的场景；
助听模块82，若检测数据包含场景对应的样本数据库中的样本数据，用于进入助听模式；
播放模块83，在助听模式下，用于播放全部或部分外部声音，外部声音由参考麦克风采集。
可选的，检测数据为外部声音，样本数据库为样本声音库，样本数据为样本声音；或者检测数据为心率信号，样本数据库为样本心率库，样本数据为样本心率。
可选的，不同的场景对应的样本声音库不同；或者，不同的场景对应的样本心率库不同。
可选的，请参考图8A，用于降噪的助听装置80还包括优先级配置模块84，用于给样本声音库中的样本声音配置优先级；不同的场景对应的样本声音库中的样本声音的优先级不同。
可选的，播放模块播放部分外部声音时，播放外部声音中的与样本声音对应的目标声音。
可选的，请参考图8B，用于降噪的助听装置80还包括分离模块85和增强模块86；
分离模块85和增强模块86与播放模块83连接；
分离模块85用于从外部声音中分离样本声音对应的目标声音；
增强模块86用于增大目标声音的增益。
可选的，若外部声音包含场景对应的样本声音库中的多个样本声音，播放模块83播放外部声音中的与样本声音对应的目标声音时，播放与多个样本声音中的一 个样本声音对应的目标声音。
可选的，播放模块83播放与多个外部声音中的一个样本声音对应的目标声音时，若外部声音包含场景对应的样本声音库中的第一样本声音和第二样本声音，则播放模块83根据第一样本声音和第二样本声音的优先级，选择第一样本声音对应的目标声音进行播放；第一样本声音的优先级高于第二样本声音的优先级。
可选的，样本声音包括环境声、关键词和声纹信息中的一种或多种，关键词包括人物称谓或打招呼惯用语中的一种或两种；
环境声包括：警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种。
可选的，场景包括办公场景、居家场景、室外场景和出行场景中的一种或多种，或者场景包括静止场景或运动场景中的一种或两种；
办公场景对应的样本声音库中的环境声为警报声、爆炸声、建筑坍塌声和广播播报声中的一种或多种；
室外场景和出行场景对应的样本声音库中的环境声为警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种；
居家场景对应的样本声音库中的环境声为警报声、爆炸声和建筑坍塌声中的一种或多种；
运动场景对应的样本心率库中的样本心率为高于200次/分或者低于60次/分的心率信号；
静止场景对应的样本心率库中的样本心率为高于120次/分或者低于50次/分的心率信号。
可选的，优先级配置模块还用于设置场景对应的样本声音库中的样本声音中的环境声的优先级高于关键词和声纹信息中的一种或两种的优先级。
可选的，请参考图8C，用于降噪的助听装置80还包括判断模块87；
判断模块87与场景识别模块81连接；
判断模块87用于判断外部声音是否包含场景对应的样本声音库中的样本声音，或者用于判断心率信号是否属于场景对应的样本心率库中的样本心率。
可选的，优先级配置模块还用于根据样本声音的优先级给样本声音配置权重，样本声音的优先级越高，样本声音的权重越大；
若外部声音包含的样本声音的强度乘以权重的累加和大于预设值，则判断模块判断外部声音包含场景对应的样本声音库中的样本声音。
可选的，请参考图8D，用于降噪的助听装置80还包括建库模块88，用于建立场景对应的样本声音库或者用于建立场景对应的样本心率库；
建库模块88还包括录入模块、删除模块或者调整模块中的一个或多个；
录入模块、删除模块和调整模块分别根据场景对样本声音库录入样本声音、删除样本声音和调整样本声音的优先级，或者
录入模块、删除模块分别用于根据场景对样本心率库录入样本心率或者删除样本心率。
可选的，播放模块播放的全部或部分外部声音的播放音量在预设时间段内增加到预设音量值。
可选的，请参考图8E，用于降噪的助听装置80还包括降噪模块89，在助听模式下，降噪模块89用于保持降噪模式的降噪强度或者降噪模式的降噪强度降低；在降噪模式下，降噪模块89还用于使用主动降噪技术以抵消外部声音。
申请实施例提供了一种用于降噪的助听装置，通过识别用户所处的场景，若检测数据包含场景对应的样本数据库中的样本数据，则进入助听模式，以适应用户所处的场景改变的情况，也提升了用户体验。
本申请实施例还可提供一种芯片，用于执行上述实施例提出的一种用于降噪的助听方法；如图9所示，芯片90包括存储器91和处理器92；
存储器91与处理器92耦合；
存储器91，用于存储程序指令；
处理器92，用于调用存储器存储的程序指令，使得芯片执行上述任一实施例提出的用于降噪的助听方法。
本申请实施例提供的芯片其具体的实现过程及有益效果参见上述，在此不再赘述。
本申请实施例还可提供一种耳机，包括上述任一所述实施例提供的芯片，其具体的实现过程及有益效果参见上述，在此不再赘述。请参考图10，本实施例中，耳机外部有一个参考麦克风ref，其采集的数据一路用于主动降噪模块10做主动降噪处理，另一路传到目标声音提取模块12进行信号处理，处理以后送入到音乐 播放模块13，通过音乐通道在耳机内部扬声器播放出来，其中控制中心11用于控制各个模块实现上述实施例提到的用于降噪的助听方法，控制中心11可以控制各个模块的开关以及参数调整，例如，选择或者调节主动降噪模块10的降噪方法或者滤波器参数。本实施例以控制中心在耳机端为例进行说明，但是该控制中心11可在耳机端，也可以在手机端。本实施例中，目标声音提取模块12通过信号分离、滤波、语音增强等技术完成目标声音的提取工作，并将目标声音传输到音乐播放模块，使得目标声音与音乐同时播放，若此时音乐未播放，也可以仅播放外部声音，本实施例中，目标声音可以理解为待播放的外部声音，即前述实施例中的全部或部分外部声音，也可以是外部声音中的与样本声音对应的目标声音。主动降噪模块可使用前馈(Feedforward，FF)、反馈(Feedback，FB)、混合(Hybird)结构。音乐播放模块13主要用于传输手机发送的音频信号。本实施例中，耳机还可以有误差麦克风error，误差麦克风和扬声器均在耳内环境中。本申请实施例还可提供一种计算机可读存储介质，包括：其上存储有计算机程序，该计算机程序被处理器执行时实现上述实施例中任一项的用于降噪的助听方法，其具体的实现过程及有益效果参见上述，在此不再赘述。
应注意，本申请上述方法实施例可以应用于处理器中，或者由处理器实现。处理器可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器可以是通用处理器、数字信号处理器(digital signal processor，DSP)、专用集成电路(application specific integrated circuit，ASIC)、现成可编程门阵列(field programmable gate array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器，处理器读取存储器中的信息，结合其硬件完成上述方法的步骤。
可以理解，本申请实施例中的存储器可以是易失性存储器或非易失性存储器， 或可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(read-only memory，ROM)、可编程只读存储器(programmable rom，PROM)、可擦除可编程只读存储器(erasable PROM，EPROM)、电可擦除可编程只读存储器(electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(static RAM，SRAM)、动态随机存取存储器(dynamic RAM，DRAM)、同步动态随机存取存储器(synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM，DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM，SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM，DR RAM)。应注意，本文描述的系统和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。
应理解，在本申请实施例中，“与A相应的B”表示B与A相关联，根据A可以确定B。但还应理解，根据A确定B并不意味着仅仅根据A确定B，还可以根据A和/或其它信息确定B。
另外，本文中术语“和/或”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如， 所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read-only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (35)

  1. 一种用于降噪的助听方法，其特征在于，包括：
    识别用户所处的场景；
    若检测数据包含所述场景对应的样本数据库中的样本数据，则进入助听模式，在所述助听模式下，播放全部或部分外部声音，所述外部声音由参考麦克风采集。
  2. 根据权利要求1所述的用于降噪的助听方法，其特征在于，所述检测数据为所述外部声音，所述样本数据库为样本声音库，所述样本数据为样本声音；或者
    所述检测数据为心率信号，所述样本数据库为样本心率库，所述样本数据为样本心率。
  3. 根据权利要求2所述的用于降噪的助听方法，其特征在于，不同的所述场景对应的所述样本声音库不同；或者，不同的所述场景对应的所述样本心率库不同。
  4. 根据权利要求2或3所述的用于降噪的助听方法，其特征在于，所述样本声音库中的所述样本声音配置有优先级；
    不同的所述场景对应的所述样本声音库中的所述样本声音的优先级不同。
  5. 根据权利要求4所述的降噪的助听方法，其特征在于，所述播放部分所述外部声音包括：
    播放所述外部声音中的与所述样本声音对应的目标声音。
  6. 根据权利要求5所述的降噪的助听方法，其特征在于，所述播放所述外部声音中的与所述样本声音对应的目标声音之前，还包括：
    从所述外部声音中分离所述样本声音对应的所述目标声音；
    增大所述目标声音的增益。
  7. 根据权利要求5或6所述的降噪的助听方法，其特征在于，若所述外部声音包含所述场景对应的所述样本声音库中的多个所述样本声音，所述播放所述外部声音中的与所述样本声音对应的目标声音包括：
    播放与多个所述样本声音中的一个所述样本声音对应的所述目标声音。
  8. 根据权利要求7所述的用于降噪的助听方法，其特征在于，所述播放与多个所述外部声音中的一个所述样本声音对应的所述目标声音包括：
    若所述外部声音包含所述场景对应的所述样本声音库中的第一样本声音和第二样本声音，则根据所述第一样本声音和所述第二样本声音的所述优先级，选择所 述第一样本声音对应的所述目标声音进行播放；所述第一样本声音的优先级高于所述第二样本声音的优先级。
  9. 根据权利要求4至8中任一项所述的用于降噪的助听方法，其特征在于，所述样本声音包括环境声、关键词和声纹信息中的一种或多种，所述关键词包括人物称谓或打招呼惯用语中的一种或两种；
    所述环境声包括：警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种。
  10. 根据权利要求9所述的用于降噪的助听方法，其特征在于，所述场景包括办公场景、居家场景、室外场景和出行场景中的一种或多种，或者所述场景包括静止场景或运动场景中的一种或两种；
    所述办公场景对应的所述样本声音库中的所述环境声为所述警报声、所述爆炸声、所述建筑坍塌声和所述广播播报声中的一种或多种；
    所述室外场景和所述出行场景对应的所述样本声音库中的所述环境声为所述警报声、所述撞击声、所述爆炸声、所述建筑坍塌声、所述汽车鸣笛声和所述广播播报声中的一种或多种；
    所述居家场景对应的所述样本声音库中的所述环境声为所述警报声、所述爆炸声和所述建筑坍塌声中的一种或多种；
    所述运动场景对应的所述样本心率库中的样本心率为高于200次/分或者低于60次/分的心率信号；
    所述静止场景对应的所述样本心率库中的样本心率为高于120次/分或者低于50次/分的心率信号。
  11. 根据权利要求9或10所述的用于降噪的助听方法，其特征在于，所述场景对应的所述样本声音库中的所述样本声音中的所述环境声的所述优先级高于所述关键词和所述声纹信息中的一种或两种的所述优先级。
  12. 根据权利要求4至11中任一项所述的用于降噪的助听方法，其特征在于，所述识别用户所处的场景之后，还包括判断所述外部声音是否包含所述场景对应的所述样本声音库中的样本声音，或者判断所述心率信号是否属于所述场景对应的所述样本心率库中的所述样本心率。
  13. 根据权利要求12所述的用于降噪的助听方法，其特征在于，根据所述样 本声音的优先级给样本声音配置权重，所述样本声音的优先级越高，所述样本声音的权重越大；
    所述判断所述外部声音是否包含所述场景对应的所述样本声音库中的样本声音包括：
    若所述外部声音包含的所述样本声音的强度乘以所述权重的累加和大于预设值，则判断所述外部声音包含所述场景对应的所述样本声音库中的所述样本声音。
  14. 根据权利要求4至13中任一项所述的用于降噪的助听方法，其特征在于，还包括建立所述场景对应的所述样本声音库或者建立所述场景对应的所述样本心率库；
    所述建立所述场景对应的所述样本声音库包括：
    根据所述场景对所述样本声音库录入所述样本声音、删除所述样本声音和调整所述样本声音的所述优先级中的一种或多种；
    所述建立所述场景对应的所述样本心率库包括：
    根据所述场景对所述样本心率库录入所述样本心率或者删除所述样本心率。
  15. 根据权利要求1至14中任一项所述的用于降噪的助听方法，其特征在于，包括：
    若进入所述助听模式，播放全部或部分所述外部声音时，所述全部或部分所述外部声音的播放音量在预设时间段内增加到预设音量值。
  16. 根据权利要求1至15中任一项所述的用于降噪的助听方法，其特征在于，在所述助听模式下，保持降噪模式的降噪强度或者所述降噪模式的降噪强度降低；在所述降噪模式下，使用主动降噪技术以抵消所述外部声音。
  17. 一种用于降噪的助听装置，其特征在于，包括：
    场景识别模块，用于识别用户所处的场景；
    助听模块，若检测数据包含所述场景对应的样本数据库中的样本数据，用于进入助听模式；
    播放模块，在所述助听模式下，用于播放全部或部分外部声音，所述外部声音由参考麦克风采集。
  18. 根据权利要求17所述的用于降噪的助听装置，其特征在于，所述检测数据为所述外部声音，所述样本数据库为样本声音库，所述样本数据为样本声音；或 者
    所述检测数据为心率信号，所述样本数据库为样本心率库，所述样本数据为样本心率。
  19. 根据权利要求18所述的用于降噪的助听装置，其特征在于，不同的所述场景对应的所述样本声音库不同；或者，不同的所述场景对应的所述样本心率库不同。
  20. 根据权利要求18或19所述的用于降噪的助听装置，其特征在于，还包括优先级配置模块，用于给所述样本声音库中的所述样本声音配置优先级；不同的所述场景对应的所述样本声音库中的所述样本声音的优先级不同。
  21. 根据权利要求20所述的用于降噪的助听装置，其特征在于，所述播放模块播放部分所述外部声音时，播放所述外部声音中的与所述样本声音对应的目标声音。
  22. 根据权利要求21所述的用于降噪的助听装置，其特征在于，还包括分离模块和增强模块；
    所述分离模块和所述增强模块与所述播放模块连接；
    所述分离模块用于从所述外部声音中分离所述样本声音对应的所述目标声音；
    所述增强模块用于增大所述目标声音的增益。
  23. 根据权利要求21或22所述的用于降噪的助听装置，其特征在于，若所述外部声音包含所述场景对应的所述样本声音库中的多个所述样本声音，所述播放模块播放所述外部声音中的与所述样本声音对应的目标声音时，播放与多个所述样本声音中的一个所述样本声音对应的所述目标声音。
  24. 根据权利要求23所述的用于降噪的助听装置，其特征在于，所述播放模块播放与多个所述外部声音中的一个所述样本声音对应的所述目标声音时，若所述外部声音包含所述场景对应的所述样本声音库中的第一样本声音和第二样本声音，则所述播放模块根据所述第一样本声音和所述第二样本声音的所述优先级，选择所述第一样本声音对应的所述目标声音进行播放；所述第一样本声音的优先级高于所述第二样本声音的优先级。
  25. 根据权利要求20至24中任一项所述的用于降噪的助听装置，其特征在于，所述样本声音包括环境声、关键词和声纹信息中的一种或多种，所述关键词包 括人物称谓或打招呼惯用语中的一种或两种；
    所述环境声包括：警报声、撞击声、爆炸声、建筑坍塌声、汽车鸣笛声和广播播报声中的一种或多种。
  26. 根据权利要求25所述的用于降噪的助听装置，其特征在于，所述场景包括办公场景、居家场景、室外场景和出行场景中的一种或多种，或者所述场景包括静止场景或运动场景中的一种或两种；
    所述办公场景对应的所述样本声音库中的所述环境声为所述警报声、所述爆炸声、所述建筑坍塌声和所述广播播报声中的一种或多种；
    所述室外场景和所述出行场景对应的所述样本声音库中的所述环境声为所述警报声、所述撞击声、所述爆炸声、所述建筑坍塌声、所述汽车鸣笛声和所述广播播报声中的一种或多种；
    所述居家场景对应的所述样本声音库中的所述环境声为所述警报声、所述爆炸声和所述建筑坍塌声中的一种或多种；
    所述运动场景对应的所述样本心率库中的样本心率为高于200次/分或者低于60次/分的心率信号；
    所述静止场景对应的所述样本心率库中的样本心率为高于120次/分或者低于50次/分的心率信号。
  27. 根据权利要求25至26中任一项所述的用于降噪的助听装置，其特征在于，所述优先级配置模块还用于设置所述场景对应的所述样本声音库中的所述样本声音中的所述环境声的所述优先级高于所述关键词和所述声纹信息中的一种或两种的所述优先级。
  28. 根据权利要求20至27中任一项所述的用于降噪的助听装置，其特征在于，还包括判断模块；
    所述判断模块与所述场景识别模块连接；
    所述判断模块用于判断所述外部声音是否包含所述场景对应的所述样本声音库中的样本声音，或者用于判断所述心率信号是否属于所述场景对应的所述样本心率库中的所述样本心率。
  29. 根据权利要求28所述的用于降噪的助听装置，其特征在于，所述优先级配置模块还用于根据所述样本声音的优先级给样本声音配置权重，所述样本声音 的优先级越高，所述样本声音的权重越大；
    若所述外部声音包含的所述样本声音的强度乘以所述权重的累加和大于预设值，则所述判断模块判断所述外部声音包含所述场景对应的所述样本声音库中的所述样本声音。
  30. 根据权利要求20至29所述的用于降噪的助听装置，其特征在于，还包括建库模块，用于建立所述场景对应的所述样本声音库或者用于建立所述场景对应的所述样本心率库；
    所述建库模块还包括录入模块、删除模块或者调整模块中的一个或多个；
    所述录入模块、所述删除模块和所述调整模块分别根据所述场景对所述样本声音库录入所述样本声音、删除所述样本声音和调整所述样本声音的所述优先级中，或者
    所述录入模块、所述删除模块分别用于根据所述场景对所述样本心率库录入所述样本心率或者删除所述样本心率。
  31. 根据权利要求17至30所述的用于降噪的助听装置，其特征在于，所述播放模块播放的所述全部或部分所述外部声音的播放音量在预设时间段内增加到预设音量值。
  32. 根据权利要求17至31所述的用于降噪的助听装置，其特征在于，还包括降噪模块，在所述助听模式下，所述降噪模块用于保持降噪模式的降噪强度或者所述降噪模式的降噪强度降低；在所述降噪模式下，所述降噪模块还用于使用主动降噪技术以抵消所述外部声音。
  33. 一种芯片，用于实现用于降噪的助听方法，其特征在于，包括存储器和处理器；
    所述存储器与所述处理器耦合；
    所述存储器，用于存储程序指令；
    所述处理器，用于调用所述存储器存储的程序指令，使得所述芯片执行上述权利要求1至16中任一项所述的用于降噪的助听方法。
  34. 一种耳机，其特征在于，包括如权利要求33所述的芯片。
  35. 一种计算机可读存储介质，其特征在于，包括：其上存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现上述权利要求1至16中任一项 所述的用于降噪的助听方法。
PCT/CN2020/075014 2020-02-13 2020-02-13 一种用于降噪的助听方法、装置、芯片、耳机及存储介质 WO2021159369A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202080001642.7A CN111886878A (zh) 2020-02-13 2020-02-13 一种用于降噪的助听方法、装置、芯片、耳机及存储介质
PCT/CN2020/075014 WO2021159369A1 (zh) 2020-02-13 2020-02-13 一种用于降噪的助听方法、装置、芯片、耳机及存储介质
US17/709,893 US20220225035A1 (en) 2020-02-13 2022-03-31 Hearing aid method and apparatus for noise reduction, chip, headphone and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/075014 WO2021159369A1 (zh) 2020-02-13 2020-02-13 一种用于降噪的助听方法、装置、芯片、耳机及存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/709,893 Continuation US20220225035A1 (en) 2020-02-13 2022-03-31 Hearing aid method and apparatus for noise reduction, chip, headphone and storage medium

Publications (1)

Publication Number Publication Date
WO2021159369A1 true WO2021159369A1 (zh) 2021-08-19

Family

ID=73199302

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/075014 WO2021159369A1 (zh) 2020-02-13 2020-02-13 一种用于降噪的助听方法、装置、芯片、耳机及存储介质

Country Status (3)

Country Link
US (1) US20220225035A1 (zh)
CN (1) CN111886878A (zh)
WO (1) WO2021159369A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220201407A1 (en) * 2020-12-21 2022-06-23 Sonova Ag Wireless Personal Communication via a Hearing Device

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114666695A (zh) * 2020-12-22 2022-06-24 华为技术有限公司 一种主动降噪的方法、设备及系统
CN112770214B (zh) * 2021-01-28 2022-11-11 歌尔科技有限公司 耳机的控制方法、装置及耳机
CN113724682A (zh) * 2021-09-10 2021-11-30 朝阳聚声泰（信丰）科技有限公司 一种汽车降噪结构及降噪方法
CN115312067B (zh) * 2022-10-12 2022-12-27 深圳市婕妤达电子有限公司 基于人声的声音信号识别方法、装置及存储介质

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103825993A (zh) * 2014-03-11 2014-05-28 宇龙计算机通信科技(深圳)有限公司 一种通话时环境声音的处理方法及装置
CN105100356A (zh) * 2015-07-07 2015-11-25 上海斐讯数据通信技术有限公司 一种音量自动调节的方法和系统
CN105225662A (zh) * 2015-08-24 2016-01-06 深圳市冠旭电子有限公司 智能蓝牙耳机自动播放外部语音的方法及智能蓝牙耳机
CN106550147A (zh) * 2016-10-28 2017-03-29 努比亚技术有限公司 一种语音播报提醒装置及其方法
CN106601272A (zh) * 2016-11-24 2017-04-26 歌尔股份有限公司 耳机及其语音识别方法
CN108777827A (zh) * 2018-06-14 2018-11-09 Oppo广东移动通信有限公司 无线耳机、音量调整方法及相关产品
CN109257498A (zh) * 2018-09-29 2019-01-22 维沃移动通信有限公司 一种声音处理方法及移动终端
CN109493884A (zh) * 2018-12-06 2019-03-19 江苏满运软件科技有限公司 一种外部声源安全提醒方法、系统、设备以及介质
CN110708630A (zh) * 2019-11-12 2020-01-17 广州酷狗计算机科技有限公司 控制耳机的方法、装置、设备及存储介质
CN111028834A (zh) * 2019-10-30 2020-04-17 支付宝(杭州)信息技术有限公司 语音信息提醒方法、装置、服务器和语音信息提醒设备

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8155340B2 (en) * 2008-07-24 2012-04-10 Qualcomm Incorporated Method and apparatus for rendering ambient signals
CN102915753B (zh) * 2012-10-23 2015-09-30 华为终端有限公司 一种电子设备的智能控制音量的方法及实现装置
US9390599B2 (en) * 2014-05-19 2016-07-12 Microsoft Technology Licensing, Llc Noise-sensitive alert presentation
US10497353B2 (en) * 2014-11-05 2019-12-03 Voyetra Turtle Beach, Inc. Headset with user configurable noise cancellation vs ambient noise pickup
CN105759948A (zh) * 2014-12-18 2016-07-13 联想(北京)有限公司 一种信息处理方法及电子设备
CN105205955B (zh) * 2015-09-25 2018-07-31 小米科技有限责任公司 一种发出提示信号的方法和装置
CN108605073B (zh) * 2016-09-08 2021-01-05 华为技术有限公司 声音信号处理的方法、终端和耳机
CN106445459A (zh) * 2016-10-12 2017-02-22 深圳市金立通信设备有限公司 一种控制耳机播放音频的方法及终端
CN109154979A (zh) * 2016-10-26 2019-01-04 奥康科技有限公司 用于分析图像和提供反馈的可佩戴设备和方法
CN108021349A (zh) * 2016-10-28 2018-05-11 中兴通讯股份有限公司 调整耳机工作状态的方法、装置、耳机及智能终端

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103825993A (zh) * 2014-03-11 2014-05-28 宇龙计算机通信科技(深圳)有限公司 一种通话时环境声音的处理方法及装置
CN105100356A (zh) * 2015-07-07 2015-11-25 上海斐讯数据通信技术有限公司 一种音量自动调节的方法和系统
CN105225662A (zh) * 2015-08-24 2016-01-06 深圳市冠旭电子有限公司 智能蓝牙耳机自动播放外部语音的方法及智能蓝牙耳机
CN106550147A (zh) * 2016-10-28 2017-03-29 努比亚技术有限公司 一种语音播报提醒装置及其方法
CN106601272A (zh) * 2016-11-24 2017-04-26 歌尔股份有限公司 耳机及其语音识别方法
CN108777827A (zh) * 2018-06-14 2018-11-09 Oppo广东移动通信有限公司 无线耳机、音量调整方法及相关产品
CN109257498A (zh) * 2018-09-29 2019-01-22 维沃移动通信有限公司 一种声音处理方法及移动终端
CN109493884A (zh) * 2018-12-06 2019-03-19 江苏满运软件科技有限公司 一种外部声源安全提醒方法、系统、设备以及介质
CN111028834A (zh) * 2019-10-30 2020-04-17 支付宝(杭州)信息技术有限公司 语音信息提醒方法、装置、服务器和语音信息提醒设备
CN110708630A (zh) * 2019-11-12 2020-01-17 广州酷狗计算机科技有限公司 控制耳机的方法、装置、设备及存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220201407A1 (en) * 2020-12-21 2022-06-23 Sonova Ag Wireless Personal Communication via a Hearing Device
US11736873B2 (en) * 2020-12-21 2023-08-22 Sonova Ag Wireless personal communication via a hearing device

Also Published As

Publication number Publication date
US20220225035A1 (en) 2022-07-14
CN111886878A (zh) 2020-11-03

Similar Documents

Publication Publication Date Title
WO2021159369A1 (zh) 一种用于降噪的助听方法、装置、芯片、耳机及存储介质
EP3081011B1 (en) Name-sensitive listening device
US10521512B2 (en) Dynamic text-to-speech response from a smart speaker
US10817251B2 (en) Dynamic capability demonstration in wearable audio device
US9344815B2 (en) Method for augmenting hearing
US10129624B2 (en) Method and device for voice operated control
EP1646265B1 (en) Sound playback headphone
US9509269B1 (en) Ambient sound responsive media player
CN110602594A (zh) 具体环境声音提醒模式的耳机装置
US11039240B2 (en) Adaptive headphone system
CN106170108B (zh) 具有分贝提醒模式的耳机装置
CN110636402A (zh) 具有本地通话情况确认模式的耳机装置
JP7167910B2 (ja) 情報処理装置、情報処理方法、およびプログラム
US11228828B2 (en) Alerting users to events
US20220122605A1 (en) Method and device for voice operated control
CN115804105A (zh) 用于声学透明度的系统、装置和方法
CN113038337B (zh) 一种音频播放方法、无线耳机和计算机可读存储介质
WO2015030642A1 (en) Volume reduction for an electronic device
US20210099787A1 (en) Headphones providing fully natural interfaces
US20230305797A1 (en) Audio Output Modification

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20919081

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20919081

Country of ref document: EP

Kind code of ref document: A1