CN111148271B - Method and terminal for controlling hearing aid - Google Patents

Method and terminal for controlling hearing aid Download PDF

Info

Publication number
CN111148271B
CN111148271B CN201811636396.3A CN201811636396A CN111148271B CN 111148271 B CN111148271 B CN 111148271B CN 201811636396 A CN201811636396 A CN 201811636396A CN 111148271 B CN111148271 B CN 111148271B
Authority
CN
China
Prior art keywords
hearing aid
parameter configuration
terminal
sound
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811636396.3A
Other languages
Chinese (zh)
Other versions
CN111148271A (en
Inventor
董金光
刘超
黄一炜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Device Co Ltd
Original Assignee
Huawei Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Device Co Ltd filed Critical Huawei Device Co Ltd
Priority to PCT/CN2019/114933 priority Critical patent/WO2020093937A1/en
Publication of CN111148271A publication Critical patent/CN111148271A/en
Application granted granted Critical
Publication of CN111148271B publication Critical patent/CN111148271B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725Cordless telephones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception

Abstract

The embodiment of the application provides a method and a terminal for controlling a hearing aid, wherein the method comprises the following steps: the terminal establishes a wireless communication link with the hearing aid; the terminal collects environmental data; and the terminal generates a parameter configuration instruction according to the environment data and sends the parameter configuration instruction to the hearing aid. The use scene of the hearing aid is judged according to the environment data, personalized setting of the hearing aid can be achieved, and the hearing requirement of a user is met.

Description

Method and terminal for controlling hearing aid
The present application claims priority from chinese patent office, application number 201811308958.1, chinese patent application entitled "a method and apparatus for controlling hearing aid mode", filed on 11.05 2018, the entire contents of which are incorporated herein by reference.
Technical Field
The present application relates to the field of terminal technologies, and in particular, to a method for controlling a hearing aid and a terminal.
Background
The hearing impaired people in the current society grow year by year, except for the natural hearing impaired people, the hearing of the old people is reduced to different degrees after the old people reach a certain age, and the hearing of the young people is impaired due to entertainment noise. A study report from John Hopkins university shows that 1/5 of the Americans aged 12 years and older have hearing impairment that severely affects life-related communications. For the hearing impaired people, wearing the hearing aid or equipping the terminal device supporting the hearing aid mode can facilitate daily communication and effectively improve the life quality. The Federal Communications Commission (FCC) has placed requirements for compatibility (HAC) of wireless devices and hearing aids, requiring wireless service providers and mobile wireless device manufacturers to provide handsets compatible with hearing aids; some existing terminal devices can be connected with a hearing aid in a Bluetooth mode, so that a hearing-impaired person can perform operations such as voice communication or music listening.
Currently, the parameters of hearing aids are adjusted by a professional physician according to the hearing situation of the wearer, or in a specific application by means of a bluetooth connection. These modes of regulation have the following problems: 1. parameter adjustment depends on experienced persons and specific applications, and the cost is high and not convenient enough; 2. readjustment is required after replacement of a new hearing aid, which is time-consuming; 3. the adjusted parameters cannot be flexibly changed.
Disclosure of Invention
In view of this, the embodiments of the present application provide a method and a terminal for controlling a hearing aid, which can conveniently, flexibly and intelligently adjust parameters of the hearing aid, so that the hearing aid is more suitable for the hearing demand of a user.
In a first aspect, embodiments of the present application provide a method of controlling a hearing aid, the method comprising: the terminal establishes a wireless communication link with the hearing aid; the terminal collects environmental data; and the terminal generates a parameter configuration instruction according to the environment data and sends the parameter configuration instruction to the hearing aid. In this way, the configuration of the terminal to the parameters of the hearing aid can be achieved by means of wireless communication.
In one possible implementation, the wireless communication link includes one of the following wireless connections: bluetooth, NFC, or WiFi. Of course, other wireless connection methods are also possible, such as ZigBee. The wireless connection mode is more convenient than the wired connection mode.
In one possible implementation, the environmental data may include one or more of the following: user sound, ambient noise, user action data, setup data, or user usage habits.
In one possible implementation, the terminal may periodically update the collected environmental data. This can keep the environment data in a state up to date.
In one possible implementation, the terminal may re-acquire the environmental data when the terminal detects a change in the environmental data. This can keep the environment data in a state up to date.
In one possible implementation, the terminal may upload the collected environmental data to a server for analysis.
In one possible implementation, the parameter configuration instructions comprise configuration instructions for one or more of the following hearing aid parameters: volume, noise reduction, gains of different sound bands, or gains of left and right channels.
In one possible implementation manner, the terminal generates a parameter configuration instruction according to the environment data, including: and when the user sound collected by the terminal is lower than a preset first sound threshold value, generating a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation manner, the terminal generates a parameter configuration instruction according to the environment data, including: and when the environmental noise collected by the terminal is higher than a preset second sound threshold value, generating a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation manner, the terminal generates a parameter configuration instruction according to the environment data, including: and when the environmental noise acquired by the terminal is higher than a preset second sound threshold value, generating a parameter configuration instruction for enhancing the noise reduction effect of the hearing aid.
In one possible implementation manner, the terminal generates a parameter configuration instruction according to the environment data, including: and when the user heartbeat value acquired by the terminal is higher than a preset third heartbeat threshold value, generating a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation manner, the terminal generates a parameter configuration instruction according to the environment data, including: and when the user historical listening data collected by the terminal, generating a parameter configuration instruction for setting the hearing aid volume as the historical average volume.
In one possible implementation manner, the terminal generates a parameter configuration instruction according to the environment data, including: and generating a parameter configuration instruction for setting the gain of each sound frequency band of the hearing aid to be a historical average gain value according to the historical listening data of the user acquired by the terminal.
In one possible implementation manner, the terminal generates a parameter configuration instruction according to the environment data, including: when the terminal detects that the face of the user turns in the first direction, a parameter configuration instruction is generated that increases the sound gain of the hearing aid in the first direction.
In one possible implementation manner, the terminal generates a parameter configuration instruction according to the environment data, including: when the terminal detects that the sound source is located in the second direction, a parameter configuration instruction for increasing the sound gain of the hearing aid in the second direction is generated.
In one possible implementation, the terminal obtains the right to change the settings of the hearing aid before sending the parameter configuration instructions to the hearing aid.
In a second aspect, an embodiment of the present application provides a terminal, including a connection unit, a data acquisition unit, an instruction generation unit, and an instruction transmission unit. Wherein the connection unit is used for establishing a wireless communication link between the hearing aid and the connection unit; the data acquisition unit is used for acquiring environmental data; the instruction generation unit is used for generating a parameter configuration instruction according to the environment data; and the instruction sending unit is used for sending the parameter configuration instruction to the hearing aid. In this way, the configuration of the terminal to the parameters of the hearing aid can be achieved by means of wireless communication.
In one possible implementation, the wireless communication link includes one of the following wireless connections: bluetooth, NFC, or WiFi. Of course, other wireless connection methods are also possible, such as ZigBee. The wireless connection mode is more convenient than the wired connection mode.
In one possible implementation, the environmental data may include one or more of the following: user sound, ambient noise, user action data, setup data, or user usage habits.
In one possible implementation, the data acquisition unit may periodically update the acquired environmental data. This can keep the environment data in a state up to date.
In one possible implementation, the data acquisition unit re-acquires the environmental data when the data acquisition unit detects a change in the environmental data. This can keep the environment data in a state up to date.
In one possible implementation, the terminal may upload the collected environmental data to a server for analysis.
In one possible implementation, the parameter configuration instructions comprise configuration instructions for one or more of the following hearing aid parameters: volume, noise reduction, gains of different sound bands, or gains of left and right channels.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the user sound collected by the data collection unit is lower than a preset first sound threshold value, the instruction generation unit generates a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the environmental noise acquired by the data acquisition unit is higher than a preset second sound threshold value, the instruction generation unit generates a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the environmental noise acquired by the data acquisition unit is higher than a preset second sound threshold value, the instruction generation unit generates a parameter configuration instruction for enhancing the noise reduction effect of the hearing aid.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the heartbeat value of the user acquired by the data acquisition unit is higher than a preset third heartbeat threshold value, the instruction generation unit generates a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: according to the user historical listening data acquired by the data acquisition unit, the instruction generation unit generates a parameter configuration instruction for setting the hearing aid volume as the historical average volume.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: according to the user historical listening data acquired by the data acquisition unit, the instruction generation unit generates a parameter configuration instruction for setting the gain of each sound frequency band of the hearing aid to a historical average gain value.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the data acquisition unit detects that the face of the user turns to the first direction, the instruction generation unit generates a parameter configuration instruction that increases the sound gain of the hearing aid in the first direction.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the data acquisition unit detects that the sound source is located in the second direction, the instruction generation unit generates a parameter configuration instruction that increases the sound gain of the hearing aid in the second direction.
In one possible implementation, the terminal obtains the right to change the settings of the hearing aid before sending the parameter configuration instructions to the hearing aid.
In a third aspect, embodiments of the present application provide a terminal, including a processor, a sensor, and a wireless communication device, where the wireless communication device is configured to establish a wireless communication link with a hearing aid; the sensor is used for collecting environmental data; the processor is used for generating parameter configuration instructions according to the environment data; the wireless communication device is further adapted to send parameter configuration instructions to the hearing aid. In this way, the configuration of the terminal to the parameters of the hearing aid can be achieved by means of wireless communication.
In one possible implementation, the wireless communication link includes one of the following wireless connections: bluetooth, NFC, or WiFi. Of course, other wireless connection methods are also possible, such as ZigBee. The wireless connection mode is more convenient than the wired connection mode.
In one possible implementation, the environmental data may include one or more of the following: user sound, ambient noise, user action data, setup data, or user usage habits.
In one possible implementation, the sensor may periodically update the collected environmental data. This can keep the environment data in a state up to date.
In one possible implementation, the sensor re-collects the environmental data when the sensor detects a change in the environmental data. This can keep the environment data in a state up to date.
In one possible implementation, the terminal may upload the collected environmental data to a server for analysis.
In one possible implementation, the parameter configuration instructions comprise configuration instructions for one or more of the following hearing aid parameters: volume, noise reduction, gains of different sound bands, or gains of left and right channels.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the user sound collected by the sensor is lower than a preset first sound threshold, the processor generates a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the environmental noise collected by the sensor is higher than a preset second sound threshold value, the processor generates a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the environmental noise collected by the sensor is higher than a preset second sound threshold value, the processor generates a parameter configuration instruction for enhancing the noise reduction effect of the hearing aid.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the user heartbeat value acquired by the sensor is higher than a preset third heartbeat threshold value, the processor generates a parameter configuration instruction for increasing the volume of the hearing aid.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: according to the historical listening data of the user collected by the processor, the processor generates a parameter configuration instruction for setting the hearing aid volume to be the historical average volume.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: according to the historical listening data of the user collected by the processor, the processor generates a parameter configuration instruction for setting the gain of each sound frequency band of the hearing aid to a historical average gain value.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the sensor detects that the user's face is turned in a first direction, the processor generates a parameter configuration instruction that increases the sound gain of the hearing aid in the first direction.
In one possible implementation, generating the parameter configuration instruction according to the environment data includes: when the sensor detects that the sound source is located in the second direction, the processor generates a parameter configuration instruction that increases the sound gain of the hearing aid in the second direction.
In one possible implementation, the terminal obtains the right to change the settings of the hearing aid before sending the parameter configuration instructions to the hearing aid.
In a fourth aspect, embodiments of the present application provide a terminal, including a processor, a memory, and one or more programs; wherein one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method of the first aspect.
In a fifth aspect, embodiments of the present application provide a computer program product for storing computer software instructions for performing the method according to the first aspect.
In a sixth aspect, embodiments of the present application provide a computer storage medium having instructions stored therein, which when run on a terminal, cause the terminal to perform the method according to the first aspect.
Drawings
Fig. 1 is a schematic diagram of a hearing aid 100 according to an embodiment of the present application;
fig. 2 is a schematic hardware structure of a mobile phone 200 according to an embodiment of the present application;
fig. 3 is a flowchart of a method for controlling a hearing aid according to an embodiment of the present application;
fig. 4 is a schematic diagram of a scenario in which a user uses the hearing aid 100 and the mobile phone 200 according to the embodiment of the present application;
fig. 5 is a flowchart of a mobile phone 200 according to an embodiment of the present application establishing a connection and interacting with the hearing aid 100;
fig. 6 is a schematic diagram of an operation menu of a hearing aid setting interface on a mobile phone 200 according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a terminal 700 according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a terminal 800 according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. Wherein, in the description of the present application, "/" means or, unless otherwise indicated, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. Also, in the description of the present application, unless otherwise indicated, "at least one" means one or more, and "a plurality" means two or more. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second", and the like are used to distinguish the same item or similar items having substantially the same function and effect. It will be appreciated by those of skill in the art that the words "first," "second," and the like do not limit the amount and order of execution, and that the words "first," "second," and the like do not necessarily differ. The names of the messages between the devices or the names of the parameters in the messages in the embodiments described below are only an example, and may be other names in specific implementations, which are not limited in particular in the embodiments of the present application.
A hearing aid is a device that helps to improve hearing, and can amplify sound that is not clearly heard and then perceived by a hearing impaired person (hereinafter referred to as a "user"). Hearing aids are of many types, and can be classified into a box type, a behind-the-ear type, an in-the-ear type, etc., according to the external structure; according to the conduction mode, the method can be classified into qi conduction type and bone conduction type. Common hearing aid constructions include microphones, headphones, amplifiers, power supplies, housings, various buttons, and the like. Wherein, the microphone is used for gathering sound signal and converting into the signal of telecommunication, and the earphone is used for converting the signal of telecommunication into the signal of telecommunication and exporting for the user, and the amplifier can increase the intensity of signal of telecommunication, and power (for example battery, including non-rechargeable battery and rechargeable battery) provides electric power for the audiphone, and various buttons can be shift knob, volume adjustment button, gear adjustment button or other buttons. In addition, a charging interface, an indicator light, etc. may be included. In some embodiments of the present application, the hearing aid may further comprise communication means which may establish a communication connection with other electronic devices. The communication device may be a bluetooth device, NFC device, wiFi device, etc. Some embodiments of the present application describe a communication device for a hearing aid by way of example of a bluetooth device, it being understood that the bluetooth device in these embodiments may be replaced by other types of communication devices. In some embodiments of the present application, the hearing aid may further comprise various sensors for detecting the state of the user and the surrounding environment, e.g. acceleration sensors may be used for detecting the state of motion of the user etc.
Fig. 1 is a schematic diagram of a behind-the-ear hearing aid 100 comprising a microphone 101, an earpiece 102, a battery 103, a volume adjustment button 104, and a switch 105, wherein the microphone 101 is adapted to collect sound from the surrounding environment and convert it into an electrical signal, the earpiece 102 is adapted to output amplified sound to a user, the battery 103 is adapted to power the hearing aid 100, the volume adjustment button 104 is adapted to increase or decrease the volume, and the switch 105 is adapted to turn the hearing aid 100 on or off. In use, the hearing aid 100 is powered on by first pressing the switch 105 and then adjusted to the appropriate volume level by the volume adjustment button 104. In addition, the hearing aid 100 may also have bluetooth means (not shown) for establishing a communication connection with other electronic devices; the hearing aid 100 may also have sensors (not shown) for detecting the state of the user and the surrounding environment. It will be appreciated that the hearing aid 100 of fig. 1 is only an example and not limiting, that an actual hearing aid may be of other types or shapes, may comprise more or fewer components than in fig. 1, or may be combined with certain components, or may be split into certain components, or may be arranged with different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Some embodiments of the present application provide a terminal, which may be, for example, a cell phone, tablet, desktop, laptop, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), handheld computer, netbook, personal digital assistant (personal digital assistant, PDA), wearable device (including smart bracelet, smart watch, smart glasses, etc.), in-vehicle device, augmented Reality (AR)/Virtual Reality (VR), etc. In some embodiments of the present application, the mobile phone 200 is taken as an example to describe the terminal, and it is understood that these embodiments may also be applicable to other types of terminals listed above.
Fig. 2 is a schematic diagram of a hardware architecture of a mobile phone 200, where the mobile phone 200 may include a processor 201, a memory 202, a display 203, a camera 204, i/O devices 205, a sensor 206, a power supply 207, a bluetooth device 208, a positioning device 209, an audio circuit 210, a wifi device 211, a radio frequency circuit 212, and the like. The components communicate via one or more communication buses or signal lines. It should be understood that the hardware structure in fig. 2 is only an example of the mobile phone 200, and does not limit the structure of the mobile phone 200; the handset 200 may have more or fewer components than shown in fig. 2, may combine two or more components, or may have a different configuration or arrangement of the components. Operating systems running on the handset 200 include, but are not limited to DOS, unix, linux, or other operating system.
Processor 201 includes a single processor or processing unit, multiple processors, multiple processing units, or one or more other suitably configured computing elements. For example, the processor 201 may be a microprocessor, a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), or a combination of such devices. Optionally, the processor 201 may integrate an application processor (application processor, AP), a modem, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a Neural network processor (Neural-network Processing Unit, NPU), etc. The application processor mainly processes an operating system, a user interface, an application program and the like, and the modem mainly processes wireless communication. The different processing units may be separate devices or may be integrated in the same processor. In some embodiments, the processor 110 may include an interface. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others. The processor 201 is a control center of the mobile phone 200, directly or indirectly connects various parts of the mobile phone 200 using various interfaces and lines, and performs various functions and processes data of the mobile phone 200 by running or executing software programs or instruction sets stored in the memory 202 and invoking data stored in the memory 202, thereby performing overall monitoring of the mobile phone 200.
Memory 202 may store electronic data such as computer-executable program code, operating systems, application programs and their generated data, various documents such as text, picture, audio, video, etc., device settings and user preferences, contact lists and communication records, memos and calendars, biometric data, data structures or databases, and the like, that may be used by cell phone 200. The memory 202 may be configured as any type of memory such as random access memory, read only memory, flash memory, removable memory, or other type of storage element, or a combination of such devices.
The display 203 may be used to display information entered by a user or provided to a user as well as various interfaces of the cell phone 200. The display screen includes a display panel. The display panel may employ an LCD (liquid crystal display ), an OLED (organic light-emitting diode), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), miniled, micro-OLED, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. Alternatively, the display 203 may be integrated with a touch panel, which can detect whether contact has occurred, and pressure value, moving speed and direction, position information, etc. of the contact. The detection modes of the touch panel include, but are not limited to, capacitive, resistive, infrared, surface acoustic wave, and the like. When the touch panel detects a touch operation thereon or thereabout, it is communicated to the processor 201 to determine the type of touch event, and the processor 201 then provides a corresponding visual output on the display 203 based on the type of touch event, including text, graphics, icons, video, and any combination thereof. Alternatively, the mobile phone 200 may include 1 or N display screens, where N is a positive integer greater than 1.
The camera 204 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. Alternatively, the mobile phone 200 may include 1 or N cameras, where N is a positive integer greater than 1. Alternatively, the camera 204 may be divided into a front camera and a rear camera, and used in combination with other components such as a flash.
The I/O device 205, i.e., an input/output device, may receive data and instructions sent by a user or other device, or may output data or instructions to a user or other device. The I/O device 205 includes various buttons, interfaces, keyboards, touch input devices, touch pads, mice, etc. of the cell phone 200; the generalized I/O devices may also include the display 203, camera 204, audio circuitry 210, etc., shown in FIG. 2.
The cell phone 200 may include one or more sensors 206, and the sensors 206 may be configured to detect any type of attribute including, but not limited to, image, pressure, light, touch, heat, magnetism, movement, relative motion, and the like. For example, the sensor 206 may be an image sensor, thermometer, hygrometer, proximity sensor, infrared sensor, accelerometer, angular velocity sensor, gravity sensor, gyroscope, geomagnetic meter, heart rate detector, and so forth.
The pressure sensor is used for sensing a pressure signal and can convert the pressure signal into an electric signal. In some embodiments, the pressure sensor may be provided on the display screen. Pressure sensors are of many kinds, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. When a force is applied to the pressure sensor, the capacitance between the electrodes changes. The handset 200 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen, the mobile phone 200 detects the touch operation intensity according to the pressure sensor. The mobile phone 200 may also calculate the position of the touch based on the detection signal of the pressure sensor. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.
The gyro sensor may be used to determine the motion gesture of the cell phone 200. In some embodiments, the angular velocity of the handpiece 200 about three axes (i.e., the x, y, and z axes) may be determined by a gyroscopic sensor. The gyro sensor may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor detects the shake angle of the mobile phone 200, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the mobile phone 200 through the reverse motion, thereby realizing anti-shake. The gyroscopic sensor may also be used to navigate, somatosensory a game scene.
The air pressure sensor is used for measuring air pressure. In some embodiments, the handset 200 calculates altitude from barometric pressure values measured by barometric pressure sensors, aiding in positioning and navigation.
The magnetic sensor includes a hall sensor. The mobile phone 200 can detect the opening and closing of the flip holster using a magnetic sensor. In some embodiments, when the mobile phone 200 is a flip phone, the mobile phone 200 may detect the opening and closing of the flip based on the magnetic sensor. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.
The acceleration sensor may detect the magnitude of acceleration of the phone 200 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the handset 200 is stationary. The method can also be used for identifying the gesture of the terminal, and is applied to the applications such as horizontal and vertical screen switching, pedometers and the like.
And a distance sensor for measuring the distance. The cell phone 200 may measure the distance by infrared or laser. In some embodiments, the cell phone 200 may range using a distance sensor to achieve quick focus when shooting a scene.
The proximity light sensor may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. Infrared light is emitted outwards by the light emitting diode. A photodiode is used to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object in the vicinity of the cell phone 200. When insufficient reflected light is detected, it can be determined that there is no object in the vicinity of the cell phone 200. The mobile phone 200 can detect that the user holds the mobile phone 200 close to the ear to talk by using the proximity light sensor, so as to automatically extinguish the screen to achieve the purpose of saving electricity. The proximity light sensor can also be used in a holster mode, and a pocket mode can be used for automatically unlocking and locking a screen.
The ambient light sensor is used for sensing ambient light brightness. The mobile phone 200 can adaptively adjust the display brightness according to the perceived ambient light level. The ambient light sensor may also be used to automatically adjust white balance when taking a photograph. The ambient light sensor may also cooperate with the proximity light sensor to detect if the phone 200 is in a pocket to prevent false touches.
The fingerprint sensor is used for collecting fingerprints. The mobile phone 200 can utilize the collected fingerprint characteristics to realize fingerprint unlocking, access an application lock, fingerprint photographing, fingerprint incoming call answering and the like.
The temperature sensor is used for detecting temperature. In some embodiments, the handset 200 performs a temperature processing strategy using the temperature detected by the temperature sensor. For example, when the temperature reported by the temperature sensor exceeds a threshold, the handset 200 performs a reduction in the performance of a processor located in the vicinity of the temperature sensor in order to reduce power consumption and implement thermal protection.
Touch sensors, also known as "touch panels". Can be arranged on a display screen. For detecting a touch operation acting on or near it. The detected touch operation may be communicated to an application processor to determine the touch event type and provide a corresponding visual output through the display screen.
The bone conduction sensor may acquire a vibration signal. In some embodiments, the bone conduction sensor may acquire a vibration signal of the human vocal tract vibrating the bone pieces. The bone conduction sensor can also contact the pulse of a human body to receive the blood pressure jumping signal. In some embodiments, the bone conduction sensor may also be disposed in the earphone, and the audio module may parse out a voice signal based on the vibration signal of the acoustic vibrating bone block obtained by the bone conduction sensor, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beating signals acquired by the bone conduction sensor, so that a heart rate detection function is realized.
The power supply 207 may provide power to the handset 200 and its components. The power supply 207 may include one or more rechargeable batteries, or non-rechargeable batteries, or an external power source connected to the handset 200 by wire/wireless means. The power supply 207 may also include a charge management module for receiving a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module may receive a charging input of the wired charger through the USB interface. In some wireless charging embodiments, the charge management module may receive wireless charging input through a wireless charging coil of the cell phone 200. The charging management module can also supply power to the terminal equipment through the power management module while charging the battery. Optionally, the power supply 207 may further include a power management system, a fault detection system, a power conversion system, and other related devices. The power management system is used for connecting the battery, the charging management module and the processor 201. The power management module receives input from the battery and/or charge management module and provides power to the processor 201, memory 202, display 203, camera 204, etc. The power management system can also be used for monitoring parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance) and the like.
The bluetooth device 208 is used to exchange data between the mobile phone 200 and other devices via bluetooth protocol. It will be appreciated that the handset 200 may also include other short range communication devices such as NFC devices and the like.
The locating device 209 may provide geographic location information for the cell phone 200 and installed applications. The positioning device 209 may be a positioning system such as GPS, beidou satellite navigation system, GLONASS, etc. Optionally, the positioning device 209 further includes an assisted global positioning system AGPS, performing assisted positioning based on a base station or a WiFi access point, and so on.
Audio circuitry 210 may perform audio signal processing, input, output, etc., and may include speaker 210-1, microphone 210-2, and other audio processing devices. The speaker 210-1, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The handset 200 may listen to music through a speaker or to hands-free calls. Microphone 210-2, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, a user can sound near the microphone through the mouth, inputting a sound signal to the microphone. The mobile phone 200 may be provided with at least one microphone, and when two microphones are provided, besides collecting sound signals, functions such as noise reduction, sound source identification, directional recording and the like can be realized.
The WiFi device 211 is used to provide the mobile phone 200 with network access conforming to a WiFi related standard protocol, for example, the mobile phone 200 may access to a WiFi access point through the WiFi device 211 to connect to a network.
Radio Frequency (RF) circuitry 212 may be used to receive and transmit information or signals during a conversation, convert electrical signals to electromagnetic signals or vice versa, and communicate with a communication network and other communication devices via the electromagnetic signals. The radio frequency circuit 212 may provide a communication processing module including a solution for wireless communication such as 2G/3G/4G/5G applied to the handset 200. The structure of the radio frequency circuit 212 includes, but is not limited to: an antenna system, a radio frequency transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a SIM (Subscriber Identity Module) card, etc. The rf circuit 212 may receive electromagnetic waves from an antenna, filter, amplify, and the like the received electromagnetic waves, and transmit the electromagnetic waves to a modem for demodulation. The radio frequency module can amplify the signal modulated by the modem and convert the signal into electromagnetic waves to radiate through the antenna. Optionally, at least some of the functional blocks of the radio frequency circuitry 212 may be provided in the processor 201. Alternatively, at least some of the functional blocks of the radio frequency circuitry 212 may be provided in the same device as at least some of the blocks of the processor 201. The radio frequency circuitry 212 may communicate with networks such as the internet, intranets, and/or wireless networks (such as cellular telephone networks, wireless local area networks, and/or metropolitan area networks) and other devices via wireless communications. Wireless communications may use any of a variety of communication standards, protocols, and technologies, including, but not limited to, global system for mobile communications, enhanced data GSM environments, high speed downlink packet access, high speed uplink packet access, wideband code division multiple access, time division multiple access, bluetooth, wireless fidelity (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and/or IEEE 802.11 n), voice over internet protocol, wi-MAX, email protocol (e.g., internet Message Access Protocol (IMAP), and/or Post Office Protocol (POP)), instant messaging (e.g., extensible messaging presence protocol (XMPP), session initiation protocol (SIMPLE) for instant messaging and presence utilization extensions, instant Messaging and Presence Services (IMPS)), and/or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed at the filing date of this application.
Although not shown in fig. 2, the mobile phone 200 may further include other components, which are not described herein.
As shown in fig. 3, an embodiment of the present application provides a method for controlling a hearing aid, including the steps of:
s301: the terminal establishes a wireless communication link with the hearing aid.
For example, the handset 200 may establish a wireless communication link with the hearing aid 100. As shown in fig. 4, a wireless communication link may be established between the hearing aid 100 and the handset 200 when the hearing aid 100 is worn by a user. For example, the hearing aid 100 may be connected to the mobile phone 200 via a wireless connection such as bluetooth/NFC/WiFi, and a bluetooth connection will be used as an example to describe how to control the hearing aid 100, where both the hearing aid 100 and the mobile phone 200 have bluetooth modules and are activated, and a connection may be established according to the bluetooth standard protocol (including various versions of the protocol). For example, when the hearing aid 100 is connected by the mobile phone 200, the respective bluetooth devices may be activated, the nearby hearing aid 100 may be found by scanning, then a bluetooth connection may be initiated, and the bluetooth connection may be established after pairing. There are various bluetooth pairing procedures, such as direct pairing, PIN code entry pairing, physical or virtual button pressing pairing, etc. The handset 200 and the hearing aid 100 may then interact to communicate data or instructions to each other. It will be appreciated that according to the existing bluetooth standard protocol, one master device may be connected to a plurality of slave devices, so that the handset 200 may also be connected to a plurality of hearing aids 100 simultaneously, send data and instructions to a plurality of hearing aids 100, or receive data and instructions sent by a plurality of hearing aids 100.
For example, in fig. 4, when the handset 200 is playing music, the user may hear the music through the hearing aid 100 worn with the bluetooth connection established. It will be appreciated that the user may perform the functions of volume adjustment, switching music, pausing play, etc. by operating the buttons of the hearing aid 100, or may perform these functions by operating the handset 200. Optionally, the user may also use the mobile phone 200 to watch video, talk, etc. through the hearing aid 100; in addition to this, the user can hear the sound of the surrounding environment, or the talking sound of another person, etc. through the hearing aid 100.
S302: the terminal collects environmental data.
To determine the usage scenario of the hearing aid 100, the handset 200 may collect various environmental data, such as detecting user sounds, environmental noise and user action data (user action data including movement state, movement, distance, heartbeat, etc.), collecting user setting data or system menu setting data (collectively setting data), collecting user usage habits, etc. by various sensors. There are various ways of collecting environmental data, specifically, a microphone may be used to collect sound data (such as volume level, frequency, etc.) of user sound or environmental noise, or a microphone may be used to locate a sound source position, or an acceleration sensor may be used to detect a motion state of a user, or a proximity sensor may be used to detect a change in distance between the user and the mobile phone 200, or a camera of the mobile phone 200 may be used to track eye movements of the user, or hearing aid data set by the user or hearing aid data set by a system (such as hearing aid volume level, noise reduction effect, gains of different sound frequency bands, gains of left and right channels, etc.), or historical usage data may be collected to determine usage habits of the user, etc. It will be appreciated that in some examples, the microphone may also be considered as one of the sensors; in other examples, the processor may also collect environmental data, where the processor may also be considered part of the sensor.
Optionally, when the terminal collects the environmental data, a plurality of terminals may cooperate to collect the environmental data. For example, a user may wear a wearable device (which may be referred to as a "second terminal" at this time) while using the mobile phone 200 (which may be referred to as a "first terminal" at this time), and the wearable device may also collect environmental data, and determine a usage scenario of the hearing aid 100 in cooperation with the mobile phone 200. In this case, the wearable device may use various sensors to collect environmental data, for example, an ECG electrocardiograph may be used to measure heart rate of the user, an acceleration sensor or the like may be used to measure movement data of the user such as the number of steps, movement distance, and the like. Alternatively, the mobile phone 200 may upload the collected environmental data to a server for analysis, for example, the server analyzes historical usage data of the user, determines usage habits of the user, or the server analyzes environmental noise collected by a microphone of the mobile phone 200, and so on.
Alternatively, the handset 200 may update the collected environmental data, such as periodically re-collecting the environmental data at intervals (e.g., 5 minutes), or re-collecting the environmental data after detecting a change in the environmental data. For example, when the acceleration sensor of the mobile phone 200 detects that the motion state of the user is changed, the environmental data may be collected again.
S303: and the terminal generates a parameter configuration instruction according to the environment data and sends the parameter configuration instruction to the hearing aid.
After the mobile phone 200 collects the environmental data, a parameter configuration instruction may be generated and sent to the hearing aid 100, where the parameter configuration instruction is used to configure various parameters of the hearing aid 100, for example, parameters such as a hearing aid volume, a noise reduction effect, gains of different sound frequency bands, and gains of left and right channels may be adjusted, so as to achieve a better hearing effect.
It will be appreciated that the parameter configuration instructions are instructions that can be executed by the hearing aid 100, in accordance with a pre-set format, sent by the terminal (e.g. the handset 200) to the hearing aid 100 via a wireless communication link. The handset 200 may send parameter configuration instructions to the hearing aid 100 via a bluetooth communication link to enable configuration of the various parameters of the hearing aid 100. For example, the mobile phone 200 may send a command for volume adjustment to the hearing aid 100 to control the volume of the hearing aid 100, or configure parameters such as gain of each frequency band of sound, sound amplification effect, noise reduction effect, etc. The user may use the hearing aid 100 after configuring the parameters to hear sounds played by the cell phone 200, or sounds from the surrounding environment, talking sounds of others, etc. It will be appreciated that the hearing aid 100 needs to open corresponding rights (e.g. the right that the handset 200 alters the settings of the hearing aid 100) so that the parameter configuration instructions sent by the handset 200 can be executed to enable control of the hearing aid 100 with the handset 200.
Optionally, the mobile phone 200 may analyze the collected environmental data to generate a parameter configuration instruction. For example, for collected user sound, environmental noise, user action data, user settings and system settings, or environmental data such as user usage habits, the mobile phone 200 may determine the usage scenario of the hearing aid 100, thereby generating a parameter configuration instruction, and implementing personalized settings for the hearing aid 100, so that the hearing aid 100 more conforms to the hearing requirements of the user.
For example, when the user's voice collected by the microphone of the mobile phone 200 is small (e.g., below a preset first voice threshold), a parameter configuration instruction to increase the volume may be generated. For example, when the environmental noise collected by the microphone of the mobile phone 200 is large (e.g., above a preset second sound threshold), a parameter configuration instruction to increase the volume or enhance the noise reduction effect may be generated. For another example, when the wearable device detects that the user's heartbeat/pulse is fast using the ECG sensor, it may be determined that the user is running or hearing unclear sounds and becoming impatient tension results in a fast pulse, at which time the wearable device may generate a parameter configuration instruction to increase the volume. For another example, the mobile phone 200 may perform spectrum analysis on the sound signal and the noise signal collected by the microphone, and configure gain parameters of different frequency bands to generate parameter configuration instructions. For another example, the handset 200 may analyze the historical data of the user's use of the hearing aid 100 to determine the user's usage habits, e.g., if the user prefers to hear a bass, the handset 200 may generate parameter configuration instructions that enhance the bass gain. For another example, the hearing of the left and right ears of the user may be different, and the mobile phone 200 may generate parameter configuration instructions of different gain effects of the left and right ears according to the listening difference of the user. For another example, the direction of the face of the user may be determined by an acceleration sensor or an eye tracking sensor, and the volume gain parameters of the left and right ears may be adjusted according to the sound source position at which the microphone is positioned. For another example, the sound gain of the hearing aid in the first direction is increased when it is detected that the user's face is turned in the first direction. For another example, the sound gain of the hearing aid in the second direction is increased when the sound source is detected to be located in the second direction. As another example, the volume of the hearing aid 100 is automatically adjusted to conform to the usage habits of the user based on the user's historical volume setting data. By means of the above-described auditory scene analysis and personalized settings, the different auditory demands of the hearing impaired can be improved and the parameters of the hearing aid 100 can be dynamically adjusted.
Alternatively, a plurality of terminals may cooperate to control the hearing aid 100, in which case parameter configuration instructions may be issued by one or more of the plurality of terminals, which parameter configuration instructions may be executed by the hearing aid 100. Alternatively, the hearing aid 100 may execute a plurality of parameter configuration instructions simultaneously, or execute the parameter configuration instructions in a preset order, or select to execute the parameter configuration instructions sent by the terminal with higher priority. For example, the user may control the hearing aid 100 using both the mobile phone 200 and the wearable device, both the mobile phone 200 and the wearable device may send parameter configuration instructions to the hearing aid 100, the hearing aid 100 may execute these parameter configuration instructions simultaneously, or preferably execute parameter configuration instructions sent by the mobile phone 200, or preferably execute parameter configuration instructions sent by the wearable device, etc. Alternatively, the wearable device may control the hearing aid 100 via the handset 200, configuring various parameters of the hearing aid 100.
Fig. 5 is a schematic diagram of a handset 200 interfacing and interacting with the hearing aid 100. The method comprises the following steps:
1. the handset 200 activates bluetooth and scans for peripherals.
The mobile phone 200 turns on the bluetooth module and scans peripheral devices according to the bluetooth standard protocol.
2. The hearing aid 100 returns the scan result and the handset 200 finds the hearing aid 100.
The handset 200 may display the scanned and found peripherals in the form of a list, which may include the hearing aid 100.
3. The handset 200 establishes a bluetooth communication link with the hearing aid 100.
After the handset 200 finds the hearing aid 100, it may attempt to establish a bluetooth connection with the hearing aid 100. Specifically, the bluetooth communication link may be established in a bluetooth pairing manner. There are various bluetooth pairing procedures, such as direct pairing, PIN code entry pairing, physical or virtual button pressing pairing, etc.
4. The handset 200 sends parameter configuration instructions to the hearing aid 100.
The mobile phone 200 may set various parameters of the hearing aid 100, and specifically may send a parameter configuration instruction to the hearing aid 100 through a bluetooth communication link, so as to adjust parameters such as volume of the hearing aid 100, noise reduction effect, gains of different sound frequency bands, and gains of left and right channels. It will be appreciated that the hearing aid 100 needs to open the corresponding rights so that the handset 200 can set the parameters of its 100.
5. The handset 200 performs data interactions with the hearing aid 100.
The data interaction between the handset 200 and the hearing aid 100 may be via a bluetooth communication link, where the data may be audio files, parameter configuration instructions, and other data.
Fig. 6 is a schematic diagram of an operational menu on a mobile phone 200 for controlling the hearing aid 100. The handset 200 may set up a hearing aid 100 parameter configuration menu at a setup menu. For example, the user may manually configure various parameters of the hearing aid 100, or may turn on an automatic setting function, i.e. the mobile phone 200 generates a parameter configuration instruction according to the collected environmental data, and sends the parameter configuration instruction to the hearing aid 100, so as to implement automatic setting. Alternatively, in fig. 6, the user manually adjusts the parameters of the hearing aid 100 by sliding the triangular slider left and right with his fingers to interface the parameters.
Optionally, for the case that the user wears two hearing aids or the hearing aid is worn on the left ear or the right ear, the setting menu may separately configure parameters of the left ear and the right ear, and set sound volume, noise reduction effect, gain of each frequency band or gain of the sound channel, and the like of the left ear and the right ear respectively. Optionally, the user may also view the power of the hearing aid 100 and receive a charging prompt message when the power is low. Optionally, a list of hearing aid devices found by the handset 200 may be displayed in a hearing aid settings menu to enable quick pairing, switching to a different hearing aid, etc. Alternatively, the hearing aid settings options may be integrated in one application APP or invoked by a shortcut (including a shortcut key, a voice assistant, etc.).
As shown in fig. 6, the setting of the parameters of the hearing aid 100 may be done manually by the user or automatically by the handset 200. The parameters of the hearing aid 100 may include: volume, noise reduction effect, low frequency gain, intermediate frequency gain, high frequency gain, left channel gain, right channel gain, etc. The volume may be adjusted according to the sound size or ambient noise, for example, when the sound is too small or the ambient noise is relatively loud, the volume may be increased so that the user listens clearly.
The noise reduction effect indicates the degree of filtering of ambient noise. The noise reduction specifically may include the steps of: 1. separating the collected mixed sound signal to separate the sound signal from the noise signal; 2. the separated sound signals are subjected to automatic gain adjustment, and the sound can be subjected to automatic gain adjustment with different degrees according to the ratio relation between the sound and the noise and decibels so as to achieve a better hearing effect; 3. the gain-adjusted sound information is output, for example, when the external environment is noisy, the output sound is amplified appropriately so that the user can hear the sound clearly.
The gain of each frequency band of the sound is adjusted according to the preference of the user on tone color and the sensitivity of ears on the sound of different frequency bands, and the gains of the bass, midrange and treble areas are adjusted in a targeted manner. The balance and the offset degree of the left and the right channels can be adjusted by adjusting the gains of the left and the right channels.
It will be appreciated that in order to achieve the above-described functionality, the electronic device comprises corresponding hardware and/or software modules that perform the respective functionality. The various example method steps described in connection with the embodiments disclosed herein may be embodied in hardware or a combination of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application in conjunction with the embodiments, but such implementation is not to be considered as outside the scope of this application.
The present embodiment may divide the functional modules of the electronic device according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated modules described above may be implemented in hardware. It should be noted that, in this embodiment, the division of the modules is schematic, only one logic function is divided, and another division manner may be implemented in actual implementation.
Fig. 7 provides a terminal 700 that may be used to control the hearing aid 100. The terminal 700 includes: a connection unit 701, a data acquisition unit 702, an instruction generation unit 703, an instruction transmission unit 704, wherein the connection unit 701 is used for establishing a wireless communication link between the terminal 700 and the hearing aid 100; the data acquisition unit 702 is configured to acquire environmental data, the instruction generation unit 703 is configured to generate a parameter configuration instruction according to the environmental data, and the instruction transmission unit 704 is configured to transmit the parameter configuration instruction to the hearing aid 100. Reference may be made to the above respective method embodiments for specific implementations.
In addition, the present application also provides a terminal 800 that may be used to control the hearing aid 100. The terminal 800 includes: a processor 801, a sensor 802, a wireless communication device 803. The wireless communication means 803 is arranged to establish a wireless communication link with the hearing aid 100; the sensor 802 is used to collect environmental data; the processor 801 is configured to generate a parameter configuration instruction according to the environmental data; the wireless communication means 803 is also adapted to send parameter configuration instructions to the hearing aid 100. Reference may be made to the above respective method embodiments for specific implementations.
In addition, the present application also provides a terminal 900, including a processor, a memory, and one or more programs; wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for: the terminal establishes a wireless communication link with the hearing aid; the terminal collects environmental data; and the terminal generates a parameter configuration instruction according to the environment data and sends the parameter configuration instruction to the hearing aid. Reference may be made to the above respective method embodiments for specific implementations.
In addition, the present application also provides a storage medium or computer program product for storing computer software instructions for: the terminal establishes a wireless communication link with the hearing aid; the terminal collects environmental data; and the terminal generates a parameter configuration instruction according to the environment data and sends the parameter configuration instruction to the hearing aid. Reference may be made to the above respective method embodiments for specific implementations.
It will be appreciated by those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional modules is illustrated, and in practical application, the above-described functional allocation may be performed by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to perform all or part of the functions described above.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a device (may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (47)

1. A method of controlling a hearing aid, comprising:
a terminal establishes a wireless communication link with the hearing aid, wherein the hearing aid is used for receiving audio played by the terminal through the wireless communication link and is used for helping a user to hear sounds of the environment or talking sounds of other people;
the terminal acquires first environmental data and receives second environmental data acquired by other terminals;
the terminal generates a parameter configuration instruction according to the first environment data and the second environment data, and sends the parameter configuration instruction to the hearing aid;
the terminal generates a parameter configuration instruction according to the first environment data and the second environment data, and the parameter configuration instruction comprises:
and when the terminal detects that the face of the user turns to the first direction, generating a parameter configuration instruction for increasing the sound gain of the hearing aid in the first direction.
2. The method of claim 1, wherein the wireless communication link comprises one of the following wireless connections: bluetooth, NFC, or WiFi.
3. The method of claim 1, wherein the first environmental data comprises one or more of the following: user sound, ambient noise, user action data, setup data, or user usage habits.
4. A method according to any one of claims 1-3, wherein the acquiring the first environmental data comprises:
the terminal periodically updates the collected environmental data.
5. A method according to any one of claims 1-3, wherein the acquiring the first environmental data comprises:
and when the terminal detects that the first environmental data changes, the terminal re-collects the first environmental data.
6. A method according to any one of claims 1-3, wherein the acquiring the first environmental data comprises:
and the terminal uploads the acquired first environmental data to a server for analysis.
7. The method according to claim 1, wherein the parameter configuration instructions comprise configuration instructions for one or more of the following hearing aid parameters:
Volume, noise reduction, gains of different sound bands, or gains of left and right channels.
8. A method according to any of claims 1-3, wherein the terminal generating parameter configuration instructions from the first and second environment data comprises:
and when the acquired user sound is lower than a preset first sound threshold, the terminal generates a parameter configuration instruction for increasing the volume of the hearing aid.
9. A method according to any of claims 1-3, wherein the terminal generating parameter configuration instructions from the first and second environment data comprises:
and when the acquired environmental noise is higher than a preset second sound threshold value, the terminal generates a parameter configuration instruction for increasing the volume of the hearing aid.
10. A method according to any of claims 1-3, wherein the terminal generates parameter configuration instructions from the first and second environment data, further comprising:
and when the acquired environmental noise is higher than a preset second sound threshold value, the terminal generates a parameter configuration instruction for enhancing the noise reduction effect of the hearing aid.
11. A method according to any of claims 1-3, wherein the terminal generates parameter configuration instructions from the first and second environment data, further comprising:
And when the acquired heartbeat value of the user is higher than a preset third heartbeat threshold value, the terminal generates a parameter configuration instruction for increasing the volume of the hearing aid.
12. A method according to any of claims 1-3, wherein the terminal generates parameter configuration instructions from the first and second environment data, further comprising:
and according to the collected historical listening data of the user, the terminal generates a parameter configuration instruction for setting the hearing aid volume as the historical average volume.
13. A method according to any of claims 1-3, wherein the terminal generates parameter configuration instructions from the first and second environment data, further comprising:
and generating a parameter configuration instruction for setting the gain of each sound frequency band of the hearing aid to be a historical average gain value by the terminal according to the collected historical listening data of the user.
14. A method according to any of claims 1-3, wherein the terminal generating parameter configuration instructions from the first and second environment data comprises:
when the sound source is detected to be located in the second direction, the terminal generates a parameter configuration instruction for increasing the sound gain of the hearing aid in the second direction.
15. A method according to any of claims 1-3, characterized in that before said sending of said parameter configuration instructions to said hearing aid, said method comprises:
the terminal obtains rights to change the hearing aid settings.
16. The utility model provides a terminal, includes connecting element, data acquisition unit, instruction generation unit, receiving element and instruction sending unit, its characterized in that wherein:
the connection unit is used for establishing a wireless communication link between the terminal and a hearing aid, wherein the hearing aid is used for receiving audio played by the terminal through the wireless communication link and helping a user to hear the sound of the environment or the talking sound of other people;
the data acquisition unit is used for acquiring first environment data;
the receiving unit is used for receiving second environment data acquired by other terminals;
the instruction generating unit is used for generating parameter configuration instructions according to the first environment data and the second environment data;
the instruction sending unit is used for sending the parameter configuration instruction to the hearing aid;
the generating parameter configuration instructions according to the first environment data and the second environment data comprises the following steps: when the data acquisition unit detects that the face of the user turns to a first direction, the instruction generation unit generates a parameter configuration instruction that increases the sound gain of the hearing aid in the first direction.
17. The terminal of claim 16, wherein the wireless communication link comprises one of the following wireless connections: bluetooth, NFC, or WiFi.
18. The terminal according to claim 16 or 17, wherein the first environmental data comprises one or more of the following: user sound, ambient noise, user action data, setup data, or user usage habits.
19. Terminal according to claim 16 or 17, characterized in that,
the receiving unit is configured to periodically update the acquired first environmental data.
20. The terminal according to claim 16 or 17, wherein the acquiring the first environmental data comprises:
when the data acquisition unit detects that the first environmental data changes, the data acquisition unit acquires the first environmental data again.
21. The terminal according to claim 16 or 17, characterized in that the terminal further comprises a transmitting unit,
the sending unit is used for uploading the acquired first environmental data to a server for analysis.
22. The terminal according to claim 16, characterized in that the parameter configuration instructions comprise configuration instructions for one or more of the following hearing aid parameters:
Volume, noise reduction, gains of different sound bands, or gains of left and right channels.
23. Terminal according to claim 16 or 17, characterized in that,
the instruction generating unit is used for generating a parameter configuration instruction for increasing the volume of the hearing aid when the acquired sound of the user is lower than a preset first sound threshold value.
24. Terminal according to claim 16 or 17, characterized in that,
the instruction generating unit is used for generating a parameter configuration instruction for increasing the volume of the hearing aid when the acquired environmental noise is higher than a preset second sound threshold value.
25. Terminal according to claim 16 or 17, characterized in that,
the instruction generating unit is used for generating a parameter configuration instruction for enhancing the noise reduction effect of the hearing aid when the acquired environmental noise is higher than a preset second sound threshold value.
26. Terminal according to claim 16 or 17, characterized in that,
the instruction generating unit is used for generating a parameter configuration instruction for increasing the volume of the hearing aid when the acquired heartbeat value of the user is higher than a preset third heartbeat threshold value.
27. Terminal according to claim 16 or 17, characterized in that,
the instruction generating unit is used for generating a parameter configuration instruction for setting the hearing aid volume as a historical average volume according to the collected historical listening data of the user.
28. Terminal according to claim 16 or 17, characterized in that,
the instruction generating unit is used for generating parameter configuration instructions for setting the gain of each sound frequency band of the hearing aid to be a historical average gain value according to collected historical listening data of a user.
29. Terminal according to claim 16 or 17, characterized in that,
the instruction generation unit is configured to generate a parameter configuration instruction for increasing a sound gain of the hearing aid in a second direction when the sound source is detected to be located in the second direction.
30. A terminal according to claim 16 or 17, characterized in that the terminal is adapted to obtain rights to change the settings of the hearing aid before said sending of the parameter configuration instructions to the hearing aid.
31. A terminal comprising a processor, a sensor, a wireless communication device, wherein:
the wireless communication device is used for establishing a wireless communication link with a hearing aid, wherein the hearing aid is used for receiving audio played by the terminal through the wireless communication link and is used for helping a user to hear the sound of the environment or the talking sound of other people;
the sensor is used for collecting first environment data;
The wireless communication device is also used for receiving second environment data acquired by other terminals;
the processor is used for generating parameter configuration instructions according to the first environment data and the second environment data;
the wireless communication device is further configured to send the parameter configuration instructions to the hearing aid;
the generating parameter configuration instructions according to the first environment data and the second environment data comprises the following steps:
when the sensor detects that the user's face is turned in a first direction, the processor generates a parameter configuration instruction that increases the sound gain of the hearing aid in the first direction.
32. The terminal of claim 31, wherein the wireless communication link comprises one of the following wireless connections: bluetooth, NFC, or WiFi.
33. The terminal according to claim 31 or 32, wherein the first environmental data comprises one or more of the following: user sound, ambient noise, user action data, setup data, or user usage habits.
34. Terminal according to claim 31 or 32, characterized in that,
the sensor is configured to periodically update the acquired first environmental data.
35. Terminal according to claim 31 or 32, characterized in that,
the sensor is used for collecting the first environmental data again when detecting that the first environmental data changes.
36. Terminal according to claim 31 or 32, characterized in that,
the wireless communication device is also used for uploading the acquired first environment data to a server for analysis.
37. The terminal according to claim 31, characterized in that the parameter configuration instructions comprise configuration instructions for one or more of the following hearing aid parameters:
volume, noise reduction, gains of different sound bands, or gains of left and right channels.
38. Terminal according to claim 31 or 32, characterized in that,
the processor is used for generating a parameter configuration instruction for increasing the volume of the hearing aid when the acquired sound of the user is lower than a preset first sound threshold value.
39. Terminal according to claim 31 or 32, characterized in that,
the processor is used for generating a parameter configuration instruction for increasing the volume of the hearing aid when the acquired environmental noise is higher than a preset second sound threshold value.
40. Terminal according to claim 31 or 32, characterized in that,
The processor is used for generating parameter configuration instructions for enhancing the noise reduction effect of the hearing aid when the acquired environmental noise is higher than a preset second sound threshold value.
41. Terminal according to claim 31 or 32, characterized in that,
the processor is used for generating a parameter configuration instruction for increasing the volume of the hearing aid when the acquired heartbeat value of the user is higher than a preset third heartbeat threshold value.
42. Terminal according to claim 31 or 32, characterized in that,
the processor is used for generating a parameter configuration instruction for setting the hearing aid volume as a historical average volume according to the collected historical listening data of the user.
43. Terminal according to claim 31 or 32, characterized in that,
the processor is used for generating parameter configuration instructions for setting the gain of each sound frequency band of the hearing aid to be a historical average gain value according to collected historical listening data of a user.
44. Terminal according to claim 31 or 32, characterized in that,
the processor is configured to generate a parameter configuration instruction to increase a sound gain of the hearing aid in a second direction when the sound source is detected to be in the second direction.
45. The terminal according to claim 31 or 32, characterized in that the wireless communication means is further adapted to obtain rights to change the settings of the hearing aid before said sending of said parameter configuration instructions to the hearing aid.
46. A terminal comprising a processor, a memory, one or more programs; wherein one or more programs are stored in a memory and configured to be executed by one or more processors, the one or more programs comprising instructions for performing the method of any of claims 1-15.
47. A computer storage medium having instructions stored therein, which when run on a terminal, cause the terminal to perform the method of any of claims 1-15.
CN201811636396.3A 2018-11-05 2018-12-29 Method and terminal for controlling hearing aid Active CN111148271B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/114933 WO2020093937A1 (en) 2018-11-05 2019-11-01 Method for controlling hearing aid and terminal

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811308958 2018-11-05
CN2018113089581 2018-11-05

Publications (2)

Publication Number Publication Date
CN111148271A CN111148271A (en) 2020-05-12
CN111148271B true CN111148271B (en) 2024-04-12

Family

ID=70516518

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811636396.3A Active CN111148271B (en) 2018-11-05 2018-12-29 Method and terminal for controlling hearing aid

Country Status (2)

Country Link
CN (1) CN111148271B (en)
WO (1) WO2020093937A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111800720B (en) * 2020-07-06 2021-11-19 惠州市锦好医疗科技股份有限公司 Digital hearing aid parameter adjusting method and device based on big data and cloud space
CN111901737A (en) * 2020-08-07 2020-11-06 浙江大学 Hearing aid parameter self-adaption method based on intelligent terminal
CN111954142A (en) * 2020-08-29 2020-11-17 深圳市韶音科技有限公司 Hearing assisting device
CN113259826B (en) * 2021-06-23 2021-10-01 央广新媒体文化传媒(北京)有限公司 Method and device for realizing hearing aid in electronic terminal
US20230011498A1 (en) * 2021-07-12 2023-01-12 Apple Inc. Proximity Sensor Based Communications Interface for Electronic Devices
CN113746983B (en) * 2021-09-06 2023-05-12 周恪睿 Hearing aid method and device, storage medium and intelligent terminal
CN116939458A (en) * 2022-04-06 2023-10-24 上海又为智能科技有限公司 Monitoring method and device for hearing assistance device
WO2024066443A1 (en) * 2022-09-27 2024-04-04 海信视像科技股份有限公司 Display device and volume adjustment method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101300897A (en) * 2005-11-01 2008-11-05 皇家飞利浦电子股份有限公司 Hearing aid comprising sound tracking means
CN102771144A (en) * 2010-02-19 2012-11-07 西门子医疗器械公司 Device and method for direction dependent spatial noise reduction
CN104581536A (en) * 2015-01-26 2015-04-29 深圳市冠旭电子有限公司 Method and device for controlling noise reduction of earphone
CN104735599A (en) * 2013-12-19 2015-06-24 Gn瑞声达A/S A hearing aid system with selectable perceived spatial positioning of sound sources
WO2018077305A1 (en) * 2016-10-28 2018-05-03 中兴通讯股份有限公司 Method and apparatus for adjusting working status of earphone, earphone, and smart terminal
CN108429956A (en) * 2018-04-26 2018-08-21 Oppo广东移动通信有限公司 Wireless headset, control operating method and Related product

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110089020A (en) * 2010-01-29 2011-08-04 주식회사 팬택 Portable terminal capable of adjusting sound output of a wireless headset
US8369549B2 (en) * 2010-03-23 2013-02-05 Audiotoniq, Inc. Hearing aid system adapted to selectively amplify audio signals
KR102052153B1 (en) * 2013-02-15 2019-12-17 삼성전자주식회사 Mobile terminal for controlling a hearing aid and method therefor
KR101490336B1 (en) * 2013-04-24 2015-02-05 주식회사 바이오사운드랩 Method for Fitting Hearing Aid Customized to a Specific Circumstance of a User and Storage Medium for the Same
JP6588098B2 (en) * 2015-01-26 2019-10-09 深▲せん▼市冠旭電子股▲ふん▼有限公司Shenzhen Grandsun Electronic Co., Ltd. Method and apparatus for controlling headset noise reduction
CN108024187A (en) * 2016-10-31 2018-05-11 苏州乐听电子科技有限公司 It is a kind of independently to debug the intelligent hearing aid tested and matched somebody with somebody

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101300897A (en) * 2005-11-01 2008-11-05 皇家飞利浦电子股份有限公司 Hearing aid comprising sound tracking means
CN102771144A (en) * 2010-02-19 2012-11-07 西门子医疗器械公司 Device and method for direction dependent spatial noise reduction
CN104735599A (en) * 2013-12-19 2015-06-24 Gn瑞声达A/S A hearing aid system with selectable perceived spatial positioning of sound sources
CN104581536A (en) * 2015-01-26 2015-04-29 深圳市冠旭电子有限公司 Method and device for controlling noise reduction of earphone
WO2018077305A1 (en) * 2016-10-28 2018-05-03 中兴通讯股份有限公司 Method and apparatus for adjusting working status of earphone, earphone, and smart terminal
CN108429956A (en) * 2018-04-26 2018-08-21 Oppo广东移动通信有限公司 Wireless headset, control operating method and Related product

Also Published As

Publication number Publication date
WO2020093937A1 (en) 2020-05-14
CN111148271A (en) 2020-05-12

Similar Documents

Publication Publication Date Title
CN111148271B (en) Method and terminal for controlling hearing aid
JP7293398B2 (en) Bluetooth connection methods, devices and systems
CN112040461B (en) Approach discovery method and device
CN113395388B (en) Screen brightness adjusting method and electronic equipment
CN110401767B (en) Information processing method and apparatus
WO2021043219A1 (en) Bluetooth reconnection method and related apparatus
US20230059427A1 (en) Bluetooth Communication Method and Apparatus
US20220256321A1 (en) Method for Implementing Functions by Using NFC Tag, Electronic Device, and System
CN111132234A (en) Data transmission method and corresponding terminal
CN111182140B (en) Motor control method and device, computer readable medium and terminal equipment
CN114422340A (en) Log reporting method, electronic device and storage medium
EP4307692A1 (en) Method and system for adjusting volume, and electronic device
CN113395382A (en) Method for data interaction between devices and related devices
EP4350503A1 (en) Volume adjustment method, and electronic device and system
CN111930335A (en) Sound adjusting method and device, computer readable medium and terminal equipment
CN113438364B (en) Vibration adjustment method, electronic device, and storage medium
CN111935705A (en) Data service management method and device, computer readable medium and terminal equipment
CN113129916A (en) Audio acquisition method, system and related device
CN113467747B (en) Volume adjusting method, electronic device and storage medium
WO2022161036A1 (en) Method and apparatus for selecting antenna, electronic device, and readable storage medium
CN115665632A (en) Audio circuit, related device and control method
CN114554012B (en) Incoming call answering method, electronic equipment and storage medium
CN113467904A (en) Method and device for determining collaboration mode, electronic equipment and readable storage medium
CN114915359A (en) Method, device, electronic equipment and readable storage medium for selecting channel
EP4254195A1 (en) Data backup method, electronic device, data backup system and chip system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant