CN112562265A - Intelligent monitoring system and monitoring method based on hearing aid - Google Patents
Intelligent monitoring system and monitoring method based on hearing aid Download PDFInfo
- Publication number
- CN112562265A CN112562265A CN202011538734.7A CN202011538734A CN112562265A CN 112562265 A CN112562265 A CN 112562265A CN 202011538734 A CN202011538734 A CN 202011538734A CN 112562265 A CN112562265 A CN 112562265A
- Authority
- CN
- China
- Prior art keywords
- signal
- hearing aid
- voice
- unit
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 73
- 238000012544 monitoring process Methods 0.000 title claims abstract description 57
- 238000004891 communication Methods 0.000 claims abstract description 76
- 238000012545 processing Methods 0.000 claims abstract description 51
- 239000000779 smoke Substances 0.000 claims abstract description 49
- 230000036541 health Effects 0.000 claims abstract description 21
- 238000001514 detection method Methods 0.000 claims abstract description 9
- 238000006243 chemical reaction Methods 0.000 claims description 21
- 230000001629 suppression Effects 0.000 claims description 14
- 238000001914 filtration Methods 0.000 claims description 10
- 230000007613 environmental effect Effects 0.000 claims description 5
- 230000006835 compression Effects 0.000 claims description 4
- 238000007906 compression Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 3
- 239000007789 gas Substances 0.000 abstract description 31
- 230000006870 function Effects 0.000 abstract description 9
- 239000002737 fuel gas Substances 0.000 abstract description 4
- 230000036760 body temperature Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000005259 measurement Methods 0.000 description 3
- 208000016354 hearing loss disease Diseases 0.000 description 2
- 208000016621 Hearing disease Diseases 0.000 description 1
- 206010036626 Presbyacusis Diseases 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 208000009800 presbycusis Diseases 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0438—Sensor means for detecting
- G08B21/0453—Sensor means for detecting worn on the body to detect health condition by physiological monitoring, e.g. electrocardiogram, temperature, breathing
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B17/00—Fire alarms; Alarms responsive to explosion
- G08B17/10—Actuation by presence of smoke or gases, e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/12—Alarms for ensuring the safety of persons responsive to undesired emission of substances, e.g. pollution alarms
- G08B21/16—Combustible gas alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B3/00—Audible signalling systems; Audible personal calling systems
- G08B3/10—Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
- G08B3/1008—Personal calling arrangements or devices, i.e. paging systems
- G08B3/1016—Personal calling arrangements or devices, i.e. paging systems using wireless transmission
- G08B3/1025—Paging receivers with audible signalling details
- G08B3/1033—Paging receivers with audible signalling details with voice message alert
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/35—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using translation techniques
- H04R25/353—Frequency, e.g. frequency shift or compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/558—Remote control, e.g. of amplification, frequency
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/01—Hearing devices using active noise cancellation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Neurosurgery (AREA)
- Signal Processing (AREA)
- Acoustics & Sound (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Otolaryngology (AREA)
- Chemical & Material Sciences (AREA)
- Biophysics (AREA)
- Gerontology & Geriatric Medicine (AREA)
- Analytical Chemistry (AREA)
- Cardiology (AREA)
- Pulmonology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physical Education & Sports Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Physiology (AREA)
- Combustion & Propulsion (AREA)
- Environmental & Geological Engineering (AREA)
- Toxicology (AREA)
- Electromagnetism (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses an intelligent monitoring system and a monitoring method based on a hearing aid, which increase the functions of the hearing aid, realize the hearing aid, monitor other health conditions and improve the use convenience, and comprises a health detection module, a communication module, an intelligent terminal, a cloud platform and an environment early warning module, wherein the health detection module comprises the hearing aid, the hearing aid comprises a microphone, a loudspeaker and a hearing aid chip, the hearing aid chip comprises an audio processing module, a microcontroller and a communication unit, the hearing aid is in communication connection with the intelligent terminal through the communication module, the intelligent terminal is in communication connection with the cloud platform through the communication module, the environment early warning module comprises a smoke warning unit and a gas leakage warning unit, the environment early warning module is in communication connection with the intelligent terminal through the communication module, and the monitoring method based on the intelligent monitoring system comprises a body condition monitoring method, A fuel gas leakage and smoke warning method and a method for processing voice signals by adopting a voice processing module.
Description
Technical Field
The invention relates to the technical field of hearing aids, in particular to an intelligent monitoring system and a monitoring method based on a hearing aid.
Background
Presbycusis is a common hearing disease of the elderly, and the hearing aid as a medical device for assisting hearing provides great convenience for the elderly with hearing impairment. Recently, the national institute promulgates a notification that it is practical to solve the difficulty of the old people in using the intelligent technology, and the digital hearing aid has received a wide attention as one of the most common devices for the old people, and simultaneously, certain requirements are provided for the functionality, practicability, usability, portability and the like of the hearing aid. Traditional audiphone is different according to the function, and the price difference is also great, and although the audiphone price of well low-end is cheap, its noise reduction effect is relatively poor with speech processing effect, and common audiphone exists multiple defect on the market at present: the existing hearing aid has single function, generally can only realize the function of hearing aid, but cannot monitor other health conditions of the old; secondly, the existing hearing aids capable of simultaneously monitoring body temperature or heart rate are implantable hearing aids, which are inconvenient to use and require active measurement of a user to acquire health data, and a corresponding monitoring system is not available for realizing real-time monitoring and data analysis; and thirdly, the hearing aids with the detection and alarm functions are integrated, the hearing aids realize the function of seeking help for a guardian when an accident occurs, but the hearing aids cannot timely warn and prevent the accident.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides an intelligent monitoring system and a monitoring method based on a hearing aid, which increase the functions of the hearing aid, monitor other health conditions while realizing the hearing aid, realize real-time monitoring and data processing without active measurement of a user, and timely pre-warn and prevent accidents.
In order to achieve the purpose, the invention adopts the following technical scheme:
an intelligent monitoring system based on a hearing aid comprises a health detection module and a communication module, wherein the health detection module comprises the hearing aid, the hearing aid comprises a microphone, a loudspeaker and a hearing aid chip, the hearing aid chip comprises an audio processing module, a microcontroller and a communication unit, the microphone, the loudspeaker, a sensor and the audio processing module are electrically connected with the microcontroller, the microphone is used for collecting voice signals, the audio processing module is used for processing the voice signals, and the loudspeaker is used for playing the processed voice signals; the hearing aid is characterized by further comprising an intelligent terminal, a cloud platform, an environment early warning module and a sensor, wherein the sensor is used for acquiring body state data; the sensors comprise an infrared temperature sensor and a heart rate sensor, the body state data comprise a body temperature value, a heart rate value and a pulse, the infrared temperature sensor is used for acquiring the body temperature value, and the heart rate sensor is used for acquiring the heart rate value and the pulse;
the hearing aid is in communication connection with the intelligent terminal through the communication module, and the intelligent terminal is in communication connection with the cloud platform through the communication module;
the environment early warning module comprises a smoke warning unit and a gas leakage warning unit, and is in communication connection with the intelligent terminal through the communication module.
It is further characterized in that the method further comprises the steps of,
the communication module comprises Bluetooth communication and WIFI communication, the hearing aid is in communication connection with the intelligent terminal through the Bluetooth communication, and the intelligent terminal is in communication connection with the cloud platform through the WIFI communication;
the intelligent terminal comprises an intelligent mobile phone, a notebook or a PAD;
the audio processing module processes doorbell signals sent by the doorbell prompt module and plays the doorbell signals through the loudspeaker;
the audio processing module comprises an analog-to-digital converter, a high-pass filter, a time domain-frequency domain conversion unit, a voice enhancement unit, a hearing compensation unit, a frequency domain-time domain conversion unit, an automatic gain control unit, a digital-to-analog conversion unit and a feedback suppression unit;
the analog-to-digital converter is used for converting the input voice signal into a digital signal; the high-pass filter is used for filtering noise in the digital signal;
the time domain-frequency domain conversion unit is used for converting the filtered voice signal into a frequency domain signal which is uniformly divided according to sub-bands;
the voice enhancement unit is used for improving the identifiability of the frequency domain signal by reducing the environmental noise;
the hearing compensation unit is used for combining sub-bands to obtain a plurality of channels and compensating each channel according to a compensation curve;
the frequency domain-time domain conversion unit is used for restoring the compensated frequency domain signal into a time domain signal and outputting the time domain signal;
the automatic gain control unit is used for automatically controlling the gain of the voice signal;
the feedback suppression unit is used for suppressing the feedback signal loop from generating howling;
the digital-to-analog converter is used for converting the digital signal after automatic gain into an audio analog signal.
The smoke alarm unit comprises a smoke alarm used for collecting smoke information in the environment and sending out an alarm signal;
the gas leakage alarm unit comprises a gas leakage alarm, and the gas leakage alarm is used for acquiring gas leakage information in the environment and sending out an alarm signal.
A method for monitoring by adopting the intelligent monitoring system comprises a physical condition monitoring method, a fuel gas leakage and smoke warning method and a method for processing voice signals by adopting a voice processing module, and is characterized in that,
the physical condition monitoring method comprises the following steps:
acquiring physical condition information of a user through the sensor packaged in the hearing aid;
the sensor sends the physical condition information to the intelligent terminal through the Bluetooth communication;
the intelligent terminal sends the physical condition information to the cloud platform through the WIFI communication, and the cloud platform analyzes the physical condition information to obtain the health state of the current user;
and the cloud platform sends the health condition to the intelligent terminal for the user to check at any time.
A method for monitoring by adopting the intelligent monitoring system comprises the physical condition monitoring method, a gas leakage and smoke warning method and a method for processing a voice signal by adopting a voice processing module, and is characterized in that the gas leakage and smoke warning method comprises the following steps:
respectively acquiring gas leakage information and smoke information in the environment through a gas leakage detector and a smoke detector;
when gas leakage or smoke in the environment exceeds a preset threshold value, sending a gas leakage alarm signal or a smoke alarm signal to the intelligent terminal through WIFI communication;
the intelligent terminal sends an alarm signal to the hearing aid through Bluetooth communication;
the player of the hearing aid plays an alarm signal to the user.
A method for monitoring by adopting the intelligent monitoring system comprises the body condition monitoring method, a gas leakage and smoke warning method and a method for processing a voice signal by adopting a voice processing module, and is characterized in that the voice signal comprises an alarm signal and a doorbell signal, and the method for processing the voice signal by adopting the voice processing module comprises the following steps:
acquiring the voice signal, wherein the voice signal comprises an alarm signal acquired by adopting the gas leakage or smoke warning method or a doorbell signal sent by the doorbell prompt unit;
the analog-to-digital converter converts an input voice signal into a digital signal;
filtering noise in the digital signal by adopting the high-pass filter;
the time domain-frequency domain conversion unit converts the filtered voice signal into a frequency domain signal which is uniformly divided according to sub-bands;
the voice enhancement unit improves the identifiability of the frequency domain signal by reducing the environmental noise;
the hearing compensation unit is used for combining sub-bands to obtain a plurality of channels and compensating each channel according to a compensation curve by adopting a wide dynamic compression method;
the frequency domain-time domain conversion unit restores the compensated frequency domain signal into a time domain signal and outputs the time domain signal;
the automatic gain control unit is used for automatically controlling the gain of the voice signal to adjust the volume of the voice signal so that the volume of the output voice is in a comfortable range;
the feedback suppression unit is used for suppressing the feedback signal loop from generating howling;
the digital-to-analog converter is used for converting the digital signal after automatic gain into an audio analog signal, and the audio analog signal is sent to a user through the loudspeaker.
It is further characterized in that the method further comprises the steps of,
performing time-frequency domain interconversion on the filtered voice signal by adopting a short-time Fourier transform method and an inverse short-time Fourier transform method, or performing time-frequency domain interconversion on the filtered voice signal by adopting a weighted splicing-addition uniform channel filter group;
the hearing compensation unit adopts a wide dynamic compression method to compensate each channel according to a compensation curve;
the feedback suppression unit performs feedback suppression on the voice signal by adopting a self-adaptive recursive least square method, a self-adaptive wiener filtering method, a self-adaptive minimum mean square error method or a self-adaptive band-limited minimum mean square error method or a Kalman filtering method.
By adopting the structure of the invention, the following beneficial effects can be achieved: 1. the hearing aid is characterized in that a sensor is integrated in the hearing aid to collect body state data of a user in real time, the body state data are transmitted to the intelligent terminal through the integrated communication module, the intelligent terminal sends the body state data to the cloud platform through the communication module to analyze the data, and therefore real-time monitoring of the body state data of the user is achieved. The function of the hearing aid is added by the sensor, the hearing aid can monitor other health conditions while the hearing aid is realized, real-time monitoring and data processing can be realized without active measurement of a user, the user can acquire monitoring data in real time, and the use convenience is improved.
2. The intelligent terminal further comprises an environment early warning module, the environment early warning module comprises a smoke alarm unit and a gas leakage alarm unit, the smoke alarm unit and the gas leakage alarm unit are respectively used for acquiring smoke information and gas leakage information in the environment, and sending smoke alarm signals and gas leakage alarm signals to the intelligent terminal through the communication module, the intelligent terminal sends smoke alarm signals and gas leakage alarm signals to the hearing aid through the communication module, and the hearing aid plays corresponding signals to a user through a loudspeaker, so that timely early warning and accident prevention are realized.
3. It still includes doorbell suggestion module, and doorbell suggestion module passes through the microcontroller communication connection of bluetooth communication and audiphone, and audio frequency processing module handles the doorbell signal that doorbell suggestion module sent to the speaker broadcast doorbell signal through the audiphone gives the user, and convenient to use person hears doorbell information, has further improved the convenience in utilization of audiphone.
4. The method for processing the alarm signal or the doorbell signal by adopting the voice processing module effectively removes noise in the voice signal, greatly improves the playing effect of the voice signal of the hearing aid, enables a user to obtain accurate monitoring and real-time data, and improves the wearing comfort level.
Drawings
FIG. 1 is a block diagram of the system architecture of the present invention;
FIG. 2 is a flow chart of the audio processing module processing a speech signal according to the present invention.
Detailed Description
Referring to fig. 1, an intelligent monitoring system based on a hearing aid comprises a health detection module, a communication module, an intelligent terminal, a cloud platform, an environment early warning module and a doorbell prompt module, wherein the health detection module comprises the hearing aid, the communication module comprises bluetooth communication and WIFI communication, the hearing aid is in communication connection with the intelligent terminal through the bluetooth communication, and the intelligent terminal is in communication connection with the cloud platform through the WIFI communication;
the environment early warning module comprises a smoke alarm unit and a fuel gas leakage alarm unit, the environment early warning module is in communication connection with the intelligent terminal through Bluetooth communication, the smoke alarm unit comprises a smoke alarm, and the smoke alarm is used for collecting smoke information in the environment and sending out an alarm signal; the smoke detector in this embodiment is a TAD-168 smoke alarm. The gas leakage alarm unit comprises a gas leakage alarm used for acquiring gas leakage information in the environment and sending out an alarm signal; the type of the gas leakage alarm in this embodiment is an HD8200 alarm.
The doorbell prompt module is in communication connection with a microcontroller of the hearing aid through Bluetooth communication, and the audio processing module processes a doorbell signal sent by the doorbell prompt module and plays the doorbell signal through a loudspeaker;
the hearing aid comprises a microphone, a loudspeaker and a hearing aid chip, wherein the hearing aid chip comprises an audio processing module, a microcontroller and a communication unit, the microphone, the loudspeaker, a sensor and the audio processing module are electrically connected with the microcontroller, the microphone is used for acquiring a voice signal, the audio processing module is used for processing the voice signal, the loudspeaker is used for playing the processed voice signal, the hearing aid further comprises an infrared temperature sensor (with the model of MLX90615) and a heart rate sensor (with the model of SON7015), the infrared temperature sensor is used for acquiring a body temperature value, and the SON7015 heart rate sensor is used for acquiring a heart rate value and a pulse;
the audio processing module comprises an analog-to-digital converter, a high-pass filter, a time domain-frequency domain conversion unit, a voice enhancement unit, a hearing compensation unit, a frequency domain-time domain conversion unit, an automatic gain control unit, a digital-to-analog conversion unit and a feedback suppression unit;
the analog-to-digital converter is used for converting an input voice signal into a digital signal; the high-pass filter is used for filtering noise in the digital signal; the time domain-frequency domain conversion unit is used for converting the filtered voice signal into a frequency domain signal which is uniformly divided according to sub-bands; the voice enhancement unit is used for improving the identifiability of the frequency domain signal by reducing the environmental noise; the hearing compensation unit is used for combining the sub-bands to obtain a plurality of channels and compensating each channel according to a compensation curve; the frequency domain-time domain conversion unit is used for restoring the compensated frequency domain signal into a time domain signal and outputting the time domain signal; the automatic gain control unit is used for automatically controlling the gain of the voice signal to enable the volume of the output voice to be in a comfortable range, and the comfortable range is 20 dB-120 dB; the feedback suppression unit is used for suppressing the feedback signal loop from generating howling; the digital-to-analog converter is used for converting the digital signal after automatic gain into an audio analog signal.
A method for monitoring a user by adopting the intelligent monitoring system comprises a physical condition monitoring method, a fuel gas leakage and smoke warning method and a method for processing voice signals by adopting a voice processing module, wherein the voice signals comprise an alarm signal and a doorbell signal,
the physical condition monitoring method comprises the following steps: a1, collecting the physical condition information of the user through a sensor packaged in the hearing aid; a2, the sensor sends the physical condition information to the intelligent terminal through Bluetooth communication; a3, the intelligent terminal sends the physical condition information to the cloud platform through WIFI communication, and the cloud platform analyzes the physical condition information to obtain the health state of the current user; a4, the cloud platform sends the health condition to the intelligent terminal for the user to check at any time;
the gas leakage and smoke warning method comprises the following steps: b1, respectively acquiring gas leakage information and smoke information in the environment through a gas leakage detector and a smoke detector; b2, when gas leakage or smoke in the environment exceeds a preset threshold value, sending a gas leakage alarm signal or a smoke alarm signal to the intelligent terminal through WIFI communication; b3, the intelligent terminal sends an alarm signal to the hearing aid through Bluetooth communication; b4, playing an alarm signal to the user by the player of the hearing aid;
referring to fig. 2, the processing of the alarm signal or the doorbell signal by using the voice processing module in the hearing aid specifically includes the following processing steps:
c1, acquiring a voice signal, wherein the voice signal comprises an alarm signal acquired by the gas leakage or smoke alarm method or a doorbell signal sent by a doorbell prompt unit;
c2, converting the input voice signal into a digital signal by an analog-to-digital converter;
c3, filtering noise in the digital signal by adopting a high-pass filter;
c4, the time-frequency domain conversion unit adopts the existing short-time Fourier transform method to carry out time-frequency domain interconversion on the filtered voice signal, and converts the filtered voice signal into a frequency domain signal which is uniformly divided according to sub-bands;
c5, the voice enhancement unit reduces the noise of the collected signal by adopting multi-sub-band spectral subtraction to improve the identifiability of the frequency domain signal;
c6, the hearing compensation unit is used for combining the sub-bands to obtain a plurality of channels, and a wide dynamic range compression method is adopted to compensate each channel according to a compensation curve;
c7, converting the compensated frequency domain signal by the frequency domain-time domain conversion unit by adopting an inverse short-time Fourier transform method, restoring the compensated frequency domain signal into a time domain signal and outputting the time domain signal;
c8, the automatic gain control unit is used for automatically controlling the gain of the voice signal by detecting the amplitude of the voice signal so as to make the volume of the output voice in a comfortable range;
c9, the feedback suppression unit adopts an adaptive feedback suppression algorithm, such as Kalman filtering, and is used for suppressing the feedback signal loop from generating howling;
the function of the C10, the dac is to convert the digital signal after the automatic gain into an audio analog signal, and the audio analog signal is sent to the user through the speaker.
The intelligent monitoring system and the monitoring method are suitable for old people with hearing impairment, an environment early warning module is integrated in the monitoring system, the environment early warning module comprises a smoke warning unit and a gas leakage warning unit, when accidents such as smoke or gas leakage occur in the environment, warning signals can be sent into a hearing aid through WIFI communication, an intelligent terminal and Bluetooth communication, and the warning signals are sent to the old people through a loudspeaker, so that the effects of early warning and accident avoidance are achieved; the hearing aid worn by the old people is integrated with the sensor, can be used for collecting the physical condition information of the old people in real time and sending the physical condition information to the intelligent terminal in real time, and the intelligent terminal uploads data to the cloud platform through WIFI communication to analyze the data and monitor the health state of the old people, so that the old people can know the health condition of the old people at any time; when someone pressed the doorbell, doorbell suggestion unit transmitted the doorbell signal to intelligent terminal, notebook or PAD etc. through the WIFI communication, and intelligent terminal etc. transmitted the doorbell signal to microcontroller through bluetooth communication, and microcontroller handled the doorbell signal and broadcast the doorbell signal through the speaker through audio processing unit, has further made things convenient for and has listened the old person of barrier and use the audiphone.
The above is only a preferred embodiment of the present application, and the present invention is not limited to the above embodiments. It is to be understood that other modifications and variations directly derivable or suggested by those skilled in the art without departing from the spirit and concept of the present invention are to be considered as included within the scope of the present invention.
Claims (10)
1. An intelligent monitoring system based on a hearing aid comprises a health detection module and a communication module, wherein the health detection module comprises the hearing aid, the hearing aid comprises a microphone, a loudspeaker and a hearing aid chip, the hearing aid chip comprises an audio processing module, a microcontroller and a communication unit, the microphone, the loudspeaker, a sensor and the audio processing module are electrically connected with the microcontroller, the microphone is used for collecting voice signals, the audio processing module is used for processing the voice signals, and the loudspeaker is used for playing the processed voice signals; the hearing aid is characterized by further comprising an intelligent terminal, a cloud platform, an environment early warning module and a sensor, wherein the sensor is used for acquiring body state data;
the hearing aid is in communication connection with the intelligent terminal through the communication module, and the intelligent terminal is in communication connection with the cloud platform through the communication module;
the environment early warning module comprises a smoke warning unit and a gas leakage warning unit, and is in communication connection with the intelligent terminal through the communication module.
2. The hearing aid-based intelligent monitoring system according to claim 1, wherein the communication module comprises bluetooth communication and WIFI communication, the hearing aid is in communication connection with the intelligent terminal through the bluetooth communication, and the intelligent terminal is in communication connection with the cloud platform through the WIFI communication.
3. The hearing aid-based intelligent monitoring system according to claim 1 or 2, further comprising a doorbell prompt module, wherein the doorbell prompt module is in communication connection with a microcontroller of the hearing aid through the bluetooth communication, and the audio processing module processes a doorbell signal sent by the doorbell prompt module and plays the doorbell signal through the speaker.
4. The hearing aid-based intelligent monitoring system according to claim 3, wherein the audio processing module comprises an analog-to-digital converter, a high-pass filter, a time domain-frequency domain conversion unit, a voice enhancement unit, a hearing compensation unit, a frequency domain-time domain conversion unit, an automatic gain control unit, a digital-to-analog conversion unit, and a feedback suppression unit;
the analog-to-digital converter is used for converting the input voice signal into a digital signal;
the high-pass filter is used for filtering noise in the digital signal;
the time domain-frequency domain conversion unit is used for converting the filtered voice signal into a frequency domain signal which is uniformly divided according to sub-bands;
the voice enhancement unit is used for improving the identifiability of the frequency domain signal by reducing the environmental noise;
the hearing compensation unit is used for combining sub-bands to obtain a plurality of channels and compensating each channel according to a compensation curve;
the frequency domain-time domain conversion unit is used for restoring the compensated frequency domain signal into a time domain signal and outputting the time domain signal;
the automatic gain control unit is used for automatically controlling the gain of the voice signal to adjust the volume of the voice signal;
the feedback suppression unit is used for suppressing the feedback signal loop from generating howling;
the digital-to-analog converter is used for converting the digital signal after automatic gain into an audio analog signal.
5. The hearing aid-based intelligent monitoring system according to claim 4, wherein the smoke alarm unit comprises a smoke alarm for collecting smoke information in the environment and sending out an alarm signal; the gas leakage alarm unit comprises a gas leakage alarm, and the gas leakage alarm is used for acquiring gas leakage information in the environment and sending out an alarm signal.
6. A monitoring method using the intelligent monitoring system of claim 5, which comprises a physical condition monitoring method, a gas leakage and smoke warning method, a method for processing voice signals by using a voice processing module,
the physical condition monitoring method comprises the following steps:
acquiring physical condition information of a user through the sensor packaged in the hearing aid;
the sensor sends the physical condition information to the intelligent terminal through the Bluetooth communication;
the intelligent terminal sends the physical condition information to the cloud platform through the WIFI communication, and the cloud platform analyzes the physical condition information to obtain the health state of the current user;
and the cloud platform sends the health condition to the intelligent terminal for the user to check at any time.
7. A monitoring method using the intelligent monitoring system of claim 5 or 6, which comprises a body condition monitoring method, a gas leakage and smoke warning method, and a method for processing voice signals by using a voice processing module, wherein the gas leakage and smoke warning method comprises the following steps:
respectively acquiring gas leakage information and smoke information in the environment through a gas leakage detector and a smoke detector;
when gas leakage or smoke in the environment exceeds a preset threshold value, sending a gas leakage alarm signal or a smoke alarm signal to the intelligent terminal through WIFI communication;
the intelligent terminal sends an alarm signal to the hearing aid through Bluetooth communication;
the player of the hearing aid plays an alarm signal to the user.
8. A monitoring method using the intelligent monitoring system of claim 7, which comprises a body condition monitoring method, a gas leakage and smoke warning method, and a method for processing a voice signal by using a voice processing module, wherein the voice signal comprises an alarm signal and a doorbell signal, and the method for processing the voice signal by using the voice processing module comprises:
acquiring the voice signal, wherein the voice signal comprises an alarm signal acquired by adopting the gas leakage or smoke warning method or a doorbell signal sent by the doorbell prompt unit;
the analog-to-digital converter converts an input voice signal into a digital signal;
filtering noise in the digital signal by adopting the high-pass filter;
the time domain-frequency domain conversion unit converts the filtered voice signal into a frequency domain signal which is uniformly divided according to sub-bands;
the voice enhancement unit improves the identifiability of the frequency domain signal by reducing the environmental noise;
the hearing compensation unit is used for combining the sub-bands to obtain a plurality of channels and compensating according to the compensation curve;
the frequency domain-time domain conversion unit restores the compensated frequency domain signal into a time domain signal and outputs the time domain signal;
the automatic gain control unit is used for automatically controlling the gain of the voice signal;
the feedback suppression unit is used for suppressing the feedback signal loop from generating howling;
the digital-to-analog converter is used for converting the digital signal after automatic gain into an audio analog signal, and the audio analog signal is sent to a user through the loudspeaker.
9. The monitoring method according to claim 8, wherein the filtered voice signal is subjected to time-frequency domain interconversion by a short-time fourier transform method and an inverse short-time fourier transform method, or is subjected to time-frequency domain interconversion by a weighted overlap-add uniform channel filter bank; and the hearing compensation unit adopts a wide dynamic compression method to compensate each channel according to the compensation curve.
10. The monitoring method according to claim 9, wherein the feedback suppression unit performs feedback suppression on the speech signal by using a kalman filtering method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011538734.7A CN112562265A (en) | 2020-12-23 | 2020-12-23 | Intelligent monitoring system and monitoring method based on hearing aid |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011538734.7A CN112562265A (en) | 2020-12-23 | 2020-12-23 | Intelligent monitoring system and monitoring method based on hearing aid |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112562265A true CN112562265A (en) | 2021-03-26 |
Family
ID=75030932
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011538734.7A Pending CN112562265A (en) | 2020-12-23 | 2020-12-23 | Intelligent monitoring system and monitoring method based on hearing aid |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112562265A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114584908A (en) * | 2022-03-04 | 2022-06-03 | 科大讯飞股份有限公司 | Acoustic testing method, device and equipment for hearing aid |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103096230A (en) * | 2013-01-15 | 2013-05-08 | 杭州爱听科技有限公司 | All-digital type hearing-aid and changing channel matching and compensating method thereof |
| CN103503482A (en) * | 2011-05-04 | 2014-01-08 | 峰力公司 | Self-learning hearing assistance system and method of operating the same |
| CN204377139U (en) * | 2015-01-13 | 2015-06-03 | 厦门鹭宏声科技发展有限公司 | A kind of can sign monitoring hearing aids |
| CN204721608U (en) * | 2015-04-24 | 2015-10-21 | 富港电子(昆山)有限公司 | Multifunctional audiphones |
| CN109493877A (en) * | 2017-09-12 | 2019-03-19 | 清华大学 | A kind of sound enhancement method and device of auditory prosthesis |
| KR20190065602A (en) * | 2017-12-04 | 2019-06-12 | 올리브유니온(주) | Digital hearing device using bluetooth circuit and digital signal processing |
| CN110095202A (en) * | 2018-01-30 | 2019-08-06 | 天津大学 | A kind of Thermometer System based on hearing aid |
| CN110099346A (en) * | 2018-01-30 | 2019-08-06 | 天津大学 | Method for measuring heart rate in a kind of ear canal based on hearing aid |
| CN213844321U (en) * | 2020-12-23 | 2021-07-30 | 江苏集萃智能集成电路设计技术研究所有限公司 | Intelligent monitoring system based on hearing aid |
-
2020
- 2020-12-23 CN CN202011538734.7A patent/CN112562265A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103503482A (en) * | 2011-05-04 | 2014-01-08 | 峰力公司 | Self-learning hearing assistance system and method of operating the same |
| CN103096230A (en) * | 2013-01-15 | 2013-05-08 | 杭州爱听科技有限公司 | All-digital type hearing-aid and changing channel matching and compensating method thereof |
| CN204377139U (en) * | 2015-01-13 | 2015-06-03 | 厦门鹭宏声科技发展有限公司 | A kind of can sign monitoring hearing aids |
| CN204721608U (en) * | 2015-04-24 | 2015-10-21 | 富港电子(昆山)有限公司 | Multifunctional audiphones |
| CN109493877A (en) * | 2017-09-12 | 2019-03-19 | 清华大学 | A kind of sound enhancement method and device of auditory prosthesis |
| KR20190065602A (en) * | 2017-12-04 | 2019-06-12 | 올리브유니온(주) | Digital hearing device using bluetooth circuit and digital signal processing |
| CN110095202A (en) * | 2018-01-30 | 2019-08-06 | 天津大学 | A kind of Thermometer System based on hearing aid |
| CN110099346A (en) * | 2018-01-30 | 2019-08-06 | 天津大学 | Method for measuring heart rate in a kind of ear canal based on hearing aid |
| CN213844321U (en) * | 2020-12-23 | 2021-07-30 | 江苏集萃智能集成电路设计技术研究所有限公司 | Intelligent monitoring system based on hearing aid |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114584908A (en) * | 2022-03-04 | 2022-06-03 | 科大讯飞股份有限公司 | Acoustic testing method, device and equipment for hearing aid |
| CN114584908B (en) * | 2022-03-04 | 2023-12-01 | 科大讯飞股份有限公司 | Acoustic testing method, device and equipment for hearing aid |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10674247B2 (en) | Hearing protection earphone, hearing protection method and computer program storage medium for the same | |
| CN107071647B (en) | A kind of sound collection method, system and device | |
| CN109195042B (en) | Low-power-consumption efficient noise reduction earphone and noise reduction system | |
| JP5485256B2 (en) | Hearing aid, hearing aid system, gait detection method and hearing aid method | |
| AU2010272769B2 (en) | A hearing aid adapted for detecting brain waves and a method for adapting such a hearing aid | |
| JP3165044B2 (en) | Digital hearing aid | |
| US11304001B2 (en) | Speaker emulation of a microphone for wind detection | |
| JPS6031315B2 (en) | Method and apparatus for filtering ambient noise from speech | |
| CN109920451A (en) | Voice activity detection method, noise suppressing method and noise suppressing system | |
| CN100345464C (en) | Hearing aid and a method of processing a sound signal | |
| CN103618835A (en) | Method and system for automatically switching scene mode according to magnitude of peripheral noise | |
| CN105554664A (en) | Headset based sound processing method and apparatus, and headset | |
| CN104754462A (en) | Automatic regulating device and method for volume and earphone | |
| CN106488370A (en) | The method of the feedback for suppressing in hearing device | |
| CN213844321U (en) | Intelligent monitoring system based on hearing aid | |
| US20170111490A1 (en) | Method of transmitting data and a device and system thereof | |
| CN204652616U (en) | A kind of noise reduction module earphone | |
| CN112562265A (en) | Intelligent monitoring system and monitoring method based on hearing aid | |
| CN111182416B (en) | Processing method and device and electronic equipment | |
| WO2011116569A1 (en) | Mobile phone mute identification apparatus and mobile phone mute noise cancellation method and system | |
| CN113963699A (en) | Intelligent voice interaction method for financial equipment | |
| CN108735234A (en) | A kind of device monitoring health status using voice messaging | |
| CN112637438B (en) | Entrance guard double-end intercom method and system based on single-line transmission | |
| CN103200511B (en) | The digital hearing-aid of built-in sound field check and evaluation system and method thereof | |
| CN207995324U (en) | Neck wears formula interactive voice earphone |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |