CN112468947A - Mobile phone hearing aid system capable of enhancing voice in real time - Google Patents
Mobile phone hearing aid system capable of enhancing voice in real time Download PDFInfo
- Publication number
- CN112468947A CN112468947A CN202011365024.9A CN202011365024A CN112468947A CN 112468947 A CN112468947 A CN 112468947A CN 202011365024 A CN202011365024 A CN 202011365024A CN 112468947 A CN112468947 A CN 112468947A
- Authority
- CN
- China
- Prior art keywords
- module
- real
- user
- time
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/45—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback
- H04R25/453—Prevention of acoustic reaction, i.e. acoustic oscillatory feedback electronically
Abstract
The utility model provides a cell-phone audiphone system of real-time reinforcing pronunciation, cell-phone audiphone system of real-time reinforcing pronunciation passes through smart mobile phone microphone and earphone, with the help of the built-in APP of smart mobile phone, carry out real-time enhancement for the pronunciation that the user received, it includes pronunciation collection module, sound source orientation module, the echo cancellation module, the module of making an uproar falls in the AI, the speech enhancement module, global compression module, the voice playing module, realize the speech enhancement effect with the help of cell-phone APP and earphone, the user can independently adjust the reinforcing effect with the help of cell-phone APP, can also regard cell-phone sound or music sound as the reinforcing object, with the help of echo cancellation and AI algorithm of making.
Description
[ technical field ] A method for producing a semiconductor device
The invention relates to a hearing aid, in particular to a mobile phone hearing aid system for enhancing voice in real time.
[ background of the invention ]
The hearing aid is a device for helping the hearing-impaired people to improve the hearing impairment, assisting the hearing-impaired people to participate in conversation and improving the communication ability. When hearing aids are used in different environments in daily life, different targeted algorithms or algorithm parameters are often required to improve hearing aid performance. The smart phone is also a device frequently used in daily life of people, and has high performance and computing power.
For example, patent 201210033656.4 proposes a digital hearing aid gain control optimization method, but the invention only considers speech enhancement, and does not have the functions of noise reduction, echo cancellation, etc., and the application in daily life is limited; for example, in the new patent 201620407116.1, a hearing aid capable of controlling volume program by non-contact gesture is proposed, which is intended to improve the convenience of users for controlling the hearing aid, but has no visual interface and still has great limitation in convenience.
It is thus seen that there is a need in the art for a mobile phone hearing aid system that provides real-time speech enhancement.
[ summary of the invention ]
In order to solve the above problems, the present invention provides a mobile phone hearing aid system for enhancing speech in real time, which enhances speech received by a user in real time by means of a built-in APP of a smart phone through a smart phone microphone and an earphone, and comprises a speech acquisition module, a sound source positioning module, an echo cancellation module, an AI noise reduction module, a speech enhancement module, a global compression module, and a speech playing module, wherein the step of using the system to enhance speech in real time comprises:
the method comprises the following steps: acquiring a voice signal concerned by a user in real time through a voice acquisition module;
step two: positioning the direction of a sound source through a sound source positioning module, and displaying an angle on an APP screen of the mobile phone in real time;
step three: eliminating the echo in the voice signal through an echo eliminating module;
step four: performing AI noise reduction on the voice signal through an AI noise reduction module;
step five: enhancing the voice signal according to the hearing deficiency curve of the user by a voice enhancement module;
step six: global compression is carried out on the real-time enhanced voice through a global compression module;
step seven: and (6) voice playing.
Further, the speech signal enhancement in the fifth step includes the following steps:
s1, decomposing the real-time speech S (T), (T1, 2, T) with length L into k eigenmode functions IMF by EMDn(t),(n＝1,2,…,k,t＝1,2,…,L)；
S2 according toAccording to the hearing deficiency curve of the user, the low-frequency deficiency corresponds to the intrinsic mode with larger k, the high-frequency deficiency corresponds to the intrinsic mode with larger k, and the IMF of the corresponding frequency band is performed according to the frequency band of the hearing deficiency of the userp(t), (t ═ 1,2, …, L) and the reinforcement gives α IMFp(t),(t＝1,2,…,L,α>1)；
S3, adding the enhanced eigenmode functions and the non-enhanced eigenmode functions to obtain EMD enhanced real-time enhanced voice S' (T), (T is 1,2, T)
S'(t)＝IMF1(t)+IMF2(t)+…+αIMFp(t)+…
+IMFk(t),(t＝1,2,…,L,α>1)
Further, the mobile phone hearing aid system capable of enhancing voice in real time further comprises a falling alarm module, once the falling alarm module is started, the accelerometer arranged on the earphone keeps a working state, the falling state of the user is detected, once the detected acceleration signals a (t) meet a certain rule, the falling alarm module can make a judgment that the user may fall down, send the current position information of the user to the emergency contact person of the user, and inform the emergency contact person of the fact that the user may fall down at present through a short message.
Further, the detection rule of the acceleration signal a (t) is as follows:
wherein, t3-t2＝t2-t1λ, when there is (t) at an interval λ1,t2,t3) When the detection rule is satisfied, the falling alarm module gives an alarm to the emergency contact.
Compared with the prior art, the invention has the beneficial effects that:
(1) the voice enhancement effect is realized by means of the mobile phone APP and the earphone, and the user can independently adjust the enhancement effect by means of the mobile phone APP;
(2) the mobile phone hearing aid system can take mobile phone telephone sound or music sound as an enhanced object besides the environment sound;
(3) improving the effect of the hearing aid by means of echo cancellation and AI (artificial intelligence) noise reduction algorithms;
(4) the source tracing device which is uniquely matched with the mobile phone is arranged to help a user to communicate with a specified object in a noisy environment;
(5) be equipped with the alarm module that tumbles on the earphone, be fit for the old person and use.
[ description of the drawings ]
Fig. 1 is an overall flow diagram of the mobile phone hearing aid system of the present invention for real-time speech enhancement.
FIG. 2 is a schematic diagram of sound source localization according to the present invention.
[ detailed description ] embodiments
The directional terms of the present invention, such as "up", "down", "front", "back", "left", "right", "inner", "outer", "side", etc., are only directions in the drawings, and are only used to explain and illustrate the present invention, but not to limit the scope of the present invention.
Aiming at the problems and the defects of the prior art, the invention discloses a mobile phone hearing aid system for enhancing voice in real time.
In order to achieve the purpose, the invention adopts the following specific scheme:
referring to fig. 1 and 2, the mobile phone hearing aid system for enhancing voice in real time includes a voice acquisition module 1, a sound source positioning module 2, an echo cancellation module 3, an AI noise reduction module 4, a voice enhancement module 5, a global compression module 6, a voice playing module 7 and a fall alarm module 8.
The steps of using the system to perform real-time speech enhancement are as follows:
the method comprises the following steps: and voice collection.
Through voice acquisition module 1, gather the speech signal that the user was concerned about in real time, specifically include three kinds of speech type: ambient sound, telephone sound, and music sound.
In a general state, the voice acquisition module 1 acquires the environmental sound of a user through a mobile phone microphone; when a user turns on a telephone sound switch, if the smart phone of the user dials a call, the voice acquisition module 1 acquires voice in the call through the smart phone; when a user turns on the music sound switch, if the smart phone of the user plays music, the voice acquisition module 1 acquires audio in the music as voice through the smart phone.
Step two: and (4) positioning the sound source.
When the speech signal that the user was concerned about comes from user's all ring edge borders, through sound source positioning module 2, location sound source place direction to show the angle in real time on cell-phone APP screen, when wearing the speaker on one's body with the only ware of tracing to the source of pairing of smart mobile phone open, sound source positioning module can be through the location of cell-phone LAN ware of tracing to the source place direction, and carry out the radio reception to this direction, promote the speech quality who comes from this direction.
Step three: and (4) echo cancellation.
By means of the echo cancellation module 3, the echo in the voice signal is cancelled, especially for the case that the microphone is close to the earphone.
Step four: and (5) AI noise reduction.
And the AI noise reduction module 4 is used for carrying out AI noise reduction on the voice signal, so that the environmental noises such as car noise, wind noise and the like in the voice signal are reduced.
Step five: and (4) speech enhancement.
The voice signal is enhanced by the voice enhancement module 5 according to the hearing deficiency curve of the user.
The voice enhancement comprises the following steps:
s1, decomposing the real-time speech S (T), (T1, 2, T) with length L into k eigenmode functions IMF by EMDn(t),(n＝1,2,…,k,t＝1,2,…,L)；
S2, according to the hearing deficiency curve of the user, the low frequency deficiency corresponds to the eigenmode with larger k, the high frequency deficiency corresponds to the eigenmode with larger k, according to the frequency band of the hearing deficiency of the user, the IMF of the corresponding frequency bandp(t), (t ═ 1,2, …, L) and the reinforcement gives α IMFp(t),(t＝1,2,…,L,α>1)；
S3, adding the enhanced eigenmode functions and the non-enhanced eigenmode functions to obtain EMD enhanced real-time enhanced voice S' (T), (T is 1,2, T)
S'(t)＝IMF1(t)+IMF2(t)+…+αIMFp(t)+…+IMFk(t),(t＝1,2,…,L,α>1)
Step six: and (4) global compression.
The real-time enhanced speech S' (T), (T ═ 1, 2., T) is globally compressed by global compression module 6 so that the power of the real-time enhanced speech is not greater than Wmax。
Step seven: and (6) voice playing.
Through voice playing module 7, voice signal collected by voice collecting module 1 is played from the earphone connected with the mobile phone through sound source positioning module 2, echo eliminating module 3, AI noise reducing module 4, voice enhancing module 5 and global compression module 6.
In addition, the invention also comprises a falling alarm module 8, once the falling alarm module 8 is started, the accelerometer arranged on the earphone keeps a working state, the falling state of the user is detected, and once the detected acceleration signal a (t) meets a certain rule, the falling alarm module can make the judgment that the user may fall down, send the current position information of the user to the emergency contact person of the user, and inform the emergency contact person that the user may fall down at present through a short message; the detection law of the acceleration signal a (t) is as follows:
wherein, t3-t2＝t2-t1λ, when there is (t) at an interval λ1,t2,t3) When the detection rule is satisfied, the falling alarm module gives an alarm to the emergency contact.
Furthermore, it should be understood that although the present description refers to embodiments, not every embodiment may contain only a single embodiment, and such description is for clarity only, and those skilled in the art should integrate the description, and the embodiments may be combined as appropriate to form other embodiments understood by those skilled in the art.
Claims (4)
1. The utility model provides a cell-phone audiphone system of real-time reinforcing pronunciation, a serial communication port, cell-phone audiphone system of real-time reinforcing pronunciation passes through smart mobile phone microphone and earphone, with the help of the built-in APP of smart mobile phone, carries out real-time reinforcing for the pronunciation that the user received, and it includes pronunciation collection module (1), sound source orientation module (2), echo cancellation module (3), the AI falls the module of making an uproar (4), pronunciation enhancement module (5), global compression module (6), pronunciation broadcast module (7), the step that uses this system to carry out the real-time reinforcing of pronunciation includes:
the method comprises the following steps: the voice signal concerned by the user is collected in real time through a voice collecting module (1);
step two: positioning the direction of a sound source through a sound source positioning module (2), and displaying the angle on an APP screen of the mobile phone in real time;
step three: eliminating the echo in the voice signal through an echo eliminating module (3);
step four: performing AI noise reduction on the voice signal through an AI noise reduction module (4);
step five: enhancing the voice signal according to the hearing deficiency curve of the user by a voice enhancement module (5);
step six: global compression is carried out on the real-time enhanced voice through a global compression module (6);
step seven: and (6) voice playing.
2. The mobile hearing aid system for real-time speech enhancement according to claim 1, wherein the speech signal enhancement in step five comprises the steps of:
s1: for real-time speech s (T), (T ═ 1, 2., T) of length L, EMD decomposition into k eigenmode functions IMF is usedn(t)，(n＝1，2，...，k，t＝1，2，...，L)；
S2: according to the hearing deficiency curve of the user, the low-frequency deficiency corresponds to the intrinsic mode with larger k, the high-frequency deficiency corresponds to the intrinsic mode with larger k, and according to the frequency band of the hearing deficiency of the user, the IMF of the corresponding frequency band is processedp(t), (t ═ 1, 2.., L) and the enhancement yielded α IMFp(t)，(t＝1，2，...，L，α＞1)；
S3: and adding the enhanced and the non-enhanced intrinsic mode functions to obtain EMD enhanced real-time enhanced voice S' (T), (T is 1,2, T)
S′(t)＝IMF1(t)+IMF2(t)+...+αIMFp(t)+...+IMFk(t)，(t＝1，2，...，L，α＞1)。
3. The mobile phone hearing aid system capable of enhancing speech in real time according to claim 1, further comprising a fall alarm module (8), wherein once the fall alarm module (8) is turned on, the accelerometer mounted on the earphone keeps working, the fall state of the user is detected, and once the detected acceleration signal a (t) meets a certain rule, the fall alarm module makes a judgment that the user may fall down, and sends the current location information of the user to the emergency contact of the user, and informs the emergency contact of the possible fall of the user through a short message.
4. The mobile phone hearing aid system for real-time speech enhancement according to claim 3, wherein the acceleration signal a (t) is detected according to the following rule:
wherein, t3-t2＝t2-t1λ, when there is (t) at an interval λ1，t2，t3) When the detection rule is satisfied, the falling alarm module is connected to the emergency linkThe tie person gives an alarm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011365024.9A CN112468947A (en) | 2020-11-27 | 2020-11-27 | Mobile phone hearing aid system capable of enhancing voice in real time |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011365024.9A CN112468947A (en) | 2020-11-27 | 2020-11-27 | Mobile phone hearing aid system capable of enhancing voice in real time |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112468947A true CN112468947A (en) | 2021-03-09 |
Family
ID=74809318
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011365024.9A Pending CN112468947A (en) | 2020-11-27 | 2020-11-27 | Mobile phone hearing aid system capable of enhancing voice in real time |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112468947A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113347300A (en) * | 2021-05-31 | 2021-09-03 | 江苏爱谛科技研究院有限公司 | Mobile phone APP for assisting hearing-impaired people to perform hearing aid |
| CN113746983A (en) * | 2021-09-06 | 2021-12-03 | 周恪睿 | Hearing aid method and device, storage medium and intelligent terminal |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101300897A (en) * | 2005-11-01 | 2008-11-05 | 皇家飞利浦电子股份有限公司 | Hearing aid comprising sound tracking means |
| US20120300963A1 (en) * | 2009-08-31 | 2012-11-29 | Rauch Steven D | Hearing aid feedback noise alarms |
| CN104980581A (en) * | 2015-06-18 | 2015-10-14 | 惠州Tcl移动通信有限公司 | Method and system for realizing automatic help seeking based on mobile terminal |
| CN109121057A (en) * | 2018-08-30 | 2019-01-01 | 北京聆通科技有限公司 | A kind of method and its system of intelligence hearing aid |
| US10613823B2 (en) * | 2016-09-27 | 2020-04-07 | Grabango Co. | System and method for differentially locating and modifying audio sources |
| CN111107478A (en) * | 2019-12-11 | 2020-05-05 | 江苏爱谛科技研究院有限公司 | Sound enhancement method and sound enhancement system |
-
2020
- 2020-11-27 CN CN202011365024.9A patent/CN112468947A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101300897A (en) * | 2005-11-01 | 2008-11-05 | 皇家飞利浦电子股份有限公司 | Hearing aid comprising sound tracking means |
| US20120300963A1 (en) * | 2009-08-31 | 2012-11-29 | Rauch Steven D | Hearing aid feedback noise alarms |
| CN104980581A (en) * | 2015-06-18 | 2015-10-14 | 惠州Tcl移动通信有限公司 | Method and system for realizing automatic help seeking based on mobile terminal |
| US10613823B2 (en) * | 2016-09-27 | 2020-04-07 | Grabango Co. | System and method for differentially locating and modifying audio sources |
| CN109121057A (en) * | 2018-08-30 | 2019-01-01 | 北京聆通科技有限公司 | A kind of method and its system of intelligence hearing aid |
| CN111107478A (en) * | 2019-12-11 | 2020-05-05 | 江苏爱谛科技研究院有限公司 | Sound enhancement method and sound enhancement system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113347300A (en) * | 2021-05-31 | 2021-09-03 | 江苏爱谛科技研究院有限公司 | Mobile phone APP for assisting hearing-impaired people to perform hearing aid |
| CN113746983A (en) * | 2021-09-06 | 2021-12-03 | 周恪睿 | Hearing aid method and device, storage medium and intelligent terminal |
| CN113746983B (en) * | 2021-09-06 | 2023-05-12 | 周恪睿 | Hearing aid method and device, storage medium and intelligent terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101843118B (en) | Method and system for wireless hearing assistance | |
| CN101828410B (en) | Method and system for wireless hearing assistance | |
| TWI508056B (en) | Portable audio device | |
| CN108322845B (en) | Noise reduction earphone | |
| CN111464905A (en) | Hearing enhancement method and system based on intelligent wearable device and wearable device | |
| CN106941641B (en) | A kind of interpretation method and translation earphone of translation earphone | |
| CN112468947A (en) | Mobile phone hearing aid system capable of enhancing voice in real time | |
| CN102946493B (en) | A kind of mobile terminal call ambient sound adjusting method | |
| CN105122843A (en) | Method and system for providing hearing assistance to a user | |
| CN103618835A (en) | Method and system for automatically switching scene mode according to magnitude of peripheral noise | |
| CN106375573B (en) | Method and device for switching call mode | |
| WO2019015503A1 (en) | Bluetooth headphones | |
| CN206698401U (en) | A kind of earphone for realizing diamylose gram noise reduction | |
| CN111683319A (en) | Call pickup noise reduction method, earphone and storage medium | |
| CN109068217A (en) | A kind of sidetone Enhancement Method, device and the In-Ear Headphones of In-Ear Headphones | |
| CN208094796U (en) | A kind of hearing aid and hearing assistance system | |
| TW202322107A (en) | Noise reduction processing method | |
| CN113207056B (en) | Wireless earphone and transparent transmission method, device and system thereof | |
| CN110012378A (en) | A kind of method of voice de-noising, earplug and computer storage medium | |
| CN109873894A (en) | A kind of volume adjusting method and mobile terminal | |
| CN208316970U (en) | earphone and communication system | |
| US10200795B2 (en) | Method of operating a hearing system for conducting telephone calls and a corresponding hearing system | |
| US20090285422A1 (en) | Method for operating a hearing device and hearing device | |
| CN113347300A (en) | Mobile phone APP for assisting hearing-impaired people to perform hearing aid | |
| CN212970064U (en) | Earphone of conversation anti-wind noise based on bone conduction technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230506 Address after: No. 2 Lijing Road, Jiangbei New District, Nanjing City, Jiangsu Province, 210000 Applicant after: Nanjing Biomedical Valley Construction Development Co.,Ltd. Address before: 210032 4th floor, building 04, life science and technology Island, 11 Yaogu Avenue, Jiangbei new district, Nanjing City, Jiangsu Province Applicant before: Jiangsu Aidi science and Technology Research Institute Co.,Ltd. |
|
| TA01 | Transfer of patent application right |