CN105007557A - Intelligent hearing aid with voice identification and subtitle display functions - Google Patents
Intelligent hearing aid with voice identification and subtitle display functions Download PDFInfo
- Publication number
- CN105007557A CN105007557A CN201410153639.3A CN201410153639A CN105007557A CN 105007557 A CN105007557 A CN 105007557A CN 201410153639 A CN201410153639 A CN 201410153639A CN 105007557 A CN105007557 A CN 105007557A
- Authority
- CN
- China
- Prior art keywords
- module
- voice
- voice messaging
- hearing aid
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention relates to an intelligent hearing aid with voice identification and subtitle display functions. The intelligent hearing aid comprises an acquisition identification module, a voice amplification module, an information processing module and a projection module. The acquisition identification module is used for acquiring voice information, carrying out voice identification on the voice information and synchronously sending the identified voice information to the voice amplification module and the information processing module; the voice amplification module is used for amplifying the received voice information and transmitting the voice information in a directed manner; the information processing module is used for converting the received voice information into text information and sending the converted text information to the projection module; and the projection module is used for projecting the received text information to the retina of a user. The intelligent hearing aid provided by the invention improves the accuracy of obtained information. Since most people have text identification capabilities, for hearing impaired people, if text identification can be provided, the voice identification capability can be greatly improved, and the hearing impaired person can be more confident when communicating with other people.
Description
Technical field
The present invention relates to a kind of intelligent hearing aid, particularly relate to a kind of intelligent hearing aid with speech recognition and caption display function.
Background technology
Hearing aids (Hearing Aid) is one and contributes to hearing disabilities person and improve dysacousis, and then improves and the instrument of his conference communicative competence, unit and instrument etc.Allly in a broad sense effectively the various devices that sound imports ear into can be seen as hearing aids, say that hearing aids is exactly an electroacoustic amplifier in the narrow sense, deaf person is heard sound amplification by it originally to can not hear clearly, unheard sound, this device is exactly hearing aids.Hearing aids today is mainly divided into simulation hearing aids and digital deaf-aid two kinds.Wherein simulation hearing aids is the hearing loss curve shape regardless of patient, carry out unified amplification, and digital deaf-aid compensates accurately according to the hearing loss curve shape of patient to sound.Because the residual hearing protected effect of digital deaf-aid to the compensation effect of hearing and patient all comparatively will simulate hearing aids better, so the main product sold in Present Domestic market is based on digital deaf-aid.Hearing aids can be divided into ear-level hearing aid again, hearing aids from the angle of wearing position and profile, duct-type hearing aids, complete duct-type hearing aids, 100% stealthy hearing aids, multi-channel hearing aid etc.These hearing aidss can only play miscellaneous function, can not solve completely clearly to listen the problem distinguished.
Intelligent glasses, also smart mirror is claimed, refer to " as smart mobile phone; there is independently operating system; the program that can be provided by software houses such as user installation software, game; by voice or action manipulated adding schedule, digital map navigation, interactive with good friend, take pictures and video, launch the functions such as video calling with friend, and the general name of such class glasses of wireless network access can be realized by mobile communication network ".
Summary of the invention
The object of the invention is can only play miscellaneous function for existing hearing aids, clear deficiency of listening the problem distinguished can not be solved completely, a kind of intelligent hearing aid with speech recognition and caption display function is provided.
For above-mentioned purpose, technical scheme provided by the invention is as follows:
The invention provides a kind of intelligent hearing aid with speech recognition and caption display function, comprise acquiring and identifying module, voice amplification module, message processing module and projection module;
Described acquiring and identifying module for gathering voice messaging, and carries out speech recognition to described voice messaging, and by the voice messaging synchronized transmission after described identification to voice amplification module and message processing module;
Described voice amplification module is used for the voice messaging of reception to amplify and directional transmissions is gone out;
Described message processing module is used for the voice messaging of reception to be converted to Word message, and the Word message after conversion is sent to projection module;
Described projection module is for projecting to the retina of user by the Word message received.
Employing of the present invention this there is the hearing aids of character identification function, achieve and provide retinal projection while hearing aid, make user obtain information in audition two simultaneously, improve the accuracy of obtained information, because most people has Text region ability, for the person that listens to barrier, if can Text region be provided, greatly will improve and come from the recognition capability of voice aspect, the person that makes to listen to barrier and people link up more self-confident; Be exactly filled up current hearing aids can not provide speech recognition and the blank being converted into this field of captions about the effect of technological innovation.
On the basis of technique scheme, the present invention can also do following improvement.
As preferred scheme, also comprise control module;
Described control module receives the voice messaging that acquiring and identifying module gathers, and is amplified by voice messaging according to presetting control voice amplification module;
Described control module receives external control simultaneously, its external control comprises the control modes such as Non-follow control, phonetic order control, limbs instruction control, and the operating state of set information processing module also realizes the manipulation various functions with the intelligent hearing aid of speech recognition and caption display function of the present invention.
Adopt above-mentioned preferred scheme, user is by controlling control module, and setting says that some little sound amplifies more multiples, says that specific one section of voice messaging is converted to word and projects, the font of projection can also be controlled to zoom in or out.
As preferred scheme, also comprise voiceprint extraction module and certain database;
Described voiceprint extraction module is used for the voice messaging receiving setting according to the control of control module, and extracts voiceprint to described voice messaging, and described voiceprint is sent to certain database;
Described certain database is for preserving the voiceprint of voiceprint extraction module transfer; And with acquiring and identifying module two-way communication.
Adopt above-mentioned preferred scheme, achieve Selective recognition, after certain database preserves voiceprint, in use procedure afterwards, can select by smart machine object that you will listen attentively to and carry out special sound amplification and word amplifies and can send phonetic order to this equipment, or be managed by software function existing on intelligent glasses.
As preferred scheme, also comprise directed amplification module, described directed amplification module controls the voice messaging that acquiring and identifying module gathers specific direction and/or specific region.
As preferred scheme, also comprise mixed-media network modules mixed-media, related web content is sent to acquiring and identifying module and/or projection module according to the control of control module by described mixed-media network modules mixed-media.
Adopt above-mentioned preferred scheme, realize including but not limited to make a phone call by mixed-media network modules mixed-media, note, online, sees mail, and navigation, looks into weather forecast etc. various functions, can replace a kind of novel intelligent terminal equipment of smart mobile phone to a certain extent.
Accompanying drawing explanation
Fig. 1 is a kind of structured flowchart with the intelligent hearing aid of speech recognition and caption display function of the present invention;
Fig. 2 is a kind of structural representation with the intelligent hearing aid of speech recognition and caption display function described in the embodiment of the present invention.
In accompanying drawing, the list of parts representated by each label is as follows:
1, acquiring and identifying module, 2, voice amplification module, 3, message processing module, 4, projection module, 5, control module, 6, voiceprint extraction module, 7, certain database, 8, directed amplification module, 9, mixed-media network modules mixed-media.
Embodiment
Be described principle of the present invention and feature below in conjunction with accompanying drawing, example, only for explaining the present invention, is not intended to limit scope of the present invention.
As shown in Figure 1, a kind of intelligent hearing aid with speech recognition and caption display function of the present invention, comprises acquiring and identifying module 1, voice amplification module 2, message processing module 3 and projection module 4;
Described acquiring and identifying module 1 for gathering voice messaging, and carries out speech recognition to described voice messaging, and by the voice messaging synchronized transmission after described identification to voice amplification module 2 and message processing module 3;
Described voice amplification module 2 is gone out for the voice messaging of reception being amplified also directional transmissions;
Word message after conversion for the voice messaging of reception is converted to Word message, and is sent to projection module 4 by described message processing module 3;
Described projection module 4 is for projecting to the retina of user by the Word message received.
Also comprise control module 5;
Described control module 5 receives the voice messaging that acquiring and identifying module 1 gathers, and is amplified by voice messaging according to presetting control voice amplification module 2;
Described control module 5 receives external control simultaneously, its external control comprises the control modes such as Non-follow control, phonetic order control, limbs instruction control, and the operating state of set information processing module 3 also realizes the manipulation various functions with the intelligent hearing aid of speech recognition and caption display function of the present invention;
Described control module 5 works according to external control projection module 4.
Also comprise voiceprint extraction module 6 and certain database 7;
Described voiceprint extraction module 6 for receiving the voice messaging of setting according to the control of control module 5, and extracts voiceprint to described voice messaging, and described voiceprint is sent to certain database 7;
The voiceprint that described certain database 7 is transmitted for preserving voiceprint extraction module 6; And with acquiring and identifying module 1 two-way communication.
Also comprise directed amplification module 8, described directed amplification module 8 controls the voice messaging that acquiring and identifying module 1 gathers specific direction and/or specific region.
Also comprise mixed-media network modules mixed-media 9, related web content is sent to acquiring and identifying module 1 and/or projection module 4 according to the control of control module 5 by described mixed-media network modules mixed-media 9.
A lot of hearing has the personage of obstacle, still undistinguished situation can be there is by when hearing aids, mostly, Tianting barrier person has the ability of word read-write, the person that listens to barrier often some word does not hear and causes understanding inaccurate to whole word, if simultaneously can auxiliary with the form being similar to captions in addition Text region, gather the sound heard, greatly can improve the hearing identification accuracy of the person that listens to barrier.
The technology realizability of this invention: current social belongs to science and technology and makes rapid progress, the stage of the development of explosion type, speech recognition technology also will welcome great development, and speech discrimination accuracy and speed will significantly improve, and accomplish that synchronous identification also should be matter of time.
Be example for a kind of embodiment of the present invention below, as shown in Figure 2, wherein acquiring and identifying module 1 and voice amplification module 2 adopt the outward appearance with the hearing aids of In-Ear sound intensifier to be arranged in the ear of user, and projection module 4 is set to the outward appearance of glasses, the CUP processor as message processing module 3 outward appearance is provided with between glasses and hearing aids, conveniently wear for user, a kind of concrete use flow process with the intelligent hearing aid of speech recognition and caption display function of the present invention comprises the following steps:
Step 1: acquiring and identifying module receives extraneous voice messaging, carries out speech recognition to said voice messaging;
Step 2: acquiring and identifying module extracts the voiceprint in certain database, compares identify with the voice messaging received;
Step 3: judge whether voice messaging mates with voiceprint, if so, by voice messaging synchronized transmission to voice amplification module and message processing module; Otherwise, select voice messaging to be sent to voice amplification module and message processing module according to the control of control module;
Step 4: voice messaging is converted to Word message and is sent to projection module by message processing module;
Step 5: voice amplification module is transferred in the ear of user after being amplified by voice messaging; Simultaneously projection module by the Word message synchronized projection of correspondence on the retina of user.
By the chip processing system that this system of speech recognition system on the terminal equipment of this Intelligent visible hearing aids is exactly built-in, be connected with the sound collector of hearing aids, the work of voice recognition processing is synchronously carried out after receiving acoustic information, and be converted into Word message, this all completes this work by chip processor, Text region is carried out to the voice messaging that hearing aids collects, and the intelligent glasses by being connected with hearing aids, the word content synchronized projection identified is carried out retinal projection to amphiblestroid regional area present Google glasses (google glass), help those hearing to have obstacle but there is the people of literacy, while hearing aid voice emplifying, also the hearing identification accuracy of Hearing Impaired can be improved by captions, wish and self-confidence is exchanged with what improve the person that listens to barrier and people, help listens to barrier, and person exchanges with other people as Subjects With Normal Hearing, improve the quality of living.
Other functions that this wearable device possesses:
Selective recognition, the vocal print unique to everyone is the same with fingerprint, everyone vocal print is different, so the people filed can be wanted to set up vocal print archives for you, exist on chip processor, selectivity storage can be carried out or be connected on computer to be stored by computer software by phonetic order, add in certain database, in use procedure afterwards, can select by smart machine object that you will listen attentively to and carry out special sound amplification and word amplifies and can send phonetic order to this equipment, or managed by software function existing on intelligent glasses.
Directed amplification identifies that some smart machines rely on gyroscope and GPS location can find out orientation first at present, then by turning to this orientation just can the directed acoustic information amplifying this region, existing hearing aids has had this direction function, and the sound in that region that he wants to hear does not reduce the sound in other regions simultaneously yet to allow the person that listens to barrier hear more clearly.
The region and the scene that need noise reduction is selected easily, with the accuracy of identification that improves one's hearing by intelligent function.
Convenient handling by software simulating with smart mobile phone, to listening to barrier, person uses the facility providing maximum magnitude during hearing aids.
The technology of existing phonetic order is also gradually improved, by can send after hearing aids voice collecting phonetic order to complete on this intelligent terminal be with various application program, include but not limited to make a phone call, note, online, sees mail, navigation, look into weather forecast etc. various functions, can replace a kind of novel intelligent terminal equipment of smart mobile phone to a certain extent.Realized by computer chip and software, just as the existing SIRI function of iphone.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (5)
1. there is an intelligent hearing aid for speech recognition and caption display function, it is characterized in that, comprise acquiring and identifying module, voice amplification module, message processing module and projection module;
Described acquiring and identifying module for gathering voice messaging, and carries out speech recognition to described voice messaging, and by the voice messaging synchronized transmission after described identification to voice amplification module and message processing module;
Described voice amplification module is used for the voice messaging of reception to amplify and directional transmissions is gone out;
Described message processing module is used for the voice messaging of reception to be converted to Word message, and the Word message after conversion is sent to projection module;
Described projection module is for projecting to the retina of user by the Word message received.
2. a kind of intelligent hearing aid with speech recognition and caption display function according to claim 1, is characterized in that, also comprise control module;
Described control module receives the voice messaging that acquiring and identifying module gathers, and is amplified by voice messaging according to presetting control voice amplification module;
Described control module receives external control simultaneously, the operating state of set information processing module; Described control module works according to external control projection module.
3. a kind of intelligent hearing aid with speech recognition and caption display function according to claim 2, is characterized in that, also comprise voiceprint extraction module and certain database;
Described voiceprint extraction module is used for the voice messaging receiving setting according to the control of control module, and extracts voiceprint to described voice messaging, and described voiceprint is sent to certain database;
Described certain database is for preserving the voiceprint of voiceprint extraction module transfer; And with acquiring and identifying module two-way communication.
4. a kind of intelligent hearing aid with speech recognition and caption display function according to claim 3, it is characterized in that, also comprise directed amplification module, described directed amplification module controls the voice messaging that acquiring and identifying module gathers specific direction and/or specific region.
5. a kind of intelligent hearing aid with speech recognition and caption display function according to any one of claim 1-4, it is characterized in that, also comprise mixed-media network modules mixed-media, related web content is sent to acquiring and identifying module and/or projection module according to the control of control module by described mixed-media network modules mixed-media.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410153639.3A CN105007557A (en) | 2014-04-16 | 2014-04-16 | Intelligent hearing aid with voice identification and subtitle display functions |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410153639.3A CN105007557A (en) | 2014-04-16 | 2014-04-16 | Intelligent hearing aid with voice identification and subtitle display functions |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105007557A true CN105007557A (en) | 2015-10-28 |
Family
ID=54380037
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410153639.3A Pending CN105007557A (en) | 2014-04-16 | 2014-04-16 | Intelligent hearing aid with voice identification and subtitle display functions |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105007557A (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105916090A (en) * | 2016-05-31 | 2016-08-31 | 成都九十度工业产品设计有限公司 | Hearing aid system based on intelligent speech recognition technology |
CN106100942A (en) * | 2016-06-14 | 2016-11-09 | 安徽我要遛遛信息技术有限公司 | Household electrical appliance Internet of things system |
CN106816151A (en) * | 2016-12-19 | 2017-06-09 | 广东小天才科技有限公司 | A kind of captions alignment methods and device |
CN106847290A (en) * | 2017-04-18 | 2017-06-13 | 哈尔滨理工大学 | A kind of Embedded Speech Recognition System auditory prosthesis |
CN109151693A (en) * | 2018-08-24 | 2019-01-04 | 深圳和而泰小家电智能科技有限公司 | A kind of hearing aid control method and relevant device |
CN109616122A (en) * | 2018-12-25 | 2019-04-12 | 王让利 | A kind of visualization hearing aid |
CN110798789A (en) * | 2018-08-03 | 2020-02-14 | 张伟明 | Hearing aid and method of use |
CN111127827A (en) * | 2019-12-27 | 2020-05-08 | 钟楷文 | Life assisting system for deaf and hearing-impaired patients |
CN111640448A (en) * | 2020-06-03 | 2020-09-08 | 山西见声科技有限公司 | Audio-visual auxiliary method and system based on voice enhancement |
CN111751995A (en) * | 2020-06-11 | 2020-10-09 | 重庆工业职业技术学院 | Sound visualization monocular head-mounted AR (augmented reality) glasses device and implementation method thereof |
CN112599130A (en) * | 2020-12-03 | 2021-04-02 | 安徽宝信信息科技有限公司 | Intelligent conference system based on intelligent screen |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1822723A (en) * | 2005-02-14 | 2006-08-23 | 西门子测听技术有限责任公司 | Method for adjusting a hearing aid, hearing aid and mobile control unit for the adjustment of a hearing aid |
US20070052672A1 (en) * | 2005-09-08 | 2007-03-08 | Swisscom Mobile Ag | Communication device, system and method |
CN101695147A (en) * | 2009-05-27 | 2010-04-14 | 明展生医科技股份有限公司 | Hearing aid system |
CN201518084U (en) * | 2009-03-25 | 2010-06-30 | 胡礼斌 | Spectacle having function of hearing aid |
CN102165795A (en) * | 2008-09-25 | 2011-08-24 | 阿尔卡特朗讯美国公司 | Self-steering directional hearing aid and method of operation thereof |
CN202979040U (en) * | 2012-07-31 | 2013-06-05 | 陈永科 | Mobile phone voiceprint identification system |
CN103222283A (en) * | 2010-11-19 | 2013-07-24 | Jacoti有限公司 | Personal communication device with hearing support and method for providing the same |
CN203233539U (en) * | 2013-04-19 | 2013-10-09 | 北京亮耳听力技术有限公司 | Wireless dynamic receiving and displaying system on hearing aid |
-
2014
- 2014-04-16 CN CN201410153639.3A patent/CN105007557A/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1822723A (en) * | 2005-02-14 | 2006-08-23 | 西门子测听技术有限责任公司 | Method for adjusting a hearing aid, hearing aid and mobile control unit for the adjustment of a hearing aid |
US20070052672A1 (en) * | 2005-09-08 | 2007-03-08 | Swisscom Mobile Ag | Communication device, system and method |
CN102165795A (en) * | 2008-09-25 | 2011-08-24 | 阿尔卡特朗讯美国公司 | Self-steering directional hearing aid and method of operation thereof |
CN201518084U (en) * | 2009-03-25 | 2010-06-30 | 胡礼斌 | Spectacle having function of hearing aid |
CN101695147A (en) * | 2009-05-27 | 2010-04-14 | 明展生医科技股份有限公司 | Hearing aid system |
CN103222283A (en) * | 2010-11-19 | 2013-07-24 | Jacoti有限公司 | Personal communication device with hearing support and method for providing the same |
CN202979040U (en) * | 2012-07-31 | 2013-06-05 | 陈永科 | Mobile phone voiceprint identification system |
CN203233539U (en) * | 2013-04-19 | 2013-10-09 | 北京亮耳听力技术有限公司 | Wireless dynamic receiving and displaying system on hearing aid |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105916090B (en) * | 2016-05-31 | 2019-05-07 | 成都九十度工业产品设计有限公司 | A kind of hearing aid device system based on intelligent speech recognition technology |
CN105916090A (en) * | 2016-05-31 | 2016-08-31 | 成都九十度工业产品设计有限公司 | Hearing aid system based on intelligent speech recognition technology |
CN106100942A (en) * | 2016-06-14 | 2016-11-09 | 安徽我要遛遛信息技术有限公司 | Household electrical appliance Internet of things system |
CN106816151B (en) * | 2016-12-19 | 2020-07-28 | 广东小天才科技有限公司 | Subtitle alignment method and device |
CN106816151A (en) * | 2016-12-19 | 2017-06-09 | 广东小天才科技有限公司 | A kind of captions alignment methods and device |
CN106847290A (en) * | 2017-04-18 | 2017-06-13 | 哈尔滨理工大学 | A kind of Embedded Speech Recognition System auditory prosthesis |
CN110798789A (en) * | 2018-08-03 | 2020-02-14 | 张伟明 | Hearing aid and method of use |
CN109151693A (en) * | 2018-08-24 | 2019-01-04 | 深圳和而泰小家电智能科技有限公司 | A kind of hearing aid control method and relevant device |
CN109616122A (en) * | 2018-12-25 | 2019-04-12 | 王让利 | A kind of visualization hearing aid |
CN111127827A (en) * | 2019-12-27 | 2020-05-08 | 钟楷文 | Life assisting system for deaf and hearing-impaired patients |
CN111640448A (en) * | 2020-06-03 | 2020-09-08 | 山西见声科技有限公司 | Audio-visual auxiliary method and system based on voice enhancement |
CN111751995A (en) * | 2020-06-11 | 2020-10-09 | 重庆工业职业技术学院 | Sound visualization monocular head-mounted AR (augmented reality) glasses device and implementation method thereof |
CN112599130A (en) * | 2020-12-03 | 2021-04-02 | 安徽宝信信息科技有限公司 | Intelligent conference system based on intelligent screen |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105007557A (en) | Intelligent hearing aid with voice identification and subtitle display functions | |
US9843678B2 (en) | Visual assistance systems and related methods | |
KR20170033641A (en) | Electronic device and method for controlling an operation thereof | |
CN107231473B (en) | Audio output regulation and control method, equipment and computer readable storage medium | |
CN106936987B (en) | Method and device capable of identifying voice source of Bluetooth headset | |
US9083808B2 (en) | Unknown speaker identification system | |
CN109618263B (en) | Head/neck inclination angle detection method, device and system and wireless earphone controller | |
US11528568B1 (en) | Assisted hearing aid with synthetic substitution | |
US10453459B2 (en) | Interpreting assistant system | |
CN109257498B (en) | Sound processing method and mobile terminal | |
CN108111698B (en) | Incoming call reminding method, intelligent device and computer readable storage medium | |
CN103618835A (en) | Method and system for automatically switching scene mode according to magnitude of peripheral noise | |
US20160366528A1 (en) | Communication system, audio server, and method for operating a communication system | |
CN110147557A (en) | The charging box and storage medium of a kind of interpretation method, system and wireless headset | |
CN108415905A (en) | Real time translating method, intelligent glasses and computer readable storage medium | |
JP2021150946A (en) | Wireless earphone device and method for using the same | |
CN202772966U (en) | Mobile phone having global barrier-free communication function | |
CN110915239B (en) | On-line automatic audio transcription for hearing aid users | |
CN106205292A (en) | One listens barrier crowd to use Intelligent multifunctional electronic wrist-watch | |
CN107979686A (en) | A kind of system for realizing real-time voice intertranslation | |
CN109873894B (en) | Volume adjusting method and mobile terminal | |
CN107580785A (en) | Wear-type audio collection module | |
CN105187471B (en) | Information switching method and system | |
CN107145228B (en) | Bone conduction earphone-based interaction method and system | |
CN108877799A (en) | A kind of phonetic controller and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151028 |
|
RJ01 | Rejection of invention patent application after publication |