CN109166574B - Information grabbing and broadcasting system for endowment robot - Google Patents
Information grabbing and broadcasting system for endowment robot Download PDFInfo
- Publication number
- CN109166574B CN109166574B CN201810829472.6A CN201810829472A CN109166574B CN 109166574 B CN109166574 B CN 109166574B CN 201810829472 A CN201810829472 A CN 201810829472A CN 109166574 B CN109166574 B CN 109166574B
- Authority
- CN
- China
- Prior art keywords
- news
- information
- voice
- voice information
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The invention relates to the field of old people service, in particular to an information grabbing and broadcasting system for an old people care robot, which comprises: the system comprises an acquisition terminal, a server and a news broadcasting terminal; the collecting terminal is used for collecting voice information of the old people during speaking in life, then sending the collected voice information to the server, the server configures news information interesting to the old people according to the received voice information after receiving the voice information sent by the collecting terminal and sends the news information to the news broadcasting terminal, and the news broadcasting terminal carries out voice broadcasting on the news information after receiving the news information sent by the collecting terminal. The scheme solves the problem that the old people find inconvenient history news which the old people want to see from the television.
Description
Technical Field
The invention relates to the field of old people service, in particular to an information grabbing and broadcasting system for an old people robot.
Background
With the development of society and the decomposition of traditional family model, more and more elderly people step into the line of "empty nesters". Many old people are alone at home because children leave home for reasons of work, study, marriage and the like and do not live together with the old people for a long time, the old people living alone at home are quite lonely, and the daily life is often only that people watch news, watch TV shows, chat with the old people of the same age nearby home or play cards.
And the old man is when being at home, accompany their news and TV drama, but because the old man often can suffer from presbyopia after old, often appear seeing clearly or can not operate scheduling problem when using intelligent instrument such as cell-phone to look over news, if the old man uses TV to carry out news look over and the old man looks over what look over news looks over news is that the news is live broadcast, in case there is the news condition of missing to look over, the old man just can use the mode of looking back to look over the news that wants to look over, but now the TV is to can look back the function in can to look back the restriction of looking back the time, the old man just can't find the news that oneself wanted to look over the day that can look back promptly. The old man uses the TV to watch news can appear looking over oneself and neglecting the mode of looking over when looking over and look over news of looking over again, will appear looking over that the information volume is big or looking over news surpass the time quantum that can look over and unable look over scheduling problem, look over news for the old man and bring a lot of inconveniences. And when the old man watches the news on-air, not every news is the news that the old man wants to watch, so that the old man will easily feel boring and lonely when broadcasting the news that the old man does not want to watch.
Disclosure of Invention
The invention aims to provide an information grabbing and broadcasting system for an elderly people robot to solve the problem that the elderly people are inconvenient to find news which the elderly people want to see from a television.
The basic scheme provided by the invention is as follows: a information snatchs and reports system for endowment robot includes: the system comprises an acquisition terminal, a server and a news broadcasting terminal;
the collecting terminal is used for collecting voice information of the old people when speaking in life, then the collected voice information is sent to the server, the server receives the voice information sent by the collecting terminal, configures news information interesting to the old people according to the received voice information and sends the news information to the news broadcasting terminal, and the news broadcasting terminal receives the news information sent by the collecting terminal and then carries out voice broadcasting on the news information.
The working principle and the advantages of the invention are as follows: the old man gathers the speech information of old man through collection terminal when talking with friend, family, then sends the speech information who gathers for the server, and the server selects the news information that is fit for the old man according to received speech information after receiving the speech information that collection terminal sent and sends for news report terminal carries out the voice broadcast of news information.
Compared with the prior art, the scheme has the advantages that news information broadcasted to the old is broadcasted selectively, and the broadcasted news content is selected according to the speaking content of the old in life, so that the satisfaction degree of the old on the news content can be increased by the selected news, the lonely emotion caused by dislike of the old on the news content when the old watches the news can be reduced, the happiness of the old can be increased, meanwhile, the old does not need to screen the news content to be checked by himself, and the usage is convenient; in addition, news is played in a voice mode, and the situation that the old people cannot see news contents clearly due to illness conditions such as presbyopia and the like is avoided.
Further, the server comprises a collection object selection module, and the collection object selection module is used for screening out the voice information belonging to the service object in the voice information collected by the collection terminal.
The reason for identifying the voice information of the old people is to avoid carrying out voice acquisition on the voice of other people as an acquisition object when the old people converses with other people, and to ensure that the acquired news information after the voice information is screened is the news information suitable for the old people.
Further, the server further comprises a voice analysis module, the voice analysis module is used for selecting the voice information of the news content related to the voice information screened by the acquisition object selection module, and then the server performs news configuration according to the selected voice information.
The voice information is analyzed through the voice analysis module, and the voice information related to the voice information is selected from the voice information of the old people as the selected object to configure news, so that the configured news meets the requirements and the hobbies of the old people.
Furthermore, the server also comprises a news configuration module, the news configuration module is used for configuring news according to the voice information selected by the voice analysis module, the news configuration content comprises the configuration of real-time news and historical news, and the configured news information is sent to the news broadcasting terminal to broadcast the corresponding news.
When configuring news, configuring both real-time news and historical news, wherein the reason for configuring the historical news is that the news contents which are interested by old people are live broadcast in news, and the configuration of the real-time news is convenient for the old people to know the real-time news.
And the server further comprises an additional news analysis module, the additional news analysis module is used for selecting the voice information related to the news from the remaining voice information selected by the acquisition object selection module and then sending the voice information to the news configuration module, and the news configuration module selects the corresponding additional news information according to the content of the voice information and sends the additional news information to the news broadcast terminal for playing after receiving the voice information sent by the additional news analysis module.
The voice information of other people who gathers the terminal acquisition carries out the analysis, carries out the analysis to old man friend's voice information promptly, alright know the news content that old man friend liked, plays the back with these news contents through the news report terminal, can increase the old man and know the news information that friend liked, and the old man of being convenient for and friend have more can common topic of exchanging.
Furthermore, a selective playing panel is arranged on the news broadcasting terminal and used for selecting news played by the old man on the news broadcasting terminal.
The news content played by the news broadcasting terminal is selected through the selective playing panel, so that the situation that the old people do not like the news content liked by friends can be selectively played is avoided.
Drawings
Fig. 1 is a logic block diagram of an information capturing and broadcasting system for an elderly people robot according to an embodiment of the present invention.
Detailed Description
The following is further detailed by the specific embodiments:
example one
The embodiment is basically as shown in the attached figure 1: a information snatchs and reports system for endowment robot includes: server, news report terminal and be used for the collection terminal that the old man carried about, the server respectively with gather through wireless communication module signal connection between terminal and the news report terminal, wireless communication module chooses for use the WIFI communication module of current Risym brand in this embodiment.
The acquisition terminal includes:
and the voice acquisition module is used for acquiring voice information of the old in life and then sending the acquired voice information to the acquisition object selection module.
The server includes:
and the database is used for storing all data information in the server. The database comprises a news information storage module, a news keyword storage module, a trigger keyword storage module and a trigger keyword intelligent storage module, wherein the news keyword storage module is used for storing news keywords, the trigger keyword storage module is used for storing basic trigger keywords, before the triggering keyword storage module is used, vocabularies with prompting functions such as 'unclear', 'unknown', 'wanted to know' and 'wanted to watch' are stored in the trigger keyword storage module as the basic trigger keywords, and the trigger keyword intelligent storage module is used for storing the triggering keywords after the words are extracted from the news keywords twice in voices input by old people.
And the news information acquisition module is used for acquiring daily news information and storing the daily news information in the news information storage module for storage, and the news information can be acquired from the Internet or can cooperate with a television station to acquire the latest news.
And the news keyword updating module is used for extracting news keywords related to the news of the same day from a news website of the existing browser every day and storing the news keywords in the news keyword storage module for storage.
The system comprises a collecting object selecting module, a voice analyzing module and a voice analyzing module, wherein the collecting object selecting module is used for selecting an object needing voice collection, when the object needing voice collection is selected, voice information input by the old man needing service is collected, then voiceprint characteristics are extracted according to the input voice information, a model is trained according to the extracted voiceprint characteristics, and a voiceprint model library is established. The reason for identifying the voice information of the old people is to avoid carrying out voice collection by taking the voice of other people as a collection object when the old people converses with the other people. In addition, selected elderly voices can be recognized by the existing voiceprint collector of the company speak.
And the voice analysis module is used for receiving the voice information sent by the acquisition object selection module, then analyzing according to the received voice information, selecting the voice information related to the news content in the voice during voice analysis, and sending the selected voice information to the news configuration module. When voice information is selected, the voice information is matched with the trigger keywords stored in the trigger keyword intelligent storage module, if the trigger keywords appear in the voice information, the voice information after the trigger keywords appear is matched with the news keywords in the news keyword storage module, and when the input voice information contains the trigger keywords and the news keywords, the voice information containing the trigger keywords or the news keywords is sent to the news configuration module. For example, if the voice information is ' i do not know that B meeting is provided with care of the aged ', if ' do not know ' is stored in the trigger keyword intelligent storage module as the trigger keyword, the voice information can be successfully matched with the trigger keyword in the trigger keyword intelligent storage module, at this time, when the voice information behind ' do not know ' is matched with the news keyword stored in the news keyword storage module, if ' B meeting ' is stored in the news keyword storage module as the news keyword, ' do not know ' about ' B meeting is provided with care of the aged ' yet, the voice information behind ' and the news keyword stored in the news keyword storage module are successfully matched, and at this time, when the news configuration module performs news configuration, the news related to B meeting is configured to the corresponding old people.
And the trigger keyword combination module is used for processing the voice information containing the news keywords in the voice information when the voice analysis module analyzes the voice information, extracting the voice information leading out the news keywords in the same sentence in front of the news keywords (the pause time when the old is speaking is used as a recognition mark of a broken sentence, the voice information between two pauses is recognized as the same sentence, and the specific pause time can be set according to the speaking habits of the old) when the voice processing is carried out, matching the extracted voice information leading out the news keywords with the basic trigger keywords stored in the trigger keyword storage module, and storing the voice information leading out the news keywords into the trigger keyword storage module as the basic trigger keywords when the same basic trigger keywords are not found in the trigger keyword storage module. When the triggering keyword combination module extracts the voice information of the extracted news keywords again, the extracted voice information is matched with the basic triggering keywords stored in the triggering keyword storage module, and if the basic triggering keywords with the same content are stored in the triggering keyword storage module, the voice information is sent to the triggering keyword intelligent storage module to be stored. For example, if the speech information is "i do not know that B meeting is mentioned as old age", if "B meeting" is stored in the news keyword storage module as a news keyword, then "i do not know" in the speech information in front of "B meeting" is stored in the trigger keyword storage module as a basic trigger keyword, and when the trigger keyword combination module extracts the speech information that draws the news keyword again, the extracted speech information is "when i do not know that a meeting is called" and matching the speech information with the basic trigger keyword in the trigger keyword storage module is successful, at this time, "i do not know" is stored in the trigger keyword intelligent storage module as the trigger keyword.
And the news configuration module is used for receiving the voice information sent by the voice analysis module, searching related news information in the news information storage module according to the received voice information after receiving the voice information to configure news, and sending the configured news information to the news broadcasting terminal. When configuring news, not only real-time news but also historical news can be configured, and the judgment criterion of the historical news is that the news which is released by the news is related in the voice information received by the news configuration module. The historical news configuration is mainly performed when the received voice information contains the historical news related information and the information related information is expected to be known, and the configuration of the real-time news is performed when the received voice information contains the news related information, and the corresponding news configuration is broadcasted to the corresponding news broadcasting terminal on the current date of releasing the news. For example, if the voice information received by the news configuration module is "i do not know that B meeting refers to endowment", if the time for receiving the voice information is 7 months in 2018 and B meeting is march every year, then the B meeting information that the old people want to know belongs to historical news information, and B meeting in 2018 refers to endowment, then the news configuration module should configure the B meeting related news information called in 2018 in 3 months to the corresponding news broadcast terminal when performing news configuration; in addition, as the news information related to the meeting B is related to the voice information received by the news configuration module, the fact that the old people are interested in the meeting B information is indicated, and therefore the news configuration module configures the latest news of the meeting B to the news broadcasting terminal for broadcasting when the meeting B is held in 2019.
The news broadcasts the terminal including:
and the news voice broadcasting module is used for receiving the news information sent by the news configuration module, carrying out voice broadcasting on the real-time news and the historical news according to the received news information, and broadcasting the real-time news firstly and then broadcasting the historical news when broadcasting the news information.
When the method is implemented, the method comprises the following steps:
1. collecting voice of the old
A voice acquisition module in the acquisition terminal acquires voice information of the old when speaking in life and then sends the acquired voice information to an acquisition object selection module.
2. Acquisition object selection
After the acquisition object selection module in the server receives the voice information sent by the voice acquisition module, voiceprint features are extracted according to the received voice information, a model is trained according to the extracted voiceprint features, and a voiceprint model library is established, so that when the old person speaks, the voice information of the old person during speaking is compared with the voice stored in the voiceprint model library, and the old person who speaks is identified. The reason for identifying the voice information of the old people is to avoid carrying out voice collection on the voice of other people as a collection object when the old people converses with other people, and then sending the collected voice information to the voice analysis module.
3. Speech analysis
And after receiving the voice information sent by the acquisition object selection module, a voice analysis module in the server analyzes the voice information according to the received voice information, selects the voice information related to the news content in the voice when performing voice analysis, and sends the selected voice information to a news configuration module.
4. News screening
And after receiving the voice information sent by the voice analysis module, a news configuration module in the server configures news according to the received voice information and sends the configured news information to the news broadcasting terminal. When configuring news, not only real-time news but also historical news are configured, and the judgment criterion of the historical news is that the news which is already released is related in the voice information received by the news configuration module. The historical news configuration is mainly performed when the received voice information contains the historical news related information and the information related information which is expected to be known, and the real-time news configuration is performed when the received voice information contains the news related information, and the corresponding news configuration is broadcasted to the corresponding news broadcasting terminal on the news release day.
5. News voice broadcast
After a news voice broadcast module in the news broadcast terminal receives news information sent by a news configuration module, voice broadcast is carried out on real-time news and historical news according to the received news information, and when the news information is broadcast, the real-time news is firstly broadcast, and then the historical news is broadcast.
Example two
The difference between the second embodiment and the first embodiment is that the server in the second embodiment further includes:
and the additional news analysis module is used for matching the remaining voice information selected by the acquisition object selection module with the news keywords stored in the news keyword storage module, then sending the successfully matched voice information to the news configuration module, matching the received voice information with the news information stored in the news information storage module after the news configuration module receives the voice information sent by the additional news analysis module, and sending the successfully matched news information as the additional news information to the news broadcasting terminal for playing. The selected remaining speech information of module selection is selected to the collection object and is analyzed, the speech information of old man and friend carries out the analysis promptly, alright know the news content that old man and friend liked, broadcast the back with these news contents through the news report terminal, can increase the old man and know the news information that friend liked, be convenient for old man and friend have more can common topic of exchanging.
In addition, a selective playing panel can be arranged on the news broadcasting terminal to enable the old people to selectively listen to real-time news, historical news or additional news, and selective playing can be avoided when the old people do not like the news contents liked by friends.
The foregoing is merely an example of the present invention, and common general knowledge in the field of known specific structures and characteristics is not described herein in any greater extent than that known in the art at the filing date or prior to the priority date of the application, so that those skilled in the art can now appreciate that all of the above-described techniques in this field and have the ability to apply routine experimentation before this date can be combined with one or more of the present teachings to complete and implement the present invention, and that certain typical known structures or known methods do not pose any impediments to the implementation of the present invention by those skilled in the art. It should be noted that, for those skilled in the art, without departing from the structure of the present invention, several changes and modifications can be made, which should also be regarded as the protection scope of the present invention, and these will not affect the effect of the implementation of the present invention and the practicability of the patent. The scope of the claims of the present application shall be determined by the contents of the claims, and the description of the embodiments and the like in the specification shall be used to explain the contents of the claims.
Claims (4)
1. A information snatchs and reports system for endowment robot, its characterized in that includes: the system comprises an acquisition terminal, a server and a news broadcasting terminal;
the system comprises a collecting terminal, a server, a news broadcasting terminal and a voice broadcasting terminal, wherein the collecting terminal is used for collecting voice information when the old people speak in life, then sending the collected voice information to the server, the server configures news information which is interesting to the old people according to the received voice information after receiving the voice information sent by the collecting terminal and sends the news information to the news broadcasting terminal, and the news broadcasting terminal carries out voice broadcasting on the news information after receiving the news information sent by the collecting terminal;
the server comprises a collected object selection module, a news configuration module and an additional news analysis module, wherein the collected object selection module is used for screening out voice information which belongs to a service object in voice information collected by a collection terminal, the additional news analysis module is used for selecting voice information related to news from the remaining voice information selected by the collected object selection module and then sending the voice information to the news configuration module, and the news configuration module selects corresponding additional news information according to the content of the voice information and sends the additional news information to the news broadcasting terminal for playing after receiving the voice information sent by the additional news analysis module.
2. The information grabbing and broadcasting system for the endowment robot as claimed in claim 1, wherein: the server also comprises a voice analysis module, wherein the voice analysis module is used for selecting the voice information of the news content related to the voice information screened by the acquisition object selection module, and then the server performs news configuration according to the selected voice information.
3. The information grabbing and broadcasting system for the endowment robot as claimed in claim 2, characterized in that: the news configuration module is used for configuring news according to the voice information selected by the voice analysis module, the news configuration content comprises configuration of real-time news and historical news, and then the configured news information is sent to the news broadcasting terminal to broadcast the corresponding news.
4. The information grabbing and broadcasting system for the endowment robot as claimed in any one of claims 1 to 3, wherein: the news broadcasting terminal is provided with a selective broadcasting panel, and the selective broadcasting panel is used for selecting news played by the old man on the news broadcasting terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810829472.6A CN109166574B (en) | 2018-07-25 | 2018-07-25 | Information grabbing and broadcasting system for endowment robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810829472.6A CN109166574B (en) | 2018-07-25 | 2018-07-25 | Information grabbing and broadcasting system for endowment robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109166574A CN109166574A (en) | 2019-01-08 |
| CN109166574B true CN109166574B (en) | 2022-09-30 |
Family
ID=64898168
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810829472.6A Active CN109166574B (en) | 2018-07-25 | 2018-07-25 | Information grabbing and broadcasting system for endowment robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109166574B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110519669A (en) * | 2019-07-24 | 2019-11-29 | 合肥博略文化传播有限公司 | Intelligent information unit |
| CN112086091A (en) * | 2020-09-18 | 2020-12-15 | 南京孝德智能科技有限公司 | Intelligent endowment service system and method |
| CN113421465A (en) * | 2021-06-29 | 2021-09-21 | 西安财经大学 | News teaching display device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6332120B1 (en) * | 1999-04-20 | 2001-12-18 | Solana Technology Development Corporation | Broadcast speech recognition system for keyword monitoring |
| JP2001188784A (en) * | 1999-12-28 | 2001-07-10 | Sony Corp | Device and method for processing conversation and recording medium |
| US10055681B2 (en) * | 2013-10-31 | 2018-08-21 | Verint Americas Inc. | Mapping actions and objects to tasks |
| TWI555393B (en) * | 2015-08-24 | 2016-10-21 | 晨星半導體股份有限公司 | Tv program smart playing method and controlling device thereof |
| CN107885441A (en) * | 2017-12-06 | 2018-04-06 | 子歌教育机器人（深圳）有限公司 | News report method, system and the intelligent robot of intelligent robot |
-
2018
- 2018-07-25 CN CN201810829472.6A patent/CN109166574B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109166574A (en) | 2019-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106682090B (en) | Active interaction implementation device and method and intelligent voice interaction equipment | |
| CN109166574B (en) | Information grabbing and broadcasting system for endowment robot | |
| CN110085213B (en) | Audio abnormity monitoring method, device, equipment and storage medium | |
| CN104700835B (en) | The method and system of cable voice port is provided | |
| EP2247030B1 (en) | Intelligent conference call information agents | |
| CN107592578B (en) | Information processing method, device, terminal device and storage medium | |
| CN106331779B (en) | Method and system based on user preferences push main broadcaster during playing video | |
| DE102010054981B4 (en) | Context-sensitive, cloud-based telephony | |
| CN101267518B (en) | Method and system for extracting relevant information from content metadata | |
| US10916258B2 (en) | Audio channel monitoring by voice to keyword matching with notification | |
| CN106941619A (en) | Program prompting method, device and system based on artificial intelligence | |
| CN103095557A (en) | Instant messaging information voice output method and system | |
| CN109948603A (en) | A kind of social networks method for building up, social networks establish device and car-mounted terminal | |
| CN111683175B (en) | Method, device, equipment and storage medium for automatically answering incoming call | |
| CN106302933A (en) | Voice information whose processing method and terminal | |
| CN109313649B (en) | Method and apparatus for voice-based knowledge sharing for chat robots | |
| CN105872006A (en) | Appointment reminding system and appointment reminding method | |
| CN109271503A (en) | Intelligent answer method, apparatus, equipment and storage medium | |
| CN104217718A (en) | Method and system for voice recognition based on environmental parameter and group trend data | |
| KR101740059B1 (en) | Method and apparatus for providing time machine service based on social network service | |
| US11521626B2 (en) | Device, system and method for identifying a scene based on an ordered sequence of sounds captured in an environment | |
| CN106920546B (en) | Method and device for intelligently recognizing voice | |
| WO2017124719A1 (en) | Voice prompt method and apparatus | |
| CN107196979A (en) | Pre- system for prompting of calling out the numbers based on speech recognition | |
| CN106331781A (en) | Analysis push method and analysis push system based on household voice |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |