CN107146622B - Refrigerator, voice interaction system, method, computer device and readable storage medium - Google Patents

Refrigerator, voice interaction system, method, computer device and readable storage medium Download PDF

Info

Publication number
CN107146622B
CN107146622B CN201710461636.XA CN201710461636A CN107146622B CN 107146622 B CN107146622 B CN 107146622B CN 201710461636 A CN201710461636 A CN 201710461636A CN 107146622 B CN107146622 B CN 107146622B
Authority
CN
China
Prior art keywords
voice
text information
voice interaction
module
scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710461636.XA
Other languages
Chinese (zh)
Other versions
CN107146622A (en
Inventor
张俊
戴江
杨世清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Midea Intelligent Technologies Co Ltd
Original Assignee
Hefei Midea Intelligent Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei Midea Intelligent Technologies Co Ltd filed Critical Hefei Midea Intelligent Technologies Co Ltd
Priority to CN201710461636.XA priority Critical patent/CN107146622B/en
Publication of CN107146622A publication Critical patent/CN107146622A/en
Application granted granted Critical
Publication of CN107146622B publication Critical patent/CN107146622B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D11/00Self-contained movable devices, e.g. domestic refrigerators
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/003Arrangement or mounting of control or safety devices for movable devices
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

The invention provides a refrigerator, a voice interaction system, a voice interaction method, computer equipment and a computer readable storage medium, wherein the voice interaction system comprises: the voice acquisition module is used for acquiring and preprocessing a voice signal and sending the preprocessed voice signal to the voice recognition module; the voice recognition module is used for converting the preprocessed voice signals into text information and respectively sending the text information to the processing module and the semantic understanding module; the semantic understanding module is used for converting the text information into a semantic result and sending the semantic result to the processing module; and the processing module is used for inquiring and combining the associated information base according to the text information and the semantic result so as to execute the voice interaction task corresponding to the voice signal. The invention presets an interactive scene, more accurately understands the language of the user, realizes more natural man-machine interaction, improves the interactive experience degree and improves the intellectualization of the refrigerator.

Description

Refrigerator, voice interaction system, method, computer device and readable storage medium
Technical Field
The invention relates to the technical field of refrigerators, in particular to a refrigerator, a voice interaction system, a voice interaction method, computer equipment and a computer readable storage medium.
Background
Along with the improvement of living standard of people, intelligent household appliances gradually enter the lives of people, however, in the refrigerator industry at present, most of control modes are mainly traditional modes, the intelligent degree and the automatic degree are still relatively low, and the intelligent requirement of a user on the refrigerator can not be met. The traditional control mode replaced by the voice assistant is a future development trend, the recognition rate of the voice recognition reaches a higher level at present, but the human-computer interaction through the recognition result also needs semantic understanding, and a larger distance is left from the actual requirement.
Therefore, how to make the refrigerator understand the user language more accurately, realize more natural man-machine interaction, and improve the intellectualization of the refrigerator is an urgent problem to be solved.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art or the related art.
Therefore, the first objective of the present invention is to provide a voice interactive system.
The second objective of the present invention is to provide a voice interactive system method.
A third object of the invention is to propose a computer device.
A fourth object of the invention is to propose a computer-readable storage medium.
A fifth object of the present invention is to provide a refrigerator.
In view of the above, according to an object of the present invention, there is provided a voice interactive system, comprising: the voice acquisition module is used for acquiring and preprocessing a voice signal and sending the preprocessed voice signal to the voice recognition module; the voice recognition module is used for converting the preprocessed voice signals into text information and respectively sending the text information to the processing module and the semantic understanding module; the semantic understanding module is used for converting the text information into a semantic result and sending the semantic result to the processing module; and the processing module is used for inquiring and combining the associated information base according to the text information and the semantic result so as to execute the voice interaction task corresponding to the voice signal.
According to the voice interaction system provided by the invention, the voice acquisition module acquires the voice signal sent by the user and preprocesses the voice signal, so that the subsequent voice recognition result is more accurate. And then, the preprocessed voice signals are sent to a voice recognition module, and the voice recognition module converts the preprocessed voice signals into corresponding text information, so that voice recognition is realized. The voice recognition module sends the text information to the processing module and the semantic understanding module respectively, the semantic understanding module matches the text information to a prestored application scene, and in the matching process, the matching can be carried out according to the text information, the matching can also be carried out after user requirement association is carried out on the text information, and the matching can also be carried out according to the memory of user historical voice information, so that the user language can be more accurately understood. And then subdividing the application scene, extracting key words of the text information, outputting the application scene and the key words to a processing module as semantic comprehension, inquiring the processing module according to the received text information and the semantic comprehension and combining with a related information base, and sending a control instruction to control the refrigerator to complete a voice interaction task corresponding to a user voice signal, so that more natural human-computer interaction is realized, the human-computer interaction experience degree is improved, and the intelligence of the refrigerator is improved.
The voice interaction system according to the present invention may further have the following technical features:
in the above technical solution, preferably, the information base includes: a local information base and/or a server side information base.
In the technical scheme, the information base can be a local information base, so that the capacity of the local information base is large, information required by a user can be stored, and the stored content can be updated according to the requirements of the user at different stages. The information base can also be a server information base, and the processing module can be connected to the server information base through a network to inquire mass information and realize more interactive tasks.
In any of the above technical solutions, preferably, the semantic understanding module includes: the application scene storage module is used for storing application scenes of the voice interaction task, and the application scenes comprise one or a combination of the following: the system comprises a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene.
In the technical scheme, the semantic understanding module stores the application scene of the voice interaction task in advance, so that the refrigerator realizes more natural man-machine interaction in a special kitchen scene. The application scene comprises the following steps: the system comprises a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene. The awakening function of the voice interaction system is realized through the awakening scene of the voice interaction system; the control of the functions of the refrigerator is realized through a refrigerator control scene, such as the control of the refrigerating and freezing temperatures of the refrigerator, the control of the selection of an operation mode and the control of music playing; the functions of chatting between the user and the refrigerator and the like can be realized through a voice conversation scene; the query content service, such as weather query, menu query, song search and health management query, can be realized through the query service scene.
In any of the above technical solutions, preferably, the semantic understanding module further includes: the mapping module is used for mapping the text information to the corresponding application scene; the keyword extraction module is used for extracting keywords of the text information; and the semantic result output module is used for outputting the corresponding application scenes and the keywords as semantic results.
In the technical scheme, the mapping module maps the received text information to the corresponding application scene, the keyword extraction module simultaneously extracts the keywords of the text information, the mapping can be carried out according to the text information in the mapping process, the mapping can also be carried out after the user requirement association is carried out on the text information, and the mapping can also be carried out according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting the keywords of the text information, and finally outputting the application scene and the keywords as semantic comprehension, so that the voice information of the user can be accurately understood, the voice information of the user can be associated when the voice information needs to be expanded, the requirement of the user can be more accurately understood, more natural man-machine interaction is realized, the man-machine interaction experience degree is improved, and the intellectualization of the refrigerator is improved.
In any of the above technical solutions, preferably, the processing module includes: the control instruction output module is used for inquiring and combining the associated information base to output a control instruction according to the text information and the semantic result; and the execution module is used for executing the voice interaction task corresponding to the control instruction.
In the technical scheme, the control instruction output module in the processing module inquires and combines the associated information base according to the text information sent by the voice recognition module and the semantic result sent by the semantic understanding module to output the corresponding control instruction, and the execution module executes the voice interaction task corresponding to the voice signal of the user according to the control instruction, so that the intelligent control of the refrigerator through the voice interaction system is realized, and the intelligence of the refrigerator is improved.
According to a second object of the present invention, there is provided a voice interaction method for a refrigerator, the voice interaction method comprising: collecting and preprocessing a voice signal; converting the preprocessed voice signal into text information; converting the text information into a semantic result; and according to the text information and the semantic result, querying and combining the associated information base to execute a voice interaction task corresponding to the voice signal.
The voice interaction method provided by the invention collects the voice signals sent by the user and preprocesses the voice signals, so that the subsequent voice recognition result is more accurate. And then converting the preprocessed voice signal into corresponding text information, thereby realizing voice recognition. The text information is matched with the pre-stored application scene, in the matching process, the matching can be carried out according to the text information, the matching can also be carried out after the user requirement association is carried out on the text information, and the matching can also be carried out according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting keywords of the text information, outputting the application scene and the keywords as semantic comprehension, inquiring according to the received text information and the semantic comprehension and combining with a related information base, and sending a control instruction to control the refrigerator to complete a voice interaction task corresponding to a user voice signal, so that more natural human-computer interaction is realized, the human-computer interaction experience degree is improved, and the intelligence of the refrigerator is improved.
The voice interaction method according to the present invention may further have the following technical features:
in the above technical solution, preferably, the information base includes: a local information base and/or a server side information base.
In the technical scheme, the information base can be a local information base, so that the capacity of the local information base is large, information required by a user can be stored, and the stored content can be updated according to the requirements of the user at different stages. The information base can also be a server information base, and the processing module can be connected to the server information base through a network to inquire mass information and realize more interactive tasks.
In any of the above technical solutions, preferably, before the voice signal is collected and preprocessed, the method further includes: storing an application scenario of the voice interaction task, wherein the application scenario comprises one or a combination of the following: the system comprises a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene.
In the technical scheme, the application scene of the voice interaction task is stored in advance, so that the refrigerator can realize more natural man-machine interaction in a special kitchen scene. The application scene comprises the following steps: the system comprises a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene. The awakening function of the voice interaction system is realized through the awakening scene of the voice interaction system; the control of the functions of the refrigerator is realized through a refrigerator control scene, such as the control of the refrigerating and freezing temperatures of the refrigerator, the control of the selection of an operation mode and the control of music playing; the functions of chatting between the user and the refrigerator and the like can be realized through a voice conversation scene; the query content service, such as weather query, menu query, song search and health management query, can be realized through the query service scene.
In any of the above technical solutions, preferably, the converting text information into a semantic result includes: mapping the text information to a corresponding application scene; extracting keywords of the text information; and outputting the corresponding application scene and the keyword as a semantic result.
According to the technical scheme, the received text information is mapped to the corresponding application scene, meanwhile, the keywords of the text information are extracted, in the mapping process, the mapping can be carried out according to the text information, the mapping can also be carried out after user requirement association is carried out on the text information, and the mapping can also be carried out according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting the keywords of the text information, and finally outputting the application scene and the keywords as semantic comprehension, so that the voice information of the user can be accurately understood, the voice information of the user can be associated when the voice information needs to be expanded, the requirement of the user can be more accurately understood, more natural man-machine interaction is realized, the man-machine interaction experience degree is improved, and the intellectualization of the refrigerator is improved.
In any of the above technical solutions, preferably, querying an information base to complete a voice interaction task according to the text information and the semantic result includes: according to the text information and semantic results, inquiring and combining the associated information base to output a control instruction; and executing the voice interaction task corresponding to the control instruction.
According to the technical scheme, the relevant information base is inquired and combined according to the received text information and semantic results, the corresponding control instruction is output, and the voice interaction task corresponding to the voice signal of the user is executed according to the control instruction, so that the intelligent control of the refrigerator through the voice interaction system is realized, and the intelligence of the refrigerator is improved.
According to a third object of the present invention, there is provided a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program: collecting and preprocessing a voice signal; converting the preprocessed voice signal into text information; converting the text information into a semantic result; and according to the text information and the semantic result, querying and combining the associated information base to execute a voice interaction task corresponding to the voice signal.
The invention provides a computer device, which realizes that when a processor executes a computer program: the voice signals sent by the user are collected and preprocessed, so that the subsequent voice recognition result is more accurate. And then converting the preprocessed voice signal into corresponding text information, thereby realizing voice recognition. The text information is matched with the pre-stored application scene, in the matching process, the matching can be carried out according to the text information, the matching can also be carried out after the user requirement association is carried out on the text information, and the matching can also be carried out according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting keywords of the text information, outputting the application scene and the keywords as semantic comprehension, inquiring according to the received text information and the semantic comprehension and combining with a related information base, and sending a control instruction to control the refrigerator to complete a voice interaction task corresponding to a user voice signal, so that more natural human-computer interaction is realized, the human-computer interaction experience degree is improved, and the intelligence of the refrigerator is improved.
According to a fourth object of the present invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of: collecting and preprocessing a voice signal; converting the preprocessed voice signal into text information; converting the text information into a semantic result; and according to the text information and the semantic result, querying and combining the associated information base to execute a voice interaction task corresponding to the voice signal.
The present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements: the voice signals sent by the user are collected and preprocessed, so that the subsequent voice recognition result is more accurate. And then converting the preprocessed voice signal into corresponding text information, thereby realizing voice recognition. The text information is matched with the pre-stored application scene, in the matching process, the matching can be carried out according to the text information, the matching can also be carried out after the user requirement association is carried out on the text information, and the matching can also be carried out according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting keywords of the text information, outputting the application scene and the keywords as semantic comprehension, inquiring according to the received text information and the semantic comprehension and combining with a related information base, and sending a control instruction to control the refrigerator to complete a voice interaction task corresponding to a user voice signal, so that more natural human-computer interaction is realized, the human-computer interaction experience degree is improved, and the intelligence of the refrigerator is improved.
According to a fifth object of the present invention, there is provided a refrigerator comprising the voice interaction system of any one of the above technical solutions.
The refrigerator provided by the invention comprises the voice interaction system in any technical scheme, so that the refrigerator has all the beneficial effects of the voice interaction system, and is not repeated herein.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 shows a schematic block diagram of a voice interaction system of one embodiment of the present invention;
FIG. 2 shows a schematic block diagram of a voice interaction system of another embodiment of the present invention;
FIG. 3 shows a flow diagram of a voice interaction method of one embodiment of the present invention;
FIG. 4 shows a flow diagram of a voice interaction method of another embodiment of the invention;
FIG. 5 shows a schematic block diagram of a computer device of an embodiment of the present invention;
fig. 6 is a schematic view showing a structure of a refrigerator according to an embodiment of the present invention;
fig. 7 is a flow chart illustrating a voice interaction method according to an embodiment of the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited to the specific embodiments disclosed below.
An embodiment of the first aspect of the present invention provides a voice interaction system, and fig. 1 shows a schematic block diagram of a voice interaction system 100 according to an embodiment of the present invention:
the voice acquisition module 102 is configured to acquire and preprocess a voice signal, and send the preprocessed voice signal to the voice recognition module 104;
the voice recognition module 104 is configured to convert the preprocessed voice signal into text information, and send the text information to the processing module 108 and the semantic understanding module 106, respectively;
the semantic understanding module 106 is used for converting the text information into a semantic result and sending the semantic result to the processing module 108;
and the processing module 108 is used for querying and combining the associated information base according to the text information and the semantic result to execute the voice interaction task corresponding to the voice signal.
In the voice interaction system 100 provided by the invention, the voice acquisition module 102 acquires the voice signal sent by the user and preprocesses the voice signal, so that the subsequent voice recognition result is more accurate. Then, the preprocessed voice signal is sent to the voice recognition module 104, and the voice recognition module 104 converts the preprocessed voice signal into corresponding text information, thereby realizing voice recognition. The speech recognition module 104 sends the text information to the processing module 108 and the semantic understanding module 106 respectively, the semantic understanding module 106 matches the text information to a pre-stored application scene, and in the matching process, the matching can be performed according to the text information, the matching can be performed after the user requirement association is performed on the text information, and the matching can be performed according to the memory of the user historical speech information, so that the user language can be understood more accurately. And then subdividing the application scene, extracting key words of the text information, outputting the application scene and the key words to the processing module 108 as semantic comprehension, inquiring by the processing module 108 according to the received text information and the semantic comprehension and combining with a related information base, and sending a control instruction to control the refrigerator to complete a voice interaction task corresponding to a user voice signal, so that more natural human-computer interaction is realized, the human-computer interaction experience degree is improved, and the intelligence of the refrigerator is improved.
FIG. 2 shows a schematic block diagram of a voice interaction system 200 according to another embodiment of the present invention, wherein the voice interaction system 200 comprises:
the voice acquisition module 202 is used for acquiring and preprocessing a voice signal and sending the preprocessed voice signal to the voice recognition module 204;
the voice recognition module 204 is configured to convert the preprocessed voice signal into text information, and send the text information to the processing module 208 and the semantic understanding module 206, respectively;
the semantic understanding module 206 is configured to convert the text information into a semantic result, and send the semantic result to the processing module 208;
and the processing module 208 is used for querying and combining the associated information base according to the text information and the semantic result to execute the voice interaction task corresponding to the voice signal.
Wherein, the semantic understanding module 206 comprises:
an application scenario storage module 2602, configured to store application scenarios of the voice interaction task, where the application scenarios include one or a combination of the following: a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene;
a mapping module 2604, configured to map the text information to a corresponding application scenario;
a keyword extraction module 2606, configured to extract keywords of the text information;
a semantic result output module 2608, configured to output the corresponding application scenario and the keyword as a semantic result.
The processing module 208 includes:
a control instruction output module 2802, configured to query and output a control instruction in combination with an associated information base according to the text information and the semantic result;
and the execution module 2804 is configured to execute the voice interaction task corresponding to the control instruction.
In one embodiment of the present invention, preferably, the information base includes: a local information base and/or a server side information base.
In this embodiment, the information base may be a local information base, and the capacity of the local information base is large, so that information required by the user may be stored, and the stored content may be updated according to the requirements of the user at different stages. The information base can also be a server information base, and the processing module can be connected to the server information base through a network to inquire mass information and realize more interactive tasks.
In one embodiment of the present invention, preferably, the semantic understanding module 206 includes: an application scenario storage module 2602, configured to store application scenarios of the voice interaction task, where the application scenarios include one or a combination of the following: the system comprises a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene.
In this embodiment, the semantic understanding module 206 pre-stores the application scenario of the voice interaction task, so that the refrigerator realizes more natural human-computer interaction in a special kitchen scenario. The application scene comprises the following steps: the system comprises a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene. The awakening function of the voice interaction system is realized through the awakening scene of the voice interaction system; the control of the functions of the refrigerator is realized through a refrigerator control scene, such as the control of the refrigerating and freezing temperatures of the refrigerator, the control of the selection of an operation mode and the control of music playing; the functions of chatting between the user and the refrigerator and the like can be realized through a voice conversation scene; the query content service, such as weather query, menu query, song search and health management query, can be realized through the query service scene.
In an embodiment of the present invention, preferably, the semantic understanding module 206 further includes: a mapping module 2604, configured to map the text information to a corresponding application scenario; a keyword extraction module 2606, configured to extract keywords of the text information; a semantic result output module 2608, configured to output the corresponding application scenario and the keyword as a semantic result.
In this embodiment, the mapping module 2604 maps the received text information to a corresponding application scenario, and the keyword extraction module 2606 simultaneously extracts keywords of the text information, and in the mapping process, the mapping may be performed according to the text information itself, or after associating user requirements with the text information, or according to the memory of the user history voice information, so that the user language can be understood more accurately. And then subdividing the application scene, extracting the keywords of the text information, and finally outputting the application scene and the keywords as semantic comprehension, so that the voice information of the user can be accurately understood, the voice information of the user can be associated when the voice information needs to be expanded, the requirement of the user can be more accurately understood, more natural man-machine interaction is realized, the man-machine interaction experience degree is improved, and the intellectualization of the refrigerator is improved.
In one embodiment of the present invention, preferably, the processing module 208 includes: a control instruction output module 2802, configured to query and output a control instruction in combination with an associated information base according to the text information and the semantic result; and the execution module 2804 is configured to execute the voice interaction task corresponding to the control instruction.
In this embodiment, the control instruction output module 2802 in the processing module 208 queries and outputs a corresponding control instruction in combination with the associated information base according to the text information sent by the voice recognition module and the semantic result sent by the semantic understanding module, and the execution module 2804 executes the voice interaction task corresponding to the voice signal of the user according to the control instruction, so that the refrigerator is intelligently controlled through the voice interaction system, and the intelligence of the refrigerator is improved.
An embodiment of the second aspect of the present invention provides a voice interaction method, and fig. 3 shows a flow chart of the voice interaction method according to an embodiment of the present invention:
step 302, collecting and preprocessing a voice signal;
step 304, converting the preprocessed voice signal into text information;
step 306, converting the text information into a semantic result;
and step 308, inquiring and combining the associated information base according to the text information and the semantic result to execute the voice interaction task corresponding to the voice signal.
The voice interaction method provided by the invention collects the voice signals sent by the user and preprocesses the voice signals, so that the subsequent voice recognition result is more accurate. And then converting the preprocessed voice signal into corresponding text information, thereby realizing voice recognition. The text information is matched with the pre-stored application scene, in the matching process, the matching can be carried out according to the text information, the matching can also be carried out after the user requirement association is carried out on the text information, and the matching can also be carried out according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting keywords of the text information, outputting the application scene and the keywords as semantic comprehension, inquiring according to the received text information and the semantic comprehension and combining with a related information base, and sending a control instruction to control the refrigerator to complete a voice interaction task corresponding to a user voice signal, so that more natural human-computer interaction is realized, the human-computer interaction experience degree is improved, and the intelligence of the refrigerator is improved.
Fig. 4 shows a flow chart of a voice interaction method according to another embodiment of the present invention, wherein the voice interaction method includes:
step 402, storing the application scene of the voice interaction task;
step 404, collecting and preprocessing a voice signal;
step 406, converting the preprocessed voice signal into text information;
step 408, mapping the text information to a corresponding application scene;
step 410, extracting keywords of the text information;
step 412, outputting the corresponding application scenes and keywords as semantic results;
step 414, according to the text information and semantic result, inquiring and combining the associated information base to output a control instruction;
and step 416, executing the voice interaction task corresponding to the control instruction.
In one embodiment of the present invention, preferably, the information base includes: a local information base and/or a server side information base.
In this embodiment, the information base may be a local information base, and the capacity of the local information base is large, so that information required by the user may be stored, and the stored content may be updated according to the requirements of the user at different stages. The information base can also be a server information base, and the processing module can be connected to the server information base through a network to inquire mass information and realize more interactive tasks.
In an embodiment of the present invention, preferably, before the acquiring and preprocessing the speech signal, the method further includes: storing an application scenario of the voice interaction task, wherein the application scenario comprises one or a combination of the following: the system comprises a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene.
In the embodiment, the application scene of the voice interaction task is stored in advance, so that the refrigerator can realize more natural man-machine interaction in a special kitchen scene. The application scene comprises the following steps: the system comprises a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene. The awakening function of the voice interaction system is realized through the awakening scene of the voice interaction system; the control of the functions of the refrigerator is realized through a refrigerator control scene, such as the control of the refrigerating and freezing temperatures of the refrigerator, the control of the selection of an operation mode and the control of music playing; the functions of chatting between the user and the refrigerator and the like can be realized through a voice conversation scene; the query content service, such as weather query, menu query, song search and health management query, can be realized through the query service scene.
In one embodiment of the present invention, preferably, the text information is mapped to a corresponding application scenario; extracting keywords of the text information; and outputting the corresponding application scene and the keyword as a semantic result.
In the embodiment, the received text information is mapped to the corresponding application scene, and the keywords of the text information are extracted, so that the mapping can be performed according to the text information in the mapping process, the mapping can be performed after the user requirement association is performed on the text information, and the mapping can be performed according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting the keywords of the text information, and finally outputting the application scene and the keywords as semantic comprehension, so that the voice information of the user can be accurately understood, the voice information of the user can be associated when the voice information needs to be expanded, the requirement of the user can be more accurately understood, more natural man-machine interaction is realized, the man-machine interaction experience degree is improved, and the intellectualization of the refrigerator is improved.
In one embodiment of the present invention, preferably, the control instruction is queried and output in combination with the associated information base according to the text information and the semantic result; and executing the voice interaction task corresponding to the control instruction.
In the embodiment, according to the received text information and semantic results, the relevant information base is inquired and combined, the corresponding control instruction is output, and the voice interaction task corresponding to the voice signal of the user is executed according to the control instruction, so that the intelligent control of the refrigerator through the voice interaction system is realized, and the intelligence of the refrigerator is improved.
In an embodiment of the third aspect of the present invention, a computer device is provided, and fig. 5 shows a schematic block diagram of a computer device 500 according to an embodiment of the present invention, where the computer device 500 includes:
a memory 502, a processor 504, and a computer program stored on the memory 502 and executable on the processor 504, the processor 504 when executing the computer program implementing the steps of: collecting and preprocessing a voice signal; converting the preprocessed voice signal into text information; converting the text information into a semantic result; and according to the text information and the semantic result, querying and combining the associated information base to execute a voice interaction task corresponding to the voice signal.
In the computer device 500 provided by the present invention, the processor 504, when executing the computer program, implements: the voice signals sent by the user are collected and preprocessed, so that the subsequent voice recognition result is more accurate. And then converting the preprocessed voice signal into corresponding text information, thereby realizing voice recognition. The text information is matched with the pre-stored application scene, in the matching process, the matching can be carried out according to the text information, the matching can also be carried out after the user requirement association is carried out on the text information, and the matching can also be carried out according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting keywords of the text information, outputting the application scene and the keywords as semantic comprehension, inquiring according to the received text information and the semantic comprehension and combining with a related information base, and sending a control instruction to control the refrigerator to complete a voice interaction task corresponding to a user voice signal, so that more natural human-computer interaction is realized, the human-computer interaction experience degree is improved, and the intelligence of the refrigerator is improved.
An embodiment of the fourth aspect of the present invention proposes a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of: collecting and preprocessing a voice signal; converting the preprocessed voice signal into text information; converting the text information into a semantic result; and according to the text information and the semantic result, querying and combining the associated information base to execute a voice interaction task corresponding to the voice signal.
The present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements: the voice signals sent by the user are collected and preprocessed, so that the subsequent voice recognition result is more accurate. And then converting the preprocessed voice signal into corresponding text information, thereby realizing voice recognition. The text information is matched with the pre-stored application scene, in the matching process, the matching can be carried out according to the text information, the matching can also be carried out after the user requirement association is carried out on the text information, and the matching can also be carried out according to the memory of the historical voice information of the user, so that the user language can be more accurately understood. And then subdividing the application scene, extracting keywords of the text information, outputting the application scene and the keywords as semantic comprehension, inquiring according to the received text information and the semantic comprehension and combining with a related information base, and sending a control instruction to control the refrigerator to complete a voice interaction task corresponding to a user voice signal, so that more natural human-computer interaction is realized, the human-computer interaction experience degree is improved, and the intelligence of the refrigerator is improved.
In an embodiment of the fifth aspect of the present invention, a refrigerator is provided, and fig. 6 illustrates a schematic structural diagram of a refrigerator 600 according to an embodiment of the present invention, where the refrigerator 600 includes the voice interaction system 602 according to any of the above embodiments.
The refrigerator 600 provided by the invention comprises the voice interaction system 602 according to any of the above technical solutions, so that all the beneficial effects of the voice interaction system 602 are achieved, and details are not repeated herein.
Fig. 7 is a flow chart illustrating a voice interaction method according to an embodiment of the present invention. Wherein, the method comprises the following steps:
in step 702, the user issues "what clothes should i wear today? "is a speech signal;
step 704, convert the user's voice signal into a text message "what clothes i should wear today? ";
step 706, extracting the keyword "today, wear clothes" of the text message;
step 708, through semantic association, knowing how the user wants to know weather;
step 710, mapping the text information to a pre-stored application scene according to the semantic association result, wherein the mapping result is as follows: a weather query subclass within the content service subclass;
step 712, according to the text message "what clothes i should wear today? "the keyword" today, wear clothes ", the application scene" weather inquiry "inquires about the information base associated with weather, output" broadcast weather "the control command;
and step 714, broadcasting weather.
The voice interaction method provided by the embodiment includes the steps of collecting voice signals sent by a user, converting the voice signals into corresponding text information, associating the text information with user requirements, matching the text information into a corresponding application scene, subdividing the application scene, extracting keywords of the text information, outputting the application scene and the keywords as semantic understanding, and sending a control instruction to control a refrigerator to complete a voice interaction task corresponding to the voice signals of the user according to the received text information and the semantic understanding and combining with a related information base, so that expanded understanding of the voice signals of the user is realized, the user requirements are more accurately understood, more natural man-machine interaction is achieved, and the intelligence and the user experience degree of the refrigerator are improved.
In the description herein, the description of the terms "one embodiment," "some embodiments," "specific embodiments," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (9)

1. A voice interaction system, comprising:
the voice acquisition module is used for acquiring and preprocessing a voice signal and sending the preprocessed voice signal to the voice recognition module;
the voice recognition module is used for converting the preprocessed voice signals into text information and respectively sending the text information to the processing module and the semantic understanding module;
the semantic understanding module is used for converting the text information into a semantic result and sending the semantic result to the processing module;
the processing module is used for inquiring and combining an associated information base according to the text information and the semantic result so as to execute a voice interaction task corresponding to the voice signal;
the semantic understanding module comprises:
the keyword extraction module is used for extracting keywords of the text information;
an application scenario storage module, configured to store an application scenario of the voice interaction task, where the application scenario includes one or a combination of the following: a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene;
the mapping module is used for mapping the text information to a corresponding application scene;
and the semantic result output module is used for outputting the corresponding application scene and the keyword as the semantic result.
2. The voice interaction system of claim 1,
the information base includes: a local information base and/or a server side information base.
3. The voice interaction system according to claim 1 or 2,
the processing module comprises:
the control instruction output module is used for inquiring and combining the associated information base to output a control instruction according to the text information and the semantic result;
and the execution module is used for executing the voice interaction task corresponding to the control instruction.
4. A voice interaction method for a refrigerator is characterized by comprising the following steps:
collecting and preprocessing a voice signal;
converting the preprocessed voice signal into text information;
converting the text information into a semantic result;
according to the text information and the semantic result, inquiring and combining a related information base to execute a voice interaction task corresponding to the voice signal;
the converting the text information into a semantic result includes:
extracting keywords of the text information;
before the voice signal is collected and preprocessed, the method further comprises the following steps:
storing an application scenario of the voice interaction task, wherein the application scenario comprises one or a combination of the following: a voice interaction system awakening scene, a refrigerator control scene, a voice conversation scene and an inquiry service scene;
mapping the text information to a corresponding application scene;
and outputting the corresponding application scene and the keyword as the semantic result.
5. The voice interaction method of claim 4,
the information base includes: a local information base and/or a server side information base.
6. The voice interaction method of claim 4 or 5, wherein the querying an information base to complete a voice interaction task according to the text information and the semantic result comprises:
according to the text information and the semantic result, inquiring and combining the associated information base to output a control instruction;
and executing the voice interaction task corresponding to the control instruction.
7. Computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor realizes the steps of the voice interaction method according to any of claims 4 to 6 when executing the computer program.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the voice interaction method according to any one of claims 4 to 6.
9. A refrigerator, characterized by comprising: the voice interaction system of any one of claims 1 to 3.
CN201710461636.XA 2017-06-16 2017-06-16 Refrigerator, voice interaction system, method, computer device and readable storage medium Active CN107146622B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710461636.XA CN107146622B (en) 2017-06-16 2017-06-16 Refrigerator, voice interaction system, method, computer device and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710461636.XA CN107146622B (en) 2017-06-16 2017-06-16 Refrigerator, voice interaction system, method, computer device and readable storage medium

Publications (2)

Publication Number Publication Date
CN107146622A CN107146622A (en) 2017-09-08
CN107146622B true CN107146622B (en) 2021-02-19

Family

ID=59782208

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710461636.XA Active CN107146622B (en) 2017-06-16 2017-06-16 Refrigerator, voice interaction system, method, computer device and readable storage medium

Country Status (1)

Country Link
CN (1) CN107146622B (en)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7106827B2 (en) * 2017-09-11 2022-07-27 富士フイルムビジネスイノベーション株式会社 Information processing device, program and control method
CN107832286B (en) * 2017-09-11 2021-09-14 远光软件股份有限公司 Intelligent interaction method, equipment and storage medium
CN107704530A (en) * 2017-09-19 2018-02-16 百度在线网络技术(北京)有限公司 Speech ciphering equipment exchange method, device and equipment
CN107644642B (en) * 2017-09-20 2021-01-15 Oppo广东移动通信有限公司 Semantic recognition method and device, storage medium and electronic equipment
CN107644643A (en) * 2017-09-27 2018-01-30 安徽硕威智能科技有限公司 A kind of voice interactive system and method
CN107528755A (en) * 2017-09-30 2017-12-29 百度在线网络技术(北京)有限公司 Control method, device, equipment and the storage medium of smart machine
CN109841211A (en) * 2017-11-29 2019-06-04 深圳Tcl新技术有限公司 A kind of voice interactive method based on operation behavior, storage medium and mobile terminal
CN109903754B (en) * 2017-12-08 2022-04-26 北京京东尚科信息技术有限公司 Method, device and memory device for speech recognition
CN108040111A (en) * 2017-12-13 2018-05-15 北京北信源软件股份有限公司 A kind of apparatus and method for supporting natural language interaction
CN107910003A (en) * 2017-12-22 2018-04-13 智童时刻(厦门)科技有限公司 A kind of voice interactive method and speech control system for smart machine
CN108197213A (en) * 2017-12-28 2018-06-22 中兴通讯股份有限公司 Action performs method, apparatus, storage medium and electronic device
CN110021299B (en) * 2018-01-08 2021-07-20 佛山市顺德区美的电热电器制造有限公司 Voice interaction method, device, system and storage medium
CN110164426B (en) * 2018-02-10 2021-10-26 佛山市顺德区美的电热电器制造有限公司 Voice control method and computer storage medium
CN108597509A (en) * 2018-03-30 2018-09-28 百度在线网络技术(北京)有限公司 Intelligent sound interacts implementation method, device, computer equipment and storage medium
CN110555329A (en) * 2018-05-31 2019-12-10 苏州欧力机器人有限公司 Sign language translation method, terminal and storage medium
CN110970032A (en) * 2018-09-28 2020-04-07 深圳市冠旭电子股份有限公司 Sound box voice interaction control method and device
CN111045510A (en) * 2018-10-15 2020-04-21 中国移动通信集团山东有限公司 Man-machine interaction method and system based on augmented reality
CN109489337A (en) * 2018-10-22 2019-03-19 广东格兰仕集团有限公司 A kind of man-machine interaction method of artificial intelligence refrigerator
CN109273001B (en) * 2018-10-25 2021-06-18 珠海格力电器股份有限公司 Voice broadcasting method and device, computing device and storage medium
CN109471925A (en) * 2018-10-26 2019-03-15 北京智能优学科技有限公司 The method and system and computer readable storage medium of foreign language teaching semantic analysis, dialog process and interaction
CN111312253A (en) * 2018-12-11 2020-06-19 青岛海尔洗衣机有限公司 Voice control method, cloud server and terminal equipment
CN109903755B (en) * 2019-02-26 2021-04-13 珠海格力电器股份有限公司 Voice interaction method and device, storage medium and air conditioner
CN111696542B (en) * 2019-03-13 2022-09-20 青岛海尔电冰箱有限公司 Voice data interaction method and system for removing food materials from refrigerator
CN111692829B (en) * 2019-03-13 2022-02-01 青岛海尔电冰箱有限公司 Data interaction method and interaction system for refrigerator
CN111739541B (en) * 2019-03-19 2021-11-05 上海云思智慧信息技术有限公司 Conference assistance method and system based on voice, storage medium and terminal
CN111951808B (en) * 2019-04-30 2023-09-08 深圳市优必选科技有限公司 Voice interaction method, device, terminal equipment and medium
CN110265013A (en) * 2019-06-20 2019-09-20 平安科技(深圳)有限公司 The recognition methods of voice and device, computer equipment, storage medium
CN110706699A (en) * 2019-09-27 2020-01-17 三星电子(中国)研发中心 Method and system for realizing interaction task by adopting voice recognition mode
CN110727772A (en) * 2019-10-09 2020-01-24 浙江百应科技有限公司 Method for realizing dynamic interaction of robot through condition judgment
CN111306692A (en) * 2019-10-18 2020-06-19 珠海格力电器股份有限公司 Human-computer interaction method and system of air conditioner, air conditioner and storage medium
CN111104546B (en) * 2019-12-03 2021-08-27 珠海格力电器股份有限公司 Method and device for constructing corpus, computing equipment and storage medium
CN110931018A (en) * 2019-12-03 2020-03-27 珠海格力电器股份有限公司 Intelligent voice interaction method and device and computer readable storage medium
CN111081218A (en) * 2019-12-24 2020-04-28 北京工业大学 Voice recognition method and voice control system
CN113465282A (en) * 2020-03-30 2021-10-01 青岛海尔电冰箱有限公司 Screen device control method, refrigerator, and computer-readable storage medium
CN112069299A (en) * 2020-09-03 2020-12-11 三一专用汽车有限责任公司 Response method for question-answer interaction, server, engineering vehicle and readable storage medium
CN112581959B (en) * 2020-12-15 2023-05-09 四川虹美智能科技有限公司 Intelligent equipment control method, system and voice server
CN113421561B (en) * 2021-06-03 2024-01-09 广州小鹏汽车科技有限公司 Voice control method, voice control device, server, and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105206269A (en) * 2015-08-14 2015-12-30 百度在线网络技术(北京)有限公司 Voice processing method and device
CN105702254A (en) * 2012-05-24 2016-06-22 上海博泰悦臻电子设备制造有限公司 Voice control system based on mobile terminal and voice control method thereof
CN105913839A (en) * 2016-05-30 2016-08-31 合肥华凌股份有限公司 Intelligent refrigerator, server and voice control system and method
CN105976818A (en) * 2016-04-26 2016-09-28 Tcl集团股份有限公司 Instruction identification processing method and apparatus thereof
CN106057203A (en) * 2016-05-24 2016-10-26 深圳市敢为软件技术有限公司 Precise voice control method and device
CN106228983A (en) * 2016-08-23 2016-12-14 北京谛听机器人科技有限公司 Scene process method and system during a kind of man-machine natural language is mutual
CN106297782A (en) * 2016-07-28 2017-01-04 北京智能管家科技有限公司 A kind of man-machine interaction method and system
CN106356057A (en) * 2016-08-24 2017-01-25 安徽咪鼠科技有限公司 Speech recognition system based on semantic understanding of computer application scenario
CN106406806A (en) * 2016-09-19 2017-02-15 北京智能管家科技有限公司 A control method and device for intelligent apparatuses

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7212972B2 (en) * 1999-12-08 2007-05-01 Ddi Corporation Audio features description method and audio video features description collection construction method
JP4580885B2 (en) * 2006-03-27 2010-11-17 株式会社東芝 Scene information extraction method, scene extraction method, and extraction apparatus
CN103000173B (en) * 2012-12-11 2015-06-17 优视科技有限公司 Voice interaction method and device
CN103413549B (en) * 2013-07-31 2016-07-06 深圳创维-Rgb电子有限公司 The method of interactive voice, system and interactive terminal
CN106057205B (en) * 2016-05-06 2020-01-14 北京云迹科技有限公司 Automatic voice interaction method for intelligent robot

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105702254A (en) * 2012-05-24 2016-06-22 上海博泰悦臻电子设备制造有限公司 Voice control system based on mobile terminal and voice control method thereof
CN105206269A (en) * 2015-08-14 2015-12-30 百度在线网络技术(北京)有限公司 Voice processing method and device
CN105976818A (en) * 2016-04-26 2016-09-28 Tcl集团股份有限公司 Instruction identification processing method and apparatus thereof
CN106057203A (en) * 2016-05-24 2016-10-26 深圳市敢为软件技术有限公司 Precise voice control method and device
CN105913839A (en) * 2016-05-30 2016-08-31 合肥华凌股份有限公司 Intelligent refrigerator, server and voice control system and method
CN106297782A (en) * 2016-07-28 2017-01-04 北京智能管家科技有限公司 A kind of man-machine interaction method and system
CN106228983A (en) * 2016-08-23 2016-12-14 北京谛听机器人科技有限公司 Scene process method and system during a kind of man-machine natural language is mutual
CN106356057A (en) * 2016-08-24 2017-01-25 安徽咪鼠科技有限公司 Speech recognition system based on semantic understanding of computer application scenario
CN106406806A (en) * 2016-09-19 2017-02-15 北京智能管家科技有限公司 A control method and device for intelligent apparatuses

Also Published As

Publication number Publication date
CN107146622A (en) 2017-09-08

Similar Documents

Publication Publication Date Title
CN107146622B (en) Refrigerator, voice interaction system, method, computer device and readable storage medium
CN107908116B (en) Voice control method, intelligent home system, storage medium and computer equipment
CN105137789A (en) Control method and device of intelligent IoT electrical appliances, and related devices
CN107919121A (en) Control method, device, storage medium and the computer equipment of smart home device
CN108228064B (en) Data monitoring control method, device and computer storage medium
CN103188538A (en) Household appliance control method and system based on smart television equipment and Internet
CN108920666A (en) Searching method, system, electronic equipment and storage medium based on semantic understanding
CN103092181A (en) Household appliance control method and system thereof based on intelligent television equipment
WO2020253064A1 (en) Speech recognition method and apparatus, and computer device and storage medium
CN102708863A (en) Voice dialogue equipment, system and voice dialogue implementation method
CN107644643A (en) A kind of voice interactive system and method
CN105629750A (en) Smart home control method and system
CN113534676A (en) Intelligent household appliance control method and device, computer equipment and storage medium
CN112749266B (en) Industrial question and answer method, device, system, equipment and storage medium
CN105405442A (en) Speech recognition method, device and equipment
CN111197841A (en) Control method, control device, remote control terminal, air conditioner, server and storage medium
CN112434139A (en) Information interaction method and device, electronic equipment and storage medium
CN109710799B (en) Voice interaction method, medium, device and computing equipment
CN111178081B (en) Semantic recognition method, server, electronic device and computer storage medium
CN104134339B (en) Voice remote control method and device
CN105872803A (en) Method and device for controlling voices of smart television
CN104217718A (en) Method and system for voice recognition based on environmental parameter and group trend data
KR102042689B1 (en) IOT device setting system
CN107018354A (en) A kind of individual soldier's equipment of support case label, method and system
CN105489218A (en) Speech control system, remote control and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 230088 Building No. 198, building No. 198, Mingzhu Avenue, Anhui high tech Zone, Anhui

Applicant after: Hefei Hualing Co.,Ltd.

Address before: 230601 R & D building, No. 176, Jinxiu Road, Hefei economic and Technological Development Zone, Anhui 501

Applicant before: Hefei Hualing Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant