CN115576216A

CN115576216A - Information filling method and device based on voice control intelligent household appliance

Info

Publication number: CN115576216A
Application number: CN202211576050.5A
Authority: CN
Inventors: 郑俊浩
Original assignee: Shenzhen Renma Interactive Technology Co Ltd
Current assignee: Shenzhen Renma Interactive Technology Co Ltd
Priority date: 2022-12-09
Filing date: 2022-12-09
Publication date: 2023-01-06
Anticipated expiration: 2042-12-09
Also published as: CN115576216B

Abstract

The embodiment of the application discloses an information filling method and device based on voice control intelligent household appliances, and the method is applied to a server of a voice control intelligent household appliance system and comprises the following steps: acquiring current voice information input by a user, and performing data processing on the current voice information to obtain a first user statement and instruction information in the first user statement; if the instruction information comprises equipment information, area information, function information and operation information, controlling the target intelligent household appliance to execute equipment service according to the first user statement; and if the instruction information lacks one or more of the equipment information, the area information, the function information or the operation information, filling information into the first user statement based on the user equipment list and the historical user statement to obtain a second user statement, and controlling the target intelligent household appliance to execute equipment service according to the second user statement. By adopting the embodiment of the application, the user can control the intelligent household appliance by simple sentences which accord with daily life, the operation complexity is reduced, and the user experience is improved.

Description

Information filling method and device based on voice control intelligent household appliance

Technical Field

The invention relates to the technical field of general data processing of the Internet industry, in particular to an information filling method and device based on voice control of intelligent household appliances.

Background

With the development of internet technology and the popularization of smart homes, the voice control smart home appliance technology is widely applied to many fields, and users can control smart home appliances such as air conditioners, fans and lamps through voices, so that great convenience is brought to daily life. In a voice-controlled intelligent household appliance system, a user is usually required to speak a complete and specific instruction, the system can accurately identify and execute corresponding equipment operation, for some fuzzy and information-lacking instructions, the system needs to ask the user to supplement all required information or not identify the instruction and wait for the user to speak a new instruction, and the method causes the complexity of user operation to be improved and the user experience to be poor.

Disclosure of Invention

The embodiment of the application provides an information filling method and device based on voice control of intelligent household appliances, so that a user can control the intelligent household appliances by using simpler sentences which accord with daily life, the operation complexity is reduced, and the user experience is improved.

In a first aspect, an embodiment of the present application provides an information filling method based on voice-controlled intelligent home appliances, which is applied to a server of a voice-controlled intelligent home appliance system, where the voice-controlled intelligent home appliance system includes the server and a plurality of intelligent home appliances, and the server includes a human-computer voice interaction engine; the method comprises the following steps:

calling the human-computer voice interaction engine to obtain current voice information input by a user, and carrying out voice-to-text operation on the current voice information to obtain a first user statement;

performing data processing on the first user statement to obtain instruction information in the first user statement;

if the instruction information includes device information, area information, function information and operation information, controlling a target intelligent household appliance of the plurality of intelligent household appliances to execute a device service according to the first user statement, wherein the function information represents a device function of the target intelligent household appliance, and the operation information represents an operation performed on the target intelligent household appliance;

if the instruction information lacks one or more of the device information, the area information, the function information or the operation information, obtaining a user device list and a historical user statement, wherein the user device list comprises a device name, a device area and a device function of each of the plurality of intelligent household appliances;

matching the first user statement with the user equipment list to obtain first filling information;

matching the first user statement with the historical user statement to obtain second filling information;

and filling the first user statement according to the first filling information and the second filling information to obtain a second user statement, and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service according to the second user statement.

In the voice control intelligent household appliance system, a man-machine voice interaction engine is called to obtain current voice information input by a user, if the current voice information is a complete and specific instruction, target intelligent household appliance execution equipment service is controlled according to the current voice information, if the current voice information is a fuzzy and information-lacking instruction, information filling is carried out on the current voice information based on a user equipment list and historical user sentences, and then the target intelligent household appliance execution equipment service is controlled according to the filled information. The information filling method is used for enhancing and identifying the current voice information, so that a target control object is determined, the user can control the intelligent household appliance through simpler sentences which accord with daily life, the operation complexity of the user is reduced, and the user experience is improved.

In one possible design, when the instruction information includes the function information, searching a device name corresponding to the function information in the instruction information from the user equipment list, and using the device name as the first padding information; when the instruction information comprises the equipment information, determining an area to which a user belongs, and searching an equipment area corresponding to the equipment information in the instruction information from the user equipment list; if the equipment area contains the area to which the user belongs, taking the area to which the user belongs as the first filling information; and if the equipment area lacks the area to which the user belongs, taking the equipment area as the first filling information. When the first user statement is a fuzzy instruction lacking information, matching instruction information in the first user statement with the user equipment list to obtain first filling information, wherein the first filling information is beneficial to enhancing identification of the first user statement by a system, determining a target control object, reducing user operation complexity and improving user experience.

In another possible design, it is determined that the function information in the instruction information is volume, a device name corresponding to the volume is searched for from the user device list as a sound, and the sound is used as the first filling information. And matching the attribute volume mentioned in the first user statement with the user equipment list to determine that the first filling information is a sound, wherein the first filling information is beneficial to the enhanced identification of the first user statement and determines that the target control object is the sound.

In another possible design, when the instruction information includes the device information, associating the device information with the historical user statement to obtain area information associated with the device information, and using the area information as the second filling information; when the instruction information comprises the function information and the area information, associating the function information and the area information with the historical user statement to obtain equipment information associated with the function information and the area information, and taking the equipment information as the second filling information; when the instruction information includes the function information, associating the function information with the historical user statement to obtain device information associated with the function information, associating the device information associated with the function information with the historical user statement to obtain area information associated with the device information, and taking the device information associated with the function information and the area information associated with the device information as the second filling information. When the first user statement is a fuzzy and information-lacking instruction, the instruction information in the first user statement and the historical user statement are associated to obtain second filling information, the second filling information is beneficial to enhancing identification of the system on the first user statement, a target control object is determined, the user operation complexity is reduced, and the user experience is improved.

In another possible design, it is determined that the device information in the instruction information is a fan, a target historical statement which is closest to the first user statement in time interval and contains area information having a physical space adaptation relationship with the fan is searched from the historical user statements, the area information having the physical space adaptation relationship with the fan is obtained as a living room according to the area information in the target historical statement, and the living room is used as the second filling information. And searching a target historical statement which is closest to the time interval of the first user statement and contains a physical space adaptive relation with the fan from the historical user statements by using the equipment fan mentioned in the first user statement, and determining that the second filling information is the living room, wherein the second filling information is beneficial to the enhanced identification of the first user statement and determines that the target control object is the fan of the living room.

In another possible design, determining that the function information in the instruction information is temperature, searching a first target historical statement which is closest to the first user statement in time interval and contains equipment information having an equipment function adaptive relationship with the temperature from the historical user statement, and obtaining that the equipment information having an equipment function adaptive relationship with the temperature is an air conditioner according to area information in the first target historical statement; searching a second target historical statement which is closest to the time interval of the first target historical statement and contains regional information having a physical space adaptation relation with the air conditioner from the historical user statement, obtaining the regional information having the physical space adaptation relation with the air conditioner as a bedroom according to the regional information in the second target historical statement, and taking the air conditioner and the bedroom as second filling information. And searching a first target historical statement which is closest to the time interval of the first user statement and has a device function adaptive relation with the temperature from the historical user statements by using the attribute temperature mentioned in the first user statement, determining that the device information is an air conditioner, searching a second target historical statement which is closest to the time interval of the first target historical statement and has a physical space adaptive relation with the air conditioner from the historical user statements, and determining that the second filling information is the air conditioner and the bedroom, wherein the second filling information is beneficial to the enhanced identification of the first user statement and determining that the target control object is the air conditioner of the bedroom.

In another possible design, performing keyword parsing on the first user statement and extracting at least two keywords; and performing semantic recognition on the keywords to obtain instruction information in the first user statement. The instruction information is used for judging whether the current voice information input by the user is a complete and specific instruction or not, and performing semantic recognition and/or information filling processing on the current voice information according to different judgment results so as to determine a target control object.

In another possible design, the second user statement is disassembled to obtain a plurality of analysis graphs, each analysis graph in the plurality of analysis graphs comprises an analysis node and each analysis node relation line, and the analysis node is a word; determining a target analysis node and an analysis node relation line corresponding to the target analysis node from each analysis graph to obtain a main original triple corresponding to each analysis graph; searching a first knowledge sub-graph corresponding to a currently processed analysis graph from a knowledge graph of a knowledge base according to a main original triple corresponding to the currently processed analysis graph, wherein the knowledge graph comprises a plurality of knowledge sub-graphs; if the first knowledge sub-graph is found, marking the currently processed analytic graph as a correct statement, determining that a main original triple corresponding to the currently processed analytic graph is used for representing a statement intention of the second user statement, and controlling a target intelligent household appliance in the intelligent household appliances to execute the equipment service based on the statement intention; if the first knowledge subgraph is not found, imagination inference is carried out on the currently processed analytic graph according to the knowledge base to obtain a probability graph, and a second knowledge subgraph corresponding to the probability graph is searched from the knowledge graph of the knowledge base; if the second knowledge sub-graph is not found, discarding the currently processed analysis graph, and processing other analysis graphs except the currently processed analysis graph in the plurality of analysis graphs; and if the second knowledge sub-graph is found, determining that the main original triple corresponding to the second knowledge sub-graph is used for representing the statement intention of the second user statement, and controlling the target intelligent household appliances in the plurality of intelligent household appliances to execute the equipment service based on the statement intention. And performing text analysis and intention recognition on the complete and specific second user statement through a semantic recognition engine, and determining a target control object and equipment services to be executed.

In a second aspect, an embodiment of the present application provides an information filling apparatus for controlling an intelligent home appliance based on voice, including:

the acquisition module is used for calling the human-computer voice interaction engine to acquire current voice information input by a user;

the processing module is used for carrying out voice-to-text operation on the current voice information to obtain a first user statement;

the processing module is further configured to perform data processing on the first user statement to obtain instruction information in the first user statement;

the processing module is further configured to control a target intelligent household appliance of the plurality of intelligent household appliances to execute an appliance service according to the first user statement if the instruction information includes appliance information, area information, function information, and operation information, where the function information indicates an appliance function of the target intelligent household appliance, and the operation information indicates an operation performed on the target intelligent household appliance;

the obtaining module is further configured to obtain a user equipment list and a historical user statement if the instruction information lacks one or more of the device information, the area information, the function information, or the operation information, where the user equipment list includes a device name, a device area, and a device function of each of the plurality of intelligent home appliances;

the processing module is further configured to match the first user statement with the user equipment list to obtain first filling information;

the processing module is further configured to match the first user statement with the historical user statement to obtain second filling information;

the processing module is further configured to fill the first user statement according to the first filling information and the second filling information to obtain a second user statement, and control a target intelligent household appliance of the plurality of intelligent household appliances to execute the device service according to the second user statement.

In a possible design, the processing module is further configured to, when the instruction information includes the function information, search, from the user equipment list, an equipment name corresponding to the function information in the instruction information, and use the equipment name as the first padding information; when the instruction information comprises the equipment information, determining an area to which a user belongs, and searching an equipment area corresponding to the equipment information in the instruction information from the user equipment list; if the equipment area contains the area to which the user belongs, taking the area to which the user belongs as the first filling information; and if the equipment area lacks the area to which the user belongs, taking the equipment area as the first filling information.

In another possible design, the processing module is further configured to determine that the function information in the instruction information is a volume, search, from the user equipment list, an equipment name corresponding to the volume as a sound, and use the sound as the first filling information.

In another possible design, the processing module is further configured to, when the instruction information includes the device information, associate the device information with the historical user statement to obtain area information associated with the device information, and use the area information as the second filling information; when the instruction information comprises the function information and the area information, associating the function information and the area information with the historical user statement to obtain equipment information associated with the function information and the area information, and taking the equipment information as the second filling information; when the instruction information comprises the function information, the function information is associated with the historical user statement to obtain equipment information associated with the function information, the equipment information associated with the function information is associated with the historical user statement to obtain area information associated with the equipment information, and the equipment information associated with the function information and the area information associated with the equipment information are used as the second filling information.

In a possible design, the processing module is further configured to determine that device information in the instruction information is a fan, search, from the historical user statements, a target historical statement that is closest to the first user statement time interval and that includes area information that has a physical space adaptation relationship with the fan, obtain, according to the area information in the target historical statement, that the area information that has the physical space adaptation relationship with the fan is a living room, and use the living room as the second filling information.

In another possible design, the processing module is further configured to determine that function information in the instruction information is temperature, search, from the historical user statement, a first target historical statement that is closest to the first user statement in time interval and that includes device information having a device function adaptive relationship to the temperature, and obtain, according to area information in the first target historical statement, that the device information having a device function adaptive relationship to the temperature is an air conditioner; searching a second target historical statement which is closest to the time interval of the first target historical statement and contains regional information having a physical space adaptation relation with the air conditioner from the historical user statement, obtaining the regional information having the physical space adaptation relation with the air conditioner as a bedroom according to the regional information in the second target historical statement, and taking the air conditioner and the bedroom as second filling information.

In another possible design, the processing module is further configured to perform keyword parsing on the first user statement and extract at least two keywords; and performing semantic recognition on the keywords to obtain instruction information in the first user statement.

In another possible design, the processing module is further configured to disassemble the second user statement to obtain a plurality of analysis graphs, each analysis graph in the plurality of analysis graphs includes an analysis node and each analysis node relationship line, and the analysis node is a word; determining a target analysis node and an analysis node relation line corresponding to the target analysis node from each analysis graph to obtain a main original triple corresponding to each analysis graph; searching a first knowledge sub-graph corresponding to a currently processed analysis graph from a knowledge graph of a knowledge base according to a main original triple corresponding to the currently processed analysis graph, wherein the knowledge graph comprises a plurality of knowledge sub-graphs; if the first knowledge sub-graph is found, marking the currently processed analysis icon as a correct statement, determining that a main original triple corresponding to the currently processed analysis icon is used for representing the statement intention of the second user statement, and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service based on the statement intention; if the first knowledge subgraph is not found, imagination reasoning is carried out on the currently processed analytic graph according to the knowledge base to obtain a probability graph, and a second knowledge subgraph corresponding to the probability graph is searched from the knowledge graph of the knowledge base; if the second knowledge sub-graph is not found, discarding the currently processed analysis graph, and processing other analysis graphs except the currently processed analysis graph in the plurality of analysis graphs; and if the second knowledge sub-graph is found, determining that the main original triple corresponding to the second knowledge sub-graph is used for representing the statement intention of the second user statement, and controlling the target intelligent household appliances in the plurality of intelligent household appliances to execute the equipment service based on the statement intention.

The operations and the beneficial effects executed by the information filling device based on the voice control intelligent household appliance can be referred to the method and the beneficial effects of the first aspect, and repeated parts are not described again.

A third aspect, an embodiment of the present application provides an information filling system for controlling an intelligent home appliance based on voice, including a server and a plurality of terminal devices, where the server is configured to obtain current voice information input by a user, perform data processing on the current voice information to obtain a first user statement and instruction information in the first user statement, control a target intelligent home appliance to execute a device service according to the first user statement if the instruction information includes device information, region information, function information, and operation information, and perform information filling on the first user statement based on a user device list and a historical user statement to obtain a second user statement if the instruction information lacks one or more of the device information, the region information, the function information, and the operation information, and control the target intelligent home appliance to execute the device service according to the second user statement; the terminal equipment is used for receiving the control instruction sent by the server, and the target terminal equipment executes equipment service according to the control instruction. In the voice control intelligent household appliance system, information filling is carried out on current voice information based on a user equipment list and historical user sentences, so that the user can control the intelligent household appliance through simpler sentences which accord with daily life, the operation complexity of the user is reduced, and the user experience is improved.

In a fourth aspect, an embodiment of the present application provides an information filling system for controlling an intelligent household appliance based on voice, where the information filling system for controlling an intelligent household appliance based on voice includes a processor, a memory and a communication bus, where the memory is used to store computer execution instructions; the processor is configured to execute the computer-executable instructions stored in the memory to cause the voice-based intelligent appliance information populating system to perform the method of any one of the first aspects; the communication bus is used for realizing connection communication between the processor and the memory.

In a fifth aspect, embodiments of the present application provide a server, which includes a processor, a memory, and a communication bus, where the memory is used for storing computer-executable instructions; the processor is configured to execute computer-executable instructions stored in the memory to cause the complaint warning identification system to perform the method of any of the first aspects; the communication bus is used for realizing connection communication between the processor and the memory.

In a sixth aspect, the present application provides a computer-readable storage medium for storing a computer program, which when executed, causes the method according to any one of the first aspect to be implemented.

In a seventh aspect, the present application provides a computer program product including a computer program, and when the computer program is executed, the method according to any one of the first aspect is implemented.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present application, the drawings required to be used in the embodiments or the background art of the present application will be described below.

Fig. 1 is a schematic structural diagram of an information filling system for controlling an intelligent home appliance based on voice according to an embodiment of the present application;

fig. 2 is a schematic flowchart of an information filling method for controlling an intelligent household appliance based on voice according to an embodiment of the present application;

fig. 3 is an exemplary diagram of an information filling system using a voice-based control intelligent appliance according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an information filling apparatus for controlling an intelligent home appliance based on voice according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

As shown in fig. 1, fig. 1 is a schematic structural diagram of an information filling system for a voice-controlled intelligent appliance according to an embodiment of the present application, where the information filling system includes a server 101 and a plurality of terminal devices 102, and the detailed description of each module is as follows.

The server 101 comprises a man-machine voice interaction engine, the server 101 calls the man-machine voice interaction engine to obtain current voice information input by a user, and the current voice information is subjected to voice-to-text operation to obtain a first user statement; performing data processing on the first user statement to obtain instruction information in the first user statement; if the instruction information includes device information, area information, function information, and operation information, controlling a target intelligent appliance of the plurality of intelligent appliances to perform a device service according to a first user statement, the function information indicating a device function of the target intelligent appliance, the operation information indicating an operation performed with respect to the target intelligent appliance; if the instruction information lacks one or more of device information, area information, function information or operation information, obtaining a user device list and a historical user statement, wherein the user device list comprises a device name, a device area and a device function of each intelligent household appliance in the intelligent household appliances; matching the first user statement with the user equipment list to obtain first filling information; matching the first user statement with the historical user statement to obtain second filling information; and filling the first user statement according to the first filling information and the second filling information to obtain a second user statement, and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service according to the second user statement.

The terminal device 102 may be an intelligent appliance such as an air conditioner, a fan, a refrigerator, etc., and the manner in which the human-computer voice interaction engine in the terminal device 102 receives the current voice information of the user may be, but is not limited to, voice input, and may also adopt forms such as text input, etc.; the server 101 and the terminal device 102 may communicate with each other through a network, which may be based on any wired and wireless network, including but not limited to the internet, a wide area network, a metropolitan area network, a local area network, a Virtual Private Network (VPN), a wireless communication network, and the like. One server 101 may correspond to a plurality of terminal devices 102 at the same time, or the information filling system based on the voice-controlled intelligent appliance includes a plurality of servers 101, and each server 101 corresponds to one or more terminal devices 102.

It should be noted that the type and number of the servers 101 and the number of the terminal devices 102 in the system shown in fig. 1 are only used for example, and do not constitute a limitation to the embodiment of the present application; the terminal device 102 in this embodiment may further include other possible functional modules, such as a microphone, a speaker, an earpiece, a flash, bluetooth, an external interface, a key, various sensors, and the like, where the microphone may be configured to receive voice information of a user, and the speaker and the earpiece may be configured to transmit voice reply information to the user.

As shown in fig. 2, fig. 2 is a schematic flowchart of an information filling method for controlling an intelligent home appliance based on voice according to an embodiment of the present application, where the method includes, but is not limited to, the following steps:

step S201: and calling a man-machine voice interaction engine to obtain current voice information input by a user, and carrying out voice-to-character operation on the current voice information to obtain a first user statement.

In one implementation mode, a user inputs current voice information in a voice input mode, and the system performs voice-to-text operation on the current voice information through an external voice conversion technical method to obtain a first user statement.

In another implementation, the user directly inputs the current textual information using a textual input format, and the system directly takes the current textual information as the first user statement.

Step S202: and carrying out data processing on the first user statement to obtain instruction information in the first user statement.

Specifically, the first user statement is subjected to keyword dismantling, at least two keywords are extracted, and semantic recognition is performed on the keywords to obtain instruction information in the first user statement.

In the embodiment of the application, a semantic recognition engine disassembles a first user statement to obtain a plurality of analytic graphs, wherein each analytic graph comprises an analytic node (a single word) and each analytic node relation line; determining a target analysis node and a corresponding analysis node relation line for each analysis graph to obtain a main original triple, wherein each original triple comprises an original incidence relation (a semantic relation or a grammatical relation) and two original entities, each original entity corresponds to a word, and the original incidence relation is used for representing the semantic relation and/or the grammatical relation of the two original entities; and determining instruction information in the first user statement according to the main original triple.

For example, if the first user statement is "turn on the bedroom air conditioner", then the "handle", "bedroom", "air conditioner", "turn on" five analysis nodes and four analysis node relationship lines may be obtained through disassembly, and an analysis graph of the first user statement is obtained, where the original triples are "handle-bedroom", "bedroom-air conditioner", "air conditioner-on", "represents the analysis node relationship lines, the main original triples are" bedroom-air conditioner "and" air conditioner-on ", the device information in the first user statement is determined to be" air conditioner ", the region information is" bedroom ", and the operation information is" turn on "according to the main original triples.

Step S203: it is determined whether the instruction information includes device information, area information, function information, and operation information.

And if the instruction information comprises the equipment information, the area information, the function information and the operation information, executing S204, and if the instruction information lacks one or more of the equipment information, the area information, the function information or the operation information, executing S205-S206.

Specifically, when the instruction information includes device information, area information, function information and operation information, it is determined that the first user statement is a complete and specific instruction, and a target control object is determined according to the first user statement; when the instruction information lacks one or more of the device information, the area information, the function information or the operation information, it is determined that the first user statement is a fuzzy and information-lacking instruction, information filling needs to be performed on the first user statement to obtain a second user statement, and then a target control object is determined according to the second user statement.

Optionally, the instruction information may further include numerical information and unit information. For example, the first user statement is "adjust the temperature of the bathroom water heater to 50 degrees celsius," where "50" is numerical information and "degrees celsius" is unit information, the numerical information and the unit information corresponding to the "temperature" attribute in the first user statement.

Step S204: and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service according to the first user statement.

In the embodiment of the application, a first user statement is disassembled to obtain a plurality of analysis graphs, wherein each analysis graph in the plurality of analysis graphs comprises an analysis node and a relation line of each analysis node, and the analysis node is a word; determining a target analysis node and an analysis node relation line corresponding to the target analysis node from each analysis graph to obtain a main original triple corresponding to each analysis graph; searching a first knowledge sub-graph corresponding to the currently processed analytic graph from a knowledge graph of a knowledge base according to a main original triple corresponding to the currently processed analytic graph, wherein the knowledge graph comprises a plurality of knowledge sub-graphs; if the first knowledge sub-graph is found, marking the currently processed analytic graph as a correct sentence, determining that a main original triple corresponding to the currently processed analytic graph is used for representing a sentence intention of the first user sentence, and controlling a target intelligent household appliance in the intelligent household appliances to execute equipment service based on the sentence intention; if the first knowledge subgraph is not found, imagination reasoning is carried out on the currently processed analytic graph according to the knowledge base to obtain a probability graph, and a second knowledge subgraph corresponding to the probability graph is searched from the knowledge graph of the knowledge base; if the second knowledge subgraph is not found, discarding the currently processed analytic graph, and processing other analytic graphs except the currently processed analytic graph in the analytic graphs; and if the second knowledge sub-graph is found, determining that the main original triple corresponding to the second knowledge sub-graph is used for representing the statement intention of the first user statement, and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service based on the statement intention.

For example, the first user statement is "adjust the air conditioner temperature in the living room up", and five analysis nodes and four analysis node relationship lines of "handle", "living room", "air conditioner", "temperature", "adjust up" can be obtained by disassembling, so as to obtain the analysis graph of the first user statement, wherein the original triplets are "handle-living room", "living room-air conditioner", "air conditioner-temperature", "temperature-adjust up", and the main original triplets are "living room-air conditioner" and "temperature-adjust up". After the main original triple is determined, trying to find a knowledge sub-graph which has a matching relationship with a currently processed analytic graph in a knowledge graph of the knowledge base according to the main original triple, and if the main original triple 'living room-air conditioner' can find a plurality of target triples 'living room-certain equipment' in the knowledge sub-graph which are correspondingly matched in the knowledge graph of the knowledge base; the "temperature-raise" can also find a plurality of target triplets "temperature-certain operation" in the corresponding matched knowledge sub-graph in the knowledge graph of the knowledge base; the main original triplets "living room-air conditioning" and "temperature-up" can be used to characterize the user's intent of the user input sentence.

If the knowledge subgraph cannot be found, imagination reasoning is carried out on the analysis graph according to the knowledge base to obtain a probability graph, then the probability graph is taken into the knowledge graph to be matched, and whether the knowledge subgraph (corresponding to different expression modes with the same semantics) can be found is judged; if the expression can not be found, determining that no different expression modes exist, and discarding the expression modes as error sentences; and if the three groups can be found, determining the three groups corresponding to the found knowledge subgraph as feature data for representing the user intention of the user input sentence.

It should be noted that, imagination inference is performed on the analytic graph according to the knowledge base to obtain the probability graph, and the specific process includes: if two entities of the current main original triple are (Xa and Xb) respectively, finding a knowledge node which has a connection relation with Xa and is not matched with Xb in the knowledge base to obtain Ya, and obtaining Yb in the same way, so that an extended graph can be obtained, wherein the entities are (Ya, xa) and (Xb and Yb) respectively, namely the extended graph is obtained, and the updated extended graph is connected with the analysis graph to obtain the probability graph.

It should be noted that, taking the probability map into the knowledge map for matching to see whether the knowledge sub-map can be found, the specific process includes: and (4) assuming that only knowledge subgraphs are included in the knowledge graph of the knowledge base associated with the currently used semantic recognition engine, and matching the knowledge subgraphs to the knowledge subgraphs according to the probability graph.

It should be noted that, determining the found triple corresponding to the knowledge sub-graph as the feature data for characterizing the user intention of the user input sentence includes: and determining the triple contained in the found knowledge subgraph as feature data for representing the user intention of the user input sentence, namely the user original input sentence, and determining that the sentence representing the user intention can be another sentence prestored in the knowledge base after processing, so that the semantic identification processing process for the user original input sentence is completed.

Step S205: the method comprises the steps of obtaining a user equipment list and historical user sentences, matching a first user sentence with the user equipment list to obtain first filling information, and matching the first user sentence with the historical user sentence to obtain second filling information.

The user equipment list comprises the equipment name, the equipment area and the equipment function of each intelligent household appliance in the intelligent household appliances, and the historical user statement comprises at least one user statement.

In one implementation, when the instruction information includes function information, a device name corresponding to the function information in the instruction information is searched from a user equipment list, and the device name is used as first filling information.

For example, the function information in the instruction information is the volume, the device name corresponding to the volume is searched for from the user device list as the sound, and the sound is set as the first padding information. The specific process comprises the following steps: the first user statement is 'volume up', the attribute 'volume' mentioned according to the current sentence is matched with the user equipment list, if only one sound box can adjust the volume in the user equipment list and only one sound box exists, the equipment name is determined to be the sound box, the sound box is used as first filling information, and the system can operate the sound box to execute the instruction.

In another implementation manner, when the instruction information includes the device information, determining a region to which the user belongs, and searching a device region corresponding to the device information in the instruction information from a user device list; if the equipment area comprises an area to which the user belongs, taking the area to which the user belongs as first filling information; and if the equipment area lacks the area to which the user belongs, taking the equipment area as first filling information.

For example, the device information in the instruction information is an air conditioner, the user is in a bedroom, a device area corresponding to the air conditioner is searched from a user device list, and if the device area comprises the bedroom, the bedroom is used as first filling information; and if the equipment area lacks a bedroom, taking the equipment area as first filling information. The specific process comprises the following steps: the first user statement is 'turn on air conditioner', the area to which the user belongs is a bedroom, the device 'air conditioner' mentioned in the first user statement is matched with the user device list, if the device 'air conditioner' exists in the bedroom, the bedroom is used as first filling information, the system can operate the air conditioner of the bedroom, if only the living room has the air conditioner, the living room is used as the first filling information, and the system can operate the air conditioner of the living room.

In another implementation manner, when the instruction information includes device information, the device information is associated with the historical user statement to obtain area information associated with the device information, and the area information is used as second filling information.

For example, the device information in the instruction information is a fan, a target historical statement which is closest to the time interval of the first user statement and contains area information having a physical space adaptation relationship with the fan is searched from the historical user statements, the area information having the physical space adaptation relationship with the fan is obtained according to the area information in the target historical statement and is taken as a bedroom, and the bedroom is taken as second filling information. The specific process comprises the following steps: the adjacent historical sentences are 'air conditioners for opening bedrooms', the first user sentence is 'fans are also opened', the first user sentence lacks region information, meanwhile, the region information in the adjacent historical sentences is bedrooms, and the bedrooms are filled with equipment 'fans', the adjacent historical sentences are used as target historical sentences, the bedrooms are used as second filling information, and the system can operate the fans of the bedrooms.

In another implementation, when the instruction information includes function information and area information, the function information and the area information are associated with the historical user statement to obtain device information associated with the function information and the area information, and the device information is used as second filling information.

For example, if the adjacent history statement is "turn on the tv in the living room", the first user statement is "turn up the temperature in the living room", the function information in the instruction information is the temperature, the area information is the living room, because the first user statement lacks the device information, the target history statement which is closest to the first user statement in time interval and contains the device information having a physical space adaptation relationship with the living room and/or having a device function adaptation relationship with the temperature is searched from the history user statement, the device "tv" in the adjacent history statement does not match the temperature function, based on the non-adjacent history user statement, it is determined that the device "air conditioner" matches the temperature function and the device "air conditioner" exists in the living room, and the system will operate the air conditioner in the living room with the air conditioner as the second filling information.

In another implementation, when the instruction information includes function information, the function information is associated with a history user statement to obtain device information associated with the function information, the device information associated with the function information is associated with the history user statement to obtain area information associated with the device information, and the device information associated with the function information and the area information associated with the device information are used as second filling information.

For example, the function information in the instruction information is temperature, a first target historical statement which is closest to a first user statement time interval and contains equipment information having an equipment function adaptive relationship with the temperature is searched from historical user statements, and the equipment information having the equipment function adaptive relationship with the temperature is obtained as an air conditioner according to area information in the first target historical statement; and searching a second target historical statement which has the closest time interval with the first target historical statement and contains the area information having the physical space adaptation relation with the air conditioner from the historical user statements, obtaining the area information having the physical space adaptation relation with the air conditioner according to the area information in the second target historical statement, and taking the air conditioner and the bedroom as second filling information. The specific process comprises the following steps: the non-adjacent historical statement is 'air conditioner in bedroom is opened', the adjacent historical statement is 'fan is also opened', the first user statement is 'temperature is adjusted to 26 degrees by the way', the first user statement lacks equipment information, the equipment 'fan' in the adjacent historical statement is not matched with the temperature function, the equipment 'air conditioner' in the non-adjacent historical statement is matched with the temperature function, the area information in the non-adjacent historical statement is bedroom, the intelligent household appliance 'air conditioner' exists in the bedroom, the air conditioner and the bedroom are used as second filling information, and the system can operate the air conditioner in the bedroom.

Fig. 3 is an exemplary diagram of an information filling system using a voice-based control intelligent appliance according to an embodiment of the present application. As shown in the figure, the server acquires that the current voice information input by the user is ' adjust the temperature to-18 ℃, the system judges that the current voice information is a fuzzy and information-lacking instruction, searches the equipment information and the area information corresponding to ' temperature ' function information and ' -18 ℃ from the user equipment list, and automatically adapts the corresponding equipment function area according to the temperature range of ' -18 ℃ in the current voice information to obtain first filling information, wherein the equipment information in the first filling information is a freezing chamber of a refrigerator, and the area information in the first filling information is a kitchen; searching second filling information which is closest to the current voice information time interval and contains functional adaptation relations with 'temperature' and '-18 ℃ from historical user sentences, wherein equipment information in the second filling information is a freezing chamber of a refrigerator, area information in the second filling information is a kitchen, information filling is carried out on the current voice information by using the first filling information and the second filling information, the obtained filled information is' the temperature of a freezing chamber of the refrigerator in the kitchen is adjusted to-18 ℃, semantic recognition is carried out on the filled information to obtain a complete and specific instruction, and after the refrigerator in the kitchen receives the complete and specific instruction, the temperature of the freezing chamber is adjusted to-18 ℃.

It should be noted that, in the embodiment of the present application, filling information may be obtained according to whether instruction information in a first user statement matches a name of a device owned by a user, matches a function of a device in an area where the user is located, matches the function of the device owned by the user, and matches a historical user statement, where the filling information is beneficial to enhanced identification of the first user statement by a system.

Step S206: and filling the first user statement according to the first filling information and the second filling information to obtain a second user statement, and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service according to the second user statement.

Specifically, the first filling information and the second filling information are used for supplementing missing information in the first user statement to obtain a second user statement, wherein the second user statement comprises equipment information, area information, function information and operation information, semantic analysis and intention identification are performed on the second user statement, the specific process is the step S204, which is not repeated here, and the target intelligent household appliance is controlled to execute equipment service according to the identification result of the statement intention.

It should be noted that, when the server obtains the current voice information input by the user, that is, "freeze the ice sucker just bought by me", according to step S203, the system determines that the current voice information is a fuzzy instruction lacking information, according to step S205, the system searches the function information corresponding to "freeze" in the current voice information from the user device list as a freezing function, searches the device name corresponding to "ice sucker" and freezing function from the user device list as a freezing chamber of the refrigerator, determines that the device information in the first filling information is the freezing chamber of the refrigerator, determines that the area information in the first filling information is a kitchen, searches the second filling information which is closest to the current voice information in time interval and contains a function fitting relationship with "ice sucker" and "freeze" from a historical user sentence, determines that the device information in the second filling information is the freezing chamber of the refrigerator, and the area information in the second filling information is the kitchen; according to the step S206, the system utilizes the first filling information and the second filling information to fill the current voice information, the information after filling is obtained as that 'the ice sucker just bought by me is frozen in the freezing chamber of the kitchen refrigerator', the semantic recognition is carried out on the information after filling to obtain a complete and specific instruction that 'the freezing chamber of the kitchen refrigerator is opened', after the refrigerator in the kitchen receives the complete and specific instruction, the freezing chamber is opened, and the temperature is set to be between-4 ℃ and-24 ℃ according to the temperature range corresponding to the freezing chamber of the refrigerator.

In the embodiment of the application, the voice-controlled intelligent household appliance system acquires the current voice information input by a user by calling a man-machine voice interaction engine, and if the current voice information is a complete and specific instruction, the system controls the target intelligent household appliance to execute the equipment service according to the current voice information; if the current voice information is a fuzzy instruction lacking information, the system fills the current voice information by using a user equipment list and a historical user sentence, then controls a target intelligent household appliance to execute equipment service according to the information filled with the information, can enhance and identify the voice instruction input by the user and determine a target control object, realizes that the user can control the intelligent household appliance through simpler sentences conforming to daily life, reduces the operation complexity of the user, and improves the user experience.

As shown in fig. 4, fig. 4 is a schematic structural diagram of an information filling apparatus for controlling an intelligent home appliance based on voice according to an embodiment of the present application, where the information filling apparatus for controlling an intelligent home appliance based on voice includes an obtaining module 401 and a processing module 402, where details of each unit are described as follows.

The acquisition module 401: the system is used for calling the man-machine voice interaction engine to acquire the current voice information input by the user.

The processing module 402: and the voice conversion module is used for carrying out voice-to-character operation on the current voice information to obtain a first user statement.

Optionally, the processing module 402 is further configured to store the first user statement obtained in step S201.

The processing module 402: and the system is also used for carrying out data processing on the first user statement to obtain instruction information in the first user statement.

Specifically, keyword dismantling is carried out on a first user sentence, and at least two keywords are extracted; and performing semantic recognition on the keywords to obtain instruction information in the first user statement.

The processing module 402: and if the instruction information includes device information, area information, function information and operation information, controlling a target intelligent household appliance of the plurality of intelligent household appliances to execute a device service according to the first user statement, wherein the function information represents a device function of the target intelligent household appliance, and the operation information represents an operation performed on the target intelligent household appliance.

Specifically, a first user statement is disassembled to obtain a plurality of analysis graphs, each analysis graph in the plurality of analysis graphs comprises an analysis node and a relation line of each analysis node, and the analysis node is a word; determining a target analysis node and an analysis node relation line corresponding to the target analysis node from each analysis graph to obtain a main original triple corresponding to each analysis graph; searching a first knowledge sub-graph corresponding to the currently processed analytic graph from a knowledge graph of a knowledge base according to a main original triple corresponding to the currently processed analytic graph, wherein the knowledge graph comprises a plurality of knowledge sub-graphs; if the first knowledge sub-graph is found, marking the currently processed analytic graph as a correct sentence, determining that a main original triple corresponding to the currently processed analytic graph is used for representing a sentence intention of the first user sentence, and controlling a target intelligent household appliance in the intelligent household appliances to execute equipment service based on the sentence intention; if the first knowledge subgraph is not found, imagination reasoning is carried out on the currently processed analytic graph according to the knowledge base to obtain a probability graph, and a second knowledge subgraph corresponding to the probability graph is searched from the knowledge graph of the knowledge base; if the second knowledge subgraph is not found, discarding the currently processed analytic graph, and processing other analytic graphs except the currently processed analytic graph in the plurality of analytic graphs; and if the second knowledge sub-graph is found, determining that the main original triple corresponding to the second knowledge sub-graph is used for representing the statement intention of the first user statement, and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service based on the statement intention.

The acquisition module 401: and the processor is further configured to acquire a user equipment list and a historical user statement if the instruction information lacks one or more of device information, area information, function information, or operation information, where the user equipment list includes a device name, a device area, and a device function of each of the plurality of intelligent home appliances.

The processing module 402: and the matching module is further used for matching the first user statement with the user equipment list to obtain first filling information.

Optionally, the processing module 402 is further configured to, when the instruction information includes the function information, search a device name corresponding to the function information in the instruction information from the user equipment list, and use the device name as the first padding information.

Specifically, the function information in the instruction information is determined to be the volume, the device name corresponding to the volume is searched from the user device list and is used as the sound, and the sound is used as the first filling information.

Optionally, the processing module 402 determines the area to which the user belongs when the instruction information includes the device information, and searches a device area corresponding to the device information in the instruction information from the user device list; if the equipment area comprises the area to which the user belongs, taking the area to which the user belongs as first filling information; and if the equipment area lacks the area to which the user belongs, taking the equipment area as first filling information.

The processing module 402: and the system is also used for matching the first user statement with the historical user statement to obtain second filling information.

Optionally, when the instruction information includes device information, the processing module 402 associates the device information with a history user statement to obtain area information associated with the device information, and uses the area information as second filling information.

Specifically, the device information in the instruction information is determined to be the fan, a target historical statement which is closest to the time interval of the first user statement and contains regional information having a physical space adaptation relationship with the fan is searched from the historical user statements, the regional information having the physical space adaptation relationship with the fan is obtained as a living room according to the regional information in the target historical statement, and the living room is used as second filling information.

Optionally, when the instruction information includes function information and area information, the processing module 402 associates the function information and the area information with a historical user statement to obtain device information associated with the function information and the area information, and uses the device information as second filling information.

Optionally, when the instruction information includes function information, the processing module 402 associates the function information with a history user statement to obtain device information associated with the function information, associates the device information associated with the function information with the history user statement to obtain area information associated with the device information, and uses the device information associated with the function information and the area information associated with the device information as second filling information.

Specifically, determining that the function information in the instruction information is temperature, searching a first target historical statement which is closest to a time interval of the first user statement and contains equipment information having an equipment function adaptive relationship with the temperature from the historical user statement, and obtaining the equipment information having the equipment function adaptive relationship with the temperature as an air conditioner according to area information in the first target historical statement; and searching a second target historical statement which has the closest time interval with the first target historical statement and contains the area information having the physical space adaptation relation with the air conditioner from the historical user statements, obtaining the area information having the physical space adaptation relation with the air conditioner according to the area information in the second target historical statement, and taking the air conditioner and the bedroom as second filling information.

The processing module 402: and the second user statement is used for controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service according to the second user statement.

Specifically, the second user statement is disassembled to obtain a plurality of analysis graphs, each analysis graph in the plurality of analysis graphs comprises an analysis node and a relation line of each analysis node, and the analysis node is a word; determining a target analysis node and an analysis node relation line corresponding to the target analysis node from each analysis graph to obtain a main original triple corresponding to each analysis graph; searching a first knowledge sub-graph corresponding to the currently processed analytic graph from a knowledge graph of a knowledge base according to a main original triple corresponding to the currently processed analytic graph, wherein the knowledge graph comprises a plurality of knowledge sub-graphs; if the first knowledge sub-graph is found, marking the currently processed analytic graph as a correct statement, determining that a main original triple corresponding to the currently processed analytic graph is used for representing a statement intention of a second user statement, and controlling a target intelligent household appliance in a plurality of intelligent household appliances to execute equipment service based on the statement intention; if the first knowledge subgraph is not found, imagination inference is carried out on the currently processed analytic graph according to the knowledge base to obtain a probability graph, and a second knowledge subgraph corresponding to the probability graph is searched from the knowledge graph of the knowledge base; if the second knowledge subgraph is not found, discarding the currently processed analytic graph, and processing other analytic graphs except the currently processed analytic graph in the plurality of analytic graphs; and if the second knowledge sub-graph is found, determining that the main original triple corresponding to the second knowledge sub-graph is used for representing the statement intention of the second user statement, and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service based on the statement intention.

It should be noted that the implementation of the obtaining module 401 and the processing module 402 may correspond to the corresponding description of the method embodiment shown in fig. 2, and perform the method and the function performed by the server 101 and the terminal device 102 in the foregoing embodiment.

The foregoing details describe the information filling system based on voice-controlled intelligent home appliances and how to implement the information filling process based on voice-controlled intelligent home appliances using the system, and the following describes a deployment manner of the information filling system based on voice-controlled intelligent home appliances with reference to fig. 5.

As shown in fig. 5, fig. 5 is a schematic structural diagram of a server provided in an embodiment of the present application, where the server includes a processor 501, a memory 502, and a transceiver 503. The processor 501, the memory 502 and the transceiver 503 can communicate with each other via the communication bus 504 to transmit instructions and/or data signals, the memory 502 is used to store a computer program, and the processor 501 is used to call and run the computer program from the memory 502 to control the transceiver 503 to transmit and receive signals.

The processor 501 may correspond to the processing module 402 in fig. 4, the processor 501 and the memory 502 may be combined into a processing device, and the processor 501 is configured to execute the program code stored in the memory 502 to implement the functions. In particular implementations, the memory 502 may be integrated into the processor 501 or separate from the processor 501.

The transceiver 503 may also be referred to as a transceiver unit or a transceiver module. The transceiver 503 may include a receiver (or receiver, receiving circuit) and a transmitter (or transmitter, transmitting circuit). Wherein the receiver is used for receiving signals, and the transmitter is used for sending signals.

It should be understood that the server shown in fig. 5 can implement the processes of the method embodiment shown in fig. 2, which relate to the information filling system for controlling intelligent home appliances based on voice. The operation and/or function of each module in the server are respectively for implementing the corresponding flow in the above method embodiment. Reference may be made specifically to the description of the method embodiments above, and in order to avoid repetition, detailed description is omitted here where appropriate.

The processor 501 may be, for example, a central processing unit, a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or execute the various illustrative modules described in connection with the present disclosure. The processor 501 may also be a combination that performs computing functions, e.g., including one or more microprocessors in combination, a digital signal processor in combination with a microprocessor, and so forth. The communication bus 504 may be a peripheral component interconnect standard PCI bus or an extended industry standard architecture EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 5, but that does not indicate only one bus or one type of bus. A communication bus 504 is used to enable the connection communication between these components. In an embodiment of the present invention, the memory 502 may include a volatile memory, such as a non-volatile dynamic random access memory (NVRAM), a phase change random access memory (PRAM), a Magnetoresistive Random Access Memory (MRAM), and the like, and may further include a non-volatile memory, such as at least one magnetic disk memory device, an electrically erasable programmable read-only memory (EEPROM), a flash memory device, such as a NOR flash memory (NOR flash memory) or a NAND flash memory (EEPROM), a semiconductor device, such as a Solid State Disk (SSD), and the like. The memory 502 may optionally be at least one storage device located remotely from the processor 501. Optionally, a set of computer program code or configuration information may also be stored in memory 502. Optionally, the processor 501 may also execute programs stored in the memory 502. The transceiver 503 is used for communicating instructions or data with other components. The processor may cooperate with the memory and the transceiver to perform any of the methods and functions of the complaint warning identification system of the embodiments of the application described above.

According to the method provided by the embodiment of the present application, the present application further provides a computer program product, which includes: computer program, which, when run on a computer, causes the computer to perform the method of any of the embodiments shown in fig. 1 or fig. 2.

According to the method provided by the embodiment of the present application, the present application further provides a computer-readable medium, which stores a computer program, and when the computer program runs on a computer, the computer is caused to execute the method of any one of the embodiments shown in fig. 1 or fig. 2.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The readable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a Digital Video Disk (DVD)), or a semiconductor medium (e.g., a Solid State Disk (SSD)), among others.

It should be understood that the term "and/or" herein is merely one type of association relationship that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone.

The "plurality" appearing in the embodiments of the present application means two or more.

The descriptions of the first, second, etc. appearing in the embodiments of the present application are only for illustrating and differentiating the description objects, and do not represent the specific limitation on the number of the described objects in the embodiments of the present application, and cannot constitute any limitation on the embodiments of the present application.

The above-mentioned embodiments further explain the objects, technical solutions and advantages of the present application in detail. Any modification, equivalent replacement, improvement and the like made within the principle of the present application shall be included in the protection scope of the present application.

Claims

1. The information filling method based on the voice control intelligent household appliances is characterized by being applied to a server of a voice control intelligent household appliance system, wherein the voice control intelligent household appliance system comprises the server and a plurality of intelligent household appliances, and the server comprises a human-computer voice interaction engine; the method comprises the following steps:

if the instruction information comprises equipment information, area information, function information and operation information, controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute equipment service according to the first user statement, wherein the function information represents equipment functions of the target intelligent household appliance, and the operation information represents operation performed on the target intelligent household appliance;

2. The method of claim 1, wherein the matching the first user statement with the user device list to obtain first padding information comprises:

when the instruction information comprises the function information, searching a device name corresponding to the function information in the instruction information from the user equipment list, and taking the device name as the first filling information; or

When the instruction information comprises the equipment information, determining an area to which a user belongs, and searching an equipment area corresponding to the equipment information in the instruction information from the user equipment list;

if the equipment area contains the area to which the user belongs, taking the area to which the user belongs as the first filling information;

and if the equipment area lacks the area to which the user belongs, taking the equipment area as the first filling information.

3. The method according to claim 2, wherein when the instruction information includes the function information, the searching for a device name corresponding to the function information in the instruction information from the user equipment list, and using the device name as the first padding information comprises:

and determining that the function information in the instruction information is volume, searching the user equipment list for the equipment name corresponding to the volume to be a sound, and taking the sound as the first filling information.

4. The method of claim 1, wherein the matching the first user statement and the historical user statement to obtain second filling information comprises:

when the instruction information comprises the equipment information, associating the equipment information with the historical user statement to obtain area information associated with the equipment information, and taking the area information as the second filling information; or

When the instruction information comprises the function information and the area information, associating the function information and the area information with the historical user statement to obtain equipment information associated with the function information and the area information, and taking the equipment information as the second filling information; or

When the instruction information includes the function information, associating the function information with the historical user statement to obtain device information associated with the function information, associating the device information associated with the function information with the historical user statement to obtain area information associated with the device information, and taking the device information associated with the function information and the area information associated with the device information as the second filling information.

5. The method according to claim 4, wherein, when the instruction information includes the device information, associating the device information with the historical user statement to obtain area information associated with the device information, and using the area information as the second filling information comprises:

determining that the device information in the instruction information is a fan, searching a target historical statement which is closest to the first user statement in time interval and contains area information having a physical space adaptation relationship with the fan from the historical user statements, obtaining the area information having the physical space adaptation relationship with the fan as a living room according to the area information in the target historical statement, and taking the living room as the second filling information.

6. The method according to claim 4, wherein, when the instruction information includes the function information, associating the function information with the historical user statement to obtain device information associated with the function information, associating the device information associated with the function information with the historical user statement to obtain area information associated with the device information, and taking the device information associated with the function information and the area information associated with the device information as the second filling information, comprises:

determining that the function information in the instruction information is temperature, searching a first target historical statement which has a time interval closest to that of the first user statement and contains equipment information having an equipment function adaptive relationship with the temperature from the historical user statement, and obtaining that the equipment information having the equipment function adaptive relationship with the temperature is an air conditioner according to area information in the first target historical statement;

searching a second target historical statement which is closest to the first target historical statement in time interval and contains area information having a physical space adaptation relation with the air conditioner from the historical user statements, obtaining the area information having the physical space adaptation relation with the air conditioner as a bedroom according to the area information in the second target historical statement, and taking the air conditioner and the bedroom as second filling information.

7. The method of claim 1, wherein the performing data processing on the first user statement to obtain instruction information in the first user statement comprises:

performing keyword dismantling on the first user sentence and extracting at least two keywords;

and performing semantic recognition on the keywords to obtain instruction information in the first user statement.

8. The method of any one of claims 1-7, wherein the controlling a target smart appliance of the plurality of smart appliances to perform the device service according to the second user statement comprises:

disassembling the second user statement to obtain a plurality of analysis graphs, wherein each analysis graph in the plurality of analysis graphs comprises an analysis node and a relation line of each analysis node, and the analysis node is a word;

determining a target analysis node and an analysis node relation line corresponding to the target analysis node from each analysis graph to obtain a main original triple corresponding to each analysis graph;

searching a first knowledge sub-graph corresponding to the currently processed analytic graph from a knowledge graph of a knowledge base according to a main original triple corresponding to the currently processed analytic graph, wherein the knowledge graph comprises a plurality of knowledge sub-graphs;

if the first knowledge sub-graph is found, marking the currently processed analytic graph as a correct statement, determining that a main original triple corresponding to the currently processed analytic graph is used for representing a statement intention of the second user statement, and controlling a target intelligent household appliance in the intelligent household appliances to execute the equipment service based on the statement intention;

if the first knowledge subgraph is not found, imagination reasoning is carried out on the currently processed analytic graph according to the knowledge base to obtain a probability graph, and a second knowledge subgraph corresponding to the probability graph is searched from the knowledge graph of the knowledge base;

if the second knowledge sub-graph is not found, discarding the currently processed analysis graph, and processing other analysis graphs except the currently processed analysis graph in the plurality of analysis graphs;

and if the second knowledge sub-graph is found, determining that a main original triple corresponding to the second knowledge sub-graph is used for representing a statement intention of the second user statement, and controlling a target intelligent household appliance in the plurality of intelligent household appliances to execute the equipment service based on the statement intention.

9. The utility model provides an information filling device based on speech control intelligence household electrical appliances which characterized in that includes:

the acquisition module is used for calling a human-computer voice interaction engine to acquire current voice information input by a user;

the processing module is further configured to control a target intelligent household appliance of the plurality of intelligent household appliances to execute an appliance service according to the first user statement if the instruction information includes appliance information, area information, function information and operation information, where the function information indicates an appliance function of the target intelligent household appliance, and the operation information indicates an operation performed on the target intelligent household appliance;

the obtaining module is further configured to obtain a user device list and a historical user statement if the instruction information lacks one or more of the device information, the area information, the function information, or the operation information, where the user device list includes a device name, a device area, and a device function of each of the plurality of intelligent home appliances;

10. An information filling apparatus based on voice control of intelligent appliances, the apparatus comprising a processor, a memory and a communication interface, the memory being used for storing a computer program, and the processor being used for invoking the computer program and executing the method of any one of claims 1 to 8.