CN114609920A

CN114609920A - Intelligent household control method and device, computer equipment and medium

Info

Publication number: CN114609920A
Application number: CN202210151526.4A
Authority: CN
Inventors: 崔保磊; 李金凯; 杜永花
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-02-18
Filing date: 2022-02-18
Publication date: 2022-06-10

Abstract

The present disclosure relates to a smart home control method, apparatus, computer device and medium, and in particular, to the field of smart home technology; wherein, the method comprises the following steps: recognizing voice data of a user to obtain corresponding control information, wherein the control information comprises function types and control instructions; determining a first candidate intelligent device set corresponding to the function category according to a pre-established intelligent device information table; determining a second candidate intelligent device set matched with the control instruction based on the function state corresponding to each candidate intelligent device in the first candidate intelligent device set; and determining a target intelligent device matched with the control instruction from the second candidate intelligent device set, and controlling the target intelligent device to execute the control instruction. According to the embodiment of the intelligent home equipment control method and device, the corresponding control instruction can be executed through the voice automatic control intelligent equipment, a user can conveniently control and use the intelligent home equipment, and the improvement of intelligence and accuracy is facilitated.

Description

Intelligent household control method and device, computer equipment and medium

Technical Field

The present disclosure relates to the field of smart home technologies, and in particular, to a smart home control method and apparatus, a computer device, and a medium.

Background

The intelligent home is characterized in that various devices in the home, such as audio and video devices, lighting systems, curtain control, air conditioner control, digital cinema systems, audio and video servers, network home appliances and the like, are connected together through the Internet of things technology, and multiple functions such as home appliance control, lighting control, telephone remote control, indoor and outdoor remote control, heating and ventilation control, infrared forwarding, programmable timing control and the like are provided. The intelligent home has the traditional use function, network communication, information household appliances and equipment automation, can provide the omnibearing information interaction function, and saves energy cost.

In a traditional mode, the intelligent home operation is triggered, manual operation is often required to be performed in an application program of an intelligent home APP, the operation scene of the intelligent device is manually set, or the intelligent device is manually operated and controlled by a user, so that the operation is inconvenient, and the use experience of the user is greatly reduced.

Disclosure of Invention

In order to solve the above technology or at least partially solve the above technical problem, the present disclosure provides an intelligent home control method, apparatus, computer device, and medium, which may obtain a function category and a control instruction according to voice data of a user, and determine a target intelligent device that the user wants to control according to the function category and the control instruction, so that the target intelligent device can execute the control instruction, manual operation by the user is not required, and use experience of the user is improved.

In order to achieve the above purpose, the technical solutions provided by the embodiments of the present disclosure are as follows:

in a first aspect, the present disclosure provides a smart home control method, including:

recognizing voice data of a user to obtain corresponding control information, wherein the control information comprises function types and control instructions;

determining a first candidate intelligent device set corresponding to the function category according to a pre-established intelligent device information table;

determining a second candidate intelligent device set matched with the control instruction based on the function state corresponding to each candidate intelligent device in the first candidate intelligent device set;

and determining a target intelligent device matched with the control instruction from the second candidate intelligent device set, and controlling the target intelligent device to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the determining, from the second set of candidate smart devices, a target smart device that matches the control instruction, and controlling the target smart device to execute the control instruction includes:

determining the number of all target candidate intelligent devices contained in a second candidate intelligent device set matched with the control instruction;

and determining the target intelligent equipment from the second candidate intelligent equipment set according to the size relation between the number and a preset threshold value, and controlling the target intelligent equipment to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the determining, according to a size relationship between the number and a preset threshold, the target smart device from the second candidate smart device set, and controlling the target smart device to execute the control instruction includes:

if the number of all target candidate intelligent devices is smaller than or equal to the preset threshold, determining all target candidate intelligent devices contained in the second candidate intelligent device set as the target intelligent devices;

and controlling each target intelligent device to respectively execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the method further includes:

if the number of all target candidate intelligent devices is larger than the preset threshold value, sending first prompt information, wherein the first prompt information is used for indicating a user to determine the target intelligent devices from the second candidate intelligent device set;

receiving first response information, wherein the first response information comprises first identification information corresponding to the target intelligent device;

and controlling the target intelligent equipment corresponding to the first identification information to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the identifying voice data of a user to obtain corresponding control information includes:

performing text recognition on the voice data through a voice recognition method to obtain text information corresponding to the voice data;

and performing semantic understanding on the text information through a semantic understanding method to obtain control information contained in the text information.

As an optional implementation manner of the embodiment of the present disclosure, the smart device information table is obtained in the following manner:

acquiring equipment names, function types and function states which respectively correspond to the intelligent equipment contained in a preset scene;

and establishing or updating a corresponding intelligent equipment information table according to all equipment names, function categories and function states.

if the first candidate smart device set is an empty set, or if the first candidate smart device set is a non-empty set and the second candidate smart device set is an empty set, sending second prompt information, wherein the second prompt information is used for instructing a user to determine the target smart device from a plurality of smart devices;

receiving second response information, wherein the second response information contains second identification information corresponding to the target intelligent equipment;

and controlling the target intelligent equipment corresponding to the second identification information to execute the control instruction.

In a second aspect, the present disclosure provides an intelligent home control device, the device including:

the recognition module is used for recognizing the voice data of the user to obtain corresponding control information, and the control information comprises function types and control instructions;

the first determination module is used for determining a first candidate intelligent device set corresponding to the function category according to a pre-established intelligent device information table;

a second determining module, configured to determine, based on a function state corresponding to each candidate smart device in the first candidate smart device set, a second candidate smart device set that matches the control instruction;

and the control module is used for determining a target intelligent device matched with the control instruction from the second candidate intelligent device set and controlling the target intelligent device to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the control module includes:

a quantity determination unit, configured to determine the quantity of all target candidate smart devices included in the second candidate smart device set that matches the control instruction;

and the device determining unit is used for determining the target intelligent device from the second candidate intelligent device set according to the size relation between the number and a preset threshold value, and controlling the target intelligent device to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the device determining unit is specifically configured to:

As an optional implementation manner of the embodiment of the present disclosure, the device determining unit is further specifically configured to:

As an optional implementation manner of the embodiment of the present disclosure, the identification module is specifically configured to:

and establishing or updating a corresponding intelligent equipment information table according to all the equipment names, the function types and the function states.

As an optional implementation manner of the embodiment of the present disclosure, the apparatus further includes:

a sending module, configured to send second prompt information if the first candidate set of smart devices is an empty set, or if the first candidate set of smart devices is a non-empty set and the second candidate set of smart devices is an empty set, where the second prompt information is used to instruct a user to determine the target smart device from a plurality of smart devices;

the receiving module is used for receiving second response information, wherein the second response information comprises second identification information corresponding to the target intelligent device;

In a third aspect, the present disclosure also provides a computer device, including:

one or more processors;

a storage device for storing one or more programs,

when the one or more programs are executed by the one or more processors, the one or more processors implement the smart home control method in any of the embodiments of the present disclosure.

In a fourth aspect, the present disclosure also provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the smart home control method in any one of the embodiments of the present disclosure.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: the method comprises the steps of firstly identifying voice data of a user to obtain control information corresponding to the voice data, wherein the control information comprises a function type and a control instruction, and then determining a first candidate intelligent device set corresponding to the function type according to a pre-established intelligent device information table; and then determining a second candidate intelligent device set matched with the control instruction based on the function state corresponding to each candidate intelligent device in the first candidate intelligent device set, finally determining a target intelligent device matched with the control instruction from the second candidate intelligent device set, and controlling the target intelligent device to execute the control instruction.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.

Fig. 1A is a scene schematic diagram of an intelligent home control process in the prior art;

fig. 1B is a scene schematic diagram of an intelligent home control process in an embodiment of the present disclosure;

FIG. 2A is a block diagram of a hardware configuration of a computer device according to one or more embodiments of the present disclosure;

FIG. 2B is a software configuration diagram of a computer device according to one or more embodiments of the present disclosure;

FIG. 2C is a schematic illustration of an icon control interface display of an application included in a smart device in accordance with one or more embodiments of the present disclosure;

fig. 3A is a schematic flowchart of a smart home control method according to an embodiment of the present disclosure;

fig. 3B is a schematic diagram illustrating a principle of an intelligent home control method according to an embodiment of the disclosure;

FIG. 3C is a schematic diagram of a process for determining a second set of candidate smart devices in an embodiment of the present disclosure;

fig. 4A is a schematic flowchart of another smart home control method according to an embodiment of the present disclosure;

fig. 4B is a schematic diagram illustrating another smart home control method according to an embodiment of the disclosure;

fig. 5A is a schematic flowchart of another smart home control method provided in the embodiment of the present disclosure;

fig. 5B is a schematic diagram illustrating a principle of another smart home control method according to an embodiment of the present disclosure;

fig. 6A is a schematic flowchart of another smart home control method provided in the embodiment of the present disclosure;

fig. 6B is a schematic diagram illustrating a principle of another smart home control method according to an embodiment of the present disclosure;

fig. 6C is a schematic diagram of a process of obtaining control information in an embodiment of the disclosure;

fig. 7A is a schematic structural diagram of a local control device in an embodiment of the present disclosure;

fig. 7B is a schematic structural diagram illustrating interaction between a local control device and an intelligent device in the embodiment of the present disclosure;

fig. 8A is a schematic structural diagram of an intelligent home control device provided in the embodiment of the present disclosure;

fig. 8B is a schematic structural diagram of a control module 804 in the smart home control apparatus according to the embodiment of the disclosure;

fig. 9 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that the embodiments and features of the embodiments of the present disclosure may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.

The terms "first" and "second," etc. in this disclosure are used to distinguish between different objects, rather than to describe a particular order of objects. For example, the first set of candidate smart devices and the second set of candidate smart devices, etc. are used to distinguish between different sets of candidate smart devices, rather than to describe a particular order of the sets of candidate smart devices.

With the continuous development of science and technology, various household devices tend to be intelligent continuously, and great convenience is brought to the life of people. Under the era that mobile internet + internet of things advance with higher speed, by means of mobile intelligent terminals, especially application software such as mobile phones or tablets, an intelligent scene control function is needed for each intelligent device.

In a traditional mode, the intelligent home operation is triggered, a user is often required to enter an application program of an intelligent home APP for manual operation, the operation scene of the intelligent device is manually set, or the intelligent device is manually operated and controlled by the user, so that the operation is inconvenient, and the user experience is greatly reduced.

Fig. 1A is a scene schematic diagram of a smart home control process in the prior art. As shown in fig. 1A, for example, assuming that the smart devices in the smart home scenario include a smart device 100 (i.e., a smart refrigerator), a smart device 101 (i.e., a smart washing machine), and a smart device 102 (i.e., a smart display device), a user may control the smart device 100, the smart device 101, and the smart device 102 through a smart terminal device 103, or the user directly controls the smart device 100, the smart device 101, and the smart device 102 manually. The user needs to carry out manual operation when controlling intelligent house, has reduced user's use and has experienced.

It should be noted that: the smart home scene may include a plurality of smart devices, and fig. 1A is only an exemplary illustration and does not specifically limit the types and numbers of the smart devices.

As can be seen from the above, the existing intelligent home control method is inconvenient to operate, and therefore, a simpler and more intelligent home control method is needed.

Fig. 1B is a scene schematic diagram of an intelligent home control process in the embodiment of the disclosure. As shown in fig. 1B, it is assumed that the smart devices in the smart home scene include a smart device 200 (i.e., a smart refrigerator), a smart device 201 (i.e., a smart washing machine), and a smart device 202 (i.e., a smart display device), when a user wants to control the smart devices in the smart home scene, the user first records a sound through a sound recording application in a smart terminal device 204 to obtain recorded sound data, where the recorded sound data is mainly a control intention of the user, and the control intention does not include the smart devices to be controlled. The intelligent terminal device 204 sends the recording data of the user to the server 203, so that the server 203 recognizes the voice data to obtain specific control information corresponding to the voice data, thereby determining the intelligent device that the user actually wants to control according to the control information, and directly controlling the intelligent device to execute a corresponding control instruction, that is: the intelligent home is controlled through interaction of the server 203 and the intelligent terminal device 204; or the user may enter a sound through the local control device 205, such as a recording module in the terminal of the internet of things, where the sound is mainly the control intention of the user, and the control intention does not include the smart device to be controlled. The local control device 205 recognizes the voice data entered by the user to obtain specific control information corresponding to the voice data, determines an intelligent device that the user actually wants to control according to the control information, and directly controls the intelligent device to execute a corresponding control instruction.

In the process, the user only needs to record, and the rest processing processes do not need the participation of the user, so that the intelligent equipment can be automatically controlled through voice to execute corresponding control instructions, the intelligent household equipment can be conveniently controlled and used by the user, and the intelligence and the accuracy are improved.

It should be noted that: the smart home scene may include a plurality of smart devices, and fig. 1B is only an exemplary illustration and does not specifically limit the types and numbers of the smart devices.

The smart home control method provided by the embodiment of the disclosure can be implemented based on computer equipment, or a functional module or a functional entity in the computer equipment.

The computer may be a Personal Computer (PC), a server, a mobile phone, a tablet computer, a notebook computer, a mainframe computer, and the like, which is not specifically limited in this disclosure.

Fig. 2A is a block diagram of a hardware configuration of a computer device according to one or more embodiments of the present disclosure. As shown in fig. 2A, the computer apparatus includes: at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller 250 includes a central processing unit, a video processor, an audio processor, a graphic processor, a RAM, a ROM, a first interface to an nth interface for input/output, among others. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG audio/video data signal, from a plurality of wireless or wired broadcast television signals. The communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The computer device may establish transmission and reception of control signals and data signals with the server 203 or the local control device 205 through the communicator 220. The detector 230 is used to collect signals of an external environment or interaction with the outside. The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The user interface 280 may be used to receive control signals for controlling devices, such as infrared remote controls, etc.

In some embodiments, controller 250 controls the operation of the computer device and responds to user actions through various software control programs stored in memory. The controller 250 controls the overall operation of the computer device. A user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operation and displayed in a graphical manner. It may be an interface element such as an icon, a window, and a control displayed in a display screen of the computer device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, and other visual interface elements.

Fig. 2B is a schematic software configuration diagram of a computer device according to one or more embodiments of the present disclosure, and as shown in fig. 2B, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (Application Framework) layer (referred to as a "Framework layer"), an Android runtime (Android runtime) and system library layer (referred to as a "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, applications in the application layer include, but are not limited to, the above examples.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software, including at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

Fig. 2C is a schematic diagram illustrating an icon control interface display of an application program included in an intelligent device (mainly, an intelligent playback device, such as an intelligent television, a digital cinema system, or a video server), according to one or more embodiments of the present disclosure, as shown in fig. 2C, an application layer includes at least one application program that can display a corresponding icon control in a display, for example: the system comprises a live television application icon control, a video on demand VOD application icon control, a media center application icon control, an application center icon control, a game application icon control and the like. The live television application program can provide live television through different signal sources. A video on demand VOD application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. The media center application program can provide various applications for playing multimedia contents. The application program center can provide and store various application programs.

The intelligent home control method provided by the embodiment of the application can be realized based on the computer equipment.

The intelligent home control process provided by the embodiment of the disclosure can be realized based on the computer equipment, and the method can identify voice data of a user to obtain control information corresponding to the voice data, wherein the control information comprises a function type and a control instruction, and then a first candidate intelligent equipment set corresponding to the function type is determined according to a pre-established intelligent equipment information table; and then determining a second candidate intelligent device set matched with the control instruction based on the function state corresponding to each candidate intelligent device in the first candidate intelligent device set, finally determining a target intelligent device matched with the control instruction from the second candidate intelligent device set, and controlling the target intelligent device to execute the control instruction.

For describing the present solution in more detail, the following description is provided with reference to fig. 3A in an exemplary manner, and it is understood that the steps involved in fig. 3A may include more steps or fewer steps in actual implementation, and the order between the steps may also be different, so as to enable the smart home control method provided in the embodiment of the present application.

Fig. 3A is a schematic flowchart of an intelligent home control method provided in the embodiment of the disclosure, and fig. 3B is a schematic principle diagram of the intelligent home control method provided in the embodiment of the disclosure. The embodiment can be applied to the situation of controlling each intelligent device contained in the intelligent home scene. The method of the embodiment can be executed by an intelligent home control device, which can be implemented in a hardware/software manner and can be configured in computer equipment.

As shown in fig. 3A, the method specifically includes the following steps:

s310, recognizing the voice data of the user to obtain corresponding control information, wherein the control information comprises function types and control instructions.

The voice data can be understood as data formed after the user records. The control information may be understood as a control intention corresponding to voice data of the user, which includes function categories and control instructions related to the smart device, but does not include the smart device to be controlled specifically. The intelligent device can be understood as various devices included in an intelligent home scene, such as an audio and video device, a lighting system, a curtain control, an air conditioner control, a digital cinema system, an audio and video server, a network household appliance and the like. The function category may be understood as a category to which a specific function of the smart device belongs, for example, the category corresponding to the smart television may include: volume, brightness, video playing scene, menu scene and the like. The control instruction can be understood as an operation instruction related to the intelligent device, such as turning on, turning off, playing, pausing and the like.

In an intelligent home scene containing a plurality of different types of intelligent devices, each intelligent device is in different control states, a user needs to make clear the specific control state of each intelligent device to control the intelligent device, and for voice data of unspecified intelligent devices, execution failure in the voice intelligent home control process may be caused or the user needs to be guided for supplementing information for many times so as to determine the intelligent device to be controlled.

The execution subject in this embodiment may be a local control device 205 having processing and interaction functions, such as an internet of things terminal, and may also be a server 203 interacting with an intelligent terminal device 204. After the recording data of the user is obtained, since the local control device 205 and the server 203 cannot directly obtain the specific information included in the voice data, the voice data of the user needs to be recognized specifically by a voice recognition method and a semantic understanding method, and may also be recognized by a neural network model or a voice recognition system, which is not limited in this embodiment. After recognition, control information corresponding to the voice data can be obtained,

s320, determining a first candidate intelligent device set corresponding to the function type according to a pre-established intelligent device information table.

The intelligent device information table may be understood as a table related to information corresponding to each intelligent device in an intelligent home scene, where the table may include a device identification number, a device name, a function type, a function state, and the like corresponding to each intelligent device. The first candidate smart device set may be understood as a set of smart devices matching the function categories included in the smart home scene.

After the control information corresponding to the voice data is obtained, the function type corresponding to each intelligent device in the intelligent device information table is matched with the function type in the control information, so that a first candidate intelligent device set corresponding to the function type in the control information can be obtained.

S330, determining a second candidate intelligent device set matched with the control instruction based on the function state corresponding to each candidate intelligent device in the first candidate intelligent device set.

The second candidate set of smart devices may be understood as a set formed by smart devices matching the control instruction and included in the smart home scene, where the set is a candidate set of smart devices that the user wants to control and is finally determined.

The first set of candidate smart devices may include a plurality of candidate smart devices, and each candidate smart device may be in a different functional state, so after the first set of candidate smart devices is obtained, in order to determine the smart device that the user wants to control, the range needs to be further narrowed. At this time, according to the function state corresponding to each candidate intelligent device in the first candidate intelligent device set, the function state corresponding to each candidate intelligent device is respectively compared with the control instruction in the control information, so that a second candidate intelligent device set formed by the candidate intelligent devices matched with the control instruction can be obtained.

Exemplarily, it is assumed that the control instruction is turned on, and the corresponding functional state of the candidate smart device 1 is normal; and if the function state corresponding to the candidate intelligent device 2 is playing and the function state corresponding to the candidate intelligent device 3 is off, adding the candidate intelligent device 3 into the second candidate intelligent device set.

And S340, determining a target intelligent device matched with the control instruction from the second candidate intelligent device set, and controlling the target intelligent device to execute the control instruction.

The target smart device may be understood as a smart device matched with the control instruction.

Since there may be a plurality of intelligent devices included in the second candidate intelligent device set, the target intelligent device matched with the control instruction is further determined from the second candidate intelligent device set, the number of the target intelligent devices may be multiple, which may be determined according to specific situations, and the present disclosure is not limited specifically. After the target intelligent device is determined, the corresponding control instruction is sent to the intelligent device to control the target intelligent device to execute the control instruction, so that the requirements of the user are met, and the control of the target intelligent device which meets the voice data of the user is accurately executed.

Optionally, fig. 3C is a schematic diagram of a process of determining a second candidate set of smart devices in the embodiment of the present disclosure, as shown in fig. 3C:

1. determining a device name total set, a function category total set and a function state total set corresponding to all intelligent devices;

wherein, the total set of device names is defined as Dev, and each intelligent device is Dev1, Dev2, Dev3 and …;

the total set of function classes is defined as F, and each function is F1, F2, F3 and … respectively;

the total set of functional states is defined as S, and the functional states are S1, S2, S3, and S …, respectively.

2. Determining the combination of the function category and the function state contained in each intelligent device, wherein the corresponding set is as follows:

Dev1＝{F1S1，F2S2，…}

Dev2＝{F1S2，F2S3，F3S3，…}

Dev3＝{F1S1，F2S3，F4S1，F5S2，…}

Dev4＝{F3S3，F3S3，F5S5，…}

3. and identifying the voice data of the user to obtain a combination FxSy corresponding to the function type and the control instruction.

4. And querying each set in the step 2, and determining a second candidate intelligent device set according to the intelligent devices corresponding to the set with the same elements as FxSy in the set.

In this embodiment, first, voice data of a user is recognized to obtain control information corresponding to the voice data, where the control information includes a function type and a control instruction, and then, according to a pre-established intelligent device information table, a first candidate intelligent device set corresponding to the function type is determined; and then determining a second candidate intelligent device set matched with the control instruction based on the function state corresponding to each candidate intelligent device in the first candidate intelligent device set, finally determining a target intelligent device matched with the control instruction from the second candidate intelligent device set, and controlling the target intelligent device to execute the control instruction.

In some embodiments, optionally, the smart device information table is obtained by:

The preset scene can be understood as a scene including a plurality of intelligent devices interconnected through a network, such as an intelligent home scene, an intelligent office scene, and the like.

Specifically, the device name, the function type, and the function state respectively corresponding to each of the intelligent devices included in the preset scene may be obtained in a manner of reporting the information of the intelligent devices, and the device name, the function type, and the function state respectively corresponding to each of the intelligent devices may also be obtained in other manners. After the information corresponding to each intelligent device is acquired, a corresponding intelligent device information table can be established according to all device names, function types and function states, or the intelligent device information table can be updated in time after at least one of the device names, the function types and the function states is changed.

In this embodiment, the corresponding intelligent device information table is established or updated by the above method, and it can be ensured that the intelligent device information table is consistent with the actual functional states of the intelligent devices, thereby being beneficial to determining the first candidate intelligent device set and ensuring the accuracy of the set.

In some embodiments, optionally, the method further comprises:

receiving second response information, wherein the second response information contains second identification information corresponding to the target intelligent device;

The first candidate smart device set is an empty set, and it can be understood that there are no candidate smart devices in the set that meet the condition. An empty set of the second set of candidate smart devices may be understood as a set of smart devices that also does not have a condition in the set.

Specifically, if the first candidate smart device set is an empty set, or if the first candidate smart device set is a non-empty set and the second candidate smart device set is an empty set, it indicates that the smart device that the user actually wants to control cannot be determined currently. At this time, a second prompt message may be sent, for example, the local control device 205 sends the second prompt message, for example, the second prompt message may be sent to its own display screen or audio application to display or play the second prompt message, so as to instruct the user to determine the target smart device from the plurality of smart devices; or the server 203 sends a second prompt message to the intelligent terminal device 204 to instruct the user to determine the target intelligent device from the plurality of intelligent devices. And receiving second response information fed back by the user, wherein the second response information comprises second identification information corresponding to the target intelligent device, so that the target intelligent device corresponding to the second identification information can be directly controlled to execute the control instruction.

In the embodiment, when the intelligent device actually required to be controlled by the user cannot be determined currently, the target intelligent device can be determined by the method, so that the control requirement of the user is met, and the use experience of the user is improved.

Fig. 4A is a schematic flowchart of another smart home control method provided in the embodiment of the disclosure, and fig. 4B is a schematic diagram of a principle of another smart home control method provided in the embodiment of the disclosure. The embodiment is further expanded and optimized on the basis of the embodiment. Optionally, one possible implementation manner of S340 in this embodiment is as follows:

and S3401, determining the number of all target candidate intelligent devices contained in the second candidate intelligent device set matched with the control instruction.

Since the second candidate smart device set may include a plurality of target candidate smart devices, in order to determine a target smart device matched with the control instruction, the number of all target candidate smart devices included in the second candidate smart device set matched with the control instruction needs to be determined, so that the target smart device is determined from the second candidate smart device set according to the size relationship between the number and the preset threshold value.

And S3402, determining a target intelligent device from the second candidate intelligent device set according to the size relationship between the number and a preset threshold value, and controlling the target intelligent device to execute a control instruction.

The preset threshold may be a preset value, for example, 1, 3, or the like, and may be determined according to specific situations, which is not limited in this embodiment.

After obtaining the number of all target candidate intelligent devices included in the second candidate intelligent device set, comparing the number with a preset threshold value to obtain a size relationship between the number and the preset threshold value, so as to determine the target intelligent devices from the second candidate intelligent device set according to the size relationship between the number and the preset threshold value, for example, all the target candidate intelligent devices included in the second candidate intelligent device set are target intelligent devices, or a part of the target candidate intelligent devices included in the second candidate intelligent device set are target intelligent devices. After the target intelligent equipment is determined, the target intelligent equipment is controlled to execute the control instruction, so that intelligent home control is achieved through voice, and user operation is reduced.

In the embodiment, the target intelligent device is determined simply and quickly by the method, and the working efficiency can be improved.

Fig. 5A is a schematic flowchart of another smart home control method provided in the embodiment of the disclosure, and fig. 5B is a schematic diagram of a principle of another smart home control method provided in the embodiment of the disclosure. The embodiment is further expanded and optimized on the basis of the embodiment. Optionally, one possible implementation manner of S3402 in this embodiment is as follows:

and S34021, determining whether the number of target candidate smart devices is less than or equal to a preset threshold value.

After the number of all target candidate smart devices included in the second candidate smart device set is obtained, the magnitude relation between the number and the preset threshold is compared, and whether the number of the target candidate smart devices is smaller than or equal to the preset threshold can be determined.

If yes, executing S34022-S34023; if not, S34024-S34026 are executed.

S34022, determining all target candidate smart devices included in the second set of candidate smart devices as target smart devices.

If the number of the target candidate smart devices is less than or equal to the preset threshold, it indicates that the number of the target candidate smart devices does not exceed the upper limit, and therefore, all the target candidate smart devices included in the second candidate smart device set are determined as the target smart devices.

And S34023, controlling each target intelligent device to execute the control command respectively.

After all target candidate smart devices included in the second candidate smart device set are determined as target smart devices, a control instruction needs to be sent to each target smart device to control each target smart device to execute the control instruction respectively.

And S34024, sending first prompt information, wherein the first prompt information is used for instructing a user to determine a target intelligent device from the second candidate intelligent device set.

If the number of the target candidate smart devices is greater than the preset threshold, it indicates that the number of the target candidate smart devices exceeds the upper limit, and in order to avoid executing the same control instruction on the plurality of smart devices at the same time, thereby affecting the normal use of the user, a first prompt message needs to be sent, for example, the local control device 205 sends the first prompt message, for example, the first prompt message may be sent to a display screen or an audio application of the local control device, so as to display or play the first prompt message, so as to instruct the user to determine the target smart device from the plurality of smart devices; or the server 203 sends first prompt information to the intelligent terminal device 204 to instruct the user to determine the target intelligent device from the plurality of intelligent devices.

And S34025, receiving first response information, wherein the first response information comprises first identification information corresponding to the target intelligent device.

And receiving first response information fed back by the user so as to subsequently control the target intelligent equipment corresponding to the first identification information to execute the control instruction.

And S34026, controlling the target intelligent device corresponding to the first identification information to execute the control instruction.

Because the first response information contains the first identification information corresponding to the target intelligent device, the target intelligent device corresponding to the first identification information can be directly controlled to execute the control instruction.

In this embodiment, corresponding steps are respectively executed according to two size relationships between the number of all target candidate smart devices included in the second candidate smart device set and the preset threshold, so that the intelligence and the accuracy of the smart home control process can be further improved.

Fig. 6A is a schematic flowchart of another smart home control method provided in the embodiment of the disclosure, and fig. 6B is a schematic diagram of a principle of another smart home control method provided in the embodiment of the disclosure. The embodiment is further expanded and optimized on the basis of the embodiment. Optionally, one possible implementation manner of S310 in this embodiment is as follows:

s3101, performing text recognition on the voice data by a voice recognition method to obtain text information corresponding to the voice data.

The voice recognition method is a method of converting voice into text, such as voice recognition software.

The voice data can be subjected to text recognition through a voice recognition method, so that text information corresponding to the voice data is obtained.

S3102, performing semantic understanding on the text information by a semantic understanding method to obtain control information included in the text information, where the control information includes a function category and a control instruction.

The semantic understanding method may include a keyword extraction method, an information extraction method, and the like.

After the text information is obtained, since the text information recognized by the machine may contain redundant information, repeated information, and the like, in order to further improve the accuracy of the recognition process, the text information is semantically understood by a semantic understanding method to obtain control information contained in the text information, wherein the control information comprises a function type and a control instruction.

In the embodiment, the control information obtained by the method is more accurate and more in line with the actual situation, and the method is favorable for ensuring the smooth proceeding of the subsequent process.

For example, fig. 6C is a schematic diagram of a process of obtaining control information in the embodiment of the present disclosure, as shown in fig. 6C:

firstly, voice recognition is carried out on voice data to obtain first information, and then semantic understanding is carried out on the first information to obtain control information.

For example, fig. 7A is a schematic structural diagram of a local control device in an embodiment of the present disclosure, as shown in fig. 7A:

the local control device 205 includes voice recognition services, semantic understanding services, and intelligent device control services. The voice recognition service is mainly used for recording and recognizing voice data of a user to obtain a recognition result; the semantic understanding service is mainly used for determining control information according to the recognition result; the home control service is used for maintaining an intelligent device information table, receiving device information reported by the intelligent device and controlling the corresponding intelligent device according to the control information.

Fig. 7B is a schematic structural diagram of interaction between a local control device and an intelligent device in the embodiment of the present disclosure, as shown in fig. 7B:

the voice recognition service comprises a recording module and a recognition engine, wherein the recording module is used for recording, and the recognition engine is used for recognizing according to voice data of a user to obtain a recognition result. The semantic understanding service comprises function categories and control instructions. The home control service comprises an intelligent device information table, target-determining intelligent devices and home instruction control. The home control service interacts with each intelligent device, such as an intelligent device A, an intelligent device B, … and an intelligent device N, and the home control service acquires an intelligent device information table according to the device information reported by each intelligent device; determining a first candidate intelligent device set according to the intelligent device information table and the function category; and determining a second candidate intelligent device set according to the second candidate intelligent device set and the control instruction, determining a target intelligent device from the second candidate intelligent device set, and controlling the target intelligent device to execute the control instruction, so that the intelligent home is controlled through voice data. The intelligent device is responsible for reporting the device information and receiving and executing the control instruction issued by the home control service.

In some embodiments, assume that the smart device information table is as shown in table 1 below:

TABLE 1

Equipment identification number	Device name	Function classes	Functional status
				1	Window curtain	Brightness of light	Close off
2	Television receiver	Brightness of light	Is normal
				3	Television receiver	Volume of sound	Is normal
4	Television receiver	Menu scene	Presentation UI
				5	Intelligent sound box	Music scene	Is playing
6	Baking oven	Food material scene	Placed beefsteak
				7	Refrigerator with a door	Door with a door panel	Is opened
8	Washing machine	Door with a door panel	Close off

The information contained in each smart device in table 1 is as follows:

1. the curtain has been closed;

2. the television has normal brightness and volume and is displaying a menu UI;

3. the smart speaker is playing music;

4. and placing the steak in the oven, and waiting for starting cooking.

5. The door of the refrigerator is in an open state.

6. The door of the washing machine is in a closed state.

It should be noted that: each device contained in table 1 is an intelligent device.

Example 1: assuming that the voice data is "too dark", the function category is brightness, the control instruction is increase, and the preset threshold is 1, it can be determined that the first candidate set of smart devices is: 1 curtains and 2 televisions; then, according to the function states of the intelligent devices in the first candidate intelligent device set and the control instruction, it can be determined that the second candidate intelligent device set is: and 1, determining that the target intelligent device is a curtain 1 and controlling the curtain to execute an opening function because the number of all target candidate intelligent devices contained in the second candidate intelligent device set is equal to a preset threshold value.

Example 2: assuming that the voice data is 'I want to roast steak', the function categories are food material scenes and menu scenes, the control instruction is cooking and query, and the preset threshold is 1, the first candidate intelligent device set can be determined as follows according to the function categories and the table 1: 4 televisions and 6 ovens; then, according to the function states of the intelligent devices in the first candidate intelligent device set and the control instruction, it can be determined that the second candidate intelligent device set is: and 6, determining that the target intelligent device is the 6 oven and controlling the oven to execute the steak baking function because the number of all target candidate intelligent devices contained in the second candidate intelligent device set is equal to a preset threshold value.

In some embodiments, if it is detected that the steak is not in the oven, but the television supports the recipe query function, then the introduction of the television's barbeque recipe is performed.

Example 3: assuming that the voice data is "volume too large", the function type is volume, the control instruction is decrease, and the preset threshold is 1, it can be determined that the first candidate smart device set is: 3 television and 5 smart speakers; then, according to the function states of the intelligent devices in the first candidate intelligent device set and the control instruction, it may be determined that the second candidate intelligent device set is: and 5, determining that the target intelligent device is the 5 intelligent sound boxes and controlling the intelligent sound boxes to execute the volume reduction function because the number of all target candidate intelligent devices contained in the second candidate intelligent device set is equal to the preset threshold value.

In some embodiments, if it is detected that the television is also playing video, the user is prompted to select whether the volume-turned-down device is a television or a sound box.

Example 4: assuming that the voice data is "closed door", the function category is door, the control instruction is closed, and the preset threshold is 1, it can be determined that the first candidate set of smart devices is: 7 refrigerator and 8 TV set; then, according to the function states of the intelligent devices in the first candidate intelligent device set and the control instruction, it can be determined that the second candidate intelligent device set is: and 7, determining that the target intelligent device is the 7 refrigerator and controlling the refrigerator to execute a door closing function because the number of all target candidate intelligent devices contained in the second candidate intelligent device set is equal to a preset threshold value.

In some embodiments, if it is detected that the oven door is also open, the user is prompted as to whether the device that is to close the door is a refrigerator or an oven.

Fig. 8A is a schematic structural diagram of an intelligent home control device provided in the embodiment of the present disclosure; the device is configured in computer equipment, and can realize the intelligent home control method in any embodiment of the application. The device specifically comprises the following steps:

the recognition module 801 is configured to recognize voice data of a user to obtain corresponding control information, where the control information includes a function category and a control instruction;

a first determining module 802, configured to determine, according to a pre-established intelligent device information table, a first candidate intelligent device set corresponding to the function category;

a second determining module 803, configured to determine, based on the function state corresponding to each candidate smart device in the first candidate smart device set, a second candidate smart device set that matches the control instruction;

a control module 804, configured to determine a target smart device matched with the control instruction from the second candidate smart device set, and control the target smart device to execute the control instruction.

Fig. 8B is a schematic structural diagram of a control module 804 in an intelligent home control device according to an embodiment of the disclosure, and as shown in fig. 8B, the control module 804 includes:

a number determining unit 8041, configured to determine the number of all target candidate smart devices included in the second candidate smart device set that matches the control instruction;

a device determining unit 8042, configured to determine the target smart device from the second candidate smart device set according to a size relationship between the number and a preset threshold, and control the target smart device to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the device determining unit 8042 is specifically configured to:

As an optional implementation manner of the embodiment of the present disclosure, the device determining unit 8042 is further specifically configured to:

As an optional implementation manner of the embodiment of the present disclosure, the identification module 801 is specifically configured to:

The smart home control device provided by the embodiment of the present disclosure may execute the smart home control method provided by any embodiment of the present disclosure, has the corresponding functional modules and beneficial effects of the execution method, and is not repeated here to avoid repetition.

The disclosed embodiment provides a computer device, including: one or more processors; the storage device is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the smart home control method in any one of the embodiments of the present disclosure.

Fig. 9 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure. As shown in fig. 9, the computer apparatus includes a processor 910 and a storage 920; the number of the processors 910 in the computer device may be one or more, and one processor 910 is taken as an example in fig. 9; the processor 910 and the storage 920 in the computer device may be connected by a bus or other means, and fig. 9 illustrates the connection by the bus as an example.

The storage device 920 is a computer-readable storage medium and can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the smart home control method in the embodiments of the present disclosure. The processor 910 executes various functional applications and data processing of the computer device by running the software programs, instructions and modules stored in the storage 920, that is, implements the smart home control method provided by the embodiment of the present disclosure.

The storage 920 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Additionally, the storage 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 920 may further include memory located remotely from the processor 910, which may be connected to a computer device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The computer device provided by the embodiment can be used for executing the intelligent home control method provided by any embodiment, and has corresponding functions and beneficial effects.

The embodiment of the present disclosure provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements each process executed by the foregoing smart home control method, and can achieve the same technical effect, and in order to avoid repetition, the computer program is not described herein again.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The present disclosure provides a computer program product, comprising: when the computer program product runs on a computer, the computer is caused to implement the application installation method described above.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. The intelligent home control method is characterized by comprising the following steps:

2. The method of claim 1, wherein determining the target smart device from the second set of candidate smart devices that matches the control instruction and controlling the target smart device to execute the control instruction comprises:

3. The method according to claim 2, wherein the determining the target smart device from the second candidate smart device set according to the magnitude relationship between the number and a preset threshold, and controlling the target smart device to execute the control instruction comprises:

4. The method of claim 3, further comprising:

5. The method of claim 1, wherein the recognizing the voice data of the user to obtain the corresponding control information comprises:

6. The method of claim 1, wherein the smart device information table is obtained by:

7. The method of any one of claims 1-6, further comprising:

8. The utility model provides an intelligence house controlling means which characterized in that, the device includes:

9. A computer device, comprising:

one or more processors;

a storage device to store one or more programs,

when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-7.