CN110601933A

CN110601933A - Control method, device and equipment of Internet of things equipment and storage medium

Info

Publication number: CN110601933A
Application number: CN201910877522.2A
Authority: CN
Inventors: 戚耀文
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Baidu Online Network Technology Beijing Co Ltd; Shanghai Xiaodu Technology Co Ltd
Priority date: 2019-09-17
Filing date: 2019-09-17
Publication date: 2019-12-20

Abstract

The application discloses a control method, a control device, equipment and a storage medium of Internet of things equipment, and relates to the field of Internet of things. The specific implementation scheme is as follows: the method is applied to first electronic equipment, and the first electronic equipment is communicated with second electronic equipment. The method comprises the following steps: identifying target Internet of things equipment; displaying a guide instruction list corresponding to the target Internet of things equipment according to the identification result; and displaying a target guiding instruction determined by the user through the guiding instruction list in a preset mode so that the second electronic equipment controls the target Internet of things equipment to execute corresponding operation through the target instruction, wherein the target instruction is the target guiding instruction or a target voice instruction corresponding to the target guiding instruction.

Description

Control method, device and equipment of Internet of things equipment and storage medium

Technical Field

The application relates to the technical field of data processing, in particular to the technology of the Internet of things.

Background

With the maturity of artificial intelligence technology, the technology of internet of things has also been developed rapidly. The internet of things technology is a technology for realizing interconnection and intercommunication of all common objects capable of performing independent functions by using information bearing bodies such as the internet, a traditional telecommunication network and the like. The technology of the internet of things has wide application in a plurality of fields, such as the field of intelligent home, the field of intelligent office and the like.

In order to realize control over the internet of things devices, the intelligent voice interaction device generally identifies voice instructions of users, and controls corresponding internet of things devices according to identification results.

However, in the control method for the internet of things device in the prior art, when a user needs to send a voice instruction, no corresponding instruction reference exists, so that the user does not know which voice instructions can be executed by each internet of things device, and can only try to speak the voice instruction, so that the control efficiency and success rate of the internet of things device are low, and the control experience of the user on the internet of things device is poor.

Disclosure of Invention

The embodiment of the application provides a control method, a control device, equipment and a storage medium of Internet of things equipment, and solves the technical problems that in the prior art, the control efficiency and the success rate of the Internet of things equipment are low, and the control experience of a user on the Internet of things equipment is poor.

A first aspect of the embodiments of the present application provides a method for controlling an internet of things device, where the method is applied to a first electronic device, and the first electronic device communicates with a second electronic device, and the method includes:

identifying target Internet of things equipment; displaying a guide instruction list corresponding to the target Internet of things equipment according to the identification result; and performing preset display on a target guide instruction determined by a user through the guide instruction list so as to enable the second electronic device to control the target internet of things device to execute corresponding operation through the target instruction, wherein the target instruction is the target guide instruction or a target voice instruction corresponding to the target guide instruction.

In the embodiment of the application, the first electronic device can display the guide instruction list of the identified target internet of things device, so that a user can know all demand instructions which can be executed by the target internet of things device, the target guide instruction is displayed in a preset mode after the user determines the target voice instruction or the target guide instruction by taking the guide instruction list as a reference, the user can clearly determine the target instruction which needs to be controlled by the target internet of things device, and therefore when the target internet of things device is controlled by the second electronic device according to the target instruction, the control efficiency and the success rate of the target internet of things device are improved.

Further, the method for identifying the target internet of things device includes:

acquiring an image of a target Internet of things device by using a visual sensor; and identifying the target Internet of things equipment according to the target Internet of things equipment image.

In the embodiment of the application, the vision sensor of the first equipment is adopted to collect the image of the target Internet of things equipment, the target Internet of things equipment is identified in an image identification mode, the target Internet of things equipment which needs to be controlled by a user can be identified according to the user demand, and the identification process is more flexible.

Further, according to the method, the displaying a guidance instruction list corresponding to the target internet of things device according to the recognition result includes:

determining identification information of the target Internet of things equipment according to the recognition result; acquiring a guide instruction list corresponding to the target Internet of things equipment according to the identification information; and displaying the guide instruction list.

In the embodiment of the application, the mapping relation between the identification information of the target Internet of things equipment and the corresponding guide instruction list is pre-established, the guide instruction list corresponding to the target Internet of things equipment is obtained according to the identification information, the guide instruction list is displayed, the guide instruction list corresponding to the target Internet of things equipment can be quickly obtained, and the guide instruction list is displayed more quickly.

Further, the method as described above, the displaying the guidance instruction list includes:

and displaying the guide instruction list in an AR mode in a preset area range of the target Internet of things equipment image.

In the embodiment of the application, the guide instruction list of the target internet of things device is displayed in the preset area range of the target internet of things device image in an AR mode, so that the guide instruction list can be more vividly provided for a user, and the guide instruction list can be quickly determined to be the guide instruction list corresponding to the target internet of things device.

Further, according to the method, after the identification information of the target internet of things device is determined according to the recognition result, the method further includes:

and sending the identification information to second electronic equipment through a server so that the second electronic equipment sends out voice prompt for finding target Internet of things equipment according to the identification information.

In the embodiment of the application, after the target internet of things equipment is recognized by the first electronic equipment, the identification information of the target internet of things equipment is sent to the second electronic equipment through the server, so that the second electronic equipment sends out the voice prompt for finding the target internet of things equipment according to the identification information, and linkage of finding the target internet of things equipment by the first electronic equipment and the second electronic equipment can be realized.

Further, the method as described above, the performing the preset presentation on the target guidance instruction determined by the user through the guidance instruction list includes:

receiving a selected operation of the target guiding instruction input by a user through the guiding instruction list; and responding to the selected operation, and performing preset display on the target guide instruction.

In the embodiment of the application, when the target guide instruction determined by the user through the guide instruction list is displayed in a preset mode, the selection operation of the target guide instruction input by the user through the guide instruction list is received, the target instruction is displayed in a preset mode in response to the selection operation, the preset display of the target guide instruction can be directly performed through the operation of the user on the operation interface of the first electronic device, the second electronic device is triggered to perform corresponding control on the target internet of things device through the operation of the user on the operation interface of the first electronic device, the second electronic device does not need to recognize the voice instruction sent by the user, and the control efficiency and success rate of the target internet of things device are further improved.

Further, the method as described above, the performing the preset presentation on the target guiding instruction includes:

and displaying the target guide instruction by a first preset display strategy.

In the embodiment of the application, the target guiding instruction is displayed according to a first preset display strategy, so that the display mode of the target guiding instruction selected by a user through an operation interface of the first electronic device is distinguished from the display mode of the target guiding instruction determined by the user through the target voice instruction.

Further, the method as described above, further comprising:

and sending the target guiding instruction to the second electronic equipment through a server, so that the second electronic equipment plays corresponding voice reminding information to be responded according to the target guiding instruction, and controls the target Internet of things equipment to execute corresponding operation according to the target guiding instruction.

In the embodiment of the application, the target guiding instruction is sent to the second electronic device through the server, so that the second electronic device plays the corresponding to-be-responded voice reminding information according to the target guiding instruction, linkage of the first electronic device and the second electronic device when the target internet of things device is controlled to be about to execute corresponding operation is achieved, and the user can know about the operation about to be executed by the target internet of things device after the target guiding instruction is selected through the linkage.

receiving a target voice instruction sent by the second electronic device, wherein the target voice instruction is a voice instruction sent by a user according to the guide instruction list and received by the second electronic device; determining a guiding instruction matched with the target voice instruction; determining the matched guide instruction as the target guide instruction; and performing preset display on the target guide instruction.

In the embodiment of the application, when the target guidance instruction determined by the user through the guidance instruction list is displayed in a preset mode, the target voice instruction sent by the second electronic device is received, the target voice instruction is the voice instruction received by the second electronic device and sent by the user according to the guidance instruction list, the guidance instruction matched with the target voice instruction is determined, the matched guidance instruction is determined to be the target guidance instruction, and the target guidance instruction is displayed in a preset mode. The corresponding target guide instruction can be preset and displayed in a mode that the user speaks the target voice instruction to the second electronic device, the method and the device are suitable for a scene that the user does not conveniently operate an operation interface of the first electronic device to trigger the second electronic device to control the target Internet of things device, and a mode of triggering through the user voice is provided for controlling the target Internet of things device.

Further, the method as described above, the performing a preset presentation on the target guidance instruction includes:

and displaying the target guide instruction by a second preset display strategy.

In the embodiment of the application, the target guiding instruction is displayed according to a second preset display strategy, so that the display mode of the target guiding instruction determined by the user through the target voice instruction is distinguished from the display mode of the target guiding instruction selected by the user through the operation interface of the first electronic device.

A second aspect of the embodiments of the present application provides a control device for internet of things devices, where the control device is located in a first electronic device, the first electronic device communicates with a second electronic device, and the control device includes:

and the equipment identification module is used for identifying the target Internet of things equipment. And the list display module is used for displaying the guide instruction list corresponding to the target Internet of things equipment according to the identification result. And the target instruction display module is used for displaying a target guide instruction determined by the user through the guide instruction list in a preset mode so that the second electronic equipment controls the target internet of things equipment to execute corresponding operation through the target instruction, wherein the target instruction is the target guide instruction or a target voice instruction corresponding to the target guide instruction.

Further, the device and the equipment identification module are specifically used for acquiring the target internet of things equipment image by adopting the vision sensor. And identifying the target Internet of things equipment according to the target Internet of things equipment image.

Further, the apparatus and the list display module are specifically configured to determine the identification information of the target internet of things device according to the recognition result. And acquiring a guide instruction list corresponding to the target Internet of things equipment according to the identification information. And displaying the guide instruction list.

Further, the apparatus and the list display module are specifically configured to display the guidance instruction list in an AR manner within a preset area range of the target internet of things device image when displaying the guidance instruction list.

Further, the device and the target instruction presentation module are specifically configured to receive a selection operation of the target guidance instruction, which is input by the user through the guidance instruction list. And responding to the selected operation, and performing preset display on the target guide instruction.

Further, the apparatus as described above, the target instruction presenting module, when performing the preset presentation on the target guidance instruction, is specifically configured to present the target guidance instruction according to a first preset presentation policy.

Further, the apparatus as described above, further comprising: and the guiding instruction sending module is used for sending the target guiding instruction to the second electronic equipment through the server so that the second electronic equipment plays the corresponding voice reminding information to be responded according to the target guiding instruction and controls the target Internet of things equipment to execute corresponding operation according to the target guiding instruction.

Further, the apparatus as described above, the target instruction presenting module is specifically configured to receive a target voice instruction sent by the second electronic device, where the target voice instruction is a voice instruction sent by the user according to the guidance instruction list and received by the second electronic device. A guidance instruction matching the target voice instruction is determined. And determining the matched guide instruction as the target guide instruction. And performing preset display on the target guide instruction.

Further, the apparatus as described above, the target instruction presenting module, when performing preset presentation on the target guidance instruction, is specifically configured to present the target guidance instruction according to a second preset presentation policy.

A third aspect of the embodiments of the present application provides a first electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the first aspects.

A fourth aspect of embodiments of the present application provides a non-transitory computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of the first aspects.

A fifth aspect of the embodiments of the present application provides a method for controlling an internet of things device, where the method is applied to a second electronic device, the second electronic device communicates with a first electronic device, and the first electronic device is configured to display a guidance instruction list corresponding to a target internet of things device, where the method includes:

receiving a target instruction determined by a user through the guide instruction list, wherein the target instruction is a target guide instruction or a target voice instruction; and controlling the target Internet of things equipment to execute corresponding operation according to the target instruction.

Further, according to the method described above, if the target instruction is a target guidance instruction, the receiving a target instruction determined by the user through the guidance instruction list includes:

and receiving a target guiding instruction sent by the first electronic device, wherein the target guiding instruction is a guiding instruction selected by the user in the guiding instruction list through the first electronic device.

Further, the method, if the target instruction is a target voice instruction, after receiving the target instruction determined by the user through the guidance instruction list, further includes:

and sending the target voice instruction to the first electronic equipment through the server, so that the first electronic equipment determines a target guide instruction matched with the target voice instruction, and performing preset display on the target guide instruction.

A sixth aspect of the present application provides a control device for internet of things devices, where the control device is located in a second electronic device, the second electronic device communicates with a first electronic device, and the first electronic device is configured to display a guidance instruction list corresponding to a target internet of things device, where the control device includes:

and the target instruction receiving module is used for receiving a target instruction determined by the user through the guide instruction list, and the target instruction is a target guide instruction or a target voice instruction. And the equipment control module is used for controlling the target Internet of things equipment to execute corresponding operation according to the target instruction.

Further, according to the apparatus described above, if the target instruction is a target guidance instruction, the target instruction receiving module is specifically configured to receive the target guidance instruction sent by the first electronic device, where the target guidance instruction is a guidance instruction selected by the user in the guidance instruction list through the first electronic device.

Further, the apparatus as described above, if the target instruction is a target voice instruction, further includes: and the voice instruction sending module is used for sending the target voice instruction to the first electronic equipment through the server so that the first electronic equipment determines a target guide instruction matched with the target voice instruction and displays the target guide instruction in a preset mode.

Further, the apparatus as described above, further comprising: the voice reminding module is used for generating corresponding voice reminding information to be responded according to the target instruction; and playing the voice reminding information to be responded.

A seventh aspect of embodiments of the present application provides a second electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the second aspects.

An eighth aspect of embodiments of the present application provides a non-transitory computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any of the second aspects.

A ninth aspect of the present application provides a method for controlling an internet of things device, where the method is applied to a first electronic device, and the first electronic device communicates with a second electronic device, and the method includes:

acquiring and displaying a guide instruction list corresponding to the target Internet of things equipment;

and performing preset display on a target guide instruction determined by a user through the guide instruction list so as to enable the second electronic device to control the target internet of things device to execute corresponding operation through the target instruction, wherein the target instruction is the target guide instruction or a target voice instruction corresponding to the target guide instruction.

A tenth aspect of embodiments of the present application provides a computer program, which includes program code for performing the method according to the first, fifth or ninth aspect when the computer program runs on a computer.

Drawings

The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:

fig. 1 is a schematic flow chart of a control method of an internet of things device according to a first embodiment of the present application;

fig. 2 is a schematic flow chart of a control method of an internet of things device according to a second embodiment of the present application;

fig. 3 is a schematic view of a first operation interface in a control method of an internet of things device according to a second embodiment of the present application;

fig. 4 is a first flowchart of step 204 in a control method of an internet of things device according to a second embodiment of the present application;

fig. 5 is a schematic view of a second operation interface in the control method of the internet of things device according to the second embodiment of the present application;

fig. 6 is a second flowchart of step 204 in the method for controlling an internet of things device according to the second embodiment of the present application;

fig. 7 is a schematic flowchart of a control method of an internet of things device according to a third embodiment of the present application;

fig. 8 is a signaling flowchart of a control method for an internet of things device according to a fourth embodiment of the present application;

fig. 9 is an application scenario diagram of a control method for an internet of things device according to a fourth embodiment of the present application;

fig. 10 is a signaling flowchart of a control method of an internet of things device according to a fifth embodiment of the present application;

fig. 11 is an application scenario diagram of a control method of an internet of things device according to a fifth embodiment of the present application;

fig. 12 is a schematic structural diagram of a control device of an internet of things device according to a sixth embodiment of the present application;

fig. 13 is a schematic structural diagram of a control device of an internet of things device according to a seventh embodiment of the present application;

fig. 14 is a block diagram of a first electronic device for implementing a control method of an internet of things device according to an embodiment of the present application;

fig. 15 is a block diagram of a second electronic device for implementing a control method of an internet of things device according to an embodiment of the present application.

Detailed Description

The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

For clear understanding of the technical solutions of the present application, the following explains the apparatuses involved in the present application:

intelligent voice interaction equipment: the intelligent device realizes human-computer interaction by adopting a voice mode. Such as intelligent voice home equipment, terminal equipment and the like. The intelligent voice home equipment can be an intelligent sound box, an intelligent television, an intelligent refrigerator and the like, and the terminal equipment can be an intelligent mobile phone, a vehicle-mounted terminal, wearable equipment and the like. The intelligent voice interaction equipment can recognize the voice command of the user to perform corresponding response.

Embodiments of the present application will be described below in detail with reference to the accompanying drawings.

Example one

Fig. 1 is a schematic flowchart of a control method of an internet of things device according to a first embodiment of the present disclosure, and as shown in fig. 1, an execution subject of the embodiment of the present disclosure is a control device of the internet of things device, and the control device of the internet of things device may be integrated in a first electronic device. The first electronic device may be a smart phone, a tablet computer, an augmented reality function device (AR device for short), a mixed reality function device (MR device for short), or the like. The first electronic device is communicated with the second electronic device so as to control the target Internet of things device through the second electronic device. The second electronic device may be an intelligent voice interaction device or other terminal device capable of recognizing a voice instruction of the user, and the like. The method for controlling the internet of things device provided by the embodiment includes the following steps.

Step 101, identifying target internet of things equipment.

In this embodiment, the target internet of things device is an internet of things device for controlling the target internet of things device. The target internet of things equipment can be equipment in the internet of things environment such as intelligent home and intelligent office, and if the target internet of things equipment is the internet of things environment of the intelligent home, the target internet of things equipment can be an intelligent television, an intelligent refrigerator and the like.

Specifically, as an optional implementation manner, identifying the target internet of things device may be: the first electronic equipment is provided with the vision sensor, the vision sensor can be adopted to aim at the target Internet of things equipment, images of the target Internet of things equipment are collected, and the target Internet of things equipment is identified in an image identification mode.

Or, as another optional implementation, the identifying the target internet of things device may further be: the first electronic device can be provided with a radio receiving assembly, the radio receiving assembly receives voice of the target Internet of things equipment determined sent by a user, if the user sends 'control the smart television at present', or the user sends 'display a guide instruction list of the smart television', and the like, the voice is recognized after the user sends the voice of the target Internet of things equipment determined, so that the target Internet of things equipment is determined.

It can be understood that the identification method for the target internet of things device may be other methods, and this is not limited in this embodiment.

The value is described in this embodiment, after the target internet of things device is identified, the identification information of the target internet of things device may be determined.

And 102, displaying a guide instruction list corresponding to the target Internet of things equipment according to the identification result.

Specifically, in this embodiment, a mapping relationship between the identification information of each internet of things device and the corresponding guidance instruction list may be established in advance, and the mapping relationship is stored locally. After the target internet of things equipment is identified, a guide instruction list corresponding to the target internet of things equipment is determined according to the identification information of the target internet of things equipment.

It can be understood that, in order to reduce the local data storage amount of the first electronic device, a mapping relationship between the identification information of each internet of things device and the corresponding guidance instruction list may be further established in the cloud server, and the mapping relationship is stored in the cloud server. After the target internet of things device is identified, a guiding instruction list obtaining request is sent to the cloud server, the guiding instruction list obtaining request comprises identification information of the target internet of things device, and after the cloud server determines the guiding instruction list corresponding to the target internet of things device according to the identification information of the target internet of things device, the guiding instruction list corresponding to the target internet of things device is sent to the first electronic device.

In this embodiment, the manner of obtaining the guidance instruction list corresponding to the target internet of things device is not limited.

The guidance instruction list corresponding to the target Internet of things equipment comprises all guidance instructions capable of controlling the target Internet of things equipment. If the target internet of things device is the smart television, the guide instruction included in the corresponding guide instruction list can be ' small A, station change ', ' small A, switching to a favorite channel ', small A, volume adjustment, small A, movie watching ' and the like.

In this embodiment, after the guidance instruction list corresponding to the target internet of things device is obtained, the guidance instruction list may be displayed on the screen of the first electronic device.

When the guiding instruction list is displayed on the screen of the first electronic device, the guiding instruction list can be displayed in a list or picture mode, an image or a name of the target internet of things device can be displayed on the screen, and a corresponding guiding instruction list is displayed near the image or the name of the target internet of things device.

It can be understood that the guidance instruction list corresponding to the target internet of things device may also be displayed in other manners, which is not limited in this embodiment.

And 103, displaying a target guide instruction determined by the user through the guide instruction list in a preset mode, so that the second electronic equipment controls the target internet of things equipment to execute corresponding operation through the target instruction, wherein the target instruction is the target guide instruction or a target voice instruction corresponding to the target guide instruction.

In this embodiment, the communication method between the first electronic device and the second electronic device is not limited. For example, the communication mode between the first electronic device and the second electronic device may be Global System for mobile communication (GSM), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), or 5G. It can be understood that the communication mode between the first electronic device and the second electronic device may also be a wireless communication mode, and the wireless communication mode may be zigbee communication, bluetooth BLE communication, or wifi communication of an action hotspot.

The value of the target voice demand instruction is that after the guidance instruction list corresponding to the target internet of things device is displayed, the user can speak the target voice demand instruction which is to be controlled by using the displayed guidance instruction list as a reference, so that the second electronic device receives the target voice demand instruction and then controls the target internet of things device. In order to enable the user to know that the spoken target voice instruction is a certain guide instruction in the guide instruction list, the second electronic device can send the target voice instruction to the first electronic device after receiving the target voice instruction sent by the user, and the first electronic device displays the guide instruction matched with the target voice instruction, namely the target guide instruction in a preset mode.

Or after the guidance instruction list corresponding to the target internet of things device is displayed, the user can select the target guidance instruction which is to be controlled for the target internet of things device through the first electronic device by taking the displayed guidance instruction list as reference, communicate with the second electronic device through the first electronic device, send the target guidance instruction to the second electronic device, and control the target internet of things device through the second electronic device according to the target guidance instruction. And after the user selects the target guide instruction, the target guide instruction is displayed in a preset mode.

In this embodiment, the preset display of the target guidance instruction may be as follows: and displaying the target guide instruction in a preset color. If all the guide instructions in the original guide instruction list are displayed in black, after the target guide instruction is determined, the target guide instruction is displayed in blue.

The preset display mode of the target guiding instruction may also be as follows: and displaying the target guide instruction in a preset window frame.

It can be understood that the preset presentation of the target guidance instruction may also be in other manners, which is not limited in this embodiment.

According to the control method of the internet of things equipment provided by the embodiment, the target internet of things equipment is identified; displaying a guide instruction list corresponding to the target Internet of things equipment according to the identification result; and displaying a target guiding instruction determined by the user through the guiding instruction list in a preset mode so that the second electronic equipment controls the target Internet of things equipment to execute corresponding operation through the target instruction, wherein the target instruction is the target guiding instruction or a target voice instruction corresponding to the target guiding instruction. The first electronic device can display the guide instruction list of the identified target Internet of things device, so that a user can know all demand instructions which can be executed by the target Internet of things device, the target guide instruction is displayed in a preset mode after the user determines the target voice instruction or the target guide instruction by taking the guide instruction list as a reference, the user can clearly determine the target instruction which needs to be controlled by the target Internet of things device, and therefore when the target Internet of things device is controlled by the second electronic device according to the target instruction, the control efficiency and the success rate of the target Internet of things device are improved.

Example two

Fig. 2 is a schematic flow chart of a control method of an internet of things device according to a second embodiment of the present application, and as shown in fig. 2, the control method of the internet of things device according to the present embodiment is further detailed in steps 101 to 103 on the basis of the control method of the internet of things device according to the first embodiment of the present application. The method for controlling the internet of things equipment further comprises the step of linkage of the first electronic equipment and the second electronic equipment, and the method for controlling the internet of things equipment comprises the following steps.

Step 201, a vision sensor is adopted to collect an image of a target Internet of things device; and identifying the target Internet of things equipment according to the target Internet of things equipment image.

In this embodiment, step 201 is a further refinement of step 101 in the embodiment shown in fig. 1.

In this embodiment, a visual sensor, such as a camera, is mounted on the first electronic device. And starting the vision sensor, aligning the vision sensor to the target Internet of things equipment, and acquiring an image of the target Internet of things equipment entering the visual field of the vision sensor. And identifying the image of the target Internet of things equipment to determine the type of the target Internet of things equipment.

When the image of the target internet of things device is identified, a machine learning algorithm, a deep learning algorithm and the like can be adopted, which is not limited in this embodiment.

In this embodiment, the type of each piece of internet-of-things equipment and the corresponding identification information in the internet-of-things environment where the target internet-of-things equipment is located may be stored in association, that is, a mapping relationship between the type of each piece of internet-of-things equipment and the corresponding identification information is established. And after the type of the target Internet of things equipment is identified, determining the identification information of the target Internet of things equipment according to the mapping relation.

The identification information of the target internet of things device may be a factory number of the target internet of things device, or may also be a name, a model, and the like of the target internet of things device, which is not limited in this embodiment.

Step 202, sending the identification information to the second electronic device through the server, so that the second electronic device sends out a voice prompt for finding the target internet of things device according to the identification information.

The first electronic device and the second electronic device can communicate in a server mode. The server may be a cloud server or other type of server.

Further, in this embodiment, identification information of the target internet of things device is sent to the second electronic device through the server, and the second electronic device determines a specific name of the target internet of things device according to the identification information of the target internet of things device and sends out a voice prompt for finding the target internet of things device through the playing component. If the target internet of things device is the smart television, the sent voice prompt for finding the target internet of things device can be 'finding the smart television', can also be 'finding the smart television, please determine your needs', and the like.

In this embodiment, after the target internet of things device is recognized by the first electronic device, the identification information of the target internet of things device is sent to the second electronic device through the server, so that the second electronic device sends out a voice prompt for finding the target internet of things device according to the identification information, and linkage of finding the target internet of things device by the first electronic device and the second electronic device can be realized.

Step 203, determining identification information of the target Internet of things equipment according to the recognition result; acquiring a guide instruction list corresponding to the target Internet of things equipment according to the identification information; and displaying the guide instruction list.

In this embodiment, step 203 is a further refinement of step 102 in the embodiment shown in fig. 1.

Further, in this embodiment, first, the identification information of the target internet of things device corresponding to the type of the target internet of things device of the identification result is determined according to a mapping relationship between the type of each internet of things device and the corresponding identification information, which is established in advance. Secondly, determining a guide instruction list corresponding to the identification information of the target internet of things device according to a mapping relation between the pre-established identification information of each internet of things device and the corresponding guide instruction list, and acquiring the corresponding guide instruction list.

Further, in this embodiment, displaying the guidance instruction list includes:

Specifically, in this embodiment, after the corresponding guidance instruction list is obtained, the virtual model of the corresponding guidance instruction list may be obtained. And displaying the virtual model in an AR form in a preset area range of a target Internet of things equipment image acquired by a visual sensor.

The preset area range can be a right area, a lower area, a left area and the like of the target internet of things device image.

As shown in fig. 3, the target internet of things device is an intelligent television, and the acquired guidance instruction list corresponding to the intelligent television illustratively includes "small a and small a, change station", "small a and small a, i's favorite channel", "small a and small a, volume up", "small a and small a, watch movies". And displaying a guide instruction list in an AR form in the right area of the intelligent television image acquired by the vision sensor.

And 204, performing preset display on a target guide instruction determined by the user through the guide instruction list so that the second electronic device controls the target internet of things device to execute corresponding operation through the target instruction, wherein the target instruction is the target guide instruction or a target voice instruction corresponding to the target guide instruction.

As an optional implementation manner, in this embodiment, as shown in fig. 4, the preset presentation of the target guidance instruction determined by the user through the guidance instruction list includes the following steps:

step 204a, receiving the selected operation of the target guiding instruction input by the user through the guiding instruction list.

And step 204b, responding to the selected operation, and performing preset display on the target instruction.

Further, in this embodiment, as shown in fig. 3 and 5, after a guidance instruction list corresponding to the target internet of things device is displayed on an operation interface of the first electronic device, the user may select the target guidance instruction by clicking a certain guidance instruction in the guidance instruction list. And receiving a selection operation of the target guide instruction input by a user, and responding to the selection operation to perform preset display on the target instruction.

Further, in this embodiment, in step 204b, the performing a preset presentation on the target guidance instruction includes:

and displaying the target guide instruction by a first preset display strategy.

The displaying the target guiding instruction by the first preset displaying strategy may be displaying the target guiding instruction by blue. Or the target guide instruction is displayed in a mode different from the second preset display strategy.

As shown in fig. 3, after the user selects the target guidance instruction of "small a, and large volume" in the guidance instruction list corresponding to the smart television, the target guidance instruction is displayed in blue. In fig. 3, the blue reveal is represented by the background fill of the target guide instruction as a diagonal line pattern.

In this embodiment, when a target guidance instruction determined by a user through a guidance instruction list is displayed in a preset manner, a selection operation of the user on the target guidance instruction input through the guidance instruction list is received, the target instruction is displayed in a preset manner in response to the selection operation, the target guidance instruction can be displayed in a preset manner directly through the operation of the user on an operation interface of first electronic equipment, and the second electronic equipment is triggered to execute corresponding control on target internet of things equipment through the operation of the user on the operation interface of the first electronic equipment, and the second electronic equipment does not need to recognize a voice instruction sent by the user, so that the control efficiency and success rate of the target internet of things equipment are further improved.

After step 204b, step 204c is also included.

And 204c, sending the target guiding instruction to the second electronic device through the server, so that the second electronic device plays the corresponding voice reminding information to be responded according to the target guiding instruction, and controls the target internet of things device to execute corresponding operation according to the target guiding instruction.

Further, in this embodiment, after the first electronic device sends the target guidance instruction to the second electronic device through the server, the second electronic device generates the corresponding to-be-responded voice prompt message according to the target guidance instruction. The voice reminding message to be responded is a voice reminding message corresponding to the operation to be executed by the target Internet of things equipment aiming at the target guiding instruction.

For example, if the target guidance instruction is "small a, and the volume is turned up", the corresponding to-be-responded voice prompt message may be "master, that is, the volume is to be turned up".

In this embodiment, the target guidance instruction is sent to the second electronic device through the server, so that the second electronic device plays the corresponding to-be-responded voice prompt message according to the target guidance instruction, linkage of the first electronic device and the second electronic device when the target internet of things device is controlled to be about to execute the corresponding operation is realized, and the user can know about the operation about to be executed by the target internet of things device after the target guidance instruction is selected through the linkage.

As another optional implementation manner, as shown in fig. 6, in this embodiment, the preset presentation of the target guidance instruction determined by the user through the guidance instruction list includes the following steps:

step 2041, receiving a target voice instruction sent by the second electronic device, where the target voice instruction is a voice instruction sent by the user according to the guidance instruction list and received by the second electronic device.

Step 2042, determine the guidance instructions matching the target voice instructions.

Step 2043, determine the matched guidance instruction as the target guidance instruction.

Step 2044, the target guidance instruction is displayed in a preset manner.

Further, in this embodiment, after a guidance instruction list corresponding to the target internet of things device is displayed on the operation interface of the first electronic device, the user may send out a target voice instruction in a voice manner according to the guidance instruction list. And the second electronic equipment receives the target voice instruction and sends the target voice instruction to the first electronic equipment through the server, the first electronic equipment performs text conversion on the target voice instruction, matches the target voice instruction with each guide instruction in the guide instruction list, determines the guide instruction matched with the target guide instruction, and determines the matched guide instruction as the target guide instruction. The target voice instruction is spoken by the user with reference to the guide instruction list, so that the target guide instruction matched with the target voice instruction can be determined to a great extent, and the target guide instruction is displayed in a preset mode.

Further, in this embodiment, in step 2044, the preset showing of the target guiding instruction includes:

The displaying the target guiding instruction by the second preset displaying strategy may be displaying the target guiding instruction in red. Or the target guide instruction is displayed in a mode different from the first preset display strategy.

As shown in fig. 5, the target internet of things device is an intelligent air conditioner, and the acquired guidance instruction list corresponding to the intelligent air conditioner exemplarily includes "small a, temperature adjusted to 25 degrees", "small a, large wind", "small a, shutdown", "small a, small a". And displaying the guide instruction list in an AR mode in the right area of the intelligent air conditioner image acquired by the visual sensor, and displaying the target guide instruction in red after the target guide instruction of 'small A and small A, power off' in the guide instruction list corresponding to the intelligent air conditioner is selected by a user. In fig. 5, the red color representation is represented by the background fill of the target guidance instruction as a mesh pattern.

In this embodiment, when a target guidance instruction determined by a user through a guidance instruction list is displayed in a preset manner, a target voice instruction sent by a second electronic device is received, where the target voice instruction is a voice instruction received by the second electronic device and sent by the user according to the guidance instruction list, a guidance instruction matched with the target voice instruction is determined, the matched guidance instruction is determined as the target guidance instruction, and the target guidance instruction is displayed in a preset manner. The corresponding target guide instruction can be preset and displayed in a mode that the user speaks the target voice instruction to the second electronic device, the method and the device are suitable for a scene that the user does not conveniently operate an operation interface of the first electronic device to trigger the second electronic device to control the target Internet of things device, and a mode of triggering through the user voice is provided for controlling the target Internet of things device.

EXAMPLE III

Fig. 7 is a flowchart illustrating a control method of an internet of things device according to a third embodiment of the present application, and as shown in fig. 7, an execution main body of the control method of the internet of things device provided in this embodiment is a control device of the internet of things device, the control device of the internet of things device is integrated in a second electronic device, the second electronic device is in communication with a first electronic device, and the first electronic device is configured to display a guidance instruction list corresponding to a target internet of things device. The method for controlling the internet of things device provided by the embodiment includes the following steps.

Step 301, receiving a target instruction determined by a user through a guide instruction list, where the target instruction is a target guide instruction or a target voice instruction.

In this embodiment, as an optional implementation manner, in this embodiment, if the target instruction is a target voice instruction, the manner of receiving the target instruction determined by the user through the guidance instruction list is as follows: the user speaks a target voice instruction corresponding to a certain guiding instruction through a guiding instruction list corresponding to the target Internet of things device displayed by the first electronic device. The second electronic device receives the target voice instruction.

In this embodiment, as another optional implementation manner, if the target instruction is a target guidance instruction, receiving the target instruction determined by the user through the guidance instruction list includes:

and receiving a target guide instruction sent by the first electronic device, wherein the target guide instruction is a guide instruction selected by a user in a guide instruction list through the first electronic device.

Specifically, in this embodiment, a user inputs a selection operation on a target guidance instruction through a first electronic device, the first electronic device responds to the selection operation, and after performing preset presentation on the target guidance instruction, the first electronic device sends the target guidance instruction to a second electronic device, and the second electronic device receives the target guidance instruction.

The first optional implementation manner and the second optional implementation manner are used for explaining, before the second electronic device receives the target instruction determined by the user through the guidance instruction list, the second electronic device may receive the identification information of the target internet of things device sent by the first electronic device, and the second electronic device sends out the voice prompt for finding the target internet of things device according to the identification information.

And 302, controlling the target internet of things equipment to execute corresponding operation according to the target instruction.

In this embodiment, the second electronic device has communication connection with the internet of things device in the same internet of things environment, and the communication connection mode may be zigbee communication, bluetooth BLE communication, or wifi communication of action hotspot, etc. The second electronic device and the internet of things device in the same internet of things environment can also communicate through the infrared transmitter, which is not limited in this embodiment.

Specifically, in this embodiment, the second electronic device sends the target instruction to the target internet of things device, and the target internet of things device executes a corresponding operation according to the target instruction.

The second electronic device may play the responded voice prompt message through the play component after controlling the target internet of things device to execute the corresponding operation according to the target instruction.

For example, if the target instruction is "small a, power off", the second electronic device plays the "owner, power off" responded voice prompt message after the second electronic device controls the target internet of things device to execute the power off operation according to the target instruction.

In the method for controlling internet of things equipment provided by this embodiment, by receiving a target instruction determined by a user through a guidance instruction list, where the target instruction is a target guidance instruction or a target voice instruction, and receiving a target instruction determined by the user through the guidance instruction list, where the target instruction is a target guidance instruction or a target voice instruction, since a first electronic device can display a guidance instruction list of a target internet of things equipment that is identified, the user can know all required instructions that can be executed by the target internet of things equipment, and after the user determines the target voice instruction or the target guidance instruction with reference to the guidance instruction list, the target guidance instruction is displayed in advance, so that the user can specify the target instruction that needs to be controlled by the target internet of things equipment, when the target internet of things equipment is controlled by a second electronic device according to the target instruction, the control efficiency and the success rate of the target Internet of things equipment are improved.

Optionally, in this embodiment, if the target instruction is a target voice instruction, after receiving the target instruction determined by the user through the guidance instruction list, the method further includes:

and sending the target voice instruction to the first electronic equipment through the server so that the first electronic equipment determines a target guide instruction matched with the target voice instruction and displays the target guide instruction in a preset mode.

The specific implementation manner of the method can be seen in the implementation manners of steps 2051 to 2054 in fig. 6, which are not described in detail herein.

Optionally, in this embodiment, after step 301, the method further includes:

generating corresponding voice reminding information to be responded according to the target instruction; and playing the voice reminding information to be responded.

Specifically, in this embodiment, if the target instruction is the target voice instruction, the second electronic device generates corresponding to-be-responded voice prompt information after receiving the target voice instruction; and playing the voice reminding information to be responded. And if the target instruction is the target guide instruction, the second electronic equipment generates corresponding voice reminding information to be responded according to the target guide instruction, and plays the voice reminding information to be responded.

In this embodiment, the target guidance instruction sent by the first electronic device is received at the second electronic device, and the second electronic device plays the corresponding to-be-responded voice prompt message according to the target guidance instruction, so that linkage of the first electronic device and the second electronic device when the target internet of things device is controlled to be about to execute the corresponding operation is realized, and the user can know about the operation about to be executed by the target internet of things device after the target guidance instruction is selected through the linkage.

Example four

Fig. 8 is a signaling flow diagram of a control method of an internet of things device according to a fourth embodiment of the present disclosure, and fig. 9 is an application scenario diagram of the control method of the internet of things device according to the fourth embodiment of the present disclosure, in fig. 9, a first electronic device is a smart phone, a second electronic device is a smart speaker, a target internet of things device is a smart television, and a server is a cloud server, which are used as examples to describe the control method of the internet of things device according to the present embodiment, then the control method of the internet of things device according to the present embodiment includes the following steps:

step 401, identifying a target internet of things device by a first electronic device.

In this embodiment, the smart phone is loaded with a client of the internet of things device control method. By opening the client, acquiring an image of the target Internet of things equipment by using the camera, identifying the image of the target Internet of things equipment, determining the target Internet of things equipment as the smart television, and determining identification information of the smart television.

And 402, the first electronic device displays a guide instruction list corresponding to the target Internet of things device according to the identification result.

As shown in fig. 9, a smart tv image is displayed in the operation interface of the smartphone client, and a corresponding guidance instruction list is displayed in the right area of the smart tv image.

In step 403, the first electronic device sends the identification information to the second electronic device through the server.

And step 404, the second electronic device sends out a voice prompt for finding the target internet of things device according to the identification information.

In this embodiment, first electronic equipment sends the identification information of smart television to smart sound box through high in the clouds server, and smart sound box sends the pronunciation of "discovering smart television" and reminds.

Step 405, the first electronic device receives a selected operation of a target guiding instruction input by a user through a guiding instruction list; and responding to the selected operation, and performing preset display on the target guide instruction.

Specifically, in this embodiment, as shown in fig. 9, the user selects the target guidance instruction "small a, and volume up", where the "small a, and volume up" is displayed according to the first preset display policy, and in fig. 9, the target guidance instruction is displayed in blue.

In step 406, the first electronic device sends the target booting instruction to the second electronic device through the server.

And step 407, the second electronic device plays the corresponding voice reminding information to be responded according to the target guiding instruction.

As shown in fig. 9, after receiving the target guidance instruction of "small a, and volume up", the second electronic device plays the corresponding to-be-responded voice prompt message as "master, i.e., volume up to be made".

And step 408, sending the target guiding instruction to the target internet of things equipment so as to control the target internet of things equipment to execute corresponding operation according to the target guiding instruction.

As shown in fig. 9, after the second electronic device controls the target internet of things device to execute corresponding operations according to the target guiding instruction, the corresponding responded voice reminding information is sent as "master, volume is adjusted to be high".

According to the control method of the internet of things device, the user triggers the second electronic device to control the target internet of things device to execute corresponding operations by selecting the target guidance instruction in the guidance instruction list displayed by the first electronic device. The target guide instruction can be preset and displayed directly through the operation of the user on the operation interface of the first electronic device, the second electronic device is triggered to execute corresponding control on the target Internet of things device through the operation of the user on the operation interface of the first electronic device, the second electronic device does not need to recognize the voice instruction sent by the user, and the efficiency and the success rate of the control on the target Internet of things device are further improved. And in the stage of identifying the target Internet of things equipment, the linkage of the first electronic equipment and the second electronic equipment is realized in the stage of presetting and displaying the target guide instruction.

EXAMPLE five

Fig. 10 is a signaling flowchart of a control method of an internet of things device according to a fifth embodiment of the present application; fig. 11 is an application scenario diagram of a control method of an internet of things device according to a fifth embodiment of the present application, and in fig. 11, a control method of the internet of things device provided in this embodiment is described with reference to a first electronic device as a smart phone, a second electronic device as a smart speaker, a target internet of things device as a smart air conditioner, and a server as a cloud server, where the control method of the internet of things device provided in this embodiment includes the following steps:

step 501, identifying a target internet of things device by a first electronic device.

In this embodiment, the implementation manner of step 501 is the same as that of step 401 in the embodiment shown in fig. 8 of this application, and is not described in detail here.

And 502, the first electronic device displays a guide instruction list corresponding to the target Internet of things device according to the recognition result.

As shown in fig. 11, a smart air conditioner image is displayed in the operation interface of the smart phone client, and a corresponding guidance instruction list is displayed in the right area of the smart air conditioner image.

Step 503, the first electronic device sends the identification information to the second electronic device through the server.

And step 504, the second electronic device sends out voice prompt for finding the target Internet of things device according to the identification information.

In this embodiment, first electronic equipment sends the identification information of intelligent air conditioner for intelligent audio amplifier through high in the clouds server, and intelligent audio amplifier sends the pronunciation of "discovering intelligent air conditioner" and reminds.

And 505, the second electronic device receives a guidance instruction list corresponding to the target internet of things device and displayed by the first electronic device, and the user sends out a target voice instruction.

Step 506, the second electronic device sends the target voice command to the first electronic device.

Step 507, the first electronic device determines a target guiding instruction matched with the target voice instruction; and performing preset display on the target guide instruction.

Specifically, in this embodiment, as shown in fig. 11, the user sends a target voice instruction of "small a, power off", and the matched target guidance instruction determined by the first electronic device is also "small a, power off", the target guidance instruction of "small a, power off" is displayed according to the second preset display policy, and the target guidance instruction is displayed in red in fig. 11.

And step 508, the second electronic device plays the corresponding voice reminding information to be responded according to the target voice instruction.

As shown in fig. 11, after receiving the target voice command of "small a, power off", the second electronic device plays the corresponding voice prompt message to be responded as "master, i.e., will be powered off".

In step 509, the second electronic device sends a target voice instruction to the target internet of things device to control the target internet of things device to execute a corresponding operation according to the target voice instruction.

As shown in fig. 11, after the second electronic device controls the target internet of things device to perform corresponding operations according to the target guidance instruction, the corresponding responded voice prompt message is sent as "owner, powered off".

In the control method of the internet of things device provided by this embodiment, a user sends a target voice instruction as a reference according to a guidance instruction list of a target internet of things device to trigger the second electronic device to control the target internet of things device to execute corresponding operations. The method and the device are suitable for a scene that a user does not conveniently trigger the second electronic device to control the target Internet of things device through the operation of the operation interface of the first electronic device. And in the stage of identifying the target Internet of things equipment, the linkage of the first electronic equipment and the second electronic equipment is realized in the stage of presetting and displaying the target guide instruction.

EXAMPLE six

Fig. 12 is a schematic structural diagram of a control device of an internet of things device according to a sixth embodiment of the present application, and as shown in fig. 12, the control device of the internet of things device provided in this embodiment is located in a first electronic device, and the first electronic device communicates with a second electronic device. This controlling means 600 of thing networking device includes: a device identification module 601, a list display module 602 and a target instruction presentation module 603.

The device identification module 601 is configured to identify a target internet of things device. The list display module 602 is configured to display a guidance instruction list corresponding to the target internet of things device according to the identification result. The target instruction display module 603 is configured to preset a target guidance instruction determined by the user through the guidance instruction list, so that the second electronic device controls the target internet of things device to execute a corresponding operation through the target instruction, where the target instruction is the target guidance instruction or a target voice instruction corresponding to the target guidance instruction.

The control device of the internet of things device provided in this embodiment may execute the technical solution of the method embodiment shown in fig. 1, and the implementation principle and the technical effect of the control device are similar to those of the method embodiment shown in fig. 1, and are not described in detail here.

Further, the control device of the internet of things device provided by this embodiment further includes the following technical solutions.

Further, the device identification module 601 is specifically configured to acquire a target internet of things device image by using a visual sensor. And identifying the target Internet of things equipment according to the target Internet of things equipment image.

Further, the list displaying module 602 is specifically configured to determine, according to the recognition result, identification information of the target internet of things device. And acquiring a guide instruction list corresponding to the target Internet of things equipment according to the identification information. And displaying the guide instruction list.

Further, the list displaying module 602 is configured to display the guidance instruction list in an AR manner within a preset area of the target internet of things device image when displaying the guidance instruction list.

Further, the control device of the internet of things device provided by this embodiment further includes: and the identification sending module is used for sending the identification information to the second electronic equipment through the server so that the second electronic equipment sends out voice prompt for finding the target Internet of things equipment according to the identification information.

Optionally, the target instruction presenting module 603 is specifically configured to receive a selection operation of the target guidance instruction, which is input by the user through the guidance instruction list. And responding to the selected operation, and performing preset display on the target guide instruction.

Further, the target instruction presenting module 603 is specifically configured to present the target guidance instruction according to a first preset presentation policy when the target guidance instruction is subjected to preset presentation.

Further, the control device of the internet of things device provided by this embodiment further includes: and the guiding instruction sending module is used for sending the target guiding instruction to the second electronic equipment through the server so that the second electronic equipment plays the corresponding voice reminding information to be responded according to the target guiding instruction and controls the target Internet of things equipment to execute corresponding operation according to the target guiding instruction.

Optionally, the target instruction presenting module 603 is specifically configured to receive a target voice instruction sent by the second electronic device, where the target voice instruction is a voice instruction sent by the second electronic device according to the guidance instruction list. A guidance instruction matching the target voice instruction is determined. And determining the matched guide instruction as the target guide instruction. And performing preset display on the target guide instruction.

Further, the target instruction presenting module 603 is specifically configured to present the target guidance instruction according to a second preset presentation policy when the target guidance instruction is subjected to the preset presentation.

The control device of the internet of things device provided in this embodiment may further execute the technical solutions of the method embodiments shown in fig. 2, fig. 4, fig. 6, fig. 8, and fig. 10, and the implementation principle and technical effects of the technical solutions are similar to those of the method embodiments shown in fig. 2, fig. 4, fig. 6, fig. 8, and fig. 10, and are not described in detail herein.

EXAMPLE seven

Fig. 13 is a schematic structural diagram of a control device of an internet of things device according to a sixth embodiment of the present application, and as shown in fig. 13, the control device of the internet of things device provided in this embodiment is located in a second electronic device, the second electronic device is in communication with a first electronic device, and the first electronic device is configured to display a guidance instruction list corresponding to a target internet of things device. This controlling means 700 of thing networking device includes: a target instruction receiving module 701 and a device control module 702.

The target instruction receiving module 701 is configured to receive a target instruction determined by a user through a guidance instruction list, where the target instruction is a target guidance instruction or a target voice instruction. The device control module 702 is configured to control the target internet of things device to execute a corresponding operation according to the target instruction.

The control device of the internet of things device provided in this embodiment may execute the technical scheme of the method embodiment shown in fig. 7, and the implementation principle and the technical effect of the control device are similar to those of the method embodiment shown in fig. 7, which are not described in detail herein.

Further, if the target instruction is a target guidance instruction, the target instruction receiving module 701 is specifically configured to receive the target guidance instruction sent by the first electronic device, where the target guidance instruction is a guidance instruction selected by the user in the guidance instruction list through the first electronic device.

Further, if the target instruction is a target voice instruction, the method further includes: and the voice instruction sending module is used for sending the target voice instruction to the first electronic equipment through the server so that the first electronic equipment determines a target guide instruction matched with the target voice instruction and displays the target guide instruction in a preset mode.

Further, the control device of the internet of things device provided by this embodiment further includes: the voice reminding module is used for generating corresponding voice reminding information to be responded according to the target instruction; and playing the voice reminding information to be responded.

The control device of the internet of things device provided in this embodiment may further execute the technical solutions in the method embodiments shown in fig. 8 and 10, and the implementation principles and technical effects of the technical solutions are similar to those in the method embodiments shown in fig. 8 and 10, and are not described in detail here.

According to the method embodiment corresponding to the first electronic device, the application also provides the first electronic device and a corresponding non-transitory computer readable storage medium storing computer instructions.

As shown in fig. 14, the first electronic device is a block diagram of a first electronic device of a control method of an internet of things device according to an embodiment of the present application. The first electronic device is directed to various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The first electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.

As shown in fig. 14, the first electronic device includes: one or more processors 801, memory 802, and interfaces for connecting the various components, including a high speed interface and a low speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the first electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple first electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 14 illustrates an example of a processor 801.

The memory 802 is a non-transitory computer readable storage medium as provided herein. The memory stores instructions executable by the at least one processor, so that the at least one processor executes the control method of the internet of things device provided by the application. The non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to execute the control method of the internet of things device provided by the present application.

The memory 802 is a non-transitory computer-readable storage medium and can be used for storing non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the control method of the internet of things device in the embodiment of the present application (for example, the device identification module 601, the list display module 602, and the target instruction presentation module 603 shown in fig. 12). The processor 801 executes various functional applications of the server and data processing by running non-transitory software programs, instructions and modules stored in the memory 802, so as to implement the control method of the internet of things device in the above method embodiment.

The memory 802 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the stored data area may store data created according to the use of the first electronic device of fig. 14, and the like. Further, the memory 802 may include high speed random access memory and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 802 optionally includes memory located remotely from the processor 801, which may be connected to the first electronic device of FIG. 14 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The first electronic device of fig. 14 may further include: an input device 803 and an output device 804. The processor 801, the memory 802, the input device 803, and the output device 804 may be connected by a bus or other means, and are exemplified by a bus in fig. 14.

The input device 803 may receive input voice, numeric, or character information and generate key signal inputs related to user settings and function control of the first electronic device of fig. 14, such as a touch screen, keypad, mouse, track pad, touch pad, pointer stick, one or more mouse buttons, track ball, joystick, or like input device. The output devices 804 may include a voice playing device, a display device, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.

Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

According to the method embodiment corresponding to the second electronic device, the application also provides the second electronic device and a corresponding non-transitory computer readable storage medium storing computer instructions.

Fig. 15 is a block diagram of a second electronic device according to the method for controlling an internet of things device in the embodiment of the present application. The second electronic device is directed to various forms of digital computers having voice interaction functionality, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The second electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.

As shown in fig. 15, the second electronic device includes: one or more processors 901, memory 902, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the second electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, a plurality of second electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 15 illustrates an example of a processor 901.

Memory 902 is a non-transitory computer readable storage medium as provided herein. The memory stores instructions executable by the at least one processor, so that the at least one processor executes the control method of the internet of things device provided by the application. The non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to execute the control method of the internet of things device provided by the present application.

The memory 902, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., the target instruction receiving module 701 and the device control module 702 shown in fig. 13) corresponding to the control method of the internet of things device in the embodiment of the present application. The processor 901 executes various functional applications of the server and data processing by running non-transitory software programs, instructions and modules stored in the memory 902, that is, implements the control method of the internet of things device in the above method embodiments.

The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the stored data area may store data created according to the use of the second electronic device of fig. 15, and the like. Further, the memory 902 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 902 may optionally include memory located remotely from the processor 901, which may be connected to the second electronic device of fig. 15 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The second electronic device of fig. 15 may further include: an input device 903 and an output device 904. The processor 901, the memory 902, the input device 903 and the output device 904 may be connected by a bus or other means, and fig. 15 illustrates an example of connection by a bus.

The input device 903 may receive input voice, numeric, or character information and generate key signal inputs related to user settings and function control of the second electronic device of fig. 15, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer, one or more mouse buttons, a track ball, a joystick, or other input devices. The output devices 904 may include a voice playing device, a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.

According to the technical scheme of the embodiment of the application, the first electronic device can display the guide instruction list of the identified target Internet of things device, so that a user can know all demand instructions which can be executed by the target Internet of things device, after the user determines the target voice instruction or the target guide instruction by taking the guide instruction list as a reference, the target guide instruction is displayed in a preset mode, the user can clearly determine the target instruction which needs to be controlled by the target Internet of things device, and therefore when the target Internet of things device is controlled by the second electronic device according to the target instruction, the control efficiency and the success rate of the target Internet of things device are improved.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.

The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A control method of Internet of things equipment is applied to first electronic equipment, and the first electronic equipment is communicated with second electronic equipment, and the method comprises the following steps:

identifying target Internet of things equipment;

displaying a guide instruction list corresponding to the target Internet of things equipment according to the identification result;

2. The method of claim 1, wherein the identifying a target internet of things device comprises:

acquiring an image of a target Internet of things device by using a visual sensor;

and identifying the target Internet of things equipment according to the target Internet of things equipment image.

3. The method of claim 1, wherein the displaying a guidance instruction list corresponding to the target internet of things device according to the recognition result comprises:

determining identification information of the target Internet of things equipment according to the recognition result;

acquiring a guide instruction list corresponding to the target Internet of things equipment according to the identification information;

and displaying the guide instruction list.

4. The method of claim 3, wherein the displaying the list of guidance instructions comprises:

5. The method of claim 3, wherein after determining the identification information of the target IOT device according to the recognition result, the method further comprises:

6. The method according to claim 1, wherein the preset presentation of the target guidance instruction determined by the user through the guidance instruction list comprises:

receiving a selected operation of the target guiding instruction input by a user through the guiding instruction list;

and responding to the selected operation, and performing preset display on the target guide instruction.

7. The method of claim 6, wherein the pre-rendering the target boot instruction comprises:

and displaying the target guide instruction by a first preset display strategy.

8. The method of claim 6, further comprising:

9. The method according to claim 1, wherein the preset presentation of the target guidance instruction determined by the user through the guidance instruction list comprises:

receiving a target voice instruction sent by the second electronic device, wherein the target voice instruction is a voice instruction sent by a user according to the guide instruction list and received by the second electronic device;

determining a guiding instruction matched with the target voice instruction;

determining the matched guide instruction as the target guide instruction;

and performing preset display on the target guide instruction.

10. The method of claim 9, wherein the pre-rendering the target boot instruction comprises:

11. The method for controlling the IOT equipment is applied to second electronic equipment, the second electronic equipment is communicated with first electronic equipment, and the first electronic equipment is used for displaying a guide instruction list corresponding to a target IOT equipment, and the method comprises the following steps:

receiving a target instruction determined by a user through the guide instruction list, wherein the target instruction is a target guide instruction or a target voice instruction;

and controlling the target Internet of things equipment to execute corresponding operation according to the target instruction.

12. The method of claim 11, wherein if the target command is a target guidance command, the receiving the target command determined by the user through the guidance command list comprises:

13. The method of claim 11, wherein if the target command is a target voice command, after receiving the target command determined by the user through the guidance command list, the method further comprises:

14. A control device of Internet of things equipment is characterized in that the control device is located in first electronic equipment, the first electronic equipment is communicated with second electronic equipment, and the control device comprises:

the equipment identification module is used for identifying target Internet of things equipment;

the list display module is used for displaying a guide instruction list corresponding to the target Internet of things equipment according to the identification result;

and the target instruction display module is used for displaying a target guide instruction determined by the user through the guide instruction list in a preset mode so that the second electronic equipment controls the target internet of things equipment to execute corresponding operation through the target instruction, wherein the target instruction is the target guide instruction or a target voice instruction corresponding to the target guide instruction.

15. The utility model provides a controlling means of thing networking device, its characterized in that, the device is located second electronic equipment, second electronic equipment and first electronic equipment communication, first electronic equipment is used for showing the guide instruction list that target thing networking device corresponds, the device includes:

the target instruction receiving module is used for receiving a target instruction determined by a user through the guide instruction list, and the target instruction is a target guide instruction or a target voice instruction;

and the equipment control module is used for controlling the target Internet of things equipment to execute corresponding operation according to the target instruction.

16. A first electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-10.

17. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-10.

18. A second electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 11-13.

19. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 11-13.

20. A control method of Internet of things equipment is applied to first electronic equipment, and the first electronic equipment is communicated with second electronic equipment, and the method comprises the following steps: