CN107168085B - Intelligent household equipment remote control method, device, medium and computing equipment - Google Patents
Intelligent household equipment remote control method, device, medium and computing equipment Download PDFInfo
- Publication number
- CN107168085B CN107168085B CN201710512069.6A CN201710512069A CN107168085B CN 107168085 B CN107168085 B CN 107168085B CN 201710512069 A CN201710512069 A CN 201710512069A CN 107168085 B CN107168085 B CN 107168085B
- Authority
- CN
- China
- Prior art keywords
- intelligent
- control
- intelligent home
- environment information
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000008859 change Effects 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 11
- 230000007613 environmental effect Effects 0.000 abstract description 23
- 230000003993 interaction Effects 0.000 abstract description 5
- 238000003860 storage Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 7
- 238000010438 heat treatment Methods 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000001816 cooling Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000000779 smoke Substances 0.000 description 2
- UGFAIRIUMAVXCW-UHFFFAOYSA-N Carbon monoxide Chemical compound [O+]#[C-] UGFAIRIUMAVXCW-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 229910002091 carbon monoxide Inorganic materials 0.000 description 1
- 239000003344 environmental pollutant Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 231100000719 pollutant Toxicity 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- User Interface Of Digital Computer (AREA)
- Telephonic Communication Services (AREA)
- Selective Calling Equipment (AREA)
Abstract
The invention discloses a remote control method, a remote control device, a remote control medium and a remote control computing device for intelligent home equipment, which enable a user to intuitively know the change of field environmental information of the intelligent home equipment through the change of a control picture, reduce the interaction times between the user and the intelligent home equipment and save the expenditure of the intelligent home equipment. The remote control method of the intelligent household equipment comprises the following steps: receiving a real-time image of the intelligent home equipment sent by an intelligent home server and displaying a corresponding control picture, wherein the real-time image is acquired by an intelligent camera and sent to the intelligent home server; receiving environment information collected by intelligent home equipment and sent by the intelligent home server, and determining display information of the control picture according to the environment information, wherein the environment information is collected by the intelligent home equipment and sent to the intelligent home server through the intelligent camera; and updating the displayed control picture according to the display information.
Description
Technical Field
The invention relates to the technical field of intelligent home, in particular to a remote control method, a remote control device, a remote control medium and a remote control computing device for intelligent home equipment.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
The smart home locates each electrical equipment, lighting element and active component (such as curtain) in the home by means of a Uniform Resource Identifiers (URIs) through a bottom internet of things protocol, and communicates between states according to a Representational State Transfer (REST) principle. The intelligent household equipment comprises an intelligent lamp, an intelligent door lock, an intelligent air conditioner, an intelligent temperature controller, an intelligent camera, an intelligent water heater, an intelligent electric cooker intelligent gateway and the like.
The user can be through the intelligent home equipment of control client remote control who installs on the mobile terminal, in prior art, can gather the real-time image of intelligent home equipment and present for the user through the control client through the mode of remote image acquisition, the user can send control command to intelligent home equipment through control client is long-range, however, in prior art, the real-time image that the control client presented to the user is fixed unchangeable, unless image acquisition device's shooting angle changes, like this, if the user need learn on-the-spot environmental information, still need send control command to intelligent home equipment and acquire. If a user wants to know the temperature information of the scene, a control instruction needs to be sent to the intelligent air conditioner to check the environment temperature information. In the process, before the user sends the control command, the user needs to send the query command to the smart home device to query the on-site environment information, so that the interaction times between the user and the smart home device are increased, under normal conditions, the smart home device is in a dormant state, and after the query command sent by the user is received, the smart home device needs to be switched from the dormant state to a working state to respond to the query operation of the user, and the resource overhead of the smart home device is increased undoubtedly.
Disclosure of Invention
Embodiments of the present invention provide a method, an apparatus, a medium, and a computing device for remotely controlling an intelligent home device, so that a user can intuitively know a change of field environmental information of the intelligent home device through a change of a control picture, reduce interaction times between the user and the intelligent home device, and save overhead of the intelligent home device.
The embodiment of the invention provides a remote control method of intelligent household equipment, which comprises the following steps:
receiving a real-time image of the intelligent home equipment sent by an intelligent home server and displaying a corresponding control picture, wherein the real-time image is acquired by an intelligent camera and sent to the intelligent home server;
receiving environment information collected by intelligent home equipment and sent by the intelligent home server, and determining display information of the control picture according to the environment information, wherein the environment information is collected by the intelligent home equipment and sent to the intelligent home server through the intelligent camera; and are
And updating the displayed control picture according to the display information.
Optionally, the remote control method for the smart home device provided by the embodiment of the present invention further includes:
identifying and marking intelligent equipment contained in the control picture;
and adding a hidden control menu at a corresponding position according to the mark position of the intelligent home equipment aiming at each intelligent home equipment contained in the control picture.
Optionally, the remote control method for the smart home device provided by the embodiment of the present invention further includes:
receiving a control operation instruction sent by a user aiming at any intelligent household equipment contained in the control picture;
and sending the received control operation instruction to the intelligent camera through the intelligent home server, and sending the control operation instruction to corresponding intelligent home equipment by the intelligent camera to execute.
Preferably, the control operation instruction includes a touch operation instruction or a voice control instruction.
The embodiment of the invention provides a remote control device of intelligent household equipment, which comprises:
the first receiving unit is used for receiving a real-time image of the intelligent home equipment sent by the intelligent home server and displaying a corresponding control picture, wherein the real-time image is acquired by the intelligent camera and sent to the intelligent home server;
the second receiving unit is used for receiving environment information which is sent by the intelligent home server and acquired by the intelligent home equipment, and determining display information of the control picture according to the environment information, wherein the environment information is acquired by the intelligent home equipment and sent to the intelligent home server through the intelligent camera;
and the updating unit is used for updating the displayed control picture according to the display information.
Optionally, the remote control apparatus for smart home devices provided in the embodiments of the present invention further includes:
the identification unit is used for identifying and marking the intelligent equipment contained in the control picture;
and the adding unit is used for adding a hidden control menu at a corresponding position according to the mark position of each intelligent household device contained in the control picture.
Optionally, the remote control apparatus for smart home devices provided in the embodiments of the present invention further includes:
the third receiving unit is used for receiving a control operation instruction sent by a user aiming at any intelligent household equipment contained in the control picture;
and the sending unit is used for sending the received control operation instruction to the intelligent camera through the intelligent home server, and the intelligent camera sends the control operation instruction to corresponding intelligent home equipment for execution.
Preferably, the control operation instruction includes a touch operation instruction or a voice control instruction.
The embodiment of the invention provides a computing device, which comprises at least one processing unit and at least one storage unit, wherein the storage unit stores a computer program, and when the program is executed by the processing unit, the processing unit executes the steps of any one of the intelligent household equipment remote control methods.
The embodiment of the invention provides a computer readable medium, which stores a computer program executable by a computing device, and when the program runs on the computing device, the computing device is enabled to execute the steps of any one of the intelligent home equipment remote control methods.
According to the remote control method and device for the intelligent home equipment, the display information of the control picture is changed according to the environment information collected by the intelligent home equipment, so that a user can intuitively know the change of the on-site environment information of the intelligent home equipment through the change of the control picture without sending an environment information query instruction to the intelligent home equipment for querying, the interaction between the user and the intelligent home equipment is reduced, and the resource expense of the intelligent home equipment is saved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic diagram of an application scenario according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating an implementation process of a remote control method for smart home devices in an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a first remote control device for smart home devices according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a second remote control device for smart home devices in an embodiment of the present invention.
Detailed Description
In order to enable a user to visually know the on-site environment information of the intelligent household equipment and save the expenditure of resources of the intelligent household equipment, the embodiment of the invention provides a remote control method, a remote control device, a remote control medium and computing equipment of the intelligent household equipment.
The preferred embodiments of the present invention will be described below with reference to the accompanying drawings of the specification, it being understood that the preferred embodiments described herein are merely for illustrating and explaining the present invention, and are not intended to limit the present invention, and that the embodiments and features of the embodiments in the present invention may be combined with each other without conflict.
Fig. 1 is a schematic view of an application scenario according to an embodiment of the present invention. The user 10 accesses the smart home server 12 through the smart home control client installed in the user equipment 11, the smart camera 13 collects a live real-time image of the smart home equipment and reports the live real-time image to the smart home equipment server 12, and the smart home equipment server 12 sends the received real-time image to the smart home control client.
In specific implementation, the user 10 sends a registration request to the smart home server through the smart home control client to obtain a user identifier, where the user identifier may be a mobile phone number of the user or a user name, and the like. After the user 10 successfully registers and obtains the user identifier, the smart camera identifier, and the smart home device identifier need to be bound.
Preferably, after the user successfully logs in the smart home server by using the registered user identifier, the user may enter the smart home device identifier binding page, and sequentially bind the smart camera identifier and each smart home device, for example, the user may input the smart home device identifier to be bound on the binding page and submit the smart home device identifier to the server for smart home device binding, or obtain the identifier of the smart home device by scanning a two-dimensional code or the like on the smart camera or the smart home device and submit the identifier to the smart server, which is not limited in the embodiment of the present invention.
After the association relationship among the user identifier, the smart camera identifier, and the smart home device identifier is established, the smart camera may send the acquired real-time image of the smart home device in the field to the smart home server 12, and the smart home server 12 sends the acquired real-time image to the smart home control client, and the smart home control client presents the acquired real-time image to the user 10.
In addition, each smart home device 14 may also acquire environmental information according to a sensor installed in itself, for example, the smart air conditioner may acquire temperature information through a temperature sensor installed in itself, the smart gas meter may measure the concentration of a harmful gas such as carbon monoxide on site through a sensor installed in itself, the smart humidifier may acquire environmental humidity on site through a humidity sensor installed in itself, and the like, each smart home device 14 sends the environmental information acquired by itself to the smart home server 12 through the smart camera 13, and the smart home device server 12 sends the environmental information acquired by itself to the smart home control client to notify the user.
The user equipment, the smart camera 13 and the smart home server 12 may be connected through a communication network, where the network may be a local area network, a wide area network, or the like. The user device 11 may be a portable device (e.g., a mobile phone, a tablet, a notebook, etc.) or a Personal Computer (PC), and the smart home server 12 may be any server device. The smart camera 13 and the smart home device 14 may communicate in a near field communication manner, for example, bluetooth, WIFI (wireless fidelity), ZigBee (ZigBee protocol), and the like, which is not limited in the embodiment of the present invention.
In the following, with reference to fig. 2, a method for remotely controlling smart home devices according to an embodiment of the present invention is described with reference to an application scenario of fig. 1. It should be noted that, the above-mentioned remote control method using smart home devices. It should be noted that the above application scenarios are merely illustrated for the convenience of understanding the spirit and principles of the present invention, and the embodiments of the present invention are not limited in this respect. Rather, embodiments of the present invention may be applied to any scenario where applicable.
As shown in fig. 2, which is a schematic implementation flow diagram of the remote control method for smart home devices according to the embodiment of the present invention, the method may include the following steps:
and S21, receiving the real-time images of the intelligent home devices sent by the intelligent home server and displaying corresponding control pictures.
The real-time image is acquired by the intelligent camera and is sent to the intelligent home server.
During specific implementation, the intelligent camera acquires images of the field environment of the intelligent home equipment to obtain real-time images and sends the real-time images to the intelligent home server, and the intelligent home server sends the received real-time images to the intelligent home control client, so that a user can see the real-time images of the intelligent home equipment through the intelligent home control client.
And S22, receiving the environment information collected by the intelligent home equipment and sent by the intelligent home server, and determining the display information of the control picture according to the environment information.
The environment information is acquired by the intelligent home equipment and sent to the intelligent home server through the intelligent camera.
In this step, a sensor installed on the smart home device can acquire field environmental information according to a set period and send the field environmental information to the smart camera, and the smart camera sends the environmental information acquired by the smart home device to the smart home server.
The intelligent air conditioner can collect the ambient temperature according to a set period and send the ambient temperature to the intelligent camera, and the ambient temperature collected by the intelligent air conditioner is sent to the intelligent server by the intelligent camera.
Preferably, in order to save network transmission resources, the intelligent camera may further compare the environmental information acquired by the intelligent home device in the previous acquisition period after receiving the environmental information acquired by the intelligent home device, and if it is determined that the environmental information acquired by two adjacent times changes, the intelligent camera sends the environmental information acquired by the intelligent home device to the intelligent home server.
After receiving the environmental information collected by the intelligent camera, the intelligent home server sends the received environmental information to the intelligent home control client, so that the intelligent home control client determines the display information of the displayed control picture according to the received environmental information.
In specific implementation, the smart home control client may directly display the current ambient temperature on the smart air conditioner included in the control picture according to the received environmental information, for example, the smart home control client may directly display the current ambient temperature on the smart air conditioner included in the control picture according to the ambient temperature reported by the smart air conditioner, or the smart home device may update the color tone of the currently displayed control picture according to the received environmental information to prompt the current ambient temperature.
For example, according to the received ambient temperature, if the ambient temperature is judged to be higher than a preset first temperature threshold, the currently displayed control picture is adjusted to be warm tone, and if the ambient temperature is judged to be lower than a preset second temperature threshold, the currently displayed control picture is adjusted to be cold tone, so that a user can judge the on-site ambient temperature of the intelligent home equipment according to the control picture displayed by the intelligent home control client, and determine whether a control instruction needs to be sent to the intelligent home equipment according to the on-site ambient temperature. For example, if the user determines that the current ambient temperature is too low according to the control picture, a control instruction for starting heating may be sent to the intelligent air conditioner through the intelligent home control client, and if the user determines that the current ambient temperature is too high according to the control picture, a control instruction for starting cooling may be sent to the intelligent air conditioner through the intelligent home control client. For another example, if the smart home control client determines that the concentration of harmful gas or smoke in the current environment exceeds the preset concentration threshold according to the received concentration of harmful gas in the environment, the smart home control client may adjust the control picture to be a gray image, and the gray value of the gray image is increased according to the increase of the concentration of harmful gas, and when the user determines that the concentration of harmful gas in the current environment exceeds the preset threshold according to the control picture, the smart home control client sends a control instruction for closing a valve to the smart gas meter, and the like. Or, the smart home control client determines the on-site air quality of the smart home device according to the received pollutant index information, and adjusts the display color of the picture according to the determined air quality, for example, if the air quality is determined to be excellent, the display color of the picture is adjusted to be green, if the air quality is determined to be good, the display color of the picture is adjusted to be orange, if the air quality is determined to be light pollution, the display color of the picture is adjusted to be gray, and as the pollution index increases, the gray value of the gray level image also increases. Therefore, the user can intuitively know the change of the field environment according to the control face changing color displayed by the intelligent home control client.
During specific implementation, the intelligent home control client can also adjust the display color of the control picture while displaying the received environment information at the corresponding intelligent home equipment mark position in the control picture according to the received environment information.
It should be noted that, for the second implementation manner, that is, the implementation manner in which the smart home devices may also adjust the color tone of the currently displayed control screen according to the received environment information, if the smart home control client receives different environment information collected by a plurality of smart home devices at the same time, the smart home control client may determine, according to the preset display priority, which of the environment information collected by the smart home devices changes the color tone of the control screen.
For example, the smart home control client determines that the control picture to be adjusted and displayed is a gray picture according to the fact that the concentration of harmful gas in the received environmental information is higher than a preset concentration threshold, and determines that the current environmental temperature is higher than a preset first temperature threshold according to the environmental temperature in the received environmental information, and determines that the control picture to be adjusted and displayed is a warm tone.
Preferably, during specific implementation, if the intelligent home control client determines that the concentration of harmful gas or the concentration of smoke in the current environment exceeds a preset threshold according to the received environment information, the voice warning information can be played while the gray level image of the control picture is adjusted, so that a user is prompted to close the gas valve in time.
Or, in specific implementation, the smart home control client may further determine the currently displayed control screen according to a selection of the user, for example, if the user selects an intelligent air conditioner in the control screen, the smart home control client adjusts a display color of the control screen to be a warm tone or a cool tone according to the received ambient temperature, and if the user selects an air purifier, the smart home control client adjusts the display color of the control screen to be a green, orange, or grayscale image according to the received pollution index, and the like.
And S23, updating the displayed control picture according to the display information.
In this step, the smart home control client may update the displayed control picture according to the display information of the control picture determined in step S22.
Preferably, in the implementation, after receiving the real-time image sent by the smart home server, the smart home control client may further identify the smart home devices included therein, and mark the identified smart home devices, for example, the smart home device control client may highlight the edges of the identified smart home devices. In the embodiment of the invention, the intelligent home server can also identify and mark the intelligent home equipment in the received implementation image and then send the intelligent home equipment to the intelligent home control client, so that the intelligent home control client can directly display the intelligent home equipment without executing the step of identifying the intelligent home equipment, thereby reducing the resource consumption of the intelligent home control client.
During specific implementation, the intelligent home server can acquire image characteristic information of intelligent home devices of different brands and different models in advance, and the intelligent home devices contained in the real-time images acquired by the intelligent camera are identified according to the acquired image characteristics.
Further, the intelligent home control client adds a hidden control menu to each intelligent home device included in the control screen at a corresponding position according to the mark position of the intelligent home device. It should be understood that the corresponding control menus are different for different smart home devices, for example, for a smart air conditioner, the control menus may include several control operation instructions such as turn on cooling, turn on heating, and turn off.
During specific implementation, a user can also send a control operation instruction to corresponding intelligent home equipment according to the change of the control picture displayed by the intelligent home control client. Based on this, the remote control method for the smart home device provided by the embodiment of the present invention may further include the following steps:
firstly, an intelligent home control client receives a control operation instruction sent by a user aiming at any intelligent home equipment contained in a control picture;
and step two, the intelligent household control client sends the received control operation instruction to the intelligent camera through the intelligent household server, and the intelligent camera sends the control operation instruction to corresponding intelligent household equipment for execution.
Preferably, the control operation instruction includes a touch operation instruction or a voice control instruction. According to different types of control operation instructions sent by users, the flow executed by the smart home control client is also different, which is described below.
In the first mode, the control operation command sent by the user is a touch operation command.
In this embodiment, the Touch operation instruction may be divided into two types, one is a menu Touch operation instruction, and the other is an operation instruction implemented based on 3D Touch.
Taking a touch operation instruction sent by a user as a menu-type touch operation instruction as an example, when the smart home control client detects a touch operation of the user on any smart home device displayed in the control picture, the smart home control client displays a corresponding control menu. Preferably, the displayed control menu comprises at least one control operation instruction.
Based on the method, the intelligent home control client sends the control operation instruction selected by the user to the intelligent camera through the intelligent home server according to the control operation instruction selected by the user through the control menu, and the intelligent camera sends the control operation instruction to the corresponding intelligent home equipment for execution.
For example, when a user sees that the window begins to rain but is not closed at present according to a real-time image acquired by the intelligent camera, a control menu of the intelligent window can be called out through touch operation in a control picture, a control operation instruction for closing the window is selected and sent to the intelligent home server, the intelligent home server forwards the control operation instruction to the intelligent camera, and the intelligent camera sends the control instruction for closing the window to the intelligent window so as to close the window.
Take the Touch operation instruction sent by the user as the operation instruction realized by the 3D Touch as an example. In this embodiment, the smart home control client sets different 3D Touch control instructions for different smart home devices according to a user, for example, for a smart air conditioner, a clockwise rotation is preset to turn on heating, a counterclockwise rotation is preset to turn on cooling, and a re-pressing is used to turn off the air conditioner. Therefore, when a user needs to send a heating starting control instruction to the intelligent air conditioner, the intelligent air conditioner contained in the control picture displayed by the intelligent home control client is selected and rotates clockwise, the intelligent home control client recognizes the operation as the heating starting of the intelligent air conditioner and sends the operation to the intelligent home server, the operation is sent to the intelligent camera by the intelligent home server, and the intelligent camera sends the operation to the intelligent air conditioner to execute corresponding operation.
In specific implementation, the Touch operation instruction in the embodiment of the present invention may also be 4D Touch, and the like, which is not limited in the embodiment of the present invention.
In the second mode, the control operation instruction sent by the user is a voice control operation instruction.
In this implementation manner, the user can control the smart home device to execute corresponding operations through voice. During specific implementation, when a user determines that a control instruction needs to be sent to corresponding intelligent home equipment according to the environment information displayed by the intelligent home control client, the user can directly send a voice control instruction. For example, the voice control instruction sent by the user is 'turn on air conditioner heating', the intelligent home control client can send the received voice instruction to the intelligent home server, the voice control server performs voice recognition and then sends the voice instruction to the intelligent camera, and the intelligent camera sends the voice instruction to the intelligent air conditioner to execute corresponding operation.
According to the remote control method and device for the intelligent home equipment, the display information of the control picture is changed according to the environment information collected by the intelligent home equipment, so that a user can intuitively know the change of the on-site environment information of the intelligent home equipment through the change of the control picture without sending an environment information query instruction to the intelligent home equipment for querying, the interaction times of the user and the intelligent home equipment are reduced, and the resource overhead of the intelligent home equipment is saved.
Based on the same inventive concept, the embodiment of the invention also provides an intelligent household equipment remote control device, and as the problem solving principle of the device is similar to that of the intelligent household equipment remote control method, the implementation of the device can be referred to the implementation of the method, and repeated details are omitted.
As shown in fig. 3, which is a schematic structural diagram of an intelligent home device remote control apparatus provided in an embodiment of the present invention, the intelligent home device remote control apparatus may include:
the first receiving unit 31 is configured to receive a real-time image of the smart home device sent by the smart home server and display a corresponding control picture, where the real-time image is acquired by the smart camera and sent to the smart home server;
the second receiving unit 32 is configured to receive environment information, which is sent by the smart home server and acquired by the smart home device, and determine display information of the control picture according to the environment information, where the environment information is acquired by the smart home device and sent to the smart home server through the smart camera;
and an updating unit 33, configured to update the displayed control screen according to the display information.
Optionally, the remote control apparatus for smart home devices provided in the embodiment of the present invention may further include:
the identification unit is used for identifying and marking the intelligent equipment contained in the control picture;
and the adding unit is used for adding a hidden control menu at a corresponding position according to the mark position of each intelligent household device contained in the control picture.
Optionally, the remote control apparatus for smart home devices provided in the embodiment of the present invention may further include:
the third receiving unit is used for receiving a control operation instruction sent by a user aiming at any intelligent household equipment contained in the control picture;
and the sending unit is used for sending the received control operation instruction to the intelligent camera through the intelligent home server, and the intelligent camera sends the control operation instruction to corresponding intelligent home equipment for execution.
Preferably, the control operation instruction includes a touch operation instruction or a voice control instruction.
For convenience of description, the above parts are separately described as modules (or units) according to functional division. Of course, the functionality of the various modules (or units) may be implemented in the same or in multiple pieces of software or hardware in practicing the invention.
After the method and the device for remotely controlling smart home devices according to the exemplary embodiment of the present invention are introduced, a device for remotely controlling smart home devices according to another exemplary embodiment of the present invention is introduced.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
In some possible embodiments, the smart home device remote control apparatus according to the present invention may include at least one processing unit, and at least one storage unit. Wherein the storage unit stores program codes, and when the program codes are executed by the processing unit, the processing unit is enabled to execute the steps of the intelligent home device remote control method according to various exemplary embodiments of the present invention described in this specification. For example, the processing unit may execute step S21 shown in fig. 2, receive a real-time image of the smart home device sent by the smart home server and display a corresponding control picture, where the real-time image is collected by the smart camera and sent to the smart home server, step S22, receive environment information collected by the smart home device sent by the smart home server, determine display information of the control picture according to the environment information, where the environment information is collected by the smart home device and sent to the smart home server through the smart camera, and step S23, update the displayed control picture according to the display information.
The smart home device remote control apparatus 40 according to this embodiment of the present invention is described below with reference to fig. 4. The remote control device 40 of the smart home equipment shown in fig. 4 is only an example, and should not bring any limitation to the functions and the application range of the embodiment of the present invention.
As shown in fig. 4, the smart home device remote control apparatus 40 is represented in the form of a general purpose computing device. The components of the smart home device remote control apparatus 40 may include, but are not limited to: the at least one processing unit 41, the at least one memory unit 42, and a bus 43 connecting the various system components (including the memory unit 42 and the processing unit 41).
The storage unit 42 may include readable media in the form of volatile memory, such as Random Access Memory (RAM)421 and/or cache memory 422, and may further include Read Only Memory (ROM) 423.
The storage unit 42 may also include a program/utility 425 having a set (at least one) of program modules 424, such program modules 424 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The smart home device remote control 40 may also communicate with one or more external devices 44 (e.g., a keyboard, a pointing device, etc.), with one or more devices that enable a user to interact with the smart home device remote control 40, and/or with any device (e.g., a router, a modem, etc.) that enables the smart home device remote control 40 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 45. Also, the smart home device remote control 40 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 46. As shown, the network adapter 46 communicates with other modules of the smart home device remote control 40 via the bus 43. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the smart home device remote control 40, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
In some possible embodiments, various aspects of the remote control method for smart home devices provided by the present invention may also be implemented as a program product, which includes program codes, and when the program product runs on a computer device, the program codes are configured to enable the computer device to execute the steps in the remote control method for smart home devices according to various exemplary embodiments of the present invention described in this specification, for example, the computer device may execute step S21 shown in fig. 2, receive a real-time image of a smart home device sent by a smart home server, where the real-time image is collected by a smart camera and sent to the smart home server, and display a corresponding control screen, step S22, receive environment information collected by the smart home device sent by the smart home server, determine display information of the control screen according to the environment information, and step S23, updating the displayed control picture according to the display information.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to the program product for the remote control of the intelligent household equipment, a portable compact disc read-only memory (CD-ROM) can be adopted, the program code is contained, and the program product can be operated on a server device. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device over any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., over the internet using an internet service provider).
It should be noted that although in the above detailed description several units or sub-units of the apparatus for remote control of smart home devices are mentioned, this division is only not mandatory. Indeed, the features and functions of two or more of the units described above may be embodied in one device, according to embodiments of the invention. Conversely, the features and functions of one unit described above may be further divided into embodiments by a plurality of units.
Moreover, while the operations of the method of the invention are depicted in the drawings in a particular order, this does not require or imply that the operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. The remote control method for the intelligent household equipment is characterized by comprising the following steps:
receiving a real-time image of the intelligent home equipment sent by an intelligent home server and displaying a corresponding control picture, wherein the real-time image is acquired by an intelligent camera and sent to the intelligent home server; identifying and marking intelligent equipment contained in the control picture; adding a hidden control menu at a corresponding position according to the mark position of each intelligent household device contained in the control picture;
receiving environment information acquired by intelligent home equipment and sent by the intelligent home server, and determining display information of the control picture according to the environment information, wherein the environment information is acquired by the intelligent home equipment according to a set acquisition cycle through a sensor installed on the intelligent home equipment, is compared with the environment information acquired in the previous acquisition cycle, and is sent to the intelligent home server through the intelligent camera head under the condition that the environment information acquired in two adjacent times is determined to be changed; and are
Updating the displayed control picture according to the display information, and directly displaying the control picture on the marked intelligent household equipment by the intelligent household control client according to the received environment information; or according to the received environment information, the display color of the control picture is adjusted while the received environment information is displayed at the corresponding intelligent household equipment mark position in the control picture; and if different environment information collected by the plurality of intelligent household equipment is received at the same time, determining which intelligent household equipment collects the environment information according to the preset display priority to change the tone of the control picture.
2. The method of claim 1,
receiving a control operation instruction sent by a user aiming at any intelligent household equipment contained in the control picture;
and sending the received control operation instruction to the intelligent camera through the intelligent home server, and sending the control operation instruction to corresponding intelligent home equipment by the intelligent camera to execute.
3. The method of claim 2, wherein the control operation instruction comprises a touch operation instruction or a voice control instruction.
4. The utility model provides an intelligence household equipment remote control device which characterized in that includes:
the first receiving unit is used for receiving a real-time image of the intelligent home equipment sent by the intelligent home server and displaying a corresponding control picture, wherein the real-time image is acquired by the intelligent camera and sent to the intelligent home server;
the identification unit is used for identifying and marking the intelligent equipment contained in the control picture;
the adding unit is used for adding a hidden control menu at a corresponding position according to the mark position of each intelligent home device contained in the control picture;
the second receiving unit is used for receiving environment information acquired by the intelligent home equipment and sent by the intelligent home server, determining display information of the control picture according to the environment information, wherein the environment information is acquired by the intelligent home equipment according to a set acquisition cycle through a sensor installed on the intelligent home equipment, then is compared with the environment information acquired in the previous acquisition cycle, and is sent to the intelligent home server through the intelligent camera head under the condition that the environment information acquired in two adjacent times is determined to be changed;
the updating unit is used for updating the displayed control picture according to the display information, and the intelligent home control client side directly displays the control picture on the marked intelligent home equipment according to the received environment information; or according to the received environment information, the display color of the control picture is adjusted while the received environment information is displayed at the corresponding intelligent household equipment mark position in the control picture; and if different environment information collected by the plurality of intelligent household equipment is received at the same time, determining which intelligent household equipment collects the environment information according to the preset display priority to change the tone of the control picture.
5. The apparatus of claim 4, further comprising:
the third receiving unit is used for receiving a control operation instruction sent by a user aiming at any intelligent household equipment contained in the control picture;
and the sending unit is used for sending the received control operation instruction to the intelligent camera through the intelligent home server, and the intelligent camera sends the control operation instruction to corresponding intelligent home equipment for execution.
6. The apparatus of claim 5, wherein the control operation instruction comprises a touch operation instruction or a voice control instruction.
7. A computing device comprising at least one processing unit and at least one memory unit, wherein the memory unit stores a computer program which, when executed by the processing unit, causes the processing unit to carry out the steps of the method according to any one of claims 1 to 3.
8. A computer readable medium storing a computer program executable by a computing device, the program, when run on the computing device, causing the computing device to perform the steps of the method of any of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710512069.6A CN107168085B (en) | 2017-06-28 | 2017-06-28 | Intelligent household equipment remote control method, device, medium and computing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710512069.6A CN107168085B (en) | 2017-06-28 | 2017-06-28 | Intelligent household equipment remote control method, device, medium and computing equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107168085A CN107168085A (en) | 2017-09-15 |
| CN107168085B true CN107168085B (en) | 2021-09-24 |
Family
ID=59826382
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710512069.6A Active CN107168085B (en) | 2017-06-28 | 2017-06-28 | Intelligent household equipment remote control method, device, medium and computing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107168085B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108898231A (en) * | 2018-05-31 | 2018-11-27 | 广东美的制冷设备有限公司 | interface display method, terminal device and computer readable storage medium |
| CN108880932B (en) * | 2018-05-31 | 2022-06-03 | 广东美的制冷设备有限公司 | Interface display method, terminal device and computer readable storage medium |
| CN108988493A (en) * | 2018-07-25 | 2018-12-11 | 泰州市博瑞达舞台科技有限公司 | A kind of Intelligent electricity utilization management system |
| CN109040220B (en) * | 2018-07-26 | 2021-09-21 | 北京小米移动软件有限公司 | Remote control method and device of intelligent equipment and readable storage medium |
| CN109581886B (en) * | 2018-12-13 | 2022-01-14 | 深圳绿米联创科技有限公司 | Equipment control method, device, system and storage medium |
| CN111435227B (en) * | 2018-12-25 | 2023-07-21 | 中移（杭州）信息技术有限公司 | Smart home equipment testing method, device, equipment and medium |
| CN110297434B (en) * | 2019-06-03 | 2021-05-04 | 珠海格力电器股份有限公司 | Clothes hanger control method and device and storage medium |
| CN111093030B (en) * | 2019-12-31 | 2022-02-01 | 维沃移动通信有限公司 | Equipment control method and electronic equipment |
| CN113949805A (en) * | 2020-07-17 | 2022-01-18 | 美的智慧家居科技有限公司 | Control method and control device for intelligent equipment, intelligent equipment and storage medium |
| CN112286150B (en) * | 2020-10-15 | 2021-09-14 | 珠海格力电器股份有限公司 | Intelligent household equipment management method, device and system and storage medium |
| CN112904738A (en) * | 2021-01-19 | 2021-06-04 | 珠海格力电器股份有限公司 | Equipment linkage control method, system, device, storage medium and equipment |
| CN113419652A (en) * | 2021-06-22 | 2021-09-21 | 中国联合网络通信集团有限公司 | Intelligent equipment interaction method, server and client |
| CN114489893A (en) * | 2022-01-12 | 2022-05-13 | 深圳绿米联创科技有限公司 | Device control method, device, system, electronic device and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202948319U (en) * | 2012-12-14 | 2013-05-22 | 太原科技大学 | Intelligent household system |
| CN103139019A (en) * | 2011-11-23 | 2013-06-05 | 常州普适信息科技有限公司 | Smart home service system |
| CN103777851A (en) * | 2014-02-26 | 2014-05-07 | 朱定局 | Method and system for video interaction of internet of things |
| CN104635677A (en) * | 2014-12-19 | 2015-05-20 | 欧阳秋娜 | Intelligent home control system and control method thereof |
| CN106502118A (en) * | 2016-12-21 | 2017-03-15 | 惠州Tcl移动通信有限公司 | A kind of intelligent home furnishing control method and system based on AR photographic head |
| CN106713081A (en) * | 2016-11-18 | 2017-05-24 | 张辉 | Power environment monitoring system based on smart home |
| CN106856430A (en) * | 2015-12-08 | 2017-06-16 | 北京奇虎科技有限公司 | The long-range control method and device of smart home, system |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8073921B2 (en) * | 1997-07-01 | 2011-12-06 | Advanced Technology Company, LLC | Methods for remote monitoring and control of appliances over a computer network |
| CN104321593B (en) * | 2013-02-20 | 2017-08-15 | 松下电器（美国）知识产权公司 | Portable information terminal and its control method |
| CN203324871U (en) * | 2013-07-25 | 2013-12-04 | 广东南方通信建设有限公司 | Base station machine room remote control system |
| CN104142659B (en) * | 2013-11-12 | 2017-02-15 | 珠海优特物联科技有限公司 | Method and system for switching smart home scenes |
| KR20150079106A (en) * | 2013-12-31 | 2015-07-08 | 삼성전자주식회사 | Display apparatus, terminal apparatus and controlling method thereof |
| CN103926888B (en) * | 2014-04-03 | 2016-08-03 | 张家港赛通通信科技有限公司 | A kind of intelligent wireless camera system supporting multiple short range communication protocols and working method thereof |
| CN104699042A (en) * | 2015-02-05 | 2015-06-10 | 彭琦 | Internet of Things based facility agricultural management and control system and control method thereof |
| CN106325225A (en) * | 2015-06-24 | 2017-01-11 | 刘昌伟 | Home environment monitoring and automatic optimization system |
| CN105388869A (en) * | 2015-11-23 | 2016-03-09 | 王丽华 | Intelligent home monitoring system |
| CN106371324B (en) * | 2016-08-31 | 2019-12-10 | 海信集团有限公司 | operation interface display method and device |
| CN106681161A (en) * | 2016-12-14 | 2017-05-17 | 苏州市职业大学 | Family endowment monitor |
| CN107037848A (en) * | 2017-06-15 | 2017-08-11 | 合肥讯邦网络科技有限公司 | A kind of intelligent domestic system based on Internet of Things |
| CN110119201A (en) * | 2019-04-22 | 2019-08-13 | 珠海格力电器股份有限公司 | A kind of method and apparatus of virtual experience household appliance collocation domestic environment |
-
2017
- 2017-06-28 CN CN201710512069.6A patent/CN107168085B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103139019A (en) * | 2011-11-23 | 2013-06-05 | 常州普适信息科技有限公司 | Smart home service system |
| CN202948319U (en) * | 2012-12-14 | 2013-05-22 | 太原科技大学 | Intelligent household system |
| CN103777851A (en) * | 2014-02-26 | 2014-05-07 | 朱定局 | Method and system for video interaction of internet of things |
| CN104635677A (en) * | 2014-12-19 | 2015-05-20 | 欧阳秋娜 | Intelligent home control system and control method thereof |
| CN106856430A (en) * | 2015-12-08 | 2017-06-16 | 北京奇虎科技有限公司 | The long-range control method and device of smart home, system |
| CN106713081A (en) * | 2016-11-18 | 2017-05-24 | 张辉 | Power environment monitoring system based on smart home |
| CN106502118A (en) * | 2016-12-21 | 2017-03-15 | 惠州Tcl移动通信有限公司 | A kind of intelligent home furnishing control method and system based on AR photographic head |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107168085A (en) | 2017-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107168085B (en) | Intelligent household equipment remote control method, device, medium and computing equipment | |
| RU2617330C2 (en) | Method and for scenario mode recommendation device for smart devices | |
| CN113412457B (en) | Scene pushing method, device and system, electronic equipment and storage medium | |
| CN107294793B (en) | Replacement method, device and equipment of intelligent household equipment and storage medium | |
| RU2651164C2 (en) | Method and apparatus for customizing smart device scenario mode of the intelligent device | |
| CN106155002B (en) | Intelligent household system | |
| US9930519B2 (en) | Method and apparatus for controlling home devices on group basis based upon history of the home devices | |
| CN105471705B (en) | Intelligent control method, equipment and system based on instant messaging | |
| EP2988185B1 (en) | Smart home system and control method | |
| CN104460328B (en) | Smart machine control method and device based on set scene mode | |
| CN103345232B (en) | Individualized intelligent appliance control method and system | |
| US20140070919A1 (en) | User Identification and Location Determination in Control Applications | |
| WO2016058246A1 (en) | Smart home gateway and smart home system | |
| CN111025925A (en) | Intelligent home furnishing system based on cloud computing | |
| US20160054017A1 (en) | Air conditioning management device, air conditioning system, and program | |
| KR20180072468A (en) | Intelligence Cooling and Heating Service Method of User Using Big Data | |
| WO2017028649A1 (en) | Method and apparatus for accessing intelligent device based on instant messaging | |
| WO2020133495A1 (en) | Smart device management method, mobile terminal, and system | |
| CN112468595B (en) | Equipment control method, device and system based on gateway | |
| CN113168334A (en) | Data processing method and device, electronic equipment and readable storage medium | |
| US20220100464A1 (en) | Methods and systems for execution of voice commands | |
| CN110780598A (en) | Intelligent device control method and device, electronic device and readable storage medium | |
| CN205139694U (en) | Intelligent housing system | |
| CN109412908B (en) | Method and equipment for voice display of controllable equipment | |
| CN112229032A (en) | Environment temperature adjusting method, device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |