CN105843054A - Method for controlling household devices, intelligent household system and mobile device - Google Patents

Method for controlling household devices, intelligent household system and mobile device Download PDF

Info

Publication number
CN105843054A
CN105843054A CN201610169659.9A CN201610169659A CN105843054A CN 105843054 A CN105843054 A CN 105843054A CN 201610169659 A CN201610169659 A CN 201610169659A CN 105843054 A CN105843054 A CN 105843054A
Authority
CN
China
Prior art keywords
control
home equipment
information
outline drawing
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610169659.9A
Other languages
Chinese (zh)
Inventor
王攀
冯贤全
伍泳怡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Midea Group Co Ltd
Original Assignee
Midea Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Midea Group Co Ltd filed Critical Midea Group Co Ltd
Priority to CN201610169659.9A priority Critical patent/CN105843054A/en
Publication of CN105843054A publication Critical patent/CN105843054A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house

Abstract

The invention discloses a method for controlling household devices comprising following steps: a mobile device photographs household devices for outline images, and obtains control units of the household devices and control information corresponding to the control units according to the outline images of the household devices; AR images corresponding to the outline images are generated according to the outline images and the control units, wherein the control units are added to the AR images; the household devices are controlled according to control information of a corresponding operated control unit when an operation of the control unit is detected. The invention also discloses a mobile device, and a system for controlling household devices. By means of the method, the system and the device, users obtain a more clear, accurate and vivid control interface when controlling household devices through the mobile device.

Description

Control the method for home equipment, intelligent domestic system and mobile device
Technical field
The present invention relates to Smart Home field, particularly relate to control the method for home equipment, Smart Home system System and mobile device.
Background technology
Along with electronic equipment application in life is continuously increased, for the control technology of family's home equipment Also constantly developing, due to popularizing of mobile device, in existing home equipment control program, more Come the most home equipment production firms and release the scheme using mobile device that home equipment is controlled, User can select to want the home equipment of control by mobile device, by clicking on what mobile device showed Home equipment is controlled by home equipment graphical control.
But in prior art, when home equipment is controlled by user by mobile device, mobile device circle Face mainly provides two ways to operate for user: one, and the mode of mobile device list is selected for user Selecting home equipment to be controlled, different home equipments are differentiated by model, and this makes user unclear During the model of Chu's home equipment, it is difficult to find the home equipment of correspondence to be controlled;Its two, mobile device Display word control is for user's clicking operation, but this becomes extremely difficult to operation for not recognizing the user of word, Thus cause these certain customers to be difficult with described mobile device and home equipment is controlled.
Summary of the invention
Present invention is primarily targeted at offer a kind of control the method for home equipment, intelligent domestic system and Mobile device, it is intended to the interface that solving user is provided by mobile device cannot understand accurately and grasp intuitively Making interface control, the technology using mobile device to make troubles when being controlled home equipment to user is asked Topic.
For achieving the above object, the present invention provides a kind of method controlling home equipment, described control household The method of equipment comprises the following steps:
The outline drawing picture of mobile device picked-up home equipment, and according to the profile Image Acquisition institute of home equipment State the control of home equipment and the control information corresponding with described control;
According to described outline drawing picture and described control, generate the AR image corresponding with described outline drawing picture, and It is superimposed with described control on described AR image;
Detect when control operates, control described household according to the control information that operated control is corresponding and set Standby.
Preferably, the outline drawing picture of described mobile device picked-up home equipment, and according to outside home equipment The control of home equipment described in shape Image Acquisition and the step of the control information corresponding with described control include:
The outline drawing picture of mobile device picked-up home equipment, and the outline drawing picture to the home equipment absorbed It is identified, it is thus achieved that the flag information that described home equipment is corresponding;
Described flag information is sent to server, and it is the most right to be searched by described flag information for server The control answered and the control information corresponding with described control;
Receive control and the control corresponding with described control letter that server returns according to described flag information Breath.
Preferably, described according to described outline drawing picture and described control, generate corresponding with described outline drawing picture The step being superimposed with described control on AR image, and described AR image includes:
According to described outline drawing picture and described graphical control, outside described mobile device this locality generates and be described The AR image that shape image is corresponding;Or,
Described outline drawing picture is sent to server, and receives server according to described outline drawing picture and described The AR image corresponding with described outline drawing picture that control generates
Preferably, receive based on when on described AR image, the control of input operates, according to operated described in Control information corresponding to control control the step of described home equipment and include:
When receiving control operation, coupling obtains the control information corresponding with operated control;
Control instruction is generated, directly to control described home equipment according to described control information;Or,
Described control information is sent to server, so that described control information is controlled described family by server Occupy equipment.
Additionally, for achieving the above object, the present invention also provides for a kind of mobile device, described mobile device bag Include:
Data obtaining module, for absorbing the outline drawing picture of home equipment, and according to the profile of home equipment The control of home equipment described in Image Acquisition and the control information corresponding with described control;
Interface generation module, for according to described outline drawing picture and described control, generates and described outline drawing As corresponding AR image, and it is superimposed with described control on described AR image;
Control module, during for receiving control operation based on the input of described AR image, according to operated Control information corresponding to control control described home equipment.
Preferably, described mobile device also includes: with the communication module that server carries out communication;
Described data obtaining module is used for: the outline drawing picture of picked-up home equipment, and to the household absorbed The outline drawing picture of equipment is identified, it is thus achieved that the flag information that described home equipment is corresponding;
Described communication module is additionally operable to: described flag information is sent to server, passes through institute for server State flag information and search corresponding control and the control information corresponding with described control;
Receive control and the control corresponding with described control letter that server returns according to described flag information Breath.
Preferably, described interface generation module is used for:
According to described outline drawing picture and described graphical control, outside described mobile device this locality generates and be described The AR image that shape image is corresponding.
Preferably, described control module includes:
Control information acquisition unit, during for receiving control operation based on the input of described AR image, Join and obtain the control information corresponding with operated control;
Home equipment control unit, for generating control instruction according to described control information, directly to control Described home equipment.
Additionally, for achieving the above object, the present invention also provides for a kind of intelligent domestic system, described intelligence man The system of residence includes server, home equipment and mobile device as above, wherein, described mobile device The outline drawing picture of picked-up home equipment, and generate the AR image corresponding with described outline drawing picture, and described It is superimposed with the control corresponding with described home equipment on AR image, and is receiving based on described AR image When the control of input operates, control information corresponding for operated control is sent to server, so that clothes Business device controls described home equipment according to described control information..
Preferably, described server is additionally operable to: receive the outline drawing picture that mobile device sends, outside described Shape image is identified, it is thus achieved that the control corresponding with this outline drawing picture, and according to described outline drawing picture and institute State control, generate the AR image corresponding with described outline drawing picture, and be superimposed with described on described AR image Control, returns described AR image to mobile device.
The embodiment of the present invention is by obtaining the outline drawing picture of home equipment, and according to described profile Image Acquisition The control of home equipment and the control information corresponding with described control, generate the AR of profile image overlay AR Image, it is provided that to user operation, and receive the operation information of user, according to described operation information to household Equipment is controlled, it is achieved that provides the user and is readily apparent from, and vivid home equipment controls behaviour Make interface, make user by mobile device, home equipment be controlled.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet that the present invention controls the method first embodiment of home equipment;
Fig. 2 is the schematic flow sheet that the present invention controls method second embodiment of home equipment;
Fig. 3 is the schematic flow sheet that the present invention controls method the 3rd embodiment of home equipment;
Fig. 4 is the schematic flow sheet that the present invention controls method the 4th embodiment of home equipment;
Fig. 5 is the high-level schematic functional block diagram of the first embodiment of mobile device of the present invention;
Fig. 6 is the high-level schematic functional block diagram of the second embodiment of mobile device of the present invention;
Fig. 7 is the high-level schematic functional block diagram of the 4th embodiment of mobile device of the present invention;
Fig. 8 is the structural representation of the first embodiment of intelligent domestic system of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, do referring to the drawings further Explanation.
Detailed description of the invention
Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not used to limit Determine the present invention.
The primary solutions of the embodiment of the present invention is: the outline drawing picture of mobile device picked-up home equipment, And according to the control of home equipment described in the profile Image Acquisition of home equipment and the control corresponding with described control Information processed;According to described outline drawing picture and described control, generate the AR image corresponding with described outline drawing picture, And it is superimposed with described control on described AR (Augmented Reality, augmented reality) image;Detect During control operation, control described home equipment according to the control information that operated control is corresponding.
Due in prior art, when user uses mobile device to be controlled home equipment it will be clear that Know that described home equipment could be controlled by the model of home equipment, bring when this uses to user Inconvenience, in the case of not knowing home equipment simultaneously for user, user will be unable to described home equipment It is controlled.
The present invention provides a solution, makes user can be obtained by mobile device vivid, and Home equipment is controlled by explicit AR image.
It should be noted that the electrical equipment can used in home equipment refers to family described by the embodiment of the present invention Equipment, such as air-conditioning, electric fan, TV, refrigerator, water purifier, air purifier, electric cooker, electricity Pressure cooker, baking box, microwave oven, electromagnetic oven, electric heater, audio amplifier, electrically driven curtain etc..Can manage Solve, every can be automatically controlled equipment and family in use equipment all at the protection category of home equipment. It addition, this home equipment is not limited to traditional home-use equipment, as long as to having people Inhabitation or rest activity closing space in the home equipment in (such as hotel, exhibition room etc.) broadly fall into Home equipment described by the embodiment of the present invention.
With reference to Fig. 1, controlling the first embodiment of the method for home equipment for the present invention, described control household sets Standby method includes:
Step S100, the outline drawing picture of mobile device picked-up home equipment, and according to the profile of home equipment The control of home equipment described in Image Acquisition and the control information corresponding with described control.
Mobile device obtains the outline drawing picture of home equipment, described outline drawing picture include can indicate described The information of home equipment, described mobile device is according to home equipment described in described profile image information acquisition Control and the control information corresponding with described control, described control can be on corresponding described home equipment panel Operational controls, it is also possible to according to described home equipment characteristic generate operational controls, with described household As a example by equipment is intelligent electric lamp, described control can be color saucer, the face of diverse location on described color saucer The corresponding different color control information of color.
Step S200, according to described outline drawing picture and described control, generates with described outline drawing as corresponding It is superimposed with described control on AR image, and described AR image.
According to described control and described outline drawing picture, described outline drawing picture adds described control, generate Described outline drawing picture is superimposed with the AR image of described control, and shows the AR image of described generation, described AR image passes through control described in superposition on the basis of described outline drawing picture, by the institute of virtual control with reality Stating outline drawing picture to be overlapped presenting to user, such as, described outline drawing picture is the outline drawing picture of television set, The AR image of described generation is the position superposition virtual power supply of TV set power switch in described outline drawing picture Switch control, described virtual power supply switch control has the characteristic of TV set power switch.
Further, described control display position is the described control relative position in described outline drawing picture, When described outline drawing picture is moved, the movement that described control occurs according to described outline drawing picture moves Dynamic.
Step S300, detects when control operates, and controls according to the control information that operated control is corresponding Described home equipment.
Described in user operation during AR image, obtain user's operation information to described control, according to described behaviour Make the control information that the control operated by information acquisition is corresponding, control described household according to described control information Equipment, described operation information can be clicked on the control in described AR image by user and produce.
When being embodied as, as a example by mobile device, it is embodied as step and includes:
1, when user wants to be controlled parlor air-conditioning, user is shot by the photographic head in mobile device Described parlor air-conditioning, mobile device obtains the outline drawing picture of described parlor air-conditioning;
2, described mobile device according to control corresponding to parlor air-conditioning described in described profile Image Acquisition and with institute Stating the control information that control is corresponding, described control includes: on and off switch, mode selecting button, temperature are adjusted Joint button etc.;
3, mobile device is on the AR image that outline drawing picture based on described parlor air-conditioning is formed described in superposition Control.Such as, on and off switch control described in the position superposition of the on and off switch of described parlor air-conditioning, Mode selecting button control described in the position superposition of the mode selecting button of described parlor air-conditioning, described visitor Temperature adjustment buttons control described in the position superposition of the temperature adjustment buttons of Room air-conditioning, generates AR image and passes through Interactive interface shows, wherein, described on and off switch control corresponding power on-off control information, described pattern Select button control associative mode selects control information, and described temperature adjustment buttons control corresponding temperature regulates Control information;
4, when user clicks on the on and off switch control on described AR image, described mobile device receives user Clicking operation information, control information according on and off switch corresponding to described clicking operation acquisition of information, and Control information according to described on and off switch and open described parlor air-conditioning.
In the present embodiment, by home equipment profile Image Acquisition control and the control corresponding with described control Information processed, and the AR images for user generating control described in profile image overlay carries out operating and according to user Operation controls home equipment so that user is when using mobile device to be controlled home equipment, more Convenient and the clearest, add mobile device and control the convenience of home equipment.
Further, with reference to Fig. 2, control the second embodiment of the method for home equipment for the present invention, based on Embodiment shown in above-mentioned Fig. 1, above-mentioned steps S100 includes:
Step S101, the outline drawing picture of mobile device picked-up home equipment, and to the home equipment absorbed Outline drawing picture be identified, it is thus achieved that the flag information that described home equipment is corresponding.
After mobile device obtains the outline drawing picture of home equipment, by image recognition algorithm, described household is set Standby outline drawing picture is identified, it is thus achieved that the flag information of described home equipment, and described flag information is permissible Including: production firm, model.
Step S102, is sent to server by described flag information, for server by described flag information Search corresponding control and the control information corresponding with described control.
The flag information obtained by identification is sent to server by described mobile device, server pass through Described flag information searches the control corresponding with described flag information and the control corresponding with described control letter Breath, in an embodiment, institute is searched and obtained to described server by the type information in described flag information State control corresponding to type information and the control information corresponding with described control.
Further, described flag information is returned by mobile device with described server control and with described The control information that control is corresponding is saved in this locality, when the described mobile device described home equipment of acquisition is corresponding After flag information, first can make a look up in this locality, there is the control corresponding with described flag information if local And the control information corresponding with described control, then use the control of this locality and the control corresponding with described control Information.
Further, described flag information is returned by mobile device with described server control and with described Storage version identification information simultaneously when the control information that control is corresponding is saved in this locality.Described version identifier is believed Breath is such as timestamp, version number.After described mobile device obtains the flag information that described home equipment is corresponding, First can make a look up in this locality, obtain local corresponding control and the control information corresponding with described control Revision identification information.Obtain control and the control information corresponding with described control that server returns simultaneously, Control and the control information corresponding with described control is selected, if server returns according to described revision identification information Return control and the control information updating corresponding with described control, then update locally stored control and with institute State the control information that control is corresponding, update revision identification information simultaneously.
Step S103, receives the control that returns according to described flag information of server and corresponding with described control Control information.
Control corresponding for described flag information and the control information corresponding with described control are returned by described server Back to described mobile device, described mobile device receives described control and the control corresponding with described control letter Breath.
When being embodied as, use mobile phone to control as a example by electric fan by user, the present embodiment be embodied as step Suddenly include:
1, user uses mobile phone camera to shoot electric fan outline drawing picture;
2, the electric fan profile image information of described shooting is identified by described mobile phone, it is thus achieved that described electric wind Fan DF001, and described electric fan model DF001 is sent to server;
3, server receives the flag information of electric fan model DF001 that mobile phone sends, according to described mark Control that information searching is corresponding and the control information corresponding with described control, described control includes: wind speed is adjusted Joint switch control, it is that wind speed regulates control information that described wind speed regulates control information corresponding to switch control;
4, described control and the control information corresponding with described control are returned to mobile phone by server, and mobile phone connects After receiving described control and the control information corresponding with described control, institute on described electric fan outline drawing picture State wind speed regulation switch control described in the wind speed regulation position of the switch superposition of electric fan, generate AR image, and Display;
5, user clicks on the wind speed regulation switch control on described AR image, and mobile phone receives the click of user Operation information, according to the wind speed regulation control information that described clicking operation acquisition of information is corresponding, and according to institute State wind speed regulation control information and regulate the wind speed of described electric fan.
In the present embodiment, based on the advantage described in a upper embodiment, mobile device is by home equipment Outline drawing picture be identified, it is thus achieved that flag information, and obtain control corresponding to flag information by server Part and the control information corresponding with described control, make described mobile device can be obtained by server more The control of home equipment and the control information corresponding with described control, set such that it is able to control more household Standby, add practicality.
Further, with reference to Fig. 3, control the 3rd embodiment of the method for home equipment for the present invention, based on Embodiment shown in above-mentioned Fig. 1, above-mentioned steps S200 includes:
Step S201, according to described outline drawing picture and described control, generate in described mobile device this locality with The AR image that described outline drawing picture is corresponding;Or,
Described outline drawing picture is sent to server, and receives server according to described outline drawing picture and described The AR image corresponding with described outline drawing picture that control generates.
Generated at described outline drawing by local AR superposition algorithm according to described control and described outline drawing picture The AR image of described control it is superimposed with on picture, or by server according to described control and described outline drawing picture By AR superposition algorithm, described control is superimposed upon on described outline drawing picture the AR image generated.
When being embodied as, as a example by user uses mobile phone to control room reading lamp, an embodiment is embodied as Step includes:
1, user uses mobile phone camera to shoot reading lamp outline drawing picture;
2, the reading lamp profile image information of described shooting is identified by described mobile phone, it is thus achieved that described reading Lamp-type LIGHT0, and described reading lamp model LIGHT0 is sent to server;
3, server receives the flag information of reading lamp model LIGHT0 that mobile phone sends, according to described mark Control that will information searching is corresponding and the control information corresponding with described control, wherein, described control includes: On and off switch control and brightness regulation control, described control information includes: on and off switch controls information and bright Degree regulation control information, it is corresponding that described on and off switch control controls information with described on and off switch, described bright It is corresponding that degree regulation control controls information with described brightness regulation;
4, described control and the control information corresponding with described control are returned to mobile phone by server, and mobile phone connects After receiving described control and the control information corresponding with described control, by local AR superposition algorithm described On and off switch control described in the on and off switch position superposition of described reading lamp on reading lamp outline drawing picture, in institute State brightness regulation control described in the brightness regulating switch position superposition of reading lamp, generate AR image and return to hands Machine, mobile phone receives described AR image and shows;
5, user clicks on the on and off switch control on described AR image, and mobile phone receives the clicking operation of user Information, controls information according to the on and off switch that described clicking operation acquisition of information is corresponding, and according to described electricity Source switch controls information and opens or closes described reading lamp;Brightness regulation on AR image described in user operation Control, mobile phone receives the operation information of user, according to the brightness regulation control that described operation information acquisition is corresponding Information processed, and the brightness of the information described reading lamp of regulation is controlled according to described brightness regulation.
Another embodiment is embodied as step and includes:
1, user uses mobile phone camera to shoot reading lamp outline drawing picture;
2, the reading lamp profile image information of described shooting is identified by described mobile phone, it is thus achieved that described reading Lamp-type LIGHT0, and described reading lamp model LIGHT0 is sent to server;
3, server receives the flag information of reading lamp model LIGHT0 that mobile phone sends, according to described mark Control that will information searching is corresponding and the control information corresponding with described control, and existed by AR superposition algorithm On and off switch control described in the on and off switch position superposition of described reading lamp on described reading lamp outline drawing picture, At brightness regulation control described in the brightness regulating switch position superposition of described reading lamp, generate AR image, raw Becoming AR image, wherein, described control includes: on and off switch control and brightness regulation control, described control Information includes: on and off switch controls information and brightness regulation controls information, described on and off switch control and institute Stating on and off switch and control information correspondence, it is corresponding that described brightness regulation control controls information with described brightness regulation;
4, the AR image of described generation is returned to mobile phone by server, and mobile phone receives described AR image And show;
5, user clicks on the on and off switch control on described AR image, and mobile phone receives the clicking operation of user Information, controls information according to the on and off switch that described clicking operation acquisition of information is corresponding, and according to described electricity Source switch controls information and opens or closes described reading lamp;Brightness regulation on AR image described in user operation Control, mobile phone receives the operation information of user, according to the brightness regulation control that described operation information acquisition is corresponding Information processed, and the brightness of the information described reading lamp of regulation is controlled according to described brightness regulation.
In the present embodiment, based on the advantage described in a upper embodiment, the local or service by mobile device Device is overlapped control according to described control and the control information corresponding with described control and described outline drawing picture Generate AR image, make AR image have multiple generating mode, meet different demand, improve the suitability.
Further, with reference to Fig. 4, control the 4th embodiment of the method for home equipment for the present invention, based on Embodiment shown in above-mentioned Fig. 1, above-mentioned steps S300 includes:
Step S301, when receiving control operation, coupling obtains the control letter corresponding with operated control Breath.
Receiving user's control based on input on described AR image operation, described input includes: clicks on, slide Dynamic, the control operation coupling inputted by AR image according to described user the control information obtaining correspondence.
Step S302, generates control instruction according to described control information, directly to control described home equipment; Or, described control information is sent to server, so that described control information is sent to institute by server State home equipment.
It is transmitted directly to described household according to described control information generation control instruction by described mobile device set Standby to control described home equipment, or described control information is sent to server, server is according to described The control instruction of control information transmission correspondence, to described home equipment, controls described home equipment.
Further, described control information can include the combination to the operation of described home equipment multiple function.
In one embodiment, described control is referred to by described mobile device by the infrared signal discharger carried Order is sent to home equipment, to control described home equipment.
When being embodied as, as a example by user uses mobile phone to controlling television set, an embodiment is embodied as step Suddenly include:
1, user uses mobile phone camera televising machine outline drawing picture;
2, the television set profile image information of described shooting is identified by described mobile phone, it is thus achieved that described TV Type TV_00, and described television set model TV_00 is sent to server;
3, server receives the flag information of television set model TV_00 that mobile phone sends, according to described mark Control that information searching is corresponding and the control information corresponding with described control, wherein, described control includes: On and off switch control, channel adjustment control and volume adjusting control, described control information includes: power supply is opened Related control information, channel adjustment control information and volume adjusting and control information, described on and off switch control with It is corresponding that described on and off switch controls information, and described channel adjustment control controls information pair with described channel adjustment Should, it is corresponding that described volume adjusting control controls information with described volume adjusting;
4, described control and the control information corresponding with described control are returned to mobile phone by server, and mobile phone connects After receiving described control and the control information corresponding with described control, by local AR superposition algorithm described On television set outline drawing picture, control described in superposition generates AR image, and shows;
5, user clicks on the on and off switch control on described AR image, and mobile phone receives the clicking operation of user Information, is generated according to described operation information and opens television command, and the infrared letter carried by described mobile phone Described television command of turning on is sent to described television set by number discharger, controls described television set and opens.
Another embodiment is embodied as step and includes:
1, user uses mobile phone camera televising machine outline drawing picture;
2, the television set profile image information of described shooting is identified by described mobile phone, it is thus achieved that described TV Type TV_00, and described television set model TV_00 is sent to server;
3, server receives the flag information of television set model TV_00 that mobile phone sends, according to described mark Control that information searching is corresponding and the control information corresponding with described control, wherein, described control includes: On and off switch control, channel adjustment control and volume adjusting control, described control information includes: power supply is opened Related control information, channel adjustment control information and volume adjusting and control information, described on and off switch control with It is corresponding that described on and off switch controls information, and described channel adjustment control controls information pair with described channel adjustment Should, it is corresponding that described volume adjusting control controls information with described volume adjusting;
4, described control and the control information corresponding with described control are returned to mobile phone by server, and mobile phone connects After receiving described control and the control information corresponding with described control, by local AR superposition algorithm described On television set outline drawing picture, control described in superposition generates AR image, and shows;
5, user clicks on the on and off switch control on described AR image, and mobile phone receives the clicking operation of user The corresponding on and off switch that on and off switch control produces controls information, described on and off switch control information is sent out Give server,
6, described server controls information according to described on and off switch and generates and open television command, and by with Described television command of turning on is sent to described television set by the consolidated network at described television set place, controls institute State television set to open.
In the present embodiment, based on the advantage described in a upper embodiment, obtain user's operation information, according to The operational order that described operation information acquisition is corresponding, described operational order is transmitted directly to home equipment with Control described home equipment, make user conveniently home equipment can be controlled by mobile device System, is sent to server by described operation information, server generate operation according to described operation information and refer to Order is sent to home equipment to control described home equipment so that user remote control home can occupy equipment, The control making home equipment is more convenient.
With reference to Fig. 5, for the first embodiment of mobile device of the present invention, described mobile device includes:
Data obtaining module 100, for absorbing the outline drawing picture of home equipment, and according to outside home equipment The control of home equipment described in shape Image Acquisition and the control information corresponding with described control.
Mobile device obtains the outline drawing picture of home equipment, described outline drawing picture include can indicate described The information of home equipment, described mobile device is according to home equipment described in described profile image information acquisition Control and the control information corresponding with described control, described control can be on corresponding described home equipment panel Operational controls, it is also possible to according to described home equipment characteristic generate operational controls, with described household As a example by equipment is intelligent electric lamp, described control can be color saucer, the face of diverse location on described color saucer The corresponding different color control information of color.
Interface generation module 200, for according to described outline drawing picture and described control, generates and described profile It is superimposed with described control on the AR image that image is corresponding, and described AR image.
According to described control and described outline drawing picture, described outline drawing picture adds described control, generate Described outline drawing picture is superimposed with the AR image of described control, and shows the AR image of described generation.
Further, described control display position is the described control relative position in described outline drawing picture, When described outline drawing picture is moved, the movement that described control occurs according to described outline drawing picture moves Dynamic.
Control module 300, is used for detecting when control operates, according to the control letter that operated control is corresponding Breath controls described home equipment.
Described in user operation during AR image, obtain user's operation information to described control, according to described behaviour Make the control information that the control operated by information acquisition is corresponding, control described household according to described control information Equipment, described operation information can be clicked on the control in described AR image by user and produce.
When being embodied as, the step that is embodied as that user uses mobile device to control parlor air-conditioning includes:
1, when user wants to be controlled parlor air-conditioning, user is shot by the photographic head in mobile device Described parlor air-conditioning, mobile device obtains the outline drawing picture of described parlor air-conditioning;
2, described mobile device according to control corresponding to parlor air-conditioning described in described profile Image Acquisition and with institute Stating the control information that control is corresponding, described control includes: on and off switch, mode selecting button, temperature are adjusted Joint button etc.;
3, mobile device is on the AR image that outline drawing picture based on described parlor air-conditioning is formed described in superposition Control.Such as, on and off switch control described in the position superposition of the on and off switch of described parlor air-conditioning, Mode selecting button control described in the position superposition of the mode selecting button of described parlor air-conditioning, described visitor Temperature adjustment buttons control described in the position superposition of the temperature adjustment buttons of Room air-conditioning, generates AR image and passes through Interactive interface shows, wherein, described on and off switch control corresponding power on-off control information, described pattern Select button control associative mode selects control information, and described temperature adjustment buttons control corresponding temperature regulates Control information;
4, when user clicks on the on and off switch control on described AR image, described mobile device receives user Clicking operation information, control information according on and off switch corresponding to described clicking operation acquisition of information, and Control information according to described on and off switch and open described parlor air-conditioning.
In the present embodiment, by home equipment profile Image Acquisition control and the control corresponding with described control Information processed, and the AR images for user generating control described in profile image overlay carries out operating and according to user Operation controls home equipment so that user is when using mobile device to be controlled home equipment, more Convenient and the clearest, add mobile device and control the convenience of home equipment.
Further, with reference to Fig. 6, for the second embodiment of mobile device of the present invention, based on above-mentioned Fig. 5 institute The embodiment shown, described mobile device also includes carrying out the communication module 400 of communication, described letter with server Breath acquisition module 100 for absorbing the outline drawing picture of home equipment, and to the home equipment absorbed outside Shape image is identified, it is thus achieved that the flag information that described home equipment is corresponding.
After data obtaining module 100 obtains the outline drawing picture of home equipment, by image recognition algorithm to institute The outline drawing picture stating home equipment is identified, it is thus achieved that the flag information of described home equipment, described mark Information may include that production firm, model.
Described communication module 400 is additionally operable to described flag information is sent to server, passes through for server Described flag information searches corresponding control and the control information corresponding with described control.
The flag information obtained by identification is sent to server, by server by described communication module 400 The control corresponding with described flag information and the control corresponding with described control is searched by described flag information Information, in an embodiment, described server is searched by the type information in described flag information and is obtained Control that described type information is corresponding and the control information corresponding with described control.
Further, described flag information and described server are returned by communication module 400 control and with The control information that described control is corresponding is saved in this locality, when described mobile device obtains described home equipment pair After the flag information answered, can first make a look up in this locality, if local existence is corresponding with described flag information Control and the control information corresponding with described control, then use the control and corresponding with described control of this locality Control information.
Further, described flag information and described server are returned by communication module 400 control and with Storage version identification information simultaneously when the control information that described control is corresponding is saved in this locality.Described version mark Knowledge information such as timestamp, version number.When described mobile device obtains the mark letter that described home equipment is corresponding After breath, first can make a look up in this locality, obtain local corresponding control and the control corresponding with described control The revision identification information of information.Obtain control and the control corresponding with described control that server returns simultaneously Information, selects control and the control information corresponding with described control according to described revision identification information, if clothes The control of business device return and the control information updating corresponding with described control, then update locally stored control And the control information corresponding with described control, update revision identification information simultaneously.
Described communication module 400 be additionally operable to receive the control that returns according to described flag information of server and with The control information that described control is corresponding.
Control corresponding for described flag information and the control information corresponding with described control are returned by described server Back to described mobile device, described mobile device receives described control and the control corresponding with described control letter Breath.
When being embodied as, described mobile device is mobile phone, as a example by user uses mobile phone to control electric fan, The step that is embodied as of the present embodiment includes:
1, user uses mobile phone camera to shoot electric fan outline drawing picture;
2, the electric fan profile image information of described shooting is identified by described mobile phone, it is thus achieved that described electric wind Fan DF001, and described electric fan model DF001 is sent to server;
3, server receives the flag information of electric fan model DF001 that mobile phone sends, according to described mark Control that information searching is corresponding and the control information corresponding with described control, described control includes: wind speed is adjusted Joint switch control, it is that wind speed regulates control information that described wind speed regulates control information corresponding to switch control;
4, described control and the control information corresponding with described control are returned to mobile phone by server, and mobile phone connects After receiving described control and the control information corresponding with described control, institute on described electric fan outline drawing picture State wind speed regulation switch control described in the wind speed regulation position of the switch superposition of electric fan, generate AR image, and Display;
5, user clicks on the wind speed regulation switch control on described AR image, and mobile phone receives the click of user Operation information, according to the wind speed regulation control information that described clicking operation acquisition of information is corresponding, and according to institute State wind speed regulation control information and regulate the wind speed of described electric fan.
In the present embodiment, based on the advantage described in a upper embodiment, mobile device is by home equipment Outline drawing picture be identified, it is thus achieved that flag information, and obtain control corresponding to flag information by server Part and the control information corresponding with described control, make described mobile device can be obtained by server more The control of home equipment and the control information corresponding with described control, set such that it is able to control more household Standby, add practicality.
Further, for the 3rd embodiment of mobile device of the present invention, based on the enforcement shown in above-mentioned Fig. 5 Example, described interface generation module 200 is for according to described outline drawing picture and described graphical control, described Mobile device this locality generates the AR image corresponding with described outline drawing picture.
Described interface generation module 200 is according to described control and the control information corresponding with described control and institute State outline drawing picture, generate the AR image of described profile image overlay AR in described mobile device this locality or connect Receive server according to described control and the controls information corresponding with described control and described outline drawing as generation The AR image of described profile image overlay AR.
Described interface generation module 200 passes through according to described control and the control information corresponding with described control Local AR superposition algorithm generates the AR image of described profile image overlay AR.
When being embodied as, described mobile device is mobile phone, uses mobile phone to control room reading lamp with user and is Example, is embodied as step and includes:
1, user uses mobile phone camera to shoot reading lamp outline drawing picture;
2, the reading lamp profile image information of described shooting is identified by described mobile phone, it is thus achieved that described reading Lamp-type LIGHT0, and described reading lamp model LIGHT0 is sent to server;
3, server receives the flag information of reading lamp model LIGHT0 that mobile phone sends, according to described mark Control that will information searching is corresponding and the control information corresponding with described control, wherein, described control includes: On and off switch control and brightness regulation control, described control information includes: on and off switch controls information and bright Degree regulation control information, it is corresponding that described on and off switch control controls information with described on and off switch, described bright It is corresponding that degree regulation control controls information with described brightness regulation;
4, described control and the control information corresponding with described control are returned to mobile phone by server, and mobile phone connects After receiving described control and the control information corresponding with described control, by local AR superposition algorithm described On and off switch control described in the on and off switch position superposition of described reading lamp on reading lamp outline drawing picture, in institute State brightness regulation control described in the brightness regulating switch position superposition of reading lamp, generate AR image, and show;
5, user clicks on the switch AR on and off switch control on described AR image, and mobile phone receives user's Clicking operation information, controls information, and root according to the on and off switch that described clicking operation acquisition of information is corresponding Control information according to described on and off switch and open or close described reading lamp;On AR image described in user operation Brightness regulation control, mobile phone receives the operation information of user, according to corresponding bright of described operation information acquisition Degree regulation control information, and the brightness of the information described reading lamp of regulation is controlled according to described brightness regulation..
In the present embodiment, based on the advantage described in a upper embodiment, local according to institute by mobile device State control and the control information corresponding with described control and described outline drawing picture is overlapped AR and generates AR figure Picture, makes AR image quickly generate in mobile device this locality, improves formation efficiency.
Further, with reference to Fig. 7, for the 4th embodiment of mobile device of the present invention, based on above-mentioned Fig. 5 institute The embodiment shown, described control module 300 includes:
Control information acquisition unit 301, during for receiving control operation based on the input of described AR image, Coupling obtains the control information corresponding with operated control.
The control operation coupling inputted by AR image according to described user the control information obtaining correspondence.
Home equipment control unit 302, for generating control instruction according to described control information, with directly control Make described home equipment.
It is transmitted directly to described household according to described control information generation control instruction by described mobile device set Standby to control described home equipment.
Further, described control information can include the combination to the operation of described home equipment multiple function. In one embodiment, described control instruction is sent out by described mobile device by the infrared signal discharger carried Give home equipment, to control described home equipment.
When being embodied as, described mobile device is mobile phone, as a example by user uses mobile phone to controlling television set, It is embodied as step to include:
1, user uses mobile phone camera televising machine outline drawing picture;
2, the television set profile image information of described shooting is identified by described mobile phone, it is thus achieved that described TV Type TV_00, and described television set model TV_00 is sent to server;
3, server receives the flag information of television set model TV_00 that mobile phone sends, according to described mark Control that information searching is corresponding and the control information corresponding with described control, wherein, described control includes: On and off switch control, channel adjustment control and volume adjusting control, described control information includes: power supply is opened Related control information, channel adjustment control information and volume adjusting and control information, described on and off switch control with It is corresponding that described on and off switch controls information, and described channel adjustment control controls information pair with described channel adjustment Should, it is corresponding that described volume adjusting control controls information with described volume adjusting;
4, described control and the control information corresponding with described control are returned to mobile phone by server, and mobile phone connects After receiving described control and the control information corresponding with described control, by local AR superposition algorithm described On television set outline drawing picture, control described in superposition generates AR image, and shows;
5, user clicks on the on and off switch control on described AR image, and mobile phone receives the clicking operation of user Information, is generated according to described operation information and opens television command, and the infrared letter carried by described mobile phone Described television command of turning on is sent to described television set by number discharger, controls described television set and opens.
In the present embodiment, based on the advantage described in a upper embodiment, obtain user's operation information, according to The operational order that described operation information acquisition is corresponding, described operational order is transmitted directly to home equipment with Control described home equipment, make user conveniently home equipment can be controlled by mobile device System.
With reference to Fig. 8, for the first embodiment of intelligent domestic system of the present invention, described intelligent domestic system includes: Server 10, home equipment 20 and mobile device 30 as above.
Wherein, described mobile device 30 absorbs the outline drawing picture of home equipment, and generates and described outline drawing As corresponding AR image, and on described AR image, it is superimposed with the control corresponding with described home equipment 20, And when receiving control operation based on the input of described AR image, by control corresponding for operated control Information sends to server 10, so that server 10 controls described home equipment according to described control information 20。
Mobile device 30 obtains the outline drawing picture of home equipment 20, and described outline drawing picture includes can be marked Showing the information of described home equipment 20, described mobile device 30 is according to described profile image information acquisition institute Stating the control of home equipment 20 and the control information corresponding with described control, described control can be corresponding described Operational controls on home equipment 20 panel, it is also possible to according to described home equipment 20 characteristic generate Operational controls, as a example by described home equipment 20 is as intelligent electric lamp, described control can be color saucer, institute State the corresponding different color control information of color of diverse location on color saucer;
According to described control and described outline drawing picture, described outline drawing picture adds described control, generate Described outline drawing picture is superimposed with the AR image of described control, and shows the AR image of described generation, and one is real Executing in example, described control display position is the described control relative position in described outline drawing picture, works as institute Stating outline drawing picture when being moved, the movement that described control occurs according to described outline drawing picture moves;
Described in user operation during AR image, obtain user's operation information to described control, according to described behaviour Make the control information that the control operated by information acquisition is corresponding, described control information be sent to server 10, Server 10 sends corresponding control instruction to described home equipment 20, control institute according to described control information State home equipment 20.
When being embodied as, described mobile device 30 is mobile phone, and user controls the concrete of television set by mobile phone Implement step to include:
1, user uses mobile phone camera televising machine outline drawing picture;
2, the television set profile image information of described shooting is identified by described mobile phone, it is thus achieved that described TV Type TV_00, and described television set model TV_00 is sent to server;
3, server receives the flag information of television set model TV_00 that mobile phone sends, according to described mark Control that information searching is corresponding and the control information corresponding with described control, wherein, described control includes: On and off switch control, channel adjustment control and volume adjusting control, described control information includes: power supply is opened Related control information, channel adjustment control information and volume adjusting and control information, described on and off switch control with It is corresponding that described on and off switch controls information, and described channel adjustment control controls information pair with described channel adjustment Should, it is corresponding that described volume adjusting control controls information with described volume adjusting;
4, described control and the control information corresponding with described control are returned to mobile phone by server, and mobile phone connects After receiving described control and the control information corresponding with described control, by local AR superposition algorithm described On television set outline drawing picture, control described in superposition generates AR image, and shows;
5, user clicks on the on and off switch control on described AR image, and mobile phone receives the clicking operation of user The corresponding on and off switch that on and off switch control produces controls information, described on and off switch control information is sent out Give server,
6, described server controls information according to described on and off switch and generates and open television command, and by with Described television command of turning on is sent to described television set by the consolidated network at described television set place, controls institute State television set to open.
In the present embodiment, by home equipment 20 profile Image Acquisition control and corresponding with described control Control information, and the AR images for user generating control described in profile image overlay carries out operating and according to Family operation controls home equipment 20 so that home equipment 20 is controlled by user in use mobile device 30 Time processed, server 10 generate operational order according to described operation information and be sent to home equipment 20 with control Make described home equipment 20 so that user remote control home can occupy equipment 20, makes home equipment 20 Control more convenient.
Further, intelligent domestic system the second embodiment of the present invention, based on the enforcement shown in above-mentioned Fig. 8 Example, described server 10 is additionally operable to receive the outline drawing picture that mobile device sends, enters described outline drawing picture Row identifies, it is thus achieved that the control corresponding with this outline drawing picture, and according to described outline drawing picture and described control, Generate the AR image corresponding with described outline drawing picture, and be superimposed with described control on described AR image, return Return described AR image to mobile device.
Mobile device 30 obtains the outline drawing picture of home equipment 20, and described outline drawing picture includes can be marked Show that the information of described home equipment, described mobile device 30 pass through image recognition algorithm to described home equipment The outline drawing picture of 20 is identified, it is thus achieved that the flag information of described home equipment 20, according to described mark letter Breath is searched and is obtained the control of coupling and the control information corresponding with described control, and server 10 is according to described control Described control is superimposed upon on described outline drawing picture by part and described outline drawing picture by AR superposition algorithm, generates AR image, described AR image is returned to described mobile device 30.
When being embodied as, as a example by user uses mobile phone to control room reading lamp, it is embodied as step and includes:
1, user uses mobile phone camera to shoot reading lamp outline drawing picture;
2, the reading lamp profile image information of described shooting is identified by described mobile phone, it is thus achieved that described reading Lamp-type LIGHT0, and described reading lamp model LIGHT0 is sent to server 10;
3, server 10 receives the flag information of reading lamp model LIGHT0 that mobile phone sends, according to institute State flag information and search corresponding control and the control information corresponding with described control, wherein, described control Including: on and off switch control and brightness regulation control, described control information includes: on and off switch controls letter Breath and brightness regulation control information, and it is corresponding that described on and off switch control controls information with described on and off switch, It is corresponding that described brightness regulation control controls information with described brightness regulation;
4, server 10 is by AR superposition algorithm electricity of described reading lamp on described reading lamp outline drawing picture On and off switch control described in the superposition of source switch position, in the brightness regulating switch position superposition of described reading lamp Described brightness regulation control, generates AR image and returns to mobile phone, and mobile phone receives described AR image and shows Show;
5, user clicks on the on and off switch control on described AR image, and mobile phone receives the clicking operation of user Information, controls information according to the on and off switch that described clicking operation acquisition of information is corresponding, and according to described electricity Source switch controls information and opens or closes described reading lamp;Brightness regulation on AR image described in user operation Control, mobile phone receives the operation information of user, according to the brightness regulation control that described operation information acquisition is corresponding Information processed, and the brightness of the information described reading lamp of regulation is controlled according to described brightness regulation.
In the present embodiment, based on the advantage described in a upper embodiment, by server 10 according to described control Part and the control information corresponding with described control and described outline drawing picture are overlapped AR and generate AR image, Make AR image generate and no longer take mobile device 30 resource, meet mobile device 30 local computing capability relatively Weak situation, improves the suitability.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every Utilize equivalent structure or equivalence flow process conversion that description of the invention and accompanying drawing content made, or directly or Connect and be used in other relevant technical fields, be the most in like manner included in the scope of patent protection of the present invention.

Claims (10)

1. the method controlling home equipment, it is characterised in that the method bag of described control home equipment Include following steps:
The outline drawing picture of mobile device picked-up home equipment, and according to the profile Image Acquisition institute of home equipment State the control of home equipment and the control information corresponding with described control;
According to described outline drawing picture and described control, generate the AR image corresponding with described outline drawing picture, And it is superimposed with described control on described AR image;
Detect when control operates, control described household according to the control information that operated control is corresponding and set Standby.
2. the method controlling home equipment as claimed in claim 1, it is characterised in that described movement sets The outline drawing picture of standby picked-up home equipment, and according to home equipment described in the profile Image Acquisition of home equipment Control and the step of the control information corresponding with described control include:
The outline drawing picture of mobile device picked-up home equipment, and the outline drawing picture to the home equipment absorbed It is identified, it is thus achieved that the flag information that described home equipment is corresponding;
Described flag information is sent to server, and it is the most right to be searched by described flag information for server The control answered and the control information corresponding with described control;
Receive control and the control corresponding with described control letter that server returns according to described flag information Breath.
3. the method controlling home equipment as claimed in claim 1, it is characterised in that described according to institute State outline drawing picture and described control, generate with described outline drawing as corresponding A R image, and described AR figure The step being superimposed with described control on picture includes:
According to described outline drawing picture and described control, generate and described outline drawing in described mobile device this locality As corresponding AR image;Or,
Described outline drawing picture is sent to server, and receives server according to described outline drawing picture and described The AR image corresponding with described outline drawing picture that control generates.
4. the as claimed in claim 1 method controlling home equipment, it is characterised in that described in receive During control operation based on input on described AR image, according to the control information that operated control is corresponding The step controlling described home equipment includes:
When receiving control operation, coupling obtains the control information corresponding with operated control;
Control instruction is generated, directly to control described home equipment according to described control information;Or, will Described control information is sent to server, so that described control information is controlled described home equipment by server.
5. a mobile device, it is characterised in that described mobile device includes:
Data obtaining module, for absorbing the outline drawing picture of home equipment, and according to the profile of home equipment The control of home equipment described in Image Acquisition and the control information corresponding with described control;
Interface generation module, for according to described outline drawing picture and described control, generates and described outline drawing As corresponding AR image, and it is superimposed with described control on described AR image;
Control module, is used for detecting when control operates, according to the control information that operated control is corresponding Control described home equipment.
6. mobile device as claimed in claim 5, it is characterised in that described mobile device also includes: With the communication module that server carries out communication;
Described data obtaining module is used for: the outline drawing picture of picked-up home equipment, and to the household absorbed The outline drawing picture of equipment is identified, it is thus achieved that the flag information that described home equipment is corresponding;
Described communication module is additionally operable to: described flag information is sent to server, passes through institute for server State flag information and search corresponding control and the control information corresponding with described control;Receive server The control returned according to described flag information and the control information corresponding with described control.
7. mobile device as claimed in claim 5, it is characterised in that described interface generation module is used for: According to described outline drawing picture and described graphical control, generate and described outline drawing in described mobile device this locality As corresponding AR image.
8. mobile device as claimed in claim 5, it is characterised in that described control module includes:
Control information acquisition unit, during for receiving control operation based on the input of described AR image, Coupling obtains the control information corresponding with operated control;
Home equipment control unit, for generating control instruction according to described control information, directly to control Described home equipment.
9. an intelligent domestic system, it is characterised in that described intelligent domestic system includes server, family Occupy the mobile device described in equipment and claim 5 or 6;Wherein, described mobile device picked-up household sets Standby outline drawing picture, and generate the AR image corresponding with described outline drawing picture, and on described AR image It is superimposed with the control corresponding with described home equipment, and receives control based on the input of described AR image During part operation, control information corresponding for operated control is sent to server so that server according to Described control information controls described home equipment.
10. intelligent domestic system as claimed in claim 9, it is characterised in that: described server is also used In: receive the outline drawing picture that mobile device sends, described outline drawing picture is identified, it is thus achieved that outer with this The control that shape image is corresponding, and according to described outline drawing picture and described control, generate and described outline drawing picture Corresponding AR image, and it is superimposed with described control on described AR image, return described AR image extremely Mobile device.
CN201610169659.9A 2016-03-22 2016-03-22 Method for controlling household devices, intelligent household system and mobile device Pending CN105843054A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610169659.9A CN105843054A (en) 2016-03-22 2016-03-22 Method for controlling household devices, intelligent household system and mobile device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610169659.9A CN105843054A (en) 2016-03-22 2016-03-22 Method for controlling household devices, intelligent household system and mobile device

Publications (1)

Publication Number Publication Date
CN105843054A true CN105843054A (en) 2016-08-10

Family

ID=56583190

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610169659.9A Pending CN105843054A (en) 2016-03-22 2016-03-22 Method for controlling household devices, intelligent household system and mobile device

Country Status (1)

Country Link
CN (1) CN105843054A (en)

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106302796A (en) * 2016-08-31 2017-01-04 广东格兰仕集团有限公司 A kind of intelligent electrical appliance control based on AR technology
CN106331806A (en) * 2016-08-23 2017-01-11 青岛海信电器股份有限公司 Realization method for virtual remote controller and devices
CN106354510A (en) * 2016-08-31 2017-01-25 广东格兰仕集团有限公司 Household appliance control method based on image recognition technology
CN106354316A (en) * 2016-08-31 2017-01-25 广东格兰仕集团有限公司 Operation panel based on AR technology and image recognition technology
CN106352404A (en) * 2016-08-31 2017-01-25 广东格兰仕集团有限公司 Air purifier based on AR technology and control method of air purifier
CN106406111A (en) * 2016-08-31 2017-02-15 广东格兰仕集团有限公司 Intelligent household electrical appliance operation method based on AR technology and image recognition technology
CN106412019A (en) * 2016-08-31 2017-02-15 广东格兰仕集团有限公司 Intelligent remote household appliance control method based on augmented reality technology
CN106485956A (en) * 2016-09-29 2017-03-08 珠海格力电器股份有限公司 A kind of method of demonstration electronic functionalities, device and intelligent terminal
CN106502118A (en) * 2016-12-21 2017-03-15 惠州Tcl移动通信有限公司 A kind of intelligent home furnishing control method and system based on AR photographic head
CN106569409A (en) * 2016-10-13 2017-04-19 杭州鸿雁电器有限公司 Graph capturing based household equipment control system, device and method
CN107703872A (en) * 2017-10-31 2018-02-16 美的智慧家居科技有限公司 Terminal control method, device and the terminal of home appliance
CN107861388A (en) * 2017-09-30 2018-03-30 珠海格力电器股份有限公司 A kind of exchange method, device, storage device and terminal
CN108319151A (en) * 2018-02-09 2018-07-24 广东美的制冷设备有限公司 Control method, device, system, mobile terminal and the storage medium of household appliance
CN108614456A (en) * 2018-05-25 2018-10-02 苏州市职业大学 A kind of household electrical appliances safety management system using AR augmented reality technologies
CN108663953A (en) * 2017-03-31 2018-10-16 三菱电机(中国)有限公司 Air quality regulation system, mobile terminal and server
CN108762213A (en) * 2018-06-04 2018-11-06 李宇轩 Control method, device and the intelligent glasses of smart home
CN108803371A (en) * 2018-08-13 2018-11-13 三星电子(中国)研发中心 A kind of control method and device of electrical equipment
CN109547619A (en) * 2018-11-28 2019-03-29 三星电子(中国)研发中心 The method, apparatus and system of equipment room connection are established in a kind of detection based on flexible screen
CN110321003A (en) * 2019-05-30 2019-10-11 苏宁智能终端有限公司 Smart home exchange method and device based on MR technology
CN110892202A (en) * 2017-07-21 2020-03-17 开利公司 Service system of air conditioning system
CN111045344A (en) * 2019-12-31 2020-04-21 维沃移动通信有限公司 Control method of household equipment and electronic equipment
WO2020088032A1 (en) * 2018-10-29 2020-05-07 珠海格力电器股份有限公司 Air conditioner defrosting method and apparatus and storage medium
CN111124216A (en) * 2018-10-30 2020-05-08 九阳股份有限公司 Method and device for setting control interface of household appliance
CN113970888A (en) * 2020-07-07 2022-01-25 华为技术有限公司 Household equipment control method, terminal equipment and computer readable storage medium
WO2022028537A1 (en) * 2020-08-05 2022-02-10 华为技术有限公司 Device recognition method and related apparatus
CN114079691A (en) * 2020-08-05 2022-02-22 华为技术有限公司 Equipment identification method and related device
CN114641177A (en) * 2020-12-15 2022-06-17 华为技术有限公司 Electronic device
CN114968451A (en) * 2022-04-18 2022-08-30 厦门智小金智能科技有限公司 Operation interface building method and system based on combination of household equipment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101621583A (en) * 2009-07-27 2010-01-06 深圳华为通信技术有限公司 Equipment remote-control method, remote controller and mobile communication terminals thereof
CN202339630U (en) * 2011-09-21 2012-07-18 歌尔声学股份有限公司 Electronic equipment
CN102930712A (en) * 2012-11-14 2013-02-13 Tcl通力电子(惠州)有限公司 Method and system for controlling infrared controlled equipment
CN203102554U (en) * 2012-11-28 2013-07-31 陆俊达 Universal remote controller based on smart phone
KR20130100881A (en) * 2012-03-04 2013-09-12 엘지전자 주식회사 A device, method and time-line user interface for controlling home devices
CN103531015A (en) * 2013-10-08 2014-01-22 海信集团有限公司 Method for realizing remote control function, and electronic device thereof
US20140375547A1 (en) * 2012-03-13 2014-12-25 Eyesight Mobile Technologies Ltd. Touch free user interface
CN104460330A (en) * 2014-11-04 2015-03-25 宁波工程学院 Augmented reality and remote control method based on indoor positioning and electronic compass
CN104977904A (en) * 2014-04-04 2015-10-14 浙江大学 Visible and controllable intelligent household control system and control method thereof
CN105204347A (en) * 2015-06-18 2015-12-30 丰唐物联技术(深圳)有限公司 Method, device and system for smart home interaction based on augmented reality technologies

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101621583A (en) * 2009-07-27 2010-01-06 深圳华为通信技术有限公司 Equipment remote-control method, remote controller and mobile communication terminals thereof
CN202339630U (en) * 2011-09-21 2012-07-18 歌尔声学股份有限公司 Electronic equipment
KR20130100881A (en) * 2012-03-04 2013-09-12 엘지전자 주식회사 A device, method and time-line user interface for controlling home devices
US20140375547A1 (en) * 2012-03-13 2014-12-25 Eyesight Mobile Technologies Ltd. Touch free user interface
CN102930712A (en) * 2012-11-14 2013-02-13 Tcl通力电子(惠州)有限公司 Method and system for controlling infrared controlled equipment
CN203102554U (en) * 2012-11-28 2013-07-31 陆俊达 Universal remote controller based on smart phone
CN103531015A (en) * 2013-10-08 2014-01-22 海信集团有限公司 Method for realizing remote control function, and electronic device thereof
CN104977904A (en) * 2014-04-04 2015-10-14 浙江大学 Visible and controllable intelligent household control system and control method thereof
CN104460330A (en) * 2014-11-04 2015-03-25 宁波工程学院 Augmented reality and remote control method based on indoor positioning and electronic compass
CN105204347A (en) * 2015-06-18 2015-12-30 丰唐物联技术(深圳)有限公司 Method, device and system for smart home interaction based on augmented reality technologies

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331806A (en) * 2016-08-23 2017-01-11 青岛海信电器股份有限公司 Realization method for virtual remote controller and devices
CN106331806B (en) * 2016-08-23 2019-11-19 青岛海信电器股份有限公司 A kind of implementation method and equipment of virtual remote controller
CN106302796A (en) * 2016-08-31 2017-01-04 广东格兰仕集团有限公司 A kind of intelligent electrical appliance control based on AR technology
CN106354510A (en) * 2016-08-31 2017-01-25 广东格兰仕集团有限公司 Household appliance control method based on image recognition technology
CN106354316A (en) * 2016-08-31 2017-01-25 广东格兰仕集团有限公司 Operation panel based on AR technology and image recognition technology
CN106352404A (en) * 2016-08-31 2017-01-25 广东格兰仕集团有限公司 Air purifier based on AR technology and control method of air purifier
CN106406111A (en) * 2016-08-31 2017-02-15 广东格兰仕集团有限公司 Intelligent household electrical appliance operation method based on AR technology and image recognition technology
CN106412019A (en) * 2016-08-31 2017-02-15 广东格兰仕集团有限公司 Intelligent remote household appliance control method based on augmented reality technology
CN106485956A (en) * 2016-09-29 2017-03-08 珠海格力电器股份有限公司 A kind of method of demonstration electronic functionalities, device and intelligent terminal
CN106569409A (en) * 2016-10-13 2017-04-19 杭州鸿雁电器有限公司 Graph capturing based household equipment control system, device and method
CN106502118A (en) * 2016-12-21 2017-03-15 惠州Tcl移动通信有限公司 A kind of intelligent home furnishing control method and system based on AR photographic head
CN108663953A (en) * 2017-03-31 2018-10-16 三菱电机(中国)有限公司 Air quality regulation system, mobile terminal and server
CN110892202A (en) * 2017-07-21 2020-03-17 开利公司 Service system of air conditioning system
CN107861388A (en) * 2017-09-30 2018-03-30 珠海格力电器股份有限公司 A kind of exchange method, device, storage device and terminal
WO2019062210A1 (en) * 2017-09-30 2019-04-04 格力电器(武汉)有限公司 Interaction method and device, storage device and terminal
CN107703872A (en) * 2017-10-31 2018-02-16 美的智慧家居科技有限公司 Terminal control method, device and the terminal of home appliance
CN108319151A (en) * 2018-02-09 2018-07-24 广东美的制冷设备有限公司 Control method, device, system, mobile terminal and the storage medium of household appliance
CN108614456A (en) * 2018-05-25 2018-10-02 苏州市职业大学 A kind of household electrical appliances safety management system using AR augmented reality technologies
CN108762213A (en) * 2018-06-04 2018-11-06 李宇轩 Control method, device and the intelligent glasses of smart home
CN108803371A (en) * 2018-08-13 2018-11-13 三星电子(中国)研发中心 A kind of control method and device of electrical equipment
CN108803371B (en) * 2018-08-13 2021-09-03 三星电子(中国)研发中心 Control method and device for electrical equipment
WO2020088032A1 (en) * 2018-10-29 2020-05-07 珠海格力电器股份有限公司 Air conditioner defrosting method and apparatus and storage medium
CN111124216B (en) * 2018-10-30 2023-11-10 九阳股份有限公司 Control interface setting method and device for household electrical appliance
CN111124216A (en) * 2018-10-30 2020-05-08 九阳股份有限公司 Method and device for setting control interface of household appliance
CN109547619A (en) * 2018-11-28 2019-03-29 三星电子(中国)研发中心 The method, apparatus and system of equipment room connection are established in a kind of detection based on flexible screen
CN110321003A (en) * 2019-05-30 2019-10-11 苏宁智能终端有限公司 Smart home exchange method and device based on MR technology
CN111045344A (en) * 2019-12-31 2020-04-21 维沃移动通信有限公司 Control method of household equipment and electronic equipment
CN113970888A (en) * 2020-07-07 2022-01-25 华为技术有限公司 Household equipment control method, terminal equipment and computer readable storage medium
CN114079691A (en) * 2020-08-05 2022-02-22 华为技术有限公司 Equipment identification method and related device
CN114079691B (en) * 2020-08-05 2022-11-04 华为技术有限公司 Equipment identification method and related device
WO2022028537A1 (en) * 2020-08-05 2022-02-10 华为技术有限公司 Device recognition method and related apparatus
CN114641177A (en) * 2020-12-15 2022-06-17 华为技术有限公司 Electronic device
CN114968451A (en) * 2022-04-18 2022-08-30 厦门智小金智能科技有限公司 Operation interface building method and system based on combination of household equipment

Similar Documents

Publication Publication Date Title
CN105843054A (en) Method for controlling household devices, intelligent household system and mobile device
CN109991859A (en) A kind of gesture instruction control method and intelligent home control system
CN104977904B (en) A kind of visible i.e. controllable intelligent home control system and control method
CN106647310B (en) Method and system for starting linkage between household appliances
CN107703872B (en) Terminal control method and device of household appliance and terminal
WO2016065813A1 (en) Method and apparatus for customising smart device scenario mode
WO2017215308A1 (en) Method, device and system for controlling electrical appliance
CN106873551A (en) Interlock method and system between a kind of different household electrical appliances
WO2016065812A1 (en) Scenario mode setting-based smart device control method and apparatus
CN104077095B (en) Message processing device
CN103616876A (en) Intelligent home centralized control device and intelligent home contextual model establishing method
CN108803529A (en) A kind of device and method switching room environment pattern based on mobile terminal
CN109088803A (en) A kind of AR remote control device, intelligent domestic remote control system and method
CN104597759A (en) Network video based household control method and system and intelligent household management system
CN101621583A (en) Equipment remote-control method, remote controller and mobile communication terminals thereof
CN104880956A (en) Information processing method and first intelligent household device
CN105867145A (en) Intelligent household equipment control method and apparatus
CN106597860A (en) Household electrical appliance control system, and control device, construction method and control method thereof
CN105739315A (en) Indoor user electric appliance equipment control method and device
CN111459388B (en) Information screen display method, display equipment and storage medium for smart home information
CN107204904A (en) The control method of smart home, Centralized Controller, intelligent domestic system
CN110032096A (en) Home intelligence scenery control system and its control method based on recognition of face
CN108803371B (en) Control method and device for electrical equipment
CN106569409A (en) Graph capturing based household equipment control system, device and method
CN103900207B (en) A kind of instruction executing method and air-conditioning

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160810