Summary of the invention
Based on this, be necessary for problems of the prior art, provide a kind of appliance control method of video Network Based and system and intelligent household management system, it can carry out remote monitoring display of Smart Home in dynamic monitoring picture.
An appliance control method for video Network Based, it comprises:
Obtain video monitoring data, generate dynamic image;
Identify at least one configuration band of position residing for object in described dynamic image;
Obtain the current operating state of at least one configuration object described;
Definition with described at least one configure at least one object displaying control that object one_to_one corresponding arranges, the image attributes of each object displaying control is configured to the described current operating state of the configuration object corresponding with this object displaying control;
Show described dynamic image, and superpose the object displaying control that arrange corresponding to this configuration object in the band of position of each configuration object or the surrounding neighbors of this band of position.
Wherein in an embodiment, described method also comprises:
Definition interfaces displaying control, is configured to the status attribute of described showing interface control open or close;
White spatially showing interface control described in Overlapping display is stayed in described dynamic image or user interface.
Wherein in an embodiment, described method also comprises:
Obtain the focal coordinates at focus place when user touches user interface;
Search the control that described focal position is pointed to;
When described focal coordinates point to object displaying control described in, generate the second amendment order, according to described second amendment order, send the instruction regulating current operating state to the configuration object that this object displaying control is corresponding.
Wherein in an embodiment, described method also comprises: when described focal coordinates point to described showing interface control, generate the first amendment order, according to described first amendment order, revise the status attribute of described showing interface control, and the visual attribute revising described object displaying control is visible or invisible.
Wherein in an embodiment, described method also comprises: for demarcating the step of configuration object, this step comprises:
Obtain first focal coordinates at focus place when user touches user interface;
Identify the first image block comprising described first focal coordinates, generate the image features corresponding with this first image block;
Ejection prompting frame requirement user inputs the object information that this first image block refers to;
Obtain the object information that described first image block refers to, the image features that this object information is corresponding with described first image block carries out association store, generates the information list recording configuration object;
The step of the band of position in the described dynamic image of described identification residing at least one configuration object is performed according to described information list.
Wherein in an embodiment, described method also comprises:
Obtain the focal coordinates at focus place when user touches user interface;
Judge whether there is pointed control near described focal coordinates or this focal coordinates; If not, then following steps are performed:
Identify the second image block comprising described focal coordinates, generate second image features corresponding with this second image block;
Ejection prompting frame requirement user inputs the object information that this second image block refers to;
Obtain the object information that described second image block refers to, the image features that the object information referred to by described second image block is corresponding with described second image block carries out association store, and to add in described information list configuration object as a supplement to.
Wherein in an embodiment, described method also comprises: according to described supplementary configuration object, triggers the step of the current operating state performing at least one configuration object described in described acquisition.
Wherein in an embodiment, described object displaying control is a status adjustment control in order to provide user to select the functional parameter of the described configuration object of a selection.
A house control system for video Network Based, it comprises:
First receiving element, for obtaining video monitoring data, generates dynamic image;
Recognition unit, for identifying the band of position in described dynamic image residing at least one configuration object;
Second receiving element, for obtaining the current operating state of at least one configuration object described;
Displaying control generation unit, for define with described at least one configure at least one object displaying control that object one_to_one corresponding arranges, the image attributes of each object displaying control is configured to the described current operating state of the configuration object corresponding with this object displaying control;
Overlapping display unit, for showing described dynamic image, and superposes the object displaying control that arrange corresponding to this configuration object in the band of position of each configuration object or the surrounding neighbors of this band of position.
A kind of intelligent household management system, it comprises: at least one has the configuration object of wireless signal transmitting-receiving and the house control system of above-mentioned video Network Based; Or comprise the house control system of at least one configuration object, the control control device far away be connected with described configuration object and above-mentioned video Network Based.
Utilize technique scheme provided by the invention, the real-time monitoring and control of dynamic menu can be provided under convention video monitoring, by wire/radio network transmission picture data to terminal, provide application foundation alternately for user completes function according to preset function menu.In technique effect further, the invention provides the pilot signal interactive function based on real-time monitored picture, it is more easily for user provides the situation of real time environment, facilitates user to realize real time inspection and control operation more accurately.Present invention achieves and realized the virtual real-time control to realistic space by dynamic menu direct interaction.
Embodiment
Based on Intelligent housing technology, the present invention proposes a kind of method utilizing video monitoring data to carry out real time remote control, specifically explain each embodiment of the present invention in detail by reference to the accompanying drawings.
As shown in Fig. 1 (a), in one embodiment of the invention, the appliance control method of its video Network Based, it runs on a mobile terminal device (as smart mobile phone or host computer), be similar to APP mono-application service, it can be connected with intelligent household management system, this intelligent household management system comprises: various electric equipments (the such as air-conditioning that can access intelligent household management system, refrigerator, warm-air drier, the intelligent window frame of automatic hinge-opening, TV, electric light etc.), and far control control device, remote control is regulated by the duty of remote control signal to above-mentioned various electric equipment received from remote control terminal.In addition, above-mentioned intelligent household management system also comprises at least one camera, the output of this camera is connected in order to the video monitoring data obtained in real time is transferred to remote control terminal with described remote control, and remote control terminal here comprises: smart mobile phone, host computer etc.Certainly, in another embodiment of the present invention, as shown in Fig. 1 (b), this intelligent household management system comprises: various electric equipments (such as the intelligent window frame, TV, electric light etc. of air-conditioning, refrigerator, warm-air drier, automatically hinge-opening) and/or at least one camera that can access intelligent household management system, various electric equipment and camera have can carry out communication, transmission of information respectively by gateway and remote control terminal separately by the wireless signal transceiver of wireless network communication.Here gateway can be zigBee gateway device.
As shown in Figure 2, above-mentioned appliance control method comprises the following steps:
In step 100, obtain video monitoring data, generate dynamic image; Such as, exported by the video monitoring calling intelligent household management system and obtain video monitoring data, or obtain by connecting family's monitoring camera the video monitoring data transmitted in real time.
In step 200, at least one configuration band of position residing for object in above-mentioned dynamic image is identified.Here mentioned configuration object refers to the electric equipment that can access intelligent household management system, such as the intelligent window frame, TV, electric light etc. of air-conditioning, refrigerator, warm-air drier, automatically hinge-opening.
In order to improve data processing speed, be convenient to Overlapping display control on the dynamic image of real-time Transmission, then in a preferred embodiment of the invention, only the configuration object that user demarcates in advance is identified in the first implementation of step 200, as shown in Figure 3, before step 200, also comprise the process for demarcating configuration object, this process comprises the following steps:
Step 201, obtains first focal coordinates at focus place when user touches user interface;
Step 202, identifies the first image block comprising above-mentioned first focal coordinates, generates the image features corresponding with this first image block;
Step 203, ejection prompting frame requirement user inputs the object information that this first image block refers to;
Step 204, obtains the object information that above-mentioned first image block refers to, and the image features that this object information is corresponding with above-mentioned first image block carries out association store, generates the information list recording configuration object;
Step 205, performs the step of the band of position in the above-mentioned dynamic image of above-mentioned identification residing at least one configuration object according to above-mentioned information list.
So, when at least one configures the band of position residing for object in the above-mentioned dynamic image of identification performing above-mentioned steps 200, the configuration object whether existed in information list can be identified in dynamic image according to the first image features in described information list.Specifically can comprise the following steps:
First, each band of position in above-mentioned dynamic image is identified;
Then, by the band of position identified, mate with the image features in above-mentioned information list;
Secondly, when what the match is successful, then the object information of configuration object relevant to this image features for the band of position of identification is associated.Otherwise, continue to identify each band of position in dynamic image until the configuration object that records in the match is successful information list.
In step 300, the current operating state of at least one configuration object above-mentioned is obtained.Here by receiving the current operating state knowing relevant configuration object from the remote control feedack in above-mentioned intelligent household management system, or the communication information transmitted by receiving each configuration object independently with wireless signal transmission-receiving function knows the current operating state of relevant configuration object.
In step 400, definition with above-mentioned at least one configure at least one object displaying control that object one_to_one corresponding arranges, the image attributes of each object displaying control is configured to the above-mentioned current operating state of the configuration object corresponding with this object displaying control.The image attributes only opening or closing the object displaying control of its correspondence of configuration object of two kinds of duties for duty has two states, and according to the real-time information that above-mentioned steps 300 obtains, and the current operating state being configured to by image attributes receive is in order to display.
Certainly can be the situation of a range of adjustment for duty, such as air-conditioner temperature, electric light brightness, opening angle of intelligence window frame etc., then in a preferred embodiment of the invention, above-mentioned object displaying control can be defined as a status adjustment control in order to provide user to select the functional parameter of the above-mentioned configuration object of a selection, the image attributes of this status adjustment control has a range of adjustment, correspond to working range (the i.e. air-conditioner temperature working range residing for functional parameter of configuration object, electric light Brightness Duty scope, the opening angle scope of intelligence window frame), similarly, when for showing, the image attributes of above-mentioned object displaying control is configured to the current operating state of the configuration object of current sensing.
In step 500, show above-mentioned dynamic image, and superpose the object displaying control that arrange corresponding to this configuration object in the band of position of each configuration object or the surrounding neighbors of this band of position.
By above embodiment, the present invention can superpose the current operating state information of relevant configuration object on the dynamic image that monitoring obtains in real time, is convenient to user and checks each electric equipment in monitoring range, is easy to control.Compare traditional approach, method of the present invention can associate with the video data monitored in real time, facilitates user to control domestic environment according to the information of Real-time Feedback.
Based on above-described embodiment, in one embodiment of the invention, as shown in Figure 2, said method also comprises:
Step 600, obtains the focal coordinates at focus place when user touches user interface;
Step 700, searches the control that above-mentioned focal position is pointed to; Here control comprises: above-mentioned object displaying control or following showing interface control.
If when above-mentioned focal coordinates point to an above-mentioned object displaying control, generate the second amendment order, according to above-mentioned second amendment order, send the instruction regulating current operating state to the configuration object that this object displaying control is corresponding.The regulating command of duty can be sent to configuration object by touch-control related control.
In addition, search in this step 700 of control pointed to above-mentioned focal position, specifically comprise the following steps:
Step 701, judge near above-mentioned focal coordinates or this focal coordinates, whether (such as in certain limit) exists pointed control, if, then generate above-mentioned amendment order, if not, then represent the configuration object that this focal position is not labeled, then trigger the step of above-mentioned demarcation configuration object, shown in specific as follows:
Step 702, identifies the second image block comprising described focal coordinates, generates second image features corresponding with this second image block;
Step 703, ejection prompting frame requirement user inputs the object information that this second image block refers to;
Step 704, obtain the object information that described second image block refers to, the image features that the object information referred to by described second image block is corresponding with described second image block carries out association store, and the configuration object added in described information list as a supplement, return step 300 according to the configuration object that this supplements, trigger the step 300 performing described acquisition relevant configuration object current operating state.
Again can be demarcated initial unlabelled configuration object by above-described embodiment, supplement missing term.
Based on above-described embodiment, in one embodiment of the invention, as shown in Figure 4, it is characterized in that, said method also comprises:
Step 800, definition interfaces displaying control, is configured to the status attribute of above-mentioned showing interface control open or close;
Step 900, stays the above-mentioned showing interface control of white spatially Overlapping display in above-mentioned dynamic image or user interface.
Whether shown by the above-mentioned all objects displaying control of the same Switch Controller of setting in the present embodiment and control, such as in a preferred embodiment of the invention, in said method, step 600 and step 700 can comprise:
First, the focal coordinates at focus place when user touches user interface are obtained;
Then, the control that above-mentioned focal position is pointed to is searched; When above-mentioned focal coordinates point to above-mentioned showing interface control, generate the first amendment order, according to above-mentioned first amendment order, revise the status attribute of above-mentioned showing interface control, and the visual attribute revising above-mentioned object displaying control is visible or invisible.When the visual attribute of above-mentioned object displaying control is marked as visible, then can display object body display control on dynamic image, otherwise on dynamic image hidden objects displaying control.
The process controlled above-mentioned showing interface control is added in the flow process shown in Fig. 2, the flow process shown in Fig. 4 can be obtained, namely in execution step 701, judge near above-mentioned focal coordinates or this focal coordinates, whether (such as in certain limit) exists pointed control (comprising above-mentioned object displaying control or above-mentioned showing interface control), if not, then represent the configuration object that this focal position is not labeled, then trigger the step of above-mentioned demarcation configuration object, perform above-mentioned steps 702 to above-mentioned steps 704.If, then represent that focal coordinates point to a certain control, then perform corresponding order according to control type, such as shown in Fig. 4, when focal coordinates point to a certain control, if when above-mentioned focal coordinates point to above-mentioned showing interface control, generate the first amendment order, according to above-mentioned first amendment order, revise the status attribute of above-mentioned showing interface control, and the visual attribute revising above-mentioned object displaying control is visible or invisible; Or when if above-mentioned focal coordinates point to an above-mentioned object displaying control, generate the second amendment order, according to above-mentioned second amendment order, send the instruction regulating current operating state to the configuration object that this object displaying control is corresponding.The regulating command of duty can be sent to configuration object by touch-control related control.Different operational orders is triggered for the control difference pointed to for touch-control.
Based on said method, as shown in Figure 5, present invention also offers a kind of house control system 1 of video Network Based, it comprises:
First receiver module 11, for obtaining video monitoring data, generates dynamic image;
Identification module 12, for identifying the band of position in above-mentioned dynamic image residing at least one configuration object;
Second receiver module 13, for obtaining the current operating state of at least one configuration object above-mentioned;
Displaying control generation module 14, for define with above-mentioned at least one configure at least one object displaying control that object one_to_one corresponding arranges, the image attributes of each object displaying control is configured to the above-mentioned current operating state of the configuration object corresponding with this object displaying control;
Overlapping display module 15, for showing above-mentioned dynamic image, and superposes the object displaying control that arrange corresponding to this configuration object in the band of position of each configuration object or the surrounding neighbors of this band of position.
Each functional module 11 to 15 above-mentioned is respectively used to perform step 100 in said method to step 500, and therefore, the specific implementation of its functional module, see the detailed description of above-mentioned steps 100 to step 500, tiredly to be stated at this.
Based on above-described embodiment, in one embodiment of the invention, said system also comprises:
Focus acquisition module 16, for obtaining the focal coordinates at focus place when user touches user interface; With
Search module 17, for searching the control that above-mentioned focal position is pointed to.For the result of searching, if when above-mentioned focal coordinates point to an above-mentioned object displaying control, generate the second amendment order, according to above-mentioned second amendment order, send the instruction regulating current operating state to the configuration object that this object displaying control is corresponding.The regulating command of duty can be sent to configuration object by touch-control related control.Each functional module 16 to 17 above-mentioned is respectively used to perform step 600 in said method to step 700, and therefore, the specific implementation of its functional module, see the detailed description of above-mentioned steps 600 to step 700, tiredly to be stated at this.
In addition, in one embodiment of the invention, above-mentioned module 17 of searching specifically comprises with lower unit:
First module, for judging near above-mentioned focal coordinates or this focal coordinates, whether (such as in certain limit) exists pointed control, if, then generate above-mentioned amendment order, if not, then represent the configuration object that this focal position is not labeled, then trigger the step of above-mentioned demarcation configuration object, shown in specific as follows:
Second unit, for identifying the second image block comprising above-mentioned focal coordinates, generates second image features corresponding with this second image block;
Unit the 3rd, inputs for ejecting prompting frame requirement user the object information that this second image block refers to; And
Unit the 4th, for obtaining the object information that above-mentioned second image block refers to, the image features that the object information referred to by above-mentioned second image block is corresponding with above-mentioned second image block carries out association store, and the configuration object added in above-mentioned information list as a supplement, return according to this configuration object supplemented and call the second receiver module 13 to 15.Each functional unit above-mentioned is respectively used to perform step 701 in said method to step 704, and therefore, the specific implementation of its functional module, see the detailed description of above-mentioned steps 701 to step 704, tiredly to be stated at this.
Based on above-described embodiment, in one embodiment of the invention, said system also comprises:
Showing interface control generation module, for definition interfaces displaying control, is configured to the status attribute of above-mentioned showing interface control open or close; With
Add module, stay the above-mentioned showing interface control of white spatially Overlapping display in above-mentioned dynamic image or user interface.Each functional module above-mentioned is respectively used to perform step 800 in said method to step 900, and therefore, the specific implementation of its functional module, see the detailed description of above-mentioned steps 800 to step 900, tiredly to be stated at this.Whether shown by the above-mentioned all objects displaying control of the same Switch Controller of setting in the present embodiment and control, such as in a preferred embodiment of the invention, said system also comprises:
Focus acquisition module 16, for obtaining the focal coordinates at focus place when user touches user interface;
Search module 17, for searching the control that above-mentioned focal position is pointed to; When above-mentioned focal coordinates point to above-mentioned showing interface control, generate the first amendment order, according to above-mentioned first amendment order, revise the status attribute of above-mentioned showing interface control, and the visual attribute revising above-mentioned object displaying control is visible or invisible.When the visual attribute of above-mentioned object displaying control is marked as visible, then can display object body display control on dynamic image, otherwise on dynamic image hidden objects displaying control.
And for while Presence of an interface displaying control and object displaying control time, then search module 17, for search above-mentioned focal position point to control; When above-mentioned focal coordinates point to above-mentioned showing interface control, generate the first amendment order, according to above-mentioned first amendment order, revise the status attribute of above-mentioned showing interface control, and the visual attribute revising above-mentioned object displaying control is visible or invisible; Or when above-mentioned focal coordinates point to an above-mentioned object displaying control, generate the second amendment order, according to above-mentioned second amendment order, send the instruction regulating current operating state to the configuration object that this object displaying control is corresponding.The regulating command of duty can be sent to configuration object by touch-control related control.Or in another embodiment of the present invention, above-mentionedly search first module in module 17 also for judging near above-mentioned focal coordinates or this focal coordinates, whether (such as in certain limit) exists pointed control, if, then when above-mentioned focal coordinates point to above-mentioned showing interface control, generate the first amendment order, according to above-mentioned first amendment order, revise the status attribute of above-mentioned showing interface control, and the visual attribute revising above-mentioned object displaying control is visible or invisible; Or when above-mentioned focal coordinates point to an above-mentioned object displaying control, generate the second amendment order, according to above-mentioned second amendment order, send the instruction regulating current operating state to the configuration object that this object displaying control is corresponding.
Above-mentioned Fig. 2 to Fig. 4 is the method flow schematic diagram of the embodiment of the present invention.Although it should be understood that each step in the process flow diagram of Fig. 2 to Fig. 4 shows successively according to the instruction of arrow, these steps are not that the inevitable order according to arrow instruction performs successively.Unless had explicitly bright herein, the order that the execution of these steps is strict limits, and it can perform with other order.And, at least one step in Fig. 2 to Fig. 4 can comprise multiple sub-step or multiple stage, these sub-steps or stage are necessarily not complete at synchronization, but can perform in the different moment, its execution sequence does not also necessarily carry out successively, but can implement with the sub-step of other steps or other steps or stage combination or replace that tandem completes.
The implementation of each embodiment only for corresponding steps in illustrating is set forth above, then in the not conflicting situation of logic, each embodiment above-mentioned be can mutually combine and form new technical scheme, and this new technical scheme is still in the open scope of this embodiment.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that above-described embodiment method can add required general hardware platform by software and realize, hardware can certainly be passed through, but in a lot of situation, the former is better embodiment.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a non-volatile computer readable storage medium (as ROM, magnetic disc, CD, server storage) in, comprising some instructions in order to make a station terminal equipment (can be mobile phone, computing machine, server, or the network equipment etc.) perform system architecture described in each embodiment of the present invention and method.
Based on foregoing, present invention also offers a kind of intelligent household management system, as shown in Fig. 1 (a) He (b), in one embodiment of the invention, above-mentioned intelligent household management system comprises: at least one has the house control system of video Network Based that the configuration object of wireless signal transmitting-receiving and each embodiment above-mentioned provide; Or comprise the house control system of the video Network Based that at least one configuration object, the control control device far away be connected with described configuration object and each embodiment above-mentioned provide.And configuration object here comprises: at least one object in above-mentioned various electric equipment and camera.
In sum, utilize technique scheme provided by the invention, the real-time monitoring and control of dynamic menu can be provided under convention video monitoring, by wire/radio network transmission picture data to terminal, provide application foundation alternately for user completes function according to preset function menu.In technique effect further, the invention provides the pilot signal interactive function based on real-time monitored picture, it is more easily for user provides the situation of real time environment, facilitates user to realize real time inspection and control operation more accurately.Present invention achieves and realized the virtual real-time control to realistic space by dynamic menu direct interaction.
The above embodiment only have expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but therefore can not be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.