CN105739315A - Indoor user electric appliance equipment control method and device - Google Patents
Indoor user electric appliance equipment control method and device Download PDFInfo
- Publication number
- CN105739315A CN105739315A CN201610072604.6A CN201610072604A CN105739315A CN 105739315 A CN105739315 A CN 105739315A CN 201610072604 A CN201610072604 A CN 201610072604A CN 105739315 A CN105739315 A CN 105739315A
- Authority
- CN
- China
- Prior art keywords
- control
- consumer electronics
- electronics equipment
- indoor
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000012800 visualization Methods 0.000 claims description 12
- 230000008859 change Effects 0.000 claims description 10
- 239000000284 extract Substances 0.000 claims description 9
- 230000001143 conditioned effect Effects 0.000 claims description 6
- 238000001816 cooling Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 description 21
- 230000001276 controlling effect Effects 0.000 description 12
- 230000000875 corresponding effect Effects 0.000 description 12
- 230000004048 modification Effects 0.000 description 8
- 238000012986 modification Methods 0.000 description 8
- 230000000007 visual effect Effects 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 238000003825 pressing Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- KLDZYURQCUYZBL-UHFFFAOYSA-N 2-[3-[(2-hydroxyphenyl)methylideneamino]propyliminomethyl]phenol Chemical compound OC1=CC=CC=C1C=NCCCN=CC1=CC=CC=C1O KLDZYURQCUYZBL-UHFFFAOYSA-N 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 201000001098 delayed sleep phase syndrome Diseases 0.000 description 2
- 208000033921 delayed sleep phase type circadian rhythm sleep disease Diseases 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000002245 particle Substances 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000010420 art technique Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005034 decoration Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 230000004899 motility Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Selective Calling Equipment (AREA)
Abstract
The embodiment of the invention provides an indoor user electric appliance equipment control method comprising the steps that an indoor scene is photographed; images of user electric appliance equipment presented in the photographed indoor scene are extracted and separated, and the presented images of the user electric appliance equipment at least partially reflect the features of the user electric appliance equipment; connection signals are transmitted to the corresponding user electric appliance equipment based on an indoor electrical control network according to the extracted and separated images of the user electric appliance equipment; and control instructions are transmitted to the user electric appliance equipment after completion of connection. Another embodiment of the invention provides a corresponding device of the indoor user electric appliance equipment control method.
Description
Technical field
The invention mainly relates to the control of a kind of smart machine based on image and be connected with each other method, the invention belongs to indoor intelligent and control technical field.
Background technology
Along with developing rapidly of each side Smart Home technology, increasing smart machine occurs in the life of people.How the dominance of these smart machines is controlled, embody the motility of user, and how to make these smart machines be connected with each other easily, be one important actual demand of users.
In order to solve these demands, the present invention provides the control of a kind of smart machine based on image and interconnective method.
Summary of the invention
The present invention will solve these defects, it is provided that the control method of a kind of indoor user electric equipment and device, based on the information of the identification extraction household electrical appliance to indoor scene image, to realize the control to household electrical appliance and to be connected with each other.
In one embodiment, the control method of indoor user electric equipment includes: shoot an indoor scene；Extracting and separate the image of the consumer electronics equipment presented in captured indoor scene, the image of the consumer electronics equipment wherein presented is the feature embodying this consumer electronics equipment at least partly；According to the image of consumer electronics equipment that extracts and separate, control network based on indoor electric and send to corresponding consumer electronics equipment and connect signal；And after described connection completes, send control instruction to described consumer electronics equipment.
Further, described to described consumer electronics equipment send control instruction also include: generate at least similar to captured indoor scene part control interface；Described control interface carries out the visualization at least one consumer electronics equipment control；And control the operation corresponding control instruction of generation according to this visualization.
Or, the control method of described indoor user electric equipment farther includes: change the performance state of the map unit of at least one the consumer electronics equipment embodied in described control interface, wherein, described performance state has included at least the performance state identical with the functional status of this consumer electronics equipment；And by this performance State Transferring be numeral conditioned signal, to form described control instruction.
Wherein, described control instruction can be received by multiple controlled consumer electronics equipment simultaneously, and wherein the Control Cooling of these multiple controlled consumer electronics equipment is different.
In another embodiment, the control device of a kind of indoor user electric equipment includes: shooting parts, is used for shooting an indoor scene；Connect the control parts of these shooting parts, be configured to: extracting and separate the image of the consumer electronics equipment presented in captured indoor scene, the image of the consumer electronics equipment wherein presented is the feature embodying this consumer electronics equipment at least partly；According to the image of consumer electronics equipment that extracts and separate, control network based on indoor electric and send to corresponding consumer electronics equipment and connect signal；And after described connection completes, send control instruction to described consumer electronics equipment.
It is preferred that described control parts include controlling network by described indoor electric connects the first control parts of several consumer electronics equipment, it is configured to: generate at least similar to captured indoor scene part control interface；Described control interface carries out the visualization at least one consumer electronics equipment control；And control the operation corresponding control instruction of generation according to this visualization.
Or, described control parts include again connecting the described first the second control parts controlling parts and shooting parts, it is configured to: change the performance state of the map unit of at least one the consumer electronics equipment embodied in described control interface, wherein, described performance state has included at least the performance state identical with the functional status of this consumer electronics equipment；And by this performance State Transferring be numeral conditioned signal, to form described control instruction.
Wherein, it is cable network or wireless network that described indoor electric controls network, or combination of the two.
Accompanying drawing explanation
Fig. 1 schematically depicts the method schematic diagram of consumer electronics equipment in control room of the present invention；
Fig. 2 shows the control interface on a portable digital device visually；
Fig. 3 schematically shows the connection line schematic diagram of indoor electric appliance；
Fig. 4 shows a control mode visually；
Fig. 5 is the flow chart of control method of the present invention；
Fig. 6 is a kind of modification of Fig. 5 control method.
Detailed description of the invention
The content of the embodiment of the present invention and effect thereof will embody in detail in conjunction with accompanying drawing.In current intelligent domestic system use image recognition technology, by user friendly operation, user can implement technical scheme and obtain significantly convenient.It should be appreciated that the control device used in the present invention or data processing equipment can select according to the actual demand of user.Wherein, (such as) some control device can be existing hardware device, based on the present invention, these hardware devices can be improved and realize the function of the present invention, some other control device and can be installed easily when not changing indoor furniture power wiring structure, such as, by power line carrier (PLC) mode.
Control parts to be realized by one or more application specific integrated circuits (ASIC), digital signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor (MCU) or other electronic components, for performing the example of following apparatus and method.
In the exemplary embodiment, additionally provide the non-transitory computer-readable recording medium including performing the instruction of control method of the present invention, such as including the non-volatile memory device of this instruction, above-mentioned instruction can be performed by the processor controlling parts to complete said method.Such as, non-transitory computer-readable recording medium can be ROM, random access memory (RAM), CD-ROM, tape, floppy disk and optical data storage devices etc..
For Fig. 1, in various embodiments of the present invention, indoor user electric equipment can refer to the household electrical appliance of indoor shelter user, for instance, television set 10, refrigerator, washing machine etc., it is also possible to refer to power wiring and the attachment component thereof of indoor shelter, such as wall surface switch, window 30 or lamp 21, according to technical scheme, any one consumer electronics equipment all can be controlled by the way of image taking by user.
Shown in Fig. 1, the control device of indoor user electric equipment can include shooting parts, is used for shooting an indoor scene 100.Shooting parts can be video camera, photographing unit or other camera-shooting and recording devices, it can also be embedded video camera, the such as photographic head of PC (PC), the photographic head of portable personal digital device can be used in the present embodiment as an example, so, user can shoot the household electrical appliance of required control movably, repeatedly can also be undertaken storing or combining by captured image afterwards in shooting, then in the way of fixing described portable digital device, control the electrical equipment presented in image, such as, described portable digital device can be positioned on desk by user, and user needs to carry out other work at this moment.
Using the indoor scene 100 that above-mentioned shooting parts photograph can be the multiple photo of continuous print, and in an example, in order to reach better image recognition effect, user is optional to be repeated same indoor scene 100 to shoot repeatedly to obtain the shooting effect of the best.In another example, captured photograph image can be different from each other, user may select the multiple different spaces in indoor with different angles to shoot indoor scene 100, such as in parlor, three images in bedroom and kitchen, these three images can be merged, thus allowing user realize more extension and to control easily.
Generally speaking, above-mentioned control device also includes the control parts connecting these shooting parts, it is configured to: extracting and separate the image of the consumer electronics equipment presented in captured indoor scene 100, the image of the consumer electronics equipment wherein presented is the feature embodying this consumer electronics equipment at least partly；According to the image of consumer electronics equipment that extracts and separate, control network based on indoor electric and send to corresponding consumer electronics equipment and connect signal；And after described connection completes, send control instruction to described consumer electronics equipment.
As in figure 2 it is shown, in the preferred example of a diagram, control parts and can at least include a portable digital device 202, for instance the mobile phone used in prior art, or plate type computer.User can shoot multiple scene images by portable digital device 202, such as can present the scene 101 in one corner, parlor, can showing the scene 102 in another corner, parlor and can present the scene 103 in one corner, kitchen, wherein said scene 101,102,103 can be processed the image after being combined into combination by this portable digital device 202.After some controlled household electrical appliance in one indoor scene 100 image also can be easily separated (such as, cutting image) by described portable digital device 202, then these isolated images are combined and formed one combination after scene image.Such as, scene 101 and scene 102 come from scene 100, namely in scene 101, television set 10, window 30 are mainly presented as principal home's electrical appliance equipment, with scene 100 the difference is that, there is certain change in sight background beyond household electrical appliance in scene 101 and 102, but effect according to embodiments of the present invention, the household electrical appliance in each scene above-mentioned all can be identified constantly.
Specifically, control parts (such as, portable digital device 202) and Graphics Processing Unit can be included, be configured to:
Consumer electronics equipment drawing picture after extracting and separating is combined, for instance repeat one household electrical appliance of shooting or shoot same household electrical appliance under different scenes, then these images being combined.The mode of combination can be known image composing technique, color formula that can also to be (such as) carry out in order to avoid light is partially dark or connecting method, a kind of connecting method is according to Fig. 2 mode, another kind of connecting method can combine according to panorama mode, namely the image at one continuous transformation visual angle of shooting is set according to the time, such image can make the angular field of view of shoot part part be extended, it is achieved the control of bigger angular field of view；
The consumer electronics equipment drawing picture presented in image after combination is identified, extract the feature wherein representing these consumer electronics equipment, generation feature identification accords with, described control device can have memorizer, and the feature identification that the feature of consumer electronics equipment would correspond to wherein store accords with and read out by controlling parts.The identification of described feature is included the multiple processing mode to image, such as can according to default image alignments, shoot the direct picture of a window 30 comparatively clearly, this direct picture will be used to carry out numeric ratio pair with a pre-set image, impose a condition if identifying to meet, then consumer electronics equipment drawing picture in this scene 101 is defined as " window " by Graphics Processing Unit.Thus, if window 30 is an electrified equipment, then it will by above-mentioned control component controls.In fig. 2, to window 30 be identified by set a minimum identification region 111, in actual identification process, the image of the window 30 in this minimum identification region 111 is carried out above-mentioned process.Or, generate described identification according to the unique identifier of each consumer electronics equipment.Such as, each household electrical appliance can stick this identifier (such as, bar code), the image of these identifiers is got when shooting these household electrical appliance, by the identification to this identifier image, Graphics Processing Unit can read this identifier to generate the corresponding association to each household electrical appliance；And
Accord with according to described feature identification, same consumer electronics equipment in scene areas in different chamber is associated, so, one of which will not be in presenting with controlled in other consumer electronics equipment drawing pictures for the consumer electronics equipment presented in the consumer electronics equipment drawing picture of described combination.Such as in scene 101 and 102, if window 30 is presented in scene 102 simultaneously, then the window 30 determined in scene 102 is background image by described Graphics Processing Unit, will not be identified, or, it is separated scene 102.It should be appreciated that the image after combination can be discontinuous on figure is constituted, only highlight the desired household electrical appliance controlled of user.
In one embodiment, described control parts can be split type electric component.Control parts and can include being connected by described indoor electric control network the first control parts of several consumer electronics equipment, such as, fixed digital device 201 in Fig. 1 is (such as, computer or server), it is configured to: generate at least similar to captured indoor scene 100 part control interface；Described control interface carries out the visualization at least one consumer electronics equipment control；And control the operation corresponding control instruction of generation according to this visualization.
In another embodiment, described control parts include again connecting the described first the second control parts controlling parts and shooting parts, such as portable digital device 202 is (such as, mobile phone), it is configured to: change the performance state of the map unit 213 of at least one the consumer electronics equipment embodied in described control interface 212, wherein, described performance state has included at least the performance state identical with the functional status of this consumer electronics equipment；And by this performance State Transferring be numeral conditioned signal, to form described control instruction.
In yet another embodiment, described control parts can include fixed digital device 201 and portable digital device 202 simultaneously, furthermore, it is understood that it is cable network or wireless network that described indoor electric controls network, or combination of the two.Such as, it is realized by Wi-Fi, ZigBee or HAN network that indoor electric controls network, can also be realized by PLC mode, shown in Fig. 3, the set-up mode of above-mentioned control parts can be and wire type communicate to connect with each household electrical appliance, wherein fixed digital device 201 can pass through power line mode to each electric equipment transmission power line carrier signal S1, and portable digital device 202 can be communicated to connect by ZigBee mode and described fixed digital device 201 simultaneously.
In a kind of modification, television set 10 can with fixed digital device 201 by described electric lines of force L, N communication connection, and lamp 21 (especially LED) also wire type same with television set 10 connects.The difference is that, in the illustrative example of Fig. 3, the connected mode of lamp 21 is different from television set 10, lamp 21 can pass through control panel 251 and control, and be not directed through fixed digital device 201 and control, such effect is to change original wire laying mode of indoor electric network, and changes and improved can realize by control panel 251.According to each embodiment above-mentioned, user can realize the control to this control panel 251 by shooting described control panel 251, or user controls this control panel 251 also by portable digital device 202 in Wi-Fi mode, between this, control panel 251 is provided with response and modulates the wireless transceiver of this ZigBee or Wi-Fi signal.Can the lamp 21 of controlled (such as brightness-adjustable, colour temperature or color) if installing according to the mode of Fig. 3, then will transmit power line carrier signal S1 between the node c to d on electric lines of force, at node a and b place, then not there is this power line carrier signal S1, and digital carrier dim signal S2 only can be produced between described control panel 251 and lamp 21 by the conditioning mode of power line carrier signal S1 similar manner, such effect is in that, not by the disturbance of transmitted signal between node c and d.
Specifically, first controls parts can be configured to again identify the described second type controlling parts or state, to be attached.Such as, embodiment shown in Fig. 1, portable digital device 202 can pass through Wi-Fi network and communicate with fixed digital device 201, thus the indoor scene 100 generated in fixed digital device 201 can be correspondingly presented in the map unit 213 of portable digital device 202, shown portable digital device 202 can be presented simultaneously to this map unit 213 of user and control interface 212, control interface 212 can also directly present according to the in addition full screen of mode as shown in Figure 2, above-mentioned presentation mode can pass through user operation mode and be switched, such as upset or the anglec of rotation.So, user can change control mode into movable type, it might even be possible to is the state change of consumer electronics equipment in control room when outdoor.At this under application, fixed digital device 201 needs to identify the device type of portable digital device 202, thus identifying the user identity using this portable digital device 202, in the example of Fig. 2, knowing to adopt the recognition unit 232 of portable digital device 202 to realize otherwise, such as known mobile phone is (such as) bio-identification unit 232 (such as, metal inductance loop).Or, in order to more precisely control household electrical appliance, fixed digital device 201 needs the use state of Real time identification portable digital device 202, if such as lamp 21 or 22 is closed by user on the control interface of portable digital device 202, in the indoor scene 100 then correspondingly presented in the display unit 241 of fixed digital device, lamp 21 or 22 should correspondingly be changed to closed mode.So, user can be switched more easily between the above-mentioned fixed and control form of portable digital device.
As a kind of modification, described control parts are configured to again: complete the control at least another consumer electronics equipment by sending control instruction to a described consumer electronics equipment.
In an application of this modification, lamp 21 can be passed through and transmit a signal to the household electrical appliance of indoor, for instance signal can be transmitted by light.Above-mentioned shooting parts can be integrated in portable digital device 202, it is configured to receive the signal transmitted by light, skilled artisan understands that, the signal adopting lamp 21 transmission can have different modulation systems and frequency, in order to obtain the larger lengths Frame in the signal of light transmission, to individually not adopt the connected mode shown in Fig. 3, the connected mode of lamp 21 can be identical with TV play 10 and wire type be connected, can also being connected by optical cable, (such as) provides illuminating power by optical fiber.In an example, the condition responsive signal of household electrical appliance can be transmitted by light, enables a user to obtain the information wherein expressed.
Such as, Fig. 4 has shown the example of an application visually, and in this example, the lamp 21 being placed on the desk that user is indoor is an Intelligent LED lamp, and it passes through lead-in wire 252 connection wall wall plug receptacles or aforesaid control panel 251 to obtain electric power.According to the mode of previous embodiment, power line carrier signal S1 can pass through 252 demodulating equipments being transferred in lamp 21 that go between, thus realizing the carrier-wave transmission of data.Data can be modulated by the light of lamp 21 outgoing and be transmitted.In an example, shooting parts can be selected for portable digital device 202 (such as, mobile phone) front-facing camera 242, adopt the photobehavior of photographic head, data can specifically modulating frequency or wavelength be carried in light wave (such as, flicker), thus, light wave is received and after demodulation by the demodulating equipment in portable digital device 202, it is thus achieved that data content therein.
In another application of this modification, lamp 21 can be placed in window 30 side, lamp 21 is provided with photosensitive-member, it is configured to induced environment (such as, outside window 30, be projected into indoor) light intensity, the turn on lights 21 when the threshold value that ambient light intensity sets lower than lamp 21, lamp 21 irradiates portable digital device 202 with transmitting scene information, this scene information can include the different situations of the prompting available operation of user, such as light the sight luminaire that a part is indoor, or other electric equipments started when starting a part of user expectation and be preset in rather dark, such as start curtain closedown etc..Certainly, user can also be set as being sensed the intensity of illumination in the external world by portable digital device 202, sends enabling signal to lamp 21 after light intensity is lower than predetermined threshold value.
Based on previous embodiment, it may be achieved the control method of one or more indoor user electric equipments, in one total, described method comprises the steps that
Step S100, shooting indoor scene 100, according to foregoing individual embodiments, scene can be directly obtained by the shooting parts of portable digital device 202, it is also possible to forms map unit 213 after being obtained by fixed digital device 201 and processed on the display interface of portable digital device 202；
The consumer electronics equipment presented in indoor scene 100 captured by step S200, extraction and separation is (such as, lamp 21 or 22, television set 10 and control panel 251) image, the image of the consumer electronics equipment wherein presented is the feature embodying this consumer electronics equipment at least partly；
Step S300, according to the image of consumer electronics equipment that extracts and separate, control network based on indoor electric and send to corresponding consumer electronics equipment and connect signal；And
Step S400, after described connection completes, to described consumer electronics equipment send control instruction.
Embodiment 1: the method controlling interior illumination fixture
In the step S400 of said method, send control instruction to described consumer electronics equipment and also include:
Step S410, generate at least similar to captured indoor scene 100 part control interface 212.User may utilize the topography of the shooting parts acquisition indoor scene 100 of fixed digital device 201, or indoor scene 100 is (such as shown in Fig. 1, can present is parlor) a part of region, in order to more clearly obtain household electrical appliance figure that may be present in scene 100, the selection of shooting parts is various ways, for instance can the higher external camera of external imaging pixels or camera.User have taken in scene 100 multiple be arranged on construction ceiling (such as, ceiling or decoration ceiling) on lamp 21 and 22, user utilizes the information that fixed digital device 201 obtains lamp 21 and 22 may is that
The figure of taken indoor scene 100 is carried out rasterizing, rasterizing may utilize " grid " G1, G2 distinguishes each the more tiny scene comprised in scene 100, such as each scene 101/102/103 etc. shown in Fig. 2, it is somebody's turn to do the virtual some demarcation line for being layered by the image presented in indoor scene 100 that " grid " is set by the Graphics Processing Unit in fixed digital device 201, wherein said Graphics Processing Unit is configured to, with described grid and described indoor scene 100 or more careful scene therein is divided into multiple section, than each section in these multiple sections of more continuous and a upper section image parameter (such as, gray value) to identify profile and the visual angle of consumer electronics equipment that may be present in this section.
Profile and visual angle can be through what described Graphics Processing Unit judged, and the width of above-mentioned section is alterable and mutually different.Such as, if user selects this scene of viewing angles with indoor scene 100 central position, then graphic processing facility using the highest distance position that first sets in this scene 100 as datum mark, from this datum mark as minimum section, generate multiple concentric grid laterally (such as, G1 and G2), will at least confine a consumer electronics equipment between two grids.Visual angle can be primarily determined that in this way, the profile according to the recognizable consumer electronics equipment in this visual angle, for the in addition matching identification of the preset model in memorizer.Such as in scene 100, window 30 is confined in a section and is front view, will be easiest to be identified by Graphics Processing Unit.Certain visual angle is then there is in television set 10 in this scene 100, a part according to the television set 10 within the scope of the section that the visual angle identified before and grid G1, G2 are confined carries out data operation (such as, convolution mode) and can determine whether out the feature of television set 10.And for some particular case, such as lamp 21 becomes regularly arranged with 22 in indoor scene 100, then according to above-mentioned grid, the position of these lamps can be confined, regulate the position of grid again to determine the determination section of lamp 21 and 22, for instance make the Box junction of two dimensions to determine the position of lamp 21 and 22.
Step S420, described control interface 212 carries out the visualization at least one consumer electronics equipment control.The example controlling interface 212 can describe in FIG clearly, user select to adopt portable digital device 202 to control in scene 100 lamp 21 and 22 time, grid will be removed, and so can allow user is vivider to be manipulated intuitively.In above-mentioned steps S200, arranging grid is for the household electrical appliance in each section are extracted and separated, thus identifying household electrical appliance more accurately.If the household electrical appliance feature that described Graphics Processing Unit has efficiently separated and identified in each section, these sections then can be reassembled into the map unit 213 shown in Fig. 1, this map unit 213 can be determined again according to above-mentioned grid the position of wherein controlled household electrical appliance, and on each position, generate selection module.Such as, if user expects that lamp 21 is lighted, then can pressing the selection module 211 of lamp 21 in map unit 213, so, if portable digital device 202 determines this pressing signal, then its processor will change the parameter of this selection module 211.Similarly, lamp 22 is in the state lighted originally, and user can also press the position selecting module 221 in map unit 213, then the parameter of this selection module 221 also will be changed.
Step S430, according to this visualization control operation generate corresponding control instruction.In above-mentioned steps, visualized operation is based on and can the portable digital device 202 of touch-control complete, and for not possessing the digital device of touch control operation, can adopt other modes, for instance click.The change of the parameter of each selection module above-mentioned will be received by processor and computing, thus generating the control instruction to lamp 21 or 22.In a preferred example, the content of control instruction can not only comprise the switching signal of lamp, also contains the variable signal of the brightness of lamp, colour temperature or color, the control of these variable signals can be operated with the gesture that (such as) is different in map unit 213.
Generally speaking, can farther include in the methods described above:
Step S421, changing the performance state of the map unit 213 of at least one the consumer electronics equipment embodied in described control interface 212, wherein, described performance state has included at least the performance state identical with the functional status of this consumer electronics equipment；And
Step S422, by this performance State Transferring be numeral conditioned signal, to form described control instruction.
Further, described control instruction can be received by multiple controlled consumer electronics equipment (such as lamp 21 and 22) simultaneously simultaneously, and wherein the Control Cooling of these multiple controlled consumer electronics equipment is different.
Embodiment 2: the method for home appliance in control room
Fig. 2 shows multiple scene presenting different household electrical appliance visually, in step s 200, can farther include:
Step 210, by extract and separate after consumer electronics equipment drawing picture be combined; such as shoot multiple scene comprising different household electrical appliance; such as comprise the scene 101 of window 30; comprise the scene 102 of television set 10 and the scene 103 of protection water heater 40 and microwave oven 50, then these images are combined.The mode of combination is known image composing technique, color formula that can also to be (such as) carry out in order to avoid light is partially dark or connecting method, a kind of connecting method is according to Fig. 2 mode, another kind of connecting method can combine according to panorama mode, namely the image at one continuous transformation visual angle of shooting is set according to the time, such image can make the angular field of view of shoot part part be extended, it is achieved the control of bigger angular field of view.
Step 220, the consumer electronics equipment drawing picture that presents in the image after combination is identified, extract the feature wherein representing these consumer electronics equipment, generate feature identification symbol.
Aforesaid control device can have memorizer, and the feature identification that the feature of consumer electronics equipment would correspond to wherein store accords with and read out by controlling parts.The identification of described feature is included the multiple processing mode to image, such as can according to default image alignments, shoot the direct picture of a window 30 comparatively clearly, this direct picture will be used to carry out numeric ratio pair with a pre-set image, impose a condition if identifying to meet, then consumer electronics equipment drawing picture in this scene 101 is defined as " window " by Graphics Processing Unit.Thus, if window 30 is an electrified equipment, then it will by above-mentioned control component controls.In fig. 2, to window 30 be identified by set a minimum identification region 111, in actual identification process, the image of the window 30 in this minimum identification region 111 is carried out above-mentioned process.Or, generate described identification according to the unique identifier of each consumer electronics equipment.Such as, each household electrical appliance can stick this identifier (such as, bar code), the image of these identifiers is got when shooting these household electrical appliance, by the identification to this identifier image, Graphics Processing Unit can read this identifier to generate the corresponding association to each household electrical appliance；And
Step 230, accord with according to described feature identification, same consumer electronics equipment in scene areas in different chamber is associated, so, one of which will not be in presenting with controlled in other consumer electronics equipment drawing pictures for the consumer electronics equipment presented in the consumer electronics equipment drawing picture of described combination.Such as in scene 101 and 102, if window 30 is presented in scene 102 simultaneously, then the window 30 determined in scene 102 is background image by described Graphics Processing Unit, will not be identified, or, it is separated scene 102.
It addition, as a kind of modification, in step S421, the performance state changing the map unit 213 controlling interior at least one the consumer electronics equipment embodied in interface 212 includes again:
Step S4211, choose the selection module of the consumer electronics equipment presented in a map unit 213.Such as in fig. 2, the use state of desired control microwave oven 50 is (such as in scene 103 for user, set heat time heating time), but size and touch-control area owing to controlling interface accurately cannot meet operating habit meticulously, then user can press with this selection module 113 selected by selecting module 113 to carry out, then, this selection module 113 can be amplified to suitable dimension by user on this control interface, and this selection module 113 is formed a new scene 104 by described Graphics Processing Unit.Wherein, the mode of amplification can be conventional approaches, for instance finger drags, continuous pressing etc.；
Step S4212, generate a new scene according to this selection module, produce the selection module of several new performance states reflecting these consumer electronics equipment in this scenario.In fig. 2, new scene 104 can be concurrently presented on original control interface, and unwanted scene can be removed by user, or is iterated with this new scene 104.Described Graphics Processing Unit will produce new selection module in scene 104, for instance the mode selection module 51 shown in Fig. 2 and selection of time module 52, and user can be controlled by equally in the way of pressing.
Wherein, processor generates the selection module in described new scene according to features described above identifier, the feature of the consumer electronics equipment that the selection module in new scene is associated with in its initial scene in data, and can by control initial scene time connect this consumer electronics equipment time obtain the control parameter corresponding to each selection module from this consumer electronics equipment.
Embodiment 3: the mutual control method of indoor electric appliance equipment
In said method step, it is possible to farther include: complete the control at least another consumer electronics equipment by sending control instruction to a described consumer electronics equipment.
Referring to figs. 1 through 4, the lamp 21 or 22 in indoor scene 100 can be identified according to the step of preceding method, or Graphics Processing Unit can be passed through and set one at first or best identified household electrical appliance, if the household electrical appliance identified at first have aforementioned control parts or have the minimum function controlling parts, then can realize the control to other electrical equipment.Such as, fixed digital device 201 have identified lamp 21, and according to the embodiment illustrated in earlier figures 4, lamp 21 can as an emission element, and power line carrier signal S1 can pass through 252 demodulating equipments being transferred in lamp 21 that go between, thus realizing the carrier-wave transmission of data.Data can be modulated by the light of lamp 21 outgoing and be transmitted.If this lamp 21 receives numerical control instruction in the power line carrier signal S1 of fixed digital device 201 transmitting, can according to the content of this numerical control instruction to another electrical equipment, such as television set 10 is passed on, television set 10 can have reception device (the such as known signal transceiver launching signal for receiving TV remote controller), for receiving the signal that lamp 21 is launched, such as, lamp 21 can be launched Infrared and irradiate television set 10, television set 10 receives in Infrared and performs corresponding action after the digital signal of carrying, for instance open.Technical staff is it should be understood that in order to reach best transmitting-receiving effect, at least one LED particle of above-mentioned lamp 21 launches monochromatic light, and launches according to suitable wavelength, thus being obtained better by the reception device of LED particle.
In other embodiments, other electrical equipment can be controlled further by television set 10, for instance water heater 40 is to realize the transmission of some simple switch signals.Control can be performed by processor, in each embodiment above, described processor is to be realized by one or more application specific integrated circuits (ASIC), digital signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor (MCU) or other electronic components, for performing the example of the said equipment and method.
Those skilled in the art, after considering description and putting into practice invention disclosed herein, will readily occur to other embodiment of the present invention.The application is intended to any modification of the present invention, purposes or adaptations, and these modification, purposes or adaptations are followed the general principle of the present invention and include undocumented known general knowledge in the art or conventional techniques means.Description and embodiments is considered only as exemplary, and the true scope of the present invention and spirit are pointed out by appended claim.
Claims (10)
1. the control method of an indoor user electric equipment, it is characterised in that including:
Shoot an indoor scene；
Extracting and separate the image of the consumer electronics equipment presented in captured indoor scene, the image of the consumer electronics equipment wherein presented is the feature embodying this consumer electronics equipment at least partly；
According to the image of consumer electronics equipment that extracts and separate, control network based on indoor electric and send to corresponding consumer electronics equipment and connect signal；And
After described connection completes, send control instruction to described consumer electronics equipment.
2. the control method of indoor user electric equipment according to claim 1, it is characterised in that described to consumer electronics equipment send control instruction also include:
Generate at least similar to captured indoor scene part control interface；
Described control interface carries out the visualization at least one consumer electronics equipment control；
Control operation according to this visualization and generate corresponding control instruction.
3. the control method of indoor user electric equipment according to claim 2, it is characterised in that farther include:
Changing the performance state of the map unit of at least one the consumer electronics equipment embodied in described control interface, wherein, described performance state has included at least the performance state identical with the functional status of this consumer electronics equipment；And
It is numeral conditioned signal by this performance State Transferring, to form described control instruction.
4. the control method of indoor user electric equipment according to claim 3, it is characterised in that described control instruction can be received by multiple controlled consumer electronics equipment simultaneously, wherein the Control Cooling of these multiple controlled consumer electronics equipment is different.
5. the control device of an indoor user electric equipment, it is characterised in that including:
Shooting parts, are used for shooting an indoor scene；
Connect the control parts of described shooting parts, be configured to: extracting and separate the image of the consumer electronics equipment presented in captured indoor scene, the image of the consumer electronics equipment wherein presented is the feature embodying this consumer electronics equipment at least partly；According to the image of consumer electronics equipment that extracts and separate, control network based on indoor electric and send to corresponding consumer electronics equipment and connect signal；And after described connection completes, send control instruction to described consumer electronics equipment.
6. the control device of indoor user electric equipment according to claim 5, it is characterized in that, described control parts include controlling network by described indoor electric and connect the first control parts of several consumer electronics equipment, are configured to: generate at least similar to captured indoor scene part control interface；Described control interface carries out the visualization at least one consumer electronics equipment control；And control the operation corresponding control instruction of generation according to this visualization.
7. the control device of indoor user electric equipment according to claim 6, it is characterized in that, described control parts include again connecting the described first the second control parts controlling parts and shooting parts, it is configured to: change the performance state of the map unit of at least one the consumer electronics equipment embodied in described control interface, wherein, described performance state has included at least the performance state identical with the functional status of this consumer electronics equipment；And by this performance State Transferring be numeral conditioned signal, to form described control instruction.
8. the control device of the indoor user electric equipment according to claim 5 or 6, it is characterised in that it is cable network or wireless network that described indoor electric controls network, or combination of the two.
9. the control device of indoor user electric equipment according to claim 7, it is characterised in that described first controls parts is configured to again: identify the described second type controlling parts or state, to be attached.
10. the control device of the indoor user electric equipment according to any one of claim 5 to 7, it is characterized in that, described control parts are configured to again: complete the control at least another consumer electronics equipment by sending control instruction to a described consumer electronics equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610072604.6A CN105739315B (en) | 2016-02-02 | 2016-02-02 | Control method and device for indoor user electrical equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610072604.6A CN105739315B (en) | 2016-02-02 | 2016-02-02 | Control method and device for indoor user electrical equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105739315A true CN105739315A (en) | 2016-07-06 |
| CN105739315B CN105739315B (en) | 2019-12-06 |
Family
ID=56242192
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610072604.6A Active CN105739315B (en) | 2016-02-02 | 2016-02-02 | Control method and device for indoor user electrical equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105739315B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106200433A (en) * | 2016-08-17 | 2016-12-07 | 北京小米移动软件有限公司 | Equipment long-range control method and device, electronic equipment |
| CN106444396A (en) * | 2016-08-28 | 2017-02-22 | 杭州鸿雁电器有限公司 | Household equipment far-end control system and control method |
| CN106502154A (en) * | 2016-11-04 | 2017-03-15 | 三星电子（中国）研发中心 | For the electric control method of electrical apparatus control system, device and terminal |
| CN106569409A (en) * | 2016-10-13 | 2017-04-19 | 杭州鸿雁电器有限公司 | Graph capturing based household equipment control system, device and method |
| CN106773750A (en) * | 2016-11-11 | 2017-05-31 | 北京小米移动软件有限公司 | Equipment method for displaying image and device |
| CN109218145A (en) * | 2018-08-24 | 2019-01-15 | 英华达（上海）科技有限公司 | Display methods, system, equipment and the storage medium of IOT appliance control interface |
| CN109445352A (en) * | 2018-12-10 | 2019-03-08 | 美的集团武汉制冷设备有限公司 | Appliances equipment control method, household appliance and storage medium |
| CN109521684A (en) * | 2018-11-23 | 2019-03-26 | 维沃移动通信（杭州）有限公司 | A kind of home equipment control method and terminal device |
| CN110086694A (en) * | 2018-01-25 | 2019-08-02 | 日立空调·家用电器株式会社 | Program, household appliances system and household appliances |
| CN113488041A (en) * | 2021-06-28 | 2021-10-08 | 青岛海尔科技有限公司 | Method, server and information recognizer for scene recognition |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101937612A (en) * | 2009-06-30 | 2011-01-05 | 纬创资通股份有限公司 | Real image network control device and correlation method thereof |
| CN103631225A (en) * | 2013-11-26 | 2014-03-12 | 广东威创视讯科技股份有限公司 | Method and device for remotely controlling scene equipment |
| CN103914969A (en) * | 2013-01-07 | 2014-07-09 | 凹凸电子（武汉）有限公司 | Mobile terminal apparatus, and electrical equipment control method |
| WO2014188227A1 (en) * | 2013-05-20 | 2014-11-27 | Thomson Licensing | Remote control programming using images |
| CN104977904A (en) * | 2014-04-04 | 2015-10-14 | 浙江大学 | Visible and controllable intelligent household control system and control method thereof |
| CN105259765A (en) * | 2015-09-18 | 2016-01-20 | 小米科技有限责任公司 | Method and device for generating control interface |
-
2016
- 2016-02-02 CN CN201610072604.6A patent/CN105739315B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101937612A (en) * | 2009-06-30 | 2011-01-05 | 纬创资通股份有限公司 | Real image network control device and correlation method thereof |
| CN103914969A (en) * | 2013-01-07 | 2014-07-09 | 凹凸电子（武汉）有限公司 | Mobile terminal apparatus, and electrical equipment control method |
| WO2014188227A1 (en) * | 2013-05-20 | 2014-11-27 | Thomson Licensing | Remote control programming using images |
| CN103631225A (en) * | 2013-11-26 | 2014-03-12 | 广东威创视讯科技股份有限公司 | Method and device for remotely controlling scene equipment |
| CN104977904A (en) * | 2014-04-04 | 2015-10-14 | 浙江大学 | Visible and controllable intelligent household control system and control method thereof |
| CN105259765A (en) * | 2015-09-18 | 2016-01-20 | 小米科技有限责任公司 | Method and device for generating control interface |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106200433A (en) * | 2016-08-17 | 2016-12-07 | 北京小米移动软件有限公司 | Equipment long-range control method and device, electronic equipment |
| CN106444396A (en) * | 2016-08-28 | 2017-02-22 | 杭州鸿雁电器有限公司 | Household equipment far-end control system and control method |
| CN106569409A (en) * | 2016-10-13 | 2017-04-19 | 杭州鸿雁电器有限公司 | Graph capturing based household equipment control system, device and method |
| CN106502154B (en) * | 2016-11-04 | 2019-10-01 | 三星电子（中国）研发中心 | Electric control method, device and terminal for electrical control system |
| CN106502154A (en) * | 2016-11-04 | 2017-03-15 | 三星电子（中国）研发中心 | For the electric control method of electrical apparatus control system, device and terminal |
| CN106773750A (en) * | 2016-11-11 | 2017-05-31 | 北京小米移动软件有限公司 | Equipment method for displaying image and device |
| CN106773750B (en) * | 2016-11-11 | 2020-06-19 | 北京小米移动软件有限公司 | Equipment image display method and device |
| CN110086694A (en) * | 2018-01-25 | 2019-08-02 | 日立空调·家用电器株式会社 | Program, household appliances system and household appliances |
| CN110086694B (en) * | 2018-01-25 | 2023-08-01 | 日立环球生活方案株式会社 | Storage medium and home appliance system |
| CN109218145A (en) * | 2018-08-24 | 2019-01-15 | 英华达（上海）科技有限公司 | Display methods, system, equipment and the storage medium of IOT appliance control interface |
| CN109218145B (en) * | 2018-08-24 | 2021-10-08 | 英华达（上海）科技有限公司 | IOT equipment control interface display method, system, equipment and storage medium |
| CN109521684A (en) * | 2018-11-23 | 2019-03-26 | 维沃移动通信（杭州）有限公司 | A kind of home equipment control method and terminal device |
| CN109521684B (en) * | 2018-11-23 | 2022-06-17 | 维沃移动通信（杭州）有限公司 | Household equipment control method and terminal equipment |
| CN109445352A (en) * | 2018-12-10 | 2019-03-08 | 美的集团武汉制冷设备有限公司 | Appliances equipment control method, household appliance and storage medium |
| CN113488041A (en) * | 2021-06-28 | 2021-10-08 | 青岛海尔科技有限公司 | Method, server and information recognizer for scene recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105739315B (en) | 2019-12-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105739315A (en) | Indoor user electric appliance equipment control method and device | |
| RU2622405C2 (en) | Light source remote control | |
| CN105843054A (en) | Method for controlling household devices, intelligent household system and mobile device | |
| CN109076680B (en) | Controlling a lighting system | |
| CN104977904B (en) | A kind of visible i.e. controllable intelligent home control system and control method | |
| US9986622B2 (en) | Lighting system, lighting apparastus, and lighting control method | |
| EP2706821B1 (en) | Lighting control system | |
| CN106896732B (en) | Display method and device of household appliance | |
| JP5313153B2 (en) | Light wand for lighting control | |
| CN106302057B (en) | Intelligent home equipment control method and device | |
| JP6310457B2 (en) | Control of a system having one or more controllable devices | |
| CN106664782B (en) | Lamp control device and its lamp control method | |
| CN109076679B (en) | Controlling a lighting system | |
| CN107426886A (en) | Intelligent lightening device | |
| EP2529596A1 (en) | Interactive lighting control system and method | |
| WO2017088331A1 (en) | Control device and operating method | |
| WO2018182856A1 (en) | Image-based lighting controller | |
| JP2019121608A (en) | Terminal equipment and lighting fixture control system | |
| CN115524990A (en) | Intelligent household control method, device, system and medium based on digital twins | |
| CN113424660B (en) | Controller for controlling light source and method thereof | |
| CN110784980A (en) | Life scene-based light configuration method, server and storage medium | |
| CN104541580B (en) | The system that control includes one or more controllable devices | |
| CN107688326A (en) | Control device and its System and method for | |
| CN115914097A (en) | Method of controlling a light emitting device and related device | |
| KR101275902B1 (en) | An air conditioner, air conditioning system and control method for the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |