CN105739315B - Control method and device for indoor user electrical equipment - Google Patents
Control method and device for indoor user electrical equipment Download PDFInfo
- Publication number
- CN105739315B CN105739315B CN201610072604.6A CN201610072604A CN105739315B CN 105739315 B CN105739315 B CN 105739315B CN 201610072604 A CN201610072604 A CN 201610072604A CN 105739315 B CN105739315 B CN 105739315B
- Authority
- CN
- China
- Prior art keywords
- control
- user
- electrical equipment
- indoor
- user electrical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000012545 processing Methods 0.000 claims description 26
- 238000013507 mapping Methods 0.000 claims description 21
- 230000000007 visual effect Effects 0.000 claims description 17
- 230000003750 conditioning effect Effects 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 4
- 230000000875 corresponding effect Effects 0.000 description 14
- 230000000694 effects Effects 0.000 description 7
- 230000008859 change Effects 0.000 description 5
- 230000001276 controlling effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000003213 activating effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000002245 particle Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Selective Calling Equipment (AREA)
Abstract
In one embodiment, there is provided a method of controlling an indoor user electrical device, comprising: shooting an indoor scene; extracting and separating images of the user electrical equipment presented in the shot indoor scene, wherein the presented images of the user electrical equipment at least partially embody the characteristics of the user electrical equipment; sending a connection signal to the corresponding user electrical equipment based on the indoor electrical control network according to the extracted and separated image of the user electrical equipment; and after the connection is finished, sending a control instruction to the user electrical equipment. In another embodiment, a corresponding apparatus for implementing the control method of the indoor user electrical equipment is provided.
Description
Technical Field
the invention mainly relates to a control and interconnection method of intelligent equipment based on images, and belongs to the technical field of indoor intelligent control.
background
with the rapid development of various intelligent home technologies, more and more intelligent devices appear in the lives of people. How to dominantly control the smart devices, reflect the user's activity, and how to conveniently connect the smart devices with each other is an important practical requirement for a large number of users.
to address these needs, the present invention provides a method for control and interconnection of image-based smart devices.
Disclosure of Invention
The invention solves the defects and provides a method and a device for controlling indoor user electrical equipment, which extract the information of household electrical equipment based on the recognition of indoor scene images so as to realize the control and the mutual connection of the household electrical equipment.
In one embodiment, a control method of an indoor user electrical appliance device includes: shooting an indoor scene; extracting and separating images of the user electrical equipment presented in the shot indoor scene, wherein the presented images of the user electrical equipment at least partially embody the characteristics of the user electrical equipment; sending a connection signal to the corresponding user electrical equipment based on the indoor electrical control network according to the extracted and separated image of the user electrical equipment; and after the connection is finished, sending a control instruction to the user electrical equipment.
further, the sending the control instruction to the user electrical equipment further includes: generating a control interface at least partially similar to the captured indoor scene; performing visual control of at least one user electrical device on the control interface; and generating a corresponding control instruction according to the visual control operation.
or, the control method of the indoor user electrical equipment further includes: changing the expression state of a mapping unit of at least one user electric device embodied in the control interface, wherein the expression state at least comprises an expression state which is the same as the functional state of the user electric device; and converting the performance state into a digital conditioning signal to form the control command.
Wherein the control instruction can be received by a plurality of controlled user electrical devices at the same time, wherein the control types of the plurality of controlled user electrical devices are different.
in another embodiment, a control apparatus of an indoor user electrical device includes: a photographing part for photographing an indoor scene; a control section connected to the photographing section, configured to: extracting and separating images of the user electrical equipment presented in the shot indoor scene, wherein the presented images of the user electrical equipment at least partially embody the characteristics of the user electrical equipment; sending a connection signal to the corresponding user electrical equipment based on the indoor electrical control network according to the extracted and separated image of the user electrical equipment; and after the connection is finished, sending a control instruction to the user electrical equipment.
Preferably, the control means comprises a first control means connected to a number of user electrical devices through the indoor electrical control network, configured to: generating a control interface at least partially similar to the captured indoor scene; performing visual control of at least one user electrical device on the control interface; and generating a corresponding control instruction according to the visual control operation.
Or, the control means in turn comprises second control means connecting the first control means and the shooting means, configured to: changing the expression state of a mapping unit of at least one user electric device embodied in the control interface, wherein the expression state at least comprises an expression state which is the same as the functional state of the user electric device; and converting the performance state into a digital conditioning signal to form the control command.
Wherein, the indoor electric control network is a wired network or a wireless network, or the combination of the two.
drawings
FIG. 1 is a schematic diagram of a method for controlling an electrical device of an indoor user according to the present invention;
FIG. 2 pictorially depicts a control interface on a portable digital device;
FIG. 3 is a schematic diagram of the connection circuit of the indoor electric appliance;
FIG. 4 pictorially depicts a control scheme;
FIG. 5 is a flow chart of a control method of the present invention;
fig. 6 is a variation of the control method of fig. 5.
Detailed Description
the contents of the embodiments of the present invention and the effects thereof will be described in detail with reference to the accompanying drawings. The image recognition technology is used in the current intelligent home system, so that the operation of a user is facilitated, and the user can implement the technical scheme of the invention to obtain obvious convenience. It should be understood that the control means or data processing means used in the present invention may be selected according to the actual needs of the user. Some of the control devices may be existing hardware devices, for example, which may be modified based on the present invention to implement the functions of the present invention, and some other control devices may be conveniently installed without changing the wiring structure of the power in the home, for example, by means of a Power Line Carrier (PLC).
The control components may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, Microprocessors (MCUs), or other electronic components for performing the examples of the apparatus and methods described below.
in an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions to perform the control method of the present invention, such as a non-volatile memory device comprising such instructions, is also provided, which are executable by a processor of the control component to perform the method described above. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Taking fig. 1 as an example, in various embodiments of the present invention, the indoor user electrical equipment may refer to household electrical appliances of users of indoor residences, such as a television 10, a refrigerator, a washing machine, and the like, and may also refer to power wiring and its attached components of indoor residences, such as a wall switch, a window 30, or a lamp 21.
As shown in fig. 1, the control device of the indoor user electrical appliance may include a photographing part for photographing an indoor scene 100. The shooting component may be a video camera, a still camera or other video recording devices, or an embedded video camera, such as a camera of a Personal Computer (PC), in this embodiment, a camera of a personal portable digital device may be used as an example, so that a user may shoot a household appliance to be controlled in a mobile manner, or may store or combine the shot images after shooting for multiple times, and then control the appliance presented in the image in a manner of fixing the portable digital device, for example, the user may place the portable digital device on a desk, and the user needs to perform other work at this time.
The indoor scene 100 photographed by using the photographing part may be a plurality of continuous photographs, and in one example, in order to achieve a better image recognition effect, the user may choose to repeatedly photograph the same indoor scene 100 for a plurality of times to obtain an optimal photographing effect. In another example, the photo images taken may be different from each other, and the user may choose to take the indoor scene 100 at different angles in multiple different spaces in the room, such as three images in the living room, bedroom, and kitchen, which may be combined to allow the user more extended and convenient control.
in general, the control apparatus described above further includes a control section connected to the photographing section, configured to: extracting and separating images of the user electrical equipment presented within the captured indoor scene 100, wherein the presented images of the user electrical equipment are at least partially characteristic of the user electrical equipment; sending a connection signal to the corresponding user electrical equipment based on the indoor electrical control network according to the extracted and separated image of the user electrical equipment; and after the connection is finished, sending a control instruction to the user electrical equipment.
As shown in FIG. 2, in a preferred example, the control means may comprise at least one portable digital device 202, such as a cell phone, or a tablet computer, as is known in the art. A user may take multiple images of a scene through the portable digital device 202, such as scene 101 capable of presenting one corner of a living room, scene 102 capable of displaying another corner of a living room, and scene 103 capable of presenting one corner of a kitchen, where the scenes 101, 102, 103 may be processed by the portable digital device 202 to combine into a combined image. The portable digital device 202 may also separate (e.g., crop) controlled home appliances from an image of the indoor scene 100 and combine the separated images to form a combined scene image. For example, the scene 101 and the scene 102 are from the scene 100, that is, the television 10 and the window 30 are mainly presented in the scene 101 as the main household appliance devices, and unlike the scene 100, the scene background of the scenes other than the household appliances in the scenes 101 and 102 is changed to some extent, but according to the effect of the embodiment of the present invention, the household appliances in the above scenes can be continuously identified.
In particular, the control component (e.g., portable digital device 202) may include a graphics processing unit configured to:
Combining the extracted and separated user electrical appliance device images, for example, repeatedly shooting one household electrical appliance or shooting the same household electrical appliance in different scenes, and then combining the images. The combination mode can be a conventional image synthesis technology, and can also be a color synthesis or splicing mode performed to avoid light dim (for example), one splicing mode is a mode according to fig. 2, and the other splicing mode can be a panoramic mode, namely, an image with continuously changed visual angles is shot according to time setting, so that the visual angle range of the shooting component can be extended, and the control of a larger visual angle range is realized;
the control device may have a memory, and the features of the user electrical equipment are read by the control unit corresponding to the feature identifiers stored therein. The recognition of the features includes various processing modes of the image, for example, a front image of a clearer window 30 may be captured according to a preset image comparison mode, the front image is used for performing numerical comparison with a preset image, and if the recognition meets a set condition, the graphic processing unit determines the user electrical equipment image in the scene 101 as a "window". Thus, if the window 30 is an electrical device, it will be controlled by the control means described above. In fig. 2, the window 30 is identified by setting a minimum identification area 111, and the above-described processing is performed on the image of the window 30 in the minimum identification area 111 in the actual identification process. Alternatively, the identification is generated from a unique identifier of each user electrical device. For example, the identifier (e.g., a bar code) may be applied on each household appliance, an image of the identifiers is obtained when the household appliance is photographed, and through recognition of the identifier image, the graphics processing unit may read the identifier to generate a corresponding association for each household appliance; and
And associating the same user electrical equipment in different indoor scene areas according to the characteristic identifiers, so that the user electrical equipment presented in one of the user electrical equipment images for the combination is not presented and controlled in the other user electrical equipment images. For example, in scenes 101 and 102, if window 30 is simultaneously present in scene 102, the graphics processing unit will determine that window 30 in scene 102 is a background image and will not be recognized or, alternatively, is isolated from scene 102. It should be understood that the combined image may not be continuous in graphical composition, only highlighting the home appliance that the user desires to control.
in one embodiment, the control component may be a split electrical component. The control means may comprise a first control means connected to a number of user electrical devices through said in-house electrical control network, such as the stationary digital device 201 (e.g. a computer or a server) in fig. 1, configured to: generating a control interface at least partially similar to the captured indoor scene 100; performing visual control of at least one user electrical device on the control interface; and generating a corresponding control instruction according to the visual control operation.
In another embodiment, the control component in turn comprises a second control component, such as a portable digital device 202 (e.g., a cell phone), connecting the first control component and the camera component, configured to: changing the performance state of the mapping unit 213 of at least one user electrical device embodied in the control interface 212, wherein the performance state at least comprises the same performance state as the functional state of the user electrical device; and converting the performance state into a digital conditioning signal to form the control command.
in yet another embodiment, the control unit may include both the fixed digital device 201 and the portable digital device 202, and further, the indoor electrical control network may be a wired network or a wireless network, or a combination of both. For example, the indoor electrical control network may be implemented by a Wi-Fi, ZigBee or HAN network, or may be implemented by a PLC method, and as shown in fig. 3, the control unit may be configured to be in communication connection with each household appliance in a parallel manner, where the fixed digital device 201 may transmit the power line carrier signal S1 to each appliance device in a power line manner, and the portable digital device 202 may be in communication connection with the fixed digital device 201 in a ZigBee manner.
in a variant, the television 10 may be communicatively connected to the stationary digital device 201 via said power line L, N, the lights 21 (in particular LED lights) being connected in parallel as well as to the television 10. In contrast, in the illustrative example of fig. 3, the lamp 21 is connected in a manner different from that of the tv 10, and the lamp 21 can be controlled by the control panel 251 rather than directly by the fixed digital device 201, which has the effect that the original wiring manner of the indoor electrical network does not need to be changed, but instead, the control panel 251 is modified. According to the above embodiments, the user may control the control panel 251 by shooting the control panel 251, or the user may control the control panel 251 in a Wi-Fi manner through the portable digital device 202, and herein, the control panel 251 is provided with a wireless transceiver for responding and modulating the ZigBee or Wi-Fi signal. If the lamp 21 is arranged in the manner of fig. 3, which can be controlled (e.g. adjustable brightness, color temperature or color), the power line carrier signal S1 will be transmitted between nodes c to d on the power line, whereas the power line carrier signal S1 is not present at nodes a and b, and the digital carrier dimming signal S2 can be generated only between the control panel 251 and the lamp 21 by a conditioning manner similar to the power line carrier signal S1, which has the effect that it is not disturbed by the signal transmitted between nodes c and d.
in particular, the first control component may in turn be configured to identify the type or state of the second control component for connection. For example, according to the embodiment shown in fig. 1, the portable digital device 202 may communicate with the fixed digital device 201 through a Wi-Fi network, so that the indoor scene 100 generated in the fixed digital device 201 may be correspondingly presented in the mapping unit 213 of the portable digital device 202, the mapping unit 213 and the control interface 212 may be presented to the user on the portable digital device 202 at the same time, and the control interface 212 may also be presented full screen directly in the manner shown in fig. 2, and the presentation manner may be switched by a user operation manner, such as turning or rotating. Therefore, the user can change the control mode into a mobile mode, and can even control the state change of the indoor user electrical equipment under the outdoor condition. In this application, the fixed digital apparatus 201 needs to identify the type of the portable digital apparatus 202, so as to identify the identity of the user using the portable digital apparatus 202, in the example of fig. 2, the identification can be implemented by using the identification unit 232 of the portable digital apparatus 202, such as the biometric unit 232 (e.g., a metal inductive loop) of a conventional mobile phone (e.g., a mobile phone). Alternatively, in order to control the household appliance more accurately, the stationary digital device 201 needs to recognize the usage state of the portable digital device 202 in real time, for example, if the user has turned off the lamp 21 or 22 on the control interface of the portable digital device 202, the lamp 21 or 22 should be changed to the off state accordingly in the indoor scene 100 presented in the display unit 241 of the stationary digital device accordingly. In this way, the user can more conveniently switch between the control forms of the fixed and portable digital devices described above.
As a variant, the control means are in turn configured to: control of at least one other user electrical device is accomplished by sending a control instruction to one of the user electrical devices.
In one application of this variant, the signal may be transmitted to the household appliances in the room by means of the lamp 21, for example by means of light. The above-described camera components may be integrated into the portable digital device 202 and configured to receive signals transmitted via light, and it will be understood by those skilled in the art that the signals transmitted using the lamps 21 may have different modulation schemes and frequencies, and that the connection scheme shown in fig. 3 will not be used separately in order to obtain a larger length of data frames in the light-transmitted signals, and that the lamps 21 may be connected in parallel as in the tv play 10, or may be connected via optical cables (for example) to provide illumination power via optical fibers. In one example, the status response signal of the home appliance may be transmitted through a light to enable a user to obtain information expressed therein.
for example, FIG. 4 pictorially illustrates an example of an application in which the lamp 21 at a desk placed in a user's room is a smart LED lamp that is connected to a wall outlet or the aforementioned control panel 251 by a lead 252 for power. In the manner of the foregoing embodiment, the power line carrier signal S1 may be transmitted to the demodulation device within the lamp 21 via the lead 252, thereby achieving carrier transmission of data. Data may be modulated and transmitted by light emitted from lamp 21. In one example, the camera component may be a front-facing camera 242 of the portable digital device 202 (e.g., a mobile phone), and data may be carried in a light wave (e.g., flickers) at a specific modulation frequency or wavelength by using a light-sensitive characteristic of the camera, so that the demodulation device in the portable digital device 202 receives and demodulates the light wave to obtain data content therein.
In another application of this variation, the lamp 21 may be placed next to the window 30, the lamp 21 is provided with a photosensitive member configured to sense the light intensity of the environment (e.g., projected into the room from outside the window 30), the lamp 21 is turned on when the ambient light intensity is below a threshold value set by the lamp 21, the lamp 21 illuminates the portable digital device 202 to transmit scene information, which may include different conditions prompting the user for alternative operations, such as lighting a portion of the scene lighting device in the room, or activating a portion of other electrical devices that the user desires and presets to activate when the light is dim, such as activating a curtain to close, etc. Of course, the user may also set the portable digital device 202 to sense the external illumination intensity and send the activation signal to the lamp 21 when the light intensity is lower than the preset threshold.
Based on the foregoing embodiments, a method of controlling one or more indoor user electrical devices may be implemented, which in one general aspect may include:
Step S100, shooting an indoor scene 100, according to the foregoing embodiments, the scene may be directly obtained by a shooting component of the portable digital device 202, or may be obtained and processed by the fixed digital device 201 to form a mapping unit 213 on a display interface of the portable digital device 202;
step S200, extracting and separating images of user electrical devices (e.g., the lamp 21 or 22, the television 10 and the control panel 251) presented in the photographed indoor scene 100, wherein the presented images of the user electrical devices at least partially embody the characteristics of the user electrical devices;
Step S300, according to the extracted and separated images of the user electrical equipment, sending a connection signal to the corresponding user electrical equipment based on an indoor electrical control network; and
And step S400, after the connection is finished, sending a control instruction to the user electrical equipment.
Example 1: method for controlling indoor lighting equipment
in step S400 of the above method, the sending the control instruction to the user electrical equipment further includes:
Step S410, generating a control interface 212 at least partially similar to the captured indoor scene 100. In order to more clearly acquire the images of the household appliances that may exist in the scene 100, the user may select a shooting component of the fixed digital device 201 in various ways, such as an external camera or a video camera with higher external camera pixels, to obtain a partial image of the indoor scene 100 or a partial area of the indoor scene 100 (such as shown in fig. 1, which may be presented as a living room). The user photographs a plurality of lamps 21 and 22 installed on a top surface (e.g., a ceiling or a decorative ceiling) of a building within the scene 100, and the user may obtain information of the lamps 21 and 22 using the stationary digital device 201 by:
rasterizing the captured image of the indoor scene 100, the rasterizing may distinguish each of the finer scenes contained within the scene 100, such as each of the scenes 101/102/103 shown in fig. 2, and the like, using a "mesh" G1, G2, which is a virtual number of boundaries set by a graphics processing unit within the fixed digital device 201 for layering the image presented within the indoor scene 100, wherein the graphics processing unit is configured to divide the indoor scene 100 or the finer scenes therein into a plurality of sections using the mesh, and compare image parameters (e.g., grayscale values) of each of the plurality of sections in succession with image parameters (e.g., grayscale values) of a previous section to identify the appearance and perspective of the user electrical device that may be present within the section.
The shape and the angle of view may be determined by the graphic processing unit, and the widths of the above sections may be variable and different from each other. For example, if the user selects to photograph an indoor scene 100 from a perspective at the center of the scene, the graphics processing apparatus first sets the farthest position in the scene 100 as a reference point, and generates a plurality of concentric grids (e.g., G1 and G2) outward from the reference point as a minimum segment, with at least one user electrical device being framed between the two grids. In this way, the viewing angle can be initially determined, from which the outer shape of a consumer electrical device can be recognized for comparison with the predetermined model in the memory. For example, in the scene 100, the window 30 is framed in a section and is a frontal view that will be most easily recognized by the graphics processing unit. The tv 10 has a certain viewing angle in the scene 100, and the characteristics of the tv 10 can be determined by performing data operation (e.g., convolution) on a portion of the tv 10 within the range of the section defined by the grids G1 and G2 according to the previously identified viewing angle. For certain situations, such as a regular arrangement of the lamps 21 and 22 in the indoor scene 100, the positions of the lamps may be framed according to the grid, and the positions of the grid may be adjusted to determine the determined sections of the lamps 21 and 22, such as by intersecting the grids in two dimensions to determine the positions of the lamps 21 and 22.
step S420, performing visual control on at least one user electrical device on the control interface 212. An example of a control interface 212 is explicitly depicted in fig. 1, where the grid is removed when the user chooses to use the portable digital device 202 to control the lights 21 and 22 in the scene 100, which allows the user to manipulate more intuitively and visually. In the above step S200, the grid is provided for extracting and separating the home appliances within each section, thereby more accurately identifying the home appliances. If the graphics processing unit has effectively separated and identified the household appliance features in each section, these sections can be recombined into a mapping unit 213 shown in fig. 1, in which mapping unit 213 the position of the household appliance controlled therein can be determined again from the above-mentioned grid, and a selection module can be generated at each position. For example, if the user desires the lamp 21 to be lit, the selection module 211 of the lamp 21 may be pressed in the mapping unit 213, and thus if the portable digital device 202 determines the pressing signal, its processor will change the parameters of the selection module 211. Likewise, the lamp 22 is originally in the lighting state, and the user can also press the position of the selection module 221 in the mapping unit 213, so that the parameter of the selection module 221 will be changed.
And step S430, generating a corresponding control instruction according to the visualization control operation. In the above steps, the visualization operation is performed based on the portable digital device 202 that can be touched, and for a digital device without touch operation, other manners, such as mouse click, can be adopted. The above-mentioned variation of the parameters of the respective selection module will be received and evaluated by the processor to generate a control command for the lamp 21 or 22. In a preferred example, the content of the control command may include not only the on/off signal of the lamp, but also the change signal of the brightness, color temperature or color of the lamp, and the control of these change signals can be operated in the mapping unit 213 by, for example, different gestures.
In general, the method may further include:
Step S421, changing the performance state of the mapping unit 213 of at least one user electrical device embodied in the control interface 212, where the performance state at least includes a performance state identical to the functional state of the user electrical device; and
Step S422, converting the performance status into a digital conditioning signal to form the control command.
Further, the control command may be simultaneously received by a plurality of controlled user electric devices (e.g., lamps 21 and 22) at the same time, wherein the control types of the plurality of controlled user electric devices are different.
Example 2: method for controlling indoor household electrical appliance
Fig. 2 is a schematic diagram illustrating a plurality of scenes presenting different home appliances, and in step S200, the method may further include:
Step 210, combining the extracted and separated images of the user electrical equipment, for example, shooting a plurality of scenes containing different household electrical appliances, for example, the scene 101 containing the window 30, the scene 102 containing the television 10 and the scene 103 protecting the water heater 40 and the microwave oven 50, and then combining the images. The combination method is a conventional image combination technology, and can also be a color combination or a splicing method performed to avoid the light dim, for example, one splicing method is a splicing method according to the method shown in fig. 2, and the other splicing method can be a panoramic method, namely, an image with continuously changed visual angles is shot according to the time setting, so that the visual angle range of the shooting component can be extended, and the control of a larger visual angle range is realized.
Step 220, the images of the user electrical equipment presented in the combined images are identified, and features representing the user electrical equipment are extracted to generate feature identifiers.
The aforementioned control device may have a memory, and the characteristics of the user electrical equipment will be read out by the control unit corresponding to the characteristic identifier stored therein. The recognition of the features includes various processing modes of the image, for example, a front image of a clearer window 30 may be captured according to a preset image comparison mode, the front image is used for performing numerical comparison with a preset image, and if the recognition meets a set condition, the graphic processing unit determines the user electrical equipment image in the scene 101 as a "window". Thus, if the window 30 is an electrical device, it will be controlled by the control means described above. In fig. 2, the window 30 is identified by setting a minimum identification area 111, and the above-described processing is performed on the image of the window 30 in the minimum identification area 111 in the actual identification process. Alternatively, the identification is generated from a unique identifier of each user electrical device. For example, the identifier (e.g., a bar code) may be applied on each household appliance, an image of the identifiers is obtained when the household appliance is photographed, and through recognition of the identifier image, the graphics processing unit may read the identifier to generate a corresponding association for each household appliance; and
And step 230, associating the same user electrical equipment in different indoor scene areas according to the characteristic identifiers, so that the user electrical equipment presented in one of the user electrical equipment images for the combination is not presented and controlled in the other user electrical equipment images. For example, in scenes 101 and 102, if window 30 is simultaneously present in scene 102, the graphics processing unit will determine that window 30 in scene 102 is a background image and will not be recognized or otherwise isolated from scene 102.
In addition, as a variant, in step S421, changing the performance state of the mapping unit 213 of the at least one user electrical device embodied within the control interface 212 further comprises:
Step S4211, selecting a selection module of the user electrical equipment presented in the mapping unit 213. For example, in fig. 2, the user wants to control the usage status of the microwave oven 50 (e.g., set the heating time) in the scene 103, but since the size and the touch area of the control interface cannot accurately and carefully meet the operation habit, the user can press the selection module 113 to select the selection module 113, and then the user can enlarge the selection module 113 to a proper size on the control interface, and the gpu forms the selection module 113 into a new scene 104. Wherein the zooming manner can be a conventional manner, such as dragging with a finger, continuously pressing, etc.;
step S4212, generating a new scene according to the selection module, and generating a plurality of new selection modules reflecting the performance status of the user electrical equipment in the scene. In fig. 2, a new scene 104 may be presented on the original control interface at the same time, and the user may remove an unwanted scene or iterate with this new scene 104. The graphics processing unit will generate new selection modules in the scene 104, such as the mode selection module 51 and the time selection module 52 shown in fig. 2, which the user can control in a pressing manner as well.
The processor generates the selection modules in the new scene according to the feature identifiers, the selection modules in the new scene are related to the features of the user electrical equipment in the initial scene in terms of data, and the control parameters corresponding to each selection module can be obtained from the user electrical equipment when the user electrical equipment is connected in the control of the initial scene.
Example 3: mutual control method for indoor electrical equipment
in the above method steps, the method may further include: control of at least one other user electrical device is accomplished by sending a control instruction to one of the user electrical devices.
Referring to fig. 1 to 4, the lamps 21 or 22 in the indoor scene 100 may be identified according to the steps of the aforementioned method, or an initially or optimally identified household appliance may be set by the graphic processing unit, and if the initially identified household appliance has the aforementioned control component or has the minimum function of the control component, the control of other appliances may be implemented. For example, the fixed digital device 201 recognizes the lamp 21, and according to the embodiment shown in fig. 4, the lamp 21 can be used as a transmitting component, and the power line carrier signal S1 can be transmitted to the demodulating device in the lamp 21 through the lead 252, so as to implement the carrier transmission of data. Data may be modulated and transmitted by light emitted from lamp 21. If the lamp 21 receives the digital control command from the power line carrier signal S1 transmitted by the fixed digital device 201, the digital control command can be forwarded to another electrical appliance, such as the tv 10, and the tv 10 can have a receiving device (e.g. a conventional signal transceiver for receiving signals transmitted by a tv remote controller) for receiving signals transmitted by the lamp 21, for example, the lamp 21 can emit infrared light to illuminate the tv 10, and the tv 10 performs a corresponding action, such as turning on, after receiving the digital signal carried in the infrared light. The skilled person will understand that for optimal transceiving, at least one LED particle of the above-mentioned lamp 21 emits monochromatic light and at a suitable wavelength, so as to be better captured by the receiving means of the LED particle.
in other embodiments, other appliances, such as water heater 40, may be further controlled by television 10 to enable the delivery of some simple switching signals. Control may be performed by a processor, which in the various embodiments above is implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, Microprocessors (MCUs), or other electronic components, which are adapted to perform examples of the above-described apparatus and methods.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
Claims (12)
1. A control method of indoor user electrical equipment is characterized by comprising the following steps:
shooting indoor scenes, wherein one user electrical equipment is shot repeatedly or the same user electrical equipment is shot in different scenes, and shot images are combined;
extracting and separating images of the user electrical equipment presented in the shot indoor scene, wherein the presented images of the user electrical equipment at least partially embody the characteristics of the user electrical equipment;
Sending a connection signal to the corresponding user electrical equipment based on the indoor electrical control network according to the extracted and separated image of the user electrical equipment; and
after the connection is finished, sending a control instruction to the user electric equipment,
Wherein said extracting and separating the captured image of the user electrical device presented within the indoor scene further comprises:
combining the extracted and separated user electrical equipment images;
Identifying the images of the user electrical equipment presented in the combined images, extracting the characteristics of the user electrical equipment to generate characteristic identifiers; and
Associating the same user electrical equipment in different indoor scene areas according to the feature identifiers to determine that the user electrical equipment presented in one of the user electrical equipment images for the combination will not be presented or controlled by other electrical equipment images;
Wherein said sending a control instruction to the user electrical device further comprises:
Generating a control interface at least partially similar to the shot indoor scene, rasterizing the shot graphics of the indoor scene and distinguishing each finer scene contained in the scene by using a grid, wherein the grid is virtual boundaries set by a graphics processing unit for layering images presented in the indoor scene, the indoor scene or the finer scenes can be divided into a plurality of sections by using the grid, and comparing image parameters of each section and a previous section in the plurality of continuous sections to identify the appearance and the view angle of the user electrical equipment possibly existing in the section;
performing visual control of at least one user electrical device on the control interface; and
And generating a corresponding control instruction according to the visual control operation.
2. the control method of an indoor user electrical appliance device according to claim 1, further comprising: the grid is removed when a portable digital device is employed to control an appliance device in a current indoor scene, wherein
if the graphic processing unit has effectively separated and identified the electrical equipment characteristics in each section, the sections are recombined into a mapping unit, the position of the controlled electrical equipment in the mapping unit can be determined again according to the grids, and a selection module is generated at each position.
3. the control method of an indoor user electric appliance device according to claim 2, further comprising:
changing the expression state of a mapping unit of at least one user electric device embodied in the control interface, wherein the expression state at least comprises an expression state which is the same as the functional state of the user electric device; and
And converting the expression state into a digital conditioning signal to form the control instruction.
4. The control method of an indoor user electric appliance device of claim 3,
Selecting a selection module of the user electrical equipment presented in the mapping unit; and
Generating a new scene according to the selection module, and generating a plurality of new selection modules which reflect the performance states of the user electrical equipment in the scene; wherein the selection module in the new scene is data related to the characteristics of the user electrical device in its original scene.
5. The control method of an indoor user electrical appliance device according to claim 3, wherein the control command is simultaneously received by a plurality of controlled user electrical appliance devices having different control types.
6. a control device for indoor user electrical equipment is characterized by comprising:
the shooting component is used for shooting an indoor scene, wherein one piece of user electrical equipment is shot repeatedly or the same piece of user electrical equipment is shot in different scenes, and shot images are combined;
A control section connected to the photographing section, configured to: extracting and separating images of the user electrical equipment presented in the shot indoor scene, wherein the presented images of the user electrical equipment at least partially embody the characteristics of the user electrical equipment;
Sending a connection signal to the corresponding user electrical equipment based on the indoor electrical control network according to the extracted and separated image of the user electrical equipment; and
after the connection is finished, sending a control instruction to the user electric equipment,
Wherein the control component further comprises a graphics processing unit configured to:
Combining the extracted and separated user electrical equipment images;
identifying the images of the user electrical equipment presented in the combined images, extracting the characteristics of the user electrical equipment to generate characteristic identifiers; and
associating the same user electrical equipment in different indoor scene areas according to the feature identifiers to determine that the user electrical equipment presented in one of the user electrical equipment images for the combination will not be presented or controlled by other electrical equipment images;
a first control component connected to a number of user electrical devices through the indoor electrical control network, configured to:
Generating a control interface at least partially similar to the captured indoor scene;
Performing visual control of at least one user electrical device on the control interface; generating a corresponding control instruction according to the visual control operation;
A graphics processing unit configured to:
rasterizing the shot graph of the indoor scene and distinguishing each finer scene contained in the scene by using grids;
setting virtual boundaries for layering images presented within the indoor scene, dividing the indoor scene or a finer scene thereof into a plurality of sections by the grid, and comparing image parameters of each of the plurality of sections in succession with a previous section to identify the appearance and viewing angle of the user electrical device that may be present within the section.
7. The control device of indoor user electrical equipment as claimed in claim 6, wherein the control part further comprises a second control part connecting the first control part and the photographing part, configured to: changing the expression state of a mapping unit of at least one user electric device embodied in the control interface, wherein the expression state at least comprises an expression state which is the same as the functional state of the user electric device; and converting the performance state into a digital conditioning signal to form the control command.
8. The control apparatus of indoor user electrical equipment of claim 7, wherein the control part comprises a fixed digital device and a portable digital device communicating therewith, and the indoor electrical control network is divided into a wired network and a wireless network, wherein
The control component is arranged in a mode of being in communication connection with each user electrical equipment in a wired mode in a parallel mode, and the portable digital equipment is in communication connection with the fixed digital equipment in a wireless mode.
9. The control device of the indoor user electrical equipment according to claim 8, wherein the fixed digital equipment transmits a power line carrier signal to each user electrical equipment through a power line.
10. The control apparatus of an indoor user electrical appliance device of claim 7, wherein the first control part is further configured to: the type or state of the second control means is identified for connection, so that the indoor scene generated in the stationary digital device is correspondingly presented in the mapping unit of the portable digital device, on which the mapping unit and the control interface are simultaneously presented to the user.
11. the control apparatus of an indoor user electrical appliance device of claim 10, wherein the stationary digital device is further configured to identify a device type of the portable digital device, thereby identifying a user identity of a manipulation performed using the portable digital device, wherein the identification is performed remotely using an identification unit in the portable digital device.
12. The control arrangement of an indoor user electrical appliance device according to claim 6 or 7, characterized in that the control means is in turn configured to: control of at least one other user electrical device is accomplished by sending a control instruction to one of the user electrical devices.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610072604.6A CN105739315B (en) | 2016-02-02 | 2016-02-02 | Control method and device for indoor user electrical equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610072604.6A CN105739315B (en) | 2016-02-02 | 2016-02-02 | Control method and device for indoor user electrical equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105739315A CN105739315A (en) | 2016-07-06 |
| CN105739315B true CN105739315B (en) | 2019-12-06 |
Family
ID=56242192
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610072604.6A Active CN105739315B (en) | 2016-02-02 | 2016-02-02 | Control method and device for indoor user electrical equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105739315B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106200433A (en) * | 2016-08-17 | 2016-12-07 | 北京小米移动软件有限公司 | Equipment long-range control method and device, electronic equipment |
| CN106444396A (en) * | 2016-08-28 | 2017-02-22 | 杭州鸿雁电器有限公司 | Household equipment far-end control system and control method |
| CN106569409A (en) * | 2016-10-13 | 2017-04-19 | 杭州鸿雁电器有限公司 | Graph capturing based household equipment control system, device and method |
| CN106502154B (en) * | 2016-11-04 | 2019-10-01 | 三星电子（中国）研发中心 | Electric control method, device and terminal for electrical control system |
| CN106773750B (en) * | 2016-11-11 | 2020-06-19 | 北京小米移动软件有限公司 | Equipment image display method and device |
| JP6815339B2 (en) * | 2018-01-25 | 2021-01-20 | 日立グローバルライフソリューションズ株式会社 | Programs, appliances systems and appliances |
| CN109218145B (en) * | 2018-08-24 | 2021-10-08 | 英华达（上海）科技有限公司 | IOT equipment control interface display method, system, equipment and storage medium |
| CN109521684B (en) * | 2018-11-23 | 2022-06-17 | 维沃移动通信（杭州）有限公司 | Household equipment control method and terminal equipment |
| CN109445352B (en) * | 2018-12-10 | 2020-12-22 | 美的集团武汉制冷设备有限公司 | Household appliance control method, household appliance and storage medium |
| CN113488041A (en) * | 2021-06-28 | 2021-10-08 | 青岛海尔科技有限公司 | Method, server and information recognizer for scene recognition |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101937612A (en) * | 2009-06-30 | 2011-01-05 | 纬创资通股份有限公司 | Real image network control device and correlation method thereof |
| CN103631225A (en) * | 2013-11-26 | 2014-03-12 | 广东威创视讯科技股份有限公司 | Method and device for remotely controlling scene equipment |
| CN103914969A (en) * | 2013-01-07 | 2014-07-09 | 凹凸电子（武汉）有限公司 | Mobile terminal apparatus, and electrical equipment control method |
| WO2014188227A1 (en) * | 2013-05-20 | 2014-11-27 | Thomson Licensing | Remote control programming using images |
| CN104977904A (en) * | 2014-04-04 | 2015-10-14 | 浙江大学 | Visible and controllable intelligent household control system and control method thereof |
| CN105259765A (en) * | 2015-09-18 | 2016-01-20 | 小米科技有限责任公司 | Method and device for generating control interface |
-
2016
- 2016-02-02 CN CN201610072604.6A patent/CN105739315B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101937612A (en) * | 2009-06-30 | 2011-01-05 | 纬创资通股份有限公司 | Real image network control device and correlation method thereof |
| CN103914969A (en) * | 2013-01-07 | 2014-07-09 | 凹凸电子（武汉）有限公司 | Mobile terminal apparatus, and electrical equipment control method |
| WO2014188227A1 (en) * | 2013-05-20 | 2014-11-27 | Thomson Licensing | Remote control programming using images |
| CN103631225A (en) * | 2013-11-26 | 2014-03-12 | 广东威创视讯科技股份有限公司 | Method and device for remotely controlling scene equipment |
| CN104977904A (en) * | 2014-04-04 | 2015-10-14 | 浙江大学 | Visible and controllable intelligent household control system and control method thereof |
| CN105259765A (en) * | 2015-09-18 | 2016-01-20 | 小米科技有限责任公司 | Method and device for generating control interface |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105739315A (en) | 2016-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105739315B (en) | Control method and device for indoor user electrical equipment | |
| CN109076680B (en) | Controlling a lighting system | |
| RU2622405C2 (en) | Light source remote control | |
| KR101700442B1 (en) | Method and computer implemented apparatus for controlling a lighting infrastructure | |
| CN109076679B (en) | Controlling a lighting system | |
| EP2879470B1 (en) | Control method of mobile device | |
| US9226370B2 (en) | Lighting control device | |
| US10295972B2 (en) | Systems and methods to operate controllable devices with gestures and/or noises | |
| EP2779651A1 (en) | Configuring a system comprising a primary image display device and one or more remotely lamps controlled in accordance with the content of the image displayed | |
| CN110196557B (en) | Equipment control method, device, mobile terminal and storage medium | |
| JP2016525732A (en) | Device with graphic user interface for controlling lighting characteristics | |
| WO2010141076A1 (en) | Virtual room-based light fixture and device control | |
| CN109691237A (en) | Light control | |
| CN114585131A (en) | Lamp effect control method and device, computer equipment and storage medium | |
| CN105785784A (en) | Smart home scene visualization method and smart home scene visualization device | |
| WO2018182856A1 (en) | Image-based lighting controller | |
| CN109283850A (en) | Household appliance, the control method of household appliance and storage medium | |
| JP2019121608A (en) | Terminal equipment and lighting fixture control system | |
| WO2018142771A1 (en) | Control device, control method, and illumination system | |
| EP3928595B1 (en) | A controller for controlling light sources and a method thereof | |
| JP2001250696A (en) | Automatic illumination setting system | |
| CN110784980A (en) | Life scene-based light configuration method, server and storage medium | |
| CN110809353A (en) | Lamplight matching method, server and storage medium | |
| CN110671652A (en) | Lamp, light setting method thereof and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |