CN111752165A - Intelligent equipment control method and device of intelligent home system - Google Patents
Intelligent equipment control method and device of intelligent home system Download PDFInfo
- Publication number
- CN111752165A CN111752165A CN202010665220.1A CN202010665220A CN111752165A CN 111752165 A CN111752165 A CN 111752165A CN 202010665220 A CN202010665220 A CN 202010665220A CN 111752165 A CN111752165 A CN 111752165A
- Authority
- CN
- China
- Prior art keywords
- target
- intelligent
- behavior state
- control
- intelligent home
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000001514 detection method Methods 0.000 claims abstract description 79
- 238000013507 mapping Methods 0.000 claims abstract description 42
- 230000006399 behavior Effects 0.000 claims description 94
- 230000015654 memory Effects 0.000 claims description 20
- 230000009471 action Effects 0.000 claims description 13
- 230000008859 change Effects 0.000 claims description 5
- 230000033001 locomotion Effects 0.000 description 17
- 239000002609 medium Substances 0.000 description 10
- 230000008569 process Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000013527 convolutional neural network Methods 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000003542 behavioural effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001144 postural effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Selective Calling Equipment (AREA)
Abstract
The embodiment of the application discloses an intelligent equipment control method and device of an intelligent home system. According to the technical scheme, the target is detected in real time, when the target is detected, video image data of the target are obtained, the video image data are input into a preset behavior state detection model, the behavior state of the current target is determined, and the corresponding intelligent home equipment of the intelligent home system is adjusted and controlled according to the behavior state of the current target and a preset mapping control mode. By adopting the technical means, the corresponding intelligent household equipment of the intelligent household system can be automatically and intelligently controlled according to the real-time behavior state of the user, the control operation of the user is reduced, the control flexibility and convenience of the intelligent household equipment are improved, and the use experience of the user on the intelligent household system is optimized.
Description
Technical Field
The embodiment of the application relates to the technical field of intelligent home, in particular to an intelligent equipment control method and device of an intelligent home system.
Background
At present, with the rapid development of the internet of things and the internet technology, the demand for the household intelligent home system is more and more strong. The intelligent home system combines a plurality of modern scientific technologies such as an automatic control system, a computer network system, a network communication technology and the like to create a networked and intelligent home control system, so that the management of the home equipment which is fragmented and disordered and does not form a flexible and combinable whole is more convenient, the time cost, the production cost, the management cost and the control cost are greatly saved, and the home use control experience of a user is optimized.
However, in the use process of the existing smart home system, the centralized control of the smart home devices is generally realized through a controller or a user client, and the control mode is mostly completed through the active operation of a user, which is relatively single and lacks flexibility and convenience.
Disclosure of Invention
The embodiment of the application provides an intelligent equipment control method and device of an intelligent home system, which can automatically control intelligent home equipment according to the behavior state of a user, reduce user control operation, and improve flexibility and convenience of intelligent home equipment control.
In a first aspect, an embodiment of the present application provides an intelligent device control method for an intelligent home system, including:
carrying out target detection in real time, and acquiring video image data of a target when the target is detected;
inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target;
and adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
Further, inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target, including:
recognizing the gesture action state of the target based on the video image data, and detecting the associated target of the target;
and comparing the posture action state with the associated target according to a preset behavior state characteristic standard, and determining the current behavior state of the target.
Further, according to the behavior state of the current target, adjusting and controlling the corresponding smart home device of the smart home system according to a preset mapping control mode, the method includes:
inquiring a preset mapping relation table of the behavior states and mapping control modes based on the behavior state of the current target, and determining the corresponding mapping control mode;
and generating control data based on the corresponding mapping control mode, and outputting the control data to corresponding intelligent household equipment of the intelligent household system.
Further, the real-time target detection comprises:
and acquiring indoor video images through a camera to perform target detection or performing target detection through infrared detection.
Further, when an object is detected, acquiring video image data of the object, further comprising:
and responding to the target detection result to control to start the intelligent household equipment appointed by the intelligent household system.
Further, according to the behavior state of the current target, adjusting and controlling the corresponding smart home device of the smart home system according to a preset mapping control mode, further comprising:
the method comprises the steps of acquiring state data corresponding to an indoor environment and/or a specified area around a house in real time through a sensor, and adjusting and controlling corresponding intelligent home equipment of an intelligent home system based on the state data.
Further, after the corresponding smart home devices of the smart home system are adjusted and controlled according to the behavior state of the current target and in a preset mapping control manner, the method further includes:
determining associated household equipment with a preset linkage control relation with corresponding intelligent household equipment, and carrying out linkage adjustment control on the associated household equipment based on the running state change of the corresponding intelligent household equipment.
In a second aspect, an embodiment of the present application provides an intelligent device control apparatus for an intelligent home system, including:
the detection module is used for detecting a target in real time and acquiring video image data of the target when the target is detected;
the determining module is used for inputting the video image data into a preset behavior state detection model and determining the current behavior state of the target;
and the control module is used for adjusting and controlling the corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
In a third aspect, an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
the memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the intelligent device control method of the intelligent home system according to the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the smart device control method of a smart home system according to the first aspect.
According to the embodiment of the application, the target detection is carried out in real time, when the target is detected, the video image data of the target are obtained, the video image data are input into the preset behavior state detection model, the behavior state of the current target is determined, and the corresponding intelligent home equipment of the intelligent home system is adjusted and controlled according to the behavior state of the current target and the preset mapping control mode. By adopting the technical means, the corresponding intelligent household equipment of the intelligent household system can be automatically and intelligently controlled according to the real-time behavior state of the user, the control operation of the user is reduced, the control flexibility and convenience of the intelligent household equipment are improved, and the use experience of the user on the intelligent household system is optimized.
Drawings
Fig. 1 is a flowchart of an intelligent device control method of an intelligent home system according to an embodiment of the present application;
FIG. 2 is a flow chart of behavior state determination in the first embodiment of the present application;
FIG. 3 is a flow chart of the adjustment control in the first embodiment of the present application;
fig. 4 is a schematic structural diagram of an intelligent device control apparatus of an intelligent home system according to a second embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The application provides an intelligent equipment control method of an intelligent home system, which aims to detect and identify behavior states of users and adjust and control corresponding intelligent home equipment of the intelligent home system according to different behavior states of the users, so that the flexibility and convenience of intelligent home equipment control are improved, and the use experience of the users on the intelligent home system is optimized. Compared with the traditional intelligent home system, when the intelligent home system controls the intelligent home equipment, the controller or the user client is used, and the user actively controls the intelligent home equipment. Or simply starting or switching the working mode of the intelligent household equipment at regular time according to a control cycle preset by a user. Obviously, the existing control mode for the smart home devices is relatively single, the control flow that the user needs to put into operation is relatively complicated, and the intelligent degree is relatively low. Based on this, the intelligent equipment control method of the intelligent home system in the embodiment of the application is provided to solve the technical problems that the existing intelligent home system is single in control mode and complicated and inconvenient to control.
The first embodiment is as follows:
fig. 1 is a flowchart of an intelligent device control method of an intelligent home system according to an embodiment of the present disclosure, where the intelligent device control method of the intelligent home system provided in this embodiment may be executed by an intelligent device control apparatus of the intelligent home system, the intelligent device control apparatus of the intelligent home system may be implemented in a software and/or hardware manner, and the intelligent device control apparatus of the intelligent home system may be formed by two or more physical entities or may be formed by one physical entity. Generally speaking, the smart device control apparatus of the smart home system may be a smart home system server, a smart home gateway, or the like.
The following description will be given taking an intelligent device control apparatus of an intelligent home system as an example of a main body for executing an intelligent device control method of the intelligent home system. Referring to fig. 1, the intelligent device control method of the intelligent home system specifically includes:
and S110, detecting the target in real time, and acquiring video image data of the target when the target is detected.
Specifically, when the user behavior state is detected, the method and the device firstly perform target detection to determine whether a target exists in the current indoor environment, and further acquire video image data of the target. Generally, the target is the user. The camera is used for collecting indoor video images to perform target detection or infrared detection is used for performing target detection. And correspondingly acquiring indoor video images through the camera to perform target detection, requiring the camera to start acquiring the indoor video images in real time, and further performing the target detection based on the acquired indoor video images. And carrying out target detection through a preset target detection model to determine whether the indoor video image contains the corresponding target. The target detection model may be a target detection model constructed using a network such as Faster R-CNN, YOLOv3, or the like. In the prior art, there are many specific implementation manners for target detection, and the embodiments of the present application are not limited herein. On the other hand, corresponding to the way of detecting the target through infrared detection, the comparison and identification are carried out according to the infrared detection data detected by the infrared detection device, and whether the target exists in the detection environment or not is determined. In the infrared detection device, the presence or movement of a human body is detected by a pyroelectric element, and an output signal of the pyroelectric element is converted into a voltage signal. Then, the voltage signal is subjected to waveform analysis. Before that, the infrared detection device stores in advance a voltage waveform corresponding to the infrared detection of the human body. The infrared detection device outputs a detection signal only when a waveform generated by a human body is detected by waveform analysis, thereby realizing target detection.
Further, based on the target detection result, when the target is detected, the video image data of the target is further acquired through the camera, so that the behavior state of the target can be detected and identified subsequently.
In one embodiment, whether the target is a designated user is also judged according to the target detection result. Before that, the control device of the intelligent device stores the face image of the designated user in advance, then extracts the face image data of the target based on the detected target, compares the face image data with the face image data of the user stored in advance, and judges that the target is the designated user if the face image data and the face image data are matched. Otherwise, the target non-specified user is judged. Furthermore, if the target is judged to be a target of a non-specified user, the control device of the intelligent device does not further detect and identify the behavior state of the target. Therefore, the control device of the intelligent equipment can be prevented from being influenced by too many targets to control each intelligent equipment, and the situation of control contradiction is avoided.
In addition, in one embodiment, based on the target detection result, the method further controls to start the specified smart home devices in the smart home system in response to the target detection result. By starting the designated intelligent household equipment when the target is detected, the control operation of the user is reduced, the flexibility of intelligent household equipment control can be realized, and the user experience is optimized. For example, when a user enters indoors, the presence of the user is determined by target detection at this time. Based on the target detection result, after the user is detected in the indoor environment, the intelligent device control device responds to the target detection result and starts intelligent household devices such as indoor lamplight and air conditioners so as to be convenient for the user to use. Therefore, manual control operation of a user after entering a room can be omitted, and the intelligent home equipment control device replaces the user to perform automatic and intelligent control, so that the use experience of the user is optimized.
And S120, inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target.
Further, based on the video image data collected in step S110, the video image data can be further identified and detected, so as to determine the current behavior state of the target. The behavior state can be the behavior state of a user such as sleeping, sports, watching television, reading and working. Through the identification of the behavior states, the automatic control of the corresponding intelligent household equipment is conveniently carried out according to the behavior states. And detecting and identifying the target behavior state through a preset behavior state detection model. The behavior state detection model can be a detection and recognition model based on a CNN network, and mainly identifies gesture actions of the target and associated targets of the environment where the target is located. The related objects are mainly related household settings in the environment where the objects are located, such as beds, quilts, sofas, televisions, books, computers, table lamps and the like. And determining a current behavioral state of the target based on the recognized gesture motion state and the associated target.
Referring to fig. 2, the behavior state determination process includes:
s1201, recognizing the gesture action state of the target based on the video image data, and detecting a related target of the target;
s1202, comparing the posture action state with the associated target according to a preset behavior state characteristic standard, and determining the current behavior state of the target.
Specifically, detection and recognition may be performed by a gesture motion recognition model trained in advance in response to recognition of the gesture motion state. The gesture motion recognition model mainly recognizes and detects the current gesture motion of the target. When the gesture motion recognition model detects and recognizes the gesture motion state motion of the target, the gesture motion can be detected and recognized by adopting a motion recognition algorithm based on a convolutional neural network. Specifically, a plurality of joint points of the target are positioned, and the motion vector of the target is determined based on the joint point connecting line, so that the posture motion state of the target is determined. Heretofore, the gesture motion recognition model needs to acquire a large number of images of the user including various types of gesture motions in advance, and realize detection and recognition of the gesture motions of the user through model training by using the images as training samples. On the other hand, corresponding to the associated target recognition of the user, the detection recognition is carried out through a pre-trained associated target detection model. The related target detection model can be a target detection model constructed by using a network such as Faster R-CNN, YOLOv3 and the like. When the model is trained and constructed, a large amount of image data containing articles such as beds, quilts, sofas, televisions, books, computers, table lamps and the like are obtained to be used as training samples, model training is carried out through the network, and the associated target detection model is constructed. Therefore, the associated target detection model performs target detection and identification based on the video image data of the detected target, namely, the associated target contained in the image data can be determined.
Based on the detected gesture action state and the associated target, the behavior state of the current target can be further determined. Before this, the control device of the intelligent device establishes a behavior state characteristic standard in advance, and then determines the current behavior state of the target by comparing the detected gesture action state with the associated target. Wherein the behavior state feature criteria may predefine the gesture action state and the corresponding relationship of the associated target and the behavior state. For example, the postural motion state is "lying" and the associated targets include "bed" and "quilt", defining its corresponding behavioral state as "sleeping". Therefore, when the recognized posture action state and the associated target are detected to determine that the current target lies on the bed, the behavior state of the current target is determined to be sleeping by comparing the behavior state characteristic standards. By analogy, detection and identification of various behavior states of the user can be realized, so that the adaptive automatic control of the intelligent household equipment can be conveniently carried out subsequently according to different behavior states of the user.
And S130, adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the behavior state of the current target and a preset mapping control mode.
Based on the behavior state of the current target (i.e., the user) determined in step S120, the smart home devices of the smart home system may be controlled and adjusted according to the behavior state of the current target. Before that, the control device of the smart home device may pre-construct a mapping control table of behavior states and mapping control manners, and when determining which behavior state a user is currently in, the control device of the smart home device controls the corresponding smart home device by using the corresponding control manner. Referring to fig. 3, the adjusting control process of the smart home device includes:
s1301, inquiring a preset mapping relation table of the behavior states and mapping control modes based on the behavior states of the current targets, and determining the corresponding mapping control modes;
s1302, generating control data based on the corresponding mapping control mode, and outputting the control data to corresponding intelligent home devices of the intelligent home system.
And after the behavior state of the current target is determined, taking the behavior state as a data index to inquire a mapping relation table and determining a corresponding mapping control mode. And then, generating corresponding control data based on the mapping control mode so as to output the control data to the corresponding intelligent household equipment for regulation control. In an expression to be described, the mapping control manner should include identification information of the smart home device to be adjusted and corresponding adjustment control parameter information. Based on the identification information and the adjustment control parameter information of the intelligent home equipment, the control device of the intelligent home equipment can generate a corresponding control instruction and send the control instruction to the intelligent home equipment corresponding to the identification information of the intelligent home equipment, so that the automatic adjustment of the intelligent home equipment is realized. For example, assuming that the behavior state of the current user is "sleep", the mapping relationship table is queried according to the behavior state, and it is determined that the mapping control mode is "turn off the indoor intelligent lamp, turn off the intelligent curtain, and adjust the working mode of the air conditioner or the fan to be the sleep mode", according to the mapping control mode, the intelligent home device generates a corresponding control instruction, and sends the control instruction to the intelligent lamp, the intelligent curtain, the air conditioner or the fan of the intelligent home system, so as to adjust and control the running state of the corresponding intelligent home device.
According to the method, the target is detected in real time, when the target is detected, the video image data of the target are obtained, the video image data are input into the preset behavior state detection model, the behavior state of the current target is determined, and the corresponding intelligent home equipment of the intelligent home system is adjusted and controlled according to the behavior state of the current target and the preset mapping control mode. By adopting the technical means, the corresponding intelligent household equipment of the intelligent household system can be automatically and intelligently controlled according to the real-time behavior state of the user, the control operation of the user is reduced, the control flexibility and convenience of the intelligent household equipment are improved, and the use experience of the user on the intelligent household system is optimized.
Further, in one embodiment, the state data corresponding to the indoor environment and/or the designated area around the house is collected in real time through a sensor, and the corresponding intelligent home equipment of the intelligent home system is adjusted and controlled based on the state data. Illustratively, the light sensing detection element is arranged indoors, indoor light is detected in real time, and when the indoor light brightness is detected to be higher than a set upper limit, the control device of the intelligent household equipment sends a control instruction to the intelligent curtain to drive the curtain to be closed. When detecting that indoor light luminance height is less than the settlement lower limit, intelligent household equipment's controlling means sends control command to the intelligent lamp, and drive control intelligent lamp opens. In addition, after the behavior state of the user is detected and identified according to the video image data, the indoor environment light can be adjusted according to the behavior state of the user and by combining the real-time detection value of the light sensation detection element. For example, when the situation that the user is reading a book and the brightness of the current indoor light does not meet the indoor brightness requirement in the 'reading' scene is detected, the control device of the intelligent household equipment sends a control instruction to the intelligent lamp according to the detection and identification result, and the brightness of the intelligent lamp is adaptively increased so as to meet the requirement on the indoor brightness in the 'reading' scene of the user.
In addition, in one embodiment, the associated household equipment is determined to have a preset linkage control relationship with the corresponding intelligent household equipment, and the associated household equipment is controlled based on the running state change linkage adjustment of the corresponding intelligent household equipment. Illustratively, by linkage control of the associated household equipment, the control operation of the user can be further reduced, and more intelligent and automatic intelligent household equipment control is realized. For example, the linkage control relationship between the intelligent curtain and the intelligent lamp is constructed in advance. When the control device of the intelligent household equipment sends a control instruction to control the intelligent curtain to be opened, the control device of the intelligent household equipment sends the control instruction to the intelligent lamp according to the change condition of the running state of the intelligent curtain according to the linkage control relation between the intelligent curtain and the intelligent lamp, the power of the intelligent lamp is reduced to reduce the brightness of the intelligent lamp, or the intelligent lamp is directly closed, so that the control device of the intelligent household equipment realizes the linkage control of various intelligent household equipment with the linkage control relation. It can be understood that, after the (window) curtain was opened, indoor luminance influenced by external environment light can turn bright relatively, then avoid indoor luminance too bright this moment, practice thrift the power consumptive of system, then can the adaptive dimming intelligent lamp luminance or directly close the electricity-saving lamp to this comes to realize the energy-conserving effect of system through coordinated control's mode, and further reduces user operation through coordinated control's mode, optimizes user's use and experiences.
Example two:
on the basis of the foregoing embodiment, fig. 4 is a schematic structural diagram of an intelligent device control apparatus of an intelligent home system according to a second embodiment of the present application. Referring to fig. 4, the intelligent device control apparatus of the intelligent home system provided in this embodiment specifically includes: a detection module 21, a determination module 22 and a control module 23.
The detection module 21 is configured to perform target detection in real time, and when a target is detected, obtain video image data of the target;
the determining module 22 is configured to input the video image data into a preset behavior state detection model, and determine a current behavior state of the target;
the control module 23 is configured to adjust and control the corresponding smart home device of the smart home system according to the behavior state of the current target in a preset mapping control manner.
According to the method, the target is detected in real time, when the target is detected, the video image data of the target are obtained, the video image data are input into the preset behavior state detection model, the behavior state of the current target is determined, and the corresponding intelligent home equipment of the intelligent home system is adjusted and controlled according to the behavior state of the current target and the preset mapping control mode. By adopting the technical means, the corresponding intelligent household equipment of the intelligent household system can be automatically and intelligently controlled according to the real-time behavior state of the user, the control operation of the user is reduced, the control flexibility and convenience of the intelligent household equipment are improved, and the use experience of the user on the intelligent household system is optimized. Further, the determination module 22 includes:
a recognition unit configured to recognize a gesture action state of the target based on the video image data and detect a related target of the target;
and the comparison unit is used for comparing the posture action state with the associated target by a preset behavior state characteristic standard and determining the current behavior state of the target.
The control module 23 includes:
the query unit is used for querying a preset mapping relation table of the behavior state and the mapping control mode based on the behavior state of the current target and determining the corresponding mapping control mode;
and the output unit is used for generating control data based on the corresponding mapping control mode and outputting the control data to the corresponding intelligent home equipment of the intelligent home system.
The detection module 21 includes:
and the response unit is used for responding to the target detection result and controlling to start the intelligent household equipment appointed by the intelligent household system.
The control module 23 further comprises:
and the acquisition control unit is used for acquiring state data corresponding to the indoor environment in real time through a sensor and adjusting and controlling corresponding intelligent home equipment of the intelligent home system based on the state data.
Specifically, still include:
and the linkage control module is used for determining the associated household equipment with a preset linkage control relation with the corresponding intelligent household equipment and carrying out linkage adjustment control on the associated household equipment based on the running state change of the corresponding intelligent household equipment.
The intelligent device control apparatus of the intelligent home system provided in the second embodiment of the present application may be used to execute the intelligent device control method of the intelligent home system provided in the first embodiment of the present application, and has corresponding functions and beneficial effects.
Example three:
an embodiment of the present application provides an electronic device, and with reference to fig. 5, the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors in the electronic device may be one or more, and the number of memories in the electronic device may be one or more. The processor, memory, communication module, input device, and output device of the electronic device may be connected by a bus or other means.
The memory 32 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the intelligent device control method of the intelligent home system according to any embodiment of the present application (for example, the detection module, the determination module, and the control module in the intelligent device control apparatus of the intelligent home system). The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system and an application program required by at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication module 33 is used for data transmission.
The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, so as to implement the intelligent device control method of the intelligent home system.
The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen.
The electronic device provided by the embodiment can be used for executing the intelligent device control method of the intelligent home system provided by the embodiment one, and has corresponding functions and beneficial effects.
Example four:
an embodiment of the present application further provides a storage medium containing computer-executable instructions, where the computer-executable instructions are executed by a computer processor to perform an intelligent device control method of an intelligent home system, and the intelligent device control method of the intelligent home system includes: carrying out target detection in real time, and acquiring video image data of a target when the target is detected; inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target; and adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations, e.g., in different computer systems connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.
Of course, in the storage medium including the computer-executable instructions provided in the embodiments of the present application, the computer-executable instructions are not limited to the intelligent device control method of the intelligent home system described above, and may also perform related operations in the intelligent device control method of the intelligent home system provided in any embodiments of the present application.
The smart device control apparatus, the storage medium, and the electronic device of the smart home system provided in the foregoing embodiments may execute the smart device control method of the smart home system provided in any embodiment of the present application, and reference may be made to the smart device control method of the smart home system provided in any embodiment of the present application without detailed technical details described in the foregoing embodiments.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (10)
1. An intelligent equipment control method of an intelligent home system is characterized by comprising the following steps:
carrying out target detection in real time, and acquiring video image data of a target when the target is detected;
inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target;
and adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
2. The intelligent device control method of the intelligent home system according to claim 1, wherein inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target comprises:
recognizing the gesture action state of the target based on the video image data, and detecting the associated target of the target;
and comparing the posture action state with the associated target according to a preset behavior state characteristic standard, and determining the current behavior state of the target.
3. The intelligent device control method of the intelligent home system according to claim 1, wherein the step of adjusting and controlling the corresponding intelligent home device of the intelligent home system according to the current behavior state of the target and in a preset mapping control manner comprises:
inquiring a preset mapping relation table of the behavior states and mapping control modes based on the behavior state of the current target, and determining the corresponding mapping control mode;
and generating control data based on the corresponding mapping control mode, and outputting the control data to corresponding intelligent household equipment of the intelligent household system.
4. The intelligent device control method of the intelligent home system according to claim 1, wherein the real-time target detection comprises:
and acquiring indoor video images through a camera to perform target detection or performing target detection through infrared detection.
5. The intelligent device control method of the intelligent home system according to claim 1, wherein when an object is detected, video image data of the object is acquired, and further comprising:
and responding to the target detection result to control to start the intelligent household equipment appointed by the intelligent household system.
6. The intelligent device control method of the intelligent home system according to any one of claims 1 to 5, wherein the corresponding intelligent home device of the intelligent home system is adjusted and controlled according to the current behavior state of the target and in a preset mapping control manner, further comprising:
the method comprises the steps of acquiring state data corresponding to an indoor environment and/or a specified area around a house in real time through a sensor, and adjusting and controlling corresponding intelligent home equipment of an intelligent home system based on the state data.
7. The intelligent device control method of the intelligent home system according to any one of claims 1 to 5, further comprising, after adjusting and controlling the corresponding intelligent home device of the intelligent home system according to the current behavior state of the target and in a preset mapping control manner:
determining associated household equipment with a preset linkage control relation with corresponding intelligent household equipment, and carrying out linkage adjustment control on the associated household equipment based on the running state change of the corresponding intelligent household equipment.
8. The utility model provides an intelligent equipment controlling means of intelligent home systems which characterized in that includes:
the detection module is used for detecting a target in real time and acquiring video image data of the target when the target is detected;
the determining module is used for inputting the video image data into a preset behavior state detection model and determining the current behavior state of the target;
and the control module is used for adjusting and controlling the corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
9. An electronic device, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the smart device control method of the smart home system according to any one of claims 1 to 7.
10. A storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the smart device control method of a smart home system according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010665220.1A CN111752165A (en) | 2020-07-10 | 2020-07-10 | Intelligent equipment control method and device of intelligent home system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010665220.1A CN111752165A (en) | 2020-07-10 | 2020-07-10 | Intelligent equipment control method and device of intelligent home system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111752165A true CN111752165A (en) | 2020-10-09 |
Family
ID=72711320
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010665220.1A Pending CN111752165A (en) | 2020-07-10 | 2020-07-10 | Intelligent equipment control method and device of intelligent home system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111752165A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112666837A (en) * | 2020-11-13 | 2021-04-16 | 广州大学 | Indoor environment monitoring system and method based on group adaptive behavior recognition |
| CN112820014A (en) * | 2020-12-30 | 2021-05-18 | 珠海格力电器股份有限公司 | Intelligent access control system control method, device, equipment and medium |
| CN113194292A (en) * | 2021-04-30 | 2021-07-30 | 招商局金融科技有限公司 | Coordination management method, device, equipment and storage medium for intelligent equipment |
| CN113341743A (en) * | 2021-06-07 | 2021-09-03 | 深圳市欧瑞博科技股份有限公司 | Intelligent household equipment control method and device, electronic equipment and storage medium |
| CN113671847A (en) * | 2021-08-13 | 2021-11-19 | 珠海格力电器股份有限公司 | Linkage control method, system and device of intelligent household equipment and storage medium |
| CN114035441A (en) * | 2021-11-11 | 2022-02-11 | 珠海格力电器股份有限公司 | Control method, device and system of household appliance |
| CN114519818A (en) * | 2022-01-14 | 2022-05-20 | 杭州未名信科科技有限公司 | Method and device for detecting home scene, electronic equipment and medium |
| CN114740745A (en) * | 2022-04-25 | 2022-07-12 | 深圳市联合同创科技股份有限公司 | Intelligent home control method and terminal |
| CN114842319A (en) * | 2022-03-01 | 2022-08-02 | 杭州未名信科科技有限公司 | Method and device for detecting home scene, electronic equipment and medium |
| WO2023088061A1 (en) * | 2021-11-16 | 2023-05-25 | 华为技术有限公司 | Smart device control method and electronic device |
| CN116165911A (en) * | 2023-04-19 | 2023-05-26 | 深圳市吉方工控有限公司 | Smart home control method and device, embedded industrial control equipment and medium |
| WO2023115928A1 (en) * | 2021-12-20 | 2023-06-29 | 珠海格力电器股份有限公司 | Indoor environment control method, apparatus and system, and storage medium |
| CN116685033A (en) * | 2023-06-21 | 2023-09-01 | 惠州兴通成机电技术有限公司 | Intelligent control system for lamp |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105785782A (en) * | 2016-03-29 | 2016-07-20 | 北京小米移动软件有限公司 | Intelligent household equipment control method and device |
| WO2017016432A1 (en) * | 2015-07-27 | 2017-02-02 | 中兴通讯股份有限公司 | Intelligent home appliance control method and intelligent home appliance controller |
| CN107166645A (en) * | 2017-05-18 | 2017-09-15 | 厦门瑞为信息技术有限公司 | A kind of air conditioning control method analyzed based on indoor scene |
| CN207096800U (en) * | 2017-09-01 | 2018-03-13 | 南昌欧菲光科技有限公司 | Intelligent home control device and intelligent domestic system |
| CN108427310A (en) * | 2018-05-17 | 2018-08-21 | 深圳市零度智控科技有限公司 | Intelligent home furnishing control method, device and computer readable storage medium |
| CN108572558A (en) * | 2018-05-28 | 2018-09-25 | 深圳市零度智控科技有限公司 | Intelligent home furnishing control method, device and computer readable storage medium |
| CN109558865A (en) * | 2019-01-22 | 2019-04-02 | 郭道宁 | A kind of abnormal state detection method to the special caregiver of need based on human body key point |
-
2020
- 2020-07-10 CN CN202010665220.1A patent/CN111752165A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017016432A1 (en) * | 2015-07-27 | 2017-02-02 | 中兴通讯股份有限公司 | Intelligent home appliance control method and intelligent home appliance controller |
| CN105785782A (en) * | 2016-03-29 | 2016-07-20 | 北京小米移动软件有限公司 | Intelligent household equipment control method and device |
| CN107166645A (en) * | 2017-05-18 | 2017-09-15 | 厦门瑞为信息技术有限公司 | A kind of air conditioning control method analyzed based on indoor scene |
| CN207096800U (en) * | 2017-09-01 | 2018-03-13 | 南昌欧菲光科技有限公司 | Intelligent home control device and intelligent domestic system |
| CN108427310A (en) * | 2018-05-17 | 2018-08-21 | 深圳市零度智控科技有限公司 | Intelligent home furnishing control method, device and computer readable storage medium |
| CN108572558A (en) * | 2018-05-28 | 2018-09-25 | 深圳市零度智控科技有限公司 | Intelligent home furnishing control method, device and computer readable storage medium |
| CN109558865A (en) * | 2019-01-22 | 2019-04-02 | 郭道宁 | A kind of abnormal state detection method to the special caregiver of need based on human body key point |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112666837A (en) * | 2020-11-13 | 2021-04-16 | 广州大学 | Indoor environment monitoring system and method based on group adaptive behavior recognition |
| CN112820014A (en) * | 2020-12-30 | 2021-05-18 | 珠海格力电器股份有限公司 | Intelligent access control system control method, device, equipment and medium |
| CN113194292A (en) * | 2021-04-30 | 2021-07-30 | 招商局金融科技有限公司 | Coordination management method, device, equipment and storage medium for intelligent equipment |
| CN113341743A (en) * | 2021-06-07 | 2021-09-03 | 深圳市欧瑞博科技股份有限公司 | Intelligent household equipment control method and device, electronic equipment and storage medium |
| CN113341743B (en) * | 2021-06-07 | 2023-11-28 | 深圳市欧瑞博科技股份有限公司 | Smart home equipment control method and device, electronic equipment and storage medium |
| CN113671847A (en) * | 2021-08-13 | 2021-11-19 | 珠海格力电器股份有限公司 | Linkage control method, system and device of intelligent household equipment and storage medium |
| CN114035441A (en) * | 2021-11-11 | 2022-02-11 | 珠海格力电器股份有限公司 | Control method, device and system of household appliance |
| WO2023088061A1 (en) * | 2021-11-16 | 2023-05-25 | 华为技术有限公司 | Smart device control method and electronic device |
| WO2023115928A1 (en) * | 2021-12-20 | 2023-06-29 | 珠海格力电器股份有限公司 | Indoor environment control method, apparatus and system, and storage medium |
| CN114519818A (en) * | 2022-01-14 | 2022-05-20 | 杭州未名信科科技有限公司 | Method and device for detecting home scene, electronic equipment and medium |
| CN114842319A (en) * | 2022-03-01 | 2022-08-02 | 杭州未名信科科技有限公司 | Method and device for detecting home scene, electronic equipment and medium |
| CN114740745A (en) * | 2022-04-25 | 2022-07-12 | 深圳市联合同创科技股份有限公司 | Intelligent home control method and terminal |
| CN116165911A (en) * | 2023-04-19 | 2023-05-26 | 深圳市吉方工控有限公司 | Smart home control method and device, embedded industrial control equipment and medium |
| CN116685033A (en) * | 2023-06-21 | 2023-09-01 | 惠州兴通成机电技术有限公司 | Intelligent control system for lamp |
| CN116685033B (en) * | 2023-06-21 | 2024-01-12 | 惠州兴通成机电技术有限公司 | Intelligent control system for lamp |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111752165A (en) | Intelligent equipment control method and device of intelligent home system | |
| CN106152408B (en) | Intelligent air conditioner controller, control method and air conditioner | |
| WO2020029484A1 (en) | Control method and apparatus for smart home system, processor, and storage medium | |
| CN106413224B (en) | A kind of room lighting intelligent control method and system | |
| CN112051743A (en) | Device control method, conflict processing method, corresponding devices and electronic device | |
| CN105843050A (en) | Intelligent household system, intelligent household control device and method | |
| CN105785782A (en) | Intelligent household equipment control method and device | |
| CN108131808B (en) | Air conditioner control device and method based on hierarchical gesture recognition | |
| CN107229262A (en) | A kind of intelligent domestic system | |
| JP2005529548A (en) | System and method for adapting the environmental nature of a local environment to the location in the local environment and the preference of a person | |
| CN107566227A (en) | Control method, device, smart machine and the storage medium of home appliance | |
| TW201636887A (en) | Smart control apparatus and system | |
| CN111025922B (en) | Target equipment control method and electronic equipment | |
| CN111338227B (en) | Electronic appliance control method and control device based on reinforcement learning and storage medium | |
| WO2022242143A1 (en) | Air conditioner control method and apparatus, and air conditioner | |
| CN107682236B (en) | Intelligent household interaction system and method based on computer image recognition | |
| CN105042789A (en) | Control method and system of intelligent air conditioner | |
| CN107360066A (en) | A kind of household service robot and intelligent domestic system | |
| CN113867163A (en) | Intelligent household scene switching method and device, intelligent terminal and storage medium | |
| CN108536027B (en) | Intelligent home control method and device and server | |
| CN114509953A (en) | Device control method, computer program product, control device, and storage medium | |
| CN110543103A (en) | Automatic control method for smart home | |
| CN112696806A (en) | Air conditioner operation method and device | |
| CN114063572A (en) | Non-sensing intelligent device control method, electronic device and control system | |
| CN108415572B (en) | Module control method and device applied to mobile terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |