CN111752165B - Intelligent equipment control method and device of intelligent home system - Google Patents
Intelligent equipment control method and device of intelligent home system Download PDFInfo
- Publication number
- CN111752165B CN111752165B CN202010665220.1A CN202010665220A CN111752165B CN 111752165 B CN111752165 B CN 111752165B CN 202010665220 A CN202010665220 A CN 202010665220A CN 111752165 B CN111752165 B CN 111752165B
- Authority
- CN
- China
- Prior art keywords
- target
- intelligent
- intelligent household
- state
- behavior state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000001514 detection method Methods 0.000 claims abstract description 74
- 238000013507 mapping Methods 0.000 claims abstract description 41
- 230000006399 behavior Effects 0.000 claims description 93
- 230000015654 memory Effects 0.000 claims description 23
- 230000033001 locomotion Effects 0.000 claims description 21
- 230000009471 action Effects 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 4
- 230000001105 regulatory effect Effects 0.000 abstract description 3
- 230000001276 controlling effect Effects 0.000 description 15
- 239000002609 medium Substances 0.000 description 10
- 230000006870 function Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000013527 convolutional neural network Methods 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Selective Calling Equipment (AREA)
Abstract
The embodiment of the application discloses an intelligent device control method and device of an intelligent home system. According to the technical scheme provided by the embodiment of the application, the target detection is performed in real time, when the target is detected, the video image data of the target is obtained, the video image data is input into a preset behavior state detection model, the behavior state of the current target is determined, and the corresponding intelligent household equipment of the intelligent household system is regulated and controlled according to the behavior state of the current target and a preset mapping control mode. By adopting the technical means, the corresponding intelligent household equipment of the intelligent household system can be automatically and intelligently controlled according to the real-time behavior state of the user, the control operation of the user is reduced, the control flexibility and convenience of the intelligent household equipment are improved, and the use experience of the user to the intelligent household system is optimized.
Description
Technical Field
The embodiment of the application relates to the technical field of intelligent home, in particular to an intelligent device control method and device of an intelligent home system.
Background
At present, with the high-speed development of the internet of things and the internet technology, the demands on the household intelligent home system are also increasing. The intelligent home system combines with a plurality of modern scientific technologies such as an automatic control system, a computer network system and a network communication technology to create a networked and intelligent home control system, so that the home control system is scattered and unordered, and is more convenient to manage without forming a flexible and organized whole home equipment, the time cost, the production cost, the management cost and the control cost are greatly saved, and the home use control experience of a user is optimized.
However, in the use process of the existing intelligent home system, centralized control of intelligent home equipment is generally realized through a controller or a user client, most of control modes are finished through active operation of users, and the control modes are relatively single and lack of flexibility and convenience.
Disclosure of Invention
The embodiment of the application provides an intelligent equipment control method and device for an intelligent home system, which can automatically control intelligent home equipment according to the behavior state of a user, reduce the control operation of the user and improve the control flexibility and convenience of the intelligent home equipment.
In a first aspect, an embodiment of the present application provides an intelligent device control method of an intelligent home system, including:
performing target detection in real time, and acquiring video image data of a target when the target is detected;
inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target;
And adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
Further, inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target includes:
identifying a gesture motion state of the target based on the video image data, and detecting an associated target of the target;
And comparing the gesture action state with the associated target to a preset behavior state characteristic standard, and determining the current behavior state of the target.
Further, according to the current behavior state of the target, the corresponding intelligent home equipment of the intelligent home system is adjusted and controlled according to a preset mapping control mode, including:
inquiring a mapping relation table of a preset behavior state and a mapping control mode based on the current behavior state of the target, and determining a corresponding mapping control mode;
And generating control data based on the corresponding mapping control mode, and outputting the control data to corresponding intelligent household equipment of the intelligent household system.
Further, performing target detection in real time includes:
And acquiring an indoor video image through a camera to detect the target or detecting the target through infrared detection.
Further, when an object is detected, acquiring video image data of the object, further including:
And controlling to start the intelligent household equipment appointed by the intelligent household system in response to the target detection result.
Further, according to the current behavior state of the target, the corresponding intelligent home equipment of the intelligent home system is adjusted and controlled according to a preset mapping control mode, and the method further comprises the following steps:
And acquiring state data corresponding to indoor environments and/or designated areas around houses in real time through sensors, and adjusting and controlling corresponding intelligent household equipment of the intelligent household system based on the state data.
Further, after adjusting and controlling the corresponding intelligent home equipment of the intelligent home system according to the current behavior state of the target and a preset mapping control mode, the method further comprises the following steps:
and determining associated household equipment with a preset linkage control relation with the corresponding intelligent household equipment, and adjusting and controlling the associated household equipment in a linkage mode based on the running state change of the corresponding intelligent household equipment.
In a second aspect, an embodiment of the present application provides an intelligent device control apparatus for an intelligent home system, including:
the detection module is used for detecting the target in real time, and acquiring video image data of the target when the target is detected;
The determining module is used for inputting the video image data into a preset behavior state detection model and determining the current behavior state of the target;
And the control module is used for adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
In a third aspect, an embodiment of the present application provides an electronic device, including:
A memory and one or more processors;
The memory is used for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the smart device control method of the smart home system as described in the first aspect.
In a fourth aspect, an embodiment of the present application provides a storage medium containing computer executable instructions, which when executed by a computer processor, are configured to perform a smart device control method of a smart home system according to the first aspect.
According to the embodiment of the application, the target detection is performed in real time, when the target is detected, video image data of the target is obtained, the video image data is input into a preset behavior state detection model, the behavior state of the current target is determined, and the corresponding intelligent household equipment of the intelligent household system is regulated and controlled according to the behavior state of the current target and a preset mapping control mode. By adopting the technical means, the corresponding intelligent household equipment of the intelligent household system can be automatically and intelligently controlled according to the real-time behavior state of the user, the control operation of the user is reduced, the control flexibility and convenience of the intelligent household equipment are improved, and the use experience of the user to the intelligent household system is optimized.
Drawings
Fig. 1 is a flowchart of an intelligent device control method of an intelligent home system according to an embodiment of the present application;
FIG. 2 is a flow chart of behavior state determination in a first embodiment of the application;
FIG. 3 is a flow chart of the regulation control in the first embodiment of the present application;
Fig. 4 is a schematic structural diagram of an intelligent device control apparatus of an intelligent home system according to a second embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the following detailed description of specific embodiments of the present application is given with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the matters related to the present application are shown in the accompanying drawings. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The intelligent equipment control method of the intelligent home system aims at improving the flexibility and convenience of intelligent home equipment control and optimizing the use experience of a user on the intelligent home system by detecting and identifying the behavior states of the user and adjusting and controlling the corresponding intelligent home equipment of the intelligent home system according to different behavior states of the user. Compared with the traditional intelligent home system, when the intelligent home equipment is controlled, the controller or the user client is required to be used, and the user actively performs control operation. Or simply starting or switching the working mode of the intelligent household equipment at regular time according to the control period preset by the user. Obviously, the existing control mode for the intelligent household equipment is relatively single, the control flow of the user needing to put into operation is relatively complicated, and the intelligent degree is relatively low. Based on the control method, the intelligent equipment control method of the intelligent home system is provided, and the technical problems that the existing intelligent home system is single in control mode and complex and inconvenient to control are solved.
Embodiment one:
Fig. 1 is a flowchart of an intelligent device control method of an intelligent home system according to a first embodiment of the present application, where the intelligent device control method of the intelligent home system provided in the present embodiment may be executed by an intelligent device control apparatus of the intelligent home system, and the intelligent device control apparatus of the intelligent home system may be implemented by software and/or hardware, and the intelligent device control apparatus of the intelligent home system may be configured by two or more physical entities or may be configured by one physical entity. In general, the smart device control apparatus of the smart home system may be a smart home system server, a smart home gateway, or the like.
The following description will take an intelligent device control apparatus of an intelligent home system as an example of a main body for executing an intelligent device control method of the intelligent home system. Referring to fig. 1, the intelligent device control method of the intelligent home system specifically includes:
s110, detecting a target in real time, and acquiring video image data of the target when the target is detected.
Specifically, when the user behavior state is detected, the embodiment of the application firstly carries out target detection to determine whether the current indoor environment has the target or not, and further obtains the video image data of the target. Generally, the target is the user. The method comprises the steps of collecting indoor video images through a camera to detect targets or detecting targets through infrared detection. And the camera is required to start to acquire the indoor video image in real time corresponding to the mode of acquiring the indoor video image through the camera for target detection, and the target detection is further carried out based on the acquired indoor video image. And carrying out target detection through a preset target detection model so as to determine whether the indoor video image contains a corresponding target. The target detection model may be one constructed using a network such as Faster R-CNN, yolov3, etc. There are many specific embodiments of the prior art corresponding to the target detection, and the embodiment of the present application is not limited in this disclosure. On the other hand, according to the mode of detecting the target through infrared detection, comparison and identification are carried out according to the infrared detection data detected by the infrared detection device, and whether the target exists in the current detection environment or not is determined. In the infrared detection device, the presence or movement of a human body is detected by a thermoelectric element, and an output signal of the thermoelectric element is converted into a voltage signal. Then, waveform analysis is performed on the voltage signal. Before that, the infrared detection device stores in advance a voltage waveform corresponding to infrared detection of a human body. The infrared detection device outputs a detection signal only when a waveform generated by a human body is detected by waveform analysis, thereby achieving target detection.
Further, based on the target detection result, when a target is detected, video image data of the target is further acquired through the camera, so that behavior state detection and identification of the target can be conveniently carried out later.
In one embodiment, it is further determined whether the target is a designated user based on the target detection result. Before the above, the control device of the intelligent device stores the face image of the appointed user in advance, then extracts the face image data of the target based on the detected target, compares the face image data with the face image data of the pre-stored user, and if the face image data and the face image data are matched, judges that the target is the appointed user. And otherwise, judging that the target is not the designated user. Further, if the corresponding interpretation is a target of a non-designated user, the control device of the intelligent device does not further perform behavior state detection and identification of the target. Therefore, the control device which affects the intelligent equipment excessively can be prevented from controlling all the intelligent equipment, and the situation of control contradiction is avoided.
In addition, in one embodiment, based on the target detection result, the smart home devices specified in the smart home system are also controlled to be started in response to the target detection result. The appointed intelligent household equipment is started when the target is detected, so that the control operation of a user is reduced, the control flexibility of the intelligent household equipment can be realized, and the user experience is optimized. For example, when a user enters a room, the presence of the user is determined by target detection at this time. Based on the target detection result, after the user is detected in the indoor environment, the intelligent equipment control device responds to the target detection result to start intelligent household equipment such as indoor light, air conditioner and the like so as to be convenient for the user to use. Therefore, manual control operation after the user enters the house can be omitted, and the intelligent household equipment control device replaces the user to perform automatic and intelligent control, so that the use experience of the user is optimized.
S120, inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target.
Further, based on the video image data collected in the step S110, identification and detection of the video image data can be further performed to determine the current behavior state of the target. The behavior state can be the behavior state of a user for sleeping, exercising, watching television, reading books, working, and the like. By identifying the behavior states, the follow-up automatic control of corresponding intelligent household equipment according to the behavior states is facilitated. And detecting and identifying the target behavior state through a preset behavior state detection model. The behavior state detection model can be a detection and identification model based on a CNN network, and mainly identifies gesture actions of the target and associated targets of the environment in which the target is located. The related targets are mainly related household settings in the environment where the targets are located, such as articles of beds, quilts, sofas, televisions, books, computers, desk lamps and the like. And based on the recognized gesture motion state and the associated target to determine a current behavioral state of the target.
Referring to fig. 2, the behavior state determination flow includes:
S1201, recognizing a gesture action state of the target based on the video image data, and detecting an associated target of the target;
S1202, comparing the gesture action state with the associated target to a preset behavior state characteristic standard, and determining the current behavior state of the target.
Specifically, the recognition of the corresponding gesture motion state may be detected and recognized by a gesture motion recognition model trained in advance. The gesture recognition model mainly recognizes and detects the current gesture of the target. When the gesture motion recognition model detects and recognizes the gesture motion state motion of the target, a gesture motion detection and recognition algorithm based on a convolutional neural network may be used. Specifically, by locating a plurality of joints of the target, the action vector of the target is determined based on the joint connection line, so that the gesture action state of the target is determined. Before this, the gesture recognition model needs to acquire a large number of images of the user including gesture movements of various types in advance, and detect and recognize the gesture movements of the user by model training using these images as training samples. On the other hand, the associated target of the corresponding user is identified, and detection and identification are carried out through a pre-trained associated target detection model. The associated target detection model can be a target detection model constructed by using a network such as Faster R-CNN, yolov3 and the like. When the model is built by training, a large amount of image data containing articles such as beds, quilts, sofas, televisions, books, computers, desk lamps and the like are obtained as training samples, and the model is trained by the network to build the associated target detection model. Thus, the associated target detection model performs target detection and identification based on the video image data of the detected target, and the associated target contained in the image data can be determined.
Based on the detected and identified gesture action state and the associated targets, the current target action state can be further judged. Before the gesture action state detection and recognition device, a control device of the intelligent device establishes a behavior state characteristic standard in advance, and then determines the current behavior state of the target by comparing the detected and recognized gesture action state with the associated target. The behavior state feature standard may define in advance a corresponding relationship between a gesture action state and an associated target and a behavior state. For example, a gestured action state is "lying down", and an associated target includes a "bed" and a "quilt", defining its corresponding behavior state as "sleeping". Therefore, when the detected and identified gesture action state and the associated target determine that the current target lies in the bed, the behavior state of the current target is determined to be 'sleeping' through comparison of the behavior state characteristic standard. By analogy, detection and identification of various behavior states of the user can be realized, so that the follow-up adaptive automatic control of the intelligent home equipment can be conveniently carried out according to different behavior states of the user.
S130, adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
Based on the behavior state of the current target (i.e., the user) determined in step S120, the smart home device of the smart home system can be controlled and adjusted by referring to the behavior state of the current target. Before that, the control device of the smart home device may pre-construct a mapping control table of the behavior state and the mapping control mode, and when determining which behavior state the user is currently in, control the corresponding smart home device by adopting the corresponding control mode. Referring to fig. 3, the adjustment control flow of the smart home device includes:
S1301, inquiring a mapping relation table of a preset behavior state and a mapping control mode based on the current behavior state of the target, and determining a corresponding mapping control mode;
S1302, generating control data based on a corresponding mapping control mode, and outputting the control data to corresponding intelligent household equipment of the intelligent household system.
And after determining the current behavior state of the target, inquiring a mapping relation table by taking the behavior state as a data index, and determining a corresponding mapping control mode. And then, generating corresponding control data based on the mapping control mode, and outputting the corresponding control data to corresponding intelligent household equipment for adjustment control. The mapping control mode should include the intelligent home equipment identification information to be adjusted and the corresponding adjustment control parameter information. The control device of the intelligent household equipment can generate corresponding control instructions based on the intelligent household equipment identification information and the adjustment control parameter information and send the corresponding control instructions to the intelligent household equipment corresponding to the intelligent household equipment identification information, so that automatic adjustment of the intelligent household equipment is realized. For example, assuming that the current behavior state of the user is "sleep", inquiring a mapping relation table according to the behavior state, determining that the mapping control mode is "turn off an indoor intelligent lamp, turn off an intelligent curtain, adjust the working mode of an air conditioner or a fan to be a sleep mode", and according to the mapping control mode, producing a corresponding control instruction by the intelligent household equipment, and sending the corresponding control instruction to the intelligent lamp, the intelligent curtain, the air conditioner or the fan of the intelligent household system so as to adjust and control the running state of the corresponding intelligent household equipment.
And when the target is detected, acquiring video image data of the target, inputting the video image data into a preset behavior state detection model, determining the behavior state of the current target, and adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the behavior state of the current target in a preset mapping control mode. By adopting the technical means, the corresponding intelligent household equipment of the intelligent household system can be automatically and intelligently controlled according to the real-time behavior state of the user, the control operation of the user is reduced, the control flexibility and convenience of the intelligent household equipment are improved, and the use experience of the user to the intelligent household system is optimized.
Further, in one embodiment, state data corresponding to the indoor environment and/or the designated area around the house is also collected in real time through the sensor, and corresponding intelligent home equipment of the intelligent home system is adjusted and controlled based on the state data. By way of example, by arranging the light sensing detection element in the room, the indoor light is detected in real time, and when the indoor light brightness is detected to be higher than the set upper limit, the control device of the intelligent household equipment sends a control instruction to the intelligent curtain to drive and control the curtain to be closed. When the indoor light brightness is detected to be lower than the set lower limit, the control device of the intelligent household equipment sends a control instruction to the intelligent lamp to drive and control the intelligent lamp to be started. In addition, after the behavior state of the user is detected and identified according to the video image data, the indoor environment light can be adjusted according to the behavior state of the user and by combining the real-time detection value of the light sensation detection element. For example, when it is detected that the user is reading and the brightness of the current indoor light does not reach the indoor brightness requirement under the scene of reading, the control device of the intelligent household equipment sends a control instruction to the intelligent lamp according to the detection and identification result, and the brightness of the intelligent lamp is adaptively adjusted to meet the requirement of the user on the indoor brightness under the scene of reading.
In addition, in one embodiment, the associated household equipment is also controlled by determining the associated household equipment with the preset linkage control relation with the corresponding intelligent household equipment based on the operation state change linkage adjustment of the corresponding intelligent household equipment. By means of linkage control of the associated household equipment, control operation of a user can be further reduced, and intelligent household equipment control with more intelligence and automation is achieved. For example, the linkage control relation between the intelligent curtain and the intelligent lamp is constructed in advance. When the control device of the intelligent household equipment sends a control instruction to control the intelligent curtain to be opened, at the moment, the control device of the intelligent household equipment sends the control instruction to the intelligent lamp according to the linkage control relation between the intelligent curtain and the intelligent lamp, and the intelligent lamp power is regulated down to regulate the brightness of the intelligent lamp or the intelligent lamp is directly closed, so that the linkage control of the control device of the intelligent household equipment on various intelligent household equipment with linkage control relation is realized. It can be understood that when the curtain is opened, the indoor brightness is influenced by external environment light and can be relatively lightened, so that the indoor brightness is prevented from being too bright at the moment, the power consumption of the system is saved, the intelligent lamp brightness can be reduced adaptively or the energy-saving lamp can be turned off directly, the energy-saving effect of the system is achieved in a linkage control mode, the user operation is further reduced in a linkage control mode, and the use experience of the user is optimized.
Embodiment two:
On the basis of the above embodiment, fig. 4 is a schematic structural diagram of an intelligent device control apparatus of an intelligent home system according to a second embodiment of the present application. Referring to fig. 4, the intelligent device control apparatus of the intelligent home system provided in this embodiment specifically includes: a detection module 21, a determination module 22 and a control module 23.
The detection module 21 is used for detecting a target in real time, and acquiring video image data of the target when the target is detected;
The determining module 22 is configured to input the video image data into a preset behavior state detection model, and determine a current behavior state of the target;
The control module 23 is configured to adjust and control a corresponding smart home device of the smart home system according to a preset mapping control manner according to a current behavior state of the target.
And when the target is detected, acquiring video image data of the target, inputting the video image data into a preset behavior state detection model, determining the behavior state of the current target, and adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the behavior state of the current target in a preset mapping control mode. By adopting the technical means, the corresponding intelligent household equipment of the intelligent household system can be automatically and intelligently controlled according to the real-time behavior state of the user, the control operation of the user is reduced, the control flexibility and convenience of the intelligent household equipment are improved, and the use experience of the user to the intelligent household system is optimized. Further, the determining module 22 includes:
an identification unit for identifying a gesture motion state of the object based on the video image data and detecting an associated object of the object;
And the comparison unit is used for comparing the gesture action state with the associated target to a preset behavior state characteristic standard and determining the current behavior state of the target.
The control module 23 includes:
the query unit is used for querying a mapping relation table of a preset behavior state and a mapping control mode based on the current behavior state of the target, and determining a corresponding mapping control mode;
And the output unit is used for generating control data based on the corresponding mapping control mode and outputting the control data to corresponding intelligent household equipment of the intelligent household system.
The detection module 21 includes:
And the response unit is used for responding to the target detection result and controlling to start the intelligent household equipment appointed by the intelligent household system.
The control module 23 further includes:
and the acquisition control unit is used for acquiring state data corresponding to the indoor environment in real time through the sensor, and adjusting and controlling corresponding intelligent household equipment of the intelligent household system based on the state data.
Specifically, the method further comprises the following steps:
The linkage control module is used for determining associated household equipment with a preset linkage control relation with corresponding intelligent household equipment, and controlling the associated household equipment based on the operation state change linkage of the corresponding intelligent household equipment.
The intelligent device control device of the intelligent home system provided by the second embodiment of the application can be used for executing the intelligent device control method of the intelligent home system provided by the first embodiment of the application, and has corresponding functions and beneficial effects.
Embodiment III:
An electronic device according to a third embodiment of the present application, referring to fig. 5, includes: processor 31, memory 32, communication module 33, input device 34 and output device 35. The number of processors in the electronic device may be one or more and the number of memories in the electronic device may be one or more. The processor, memory, communication module, input device, and output device of the electronic device may be connected by a bus or other means.
The memory 32 is used as a computer readable storage medium for storing software programs, computer executable programs and modules, and is configured to store program instructions/modules corresponding to the smart device control method of the smart home system according to any embodiment of the present application (e.g., a detection module, a determination module and a control module in the smart device control apparatus of the smart home system). The memory may mainly include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store data created according to the use of the device, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, the memory may further include memory remotely located with respect to the processor, the remote memory being connectable to the device through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication module 33 is used for data transmission.
The processor 31 executes various functional applications of the device and data processing by running software programs, instructions and modules stored in the memory, that is, implements the smart device control method of the smart home system described above.
The input means 34 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the device. The output means 35 may comprise a display device such as a display screen.
The electronic device provided by the above can be used for executing the intelligent device control method of the intelligent home system provided by the above embodiment, and has corresponding functions and beneficial effects.
Embodiment four:
the embodiment of the application also provides a storage medium containing computer executable instructions, which when executed by a computer processor, are used for executing a smart device control method of a smart home system, the smart device control method of the smart home system comprises the following steps: performing target detection in real time, and acquiring video image data of a target when the target is detected; inputting the video image data into a preset behavior state detection model, and determining the current behavior state of the target; and adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode.
Storage media-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, lanbas (Rambus) RAM, etc.; nonvolatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a second, different computer system connected to the first computer system through a network such as the internet. The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations (e.g., in different computer systems connected by a network). The storage medium may store program instructions (e.g., embodied as a computer program) executable by one or more processors.
Of course, the storage medium containing the computer executable instructions provided by the embodiment of the application is not limited to the intelligent device control method of the intelligent home system, and related operations in the intelligent device control method of the intelligent home system provided by any embodiment of the application can be performed.
The intelligent device control device, the storage medium and the electronic device of the intelligent home system provided in the foregoing embodiments may execute the intelligent device control method of the intelligent home system provided in any embodiment of the present application, and technical details not described in detail in the foregoing embodiments may be referred to the intelligent device control method of the intelligent home system provided in any embodiment of the present application.
The foregoing description is only of the preferred embodiments of the application and the technical principles employed. The present application is not limited to the specific embodiments described herein, but is capable of numerous modifications, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, while the application has been described in connection with the above embodiments, the application is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit of the application, the scope of which is set forth in the following claims.
Claims (8)
1. The intelligent equipment control method of the intelligent home system is characterized by comprising the following steps of:
performing target detection in real time, and acquiring video image data of a target when the target is detected;
Inputting the video image data into a preset behavior state detection model, determining the current behavior state of the target, wherein the method comprises the steps of identifying the gesture action state of the target based on the video image data, detecting the associated target of the target, comparing the gesture action state with the associated target to a preset behavior state feature standard, and determining the current behavior state of the target, wherein the step of identifying the gesture action state of the target based on the video image data comprises the following steps: positioning a plurality of joints of a target, determining a motion vector of the target based on joint connection, and determining a gesture motion state of the target based on the motion vector of the target;
And adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode, wherein the intelligent household equipment comprises the steps of collecting state data corresponding to indoor environments and/or designated areas around houses in real time through sensors, and adjusting and controlling the corresponding intelligent household equipment of the intelligent household system based on the state data.
2. The smart device control method of the smart home system according to claim 1, wherein adjusting and controlling the corresponding smart home device of the smart home system according to the current behavior state of the target and a preset mapping control manner, includes:
inquiring a mapping relation table of a preset behavior state and a mapping control mode based on the current behavior state of the target, and determining a corresponding mapping control mode;
And generating control data based on the corresponding mapping control mode, and outputting the control data to corresponding intelligent household equipment of the intelligent household system.
3. The smart device control method of the smart home system according to claim 1, wherein the target detection is performed in real time, comprising:
And acquiring an indoor video image through a camera to detect the target or detecting the target through infrared detection.
4. The smart device control method of a smart home system according to claim 1, wherein, when a target is detected, video image data of the target is acquired, further comprising:
And controlling to start the intelligent household equipment appointed by the intelligent household system in response to the target detection result.
5. The smart device control method of the smart home system according to any one of claims 1 to 4, further comprising, after adjusting and controlling a corresponding smart home device of the smart home system according to a preset mapping control manner according to a current behavior state of the target:
and determining associated household equipment with a preset linkage control relation with the corresponding intelligent household equipment, and adjusting and controlling the associated household equipment in a linkage mode based on the running state change of the corresponding intelligent household equipment.
6. An intelligent device control apparatus of an intelligent home system, comprising:
the detection module is used for detecting the target in real time, and acquiring video image data of the target when the target is detected;
The determining module is configured to input the video image data into a preset behavior state detection model, determine a current behavior state of the target, and include identifying a gesture motion state of the target based on the video image data, detecting an associated target of the target, comparing the gesture motion state with the associated target to a preset behavior state feature standard, and determining the current behavior state of the target, specifically configured to identify the gesture motion state of the target based on the video image data, where the determining module includes: positioning a plurality of joints of a target, determining a motion vector of the target based on joint connection, and determining a gesture motion state of the target based on the motion vector of the target;
The control module is used for adjusting and controlling corresponding intelligent household equipment of the intelligent household system according to the current behavior state of the target and a preset mapping control mode, and particularly used for acquiring state data corresponding to indoor environments and/or designated areas around houses in real time through sensors and adjusting and controlling the corresponding intelligent household equipment of the intelligent household system based on the state data.
7. An electronic device, comprising:
A memory and one or more processors;
The memory is used for storing one or more programs;
The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the smart device control method of the smart home system of any of claims 1-5.
8. A storage medium containing computer executable instructions which, when executed by a computer processor, are for performing the smart device control method of the smart home system of any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010665220.1A CN111752165B (en) | 2020-07-10 | 2020-07-10 | Intelligent equipment control method and device of intelligent home system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010665220.1A CN111752165B (en) | 2020-07-10 | 2020-07-10 | Intelligent equipment control method and device of intelligent home system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111752165A CN111752165A (en) | 2020-10-09 |
| CN111752165B true CN111752165B (en) | 2024-08-27 |
Family
ID=72711320
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010665220.1A Active CN111752165B (en) | 2020-07-10 | 2020-07-10 | Intelligent equipment control method and device of intelligent home system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111752165B (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112666837A (en) * | 2020-11-13 | 2021-04-16 | 广州大学 | Indoor environment monitoring system and method based on group adaptive behavior recognition |
| CN114661001A (en) * | 2020-12-23 | 2022-06-24 | 深圳Tcl新技术有限公司 | Control method and system for smart home, storage medium and server |
| CN112820014A (en) * | 2020-12-30 | 2021-05-18 | 珠海格力电器股份有限公司 | Intelligent access control system control method, device, equipment and medium |
| CN112596615A (en) * | 2020-12-31 | 2021-04-02 | 广东富美达科技有限公司 | AI intelligent control system based on LED display screen and control method thereof |
| CN113194292A (en) * | 2021-04-30 | 2021-07-30 | 招商局金融科技有限公司 | Coordination management method, device, equipment and storage medium for intelligent equipment |
| CN113341743B (en) * | 2021-06-07 | 2023-11-28 | 深圳市欧瑞博科技股份有限公司 | Smart home equipment control method and device, electronic equipment and storage medium |
| CN113671847A (en) * | 2021-08-13 | 2021-11-19 | 珠海格力电器股份有限公司 | Linkage control method, system and device of intelligent household equipment and storage medium |
| CN114035441A (en) * | 2021-11-11 | 2022-02-11 | 珠海格力电器股份有限公司 | Control method, device and system of household appliance |
| CN116136659A (en) * | 2021-11-16 | 2023-05-19 | 华为技术有限公司 | Intelligent device control method and electronic device |
| CN114237069B (en) * | 2021-12-20 | 2024-07-09 | 珠海格力电器股份有限公司 | Indoor environment control method, device, system and storage medium |
| CN114519818A (en) * | 2022-01-14 | 2022-05-20 | 杭州未名信科科技有限公司 | Method and device for detecting home scene, electronic equipment and medium |
| CN114842319A (en) * | 2022-03-01 | 2022-08-02 | 杭州未名信科科技有限公司 | Method and device for detecting home scene, electronic equipment and medium |
| CN114740745B (en) * | 2022-04-25 | 2023-01-24 | 深圳市联合同创科技股份有限公司 | Intelligent household control method and terminal |
| CN116165911B (en) * | 2023-04-19 | 2023-07-11 | 深圳市吉方工控有限公司 | Smart home control method and device, embedded industrial control equipment and medium |
| CN116685033B (en) * | 2023-06-21 | 2024-01-12 | 惠州兴通成机电技术有限公司 | Intelligent control system for lamp |
| CN118139245B (en) * | 2024-03-07 | 2024-09-20 | 广东艾罗智能光电股份有限公司 | Lighting control method and device based on indoor UWB positioning |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107166645A (en) * | 2017-05-18 | 2017-09-15 | 厦门瑞为信息技术有限公司 | A kind of air conditioning control method analyzed based on indoor scene |
| CN108427310A (en) * | 2018-05-17 | 2018-08-21 | 深圳市零度智控科技有限公司 | Intelligent home furnishing control method, device and computer readable storage medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106707770B (en) * | 2015-07-27 | 2019-06-14 | 中兴通讯股份有限公司 | Intelligent electrical appliance control and intelligent Home Appliance Controller |
| CN105785782B (en) * | 2016-03-29 | 2018-12-11 | 北京小米移动软件有限公司 | Intelligent home equipment control method and device |
| CN207096800U (en) * | 2017-09-01 | 2018-03-13 | 南昌欧菲光科技有限公司 | Intelligent home control device and intelligent domestic system |
| US10664688B2 (en) * | 2017-09-20 | 2020-05-26 | Google Llc | Systems and methods of detecting and responding to a visitor to a smart home environment |
| CN108572558A (en) * | 2018-05-28 | 2018-09-25 | 深圳市零度智控科技有限公司 | Intelligent home furnishing control method, device and computer readable storage medium |
| CN109558865A (en) * | 2019-01-22 | 2019-04-02 | 郭道宁 | A kind of abnormal state detection method to the special caregiver of need based on human body key point |
| CN110032081A (en) * | 2019-04-18 | 2019-07-19 | 合肥泛米智能科技有限公司 | A kind of smart home mode triggering method |
-
2020
- 2020-07-10 CN CN202010665220.1A patent/CN111752165B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107166645A (en) * | 2017-05-18 | 2017-09-15 | 厦门瑞为信息技术有限公司 | A kind of air conditioning control method analyzed based on indoor scene |
| CN108427310A (en) * | 2018-05-17 | 2018-08-21 | 深圳市零度智控科技有限公司 | Intelligent home furnishing control method, device and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111752165A (en) | 2020-10-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111752165B (en) | Intelligent equipment control method and device of intelligent home system | |
| KR102393418B1 (en) | Data learning server and method for generating and using thereof | |
| CN106152408B (en) | Intelligent air conditioner controller, control method and air conditioner | |
| WO2020029484A1 (en) | Control method and apparatus for smart home system, processor, and storage medium | |
| CN104965552B (en) | A kind of smart home environment cooperative control method based on emotional robot and system | |
| WO2018093463A1 (en) | Controlling connected devices using a relationship graph | |
| US20030227439A1 (en) | System and method for adapting the ambience of a local environment according to the location and personal preferences of people in the local environment | |
| TW201636887A (en) | Smart control apparatus and system | |
| CN107229262A (en) | A kind of intelligent domestic system | |
| CN107566227A (en) | Control method and device of household appliance, intelligent device and storage medium | |
| US20170315519A1 (en) | Systems and methods to operate controllable devices with gestures and/or noises | |
| WO2015003377A1 (en) | Smart house system and operation method therefor | |
| CN107360066A (en) | A kind of household service robot and intelligent domestic system | |
| CN108131808B (en) | Air conditioner control device and method based on hierarchical gesture recognition | |
| CN110426962A (en) | A kind of control method and system of smart home device | |
| CN111338227A (en) | Electronic appliance control method and control device based on reinforcement learning and storage medium | |
| CN118102556B (en) | Full-house intelligent lamplight illumination noninductive control method and related device | |
| WO2024193560A1 (en) | Area configuration method and apparatus, and device and storage medium | |
| CN108536027B (en) | Intelligent home control method and device and server | |
| CN113867163A (en) | Intelligent household scene switching method and device, intelligent terminal and storage medium | |
| CN104214888A (en) | Air conditioner and temperature control method and device thereof | |
| CN114509953A (en) | Device control method, computer program product, control device, and storage medium | |
| CN109143882A (en) | A kind of control method and device | |
| KR102561210B1 (en) | System and Method for Sleeptech controlling using AR in Smart Home Environment | |
| Zou et al. | Design of smart home controller based on raspberry PI |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |