CN113625584A - Household equipment locking method, system and device and household equipment - Google Patents
Household equipment locking method, system and device and household equipment Download PDFInfo
- Publication number
- CN113625584A CN113625584A CN202111011860.1A CN202111011860A CN113625584A CN 113625584 A CN113625584 A CN 113625584A CN 202111011860 A CN202111011860 A CN 202111011860A CN 113625584 A CN113625584 A CN 113625584A
- Authority
- CN
- China
- Prior art keywords
- household equipment
- locking
- area
- user
- threshold value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000001514 detection method Methods 0.000 claims abstract description 65
- 238000012544 monitoring process Methods 0.000 claims abstract description 39
- 238000004891 communication Methods 0.000 claims description 33
- 238000005406 washing Methods 0.000 claims description 30
- 238000013507 mapping Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 9
- 238000003331 infrared imaging Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000013473 artificial intelligence Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 230000003930 cognitive ability Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Selective Calling Equipment (AREA)
Abstract
The application discloses a locking method, a system and a device of household equipment and the household equipment, wherein the locking method of the household equipment comprises the following steps: acquiring an area array image shot by a ToF camera aiming at a monitoring area of household equipment; extracting size parameters representing user features from the area array image; locking the household equipment according to the relation between the size parameter and a pre-stored first detection threshold value; the first detection threshold is used to define a characteristic of a constraint object. The safety performance of the household equipment can be improved.
Description
Technical Field
The application relates to the technical field of intelligent control, in particular to a locking method, a locking system and a locking device for household equipment and the household equipment.
Background
Household equipment such as washing machines, gas stoves and refrigerators face a curiosity of children and are difficult to operate normally, and the household equipment has a locking requirement so as to ensure personal safety of the household equipment, and the household equipment can be prevented from being interfered by the household equipment and can be operated normally at some time. At present, the home equipment can only identify operation behaviors sent by children with lower cognitive competence or younger children, and the locking function is executed according to the operation behaviors, so that the coverage of the locking function is limited, and the safety performance of the home equipment is low easily.
Disclosure of Invention
In view of this, the application provides a locking method, a locking system, a locking device and home equipment for home equipment, so as to solve the problem that the locking function coverage of the conventional home equipment is limited, which easily causes low security performance of the home equipment.
The application provides a locking method of household equipment in a first aspect, and the method comprises the following steps:
acquiring an area array image shot by a ToF camera aiming at a monitoring area of household equipment;
extracting size parameters representing user features from the area array image;
locking the household equipment according to the relation between the size parameter and a pre-stored first detection threshold value; the first detection threshold is used to define a characteristic of a constraint object.
Optionally, the size parameter comprises a user height; the first detection threshold comprises a height threshold; the locking the household equipment according to the relation between the size parameter and the pre-stored first detection threshold value comprises the following steps: when the height of the user is smaller than the height threshold value, locking the household equipment;
and/or, the size parameter comprises palm area; the first detection threshold comprises an area threshold; the locking the household equipment according to the relation between the size parameter and the pre-stored first detection threshold value comprises the following steps: and when the palm area is smaller than the area threshold value, locking the household equipment.
Optionally, the locking the household device includes: keeping the running state of the household equipment unchanged; preventing the household equipment from being started; and/or locking a switch component of the household equipment.
Optionally, the extracting, from the area array image, a size parameter characterizing a user feature includes:
identifying a target image plane characterizing the user in the area array image;
and determining the size parameter according to the coordinate parameter of the target image surface.
Optionally, the determining the size parameter according to the coordinate parameter of the target image plane includes:
acquiring a boundary line of the target image surface, and searching a first key point and a second key point representing the height of the user on the boundary line;
and determining the height of the user according to the first key point and the second key point.
Optionally, the determining the user height from the first and second keypoints comprises:
acquiring a first depth coordinate of the first key point in a depth coordinate system and a second depth coordinate of the second key point in the depth coordinate system; the depth coordinate system is used for limiting the coordinates of each point on the area array image;
mapping the first depth coordinate and the second depth coordinate to a world coordinate system respectively to obtain a first world coordinate corresponding to the first key point and a second world coordinate corresponding to the second key point; the world coordinate system is used for defining coordinates in a physical space where the user is located;
and calculating the height of the user according to the first world coordinate and the second world coordinate.
Optionally, the determining the size parameter according to the coordinate parameter of the target image plane includes:
identifying a palm region characterizing a palm of a user's hand in the target image plane;
and acquiring the area size of the palm area, and calculating the palm area according to the area size.
Optionally, the region size comprises a first side length and a second side length of a minimum bounding rectangle of the palm region.
Optionally, the locking method of the household device further includes:
after the household equipment is locked, pushing a locking message of the household equipment to a communication object;
and/or receiving a first new threshold value from the communication object, and determining the first detection threshold value according to the first new threshold value.
Optionally, the locking method of the household device further includes:
when the household equipment is in a locked state, unlocking the household equipment according to the relation between the size parameter and a second detection threshold value; the second detection threshold is used to define a characteristic of the unrestricted object.
Another aspect of the present application provides a locking system for a home device, including:
the system comprises an acquisition module, a monitoring module and a processing module, wherein the acquisition module is used for acquiring an area array image shot by a ToF camera aiming at a monitoring area of household equipment;
the extraction module is used for extracting size parameters representing the characteristics of the user from the area array image;
the locking module is used for locking the household equipment according to the relation between the size parameter and a pre-stored first detection threshold value; the first detection threshold is used to define a characteristic of a constraint object.
Another aspect of the present application provides a locking device for a household device, including a ToF camera, a processor and a storage medium; the storage medium having program code stored thereon; the processor is used for calling the program codes stored in the storage medium to execute any one of the locking methods of the household equipment.
Another aspect of the present application provides a piece of household equipment, including any one of the above-mentioned locking devices of household equipment.
Optionally, the household equipment comprises a gas stove, the monitoring area comprises an area where a user ready to use the gas stove is located and/or an area where an ignition device of the gas stove is operated, and the ToF camera is arranged above the gas stove to shoot the monitoring area;
and/or the household equipment comprises a washing machine, the monitoring area comprises an area where a user who is ready to use the washing machine is located and/or an area where a control panel of the washing machine is operated, and the ToF camera is arranged on at least one surface of the washing machine facing the user to shoot the area where the user who is ready to use the washing machine is located.
Optionally, the home device further includes a communication module, so that after the home device is locked, a locking message of the home device is pushed to a communication object; and/or receiving a first new threshold value from the communication object, and determining the first detection threshold value according to the first new threshold value.
According to the locking method, the locking system and the locking device for the household equipment and the household equipment, the size parameters representing the characteristics of the user are extracted from the area array image by acquiring the area array image shot by the ToF camera aiming at the monitoring area of the household equipment, the type of the size parameters can be set according to the characteristics of the limited object and the non-limited object in the family of the user, the flexibility is high, and the coverage area is wide; and locking the household equipment according to the relation between the size parameter and the first detection threshold value for limiting the characteristics of the limited object, so that the limited object can be locked in time when the corresponding household equipment is prepared to operate in a monitoring area of the household equipment, the household equipment is not limited by the interference of the limited object, the household equipment can continue to operate and/or does not respond to the related operation and control of the limited object, the related safety problem of the limited object is not caused, and the safety performance of the household equipment can be effectively improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a locking method of home equipment according to an embodiment of the present application;
FIG. 2 is a waveform diagram illustrating the emission and reflection of infrared laser pulses in an embodiment of the present application;
fig. 3 is a schematic structural diagram of a locking system of a household device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a locking device of a household appliance according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a home device according to an embodiment of the present application.
Detailed Description
As described in the background art, at present, home equipment such as washing machines and gas cookers can only be locked for children with low cognitive ability or younger age to prevent behaviors such as misoperation. For example, some gas cookers have children locks that can only prevent children under 5 years of age, and for children over 5 years of age, the older the child is, the stronger the cognition is, the weaker the corresponding prevention effect is; and some child locks on the washing machine can be unlocked only by continuously trial and error (such as multiple touches, long-time touches and the like). Therefore, the coverage of the locking function on the household equipment is limited, and the safety performance of corresponding household products is easy to be low.
In order to solve the problems, when a user is located in a monitoring area of home equipment to prepare to operate the corresponding home equipment, the home equipment can be locked according to the relation between the size parameter detected in real time and the first detection threshold value used for limiting the characteristics of the limited object, so that the home equipment is not limited by the interference of the limited object, can continuously operate and/or does not respond to the related control of the limited object, the related safety problem of the corresponding limited object is not caused, and the safety performance of the home equipment is effectively improved.
The technical solutions in the embodiments of the present application are clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. The following embodiments and their technical features may be combined with each other without conflict.
In a first aspect of the present application, a locking method for a home device is provided, and as shown in fig. 1, the locking method for the home device includes:
and S110, acquiring an area array image shot by the ToF camera aiming at the monitoring area of the household equipment.
The household equipment may include equipment which may cause safety accidents of some restricted objects or be easily operated by the restricted objects, such as a gas stove, a washing machine, a refrigerator and/or some storage cabinets. The restricted object is a person who needs to restrict the household equipment from being used by a family using the corresponding household equipment, and can comprise people who cannot independently operate the household equipment, such as children and/or mentally impaired people; accordingly, non-limiting objects may include people who are able to operate the home devices described above independently. The monitoring area is set according to the characteristics of the corresponding household equipment; for example, if the household device includes a gas stove, the monitoring area includes an area where a user ready to use the gas stove is located and/or an area where an ignition device of the gas stove is operated, and the corresponding ToF camera may be disposed above the gas stove (e.g., outside or below a range hood corresponding to the gas stove, etc.); if the household equipment comprises a drum washing machine, the monitoring area comprises an area where a user who is ready to use the drum washing machine is located and/or an area where a control panel of the drum washing machine is operated, and the corresponding ToF camera can be arranged near the control panel of the drum washing machine; if the home device includes a refrigerator, the monitoring area includes an area where a user is located to open a refrigerator door, and the ToF camera may be located at a position above an outer side of the refrigerator door.
The ToF camera can shoot a monitoring area, acquire an area array image including user whole-body image information and/or target part image information appearing in the monitoring area, the area array image includes depth map information, and each point data of the area array image can be acquired according to the depth map information, where each point data can include coordinates of each point (such as image coordinates, pixel coordinates and/or depth coordinates, etc.), depth information, membership of each point with the user or the target part, and which feature specifically belongs to the user (such as a point on a boundary of a certain edge of a corresponding image), and so on. Optionally, the ToF camera may further include an infrared laser emitter and a photosensitive sensor, where the external laser emitter actively and continuously emits infrared laser pulses, and the photosensitive sensor collects energy of reflected light at multiple times, so as to determine distance information between the user and the ToF camera according to collected parameters such as energy, convert the distance information, and determine depth information of corresponding points of the area array image.
Optionally, the above steps may control the ToF camera to shoot the monitoring area after the user appears in the monitoring area, so as to improve the effectiveness of the shot area array image.
And S120, extracting size parameters representing the user characteristics from the area array image.
The area array image may include depth map information, and the depth map information may be analyzed using a correlation artificial intelligence analysis technique to identify data points and coordinates of the data points representing the user and/or locations of the user, thereby determining a dimensional parameter characterizing the user characteristic. Optionally, the area array image may further include infrared imaging information, the infrared imaging information is identified by using a related artificial intelligence identification technology, a target image plane representing the user and/or each part of the user may be identified more accurately, the depth map information is analyzed, and coordinates of each data point may be determined, so as to determine a size parameter representing the user characteristic.
The type of the above-mentioned size parameter may be determined according to the object characteristics of the limited object, and may include, for example, height, face area, palm area, and/or the like.
S130, locking the household equipment according to the relation between the size parameter and a pre-stored first detection threshold value; the first detection threshold is used to define a characteristic of a constraint object.
The first detection threshold may be determined according to the type of the size parameter and/or the corresponding characteristics of the restricted object and the non-restricted object in the corresponding household; the first detection threshold value can be set by a user according to specific characteristics of a limited object and a non-limited object corresponding to the home of the user by the corresponding home equipment, and when the corresponding characteristics of the limited object and the non-limited object change, the first detection threshold value can be reset, so that the flexibility of the locking method of the home equipment is improved. For example, for a limited object such as a child, if the size parameter includes a height of the user, the corresponding first detection threshold may include a height threshold, and when the height of the user is smaller than the height threshold, it indicates that the user currently appearing in the monitoring area is the child, and the home device may be locked to improve the safety performance of the home device.
Optionally, the size parameters may include multiple types of parameters in user characteristic parameters such as height, face area, palm area, and the like, each type of size parameter has a corresponding first detection threshold, so as to simultaneously detect a relationship between each type of size parameter and the corresponding first detection threshold, and lock the home equipment according to each detection result, so as to ensure accuracy of the locking operation.
In one embodiment, the size parameter may include a height of the user; the first detection threshold comprises a height threshold; the locking the household equipment according to the relation between the size parameter and the pre-stored first detection threshold value comprises the following steps: and when the height of the user is smaller than the height threshold value, locking the household equipment. The height threshold may be determined based on the height of the subject; the height of the user is smaller than the height threshold value, which indicates that the user currently appearing in the monitoring area is a limiting object, and the home equipment is locked, so that the home equipment is not interfered by the limiting object and related safety problems to the limiting object are avoided; the height of the user is larger than or equal to the height threshold value, the user currently appearing in the monitoring area is an unlimited object, and the home device can normally respond to various operations of the user.
In one example, the size parameter includes a palm area; the first detection threshold comprises an area threshold; the locking the household equipment according to the relation between the size parameter and the pre-stored first detection threshold value comprises the following steps: and when the palm area is smaller than the area threshold value, locking the household equipment. The area threshold may be determined according to the size of the palm of the subject. If the area of the palm is smaller than the area threshold value, the user currently appearing in the monitoring area is the limiting object, and the household equipment is locked, so that the household equipment is not interfered by the limiting object, and the personal safety of the limiting object is not influenced; the area of the palm is larger than or equal to the area threshold value, which indicates that the user currently appearing in the monitoring area is a non-limiting object, and the household equipment does not need to be locked so as to normally respond to various operations of the user and ensure the user experience.
Specifically, the mode of locking the home device may be determined according to the features of the home device, such as the function and/or the current state. For example, for a running washing machine, locking can be realized by keeping the running state of the washing machine unchanged, so that no matter what instruction is input to the control panel by the limiting object, the washing machine does not respond, and the washing machine continues to run to respond to the washing requirement of a corresponding user; for household equipment such as a gas stove which possibly causes safety accidents, the household equipment can be prevented from being started (such as ignition of the gas stove is prevented), so that corresponding safety problems are prevented from being caused after the household equipment is started, and the safety of the household equipment and a limited object can be ensured; the switch parts of the household equipment can be locked aiming at the storage equipment such as the refrigerator, so that the household equipment does not respond to the opening operation of the limited object, and the stored articles are protected.
In one embodiment, the extracting of the size parameter characterizing the user feature from the area array image includes: identifying a target image plane characterizing the user in the area array image; and determining the size parameter according to the coordinate parameter of the target image surface. In this embodiment, the depth information of each pixel in the area array image may be identified to determine a target image plane representing the user, for example, a pixel with a depth parameter in a certain specific range is determined as a pixel representing the user, so as to determine the target image plane, and the like. Optionally, the area array image may further include infrared imaging information, and identifying a target image plane representing the user in the area array image may include: and determining a target image plane representing the user in the area array image according to the infrared imaging information. The area array image comprises infrared imaging information and depth map information, the infrared imaging information is identified by adopting a related artificial intelligence identification technology, a target image surface of a user representing a vehicle to be used can be identified more accurately, the depth map information is analyzed, the coordinates of each data point can be determined, the coordinates of a plurality of points representing various characteristics of the user are determined, and size parameters representing the characteristics of the user are calculated according to the coordinates of the points.
Further, the present embodiment may further analyze the target image plane to identify images representing various parts of the user, such as a face image and/or a palm image, so as to obtain the size parameters for the images, thereby improving the comprehensiveness of the obtained size parameters.
In one example, if the size parameter includes a height of the user, the determining the size parameter according to the coordinate parameter of the target image plane includes: acquiring a boundary line of the target image surface, and searching a first key point and a second key point representing the height of the user on the boundary line; and determining the height of the user according to the first key point and the second key point. The first key point can be a point representing the top of the head of the user, and the second key point can be a point representing the sole of the foot of the user; the height of the user is determined according to the first key point and the second key point, and the accuracy of the determined height of the user is guaranteed.
Specifically, the determining the height of the user according to the first key point and the second key point comprises: acquiring a first depth coordinate of the first key point in a depth coordinate system and a second depth coordinate of the second key point in the depth coordinate system; the depth coordinate system is used for limiting the coordinates of each point on the area array image; mapping the first depth coordinate and the second depth coordinate to a world coordinate system respectively to obtain a first world coordinate corresponding to the first key point and a second world coordinate corresponding to the second key point; the world coordinate system is used for defining coordinates in a physical space where the user is located; and calculating the height of the user according to the first world coordinate and the second world coordinate. The points on the area array image may also correspond to a plurality of coordinate systems defining corresponding characteristics of each point, such as an image coordinate system and a pixel coordinate system, and each point may be mapped or transformed between the coordinate systems to obtain its parameters in other coordinate systems according to its parameters in one coordinate system, for example, any point in a world coordinate system is mapped into the image coordinate system by way of pinhole imaging, and transformation between the image coordinate system and the pixel coordinate system is realized by way of translation, and so on. After obtaining the first world coordinate and the second world coordinate, the distance between the first key point and the second key point in the world coordinate system can be calculated according to the related distance calculation formula to obtain the first world coordinate and the second world coordinateThe height of the user, for example, if the first world coordinate is P (x)1，y1，z1) Second world coordinate is P' (x)2，y2，z2) Then, the distance between the first key point and the second key point in the world coordinate system is:
optionally, the mapping relationship between the depth coordinate system and the world coordinate system includes:
wherein u represents a first-dimensional coordinate of the mapping point in the depth coordinate system, v represents a second-dimensional coordinate of the mapping point in the depth coordinate system, and ZcDepth information representing a mapping point, fxRepresenting a first internal parameter, f, of the ToF camerayRepresenting a second internal parameter, u, of the ToF camera0Representing a third internal parameter, v, of the ToF camera0Represents a fourth internal parameter of the ToF camera, R represents a first external parameter of the ToF camera, T represents a second external parameter of the ToF camera,
denotes the zero vector, XWRepresenting the first-dimensional coordinate, Y, of a mapped point in the world coordinate systemWSecond-dimensional coordinates, Z, representing mapped points in the world coordinate systemWRepresenting the third coordinate of the mapped point in the world coordinate system. Wherein the first internal parameter fxSecond internal parameter fyThe third internal parameter u is the two-axis focal length of the ToF camera0And a fourth internal parameter v0The central positions of the ToF camera in the two axis directions may be determined by calibration or the like.
Optionally, the depth information may include distance information detected by the ToF camera for the user, and the distance information detected by the ToF camera for the user is correspondingly calculated, so that accurate depth information may be obtained. Specifically, the process of acquiring the distance information includes: acquiring first energy acquired by the ToF camera at a first acquisition moment and second energy acquired by the ToF camera at a second acquisition moment respectively; calculating distance information between the user and the ToF camera according to the first energy, the second energy and a distance calculation formula; the distance calculation formula is used to define a relationship of the first energy, the second energy, the distance between the user and the ToF camera. The ToF camera is adopted to emit infrared laser pulses to a user, and the energy of the infrared laser pulses reflected to the ToF camera by the user is collected, so that the distance between the ToF camera and the ToF camera is calculated, and the accuracy, the continuity and the timeliness in the distance acquisition process can be ensured.
The ToF camera comprises an infrared laser emitter and a photosensitive sensor, so that the infrared laser emitter is used for emitting infrared laser pulses to a user, and the photosensitive sensor is used for collecting energy corresponding to the infrared laser pulses reflected by the user; the waveform diagram in this process can be referred to as shown in fig. 2. Wherein the infrared laser emitter actively and continuously emits infrared laser pulses, and the photosensitive sensor collects the energy of the reflected light at each moment to obtain a first energy Q1And a second energy Q2(ii) a First energy Q1And a second energy Q2Corresponding to the total amount of reflected light, and Q2The ratio with respect to the total amount is exactly equal to a delay of the reflected light with respect to the emitted light, so that the distance between the ToF camera and the user is obtained by multiplying this delay by the speed of light and dividing by 2. Accordingly, the above distance calculation formula includes:
where d denotes distance information between the user and the ToF camera, c denotes a speed of light, Δ t denotes a time interval between the first acquisition time and the second acquisition time, Q1Representing a first energy, Q2Representing a second energy.
In one example, the above size parameter includes a palm area, and the determining the size parameter according to the coordinate parameter of the target image plane includes: identifying a palm region characterizing a palm of a user's hand in the target image plane; and acquiring the area size of the palm area, and calculating the palm area according to the area size. The region size may include the side length and the like of the palm region, and the palm area can be accurately calculated according to the region size. Optionally, the present example may convert the region size from the depth coordinate system to the world coordinate system to obtain the palm region defined by the world coordinate system, so as to set a corresponding area threshold value with which to accurately identify the palm area representing the constraint object.
In particular, the region size includes a first side length and a second side length of a minimum bounding rectangle of the palm region. The first side length and the second side length are used for calculating the side lengths of the corresponding rectangular areas, and the area of the palm area is calculated by adopting the minimum external rectangle, so that the calculation process can be simplified, and the processing efficiency is improved.
In one embodiment, the locking method of the household device further includes: after the household equipment is locked, a locking message of the household equipment is pushed to a communication object. The communication object may include communication addresses corresponding to some intelligent terminals of a family, such as mobile phone addresses corresponding to a wireless local area network, and the like, or may include contact accounts corresponding to a guardian's mobile phone number and the like, which can contact corresponding family members in time, and the like. In this embodiment, after the home device is locked, the locking message of the home device is pushed to the communication object, so that the corresponding family member can timely know the above situation, and perform corresponding processing, thereby further improving the security of the home device and the corresponding restricted object.
In an example, if the home device has a function of communicating with other communication terminals and/or communication objects such as communication accounts, the method for locking the home device may further include: receiving a first new threshold value from a communication object, and determining the first detection threshold value according to the first new threshold value. According to the method, when the user needs to remotely set the first detection threshold, the first newly-set threshold is set on the communication object capable of communicating with the household equipment, so that the communication object sends the first newly-set threshold to the household equipment, and the household equipment determines the first detection threshold according to the first newly-set threshold, so that the flexibility of setting the first detection threshold by the user is further improved. Optionally, if the first detection threshold is not pre-stored in the home device, the home device may determine the first new threshold as the first detection threshold; if the first detection threshold value is pre-stored in the home equipment, the home equipment can update the first detection threshold value to a first newly-set threshold value so as to ensure the accuracy of the predicted first detection threshold value.
Optionally, if the home device needs to pre-store a second detection threshold for unlocking the device, the method for locking the home device may further include: and receiving a second new threshold value from the communication object, and determining the second detection threshold value according to the second new threshold value. When the user needs to remotely set the second detection threshold, a second newly-set threshold can be set on the communication object, so that the communication object sends the second newly-set threshold to the home equipment, and the home equipment determines the second detection threshold according to the second newly-set threshold, so that the flexibility of setting the second detection threshold by the user is improved.
After the home equipment is locked, the user operation cannot be responded before the home equipment is unlocked, and at this time, if the non-restricted object needs to use the home equipment, the home equipment is difficult to directly use. In view of this problem, in an embodiment, the method for locking a household device further includes: when the household equipment is in a locked state, unlocking the household equipment according to the relation between the size parameter and a second detection threshold value; the second detection threshold is used to define a characteristic of the unrestricted object. The second detection threshold is matched with the first detection threshold, and may be determined according to the type of the size parameter and/or the object characteristics of the unrestricted object, and is usually set as a threshold capable of characterizing most of the unrestricted object. Under some conditions, various size parameters of non-limited objects such as adult users are often in a relatively large level, and at the moment, when the size parameters are larger than or equal to a second detection threshold value, it can be judged that the user currently appearing in the monitoring area is the non-limited object, and the household equipment is unlocked in time, so that the household equipment can respond to various operations of the user, and user experience brought by the household equipment is improved.
According to the locking method of the household equipment, the area array image shot by the ToF camera aiming at the monitoring area of the household equipment is obtained, the size parameter representing the characteristics of the user is extracted from the area array image, the type of the size parameter can be set according to the characteristics of the limited object and the non-limited object of the user in the family, the flexibility is high, and the coverage area is wide; and locking the household equipment according to the relation between the size parameter and the first detection threshold value for limiting the characteristics of the limited object, so that the limited object can be locked in time when the corresponding household equipment is prepared to operate in a monitoring area of the household equipment, the household equipment is not limited by the interference of the limited object, the household equipment can continue to operate and/or does not respond to the related operation and control of the limited object, the related safety problem of the limited object is not caused, and the safety performance of the household equipment can be effectively improved.
The present application provides, in a second aspect, a locking system for a household device, as shown in fig. 3, including:
the acquisition module 110 is configured to acquire an area array image shot by the ToF camera for a monitoring area of the home equipment;
an extracting module 120, configured to extract a size parameter representing a user feature from the area array image;
the locking module 130 is configured to lock the household equipment according to a relationship between the size parameter and a pre-stored first detection threshold; the first detection threshold is used to define a characteristic of a constraint object.
For specific limitations of the locking system of the home device, reference may be made to the above limitations on the locking method of the home device, which are not described herein again. All or part of each module in the locking system of the household equipment can be realized through software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent of an operation module in the computer equipment, and can also be stored in a memory in the computer equipment in a software form, so that the operation module of the computer equipment can call and execute the operation corresponding to each module.
The present application provides a locking device for a household device in a third aspect, as shown in fig. 4, the locking device for a household device includes a ToF camera 610, a processor 620 and a storage medium 630; the storage medium 630 has program code stored thereon; the processor 620 is configured to call the program code of the storage medium storage 630 to execute the locking method of the home device according to any of the embodiments.
The locking device of the home equipment can execute the locking method of the home equipment in any embodiment, can lock the corresponding home equipment in time when various limited objects appear in the monitoring area of the home equipment, has high coverage for the limited objects, and can provide the safety performance of the home equipment.
The present application provides, in a fourth aspect, a home appliance including the locking device for a home appliance provided in any one of the above embodiments.
In one embodiment, the household devices may include devices that may cause safety accidents of corresponding restricted objects or be easily misoperated by the restricted objects, such as a gas stove, a washing machine, a refrigerator and/or other specific storage cabinets; the corresponding monitoring area is set according to the characteristics of the corresponding household equipment. For example, in one example, the household device includes a gas stove, the monitoring area includes an area where a user who is ready to use the gas stove is located and/or an area where an ignition device of the gas stove is operated, and the ToF camera is disposed above the gas stove (e.g., outside or below a range hood corresponding to the gas stove, etc.) to photograph the monitoring area. In another example, the household device includes a washing machine, the monitoring area includes an area where a user who is ready to use the washing machine is located and/or an area where a control panel of the washing machine is operated, and the ToF camera may be disposed on at least one surface of the washing machine facing the user (e.g., a front surface of the washing machine and/or an upper side of the control panel, etc.) to photograph the area where the user who is ready to use the washing machine is located.
In an embodiment, referring to fig. 5, the home device includes a locking apparatus 600 for a home device, and may further include a communication module 710, where the communication module 710 may push a locking message of the home device to a communication object after the home device is locked, so that a corresponding family member can timely know the above situation. Optionally, the communication module 710 may further receive a first new threshold from the communication object, and determine the first detection threshold according to the first new threshold. Optionally, the communication module 710 may further receive a second new threshold from the communication object, and determine the second detection threshold according to the second new threshold. Specifically, the communication module 710 may include a module with stable performance and convenient communication, such as a bluetooth module or a WIFI module, so as to ensure the communication quality.
Although the application has been shown and described with respect to one or more implementations, equivalent alterations and modifications will occur to others skilled in the art based upon a reading and understanding of this specification and the annexed drawings. This application is intended to embrace all such modifications and variations and is limited only by the scope of the appended claims. In particular regard to the various functions performed by the above described components, the terms used to describe such components are intended to correspond, unless otherwise indicated, to any component which performs the specified function of the described component (e.g., that is functionally equivalent), even though not structurally equivalent to the disclosed structure which performs the function in the herein illustrated exemplary implementations of the specification.
That is, the above description is only an embodiment of the present application, and not intended to limit the scope of the present application, and all equivalent structures or equivalent flow transformations made by using the contents of the specification and the drawings, such as mutual combination of technical features between various embodiments, or direct or indirect application to other related technical fields, are included in the scope of the present application.
In addition, in the description of the present application, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, should not be considered as limiting the present application. In addition, structural elements having the same or similar characteristics may be identified by the same or different reference numerals. Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
In this application, the word "exemplary" is used to mean "serving as an example, instance, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The previous description is provided to enable any person skilled in the art to make and use the present application. In the foregoing description, various details have been set forth for the purpose of explanation. It will be apparent to one of ordinary skill in the art that the present application may be practiced without these specific details. In other instances, well-known structures and processes are not shown in detail to avoid obscuring the description of the present application with unnecessary detail. Thus, the present application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
Claims (15)
1. A locking method of household equipment is characterized by comprising the following steps:
acquiring an area array image shot by a ToF camera aiming at a monitoring area of household equipment;
extracting size parameters representing user features from the area array image;
locking the household equipment according to the relation between the size parameter and a pre-stored first detection threshold value; the first detection threshold is used to define a characteristic of a constraint object.
2. The locking method for a household appliance according to claim 1, wherein the size parameter comprises a height of the user; the first detection threshold comprises a height threshold; the locking the household equipment according to the relation between the size parameter and the pre-stored first detection threshold value comprises the following steps: when the height of the user is smaller than the height threshold value, locking the household equipment;
and/or, the size parameter comprises palm area; the first detection threshold comprises an area threshold; the locking the household equipment according to the relation between the size parameter and the pre-stored first detection threshold value comprises the following steps: and when the palm area is smaller than the area threshold value, locking the household equipment.
3. The locking method for the household equipment according to claim 2, wherein the locking the household equipment comprises: keeping the running state of the household equipment unchanged; preventing the household equipment from being started; and/or locking a switch component of the household equipment.
4. The locking method for the household equipment according to claim 2, wherein the extracting of the size parameter characterizing the user feature from the area array image comprises:
identifying a target image plane characterizing the user in the area array image;
and determining the size parameter according to the coordinate parameter of the target image surface.
5. The locking method for the household equipment according to claim 4, wherein the determining the size parameter according to the coordinate parameter of the target image plane comprises:
acquiring a boundary line of the target image surface, and searching a first key point and a second key point representing the height of the user on the boundary line;
and determining the height of the user according to the first key point and the second key point.
6. The method for locking a household device according to claim 5, wherein the determining the height of the user according to the first and second key points comprises:
acquiring a first depth coordinate of the first key point in a depth coordinate system and a second depth coordinate of the second key point in the depth coordinate system; the depth coordinate system is used for limiting the coordinates of each point on the area array image;
mapping the first depth coordinate and the second depth coordinate to a world coordinate system respectively to obtain a first world coordinate corresponding to the first key point and a second world coordinate corresponding to the second key point; the world coordinate system is used for defining coordinates in a physical space where the user is located;
and calculating the height of the user according to the first world coordinate and the second world coordinate.
7. The locking method for the household equipment according to claim 4, wherein the determining the size parameter according to the coordinate parameter of the target image plane comprises:
identifying a palm region characterizing a palm of a user's hand in the target image plane;
and acquiring the area size of the palm area, and calculating the palm area according to the area size.
8. The locking method of a home device according to claim 7, wherein the region size includes a first side length and a second side length of a minimum bounding rectangle of the palm region.
9. The locking method of the household equipment according to claim 1, further comprising:
after the household equipment is locked, pushing a locking message of the household equipment to a communication object;
and/or receiving a first new threshold value from the communication object, and determining the first detection threshold value according to the first new threshold value.
10. The locking method of the household equipment according to claim 1, further comprising:
when the household equipment is in a locked state, unlocking the household equipment according to the relation between the size parameter and a second detection threshold value; the second detection threshold is used to define a characteristic of the unrestricted object.
11. A locking system of a household device, comprising:
the system comprises an acquisition module, a monitoring module and a processing module, wherein the acquisition module is used for acquiring an area array image shot by a ToF camera aiming at a monitoring area of household equipment;
the extraction module is used for extracting size parameters representing the characteristics of the user from the area array image;
the locking module is used for locking the household equipment according to the relation between the size parameter and a pre-stored first detection threshold value; the first detection threshold is used to define a characteristic of a constraint object.
12. A locking device of household equipment is characterized by comprising a ToF camera, a processor and a storage medium; the storage medium having program code stored thereon; the processor is used for calling the program codes stored in the storage medium to execute the locking method of the household equipment according to any one of claims 1 to 10.
13. A home appliance characterized by comprising the locking device of a home appliance according to claim 12.
14. The household equipment according to claim 13, wherein the household equipment comprises a gas stove, the monitoring area comprises an area where a user who is ready to use the gas stove is located and/or an area where an ignition device of the gas stove is operated, and the ToF camera is arranged above the gas stove to shoot the monitoring area;
and/or the household equipment comprises a washing machine, the monitoring area comprises an area where a user who is ready to use the washing machine is located and/or an area where a control panel of the washing machine is operated, and the ToF camera is arranged on at least one surface of the washing machine facing the user to shoot the area where the user who is ready to use the washing machine is located.
15. The home equipment according to claim 13, wherein the home equipment further comprises a communication module for pushing a locking message of the home equipment to a communication object after the home equipment is locked; and/or receiving a first new threshold value from the communication object, and determining the first detection threshold value according to the first new threshold value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111011860.1A CN113625584A (en) | 2021-08-31 | 2021-08-31 | Household equipment locking method, system and device and household equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111011860.1A CN113625584A (en) | 2021-08-31 | 2021-08-31 | Household equipment locking method, system and device and household equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113625584A true CN113625584A (en) | 2021-11-09 |
Family
ID=78388482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111011860.1A Pending CN113625584A (en) | 2021-08-31 | 2021-08-31 | Household equipment locking method, system and device and household equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113625584A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104765292A (en) * | 2015-03-16 | 2015-07-08 | 广东美的暖通设备有限公司 | Anti-misoperation method for controller |
| CN106683070A (en) * | 2015-11-04 | 2017-05-17 | 杭州海康威视数字技术股份有限公司 | Body height measurement method and body height measurement device based on depth camera |
| CN108489040A (en) * | 2018-03-07 | 2018-09-04 | 广东美的制冷设备有限公司 | Floor air conditioner and its control method and computer readable storage medium |
| CN110535732A (en) * | 2019-07-29 | 2019-12-03 | 深圳绿米联创科技有限公司 | A kind of apparatus control method, device, electronic equipment and storage medium |
| CN111996740A (en) * | 2019-05-27 | 2020-11-27 | 青岛海尔洗衣机有限公司 | Control method of washing machine |
| CN112305922A (en) * | 2019-07-29 | 2021-02-02 | 广东美的制冷设备有限公司 | Control method and device of household appliance, household appliance and electronic equipment |
| CN112726100A (en) * | 2020-12-10 | 2021-04-30 | 青岛海尔洗衣机有限公司 | Washing machine, control method, control device, control equipment, storage medium and program product of washing machine |
| KR20210074131A (en) * | 2019-12-11 | 2021-06-21 | 하수영 | safe reminder washing machine |
| CN113341772A (en) * | 2021-05-24 | 2021-09-03 | 珠海格力电器股份有限公司 | Household appliance function permission unlocking method, device and medium and household appliance |
| CN113753158A (en) * | 2021-08-27 | 2021-12-07 | 上海炬佑智能科技有限公司 | Seat adjusting method, system, equipment and riding tool based on ToF camera |
-
2021
- 2021-08-31 CN CN202111011860.1A patent/CN113625584A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104765292A (en) * | 2015-03-16 | 2015-07-08 | 广东美的暖通设备有限公司 | Anti-misoperation method for controller |
| CN106683070A (en) * | 2015-11-04 | 2017-05-17 | 杭州海康威视数字技术股份有限公司 | Body height measurement method and body height measurement device based on depth camera |
| CN108489040A (en) * | 2018-03-07 | 2018-09-04 | 广东美的制冷设备有限公司 | Floor air conditioner and its control method and computer readable storage medium |
| CN111996740A (en) * | 2019-05-27 | 2020-11-27 | 青岛海尔洗衣机有限公司 | Control method of washing machine |
| CN110535732A (en) * | 2019-07-29 | 2019-12-03 | 深圳绿米联创科技有限公司 | A kind of apparatus control method, device, electronic equipment and storage medium |
| CN112305922A (en) * | 2019-07-29 | 2021-02-02 | 广东美的制冷设备有限公司 | Control method and device of household appliance, household appliance and electronic equipment |
| KR20210074131A (en) * | 2019-12-11 | 2021-06-21 | 하수영 | safe reminder washing machine |
| CN112726100A (en) * | 2020-12-10 | 2021-04-30 | 青岛海尔洗衣机有限公司 | Washing machine, control method, control device, control equipment, storage medium and program product of washing machine |
| CN113341772A (en) * | 2021-05-24 | 2021-09-03 | 珠海格力电器股份有限公司 | Household appliance function permission unlocking method, device and medium and household appliance |
| CN113753158A (en) * | 2021-08-27 | 2021-12-07 | 上海炬佑智能科技有限公司 | Seat adjusting method, system, equipment and riding tool based on ToF camera |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Zhang et al. | Ev-loc: integrating electronic and visual signals for accurate localization | |
| CN105409212B (en) | The electronic equipment with depth sense is caught with multi-view image | |
| CN105408938B (en) | System for the processing of 2D/3D space characteristics | |
| Zhang et al. | TASA: Tag-free activity sensing using RFID tag arrays | |
| US11537696B2 (en) | Method and apparatus for turning on screen, mobile terminal and storage medium | |
| KR101591471B1 (en) | apparatus and method for extracting feature information of object and apparatus and method for generating feature map | |
| CN105246039B (en) | A kind of indoor orientation method and system based on image procossing | |
| CN104969538B (en) | Manage the mobile augmented reality of closed area | |
| CN108615285B (en) | Safe door opening control method and server for unmanned vending equipment and unmanned vending system | |
| US20040153671A1 (en) | Automated physical access control systems and methods | |
| CN103377471B (en) | Object positioning method and device, optimum video camera are to determining method and apparatus | |
| US8576071B2 (en) | Automatic lock and automatic unlock method for computer system and computer system thereof | |
| CN109831738A (en) | A kind of localization method and smart machine of smart machine | |
| US20160104037A1 (en) | Method and device for generating motion signature on the basis of motion signature information | |
| JP5027741B2 (en) | Image monitoring device | |
| CN110383289A (en) | Device, method and the electronic equipment of recognition of face | |
| TW201842753A (en) | Method for connecting a household appliance to a wireless home network | |
| US20200117780A1 (en) | Multi-factor biometric authentication | |
| WO2016145873A1 (en) | Accidental operation identification method and device | |
| CN113625584A (en) | Household equipment locking method, system and device and household equipment | |
| CN110579772A (en) | Operation mode of intelligent safety warning system | |
| CN106056080A (en) | Visualized biometric information acquisition device and acquisition method | |
| CN113622786B (en) | Automatic door control method, system and equipment | |
| Greenhill et al. | Learning the semantic landscape: embedding scene knowledge in object tracking | |
| Zhao et al. | A sensor-service collaboration approach for target tracking in wireless camera networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |