CN114500795B - Laser safety control method and device, intelligent door lock and storage medium - Google Patents
Laser safety control method and device, intelligent door lock and storage medium Download PDFInfo
- Publication number
- CN114500795B CN114500795B CN202111617452.0A CN202111617452A CN114500795B CN 114500795 B CN114500795 B CN 114500795B CN 202111617452 A CN202111617452 A CN 202111617452A CN 114500795 B CN114500795 B CN 114500795B
- Authority
- CN
- China
- Prior art keywords
- laser
- target object
- depth camera
- safety control
- distance information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 238000003860 storage Methods 0.000 title claims abstract description 14
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 230000009286 beneficial effect Effects 0.000 abstract description 7
- 238000004590 computer program Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000005265 energy consumption Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 230000010354 integration Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
- G07C9/00309—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys operated with bidirectional data transmission between data carrier and locks
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
- G07C9/00563—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Abstract
The invention discloses a laser safety control method, a device, an intelligent door lock and a storage medium, wherein the laser safety control method is applied to a depth camera and comprises the following steps: acquiring a speckle image and an infrared image containing a target object based on the depth camera; acquiring distance information of the target object based on the speckle image or the infrared image, wherein the distance information of the target object is acquired based on the speckle image when a target object area in the speckle image is not overexposed, and the distance information of the target object is acquired based on the infrared image when the target object area in the speckle image is overexposed; and safety control is carried out on the laser in the depth camera based on the distance information. Compared with the prior art, the scheme of the invention is beneficial to safely and intelligently controlling the laser emitted by the depth camera, and improves the use safety of users.
Description
Technical Field
The invention relates to the technical field of optics, in particular to a laser safety control method and device, an intelligent door lock and a storage medium.
Background
Along with the development of scientific technology, face recognition technology is also rapidly developed and widely applied to various fields. Currently, face recognition based on face recognition technology is a common way to verify identity, for example, when a door lock is used, the user can be subjected to face recognition through a depth camera to determine the identity of the user, and unlocking is performed when the user is a homeowner.
In 3D living body face recognition by a depth camera, laser light needs to be emitted by a laser in order to collect an image of a user. In the prior art, depth cameras typically continue to emit laser light to acquire corresponding images in real time. The problem in the prior art is that the lack of a safe laser control scheme for the depth camera is unfavorable for safe and intelligent control of laser emitted by the depth camera, and the laser emitted continuously may damage eyes of a user when the distance between the user is relatively short, so that the safety of the user is unfavorable for improvement.
Disclosure of Invention
The invention mainly aims to provide a laser safety control method, a device, an intelligent door lock and a storage medium, and aims to solve the problems that a safe depth camera laser control scheme is lack in the prior art, safety and intelligent control on laser emitted by a depth camera are not facilitated, and use safety of a user is not facilitated.
In order to achieve the above object, a first aspect of the present invention provides a laser safety control method, which is applied to a depth camera, wherein the method includes:
acquiring a speckle image and an infrared image containing a target object based on the depth camera;
acquiring distance information of the target object based on the speckle image or the infrared image, wherein the distance information of the target object is acquired based on the speckle image when a target object area in the speckle image is not overexposed, and the distance information of the target object is acquired based on the infrared image when the target object area in the speckle image is overexposed;
and safety control is carried out on the laser in the depth camera based on the distance information.
Optionally, the acquiring, based on the depth camera, a speckle image and an infrared image including the target object includes:
controlling the laser to work based on a preset working mode, and alternately turning on and off the laser in the preset working mode;
when the laser is started, the speckle image corresponding to the target object is obtained through the depth camera;
and when the laser is turned off, acquiring an infrared image corresponding to the target object through the depth camera.
Optionally, when the target object area in the speckle image is overexposed, acquiring distance information of the target object based on the infrared image includes:
when the target object area in the speckle image is overexposed, recognizing the face in the infrared image based on a face recognition algorithm;
when the effective face is identified, acquiring the distance information of the target object based on the size of the effective face;
and when the effective face is not recognized, the distance of the target object is too close to the distance information of the target object.
Optionally, the performing safety control on the laser in the depth camera based on the distance information includes:
determining whether the distance between the target object and the depth camera is too close or not based on the distance information and a preset safety distance threshold;
and when the distance between the target object and the depth camera is too close, controlling the laser to exit the preset working mode, and turning off the laser.
Optionally, after controlling the laser to exit the preset operation mode and turning off the laser when the target object is too close to the depth camera, the method further includes:
acquiring a re-judging infrared image based on the depth camera;
acquiring re-judgment distance information of the target object based on the re-judgment infrared image;
determining whether the target object is far from the depth camera based on the re-judgment distance information and the safety distance threshold;
and when the target object is far away from the depth camera, starting the laser and controlling the laser to work based on the preset working mode.
Optionally, the method further comprises: and outputting a distance too close prompt when the distance between the target object and the depth camera is too close.
The second aspect of the present invention provides a laser safety control device, wherein the laser safety control device performs safety control on the laser based on any one of the laser safety control methods.
Optionally, the device includes:
a depth camera for acquiring a speckle image and an infrared image containing a target object;
and a control processor for acquiring distance information of the target object based on the speckle image or the infrared image, and performing security control on the laser in the depth camera based on the distance information, wherein the distance information of the target object is acquired based on the speckle image when the target object area in the speckle image is not overexposed, and the distance information of the target object is acquired based on the infrared image when the target object area in the speckle image is overexposed.
The third aspect of the present invention provides an intelligent door lock, wherein the intelligent door lock includes any one of the laser safety control devices, and the laser safety control device performs safety control on the laser based on any one of the laser safety control methods.
A fourth aspect of the present invention provides a computer-readable storage medium having stored thereon a laser safety control program which, when executed by a processor, implements the steps of any one of the above laser safety control methods.
From the above, in the present invention, a laser safety control method is provided, which can be applied to a depth camera, and the method includes: acquiring a speckle image and an infrared image containing a target object based on the depth camera; acquiring distance information of the target object based on the speckle image or the infrared image, wherein the distance information of the target object is acquired based on the speckle image when a target object area in the speckle image is not overexposed, and the distance information of the target object is acquired based on the infrared image when the target object area in the speckle image is overexposed; and safety control is carried out on the laser in the depth camera based on the distance information. Compared with the scheme of continuously emitting laser in the prior art, the method and the device acquire the distance information corresponding to the target object (namely, the user needing face recognition) through the speckle image and the infrared image, so that the laser in the depth camera is safely controlled according to the distance information (for example, the laser is turned off when the distance is too close). The laser control method is beneficial to safe and intelligent control of laser emitted by the depth camera, improves the safety of user use and protects the health of the user, so that the use experience of the user is improved, the depth camera does not need to be additionally provided with an independent distance sensor, the space volume of the depth camera does not need to be increased, and the integration performance of the depth camera is improved, and the power consumption and the cost are reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a laser safety control method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating a specific flow chart of the present invention for implementing step S100 in FIG. 1;
FIG. 3 is a schematic view of a non-overexposed speckle image provided by an embodiment of the present invention;
FIG. 4 is a schematic view of an overexposed speckle image provided by an embodiment of the present invention;
FIG. 5 is a schematic diagram of a specific flow for acquiring distance information based on an infrared image according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating the step S300 in FIG. 1 according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a laser safety control device according to an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in this specification and the appended claims, the term "if" may be interpreted in context as "when …" or "upon" or "in response to a determination" or "in response to detection. Similarly, the phrase "if a condition or event described is determined" or "if a condition or event described is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a condition or event described" or "in response to detection of a condition or event described".
The following description of the embodiments of the present invention will be made more fully hereinafter with reference to the accompanying drawings, in which embodiments of the invention are shown, it being evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways other than those described herein, and persons skilled in the art will readily appreciate that the present invention is not limited to the specific embodiments disclosed below.
Along with the development of scientific technology, face recognition technology is also rapidly developed and widely applied to various fields. Currently, face recognition based on face recognition technology is a common way to verify identity, for example, when an intelligent door lock is used, the user can be subjected to face recognition through a depth camera to determine the identity of the user, and unlocking is performed when the user is a homeowner.
In 3D living body face recognition by a depth camera, laser light needs to be emitted by a laser (or a laser lamp) in order to collect an image of a user. In the prior art, depth cameras typically continue to emit laser light to acquire corresponding images in real time. The problem in the prior art is that the lack of a safe laser control scheme for the depth camera is unfavorable for safe and intelligent control of laser emitted by the depth camera, and the laser emitted continuously may damage eyes of a user when the distance between the user is relatively short, so that the safety of the user is unfavorable for improvement.
On the other hand, in the prior art, when the distance between the user and the depth camera needs to be acquired, an independent distance sensor is generally added to the depth camera to acquire the distance between the user and the depth camera, so as to determine whether the face is too close. The problem in the prior art is that in order to obtain the distance between the user and the depth camera, an independent distance sensor needs to be additionally arranged in the depth camera, so that the space volume of the depth camera can be increased, the integration performance of the depth camera is not beneficial to being improved, and additional power consumption and additional cost can be brought.
In order to solve one or more problems in the prior art, in this embodiment, a laser security control method, a device, an intelligent door lock, and a storage medium are provided for performing security control on laser emitted by a depth camera. Specifically, distance information corresponding to a target object (i.e., a user who needs to perform face recognition) is acquired through the speckle image and the infrared image, so that a laser in the depth camera is safely controlled according to the distance information (for example, the laser is turned off when the distance is too close). The laser shot by the depth camera is controlled safely and intelligently, the safety of user use is improved, the health of the user is protected, and therefore the use experience of the user is improved. When the scattered spot area of the speckle image is not overexposed, the distance information of the target object is directly acquired based on the speckle image, the distance acquisition precision is improved, and when the scattered spot area of the speckle image is overexposed, the distance information is continuously acquired through the infrared image. The method can directly utilize the speckle image and the infrared image obtained by the depth camera to obtain the distance information of the target object, and does not need to additionally add an independent distance sensor in the depth camera, and the space volume of the depth camera is not required to be increased, so that the method is beneficial to improving the integration performance of the depth camera and reducing the power consumption and the cost.
Exemplary method
As shown in fig. 1, an embodiment of the present invention provides a laser security control method applied to a depth camera, specifically, the method includes the following steps:
step S100, a speckle image and an infrared image containing a target object are acquired based on the depth camera.
The depth camera is an imaging module (or camera) for performing 3D face recognition, and is used for acquiring a corresponding image. It should be noted that, the depth camera is further provided with other functional modules for implementing 3D face recognition, for example, a processing module for executing a face recognition algorithm, which is not limited herein. However, in this embodiment, the depth camera does not include a separate module or a distance sensor for measuring the distance, which is beneficial to reducing the volume of the depth camera and reducing the energy consumption and the cost.
In this embodiment, the speckle image is a collected speckle image including a target object, the infrared image is a collected infrared (IR, infrared Radiation) image including a target object, and the target user is a user who needs 3D face recognition by a depth camera.
And step 200, acquiring distance information of the target object based on the speckle image or the infrared image, wherein the distance information of the target object is acquired based on the speckle image when the target object area in the speckle image is not overexposed, and the distance information of the target object is acquired based on the infrared image when the target object area in the speckle image is overexposed.
The speckle image is formed by marking the whole image area through a laser on the infrared image, and depth information can be obtained through calculation through a depth engine algorithm by utilizing the mark. Based on the infrared image, image information such as a human face and the like can be identified and acquired through a preset algorithm. Thus, the distance information of the target object can be obtained according to the depth information and/or the face image information. The target object region is a region in which a target object is located in an image, for example, a region including a face in the image.
In this embodiment, the distance information includes a distance between the target object and the depth camera. Preferably, the distance information may further include a distance between the target object and a laser in the depth camera. Wherein the distance is a specific distance value. In one embodiment, the distance information may further include a word "the distance of the target object is too close" to indicate that the distance of the target object is too close, and optionally, a distance too close flag (or a distance too close value), for example, "0", may be preset, where the distance information is "0", and when the distance information is "0", it does not represent that the distance between the target object and the laser is actually 0, it represents that the distance between the target object and the laser is too close (the actual distance is less than the preset safe distance threshold).
And step S300, performing safety control on the laser in the depth camera based on the distance information.
Specifically, the distance between the target object and the depth camera can be known based on the distance information, so as to determine whether the target object is too close to the depth camera (or the laser), and if so, safety control is required. There are various specific safety control modes, for example, turning off the laser, adjusting the laser light emitted by the laser according to the distance (the closer the laser is, the weaker the laser is), etc., and other specific control modes are also possible, and are not particularly limited herein. By safely controlling the laser, the target object can be protected by turning off the laser immediately when the distance from the face to the laser is too short, for example.
From the above, in the present invention, a laser safety control method is provided, which can be applied to a depth camera, and the method includes: acquiring a speckle image and an infrared image containing a target object based on the depth camera; acquiring distance information of the target object based on the speckle image or the infrared image, wherein the distance information of the target object is acquired based on the speckle image when a target object area in the speckle image is not overexposed, and the distance information of the target object is acquired based on the infrared image when the target object area in the speckle image is overexposed; and safety control is carried out on the laser in the depth camera based on the distance information. Compared with the scheme of continuously emitting laser in the prior art, the method and the device acquire the distance information corresponding to the target object (namely, the user needing face recognition) through the speckle image and the infrared image, so that the laser in the depth camera is safely controlled according to the distance information (for example, the laser is turned off when the distance is too close). The laser shot by the depth camera is controlled safely and intelligently, the safety of user use is improved, the health of the user is protected, and therefore the use experience of the user is improved. And can make the depth camera need not to additionally install independent distance sensor, need not to increase the space volume of depth camera, be favorable to improving the integrated performance of depth camera, reduce consumption and cost.
In one embodiment, the step S100 more specifically includes the steps shown in fig. 2:
step S101, controlling the laser to operate based on a preset operation mode, where the laser is alternately turned on and off.
Step S102, when the laser is turned on, the speckle image corresponding to the target object is acquired through the depth camera.
Step S103, when the laser is turned off, acquiring an infrared image corresponding to the target object through the depth camera.
The preset working mode is a working mode preset for the laser in the depth camera. In a preset operating mode, the laser alternately emits laser light. At this time, the image acquisition can be performed on the target object through the depth camera, so as to obtain a corresponding speckle image and an infrared image. It should be noted that, in the preset working mode, the alternating time of the laser alternating on and off actions may be set and adjusted according to the actual requirement, which is not limited herein.
In this embodiment, the depth camera includes an infrared sensor camera, where the infrared sensor camera may capture and acquire a speckle image when the laser is turned on; when the laser is turned off, an infrared image is captured. Meanwhile, the infrared sensing camera is an original camera in the depth camera, and other cameras are not required to be additionally arranged, so that the space volume of the depth camera is reduced.
In the case where the distance is normal (not too close), the depth information may be calculated and acquired from the speckle image, so that the distance information of the corresponding target object is obtained. However, under the condition that the face is too close, overexposure occurs in the speckle image, so that the depth information is invalid, and corresponding distance information cannot be obtained based on the speckle image.
Fig. 3 is a schematic view of an unexposed speckle image according to an embodiment of the present invention, and fig. 4 is a schematic view of an overexposed speckle image according to an embodiment of the present invention. As shown in fig. 3 and fig. 4, depth information corresponding to a face of a target object may be obtained according to a non-overexposed speckle image, so as to obtain corresponding distance information, and in the overexposed speckle image, the face of the target object cannot be distinguished, so that the depth information corresponding to the face cannot be obtained, and the corresponding distance information cannot be obtained.
In this embodiment, when the target object region in the speckle image is not overexposed, the distance information corresponding to the target object is directly acquired based on the speckle image. In one embodiment, when the target object area in the above-mentioned speckle image is not overexposed, the corresponding distance information may also be obtained by combining the speckle image and the infrared image through calculation, which is not limited herein specifically.
In one embodiment, the acquiring the distance information of the target object based on the infrared image more specifically includes the steps as shown in fig. 5:
in step S201, when the target object area in the speckle image is overexposed, the face in the infrared image is identified based on a face recognition algorithm.
Step S202, when the effective face is identified, the distance information of the target object is acquired based on the size of the effective face.
In step S203, when the effective face is not recognized, the distance of the target object is too close as the distance information of the target object.
Specifically, when the target object area in the speckle image is overexposed, the depth value cannot be calculated according to the speckle image, and the corresponding distance information can be obtained only through the infrared image. The effective face is a complete face corresponding to the target object. The face recognition algorithm is a preset algorithm, and can be selected and set according to actual requirements, and is not particularly limited herein.
It should be noted that, based on the above face recognition algorithm, the face in the infrared image can be detected and recognized, and when an effective face (i.e., a complete face) is recognized, the distance between the target object and the laser can be obtained based on the size of the face (e.g., the area corresponding to the face frame) as distance information. For example, the distance between the target object and the laser may be calculated according to a preset scaling and the obtained face size, and other calculation manners are also possible, which are not limited herein. Specifically, when the face recognition algorithm does not recognize a valid face, the algorithm gives a result of "no face detected". It should be noted that, when the distance between users is too short, the infrared sensor camera cannot shoot the complete face, so that the face recognition algorithm cannot recognize the effective face. In this case, the distance of the target object may be set too close as the distance information of the target object. In this embodiment, the distance information may further include a text information of "the distance of the target object is too close" to indicate that the distance of the target object is too close, and optionally, a distance too close mark (or a distance too close value), for example, "0", may be preset, where "0" is used as the distance information when the effective face is not detected, and when the distance information is "0", it does not represent that the distance between the target object and the laser is actually 0, but represents that the distance between the target object and the laser is too close (for example, the actual distance is smaller than a preset safety distance threshold).
In this embodiment, distance measurement can be realized based on the existing infrared sensor camera in the depth camera, thereby realizing laser protection. No additional distance sensor is needed for the depth camera, which is beneficial to reducing the space volume of the depth camera, so that the depth camera can be better integrated on other devices, and the energy consumption and the manufacturing cost are reduced.
In one embodiment, the step S300 more specifically includes the steps shown in fig. 6:
step S301, determining whether the distance between the target object and the depth camera is too short or not based on the distance information and a preset safety distance threshold.
In step S302, when the distance between the target object and the depth camera is too short, the laser is controlled to exit the preset working mode, and the laser is turned off.
Wherein the safety distance threshold is a preset value for limiting the distance between the user and the laser, and can be preset and adjusted, and when the distance between the user and the laser is smaller than (or equal to) the safety distance threshold, the laser is considered to damage eyes of the user, and safety control is needed.
In the present embodiment, the above-described safe distance threshold value is set to 15 cm, but is not particularly limited. Specifically, when a specific distance value is stored in the distance information, the distance value is compared with a safety distance threshold value, and when the distance value is smaller than (or equal to) 15 cm, it is indicated that the user is too close to the laser (depth camera), and at this time, the laser needs to be turned off so as not to damage eyes of the user, specifically, the laser is controlled to exit a preset working mode of alternately turning on and off, and the laser is turned off.
Further, after turning off the laser, if the user gets further away from the depth camera (laser) and falls outside the safe distance threshold, the laser may be turned on again to perform face recognition on the user. After the laser is turned off, a corresponding speckle image cannot be obtained, only an infrared image can be continuously obtained, whether a user is far away or not is judged by continuously detecting the size of a face frame according to the infrared image, and when the distance between the user and the depth camera is greater than a safe distance threshold value, the laser can be turned on again.
In this embodiment, after the step S302, the method further includes:
acquiring a re-judging infrared image based on the depth camera;
acquiring re-judgment distance information of the target object based on the re-judgment infrared image;
determining whether the target object is far from the depth camera based on the re-judgment distance information and the safety distance threshold;
and when the target object is far away from the depth camera, starting the laser and controlling the laser to work based on the preset working mode.
Wherein the re-judging infrared image is an infrared image obtained by the infrared sensor camera after turning off the laser and used for re-judging the distance between the user and the depth camera (or the laser), and the re-judging distance information is based on the distance between the user obtained by re-judging the infrared image and the depth camera (or the laser), and the re-judging distance information can be used for judging whether the user is far away from the depth camera (or the laser in the depth camera). When the user is far away from the depth camera, the laser can resume normal operation, namely, the laser works based on a preset working mode, and meanwhile, the laser can be continuously controlled safely through the laser safety control method.
Further, the method further comprises the steps of: and outputting a distance too close prompt when the distance between the target object and the depth camera is too close. The output distance is too close to the prompt mode in various modes, such as voice output, or the current distance is too close to the user through lamplight flashing, so that the user is far away from the laser in time.
Exemplary apparatus
Corresponding to the laser safety control method, the embodiment of the invention also provides a laser safety control device which performs safety control on the laser based on any one of the laser safety control methods.
Specifically, as shown in fig. 7, the above-mentioned apparatus includes:
a depth camera 410 for acquiring a speckle image and an infrared image containing the target object.
The depth camera is an imaging module (or camera) for performing 3D face recognition, and is used for acquiring a corresponding image. It should be noted that, the depth camera is further provided with other functional modules for implementing 3D face recognition, for example, a processing module for executing a face recognition algorithm, which is not limited herein. However, in this embodiment, the depth camera does not include a separate module or a distance sensor for measuring the distance, which is beneficial to reducing the volume of the depth camera and reducing the energy consumption and the cost.
In this embodiment, the speckle image is a collected speckle image including a target object, the infrared image is a collected infrared (IR, infrared Radiation) image including a target object, and the target user is a user who needs 3D face recognition by a depth camera.
And a control processor 420 configured to acquire distance information of the target object based on the speckle image or the infrared image, and perform security control on the laser in the depth camera based on the distance information, wherein the distance information of the target object is acquired based on the speckle image when the target object area in the speckle image is not overexposed, and the distance information of the target object is acquired based on the infrared image when the target object area in the speckle image is overexposed.
The speckle image is formed by marking the whole image area through a laser on the infrared image, and depth information can be obtained through calculation through a depth engine algorithm by utilizing the mark. Based on the infrared image, image information such as a human face and the like can be identified and acquired through a preset algorithm. Thus, the distance information of the target object can be obtained according to the depth information and/or the face image information. The target object region is a region in which a target object is located in an image, for example, a region including a face in the image.
In this embodiment, the distance information includes a distance between the target object and the depth camera. Preferably, the distance information may further include a distance between the target object and a laser in the depth camera. Wherein the distance is a specific distance value. In one embodiment, the distance information may further include a word "the distance of the target object is too close" to indicate that the distance of the target object is too close, and optionally, a distance too close flag (or a distance too close value), for example, "0", may be preset, where the distance information is "0", and when the distance information is "0", it does not represent that the distance between the target object and the laser is actually 0, it represents that the distance between the target object and the laser is too close (the actual distance is less than the preset safe distance threshold).
Specifically, the distance between the target object and the depth camera can be known based on the distance information, so as to determine whether the target object is too close to the depth camera (or the laser), and if so, safety control is required. There are various specific safety control modes, for example, turning off the laser, adjusting the laser light emitted by the laser according to the distance (the closer the laser is, the weaker the laser is), etc., and other specific control modes are also possible, and are not particularly limited herein. By safely controlling the laser, the target object can be protected by turning off the laser immediately when the distance from the face to the laser is too short, for example.
It should be noted that, the specific control flow corresponding to the above laser safety control device and each module thereof may refer to the description in the above method embodiment, and will not be repeated herein.
It should be noted that, the specific control flow corresponding to the laser safety control device may refer to the description in the above method embodiment, and will not be repeated herein. The laser may be disposed in the depth camera or may be disposed outside the depth camera as a separate device, which is not particularly limited herein.
In this embodiment, an intelligent door lock is further provided, where the intelligent door lock includes any one of the above-mentioned laser safety control devices, and the above-mentioned laser safety control device performs safety control on the laser based on any one of the above-mentioned laser safety control methods, so that a laser protection function can be efficiently implemented.
Note that, the intelligent door lock may further include a module or a component for implementing other functions, for example, a sound module for playing a prompt tone, which is not limited herein. And the depth camera does not comprise an additional independent distance detection module or a distance sensor, so that the space volume of the intelligent door lock is reduced, the use experience of a user is improved, and the energy consumption and the cost can be reduced. The specific process of performing the security control may refer to the above method embodiment, and will not be described herein.
The embodiment of the invention also provides a computer readable storage medium, and the computer readable storage medium stores a laser safety control program, and the laser safety control program realizes the steps of any one of the laser safety control methods provided by the embodiment of the invention when being executed by a processor.
It should be understood that the sequence number of each step in the above embodiment does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not be construed as limiting the implementation process of the embodiment of the present invention.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present invention. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are merely illustrative, e.g., the division of the modules or units described above is merely a logical function division, and may be implemented in other manners, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed.
The integrated modules/units described above, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-readable storage medium. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the steps of each method embodiment may be implemented. The computer program comprises computer program code, and the computer program code can be in a source code form, an object code form, an executable file or some intermediate form and the like. The computer readable medium may include: any entity or device capable of carrying the computer program code described above, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. The content of the computer readable storage medium can be appropriately increased or decreased according to the requirements of the legislation and the patent practice in the jurisdiction.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that; the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions are not intended to depart from the spirit and scope of the various embodiments of the invention, which are also within the spirit and scope of the invention.
Claims (8)
1. A laser safety control method, wherein the method is applied to a depth camera, and the method comprises:
acquiring a speckle image and an infrared image containing a target object based on the depth camera;
acquiring distance information of the target object based on the speckle image or the infrared image, wherein when a target object area in the speckle image is not overexposed, the distance information of the target object is acquired based on the speckle image, and when the target object area in the speckle image is overexposed, the distance information of the target object is acquired based on the size of a face in the infrared image;
the obtaining a speckle image and an infrared image containing a target object based on the depth camera comprises: controlling a laser to work based on a preset working mode, wherein the laser alternately performs an opening and closing action in the preset working mode; when the laser is started, a speckle image corresponding to the target object is obtained through the depth camera; when the laser is turned off, acquiring an infrared image corresponding to the target object through the depth camera; the depth camera comprises an infrared sensing camera; when the laser is started, the infrared sensing camera shoots and acquires a speckle image; when the laser is turned off, the infrared sensing camera shoots and acquires an infrared image;
when the target object area in the speckle image is overexposed, acquiring the distance information of the target object based on the face size in the infrared image, including: when the target object area in the speckle image is overexposed, recognizing the face in the infrared image based on a face recognition algorithm; when an effective face is identified, acquiring distance information of the target object based on the size of the effective face; when the effective face cannot be identified, taking the too close distance of the target object as the distance information of the target object; the effective face is a complete face corresponding to the target object;
and safety control is carried out on the laser in the depth camera based on the distance information.
2. The laser safety control method according to claim 1, wherein the safety control of the laser in the depth camera based on the distance information includes:
determining whether the distance between the target object and the depth camera is too close or not based on the distance information and a preset safety distance threshold;
and when the distance between the target object and the depth camera is too short, controlling the laser to exit the preset working mode, and closing the laser.
3. The laser safety control method according to claim 2, wherein after controlling the laser to exit the preset operation mode and turning off the laser when the target object is too close to the depth camera, the method further comprises:
acquiring a re-judging infrared image based on the depth camera;
acquiring the re-judgment distance information of the target object based on the re-judgment infrared image;
determining whether the target object is far from the depth camera based on the re-judgment distance information and the safety distance threshold;
and when the target object is far away from the depth camera, starting the laser and controlling the laser to work based on the preset working mode.
4. The laser safety control method according to claim 2, characterized in that the method further comprises: and outputting a too-close distance prompt when the distance between the target object and the depth camera is too close.
5. A laser safety control device, characterized in that the laser safety control device performs safety control of the laser based on the laser safety control method according to any one of claims 1 to 4.
6. The laser safety control device of claim 5, wherein the device comprises:
a depth camera for acquiring a speckle image and an infrared image containing a target object;
and the control processor is used for acquiring the distance information of the target object based on the speckle image or the infrared image and carrying out safety control on the laser in the depth camera based on the distance information, wherein the distance information of the target object is acquired based on the speckle image when the target object area in the speckle image is not overexposed, and the distance information of the target object is acquired based on the size of the face in the infrared image when the target object area in the speckle image is overexposed.
7. An intelligent door lock, characterized in that the intelligent door lock comprises the laser safety control device according to claim 5 or 6, and the laser safety control device performs safety control on the laser based on the laser safety control method according to any one of claims 1-4.
8. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a laser safety control program, which when executed by a processor, implements the steps of the laser safety control method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111617452.0A CN114500795B (en) | 2021-12-27 | 2021-12-27 | Laser safety control method and device, intelligent door lock and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111617452.0A CN114500795B (en) | 2021-12-27 | 2021-12-27 | Laser safety control method and device, intelligent door lock and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114500795A CN114500795A (en) | 2022-05-13 |
| CN114500795B true CN114500795B (en) | 2024-03-15 |
Family
ID=81496440
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111617452.0A Active CN114500795B (en) | 2021-12-27 | 2021-12-27 | Laser safety control method and device, intelligent door lock and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114500795B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101171833A (en) * | 2005-05-11 | 2008-04-30 | 索尼爱立信移动通讯股份有限公司 | Digital cameras with triangulation autofocus systems and related methods |
| CN102089945A (en) * | 2008-07-07 | 2011-06-08 | 皇家飞利浦电子股份有限公司 | Eye-safe laser-based lighting |
| KR20150005313A (en) * | 2013-07-05 | 2015-01-14 | 리 조나단 | Infra-red Laser Device for inspection |
| CN107229925A (en) * | 2017-07-12 | 2017-10-03 | 深圳奥比中光科技有限公司 | Conversed using ear recognition |
| CN107443429A (en) * | 2016-05-31 | 2017-12-08 | 赛融公司 | Process tracking laser camera with non-human eye secure mode of operation and eye-safe operation's pattern |
| CN108509867A (en) * | 2018-03-12 | 2018-09-07 | 广东欧珀移动通信有限公司 | Control method, control device, depth camera and electronic device |
| CN108769509A (en) * | 2018-04-28 | 2018-11-06 | Oppo广东移动通信有限公司 | Control method, apparatus, electronic equipment and the storage medium of camera |
| CN113126072A (en) * | 2019-12-30 | 2021-07-16 | 浙江舜宇智能光学技术有限公司 | Depth camera and control method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10796514B2 (en) * | 2017-10-13 | 2020-10-06 | Alcatraz AI, Inc. | System and method for optimizing a facial recognition-based system for controlling access to a building |
| EP3564748A4 (en) * | 2018-02-27 | 2020-04-08 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Control method, control apparatus, terminal, computer device, and storage medium |
| WO2019205890A1 (en) * | 2018-04-28 | 2019-10-31 | Oppo广东移动通信有限公司 | Image processing method, apparatus, computer-readable storage medium, and electronic device |
| WO2020015403A1 (en) * | 2018-07-16 | 2020-01-23 | Oppo广东移动通信有限公司 | Method and device for image processing, computer readable storage medium and electronic device |
-
2021
- 2021-12-27 CN CN202111617452.0A patent/CN114500795B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101171833A (en) * | 2005-05-11 | 2008-04-30 | 索尼爱立信移动通讯股份有限公司 | Digital cameras with triangulation autofocus systems and related methods |
| CN102089945A (en) * | 2008-07-07 | 2011-06-08 | 皇家飞利浦电子股份有限公司 | Eye-safe laser-based lighting |
| KR20150005313A (en) * | 2013-07-05 | 2015-01-14 | 리 조나단 | Infra-red Laser Device for inspection |
| CN107443429A (en) * | 2016-05-31 | 2017-12-08 | 赛融公司 | Process tracking laser camera with non-human eye secure mode of operation and eye-safe operation's pattern |
| CN107229925A (en) * | 2017-07-12 | 2017-10-03 | 深圳奥比中光科技有限公司 | Conversed using ear recognition |
| CN108509867A (en) * | 2018-03-12 | 2018-09-07 | 广东欧珀移动通信有限公司 | Control method, control device, depth camera and electronic device |
| CN108769509A (en) * | 2018-04-28 | 2018-11-06 | Oppo广东移动通信有限公司 | Control method, apparatus, electronic equipment and the storage medium of camera |
| CN110324521A (en) * | 2018-04-28 | 2019-10-11 | Oppo广东移动通信有限公司 | Control method, apparatus, electronic equipment and the storage medium of camera |
| CN113126072A (en) * | 2019-12-30 | 2021-07-16 | 浙江舜宇智能光学技术有限公司 | Depth camera and control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114500795A (en) | 2022-05-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110324521B (en) | Method and device for controlling camera, electronic equipment and storage medium | |
| CN105512632B (en) | Biopsy method and device | |
| US10511810B2 (en) | Accessing cameras of audio/video recording and communication devices based on location | |
| US20130222564A1 (en) | Apparatus for recognizing face based on environment adaptation | |
| JP2009237643A (en) | Authentication system, authentication method, and program for authentication | |
| CN106095421B (en) | A kind of control method and system of virtual reality device | |
| KR20120024584A (en) | Controlled access to functionality of a wireless device | |
| KR102056523B1 (en) | System for detecting wasp | |
| WO2019011072A1 (en) | Iris live detection method and related product | |
| JP2016143060A (en) | Vision-assist devices and methods of detecting classification of object | |
| CN109594880B (en) | Method and device for controlling vehicle trunk, storage medium and vehicle | |
| JP2014146862A (en) | Imaging method, imaging apparatus and imaging program | |
| TW201327413A (en) | Systems and methods for face authentication or recognition using spectrally and/or temporally filtered flash illumination | |
| Barreto et al. | A method for image processing and distance measuring based on laser distance triangulation | |
| WO2020065851A1 (en) | Iris recognition device, iris recognition method and storage medium | |
| JP2007026213A (en) | Imaging device | |
| JPWO2020065954A1 (en) | Authentication device, authentication method, authentication program and recording medium | |
| CN114500795B (en) | Laser safety control method and device, intelligent door lock and storage medium | |
| EP1610545B1 (en) | Photographing apparatus, photographing method and computer program | |
| CN111183431A (en) | Fingerprint identification method and terminal equipment | |
| CN107241193B (en) | Authentication method, electronic device, and computer-readable storage medium | |
| JP2009277054A (en) | Finger vein authentication device and finger vein authentication method | |
| CN109543541B (en) | Living body detection method and device | |
| KR20150005094A (en) | Electronic device and method for detection eye region in electronic device | |
| CN113255401A (en) | 3D face camera device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |