WO2021208986A1 - 门开关状态监测方法、装置、设备及计算机可读存储介质 - Google Patents
门开关状态监测方法、装置、设备及计算机可读存储介质 Download PDFInfo
- Publication number
- WO2021208986A1 WO2021208986A1 PCT/CN2021/087315 CN2021087315W WO2021208986A1 WO 2021208986 A1 WO2021208986 A1 WO 2021208986A1 CN 2021087315 W CN2021087315 W CN 2021087315W WO 2021208986 A1 WO2021208986 A1 WO 2021208986A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- door
- picture
- monitored
- value
- infrared
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
Definitions
- This application relates to the field of monitoring of the Internet of Things, and in particular to methods, devices, equipment, and computer-readable storage media for monitoring the status of door switches.
- the existing method to solve the virtual cover of the smart door is to use a smart door lock with a power-assisted mechanism, that is, to provide additional rotation power for the smart door until the door is locked and cannot be turned. Although this method can close the door, it cannot lock the door. The state of the switch is monitored, and a special door lock is required, which is not universal, needs to provide additional rotation power, and also increases the cost.
- the main purpose of this application is to provide a door switch state monitoring method, which can solve the problem that the prior art cannot monitor the door switch state, and requires the use of special door locks, does not have a universal type, needs to provide additional rotation power, and also increases Technical issues of cost.
- the present application provides a method for monitoring the state of a door switch.
- the method for monitoring the state of a door switch includes the following steps:
- Photographing the door to be monitored by a preset camera device acquiring the camera information sent by the camera device, and judging whether a person is in contact with the door to be monitored according to the camera information;
- the first picture and the second picture before and after the person contacts the door to be detected in the camera information are acquired;
- the switch state of the door to be monitored is determined.
- the step of determining the switch state of the door to be monitored according to the first picture and the second picture includes:
- the reflection ratio value is greater than or equal to the first preset threshold, it is determined that the door to be monitored is in a closed state.
- the method includes:
- reflection ratio value is less than the first preset threshold, calculating the first average pixel value of all areas in the first picture, and calculating the second average pixel value of the non-reflected area in the second picture;
- the pixel ratio value is less than the second preset threshold, it is determined that the door to be monitored is in a virtual mask state.
- the process of determining the non-reflected area includes:
- the second picture perform an infrared reflection and penetration operation to determine the target infrared emission line corresponding to the non-reflected infrared;
- the target pixel points corresponding to the target infrared emission line are extracted, and the area where the target pixel points are gathered is taken as the non-reflected area.
- the step of judging whether a person is in contact with the door to be monitored according to the camera information includes:
- the contour of the main body matches the contour of the preset human body, it is determined that there is contact between a person and the door to be monitored.
- the door switch state monitoring method is applied to a door switch state monitoring device, and the door switch state monitoring device may be communicatively connected with a plurality of camera devices, and the camera information sent by the camera device is acquired, and according to all Before the step of using the camera information to determine whether a person is in contact with the door to be monitored includes:
- Acquiring picture information sent by a target camera device extracting subject color information in the picture information, and judging whether the target camera device can photograph the door to be monitored according to the subject color information;
- the target camera device can photograph the door to be monitored, a communication connection between the target camera device and the door switch state monitoring device is established.
- the method includes:
- a switch abnormality prompt message is sent through the terminal corresponding to the camera device.
- the present application also provides a door switch state monitoring device, the door switch state monitoring device including:
- a judging module configured to shoot the door to be monitored through a preset camera device, obtain the camera information sent by the camera device, and determine whether a person is in contact with the door to be monitored according to the camera information;
- An obtaining module configured to obtain a first picture and a second picture before and after the person contacts the door to be detected in the camera information if a person contacts the door to be detected;
- the determining module is configured to determine the switch state of the door to be monitored according to the first picture and the second picture.
- the present application also provides a door switch state monitoring device, the door switch state monitoring device comprising: a memory, a processor, and a door stored in the memory and capable of running on the processor.
- a switch state monitoring program which implements the steps of the door switch state monitoring method described above when the door switch state monitoring program is executed by the processor.
- the present application also provides a computer-readable storage medium having a door switch state monitoring program stored on the computer-readable storage medium, and when the door switch state monitoring program is executed by a processor, the above-mentioned The steps of the door switch state monitoring method.
- a method, device, equipment and readable storage medium for monitoring the state of a door switch are provided in the embodiments of the present invention.
- the door to be monitored is photographed by the preset camera device, thereby obtaining the camera information including the video image, and further by analyzing the video frame of the video image, it is determined whether there is a person in contact with the door to be monitored, thereby giving the person From the application scenario of the door to be monitored, when the switch state monitoring program determines that a person is in contact with the door to be monitored, it further intercepts two pictures before and after contact between the person and the door to be monitored, which are the first picture and the second picture. , And finally through the first picture and the second picture, determine the open and close state of the door to be monitored.
- This embodiment realizes real-time monitoring of the opening and closing state of the door to be monitored without increasing the cost (no special door lock is used).
- FIG. 1 is a schematic diagram of the hardware structure of an implementation manner of a door switch state monitoring device provided by an embodiment of the present invention.
- FIG. 2 is a schematic flowchart of the first embodiment of a method for monitoring the state of a door switch according to the present invention.
- Fig. 3 is a schematic diagram of the judgment personnel contacting the door to be monitored in the first embodiment of the door switch state monitoring method of the present invention.
- FIG. 4 is a schematic flowchart of a second embodiment of a method for monitoring the state of a door switch according to the present invention.
- FIG. 5 is a schematic flowchart of a third embodiment of a method for monitoring the state of a door switch according to the present invention.
- FIG. 6 is a schematic flowchart of a fourth embodiment of a method for monitoring the state of a door switch according to the present invention.
- the door switch state monitoring terminal (also called terminal, device, or terminal device) in the embodiment of the present application may be information processing equipment such as personal computers and smart phones, and also includes information acquisition equipment such as cameras, and information storage equipment such as memory and servers.
- the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
- the communication bus 1002 is used to implement connection and communication between these components.
- the user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
- the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
- the memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a magnetic disk memory.
- the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
- the terminal may also include a camera, an RF (Radio Frequency, radio frequency) circuit, a sensor, an audio circuit, a WiFi module, and so on.
- sensors such as light sensors, motion sensors and other sensors.
- the light sensor may include an ambient light sensor and a proximity sensor.
- the ambient light sensor can adjust the brightness of the display screen according to the brightness of the ambient light
- the proximity sensor can turn off the display screen and/or when the mobile terminal is moved to the ear.
- the gravity acceleration sensor can detect the magnitude of acceleration in various directions (usually three axes). It can detect the magnitude and direction of gravity when it is stationary.
- the mobile terminal can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. No longer.
- terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than shown in the figure, or combine some components, or arrange different components.
- the memory 1005 which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and a door switch state monitoring program.
- the network interface 1004 is mainly used to connect to the back-end server and communicate with the back-end server;
- the user interface 1003 is mainly used to connect to the client (user side) and communicate with the client;
- the processor 1001 may be used to call a door switch state monitoring program stored in the memory 1005, which, when executed by a processor, implements operations in the door switch state monitoring method provided in the following embodiments.
- the door switch state monitoring method includes:
- step S10 the door to be monitored is photographed by a preset camera device, the camera information sent by the camera device is acquired, and according to the camera information, it is determined whether a person is in contact with the door to be monitored.
- the door switch state monitoring method in this embodiment is applied to a door switch state monitoring device, where the door switch state monitoring device includes information processing devices such as personal computers and smart phones (hereinafter referred to as smart phones), and also includes information acquisition such as cameras Equipment (indicated by camera below), also includes information storage devices such as memory and server (indicated by memory below).
- the preset camera device in this embodiment refers to that in an IoT home environment, many devices are connected to each other through a public wireless network. The camera device is a part of these devices. The camera device may not be a separate individual. It can also be a camera installed on a TV, mobile phone, and remote drone.
- the door to be monitored refers to the door in a home environment, that is, the entrance and exit of the home environment.
- the opening and closing status of the door to be monitored directly affects the safety of the home environment.
- the camera device in this embodiment can take photos of the door to be monitored from multiple angles, and obtain camera information, which includes video images, sound, and camera time information. It can be seen that through the video image or sound in the camera information, it can be determined whether there is a person in the video image containing the door to be monitored, and if there is a person, it is further determined whether there is contact between the person and the door to be monitored.
- Step S20 If a person contacts the door to be detected, the first picture and the second picture before and after the person contacts the door to be detected in the camera information are acquired.
- the method for judging whether there is contact between a person and the door to be monitored can be to capture the movement track of the person through the camera. It is determined that there is contact between the person and the door to be monitored, that is, the person walks out of the door to be monitored in the video screen, and the specific determination method is not described in this embodiment.
- the door switch status monitoring program will obtain the system time when the person is in contact with the door to be monitored, and capture a clear picture in the video images before and after the system time, and in this system The picture taken before the time is the first picture, which is used to display the open and close status of the door to be monitored before the person touches the door to be monitored.
- the door to be monitored is closed when the person does not walk out of the door to be monitored.
- the picture captured after the time is the second picture, which is used to display the open and close state of the door to be monitored after the person contacts the door to be monitored, that is, the open and close state that needs to be judged in this embodiment.
- Step S30 Determine the open and close state of the door to be monitored according to the first picture and the second picture.
- the opening and closing status of the door to be monitored can be determined.
- the opening and closing status of the door to be monitored includes the closed state and the unclosed state (that is, the unclosed state).
- the analysis of the first picture and the second picture determines the opening and closing state of the door to be monitored. This embodiment will not be described in detail.
- step S10 includes:
- Step a1 Extract a video screen in the camera information, compare each video frame of the video screen, and determine whether there is a moving subject in the video screen.
- step a2 if the moving subject exists in the video screen, it is determined whether the contour of the subject of the moving subject matches a preset human contour.
- step a3 if the body contour matches the preset human body contour, it is determined that there is contact between a person and the door to be monitored.
- the video picture in this embodiment belongs to camera information. It can be seen that the video is composed of one frame by one frame.
- the video frame in this embodiment refers to each frame of the video. Frame pictures are compared, and if there are continuous differences in picture content, it can be determined that there is a moving subject in the video picture, which is similar to the process of animation production.
- the door switch state monitoring program will further obtain the outer edge contour of the moving subject, that is, the contour of the subject in this embodiment.
- the purpose of obtaining the contour of the moving subject is to further determine that the moving subject is People, as shown in Figure 3.
- Figure 3 shows the presence of moving people and other moving objects in the video screen (the mobile remote control car in the figure can also be a pet cat and a pet dog), and the left side of Figure 3 shows the presence of moving people. , And there are other moving objects on the right.
- the preset human contour is the pre-stored contour of the human body in each normal walking posture, and the main contour is matched with the preset human contour to determine whether A person contacts the door to be monitored, and if the matching is successful, it is determined that someone is in contact with the door to be monitored.
- the preset camera device is used to shoot the door to be monitored to obtain the camera information including the video image.
- the video frame of the video image is further analyzed to determine whether a person is in contact with the door to be monitored, thereby giving the person From the application scenario of the door to be monitored, when the switch state monitoring program determines that a person is in contact with the door to be monitored, it further intercepts two pictures before and after contact between the person and the door to be monitored, which are the first picture and the second picture. , And finally through the first picture and the second picture, determine the open and close state of the door to be monitored.
- This embodiment realizes real-time monitoring of the switch status of the door to be monitored without increasing the cost (without using a special door lock).
- This embodiment is a detailed step of step S30 in the first embodiment.
- the difference between this embodiment and the above-mentioned embodiment of this application lies in:
- Step S31 Perform an infrared reflection and penetration operation according to the first picture and the second picture to obtain a first infrared reflection value and a second infrared reflection value, respectively.
- Step S32 Calculate the reflection ratio value of the second infrared reflection value and the first infrared reflection value.
- Step S33 If the reflection ratio value is greater than or equal to the first preset threshold, it is determined that the door to be monitored is in a closed state.
- the infrared reflection and penetration operation refers to emitting infrared rays to an object. If the object has a gap or has a transparent part, the infrared rays irradiated on these positions will not be reflected.
- the switch state monitoring method can realize the monitoring of the door gap. First, by acquiring the position of the door to be monitored in the first picture and the second picture, the infrared reflection and penetration module is activated to perform an infrared 360-degree scan of the door to be monitored, and the reflected infrared rays are received.
- the infrared reflection and penetration module when the infrared reflection and penetration module is activated to perform infrared scanning on the door to be monitored in the first picture, the reflected infrared rays correspond to the first infrared reflection value (for example, 100 ⁇ 100), and for the door to be monitored in the second picture During infrared scanning, the reflected infrared corresponds to the second infrared reflectance value (for example, 90 ⁇ 100). Because the door to be monitored in the first picture is closed, the first infrared reflectance value is greater than or equal to the second infrared reflectance value.
- the reflection ratio in this embodiment is the ratio of the second infrared reflection value to the first infrared reflection value.
- the reflection ratio is The value is 0.9. It can be seen that if the reflection ratio value is larger, it means that when infrared scanning is performed on the door to be monitored in the second picture, the more infrared rays are reflected, the smaller the door gap of the door to be monitored in the second picture.
- the first preset threshold value is obtained based on the experience of multiple experiments, and is a preset value, and is adjustable. For example, the first preset threshold value is 0.95.
- the reflection ratio value is 0.96, it means that the second When the door to be monitored in the picture performs infrared scanning, the reflected infrared rays account for the ratio of the reflected infrared to 0.96 when performing infrared scanning on the door to be monitored in the first picture, that is, the more infrared rays are reflected. In this case, the door The switch state monitoring program determines that the door to be monitored is in the closed state.
- step S32 includes:
- Step b1 If the reflection ratio value is less than the first preset threshold, calculate the first average pixel value of all areas in the first picture, and calculate the second average pixel value of the non-reflected area in the second picture.
- Step b2 calculating the pixel ratio value of the first average pixel value and the second average pixel value.
- Step b3 if the pixel ratio value is greater than or equal to a second preset threshold, it is determined that the door to be monitored is in a closed state.
- step b4 if the pixel ratio value is less than the second preset threshold, it is determined that the door to be monitored is in a virtual mask state.
- the door switch state monitoring program will also obtain the pixel values of all pixels in the first picture, and calculate the average pixel value (that is, the first average pixel value in this embodiment). value).
- the non-reflective area in this embodiment refers to the area where infrared rays are not reflected during infrared scanning of the door to be monitored in the second picture. This area corresponds to the door gap of the door to be monitored. It can be seen that compared to the door to be monitored The color of the door in the picture and the color at the seam of the door are obviously different, and the color is bright because of light transmission.
- the pixel value in this embodiment is represented by RGB (a color standard) value.
- the RGB value of bright colors is higher than ordinary The color is high, so the second average pixel value in this embodiment is greater than the first average pixel value.
- the pixel ratio in this embodiment is the ratio of the first average pixel value to the second average pixel value. For example, if the first infrared reflection value is 220 ⁇ 200 ⁇ 189, the second infrared reflection value is 234 ⁇ 230 ⁇ 240, the reflection ratio value is about 0.64. It can be seen that the smaller the pixel ratio value, the larger the unreflected area showing bright light, that is, the larger the door gap of the door to be monitored in the second picture.
- the second preset threshold is also obtained based on the experience of many experiments, and is an adjustable preset value.
- the second preset threshold is 0.6. If the pixel ratio is 0.7, in this case, the door switch The condition monitoring program will determine that the door to be monitored is closed. If the reflection ratio value is less than the second preset threshold value, the door switch state monitoring program will determine that the door to be monitored is in a hidden state.
- step of determining the non-reflected area in step b1 includes:
- Step c1 Perform an infrared reflection and penetration operation according to the second picture, and determine the target infrared emission line corresponding to the unreflected infrared.
- Step c2 extract the target pixel points corresponding to the target infrared emission line, and use the area where the target pixel points are gathered as the non-reflected area.
- the target infrared emission line means that when the infrared ray emitted to the object passes through no gap or opaque part, the infrared ray will be reflected, and when the infrared ray emitted to the object passes through the slit or transparent part, the infrared ray will not be reflected.
- the part of the infrared that is not reflected is the target infrared emission line.
- the infrared and the pixels have one-to-one or multiple pairs Through this correspondence, the target pixel point corresponding to the target infrared emission line can be determined, and the area where the target pixel points are gathered is regarded as the non-reflected area, which can be used to indicate the position of the door slit.
- the reflection ratio value and the pixel ratio value are obtained, and further by judging the magnitude of the reflection ratio value and the pixel ratio value, the specific determination of the door switch state is given.
- the method realizes the real-time monitoring of the switch status of the door to be monitored.
- This embodiment is a step before step S10 in the first embodiment.
- the difference between this embodiment and the above-mentioned embodiment of this application lies in:
- Step S40 Acquire the picture information sent by the target camera device, extract the subject color information in the picture information, and determine whether the target camera device can photograph the door to be monitored according to the subject color information.
- Step S50 If the target camera device can photograph the door to be monitored, a communication connection between the target camera device and the door switch state monitoring device is established.
- the target camera device in this embodiment refers to all devices with camera functions in a smart home environment, including surveillance cameras, smart phones, smart TVs, and remote drones, etc., which are captured and sent by the target camera device. Picture information, and then obtain the subject color information in the captured photo, and analyze and judge the subject color information to determine whether the target camera device can capture the door to be monitored. Specifically, first obtain the subject of the captured picture, and use the existing Image recognition technology can determine the subject located in the center of the picture and obtain the edge of the subject. By judging the edge of the subject, you can determine whether the subject is a door, and then further obtain the color information of this subject. It can be seen that most of the doors are present.
- a fixed color such as red
- a communication connection between the target camera device that can capture the door to be monitored and the door switch state monitoring device is established, which lays the foundation for the subsequent judgment of the door switch state to be monitored.
- This embodiment is a step after step S30 in the first embodiment.
- the difference between this embodiment and the above-mentioned embodiment of the application lies in:
- step S60 if the door to be monitored is in a hidden state, a switch abnormality prompt message is sent through the terminal corresponding to the camera device.
- Step S70 Obtain a mobile terminal bound to the door to be monitored, and send the switch abnormality prompt information through the mobile terminal.
- the switch abnormality prompt information in this embodiment refers to the prompt information output in order to remind the user that the door to be monitored is not closed when the door switch state monitoring program determines that the open and close state of the door to be monitored is not closed.
- the switch abnormality prompt information may include Voice, text, sound and other forms can also be output on the terminal corresponding to the camera device. For example, when the opening and closing state of the door to be monitored is in the virtual state, the prompt information is output on the interface on the smart TV, or through the The mobile terminal bound to the monitoring door (such as a smart phone carried by the user) sends an abnormal switch prompt message.
- the terminal corresponding to the camera device or the mobile terminal bound to the door to be monitored sends an abnormal switch prompt message, which is Remind users.
- an embodiment of the present application also provides a door switch state monitoring device, the door switch state monitoring device includes:
- a judging module configured to shoot the door to be monitored through a preset camera device, obtain the camera information sent by the camera device, and determine whether a person is in contact with the door to be monitored according to the camera information;
- An obtaining module configured to obtain a first picture and a second picture before and after the person contacts the door to be detected in the camera information if a person contacts the door to be detected;
- the determining module is configured to determine the switch state of the door to be monitored according to the first picture and the second picture.
- the determining module includes:
- a penetrating unit configured to perform an infrared reflection penetrating operation according to the first picture and the second picture to obtain a first infrared reflection value and a second infrared reflection value respectively;
- a first calculation unit configured to calculate a reflection ratio value between the second infrared reflection value and the first infrared reflection value
- the first determining unit is configured to determine that the door to be monitored is in a closed state if the reflection ratio value is greater than or equal to a first preset threshold.
- the door switch state monitoring device further includes:
- the second calculation unit is configured to calculate the first average pixel value of all areas in the first picture if the reflection ratio value is less than the first preset threshold value, and calculate the second average pixel value of the non-reflected area in the second picture value;
- a third calculation unit configured to calculate a pixel ratio value of the first average pixel value and the second average pixel value
- a second determining unit configured to determine that the door to be monitored is in a closed state if the pixel ratio value is greater than or equal to a second preset threshold
- the third determining unit is configured to determine that the door to be monitored is in a virtual mask state if the pixel ratio value is less than the second preset threshold value.
- the third calculation unit includes:
- the reflecting unit is configured to perform an infrared reflection and penetration operation according to the second picture, and determine the target infrared emission line corresponding to the unreflected infrared;
- the extraction unit is configured to extract the target pixel points corresponding to the target infrared emission line, and use the area where the target pixel points are gathered as the non-reflected area.
- the judgment module includes:
- the comparison unit is configured to extract a video picture in the camera information, compare each video frame of the video picture, and determine whether there is a moving subject in the video picture;
- a determining unit configured to determine whether the body contour of the moving body matches a preset human body contour if the moving body exists in the video frame;
- the fourth determining unit is configured to determine that there is contact between a person and the door to be monitored if the contour of the main body matches the preset contour of the human body.
- the door switch state monitoring device further includes:
- An acquiring unit configured to acquire picture information sent by a target camera device, extract subject color information in the picture information, and determine whether the target camera device can photograph the door to be monitored according to the subject color information;
- the establishment unit is configured to establish a communication connection between the target camera device and the door switch state monitoring device if the target camera device can photograph the door to be monitored.
- the door switch state monitoring device further includes:
- the first sending unit is configured to send the switch abnormality prompt information through the terminal corresponding to the camera device if the door to be monitored is in a virtual hidden state; or,
- the second sending unit is configured to obtain a mobile terminal bound to the door to be monitored, and send the switch abnormality prompt information through the mobile terminal.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Alarm Systems (AREA)
- Burglar Alarm Systems (AREA)
Abstract
本申请公开了一种门开关状态监测方法，包括：对待监测门进行拍摄，得到摄像信息，若根据摄像信息判定有人员与待监测门接触，则获取摄像信息中人员与待检测门接触前后的第一图片和第二图片；根据第一图片和第二图片确定待监测门的开关状态，实现了对待监测门开关状态的实时监测。本申请还公开了一种门开关状态监测装置、设备及计算机可读存储介质。
Description
本申请涉及物联网监控领域，尤其涉及门开关状态监测方法、装置、设备及计算机可读存储介质。
随着物联网技术的不断成熟，智能家居得到了快速的发展，现在越来越多的家庭使用了可以并入物联网网络的智能门锁，然而智能门锁在提供便利性（节省了传统的钥匙开关门的步骤）的同时，也存在门可能关不严密（即虚掩）的问题。
现有的解决智能门虚掩的方法是使用具有助力机制的智能门锁，即为智能门提供额外旋转动力，直至门锁紧而无法转动为止，该方法虽然能使门关闭，但无法对门的开关状态进行监测，且需要使用特殊的门锁，不具有普及型，需要提供额外旋转动力，也增加成本。
本申请的主要目的在于提供一种门开关状态监测方法，可以解决现有技术中无法对门的开关状态进行监测，且需要使用特殊的门锁，不具有普及型，需要提供额外旋转动力，也增加成本的技术问题。
为实现上述目的，本申请提供一种门开关状态监测方法，所述门开关状态监测方法包括以下步骤：
通过预设的摄像装置对待监测门进行拍摄，获取所述摄像装置发送的摄像信息，并根据所述摄像信息，判断是否有人员与所述待监测门接触；
若有人员与所述待监测门接触，则获取所述摄像信息中人员与所述待检测门接触前后的第一图片和第二图片；
根据所述第一图片和所述第二图片，确定所述待监测门的开关状态。
可选地，所述根据所述第一图片和所述第二图片，确定所述待监测门的开关状态的步骤，包括：
根据所述第一图片和所述第二图片，进行红外反射穿透操作，分别得到第一红外反射值和第二红外反射值；
计算所述第二红外反射值与所述第一红外反射值的反射比例值；
若所述反射比例值大于或等于第一预设阈值，则判定所述待监测门处于关闭状态。
可选地，所述若计算所述第二红外反射值与所述第一红外反射值的反射比例值的步骤之后，包括：
若所述反射比例值小于第一预设阈值，则计算第一图片中全部区域的第一平均像素值，计算所述第二图片中未反射区域的第二平均像素值；
计算所述第一平均像素值与所述第二平均像素值的像素比例值；
若所述像素比例值大于或等于第二预设阈值，则判定所述待监测门处于关闭状态；
若所述像素比例值小于所述第二预设阈值，则判定所述待监测门处于虚掩状态。
可选地，所述未反射区域的确定过程，包括：
根据所述第二图片，进行红外反射穿透操作，确定未反射红外线对应的目标红外发射线；
提取所述目标红外发射线对应的目标像素点，将所述目标像素点聚集的区域作为未反射区域。
可选地，所述根据所述摄像信息，判断是否有人员与所述待监测门接触的步骤包括：
提取所述摄像信息中的视频画面，将所述视频画面的各视频帧进行比对，判断所述视频画面中是否存在移动主体；
若所述视频画面中存在所述移动主体，则判断所述移动主体的主体轮廓与预设人体轮廓是否匹配；
若所述主体轮廓与所述预设人体轮廓匹配，则判定有人员与待监测门的接触。
可选地，所述门开关状态监测方法应用于门开关状态监测设备，所述门开关状态监测设备可与多个摄像装置通信连接，所述获取所述摄像装置发送的摄像信息，并根据所述摄像信息，判断是否有人员与所述待监测门接触的步骤之前，包括：
获取目标摄像装置发送的图片信息，提取所述图片信息中的主体色彩信息，并根据所述主体色彩信息，判断所述目标摄像装置是否能拍摄到待监测门；
若所述目标摄像装置能拍摄到所述待监测门，则建立所述目标摄像装置与门开关状态监测设备的通信连接。
可选地，所述根据所述第一图片和所述第二图片，确定所述待监测门的开关状态的步骤之后，包括：
若所述待监测门处于虚掩状态，则通过摄像装置对应的终端发送开关异常提示信息；或者，
获取与所述待监测门绑定的移动终端，并通过所述移动终端发送所述开关异常提示信息。
此外，为实现上述目的，本申请还提供一种门开关状态监测装置，所述门开关状态监测装置包括：
判断模块，用于通过预设的摄像装置对待监测门进行拍摄，获取所述摄像装置发送的摄像信息，并根据所述摄像信息，判断是否有人员与所述待监测门接触；
获取模块，用于若有人员与所述待监测门接触，则获取所述摄像信息中人员与所述待检测门接触前后的第一图片和第二图片；
确定模块，用于根据所述第一图片和所述第二图片，确定所述待监测门的开关状态。
此外，为实现上述目的，本申请还提供一种门开关状态监测设备，所述门开关状态监测设备包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的门开关状态监测程序，所述门开关状态监测程序被所述处理器执行时实现如上述的门开关状态监测方法的步骤。
此外，为实现上述目的，本申请还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有门开关状态监测程序，所述门开关状态监测程序被处理器执行时实现如上述的门开关状态监测方法的步骤。
本发明实施例提出的一种门开关状态监测方法、装置、设备及可读存储介质。本发明实施例中通过预设摄像装置对待监测门进行拍摄，从而得到包含视频画面的摄像信息，进一步通过对视频画面的视频帧进行分析，确定是否有人员与待监测门接触，从而给出人员从所述待监测门走出的应用场景，开关状态监测程序在判定有人员与待监测门接触时，则进一步截取人员与待监测门接触前后的两张图片，分别为第一图片和第二图片，最终通过第一图片和第二图片，确定待监测门的开关状态。本实施例在不增加成本（不使用特殊门锁）的情况下，实现了对待监测门的开关状态的实时监测。
图1为本发明实施例提供的门开关状态监测设备一种实施方式的硬件结构示意图。
图2为本发明门开关状态监测方法第一实施例的流程示意图。
图3为本发明门开关状态监测方法第一实施例中判断人员与待监测门接触的示意图。
图4为本发明门开关状态监测方法第二实施例的流程示意图。
图5为本发明门开关状态监测方法第三实施例的流程示意图。
图6为本发明门开关状态监测方法第四实施例的流程示意图。
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
在后续的描述中，使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本申请的说明，其本身没有特定的意义。因此，“模块”、“部件”或“单元”可以混合地使用。
本申请实施例门开关状态监测终端（又叫终端、设备或者终端设备）可以是个人电脑和智能手机等信息处理设备，还包括摄像头等信息获取设备，还包括存储器和服务器等信息存储设备。
如图1所示，该终端可以包括：处理器1001，例如CPU，网络接口1004，用户接口1003，存储器1005，通信总线1002。其中，通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏（Display）、输入单元比如键盘（Keyboard），可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口（如WI-FI接口）。存储器1005可以是高速RAM存储器，也可以是稳定的存储器（non-volatile memory），例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。
可选地，终端还可以包括摄像头、RF（Radio Frequency，射频）电路，传感器、音频电路、WiFi模块等等。其中，传感器比如光传感器、运动传感器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示屏的亮度，接近传感器可在移动终端移动到耳边时，关闭显示屏和/或背光。作为运动传感器的一种，重力加速度传感器可检测各个方向上（一般为三轴）加速度的大小，静止时可检测出重力的大小及方向，可用于识别移动终端姿态的应用（比如横竖屏切换、相关游戏、磁力计姿态校准）、振动识别相关功能（比如计步器、敲击）等；当然，移动终端还可配置陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
本领域技术人员可以理解，图1中示出的终端结构并不构成对终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
如图1所示，作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及门开关状态监测程序。
在图1所示的终端中，网络接口1004主要用于连接后台服务器，与后台服务器进行数据通信；用户接口1003主要用于连接客户端（用户端），与客户端进行数据通信；而处理器1001可以用于调用存储器1005中存储的门开关状态监测程序，所述门开关状态监测程序被处理器执行时实现下述实施例提供的门开关状态监测方法中的操作。
基于上述开关状态监测设备硬件结构，提出了本申请门开关状态监测方法的实施例。
参照图2，在本申请门开关状态监测方法的第一实施例中，所述门开关状态监测方法包括：
步骤S10，通过预设的摄像装置对待监测门进行拍摄，获取所述摄像装置发送的摄像信息，并根据所述摄像信息，判断是否有人员与所述待监测门接触。
本实施例中门开关状态监测方法应用于门开关状态监测设备，其中，所述门开关状态监测设备包括个人电脑和智能手机等信息处理设备（下文以智能手机表示），还包括摄像头等信息获取设备（下文以摄像头表示），还包括存储器和服务器等信息存储设备（下文以存储器表示）。本实施例中预设的摄像装置是指，在一个物联网家居的环境中，很多设备通过公共无线网络相互连接，摄像装置即是这些设备中的一部分，摄像装置可以不是一个单独的个体，它也可以是安装在电视机、手机和遥控无人机上的摄像头。待监测门是指，一个家居环境下的大门，即这个家居环境的进出口，待监测门的开关状态直接影响到家居环境的安全。本实施例中的摄像装置可以从多个角度对待监测门进行拍摄，并获取到摄像信息，摄像信息包括视频画面、声音和摄像时间信息。可知地，通过摄像信息中的视频画面或者声音，可以判断在包含待监测门的视频画面中是否存在人员，若存在人员再进一步判断是否存在人员与待监测门的接触。
步骤S20，若有人员与所述待监测门接触，则获取所述摄像信息中人员与所述待检测门接触前后的第一图片和第二图片。
可知地，判断是否存在人员与待监测门的接触的方法可以是，通过摄像头捕捉人员的移动轨迹，若捕捉到人员从外面进入视频画面，又在视频画面中消失（未走出视频画面），则判定存在人员与待监测门的接触，即，人员从视频画面中的待监测门走出，具体的判断方法本实施例不再叙述。当有人员与待监测门接触时，门开关状态监测程序将获取人员与待监测门接触时的系统时间，并在这个系统时间前后的视频画面中分别截取一张清晰的图片，而在这个系统时间前截取的图片即是第一图片，用于显示人员与待监测门接触前待监测门的开关状态，一般认为人员未走出待监测门时，待监测门是处于关闭状态的，在这个系统时间后截取的图片即是第二图片，用于显示人员与待监测门接触后待监测门的开关状态，即本实施例需要判断的开关状态。
步骤S30，根据所述第一图片和所述第二图片，确定所述待监测门的开关状态。
通过对第一图片和第二图片的分析，可以确定待监测门的开关状态，其中，待监测门的开关状态包括关闭状态和虚掩状态（即未关闭状态），具体地，如何通过对第一图片和第二图片的分析，确定待监测门的开关状态本实施例不再详述。
具体地，步骤S10细化的步骤，包括：
步骤a1，提取所述摄像信息中的视频画面，将所述视频画面的各视频帧进行比对，判断所述视频画面中是否存在移动主体。
步骤a2，若所述视频画面中存在所述移动主体，则判断所述移动主体的主体轮廓与预设人体轮廓是否匹配。
步骤a3，若所述主体轮廓与所述预设人体轮廓匹配，则判定有人员与待监测门的接触。
本实施例中的视频画面属于摄像信息，可知地，视频是由一帧一帧的画面组成，本实施例中的视频帧即是指视频的每一帧画面，可知地，将视频的每一帧画面进行对比，若连续出现画面内容的差异，则可以确定视频画面中存在移动主体，这与动画制作的过程相似。当判定视频画面中存在移动主体时，门开关状态监测程序将进一步获取这个移动主体的外边缘轮廓，即本实施例中的主体轮廓，获取移动主体的轮廓的目的是，进一步确定该移动主体为人员，如图3所示，图3为视频画面中存在移动的人员和存在其他移动物体（图中的移动遥控小车也可以是宠物猫和宠物狗）的情况，图3左侧为存在移动人员，右侧为存在其他移动物体。通过获取主体轮廓，并进一步将主体轮廓与预设人体轮廓进行匹配，其中，预设人体轮廓为预先存储的人体在各个正常行走姿势下的轮廓，通过主体轮廓与预设人体轮廓匹配，判断是否有人员与待监测门接触，若匹配成功，则判定有人员与待监测门接触。可知地，为了排除人员只是从视频画面中走过的情况，在对视频画面的各视频帧进行对比时，排除移动主体从视频画面中走过的情况，而只对进入视频画面，且从视频画面中的待监测门处消失的移动主体进行轮廓匹配，可知地，进入视频画面，且又从视频画面中的待监测门处消失的移动主体，可以确定移动主体走出了待监测门，也可以进一步确定该移动主体为人员。
在本实施例中通过预设摄像装置对待监测门进行拍摄，从而得到包含视频画面的摄像信息，进一步通过对视频画面的视频帧进行分析，确定是否有人员与待监测门接触，从而给出人员从所述待监测门走出的应用场景，开关状态监测程序在判定有人员与待监测门接触时，则进一步截取人员与待监测门接触前后的两张图片，分别为第一图片和第二图片，最终通过第一图片和第二图片，确定待监测门的开关状态。本实施例在不增加成本（不使用特殊门锁）的情况下，实现了对待监测门开关状态的实时监测。
进一步地，参照图4，在本申请上述实施例的基础上，提出了本申请门开关状态监测方法的第二实施例。
本实施例是第一实施例中步骤S30细化的步骤，本实施例与本申请上述实施例的区别在于：
步骤S31，根据所述第一图片和所述第二图片，进行红外反射穿透操作，分别得到第一红外反射值和第二红外反射值。
步骤S32，计算所述第二红外反射值与所述第一红外反射值的反射比例值。
步骤S33，若所述反射比例值大于或等于第一预设阈值，则判定所述待监测门处于关闭状态。
本实施例中红外反射穿透操作是指，对物体发射红外线，若物体具有缝隙或者存在透明部分，照射在这些位置上的红外线将会不会发生反射，利用这个原理，本实施例中的门开关状态监测方法可以实现对门缝的监测。首先，通过获取第一图片和第二图片中待监测门的位置，然后启动红外反射穿透模块对待监测门进行红外360度扫描，并接收反射回来的红外线。可知地，启动红外反射穿透模块对第一图片中的待监测门进行红外扫描时，反射的红外线对应第一红外反射值（例如，100×100），而对第二图片中的待监测门进行红外扫描时，反射的红外线对应第二红外反射值（例如，90×100），因为第一图片中的待监测门处于关闭状态，则第一红外反射值大于或等于第二红外反射值。本实施例中的反射比例值为第二红外反射值与第一红外反射值的比例值，例如，若第一红外反射值为100×100，第二红外反射值为90×100，则反射比例值为0.9，可知地，若反射比例值越大，则说明对第二图片中的待监测门进行红外扫描时，反射的红外线越多，第二图片中的待监测门的门缝越小。本实施例中第一预设阈值是根据多次实验的经验而得，为预设值，且可调，例如，第一预设阈值为0.95，若反射比例值为0.96，则说明对第二图片中的待监测门进行红外扫描时，反射的红外线占对第一图片中的待监测门进行红外扫描时，反射的红外线的比例为0.96，即反射的红外线越多，这种情况下，门开关状态监测程序判定待监测门处于关闭状态。
具体地，步骤S32之后的步骤，包括：
步骤b1，若所述反射比例值小于第一预设阈值，则计算第一图片中全部区域的第一平均像素值，计算所述第二图片中未反射区域的第二平均像素值。
步骤b2，计算所述第一平均像素值与所述第二平均像素值的像素比例值。
步骤b3，若所述像素比例值大于或等于第二预设阈值，则判定所述待监测门处于关闭状态。
步骤b4，若所述像素比例值小于所述第二预设阈值，则判定所述待监测门处于虚掩状态。
可知地，当反射比例值小于第一预设阈值时，门开关状态监测程序还将获取第一图片中所有像素点的像素值，并计算平均像素值（即本实施例中的第一平均像素值）。本实施例中的未反射区域是指，在对第二图片中的待监测门进行红外扫描时，红外线未反射的区域，该区域对应待监测门的门缝，可知地，相较于待监测门在图片中的颜色，门缝处的颜色明显不同，因为透光而呈现亮色，而本实施例中的像素值采用RGB（一种颜色标准）值表示，可知地，亮色的RGB值比普通颜色高，所以，本实施例中的第二平均像素值大于第一平均像素值。同样地，本实施例中的像素比例值为第一平均像素值与第二平均像素值的比例值，例如，若第一红外反射值为220×200×189，第二红外反射值为234×230×240，则反射比例值约为0.64，可知地，若像素比例值越小，则说明呈现亮光的未反射区域越大，即第二图片中的待监测门的门缝越大。本实施例中第二预设阈值也是根据多次实验的经验而得，为可调预设值，例如，第二预设阈值为0.6，若像素比例值为0.7，这种情况下，门开关状态监测程序将判定待监测门处于关闭状态。若反射比例值小于第二预设阈值，则门开关状态监测程序将判定待监测门处于虚掩状态。
具体地，步骤b1中的未反射区域确定的步骤，包括：
步骤c1，根据所述第二图片，进行红外反射穿透操作，确定未反射红外线对应的目标红外发射线。
步骤c2，提取所述目标红外发射线对应的目标像素点，将所述目标像素点聚集的区域作为未反射区域。
本实施例中目标红外发射线是指，当对物体发射的红外线经过没有缝隙或者不透明的部分时，红外线会反射，而当对物体发射的红外线经过缝隙或者透明的部分时，红外线则不会反射，而没有反射的这部分红外线即是目标红外发射线。可知地，对物体发射的红外线与图片中的像素点具有对应关系，具体地，红外线与像素点的对应关系取决于红外线的发射密度，一般情况下，红外线与像素点具有一对一或多对一的关系，通过这种对应关系，可以确定目标红外发射线对应的目标像素点，进而将目标像素点聚集的区域作为未反射区域，该区域可用于表示门缝的位置。
在本实施例通过红外反射穿透操作和计算平均像素值，得到反射比例值和像素比例值，又进一步通过对反射比例值和像素比例值的大小进行判断，给出了门开关状态判定的具体方法，实现了对待监测门开关状态的实时监测。
进一步地，参照图5，在本申请上述实施例的基础上，提出了本申请门开关状态监测方法的第三实施例。
本实施例是第一实施例中步骤S10之前的步骤，本实施例与本申请上述实施例的区别在于：
步骤S40，获取目标摄像装置发送的图片信息，提取所述图片信息中的主体色彩信息，并根据所述主体色彩信息，判断所述目标摄像装置是否能拍摄到待监测门。
步骤S50，若所述目标摄像装置能拍摄到所述待监测门，则建立所述目标摄像装置与门开关状态监测设备的通信连接。
本实施例中目标摄像装置是指，在一个智能家居环境中，所有具有摄像功能的装置，可以包括监控摄像头、智能手机、智能电视和遥控无人机等，通过获取目标摄像装置拍摄并发送的图片信息，进而获取拍摄的照片内的主体色彩信息，并对主体色彩信息进行分析判断，确定目标摄像装置是否能拍摄到待监测门，具体地，首先先获取拍摄图片的主体，通过现有的图像识别技术能够确定位于图片中心的主体，并获取主体边缘，通过对主体边缘的判断，可以确定该主体是否为门，然后再进一步获取这个主体的色彩信息，可知地，大多数的门都呈现固定的颜色，例如红色，通过预先获取待监测门的色彩信息，再进一步将获取到的主体色彩与待监测门的色彩进行对比，若二者相似，则可确定该主体为待监测门，而判定目标摄像装置能够拍摄到待监测门，最终，将能拍摄到待监测门的目标摄像装置与门开关状态监测设备建立通信连接。
在本实施例中通过对所有目标摄像装置的筛选，建立能拍摄到待监测门的目标摄像装置与门开关状态监测设备之间的通信连接，为后续的待监测门开关状态的判断奠定基础。
进一步地，参照图6，在本申请上述实施例的基础上，提出了本申请门开关状态监测方法的第三实施例。
本实施例是第一实施例中步骤S30之后的步骤，本实施例与本申请上述实施例的区别在于：
步骤S60，若所述待监测门处于虚掩状态，则通过摄像装置对应的终端发送开关异常提示信息。
步骤S70，获取与所述待监测门绑定的移动终端，并通过所述移动终端发送所述开关异常提示信息。
本实施例中开关异常提示信息是指，当门开关状态监测程序判定待监测门的开关状态为虚掩状态时，为了提醒用户待监测门未关闭而输出的提示信息，开关异常提示信息可以包括语音、文字和声音等形式，也可以在摄像装置对应的终端上输出，例如，当待监测门的开关状态为虚掩状态时，在智能电视上的界面上输出提示信息，也可以通过与待监测门绑定的移动终端（如用户携带的智能手机）发送开关异常提示信息。
在本实施例中当门开关状态监测程序判定待监测门的开关状态为虚掩状态时，通过摄像装置对应的终端或与所述待监测门绑定的移动终端发送开关异常提示信息，起到了对用户的提醒作用。
此外，本申请实施例还提出一种门开关状态监测装置，所述门开关状态监测装置包括：
判断模块，用于通过预设的摄像装置对待监测门进行拍摄，获取所述摄像装置发送的摄像信息，并根据所述摄像信息，判断是否有人员与所述待监测门接触；
获取模块，用于若有人员与所述待监测门接触，则获取所述摄像信息中人员与所述待检测门接触前后的第一图片和第二图片；
确定模块，用于根据所述第一图片和所述第二图片，确定所述待监测门的开关状态。
可选地，所述确定模块，包括：
穿透单元，用于根据所述第一图片和所述第二图片，进行红外反射穿透操作，分别得到第一红外反射值和第二红外反射值；
第一计算单元，用于计算所述第二红外反射值与所述第一红外反射值的反射比例值；
第一判定单元，用于若所述反射比例值大于或等于第一预设阈值，则判定所述待监测门处于关闭状态。
可选地，所述门开关状态监测装置，还包括：
第二计算单元，用于若所述反射比例值小于第一预设阈值，则计算第一图片中全部区域的第一平均像素值，计算所述第二图片中未反射区域的第二平均像素值；
第三计算单元，用于计算所述第一平均像素值与所述第二平均像素值的像素比例值；
第二判定单元，用于若所述像素比例值大于或等于第二预设阈值，则判定所述待监测门处于关闭状态；
第三判定单元，用于若所述像素比例值小于所述第二预设阈值，则判定所述待监测门处于虚掩状态。
可选地，所述第三计算单元，包括：
反射单元，用于根据所述第二图片，进行红外反射穿透操作，确定未反射红外线对应的目标红外发射线；
提取单元，用于提取所述目标红外发射线对应的目标像素点，将所述目标像素点聚集的区域作为未反射区域。
可选地，所述判断模块，包括：
对比单元，用于提取所述摄像信息中的视频画面，将所述视频画面的各视频帧进行比对，判断所述视频画面中是否存在移动主体；
判断单元，用于若所述视频画面中存在所述移动主体，则判断所述移动主体的主体轮廓与预设人体轮廓是否匹配；
第四判定单元，用于若所述主体轮廓与所述预设人体轮廓匹配，则判定有人员与待监测门的接触。
可选地，所述门开关状态监测装置，还包括：
获取单元，用于获取目标摄像装置发送的图片信息，提取所述图片信息中的主体色彩信息，并根据所述主体色彩信息，判断所述目标摄像装置是否能拍摄到待监测门；
建立单元，用于若所述目标摄像装置能拍摄到所述待监测门，则建立所述目标摄像装置与门开关状态监测设备的通信连接。
可选地，所述门开关状态监测装置，还包括：
第一发送单元，用于若所述待监测门处于虚掩状态，则通过摄像装置对应的终端发送开关异常提示信息；或者，
第二发送单元，用于获取与所述待监测门绑定的移动终端，并通过所述移动终端发送所述开关异常提示信息。
上述各程序模块所执行的方法可参照本申请方法各个实施例，此处不再赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件商品的形式体现出来，该计算机软件商品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机和平板电脑等)执行本申请各个实施例所述的方法。
以上仅为本申请的优选实施例，并非因此限制本申请的专利范围，凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本申请的专利保护范围内。
Claims (20)
- 一种门开关状态监测方法，其中，所述门开关状态监测方法包括以下步骤：通过预设的摄像装置对待监测门进行拍摄，获取所述摄像装置发送的摄像信息，并根据所述摄像信息，判断是否有人员与所述待监测门接触；若有人员与所述待监测门接触，则获取所述摄像信息中人员与所述待检测门接触前后的第一图片和第二图片；根据所述第一图片和所述第二图片，确定所述待监测门的开关状态。
- 如权利要求1所述的门开关状态监测方法，其中，所述根据所述第一图片和所述第二图片，确定所述待监测门的开关状态的步骤，包括：根据所述第一图片和所述第二图片，进行红外反射穿透操作，分别得到第一红外反射值和第二红外反射值；计算所述第二红外反射值与所述第一红外反射值的反射比例值；若所述反射比例值大于或等于第一预设阈值，则判定所述待监测门处于关闭状态。
- 如权利要求2所述的门开关状态监测方法，其中，所述计算所述第二红外反射值与所述第一红外反射值的反射比例值的步骤之后，还包括：若所述反射比例值小于第一预设阈值，则计算第一图片中全部区域的第一平均像素值，计算所述第二图片中未反射区域的第二平均像素值；计算所述第一平均像素值与所述第二平均像素值的像素比例值；若所述像素比例值大于或等于第二预设阈值，则判定所述待监测门处于关闭状态；若所述像素比例值小于所述第二预设阈值，则判定所述待监测门处于虚掩状态。
- 如权利要求3所述的门开关状态监测方法，其中，所述计算所述第二图片中未反射区域的第二平均像素值之前，还包括：确定所述未反射区域；所述确定所述未反射区域，包括：根据所述第二图片，进行红外反射穿透操作，确定未反射红外线对应的目标红外发射线；提取所述目标红外发射线对应的目标像素点，将所述目标像素点聚集的区域作为未反射区域。
- 如权利要求1所述的门开关状态监测方法，其中，所述根据所述摄像信息，判断是否有人员与所述待监测门接触的步骤包括：提取所述摄像信息中的视频画面；将所述视频画面的各视频帧进行比对，以判断所述视频画面中是否存在移动主体；若所述视频画面中存在所述移动主体，则判断所述移动主体的主体轮廓与预设人体轮廓是否匹配；若所述主体轮廓与所述预设人体轮廓匹配，则判定有人员与待监测门的接触。
- 如权利要求1所述的门开关状态监测方法，其中，所述门开关状态监测方法应用于门开关状态监测设备，所述门开关状态监测设备与多个摄像装置通信连接，所述获取所述摄像装置发送的摄像信息，并根据所述摄像信息，判断是否有人员与所述待监测门接触的步骤之前，包括：获取目标摄像装置发送的图片信息，提取所述图片信息中的主体色彩信息；根据所述主体色彩信息，判断所述目标摄像装置是否能拍摄到待监测门；若所述目标摄像装置能拍摄到所述待监测门，则建立所述目标摄像装置与门开关状态监测设备的通信连接。
- 如权利要求1所述的门开关状态监测方法，其中，所述根据所述第一图片和所述第二图片，确定所述待监测门的开关状态的步骤之后，还包括：若所述待监测门处于虚掩状态，则通过摄像装置对应的终端输出开关异常提示信息；或者，获取与所述待监测门绑定的移动终端，并通过所述移动终端输出所述开关异常提示信息。
- 如权利要求1所述的门开关状态监测方法，其中，所述获取所述摄像信息中人员与所述待检测门接触前后的第一图片和第二图片，包括：获取人员与所述待监测门接触时的系统时间；在所述系统时间前后的视频画面中分别截取所述第一图片和所述第二图片，其中，所述第一图片为在所述系统时间前截取的图片，所述第二图片为在所述系统时间后截取的图片。
- 如权利要求5所述的门开关状态监测方法，其中，所述若所述视频画面中存在所述移动主体，则判断所述移动主体的主体轮廓与预设人体轮廓是否匹配，包括：若所述视频画面中存在所述移动主体，则判断进入所述视频画面，且从所述视频画面中的待监测门处消失的移动主体的主体轮廓与预设人体轮廓是否匹配。
- 如权利要求2所述的门开关状态监测方法，其中，所述根据所述第一图片和所述第二图片，进行红外反射穿透操作，分别得到第一红外反射值和第二红外反射值，包括：获取所述第一图片和所述第二图片中待监测门的位置；根据所述第一图片和所述第二图片中待监测门的位置，启动红外反射穿透模块对所述待监测门进行红外扫描，并接收反射回来的红外线，其中，对所述第一图片中的待监测门进行红外扫描时反射的红外线为所述第一红外反射值，对所述第二图片中的待监测门进行红外扫描时反射的红外线为所述第二红外反射值。
- 如权利要求1所述的门开关状态监测方法，其中，所述判断是否有人员与所述待监测门接触，包括：捕捉人员的移动轨迹，若捕捉到人员从外面进入视频画面，又在所述视频画面中消失且未走出所述视频画面，则判定存在人员与所述待监测门接触。
- 一种门开关状态监测装置，其中，所述门开关状态监测装置包括：判断模块，用于通过预设的摄像装置对待监测门进行拍摄，获取所述摄像装置发送的摄像信息，并根据所述摄像信息，判断是否有人员与所述待监测门接触；获取模块，用于在所述判断模块判断有人员与所述待监测门接触时，获取所述摄像信息中人员与所述待检测门接触前后的第一图片和第二图片；确定模块，用于根据所述获取模块获取的所述第一图片和所述第二图片，确定所述待监测门的开关状态。
- 如权利要求12所述的门开关状态监测装置，其中，所述确定模块，包括：穿透单元，用于根据所述获取模块获取的所述第一图片和所述第二图片，进行红外反射穿透操作，分别得到第一红外反射值和第二红外反射值；第一计算单元，用于计算所述穿透单元得到的所述第二红外反射值与所述第一红外反射值的反射比例值；第一判定单元，用于若所述第一计算单元计算的所述反射比例值大于或等于第一预设阈值，则判定所述待监测门处于关闭状态。
- 如权利要求13所述的门开关状态监测装置，其中，所述确定模块还包括：第二计算单元，用于若所述第一计算单元计算的所述反射比例值小于第一预设阈值，则计算第一图片中全部区域的第一平均像素值，计算所述第二图片中未反射区域的第二平均像素值；第三计算单元，用于计算所述第二计算单元计算的所述第一平均像素值与所述第二平均像素值的像素比例值；第二判定单元，用于若所述第三计算单元计算的所述像素比例值大于或等于第二预设阈值，则判定所述待监测门处于关闭状态；第三判定单元，用于若所述第三计算单元计算的所述像素比例值小于所述第二预设阈值，则判定所述待监测门处于虚掩状态。
- 如权利要求14所述的门开关状态监测装置，其中，所述确定模块还包括：确定单元，用于在所述第二计算单元计算所述第二图片中未反射区域的第二平均像素值之前，确定所述未反射区域；所述确定单元，包括：反射子单元，用于根据所述获取模块获取的所述第二图片，进行红外反射穿透操作，确定未反射红外线对应的目标红外发射线；提取子单元，用于提取所述反射子单元确定的所述目标红外发射线对应的目标像素点，将所述目标像素点聚集的区域作为未反射区域。
- 如权利要求12所述的门开关状态监测装置，其中，所述判断模块，包括：对比单元，用于提取所述判断模块获取的所述摄像信息中的视频画面，将所述视频画面的各视频帧进行比对，以判断所述视频画面中是否存在移动主体；判断单元，用于若所述对比单元提取的所述视频画面中存在所述移动主体，则判断所述移动主体的主体轮廓与预设人体轮廓是否匹配；第四判定单元，用于若判断单元判断所述主体轮廓与所述预设人体轮廓匹配，则判定有人员与待监测门的接触。
- 如权利要求12所述的门开关状态监测装置，其中，所述判断模块，还包括：获取单元，用于获取目标摄像装置发送的图片信息，提取所述图片信息中的主体色彩信息，并根据所述主体色彩信息，判断所述目标摄像装置是否能拍摄到待监测门；建立单元，用于若所述获取单元判断所述目标摄像装置能拍摄到所述待监测门，则建立所述目标摄像装置与门开关状态监测设备的通信连接。
- 如权利要求12所述的门开关状态监测装置，其中，所述门开关状态监测装置，还包括：第一发送模块，用于若所述确定模块确定所述待监测门处于虚掩状态，则通过摄像装置对应的终端发送开关异常提示信息；或者，第二发送模块，用于获取与所述待监测门绑定的移动终端，并通过所述移动终端发送所述开关异常提示信息。
- 一种门开关状态监测设备，其中，所述门开关状态监测设备包括：存储器、处理器及存储在所述存储器上并用于在所述处理器上运行的门开关状态监测程序，所述门开关状态监测程序被所述处理器执行时实现如权利要求1至11中任一项所述的门开关状态监测方法的步骤。
- 一种计算机可读存储介质，其中，所述计算机可读存储介质上存储有门开关状态监测程序，所述门开关状态监测程序被处理器执行时实现如权利要求1至11中任一项所述的门开关状态监测方法的步骤。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010297734.6 | 2020-04-15 | ||
| CN202010297734.6A CN112329504B (zh) | 2020-04-15 | 2020-04-15 | 门开关状态监测方法、装置、设备及计算机可读存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2021208986A1 true WO2021208986A1 (zh) | 2021-10-21 |
Family
ID=74302822
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/087315 WO2021208986A1 (zh) | 2020-04-15 | 2021-04-14 | 门开关状态监测方法、装置、设备及计算机可读存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112329504B (zh) |
| WO (1) | WO2021208986A1 (zh) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114500950A (zh) * | 2022-01-26 | 2022-05-13 | 中煤科工集团重庆智慧城市科技研究院有限公司 | 基于智慧城市的箱体异常状态检测系统及方法 |
| CN115578630A (zh) * | 2022-11-09 | 2023-01-06 | 广东科凯达智能机器人有限公司 | 一种判断空气开关工作档位的方法及系统 |
| CN117037340A (zh) * | 2023-09-06 | 2023-11-10 | 东莞市安邦德智能锁具科技有限公司 | 一种基于数据识别的智能锁控制系统 |
| CN118314528A (zh) * | 2024-06-07 | 2024-07-09 | 深圳金三立视频科技股份有限公司 | 一种基于视觉识别的配电房线状开关状态自动检测方法 |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112329504B (zh) * | 2020-04-15 | 2024-08-23 | 深圳Tcl新技术有限公司 | 门开关状态监测方法、装置、设备及计算机可读存储介质 |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101540892A (zh) * | 2009-04-23 | 2009-09-23 | 上海中安电子信息科技有限公司 | 一种基于dsp视频采集设备的统计进出口人数的方法 |
| CN102747891A (zh) * | 2012-07-13 | 2012-10-24 | 深圳市悦德智能科技有限公司 | 一种智能锁 |
| CN102747919A (zh) * | 2012-06-18 | 2012-10-24 | 浙江工业大学 | 基于全方位计算机视觉的人行自动门安全和节能控制装置 |
| CN105245839A (zh) * | 2015-09-30 | 2016-01-13 | 万科思自控信息（中国）有限公司 | 一种门口机的自动开启显示方法 |
| CN110477927A (zh) * | 2019-09-18 | 2019-11-22 | 歌尔科技有限公司 | 一种主动眨眼检测方法、装置、设备及可读存储介质 |
| US20190359451A1 (en) * | 2018-05-23 | 2019-11-28 | Otis Elevator Company | Elevator door monitoring system, elevator system and elevator door monitoring method |
| CN112329504A (zh) * | 2020-04-15 | 2021-02-05 | 深圳Tcl新技术有限公司 | 门开关状态监测方法、装置、设备及计算机可读存储介质 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202042025U (zh) * | 2011-05-09 | 2011-11-16 | 航天科工深圳（集团）有限公司 | 一种监测终端 |
| CN105160743A (zh) * | 2015-09-29 | 2015-12-16 | 吴希文 | 门禁系统和门禁监控方法 |
| WO2018007468A1 (de) * | 2016-07-06 | 2018-01-11 | Gerd Reime | Vorrichtung und verfahren zur objektbeobachtung |
| CN108983620B (zh) * | 2018-06-22 | 2021-10-22 | 联想(北京)有限公司 | 一种控制方法、装置及电子设备 |
| CN109544535B (zh) * | 2018-11-26 | 2022-06-24 | 马杰 | 一种基于红外截止滤镜光学滤波特性的窥视摄像头检测方法及系统 |
| CN110415431A (zh) * | 2019-07-16 | 2019-11-05 | 合肥美的智能科技有限公司 | 货柜控制方法、货柜控制装置以及货柜 |
-
2020
- 2020-04-15 CN CN202010297734.6A patent/CN112329504B/zh active Active
-
2021
- 2021-04-14 WO PCT/CN2021/087315 patent/WO2021208986A1/zh active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101540892A (zh) * | 2009-04-23 | 2009-09-23 | 上海中安电子信息科技有限公司 | 一种基于dsp视频采集设备的统计进出口人数的方法 |
| CN102747919A (zh) * | 2012-06-18 | 2012-10-24 | 浙江工业大学 | 基于全方位计算机视觉的人行自动门安全和节能控制装置 |
| CN102747891A (zh) * | 2012-07-13 | 2012-10-24 | 深圳市悦德智能科技有限公司 | 一种智能锁 |
| CN105245839A (zh) * | 2015-09-30 | 2016-01-13 | 万科思自控信息（中国）有限公司 | 一种门口机的自动开启显示方法 |
| US20190359451A1 (en) * | 2018-05-23 | 2019-11-28 | Otis Elevator Company | Elevator door monitoring system, elevator system and elevator door monitoring method |
| CN110477927A (zh) * | 2019-09-18 | 2019-11-22 | 歌尔科技有限公司 | 一种主动眨眼检测方法、装置、设备及可读存储介质 |
| CN112329504A (zh) * | 2020-04-15 | 2021-02-05 | 深圳Tcl新技术有限公司 | 门开关状态监测方法、装置、设备及计算机可读存储介质 |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114500950A (zh) * | 2022-01-26 | 2022-05-13 | 中煤科工集团重庆智慧城市科技研究院有限公司 | 基于智慧城市的箱体异常状态检测系统及方法 |
| CN115578630A (zh) * | 2022-11-09 | 2023-01-06 | 广东科凯达智能机器人有限公司 | 一种判断空气开关工作档位的方法及系统 |
| CN117037340A (zh) * | 2023-09-06 | 2023-11-10 | 东莞市安邦德智能锁具科技有限公司 | 一种基于数据识别的智能锁控制系统 |
| CN117037340B (zh) * | 2023-09-06 | 2024-04-12 | 东莞市安邦德智能锁具科技有限公司 | 一种基于数据识别的智能锁控制系统 |
| CN118314528A (zh) * | 2024-06-07 | 2024-07-09 | 深圳金三立视频科技股份有限公司 | 一种基于视觉识别的配电房线状开关状态自动检测方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112329504A (zh) | 2021-02-05 |
| CN112329504B (zh) | 2024-08-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021208986A1 (zh) | 门开关状态监测方法、装置、设备及计算机可读存储介质 | |
| CN107992794B (zh) | 一种活体检测方法、装置和存储介质 | |
| US11657605B2 (en) | User interfaces to configure a thermal imaging system | |
| WO2021017561A1 (zh) | 人脸识别方法及装置、电子设备和存储介质 | |
| KR101710200B1 (ko) | 얼굴 인식을 사용한 자동 출석관리 시스템 및 방법 | |
| WO2019227774A1 (zh) | 车辆及车门解锁控制方法、装置和车门解锁系统 | |
| KR101730255B1 (ko) | 얼굴 인식 디지털 도어록 | |
| WO2017181769A1 (zh) | 一种人脸识别方法、装置和系统、设备、存储介质 | |
| KR101682311B1 (ko) | 얼굴 인식 디지털 도어록 | |
| WO2017166469A1 (zh) | 一种基于智能电视机的安防方法、装置 | |
| US11538276B2 (en) | Communication system, distributed processing system, distributed processing method, and recording medium | |
| EP3383030B1 (en) | Osd information generation camera, osd information synthesis terminal (20), and osd information sharing system comprising same | |
| JP2006259931A (ja) | 顔認証装置およびその制御方法、顔認証装置を備えた電子機器、顔認証装置制御プログラム、ならびに該プログラムを記録した記録媒体 | |
| CN107038776A (zh) | 一种门禁系统及门禁控制方法 | |
| US11245707B2 (en) | Communication terminal, communication system, communication control method, and recording medium | |
| CN112783461A (zh) | 投屏方法、装置、电子设备及存储介质 | |
| KR101550206B1 (ko) | 이중보안기능이 구비된 지정맥인식시스템 및 그 제어방법 | |
| WO2019062347A1 (zh) | 人脸识别方法及相关产品 | |
| US20210176426A1 (en) | Secure video visitation system | |
| CN112949467B (zh) | 人脸检测方法、装置、电子设备和存储介质 | |
| CN213904428U (zh) | 一种门禁机和考勤门禁系统 | |
| CN113822216A (zh) | 事件检测方法及装置、系统、电子设备和存储介质 | |
| GB2499449A (en) | Surveillance by face recognition using colour display of images | |
| CN112153300A (zh) | 多目摄像头曝光方法、装置、设备及介质 | |
| US20230135997A1 (en) | Ai monitoring and processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21789221 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 21789221 Country of ref document: EP Kind code of ref document: A1 |