CN110769246B - Method and device for detecting faults of monitoring equipment - Google Patents
Method and device for detecting faults of monitoring equipment Download PDFInfo
- Publication number
- CN110769246B CN110769246B CN201910841584.8A CN201910841584A CN110769246B CN 110769246 B CN110769246 B CN 110769246B CN 201910841584 A CN201910841584 A CN 201910841584A CN 110769246 B CN110769246 B CN 110769246B
- Authority
- CN
- China
- Prior art keywords
- monitoring device
- background image
- monitoring
- scene
- fault type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
本申请提供一种检测监控设备故障的方法、装置,该方法包括:获取监控拍摄的前后两张图像中的背景图像,比较二个背景图像的相似度。当相似度达到阈值,说明监控场景发生了变更,从而可以确认监控设备发送了故障,对监控设备进行自动修复。
The present application provides a method and a device for detecting a fault of monitoring equipment. The method includes: acquiring background images in two images taken before and after monitoring, and comparing the similarity of the two background images. When the similarity reaches the threshold, it indicates that the monitoring scene has changed, so that it can be confirmed that the monitoring equipment has sent a fault, and the monitoring equipment can be automatically repaired.
Description
技术领域technical field
本申请涉及监控领域,尤其涉及一种检测监控设备故障的方法、装置。The present application relates to the field of monitoring, and in particular to a method and device for detecting failures of monitoring equipment.
背景技术Background technique
目前,监控设备的维护主要依赖于人力定期维护,即每隔一段时间,安排技术人员查看监控设备是否故障以及对故障进行处理。一方面,需要耗费较高的人力成本,另一方面,维护效率较低,很难在监控设备故障时及时发现故障和解决故障。At present, the maintenance of monitoring equipment mainly depends on the regular maintenance of manpower, that is, every once in a while, arrange technicians to check whether the monitoring equipment is faulty and deal with the fault. On the one hand, it requires high labor costs. On the other hand, the maintenance efficiency is low, and it is difficult to detect and solve the fault in time when the monitoring equipment fails.
发明内容Contents of the invention
本发明实施例提供一种检测监控设备故障的方法、装置,用于解决现有技术中监控设备故障检测效率低、成本高的技术问题。Embodiments of the present invention provide a method and a device for detecting a fault of monitoring equipment, which are used to solve the technical problems of low detection efficiency and high cost of fault detection of monitoring equipment in the prior art.
第一方面,提供一种检测监控设备故障的方法,包括:获取第一背景图像和第二背景图像;其中,所述第一背景图像为第一监控设备当前监控场景中的背景图像,所述第二背景图像为预先存储的所述第一监控设备历史监控场景中的背景图像;计算所述第一背景图像和所述第二背景图像的相似度,根据相似度计算结果判断所述第一监控设备的监控场景是否发生变更;当所述第一监控设备的监控场景发生变更时,确定所述第一监控设备故障。In a first aspect, a method for detecting a monitoring device failure is provided, including: acquiring a first background image and a second background image; wherein, the first background image is a background image in the current monitoring scene of the first monitoring device, and the The second background image is the background image in the historical monitoring scene of the first monitoring device stored in advance; the similarity between the first background image and the second background image is calculated, and the first background image is judged according to the similarity calculation result. Whether the monitoring scene of the monitoring device is changed; when the monitoring scene of the first monitoring device is changed, it is determined that the first monitoring device is faulty.
本发明实施例中,通过比较第一监控设备当前监控场景中的背景图像(即第一背景图像)和历史监控场景中的背景图像(即第二背景图像)来判断第一监控设备监控场景是否发生变更,在发现第一监控设备的监控场景发生变更时,确定第一监控设备发生故障,该方案不需要技术人员到现场检查就能及时发现监控设备故障,可以提高监控设备故障检测的及时性。In the embodiment of the present invention, it is judged whether the monitoring scene of the first monitoring device is If there is a change, when the monitoring scene of the first monitoring device is found to be changed, it is determined that the first monitoring device is faulty. This solution does not require technicians to go to the site for inspection and can detect the fault of the monitoring device in time, which can improve the timeliness of fault detection of the monitoring device .
在一种可能的设计中,所述第一背景图像和所述第二背景图像拍摄有相同物体,或者所述第一背景图像和所述第二背景图像拍摄有相同物体的一部分。这样,可以保证当前监控场景和历史监控场景处于同一地点,提高监控设备故障检测的准确性。In a possible design, the first background image and the second background image capture the same object, or the first background image and the second background image capture a part of the same object. In this way, it can be ensured that the current monitoring scene and the historical monitoring scene are in the same place, and the accuracy of fault detection of the monitoring equipment can be improved.
在一种可能的设计中,在确定所述第一监控设备故障之后,还可以基于所述第一背景图像,确定所述第一监控设备的故障类型。进一步的,当所述第一监控设备的故障类型为不需要人工修复的故障类型时,所述第一监控设备进行自动修复。当所述第一监控设备的故障类型为需要人工修复的故障类型时,发送故障通知。In a possible design, after determining that the first monitoring device is faulty, the fault type of the first monitoring device may also be determined based on the first background image. Further, when the fault type of the first monitoring device is a fault type that does not require manual repair, the first monitoring device performs automatic repair. When the fault type of the first monitoring device is a fault type requiring manual repair, a fault notification is sent.
通过本实施方式,可以确定所述第一监控设备的故障类型,在第一监控设备的故障类型为不需要人工修复的故障类型,对第一监控设备进行自动修复,以提高故障处理效率;早第一监控设备的故障类型为需要人工修复的故障类型时,发送故障通知,以使技术人员及时赶到现场进行故障。Through this embodiment, it is possible to determine the fault type of the first monitoring device. When the fault type of the first monitoring device is a fault type that does not require manual repair, the first monitoring device is automatically repaired to improve the fault handling efficiency; When the fault type of the first monitoring device is a fault type requiring manual repair, a fault notification is sent, so that technicians can rush to the site in time to troubleshoot the fault.
以下例举两种可能的不需要人工修复的故障类型。The following are examples of two possible types of faults that do not require manual repair.
第一种示例、从所述第二背景图像中提取第一特征点,并定义所述第一特征点为基准点;确定所述第一背景图像中和所述基准点相匹配的第二特征点;计算所述第二特征点相对于所述基准点的位置偏移量;根据所述位置偏移量判断所述第一监控设备的拍摄视角是否异常;在所述第一监控设备的拍摄视角异常时,确定所述第一监控设备的故障类型为不需要人工修复的故障类型。相应的,对所述第一监控设备进行自动修复,可以是:根据所述位置偏移量计算所述第一监控设备的视角偏移量,根据所述视角偏移量调整所述第一监控设备的镜头参数和/或云台参数。The first example, extracting the first feature point from the second background image, and defining the first feature point as a reference point; determining the second feature in the first background image that matches the reference point point; calculate the position offset of the second feature point relative to the reference point; judge whether the shooting angle of view of the first monitoring device is abnormal according to the position offset; When the viewing angle is abnormal, it is determined that the fault type of the first monitoring device is a fault type that does not require manual repair. Correspondingly, the automatic restoration of the first monitoring device may be: calculating the viewing angle offset of the first monitoring device according to the position offset, and adjusting the first monitoring device according to the viewing angle offset. Lens parameters and/or gimbal parameters of the device.
本实施方式通过比较第一背景图像和第二背景图像,可以及时检测并处理第一监控设备的镜头参数和/或云台参数异常,可以提高监控设备的故障检测和维护效率。In this embodiment, by comparing the first background image and the second background image, abnormalities of the lens parameters and/or pan/tilt parameters of the first monitoring device can be detected and processed in time, and the fault detection and maintenance efficiency of the monitoring device can be improved.
第二种示例、根据所述第一背景图像确定所述第一监控设备当前监控场景中的监控参数;确定所述第一监控设备当前拍摄参数是否和所述第一监控设备当前监控场景中的监控参数相匹配;在所述第一监控设备当前拍摄参数和所述第一监控设备当前监控场景中的监控参数不匹配时,确定所述第一监控设备的拍摄参数异常,并确定所述第一监控设备的故障类型为不需要人工修复的故障类型。相应的,对所述第一监控设备进行自动修复,可以是:确定和所述监控参数相匹配的拍摄参数,并将所述第一监控设备的拍摄参数调整为和所述监控参数相匹配的拍摄参数;或者,重启所述第一监控设备的应用进程;或者,重启所述第一监控设备的系统。可选的,为了提高方案的灵活性,该拍摄参数可以是亮度、色度、饱和度、对比度、锐度、日夜模式转换、曝光、聚焦、背光、白平衡、图像增强、补光灯灯光控制等,这里不做限制。The second example is to determine the monitoring parameters in the current monitoring scene of the first monitoring device according to the first background image; determine whether the current shooting parameters of the first monitoring device are the same as those in the current monitoring scene of the first monitoring device The monitoring parameters match; when the current shooting parameters of the first monitoring device do not match the monitoring parameters in the current monitoring scene of the first monitoring device, determine that the shooting parameters of the first monitoring device are abnormal, and determine that the first monitoring device A failure type of the monitoring equipment is a failure type that does not require manual repair. Correspondingly, the automatic restoration of the first monitoring device may be: determining the shooting parameters that match the monitoring parameters, and adjusting the shooting parameters of the first monitoring device to match the monitoring parameters. shooting parameters; or, restarting the application process of the first monitoring device; or restarting the system of the first monitoring device. Optionally, in order to improve the flexibility of the solution, the shooting parameters can be brightness, hue, saturation, contrast, sharpness, day and night mode conversion, exposure, focus, backlight, white balance, image enhancement, fill light light control Wait, no limit here.
本实施方式可以基于第一背景图像确定第一监控设备当前监控场景中的监控参数,在确定第一监控设备当前拍摄参数和第一监控设备当前监控场景中的监控参数不匹配时,自动将拍摄参数调整为和当前监控参数相匹配的拍摄参数,可以及时检测并处理第一监控设备的拍摄参数异常,可以提高监控设备的故障检测和维护效率。In this embodiment, the monitoring parameters in the current monitoring scene of the first monitoring device can be determined based on the first background image, and when it is determined that the current shooting parameters of the first monitoring device do not match the monitoring parameters in the current monitoring scene of the first monitoring device, the shooting The parameters are adjusted to the shooting parameters that match the current monitoring parameters, which can detect and deal with the abnormality of the shooting parameters of the first monitoring device in time, and can improve the fault detection and maintenance efficiency of the monitoring device.
在一种可能的设计中,在对所述第一监控设备进行自动修复之后,还可以获取第三背景图像;其中,所述第三背景图像为所述第一监控设备进行自动修复之后所拍摄的监控场景的背景图像;计算所述第三背景图像和所述第二背景图像的相似度,根据所述第三背景图像和所述第二背景图像的相似度确定所述第一监控设备的故障是否修复成功;如果所述第一监控设备的故障未修复成功,则发送故障通知。In a possible design, after the first monitoring device is automatically repaired, a third background image may also be obtained; wherein, the third background image is taken after the first monitoring device is automatically repaired The background image of the monitoring scene; calculate the similarity between the third background image and the second background image, and determine the first monitoring device according to the similarity between the third background image and the second background image Whether the fault is successfully repaired; if the fault of the first monitoring device is not repaired successfully, a fault notification is sent.
本实施方式可以检测第一监控设备自动修复是否成功,以及在第一监控设备自动修复失败后,及时提醒技术人员到现场进行维护,进一步提高了监控设备故障维护的可靠性和及时性。This embodiment can detect whether the automatic repair of the first monitoring device is successful, and promptly remind technicians to go to the site for maintenance after the automatic repair of the first monitoring device fails, further improving the reliability and timeliness of fault maintenance of the monitoring device.
以下例举三种可能的需要人工修复的故障类型。The following are examples of three possible fault types that require manual repair.
第一种示例,检测所述第一背景图像中是否存在裂纹;在所述第一背景图像中存在裂纹时,确定所述第一监控设备的镜头玻璃破损或脏污,并确定所述第一监控设备的故障类型为需要人工修复的故障类型。相应的,发送故障通知则是可以是:向所述第一监控设备联动的终端设备发送所述第一监控设备的镜头玻璃破损或脏污的通知信息。The first example is to detect whether there is a crack in the first background image; when there is a crack in the first background image, determine that the lens glass of the first monitoring device is broken or dirty, and determine that the first The fault type of the monitoring equipment is a fault type requiring manual repair. Correspondingly, sending the fault notification may be: sending notification information that the lens glass of the first monitoring device is broken or dirty to the terminal device associated with the first monitoring device.
本实施方式可以基于第一背景图像或者和第一背景图像确定镜头玻璃是否存在破损、划痕或者脏污的异常,并在镜头玻璃有破损、划痕或者脏污等异常时,及时发起故障通知,以使技术人员能够及时获知并赶到现场更换或者修复第一监控设备的镜头玻璃,提高了监控设备的故障检测和维护效率。This embodiment can determine whether the lens glass is damaged, scratched or dirty based on the first background image or the first background image, and initiate a fault notification in time when the lens glass is damaged, scratched or dirty. , so that technicians can know in time and rush to the scene to replace or repair the lens glass of the first monitoring equipment, which improves the efficiency of fault detection and maintenance of the monitoring equipment.
第二种示例、在所述第一背景图像中存在雾气特征、且将所述第一监控设备的拍摄参数调整为和雾天相匹配的拍摄参数也未能消除所述雾气特征时,确定所述第一监控设备的镜头进水,并确定所述第一监控设备的故障类型为需要人工修复的故障类型。相应的,发送故障通知则是可以是:向所述第一监控设备联动的终端设备发送所述第一监控设备的镜头进水的通知信息。In the second example, when there is a fog feature in the first background image, and the shooting parameters of the first monitoring device are adjusted to match the shooting parameters of the fog, the fog feature cannot be eliminated, and the fog feature is determined. The lens of the first monitoring device is flooded, and it is determined that the fault type of the first monitoring device is a fault type requiring manual repair. Correspondingly, sending the failure notification may be: sending notification information that the lens of the first monitoring device is flooded to the terminal device associated with the first monitoring device.
本实施方式可以基于第一背景图像确定镜头玻璃是否存在起雾的异常,并在镜头有起雾异常时,发起故障通知,以使技术人员能够及时获知并赶到现场解决第一监控设备的镜头中的进雾异常,提高了监控设备的故障检测和维护效率。In this embodiment, based on the first background image, it can be determined whether the lens glass is abnormally fogged, and when the lens is abnormally fogged, a fault notification is initiated, so that technicians can know in time and rush to the scene to solve the problem of the lens of the first monitoring device. The abnormal fog entering in the monitoring device improves the fault detection and maintenance efficiency of the monitoring equipment.
第三种示例、根据所述第一背景图像确定所述第一监控设备当前监控场景中的环境设施状况,以及根据所述第二背景图像确定所述第一监控设备历史监控场景中的环境设施状况;在所述第一监控设备当前监控场景中的环境设施状况和历史监控场景中的环境设施状况不同时,确定所述第一监控设备的监控场景中的环境设施变更,并确定所述第一监控设备的故障类型为需要人工修复的故障类型。相应的,发送故障通知则是可以是:向所述第一监控设备联动的终端设备发送场景重置的通知信息,以提醒技术人员对所述第一监控设备进行场景重置操作。The third example is to determine the environmental facilities in the current monitoring scene of the first monitoring device according to the first background image, and determine the environmental facilities in the historical monitoring scene of the first monitoring device according to the second background image Status; when the environmental facility status in the current monitoring scene of the first monitoring device is different from the environmental facility status in the historical monitoring scene, determine the change of the environmental facility in the monitoring scene of the first monitoring device, and determine the first monitoring device A fault type of the monitoring equipment is a fault type requiring manual repair. Correspondingly, sending the fault notification may be: sending notification information of scene reset to the terminal device associated with the first monitoring device, so as to remind technicians to perform a scene reset operation on the first monitoring device.
本实施方式考虑到了实际场景中会存在环境设施的变更的情况,用以供用户决策是否重置背景场景,以保证第二背景图像及时、准确更新,进一步提高监控设备的故障检测和维护的可靠性和及时性。This implementation mode takes into account the fact that there may be changes in environmental facilities in the actual scene, and is used for users to decide whether to reset the background scene, so as to ensure that the second background image is updated in time and accurately, and further improve the reliability of fault detection and maintenance of monitoring equipment and timeliness.
在一种可能的设计中,在基于所述第一背景图像,确定所述第一监控设备的故障类型之前,还可以获取第四背景图像;其中,所述第四背景图像为第二监控设备当前监控场景中的背景图像,所述第二监控设备当前监控场景和所述第一监控设备当前监控场景至少部分重合。在确定所述第一监控设备的故障类型时,具体可以是根据所述第一背景图像和所述第四背景图像确定所述第一监控设备的故障类型。In a possible design, before determining the fault type of the first monitoring device based on the first background image, a fourth background image may also be acquired; wherein, the fourth background image is the second monitoring device As for the background image in the current monitoring scene, the current monitoring scene of the second monitoring device and the current monitoring scene of the first monitoring device are at least partially overlapped. When determining the fault type of the first monitoring device, specifically, the fault type of the first monitoring device may be determined according to the first background image and the fourth background image.
本实施方式通过结合第二监控设备采集的背景图像分析判断第一监控设备故障的类型,可以进一步提高监控设备故障检测的准确性。In this embodiment, the accuracy of fault detection of the monitoring device can be further improved by analyzing and judging the type of the fault of the first monitoring device in combination with the background image collected by the second monitoring device.
第二方面,提供一种检测监控设备故障的装置,包括:获取模块,用于获取第一背景图像和第二背景图像;其中,所述第一背景图像为所述装置当前监控场景中的背景图像,所述第二背景图像为预先存储的所述装置历史监控场景中的背景图像;计算模块,用于计算所述第一背景图像和所述第二背景图像的相似度,根据相似度计算结果判断所述装置的监控场景是否发生变更;确定模块,用于当所述装置的监控场景发生变更时,确定所述装置故障。In a second aspect, there is provided a device for detecting a monitoring device failure, including: an acquisition module, configured to acquire a first background image and a second background image; wherein, the first background image is the background in the current monitoring scene of the device Image, the second background image is the background image in the pre-stored historical monitoring scene of the device; the calculation module is used to calculate the similarity between the first background image and the second background image, and calculate according to the similarity As a result, it is judged whether the monitoring scene of the device is changed; the determining module is configured to determine that the device is faulty when the monitoring scene of the device is changed.
在一种可能的设计中,所述第一背景图像和所述第二背景图像拍摄有相同物体,或者所述第一背景图像和所述第二背景图像拍摄有相同物体的一部分。In a possible design, the first background image and the second background image capture the same object, or the first background image and the second background image capture a part of the same object.
在一种可能的设计中,所述确定模块还用于:在确定所述装置故障之后,基于所述第一背景图像,确定所述装置的故障类型;所述装置还包括修复模块,用于当所述装置的故障类型为不需要人工修复的故障类型时,对所述装置的故障进行自动修复。In a possible design, the determining module is further configured to: determine the fault type of the device based on the first background image after determining the fault of the device; the device further includes a repair module configured to When the fault type of the device is a fault type that does not require manual repair, the fault of the device is automatically repaired.
在一种可能的设计中,所述装置还包括:发送模块,用于当所述装置的故障类型为需要人工修复的故障类型时,发送故障通知。In a possible design, the device further includes: a sending module, configured to send a fault notification when the fault type of the device is a fault type requiring manual repair.
在一种可能的设计中,所述确定模块在基于所述第一背景图像,确定所述装置的故障类型时,具体用于:从所述第二背景图像中提取第一特征点,并定义所述第一特征点为基准点;确定所述第一背景图像中和所述基准点相匹配的第二特征点;计算所述第二特征点相对于所述基准点的位置偏移量;根据所述位置偏移量判断所述装置的拍摄视角是否异常;在所述装置的拍摄视角异常时,确定所述装置的故障类型为不需要人工修复的故障类型;所述修复模块具体用于:根据所述位置偏移量计算所述装置的视角偏移量,根据所述视角偏移量调整所述装置的镜头参数和/或云台参数。In a possible design, when the determination module determines the fault type of the device based on the first background image, it is specifically configured to: extract the first feature point from the second background image, and define The first feature point is a reference point; determining a second feature point in the first background image that matches the reference point; calculating a position offset of the second feature point relative to the reference point; According to the position offset, it is judged whether the shooting angle of view of the device is abnormal; when the shooting angle of view of the device is abnormal, it is determined that the fault type of the device is a fault type that does not require manual repair; the repair module is specifically used to : Calculate the angle of view offset of the device according to the position offset, and adjust the lens parameters and/or pan/tilt parameters of the device according to the angle of view offset.
在一种可能的设计中,所述确定模块在基于所述第一背景图像,确定所述装置的故障类型时,具体用于:根据所述第一背景图像确定所述装置当前监控场景中的监控参数;确定所述装置当前拍摄参数是否和所述装置当前监控场景中的监控参数相匹配;在所述装置当前拍摄参数和所述装置当前监控场景中的监控参数不匹配时,确定所述装置的拍摄参数异常,并确定所述装置的故障类型为不需要人工修复的故障类型;所述修复模块具体用于:确定和所述监控参数相匹配的拍摄参数,并将所述装置的拍摄参数调整为和所述监控参数相匹配的拍摄参数;或者,重启所述装置的应用进程;或者,重启所述装置的系统。In a possible design, when the determination module determines the fault type of the device based on the first background image, it is specifically configured to: determine the fault type of the device in the current monitoring scene according to the first background image monitoring parameters; determine whether the current shooting parameters of the device match the monitoring parameters in the current monitoring scene of the device; when the current shooting parameters of the device do not match the monitoring parameters in the current monitoring scene of the device, determine the The shooting parameters of the device are abnormal, and it is determined that the fault type of the device is a fault type that does not require manual repair; the repair module is specifically used to: determine the shooting parameters that match the monitoring parameters, and set the shooting Adjusting the parameters to shooting parameters that match the monitoring parameters; or restarting the application process of the device; or restarting the system of the device.
在一种可能的设计中,所述拍摄参数包括亮度、色度、饱和度、对比度、锐度、日夜模式转换、曝光、聚焦、背光、白平衡、图像增强、补光灯灯光控制中的至少一种。In a possible design, the shooting parameters include at least one of brightness, hue, saturation, contrast, sharpness, day-night mode conversion, exposure, focus, backlight, white balance, image enhancement, and fill light control. A sort of.
在一种可能的设计中,所述获取模块还用于:在对所述装置进行自动修复之后,获取第三背景图像;其中,所述第三背景图像为所述装置进行自动修复之后所拍摄的监控场景的背景图像;所述计算模块还用于:计算所述第三背景图像和所述第二背景图像的相似度,根据所述第三背景图像和所述第二背景图像的相似度确定所述装置的故障是否修复成功;所述装置还包括发送模块,用于如果所述装置的故障未修复成功,则发送故障通知。In a possible design, the acquiring module is further configured to: acquire a third background image after the device is automatically repaired; wherein, the third background image is taken after the device is automatically repaired The background image of the monitoring scene; the calculation module is also used to: calculate the similarity between the third background image and the second background image, according to the similarity between the third background image and the second background image Determine whether the fault of the device is successfully repaired; the device further includes a sending module, configured to send a fault notification if the fault of the device is not repaired successfully.
在一种可能的设计中,所述确定模块在基于所述第一背景图像,确定所述装置的故障类型时,具体用于:检测所述第一背景图像中是否存在裂纹;在所述第一背景图像中存在裂纹时,确定所述装置的镜头玻璃破损或脏污,并确定所述装置的故障类型为需要人工修复的故障类型;所述发送模块具体用于:向所述装置联动的终端设备发送所述装置的镜头玻璃破损或脏污的通知信息;或者In a possible design, when the determination module determines the fault type of the device based on the first background image, it is specifically configured to: detect whether there is a crack in the first background image; When there is a crack in the background image, it is determined that the lens glass of the device is damaged or dirty, and the fault type of the device is determined to be a fault type that requires manual repair; the sending module is specifically used to: link to the device The terminal device sends a notification message that the lens glass of the device is broken or dirty; or
所述确定模块在基于所述第一背景图像,确定所述装置的故障类型时,具体用于:在所述第一背景图像中存在雾气特征、且将所述装置的拍摄参数调整为和雾天相匹配的拍摄参数也未能消除所述雾气特征时,确定所述装置的镜头进水,并确定所述装置的故障类型为需要人工修复的故障类型;所述发送模块具体用于:向所述装置联动的终端设备发送所述装置的镜头进水的通知信息;或者When the determination module determines the fault type of the device based on the first background image, it is specifically configured to: there is a fog feature in the first background image, and adjust the shooting parameters of the device to be compatible with the fog When the shooting parameters matched with the sky cannot eliminate the fog feature, it is determined that the lens of the device is flooded, and the fault type of the device is determined to be a fault type that requires manual repair; the sending module is specifically used to: The terminal device associated with the device sends a notification message that the lens of the device has been flooded; or
所述确定模块在基于所述第一背景图像,确定所述装置的故障类型时,具体用于:根据所述第一背景图像确定所述装置当前监控场景中的环境设施状况,以及根据所述第二背景图像确定所述装置历史监控场景中的环境设施状况;在所述装置当前监控场景中的环境设施状况和历史监控场景中的环境设施状况不同时,确定所述装置的监控场景中的环境设施变更,并确定所述装置的故障类型为需要人工修复的故障类型;所述发送模块具体用于:向所述装置联动的终端设备发送场景重置的通知信息,以提醒技术人员对所述装置进行场景重置操作。When the determination module determines the fault type of the device based on the first background image, it is specifically used to: determine the environmental facility status in the current monitoring scene of the device according to the first background image, and The second background image determines the environmental facility status in the historical monitoring scene of the device; when the environmental facility status in the current monitoring scene of the device is different from the environmental facility status in the historical monitoring scene, determine the environmental facility status in the monitoring scene of the device The environmental facilities are changed, and it is determined that the fault type of the device is a fault type that requires manual repair; the sending module is specifically used to: send a scene reset notification message to the terminal device linked to the device to remind technicians The above device performs scene reset operation.
在一种可能的设计中,所述获取模块还用于:在所述确定模块基于所述第一背景图像,确定所述装置的故障类型之前,获取第四背景图像;其中,所述第四背景图像为第二监控设备当前监控场景中的背景图像,所述第二监控设备当前监控场景和所述装置当前监控场景至少部分重合;所述确定模块在基于所述第一背景图像,确定所述装置的故障类型时,用于:根据所述第一背景图像和所述第四背景图像确定所述装置的故障类型。In a possible design, the obtaining module is further configured to: before the determining module determines the fault type of the device based on the first background image, obtain a fourth background image; wherein, the fourth The background image is the background image in the current monitoring scene of the second monitoring device, and the current monitoring scene of the second monitoring device and the current monitoring scene of the device at least partially overlap; When the fault type of the device is used, it is used to: determine the fault type of the device according to the first background image and the fourth background image.
第三方面,提供一种检测监控设备故障的装置,包括至少一个处理器,所述至少一个处理器与至少一个存储器耦合;所述至少一个处理器,用于执行所述至少一个存储器中存储的计算机程序或指令,以使得所述装置执行如本发明实施例第一方面或第一方面任一种可能的设计中所述的方法。In a third aspect, there is provided a device for detecting a failure of monitoring equipment, including at least one processor, and the at least one processor is coupled to at least one memory; the at least one processor is configured to execute the A computer program or instruction, so that the device executes the method described in the first aspect of the embodiment of the present invention or any possible design of the first aspect.
第四方面,提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序或指令,当计算机读取并执行所述计算机程序或指令时,使得计算机执行如本发明实施例第一方面或第一方面任一种可能的设计中所述的方法。In a fourth aspect, a computer-readable storage medium is provided, where a computer program or an instruction is stored in the computer-readable storage medium, and when the computer reads and executes the computer program or instruction, the computer executes the computer program as described in the embodiment of the present invention. The method described in the first aspect or any possible design of the first aspect.
第五方面,提供一种芯片系统,该芯片系统中包括处理器,还可以包括存储器,用于实现本发明实施例第一方面或第一方面任一种可能的设计中所述的方法中所涉及的功能。该芯片系统可以由芯片构成,也可以包含芯片和其他分立器件。A fifth aspect provides a chip system, the chip system includes a processor, and may also include a memory for implementing the method described in the first aspect of the embodiment of the present invention or any possible design of the first aspect the functions involved. The system-on-a-chip may consist of chips, or may include chips and other discrete devices.
附图说明Description of drawings
图1为本发明实施例中几种监控设备的示例图;Fig. 1 is the example figure of several monitoring equipments in the embodiment of the present invention;
图2A为本发明实施例中一种监控设备的结构示意图;2A is a schematic structural diagram of a monitoring device in an embodiment of the present invention;
图2B为本发明实施例中另一种监控设备的结构示意图;FIG. 2B is a schematic structural diagram of another monitoring device in an embodiment of the present invention;
图2C为本发明实施例中另一种监控设备的结构示意图;FIG. 2C is a schematic structural diagram of another monitoring device in an embodiment of the present invention;
图3为本发明实施例中检测监控设备故障的方法的流程图;Fig. 3 is the flow chart of the method for detecting and monitoring equipment failure in the embodiment of the present invention;
图4A为本发明实施例中第一背景图像的示意图;FIG. 4A is a schematic diagram of a first background image in an embodiment of the present invention;
图4B为本发明实施例中第二背景图像的示意图;FIG. 4B is a schematic diagram of a second background image in an embodiment of the present invention;
图4C为本发明实施例中第二背景图像的示意图;FIG. 4C is a schematic diagram of a second background image in an embodiment of the present invention;
图5A为本发明实施例中第二背景图像的示意图;FIG. 5A is a schematic diagram of a second background image in an embodiment of the present invention;
图5B为本发明实施例中第一背景图像的示意图;FIG. 5B is a schematic diagram of a first background image in an embodiment of the present invention;
图5C为本发明实施例中第四背景图像的示意图;FIG. 5C is a schematic diagram of a fourth background image in an embodiment of the present invention;
图6为本发明实施例中一种检测监控设备故障的装置的结构示意图;FIG. 6 is a schematic structural diagram of a device for detecting and monitoring equipment faults in an embodiment of the present invention;
图7为本发明实施例中另一种检测监控设备故障的装置的结构示意图。FIG. 7 is a schematic structural diagram of another device for detecting a monitoring device failure in an embodiment of the present invention.
具体实施方式Detailed ways
在视频监控领域,监控设备(例如图1所示的几款摄像机),常常被应用于室外场景或大型公共的室内场景,可用于实现交通事件检测、行人检测、车牌抓拍、交通路口违章抓拍、车站监控等。在这些场景中,监控设备安装位置较高,长时间使用后,可能由于自然、人为或老化等原因,致使监控设备的监控角度出现偏移、旋转、甚至无画面等问题。现有监控设备的维护一般依靠技术人员人工定期到现场进行检测和维护,而技术人员无法在监控设备故障的第一时间感知设备异常,因此维护效率很低,另外也会耗费较高的人力成本。In the field of video surveillance, surveillance equipment (such as several cameras shown in Figure 1) is often used in outdoor scenes or large public indoor scenes, and can be used to realize traffic incident detection, pedestrian detection, license plate capture, traffic intersection violation capture, Station monitoring, etc. In these scenarios, the monitoring equipment is installed at a relatively high position. After long-term use, the monitoring angle of the monitoring equipment may be shifted, rotated, or even have no picture due to natural, man-made, or aging reasons. The maintenance of existing monitoring equipment generally relies on technicians to go to the site for inspection and maintenance on a regular basis, and technicians cannot perceive the abnormality of the monitoring equipment at the first time when the monitoring equipment fails, so the maintenance efficiency is very low, and it will also consume high labor costs. .
鉴于此,本发明实施例提供一种检测监控设备故障的方法,该方法通过比较所述监控设备当前监控场景中的背景图像和所述监控设备历史监控场景中的背景图像来判断所述监控设备的监控场景是否发生变更,在发现所述监控设备的监控场景发生变更时,确定所述监控设备发生故障,该方法不需要技术人员到现场检查就能及时发现监控设备的故障。进一步,在确定监控设备故障后,还可以基于背景图像确定监控设备的故障类型,然后根据故障类型决策和执行故障处理策略,及时地解决故障。In view of this, an embodiment of the present invention provides a method for detecting a failure of a monitoring device. The method judges the monitoring device by comparing the background image in the current monitoring scene of the monitoring device with the background image in the historical monitoring scene of the monitoring device. Whether the monitoring scene of the monitoring device is changed, and when the monitoring scene of the monitoring device is found to be changed, it is determined that the monitoring device is faulty. This method can detect the fault of the monitoring device in time without the need for technicians to go to the site for inspection. Further, after determining the fault of the monitoring device, the fault type of the monitoring device can also be determined based on the background image, and then a decision is made and a fault handling strategy is executed according to the fault type to solve the fault in a timely manner.
当前监控场景和历史监控场景处于同一地点。The current monitoring scene and the historical monitoring scene are in the same place.
本发明实施例中,第一背景图像和第二背景图像中拍摄有:相同物体,或者相同物体的一部分。这个物体例如是建筑物、电杆、植物、装饰物。需要说明的是这个相同的物体(或者物体的一部分)在第一背景图像和第二背景图像中的成像效果可能不同,例如清晰度不同、噪点数量不同、对比度不同、锐度不同等。In the embodiment of the present invention, the first background image and the second background image capture: the same object, or a part of the same object. This object is for example a building, a pole, a plant, a decoration. It should be noted that the imaging effect of the same object (or part of the object) in the first background image and the second background image may be different, such as different definition, different amount of noise, different contrast, different sharpness, etc.
为了使本发明实施例的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施例作进一步地详细描述。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings.
请参见图2A,为本发明实施例中所涉及的监控设备的一种结构示意图,监控设备可以包括摄像部分和控制部分。Please refer to FIG. 2A , which is a schematic structural diagram of a monitoring device involved in an embodiment of the present invention. The monitoring device may include a camera part and a control part.
摄像部分,是监控设备的前端,是整个监控设备的“眼睛”,用于采集被监视场所对应的图像信号,并将采集的图像信号传送到控制中心的监视器上。摄像部分一般布置在被监视场所的某一位置上,其视场角可以覆盖整个被监视场所的各个部位。The camera part is the front end of the monitoring equipment and the "eyes" of the entire monitoring equipment. It is used to collect image signals corresponding to the monitored places and transmit the collected image signals to the monitor in the control center. The camera part is generally arranged at a certain position of the monitored place, and its field of view can cover all parts of the entire monitored place.
摄像部分可以是相机、摄像机、智能摄像机、智能摄录机、智能移动终端(比如移动电话(mobile phone)、平板电脑、等等,本发明实施例这里不做限制。The camera part may be a camera, video camera, smart video camera, smart camcorder, smart mobile terminal (such as a mobile phone), a tablet computer, etc., which are not limited in this embodiment of the present invention.
一些可能的实施例中,摄像部分可以只包括一个摄像头,另一些可能的实施例中,摄像部分可以包括多个摄像头,不同的摄像头可以有不同的视场角,本发明实施例这里不做限制。摄像头可以是红外摄像头,也即摄像头可以拍摄红外图像,摄像头也可以是可见光摄像头,也即摄像头可以拍摄彩色图像,本发明实施例这里不做限制。摄像头包括光学镜片和图像传感器,图像传感器可以是电荷耦合元件(charge-coupled device,CCD)、互补金属氧化物半导体(complementary metal oxide semiconductor,CMOS)以及接触式图像传感器(contact image sensor,CIS)等。In some possible embodiments, the camera part may only include one camera, and in other possible embodiments, the camera part may include multiple cameras, and different cameras may have different viewing angles, which are not limited in the embodiments of the present invention. . The camera can be an infrared camera, that is, the camera can capture infrared images, or it can be a visible light camera, that is, the camera can capture color images, which are not limited in this embodiment of the present invention. The camera includes an optical lens and an image sensor, and the image sensor can be a charge-coupled device (CCD), a complementary metal oxide semiconductor (CMOS), and a contact image sensor (CIS), etc. .
在一些场景下,为了节省摄像部分所用的摄像头数量、简化传输系统及控制与显示系统,在摄像部分上可以加装电动的(可遥控的)可变焦距(变倍)镜头,使摄像部分所能观察的距离更远、更清楚;还可以把摄像部分安装在云台上,通过控制台的控制,可以使云台带动摄像部分进行水平和垂直方向的转动,从而使摄像部分能覆盖的角度、面积更大。In some scenarios, in order to save the number of cameras used in the camera part, simplify the transmission system and the control and display system, an electric (remote control) variable focal length (variable magnification) lens can be added to the camera part to make the camera part The distance that can be observed is farther and clearer; the camera part can also be installed on the pan-tilt, and through the control of the console, the pan-tilt can drive the camera part to rotate horizontally and vertically, so that the camera part can cover a wide range of angles , The area is larger.
控制部分是整个系统的“心脏”和“大脑”,是实现整个视频监控系统功能的指挥中心。本发明实施例中,控制部分可以完成图像的获取和相似度的比较,还可以调整摄像机/云台的方向和角度。下面对一些功能更强大的进行介绍,控制部分主要由总控制台(有些系统还设有副控制台)组成。总控制台中主要的功能有:视频信号放大与分配、图像信号的校正与补偿、图像信号的切换、图像信号(或包括声音信号)的记录、摄像机及其辅助部件(如镜头、云台、防护罩等)的控制(遥控)等等。总控制台的另一个重要方面是能对摄像机、镜头、云台、防护罩等进行遥控,以完成对被监视的场所全面、详细的监视或跟踪监视。总控制台上还可以设置录像机,用于把发生情况的被监视场所的图像记录下来,以便事后备查或作为重要依据。总控制台上还可以设置“多画面分割器”,如四画面、九画面、十六画面等等,也就是说,可以在一台监视器上同时显示出四个、九个、十六个摄像机送来的各个被监视场所的画面,并用一台常规录像机或长延时录像机进行记录。The control part is the "heart" and "brain" of the whole system, and it is the command center to realize the functions of the whole video surveillance system. In the embodiment of the present invention, the control part can complete image acquisition and similarity comparison, and can also adjust the direction and angle of the camera/pan/tilt. The following is an introduction to some more powerful ones. The control part is mainly composed of the main console (some systems also have sub-consoles). The main functions in the main console are: video signal amplification and distribution, image signal correction and compensation, image signal switching, image signal (or including sound signal) recording, camera and its auxiliary components (such as lens, pan/tilt, protective cover, etc.) control (remote control) and so on. Another important aspect of the main console is that it can remotely control the camera, lens, pan/tilt, protective cover, etc., so as to complete the comprehensive and detailed monitoring or tracking monitoring of the monitored place. A video recorder can also be set on the main console to record the images of the monitored places where the situation occurs, for future reference or as an important basis. "Multi-screen splitter" can also be set on the main console, such as four screens, nine screens, sixteen screens, etc., that is to say, four, nine, or sixteen screens can be displayed on one monitor at the same time. The pictures of each monitored place sent by the camera are recorded with a conventional video recorder or a long-time video recorder.
控制部分包括至少一个处理器。处理器可以包括以下一项或者多项:通用处理器、图像信号处理器(image signal processor,ISP)、微处理器、数字信号处理器(digitalsignal processor,DSP)、现场可编程门阵列(field-programmable gate array,FPGA)等。The control section includes at least one processor. The processor may include one or more of the following: general purpose processor, image signal processor (image signal processor, ISP), microprocessor, digital signal processor (digital signal processor, DSP), field programmable gate array (field- programmable gate array, FPGA), etc.
控制部分还可以包括一个或多个存储器。存储器可以是只读存储器(read-onlymemory,ROM)或可存储静态信息和指令的其他类型的静态存储设备,随机存取存储器(random access memory,RAM)或者可存储信息和指令的其他类型的动态存储设备,也可以是电可擦可编程只读存储器(Electrically Erasable Programmable Read-Only Memory,EEPROM)、只读光盘(Compact Disc Read-Only Memory,CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由该装置存取的任何其他介质,但不限于此。存储器可以是独立存在,通过总线与处理器相连接。存储器也可以和处理器集成在一起。The control section may also include one or more memories. Memory can be read-only memory (ROM) or other types of static storage devices that can store static information and instructions, random access memory (random access memory, RAM) or other types of dynamic memory devices that can store information and instructions The storage device can also be Electrically Erasable Programmable Read-Only Memory (EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disk storage, optical disk storage (including Compact Disc, Laser Disc, Optical Disc, Digital Versatile Disc, Blu-ray Disc, etc.), magnetic disk storage medium or other magnetic storage device, or can be used to carry or store desired program code in the form of instructions or data structures and can be stored by the device Any other medium, but not limited to. The memory can exist independently and be connected to the processor through the bus. Memory can also be integrated with the processor.
其中,控制部分的存储器可以用于存储执行本申请方案的应用程序代码,并由处理器来控制执行,也就是说,所述处理器用于执行所述存储器中存储的应用程序代码实现本申请实施例中检测监控设备故障的方法。Wherein, the memory of the control part can be used to store the application program code that executes the solution of the present application, and the execution is controlled by the processor, that is, the processor is used to execute the application code stored in the memory to implement the implementation of the present application. The method for detecting the failure of the monitoring equipment in the example.
在一些场景下,存储器可以和处理器集成在一起,或者没有存储器,例如现场可编程门阵列(Field-Programmable Gate Array,FPGA)。In some scenarios, the memory can be integrated with the processor, or there is no memory, such as Field-Programmable Gate Array (FPGA).
需要说明的是,在具体实施时,摄像部分、控制部分可以集成在同一个物理设备上(例如:带有摄像头的平板电脑、智能摄像机),也可分别为不同的物理设备,本发明实施例这里不做限制。当摄像部分、控制部分分别为不同的物理设备时,摄像部分、控制部分可以通过有线或者无线的方式连接通信。It should be noted that during specific implementation, the camera part and the control part can be integrated on the same physical device (for example: a tablet computer with a camera, a smart camera), or they can be different physical devices respectively. Embodiments of the present invention There is no limit here. When the camera part and the control part are different physical devices, the camera part and the control part can be connected and communicated in a wired or wireless manner.
在另一些实施例中,监控设备还可以包括显示部分,如图2B所示,为本发明实施例中监控设备的另一种结构示意图。显示部分可以由几台或多台监视器(或带视频输入的普通电视机)组成。它的功能是将摄像部分采集的图像一一显示出来。显示部分可以和摄像部分、控制部分集成在一个物理设备上,也可以是单独的一个物理设备,本发明实施例这里不做限制。In some other embodiments, the monitoring device may further include a display part, as shown in FIG. 2B , which is another schematic structural diagram of the monitoring device in an embodiment of the present invention. The display section can consist of several or more monitors (or ordinary TV sets with video inputs). Its function is to display the images collected by the camera part one by one. The display part may be integrated with the camera part and the control part on one physical device, or may be a separate physical device, which is not limited here in the embodiment of the present invention.
当然,本发明实施例中检测监控设备故障的方法也可以不由监控设备执行,而是通过与监控设备通信连接的其他装置来执行。Of course, the method for detecting a failure of a monitoring device in the embodiment of the present invention may not be performed by the monitoring device, but may be performed by other devices connected in communication with the monitoring device.
例如,参见图2C,监控设备可以外接一处理装置,该处理装置可以包括一个或多个处理器、可选的,还可以包括一个或多个存储器。处理装置中的存储器可以用于存储执行本申请方案的应用程序代码,并由处理装置中的处理器来控制执行,也就是说,处理装置中的处理器用于执行处理装置中的存储器中存储的应用程序代码实现本申请实施例中检测监控设备故障的方法。For example, referring to FIG. 2C , the monitoring device may be externally connected to a processing device, and the processing device may include one or more processors, and optionally, one or more memories. The memory in the processing device can be used to store the application program code that executes the solution of the present application, and the execution is controlled by the processor in the processing device, that is, the processor in the processing device is used to execute the code stored in the memory in the processing device. The application program code implements the method for detecting and monitoring device failures in the embodiment of the present application.
下面以图2B所示的监控设备为例(即下文中的第一监控设备可以是图2B所示的监控设备),介绍本发明实施例提供的检测监控设备故障的方法。Taking the monitoring device shown in FIG. 2B as an example (that is, the first monitoring device hereinafter may be the monitoring device shown in FIG. 2B ), the method for detecting a fault in the monitoring device provided by the embodiment of the present invention is introduced below.
1)、监控场景,指监控设备所拍摄的区域。例如,设置在车站内的监控设备,其监控场景即为该监控设备能够拍摄到的车站区域;例如,设置在交通路口的监控设备,其监控场景即为该监控设备能够拍摄到的路口区域。1) Surveillance scene refers to the area captured by the surveillance equipment. For example, for a monitoring device installed in a station, its monitoring scene is the station area that the monitoring device can capture; for example, for a monitoring device installed at a traffic intersection, its monitoring scene is the intersection area that the monitoring device can capture.
2)、背景图像,或者叫图像背景、后景图像、图像后景等,指监控设备所拍摄的区域(即监控场景)中的背景区域对应的图像。其中,背景区域可以指监控场景中与监控设备的距离大于预设距离的物体或对象所处的区域,也可以指监控场景中经常出现(例如一段时间中出现时间最长)的物体或对象所处的区域,另一些实施例中,背景区域还可以是用户自定义的区域,比如监控场景中用户不想在监控设备拍摄画面中突出显示的物体或对象所处的区域,可以与用户的交互选择或者系统设置有关。2) The background image, or image background, background image, image background, etc., refers to the image corresponding to the background area in the area captured by the monitoring device (ie, the monitoring scene). Wherein, the background area may refer to the object or the area where the object or object is located at a distance greater than the preset distance from the monitoring device in the monitoring scene, or may refer to the object or object that frequently appears in the monitoring scene (for example, the longest time in a period of time). In other embodiments, the background area can also be a user-defined area, such as the object or the area where the object is located in the monitoring scene that the user does not want to be highlighted in the picture taken by the monitoring device, which can be selected through interaction with the user. Or system settings.
背景图像可以是监控设备所拍摄的图像中的全部图像,也可以是监控设备所拍摄的图像中的一部分图像,具体取决于监控场景的具体情况。例如,监控设备的监控场景为交通路口,如果监控设备执行拍摄操作时交通路口没有车辆和行人等,监控设备所拍摄的图像中只存在道路特征,则监控设备所拍摄的图像即为背景图像,如果监控设备执行拍摄操作时交通路口刚好有车辆经过,则监控设备所拍摄的图像中的车辆对应的图像部分则可以不作为背景图像,相应的,背景图像为图像中除车辆外的其它图像部分。The background image may be all of the images captured by the monitoring equipment, or may be a part of the images captured by the monitoring equipment, depending on the specific conditions of the monitoring scene. For example, the monitoring scene of the monitoring device is a traffic intersection. If there are no vehicles or pedestrians at the intersection when the monitoring device performs the shooting operation, and only road features exist in the image captured by the monitoring device, the image captured by the monitoring device is the background image. If there is a vehicle passing through the traffic intersection when the monitoring device performs the shooting operation, the image part corresponding to the vehicle in the image captured by the monitoring device may not be used as the background image. Correspondingly, the background image is other image parts in the image except the vehicle. .
3)、本发明实施例下述涉及的术语“至少一个”,是指一个,或一个以上,即包括一个、两个、三个及以上;“多个”,是指两个,或两个以上,即包括两个、三个及以上。另外,需要理解的是,在本申请的描述中,“第一”、“第二”等词汇,仅用于区分描述的目的,而不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b,或c中的至少一项(个),可以表示:a,b,c,a-b,a-c,b-c,或a-b-c,其中a,b,c可以是单个,也可以是多个。3), the term "at least one" involved in the following embodiments of the present invention refers to one, or more than one, that is, including one, two, three or more; "multiple" refers to two, or two The above includes two, three and more. In addition, it should be understood that in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or imply order. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the contextual objects are an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one item (piece) of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple .
请参见图3,为本发明实施例中检测监控设备故障的方法的流程图,该方法可以由图像/视频监控设备(例如摄像头)来执行;也可以由其他设备执行。在检测到故障以后,所述其他设备发送修复指令给所述监控设备,以指令所述监控设备进行修复。为了方便理解,下面的步骤以由监控设备执行S101-S103为例进行介绍(如果由其他设备执行步骤S101-S103,由于原理相同,不再做单独说明)该方法包括以下步骤:Please refer to FIG. 3 , which is a flowchart of a method for detecting a monitoring device failure in an embodiment of the present invention. The method may be executed by an image/video monitoring device (such as a camera); it may also be executed by other devices. After detecting a fault, the other device sends a repair instruction to the monitoring device, so as to instruct the monitoring device to perform repair. For the convenience of understanding, the following steps are introduced by taking the execution of S101-S103 by the monitoring equipment as an example (if the steps S101-S103 are executed by other equipment, since the principle is the same, no separate description will be made). The method includes the following steps:
S101、第一监控设备获取第一背景图像和第二背景图像;其中,所述第一背景图像为所述第一监控设备当前监控场景中的背景图像,所述第二背景图像为预先存储的所述第一监控设备历史监控场景中的背景图像。S101. The first monitoring device acquires a first background image and a second background image; wherein, the first background image is a background image in the current monitoring scene of the first monitoring device, and the second background image is a pre-stored The first monitoring device historically monitors background images in scenes.
具体的,第一监控设备可以采用背景建模算法从第一图像中提取第一背景图像、从第二图像中提取第二背景图像。第一图像为第一监控设备当前采集的图像,第二图像为第一监控设备之前采集的历史图像(比如第一监控设备在距离当前时刻一小时前采集的图像)。第一背景图像为第一图像中的背景图像,第二背景图像为第二图像中的背景图像。Specifically, the first monitoring device may use a background modeling algorithm to extract the first background image from the first image, and extract the second background image from the second image. The first image is an image currently collected by the first monitoring device, and the second image is a historical image previously collected by the first monitoring device (for example, an image collected by the first monitoring device one hour before the current moment). The first background image is the background image in the first image, and the second background image is the background image in the second image.
在本发明实施例中,所述当前监控场景和所述历史监控场景所处地点相同。也即要求第一监控设备在采集第一图像和采集第二图像时所处的地点相同,其中地点相同是指第一监控设备在采集第一图像的位置和采集第二图像时的位置的相对距离小于预设值,比如小于0.1m。一种可能的设计是:第一背景图像和第二背景图像中拍摄有相同物体,或者相同物体的一部分。例如,如果第一监控设备为设置在交通路口的监控设备,那么第一背景图像和第二背景图像中具有相同的道路、绿化或交通标志等。In the embodiment of the present invention, the location of the current monitoring scene and the historical monitoring scene are the same. That is to say, the first monitoring device is required to be at the same location when collecting the first image and the second image, where the same location refers to the relative position of the first monitoring device when collecting the first image and the location when collecting the second image. The distance is less than a preset value, such as less than 0.1m. A possible design is: the same object or a part of the same object is photographed in the first background image and the second background image. For example, if the first monitoring device is a monitoring device installed at a traffic intersection, then the first background image and the second background image have the same roads, greenery, or traffic signs.
背景建模算法可以是单高斯模型(Single Gaussian Model)算法、混合高斯模型(Mixture of Gaussian)算法、滑动高斯平均(Running Gaussian average)算法、码本(CodeBook)算法、自组织背景检测(SOBS-Self-organization background subtraction)算法、样本一致性背景建模算法(SACON)、VIBE算法、基于颜色信息的背景建模算法、统计平均法、本征背景法等,本发明实施例这里不做限制。The background modeling algorithm can be a single Gaussian model (Single Gaussian Model) algorithm, a mixed Gaussian model (Mixture of Gaussian) algorithm, a sliding Gaussian average (Running Gaussian average) algorithm, a codebook (CodeBook) algorithm, a self-organizing background detection (SOBS- Self-organization background subtraction) algorithm, sample consistency background modeling algorithm (SACON), VIBE algorithm, background modeling algorithm based on color information, statistical averaging method, intrinsic background method, etc., are not limited here in the embodiments of the present invention.
作为一种可选的实施方式,在本发明实施例中,第二背景图像还可以是预先计算好存储在本地的。相应的,获取第二背景图像的具体实现方式则可以是从本地读取预先存储的第二背景图像。As an optional implementation manner, in the embodiment of the present invention, the second background image may also be pre-calculated and stored locally. Correspondingly, a specific implementation manner of acquiring the second background image may be to read a pre-stored second background image locally.
在具体实施时,第一监控设备可以在每一次执行重启操作或者背景重置操作后,删除原来存储在本地的第二背景图像,并将重启后或者背景重置后采集的第一帧图像中的背景作为第二背景图像进行存储在本地。可选的,第一监控设备还可以按照预设的时间间隔周期性地执行背景重置操作,例如,每隔5min、30min或者60min等执行一次背景重置,以保证背景及时更新。第二背景图像也可以不存储在本地,例如存储在专用的存储服务器/存储阵列中,在需要时发生给所述第一监控设备。In specific implementation, the first monitoring device can delete the second background image originally stored locally after each restart operation or background reset operation, and add The background of is stored locally as the second background image. Optionally, the first monitoring device may also perform the background reset operation periodically according to a preset time interval, for example, perform a background reset every 5 minutes, 30 minutes, or 60 minutes, etc., to ensure that the background is updated in time. The second background image may not be stored locally, for example, stored in a dedicated storage server/storage array, and sent to the first monitoring device when needed.
需要说明的是,如果第一监控设备是拍摄角度可以变化的摄像机的话(比如球机、桶机等),则要求第二图像和第一图像为第一监控设备在相同的云台位置下采集的图像,也即要求第一监控设备在拍摄第一图像时的云台的位置参数和第一监控设备在拍摄第二图像时的云台的位置参数相同,比如云台的俯仰角(tilt angle)和转动角(pan angle)相同。It should be noted that if the first monitoring device is a camera with a variable shooting angle (such as a dome camera, barrel camera, etc.), the second image and the first image are required to be collected by the first monitoring device at the same pan-tilt position image, that is, the position parameters of the pan-tilt when the first monitoring device is required to capture the first image are the same as the position parameters of the pan-tilt when the first monitoring device is capturing the second image, such as the pitch angle of the pan-tilt (tilt angle ) is the same as the pan angle.
S102、所述第一监控设备计算所述第一背景图像和所述第二背景图像的相似度,并根据相似度计算结果判断所述第一监控设备的监控场景是否发生变更。S102. The first monitoring device calculates a similarity between the first background image and the second background image, and judges whether a monitoring scene of the first monitoring device changes according to a similarity calculation result.
图像的相似度的计算方法可以有多种实现方式,例如结构相似性和感知哈希算法、巴氏距离算法或者灰度颜色直方图算法等,本发明实施例这里不做限制。There are many ways to calculate the image similarity, such as structural similarity and perceptual hash algorithm, Bhattacharyachian distance algorithm, or grayscale color histogram algorithm, etc., which are not limited here in the embodiment of the present invention.
作为一种可选的实施方式,第一监控设备在对第一背景图像和第二背景图像进行相似度计算前,还可以先对第一背景图像、第二背景图像进行直方图统计、归一化预处理,然后基于预处理后的第一背景图像、第二背景图像计算相似度。As an optional implementation, before the first monitoring device calculates the similarity between the first background image and the second background image, it may first perform histogram statistics and normalization on the first background image and the second background image. and then calculate the similarity based on the preprocessed first background image and the second background image.
在计算出第一背景图像和第二背景图像的相似度之后,判断该相似度是否小于预设的第一相似度阈值,如果是,则确定第一监控设备的监控场景发生变更,否则确定第一监控设备的监控场景未变更。After calculating the similarity between the first background image and the second background image, it is judged whether the similarity is smaller than the preset first similarity threshold, if yes, then it is determined that the monitoring scene of the first monitoring device has changed, otherwise, it is determined that the second The monitoring scene of a monitoring device has not changed.
S103、当所述第一监控设备的监控场景发生变更时,确定所述第一监控设备故障。S103. When the monitoring scene of the first monitoring device changes, determine that the first monitoring device is faulty.
在本发明实施例技术方案中,第一监控设备通过比较当前监控场景中的背景图像(即第一背景图像)和历史监控场景中的背景图像(即第二背景图像)来判断监控场景是否发生变更,在发现监控设备的监控场景发生变更时,确定监控设备发生故障,该方案不需要技术人员到现场检查就能及时发现监控设备故障,可以提高监控设备故障检测的及时性。In the technical solution of the embodiment of the present invention, the first monitoring device judges whether the monitoring scene occurs by comparing the background image (ie, the first background image) in the current monitoring scene with the background image (ie, the second background image) in the historical monitoring scene Change, when the monitoring scene of the monitoring equipment is found to be changed, it is determined that the monitoring equipment is faulty. This solution can detect the monitoring equipment failure in time without the need for technicians to go to the site for inspection, and can improve the timeliness of monitoring equipment failure detection.
作为一种可选的方式,在本发明实施例中,可以以设定的时间间隔周期性地执行上述步骤S101~S103的方法步骤,例如每隔10s、20s或者1min执行一次上述步骤S101~S103的方法,这样可进一步提高监控设备故障检测的及时性。另外,也可以通过触发事件来触发第一监控设备执行上述步骤S101~S103的方法,比如技术人员远程发送故障检测指令,第一监控设备在接收到故障检测指令后,响应该故障检测指令执行上述步骤S101~S103的方法。As an optional manner, in the embodiment of the present invention, the method steps of the above steps S101-S103 may be performed periodically at a set time interval, for example, the above-mentioned steps S101-S103 are performed every 10s, 20s or 1min. This method can further improve the timeliness of monitoring equipment fault detection. In addition, it is also possible to trigger the first monitoring device to execute the above steps S101-S103 by triggering an event. For example, a technician sends a fault detection command remotely. After receiving the fault detection command, the first monitoring device responds to the fault detection command. The method of steps S101-S103.
作为一种可选的实施方式,当执行完步骤S103后,即在确定第一监控设备故障之后,还可以进行故障处理,故障处理的方式包括但不限于设备自检、发送故障通知等方式。As an optional implementation, after step S103 is performed, that is, after the first monitoring device is determined to be faulty, fault handling may also be performed. The fault processing methods include but are not limited to device self-test, sending fault notifications, and the like.
具体实施时,第一监控设备可以根据不同的故障类型,执行不同的故障处理策略。示例性地,若第一监控设备的故障类型为不需要人工修复的故障类型,则对第一监控设备进行自动修复,以提高故障处理效率;若第一监控设备的故障类型为需要人工修复的故障类型,则发送故障通知,以使技术人员及时赶到现场进行故障。During specific implementation, the first monitoring device may execute different fault handling strategies according to different fault types. For example, if the fault type of the first monitoring device is a fault type that does not require manual repair, then the first monitoring device is automatically repaired to improve the efficiency of fault handling; if the fault type of the first monitoring device is a fault type that requires manual repair If the fault type is faulty, a fault notification is sent to enable technicians to arrive at the scene in time to troubleshoot the fault.
作为一种可选的实施方式,第一监控设备可以基于采集到的背景图像,比如第一背景图像,或者第一背景图像前后相邻预设数量帧的背景图像,来确定第一监控设备的故障类型。As an optional implementation manner, the first monitoring device may determine the background image of the first monitoring device based on the collected background image, such as the first background image, or a background image of a preset number of frames adjacent to the first background image. Fault type.
下面例举几个具体的故障场景,对第一监控设备进行故障检测和故障处理的方式进行详细说明。Several specific fault scenarios are exemplified below to describe in detail how the first monitoring device performs fault detection and fault handling.
场景1、监控设备镜头参数异常、云台异常引起的故障检测和处理。Scenario 1. Fault detection and processing caused by abnormal lens parameters of monitoring equipment and abnormal pan/tilt.
第一监控设备基于上述场景变更检测确认自身故障后,可以从第二背景图像中提取至少一个特征点,为了和后面的第一背景图像中的特征点相区别,这里将从第二背景图像中提取的特征点定义为第一特征点;将该至少一个第一特征点作为基准点;从第一背景图像中提取出和基准点相匹配的特征点,这里将从第一背景图像中提取的特征点定义为第二特征点,其中第一特征点的数量和第二特征点的数量相等;然后,计算第二特征点相对于基准点的位置偏移量,根据位置偏移量判断第一监控设备的拍摄视角是否异常。After the first monitoring device confirms its own failure based on the above-mentioned scene change detection, it can extract at least one feature point from the second background image. In order to distinguish it from the feature point in the first background image later, the The extracted feature point is defined as the first feature point; the at least one first feature point is used as a reference point; the feature point matching the reference point is extracted from the first background image, here the extracted from the first background image The feature point is defined as the second feature point, where the number of the first feature point is equal to the number of the second feature point; then, the position offset of the second feature point relative to the reference point is calculated, and the first feature point is judged according to the position offset. Check whether the shooting angle of the monitoring device is abnormal.
如果根据位置偏移量确定第一监控设备的视角方向发生了偏移(拍摄第一图像时的视角方向与拍摄第二图像时的视角方向不同),但视角大小未变化(拍摄第一图像时的视角大小与拍摄第二图像时的视角大小相同,或者两者的差值小于预设值),则确定监控设备的视角方向异常,认定第一监控设备当前发生的故障为不需要人工修复的故障类型,第一监控设备可自动调整监控设备的云台参数(比如云台的俯仰角度、转动角度等),以将第一监控设备的视角方向恢复至变化前的视角方向。If it is determined according to the position offset that the viewing angle direction of the first monitoring device has shifted (the viewing angle direction when taking the first image is different from the viewing angle direction when shooting the second image), but the viewing angle does not change (when the first image is taken, is the same as the viewing angle of the second image, or the difference between the two is smaller than the preset value), then it is determined that the viewing angle direction of the monitoring device is abnormal, and it is determined that the current failure of the first monitoring device does not require manual repair Fault type, the first monitoring device can automatically adjust the pan/tilt parameters of the monitoring device (such as the pitch angle and rotation angle of the pan/tilt), so as to restore the viewing angle direction of the first monitoring device to the viewing angle direction before the change.
如果根据位置偏移量确定第一监控设备的视角大小发生变化(拍摄第一图像时的视角大小与拍摄第二图像时的视角大小不相同,或者两者的差值大于预设值),但视角方向没有变化(拍摄第一图像时的视角方向与拍摄第二图像时的视角方向相同,或者两者的差值小于设定值),则确定监控设备的镜头参数异常,认定第一监控设备当前发生的故障为不需要人工修复的故障类型,第一监控设备可自动调整监控设备的镜头参数(比如焦距),以将第一监控设备的视角大小恢复至变化前的视角大小。If it is determined according to the position offset that the viewing angle of the first monitoring device has changed (the viewing angle when shooting the first image is different from the viewing angle when shooting the second image, or the difference between the two is greater than a preset value), but If there is no change in the viewing angle direction (the viewing angle direction when shooting the first image is the same as the viewing angle direction when shooting the second image, or the difference between the two is less than the set value), then it is determined that the lens parameters of the monitoring device are abnormal, and the first monitoring device is determined to be The currently occurring fault is a type of fault that does not require manual repair. The first monitoring device can automatically adjust the lens parameters (such as the focal length) of the monitoring device to restore the viewing angle of the first monitoring device to the viewing angle before the change.
如果根据位置偏移量确定第一监控设备的视角大小和方向均发生了变化,则确定监控设备的视角大小和方向异常,认定第一监控设备当前发生的故障为不需要人工修复的故障类型,第一监控设备自动调整监控设备的云台参数和镜头参数,以将第一监控设备的视角大小和方向恢复至变化前的视角大小和方向。If it is determined according to the position offset that the size and direction of the viewing angle of the first monitoring device have changed, then it is determined that the size and direction of the viewing angle of the monitoring device are abnormal, and it is determined that the current fault of the first monitoring device is a fault type that does not require manual repair, The first monitoring device automatically adjusts the pan/tilt parameters and lens parameters of the monitoring device, so as to restore the size and direction of the viewing angle of the first monitoring device to the size and direction of the viewing angle before the change.
示例性地,参见图4A、图4B,图4A为第一背景图像的示意图,其中第一背景图像中具有两个第二特征点,A、B,其坐标分别为(1,10)、(5,5),图4B为第二背景图像的示意图,其中第二背景图像中和第一背景图像中的第一特征点相匹配的第一特征点分别为A’、B’,其坐标分别为(2,10)、(6,5)。通过比较A、B和A’、B’的坐标可以确定,第一监控设备的视角方向沿图示的x方向发生了偏移。因此,第一监控设备可以往-x方向调节视角,以将第一监控设备的视角方向恢复至偏移前。For example, referring to FIG. 4A and FIG. 4B, FIG. 4A is a schematic diagram of the first background image, wherein there are two second feature points in the first background image, A and B, whose coordinates are (1, 10), ( 5, 5), Fig. 4B is a schematic diagram of the second background image, wherein the first feature points in the second background image that match the first feature points in the first background image are respectively A' and B', and their coordinates are respectively It is (2, 10), (6, 5). By comparing the coordinates of A, B and A', B', it can be determined that the viewing angle direction of the first monitoring device is shifted along the illustrated x direction. Therefore, the first monitoring device can adjust the viewing angle toward the -x direction, so as to restore the viewing angle direction of the first monitoring device to the direction before the shift.
示例性地,参见图4A、图4C,图4A为第一背景图像的示意图,其中第一背景图像中具有两个第二特征点,A、B,其坐标分别为(1,10)、(5,5),图4C为第二背景图像的示意图,其中第二背景图像中和第一背景图像中的第二特征点相匹配的第一特征点分别为A’、B’,其坐标分别为(0.5,5)、(2.5,2.5)。通过比较A、B和A’、B’可以确定,第一监控设备的视角大小缩小了。因此,第一监控设备可以调整镜头的焦距,以将第一监控设备的视角大小恢复至缩小前。For example, referring to FIG. 4A and FIG. 4C, FIG. 4A is a schematic diagram of the first background image, wherein there are two second feature points in the first background image, A and B, whose coordinates are (1, 10), ( 5, 5), Fig. 4C is a schematic diagram of the second background image, wherein the first feature points in the second background image that match the second feature points in the first background image are respectively A' and B', and their coordinates are respectively It is (0.5, 5), (2.5, 2.5). It can be determined by comparing A, B with A', B' that the viewing angle of the first monitoring device is reduced. Therefore, the first monitoring device can adjust the focal length of the lens, so as to restore the viewing angle of the first monitoring device to that before zooming out.
需要说明的是,如果第一监控设备是拍摄角度可以变化的摄像机的话(比如球机、桶机等),则要求第二图像和第一图像为第一监控设备在相同的云台位置下采集的图像。另外,第一监控设备在调整镜头参数时云台位置需要和第一监控设备在拍摄第一图像时的云台位置相同。It should be noted that if the first monitoring device is a camera with a variable shooting angle (such as a dome camera, barrel camera, etc.), the second image and the first image are required to be collected by the first monitoring device at the same pan-tilt position Image. In addition, the position of the pan-tilt when the first monitoring device adjusts the lens parameters needs to be the same as the position of the pan-tilt when the first monitoring device captures the first image.
本实施方式,通过比较第一背景图像和第二背景图像,可以及时检测并处理第一监控设备的镜头参数和/或云台参数异常,可以提高监控设备的故障维护效率。In this embodiment, by comparing the first background image and the second background image, abnormalities of the lens parameters and/or pan/tilt parameters of the first monitoring device can be detected and processed in time, and the failure maintenance efficiency of the monitoring device can be improved.
场景2、监控设备拍摄参数异常引起的故障检测和处理。Scenario 2. Fault detection and processing caused by abnormal shooting parameters of monitoring equipment.
第一监控设备基于上述场景变更检测确认自身故障后,可以根据第一背景图像确定第一监控设备当前监控场景中的监控参数,然后判断第一监控设备当前拍摄参数是否和第一监控设备当前监控场景中的监控参数相匹配,在确定第一监控设备当前拍摄参数和第一监控设备当前监控场景中的监控参数不匹配时,确定第一监控设备的拍摄参数异常,并认定第一监控设备的故障类型为不需要人工修复的故障类型,然后自动调整第一监控设备的拍摄参数,将第一监控设备的拍摄参数调整为和监控参数相匹配的拍摄参数。After the first monitoring device confirms its own failure based on the above scene change detection, it can determine the monitoring parameters in the current monitoring scene of the first monitoring device according to the first background image, and then determine whether the current shooting parameters of the first monitoring device are consistent with the current monitoring parameters of the first monitoring device. The monitoring parameters in the scene match, and when it is determined that the current shooting parameters of the first monitoring device do not match the monitoring parameters in the current monitoring scene of the first monitoring device, it is determined that the shooting parameters of the first monitoring device are abnormal, and the first monitoring device's The fault type is a fault type that does not require manual repair, and then the shooting parameters of the first monitoring device are automatically adjusted, and the shooting parameters of the first monitoring device are adjusted to match the shooting parameters of the monitoring parameters.
其中,当前监控场景中的监控参数可以包括亮度、色温、清晰度、天气状况(比如晴朗、阴天、雨天、雪天、雾天)、拍摄场景(比如建筑物、植物花卉、天空等)。拍摄参数可以包括亮度、色度、饱和度、对比度、锐度、日夜模式转换(黑白模式、彩色模式、自动模式等)、曝光、聚焦、背光、白平衡、图像增强(电子防抖、降噪、透雾等)、补光灯灯光控制国际标准化组织(international standards organization,ISO)感光度等参数,当然,在实际应用中,拍摄参数还可以包括其它参数,比如,快门、光圈、焦距、监控设备所支持的文件格式、分辨率等,本发明实施例这里不做具体限定。Wherein, the monitoring parameters in the current monitoring scene may include brightness, color temperature, definition, weather conditions (such as sunny, cloudy, rainy, snowy, foggy), shooting scenes (such as buildings, plants and flowers, sky, etc.). Shooting parameters can include brightness, hue, saturation, contrast, sharpness, day and night mode conversion (black and white mode, color mode, automatic mode, etc.), exposure, focus, backlight, white balance, image enhancement (electronic image stabilization, noise reduction , fog penetration, etc.), fill light control, international standards organization (ISO) sensitivity and other parameters, of course, in practical applications, shooting parameters can also include other parameters, such as shutter, aperture, focal length, monitoring The file format and resolution supported by the device are not specifically limited in this embodiment of the present invention.
第一监控设备还可以预先存储监控参数和拍摄参数的映射关系,这样在调整拍摄参数时可以根据该映射关系表确定和当前监控参数相匹配的拍摄参数。The first monitoring device can also pre-store the mapping relationship between the monitoring parameters and the shooting parameters, so that when adjusting the shooting parameters, the shooting parameters that match the current monitoring parameters can be determined according to the mapping relationship table.
作为一种可选的实施方式,在本发明实施例中,为了提高监控参数的准确性,第一监控设备还可以获取和第一背景图像相邻的预设数量帧(比如前后5帧)的背景图像,然后基于第一背景图像、以及相邻预设数量帧的背景图像共同确定当前场景中的监控参数。As an optional implementation, in the embodiment of the present invention, in order to improve the accuracy of the monitoring parameters, the first monitoring device can also acquire the images of a preset number of frames (for example, 5 frames before and after) adjacent to the first background image. The background image, and then based on the first background image and the background images of the adjacent preset number of frames, the monitoring parameters in the current scene are jointly determined.
本实施方式可以基于第一背景图像或者和第一背景图像相邻的预设数量帧的背景图像确定第一监控设备当前监控场景中的监控参数,在确定第一监控设备当前拍摄参数和第一监控设备当前监控场景中的监控参数不匹配时,第一监控设备自动将拍摄参数调整为和当前监控参数相匹配的拍摄参数,可以及时检测并处理第一监控设备的拍摄参数异常,可以提高监控设备的故障维护效率。In this embodiment, the monitoring parameters in the current monitoring scene of the first monitoring device can be determined based on the first background image or the background images of a preset number of frames adjacent to the first background image. After determining the current shooting parameters of the first monitoring device and the first When the monitoring parameters in the current monitoring scene of the monitoring device do not match, the first monitoring device automatically adjusts the shooting parameters to the shooting parameters that match the current monitoring parameters, which can detect and deal with abnormal shooting parameters of the first monitoring device in time, and can improve monitoring Equipment failure maintenance efficiency.
上例举了两种不需要人工修复的具体故障类型,在实际应用中,不需要人工修复的故障类型还可以包括其它具体的实现方式,本发明实施例这里不一一例举。第一监控设备进行自动修复的策略也不限于上述的拍摄参数、镜头参数、云台参数等的调整,还可以有其它具体实现方式,例如重启第一监控设备的相关应用进程,重启第一监控设备的系统等。Two specific types of faults that do not require manual repair are cited above. In practical applications, the types of faults that do not require manual repair may also include other specific implementation methods, which are not listed here in the embodiments of the present invention. The strategy for the automatic repair of the first monitoring device is not limited to the above-mentioned adjustments of shooting parameters, lens parameters, and pan/tilt parameters. equipment system, etc.
场景3、监控设备镜头玻璃异常引起的故障检测和处理。Scenario 3. Fault detection and handling caused by abnormality of the lens glass of the monitoring equipment.
第一监控设备基于上述场景变更检测确认自身故障后,可以检测第一背景图像中是否存在裂纹(具体实现方式可以是基于边缘检测算法、深度学习算法等对第一背景图像进行裂纹检测),在确定第一背景图像中存在裂纹时,确定第一监控设备的镜头玻璃破损、有划痕或者脏污,并确定第一监控设备的故障类型为需要人工修复的故障类型,然后发起故障通知,比如向第一监控设备联动的终端设备发送第一监控设备的镜头玻璃破损、有划痕或者脏污的通知信息,以使技术人员能够及时获知并赶到现场更换或者修复第一监控设备的镜头玻璃。After the first monitoring device confirms its own failure based on the above-mentioned scene change detection, it can detect whether there is a crack in the first background image (the specific implementation method can be to perform crack detection on the first background image based on an edge detection algorithm, a deep learning algorithm, etc.). When it is determined that there is a crack in the first background image, it is determined that the lens glass of the first monitoring device is broken, scratched or dirty, and the fault type of the first monitoring device is determined to be a fault type requiring manual repair, and then a fault notification is initiated, such as Send a notification message that the lens glass of the first monitoring device is broken, scratched or dirty to the terminal device linked to the first monitoring device, so that technicians can know in time and rush to the scene to replace or repair the lens glass of the first monitoring device .
类似的,为了提高裂纹检测的准确性,第一监控设备还可以获取和第一背景图像相邻的预设数量帧(比如前后5帧)的背景图像,然后基于第一背景图像、以及相邻预设数量帧的背景图像共同确定镜头玻璃是否存在破损、划痕或者脏污的异常。Similarly, in order to improve the accuracy of crack detection, the first monitoring device can also acquire background images of a preset number of frames (such as 5 frames before and after) adjacent to the first background image, and then based on the first background image, and adjacent The background images of the preset number of frames jointly determine whether the lens glass is damaged, scratched or dirty.
本实施方式可以基于第一背景图像或者和第一背景图像相邻的预设数量帧的背景图像确定镜头玻璃是否存在破损、划痕或者脏污的异常,并在镜头玻璃有破损、划痕或者脏污等异常时,及时发起故障通知,以使技术人员能够及时获知并赶到现场更换或者修复第一监控设备的镜头玻璃,提高了监控设备的故障维护效率。In this embodiment, based on the first background image or the background images of a preset number of frames adjacent to the first background image, it can be determined whether the lens glass is damaged, scratched or dirty, and if the lens glass is damaged, scratched or In case of abnormalities such as dirt, a fault notification is initiated in time, so that technicians can be informed in time and rush to the scene to replace or repair the lens glass of the first monitoring device, which improves the fault maintenance efficiency of the monitoring device.
场景4、监控设备镜头进水或起雾异常引起的故障检测和处理。Scenario 4. Fault detection and treatment caused by abnormal water ingress or fogging of the monitoring equipment lens.
第一监控设备基于上述场景变更检测确认自身故障后,可以检测第一背景图像中是否存在雾气特征;如果存在,则可以获取当前监控场景中的天气信息,在确定天气状况不是雾天时,则确定监控设备镜头存在起雾的异常,或者是将第一监控设备的拍摄参数调整为和雾天相匹配的拍摄参数后也未能消除该雾气特征时,则确定监控设备镜头存在起雾的异常;认定第一监控设备的故障类型为需要人工修复的故障类型,发起故障通知,比如向第一监控设备联动的终端设备发送第一监控设备的镜头起雾的通知信息。其中,通知的方式可以是邮件、短信、即时通信应用的通知消息等,本发明实施例这里不做限制。After the first monitoring device confirms its own failure based on the above-mentioned scene change detection, it can detect whether there is a fog feature in the first background image; If there is an abnormality of fogging on the lens of the monitoring equipment, or if the fog feature cannot be eliminated even after adjusting the shooting parameters of the first monitoring equipment to match the shooting parameters of the foggy weather, then it is determined that the lens of the monitoring equipment has an abnormality of fogging; Determine that the fault type of the first monitoring device is a fault type that requires manual repair, and initiate a fault notification, such as sending a notification message that the lens of the first monitoring device is fogged to a terminal device linked to the first monitoring device. Wherein, the notification method may be an email, a short message, a notification message of an instant messaging application, etc., which is not limited in this embodiment of the present invention.
另外,第一监控设备还可以检测第一背景图像中是否存在水珠特征;如果存在,则可以获取当前监控场景中的天气信息,在确定天气状况不是雨天时,则确定监控设备镜头存在进水的异常,或者是将第一监控设备的拍摄参数调整为和雨天相匹配的拍摄参数后也未能消除该水珠特征时,则确定监控设备镜头存在进水的异常;认定第一监控设备的故障类型为需要人工修复的故障类型,发起故障通知,比如向第一监控设备联动的终端设备发送第一监控设备的镜头进水的通知信息。In addition, the first monitoring device can also detect whether there is a water drop feature in the first background image; if it exists, it can obtain the weather information in the current monitoring scene, and when it is determined that the weather condition is not rainy, it is determined that there is water in the lens of the monitoring device abnormality, or when the shooting parameters of the first monitoring device are adjusted to match the shooting parameters of the rainy day, but the feature of water drops cannot be eliminated, it is determined that there is an abnormality of water ingress in the lens of the monitoring device; it is determined that the first monitoring device The fault type is a fault type that requires manual repair, and a fault notification is initiated, such as sending a notification message that the lens of the first monitoring device is flooded to a terminal device linked with the first monitoring device.
类似的,为了提高进水或者起雾检测的准确性,第一监控设备还可以获取和第一背景图像相邻的预设数量帧(比如前后5帧)的背景图像,然后基于第一背景图像、以及相邻预设数量帧的背景图像共同确定镜头玻璃是否存在进水或者起雾的异常。Similarly, in order to improve the accuracy of water ingress or fogging detection, the first monitoring device can also acquire background images of a preset number of frames (such as 5 frames before and after) adjacent to the first background image, and then based on the first background image , and the background images of the adjacent preset number of frames jointly determine whether there is an abnormality of water ingress or fogging in the lens glass.
本实施方式可以基于第一背景图像或者和第一背景图像相邻的预设数量帧的背景图像确定镜头玻璃是否存在进水或者起雾的异常,并在镜头有进水或者起雾异常时,发起故障通知,以使技术人员能够及时获知并赶到现场解决第一监控设备的镜头中的进水或者起雾异常,提高了监控设备的故障维护效率。In this embodiment, based on the first background image or the background images of a preset number of frames adjacent to the first background image, it can be determined whether the lens glass has water ingress or fogging abnormality, and when the lens has water ingress or fogging abnormality, A fault notification is initiated, so that technicians can be notified in time and rush to the scene to solve the abnormal water ingress or fogging in the lens of the first monitoring device, which improves the fault maintenance efficiency of the monitoring device.
场景5、环境设施变更引起的故障检测和处理。Scenario 5. Fault detection and handling caused by changes in environmental facilities.
第一监控设备基于上述场景变更检测确认自身故障后,可以根据第一背景图像识别出第一监控设备当前监控场景中的环境设施状况,然后根据第二背景图像识别出第一监控设备历史监控场景中的环境设施状况;然后判断第一监控设备当前监控场景中的环境设施状况和历史监控场景中的环境设施状况是否相同,在确定第一监控设备当前监控场景中的环境设施状况和历史监控场景中的环境设施状况不同时,确定第一监控设备的监控场景中的环境设施变更,认定第一监控设备的故障类型为需要人工修复的故障类型,并发起故障通知,例如向第一监控设备联动的终端设备发送场景重置的通知信息,以提醒技术人员对第一监控设备进行场景重置操作。进一步的,第一监控设备可以在收到用户执行的背景重置操作后,将背景重置后采集的第一帧图像中的背景作为新的第二背景图像存储在本地。After the first monitoring device confirms its own failure based on the above scene change detection, it can recognize the environmental facility status in the current monitoring scene of the first monitoring device according to the first background image, and then recognize the historical monitoring scene of the first monitoring device according to the second background image The environmental facility condition in; Then judge whether the environmental facility condition in the current monitoring scene of the first monitoring device and the environmental facility condition in the historical monitoring scene are the same, determine the environmental facility condition and the historical monitoring scene in the first monitoring device current monitoring scene When the conditions of the environmental facilities are different, determine the change of the environmental facilities in the monitoring scene of the first monitoring device, determine that the fault type of the first monitoring device is a fault type that needs manual repair, and initiate a fault notification, such as linkage to the first monitoring device The terminal device sends scene reset notification information to remind technicians to perform a scene reset operation on the first monitoring device. Further, after receiving the background reset operation performed by the user, the first monitoring device may locally store the background in the first frame of image collected after the background reset as a new second background image.
考虑到实际场景中,会存在环境设施的变更,例如道路重铺、绿化维护等实际场景,本实方式用以供用户决策是否重置背景场景,以保证第二背景图像及时、准确更新,进一步提高监控设备的故障维护的可靠性和及时性。Considering that in the actual scene, there will be changes in environmental facilities, such as road resurfacing, greening maintenance and other actual scenes, this method is used for users to decide whether to reset the background scene, so as to ensure that the second background image is updated in a timely and accurate manner, and further Improve the reliability and timeliness of fault maintenance of monitoring equipment.
上例举了三种具体的需要人工修复的故障类型,在实际应用中,需要人工修复的故障类型还可以包括其它具体的故障类型,本发明实施例这里不一一例举。Three specific types of faults that require manual repair are listed above. In practical applications, the types of faults that require manual repair may also include other specific fault types, which are not listed here in this embodiment of the present invention.
作为一种可选的实施方式,第一监控设备进行自动修复之后,还可以判断第一监控设备的故障是否修复成功,如果不成功,则可以发起故障通知,以使提醒技术人员到现场进行维护。As an optional implementation, after the first monitoring device performs automatic repair, it can also judge whether the fault of the first monitoring device is successfully repaired, and if not, it can initiate a fault notification to remind technicians to go to the site for maintenance .
具体的,第一监控设备可以获取第三背景图像,其中第三背景图像为第一监控设备进行自动修复之后所拍摄的监控场景的背景图像,然后计算第三背景图像和第二背景图像的相似度,根据第三背景图像和第二背景图像的相似度确定第一监控设备的故障是否修复成功,如果相似度低于预设的第二相似度阈值,则确定故障修复未成功,则可以发起故障通知,比如向第一监控设备联动的终端设备发送故障未能自动修复的通知信息,以提醒技术人员到现场进行维护。其中,第二相似度阈值小于或者等于上述第一相似度阈值。Specifically, the first monitoring device may obtain a third background image, where the third background image is the background image of the monitoring scene captured by the first monitoring device after automatic repair, and then calculate the similarity between the third background image and the second background image According to the similarity between the third background image and the second background image, it is determined whether the fault of the first monitoring device is repaired successfully. If the similarity is lower than the preset second similarity threshold, it is determined that the fault repair is not successful, and you can initiate Fault notification, such as sending a notification message that the fault cannot be automatically repaired to the terminal device linked to the first monitoring device, so as to remind technicians to go to the site for maintenance. Wherein, the second similarity threshold is less than or equal to the above-mentioned first similarity threshold.
本实施方式可以检测第一监控设备自动修复是否成功,以及在第一监控设备自动修复失败后,及时提醒技术人员到现场进行维护,进一步提高了监控设备故障维护的可靠性和及时性。This embodiment can detect whether the automatic repair of the first monitoring device is successful, and promptly remind technicians to go to the site for maintenance after the automatic repair of the first monitoring device fails, further improving the reliability and timeliness of fault maintenance of the monitoring device.
作为一种可选的实施方式,为了进一步提高故障检测的准确性,本发明实施例还可以结合第二监控设备采集的背景图像分析判断第一监控设备是否故障以及故障的类型,其中第二监控设备当前监控场景和第一监控设备当前监控场景至少部分重合。As an optional implementation, in order to further improve the accuracy of fault detection, the embodiment of the present invention can also analyze the background image collected by the second monitoring device to determine whether the first monitoring device is faulty and the type of fault, wherein the second monitoring device The current monitoring scene of the device and the current monitoring scene of the first monitoring device are at least partially overlapped.
具体的,第一监控设备在确定第一监控设备的故障类型之前,获取第四背景图像,其中第四背景图像为第二监控设备当前监控场景中的背景图像。相应的,第一监控设备在确定第一监控设备的故障类型时,根据第一背景图像和第四背景图像确定第一监控设备的故障类型。Specifically, the first monitoring device acquires a fourth background image before determining the fault type of the first monitoring device, where the fourth background image is the background image in the current monitoring scene of the second monitoring device. Correspondingly, when determining the fault type of the first monitoring device, the first monitoring device determines the fault type of the first monitoring device according to the first background image and the fourth background image.
其中,第二监控设备可以是和第一监控设备相同类型的电子设备,比如均为智能摄像机,也可以是和第一监控设备不同类型的电子设备,比如第一监控设备为智能摄像机,而第二监控设备为普通相机,本发明实施例这里不做限制。Wherein, the second monitoring device may be the same type of electronic device as the first monitoring device, such as a smart camera, or may be a different type of electronic device from the first monitoring device, for example, the first monitoring device is a smart camera, and the second monitoring device is a smart camera. The second monitoring device is an ordinary camera, which is not limited in this embodiment of the present invention.
示例性地,以上述场景5为例。参见图5A~图5C,图5A为第一监控设备历史监控场景中的第二背景图像,图5B为第一监控设备当前监控场景中的第一背景图像,图5C为第二监控设备当前监控场景中的第四背景图像。其中,第一监控设备的视角方向为图示的y方向,第二监控设备的视角方向为图示的x方向。第一监控设备根据第一背景图像和第二背景图像检测到第一监控设备画面上方道路的树木消失,此时进一步根据第四背景图像检测到第二监控设备画面左方道路的确未有树木,则可以确定第一监控设备的监控场景中的环境设施(绿化设施)发生的了变更,进而可以向第一监控设备联动的技术人员的电子设备发送通知信息,以通知技术人员重置第一监控设备背景。Exemplarily, the above scenario 5 is taken as an example. Referring to Figures 5A to 5C, Figure 5A is the second background image in the historical monitoring scene of the first monitoring device, Figure 5B is the first background image in the current monitoring scene of the first monitoring device, and Figure 5C is the current monitoring image of the second monitoring device The fourth background image in the scene. Wherein, the viewing direction of the first monitoring device is the y direction shown in the figure, and the viewing direction of the second monitoring device is the x direction shown in the drawing. The first monitoring device detects that the trees on the road above the screen of the first monitoring device disappear according to the first background image and the second background image, and further detects that there are no trees on the road on the left side of the screen of the second monitoring device according to the fourth background image, Then it can be determined that the environmental facility (greening facility) in the monitoring scene of the first monitoring device has changed, and then a notification message can be sent to the electronic device of the technician linked to the first monitoring device to notify the technician to reset the first monitoring device. Device background.
本实施方式,通过结合第二监控设备采集的背景图像分析判断第一监控设备是否故障以及故障的类型,可以进一步提高监控设备故障检测的准确性。In this embodiment, by analyzing the background image collected by the second monitoring device to determine whether the first monitoring device is faulty and the type of the fault, the accuracy of fault detection of the monitoring device can be further improved.
基于相同的技术构思,本发明实施还提供一种检测监控设备故障的装置200。请参见图6,该装置200包括:Based on the same technical concept, the implementation of the present invention also provides a device 200 for detecting and monitoring equipment failure. Referring to Figure 6, the device 200 includes:
获取模块201,用于获取第一背景图像和第二背景图像;其中,所述第一背景图像为所述装置200当前监控场景中的背景图像,所述第二背景图像为预先存储的所述装置200历史监控场景中的背景图像;The acquiring
计算模块202,用于计算所述第一背景图像和所述第二背景图像的相似度,根据相似度计算结果判断所述装置200的监控场景是否发生变更;A
确定模块203,用于当所述装置200的监控场景发生变更时,确定所述装置200故障。The determining
在一种可能的设计中,所述第一背景图像和所述第二背景图像拍摄有相同物体,或者所述第一背景图像和所述第二背景图像拍摄有相同物体的一部分。In a possible design, the first background image and the second background image capture the same object, or the first background image and the second background image capture a part of the same object.
在一种可能的设计中,所述确定模块203还用于:在确定所述装置200故障之后,基于所述第一背景图像,确定所述装置200的故障类型;所述装置200还包括修复模块,用于当所述装置200的故障类型为不需要人工修复的故障类型时,对所述装置200的故障进行自动修复。In a possible design, the
在一种可能的设计中,所述装置200还包括:发送模块,用于当所述装置200的故障类型为需要人工修复的故障类型时,发送故障通知。In a possible design, the device 200 further includes: a sending module, configured to send a fault notification when the fault type of the device 200 is a fault type requiring manual repair.
在一种可能的设计中,所述确定模块203在基于所述第一背景图像,确定所述装置200的故障类型时,具体用于:从所述第二背景图像中提取第一特征点,并定义所述第一特征点为基准点;确定所述第一背景图像中和所述基准点相匹配的第二特征点;计算所述第二特征点相对于所述基准点的位置偏移量;根据所述位置偏移量判断所述装置200的拍摄视角是否异常;在所述装置200的拍摄视角异常时,确定所述装置200的故障类型为不需要人工修复的故障类型;所述修复模块具体用于:根据所述位置偏移量计算所述装置200的视角偏移量,根据所述视角偏移量调整所述装置200的镜头参数和/或云台参数。In a possible design, when the determining
在一种可能的设计中,所述确定模块203在基于所述第一背景图像,确定所述装置200的故障类型时,具体用于:根据所述第一背景图像确定所述装置200当前监控场景中的监控参数;确定所述装置200当前拍摄参数是否和所述装置200当前监控场景中的监控参数相匹配;在所述装置200当前拍摄参数和所述装置200当前监控场景中的监控参数不匹配时,确定所述装置200的拍摄参数异常,并确定所述装置200的故障类型为不需要人工修复的故障类型;所述修复模块具体用于:确定和所述监控参数相匹配的拍摄参数,并将所述装置200的拍摄参数调整为和所述监控参数相匹配的拍摄参数;或者,重启所述装置200的应用进程;或者,重启所述装置200的系统。In a possible design, when the
在一种可能的设计中,所述拍摄参数包括亮度、色度、饱和度、对比度、锐度、日夜模式转换、曝光、聚焦、背光、白平衡、图像增强、补光灯灯光控制中的至少一种。In a possible design, the shooting parameters include at least one of brightness, hue, saturation, contrast, sharpness, day-night mode conversion, exposure, focus, backlight, white balance, image enhancement, and fill light control. A sort of.
在一种可能的设计中,所述获取模块201还用于:在对所述装置200进行自动修复之后,获取第三背景图像;其中,所述第三背景图像为所述装置200进行自动修复之后所拍摄的监控场景的背景图像;所述计算模块202还用于:计算所述第三背景图像和所述第二背景图像的相似度,根据所述第三背景图像和所述第二背景图像的相似度确定所述装置200的故障是否修复成功;所述装置200还包括发送模块,用于如果所述装置200的故障未修复成功,则发送故障通知。In a possible design, the acquiring
在一种可能的设计中,所述确定模块203在基于所述第一背景图像,确定所述装置200的故障类型时,具体用于:检测所述第一背景图像中是否存在裂纹;在所述第一背景图像中存在裂纹时,确定所述装置200的镜头玻璃破损或脏污,并确定所述装置200的故障类型为需要人工修复的故障类型;所述发送模块具体用于:向所述装置200联动的终端设备发送所述装置200的镜头玻璃破损或脏污的通知信息;或者In a possible design, when the determining
所述确定模块203在基于所述第一背景图像,确定所述装置200的故障类型时,具体用于:在所述第一背景图像中存在雾气特征、且将所述装置200的拍摄参数调整为和雾天相匹配的拍摄参数也未能消除所述雾气特征时,确定所述装置200的镜头进水,并确定所述装置200的故障类型为需要人工修复的故障类型;所述发送模块具体用于:向所述装置200联动的终端设备发送所述装置200的镜头进水的通知信息;或者When the
所述确定模块203在基于所述第一背景图像,确定所述装置200的故障类型时,具体用于:根据所述第一背景图像确定所述装置200当前监控场景中的环境设施状况,以及根据所述第二背景图像确定所述装置200历史监控场景中的环境设施状况;在所述装置200当前监控场景中的环境设施状况和历史监控场景中的环境设施状况不同时,确定所述装置200的监控场景中的环境设施变更,并确定所述装置200的故障类型为需要人工修复的故障类型;所述发送模块具体用于:向所述装置200联动的终端设备发送场景重置的通知信息,以提醒技术人员对所述装置200进行场景重置操作。When the
在一种可能的设计中,所述获取模块201还用于:在所述确定模块203基于所述第一背景图像,确定所述装置200的故障类型之前,获取第四背景图像;其中,所述第四背景图像为第二监控设备当前监控场景中的背景图像,所述第二监控设备当前监控场景和所述装置200当前监控场景至少部分重合;所述确定模块203在基于所述第一背景图像,确定所述装置200的故障类型时,用于:根据所述第一背景图像和所述第四背景图像确定所述装置200的故障类型。In a possible design, the acquiring
上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。All relevant content of the steps involved in the above method embodiments can be referred to the function descriptions of the corresponding functional modules, and will not be repeated here.
需要说明的是,本发明实施例中对单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。在本申请的实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。It should be noted that the division of the units in the embodiment of the present invention is schematic, and is only a logical function division, and there may be another division manner in actual implementation. Each functional unit in the embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
示例性地,上述获取模块201,计算模块202以及确定模块203的功能可以由一个或者多个处理器实现。所述处理器可以是中央处理器单元,通用处理器,数字信号处理器,专用集成电路,现场可编程门阵列或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合来实现,其可以实现或执行结合本申请实施例公开内容所描述的各种示例性的逻辑方框,模块和电路。处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,数字信号处理器和微处理器的组合等。Exemplarily, the functions of the
基于同一技术构思,本发明实施例还提供一种检测监控设备故障的装置300。请参见图7,该装置300包括至少一个处理器301,所述至少一个处理器301与至少一个存储器302耦合;所述至少一个处理器301,用于执行所述至少一个存储器302中存储的计算机程序或指令,以使得所述装置300执行本发明实施例上述检测监控设备故障的方法。Based on the same technical concept, an embodiment of the present invention also provides an apparatus 300 for detecting a monitoring device failure. Referring to FIG. 7 , the device 300 includes at least one
基于同一技术构思,本发明实施例还提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序或指令,当计算机读取并执行所述计算机程序或指令时,使得计算机执行本发明实施例上述检测监控设备故障的方法。Based on the same technical concept, an embodiment of the present invention also provides a computer-readable storage medium, in which a computer program or instruction is stored, and when the computer reads and executes the computer program or instruction, the computer Execute the above-mentioned method for detecting and monitoring equipment faults in the embodiment of the present invention.
基于同一技术构思,本发明实施例还提供一种芯片系统,该芯片系统中包括处理器,还可以包括存储器,用于实现本发明实施例上述检测监控设备故障的方法中所涉及的功能。该芯片系统可以由芯片构成,也可以包含芯片和其他分立器件。Based on the same technical idea, the embodiment of the present invention also provides a chip system, which includes a processor and may also include a memory, for implementing the functions involved in the method for detecting and monitoring equipment faults in the embodiment of the present invention. The system-on-a-chip may consist of chips, or may include chips and other discrete devices.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本申请实施例是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。Embodiments of the present application are described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line,DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,数字通用光盘(digital versatile disc,DVD))、或者半导体介质(例如,固态硬盘(solid state disk,SSD))等。In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, from a website, computer, server, or data center via Wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) transmission to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media. The available medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a digital versatile disc (digital versatile disc, DVD)), or a semiconductor medium (for example, a solid state disk (solid state disk, SSD) ))wait.
显然,本领域的技术人员可以对本申请实施例进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请实施例的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Apparently, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the present application. In this way, if the modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and equivalent technologies, the present application also intends to include these modifications and variations.
Claims (13)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910841584.8A CN110769246B (en) | 2019-09-06 | 2019-09-06 | Method and device for detecting faults of monitoring equipment |
PCT/CN2020/097300 WO2021042816A1 (en) | 2019-09-06 | 2020-06-20 | Method and device for detecting fault in monitoring apparatus |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910841584.8A CN110769246B (en) | 2019-09-06 | 2019-09-06 | Method and device for detecting faults of monitoring equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110769246A CN110769246A (en) | 2020-02-07 |
CN110769246B true CN110769246B (en) | 2023-04-11 |
Family
ID=69330278
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910841584.8A Active CN110769246B (en) | 2019-09-06 | 2019-09-06 | Method and device for detecting faults of monitoring equipment |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN110769246B (en) |
WO (1) | WO2021042816A1 (en) |
Families Citing this family (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110769246B (en) * | 2019-09-06 | 2023-04-11 | 华为技术有限公司 | Method and device for detecting faults of monitoring equipment |
CN111405273A (en) * | 2020-03-02 | 2020-07-10 | 深圳奇迹智慧网络有限公司 | Camera operation and maintenance method and system |
CN111836040A (en) * | 2020-06-15 | 2020-10-27 | 福建通图信息技术有限公司 | Artificial intelligence-based basic resource and technology regulation and control system and method |
CN111787311B (en) * | 2020-07-17 | 2021-08-03 | 江苏中州科技有限公司 | Fault detection system and method for security monitoring camera |
CN112584135B (en) * | 2020-12-15 | 2024-09-17 | 平安国际智慧城市科技股份有限公司 | Monitoring equipment fault identification method, device, equipment and storage medium |
CN114648578A (en) * | 2020-12-18 | 2022-06-21 | 顺丰科技有限公司 | Method and device for detecting shooting angle change, electronic equipment and storage medium |
CN113225461A (en) * | 2021-02-04 | 2021-08-06 | 江西方兴科技有限公司 | System and method for detecting video monitoring scene switching |
CN113011316B (en) * | 2021-03-16 | 2023-05-30 | 北京百度网讯科技有限公司 | Method and device for detecting lens state, electronic equipment and medium |
CN113206994B (en) * | 2021-03-30 | 2023-03-28 | 华为技术有限公司 | Camera automatic engineering survey method and device, electronic equipment, chip and storage medium |
CN113129387A (en) * | 2021-04-22 | 2021-07-16 | 上海眼控科技股份有限公司 | Camera position detection method, device, equipment and storage medium |
CN113179180A (en) * | 2021-04-23 | 2021-07-27 | 杭州安恒信息技术股份有限公司 | Basalt client disaster fault repairing method, basalt client disaster fault repairing device and basalt client disaster storage medium |
CN115695774A (en) * | 2021-07-23 | 2023-02-03 | 北京三快在线科技有限公司 | Camera failure recovery method and device |
CN113298057B (en) * | 2021-07-27 | 2021-10-01 | 浙江力嘉电子科技有限公司 | Exception detection method and device for off-site law enforcement system, electronic device and storage medium |
CN113542698B (en) * | 2021-09-16 | 2022-01-28 | 广州洛克韦陀安防科技有限公司 | Security protection real-time monitoring system based on 5G communication network |
CN114049600A (en) * | 2021-10-18 | 2022-02-15 | 南方电网科学研究院有限责任公司 | A method and device for identifying an icing monitoring device |
CN114040094B (en) * | 2021-10-25 | 2023-10-31 | 青岛海信网络科技股份有限公司 | Preset position adjusting method and device based on cradle head camera |
CN114240826A (en) * | 2021-11-02 | 2022-03-25 | 浙江大华技术股份有限公司 | Abnormal detection method, device, system and electronic device for photographing equipment |
CN116028258B (en) * | 2023-03-22 | 2023-08-18 | 国网智联电商有限公司 | Equipment fault diagnosis method and system based on deep learning |
CN118334584B (en) * | 2024-04-28 | 2025-05-02 | 深圳市俊安建设工程有限公司 | A fire fault identification method and device based on multiple factors |
CN118711135B (en) * | 2024-07-11 | 2025-02-07 | 广州市粤峰高新技术股份有限公司 | A fault detection method and device for data acquisition terminal based on artificial intelligence |
CN118673521A (en) * | 2024-07-22 | 2024-09-20 | 深圳超盈智能科技有限公司 | Data protection method and device based on monitoring memory and memory |
CN119071474A (en) * | 2024-11-03 | 2024-12-03 | 杭州临安数智城市发展有限公司 | Road surface data AI processing system, processing method and camera module |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101098466B (en) * | 2007-07-18 | 2010-07-14 | 中兴通讯股份有限公司 | Method and apparatus for automatic monitoring malfunction of front end platform of video supervisory equipment |
JP2010081318A (en) * | 2008-09-26 | 2010-04-08 | Toyota Motor Corp | View confirmation device for vehicle |
CN101783970B (en) * | 2009-12-22 | 2011-11-09 | 新太科技股份有限公司 | Methods, devices and systems for automatically detecting and managing fault of camera |
JP5603798B2 (en) * | 2011-02-14 | 2014-10-08 | 株式会社キーエンス | Defect detection apparatus, defect detection method, and computer program |
CN104537664A (en) * | 2014-12-25 | 2015-04-22 | 合肥寰景信息技术有限公司 | Method for distinguishing abnormal conditions of monitoring camera on basis of background comparison |
CN105761261B (en) * | 2016-02-17 | 2018-11-16 | 南京工程学院 | A method of detection camera suffers artificial malicious sabotage |
CN108280386B (en) * | 2017-01-05 | 2020-08-28 | 浙江宇视科技有限公司 | Monitoring scene detection method and device |
CN107291044A (en) * | 2017-06-23 | 2017-10-24 | 深圳市盛路物联通讯技术有限公司 | The intelligent control method and system of a kind of lathe running status |
CN108198175B (en) * | 2017-12-28 | 2021-09-10 | Oppo广东移动通信有限公司 | Detection method, detection device, computer equipment and computer readable storage medium |
CN109769116B (en) * | 2019-01-17 | 2020-06-16 | 国网福建省电力有限公司泉州供电公司 | A kind of camera preset position correction method and device |
CN109902633B (en) * | 2019-03-04 | 2021-05-28 | 南京小网科技有限责任公司 | Abnormal event detection method and device based on fixed-position camera monitoring video |
CN109905678B (en) * | 2019-03-21 | 2021-04-23 | 重庆工程职业技术学院 | A coal mine monitoring image defogging processing system |
CN110769246B (en) * | 2019-09-06 | 2023-04-11 | 华为技术有限公司 | Method and device for detecting faults of monitoring equipment |
-
2019
- 2019-09-06 CN CN201910841584.8A patent/CN110769246B/en active Active
-
2020
- 2020-06-20 WO PCT/CN2020/097300 patent/WO2021042816A1/en active Application Filing
Also Published As
Publication number | Publication date |
---|---|
CN110769246A (en) | 2020-02-07 |
WO2021042816A1 (en) | 2021-03-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110769246B (en) | Method and device for detecting faults of monitoring equipment | |
US10070053B2 (en) | Method and camera for determining an image adjustment parameter | |
EP3829163B1 (en) | Monitoring method and device | |
US10277805B2 (en) | Monitoring system and camera device | |
WO2022170702A1 (en) | Mold state monitoring method, apparatus and system, and industrial personal computer and storage medium | |
KR101713684B1 (en) | Monitoring camera of complex filtering type robust to change of visibility state and image monitoring system having the same | |
JP6156163B2 (en) | Image processing apparatus and image processing method | |
KR102592231B1 (en) | Method for diagnosing fault of camera | |
US8659676B2 (en) | Image analysis device and method thereof | |
US11574393B2 (en) | Camera integrity checks in a video surveillance system | |
CN118038332B (en) | Regional warning method and system based on intelligent video identification | |
JP3486229B2 (en) | Image change detection device | |
US20210297573A1 (en) | Imaging device, control method, and storage medium | |
CN113031386B (en) | Abnormality detection method, device, equipment and medium for double-filter switcher | |
JP2011061651A (en) | Suspicious object detection system | |
JP2012124659A (en) | Monitoring system and monitoring method | |
JP2012089918A (en) | Imaging device | |
CN113271457B (en) | Video data abnormality determination method and apparatus, storage medium, and control apparatus | |
CN115018742B (en) | Target detection method, device, storage medium, electronic equipment and system | |
CN112989866B (en) | Object recognition method, device, electronic equipment and readable storage medium | |
JP2022158339A (en) | Detection device, detection method, and program | |
US10902574B2 (en) | Information processing apparatus, image capture system, control method and storage medium | |
CN112822496B (en) | Video analysis method and device | |
CN116894935A (en) | Object recognition method and device, storage medium and electronic device | |
CN114997430A (en) | Camera maintenance detection method and device and parking management system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |