KR20230174889A - A System for Reviewing an Abnormal Operating Condition of a Facility or an Apparatus - Google Patents

Abstract

The present invention relates to a system for reviewing abnormal operation of equipment or equipment. The reviewing system for abnormal operation of a facility or device includes an image acquisition module 11 that acquires continuous video images of a predetermined surveillance area or surveillance object inside or outside the device or facility; An abnormal state detection module 12 that detects an abnormal state from the acquired video image; an image separation/conversion module (13) that separates the image detected by the abnormal state detection module (12) and converts it into a digital image; An abnormal state display module 14 that separates the converted image and displays detection information; and an analysis/storage module 15 that reviews, analyzes and stores the displayed image.

Description

A System for Reviewing an Abnormal Operating Condition of a Facility or an Apparatus}

The present invention relates to a system for reviewing abnormal operation of equipment or devices, and specifically analyzes continuous video images acquired by image acquisition means such as IP (Internet Protocol) cameras to determine abnormal operating conditions that may occur in equipment or devices. It relates to a reviewing system for abnormal operation of equipment or devices that review.

A mechanical device, inspection device, or similar equipment consisting of various mechanical or electrical components may be operated according to a prescribed method. And if such a device or facility breaks down, corresponding measures are taken and the device or facility can operate normally thereafter. Errors or malfunctions of devices or equipment can appear in various forms. For example, errors or malfunctions may occur intermittently before a device or facility can be restored to its normal state. Such intermittent or non-periodic errors or malfunctions are difficult to detect without continuous monitoring of the operating status of the device or facility. Therefore, means need to be created for continuous monitoring of the device or equipment. As a prior art for monitoring the operating state of devices or facilities, Patent Registration No. 10-1464344 discloses a method of detecting an abnormal state through learning the normal state of surveillance video and a surveillance camera and video management method applying the same. Patent Publication No. 10-2017-0010730 discloses a method for non-destructive visual inspection of power generation machinery such as gas turbine engines. Abnormal conditions that occur intermittently in mechanical devices, inspection devices, or similar devices or equipment are generally difficult to detect, and because they occur for a short period of time, it may not be clear whether they have actually occurred. However, if such an error persists, or if the process proceeds or inspection is performed in such a malfunctioning state, defective products may be produced, inspection errors may occur, or process errors may occur. Therefore, such intermittent or non-periodic abnormalities need to be monitored and appropriate measures taken. However, the prior art does not disclose such systems and methods.

The present invention is intended to solve the problems of the prior art and has the following purposes.

Prior art 1: Patent registration number 101464344 (Green IT Korea Co., Ltd., announced on November 25, 2017) Abnormal state detection method through learning normal state of surveillance video and surveillance camera and video management system applying the same Prior Art 2: Patent Publication No. 10-2017-0010730 (Siemens Energy, Inc., published on February 1, 2017) Single-axis inspection scope equipped with a spherical camera and internal inspection method of power generation machinery

The purpose of the present invention is to detect various types of abnormal conditions occurring in the device or facility while acquiring continuous video images of the operating part of the device or facility, to separate related images, and to review and analyze the separated related images. The purpose is to provide a reviewing system for possible abnormal operation of equipment or equipment.

According to a preferred embodiment of the present invention, a reviewing system for abnormal operation of a device or device includes an image acquisition module that acquires continuous video images of a predetermined surveillance area or surveillance object inside or outside the device or device; An abnormal state detection module that detects an abnormal state from the acquired video image; an image separation/conversion module that separates the image detected by the abnormal state detection module and converts it into a digital image; An abnormal state display module that displays detection information on the converted image; and an analysis/storage module that checks, analyzes, and stores the displayed image.

According to another suitable embodiment of the present invention, the image acquisition module includes an IP camera.

According to another suitable embodiment of the present invention, it further includes an external computer transmission module that transmits the image separated by the separation/display module to an external computer.

According to another suitable embodiment of the present invention, the monitoring area is an input area where products are introduced, an inspection area where products are inspected, or an discharge area where products are discharged.

According to another suitable embodiment of the present invention, the inspection object is a product that moves along a defined movement line.

According to another suitable embodiment of the present invention, the abnormal state is a malfunction or error state that occurs intermittently or aperiodically.

The reviewing system for abnormal operation of equipment or equipment according to the present invention enables detection of abnormal operating conditions that occur intermittently during the operation of a machine or equipment. The reviewing system according to the invention makes it possible to detect rare types of abnormal operating conditions, for example where abnormal operation occurs for a very short period of time or momentarily and then returns to the original operating state. The system according to the invention can be applied to various devices or equipment that are kept in continuous operation, such as mechanical devices or equipment, electrical equipment or equipment, inspection equipment or equipment. For example, the system according to the present invention can be applied to an X-ray inspection device to enable detection of flow errors in the inspection object that occur during the inspection input process, inspection process, or discharge process. Additionally, the system according to the present invention enables detection of abnormal conditions occurring inside a mechanical device or facility.

Figure 1 shows an embodiment of a system for reviewing abnormal operation of equipment or equipment according to the present invention.
Figure 2 shows an embodiment of an IP camera module applied to a system according to the present invention.
Figure 3 shows an embodiment of the operating structure of the system according to the present invention.
Figure 4 shows an embodiment of a method for reviewing abnormal operation of equipment or equipment according to the present invention.

Below, the present invention will be described with reference to examples shown in the attached drawings, but the examples are for a clear understanding of the present invention and the present invention is not limited thereto. In the description below, components having the same reference numerals in different drawings have similar functions, so unless necessary for understanding the invention, the description will not be repeated, and well-known components will be briefly explained or omitted, but the present invention It should not be understood as being excluded from the embodiments.

Figure 1 shows an embodiment of a system for reviewing abnormal operation of equipment or equipment according to the present invention.

Referring to FIG. 1, the reviewing system for abnormal operation of a facility or device includes an image acquisition module 11 that acquires continuous video images of a predetermined surveillance area or surveillance object inside or outside the device or facility; An abnormal state detection module 12 that detects an abnormal state from the acquired video image; an image separation/conversion module (13) that separates the image detected by the abnormal state detection module (12) and converts it into a digital image; An abnormal state display module 14 that displays detection information on the converted image; and an analysis/storage module 15 that checks, analyzes, and stores the displayed image.

The image acquisition module 11 may be installed in a predetermined surveillance area, and the surveillance area may be part of the operating part of the device or installation. For example, the device or facility may be an X-ray inspection device that inspects multiple inspection objects that are continuously moved. In addition, in the X-ray inspection device, an input area where the test object is input, an inspection area where the test object is tested, or an discharge area where the test object is discharged may be set as a surveillance area. A surveillance object can be determined in the surveillance area, and the surveillance object can be a part of a device or facility, or an inspection target. Once the monitoring target is determined in the monitoring area, monitoring conditions can be set. Surveillance conditions may include focus position, surveillance boundary area, brightness, or similar image acquisition conditions. Once the monitoring area and monitoring conditions are determined, at least one image acquisition module 11 may be installed for continuous monitoring of the device or facility. The image acquisition module 11 may be, for example, a camera such as an Internet Protocol (IP) camera. Images can be continuously acquired by the image acquisition module 11, and abnormal states can be detected from the acquired images by the abnormal state detection module 12. The abnormal state detection module 12 may have a function to detect the occurrence of an abnormal state from the image acquired by the image acquisition module 11. For example, the abnormal state detection module 12 may include a reference image, and has the function of determining whether an abnormal state or abnormal state occurs by comparing the reference image with the image acquired by the image acquisition module 11. You can. Alternatively, the abnormal state detection module 12 may have a function of detecting a part corresponding to an abnormal state from an acquired video image. The abnormal state detection module 12 can detect a part corresponding to an abnormal state from an image acquired in real time and determine the part corresponding to an abnormal state using various methods. For example, detection of an abnormal state can be performed by a soft program, and an artificial intelligence learning algorithm method can be applied to detect an abnormal state. If it is determined to be in an abnormal state by the abnormal state detection module 12, the image of the corresponding part may be separated by the image separation/conversion module 13, and the separated image may be converted into a digital image. Separation of images can be either capture-based or label-based. If an abnormal condition occurs by the capture method, the corresponding image is captured, and a boundary area may be formed based on the location of the abnormal condition in the captured image. And the outside of the border area can be shaded to create a separate image. Depending on the marking method, the location where an abnormal condition occurred can be marked in various ways, and the marked portion can be converted and processed. Separation of images can be accomplished in various ways, and the present invention is not limited thereto. The separated image converted into a digital image can be combined with monitoring information by the abnormal state display module 14. Monitoring information may include the type of abnormal condition, time of occurrence, location of occurrence, or similar information. Display of surveillance information on separated images can be achieved in various ways, and the present invention is not limited thereto. In this way, if abnormal state-related information or monitoring information is displayed on the separated image, it can be transmitted to the analysis/storage module 15, and the analysis/storage module 15 can be, for example, a personal computer. The abnormal state display module 14 can communicate data with the analysis/storage module 15 through, for example, Wi-Fi communication, Bluetooth communication, or similar short-distance communication means. The abnormal state display module 14 can transmit the displayed separated image to the analysis/storage module 15 through short-distance wireless communication. The analysis/storage module 15 can check and analyze the transmitted image to check for abnormal conditions. And transmitted images, related information, and analysis results can be stored. The analysis/storage module 15 can be located separately from the image acquisition module 11, the abnormal state detection module 12, the image separation/conversion module 13, and the abnormal state display module 14, and can provide various types of It can be an electronic device capable of data analysis, and the present invention is not limited thereby.

Figure 2 shows an embodiment of an IP camera module applied to a system according to the present invention.

Referring to Figure 2, the IP camera module includes a camera body 21; A lens unit 22 formed in front of the camera body 21; A plurality of lighting elements (23_1 to 23_N) disposed along the circumference of the lens unit 22; and a cover (C). Various parts or elements for image generation may be placed inside the camera body 21, and images may be acquired by light introduced through the lens unit 22. The IP camera module may be placed inside a device or facility, and as a result, the brightness necessary for image acquisition may not be secured. At least one lighting element 23_1 to 23_N may be disposed around the lens unit 22 to form an appropriate lighting environment for image acquisition. The light emission level of the lighting elements 23_1 to 23_N may be adjusted, and the illuminance sensor 24 may be installed to create an appropriate lighting environment. A control means may be disposed inside the camera body 21, and the control means may adjust the light emission level of the lighting elements 23_1 to 23_N based on information obtained from the illuminance sensor 24. The environmental sensor module 25 may be installed on the front side of the camera body 21 or at another suitable location, and the temperature, humidity, or similar environmental conditions of the surveillance area may be measured by the environmental sensor module 25. The camera body 21 can be protected by the cover C, and a short-distance communication means can be installed in the IP camera module. The IP camera module can be combined with a fixed jig and installed to monitor the surveillance area. The fixing jig includes an extension arm (27); A fastening block (28) formed at one end of the extension arm (27); and a fixing bracket 29 formed at the other end of the extension arm 27. The fixing bracket 29 can have a structure that can be fixed to a device, facility or structure, and the extension arm 27 can be extended so that the focus of the IP camera module can be formed on the surveillance area. Optionally, the extension arm 27 may have an adjustable length structure. The camera body 21 may be coupled to the fastening block 28, and, for example, a plus-shaped fixing hole 281 may be formed in the fastening block 28. A fastening wing that is inserted into and fixed to the fixing hole 281 may be formed at the bottom of the camera body 21. The camera body 21 may be fixed to the fastening block 28 by a fixing means 282 such as a bolt, screw, or pin. The focus position of the IP camera module may change over time due to various reasons. As a result, images for a designated surveillance area may not be obtained. In order to detect such changes in the surveillance area, positioning units 26a and 26b may be installed on both sides of the lens unit 22. The positioning units 26a and 26b may have a function of monitoring whether the camera is focused at a given position. The positioning units 26a, 26b can be, for example, acceleration sensors, gyro sensors or optical sensors. If the focus of the camera is determined to be outside a predetermined range by detection by the positioning units 26a and 26b, the camera may be automatically focused or a change in the focus position may be transmitted to the management module. A change in the position of the camera focus can be detected in a variety of ways and is not limited to the presented embodiment. Additionally, the fixing jig may have various structures, for example, may have a structure capable of adjusting the inclination of the camera body 21. The IP camera module can be fixed by being coupled to a fixing jig having various structures and is not limited to the presented embodiment.

Figure 3 shows an embodiment of the operating structure of the system according to the present invention.

Referring to FIG. 3, a surveillance image of the surveillance area can be obtained by the IP camera 31, and surveillance conditions can be set in advance. Images acquired by the IP camera 31 may be reviewed by the image review module 32. If an image in an abnormal state is searched for during the review process by the image review module 32, the image may be selected by the abnormal image selection module 33. Specifically, an abnormal label may be assigned to an image corresponding to an abnormal state. Images marked as abnormal may be separated by the data separation/conversion module 34 and converted into digital images. Afterwards, surveillance information can be combined with the separated digital images by the information combining module 35. Monitoring information may include, for example, image acquisition time, temperature, humidity, type of abnormal condition, image acquisition location, or similar information. Image data with information combined in this way can be transmitted to an externally installed personal computer by the external PC transmission module 36 through short-distance communication means. The analysis/storage module 15 may be installed in an external PC, and digital data transmitted by the analysis/storage module 15 may be analyzed and stored. And depending on the analysis results, appropriate measures can be taken for the device or facility.

Figure 4 shows an embodiment of a method for reviewing abnormal operation of a device or facility according to the present invention.

Referring to FIG. 4, the method of reviewing abnormal operation of a device or facility includes the steps of installing at least one IP camera at each of the input, inspection, and discharge sites (P41); A step in which images are acquired continuously and in real time from installed IP cameras and reviewed (P42); A step in which it is confirmed whether an abnormal condition has occurred (P43); A step in which the image for the abnormal state is separated and converted into a digital image (P44); A step of transmitting the converted image to an external computer through wireless communication (P45); and a step (P46) in which the image is confirmed and analyzed on an external computer.

The equipment or device may be various types of inspection devices, for example, an X-ray inspection device that continuously inspects electronic products, batteries, food, or similar products in an in-line manner. The X-ray inspection device includes an input area where products are continuously transferred and supplied; An inspection area having a closed structure; and a discharge area where inspected products are discharged. At least one IP camera can be installed in each area (P41), and surveillance images can be acquired continuously and in real time. Each consecutive image can be reviewed (P42), and whether an abnormal condition has occurred can be determined based on the review results (P43). If no abnormal condition has occurred (N), image review can continue (P42). In comparison, if it is determined that an abnormal state has occurred (Y), the related image can be separated and converted to a digital image (P44). Additionally, surveillance information can be combined with digital images, as described above. The converted image can be transmitted to an external computer through short-distance communication means (P45), and the image can be reviewed on the external computer to determine whether an abnormal condition has occurred. Additionally, the type or cause of an abnormal condition can be analyzed (P46). And confirmation results and analysis results can be saved (P47).

The abnormal state or abnormal state that is the subject of search may mainly occur intermittently or aperiodically. Abnormal conditions include various types of errors or malfunctions, and may occur in the device or equipment itself, or in the inspection object. Abnormal states to be searched in this way include various types of errors or malfunctions that occur during the operation of devices or facilities, and the present invention is not limited thereby.

Although the present invention has been similarly described with reference to the examples presented above, those skilled in the art can make various variations and modifications without departing from the technical spirit of the present invention by referring to the presented practical examples. The present invention is not limited by such variations and modifications, but is limited by the claims appended below.

11: Image acquisition module 12: Abnormal state detection module
13: Image separation/conversion module 14: Abnormal state display module
15: analysis/storage module 36: external computer transmission module

Claims (5)

An image acquisition module 11 that acquires continuous video images of a predetermined surveillance area or surveillance object inside or outside a device or facility;
An abnormal state detection module 12 that detects an abnormal state from the acquired video image;
an image separation/conversion module (13) that separates the image detected by the abnormal state detection module (12) and converts it into a digital image;
An abnormal state display module 14 that displays detection information on the converted image; and
A reviewing system for abnormal operation of a facility or device that includes an analysis/storage module (15) that checks, analyzes, and stores displayed images. The system according to claim 1, wherein the image acquisition module (11) includes an IP camera. The system according to claim 1, further comprising an external computer transmission module (36) for transmitting the image separated by the separation/display module (14) to an external computer. The system according to claim 1, wherein the monitoring area is an input area where the product is input, an inspection area where the product is inspected, or an discharge area where the product is discharged. The system for reviewing abnormal operation of a facility or device according to claim 1, wherein the inspection target is a product that moves along a predetermined movement line.