KR20210100415A - Surveillance system and Method using the multiple recognition information - Google Patents

Abstract

The present invention relates to a monitoring system and a monitoring method using multi-information recognition. The monitoring system using multi-information recognition comprises: an information acquisition unit acquiring screen capture information from at least one equipment device; a relation analysis unit analyzing a relation of screen capture information of equipment devices acquired by the information acquisition unit; and a failure prediction unit identifying whether a fault occurs in accordance with an analysis result in the relation analysis unit, and using previously stored analysis data to predict a failure. By the monitoring system using multi-information recognition, the effect on a system previously constructed on a system including a plurality of devices to be integrated and operated is minimized, and only required screen information is extracted from an operating system of independent devices to allow a user to recognize information as needed. Recognized information is combined to derive new information to facilitate the overall operation of the entire system. If a system failure occurs, fault analysis can be effectively performed.

Description

Surveillance system and method using the multiple recognition information

The present invention relates to a monitoring system and method using multiple information recognition, and more particularly, to a monitoring system and method using multiple information recognition for acquiring screen capture information from at least one equipment device.

Various types of operating systems such as monitoring and control systems are used at the operation site of each industry. Each independently operating system may be constructed and operated as an integrated system if necessary.

By constructing and operating an integrated system, it is possible to improve the convenience and efficiency of the maintainer and to reduce the operating cost by enabling the overall operation of the system with a minimum number of personnel.

However, even if an integrated operating system is built, the information transmitted between devices is limited, and the failure of an independent device may lead to failure of other devices or cause an accident.

In addition, since there are technical and cost problems to integrate and operate all systems, it is common to build an integrated system using only limited information for some important facilities.

At this time, even if you want to change the existing facilities in order to obtain additional information, it is not easy to change the facilities already built into the system because each facility used in the existing industrial site has many interfaces with other facilities. .

If the overall operation and maintenance of the integrated system can collect, monitor, and analyze the necessary information without affecting the existing facilities, the overall operation will be easy and failure analysis in the event of a system failure will be facilitated.

In addition, it becomes possible not only to respond quickly to this, but also to predict or prevent failure in advance.

US 10-1608424 B1 US 10-1632903 B1 US 10-1701278 B1

The present invention is derived from such a technical background, and minimizes the influence on the existing system on an integrated operating system including a plurality of devices, and extracts only the necessary screen information from the operating system of an independent device as desired by the user. A monitoring system using multi-information recognition that can recognize information and derive new information by combining the recognized information to facilitate the overall operation of the overall system and facilitate failure analysis in the event of a system failure The purpose is to provide a method.

In addition, multi-information that can prevent the failure of the entire system in advance by predicting the occurrence of failures as well as analyzing the operating status of facilities scattered throughout the site at a glance in an industrial system in which multiple devices operate organically An object of the present invention is to provide a monitoring system and method using recognition.

In addition, the purpose of this is to provide a monitoring system and method using multi-information recognition that is very easy to expand by simply adding on to the existing equipment without considering the interface between each equipment because it can be added without changing the equipment on the existing system.

The present invention for achieving the above object includes the following configuration.

That is, the monitoring system using multi-information recognition according to an embodiment of the present invention analyzes the correlation between the information acquisition unit acquiring screen capture information from at least one equipment device, and screen capture information of the equipment devices acquired by the information acquisition unit It is characterized in that it comprises a correlation analysis unit and a failure prediction unit to determine whether a failure occurs according to the analysis result in the correlation analysis unit, predicting a failure using the pre-stored analysis data.

On the other hand, the monitoring method for multiple information recognition performed in a monitoring system using multiple information recognition includes the steps of: an information acquiring unit acquiring screen capture information from at least one or more equipment devices, and a correlation analysis unit capturing screens of the acquired equipment devices It is characterized in that it comprises the steps of analyzing the correlation between the information and the failure prediction unit to determine whether a failure occurs according to the analysis result, and predicting the failure using pre-stored analysis data.

According to the present invention, it minimizes the influence on the existing system on the integrated operating system including a plurality of devices, and extracts only the necessary screen information from the operating system of the independent device so that the user can recognize the information as desired, The effect of providing a monitoring system and method using multi-information recognition that not only facilitates the overall operation of the overall system by deriving new information by combining the recognized information, but also facilitates failure analysis in the event of a system failure is derived

In addition, multi-information that can prevent the failure of the entire system in advance by predicting the occurrence of failures as well as analyzing the operating status of facilities scattered throughout the site at a glance in an industrial system in which multiple devices operate organically A monitoring system and method using recognition may be provided.

In addition, since it is possible to add without changing the equipment on the existing system, it is possible to provide a monitoring system and method using multi-information recognition that is very easy to expand by simply adding on to the existing equipment without considering the interface between each equipment. there is.

1 is an exemplary diagram for explaining a monitoring system using multiple information recognition according to an embodiment of the present invention;
2 is a block diagram showing the configuration of a monitoring system using multiple information recognition according to an embodiment of the present invention;
3 is a reference diagram for explaining the operation of a monitoring system using multiple information recognition according to an embodiment of the present invention;
4 is a flowchart of a monitoring method using multiple information recognition according to an embodiment of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as meanings generally understood by those of ordinary skill in the art to which the present invention belongs, unless otherwise defined in particular in the present invention, and excessively comprehensive It should not be construed in the meaning of a human being or in an excessively reduced meaning.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is an exemplary diagram for explaining a monitoring system using multiple information recognition according to an embodiment of the present invention.

The monitoring system 10 using multi-information recognition according to an embodiment of the present invention uses a technique for using an existing facility, a technique for extracting necessary information, a technique for monitoring a new linkage state from the extracted information, and accumulated logged data. implemented including technology.

The monitoring system 10 using multiple information recognition according to an embodiment may include a capture module for receiving an image output signal of an existing facility, and an industrial computer in which a monitoring program is installed and driven.

According to an embodiment, the monitoring system 10 using multi-information recognition acquires image information using a capture module, so that it does not affect the existing facility at all, and implements it even without considering the interface with the existing facility The effect that this is possible is derived.

In general, when a failure occurs in the system, the operator can reveal the cause of the failure through failure analysis. And find a solution to the cause of the failure and correct it.

In one embodiment, the capture module of the monitoring system using multiple information recognition provides two or more monitor outputs. One monitor output is connected to one monitor among the existing maintenance consoles to perform a normal function, and the other monitor output port is connected to the information acquisition unit of the monitoring system using multiple information recognition and maintained from at least one equipment device. Screen capture information for maintenance management or control is acquired and transmitted to the information acquisition unit.

In one embodiment, the existing equipment connected to the monitoring system using multi-information recognition may be implemented to interwork with all systems that recognize and analyze changes in display, such as a control console or a large-screen control facility, as well as a maintenance console.

A typical failure analysis step can be composed of three steps.

First, the fault diagnosis step first performs fault diagnosis. Performing fault diagnosis may be implemented as an act of performing information recognition.

Information recognition is to understand the overall operating status of the facility by combining all performance and status data of the facility. At this time, the status data appears in the form of objective measurement data, status indicators, damage, etc.

In the failure analysis stage, necessary diagnostic information is collected and the cause is analyzed and identified according to past experiences and manuals. In this case, appropriate failure statistics can be obtained. In other words, it is possible to express probabilistic expressions of the symptoms of failure and the cause of the failure.

Then, in the troubleshooting step, if the cause of the failure is found as a result of the analysis in the failure analysis step, a solution method is derived accordingly.

In this case, the solution method can be applied by manual or empirical statistics when the solution method is derived. If it is used as a series of cumulative data, it makes it possible for anyone to easily take action and prevent failure.

The monitoring system 10 using multi-information recognition according to an embodiment may organically collect specific information of facilities that an operation manager wants to analyze by using facilities of an existing system for fault diagnosis.

Receive video output signals from each maintenance console. And it enables operation managers and maintainers to recognize failures by setting the screen area for necessary data.

Since this is already recognized as a failure in an existing facility when a failure occurs, there is no advantage in determining the presence or absence of a failure in the monitoring system 10 using multi-information recognition according to an embodiment.

It monitors the information that can be linked by deriving, recognizing, and linking only the part to be analyzed among the video output signals of various facilities. And if necessary, if a part of the screen related to the fault diagnosis part of each facility is derived, it is also possible to recognize a fault when a fault occurs.

And the monitoring system 10 using multi-information recognition according to an embodiment analyzes the correlation of each information obtained from various facilities for failure analysis. It is also possible to create a correlation between the specifically derived information and additionally set an event alarm.

According to an embodiment, it is possible to collect and analyze in one place how a failure event of an independent facility is correlated with a failure event of another facility. This is the same as the operation manager maintaining several connected facilities together in the failure analysis stage.

It enables quicker and more accurate failure analysis because it is possible to collect and check information on several physically separated facilities at once, and to understand which events affect the entire system.

Thereafter, the monitoring system 10 using multi-information recognition according to an embodiment facilitates the failure action by showing the learned content to the operation manager using the analysis data stored in the database for the failure action.

In addition, when a sudden change is detected, an alarm is output separately, so that an operation manager can perform a preliminary inspection in advance, thereby preventing failure. That is, the monitoring system 10 using multi-information recognition according to an embodiment is a technology derived to prevent failure of an industrial site system including at least one or more facilities in an industrial site in advance.

2 is a block diagram illustrating the configuration of a monitoring system using multiple information recognition according to an embodiment of the present invention.

As shown in FIG. 2 , the monitoring system 10 using multiple information recognition according to an embodiment includes an information acquisition unit 100 , a correlation analysis unit 110 , a failure prediction unit 120 , an event alarm unit 130 , and a report. It includes a generator 140 and a database 150 .

The information acquisition unit 100 acquires screen capture information for maintenance management from at least one or more equipment devices. In an embodiment, the information acquisition unit 100 may include screen capture information according to driving a maintenance management program of at least one or more different equipment from at least one or more equipment devices, or screen capture information according to driving a control program, or a large screen control facility. Acquire display screen capture information, etc.

In an embodiment, the information acquisition unit 100 acquires an information screen through a capture module of a screen signal of a device requiring existing control and monitoring or other information display. At this time, the information can be acquired without changing or modifying the existing system.

In addition, by acquiring and integrating one or more, i.e., multiple screen information from a device requiring control and monitoring or other information display, faults and other information can be guided singly or collectively.

At this time, when one or more screens maintain the same screen base, the recognition of screen capture information is simple. It can perform a software function that recognizes it manually or automatically.

Accordingly, the information acquisition unit 100 may also manually or automatically classify and inform the obstacles or information signals recognized in a plurality of different screen bases.

In this case, when the information acquisition unit 100 automatically recognizes an obstacle or an information signal recognized from a plurality of different screen bases, it is possible to recognize an obstacle or an information signal by the AI screen recognition and AI alarm prediction function.

The information acquisition unit 100 performs network communication with at least one or more equipments in various wired/wireless communication methods.

In this case, the communication method supported by each information acquisition unit 100 is not limited, and devices as well as communication methods using a communication network (eg, mobile communication network, wired Internet, wireless Internet, broadcasting network) that the network may include Data transmission and reception can be performed using a short-distance wired/wireless communication method between the two.

Here, the network is a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), among networks such as the Internet. It may include one or more arbitrary networks.

Further, the network may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, and the like. does not

In one aspect, the at least one equipment device may be a maintenance console for maintaining and managing the at least one equipment device. That is, it receives screen capture information that captures maintenance management screens for a plurality of equipments managed by the maintenance console from the existing maintenance console that manages the maintenance of equipment for each site area.

The correlation analysis unit 110 analyzes the correlation between the screen capture information of the equipment acquired by the information acquisition unit.

According to a characteristic aspect of the present invention, the correlation analysis unit 110 sets the recognition area and range desired by the user from the screen capture information obtained by the information obtaining unit 100, and sets the recognition area and range of the screen capture information within the set recognition area and range. Analyze the relationship.

That is, the correlation analysis unit 110 receives the screen area of data required from the screen capture information acquired by the information acquisition unit 100 from the operation manager. And only necessary information can be extracted from the set data screen area.

The correlation analysis unit 110 provides a user interface screen so that the operation manager can set a necessary information area from the received screen capture information. Setting the screen area can be set in such a way that the operation manager can identify it.

The correlation analysis unit 110 recognizes an event based on the extracted information. For example, when the track is changed to Red-White, it is recognized as Event 1, when it is changed to White-Red, it is Event 2, when it is white flashing, it is Event 3, and when it is red flashing, it is recognized as Event 4.

In this case, the event alarm unit 130 outputs an event alarm when an event occurs as a result of analysis by the correlation analysis unit 110 according to the setting of the operation manager. It can be output as a warning sound or in text format so that the operation manager can check it.

Additionally, the event alarm unit 130 may transmit an event alarm message to a user terminal possessed by a previously registered operation manager when an event occurs. Accordingly, the operation manager can quickly recognize whether an event has occurred, and it is possible to deal with it.

The correlation analysis unit 110 may compare and analyze whether a failure event of an independent facility device has any correlation with a failure event of another facility device by monitoring the occurrence of each event. That is, it is possible to collect and analyze events of the same type that occur in different equipments.

The correlation analysis unit 110 performs comparison and analysis by recognizing that the same failure is recognized even if the event occurrence types between equipment devices are different, even if different types of events occur, as the same failure due to the interworking operation between equipment devices. implemented to do so.

That is, the operation manager can grasp at a glance whether a failure occurs among a large number of equipments in the system and the correlation between failures and failures of equipments.

And the failure prediction unit 120 analyzes the cause according to the past experience and manual stored in the database 150 according to the analysis result in the correlation analysis unit 110 .

The failure prediction unit 120 determines whether a failure occurs, and predicts a failure by using the analysis data pre-stored in the database 150 .

In this case, to predict the failure, the occurrence of failure may be predicted by referring to a manual reflecting the existing failure occurrence history information stored in the database 150 or by monitoring whether it is outside the reference range set by the operation manager. However, the present invention is not limited thereto.

The report generation unit 140 generates a report format including the failure information predicted by the failure prediction unit 120 . According to an embodiment, the report format includes image, text, table, and graph functions, and may be implemented in the form of various types of files that provide editing functions for them.

It includes information on whether or not a general failure has occurred and the cause of failure for the equipment maintained and managed by the monitoring system 10 using multi-information recognition according to an embodiment, and the equipment managed by the equipment.

At this time, the report generating unit 140 analyzes the causes based on the previously stored past failure history information and manuals in the database 150 in the failure prediction unit 120 to analyze the system-wide failure symptoms and failure causes. It is possible to generate a report containing a probabilistic representation of

Therefore, there is an effect that the overall situation of the failure symptoms and failure causes of a large number of equipment in the field system can be grasped at a glance. In addition, based on the failure history information and manuals for each equipment stored in the database 150, the failure history for the entire system can be grasped in an integrated manner. Accordingly, it is possible to simply check overall information such as which equipment part of the system frequently fails and how regularly the failure occurs.

3 is a reference diagram for explaining the overall operation of a monitoring system using multiple information recognition according to an embodiment of the present invention.

That is, the monitoring system 10 according to an embodiment obtains screen capture information from an existing facility device. And from the screen capture information received by the operation manager, the necessary information area is set.

For example, in the screen capture information, you can select information corresponding to Track, Cubicle, and UPS.

Thereafter, information in the set information area can be recognized for each event. And by analyzing the correlation between the recognized multiple information, the failure is predicted by identifying the occurrence and frequency of the event according to the analysis result.

Then, by graphing the occurrence or frequency of events, a report is generated on the occurrence of failures and history of failures.

For example, it is possible to determine the occurrence rate of each event in the Track, predict a failure when the occurrence frequency of Event 4 where red flashing occurs increases from 4% to 72%, and generate and output a report including the corresponding information.

At this time, to determine whether a failure has occurred for each event, the failure can be predicted by referring to the existing failure stored in the database or monitoring whether it is outside the reference range set by the operation manager. However, the present invention is not limited thereto.

The monitoring system according to an embodiment collects many maintenance programs used in the industrial field and collects necessary parts to identify the failure of each facility or to monitor the relationship between them and use it without changing the existing facility to predict the failure. It is a system that can

Any system can be added without affecting the existing equipment at all, and it has the advantage of being very easy to expand by simply adding on to the existing equipment without considering the interface between each equipment.

In addition, if necessary, the operator can use it as a tool to analyze the correlation between specific facilities, and it can detect changes that the operation manager is not aware of and prevent unexpected failures, thereby enhancing system stability and collecting necessary parts of various facilities. This makes it possible to create a new maintenance model by increasing convenience.

4 is a flowchart of a monitoring method using multiple information recognition according to an embodiment of the present invention.

In the monitoring method for multiple information recognition performed in a monitoring system using multiple information recognition according to an embodiment, first, an information acquisition unit acquires screen capture information from at least one equipment device (S400).

The monitoring system using multi-information recognition according to an embodiment may organically collect specific information of facilities that an operation manager wants to analyze by using facilities of an existing system for fault diagnosis.

In one aspect, the at least one equipment device may be a maintenance console for maintaining and managing the at least one equipment device. That is, screen capture information of capturing maintenance management screens for a plurality of equipments managed by the maintenance console is received from the existing maintenance console that manages the maintenance of equipment for each site area.

According to an aspect of the present invention, the analyzing of the relationship comprises setting a recognition area and range desired by the user from the obtained screen capture information (S410), and analyzing the relationship between the screen capture information within the set recognition area and range. .

That is, in the step of analyzing the correlation, a screen area of data required from the screen capture information acquired by the information acquisition unit is set from the operation manager. And only necessary information can be extracted from the set data screen area.

In this case, the step of analyzing the correlation provides a user interface screen so that the operation manager can set the necessary information area from the screen capture information received. Setting the screen area can be set in such a way that the operation manager can identify it.

And the correlation analysis unit analyzes the correlation between the acquired screen capture information of the equipment (S420).

Analyzing the correlation may be performed by performing monitoring on whether an occurrence occurs for each event and comparing and analyzing whether a failure event of an independent equipment has any correlation with a failure event of another equipment. That is, it is possible to collect and analyze events of the same type that occur in different equipments.

In the step of analyzing the correlation, if the same failure is recognized even if the event occurrence types are different between facilities, comparison and analysis can be performed by recognizing the same failure due to the interworking operation between facilities even in different event types. implemented so that

That is, the operation manager can grasp at a glance whether a failure occurs among a large number of equipments in the system and the correlation between failures and failures of equipments.

In this case, the event alarm unit outputs an event alarm when an event occurs (S430) as a result of the analysis in the step of analyzing the correlation (S440).

The event alarm unit outputs an event alarm when an event occurs as a result of analysis by the correlation analysis unit according to the setting of the operation manager. It can be output as a warning sound or in text format so that the operation manager can check it.

Additionally, the event alarm unit may transmit an event alarm message to a user terminal possessed by a previously registered operation manager when an event occurs. Accordingly, the operation manager can quickly recognize whether an event has occurred, and it is possible to deal with it.

And, the failure prediction unit determines whether a failure occurs according to the analysis result, and predicts the failure using pre-stored analysis data (S450).

At this time, to predict the failure, the occurrence of failure can be predicted by referencing the manual reflecting the existing failure occurrence history information stored in the database or by monitoring whether it is outside the reference range set by the operation manager. However, the present invention is not limited thereto.

Thereafter, the report generation unit generates a report format including the failure information predicted in the step of predicting the failure (S460).

The step of generating the report format generates a report format including the failure information predicted by the failure prediction unit. According to an embodiment, the report format may include image, text, table, and graph functions, and may be implemented in the form of various types of files that provide editing functions for them.

It includes information on whether or not a general failure has occurred and the cause of failure for the equipment maintained and managed by the monitoring system using multi-information recognition according to an embodiment, and the equipment managed by the equipment.

At this time, the report generation unit generates a report including the probabilistic expression of the failure symptoms and failure causes throughout the system derived through the process of analyzing the cause based on the manual and past failure history information stored in the database in the failure prediction unit. can do.

Therefore, there is an effect that the overall situation of the failure symptoms and failure causes of a large number of equipment in the field system can be grasped at a glance. In addition, based on the failure history information and manuals for each facility stored in the database, it is possible to comprehensively grasp the failure history of the entire system. Accordingly, it is possible to simply check overall information such as which equipment part of the system frequently fails and how regularly the failure occurs.

The above-described method may be implemented as an application or implemented in the form of program instructions that may be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination.

The program instructions recorded on the computer-readable recording medium are specially designed and configured for the present invention, and may be known and available to those skilled in the computer software field.

Examples of the computer-readable recording medium include a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM and DVD, and a magneto-optical medium such as a floppy disk. media), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.

Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa.

Although the above has been described with reference to the embodiments, those skilled in the art will understand that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. will be able

10: Monitoring system using multi-information recognition
100: information acquisition unit 110: correlation analysis unit
120: failure prediction unit 130: event alarm unit
140: report generation unit

Claims (10)

an information acquisition unit configured to acquire screen capture information from at least one equipment;
a correlation analysis unit that analyzes the correlation between the screen capture information of the equipment acquired by the information acquisition unit; and
a failure prediction unit for determining whether a failure occurs according to the analysis result in the correlation analysis unit and predicting a failure using pre-stored analysis data; Monitoring system using multi-information recognition comprising a.
The method of claim 1,
The correlation analysis unit,
A monitoring system using multiple information recognition, characterized in that the user sets a desired recognition area and range from the screen capture information acquired by the information acquisition unit, and analyzes a correlation between the screen capture information within the set recognition area and range.
3. The method of claim 2,
Monitoring system using multi-information recognition, characterized in that it further comprises;
The method of claim 1,
A monitoring system using multiple information recognition, characterized in that it further comprises; a report generation unit for generating a report format including the failure information predicted by the failure prediction unit.
The method of claim 1,
At least one equipment device is a monitoring system using multiple information recognition, characterized in that the maintenance console.
In the monitoring method for multiple information recognition performed in a monitoring system using multiple information recognition,
acquiring, by an information acquisition unit, screen capture information from at least one equipment device;
analyzing, by a correlation analysis unit, a correlation between the acquired screen capture information of the equipment; and
A monitoring method using multi-information recognition comprising: a failure prediction unit determining whether a failure occurs according to the analysis result, and predicting a failure using pre-stored analysis data.
7. The method of claim 6,
The step of analyzing the relationship is,
A monitoring method using multi-information recognition, characterized in that the user sets a desired recognition area and range from the acquired screen capture information, and analyzes a correlation between the screen capture information within the set recognition area and range.
8. The method of claim 7,
The monitoring method using multi-information recognition further comprising; outputting an event alarm when an event occurs as a result of the analysis in the step of analyzing the correlation by the event alarm unit.
7. The method of claim 6,
The report generation unit generating a report format including the failure information predicted in the step of predicting the failure; Monitoring method using multi-information recognition, characterized in that it further comprises.
7. The method of claim 6,
The monitoring method using multiple information recognition, characterized in that at least one equipment device is a maintenance console.

Images