JP4634966B2 - Equipment data analysis processing system and method - Google Patents

Description

  The present invention is connected via a network to a monitoring control system that captures the equipment status of a facility to be monitored and controlled, captures an image signal displayed on the screen on the monitor unit of the monitoring control system as image data, and performs image analysis processing. The present invention relates to an equipment data analysis processing system and method for generating equipment data and storing it.

  When maintaining and operating private generator equipment and air conditioning equipment (hereinafter simply referred to as equipment), it is important to understand the energy usage state of the equipment and operate it while maintaining an optimal efficiency state.

  For this reason, an equipment state is taken into a supervisory control system, which is a computer system having a monitor, and the result is notified to an operator as equipment data. At some sites, the equipment data displayed on the monitor is grasped by the operator and is used to perform operations to set the equipment to the optimal state based on past experience. There are many sites where it is difficult to say that they are fully utilized effectively. This is thought to be because a method for utilizing facility data has not been established in terms of maintaining and improving energy utilization efficiency.

  On the other hand, recently, in order to improve facility operation efficiency, computer systems (hereinafter referred to as facility data analysis processing systems) having various optimum operation algorithms taking into consideration the actual energy usage have been developed. For this reason, there is an increasing demand for efficient operation of equipment while effectively utilizing the existing monitoring control system by connecting the equipment data analysis processing system to the existing monitoring control system.

  That is, it is expected to realize a method of extracting equipment state data from an existing monitoring control system to an equipment data analysis processing system, creating guidance for optimal operation setting, and notifying the operator. When realizing such a system for optimal operation setting, the system for extracting equipment state data from the existing supervisory control system to the equipment data analysis processing system should be a common and open system. This is an important requirement for dissemination.

  As a method for extracting data from the supervisory control computer, a new data transmission device is additionally connected to the input / output port of the supervisory control computer of the supervisory control system, and a program for memory expansion or data transmission is incorporated. However, this method generally requires an enormous amount of work, which requires a large amount of work and exceeds the expected effect after introduction. For this reason, from the viewpoint of reducing the amount of work and cost, a method of collecting data with the equipment data analysis processing system using the function to display equipment status data on the monitor that is normally provided in many monitoring control systems is proposed. Has been.

  For example, the invention disclosed in Patent Document 1 captures image data that displays facility data of a monitoring control system by an facility data analysis processing system, and extracts and generates facility data from the image data.

  FIG. 8 is a block diagram showing a configuration example of such a conventional facility data analysis processing system. As shown in FIG. 8, the monitoring control system 110 that captures data indicating the equipment state of the monitoring control target equipment 100 is connected to the equipment data analysis processing system 130 via the network 120.

  The monitor control system 110 includes a monitor control computer 111 and a monitor control program 112 incorporated therein, an image signal distributor 113, a monitor device 114, an image signal transmission device 115, a signal synthesizer 116, a keyboard (KB) / mouse device 117. , A keyboard (KB) / mouse signal transmission device 118, and the like. The network 120 is composed of various local or wide-area transmission lines.

  The equipment data analysis processing system 130 includes an analysis computer 131 and a keyboard (KB) / mouse signal generation program 132 incorporated therein, an automatic screen call program 133, an image data capture program 134, an image analysis program 135, and an analysis computer. The image data file 136, the equipment data file 137, etc. preserve | saved at 131 various memory or memory | storage devices are comprised.

  In the configuration shown in FIG. 8, data indicating the equipment state of the monitoring control target equipment 100 is collected as follows.

  First, data indicating the state of the monitoring control target equipment 100 is collected by the data collection function of the monitoring control program 112 incorporated in the monitoring control computer 111 of the monitoring control system 110 and stored in the monitoring control computer 111. .

  When a screen call / screen operation signal is output by the screen automatic call program 133 incorporated in the analysis computer 131 of the equipment data analysis processing system 130, a keyboard / mouse signal is generated based on the screen call / screen operation signal. A keyboard / mouse operation signal for calling a screen is generated by the program 132 and transmitted to the keyboard / mouse signal transmission device 118 of the monitoring control system 110 via the network 120. The keyboard / mouse operation data is notified from the keyboard / mouse signal transmission device 118 to the supervisory control computer 111 via the signal synthesizer 116.

  FIG. 9 is a flowchart showing an outline of the operation of the facility data analysis processing system 130 shown in FIG. As shown in FIG. 9, various keyboard / mouse operation signals for calling a screen are sequentially transmitted from the equipment data analysis processing system 130 to the monitoring control system 110 (S11), and these keyboard / mouse The operation signal is sequentially notified to the monitoring control computer 111 of the monitoring control system 110, and a screen corresponding to the keyboard / mouse operation signal is displayed on the monitor device 114 by the monitoring control program 112 (S12).

  That is, on the monitor device 114, a menu selection screen, a target data type, a screen for specifying a date, and the like are sequentially called, and data such as the amount of power used, the measured temperature, and the amount of heat representing the operating state of the equipment are displayed. The screen that displays is called. Alternatively, various screen operations such as continuously switching and displaying data on a screen that has been called and displayed on the screen are performed.

  Here, the image signals displayed on the monitor device 114 of the monitoring control system 110 are displayed on the analysis computer 131 of the equipment data analysis processing system 130 via the network 120 via the image signal distributor 113 and the image signal transmission device 115. (S13), and is captured as image data by the image data capturing program 134 and stored in the image data file 136 (S14).

  The image data stored in the image data file 136 is subjected to image analysis processing for converting the image data into character data by the image analysis program 135, thereby generating facility data in the character data format, and the facility data file 137. (S15). In this case, generally, for example, OCR conversion is adopted as the image analysis process, and as the facility data in the character data format, for example, text format facility data such as CSV format is generated.

JP2004-302990

  By the way, in the prior art shown in FIG. 8, in order to display a screen showing the equipment state on the monitor device 114 of the supervisory control system 110, the equipment data analysis processing system 130 outputs a keyboard / mouse operation signal for calling a screen. The information is generated and notified to the monitoring control computer 111 via the signal synthesizer 116 of the monitoring control system 110 through the network 120.

  When such a keyboard / mouse operation signal notification method is employed, all of the series of keyboard / mouse operation signals transmitted from the facility data analysis processing system 130 for calling a certain screen are displayed on the monitor device 114. It is a necessary condition that it is accurately reflected in all the screens displayed on the screen.

  However, in reality, not all keyboard / mouse operation signals transmitted from the equipment data analysis processing system 130 reach the supervisory control computer 111, for example, when the processing load of the supervisory control computer 111 is high. In some cases, part or all of the keyboard / mouse operation signal may be discarded.

  Thus, when a part or all of the keyboard / mouse operation signal transmitted from the equipment data analysis processing system 130 is discarded, it is automatically discarded regardless of the type of signal. Therefore, for example, when a part of the signal corresponding to the mouse click operation related to the screen selection is discarded, the keyboard transmitted from the equipment data analysis processing system 130 is displayed on the monitor device 114 of the monitoring control system 110. / Inconveniences such as an unauthorized screen not corresponding to the mouse operation signal being displayed or an unauthorized screen operation being performed on the displayed screen occur.

  In this way, when an unauthorized screen display or an unauthorized screen operation that does not correspond to the keyboard / mouse operation signal transmitted from the facility data analysis processing system 130 is performed on the monitor device 114 of the monitoring control system 110, On the facility data analysis processing system 130 side, illegal image data is captured from the monitoring control system 110. For this reason, it is impossible to generate and store facility data that should originally be acquired, and there is a possibility that inconveniences such as generation and storage of incorrect facility data may occur.

  The present invention has been proposed to solve the above-described problems of the prior art, and the purpose of the present invention is to confirm whether or not a correct screen according to the transmitted keyboard / mouse operation signal is displayed. Reliable equipment that can easily and reliably collect equipment data from screens displayed on existing monitoring and control systems by enabling unauthorized screen display and unauthorized screen operations to be stopped promptly A data analysis processing system and method are provided.

  In order to solve the above problems, the facility data analysis processing system of the present invention stores reference image data indicating the characteristics of a screen displayed based on a keyboard / mouse operation signal in advance and actually transmits the keyboard. Whether or not the correct screen corresponding to the transmitted keyboard / mouse operation signal is displayed by determining whether or not the image data of the screen displayed based on the mouse operation signal matches the reference image data This makes it easy to check whether or not.

  The equipment data analysis processing system of the present invention is a system connected to a monitoring control system via a network. Here, the monitoring control system takes in the equipment state of the equipment to be monitored and controlled, outputs a monitoring control processing unit that outputs an image signal indicating the equipment state, a monitoring unit that displays the image signal output from the monitoring control processing unit, And a system including a keyboard / mouse unit for manual operation input.

  The facility data analysis processing system of the present invention basically includes an operation signal generation unit that generates an operation signal of the keyboard / mouse unit and transmits the operation signal to the monitoring control system, and an image signal displayed on the monitor unit. An image data capturing unit that captures as image data, and an image that generates and stores facility data in character data format by performing image analysis processing that converts the image data captured by the image data capturing unit into character data This system includes an analysis unit.

  The facility data analysis processing system of the present invention is characterized in that it includes a screen identification data storage unit and an image determination unit, and a configuration of an operation signal generation unit in addition to the above basic configuration. Here, the screen identification data storage unit displays a screen displayed on the monitor unit as a result of transmission of the operation signal by the operation signal generation unit, and a partial image characteristic to the screen of that type for each different type of screen. This is a portion in which reference image data expressed as a set of data is preliminarily stored with screen identification data that is combined with operation signal specifying data that specifies an operation signal from which a screen of the type is displayed. The image determination unit is actually displayed on the screen based on the screen identification data stored in the screen identification data storage unit each time the screen is displayed on the monitor unit as a result of operation signal transmission by the operation signal generation unit. This is a part for determining whether the image data of the determination target screen matches the reference image data of the operation signal. The operation signal generation unit is configured to continue the generation and transmission of the operation signal only when the determination result by the image determination unit is coincident, and to stop the generation and transmission of the operation signal when they do not coincide with each other. .

  In addition, the equipment data analysis processing method in this invention grasps the above system from the viewpoint of the method.

  According to the present invention, it is possible to confirm whether or not a correct screen corresponding to the transmitted keyboard / mouse operation signal is displayed, and it is possible to quickly stop illegal screen display and illegal screen operation. It is possible to provide a highly reliable equipment data analysis processing system and method capable of easily and reliably collecting equipment data from a screen displayed by an existing monitoring control system.

  Hereinafter, an embodiment of an equipment data analysis processing system according to the present invention will be specifically described with reference to the drawings. In addition, the same code | symbol is attached | subjected to the same part as the conventional installation data analysis processing system shown in FIG. 8, and the overlapping description is abbreviate | omitted suitably.

[Constitution]
FIG. 1 is a block diagram showing a configuration of an equipment data analysis processing system according to an embodiment to which the present invention is applied. As shown in FIG. 1, the facility data analysis processing system 200 of this embodiment has a screen identification data file (screen identification data) in the configuration of the analysis computer 131 of the conventional facility data analysis processing system 130 shown in FIG. A storage unit) 201 and an image determination program (image determination unit) 202 are added.

  Here, the screen identification data file 201 is a screen displayed on the monitor device 114 of the monitoring control system 110 as a transmission result of the keyboard / mouse operation signal by the keyboard (KB) / mouse signal generation program (operation signal generation unit) 132. This is a data file in which the screen identification data indicating the characteristics of each is stored in advance for each different type of screen. The screen identification data file 201 is stored in various memories or storage devices of the analysis computer 131 in the same manner as the image data file 136 and the equipment data file 137.

  FIG. 2 is a diagram showing a data configuration of the screen identification data 210 stored in the screen identification data file 201. As shown in FIG. As shown in FIG. 2, the screen identification data 210 includes a name or number (screen type) 211 indicating the screen type and a set of partial image data characteristic of the screen for each different type of screen. The reference image data 212 to be expressed is combined with the operation signal specifying data 213 for specifying the operation signal from which the screen of the type is displayed.

  In this case, if there is a unique operation signal name such as a name or number that can individually identify the operation signal from which each type of screen is displayed, the unique operation signal name is designated as operation signal identification data. What is necessary is just to use as 213. On the other hand, the reference image data 212 is substantial data expressed as a set of partial image data, but a specific data configuration of the reference image data can be appropriately selected. For example, a unique reference image data name such as a name or number that can identify each reference image data is used, and a table that associates the reference image data name with the screen type and operation signal specifying data is managed. A substantive reference image data file to which the reference image data name is added may be managed separately.

  The image determination program 201 is stored in the screen identification data file 201 each time it is displayed on the monitor device 114 of the monitoring control system 110 as a transmission result of the keyboard / mouse operation signal by the keyboard / mouse signal generation program 132. Based on the screen identification data 210, it has a function of determining whether the image data of the determination target screen that is actually displayed on the screen matches the reference image data of the operation signal.

  Further, along with the addition of the image determination program 201, the keyboard / mouse signal generation program 132 of the present embodiment continues to generate and transmit the keyboard / mouse operation signal only when the determination result by the image determination program 201 matches. In the case of mismatch, it has a function of canceling generation and transmission of keyboard / mouse operation signals.

  Along with the addition of the image determination program 201, the image analysis program 135 of the present embodiment performs an image analysis process on the image data of the screen determined to match the screen only when the determination result by the image determination program 201 matches. If they do not match, the image analysis processing of the image data of the screen is not performed.

[Operation]
In the configuration of the present embodiment as described above, data indicating the equipment state of the monitoring control target equipment 100 is collected as follows. In this embodiment, the operation of the monitoring control system 110 is exactly the same as that of the conventional monitoring control system 110 shown in FIG. 8, and the operation of the equipment data analysis processing system 200 is basically the same as that shown in FIG. 8 is the same as the operation of the conventional facility data analysis processing system 130 shown in FIG. 8, and the following description focuses on characteristic operations that are different from the conventional one.

  FIG. 3 is a flowchart showing an outline of the operation of the equipment data analysis processing system 200 in the present embodiment. As shown in FIG. 3, various keyboard / mouse operation signals for calling a screen are sequentially transmitted from the equipment data analysis processing system 200 to the monitoring control system 110 (S11), and these keyboard / mouse The operation until the operation signal is sequentially notified to the monitoring control computer 111 of the monitoring control system 110 and the screen corresponding to the keyboard / mouse operation signal is displayed on the monitor device 114 (S12) is the same as the conventional operation. is there.

  Then, an image signal displayed on the monitor device 114 of the monitoring control system 110 is transferred to the analysis computer 131 of the equipment data analysis processing system 200 through the network 120 via the image signal distributor 113 and the image signal transmission device 115. The operation up to the transmission (S13), the image data capturing program 134 capturing the image data, and storing it in the image data file 136 (S14) is the same as the conventional one.

  In the equipment data analysis processing system 200 of this embodiment, the image determination program 202 performs image determination processing on the image data stored in the image data file 136 before performing image analysis processing by the image analysis program 135. It differs from the conventional one in the point (S21) to be performed. In this image determination process (S21), the image determination program 202 uses the screen identification data 210 stored in the screen identification data file 201 to determine that the image data of the determination target screen that is actually displayed on the screen is the operation signal. It is determined whether or not it matches the reference image data, and the determination result is notified to the automatic screen calling program 133 and the image analysis program 135.

  When the determination result is a screen match (YES in S22), that is, when a correct screen that should be displayed is displayed by the transmitted keyboard / mouse operation signal, the screen automatic call program 133 displays the screen call / screen. The output of the operation signal is continued, and the keyboard / mouse signal generation program 132 continues the generation / transmission of the keyboard / mouse operation signal (S23). In this case, the image analysis program 135 performs image analysis processing of the image data of the screen determined to match the screen, generates facility data in the character data format, and stores it in the facility data file 137 (S24).

  On the other hand, if the determination result is a screen mismatch (NO in S22), that is, the correct screen that should be displayed by the transmitted keyboard / mouse operation signal is not displayed, and an incorrect screen is displayed. If so, the screen automatic call program 133 stops outputting the screen call / screen operation signal, and the keyboard / mouse signal generation program 132 stops generating / transmitting the keyboard / mouse operation signal (S25). In this case, the image analysis program 135 stops the image analysis processing of the image data of the screen determined to be inconsistent with the screen (S26).

  By performing the characteristic processing (S21 to S26) as described above, an illegal screen that does not correspond to the keyboard / mouse operation signal transmitted from the equipment data analysis processing system 130 on the monitor device 114 of the monitoring control system 110. Is displayed, the illegal screen display can be easily confirmed by the image determination processing by the image determination program 202.

  When the screens do not match, the generation / transmission of the keyboard / mouse operation signal can be automatically stopped, so that the unauthorized screen display or the unauthorized screen operation on the monitor device 114 of the monitoring control system 110 is promptly stopped. can do. In addition, when the screens do not match, the image analysis processing of the image data of the screen is not performed, and there is no inconvenience such as generation and storage of the apologized equipment data from the illegal image data.

[Specific examples of reference image data and image determination processing using the same]
4 to 6 are diagrams illustrating specific examples of the reference image data 212 (FIG. 2) in the screen identification data 210 used by the image determination process (S21) by the image determination program 202. FIG.

  Here, FIG. 4 is a diagram illustrating a plurality of partial images expressing the characteristics of the determination target screen. 5 associates the name or number (partial image name) indicating the partial image of the determination target screen shown in FIG. 4, the coordinates specifying the position, and the name of the image file in which the partial image data is stored. It is a figure which shows the partial image table.

  In the example shown in FIGS. 4 and 5, the reference image data 212 is configured by previously extracting a plurality of characteristic partial image data having characteristics different from those of other screens with respect to the determination target screen. From the viewpoint of simplification of data and simplification of processing, the shape of the partial image is generally a rectangular shape defined by two coordinates, the upper left coordinate and the lower right coordinate, as shown in FIGS. Is desirable.

  FIG. 6 is a diagram showing a data configuration of each image file corresponding to each image file name shown in the partial image table of FIG. In the image file shown in FIG. 6, for each pixel constituting the partial image related to the image file name in the partial image table of FIG. As the color element components constituting the pixel, the sizes of the red element component (R element, R0), the green element component (G element, G0), and the blue element component (B element, B0) are described. For the sake of convenience, the description of specific numerical values of the size of the color element component is omitted in the drawing.

  FIG. 7 is a flowchart showing an example of image determination processing (S21) by the image determination program 202 when the reference image data 212 shown in FIGS. 4 to 6 is used. As shown in FIG. 7, the image determination program 202 uses the image file of the reference image data 212 and the partial image table related to the transmitted keyboard / mouse operation signal, and uses the partial image table for each of the reference image data. A process of determining whether or not the size of the color element component for each pixel matches between the actually displayed image data of the determination target screen and the partial image data is performed on the coordinate range of the data.

[effect]
According to the present embodiment, it is possible to check whether or not a correct screen corresponding to the transmitted keyboard / mouse operation signal is displayed on the monitor device 114 of the monitoring control system 110, and it is possible to check whether an illegal screen display or illegal Providing a reliable equipment data analysis processing system and method capable of collecting equipment data easily and reliably from the screen displayed by the existing monitoring and control system by making it possible to quickly stop a simple screen operation be able to.

  In addition, when an unauthorized screen that does not correspond to the transmitted keyboard / mouse operation signal is displayed, image analysis processing of the image data of the screen is not performed. There is no inconvenience such as generation and storage, and in this respect, the reliability of the collected facility data can be improved.

  Also, by performing image determination processing using color element components for each pixel for each coordinate range of the partial image data, it is possible to determine whether or not a correct screen corresponding to the transmitted keyboard / mouse operation signal is displayed. Can be efficiently realized.

  Furthermore, the method of the present embodiment uses a screen display function on a monitor that is provided almost in common with the monitoring control system, without the need to change the hardware or software of the existing monitoring control system, Equipment data can be easily and reliably collected from the displayed image signal. Therefore, the method of the present embodiment can be easily applied even if, for example, the computer for monitoring control of the monitoring control system and the computer for analysis of the equipment data analysis processing system are computers manufactured by different manufacturers. As described above, the method of the present embodiment can be applied regardless of the hardware and software configurations of the monitoring control system, and is excellent in practicality.

[Other Embodiments]
It should be noted that the present invention is not limited to the above-described embodiments, and various other variations can be implemented within the scope of the present invention. That is, the system configuration, data configuration, and flowchart shown in the drawings are merely examples, and a specific configuration and processing flow can be selected as appropriate. For example, in the above-described embodiment, the case where the equipment data analysis processing system is configured by a single analysis computer has been described. However, this configuration is an example, and specific hardware and software used in the equipment data analysis processing system are described. Various configurations and combinations can be freely selected.

The block diagram which shows the structure of the installation data analysis processing system which concerns on one embodiment to which this invention is applied. The figure which shows the data structure of the screen identification data preserve | saved at the screen identification data file shown in FIG. The flowchart which shows the outline | summary of operation | movement of the equipment data analysis processing system shown in FIG. FIG. 3 is a diagram illustrating a specific example of the reference image data illustrated in FIG. 2, and is a diagram illustrating a plurality of partial images expressing the characteristics of a determination target screen. FIG. 5 is a diagram illustrating a specific example of the reference image data illustrated in FIG. 2, and is a diagram illustrating a partial image table in which the partial image name of the determination target screen illustrated in FIG. . FIG. 6 is a diagram illustrating a specific example of the reference image data illustrated in FIG. 2, and a diagram illustrating a data configuration of each image file corresponding to each image file name illustrated in the partial image table of FIG. 5. 7 is a flowchart showing an example of image determination processing when the reference image data shown in FIGS. 4 to 6 is used. The block diagram which shows the structural example of the conventional equipment data analysis processing system. The flowchart which shows the outline of operation | movement of the installation data analysis processing system shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Monitoring object apparatus 110 ... Monitoring control system 111 ... Monitoring control computer 112 ... Monitoring control program 113 ... Image signal distributor 114 ... Monitor apparatus 115 ... Image signal transmission apparatus 116 ... Signal synthesizer 117 ... Keyboard (KB) / Mouse device 118 ... Keyboard (KB) / mouse signal transmission device 120 ... Network 130 ... Equipment data analysis processing system 131 ... Analysis computer 132 ... Keyboard (KB) / Mouse signal generation program 133 ... Screen automatic call program 134 ... Image data acquisition Included program 135 ... image analysis program 136 ... image data file 137 ... facility data file 200 ... facility data analysis processing system 201 ... screen identification data file (screen identification data storage unit 202 ... image determination program (image determination unit)
210: Screen identification data 211 ... Screen type 212 ... Reference image data 213 ... Operation signal specifying data

Claims (5)

A monitoring control processing unit that captures the equipment state of the equipment to be monitored and outputs and outputs an image signal indicating the equipment state, a monitor part that displays the image signal output from this monitoring control processing part, and a keyboard that performs manual operation input It is connected via a network to a supervisory control system with a mouse part,
An operation signal generation unit that generates an operation signal for the keyboard / mouse unit and transmits the operation signal to the monitoring control system, an image data capturing unit that captures an image signal displayed on the screen as image data, and the image In the equipment data analysis processing system provided with the image analysis unit for generating and storing the equipment data in the character data format by performing the image analysis processing for converting the image data captured by the data capturing unit into the character data,
Reference image data expressing a screen displayed on the monitor unit as a result of transmission of the operation signal by the operation signal generation unit as a set of partial image data characteristic to the screen of that type for each different type of screen. A screen identification data storage unit that stores in advance screen identification data combined with operation signal specifying data for specifying an operation signal that is a source for displaying the type of screen;
An image of the determination target screen that is actually displayed on the screen based on the screen identification data stored in the screen identification data storage unit each time the screen is displayed on the monitor unit as a result of transmission of the operation signal by the operation signal generation unit An image determination unit for determining whether the data matches the reference image data of the operation signal;
The operation signal generation unit is configured to continue the generation and transmission of the operation signal only when the determination result by the image determination unit is coincident, and to stop the generation and transmission of the operation signal when they do not coincide with each other. Equipment data analysis processing system characterized by that. The image analysis unit performs image analysis processing of the image data of the screen only when the determination result by the image determination unit is identical, and does not perform image analysis processing of the image data of the screen when they do not match The equipment data analysis processing system according to claim 1, wherein the equipment data analysis processing system is configured as described above. The reference image data is
As individual partial image data, for each pixel constituting the partial image, an image file that describes the name or number for identifying the pixel, the size of the color element component constituting the pixel,
Each partial image has a partial image table that associates a name or number that identifies the partial image, coordinates that identify the position of the partial image, and a name or number that identifies the image file. The equipment data analysis processing system according to claim 1 or 2. The image determination unit
As an image determination process of whether or not the image data of the determination target screen displayed on the screen as the operation signal transmission result matches the reference image data of the operation signal,
Using the image file of the reference image data of the operation signal and the partial image table, the image data of the determination target screen and the partial image data for the coordinate range of each partial image data in the reference image data of the operation signal The facility data analysis processing system according to claim 3, wherein the processing is performed to determine whether or not the sizes of the color element components for each pixel coincide with each other. A monitoring control processing unit that captures the equipment state of the equipment to be monitored and outputs and outputs an image signal indicating the equipment state, a monitor part that displays the image signal output from this monitoring control processing part, and a keyboard that performs manual operation input It is connected via a network to a supervisory control system with a mouse part,
An operation signal generation unit that generates an operation signal for the keyboard / mouse unit and transmits the operation signal to the monitoring control system, an image data capturing unit that captures an image signal displayed on the screen as image data, and the image Equipment data analysis by an equipment data analysis processing system equipped with an image analysis section that generates and stores equipment data in character data format by performing image analysis processing that converts image data captured by the data capture section into character data In the processing method,
The facility data analysis processing system includes a screen identification data storage unit and an image determination unit,
In the screen identification data storage unit, the screen image displayed on the monitor unit as a transmission result of the operation signal by the operation signal generation unit is displayed for each different type of screen, and partial image data characteristic of the screen of that type Screen identification data that is combined with operation signal specifying data that specifies an operation signal that causes a display of the type of screen to be stored as reference image data expressed as a set of
Whenever the image determination unit displays the screen on the monitor unit as a result of operation signal transmission by the operation signal generation unit, it is actually displayed on the screen based on the screen identification data stored in the screen identification data storage unit. Image determination processing for determining whether the image data of the determination target screen matches the reference image data of the operation signal,
The operation signal generation unit performs a continuation process to continue generation and transmission of the operation signal only when the determination result by the image determination process is coincident, and stops generation and transmission of the operation signal when they are not coincident. A facility data analysis processing method characterized by performing stop processing.

Images