JP2021005751A - Monitoring system and monitoring method - Google Patents

Abstract

To provide a monitoring system and monitoring method, capable of efficiently improving the accuracy of discriminating the status of information source equipment installed in a monitored facility, thereby improving the efficiency of monitoring work.SOLUTION: A monitoring system includes an information processor connected to information source equipment installed in a monitored facility and an image processor connected to the information processor. The information processor generates, based on original data sent from the information source equipment, first facility monitoring status data having a data format that is easy for monitoring persons to recognize, and second facility monitoring status data which has a data format that is easy for the image processor to recognize and which also has contents that are substantially the same as contents of the first facility monitoring status data. The image processor performs recognition processing for the second facility monitoring status data, and, based on the recognition processing results, determines the monitoring status of the facility.SELECTED DRAWING: Figure 4

Description

The present disclosure relates to monitoring systems and monitoring methods.

Patent Document 1 discloses that a character image is printed on the surface of a recording paper in a character recognition device, each character of the character image is converted into a character code, and a code image is generated from this character code. .. Further, in this character recognition device, a code image is printed on the back surface of the recording paper, and the code image is added inconspicuously. On the other hand, in the character recognition device, character data is generated from the code image when the image on the recording paper is read, and the character data is output. As a result, OCR (Optical Character Recognition) processing can be performed quickly while improving character recognition accuracy.

Japanese Unexamined Patent Publication No. 2009-193121

According to the technique of Patent Document 1, it is possible to recognize a character image (in other words, information that is easy for humans to recognize) printed on the surface of a recording paper. However, this technology is applied to the mechanical image recognition of the monitoring status screen generated as data that is easy for humans to recognize based on the measurement data image transmitted from the information source device installed in the facility to be monitored, for example. That is not expected. For example, a person can see and accurately grasp the contents of the monitoring status screen, but when an image recognition device tries to determine the contents of the monitoring status screen by mechanical image recognition, the image captured by the monitoring status screen is captured. Depending on the environment around the recognition device (for example, the illuminance or the color in the monitoring status screen), erroneous recognition may occur when recognizing the image on the monitoring status screen, which may cause a problem that appropriate monitoring work is difficult.

This disclosure was devised in view of the conventional situation described above, and is a monitoring system and monitoring that efficiently improves the accuracy of determining the status of the information source equipment installed in the facility to be monitored and improves the efficiency of monitoring work. The purpose is to provide a method.

The present disclosure is a monitoring system including an information processing device connected to an information source device installed in a facility to be monitored and an image processing device connected to the information processing device. The first facility monitoring status data having a data format easily recognized by the observer based on the original data transmitted from the information source device, and the first data format having a data format easily recognized by the image processing apparatus. A second facility monitoring status data having substantially the same content as the content of the facility monitoring status data of the first is generated, and the image processing device recognizes and processes the second facility monitoring status data, and recognizes the second facility monitoring status data. Provided is a monitoring system that determines the monitoring status of the facility based on the processing result.

Further, the present disclosure is an image monitoring method executed by a monitoring system including an information processing device connected to an information source device installed in a facility to be monitored and an image processing device connected to the information processing device. The information processing device recognizes the first facility monitoring status data having a data format that is easy for the observer to recognize based on the original data transmitted from the information source device, and the image processing device. The second facility monitoring status data having an easy data format and having substantially the same contents as the contents of the first facility monitoring status data is generated, and the image processing apparatus generates the second facility monitoring status data. Provided is an image monitoring method that recognizes status data and determines the monitoring status of the facility based on the recognition processing result.

According to the present disclosure, it is possible to efficiently improve the accuracy of determining the status of the information source equipment installed in the facility to be monitored, and improve the efficiency of the monitoring work.

The figure which shows the configuration example of the monitoring system which concerns on Embodiment 1. The figure which shows the hardware configuration example of an information processing apparatus The figure which shows the hardware configuration example of an image processing apparatus A flowchart showing an example of an operation procedure of image monitoring by the monitoring system according to the first embodiment. Diagram showing an example of a human image Diagram showing an example of a composite image Diagram showing another example of a human image The figure which shows the configuration example of the monitoring system which concerns on Embodiment 2. A flowchart showing an example of an operation procedure of image monitoring by the monitoring system according to the second embodiment. The figure which shows the example of the monitor screen displayed in each monitoring area which concerns on Embodiment 3, and the video output device arranged in each monitoring area. The figure which shows the example of the monitor screen displayed in each monitoring area which concerns on a comparative example, and the image output device arranged in each monitoring area, respectively.

Hereinafter, embodiments in which the monitoring system and monitoring method according to the present disclosure are specifically disclosed will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations for substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate the understanding of those skilled in the art. It should be noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

(Embodiment 1)
FIG. 1 is a diagram showing a configuration example of the monitoring system 5 according to the first embodiment. The monitoring system 5 acquires data (original data) representing the status of the facility from the information source device 8, analyzes the original data, and monitors the status of the facility. The monitoring system 5 can monitor the status of a plurality of facilities by inputting original data from a plurality of information source devices 8 installed in a plurality of facilities, not limited to one facility. Here, for the sake of simplicity, the case of monitoring one facility will be illustrated.

In the following description, examples of facilities to be monitored by the monitoring system 5 include dams and power plants. The information source device 8 is at least one measuring instrument installed in a facility such as a dam or a power plant. For example, the information source device 8 is a water level meter that measures the water level of a dam and a watt-hour meter that measures the amount of power generated by a power plant. The original data are the meter values of the water level gauge and the electricity meter.

The monitoring system 5 includes an information processing device 10, a video switching device 21, a video capturing device 22, an image processing device 30, a notification device 25, and video output devices 23 and 24.

The information processing device 10 generates human image data and machine image data based on the original data transmitted from the information source device 8. The human image data is data that is easy for the observer to recognize by looking at the monitor screen, and is specific data (for example, numbers, characters, graphs, drawings, or) that the observer (human) can visually identify. It is the data of the display screen configured by appropriately arranging (data in which a part or all of them are combined). Therefore, for example, the data of the human image is data such as a table in which the situation of each facility is embodied in characters or numbers, and a time chart in which the situation of one facility is embodied in characters or numbers and expressed in time series (No. 1). It is an example of facility monitoring status data of 1. On the other hand, the machine image data has substantially the same contents as the human image data, but is composed of data that is easy for a machine such as the image processing device 30 to perform recognition processing, and is composed of data that can be easily recognized by an observer (human). It is data composed of data that cannot be visually discriminated (for example, binary data such as a character code, a numerical code, a graph or a drawing, or data in which a part or all of them are combined) as appropriate. Therefore, for example, the data of the machine image is the data of the image (marker) drawn by the two-dimensional code, the bar code, the color code, the density of dots, etc. (an example of the second facility monitoring status data). The data of the machine image may be simple data such as numerical values and character strings. Here, a case where a two-dimensional code is used as the data of the machine image is shown. In addition, the information processing device 10 generates image data of a composite image in which a machine image is superimposed on a human image. The information processing device 10 transmits the image data of the composite image to the video switching device 21.

When the information processing apparatus 10 generates a human image and a machine image, the human image and the machine image may be separately generated from the original data, but the human image is generated based on the original data. After that, a machine image may be generated based on the generated human image. In this case, since the process of generating the machine image is a process independent of the original data, it is easy to change or extend the processing program.

The video switching device 21 inputs the composite image data output from the information processing device 10, and outputs the composite image data to the video output device 23. Further, the video switching machine 21 outputs the data of the composite image to the video capturing device 22. The number of the video switching machines 21 is not limited to one, and may be a plurality of.

The video capture device 22 is a line collecting device (hub) that captures composite image data output from at least one video switching device 21.

The image processing device 30 has at least a function of reading the data of the machine image, and determines the situation of the facility based on the reading result of the data of the machine image. For example, the image processing device 30 may have a code reader and read a two-dimensional code which is a machine image with the code reader. The image processing device 30 outputs the result of image processing to the video output device 24. Further, the image processing device 30 gives an alert notification to the notification device 25 when the condition of the facility is abnormal.

When an alert notification is received from the image processing device 30, the notification device 25 makes an alarm sound, blinks a light, or the like.

The video output device 23 displays a monitor screen (an example of a monitoring status screen) showing the status of the facility in accordance with the instruction from the information processing device 10. The video output device 24 displays a monitor screen showing the status of the facility and the result of the image processing according to the instruction from the image processing device 30.

FIG. 2 is a diagram showing a hardware configuration example of the information processing device 10. The information processing device 10 acquires original data from the information source device 8 and generates data for human images, data for machines, and data for composite images, and includes a processor 11, a memory 12, a storage 13, and a storage 13. It has an input / output interface 14.

The processor 11 realizes various functions by executing a program stored in the memory 12. The processor may include an MPU (Micro processing Unit), a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a GPU (Graphical Processing Unit), and the like.

The memory 12 is used as a working memory of the processor 11. The memory 12 includes a primary storage device (for example, RAM (Random Access Memory), ROM (Read Only Memory)) and the like.

The storage 13 stores the data of the human image generated by the processor 11 and the data of the machine image in association with each other. The association may be performed by generating the data of the composite image in which the human image and the machine image are superimposed, or the identification data that links the human image data and the machine image data with the human. It may be performed by adding to the data of the image for machine and the data of the image for machine. The storage 13 includes a secondary storage device (for example, HDD (Hard Disk Drive), SSD (Solid State Drive)), a tertiary storage device (for example, an optical disk, an SD card) and the like.

The input / output interface 14 includes interfaces such as HDMI (registered trademark) (High-Definition Multimedia Interface) and USB (Universal Serial Bus) capable of transferring image data at high speed.

FIG. 3 is a diagram showing a hardware configuration example of the image processing device 30. The image processing device 30 determines whether or not there is an abnormality in the condition of the facility based on the data of the image for the machine, and if there is an abnormality, alerts the notification device 25. The processor 31, the memory 32, It has a storage 33 and an input / output interface 34.

The processor 31 realizes various functions by executing a program stored in the memory 32. The processor may include an MPU (Micro processing Unit), a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a GPU (Graphical Processing Unit), and the like.

The memory 32 is used as a working memory of the processor 31. The memory 32 includes a primary storage device (for example, RAM (Random Access Memory), ROM (Read Only Memory)) and the like.

The storage 33 stores machine image data. The storage 33 includes a secondary storage device (for example, HDD (Hard Disk Drive), SSD (Solid State Drive)), a tertiary storage device (for example, an optical disk, an SD card) and the like.

The input / output interface 34 includes interfaces such as HDMI (High-Definition Multimedia Interface) and USB (Universal Serial Bus) capable of transferring image data at high speed.

Next, the operation of the monitoring system 5 according to the first embodiment will be shown.

FIG. 4 is a flowchart showing an example of an operation procedure of image monitoring by the monitoring system 5 according to the first embodiment. The monitoring system 5 periodically executes this operation (that is, the operation procedure shown in FIG. 4).

In FIG. 4, the processor 11 of the information processing device 10 inputs the original data from the information source device 8 via the input / output interface 14 (S1). The processor 11 reads the original data and analyzes the contents of the original data (S2). As a result of the analysis, the processor 11 generates a human image based on the original data (S3). The processor 11 further generates a machine image based on the original data as a result of the analysis (S4).

The processor 11 synthesizes a human image and a machine image to generate a composite image (S5). The composite image may be an image in which a machine image is superimposed on a human image, or an image in which a human image is superimposed on a machine image. The processor 11 outputs a composite image to the video switching device 21 via the input / output interface 14 (S6).

The video switching device 21 distributes the composite image to the video output device 23 and the video capture device 22 (S7). The video output device 23 displays a composite image on the monitor screen. The human image included in the composite image displayed on the monitor screen of the video output device 23 is an image that the observer can see and grasp the situation of the facility. The video capture device 22 captures the composite image and outputs it to the image processing device 30 (S8).

The image processing device 30 inputs a composite image (S9). The image processing device 30 performs image processing on the machine image included in the input composite image (S10). The image processing device 30 displays the result of the image processing on the video output device 24 and performs an operation corresponding to the result of the image processing (S11). As a result of image processing, when the condition of the facility based on the original data is abnormal, for example, when the water level of the dam which is the facility is low and the water storage rate is low, the image processing device 30 instructs the notification device 25 to notify the alert. Then, the notification device 25 is activated. The notification device 25 performs operations such as sounding an alarm sound and blinking an alarm lamp. As a result, the observer hm can quickly notice the abnormality of the facility. After that, the monitoring system 5 ends this operation (that is, the operation procedure shown in FIG. 4).

FIG. 5 is a diagram showing an example of the human image GZ1. The human image GZ1 represents a screen showing the state of the dam in chronological order. Here, the water storage rate of the dam is shown in the shaded area in the range of 0% to 100%. The water storage rate scale is indicated by a horizontal line. In addition, the threshold value Th of the water storage rate for determining the state of the dam is indicated by a vertical line. For example, at "date and time: 5/8 10:00: 00", the "reservoir rate is 70 to 80%", indicating the condition of a dam with a high water level. Further, at "date and time: 5/9 10:00: 00", "the water storage rate is almost 100%", indicating the state of the dam that is almost full. Both the water storage rates of 5/8 and 5/9 are above the threshold Th, and the water level of the dam is high.

FIG. 6 is a diagram showing a composite image GZ3. The composite image GZ3 is generated by being synthesized by superimposing the machine image GZ2 on the human image GZ1 shown in FIG. 5, for example. The machine image GZ2 is an image in which the same contents as the human image GZ1 are expressed so that the image processing device 30 can easily grasp the contents. Here, the machine image GZ2 is drawn with, for example, a two-dimensional code. In the composite image GZ3, the mechanical image GZ2 is superposed and arranged in the lower right corner of the human image GZ1. In the image processing device 30, for example, the code reader searches for the mechanical image GZ2 included in the composite image GZ3, performs image recognition, and analyzes the two-dimensional code to grasp the situation of the facility.

FIG. 7 is a diagram showing another example of the human image GZ11. The human image GZ11 is an image showing the status of a plurality of facilities in a table format in a list. Here, dams, power plants, power transmission stations, etc. are shown as a plurality of facilities. The status of the facility is indicated by a shaded area with a horizontal line in the range of OK to NG. For example, the dam is almost OK. The power plant has a low amount of power generation and is in an intermediate situation. The power transmission station has suspended power transmission and is in a situation close to NG. The observer grasps the situation of each facility by looking at the monitor screen of the video output device 23 on which the human image GZ11 is displayed. When a composite image is generated, a machine image representing the same contents as the human image GZ11 is superimposed on a position such as a margin included in the human image GZ11.

In this way, in the monitoring system 5, the observer can judge the situation of the facility by looking at the composite image displayed on the video output device 23. On the other hand, the image processing device 30 can determine the status of the facility by acquiring the data of the machine image included in the composite image. Further, when the image processing device 30 captures the monitoring status screen (an example of the monitor screen) of the video output device 23 and reads the status of the facility, the monitoring status screen is the surrounding environment (for example, the illuminance or the color in the monitoring status screen). ) Makes it difficult to see, the image processing apparatus 30 can decode the two-dimensional code without performing character recognition processing. Therefore, erroneous recognition is suppressed.

As described above, in the first embodiment, the monitoring system 5 includes an information processing device 10 connected to the information source device 8 installed in the facility to be monitored and an image processing device 30 connected to the information processing device 10. Including. Based on the original data transmitted from the information source device 8, the information processing device 10 includes human image data (an example of first facility monitoring status data having a data format) that can be easily recognized by the observer, and image processing. It generates machine image data that is easy for the device 30 to recognize (an example of second facility monitoring status data having substantially the same content as the content of the first facility monitoring status data). The image processing device 30 recognizes the data of the machine image, and determines the presence or absence of an abnormality in the facility (an example of the monitoring status) based on the recognition processing result.

As a result, the monitoring system 5 can efficiently improve the accuracy of determining the status of the information source equipment installed in the facility to be monitored, and can improve the efficiency of the monitoring work.

Further, the processor 11 of the information processing device 10 associates the data of the human image GZ1 (an example of the first facility monitoring status data) with the data of the machine image GZ2 (an example of the second facility monitoring status data). And store it in the storage 13. As a result, the monitoring system can statistically handle data representing the status of facilities, grasp the status of facilities in chronological order, and can monitor a plurality of facilities at once.

Further, the information processing device 10 sends the composite image GZ3 on which the human image GZ1 and the machine image GZ2 are superimposed to the video output device 23 installed in the monitoring room where the observer is present, via the image switching device 21. To display. As a result, the observer can check the status of the facility by looking at the monitor screen.

Further, the information processing device 10 sends the data of the composite image GZ3 on which the human image GZ1 and the machine image GZ2 are superimposed to the image processing device 30. The image processing device 30 captures and inputs the data of the composite image GZ3 via the video capture device 22 (an example of the image capture device). As a result, the image processing device can recognize the machine image included in the composite image and easily grasp the situation of the facility. Therefore, the image processing device can reduce the load of the recognition processing without recognizing the information such as characters included in the human image by using the character recognition function. Therefore, erroneous recognition is suppressed.

Further, the information processing device 10 sends and displays the human image data to the video output device 23 installed in the monitoring room where the observer is present, and also sends the machine image data to the image processing device 30. .. The image processing device 30 captures and inputs machine image data via the video capture device 22. As a result, the video output device 23 can acquire the data of the human image and display only the human image. On the other hand, the image processing device 30 acquires only the data of the machine image. This eliminates the transfer of unnecessary data and eliminates the need for display.

Further, the image processing device 30 displays the data including at least one of the input human image data and the machine image data on the video output device 24. As a result, the video output device 24 can display an image that is easy to recognize for both the observer and the image processing device.

The configuration of the monitoring system is not limited to the configuration shown in the first embodiment described above, and various changes can be made. For example, the surveillance system may be configured such that the video switching device is omitted and the information processing device outputs a human image to the video output device. The video output device displays a human image. The video capture device outputs the composite image to the image processing device.

Further, the monitoring system may be configured such that the information processing device generates a human image and a composite image. The information processing device outputs a human image to a video output device and outputs a composite image to a video capture device. The video output device displays a human image. The video capture device outputs the composite image to the image processing device. The image processing device extracts a human image from the composite image and outputs it to the video output device.

Further, the monitoring system may be configured such that the information processing device generates a human image and a machine image and does not generate a composite image. The information processing device outputs a human image to a video output device and outputs a mechanical image to a video capture device. The video output device displays a human image. The image capturing device outputs the mechanical image to the image processing device. The image processing device outputs the mechanical image to the video output device.

Further, the monitoring system may be provided with an information separation device, and the information processing device may be configured to generate a composite image. The information separation device separates the human image from the composite image and outputs it to the video output device, and separates the machine image from the composite image and outputs it to the video capture device. The video output device displays a human image. The image capturing device outputs the mechanical image to the image processing device. The image processing device outputs the mechanical image to the video output device.

(Embodiment 2)
In the second embodiment, the image processing device 30 captures the composite image data by capturing the composite image displayed on the monitor screen of the video output device without capturing the composite image data from the video switching device. Shown.

The monitoring system according to the second embodiment has substantially the same configuration as that of the first embodiment. The same components as those in the first embodiment are used with the same reference numerals, and the description thereof will be omitted.

FIG. 8 is a diagram showing a configuration example of the monitoring system 5A according to the second embodiment. In the monitoring system 5A, the video switching device is omitted. The video capture device 22A is a camera capable of capturing the monitor screen of the video output device 23. The image processing device 30 inputs the image data of the composite image displayed on the monitor screen captured by the image capture device 22A, and performs image processing on the machine image included in the composite image. The image processing device 30 displays the result of image processing on the video output device 24. Further, the image processing device 30 notifies the notification device 25 of an alert when the condition of the facility is abnormal as a result of the image processing.

FIG. 9 is a flowchart showing an example of an operation procedure of image monitoring by the monitoring system 5 according to the second embodiment. Regarding the same step processing as in the first embodiment, the same step number will be assigned to simplify or omit the description, and different contents will be described. The processing of steps S1 to S5 is the same as that of the first embodiment.

In FIG. 9, the processor 11 of the information processing device 10 synthesizes a human image and a machine image in step S5, generates a composite image, and outputs the composite image to the video output device 23 via the input / output interface 14. (S6A). The video output device 23 displays the composite image on the monitor screen (S7A).

The video capture device 22A captures the monitor screen of the video output device 23, acquires a composite image, and outputs the composite image to the image processing device 30 (S8A). The subsequent operations of step S9 are the same as those of the first embodiment. The image processing device 30 inputs a composite image in step S9. The image processing device 30 performs image processing on the machine image included in the composite image input in step S10. The image processing device 30 displays the result of the image processing on the video output device 24 in step S11, and performs an operation corresponding to the result of the image processing.

As described above, in the monitoring system 5A, the information processing device 10 only needs to generate a composite image and display it on the video output device 23. Therefore, the information processing device 10 can omit the process of transmitting the data of the composite image to the image processing device 30, which is simplified. In addition, a camera, which is a video capturing device, can acquire a composite image by taking an image.

As described above, in the second embodiment, the image capturing device 22 is a camera that captures a human image and a machine image transmitted from the information processing device 10. This makes it easy for the observer to handle the video capturing device. Further, in the monitoring system, the information processing device and the image processing device can be electrically separated, and the information processing device and the image processing device can be arranged far apart.

The configuration of the monitoring system is not limited to the configuration shown in the second embodiment described above, and various changes can be made. For example, the monitoring system may be configured such that the information processing apparatus generates a machine image instead of a composite image. The video output device displays a mechanical image. The video capture device captures the machine image and outputs the machine image to the image processing device. The image processing device outputs the mechanical image to the video output device. In this case, no human image is required, so the observer does not have to monitor the status of the facility.

(Embodiment 3)
In the third embodiment, the image processing device selects one of a human image, a machine image, and a composite image generated by the information processing device, and a human-only monitoring area, a machine-only monitoring area, and a human. The case of distribution to each video output device installed in the monitoring area shared by the machine and the machine is shown. The monitoring area may be a monitoring room that is a closed space or a monitoring place that is an open space.

The monitoring system according to the third embodiment has substantially the same configuration as the first and second embodiments. The same components as those in the first and second embodiments are used with the same reference numerals, and the description thereof will be omitted.

FIG. 10 is a diagram showing a monitor screen displayed on each monitoring area and the video output device arranged in each monitoring area in the third embodiment. In the third embodiment, the image processing device 30 includes a monitoring robot mb capable of recognizing and processing machine image data. The surveillance robot mb is equipped with a camera and can read the data of the machine image by capturing the machine image displayed on the video output device. Further, as an example, the monitoring area includes a monitoring room SA1 in which only the monitoring robot mb monitors using the data of the machine image, a monitoring room SA2 in which the monitoring member hm and the monitoring robot mb coexist and monitor, and a monitoring person. Only hm includes a monitoring room SA3 that monitors using human image data. Video output devices 23A and 23B capable of displaying machine images are arranged in the monitoring room SA1. Video output devices 23C and 23D capable of displaying a composite image are arranged in the monitoring room SA2. Video output devices 23E and 23F capable of displaying human images are arranged in the monitoring room SA3.

The processor 11 of the information processing device 10 stores the monitoring room information in the memory 12. The monitoring room information includes information indicating that the monitoring room SA1 is dedicated to the monitoring robot mb, the monitoring room SA2 is shared by the monitoring member hm and the monitoring robot mb, and the monitoring room SA3 is dedicated to the monitoring member hm. The information processing device 10 transmits machine image data to the video output devices 23A and 23B arranged in the monitoring room SA1 based on the monitoring room information. The video output devices 23A and 23B display mechanical images. Further, the information processing device 10 transmits the composite image data to the video output devices 23C and 23D arranged in the monitoring room SA2 based on the monitoring room information. The video output devices 23C and 23D display a composite image. Further, the information processing device 10 transmits human image data to the video output devices 23E and 23F arranged in the monitoring room SA3 based on the monitoring room information. The video output devices 23E and 23F display human images. The process in which the information processing device 10 delivers the human image, the machine image, and the composite image to the video output devices 23A to 23F is performed in step S6 shown in FIG. 4 of the first embodiment.

In this way, the information processing device 10 selectively transmits at least one of the human image data and the machine image data to the video output devices 23A to 2323F based on the monitoring room information.

As a result, the image processing device can send image data suitable for the subject to be monitored to each monitoring room, and can suppress the sending of useless data. In addition, the monitoring system can clearly distinguish the subject to be monitored in the monitoring room, and can properly manage the location of the monitoring responsibility.

Further, when the image processing device 30 determines that an abnormality has been found as the monitoring status of the facility, the image processing device 30 instructs the notification device 25 connected to the image processing device 30 to notify an alert. As a result, the observer hm can quickly notice the abnormality of the facility.

FIG. 11 is a diagram showing a monitor screen displayed on each monitoring area and a video output device arranged in each monitoring area in the comparative example. In Comparative Example 3, the information processing device 10 transmits the composite image data to the video output devices 23A and 23B arranged in the monitoring room SA1. The video output devices 23A and 23B display a composite image. Further, the information processing device 10 transmits the composite image data to the video output devices 23C and 23D arranged in the monitoring room SA2. The video output devices 23C and 23D display a composite image. Further, the information processing device 10 transmits the composite image data to the video output devices 23E and 23F arranged in the monitoring room SA3. The video output devices 23E and 23F display a composite image. In this case, in any of the monitoring rooms SA1, SA2, and SA3, the monitoring staff and the monitoring robot can monitor the status of the facility, but cannot manage the monitoring room for each monitoring entity. In addition, the information processing device must transmit the data of the composite image to each video output device, which increases the amount of data communication.

As described above, in the monitoring system according to the third embodiment, the image processing device 30 is composed of a monitoring robot mb capable of recognizing and processing machine image data. In the information processing device 10, only the monitoring room SA1 (an example of the first monitoring room) in which only the observer hm monitors using the data of the human image and the monitoring robot mb monitor using the data of the machine image. It holds monitoring room information including a monitoring room SA2 (an example of a second monitoring room) and a monitoring room SA3 (an example of a third monitoring room) in which a monitoring member hm and a monitoring robot coexist and monitor. The information processing apparatus 10 selectively transmits at least one of the human image data and the machine image data based on the monitoring room information.

As a result, the image processing device can send image data suitable for the subject to be monitored to each monitoring room, and can suppress the sending of useless data. In addition, the monitoring system can clearly distinguish the subject to be monitored in the monitoring room, and can properly manage the location of the monitoring responsibility.

Further, in any of the above-described first to third embodiments, the image processing device 30 is connected to the image processing device 25 when it is determined that an abnormality has been found as the monitoring status of the facility. Instruct alert notification to. As a result, the observer hm can quickly notice the abnormality of the facility.

Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can come up with various modification examples, modification examples, replacement examples, addition examples, deletion examples, and equal examples within the scope of claims. It is understood that it naturally belongs to the technical scope of the present disclosure. In addition, each component in the various embodiments described above may be arbitrarily combined as long as the gist of the invention is not deviated.

For example, in the above-described embodiment, the information processing apparatus shows a case where a human image and a machine image are superimposed to generate a composite image, but the human image and the machine image are generated without generating the composite image. Images may be managed separately so that they can be linked with tag data. In this case, the video output device can be displayed on the monitor screen side by side vertically and horizontally without superimposing the human image and the machine image.

The present disclosure is useful as a monitoring system and a monitoring method for efficiently improving the accuracy of determining the status of information source equipment installed in a facility to be monitored and improving the efficiency of monitoring work.

5 Monitoring system 8 Information source device 10 Information processing device 11, 31 Processor 12, 32 Memory 13, 33 Storage 14, 34 Input / output interface 21 Video switching device 22 Video capture device 23, 24 Video output device 25 Notification device 30 Image processing apparatus

Claims (10)

A monitoring system including an information processing device connected to an information source device installed in a facility to be monitored and an image processing device connected to the information processing device.
The information processing device
Based on the original data transmitted from the information source device, the first facility monitoring status data having a data format easily recognized by the observer and the first data format having a data format easily recognized by the image processing apparatus. Generates a second facility monitoring status data that has substantially the same content as the content of the facility monitoring status data of
The image processing device is
The second facility monitoring status data is recognized and processed, and the monitoring status of the facility is determined based on the recognition processing result.
Monitoring system. The information processing device
The first facility monitoring status data and the second facility monitoring status data are associated and accumulated.
The monitoring system according to claim 1. The information processing device
The first facility monitoring status data and the second facility monitoring status data are associated with each other and sent to and displayed on a monitor installed in the monitoring room where the observer is located.
The monitoring system according to claim 1. The information processing device
The first facility monitoring status data and the second facility monitoring status data are associated and transmitted.
The image processing device is
The first facility monitoring status data and the second facility monitoring status data are captured and input via the image capture device.
The monitoring system according to claim 1. The information processing device
The first facility monitoring status data is transmitted to and displayed on a monitor installed in the monitoring room where the observer is located, and the second facility monitoring status data is transmitted to the image processing device.
The image processing device is
The second facility monitoring status data is captured and input via the image capturing device.
The monitoring system according to claim 1. The image processing device displays on the monitor data including at least one of the input first facility monitoring status data and the second facility monitoring status data.
The monitoring system according to claim 4. The image capturing device is a camera that captures the first facility monitoring status data and the second facility monitoring status data transmitted from the information processing device.
The monitoring system according to any one of claims 4 to 6. The image processing device is
It is composed of a monitoring robot capable of recognizing and processing the second facility monitoring status data.
The information processing device
A first monitoring room where only the observer monitors using the first facility monitoring status data, and a second monitoring room where only the monitoring robot monitors using the second facility monitoring status data. Holds monitoring room information including a third monitoring room in which the monitoring staff and the monitoring robot coexist and monitor.
At least one of the first facility monitoring status data and the second facility monitoring status data is selectively transmitted based on the monitoring room information.
The monitoring system according to claim 1. The image processing device is
When it is determined that an abnormality has been found as the monitoring status of the facility, an alert notification is instructed to the notification device connected to the image processing device.
The monitoring system according to any one of claims 1 to 8. An image monitoring method executed by a monitoring system including an information processing device connected to an information source device installed in a facility to be monitored and an image processing device connected to the information processing device.
The information processing device
Based on the original data transmitted from the information source device, the first facility monitoring status data having a data format easily recognized by the observer and the first data format having a data format easily recognized by the image processing apparatus. Generates a second facility monitoring status data that has substantially the same content as the content of the facility monitoring status data of
The image processing device is
The second facility monitoring status data is recognized and processed, and the monitoring status of the facility is determined based on the recognition processing result.
Image monitoring method.

Images