JP2002149235A - Image data collecting device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image data collecting device which can efficiently store and properly reproduce video data. SOLUTION: A video data control means 16 receive video data stored in a video data temporary buffer 15 in variable collecting cycles based upon a plant state, stores the data in a video data time-series file 17, and stores video data in an event in a video data event occurrence time file 18. Consequently, recording cycles of the video data are made short when the plant becomes abnormal or when an vent occurs to enable more detailed analysis.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image data collecting apparatus for collecting image information captured by a camera installed on site in a plant.

[0002]

2. Description of the Related Art There is a plant monitoring system that monitors a plant by installing a camera at the site of the plant, photographing the site of the plant, and processing image data of the photographed image.

An image processing apparatus used in such a plant monitoring system is disclosed, for example, in Japanese Patent Laid-Open No. 5-799.
There is one disclosed in Japanese Patent Publication No. 51-51. In this surveillance control system, the image data from the ITV camera and the sound information from the audio microphone are associated with the process data so that not only the process data but also the video and audio data are displayed synchronously when the process data is reproduced. I have.

[0004]

However, since the image information input from the camera installed in the plant is stored at a constant period, the amount of information for recording the video data becomes enormous, and the video data is stored. Due to the limitation of the storage capacity of the external auxiliary storage device, video data cannot be stored for a long time. In addition, since the image data is stored at a constant cycle, detailed video data cannot be secured when an event such as a start of operation of a plant device or a failure occurs.

In addition, video information of a camera installed in a plant and sound information from an audio microphone can be collected by managing the time in real time. . Furthermore, when reproducing the plant data, the recorded video and audio can be displayed together with the plant data,
Since it is not possible to add an operator's comment, it may not be possible to properly grasp the plant state.

An object of the present invention is to provide an image data collecting apparatus capable of efficiently storing video data and appropriately reproducing the video data.

[0007]

According to a first aspect of the present invention, there is provided an image data collecting apparatus, comprising: a temporary buffer for temporarily storing video information captured by a camera installed on site in a plant; and a temporary buffer for the video data. Video data control means for fetching the stored video data by changing the collection cycle according to the plant state, a video data time-series file for storing the video data fetched by the video data control means in time series, and the video data control means And a video data event occurrence file for storing the video data at the time of the event captured in step (1).

[0008] In the image data collecting apparatus according to the first aspect of the present invention, the video data control means fetches the video data stored in the video data temporary buffer at a variable collection cycle according to a plant state, and obtains a video data time series file. And the video data at the time of the event is stored in a video data event occurrence file. This allows
In the event of a plant abnormality or event, the recording cycle of the video data can be shortened to enable more detailed analysis.

According to a second aspect of the present invention, in the image data collecting apparatus according to the first aspect, the video data control means changes and stores a predetermined video data collection cycle when an event occurs, The video data before the change of the collection cycle and the video data after the change of the collection cycle are connected and stored in the file when the video data event occurs.

[0010] In the image data collecting apparatus according to the second aspect of the invention, in addition to the operation of the first aspect, when an event occurs, the collection cycle before the event is changed and the video data after the event is generated. Are collected, and the video data before the occurrence of the event and the video data after the occurrence of the event are connected and stored in a file at the time of occurrence of the video data event. Thereby, the video data before and after the occurrence of the event can be easily obtained.

According to a third aspect of the present invention, in the image data collecting apparatus according to the first or second aspect of the present invention, the image data control means includes an image photographed by a site patrol camera different from the site-installed camera. A time is added when data is taken in, and the data is stored in the video data time-series file.

According to the third aspect of the present invention, in addition to the operation of the first or second aspect of the present invention, the image data collecting apparatus according to the first aspect of the present invention captures video data captured by a site patrol camera different from the site-installed camera. , The video data control means adds a time and saves the video data in the video data time-series file. As a result, the video data captured by the on-site patrol camera can be managed by time in the same manner as the video data captured by the on-site camera, and can be centrally managed.

According to a fourth aspect of the present invention, in the image data collecting apparatus according to any one of the first to third aspects, the video data control means includes the video data time-series file and the video data event. The image data stored in the file at the time of occurrence is added with an operator's comment or a plant state and stored.

According to a fourth aspect of the present invention, in the image data collecting apparatus, in addition to the operation of the first aspect of the present invention, a video data time-series file and a video data event occurrence file are stored. An operator's comment and a plant state are added to the obtained video data as needed. Thus, when the video data is reproduced, the comment of the operator and the plant state can be reproduced at the same time, and the video data can be efficiently analyzed.

According to a fifth aspect of the present invention, in the image data collecting apparatus according to any one of the first to fourth aspects, the video data control means is configured to control the video data in accordance with an event state of a plant or an instruction from an operator. The data is stored in another portable auxiliary storage device.

According to a fifth aspect of the present invention, in the image data collecting apparatus, in addition to the operation of the first aspect of the present invention, a video data control means is provided by an event state of a plant or an instruction from an operator. Saves the video data in another portable auxiliary storage device. This promotes effective use of video data outside.

[0017]

Embodiments of the present invention will be described below. FIG. 1 is a configuration diagram of an image data collection device 11 according to an embodiment of the present invention. The site-installed camera 12 is installed at the site of the plant, and captures the site equipment and the status of the site at the plant. FIG. 1 shows one on-site camera 12, but actually a plurality of on-site cameras 12 are installed in the plant, and the status of the site is transmitted to the operator as video data. When a plurality of on-site cameras 12 are installed, a camera image switching device called a switcher is provided.

The image data captured by the on-site camera 12 is transmitted to the image data input means 1 of the image data collecting device 11.
3 to the video data storage means 14. The video data input means 13 receives and digitizes video data input from the on-site camera 12, and stores the video data in the video data temporary buffer 15 by an image data storage function. In the video data temporary buffer 15, the video data is buffered in a format that can be stored in the image data collection device.

The video data control means 16 takes out the video data from the video data temporary buffer 15 and stores the video data in the video data time-series file 17 with the collection cycle varied according to the plant state. When an event occurs, the video data before the event and the video data after the event are connected to create event-time data and stored in the video data event-time file 18 as described later.

On the other hand, the CRT monitoring and control device 19
The CRT monitoring and control device is designated by A, and a plant state is input from the CRT monitoring and control device 19. The plant state is an operation, a stop, a failure, a measured value from a sensor, and the like of a plant component device, and a state quantity calculated from these.

The plant status from the CRT monitoring and control device 19 is input to the video data control means 16 via the plant status input means 20. The plant state input means 20 and the CRT monitoring control device 19 are generally connected by a network such as a LAN.

The video data control means 16 can know the current plant status or the past plant status transition status based on the plant status from the plant status input means 20. The video data control means 16 has the following functions (1) to (5).

(1) A function of storing video data in the video data time-series file 17 by changing the collection cycle.

Normally, video data is stored at a predetermined fixed period, but this collection period is variable depending on the plant state. When the plant is stable and no abnormality has occurred, the video data is stored at a slow cycle, and when the plant falls into an unstable state, the video data is stored at an early cycle.

For example, in a sewage plant, the storage cycle of the image data of the on-site camera 12 installed in the rainwater inflow channel is made variable depending on the rainfall situation. If there is no rainfall, the video data is stored every 10 minutes. If the rainfall is 5 mm or less, the video data is stored every 5 minutes.
The video data is stored in the minute cycle, and when the rainfall is 50mm or more,
The video data is stored every 5 seconds. Since the video data is stored in such a manner, the storage capacity of the video data can be reduced while stabilizing the plant. These video data are
Each is stored in the video data time-series file 17 together with the index information.

In the above description, the collection cycle is variable depending on the state of the plant in the collection of video data. However, the collection cycle may be variable under the following conditions.

The storage cycle is made variable depending on the time zone specified by the operator.・ The storage cycle is variable depending on the day of the week, season, and time zone. -Search for similar dates of plant status, and change the storage cycle according to similar day patterns. -The storage cycle is made variable depending on the remaining capacity of the auxiliary storage device.

(2) The video data control means 16 has a function of storing video data before and after an event of a plant when the event occurs.

Whether an event has occurred in the plant is determined by
The determination is made based on the plant state from the plant state input means 20. The event of the plant is a start / stop or a failure of the plant equipment. For example, when an abnormality occurs in an incinerator of a sludge incineration plant, video data of the incinerator combustion state before and after the event is collected for a predetermined time, at a normal collection cycle before the event occurs, and at a high speed cycle after the event occurs ( For example, recording is performed at a 0.5 second cycle). Then, the video data before and after the occurrence of the event are connected and stored in the video data event occurrence file 18. According to this method, it is possible to save detailed video data before and after an event occurs in a spot-like manner.

In the event, in addition to the start / stop and failure of the plant equipment, it is also possible to collect data before and after the event at a predetermined timing depending on the day of the week, season, and time.

(3) The video data control means 16 has a function of taking in video information recorded by the operator 21a during a tour of a plant site or the like and attaching time information to the video information and storing it in the video data time-series file 17.

It is assumed that the on-site patrol camera 22 can interface with the video data input means 13 and can also interface with information on the time of shooting. The video data from the on-site patrol camera 22 is stored by the video data control means 16 in the video data time-series file 17 together with index information including time information. In addition,
It is also possible to capture audio information in addition to video information.

(4) The video data control means 16 has a function of storing operator comments or plant information in the video data stored in the video data time-series file 17 or the video data event occurrence file 18.

By adding operator comments and plant information to the video data, it can be used not only as video information but also as information having content in the video data.

This is because the operator 21b uses the video display means 23 to watch the video on the CRT display device 28,
A comment or plant information is added to video data by an operator operation input unit 25 using an input device 24 such as a keyboard or a mouse. The input comment and plant information are temporarily stored in the comment adding temporary buffer 26.

The video data control means 16 transmits the added operator input information to the video data time-series file 1.
7 and the video data event occurrence file 18. Thus, the video data to which the information added by the operator is added is completed. The information added by the operator is stored as a layer different from the video data. For this reason, it is possible to cope with both a case where the user wants to view only the video purely and a case where the user wants to view the information added by the operator.

Further, even when the image information is stored in a portable external storage device, the image data, the comment of the operator and the plant information can be displayed together. These data are stored in the video data time series file 17 and the video data event occurrence file 18 together with index information.

In the above description, a case has been described where an operator's comment or plant information is added to video information. However, video information of another camera is added to video information,
It is also possible to add handwritten characters. It is also possible to add form data such as a daily report and a monthly report, and plant history message information.

(5) The video data control means 16 has a function of cutting and storing video data.

This video data can be stored in a portable external storage device (FD, M ○, ZIP, etc.). It is assumed that the video data can be cut out and stored in the video data time-series file 17 and the video data stored in the video data event occurrence file 18.

This is because the operator 21b operates the input device 24
The necessary part is stored in the external storage device 27 by the video data extracting means 29 using the above-mentioned method.
In addition, this is performed by automatically saving in the external storage device 27 according to the plant state input from the plant state input means 20. When an event occurs, it is also possible to automatically save the event in the external storage device 27.

Next, the video display means 23 displays the stored video data on the CRT display device 28 at the request of the operator 21b. Hereinafter, the request contents and the display methods (A) to (E) by the operator 21b will be described.

(A) The video data of the on-site camera 12 specified by specifying the time is reproduced on the CRT display device 28.

This is a method of displaying video data stored in a time series in the video data time series file 17 using time as a key. Since it is a time key, it is intuitive and easy for the operator 21b to understand.

In order to reproduce the scene desired by the operator, it may be difficult to understand only by the time key. Therefore, there are a method of displaying the comment and the plant information added by the operator 21b together with a method of displaying only the video data. Have both sides.

Further, since the video data of the video data time-series file 17 having the variable period of the video data has been filed, it is reproduced and displayed in consideration of time at the time of reproduction. In addition, it is naturally possible to perform operations such as rewinding video data and fast-forwarding such as home VTR.

(B) The video data of the designated camera is reproduced using the comment and the plant information added by the operator as keys.

This is a method for compensating for the poor searchability in the above (A), and is a method of reproducing video data using a comment or plant information added by an operator as a key. Although the comment and the plant information specified by the operator can be reproduced even if they are directly specified, it is also possible to display the information in a list format and allow the operator to select and display it.

(C) The video data is reproduced by designating the event state of the plant (part 1).

This is a method in which the video data of the video data time-series file 17 stored in time series is displayed using a plant event as a key. For example, there is a method of displaying an image from a place where the rainfall exceeds 10 mm. With this method, the operator can watch a video of a scene in which the state of the plant has changed without being conscious of time.

(D) The video data is reproduced by designating the event state of the plant (part 2).

This is similar to the above (C), but reproduces the video data of the video data file 18 at the time of event occurrence, which is recorded before and after the event occurrence. This includes a method of selecting from an event occurrence list and a method of searching for and selecting an event by an operator.

(E) Reproduce the video data stored in the external storage device.

This is a portable external storage device 27.
This is a method to reproduce the data stored in the PC, and can be reproduced on other personal computers. In addition, by setting it in a format that can be displayed by e-mail, a Web browser, or the like, it can be freely reproduced in other places.

Next, FIG. 2 is a hardware configuration diagram of the image data collection device 11 according to the embodiment of the present invention.
The CPU 30 of the image data collecting apparatus 11 includes the video data control unit 16, the video data input unit 13, the video data storage unit 14, the operator operation input unit 25,
This is a central processing unit having functions of various units such as a video display unit 23 and a video data extracting unit 29.

The storage device 31 includes a video data temporary buffer 15, a video data time-series file 17, a video data event occurrence file 18, and a comment addition temporary buffer 2.
6 is a place where each file is mounted. The switcher 32 switches the plurality of field-installed cameras 12 and captures video data into the CPU 30.

The network 34 includes the CPU 30 of the image data collecting device, the CRT monitoring control device 19, and the PLC
(Programmable controller) LAN to connect 33
Network. The PLC 33 inputs information from the on-site plant taken in by the CRT monitoring and control device 19 from the plant. Note that the CPU 30 of the image data collection device takes in data from the plant from the CRT monitoring control device 19 or the PLC 33.

FIG. 3 is a flowchart showing a process of optimizing the storage capacity in the video data control means 16 according to the plant state. First, collection of video data is started (S1). After the video data has been collected, the state of the plant is input (S2), and the collection cycle of the video data is determined from the plant status (S3). Then, it is determined whether or not the period of the collection timing is reached (S4), and if it is the collection timing, the video data is stored (S5).
Thereby, the data collection cycle can be made variable depending on the state of the plant. In other words, it is possible to collect at high speed when necessary and to collect at a slow cycle when unnecessary.
The storage capacity of the stored data can be optimized.

Next, it is determined whether or not the storage area for storing the collected data is full (S6). If the storage area is full, it is determined whether or not the video data can be overwritten (S7). If it is acceptable, the process returns to step S1 after a predetermined time delay (S8). On the other hand, if overwriting is prohibited in the process of step S7, the process is stopped (S9).

Thus, the storage capacity of the video information to be stored can be optimized according to the state of the plant. In other words, the storage capacity used during normal operation of the plant can be minimized, so that video information can be stored for a long time. Conversely, in the event of an abnormality, the recording cycle is shortened, and more detailed video information can be stored.

FIG. 4 is a flowchart showing a process of storing video information before and after an event of a plant in the video data control means 16, and FIG. 4A is a flowchart of a process of storing data before an event occurs. , FIG.
(B) is a flowchart showing the content of processing for saving data after the occurrence of an event.

Data storage before the occurrence of an event is described in FIG.
As shown in (a), a collection cycle of video data is extracted (S1), and if it is a collection timing cycle, video data is stored (S2). Next, the state of the plant is input (S
3) It is determined whether or not an event of stopping the capture of the video data has occurred (S4). If the event of stopping the capture of the video data has occurred, the processing is terminated and the storage of the video data is stopped. On the other hand, when the event of stopping the reading of the video data has not occurred, the process returns to the step S1 and the collection of the video data is continued. As a result, data before the occurrence of the event is created.

Data storage after an event has occurred is described in FIG.
As shown in (b), the data storage cycle is extracted (S
1) The state of the plant is input (S2). Then, it is determined whether or not an event of starting storage of video data has occurred (S3). If an event of starting storage of video data has occurred, the video data is stored (S4). If it is determined in step S3 that a save start event has not occurred, the process proceeds to step S1 and waits for a save start event.

After saving the video data in step S4, it is determined whether the saving for a certain period is completed (S5). When the saving is not completed, the process returns to step S4, and when the saving is completed, the process is terminated.
Thus, data before the occurrence of the event is created.

The video data control means 16 joins the thus obtained video data before the occurrence of the event and the data after the occurrence of the event and saves the data in the file 18 when the video data event occurs. As a result, the video data before and after the occurrence of the event can be efficiently saved.

That is, when an event occurs, by creating and storing the video data before and after the event, it is possible to prevent the video information before and after the event from being overwritten due to the limited storage capacity. Further, the video information before and after the occurrence of the event can be reliably stored without causing a situation in which the storage capacity is insufficient, and the abnormality analysis of the plant can be performed.

FIG. 5 is a flow chart showing the contents of the processing by the video data control means 16 for capturing the video information recorded by the on-site patrol camera 22. First, the operator 21a
It is determined whether or not the video information recorded by the on-site patrol camera 22 is taken into the image data collection device by the on-site patrol (S)
1) If there is a capture request, external video data is input to the image data collection device in a manner similar to a capture port (S2). If the time information is added to the video information, the video information is directly taken in. If the time information is not added, the time information is added according to the instruction of the operator (S3). The data is saved (S4). Then, it is determined whether or not the input of the video information has been completed (S5). If all the video information has been input, the process is terminated.
Return to

By storing the video information recorded by the operator during the on-site patrol in the image data collection device 11, the video data of the plant can be unified and arranged in a time-series manner. Comprehensive management of information becomes possible. In particular, video data at a place where the on-site camera 12 is not installed can be stored as valuable information.

FIG. 6 is a flowchart showing the contents of processing in which the video data control means 16 adds operator comments and plant information to video information. It is determined whether there is an operator's comment and a request for addition of plant information (S1). If there is an addition request, the video data requested to be added is reproduced (S2). It should be noted that the video can be reproduced by designating a time, fast-forwarding or rewinding.

Then, it is determined whether it is a position to add a comment or plant information of the operator (S3). If the position is a position to be added by the operator, a comment and plant information are added to the position and the data is stored (step S3). S
4). Thereafter, it is confirmed whether or not the reproduction of the video data has been completed (S5). If the reproduction of the video data has been completed, the process is terminated, and if the reproduction is left, the process returns to step S2.

Thus, it is possible to add the comment of the operator and the plant information. This comment may be character information input by an operator's key or voice input by the operator, as long as the information to be added is electronic data. The plant information is a state of the plant at the time when this event occurs, and is, for example, an operation state of a plant device, a failure state, analog data from a sensor, and the like.

FIG. 7 is a diagram showing the structure of data to which operator comments and plant information are added. The entire video data 35 includes a plurality of video data (1) to (n), and the added comment information 36 stores a list of added comments. Similarly, the added plant information is stored in a list in the entire plant information 36.

Then, the video data 35 and the comment information 3
6. The plant information 37 is linked as data. For example, when reproducing the video data (2), the comment (2) is linked, and when reproducing the video data (2), the comment (2) is also added. 2) becomes reproducible. Similarly, regarding the plant information, for example, the plant information (1) is linked to the video data (1) and stored. This makes it possible to reproduce the plant information (1) when reproducing the video data (1).

As described above, by superimposing the comment of the operator and the plant information on the video data, it is possible to add the comment of the result after the abnormality analysis by the operator and to store the state of the plant at that time. Thereby, it can be recorded as valuable maintenance data and maintenance data. Further, it is possible to search for a video using the comment or the plant information as a key, and the video can be reproduced not only by the time key but also by the comment or the plant information.

FIG. 8 is a flowchart showing the contents of processing for cutting out video data by the video data control means 16 and storing it in the external storage device 27. First, it is determined whether or not there is a video data cut-off request (S1), and if there is a cut-off request, the video is reproduced (S2). In addition, in the reproduction of the video, it is possible to perform reproduction by designating a time, fast-forward or rewind. Next, it is determined whether or not it is within the cut range (S3). If the cut position is at the cut position, the video data is cut and the data is stored in the specified external storage device 27 (S4). Then, it is confirmed whether or not the reproduction of the video data is completed (S5).
The process ends. If the reproduction of the video data remains, the process returns to step S2. This makes it possible to cut out portable image information.

As described above, the video data is cut out and stored in the external storage device 27, so that the video data can be used by an external personal computer or the like. For example, it can be attached to a report or distributed by e-mail, and information can be provided to specialists.

[0077]

As described above, according to the present invention, the recording capacity of the video information stored in the storage device is optimized according to the state of the plant. On the contrary, when an abnormality occurs, the recording cycle is shortened, and finer reproduction of video information becomes possible. In addition, since the video information before and after the occurrence of the event can be reliably stored, an abnormality analysis of the plant can be performed.

The information recorded by the operator during the on-site patrol can also be stored in the image data collection device, so that the comprehensive management of the video information of the plant becomes possible.

Since operator comments and plant information can be superimposed on the video data, it can be recorded as valuable maintenance data and maintenance data. Further, since the video data can be stored in the external storage device, it is possible to easily provide information to specialists.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an image data collection device according to an embodiment of the present invention.

FIG. 2 is a hardware configuration diagram of the image data collection device according to the embodiment of the present invention.

FIG. 3 is a flowchart showing a process of optimizing a storage capacity according to a plant state in a video data control unit according to the embodiment of the present invention.

FIG. 4 is a flowchart showing a process of storing video information before and after the occurrence of an event of a plant in the video data control means according to the embodiment of the present invention, and FIG. FIG. 4B is a flowchart showing the content of the data storage process after the event occurs.

FIG. 5 is a flowchart showing a process of capturing video information recorded by the on-site patrol camera in the video data control means according to the embodiment of the present invention.

FIG. 6 is a flowchart showing processing for adding operator comments and plant information to video information by the video data control means according to the embodiment of the present invention.

FIG. 7 is a configuration diagram of data to which an operator comment and plant information are added according to the embodiment of the present invention.

FIG. 8 is a flowchart showing a process of cutting video data and storing the video data in an external storage device by the video data control means according to the embodiment of the present invention.

[Explanation of symbols]

11: Image data collection device, 12: On-site camera, 1
3 ... Video data input means, 14 ... Video data storage means,
15: Video data temporary buffer, 16: Video data control means, 17: Video data time-series file, 18: Video data event occurrence file, 19: CRT monitoring control device, 20: Plant status input means, 21: Operator,
Reference numeral 22: on-site patrol camera, 23: video display means, 24: input device, 25: operator operation input means, 26: temporary buffer for adding comments, 27: external storage device, 28: CR
T display device, 29 ... Video data extracting means, 30 ... C
PU, 31: storage device, 32: switcher, 33: P
LC, 34 ... Network

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) H04Q 9/00 311 H04Q 9/00 311J 321 321E 341 341A F term (reference) 5C054 AA01 EA05 EA07 FA01 GB05 GD06 GD07 HA01 HA18 5C087 AA02 AA03 AA04 AA08 AA10 AA24 BB74 DD08 DD21 EE05 EE14 FF01 FF02 FF04 FF19 GG02 GG17 GG23 GG30 GG37 GG81 GG90 5H223 AA01 CC08 DD03 DD07 DD09 EE06 FF03 5K048 AA04 FC23 HA02 EB03 DC08

Claims (5)

[Claims] A video data temporary buffer for temporarily storing video information captured by a camera installed on site of a plant;
A video data control means for capturing the video data stored in the video data temporary buffer at a variable collection period according to a plant state; and a video data time-series file for storing the video data captured by the video data control means in a time-series manner. A video data event occurrence file for storing video data at the time of the event captured by the video data control means. 2. The image data control means changes and stores a predetermined video data collection cycle when an event occurs, and connects the video data before the collection cycle is changed to the video data after the collection cycle is changed. 2. The video data event occurrence file is also stored in the file.
An image data collection device according to claim 1. 3. The video data control means adds a time when capturing video data captured by a site patrol camera different from the site-installed camera, and saves the video data in the video data time-series file. The image data collection device according to claim 1 or 2, wherein 4. The video data control means adds an operator's comment or a plant status to video data stored in the video data time-series file and the video data event occurrence file, and saves the video data. The image data collection device according to any one of claims 1 to 3, wherein 5. The image data control means according to claim 1, wherein the image data is stored in another portable auxiliary storage device according to an event state of a plant or an instruction from an operator. The image data collection device according to claim 1.