JP3213284B2 - Plant monitoring equipment - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] The present invention relates to a plant monitoring apparatus using images.

[0002]

2. Description of the Related Art Conventionally, a plant monitoring system using images generally detects an object or the like entering a field of view of a video camera, and as a part of the system, monitors an instrument panel of a plant using a camera. There are applications.

However, when monitoring the entry of an object, it is necessary to prepare dedicated hardware in addition to the camera, and the processing apparatus requires a high capability. Also, monitoring of the instrument panel is better than monitoring with dedicated hardware.
People are directly monitoring images and taking necessary actions. Human monitoring has to be continuously focused on nerves, which is difficult in terms of long-term monitoring. Therefore, it is desirable to perform plant monitoring independently of humans, but this involves a problem that large and expensive equipment must be introduced.

[0004]

SUMMARY OF THE INVENTION The present invention has been made in view of such needs and problems, and has been developed without using dedicated hardware and without using a high-performance processing apparatus. An object of the present invention is to provide an apparatus capable of performing plant monitoring by processing.

[0005]

According to a first aspect of the present invention, there is provided a plant monitoring apparatus for photographing a plant state display panel on which a display for displaying a process state of a plant or a state of equipment is arranged, and obtaining a video signal and a video signal. A video input device, a video coding transmission device that inputs the video signal and transmits it as coded data, a video processing device that processes the coded data, and data that has been processed by the video processing device. A moving image display device for displaying a result, wherein the moving image processing device decodes the encoded data in block units to obtain decoded moving image data; and Static / moving determining means for determining whether an image in a block is in a stationary state or in a moving state for each block of moving image data and detecting a moving block,
A specific color block determining means for determining whether the block is a specific color specified in advance from the color data of the moving block and detecting an object of a specific color, and the specific block and the plant state display panel A display determining means for specifying a display corresponding to the specific color block and determining the display content is provided, wherein the plant status display panel is monitored to specify the display content of the display.

According to the first aspect of the present invention, for example, it is possible to automatically detect, for example, an alarm or the lighting of an instruction lamp without laying a large amount of networks.

According to a second aspect of the present invention, in the plant monitoring apparatus according to the first aspect of the present invention, the display judging means includes an adjoining unit which is judged to be the same specific color by the specific color block judging unit. A set of specific color blocks to be separated into a set of specific color blocks corresponding to one display, and a specific color block separation and identification means for identifying the display corresponding to the set of separated specific color blocks. It is characterized by the following.

According to the second aspect of the present invention, for example, when adjacent alarms are simultaneously turned on, each of them is identified,
Can be detected.

According to a third aspect of the present invention, in the plant monitoring apparatus according to the first aspect, an angle formed between a photographed video projection surface of the plant status display panel and a display surface of the plant status display panel. Angle detection means for detecting the position, the arrangement projection map creating means for creating an arrangement projection map projecting the indicator arrangement diagram of the plant state display panel on the projection plane, the reduction ratio of the arrangement projection map together Means for specifying the displayed display device by superimposing it on the display of the image display means.

[0010] According to the third aspect of the present invention, the display can be correctly specified even if a video image of the plant status display panel taken from an oblique direction is used as a moving image input.

According to a fourth aspect of the present invention, in the plant monitoring apparatus according to the third aspect, when a specific color is detected, the degree of overlap between the detection area and the display area of the arrangement projection is determined. A display specifying means for reading and specifying the display is provided.

According to the fourth aspect of the present invention, it is possible to correctly specify even when a deviation occurs between the set position of the device and the actual position on the moving image.

According to a fifth aspect of the present invention, there is provided a plant monitoring apparatus in which a state value of a process of a plant is indicated by a rotation angle of a needle, and a needle pointing type in which a tip portion and a starting point of the needle are colored in a specific color. A video input device that captures a plant status display panel having a transmitter and converts the video signal into a video signal, a video coding transmission device that receives the video signal and converts the video signal into coded data, and processes the coded video data. A moving image processing device, and a moving image display device that displays a result processed by the moving image processing device, wherein the moving image processing device decodes the moving image data by decoding the data in blocks. A still / moving block determination color determining means for determining whether an image in a block is in a stationary state or a moving state for each block of moving image data and detecting a moving block; and generating the specific color. Judged And a pointing angle reading means for reading the angle of the needle from the coordinates of the tip of the needle and the coordinates of the starting point of the needle of the needle indicating type display which has moved from the position of the block. .

According to the invention described in claim 5, it is possible to automatically confirm the indicated value of the rotary meter by a simple method.

According to a sixth aspect of the present invention, there is provided a plant monitoring apparatus for photographing a plant state display panel having an indicator for indicating a state value of a process of a plant and coloring a background of an area where an indicator moves. A video input device, a video coding transmission device that receives the video signal and converts it to coded data, a video processing device that processes coded video data, and a video processing device that processes the video signal. A moving image display device for displaying the decoded result, wherein the moving image processing device decodes the moving image data in units of blocks, and the image in the block is static for each block of the decoded moving image data. A still / moving block determining means for determining whether a state is present or a moving state and detecting a moving block; and determining the occurrence of a specific color from the color data of the moving block. A specific color determination unit, is characterized in that it has a command value specifying means for specifying an indication from the size of the determined contiguous blocks of said specific color generation.

According to the invention described in claim 6, even in the case of a meter or the like in which the pointer moves linearly, the indicated value can be correctly monitored by a simple method.

According to a seventh aspect of the present invention, in the plant monitoring apparatus according to any one of the first to sixth aspects, the moving image display device includes a graphics corresponding to the photographed display and the indicator. A screen database is provided, and the display of the specific result is displayed together with the corresponding graphics screen to clarify the display contents.

According to the seventh aspect of the invention, the contents detected by the plant monitoring device can be grasped in an easy-to-understand form, and the response can be facilitated.

The plant monitoring apparatus according to claim 8 of the present invention captures an image of a plant state display panel on which at least one of a display unit and an indicating instrument for displaying a process state of a plant and a state of equipment is arranged. A fixed video input device that captures a wide range and shoots a wide area to generate a video signal, a video coding transmission device that inputs the video signal and converts the video signal to coded data, and a video processing that processes the coded data Device, and a moving image display device that displays a result of data processing performed by the moving image processing device, wherein the moving image processing device decodes the encoded data in block units and decodes the decoded moving image. A moving image decoding means for determining whether the image in the block is still or moving for each block of the decoded moving image data; A movement determination means for detecting the click,
A specific color object determining means for determining whether the block is a specific color specified in advance from the color data of the moving block and detecting an object of a specific color; and the specific color block is formed continuously. Object size specifying means for specifying the size of the specific color object from the pattern, and position specifying means for detecting the position of the specific color object, further,
A moving image input device is provided that sets a shooting direction, a position, and an enlargement ratio based on the size and the position of the specific color object and clearly captures an image of the specific color object. According to the eighth aspect of the present invention, it is possible to automatically shoot a clear image following the movement of the object and the color detection.

According to a ninth aspect of the present invention, in the plant monitoring apparatus according to the eighth aspect, when the specific color object is not detected, an image input and processed from the fixed video input device is processed. When the specific color object is detected and transmitted to the moving image display device, the image of the movable image input device is transmitted to the moving image display device, and the transmission data of the image input and processed from the fixed image input device is transmitted. By transmitting the image in a reduced amount, the image by the movable image input device and the image input and processed from the fixed image input device can be simultaneously displayed.

According to the ninth aspect of the present invention, the video to be transmitted can be switched according to the situation, for example, and the increase in the network load can be suppressed.

According to a tenth aspect of the present invention, there is provided a plant monitoring apparatus for photographing a plant state display panel on which at least one of an indicator and an indicating instrument for displaying a state of a process of a plant and a state of equipment is arranged. A fixed image input device that fixes the position and shoots a wide area to make a video signal,
A moving image encoding and transmitting device that receives the video signal and converts it into encoded data, a moving image processing device that processes the encoded data, and a moving image display that displays a result of the data processing performed by the moving image processing device A moving image processing device or a moving image display device, a moving image storage unit for storing a moving image, and selecting a frame from the stored moving image at regular intervals to select the moving image. A storage image selection display means for displaying on a display device, a frame image of the moving image stored together with the moving image display displayed in real time is selected at a fixed time interval, and the selected frame image is used for evolving time. Scroll display, and when a specific frame image is selected from the frame images displayed on the display, the frame image is enlarged and displayed. Door monitoring equipment.

According to the tenth aspect of the present invention, for example, a photographed important scene can be immediately selected and confirmed.

According to a eleventh aspect of the present invention, in the plant monitoring apparatus according to the tenth aspect, the moving image processing apparatus decodes the moving image data in block units and decodes the moving image data in units of blocks. A means for determining whether the image in the block is stationary or moving, and detecting a moving object or a color from the determination result, and a means for specifying the detected moving object or a specific color on the image. Instead of displaying the frame image, the frame at the time of detection is preferentially displayed, and the detection frame is overlapped with a display that clearly indicates a moving object or a specific color.

According to the eleventh aspect of the present invention, for example, important scenes are selected on the system side, so that selection and confirmation of the scenes are facilitated.

A plant monitoring apparatus according to a twelfth aspect of the present invention is the plant monitoring apparatus according to the tenth or eleventh aspect, wherein a frame selection mode is provided for displaying a frame image, and when this mode is selected, frames are automatically forwarded sequentially. Is temporarily stopped, and all frames before the selected time point or the selected frames are scroll-displayed at a short cycle interval.

According to the twelfth aspect of the present invention, for example, scene selection can be performed finely, and an optimum scene can be selected and confirmed.

According to a thirteenth aspect of the present invention, there is provided a plant monitoring apparatus, comprising: a video input device for photographing a state of a plant; a video coding transmission device for coding and transmitting a video input; A moving image processing device, and a moving image display device that displays a result of data processing performed by the moving image processing device, wherein the moving image processing device decodes encoded moving image data. Means, a moving image processing means for processing the decoded moving image data, and decoding the moving image data in block units, and for each of the decoded blocks, determining whether the image in the block is in a still state or a moving state. A moving object detecting unit that detects a moving object in a moving image; and a determination area adjusting unit that adjusts a block to be determined as a moving object by limiting the block to a specified area. A.

According to the plant monitoring apparatus of the thirteenth aspect, for example, the detection of a moving object can be performed not on the entire captured image area but on any specified area, and the detection time can be shortened. , Can be used even for those that are fast moving.

According to a fourteenth aspect of the present invention, in the plant monitoring apparatus according to the fourteenth aspect, when the movement of the moving object detected by the moving object detecting means exceeds the designated area. And means for moving a block area to be determined as a moving object in accordance with the moving direction of the moving object.

According to the fourteenth aspect of the invention, for example, it is possible to follow a case where the moving range of the moving object is large from the designated area and departs from the area.

According to a fifteenth aspect of the present invention, in the plant monitoring apparatus according to the thirteenth aspect, when the movement of the moving object detected by the moving object detecting means exceeds the designated area. And means for enlarging or reducing the area of the block to be determined as a moving object in accordance with the movement of the moving object.

According to the fifteenth aspect, for example, even when the movement of the moving object greatly changes, the detection area can be made to follow.

The plant monitoring apparatus according to claim 16 of the present invention is the plant monitoring apparatus according to any one of claims 13 to 15, wherein the movement is specified by the moving object detection means to detect the pointer of the needle-type indicator. The apparatus further comprises means for specifying an indicated value of the indicating plate shielded by the indicating needle.

According to the sixteenth aspect of the invention, it is possible to read the indicated value of the meter from a moving image, for example.

A plant monitoring apparatus according to a seventeenth aspect of the present invention is an image input device for photographing a plant state display panel on which a display for displaying a process state of a plant and a state of equipment is arranged, and for generating a video signal. A moving image encoding and transmitting apparatus that receives the video signal and converts it into encoded data, a moving image processing apparatus that processes the encoded data, and a moving image that displays a result of data processing performed by the moving image processing apparatus A display device, the video processing device comprising: a video decoding unit that decodes the encoded data in units of blocks to generate decoded video data; and a video decoding unit that decodes the decoded video data. Static / moving determining means for determining from the luminance data whether the image in the block is in a stationary state or in a moving state for each block, and detecting a moving block; It is characterized in that it has a display condition specifying means for determining the display content from the luminance data.

According to the seventeenth aspect, it is possible to read, for example, the state of an alarm or an instruction lamp.

The plant monitoring apparatus according to claim 18 of the present invention is the plant monitoring apparatus according to claim 17, wherein the means for continuously recording luminance data of a block determined as a moving object, Means for determining the soundness of the display by comparing the luminance data of the block with the recorded luminance data.

A plant monitoring apparatus according to a nineteenth aspect of the present invention is the plant monitoring apparatus according to the eighteenth aspect, wherein the comparison of data is performed continuously over time.
The soundness of the status indicator is determined by acquiring the temporal change of the characteristic.

According to the eighteenth and nineteenth aspects of the present invention, for example, the soundness of an alarm or an indicator lamp can be confirmed.
Monitoring reliability can be increased.

According to a twentieth aspect of the present invention, there is provided the plant monitoring apparatus according to the first aspect,
The plant has a surveillance camera for monitoring each location, includes a warning lamp and an indicator lamp, and displays the status of the process of the plant and the status of the equipment, and displays the status of the display by the static / moving determination means of the video data block. From the surveillance camera at the plant corresponding to the moving block.

According to the twentieth aspect of the present invention, it is possible to automatically display an image of a monitoring camera at a corresponding plant location according to, for example, the state of an alarm or an indicator lamp.

A plant monitoring apparatus according to a twenty-first aspect of the present invention is the plant monitoring apparatus according to the fifth or sixth aspect, wherein the plant has a monitoring camera for monitoring each location, and the indication value of the indicator is A moving image of a surveillance camera at a plant corresponding to the indicator is displayed when the distance deviates from a prescribed range.

According to the twenty-first aspect of the present invention, it is possible to automatically display an image of a monitoring camera at a corresponding plant location based on, for example, a meter reading.

According to a twenty-second aspect of the present invention, a plant monitoring apparatus includes a monitoring camera for monitoring each part of the plant according to the first aspect, and identifies color information of an alarm lamp or an indicator lamp to determine an abnormality. In this case, the display can be made by a monitoring camera at a plant corresponding to the lamp.

According to the twenty-second aspect of the present invention, it is possible to automatically adjust and display the image quality of the image of the surveillance camera at the corresponding plant location according to, for example, the color of an alarm or an instruction lamp. The plant monitoring device according to claim 23 of the present invention, in the plant monitoring device according to claim 20 or 21, converts the name of the process or device determined to be abnormal and the displayed abnormal state into text data, It is characterized by being superimposed and displayed on the moving image display device.

According to the twenty-third aspect of the present invention, the names and states of the devices can be displayed in a manner superimposed on the moving image in accordance with, for example, the states of alarms and indicator lamps and the indicated values of meters.

According to a twenty-fourth aspect of the present invention, in the plant monitoring apparatus according to the twentieth or twenty-first aspect, the name of the process or the equipment determined to be abnormal and the displayed abnormal state are transmitted to the voice synthesizing means. It is characterized in that the sound is converted into a sound and the sound is notified at the same time when the moving image is displayed.

According to the twenty-fourth aspect of the present invention, the name and status of the device can be reported by voice and moving image in accordance with, for example, the status of an alarm, an indicator lamp, and the indicated value of a meter.

A plant monitoring apparatus according to a twenty-fifth aspect of the present invention comprises a video input device for photographing a situation of a plant, a video coding device for coding and transmitting a video input, and a specific image from a video input. A still image encoding device for encoding as a still image, a still image encoding timing device for instructing a timing for performing still image encoding, and bidirectional transmission of encoded moving image data, still image data, and control data Transmitting device, a decoding device for decoding encoded moving image and still image data, a moving object detecting device for detecting a moving object in a moving image, and detecting a specific color from the moving image. A specific color detecting device, a specific color selecting device for specifying a specific color detected by the specific color detecting device, and an image for receiving decoded moving image and still image data and performing data processing. A processing device, and a moving image display device that displays the processed moving image and still image, wherein the image processing device detects a moving object, a specific color object, and a still image in each part of the plant to thereby control the moving image in the plant management area. It has means for reading the work contents of each part and comparing it with the standard work procedure of the plant to detect differences, and when a difference is recognized, gives a recommendation or instruction for correction. .

According to the twenty-fifth aspect of the present invention, it is possible to check the work status of the management area based on, for example, a work procedure manual.

According to a twenty-sixth aspect of the present invention, in the plant monitoring apparatus according to the twenty-fifth aspect, the image processing apparatus detects a specific movement or a specific color when starting or completing the operation of the plant. Has means for determining the start or completion of work,
It is characterized by making a recommendation or instruction on the content of work that follows.

According to the twenty-sixth aspect of the present invention, the start and completion timings of the work can be correctly grasped, and a recommendation or an instruction can be issued.

According to a twenty-seventh aspect of the present invention, in the plant monitoring apparatus according to the twenty-fifth aspect, the image processing apparatus has means for judging the presence or absence of an operator in a restricted area of the plant. When the existence is determined, a warning or an instruction is issued.

According to the twenty-seventh aspect of the present invention, it is possible to confirm a worker in a restricted area, for example.

According to a twenty-eighth aspect of the present invention, in the plant monitoring apparatus according to the twenty-fifth aspect, the image processing apparatus has means for determining the presence or absence of a worker in a work area. If the movement of the object is not detected for a certain period of time, a notice is given to the area and the surrounding area.

According to the twenty-eighth aspect, for example, the movement of the worker can be monitored to ensure the worker's safety.

According to the twenty-ninth aspect of the present invention, it is possible to obtain necessary information from past history data on current information and display it on a still image, for example.

According to a twenty-fourth aspect of the present invention, in the plant monitoring apparatus according to the twenty-fifth aspect, the image processing apparatus specifies a shooting location of the acquired still image and stores a history of the status of the shooting location. It is characterized by having means for acquiring and pasting past history information on the acquired still image.

According to the twenty-ninth aspect, it is possible to obtain necessary information from, for example, past history data and display it on a still image by superimposing it on the current information.

[0061]

DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment (corresponding to claim 1) FIG. 1 is a block diagram of the present embodiment for monitoring the status of a plant status indicator such as an alarm or a meter using a video signal of a camera or the like. A video input device that captures video, a video encoding transmission device that encodes the video data for processing such as compression of the captured video data, and transmits the encoded data, decodes the transmitted encoded data, It is composed of a moving image processing device for performing processing and a moving image display device for displaying a moving image subjected to data processing on a display or the like.

Here, the moving picture coding and transmitting apparatus may be integrated with the video input apparatus, or may be a computer connected to the video input apparatus via a signal cable so as to capture a moving picture. In addition, when the video input device and the moving image processing device are separated from each other, the moving image encoding transmission device and the moving image processing device are connected by a wired or wireless computer network, a telephone line, or a signal cable, and data is transmitted. Is done. When transmitting data over a network or a telephone line, it is necessary to transmit compressed data in order to secure an update cycle of a moving image. Hereinafter, an embodiment will be described in which the video input device and the moving image processing device are located at remote locations, and the moving image is encoded and transmitted.

FIG. 2 is a block diagram showing an example of a moving picture coding processing configuration. In FIG. 2, the input video signal is
The block is divided into macroblocks by a blocking unit 301. An input video signal divided into macro blocks is input to a subtractor 302.
, And a difference from the predicted image signal is calculated to generate a prediction residual signal. One of the prediction residual signal and the input video signal from the blocking section 301 is selected by the mode selection switch 303, and is subjected to discrete cosine transform by the DCT (discrete cosine transform) section 304. DCT section 30
The DCT coefficient data obtained in step 4 is quantized in the quantization section 305. The signal quantized by the quantizer 305 is split into two,
One of them is subjected to variable length coding by a variable length coding unit 313. On the other hand, the other of the signal quantized by the quantizing unit 305 and branched into two is an inverse quantizing unit 306 and an IDCT (inverse discrete cosine transform) unit.
After sequentially receiving the processing inverse to the processing of the quantization section 305 and the DCT section 304 by 307, the adder 308 adds the prediction image signal input via the switch 311 to generate a local decoded signal. You. This local decoded signal is stored in the frame memory 309 and input to the motion compensation unit 310. The motion compensation unit 310 generates a predicted image signal and sends necessary information to the mode selection unit. The mode selection unit 312 selects a macroblock for performing inter-frame coding and a macroblock for performing intra-frame coding based on the prediction information P from the motion compensation unit 310 in macroblock units. When performing intra-frame coding (intra coding), set the mode selection switch information M to A
And the switch information S is A. When inter-frame coding (inter coding) is performed, the mode selection switch information M is set to B, and the switch information S is set to B. The mode selection switch 303 changes the switch based on the mode selection switch information P, and the switch 311 changes the switch based on the switch information S. Here, the modes include intra mode (INTRA), inter mode (INTER), and non-coding mode (NOT_CODED).
The macro block of INTRA is the image area to be intra-coded, the macro block of INTER is the image area to be inter-coded, NOT_
A CODED macroblock is an image area that does not require encoding.

The moving picture data encoded by the above-described processing is transmitted to the moving picture processing device, and processing for decoding the moving picture and monitoring the plant status display is executed. FIG. 3 shows the configuration of the processing included in the moving image processing apparatus. In the process of decoding the moving image, the still / moving state of the image is determined, the specific color is determined with respect to the moving determination block, and the position where the specific color is detected. And a plant status indicator corresponding to the position. FIG. 4 shows a processing configuration of a moving picture decoding unit, a block still / moving judging unit, and a specific color object detecting unit. In the moving picture decoding unit 110, first, the coding received from a transmission path or a storage system is performed. Data is input buffer
The variable length decoding unit 10 stores the data once in a frame 101 and demultiplexes each frame by a demultiplexing unit 102 based on the syntax.
Output to 3. The variable length decoding unit 103 decodes a variable length code of information of each syntax.

In the variable length decoding unit 103, if the mode of the macroblock is INTRA, the mode changeover switch 109
Is turned off, and the quantized DCT coefficient information decoded by the variable-length decoding unit 103 is inversely quantized by the inverse quantization unit 104, and is subjected to inverse discrete cosine transform processing by the IDCT unit 105. A reproduced image signal is generated. The reproduced image signal is stored in the frame memory 107 as a reference image, while the display state determination unit 205 in the specific color object detection unit 116
Is input to

In the variable length decoding unit 103, if the mode of the macroblock is INTER and NOT_CODED, the mode changeover switch 109 is selected to be off, and the variable length decoding unit 103
The quantized DCT coefficient information decoded in
The IDCT unit 105 performs an inverse discrete cosine transform process, and based on the motion vector information decoded by the variable length decoding unit 103, a motion compensation unit 108 motion-compensates the reference image, and an adder At step 106, a reproduced image signal is generated. The reproduced image signal is stored in the frame memory 107 as a reference image, and is input to the display state determination unit 205 in the specific color object detection unit 116.

On the other hand, in the block static / movement determining unit 202 and the specific color object detecting unit 203, as shown in the flowchart of FIG.
For each frame, two processes of a macroblock still / moving judgment (S101) and a specific color object judgment (S102) are performed.

The macroblock static / motion determining unit 111 calculates the mode information, the motion vector information, the DCT coefficient information decoded by the variable-length decoding unit 103, and the INTRA obtained by the subtractor 112.
From the sum of absolute differences (SAD) between the reproduced image signal at the time of the macroblock and the frame memory of one frame before, a still / moving determination for each macroblock in the frame is performed.

FIG. 6 shows a macroblock static / dynamic determination (S101).
3 is a specific flowchart of FIG. Here, i and j represent the addresses of the vertical and horizontal macroblocks in the frame, respectively, and V_NMB and H_NMB represent the numbers of the vertical and horizontal macroblocks in the frame. The two-dimensional array M [i] [j] is an array for storing information as to whether each macroblock is a moving macroblock. TRUE indicates a moving macroblock, and FALSE indicates a still macroblock.

First, a variable length decoding unit is provided for each macroblock.
The mode information MODE from step 103 is determined (S203). If MODE is INTRA, the sum of absolute differences (SAD) between the reproduced image signal of the macroblock and the frame memory one frame before is calculated and compared with the threshold value T0 (S204). If the macroblock is larger than the threshold T0, the macroblock is determined to be a moving macroblock, and TRUE is substituted for M [i] [j] (S206). If MODE is INTER, from the motion vector information and DCT coefficient information from variable length decoding section 103, the sum of the absolute value of the motion vector of the macroblock Σ |
MV | and the sum of absolute values of the DCT coefficients Σ | COF | are calculated and compared with the respective thresholds T1 and T2 (S205). If the sum of the absolute value of the motion vector and the sum of the absolute values of the DCT coefficients are equal to or larger than the threshold, the macroblock is determined to be a moving macroblock, and TRUE is substituted into M [i] [j] (S206). ).

The specific color object determination unit 113 determines a specific color object based on the static / movement determination information for each macroblock of the macroblock static / movement determination unit 112. FIG. 7 is a specific flowchart. As shown in FIG. 7, the processing content is composed of two processes, a specific color detection process (S301) and a specific color object inclusion process (S302). In the specific color detection processing (S301), in order to prevent the detection of a moving macroblock from being erroneously detected due to fluctuation of a small object in a background image or noise at the time of image capture,
Moving macroblocks in which all surrounding 8 macroblocks are still are removed. Specific color object inclusion processing (S302)
Performs a process of detecting the smallest rectangle that includes an adjacent area where a moving macroblock exists, from the still / moving determination result after removing noise. Through this processing, a rectangle that includes the specific color object can be found.

FIG. 8 shows the specific processing contents of the specific color detection processing. As in FIG. 6, i and j represent the addresses of the vertical and horizontal macroblocks in the frame, respectively, and V_NMB and H_NMB represent the numbers of the vertical and horizontal macroblocks in the frame. The two-dimensional array M [i] [j] here is an array for storing information as to whether each macroblock is a specific color macroblock, and if TRUE, indicates a specific color macroblock.

First, the result of the still / moving judgment for each macroblock is examined. (S403) In the two-dimensional array M [i] [j], the static / movement determination result is stored by the macroblock static / movement determination process (S101). If TRUE, a dynamic macroblock is determined.
If so, it represents a still macroblock. If the value of the two-dimensional array M [i] [j] is FALSE, that is, if it is a still macroblock, the macroblock does nothing and goes to the next macroblock. If the value of the two-dimensional array M [i] [j] is true, that is, if it is a moving macroblock, check whether the pixel value of the macroblock is within the color space specified by the specific color specification part. Yes (S40
Five). If not, it is determined that the moving macroblock, that is, the newly rewritten macroblock has no specific color, and is rewritten to FALSE (S406).

The specific color designation section 114 designates the range of the color space of the color to be detected. If the color is known in advance, it can be specified directly in the YCbCr color space.
Here, D1 to D6 are threshold values.

[0075]

[Formula 1] D1 <Y <D2 and D3 <Cb <D4 and D5 <Cr <D6 As another method of specifying a specific color, the user is asked to specify a color range on the RGB color space, and the range is specified. May be converted to YCbCr using Equation 2 and determined.

[0076]

[Equation 2] EY = 0.299R + 0.587G + 0.114BY = 219 (EY) / 256 + 16 Cb = 126 (B-EY) / 256 + 128 Cr = 160 (R-EY) / 256 + 128 As a method of designating a specific color of, there is also a method of converting the YCbCr color space being encoded into an RGB space by using Expression 3 and detecting it in the form of Expression 4.

[0077]

[Equation 3] R = (298Y + 408Cr-56993) / 256 G = (298Y-100Cb-207Cr + 34495) / 256 B = (298Y + 518Cb-72085) / 256

[0078]

[Formula 4] D1 <R <D2 and D3 <G <D4 and D5 <B <D6 In this way, if a range that can be distinguished in an appropriate color space can be specified, any method can be used. Can be done

Next, it is determined which plant status indicator corresponds to the block in which the specific color is detected by the above processing. In the specification of the plant status indicator, first, a setting is made as to where on the actual plant site the moving image displayed first is displayed.

FIG. 9 shows a flow of processing for specifying the position of the plant status display. When a moving image as shown in FIG. 10 is displayed, first, a plant status indicator included in the image is selected. This selection is made by preparing a device layout display at the video input site and selecting an area where an image is displayed on the layout. Next, a vertex of a video having a characteristic on the moving image display, for example, a vertex of the alarm display area is selected, and vertex coordinates on the moving image are acquired. At this time, a vertex mark is displayed on the device layout drawing display, and the vertex is moved to a position selected on the moving image. Similarly, another vertex is selected on the moving image, and alignment is performed on the device layout diagram. The coordinates of the plant status display in the area surrounded by the coordinates of the vertices are calculated. After performing these initial settings, monitoring of the plant status indicator by video is started.

In the plant state identification process, when a specific color is detected on a moving image, a device identification indicating which plant state indicator the detected object corresponds to, and a state indicating which state is represented by the specific color. Two processes of identification are performed. FIG.
Is a flow of the plant state identification processing when the plant state indicator is arranged at a distance. In the device identification, first, the center coordinates of the detected block are obtained using the position and the block size of the block where the specific color is detected. This process is performed for each block of detected blocks. Next, a plant status indicator located at the center coordinates of the detection block is obtained from the area coordinates of the plant status indicator acquired at the time of initialization, and the indicator is identified.

In the status identification of the plant status display, the status of the identified display is determined from the type of the specified color. For example, when the lighting color of the alarm is displayed in red on the moving image, the alarm lights when the red display is detected, turns off when the detection of red is completed, and the detection and non-detection of red are periodically performed in the same place. Is repeatedly detected, it is determined that a flicker state has occurred.

The identification result and the moving image are sent to the moving image display device and displayed.

[Embodiment 2] (Corresponding to claim 2) When a plant state indicator is arranged adjacent to an alarm display and there is a possibility of lighting at the same time, when a color is detected, it is detected together. It may be detected as a block of one detection block. Therefore, the block is separated from the block size of the detected object.
FIG. 12 shows the flow of the device identification process when the plant status indicators are arranged adjacent to each other. First, the center coordinates of the detected block are obtained using the position and the block size of the block where the specific color is detected. Next, the plant status display located at the center coordinates of the detection block is identified from the region coordinates of the plant status display acquired at the time of initialization, and the size of the block occupied by the display is determined. Here, when the size of the detection block and the size of the block occupied by the display are different from each other by a minimum error or more, the detection block portion corresponding to the display area of the display is cut out as the detection of the display, and the remaining portion is extracted. Performs the device identification process again.

[Third Embodiment] (Corresponding to claim 3) It is necessary to make the positional relationship between a moving image and a plant status display with high accuracy from the relationship between the arrangement of the plant status display and the installation location of the video input device. In such a case, it is necessary to set the position in consideration of not only the simple selection of the area but also the position and orientation of the video input device. As means for this purpose, an image input device is provided with an azimuth detector such as a magnet and a vertical angle detector for the photographing direction to detect the direction of image input. The position of the plant status display is corrected according to the image input direction, and the position is set. FIG. 13 shows the flow of the process at this time. Normally, the layout of the plant status indicator is drawn in a drawing viewed from a certain direction, and the orientation is described. here,
A three-dimensional space having a coordinate system corresponding to east, west, north and south as shown in FIG. 14 is prepared, and the layout is arranged according to the actual azimuth. Next, the imaging direction of the video input device is obtained from the azimuth detector and the vertical angle detector, and an imaging plane having the imaging direction as a normal is calculated. A projection map of the layout map with respect to the imaging plane is obtained, the projection map is superimposed on a moving image on the display, the reduction ratio is adjusted, and the position of the plant status display is set. With this method, the position can be accurately set even when the image is taken from an oblique direction with respect to the display.

[Embodiment 4] (Corresponding to claim 4) By the above method, even when the position of the moving picture and the plant status indicator are corrected, the positions of all the plant status indicators in the moving picture completely match. It is difficult to make it happen. Also, the size of the color detection block and the size of the plant status indicator may be different depending on the environmental conditions at the image input site. FIG. 15 shows the flow of the device identification process at this time. First, the center coordinates of the plant status display are determined in the moving image position setting process. Next, when the color detection is performed in the state as shown in FIG. 16, the range of the color detection block 401 is obtained, and the display devices 402 and 404 having the center within the range are selected. The setting area of the selected display is compared with the area of the color detection block to determine the ratio of the setting area of the display included in the detection block area. When this ratio is high, it is considered that the display has been detected. This process is performed for all displays centered in the detection block.

[Embodiment 5] (Corresponding to claim 5) A method of reading the indicated value of a meter for indicating the process value by the rotation angle of the hand as shown in FIG. 17 using the color detection of the moving image will be described. In the meter of FIG. 17, when the process value changes, the pointer rotates and indicates the value. When the method of detecting a change in the indicated value by detecting the movement of the needle is used, the movement of the entire needle is detected. However, only the tip of the needle is necessary for confirming the indicated value, and the detection of the other portions is not useful because it only increases the processing. Therefore, only the tip of the pointer is detected to read the indicated value. As a means, using a meter in which the tip and the start point of the indicator needle are colored as shown in FIG. 18, the angle of the indicator needle is obtained from the coordinates of the tip and the start point which are color detected from the moving image, and the indicator is indicated from the angle. Read the value. In this method, since only the angle is to be detected, it is not necessary to strictly set the meter position on the moving image, and a simple installation of a video input device can be used.

[Embodiment 6] (Corresponding to claim 6) FIG. 19 is an explanatory diagram of an example in which an indicator value is read using a moving image for a meter whose indicator value moves in a linear direction. Here, a color contrasting with the pointer is painted on the background of the area where the pointer of the meter to be monitored in the moving image moves, in a width shorter than the length of the pointer. The color detection based on the moving image is performed on the background color. As a result, the entire moving area of the pointer is detected, but since the pointer is not detected, the color detection block is separated into two right and left blocks. . The indicated value of the meter is read from the size of the separated color detection block.
The selection of the color detection block used for reading and the relationship between the block size and the indicated value depend on the scale of the meter. If the left end is set to 0, the size of the left color detection block indicates the indicated value. become. If the zero point is in the middle of the moving area, the difference between the length from the end to the zero point and the size of the color detection block indicates the designated value.

[Embodiment 7] (Corresponding to Claims 7 and 21) By detecting the color of a moving image, the lighting detection of an alarm and the reading result of the meter reading are sent to the moving image display device together with the moving image. The moving image display device stores the received data and displays the data on a display as needed. FIG. 20 shows an embodiment of data display, in which a display in which detection data is reflected on a graphic display of a plant status indicator and a meter included in the moving image together with the moving image display, and a screen related to the detection data are displayed. By displaying information in such a combination, the plant operator can easily confirm the situation at the site, clear display, and necessary information. In addition, a surveillance camera for monitoring each part of the plant is provided so that when the indicated value of the indicator is out of the specified range, a moving image of the surveillance camera at the plant corresponding to the indicator is displayed. You may.

[Embodiment 8] (Corresponding to claim 8) When detecting the motion or color of a subject by using a difference between the video data and the preceding period data, when the direction or position of the video input device is moved, The whole image moves, and the moving object cannot be detected. Therefore, the above-described detection method cannot cope with a case where a moving object is automatically detected and a moving image is followed to follow a video, or a case where a color-detected object is enlarged and photographed clearly. The present embodiment provides a means that can cope with such a situation, and controls the direction and enlargement ratio of another video input device using the detection result of motion and color on a moving image, and Follow and provide clear images.

FIG. 21 is a block diagram of the present embodiment.
A fixed image input device for inputting an image in a fixed direction, and a movable image input device having an image input control device for controlling the orientation and magnification of the image input device are installed adjacent to the fixed image input device. The fixed image input device captures an image of a wide area, and detects the movement and color of the object from the image using the above-mentioned means. FIG. 22 shows the flow of the process at this time. First, in order to obtain the horizontal angle and the vertical angle of the detected object from the coordinates on the detected moving image, an angle with respect to the coordinate value is calculated in advance from the actual size of the subject as a reference and the size on the image. Here, when motion or color detection is performed, the position and size of the detection block are obtained, and the horizontal angle and vertical angle of the detection object are obtained from the position of the detection block. Generate a signal that controls Further, a signal for controlling the enlargement ratio is generated from the size of the detection block. The generated control signal is sent to the video input control device of the movable video input device, and controls the direction and the magnification of the movable video input device. As a result, it is possible to provide an image that moves in accordance with the movement of the moving object or a clear image in which the object whose color is detected is enlarged.

In the above embodiment, an example using one fixed video input device and one movable video input device has been described. Therefore, the movable video input device is installed adjacent to the fixed video input device. When multiple devices are used, the depth can be specified from the coordinates of the detected object projected on the image of the fixed image input device, so there is no need to install a movable image input device adjacent to the fixed image input device, and the movable image The position of the input device can also be included in the control item.

[Embodiment 9] (Corresponding to claim 9) When transmitting video data of a fixed video input device and video data of a movable video input device via a network, the network load is one. There are two problems.
Therefore, in order to minimize the network load, only fixed video data is transmitted when nothing is detected, and when moving objects and color detection are performed, movable video data is transmitted and fixed video data is transmitted. The compression ratio of the video data is increased and the transmission amount is reduced to be transmitted. FIG. 23 shows a flow of the process at this time, and the process suppresses an increase in the video data transmission load at the time of object detection.

[Embodiment 10] (Corresponding to claim 10) When monitoring a plant while watching a moving image, it is sometimes necessary to confirm a necessary scene with a clearer image. FIG.
4 is an embodiment of an interface that meets this request;
A frame image of a moving image stored in the moving image processing device or the moving image display device is displayed together with the moving image. Then, a corresponding frame is selected from the moving image data stored when the frame image is selected, and a still image of the frame is displayed in a large size. FIG. 25 shows the flow of this processing. FIG. 26 shows an example of an image data structure stored in a moving image processing device or a moving image display device. Each frame data is composed of header data and image data for storing data transmitted together with a time stamp and image data. Is done. In the frame display, the data size of the image data of the frame selected at regular intervals is reduced and displayed in order. Some of the displayed frame images are scrolled (forward-forwarded) as time elapses, so that data that is almost the latest is always displayed. The frame selection interval is set in accordance with the scroll cycle, and the frames are selected at one-second intervals when frame display is sequentially performed every second. Here, when a change appears in the monitored image and the image at that time is to be displayed in a large size, the corresponding frame is selected. In response to this selection input, the corresponding frame data is called from the stored data, and the frame image is displayed without reducing the data size. If the frame to be selected is not already on the screen, the frame display is scrolled back to display and select the frame to be selected. When the scroll-back operation is performed, the automatic sequential forwarding of the frame display is temporarily stopped. With these processes, images of scenes that have passed by can be displayed and displayed immediately.
You can check.

The time may be written together with the frame display so that the frame can be easily selected using the sense of time of the operator.

[Embodiment 11] (Corresponding to claim 11) In the above embodiment, frame display is selected at fixed time intervals. However, when performing motion detection or color detection on a moving image, the detection is performed at the time of detection. Frame is displayed with priority so that it can be easily selected and confirmed. FIG. 27 shows the flow of the processing of this embodiment, and the above-described method is used for motion detection and color detection on a moving image. FIG. 28 shows an example of an image storage data configuration when the detection function is used together, and detection data is added to each frame data. The frame in which the detection data is set is preferentially selected and displayed as a frame. Here, when a motion or color is detected, the detection block is specified. Therefore, as shown in FIG. 29, the detection position is specified using a simple graphic according to the block of the detection block, and this graphic is displayed on the image. The superimposed image is displayed in the frame display. The operator can immediately confirm the image automatically detected on the moving image rather than selecting this frame.

[Twelfth Embodiment] (Corresponding to Claim 12) In the frame display of FIG. 24, in order to allow the operator to easily select the frame display, the time interval of the frame forward must be increased to some extent. As a result, the number of dropped frames increases, and the frame to be selected may not be displayed and cannot be selected.
Therefore, a frame selection mode is provided for frame display, and when this mode is selected, the automatic sequential forwarding of frames is temporarily stopped, and at the same time, all previous frames or frames selected at short intervals from that point are scroll-displayed. By using this processing, not only can the operator always select a frame to be selected, but also the forward-moving interval of frames can be shortened, and the number of dropped frames in frame display in a normal state can be reduced.

[Thirteenth Embodiment] (corresponding to the thirteenth embodiment) FIG. 30 is a block diagram showing a configuration of the present invention. In FIG. 31, an input video signal captured by a video input device 501 is transmitted after being encoded by a video encoding / transmission device 502. Transmission is, for example, telephone line, wireless telephone line,
There is a LAN. The decoding device 503 decodes the moving image data sent from the transmission device to create a reproduced image signal. The reproduced image signal is subjected to signal processing in the moving image processing device 504 and then displayed on the moving image display device 505. The moving object detecting means 506 detects a moving object area in the judgment area set by the judgment area adjusting means 507 based on the data sent from the decoding device 503.

FIG. 31 is a block diagram showing an example of the configuration of the determination area adjusting means 507. The judgment area is set by the pointing means 512, or set by the movement means 513 following the movement of the object, the judgment area is set by the enlargement / reduction means (514), and the area for detecting the moving object is selected by the judgment area determination means 511. I do.

FIG. 32 shows a method of associating the decision area set by the pointing means 512 with a macroblock to be coded. The decision areas 521 and 522 set by the pointing means are
3,524 are supported. Here, the area 523 is the area 52
It is determined by the means that covers all ones and is the smallest.

On the other hand, in the moving object detecting means 508,
As shown in the flow chart of FIG. 33, the macroblock static / movement determining unit K111 performs three processes of macroblock static / movement determination (S101), determination area adjustment (S102), and moving object determination (S103) for each frame. Area adjustment means 506, moving object determination unit
Perform at K113.

The macroblock static / dynamic judging section K111 includes the mode information, motion vector information, DCT coefficient information decoded by the variable length decoding section K103, and the INTRA obtained by the subtractor H112.
From the sum of absolute differences (SAD) between the reproduced image signal at the time of the macroblock and the frame memory of one frame before, a still / moving determination for each macroblock in the frame is performed.

FIG. 34 is a flowchart for determining whether a macroblock is still or not (S101).
3 is a specific flowchart of FIG. Here, i and j represent the addresses of the vertical and horizontal macroblocks in the frame, respectively, and V_NMB and H_NMB represent the numbers of the vertical and horizontal macroblocks in the frame. The two-dimensional array M [i] [j] is an array for storing information as to whether each macroblock is a moving macroblock. TRUE indicates a moving macroblock, and FALSE indicates a still macroblock.

First, a variable length decoding unit is provided for each macroblock.
The mode information MODE from K103 is determined (S203). If MODE is INTRA, the sum of absolute differences (SAD) between the reproduced image signal of the macroblock and the frame memory one frame before is calculated and compared with the threshold value T0 (S204). If the macroblock is larger than the threshold T0, the macroblock is determined to be a moving macroblock, and TRUE is substituted for M [i] [j] (S206). If the value is equal to or smaller than the threshold value T0, the macro block is determined to be a still macro block, and M [i] [j] is set to FALSE.
Is substituted (S207).

If MODE is INTER, from the motion vector information and DCT coefficient information from the variable length decoding unit K103,
Sum of absolute values of motion vectors of the macroblock Σ | MV |
Then, the absolute value sum Σ | COF | of the DCT coefficients is calculated and compared with the respective thresholds T1 and T2. (S205) If the sum of the absolute value of the motion vector and the sum of the absolute values of the DCT coefficients are smaller than the threshold, the macroblock is determined to be a still macroblock, and FALSE is substituted into M [i] [j]. (S207). Otherwise, the macro block is determined to be a moving macro block, and TRUE is substituted for M [i] [j] (S20).
6). If NOT_CODED, the macroblock is determined to be a still macroblock, and FALSE is substituted for M [i] [j] (S207).

The moving object determination unit K113 determines a moving object from the static / movement determination information for each macroblock of the macroblock static / movement determination unit K112. FIG. 35 is a specific flowchart. As shown in FIG. 35, the processing content includes three parts: a loop unit (S301) for setting the number of determinations according to the number of determination areas, a noise removal processing (S302), and a moving object inclusion processing (S303). In the loop section (S301), the set number of detection areas is fetched. In the noise removal processing (S302), in order to prevent erroneous detection as a moving macroblock due to fluctuation of a small object in the background image or noise at the time of image capture, the surrounding 8
The moving macroblock in which all the macroblocks are still is removed. The moving object inclusion process (S303) performs a process of detecting a minimum rectangle that includes an adjacent region where a moving macroblock exists, from the still / moving determination result after removing noise. Through this process, a rectangle that includes the moving object can be found.

FIG. 36 shows the specific processing contents of the noise removal processing. As in FIG. 34, i and j represent the addresses of the vertical and horizontal macroblocks in the frame, respectively, and V_PB and H_PB represent the numbers of the vertical and horizontal macroblocks in the frame. Two-dimensional array M [i] [j]
Is an array that stores information on whether each macroblock is a moving macroblock or not.
Represents a still macroblock.

First, the result of static / dynamic determination for each macroblock is examined (S403). If the value of the two-dimensional array M [i] [j] is FALS
E, that is, if it is a still macroblock, do nothing in that macroblock and go to the next macroblock. If the value of the two-dimensional array M [i] [j] is TRUE, that is, if it is a moving macroblock, the static / moving determination results of eight macroblocks around the macroblock are checked (S405).
FALSE, that is, if the macroblock is a still macroblock, the macroblock is determined to be noise and rewritten to a still macroblock (S406). If at least one of the surrounding eight macroblocks has a TURE, it is not determined that the noise is present, and the processing moves to the next macroblock. The outside of the screen is assumed to be a still macroblock.

FIGS. 37 to 39 show the specific processing contents of the moving object inclusion processing. Here, n is a counter indicating the number of moving objects, S1 to S4 are parameters indicating a search range of a rectangle including the moving object, and S1 and S2 are start and end points of a vertical address. Yes, S3 and S4 are the start and end points of the horizontal address.

In the flowchart of FIG. 37, initialization is performed so that a detection target area is specified as a search range (S501). Next, a function Rectangular for searching for the smallest rectangle including the moving object in the specified search range is called (S502).

The flow charts of FIGS. 38 and 39 are based on the function Rectangular.
Shows the contents of the processing. The function Rectangular receives a search range S1 to S4, n indicating the number of moving objects, and a two-dimensional array M in which the result of static / dynamic determination of each macroblock is stored, and stores a rectangular address of the search result. The dimensional arrays B1 to B4 and n indicating the number of moving objects are output. Here, the one-dimensional array HV is a working array for creating a histogram of the number of moving macroblocks in the vertical direction, and the one-dimensional array HH is used for creating a histogram of the number of moving macroblocks in the horizontal direction. It is a working array. Also, the variable VF
LAG is a flag that changes to TRUE when the value of the horizontal histogram is not 0, and changes to FALSE when the value of the histogram is 0. This flag is changed to TRUE when the value is 0 and FALSE when the value is 0.

First, the range of S1 to S2, which is the search range of the work array HV for creating a histogram of the number of moving macroblocks in the vertical direction, is initialized with a value of 0 (S601). Next LO
In the double loop of OP1 and LOOP2, a histogram of the number of moving macroblocks in the vertical direction in the search range is created. That is, the static / dynamic determination result M [i] for each macroblock
The value of [j] is compared (S604), and if the value is TURE, that is, a moving macroblock, HV [i] is incremented by 1 (S605),
In the case of FALSE, the action that does nothing is taken.
Next, a non-zero continuous part is searched from the vertical histogram. First, set the flag VFLAG to FALSE
(S608). Next, it is checked whether the histogram HV is not 0 and VFLAG is FALSE in the order of the search range S1 to S2. (S610) This condition corresponds to the start point of a continuous portion where the histogram is not 0. Therefore, since it is a candidate for the starting point in the vertical direction of the rectangle being searched, the address i is stored in the one-dimensional array B1 [n], and VFLAG is set to TURE. (S611) Next, when the histogram HV is 0 or at the end point of the search range, VFLAG is
It is checked whether it is TURE (S612). This condition is applied to the end point of a continuous portion where the histogram is not zero. Therefore, since it is a candidate for the vertical end point of the rectangle being searched, if the histogram HV is 0
In the case of (1), the address i-1 is stored in the one-dimensional array B2 [n] (S614). Otherwise, the address i is stored in the one-dimensional array B2 [n] (S615). And VFLAG again FALSE
(S611). FIG. 39 is a continuation of the flowchart of FIG. This time, the range of S3 to S4, which is the search range of the work array HV for creating a histogram of the number of moving macroblocks in the horizontal direction, is initialized to a value of 0 (S617). Next LOOP
In the double loop of 4 and LOOP5, a histogram of the number of moving macroblocks in the horizontal direction in the search range is created.
That is, the value of the static / movement determination result M [i] [j] for each macroblock is compared (S604). In the case of FALSE, the action that does nothing is taken. Next, a non-zero continuous portion is searched from the horizontal histogram. First, the flag HFLAG is set to FALSE (S624). Next, in the order of the search ranges S3 to S4, it is checked whether the histogram HH is not 0 and HFLAG is FALSE (S626). This condition applies to the starting point of a continuous portion where the histogram is not zero. Therefore, since it is a candidate for the starting point in the horizontal direction of the rectangle being searched, the address j is stored in the one-dimensional array B3 [n], and the HFLA
Set G to TURE (S627). Next, the histogram HH
Is 0 or at the end of the search range, it is checked whether HFLAG is TURE (S628). This condition is applied to the end point of a continuous part where the histogram is not zero. Therefore, since it is a candidate for the horizontal end point of the rectangle being searched, if the histogram HH is 0, the address j-1 is stored in the one-dimensional array B4 [n] (S63).
0), otherwise, store address j in one-dimensional array B4 [n]. (S631) Then, HFLAG is set to FALSE again (S632).

Here, the search using one kind of histogram in the vertical direction and the horizontal direction is completed, but the search result B1 [
It is checked whether or not n] to B4 [n] matches the search range S1 to S4 (S633). If they match, there is no more search range, so it can be determined that the minimum rectangle has been obtained. (S634). Then add n representing the number of moving objects
1 (S635), and proceed to search for the next moving object. If the search results B1 [n] to B4 [n] do not match the search ranges S1 to S4, a plurality of moving objects still exist in the search result range, and the search results B1 [n] to B4 [n Is transferred to S1 to S4 (S637), and the function Rectangular is called again (S637). In this way, the moving objects B1 [n] to B4 [
n].

[Embodiment 14] (corresponding to Embodiment 14) FIG. 40 is a diagram showing an embodiment 14 of the present invention. Fig. 32
The inspection target areas 530 and 531 of the macro block set from H_PB [n] [0], H_PB [n] [1], V_PB [n] [0] and V_PB [n]
This is the area enclosed by [1]. Here, n is the number of detection target areas. Moving objects 532 and 533 are present therein, and are moving in directions 534 and 535 indicated by arrows in FIG. 40, respectively. After a certain period of time, the moving objects 536 and 537 will come out of the set frame (outside the detectable area) as they are. According to this method, each detection target area can be moved like 538, 539 according to the movement of the moving object, depending on the magnitude of the movement. H_PB '[n] [0], H_PB' [n] [1], V_P
B '[n] [0] and V_PB' [n] [1] indicate the moved macroblock.

[Embodiment 15] (corresponding to Embodiment 15) FIG. 41 is a diagram showing an embodiment 15 of the present invention. Fig. 32
H_PB [n] [0], H_PB [n] [1], V_PB [n] [0], V_PB [n]
This is the area enclosed by [1]. Here, n is the number of detection target areas. Moving objects 552 and 553 are present therein, and move in directions 555, 556 and 557 indicated by arrows in FIG. 41, respectively. The moving objects 556 and 557 having a large change in movement may come out of the set frame (out of the detectable area) as they are. According to the present method, the movement can be detected by enlarging each detection target area in accordance with the amount of change of the moving object, such as 559, according to the magnitude of the change in movement. On the other hand, when the change in movement is small like the moving object 552, the detection determination time can be shortened by narrowing the detection target like 558. H_PB '[n] [0], H_PB' [n] [1], V_
PB '[n] [0] and V_PB' [n] [1] indicate the macroblock after movement.

Sixteenth Embodiment (corresponding to the Sixteenth Embodiment) FIGS. 42 to 43 are views showing an embodiment of the sixteenth embodiment.
FIG. 42 shows an embodiment for a vertical meter, and FIG. 43 shows an embodiment for a rotary meter. In FIG. 42, the meter pointer 60
When 0 moves to the position of movement 601, the meter pointer 600
At first, the meter plate 602 is shielded, and 606 is the moving object detection block. The movement of the meter changes the luminance of 606, and the moving object detection and the luminance change move to 607 and 608. Let L1, L2, and L3 be the original luminance in each block, and let ML be the amount of change in luminance due to meter blocking. By setting ML to be constant, the brightness when shielded by the meter is L1-M
L, L2-ML and L3-ML. By making a detectable difference between L1 to L3, a meter indication panel, that is, a meter value can be read from the macroblock number of the moving object detection.
FIG. 43 shows an example of application to a rotary meter. It is basically the same as the vertical type, but the meter plate is installed so that the largest change in luminance can be obtained with respect to the meter pointer.

[Embodiment 17] (corresponding to Embodiment 17) FIG. 44 is a block diagram showing a configuration of the present invention. In FIG. 44, an input video signal captured by a video input device 501 is transmitted after being encoded by a video encoding / transmission device 502. Transmission is, for example, telephone line, wireless telephone line,
LAN. The decoding device 503 decodes the moving image data sent from the transmission device to create a reproduced image signal. The reproduced image signal is subjected to signal processing in the moving image processing device 504 and then displayed on the moving image display device 505. The luminance change detecting means 620 detects a change from the luminance set in the luminance information setting 621 based on the data sent from the decoding device 503.

FIG. 45 is a block diagram showing the configuration of the moving picture specific luminance object detecting device according to the embodiment of the present invention. The moving image specific color object detection device in FIG. 45 includes two parts, a moving image decoding unit K110 and a specific color object detection unit K116.

In the moving picture decoding unit K110, first, the encoded data received from the transmission path or the storage system is once stored in the input buffer K101, and is demultiplexed by the demultiplexing unit K102.
The frames are separated based on the syntax for each frame and output to the variable-length decoding unit K103. The variable length decoding unit K103 decodes a variable length code of information of each syntax.

In the variable length decoding unit K103, if the mode of the macroblock is INTRA, the mode changeover switch K109
Is turned off, and the quantized DCT coefficient information decoded by the variable-length decoding unit K103 is inversely quantized by the inverse quantization unit K104, and is subjected to inverse discrete cosine transform processing by the IDCT unit K105. A reproduced image signal is generated. The reproduced image signal is stored as a reference image in the frame memory K107, while the specific color object synthesis display unit in the specific color object detection unit K116.
Entered in K115.

In the variable length decoding unit K103, if the mode of the macroblock is INTER and NOT_CODED, the mode changeover switch K109 is turned off, and the variable length decoding unit K103
The quantized DCT coefficient information decoded in
The IDCT unit K105 performs inverse discrete cosine transform processing, and based on the motion vector information decoded by the variable length decoding unit K103, performs motion compensation on the reference image in the motion compensation unit K108, and adds The sum is added at K106 to generate a reproduced image signal. The reproduced image signal is stored in the frame memory K107 as a reference image, and is input to the specific luminance object synthesis display unit K115 in the specific luminance object detection unit K116.

On the other hand, the specific luminance object detection unit K116 performs three processes of macroblock static motion determination, specific color object determination, and specific luminance object composite display for each frame, respectively. This is performed by the luminance object determination unit K112 and the specific color object synthesis display unit K115.

FIG. 46 is a schematic diagram showing an application example of the present invention. Lamp off state 630, lighting state 632, intermediate state 63
1, a luminance map 633 is shown. Lighting information is obtained by setting luminance information in each lighting state. Using this, the on / off state of the lamp is specified from the moving image.

[Embodiment 18] (Claim 18) FIG. 47 is a block diagram showing a configuration of the present invention. The luminance information obtained from the luminance change detecting means is stored in the luminance information recording means 641.
And stored in the luminance information storage means 644 as history data. Further, the current luminance information from the luminance information recording means 641 and the past luminance information from the luminance information storage means 644 are compared by the luminance information comparing means 642, and the display device 643
Will be displayed. The information from the luminance information comparing means 642 is input to the moving image processing device 504, and is input to the moving image display device 505.
Is output to FIG. 48 is a flowchart showing a soundness determination method. It is composed of a display determination S601 of the current frame, a search S602 of a frame of the same display in the past, a screen processing S603 for comparing both, and a comparison processing S604. This allows the present and past displays to be implemented while capturing moving images.

[Embodiment 19] (Corresponding to claim 19) In the apparatus shown in FIG. 47, not only the comparison at that time but also the comparison from a specific moment (lighting of the display, etc.) is continuously performed. , The temporal health of the display can be determined.

FIG. 49 shows an example of determination. By comparing the data 651 of the current display with the data 652 of the past display, the current state of the display can be estimated. For example, if the temporal gradient of the luminance is steep compared to the past history data, it can be determined that the soundness is being impaired.

[Embodiment 20] (Corresponding to claim 20) The present invention will be described below using embodiments. FIGS. 51 to 54 are drawings which are described with reference to a remote monitoring apparatus according to Japanese Patent Application No. 10-231766 used as an embodiment. FIG. 50 is a configuration diagram of the plant monitoring device. FIG. 51 is a detailed functional block diagram of the plant remote device. FIG. 52 is a diagram illustrating a use situation of the image input apparatus. FIG. 53 and FIG. 54 are diagrams for explaining messages used in the plant remote device. FIG. 55 is a configuration example of a correspondence table for selecting a monitoring camera from the color detection result according to the present invention. FIG. 56 is a diagram showing a configuration example of a correspondence table for determining image quality from a color detection result according to the present invention.

The image input device 901 receives a moving image captured by the monitoring camera 904, encodes the moving image by the image compression means 911, and transmits the encoded image by the communication means 915. The image input device 901 sends the encoded moving image data to the image output device 902, and sends and receives messages to and from the image control device 903. Image output device 90
2 decompresses the received moving image using the image decompression means 925 and displays the moving image on the monitoring screen 905 of the plant monitoring device.

[0129] The image control device 903 includes the image input devices 901,
Negotiating with the image output device 902 and the higher-level monitoring system by messages, inputting and transmitting and receiving images according to the situation,
Then, an instruction is given to the image input device 901 and the image output device 902 so that the display is optimized. The image control device 90
3 does not receive moving image data. The image control device 903 has a table shown in FIG. 52, and has an image input device 901 and an image output device 902 connected on a network.
It manages the status and correspondence of

FIG. 53 shows the types of messages used in the plant remote device of the embodiment, and FIG. 54 shows the syntax thereof. The from statement indicates the sender, and the to statement indicates the destination. <ID> is director # 1 or
Use a device identifier such as camera # 1. Director # 1 means the first image control device, and camera # 1 means the first image input device. Ca to send to all image input devices
Specify as mera # all. Describe the message type in subject.

For example, upon receiving the message, the image input device 901 interprets the content by the message interpretation executing means 914, and changes the encoding parameter of the image compressing means 911 if it is a moving image compression command. Alternatively, if the instruction is a camera operation command, panning, tilting, and zooming of the monitoring camera 904 are controlled.

In this embodiment, transmission and reception of messages and moving image data are implemented using a TCP / IP communication protocol via Ethernet. When installing a camera, a set of the monitoring camera 904 and the image input device 901 is connected to a network. The autonomous control means 912 of the image input apparatus 901 is started by turning on the power of the apparatus or by software reset, and starts processing.

The image output device 902 includes, in the image decompression means 925, means for specifying the on / off state of the warning or instruction lamp according to claim 1 from a moving image. The image output device 902 obtains a block number indicating which block has been detected,
Reference is made to the table shown in FIG. If the block number is 2, a plant monitoring camera ID that monitors the plant location corresponding to the lamp is obtained, in this case, camera # 10. Next, the image output device 902 creates a moving image compressed message shown in the following example using the message creating means 923, and
1 sends a message to the surveillance camera. Upon receiving the message, the image input unit 901 interprets the instruction,
Start transmission of the moving image. When the plant monitoring camera ID in the table of FIG. 55 is blank, no message is created and transmitted.

[Embodiment 21] (Corresponding to claim 22) The image output device 902 has a device for detecting a specific color used in claim 1, and receives the determination result of the specific color detection as a color index. Then, based on the index values, the image quality is determined with reference to the table shown in FIG. For example, if the color index value is 100, the image quality fine is obtained by referring to the table.

Next, the image output device 902 obtains a block number indicating which block has been detected, and obtains a plant monitoring camera ID with reference to the table shown in FIG. Then, the image output device 902 creates a moving image compression message shown in the following example using the message creating means 923, and sends the message to the corresponding monitoring camera via the communication means 921. Upon receiving the message, the image input unit 901 interprets the contents of the instruction, and changes the parameters to the image compression unit 911 to change the image quality.

Thus, for example, when the red lamp is turned on, the moving image is transmitted with high image quality, and when the blue lamp is turned on, the moving image is transmitted with normal image quality. Can be done.

[Embodiment 22] (Claims 23 and 24)
The image output device 902 has a character string synthesizing and displaying means 926 and a character string buffer 928, and obtains the plant equipment name as a character string when referring to FIG. 55, and stores it in the character string buffer 928. Next, the character string is superimposed on the moving image decoded by the image decompression means 925 using the character string synthesis display means 926 and sent to the monitoring device 905 (FIG. 57). Also, the contents of the character string buffer 928 are sent to the voice synthesizing means 927 to be converted into voice data, and are sent to the monitoring device 905
(Fig. 57).

[Twenty-third Embodiment] FIG. 60 is a block diagram showing a configuration of the present invention. In FIG. 60, an input video signal captured by a video input device 701 is encoded by a moving image encoding device 702 and a still image encoding device 703, and then transmitted together with control data by a transmission device 704. Transmission forms include, for example, telephone lines,
There are wireless telephone lines and LAN. The decoding device 705 decodes the moving image or still image data sent from the transmission device to create a reproduced image signal. The reproduced image signal is processed by the moving image processing device 706 and then displayed on the moving image display device 707. The moving object detecting means 708 includes a decoding device 705.
The moving object is detected based on the data sent from.
The specific color detecting means 709 detects the color selected by the specific color selecting means 710 based on the data sent from the decoding device 705. Further, the still image encoding timing device 71
According to 1, control information for acquiring a still image is transmitted to the still image encoding device 703 by the transmission device 704 to acquire a still image. Also, the still image is acquired by the still image acquisition timing means 712 on the video photographing side.

The work contents input from the work procedure manual input device 713 are recorded and stored in the work procedure manual database 714.
Data transmission with the image processing device 706 is performed as needed. FIG. 61 is a flowchart showing the overall configuration of the present invention. First, the work content of the sense area work is read by a work procedure manual or the like. Next, a work place corresponding to the actual work is specified, the number of workers at the work place is determined, and the color of the worker's work clothes is determined. Compare this information with the contents of the work procedure manual, and if there is a difference, take action to correct the difference.

FIG. 62 is a flowchart specifically showing this operation. First, the work contents are read from the work procedure database, and the number of works, the work place, the number of workers, the work clothes type (color), and the work data of the work procedure are initialized for each work. Next, a moving body is detected from the image of the input video device at the work place determined based on the work content, and the number of workers is determined using information on the moving body block. At the same time, the worker is detected by the specific color detection function from the color information of the work clothes. The number of workers determined by this device is compared with the number of workers in the work procedure manual, and if there is a difference, measures such as correction recommendations and instructions are taken. In addition, based on the color of the work clothes, an inspection will be conducted to determine whether or not appropriate work clothes are determined according to the work content, and if there are differences, measures such as corrective recommendations and instructions will be taken. In this way, it is possible to monitor whether or not the proper work according to the work content is being performed.

[Embodiment 24] (Corresponding to claim 26) FIG. 63 is a flow chart showing the structure of the present invention. Notification is made by performing a specific movement at the start of work or at the completion of work for each work. This movement is, for example, an operation of waving a hand. In addition, an image indicating a specific color may be indicated on the video input device. This takes a method of, for example, displaying green at the start of work and blue at completion. By taking this measure, it is possible to know the break of the work without any special communication from the worker, and to confirm the work to be performed at the start of the work, to confirm the work to be performed at the completion of the work, and to confirm the next work Instructions can be contacted.

[Embodiment 25] (Corresponding to claim 27) FIG. 64 is a flow chart showing the structure of the present invention. It monitors the image of an area where people would not normally enter, detects the moving object and detects a specific color from the color of the work clothes, and determines whether the moving object in the monitored area is an operator. I can do it. If you are a worker, you can take measures such as warnings, and if not, contact the relevant department to that effect and monitor uninhabited restricted areas. Although the present invention relates to a no-go zone, it is clear from the twenty-fifth embodiment that the present invention can be applied to the monitoring of the number of people in the work area.

[Embodiment 26] (Corresponding to claim 28) FIG. 66 is a flowchart showing the configuration of the present invention. By monitoring the movement of the worker in the work area, it is possible to monitor that the worker is in a state where the movement has lost when any abnormality occurs, and to ensure safety. Monitoring starts when workers appear in the work area. When the movement of the worker is detected, the prescribed work time is measured, and when the worker stops moving, the time during which the movement has stopped since the last stop time is measured. If the work time exceeds the specified time while the movement of the worker is detected, the fact is notified. If the time during which the worker stops moving exceeds the set time, it is determined that some abnormality has occurred and the relevant department is notified. According to the present monitoring device, it is possible to monitor work time and ensure safety in this way.

[Embodiment 27] (Corresponding to claim 29) FIG. 66 is a flow chart showing the structure of the present invention. Video input device for monitoring work area to still image coding timing device
711 or a still image is acquired by the still image encoding timing means 712. The location is specified from the acquired still image, and management area information such as past dose measurement values is searched and read from the history database. The read data is overlapped and pasted at a corresponding location on the still image. This still image data can be displayed on the image display device 707 or transmitted to the site and displayed on a portable terminal or the like at the site. According to the present monitoring device, history data can be displayed on a still image at the site.

FIG. 67 shows an example in which the previous data is displayed on a still image of a pipe or a board.

[0146]

According to the plant monitoring system of the present invention, monitoring can be automated by simple means without using dedicated hardware or using a high-capacity processing device. The quality can be dramatically improved.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of a moving image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration of a moving image encoding process according to an embodiment of the present invention.

FIG. 3 is a diagram illustrating a configuration of a moving image processing apparatus according to an embodiment of the present invention.

FIG. 4 shows a moving picture decoding unit according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a configuration of a block still / movement determination unit and a specific color object detection unit.

FIG. 5 is a diagram illustrating a specific color object detection process according to an embodiment of the present invention.

FIG. 6 is a diagram illustrating a macroblock still / moving determination process according to an embodiment of the present invention.

FIG. 7 is a diagram illustrating a specific color object determination process according to an embodiment of the present invention.

FIG. 8 is a diagram illustrating a specific color object detection process according to an embodiment of the present invention.

FIG. 9 is a diagram illustrating a process of specifying a position of a plant status indicator according to the embodiment of the present invention.

FIG. 10 is an explanatory diagram of acquiring coordinates on an image of a plant status display according to the embodiment of the present invention.

FIG. 11 is a flowchart of a plant state identification process according to an embodiment of the present invention.

FIG. 12 is a flowchart of a device identification process according to an embodiment of the present invention.

FIG. 13 is a flowchart of a plant status indicator position setting process according to an embodiment of the present invention.

FIG. 14 is an explanatory diagram of a method for setting a position of a plant status indicator according to an embodiment of the present invention.

FIG. 15 is a diagram illustrating a device identification process when correcting the position of the identification device according to the embodiment of the present invention.

FIG. 16 is a diagram illustrating a device identification process according to an embodiment of the present invention.

FIG. 17 is a flowchart of a process in the case of a rotary meter according to an embodiment of the present invention.

FIG. 18 is an explanatory diagram of rotary meter coloring in one embodiment of the present invention.

FIG. 19 is a flowchart of processing in the case of a linearly movable meter according to an embodiment of the present invention.

FIG. 20 is a diagram showing a screen display of the movable video input device according to the embodiment of the present invention.

FIG. 21 is a system configuration diagram when controlling a movable video input device according to an embodiment of the present invention.

FIG. 22 is a flowchart of a process of controlling a movable video input device according to an embodiment of the present invention.

FIG. 23 is a flowchart of a moving image transmission process when a movable video input device according to an embodiment of the present invention is used.

FIG. 24 is a screen example of a scroll display of a frame according to the embodiment of the present invention.

FIG. 25 is a flowchart of a display frame selection process according to an embodiment of the present invention.

FIG. 26 is a diagram showing a moving image data structure according to an embodiment of the present invention.

FIG. 27 is a flowchart of display frame selection processing when a detection function is used according to an embodiment of the present invention.

FIG. 28 is a diagram illustrating a moving image data structure when a detection function is used according to an embodiment of the present invention.

FIG. 29 is a diagram showing a display of a detection block in one embodiment of the present invention.

FIG. 30 is a block diagram showing a configuration of a thirteenth embodiment of the present invention.

FIG. 31 is a block diagram illustrating setting of a determination area according to Embodiment 13 of the present invention.

FIG. 32 is a block diagram showing correspondence of a decision basin to a macroblock according to the thirteenth embodiment of the present invention.

FIG. 33 is a flowchart showing the operation of the moving object detection unit according to one embodiment of the present invention.

FIG. 34 is a flowchart illustrating an operation of a macroblock still / moving determination unit according to an embodiment of the present invention.

FIG. 35 is a flowchart showing an operation of a moving object determination unit in one embodiment of the present invention.

FIG. 36 is a flowchart illustrating an operation of noise processing of a moving object determination unit according to an embodiment of the present invention.

FIG. 37 is a flowchart showing an operation of a moving object inclusion process of a moving object determination unit according to an embodiment of the present invention.

FIG. 38 is a flowchart showing an operation of a moving object inclusion process of a moving object determination unit according to an embodiment of the present invention.

FIG. 39 is a flowchart showing an operation of a moving object inclusion process of a moving object determination unit according to an embodiment of the present invention.

FIG. 40 is a diagram illustrating conversion to a macroblock according to the fourteenth embodiment of the present invention.

FIG. 41 is a diagram illustrating conversion into a macroblock according to the fifteenth embodiment of the present invention.

FIG. 42 is a diagram illustrating a reading method using the vertical meter according to the sixteenth embodiment of the present invention.

FIG. 43 is a diagram illustrating a reading method using the rotary meter according to the embodiment of the present invention.

FIG. 44 is a block diagram showing a configuration of a seventeenth embodiment of the present invention.

FIG. 45 is a block diagram illustrating a configuration of a luminance detecting unit according to Embodiment 17 of the present invention.

FIG. 46 is a diagram illustrating luminance detection according to the seventeenth embodiment of the present invention.

FIG. 47 is a block diagram illustrating a configuration example of a luminance information comparing unit according to an eighteenth embodiment of the present invention.

FIG. 48 is a flowchart showing the operation of the eighteenth embodiment of the present invention.

FIG. 49 is a block diagram illustrating aging according to the nineteenth embodiment of the present invention.

FIG. 50 is a diagram showing a system configuration of a plant monitoring device according to an embodiment of the present invention.

FIG. 51 is a functional block diagram of a plant monitoring device according to an embodiment of the present invention.

FIG. 52 is a status table of an image input device and an image output device according to an embodiment of the present invention.

FIG. 53 is a list of messages used for control of each device and information exchange in the embodiment of the present invention.

FIG. 54 shows a syntax of a message used for control of each device and information exchange in one embodiment of the present invention.

FIG. 55 is a configuration example of a correspondence table for selecting a monitoring camera from a color detection result according to the present invention.

FIG. 56 is a configuration example of a correspondence table for determining image quality from a color detection result according to the present invention.

FIG. 57 is a configuration example of a character notification unit and a voice notification unit of a plant abnormality location according to the present invention.

FIG. 58 is a diagram illustrating a mechanism for automatically selecting a camera from a meter indication value according to the present invention.

FIG. 59 is a diagram illustrating a flow of automatically controlling a camera according to the present invention.

FIG. 60 is a block diagram showing a configuration example of a twenty fifth embodiment of the present invention.

FIG. 61 is a flowchart showing an operation of Embodiment 25 of the present invention.

FIG. 62 is a flowchart showing the operation of the twenty-fifth embodiment of the present invention.

FIG. 63 is a flowchart showing an operation of Embodiment 26 of the present invention.

FIG. 64 is a flowchart showing an operation of Embodiment 27 of the present invention.

FIG. 65 is a flowchart showing an operation of Embodiment 28 of the present invention.

FIG. 66 is a flowchart showing the operation of Embodiment 29 of the present invention.

FIG. 67 is an example of application of the twenty-ninth embodiment of the present invention.

[Explanation of symbols]

11: plant status display device, 12: video input device, 13: video coding and transmitting device, 14: video processing device, 15: video display device, 21: movable video input device control device, 22
… Movable video input device, 101… input buffer, 102
... Demultiplexing unit, 103 ... Variable length decoding unit, 104 ... Dequantization unit, 105 ... IDCT unit, 106 ... Adder, 107 ... Frame memory, 108 ... Motion compensation unit, 109 ... Switch, 111 ... Macro block static Motion determination unit, 112: subtractor, 113: specific object determination unit, 114: specific color designation unit,
201: moving picture decoding section, 202: block still / moving determining section, 203: specific color object detecting section, 204: display position setting section, 205: display state determining section, 206: moving picture coding section, 301: block , 302 ... subtractor, 303 ...
Mode selection switch, 304 DCT unit, 305 quantization unit, 306 inverse quantization unit, 307 IDCT unit, 308 adder, 309 frame memory, 310 motion compensation unit
311: switch, 312: mode selector, 411: moving image display, 412: graphics display, 413: related information display, 421: moving image display, 422: frame image display, S101: macroblock still / moving judgment processing, S102 …
Specific color object determination processing, S201: loop processing, S202: loop processing, S203: mode determination processing, S204: macroblock still / movement determination processing, S205: macroblock still / movement determination processing, S206: moving macroblock processing S207: still macro Block processing, S208: loop end processing, S209: loop end processing, S301: specific color detection processing, S302: specific color object inclusion processing, S303: shooting area selection processing, S304 ...
Reference point coordinate acquisition processing, S305: coordinate setting processing, S306: individual apparatus coordinate setting processing, S311: block center coordinate acquisition processing, S312: inclusion display acquisition processing, S313: display state determination processing, S314: flicker state determination processing S321: Area size comparison processing, S322: Detection registration processing, S323: Block removal processing, S324: Detection registration processing, S331
… Layout diagram setting processing, S332… Video direction acquisition processing, S
333: Image display surface setting process, S334: Projection diagram generation process,
S335: Display area selection processing, S336: Reference point coordinate acquisition processing, S337: Reference point setting processing, S338: Display coordinate calculation processing, S341: Area coordinate acquisition processing, S342
… Inclusion indicator selection processing, 343… Inclusion rate calculation processing, S
344… Area coverage judgment processing, S345… Detection registration processing,
S346: Selection display determination processing, S351: Angle calculation processing, S352: Detected object angle calculation processing, S353: Magnification ratio calculation processing, S354: Movable video input device control processing,
S361: Detection judgment processing, S362: Compression rate change processing,
S363: fixed video transmission processing, S364: movable video transmission processing, S365: movable video transmission end processing, S366: fixed video transmission processing, S371: moving image processing, S372: interval determination processing, S373: frame display generation processing, S374
… Interval clear processing, S375… Interval count processing,
S376: Frame data storage processing, S381: Moving image processing, S382: Interval determination processing, S383: Detection determination processing, S384: Frame display generation processing, S385: Interval clear processing, S386: Interval counting processing, S387: Frame data storage processing , S401… Loop processing, S402…
Loop processing, S403: Macroblock static / dynamic judgment processing,
S405: Specific color determination processing, S407: Loop end processing,
S408: Loop end processing 901: Image input device, 902: Image output device, 903:
Image control device, 904 ... Surveillance camera, 905 ... Surveillance device, 906 ... Network

──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Takeshi Kenjo 1 Kosuka Toshiba-cho, Saiwai-ku, Kawasaki-shi, Kanagawa Prefecture Inside Toshiba R & D Center (72) Inventor Shun Ikeda 8 Shinsugita-cho, Isogo-ku, Yokohama-shi, Kanagawa Toshiba Corporation Yokohama Office (72) Inventor Yoshihiro Kikuchi 1 Kosaka Toshiba-cho, Saiwai-ku, Kawasaki-shi, Kanagawa Prefecture Toshiba Corporation Research and Development Center (56) References JP-A-2-121008 (JP, A) JP JP-A-7-222137 (JP, A) JP-A-8-123946 (JP, A) JP-A-9-93570 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) H04N 7 / 18

Claims (29)

(57) [Claims] 1. A video input device for photographing a plant status display panel on which a display for displaying a process state of a plant or a status of equipment is arranged and converting the video signal into a video signal, and inputting the video signal to generate encoded data A moving image encoding / transmission apparatus for transmitting, a moving image processing apparatus for processing the encoded data, and a moving image display apparatus for displaying a result of data processing by the moving image processing apparatus; Moving image decoding means for decoding the coded data in units of blocks to obtain decoded moving image data, and for each block of the decoded moving image data, the image in the block is in a static state. Static / moving determining means for determining whether there is a moving block or not and detecting a moving block; and specifying the block in advance from the color data of the moving block. A specific color block determining means for determining whether an object of a specific color is detected or not, and a display for specifying a display corresponding to the specific color block on the specific block and the blunt state display panel and determining display contents. A plant monitoring device, comprising: a device determination means for monitoring the plant status display panel and specifying display contents of a display device. 2. The plant monitoring apparatus according to claim 1, wherein said display determining means corresponds to a set of adjacent specific color blocks determined to be the same specific color by said specific color block determining means. A plant monitoring apparatus comprising: a specific color block separation / identification unit that identifies a display corresponding to a set of separated specific color blocks after being separated into a set of specific color blocks. 3. The plant monitoring apparatus according to claim 1, wherein an angle detecting means for detecting an angle between a photographed video projection surface of the plant status display panel and a display surface of the plant status display panel, and the plant status display. A layout projection map creating means for creating a layout projection map by projecting the display layout map of the board onto a projection plane, and a display by superimposing on the display of the image display means with matching the reduction ratio of the layout projection map. Means for specifying the displayed indicator. 4. A blunt monitoring apparatus according to claim 3, further comprising: a display specifying unit configured to read a degree of overlap between the detection area and the display area of the arrangement projection view when a specific color is detected, and specify the display. A plant monitoring device, comprising: 5. A plant status display panel having a needle-pointing type indicator in which a state value of a process of a plant is indicated by a rotation angle of a needle and a tip portion and a start point of the needle are colored in a specific color. A video input device that serves as a video signal, a video encoding / transmission device that receives the video signal as encoded data, and a video processing device that processes encoded video data,
A moving image display device that displays a result processed by the moving image processing device, wherein the moving image processing device decodes the moving image data in block units and decodes the moving image data in units of blocks. A static / moving block determination color determining means for determining whether the image in the block is in a stationary state or in a moving state and detecting the moving block; A blunt monitoring device comprising: a pointing angle reading means for reading the angle of the needle from the coordinates of the tip of the needle and the coordinates of the starting point of the needle of the needle indicating type display that has moved from a position. 6. A video input device for photographing a plant status display panel having an indicator for indicating a state value of a process of a plant and for coloring a background of an area where an indicator moves, and for converting the image signal into an image signal. A moving image encoding transmission device that inputs and encodes data, a moving image processing device that processes encoded moving image data, and a moving image display device that displays a result processed by the moving image processing device. Wherein the moving image processing apparatus decodes the moving image data in block units, and in each block of the decoded moving image data, the image in the block is in a stationary state or in a moving state. Static-moving block determining means for determining whether or not a moving block has been determined, and specific color determining means for determining the occurrence of a specific color from the color data of the moving block;
And a designated value specifying means for specifying a designated value from a size of a continuous block in which the generation of the specific color is determined. 7. The plant monitoring device according to claim 1, wherein the moving image display device has a database of a graphics screen corresponding to the captured display device and the indicator device, A blunt monitoring apparatus characterized in that the display of the specific result is displayed together with a corresponding graphics screen to clarify the display contents. 8. An image of a plant state display panel on which at least one of a display unit and an indicating instrument for displaying a state of a process of a plant and a state of equipment is arranged, and a photographing position is fixed and a wide range is photographed. A fixed video input device as a signal, a video coding transmission device that inputs the video signal and converts it into coded data, a video processing device that processes the coded data, and data processing with the video processing device A moving image display device that displays a result of the moving image processing, the moving image processing device decodes the encoded data in block units to obtain moving image data as decoded moving image data, Static / moving determining means for determining, for each block of the decoded moving image data, whether the image in the block is in a stationary state or a moving state, and detecting a moving block; A specific color object determining means for determining whether or not the block is a specific color specified in advance from the color data of the existing block and detecting an object of the specific color; and a pattern in which the specific color block is continuously formed. It has an object size specifying means for specifying the size of the specific color object and a position specifying means for detecting the position of the specific color object, and further, based on the size and the position of the specific color object, a shooting direction and a position. And a movable image input device for setting an enlargement factor and clearly capturing an image of the specific color object. 9. The plant monitoring apparatus according to claim 8, wherein when the specific color object is not detected, an image input and processed from the fixed video input device is transmitted to a moving image display device, and the specific color object is transmitted. Is detected, the image of the movable image input device is transmitted to a moving image display device, and the amount of data transmitted and processed from the fixed image input device is reduced and transmitted, whereby the movable image is transmitted. A plant monitoring device characterized in that an image by a video input device and an image input and processed from a fixed video input device can be displayed simultaneously. 10. An image of a plant state display panel on which at least one of a display unit and an indicating instrument for displaying a process state of a plant and a state of a device arranged thereon is photographed over a wide range with a fixed photographing position. A fixed video input device as a signal, a video coding transmission device that inputs the video signal and converts it into coded data, a video processing device that processes the coded data, and data processing with the video processing device A moving image display device that displays the obtained result, wherein the moving image processing device or the moving image display device has a moving image storage unit that stores a moving image, and a fixed period from among the stored moving images. Storage image selection display means for selecting a frame for each and displaying the selected image on the moving image display device, and displaying the frame image of the moving image stored together with the moving image display displayed in real time at a fixed time Selecting at intervals, scrolling the selected frame image in accordance with the progress of time, and when a specific frame image is selected from the frame images displayed on the display, expanding the frame image. Features plant monitoring equipment. 11. The plant monitoring apparatus according to claim 10, wherein the moving image processing device decodes the moving image data in block units and determines whether an image in the block is in a still state or a moving state for each decoded block. Means for detecting a moving object or a color from the result of the judgment, and a means for specifying the detected moving object or a specific color on an image, so that a frame at the time of detection is displayed instead of displaying a frame image at fixed time intervals. A plant monitoring apparatus, wherein a display indicating a moving object or a specific color is superimposed and displayed on the detection frame. 12. The plant monitoring apparatus according to claim 10, wherein a frame selection mode is provided for displaying a frame image, and when this mode is selected, automatic sequential forwarding of frames is temporarily stopped, and all frames before the selected time point are stopped. A plant monitoring apparatus, wherein a frame or a frame selected at a short cycle interval is scroll-displayed. 13. A video input device for photographing a state of each part of a plant, a video coding transmission device for coding and transmitting a video input, a video processing device for performing video processing of the encoded data, and the video A moving image display device that displays a result of the data processing performed by the processing device, wherein the moving image processing device includes a decoding unit that decodes encoded moving image data, and a decoded moving image data. A moving image processing unit that decodes moving image data in blocks and determines whether the image in the block is in a still state or a moving state for each decoded block and detects a moving object in the moving image A plant monitoring apparatus comprising: a moving object detecting unit that performs a moving object determination; and a determination region adjusting unit that limits and adjusts a block to be determined as a moving object within a specified region. 14. The plant monitoring apparatus according to claim 13, wherein when the movement of the moving object detected by the moving object detecting means exceeds the designated area, the area of the block to be determined as the moving object. A plant monitoring device comprising: means for moving an object in accordance with a moving direction of a moving object. 15. The area of a block to be determined as a moving object when the movement of the moving object detected by the moving object detecting means exceeds the specified area. A means for enlarging or reducing the size according to the movement of a moving object. 16. The plant monitoring apparatus according to claim 13, wherein the movement is specified by the moving object detection means, and the pointer of the needle type indicator is detected, and is shielded by the pointer. A plant monitoring device comprising means for specifying an indicated value of an indicating plate. 17. A video input device for photographing a plant status display panel on which a display for displaying a state of a process of a plant and a status of equipment is arranged, and converting the video signal into a video signal; A moving image encoding and transmitting device, a moving image processing device that processes the encoded data, and a moving image display device that displays a result of the data processing performed by the moving image processing device. The apparatus includes: a moving image decoding unit that decodes the encoded data in units of blocks to obtain decoded moving image data; and an image in a block in a stationary state for each block of the decoded moving image data. Static / moving determining means for determining whether or not there is a moving state by detecting from the luminance data a block having a movement, and a display for determining display contents from the luminance data of the moving block. Plant monitoring apparatus characterized by having a state specifying means. 18. The plant monitoring apparatus according to claim 17, wherein said means for continuously recording luminance data of a block determined to be a moving object, and wherein said luminance data of said block determined to be a moving object is recorded. Means for determining the soundness of the display by comparing with the luminance data. 19. The plant monitoring apparatus according to claim 18, wherein the comparison of the data is performed continuously over time to obtain the temporal change of the characteristic, thereby determining the soundness of the status indicator. A plant monitoring device characterized by the above-mentioned. 20. The plant monitoring apparatus according to claim 1, wherein the plant has a monitoring camera for monitoring each part, and includes a warning lamp and an indicator lamp, and displays a state of a process of the plant and a state of equipment. A plant monitoring device, wherein a state of a vessel is identified from the static / moving determination means of the moving image data block, and a moving image of a monitoring camera at a location of a plant corresponding to the moving block is displayed. . 21. The plant monitoring apparatus according to claim 5, wherein the plant has a monitoring camera for monitoring each location, and the indicator is provided when the indicator value of the indicator is out of a specified range. A plant monitoring device, wherein a moving image of a monitoring camera at a plant corresponding to the total is displayed. 22. The plant monitoring apparatus according to claim 1, wherein the plant has a monitoring camera for monitoring each part, and when the abnormality is determined by identifying color information of an alarm lamp or an indicator lamp. A plant monitoring device characterized in that it can be displayed by a monitoring camera at a plant corresponding to a lamp. 23. The plant monitoring apparatus according to claim 20, wherein the name of the process or the equipment determined to be abnormal and the displayed abnormal state are converted into text data, superimposed on a moving image, and displayed on the moving image display device. A plant monitoring device characterized by displaying. 24. The plant monitoring apparatus according to claim 20, wherein the name of the process or equipment determined to be abnormal and the displayed abnormal state are voiced using a voice synthesizing unit, and the voice is displayed simultaneously with the display of the moving image. A plant monitoring device characterized in that it is used for notification. 25. A video input device for photographing a situation of a plant, a video encoding device for encoding and transmitting the video input, and a still image encoding device for encoding a specific image from the video input as a still image. A still image encoding timing device for instructing the timing of performing still image encoding, a transmission device for bidirectionally transmitting encoded moving image data, still image data and control data, and an encoded moving image And a decoding device for decoding still image data, a moving object detecting device for detecting a moving object in a moving image, a specific color detecting device for detecting a specific color in a moving image, and a specific color detecting device A specific color selecting device that specifies a specific color to be detected by the image processing device, an image processing device that receives decoded moving image and still image data and performs data processing, and a processed moving image and still image A moving image display device for displaying an image, wherein the image processing device reads a work content in a control area of the plant by detecting a moving object, a specific color object, and a still image in the plant, and reads the work content in the plant based on the reference work. A plant monitoring device comprising means for comparing a procedure with a procedure to detect a difference, and when a difference is recognized, a recommendation or instruction for correction is given. 26. The plant monitoring apparatus according to claim 25, wherein the image processing device detects a specific movement or a specific color at the time of starting or completing the operation of the plant to determine the start or completion of the operation. A plant monitoring apparatus having a recommendation or instruction regarding the content of work to be performed subsequently. 27. The plant monitoring device according to claim 25, wherein the image processing device has means for determining the presence or absence of a worker in a restricted area of the plant, and issues a warning or instruction when the presence is determined. A plant monitoring device characterized by performing. 28. The plant monitoring device according to claim 25, wherein the image processing device has means for determining the presence or absence of a worker in the work area, and when the movement of the worker is not detected for a certain period of time, A plant monitoring device for notifying an area and a surrounding area. 29. The plant monitoring apparatus according to claim 25, wherein the image processing apparatus specifies a shooting location of the obtained still image, obtains a history of the status of the shooting location, and obtains a past history of the obtained still image. A plant monitoring device comprising means for superimposing historical information of a plant.