JPH1079932A - Monitoring device and method for linking plural picture and device therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To continuously monitor a subject extended to one direction by synthesizing a picture obtained by image picking-up a subject having a longitudinal length, and scroll-displaying it along a longitudinal direction of a subject on a display device. SOLUTION: The picture signals of a subject 28 image picked-up by each image pickup means 22a-22e are transmitted through a cable 23 to a picture processor 24. A picture processing device 24 fetches a picture signal transmitted from each image pickup means 22a-22e, operates a synthesizing processing based on an identification mark 30, converts it into a synthetic screen signal, and transmits it to a controller 25 and a storage device 26. The controller 25 converts it so as to be scroll-displayed on a display device 27. Thus, the picture signals outputted by each image pickup device 22a-22e which image picks-up the subject 28 can be synthesized, and the synthetic pictures linked in the longitudinal direction of the subject 28 can be scroll-displayed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a monitoring apparatus for capturing an image of an object using a plurality of image capturing devices, synthesizing the images, and scroll-displaying the images on a display device, and a method and apparatus for connecting a plurality of images.

[0002]

2. Description of the Related Art Conventionally, liquefied natural gas (hereinafter referred to as "LN
G) is usually filled with nitrogen gas in a tunnel (common groove) in which pipes for supplying the pipes are arranged to prevent LNG leaking from the pipes from being ignited. Have been. In addition, a surveillance camera is provided in the tunnel to monitor liquid leaks and human intrusion.
Although the tunnel is buried underground, images obtained from surveillance cameras are sent to a central station on the ground, for example. The observer watches the image sent to the central office, and the inside of the tunnel is monitored.

FIG. 7 is a longitudinal sectional view of a tunnel 1 buried underground and provided with a conduit 3 for transporting LNG. In the tunnel 1, a metal conduit 3 is placed on a gantry 2 erected from the bottom of the tunnel 1.

On the upper surface of the tunnel 1, a plurality of monitoring cameras 4a to 4c and an illuminator 5 are arranged along the axial direction of the conduit 3. For example, an image captured by the monitoring camera 4a is sent to a central station on the ground by a cable (not shown). As a result, an image sent from the monitoring camera 4a to the central office is displayed on a display device called a CRT and monitored by a monitoring person. If there is no abnormality in the conduit 3 or in the vicinity of the conduit 3 displayed on the display device, the observer operates the changeover switch to activate another surveillance camera 4b.
Alternatively, the image sent from 4c is displayed. In this way, the pipe 3 and the vicinity thereof are monitored by a plurality of monitoring cameras 4.
Monitoring is performed by repeating the operation of switching and viewing the images sent from a to 4c. Instead of the monitoring cameras 4a to 4c, the conduit 3 can be monitored using a traveling robot equipped with a small camera. An image from the mounted small camera is sent to a display device that is watched by a monitor through a cable connected to the small camera. By monitoring the traveling robot along the conduit 3 by remotely operating the traveling robot, the observer can monitor the conduit 3 and its vicinity without entering the tunnel 1.

[0005]

As described above, according to the method of monitoring a tunnel by installing a plurality of surveillance cameras, an observer displays an image sent from another surveillance camera when continuously monitoring a conduit. Therefore, there is a problem that the switching operation has to be repeatedly performed, which is troublesome. As shown in FIG. 7, when the image sent from one surveillance camera 4a does not overlap with the image sent from the surveillance camera 4b, the blind spot of the conduit 3 and its vicinity should be monitored. Can not. Further, when the images of the monitoring camera 4a and the monitoring camera 4b are overlapped, the same subject is displayed as two images, so that there is a problem that monitoring is inefficient when monitoring. Further, the above-described method of mounting a small camera on a traveling robot and monitoring the conduits may cause the robot to move at high speed because the friction generated between the tunnel and the robot may reduce the explosion-proof property in the tunnel. Can not do. A cable is connected to the small camera of the traveling robot, and the range of movement of the traveling robot is limited by the length of the cable. That is, for example, gas leaks, fires,
When an abnormality such as liquid leakage or intrusion of a person occurs, it is not practical because it cannot be quickly responded.

[0006] Such a problem occurs not only in a conduit but also when a subject extending in one direction such as a station platform or a plant must be continuously monitored.

[0007] It is an object of the present invention to provide a monitoring apparatus and a method and apparatus for joining a plurality of screens, which can suitably monitor a subject extending in one direction continuously.

[0008]

According to the present invention, there are provided a plurality of image pickup means arranged so as to partially overlap an image pickup range along a longitudinal direction of a subject extending in one direction; A monitoring device, comprising: image processing means for synthesizing an image in a scrollable manner; and display means for displaying the image. According to the present invention, the plurality of imaging units are arranged along the longitudinal direction of the subject extending in one direction.
Since the imaging ranges are arranged so as to overlap with each other, it is possible to preferably perform imaging of a subject having a longer length in the longitudinal direction than the imaging range. The images obtained by the imaging unit are synthesized by the image processing unit so that the overlapping imaging range portions coincide. This can solve the problem that a part of the same subject is displayed as a plurality of images by a plurality of imaging units. The synthesized image is scrolled by the control means and scroll-displayed by the display device. Since the image of the subject extending in one direction displayed on the display means is continuously displayed as if the imaging means is moving along the longitudinal direction of the subject, the subject extending in one direction is continuously displayed. Can be monitored.

Further, the present invention is characterized in that one or a plurality of identification marks are provided on a subject which is an overlapping part of the imaging range. According to the present invention, one or a plurality of identification marks are attached to a part of the subject, which is imaged by the plurality of imaging means in a superimposed manner, for example, by an adhesive or the like. It is possible to reliably identify a part of the image to be synthesized and synthesize the image.

Further, the present invention is characterized in that it includes a plurality of illuminating means scattered in the imaging range, and lighting means for illuminating each illuminating means during monitoring. According to the present invention, since a plurality of illuminating means are scattered in the imaging range, by illuminating the illuminating means, an amount of light necessary for monitoring a subject at night or in a place where sunlight does not reach is obtained. be able to. Further, since the lighting means is turned on only during monitoring, power can be saved and the service life of the lighting means can be improved.

Further, the present invention is characterized in that it includes a lighting means for lighting each lighting means only when an abnormality occurs. According to the present invention, since each lighting means is turned on only at the time of abnormality, the observer visually checks the image displayed on the display device and confirms whether or not each lighting means is turned on. Since it is possible to determine whether or not the monitoring is performed, monitoring becomes easy.

Further, the present invention is characterized in that it comprises a detecting means for pattern-recognizing the synthesized image and detecting an abnormality. According to the present invention, the monitoring device performs pattern recognition on the synthesized image and detects an abnormality. An abnormality that is difficult to recognize with the naked eye can be detected.

Further, the present invention is characterized by including a storage means for storing the synthesized image. According to the present invention, since the monitoring device includes the storage unit that stores the combined image, the monitoring device can store the combined image. The storage amount can be reduced as compared with a case where a plurality of imaging units are provided with storage units for storing the respective images. Further, for example, when playing back stored images, there is no need to play back each image obtained by the plurality of imaging means one by one.

According to the present invention, a combination of a plurality of imaging means arranged so that the imaging ranges partially overlap, a plurality of identification marks provided around a subject, and a plurality of identification marks is used for each imaging range. And image processing means for combining the images so that lines connecting the identification marks overlap each other. According to the present invention, the images obtained by the plurality of imaging units are sent to the image processing unit. In the image,
In addition to the subject, an identification mark provided around the subject is also imaged. In the image processing means, the images are combined so that the same line provided at both ends of each imaging range, that is, the same line connecting the combination of the identification marks imaged at both ends of each image is overlapped. This makes it possible to easily obtain a composite image. For example, even if the subject has a size that does not fit within the imaging range of one imaging unit, a composite image of the entire subject can be easily obtained.

Further, the present invention is characterized in that the line connecting the identification marks is perpendicular to the longitudinal direction of the subject. According to the present invention, a line connecting the identification marks is
Since the identification marks are arranged so as to be perpendicular to the longitudinal direction of the subject, the number of the identification marks can be reduced as compared with the case where the identification marks are randomly arranged. As a result, the processing speed of the image processing means can be improved.

Further, the present invention is characterized in that the plurality of imaging means are arranged so that the imaging ranges overlap along the longitudinal direction. According to the present invention, since the plurality of imaging units are arranged along the longitudinal direction of the subject, the number of necessary imaging units can be reduced as compared with a case where the imaging units are arranged randomly. This can reduce costs.

Further, the present invention is characterized in that a combination of a plurality of identification marks is provided at both ends of each imaging range, and each image is connected so as to overlap a line connecting the plurality of identification marks. Is a method of joining images. According to the present invention, since the same line connecting a combination of a plurality of identification marks imaged at both ends of each image is synthesized so as to overlap, a part of the image is not duplicated or missing A complete constituent image can be easily obtained.

[0018]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a system diagram for explaining a basic configuration of a monitoring device 21 according to an embodiment of the present invention. The monitoring device 21 includes five imaging devices 22a to
22e, an image processing device 24, a control device 25, a storage device 26, and a display device 27. The five imaging devices 22a to 22e are arranged in one direction, for example, along the longitudinal direction of the horizontally long subject 28. As shown in FIG. 1, the distance between the imaging device 22a and the imaging device 22b is such that the imaging devices 22a and 22b
8 are adjusted so that the ends of the imaging ranges S1 and S2 for imaging the image 8 overlap. The distance between other adjacent imaging devices is adjusted in the same manner. Further, the imaging ranges S1 and S1
The subject 2 in the overlapping imaging range W1 in which the area 2 overlaps
An identification mark 30 is adhered to the surface of 8 by means such as an adhesive.

An image signal of the subject 28 taken by each of the image pickup means 22a to 22e is sent to an image processing device 24 via a cable 23. The image processing device 24 captures an image signal sent from each of the imaging units 22a to 22e,
Based on the signal of the identification mark 30, a synthesizing process described below is performed, converted into a synthesized screen signal, and sent to the control device 25 and the storage device 26. The control device 25 converts the combined screen signal so that the display device 27 scrolls the display. Accordingly, each of the imaging devices 22a to 22e that has captured the subject 28
Can be combined and the combined image connected in the longitudinal direction of the subject 28 can be scrolled and displayed. The signal stored in the storage device 26 can be reproduced and displayed on the display device 27 by operating the control device 25.

FIG. 2, FIG. 3 and FIG. 4 are diagrams for explaining the use state of the monitoring device 21 according to the embodiment of the present invention.
FIG. 2 is a simplified view of a tunnel 32 provided with the imaging devices 22a to 22e. FIG. 2 is a longitudinal sectional view, FIG. 3 is a horizontal sectional view, and FIG. The tunnel 32 buried in the ground includes a fume tube 33, a gantry 35, and conduits 36a and 36b, and is a lower surface 37 of an internal space 34 of the fume tube 33 made of concrete and formed in a cylindrical shape. The gantry 35 is erected from below (from the lower side in FIGS. 2 and 4), and metal-made cylindrical conduits 36a and 36b are placed on the upper surface of the gantry 35. On the upper surface 38 of the internal space 34 of the fume tube 33, five imaging devices 22a to 22e are arranged at regular intervals along the longitudinal direction of the conduits 36a and 36b.
To 22e, the length of the interval between each adjacent imaging device is:
The end of the imaging range is set so as to overlap the end of the imaging range of an adjacent imaging device.

The remaining portion of the upper surface of the internal space 34 of the fume tube 33 includes a gas sensor 39 and an illuminator 40.
Are arranged at equal intervals along the longitudinal direction of the conduits 36a and 36b. The gas sensor 39 is located in the internal space 34.
It is output when the concentration of a certain substance (for example, the concentration of methane gas) exceeds a predetermined value, issues an alarm to a central station on the ground, and automatically activates the monitoring device when the monitoring device 21 is not operating. 21 is provided for actuation. The illuminator 40 is linked to each of the imaging devices 22a to 22e,
When one or more of the conduits 36a, 36b of the imaging devices 22a to 22e is being imaged, the imaging range is illuminated, and the image quality of the image obtained by the imaging device can be improved. An imaging range of the imaging device 22a;
The conduits 36a and 36 overlap with the imaging range of the imaging device 22b.
6b, metal tapes 43a, 43b respectively
Is affixed. The metal tapes 43a and 43b are shown in FIG.
As shown in the figure, the distances L1 and L2 from the imaging device 22a are L
1 = L2, and each of the imaging devices 22a to 22e
And the line direction connecting the metal tapes 43a, 43b is perpendicular to the line direction. Each metal tape 43a,
On the surface of 43b facing the imaging device 22a, the identification mark 49a is painted black, and the margin is painted in the same color as that painted on the conduits 36a, 36b. Identification mark 50a
Metal tapes 44a-46a and 44b-46b are painted in black, and the margins are painted in the same color as the colors painted on the conduits 36a, 36b.
Also, like the metal tapes 49a and 49b, the conduits 36a and 3
6b are attached at equal intervals along the longitudinal direction of 6b.

Although a metal tape is used in the present embodiment, the identification marks 49a to 52a and 49b to 52b may be drawn directly on the conduits 36a and 36b with black metal paint. By providing such an identification mark, it is possible to easily identify an end to be combined by, for example, an image sensor built in the image processing device 24. The images of the conduits 36a, 36b and the vicinity thereof captured by the respective imaging devices 22a to 22e are as follows.
It is transmitted as an image signal to a central station on the ground by a cable (not shown).

FIG. 5 is a schematic diagram for explaining a method of joining images sent from the imaging devices 22a to 22e. A plurality of (five in the present embodiment) imaging devices 22a to 22e are used to connect a plurality of images.
And identification marks 49a-52a and 49b-52b
And an image processing device 24. Each imaging device 2
Each image 47a-47e imaged by 2a-22e
Is sent to the image processing device 24 as an image signal and is synthesized. At this time, the image processing device 24 outputs the images 47a to 47a.
Each of the identification marks 49a to 52a and 49b to 52b imaged in 7e is identified two by two, and the images 47a to 47e are synthesized such that the identification marks 49a to 52a and 49b to 52b overlap one each.

For example, the identification marks 49a shown above the images 47a and 47b in the vertical direction (up and down direction in FIG. 5) respectively correspond to the metal tape 43 attached to the conduit 36a.
a is a captured image, and an image 47a and an image 47
b, identification marks 49 respectively shown below the vertical direction.
b shows an image of the metal tape 43b attached to the conduit 36b. When the image 47a and the image 47b are combined, two identification marks 49a shown in the horizontal direction (left and right direction in FIG. 5) of each of the images 47a and 47b are added to the image 4a.
The image 47a and the image 47b are slid in a direction approaching each other so that the two identification marks 49b shown in the horizontal direction of 7a and 47b overlap. The identification marks 49a of the image 47a and the image 47b overlap and
When the respective identification marks 49b of the image 7a and the image 47b overlap, the image 47a and the image 47b are combined.
Image 47b and image 47 which are other two adjacent images
c, image 47c and image 47d, image 47d and image 47e
Similarly, when the identification marks 50a to 52a overlap and the identification marks 50b to 52b overlap, the combining process is performed. In the present embodiment, although the synthesizing process is performed so that the identification marks match, for example, identification marks 49a and 49 displayed on image 47a are displayed.
The image 47a and the image 47b are slid in a direction approaching each other so that the line connecting b and the line connecting the identification marks 49a and 49b displayed on the image 47b coincide with each other. When the above two lines overlap, image 4
7a and the image 47b are combined. Other neighbor 2
The same applies to the two images. Thus, the combining process may be performed such that the lines overlap each other. Images 47a-
47e, the combined image 54 combined by the image processing device 24 is sent to the control device 25 (see FIG. 1) and the storage device 26 (see FIG. 1) as a combined signal. Control device 25
Indicates that the display device 27 moves the image 54 from one lateral end 55 to the other lateral end 56 or the other lateral end 56
The composite signal is controlled so as to scroll and display from one side to one end 55 in the horizontal direction. The storage device 26 stores the transmitted composite signal in a memory provided in the storage device 26. The signal stored in the memory is reproduced by operating the control device 25 and displayed on the display device.

The storage device 26 may be, for example, a video tape recorder, and may record an image sent from the image processing device 24 on a video tape. By operating the storage device 26 at all times, if any abnormality occurs in the subject, the situation can be imaged and recorded. By analyzing this record, a more secure system can be constructed.

FIG. 6 is a flowchart shown to explain the operation for monitoring tunnel 32 according to the embodiment of the present invention. The operation starts from step a0, and in step a1, it is determined whether to operate the monitoring device 21. When the monitoring device 21 is not operating, only the output of the gas sensor 39 is sent to the central office. When the gas concentration in the tunnel 32 exceeds the specified value by the gas sensor 39, the monitoring device 21 automatically starts the operation.
When the monitoring device 21 starts operating, the illuminator 40 that illuminates the imaging range of the imaging devices 22a to 22e in the internal space 34 is turned on in step a3, and in step a4, each of the imaging devices 2 is turned on.
The conduits 36a and 36b are imaged by 2a to 22e. These captured images 47a to 47e are
5, a composite image 54
Becomes The synthesized image 54 is output from the control device 25 as a synthesized signal.
And sent to the storage device 26, stored in the memory of the storage device 26 in step a6, and scroll-displayed on the display device 27 via the control device 25 in step a7. The observer determines whether to prohibit the scroll display in step a8. When the scroll display is stopped, it is determined whether or not to view the image stored in the storage device 26 in step a9. When the stored image is to be viewed, a signal input to the control device 25 is transmitted from the storage device 26. Switch to the desired signal. Step a1
1. In step a12, an image pickup device that picks up an image of a location to be monitored on the conduits 36a and 36b is selected, and step a13 is performed.
In, it is determined whether to enlarge the displayed image. To enlarge the image, the user operates the display device 27 to enlarge the image. At this time, the image displayed by the display device 27 may be an image directly sent from the imaging device instead of the composite image 54. In step a15, the observer monitors the displayed image to see if there is any abnormality. In this embodiment, five imaging devices are used, but more may be used. For example, assuming that the imaging range S1 or S2 shown in FIG. 1 is 10 m and the conduits 36a and 36b have a length of 1 km in the longitudinal direction, by using 100 imaging devices, the observer can use the imaging devices 22a to 22e. , 36b, the entire length of the conduits 36a, 36b can be monitored simply by looking at the display screen of the display device 27 that scrolls the captured images. In addition, when an abnormality occurs, the scroll display is immediately stopped, and the abnormal state can be visually displayed by selecting an image sent from the imaging device that is imaging the abnormal part.

Further, by displaying the composite image 54 with a device called a thermography which can display the temperature distribution of the imaged object, it is possible to monitor the temperature change of the subject.

It is also possible to make the synthesized image 54 pattern-recognized and detect an abnormality.

[0029]

As described above, according to the present invention, when monitoring an object having a length in the longitudinal direction that does not fall within the imaging range of one imaging means, an image obtained by imaging the object is synthesized, and a display device is provided. Since the scroll display is performed along the longitudinal direction of the subject, it is possible to continuously monitor a subject extending in one direction such as a tunnel, a plant, a platform of a station, and a bridge.

Further, according to the present invention, when each image is combined, a point to be combined is reliably identified, so that a complete combined image can be obtained without fail. The identification mark may be any one that can be recognized by the image processing means, and can be implemented by a simple method of painting the surface of the subject with black paint, for example.

Further, according to the present invention, it is possible to suitably monitor a subject even at night or in a place where no sunlight is exposed. In addition, since the light is turned on only during monitoring, power can be saved, and the life of the lighting device can be improved.

Further, according to the present invention, since each lighting means is turned on only at the time of abnormality, it is possible to confirm whether an abnormality has occurred in the subject only by checking whether or not the lighting means is turned on. .

Further, according to the present invention, since an image obtained by the image pickup device is subjected to pattern recognition and an abnormality is detected, it is possible to easily detect an abnormality that is hardly visible to the naked eye.

Further, according to the present invention, since there is provided a means for storing a combined image, it is possible to view each captured combined image at any time. By reproducing the image stored by the storage means and verifying it later, it is possible to visually observe, for example, a state when an abnormality occurs.

Further, according to the present invention, since the apparatus is configured with a simple configuration, the price of the apparatus can be reduced. Even a large subject that does not fit within the imaging range of one imaging unit is imaged by a plurality of imaging units,
By combining the images, it is possible to easily obtain a combined image in which the entire length of the subject is captured.

Further, according to the present invention, it is possible to suppress an increase in necessary identification marks, so that it is possible to reduce the trouble when installing a monitoring device and to suppress the cost of the device.

Further, according to the present invention, it is possible to easily combine images picked up by the image pickup means and to suppress an increase in the number of image pickup means, so that the cost of the apparatus can be reduced.

Further, according to the present invention, since the same line connecting a combination of a plurality of identification marks imaged at both ends of each image is synthesized so as to overlap, a part of the image is dubbed or missing. It is possible to easily obtain a complete composite image that has not been lost.

[Brief description of the drawings]

FIG. 1 is a system diagram showing a basic configuration of a monitoring device 21 according to an embodiment of the present invention.

FIG. 2 is a longitudinal sectional view of a tunnel 32 for explaining a state in which the monitoring device 21 according to the embodiment of the present invention is used.

FIG. 3 is a horizontal sectional view of the tunnel 32 shown in FIG.

FIG. 4 is a sectional view taken at right angles to the axis of the tunnel 32 shown in FIG. 2;

FIG. 5 is a system diagram for explaining a method of joining images sent from the imaging devices 22a to 22e shown in FIGS. 2 to 4;

FIG. 6 shows the monitoring device 22 shown in FIGS.
5 is a flowchart shown to explain a state used in the embodiment.

FIG. 7 is a longitudinal sectional view of a tunnel 1 showing a typical prior art.

[Explanation of symbols]

 Reference Signs List 21 monitoring device 22a to 22e imaging device 24 image processing device 25 control device 26 storage device 27 display device 28 subject 30, 49a to 52a, 49b to 52b identification mark 32 tunnel 36a, 36b conduit 47a to 47e image 54 synthetic image S1, S2 Imaging range

Claims (10)

[Claims] 1. A plurality of image pickup means arranged so that image pickup areas partially overlap along a longitudinal direction of a subject extending in one direction;
A monitoring device comprising: an image processing unit for combining; and a display unit for displaying the image. 2. The monitoring apparatus according to claim 1, wherein one or a plurality of identification marks are provided on a subject which is an overlapping part of the imaging range. 3. The monitoring apparatus according to claim 1, further comprising: a plurality of illumination units scattered in the imaging range; and a lighting unit for lighting each illumination unit during monitoring. 4. The monitoring device according to claim 3, further comprising lighting means for lighting each lighting means only when an abnormality occurs. 5. The image processing apparatus according to claim 1, further comprising detecting means for pattern-recognizing the synthesized image and detecting an abnormality.
5. The monitoring device according to any one of 4. 6. The monitoring device according to claim 1, further comprising storage means for storing the combined image. 7. A combination of a plurality of imaging means arranged so that imaging ranges partially overlap, a plurality of identification marks provided around a subject, and a plurality of identification marks are provided at both ends of each imaging range. And an image processing means for synthesizing the images so that lines connecting the identification marks are overlapped with each other. 8. The apparatus according to claim 7, wherein a line connecting the identification marks is perpendicular to a longitudinal direction of the subject. 9. The apparatus according to claim 7, wherein the plurality of imaging units are arranged so that imaging ranges overlap each other along the longitudinal direction. 10. A combination of a plurality of images, wherein a combination of a plurality of identification marks is provided at both ends of each imaging range, and each image is connected so that lines connecting the plurality of identification marks overlap. Splicing method.