JPH07284089A - Multi-screen display device - Google Patents

Abstract

PURPOSE:To obtain the same continuous visual field image and the same presence as those in a photographing job site. CONSTITUTION:Image pick-up cameras 18 to 22 which plurally divide the horizontal direction of a construction job site visual field so as to conduct photographing and the image pick-up cameras 18, 23 and 24 which plurally divide the longitudinal direction so as to conduct photographing are arranged so as to position eye axes on a same horizontal or longitudinal surface, to permit them to intersect at a same point P and to permit angle between adjacent eye axes to be equal. Thus, a division visual field area image photographed by the respective image pick-up cameras 18 to 24 is permitted to be the continuous one and a video display screens 271 to 277 in one-to-one relation with the image pick-up cameras 18 to 24 are arranged in a regular polygonal state surrounding a periphery in the horizontal and longitudinal directions of a viewer 28.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multi-screen display device, and more particularly to a plurality of cameras and a plurality of microphones for photographing at least one of a horizontal plane and a vertical plane of a scene of a scene. The present invention relates to a display device capable of multi-screen display by using a viewing monitor or screen corresponding to a camera on a one-to-one basis.

[0002]

2. Description of the Related Art Conventionally, for example, as a method of displaying the work status of a civil engineering construction site and the work status of an unmanned power shovel, a crawler dump, etc. for civil engineering work on a remote office or center, etc. Take a picture of the scene with one or several TV cameras, transmit this video information to the monitoring center through a communication line such as ISDN line or satellite line, and display it on one or several monitor TVs installed in the center etc. By doing so, the construction situation and work situation of the site were grasped.

[0003]

However, since the display screen in the above-mentioned conventional display system is a two-dimensional plane regardless of whether there is one monitor television or a plurality of monitor televisions constituting this display, The scene image of the construction site displayed on the screen is also flat, and it is not possible to obtain a screen with a realistic feeling similar to the scene of the actual construction site. In addition, the angle of view that indicates the shooting range of the TV camera in terms of angle is determined by the focal length of the lens and the screen size of the image forming surface.
If the image in the display screen is enlarged so that the content of the display image can be clearly determined, the range that can be captured by the TV camera is narrowed. Therefore, in a construction area having a field of view several times as large as the angle of view of the TV camera or more, the entire area cannot be displayed at once. On the other hand, it is possible to divide the field of view of the construction area with several TV cameras and shoot, and display the captured images of each TV camera on different monitor TVs. However, this is the image displayed on each monitor TV. Since there is no continuity in the display, the screen will be difficult for the observer to see, and there will be a gap between the actual view of the construction area and the image displayed on the monitor TV, making it impossible to grasp the exact site. there were.

The present invention has been made in view of the above circumstances, and an object thereof is to provide a multi-screen capable of obtaining a continuous visual field image similar to that at a shooting site and a realistic sensation of being at the shooting site. It is to provide a display device.

[0005]

In order to achieve the above-mentioned object, the invention of claim 1 directs the field of view of the object to be photographed,
The line-of-sight axes of the two are located on the same plane, intersect at the same point, and are arranged so that the angles between adjacent line-of-sight axes are equal, and the field of view to be photographed is divided into at least one of the horizontal direction and the vertical direction. A plurality of imaging cameras that respectively capture the divided visual field regions so as to be continuous with each other, and the imaging cameras, which correspond to the respective imaging cameras and are continuously arranged in the division direction of the imaging target visual field. A plurality of video display means, which are oriented in the same place as each other and whose directivity directions are shifted by an angle equal to the angle, and video signals output from the respective imaging cameras are transmitted to the corresponding video display means, and the respective video display means are displayed. Means for displaying the images of the respective divided visual field areas.

According to a second aspect of the present invention, the angle between the line-of-sight axes of each of the image pickup cameras is set to an angle corresponding to the lens field angle of the image pickup camera. According to a third aspect of the present invention, each of the image display means comprises a viewing monitor receiver. According to a fourth aspect of the present invention, each of the image display means comprises a screen and a video projector for projecting an image of the divided visual field region photographed by the imaging camera on the screen. According to a fifth aspect of the present invention, a plurality of microphones which respectively correspond to the respective imaging cameras and pick up sound in the visual axis direction of the imaging cameras, and the respective image display means are provided respectively corresponding to the respective microphones, It further comprises a plurality of speakers driven by audio signals from corresponding microphones.

[0007]

According to the present invention, the plurality of image pickup cameras are respectively directed to the field of view of the object to be photographed, their sight line axes are located on the same plane and intersect at the same point, and the angles between adjacent sight line axes are equal. Since the plurality of image display means for displaying the divided visual field regions photographed by the respective imaging cameras are arranged so as to be continuous with each other in the direction corresponding to the directivity direction of the respective imaging cameras, The viewer of the image display means can visually recognize an image in the same field of view as at the shooting site where the image pickup camera is arranged, and can obtain a sense of presence as if he or she were at the shooting site. Further, in the present invention, by making a speaker provided for each video display unit ring, it is possible to obtain a realistic sensation closer to the shooting site.

[0008]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an overall schematic configuration diagram when the multi-screen display device of the present invention is applied to a panoramic view of a construction area such as river stone removing work, and FIG. 2 is an imaging camera for photographing the panoramic view of the construction area in the horizontal direction. Layout diagram, FIG. 3 is a layout diagram of an image pickup camera that captures a vertical view of the entire construction area view, FIG. 4 is a layout diagram of a horizontal direction multi-sided display screen, and FIG. 5 is a layout diagram of a vertical direction multi-sided display screen.
FIG. 6 is a block diagram of a video signal transmission system in this embodiment, and FIG. 7 is a block diagram of an audio signal transmission system in this embodiment.

In FIG. 1, reference numeral 10 is a construction area where stone removing work is performed. In the construction area 10, an unmanned power shovel 11, an unmanned breaker 12 and an unmanned bulldozer 13 which are operated unmanned are arranged. The debris excavated at the excavation site 14 by the unmanned power shovel 11 is
It is transported by an unmanned crawler dump truck 16 and an unmanned heavy dump truck 17 that autonomously travel between an excavation site 14 and a temporary disposal site 15 outside the construction area 10.

At a position where a panoramic view of the construction area 10 can be overlooked, five horizontal image pickup cameras 18 to 22 for taking a picture by dividing the panoramic field of view into five parts and a vertical direction of the panoramic view field into three parts are divided into three parts. Three image pickup cameras in the vertical direction, that is, a central image pickup camera 18 that also serves as a horizontal direction, an image pickup camera 23 that faces obliquely upward, and an image pickup camera 24 that faces upward are provided with a tripod. It is installed by the pedestal 25. Further, the video signals output from the respective imaging cameras 18 to 24 are transmitted to the display device 27 installed in a center such as a business office in a remote place through the ISDN network 26. The display device 27 is additionally provided with a display control unit that controls the display operation of video.

Each of the horizontal image pickup cameras 18 to 22
As shown in FIG. 2, the lens thereof is directed to the field of view to be photographed, that is, the construction area 10, and the imaging cameras 18 to 22 have their visual axes on the same horizontal plane and are the same. They are arranged such that they intersect at a point P and the angles between adjacent line-of-sight axes are equal, and the angle is set to an angle corresponding to the angle of view (horizontal angle of view) of the camera lens. For example, the horizontal angle of view of the lens of each of the image pickup cameras 18 to 22 shown in FIG. 2 is 45 degrees, and each image pickup camera 1 corresponds to this.
The angle between the line-of-sight axes 8 to 22 is 45 degrees. in this case,
The horizontal field of view that can be captured by the image capturing cameras 18 to 22 is 180 degrees.

Further, each image pickup camera 1 for the vertical direction
As shown in FIG. 3, the lenses 8, 23 and 24 of the imaging cameras 18, 23 and 24 are directed toward the construction area 10. Further, the imaging cameras 18, 23 and 24 have imaging axes of the imaging cameras 18-2.
They are located on the same plane in the vertical direction orthogonal to the horizontal plane including the two line-of-sight axes, intersect at the point P, and are arranged so that the angles between adjacent line-of-sight axes are equal, and the angle is the angle of view of the camera lens. It is set to an angle corresponding to (vertical angle of view). For example, the vertical angle of view of the lenses of the imaging cameras 18, 23, 24 shown in FIG. 3 is 45 degrees, and the angle between the line-of-sight axes of the imaging cameras 18, 23, 24 is 45 degrees correspondingly.
It becomes degree. In this case, the field of view in the vertical direction that can be captured by the imaging cameras 18, 23, 24 is 90 degrees.

The display device 27 includes the image pickup cameras 1
Seven video display screens 271 corresponding to 8 to 24 on a one-to-one basis
Each of the image display screens 271 to 277 includes a picture tube of 60 to 100 inches, or a display panel in which RGB light emitting elements are arranged in a matrix with a predetermined density as one pixel. Composed. Of the video display screens 271 to 277, the video display screens 271 to 275 corresponding to the horizontal direction imaging cameras 18 to 22 in a one-to-one correspondence are shown in FIG.
Centering on its front, diagonal left front, diagonal right front,
It is arranged so as to surround five left and right faces and form five faces out of eight regular octagon faces. The respective video display screens 271-275 are joined in such a state that a gap between the respective screens is not generated as much as possible so that a continuous screen can be formed as a whole.
The sensation that the image displayed on 75 is divided at the joint between the screens is reduced.

Further, the image pickup cameras 18 and 2 for the vertical direction are used.
Video display screens 271 and 27 corresponding to 3 and 24 on a one-to-one basis
As shown in FIG. 5, the reference numerals 6 and 277 surround the viewer 28 so as to surround the front surface, the obliquely upper surface, and the upper surface,
It is arranged in such a manner that it forms three surfaces out of eight regular octagonal surfaces. This video display screen 271, 276, 277
In the same manner as the horizontal image display screens 271 to 275, are joined so that a gap between the screens is not generated as much as possible so that a continuous screen can be formed as a whole.

Next, the configuration of the video signal transmission system will be described with reference to FIG. In FIG. 6, each imaging camera 1
The video signals output from 8 to 24 are converted into digital signals by the respective AD converters 31 to 37,
After being subjected to a predetermined compression process, it is input to the multiplexing circuit 38 and multiplexed. The multiplexed video signal is sent to the ISDN line 26 via the terminal adapter 39 for ISDN. A separation circuit 41 is connected to the ISDN line 26 via a terminal adapter 40 on the center side, and the separation circuit 41 allows the imaging cameras 18 to 2 to be connected.
The video signals separated for each 4 are converted into analog signals by the respective D-A converters 42 to 48, expanded, and then output to the video display screens 271 to 277 composed of respective picture tubes or the like.

Next, the configuration of the audio signal transmission system will be described with reference to FIG. In FIG. 7, reference numerals 51 to 57 are microphones for picking up sounds in the visual axis directions of the respective imaging cameras 18 to 24.
The audio signals output from ˜57 are converted into digital signals by the respective A / D converters 58 to 64, subjected to predetermined compression processing, and then input to the multiplexing circuit 38 to be multiplexed. The multiplexed voice signal is sent to the ISDN line 26 via the ISDN terminal adapter 39. The multiplexed audio signal is input to the separating circuit 41 via the ISDN line 26 and the terminal adapter 40 on the center side, and the audio signals separated by the separating circuit 41 for each of the microphones 51 to 57 are respectively separated. The signals are converted into analog signals by the DA converters 65 to 71, expanded, and then output to the respective speakers 72 to 78. The speakers 72 to 78 correspond to the video display screens 271 to 277 one to one.

Next, the operation of the display device of this embodiment constructed as described above will be explained. Each imaging camera 18-
24 and each of the microphones 51 to 57 are set to the operation mode, the entire construction area 10 is set to the respective imaging cameras 1.
8 to 24, the image is taken as an image of the divided visual field area divided into seven. The video signals output from the respective imaging cameras 18 to 24 are AD converters 31 to 37, a multiplexing circuit 38, a terminal adapter 39, an ISDN line 26 and a terminal adapter 40, a separation circuit 41, and a DA converter 42. Through 48 to the corresponding video display screens 271 to 277, and the respective imaging cameras 18
The images in the divided visual field regions captured in 24 to 24 are displayed on the respective image display screens 271 to 277.

FIG. 8 shows an example of the case where the visual field images photographed by the image pickup cameras 18 to 24 are displayed on the display device 27. In FIG. 8, on the image display screens 271 to 275, horizontal images of the field of view photographed by the imaging cameras 18 to 22 having a one-to-one relationship with the image display screens 271 to 275 are continuously displayed. Although not shown in FIG. 8, on the image display screens 276 and 277 of the display device 27 shown in FIG. 1, the field of view taken by the imaging cameras 23 and 24 having a one-to-one relationship with the image display screens 276 and 277. An image in the vertical direction, that is, an image in the sky is continuously displayed on the image display screen 271 on the front side.

On the other hand, the sound generated in the direction of the line-of-sight axis of each of the imaging cameras 18-24 is the microphone 51-5.
Picked up by 7. Each microphone 5
The audio signals output from 1 to 57 are AD converters 58 to 64, the multiplexing circuit 38, and the terminal adapter 3.
9, the ISDN line 26, the terminal adapter 40, the separation circuit 41, and the DA converters 65 to 71, and output to the corresponding speakers 72 to 78, which are generated in the visual axis directions of the respective imaging cameras 18 to 24. The sounds of the unmanned power shovel 11 and the like picked up by the microphones 51 to 57 are output from the speakers 72 to 78.

As described above, in this embodiment, the image pickup cameras 18 to 22 which divide the field of view of the construction site 10 in the horizontal direction and the image pickup cameras 18 and 23 which divide the image in the field of view in the vertical direction. , 24, the lenses of which face the construction site 10, and the line-of-sight axes thereof are located on the same plane in the horizontal or vertical direction and intersect at the same point P, and the angles between adjacent line-of-sight axes are equal to each other. So that
As a result, the images of the divided visual field regions captured by the respective imaging cameras 18 to 22 are made continuous and the image display screen 27 having a one-to-one relationship with the imaging cameras 18 to 24.
1 to 277 are arranged in a regular polygonal shape surrounding the horizontal periphery and the vertical periphery of the viewer 28, and further, the respective image display screens 271 to 277 are set in a state in which a gap between the screens is not generated as much as possible. Joined, each video display screen 271-27
The sensation that the image displayed on 7 is divided at the joint between the screens is reduced. Therefore, the viewer 2
When the display screen 8 is viewed at the position shown in FIGS. 4 and 5, the sense of image division at the joints between the image display screens 271 to 277 is weakened, and the immersive feeling of being at the scene is obtained. You can get the same sense of presence as on-site.

Further, in this embodiment, microphones 51 to 57 for picking up sounds in the respective visual axis directions are provided in a one-to-one correspondence with the respective imaging cameras 18 to 24, and the microphones 51 to 57 are paired with the microphones 51 to 57. Since the speakers 72 to 78 corresponding to No. 1 are provided for each of the video display screens 271 to 277, by making the speakers 72 to 78 ring, the corresponding video display screens 271 to 277
It is possible to generate the sound of the unmanned power shovel 11 and the like generated in the line-of-sight axis direction of each of the imaging cameras 18 to 24, and obtain a realistic sensation closer to the scene.

The present invention is not limited to the structure described in the above embodiment, and various modifications can be made without departing from the scope of the claims. For example, in the present embodiment, a case has been described in which the video display screens 271 to 277 are configured by viewing monitor receivers, but the display screen may be configured by a screen and a video projector. In this case, the division of the display image at the joint portion of the display screen can be further improved. Further, in the present embodiment, the video signal and the audio signal are compression-multiplexed and transmitted by one ISDN line 26, but an individual ISDN line 26 may be used for each video signal and audio signal. . Further, in the present embodiment, the video signal and the audio signal are transferred to the ISDN line 2
However, other communication lines such as satellite lines may be used.

[0023]

As described above, according to the present invention, the visual fields of the object to be photographed are respectively directed, the axes of the sight lines of the two are located on the same plane and intersect at the same point, and the angles between the neighboring sight lines are equal to each other. A plurality of imaging cameras, each of which is arranged so that each of the divided visual field regions obtained by dividing the photographing target visual field in at least one of the horizontal direction and the vertical direction so as to be continuous with each other, respectively corresponds to the respective imaging cameras, Arranged in succession in the direction of division of the field of view to be photographed,
A plurality of image display means, which are oriented in the same place and whose directivity directions are shifted by an angle equal to the angle between the adjacent line-of-sight axes, and the image signals output from the respective image pickup cameras are associated with the corresponding image display means. A control means for transmitting and displaying the video of each of the divided visual field areas on the video display means is provided.

Further, according to the present invention, the angle between the line-of-sight axes of each of the image pickup cameras is set to an angle corresponding to the angle of view of the lens of the image pickup camera. Further, in the present invention, each of the image display means is composed of a viewing monitor receiver. Further, the present invention is
Each of the image display means is composed of a screen and a video projector for projecting an image of the divided visual field region photographed by the imaging camera on the screen. Therefore, it is possible to obtain a continuous visual field image similar to that at the shooting site and a realistic sensation of being at the shooting site.

Further, according to the present invention, a plurality of microphones respectively corresponding to the respective image pickup cameras for picking up sound in the visual axis direction of the image pickup cameras, and the respective image display means respectively corresponding to the respective microphones. Since each speaker is provided with a plurality of speakers that are driven by the audio signals from the corresponding microphones, the sounding of the speakers causes the corresponding image display screen to be generated in the direction of the line-of-sight axis of each imaging camera. The sound of unmanned heavy equipment and the like can be generated, and a sense of reality closer to the scene can be obtained.

[Brief description of drawings]

FIG. 1 is an overall schematic configuration diagram when a multi-screen display device of the present invention is applied to a panoramic view of a construction area such as river stone removal work.

FIG. 2 is a layout view of an image pickup camera that captures a horizontal view of the entire construction area view in the present embodiment.

FIG. 3 is a layout view of an image pickup camera for capturing a vertical view of the entire construction area view in the present embodiment.

FIG. 4 is a layout view of a horizontal multi-faceted display screen according to the present embodiment.

FIG. 5 is a layout view of a vertical multi-faceted display screen in the present embodiment.

FIG. 6 is a configuration diagram of a video signal transmission system in the present embodiment.

FIG. 7 is a configuration diagram of an audio signal transmission system in the present embodiment.

FIG. 8 is an explanatory diagram showing an example of multi-faced display in the present embodiment.

[Explanation of symbols]

 10 Construction Area 18-24 Imaging Camera 26 ISDN Line 27 Display Device (Control Means) 28 Viewer 31-37 A-D Converter 38 Multiplexing Circuit 41 Separation Circuit 42-48 D-A Converter 51-57 Microphone 58-64 A -D converter 65-71 DA converter 72-78 Speaker 271-277 Video display screen (video display means)

Claims (5)

[Claims] 1. The objects to be photographed are arranged so as to respectively direct the fields of view of the objects to be photographed, the axes of the sight lines of the two are located on the same plane and intersect at the same point, and the angles of the axes of the sight lines adjacent to each other are equal. A plurality of imaging cameras that respectively capture the divided visual field regions in which the visual field is divided into at least one of the horizontal direction and the vertical direction so as to be continuous with each other, and correspond to each of the imaging cameras, and are continuous in the division direction of the imaging target visual field. A plurality of image display means that are respectively arranged and are shifted in the directing direction by an angle equal to the angle between the adjacent line-of-sight axes and are directed to the same location, and the video signals output from the respective imaging cameras correspond to each other. A multi-screen display device comprising: a control unit that transmits to each of the image display units and causes each of the image display units to display an image of each of the divided visual field regions. 2. The angle between the line-of-sight axes of each of the imaging cameras is
The multi-screen display device according to claim 1, wherein the multi-screen display device is set to an angle corresponding to a lens angle of view of the imaging camera. 3. The multi-screen display device according to claim 1, wherein each of the image display means is composed of a viewing monitor receiver. 4. The image display means includes a screen,
The multi-screen display device according to claim 1 or 2, comprising a video projector for projecting an image of a divided visual field region photographed by the imaging camera on the screen. 5. A plurality of microphones respectively corresponding to the respective image pickup cameras for picking up sound in the line-of-sight axis direction of the image pickup cameras, and correspondingly provided to the respective image display means respectively corresponding to the respective microphones. The multi-screen display device according to claim 1, further comprising a plurality of speakers driven by a sound signal from a microphone.