JP2004282712A - Adjustment device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display video with normal and high image quality and high resolution when viewed from video observers, even if a non-plane screen such as the screen 4 with the concave spherical surface is used when large-sized display video is composed by combining display video from a plurality of projectors 1, 2, and 3. <P>SOLUTION: The adjustment device is provided with a means 16 for generating adjustment signals which projects the video based on the adjustment signals on the non-plane screen 4 by each projector 1, 2, and n, three or more image pickup devices for photographing the projected video based on the adjustment signals, and a measuring means 17 for executing the three-dimensional measurement regarding the projected video. Video deformation information based on the results measured by the measuring means 17 is supplied to geometric converters 11a, 11b, and 11n. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an adjustment device that adjusts an image deformation amount in a projection display device that projects and displays an image on a non-planar screen using a plurality of projection display units.

  Conventionally, a plurality of projection display devices are used to form a large display image by displaying a plurality of images projected and displayed by the projection display devices side by side on a single flat screen. Type indicators have been proposed.

  However, in order to form a large-screen display image on a flat screen, a large-screen size screen is required, and a large-screen image display cannot be realized in a narrow environment.

  In addition, a device has been proposed that allows a user to experience virtual reality using a screen such as the inside of a cube. However, it is not possible to realize a space with a sense of distance, and a sufficient sense of reality is provided. Not something you can taste.

  In view of the above, conventionally, there has been proposed a projection display device that uses a special lens such as a fisheye lens as a projection lens to project and display an image on a screen having a curved surface such as a concave spherical surface.

  Furthermore, by using a plurality of projection display devices and displaying a plurality of images projected and displayed by these projection display devices side by side on a concave spherical screen, it is possible to have a large size and cover an image viewer. There has been proposed a projection display device on which an image is displayed.

By using such a concave spherical (non-planar) screen, it is possible to completely cover the field of view of a video observer, so that even in a limited size, it is possible to realize an environment as if looking at a large screen screen. Can be.
JP-A-2002-72359

  By the way, as described above, in a projection display device in which a plurality of images are arranged and displayed on a concave spherical screen by a plurality of projection display devices, a display device without pixels such as a CRT is used as the projection display device. Are used. This is because, when an image is projected and displayed on a concave spherical screen by a projection display, the displayed image is distorted. Therefore, it is necessary to apply a distortion opposite to this distortion to the displayed image in advance. This is because a display device that easily causes distortion is used.

  In a projection type display using a display device without pixels, the arrangement is limited, and it is difficult to improve the contrast of an image due to reflection from a screen or the like. Particularly, in the case of a concave spherical screen, there is a problem that the reflected light is reflected on the screen due to the arrangement of the projection device, and the contrast is reduced.

  If a projection display using a display device having pixels, such as a liquid crystal display panel, is used, the arrangement and composition of the projection display can be facilitated, and the reduction in contrast due to reflection on the screen can be suppressed.

  However, projecting a display image on a non-planar screen from a projection display using a display device having pixels has been realized only with an image using an optical lens (particularly a fisheye lens).

  That is, combining images projected from a plurality of projection display devices using a display device with pixels to form one image has been realized only when a flat screen is used. If a large-screen composite image is to be formed on a concave spherical screen (non-planar screen) by a projection display using a display device with pixels, the image will be deformed on a curved surface and viewed from an image observer. This is because normal images cannot be obtained.

  Therefore, such a concave spherical screen (non-planar screen) cannot be used for applications requiring high image quality and high resolution.

  Therefore, the present invention has been proposed in view of the above-described circumstances, and in using a projection display device that configures a large display image by combining display images from a plurality of projection display units, a concave spherical surface is used. It is an object of the present invention to provide an adjustment device that can display a high-quality, high-resolution image that is normal to an image observer even when a non-planar screen such as a screen is used.

  In order to solve the above-mentioned problem, an adjustment device according to the present invention includes a projection display unit that projects and displays an image according to a supplied image signal, a non-planar screen on which an image is projected by the projection display unit, and a projection device. Image in a projection display device comprising image deforming means for changing the angle of view of an image displayed according to the relationship between the position of the pattern display means, the area where the image is displayed on the non-planar screen, and the position of the image observer An adjustment device for adjusting the amount of deformation of an image by the deformation means, the adjustment signal generating means for projecting an image based on the adjustment signal on a non-planar screen by a projection display means, and A plurality of image capturing devices for capturing an image based on the image, measuring means for performing three-dimensional measurement on a video projected based on a video signal obtained from the image capturing device, The image deformation information based on the result measured by the measuring means is characterized in that a deformation processing means for supplying to the image deforming means.

  In this adjusting device, the projection display device can display a high-quality, high-resolution video that is normal for the video observer.

  Further, in the adjustment device according to the present invention, the plurality of imaging devices may be supported on the same gantry, and have a configuration that can integrally change the imaging direction with the gantry two-dimensionally when performing three-dimensional measurement. desirable.

  In this case, the accuracy of three-dimensional measurement can be improved.

  Further, in the adjusting device according to the present invention, the image transformation means includes a frame memory for storing the image signal, a position information memory for storing the position information of the pixel, and a digital filter processing for reading and storing the image signal from the frame memory. A data memory for sequentially writing video signals to the frame memory, storing new position information of the pixel to be converted in the position information memory, and reading out from the position information memory in the digital filter processing data memory. The video signal of the area used for the digital filter processing is read from the frame memory as needed based on the new position information.

  The present invention relates to a projection display device that composes a large display image by combining display images from a plurality of projection-type display means, even when a non-planar screen such as a concave spherical screen is used. It is possible to provide an adjustment device that can display a high-quality, high-resolution video that is normal when viewed from the front.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a plan view showing a configuration of a projection display device to which the adjustment device according to the present invention is applied.

  As shown in FIG. 1, the projection display device includes a plurality of projectors 1, 2, and 3 serving as a plurality of projection display units that project and display an image according to a supplied image signal. In this embodiment, there are three projectors.

  These projectors 1, 2, and 3 are projection-type display devices configured using a display device (spatial light modulation element) having pixels, such as a so-called liquid crystal projector.

Each of the projectors 1, 2, 3 includes a display device, a light source and an illumination optical system for illuminating the display device, and a projection lens (imaging lens) for projecting and displaying an image of the display device on a screen. Be composed. As a display device having pixels used in such a projector, there is a so-called "DMD" (Digital Mirror Device) in addition to a liquid crystal display device.

  The projection display device includes a non-planar screen 4 on which an image is projected by a plurality of projectors 1, 2, and 3. The non-planar screen 4 has, for example, a shape that is a part of a concave spherical surface, preferably a concave hemispherical shape. However, the shape of the non-planar screen 4 is not limited to a shape that is a part of a spherical surface, but may be a concave cylindrical surface or another free-form surface. In the case where the non-planar screen 4 has a part of a concave spherical surface or another shape, the height in the vertical direction may be narrower than the width in the horizontal direction in accordance with the viewing angle of a human.

  The plurality of projectors 1, 2, 3 are arranged near the center of curvature of the non-planar screen 4 or on a straight line passing through the center of curvature and the center of the non-planar screen 4.

  FIG. 2 is a perspective view showing a configuration of the projection display device.

  As shown in FIG. 2, these projectors 1, 2, and 3 are installed near the center of curvature of the non-planar screen 4 with the optical axis of the projection lens substantially horizontal. The projectors 1, 2, and 3 have directions of the optical axis of the projection lens different from each other, for example, the center direction of the non-planar screen 4, the right direction of the non-planar screen 4, and the left direction of the non-planar screen 4. Installed.

  FIG. 3 is a front view showing a region where an image is projected on the non-planar screen 4 in the projection display device.

  In the projection display device, the projectors 1, 2, and 3 project and display images on different image display areas on the non-planar screen 4 as shown in FIG. Each of the video display areas 1a, 2a, and 3a is in a state of being slightly overlapped with an adjacent video display area. In these video display areas 1a, 2a, 3a, one combined composite video is displayed.

  In the overlap area where the video display areas overlap, the two projectors project the same video and overlap. Therefore, in this overlap area, if each of the projectors 1, 2, and 3 displays an image of uniform luminance over the corresponding image display area, the luminance of the display image is higher than that of the area other than the overlap area. Will be higher. Therefore, in this projection display device, each of the projectors 1, 2, and 3 lowers the luminance of a portion of the display image projected on the overlap region to about half, and the two projectors overlap and project. Thus, the luminance is set to be substantially equal to the image projected by one projector. Such processing of the luminance in the overlap area where the image display areas overlap each other is called blending processing.

  FIG. 4 is a perspective view showing another embodiment of the configuration of the projection display device.

  As shown in FIG. 4, this projection display device includes not only three projectors 1, 2, 3 in the middle, but also three projectors 5, 6, 7, and three projectors 8, 9, 7, in the upper row. It is also possible to use a total of nine projectors including ten.

  FIG. 5 is a front view showing a region where an image is projected on the non-planar screen 4 in another embodiment of the projection display device.

  In this projection display device, the projectors 1, 2, 3, 5,... 10 project and display images on different image display areas on the non-planar screen 4, as shown in FIG. Each of the video display areas 1a, 2a, 3a, 5a,..., 10a is in a state of being slightly overlapped with an adjacent video display area. .. 10a display one connected composite video. In the video display areas 1a, 2a, 3a, 5a,.

  The processing of the luminance in the overlap area where the video display areas overlap each other is the same as described above. In the area where the four video display areas overlap at the four corners of the video display area, the brightness of the displayed video is reduced to about 1/4, and projected by four projectors, so that one projector is used. The luminance is set to be substantially equal to the projected image.

  As a method of not lowering the contrast of the displayed image, when the non-planar screen 4 is a concave spherical screen, it is conceivable to install each projector at the center of the sphere. In this case, re-reflection to the non-planar screen 4 can be reduced as much as possible, so that a decrease in the contrast of the displayed image can be prevented.

  By the way, in order to display a composite image on the non-planar screen 4 using a plurality of projectors 1, 2, 3, 5,... 10 as described above, geometric conversion is performed in advance on the image displayed by each projector. It is necessary to compensate for the image distortion caused by the screen not being flat, and to prevent the display image from being distorted on the non-flat screen 4.

  FIG. 6 is a block diagram showing a configuration of a geometric transformation device in the projection display device.

  In this projection display device, as for each of the projectors 1, 2, 3, 5,..., As shown in FIG. Conversion). The geometric conversion device 11 includes an AD converter 12 for converting an input video signal into a digital signal, a blend function circuit 13 for performing blending processing on an output signal from the AD converter 12, and an output from the blend function circuit 13. It is composed of a digital geometric converter 14 for performing geometric transformation on a signal, and a DA converter 15 for converting an output signal from the digital geometric converter 14 into an analog signal.

In the projection display device, a high-resolution composite image can be formed on the non-planar screen 4 by using the geometric transformation device 11. That is, in this projection display device, the geometric transformation device 11 performs display in accordance with the relationship between the position of the corresponding projector, the image display area where the projector displays an image on the non-planar screen 4, and the position of the image observer. FIG. 7 is a front view showing the contents of the geometric transformation by the geometric transformation device 11 in the projection display device.

  That is, as shown in FIG. 7A, assuming that the video signal before performing the geometric transformation is a cross-hatch signal that displays a lattice-like pattern, the geometric transformation is performed as shown in FIG. 7B. In this manner, the signal is a signal subjected to deformation for compensating for image distortion caused by the non-planar shape of the screen.

  FIG. 8 is a block diagram showing a process from the video signal generator 16, which also serves as an adjustment signal generation unit, to the non-planar screen 4 in the adjustment device according to the present invention.

  That is, in this projection display device, the video signal supplied from the video signal generator 16 is supplied to each of the projectors 1, 2, 3, 5,. Is projected and displayed as an image.

  FIG. 9 is a block diagram schematically showing the overall configuration of a projection display device provided with the adjustment device according to the present invention.

  As shown in FIG. 9, the projection display apparatus divides an incoming video signal generated by a video signal generator 16 into a plurality of projectors 1, 2, 3, 5,. A dividing unit 18 is provided. The image dividing means 18 supplies the divided image signals to first to n-th geometric transformation devices 11a, 11b,... 11n corresponding to the projectors 1, 2, 3, 5,. The first to n-th geometric transformation devices 11a, 11b,..., 11n, as described above, use the projectors 1, 2, 3, 5,. The angle of view of the displayed image is changed in accordance with the relationship between the position of the screen 10, the area where the image is displayed on the non-planar screen 4 and the position of the image observer, and the image resulting from the non-planar screen shape To compensate for the distortion.

  In this projection display device, the images displayed by the projectors 1, 2, 3, 5,... N are three-dimensionally measured via a three-dimensional measuring device 17 serving as a measuring means. Accordingly, the amount of deformation of the image in each of the geometric transformation devices 11a, 11b,... 11n is determined. By determining such an image deformation amount, a composite image is formed on the non-planar screen 4 so that an optimal image is obtained when viewed from an image observer without human adjustment. The three-dimensional measurement device 17 has three observation cameras (video cameras), which are imaging devices supported on the same gantry that can be moved and operated. These observation cameras can be panned in the left-right direction and tilted in the up-down direction as a unit by moving the gantry.

  FIG. 10 is a block diagram illustrating the overall configuration of a projection display device including the adjustment device according to the present invention.

  In this projection display device, as shown in FIG. 10, the video signal generator 16 outputs various video signals such as a so-called “DVD (trade name)” disk player and a “VHS (trade name)” video player. A device that performs the above can be used. The video signal output from the video signal generator 16 is divided by the "NTSC distributor (9 ch)" as the video dividing means 18 and supplied to the geometric converters 11a, 11b,. .. 11i are controlled by personal computers (PC) 20a, 20b... 20i, respectively. .. 11i are controlled by control PCs 21 and 22 serving as deformation processing means.

  .. 11i are sent to the projectors 1, 2, 3, 5,... 10 via the controller 19 and output to the projectors 1, 2, 3, 5,. The image is displayed on the flat screen 4 as an image.

  Further, the three-dimensional measurement device 17 sends information captured by the observation camera to the control PCs 21 and 22 and the controller 19. The control PCs 21 and 22 control the geometric transformation devices 11a, 11b,... 11i based on the signals sent from the three-dimensional measurement device 17 as the three-dimensional measurement results.

  In this projection display device, in order to form a composite image by each of the projectors 1, 2, 3, 5,..., First, a position information measurement pattern (a cross hatch signal including map data, etc.) from the image generator 16 is used. ) Are displayed on the non-planar screen 4 by the projectors 1, 2, 3, 5,... 10 without performing any deformation in the geometric transformation devices 11a, 11b,.

  Then, the three-dimensional measurement device 17 performs three-dimensional measurement on the position information measurement pattern.

  FIG. 11 is a perspective view showing the contents of three-dimensional measurement performed by the three-dimensional measurement device 17.

  In the three-dimensional measurement, as shown in FIG. 11, for a predetermined target on the position information measurement pattern, polar coordinate information (Φ, Θ) and distance information D from the viewpoint position of the observation camera are measured as position information. It is. In this projection display device, such three-dimensional measurement is performed by arithmetic processing based on parallax in three observation cameras, as shown in (a), (b), and (c) in FIG. Can be done accurately.

  Furthermore, since these observation cameras can perform panning in the left-right direction and tilting in the up-down direction in a state in which the three units are integrated with the gantry, more accurate three-dimensional measurement can be performed.

  The control PCs 21 and 22 create geometric conversion map data for each of the geometric conversion devices 11a, 11b,..., 11i so that the projected image is located at the optimum position. , 11b,... 11i. In this way, the image transformation processing in each of the geometric transformation devices 11a, 11b,... 11i is automatically performed.

  Further, by adding an operation based on the position information of the video observer to the result of such three-dimensional measurement, adjacent videos match each other in pixel units as viewed from the video observer, and a natural image is obtained. A composite image having a perspective (perspective) can be configured. The position of the image observer is not limited to the center of curvature of the non-planar screen 4, but rather, a position closer to the non-planar screen 4 than the center of curvature can express rich realism.

  The position information of the video observer may be taken into the calculation by installing the three-dimensional measurement device 17 at the position of the video observer, but virtual position information is set in the three-dimensional measurement device 17. It can also be done by That is, it is possible to normalize the display image viewed from the position of the image observer without depending on the actual viewpoint of the observation camera of the three-dimensional measurement device 17.

  As described above, the adjustment device according to the present invention includes an adjustment signal generation unit that causes the projection display unit to project an image based on the adjustment signal on a non-planar screen, and captures an image based on the projected adjustment signal. , Three or more imaging devices, a measuring unit for performing three-dimensional measurement on an image projected based on a video signal obtained from these imaging devices, and image deformation information based on a result measured by the measuring unit. And a deformation processing means for supplying the image processing means to the image deformation means, so that the projection display device can display a high-quality, high-resolution image that is normal for a video observer.

  Further, in the adjustment device according to the present invention, three or more imaging devices are supported on the same gantry, and in the three-dimensional measurement, the imaging direction can be changed together with the gantry in the vertical or horizontal direction. By doing so, the accuracy of three-dimensional measurement can be improved.

  FIG. 12 is a block diagram showing a configuration of a digital geometric converter of a geometric conversion device in a projection display device to which the present invention is applied.

  Here, the configuration of the digital geometric converter 14 of the geometric converter 11 when a so-called “SXGA signal” is used as a video signal will be described in more detail.

  The digital geometric converter 14 has a synchronization signal circuit 21 as shown in FIG. The synchronizing signal circuit 21 is a circuit for separating an incoming video signal into a V signal and an H signal used for writing to a frame memory.

  The V signal and the H signal separated by the synchronization signal circuit 21 are input to an AD converter (RGB-AD converter) 12 and an address circuit 22.

  The video data digitally converted by the AD converter 12 is sequentially written into R, G, and B frame memories 23, 24, and 25 (for example, 1280 × 1024, 8-bit memory). The video data written in these frame memories 23, 24, 25 are read out to R, G, and B digital filter DMA memories 26, 27, 28, which are digital filter processing data memories. Each of the digital filter DMA memories 26, 27, and 28 reads out only data in an area used for processing in a digital filter processing circuit 29 to be described later from each of the frame memories 23, 24, and 25 at any time by block processing. .

  The video data read by each of the digital filter DMA memories 26, 27, 28 is sent to a digital filter processing circuit 29. The digital filter processing circuit 29 calculates the video data after conversion from the video data before conversion. The converted video data calculated in the digital filter processing circuit 29 is sequentially stored in the frame memories 30, 31, 32 (for example, 1280 × 1024, 8-bit memory) for R, G, and B after the geometric conversion. Written.

  Then, the converted video data is constantly read out from these post-geometric conversion frame memories 30, 31, 32 under the control of a reading circuit, and is sent to a DA converter (RGB-DA converter) 15.

  On the other hand, the address circuit 22 creates a clock signal used in the AD converter 12 and controls a write address to each of the frame memories 23, 24, and 25.

  Further, the address circuit 22 controls an Xmap memory 33 and a Ymap memory 34 (for example, a 1280 × 1024 floating memory) serving as position information memories. The Xmap memory 33 and the Ymap memory 34 are memories for storing a new X position 35 and a new Y position 36, which are positional information of a pixel to be converted. The data in the Xmap memory 33 and the Ymap memory 34 is floating data. This is because, when the geometric transformation is performed, the new X position 35 and the new Y position 36 after the transformation often do not become the center positions of the image.

  From the Xmap memory 33 and the Ymap memory 34, new X positions 35 and Y positions 36 after conversion are read out based on the address counter supplied from the synchronization signal circuit 21. On the basis of the X position 35 and the Y position 36, the digital filter DMA memories 26, 27, and 28 transmit the X position 35 and the X position 35 used for processing in the digital filter processing circuit 29 from the frame memories 23, 24, and 25. Only the data in the area centered on the Y position 36 can be read out at any time by the DMA processing.

  The floating data in the Xmap memory 33 and the Ymap memory 34 are also used to select coefficient data 37 in the digital filter processing circuit 29.

  The digital filter processing circuit 29 reads coefficient data 37 that can be switched according to the geometric deformation rate in accordance with the number of horizontal and vertical taps, and performs multiplication processing and addition processing on RGB pixels using the coefficient data 37, The final data is divided to generate new pixel data.

  The video data composed of the new pixel data calculated in this way is written into the frame memories 30, 31, 32 after the geometric transformation. As the addresses in the post-geometric-conversion frame memories 30, 31, 32 used at this time, the new X-position 35 and the new Y-position 36 read from the Xmap memory 33 and the Ymap memory 34 are used. That is, the new X position 35 and the new Y position 36 read from the Xmap memory 33 and the Ymap memory 34 are used as the XY address 38 after the geometric conversion, and the video data after the geometric conversion are used as the respective frame memories 30, 31, and 32 after the geometric conversion. Also used to write to. Here, since the addresses in each of the post-geometric transformation frame memories 30, 31, 32 are integer addresses, the floating data in the Xmap memory 33 and the Ymap memory 34 are converted into binary data, and the post-geometry transformation frame memories 30, 31, 31 are used. , 32 are used as the XY address 38 after the geometric transformation, which is the address for writing to the. The XY address 38 after the geometric conversion is also supplied to the DA converter 15.

It is a top view showing the composition of the projection display to which the adjustment device concerning the present invention is applied. FIG. 2 is a perspective view illustrating a configuration of the projection display device. FIG. 3 is a front view showing a region where an image is projected on a non-planar screen in the projection display device. It is a perspective view showing other forms of the composition of the projection display. FIG. 13 is a front view showing a region where an image is projected on a non-planar screen in another embodiment of the projection display device. FIG. 2 is a block diagram illustrating a configuration of a geometric conversion device in the projection display device. It is a front view showing the contents of the geometric transformation by the geometric transformation device in the projection display device. FIG. 4 is a block diagram showing a process from a video signal generator to a non-planar screen in the projection display device. FIG. 1 is a block diagram schematically showing an overall configuration of a projection display device including an adjustment device according to the present invention. It is a block diagram showing the whole composition of the projection display. FIG. 3 is a perspective view showing the contents of three-dimensional measurement performed by a three-dimensional measurement device in the projection display device. FIG. 2 is a block diagram illustrating a configuration of a digital geometric converter of the geometric conversion device in the projection display device.

Explanation of reference numerals

1, 2, 3, 5 ... 10 Projector 4 Non-planar screen 11 Geometric conversion device 16 Video signal generator 17 Three-dimensional measurement device

Claims (3)

Projection type display means for projecting and displaying an image according to the supplied image signal, a non-planar screen on which an image is projected by the projection type display means, a position of the projection type display means, and an image on the non-planar screen Adjusting the amount of image deformation by the image deforming means in the projection display device including the image deforming means for changing the angle of view of the image displayed according to the relationship between the area where the image is displayed and the position of the image observer A device,
Adjustment signal generating means for projecting an image based on the adjustment signal on the non-planar screen by the projection display means,
A plurality of imaging devices for capturing an image based on the projected adjustment signal, and a measurement unit that performs three-dimensional measurement on the image projected based on the image signal obtained from the imaging device;
An adjustment device comprising: a deformation processing unit that supplies video deformation information based on a result measured by the measurement unit to the video deformation unit.   2. The apparatus according to claim 1, wherein the plurality of imaging devices are supported on the same gantry, and have a configuration in which the imaging direction can be changed two-dimensionally together with the gantry during the three-dimensional measurement. 3. Adjustment device. The image transformation means includes a frame memory that stores the image signal, a position information memory that stores position information of a pixel, and a digital filter processing data memory that reads and stores the image signal from the frame memory.
A video signal is sequentially written to the frame memory, and new position information of a pixel to be converted is stored in the position information memory, and in the digital filtering data memory, based on the new position information read from the position information memory. 2. The adjustment device according to claim 1, wherein a video signal in an area used for digital filter processing is read from the frame memory as needed.

Images