JP3534785B2 - High reality image display method and device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention relates to a standard television (T
V) The present invention relates to a highly realistic video display method and apparatus for displaying an image signal having a high sense of realism by a signal.

[0002]

2. Description of the Related Art FIG. 9 is a schematic view of a conventional high-realistic projection device in which a staircase-shaped seat 92 is arranged in a screening room 91.
This is a system in which a special wide-angle optical system 93 close to a fisheye lens is prepared, a computer graphics image or a natural image is captured on a high-resolution film, and projected on a screen 94 close to a hemisphere.

[0003]

However, the one shown in FIG. 9 requires special and expensive equipment and requires a dedicated screening room, which can be installed and screened only at an exhibition or a large amusement park. It was.

The present invention is to solve the above-mentioned problems, and adds a function of correcting distortion to a liquid crystal projection means for television signals which is generally popular, and is inexpensive and has a wide viewing angle which does not require any installation condition. aims to SHR image display method images can be displayed and provides the device.

[0005]

In order to achieve the above object, the highly realistic image display method of the present invention according to claim 1 is
A video display method for projecting an image on a front screen by a plurality of projection devices at different angles with respect to the front screen, comprising:
Install the projection device in a room and install a plurality of projection devices.
An image that is installed independently on both sides of the store, that continuously converts the image so that the parts to which multiple image signals are connected are weighted, and that is projected from a direction that is not perpendicular to the projection plane of the image. the projected converts the image to be the same shape as the projected image from the vertical direction, the spacing of said plurality of independent projection device, set to be wider than the horizontal size of one image projected, a plurality The image projected by the independent projection device from a direction not perpendicular to the projection surface is projected in a direction displaying a wider-angle image than the image projected by the single projection device so that the plurality of projected images are continuous. It is characterized by converting.

Further, in the highly realistic image display device of the present invention according to claim 2, the image is projected on the front screen by a plurality of projection means at different angles with respect to the front screen. a video display device, before
Install the screen and the projection means in the room,
The projection means is independently installed on both sides of the room, and the continuous image conversion means for weighting a portion to which a plurality of image signals are connected and the image projected from a direction not perpendicular to the projection plane of the image are displayed. Projection conversion means for converting so as to have the same shape as an image projected from the vertical direction, and a plurality of independent projection means for projecting and displaying a plurality of images are provided.
The distance independent projection means, Ri a wider than the horizontal size of one image projected, and by the input image and the continuous image converting means and the projective transformation means on the projection surface by the plurality of independent projection means An image projected and projected from a non-vertical direction is projected in a direction in which it is displayed at a wider angle than an image projected by a single projection means , and the projected images are set to be continuous.

Further, the highly realistic image of the present invention according to claim 3
The image display method is to display the image on the front screen.
To project a different angle to the front screen for
Wide field of view images by connecting different numbers of imagesVideo display
Method,Put the screen and the projection device in the room
Installed and installed multiple projection devices independently on both sides of the room
InstalledWeights to the connected parts of the plurality of image signals
The image is continuously converted so that
The image projected from a direction that is not perpendicular to the shadow plane is vertical
Project the image so that it has the same shape as the image projected from the direction
Converted,The aboveMultiple GermansStandingThe distance between the projection devices,Projected
To be wider than the horizontal size of one imageConfiguration
Then, the plurality of independent imaging devices can
Images projected from different directions are projected by a single projection device
Projected in the direction to display a wider-angle image than
The converted images are consecutive
Characterize.

[0008]

According to the present invention, an image obliquely projected from a non-vertical direction from a screen can be projected as if it was projected from the vertical direction by correcting the distortion due to the oblique projection, and a plurality of continuous images can be displayed at a wide viewing angle. One image to be given can be synthesized by a video projection means using a liquid crystal which is widely used.

In addition, in a structure in which images from a plurality of independent video projection means are continuously converted to obtain one image, even if the plurality of video projection means are in front of the viewer, for example, the viewer It doesn't hinder the visibility of anything.

[0010]

EXAMPLES Hereinafter, the SHR image display apparatus of the embodiment of the present invention will be described with reference to FIG surface. At the same time, a method for displaying a highly realistic image will be described.

FIG. 1 shows the implementation of the highly realistic image display device of the present invention.
It is a block diagram which shows the structure of the 1st reference example for describing an example , and also shows the outline of the projection position of an image. In the figure, reference numerals 1a, 1b and 1c are projection means for projecting image signals.
(Video projection means) 2a, 2b and 2c are projective transformation means 3a, 3b, which correct the distortion of the obliquely projected image.
3c is a continuous image conversion means for converting the projected images to be continuous, 4 is a screen on which the images are projected, 5a,
Reference numerals 5b and 5c denote projected images that are not subjected to projection conversion.

FIG. 2 shows the highly realistic image display device of FIG.
The shape of an image when a signal having a regular rectangular shape with a standard television signal (for example, NTSC) is input to the projecting means 1a, 1b, 1c is shown. The shape of the image shown here is that projected from the ceiling to the front front (from above the vertical line of the screen), and the image 5 shown by a solid line without projection conversion is used.
The lower part and the left and right parts of a, 5b, and 5c are subject to distortion (projective transformation) that is enlarged. An image that has undergone such distortion will not be a continuous image, even if the original image signal is continuous.

In the present reference example , the distortion (projective transformation) due to the oblique projection is assumed in advance, and the reverse distortion (projective transformation) is added to the image signal to cancel the distortion of the image, and the broken line in FIG. The projected image is projected so as to form the rectangles 6a, 6b, and 6c shown in the figure. 6l and 6m are overlapping portions of the images 6a and 6b and 6b and 6c.

By the way, the transformation for canceling the image distortion (projective transformation) is performed by the projective transformation means 2a, 2b, 2c. The projective transformation is generally represented by the following formula 1 when the coordinates before the transformation are x and y and the coordinates after the transformation are x ′ and y ′.

[0015]

[Equation 1] The coordinate value (x, y) of the input image is coordinate-converted into the output coordinate value (x ′, y ′) according to the above-described formula 1 of the projective transformation. However, when considering a video projection means using a liquid crystal, the output coordinates are discrete values, and if the output coordinate values are continuous, the matching becomes poor when configuring a circuit. Therefore, discrete coordinate values (x ' _int , y'on the output side
The coordinate value (x _r , y _r ) in the input image subjected to the projective transformation corresponding to ( _int ) is obtained, and the signal level at that point is obtained by interpolation calculation.

FIG. 3 shows the projective transformation means 2a, 2b, 2c of FIG.
It is a block diagram showing the configuration of FIG.
Is a memory for accumulating image signals, 12 is a signal interpolating means, 14,
Reference numeral 17 is an address generation means, 15 is a weight generation means, and 16 is a coordinate reverse transformation means.

The image signals input from the continuous image converting means 3a, 3b, 3c of FIG. 1 are temporarily stored in the memory 11. The address generating means 17 generates the addresses of the output memory 13 corresponding to the output coordinates in the order of next output. This address (coordinate values of discrete pixels of the output image) (x '
_The coordinate inverse transforming means 16 finds the coordinate value (x _r , y _r ) in the input image that is coordinate transformed into _int , y ′ _int ). The conversion performed by the coordinate reverse conversion means 16 is shown by the following formula (2).

[0018]

[Equation 2] Further, the element r _{ij of the} rotation matrix is expressed by the equation (3).

[0019]

[Equation 3] θ is the horizontal rotation angle shown in FIG. 1, and φ is the elevation angle when the screen 4 is viewed from the ceiling projection point. θ and φ are different for each video projection means, and the subscripts a, b, and c are added.

As described above, the projective transformation means 2a, 2b,
2c, the coordinate value of the output pixel (x ' _int , y'
_int ), the elements r _{11 to} r ₃₃ of the rotation matrix R, and the focal length f to calculate the equation (2), and obtain the coordinate value (x ′) of the output pixel.
The coordinate value (x _r , y _r ) in the input image, which is coordinate-converted to _int , y ′ _int ), is determined. At this time, the center of the image is also subjected to coordinate conversion to have different coordinates, but the center of the image is offset to the reference coordinate value (for example, zero).

If the size of the coordinate-converted image is larger than the size of the original image, a reduction process is performed so that the protruding portion fits into the size of the original image. In this reduction processing, a value obtained by dividing the variable x ′ _int , y ′ _int of the equation 2 by the reduction rate is substituted, calculation is performed, and the result obtained as described below is substituted into the address of the output memory 13. is the value of the original _{x 'int, y'} int. In this reduction processing, the smallest reduction rate among the processings of the projective transformation means 2a, 2b, 2c is set as the common reduction rate of the three projection transformation means.

Next, the coordinate values (x _r ,
y _r ) determines the coordinates of a pixel to be used in the interpolation calculation and the weight at the time of interpolation to be applied to the pixel. Address generation means 14 is
Coordinate values in the input image determined by the standard inverse transformation means 16
From (x _r , y _r ), the coordinate value of the pixel used in the interpolation calculation is determined by the following formula (4). In this reference example , the interpolation calculation is performed by the cubic convolution method.

[0023]

[Equation 4] However, [] means the maximum integer not exceeding the value in [].

Using the above 4 × 4 = 16 levels in the neighboring pixels, the signal interpolating means 12 multiplies the weights of the following equation (5),
Complete the interpolation calculation. The signal interpolating means 12 carries out interpolation by the cubic convolution method.

[0025]

[Equation 5] As _(x r, _{y r)} level I _(x r, _{y r)} for calculating the. In the number 5 of the _{formula, [x r] -x r -1} + i, [y r]
The value of −y _r −1 + j is given by the following expression (6).

[0026]

[Equation 6] These values are by weight generating unit _15, x r, the fractional portion _{x r} of the _{y r - [x r],} y r - calculated from _{[y r].} The output pixel coordinate values (x ′ _int ,
y ′ _int ) of the image signal level I (x _r ,
y _r ) is written in the address of the output memory 13 indicated by the address generating means 17.

In this way, it is possible to project from the point deviated from the vertical line of the screen on the screen without the influence of distortion (projective transformation). The above processing is performed by the projective transformation means 2a, 2b, 2c.

The projection-converted image obtained as described above is input to a display device such as a liquid crystal device of the projecting means 1a, 1b, 1c and projected on the screen 4. Projection means 1
Since a, 1b, and 1c have different angles with respect to the screen, the projective transformation means 2a, 2b, and 2c have horizontal rotation angles θ.
And elevation angle φ are set to the respective angles.

The continuous image converting means 3a, 3b, 3c performs a process of smoothly connecting the image converted into the rectangle as described above into one image. This continuous image conversion means 3a,
3b and 3c apply a gentle weight to the overlapping portions 6l and 6m (see FIG. 2) of the projected image of the input image signal,
Combine the two images so that they overlap smoothly. The reason for this is that by applying a gentle weight, even if the luminance or hue of the image is slightly shifted, the connection is made so that the change is not noticeable.

FIG. 4 is a diagram showing an example of the weighting characteristics of the continuous image converting means. 6a, 6b and 6l at the positions shown in FIG. 4 correspond to those in FIG. 2, and there is an overlapping portion 6l (6m) of the images. The total of the position weights indicated by is 100%. The overlapping portions of the image signals are the continuous image converting means 3a and 3b (3b in FIG. 1).
And 3c), the data of the respective portions of the input 1 and the input 2 (the input 2 and the input 3) of the image signal are transferred, and then the weighting process is performed. In this way, the adjacent portions of the images are smoothly connected, and the three images shown by 6a, 6b, and 6c in FIG. 2 are converted into one continuous large image. For easy understanding of the above description, the operation of each part has been described in the reverse order of the flow of the image signal processing. Here, the operation will be described according to the flow of the image signal processing.

First, three images having continuous angles of view are input as inputs 1 to 3 to the input end of FIG. As for each image, in the continuous image converting means 3a, 3b, 3c, the images at the left and right ends to which the images are connected are transferred,
The weight shown in FIG. 4 is applied. The weighted image, which is obtained by connecting the end portions of the images, is shifted from the vertical line of the screen 4 by the projective transformation means 2a, 2b, 2c from the screen 4
Performs image conversion that cancels the effects of distortion (projection conversion) when projected on top.

By performing such a conversion, a correct rectangle can be projected even when it is projected from the ceiling to the screen 4 obliquely below, and the converted image is projected from the projection means 1a, 1b, 1c to the screen 4. Project to. Although the projected image is projected obliquely above the screen 4, it is possible to form a continuous rectangle like 6a, 6b, and 6c in FIG. Projection conversion means of the image that cancels the effect of distortion (projection conversion) of oblique projection,
It is possible to smoothly connect the images and form an image with a wide field of view by the continuous image conversion means that continuously changes the weights of the image end portions.

In the above reference example , the projection means 1a, 1b, 1c
As an example, three video projection means are used to project from the ceiling in the center of the room onto the screen 4 on the front side, but it is also possible to project from both sides of the room and synthesize an image with a wide viewing angle on the screen 4. It is possible.

FIG. 5 is a block diagram showing the construction of an example using two video projection means which is an embodiment of the present invention . In the figure, 1d and 1e are projection means (video projection means), 2d and 2e are projective transformation means, 3d and 3e are continuous image transformation means, and the same components as those in the previous figures are given the same reference numerals. I am doing it.

What is different from the first reference example in FIG. 1 is the angle of the projection means 1 with respect to the screen 4, and the angle of the projective transformation for canceling the distortion due to the projection of the image received in this state. At this time, the shape of the image projected on the screen 4 is shown in FIG. Reference numerals 5d and 5e are the shapes of the images when the projection conversion is not performed (shown by solid lines), and 6d and 6e are the shapes of the images when the projection conversion is performed (shown by the broken line). 6n is a portion where two images overlap. Half of the overlapping part is
The corresponding portions of the image signals of the inputs 1 and 2 are transferred by the continuous image converting means 3d and 3e. In this way, according to the present invention, even if the images are projected from both sides of the room, the images can be smoothly connected to each other and a wide-field image with a sense of reality can be projected.

As described above, in the first reference example , the image projection conversion means for canceling the influence of the distortion (projection conversion) of the oblique projection and the continuous image conversion means for continuously changing the weight of the image end portion are used. Even when an image is obliquely projected by using a normal liquid crystal video projection means, it is possible to smoothly connect the images and form an image with a wide field of view. Therefore, it is possible to obtain a highly realistic image with a wide viewing angle without using a special optical system, film, or light valve, and its practical value is high.

[0037] a description will be given of a second reference example to the next. Ginseng
In the consideration example, an apparatus and method for projecting a twin- lens stereo image will be described in order to obtain a highly realistic image. Conventionally, in order to project multiple images at the same position, it is necessary to match the optical axes of the projecting optical systems, and a special video projection means with a dedicated optical system composed of half mirrors is required. It was This reference example does not require a special optical system and realizes a method and an apparatus capable of projecting a twin-lens stereo image by a video projection means using a commonly used liquid crystal device.

FIG. 7 is a block diagram showing the configuration of the second reference example . The same components as those of the first reference example are designated by the same reference numerals and the description thereof will be omitted. Also, change the subscript for distinction. What is different from the first reference example is the polarization means of 18 g and 18 f and the position where the image is projected. The polarizing means 18g and 18f are
Insert to separate each stereo image. The projection positions of the images are set so that the centers of the images coincide with each other, as shown in FIG. 5g image without projection conversion,
Shown with 5f (solid line), the image after projection conversion is 6g, 6
It is indicated by f (broken line).

When the projection conversion is performed, each image is converted into a rectangle, and at this time, the two images can be exactly overlapped. The projection transformation of the image is performed by the projection transformation means 2f and 2g by the transformation of the equations (2) and (3) as in the first reference example . Despite projections from different angles, it is possible to coincide fully images by performing projective transformation. Polarizing means 18f and 18g are inserted between the projecting means 1f and 1g and the screen 4 to shift the polarization planes of the two images by 90 degrees,
Allow it to be separated later. The images given to the inputs 1 and 2 are stereo images to which binocular parallax is given, and a stereoscopic effect is given to the observer by separating the two images with polarizing glasses.

At this time, although the projection means projects from a point deviated from the vertical line of the screen 4, the parallax can be correctly displayed on the screen 4 in any part of the image, so that the correct depth feeling can be obtained. It is possible to present a certain highly realistic image. At this time, the video projection means may be a commonly used one using liquid crystal, which does not require a special optical system or a special video projection means, and can be highly effective.

As described above, in the second reference example , although two images are projected from different points deviated from the vertical line of the screen, they are displayed at the same position on the screen. It is possible to present a correct parallax, and it is possible to present a highly realistic image with a correct sense of depth. Further, at this time, the video projection means may be a commonly used one using liquid crystal, which can be realized without requiring a special optical system or a special video projection means, and its practical value is very high.

[0042] a to separate your second reference example in the two images, the was used the polarizing means may be replaced by a liquid crystal shutter time division which is natural. Further, although an example in which a two-eye stereoscopic 3D image using eyeglasses is applied has been shown, it is natural that it can be applied to a 3D image using a multi-lens lenticular.

[0043] To obtain the first reference example images consecutive in was or has been transferred the right and left ends of the image from each other synthesis, rather than when there is an overlap portion on the left and right ends of a plurality of input images Of course it is also good. Further, in the projective transformation means, the interpolation by the cubic convolution method shown in the equation (5) is used to interpolate the image, but it is obvious that other interpolation methods such as the biliner method may be used. Further, although the memory is used for the signal output portion of the projection conversion means, there may be a case where the memory can be omitted in relation to the output video projection means. Although the method of projective transformation has shown the method according to the principle using the elements of the rotation matrix r, the method of expanding these equations by an approximate equation or the like to simplify the calculation means is obviously the same. It is the scope of the invention.

Although the present embodiment is shown in the shape of the apparatus,
It is natural that the slow processing part may be realized as software (method) for performing processing by a computer according to this configuration.

[0045]

As described above, according to the present invention,
Projection conversion of the image that cancels the influence of distortion (projection conversion) of oblique projection and continuous image conversion that continuously changes the weight of the image edge are used to project the image obliquely using ordinary liquid crystal video projection means. Even in this case, the images can be smoothly connected to form a wide-field image. Therefore, it is possible to obtain an image with a very high sense of presence in a wide viewing angle without using a special optical system, film, or light valve.

Moreover, in a structure in which images from a plurality of independent video projection means are continuously converted to obtain one image, even if the plurality of video projection means are in front of the viewer, for example, the viewer Since it does not hinder the visual field, it is possible to enjoy a smooth image projected by a plurality of video projection means.

Further , although the two images are projected from different points deviated from the vertical line of the screen, it is possible to display the two images at the same position on the screen so that the correct parallax can be presented. It is possible to present a highly realistic image with a correct sense of depth. Furthermore, at this time, the video projection means may be a commonly used one using liquid crystal, which makes it possible to display a very realistic image without the need for a special optical system or a special video projection means. Its practical value is enormous.

[Brief description of drawings]

Describes an embodiment of a high realistic movies image display device of the present invention; FIG
It is a block diagram which shows the structure of the 1st reference example for.

FIG. 2 is a diagram showing a shape of an image projected in FIG.

FIG. 3 is a block diagram showing a configuration of a projective transformation unit in FIG.

FIG. 4 is a characteristic diagram showing an example of weighting characteristics of the continuous image converting means in FIG.

FIG. 5 is a block diagram showing a configuration of an example using two video projection means which is an embodiment of the present invention .

6 is a diagram showing the shape of the projected image of FIG.

FIG. 7 is a block diagram showing a configuration of a second reference example .

FIG. 8 is a diagram showing the shape of the projected image of FIG.

FIG. 9 is a schematic diagram of a conventional highly realistic projection device.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Projection means (video projection means), 2 ... Projection conversion means, 3 ... Continuous image conversion means, 4 ... Screen, 5 ... Image without projection conversion, 6 ... Image with projection conversion, 11, 13 ... Memory , 12 ... Signal interpolating means, 14, 17 ... Address generating means, 15 ... Weight generating means, 16 ... Inverse coordinate converting means, 18 ... Polarizing means.

   ─────────────────────────────────────────────────── ─── Continued front page       (56) References JP-A-60-227238 (JP, A)                 Japanese Patent Laid-Open No. 4-70082 (JP, A)

Claims (3)

(57) [Claims] 1. A video display method of projecting an image by a plurality of projection devices at different angles to the front face of the screen in order to screen an image on a front surface of the screen, before
Install the screen and the projection device in the room,
The projection device is installed independently on both sides of the room , the image is continuously converted so as to weight the connected parts of a plurality of image signals, and the direction is not perpendicular to the projection plane of the image. the image to be the same shape as the projected image of the image projected from the vertical direction projection transformation from an interval of the plurality of independent projection device, set to be wider than the horizontal size of one image projected However, an image projected from a direction not perpendicular to the projection surface by the plurality of independent projection devices is projected in a direction displaying a wider-angle image than an image projected by a single projection device, and the plurality of projected images are A highly realistic video display method characterized by conversion so as to be continuous. 2. A video display apparatus for projecting an image by a plurality of projection means at different angles relative to the front surface of the screen in order to screen an image on a front surface of the screen, before
Install the screen and the projection means in the room,
The projection means is independently installed on both sides of the room, and the continuous image conversion means for weighting a portion to which a plurality of image signals are connected and the image projected from a direction not perpendicular to the projection plane of the image are displayed. Projection conversion means for converting so as to have the same shape as an image projected from the vertical direction, and a plurality of independent projection means for projecting and displaying a plurality of images are provided.
The distance independent projection means, Ri a wider than the horizontal size of one image projected, and by the input image and the continuous image converting means and the projective transformation means on the projection surface by the plurality of independent projection means high, characterized in that the image projected by projecting in a direction not perpendicular is projected in the direction indicated from the wide angle projected image alone projection means, and was set to projected images are continuous Live image display device. 3. A video display for obtaining a wide-field image by connecting a plurality of different images projected at different angles to the front screen to display the image on the front screen.
Method of installing the screen and projection device in a room
However, multiple projectors can be installed independently on both sides of the room.
And location, the image to apply a weighting continuously converted connected to the portion of the plurality of image signals, and image projects an image projected from a direction not perpendicular to the projection plane of the image from a vertical direction the image to be the same shape projected converted, the spacing of said plurality of an independent projection system, set to be wider than the horizontal size of one image projected, the plurality of independent imaging device The image projected from a direction not perpendicular to the projection surface is projected in a direction displaying a wider-angle image than the image projected by a single projection device, and the projected plurality of images are converted to be continuous. Highly realistic video display method.