JP4547960B2 - Video display system and video generation method - Google Patents

Description

  The present invention relates to a video display system capable of viewing video at a plurality of viewpoint positions, and a video generation method for such a video display system.

  As a video display system in which the shape of the video display surface is a part of a curved surface with a concave surface facing the user, systems such as Patent Literature 1, Patent Literature 2, or Patent Literature 3 are known. These cover a wide range of the user's field of view with video, thereby enhancing the user's immersive and realistic feeling. Furthermore, in the system of Patent Document 4, the ideal viewpoint position used when generating the video to be presented to the user is set closer to the video display surface than the geometric center position with respect to the arc formed by the video display surface. Therefore, it is possible to provide a high realistic image to more users. Further, as a technique that can be widely applied to these systems, Patent Document 5 discloses an apparatus that provides a seamless large screen image on a screen of an arbitrary shape using a plurality of image projection means. .

JP 2000-138202 A JP 2002-62506 A JP 2002-148711 A JP 2002-350999 A JP 2002-72359 A

  In an image display system that provides an image common to all users on an image display surface common to all users, in principle, the ideal viewpoint position, that is, a position where a correct image without geometric distortion can be viewed is a space. Only one point above.

  In the conventional system, the video display surface may be a curved surface, and when viewed from a position different from the ideal viewpoint position, there is a problem that the geometric distortion is large.

  An object of the present invention is to provide a system that improves a geometric distortion when a video is viewed at a plurality of viewpoint positions different from the ideal viewpoint position.

  In the present invention, in order to solve the above problems, the video display surface is shaped so that a part of the common part with a certain plane is an arc, and the ideal viewpoint is on the circumference of the circle including the arc on the plane. The position was set and the video was generated.

  By adopting such a method, at least when viewing the image displayed on the arc from the viewpoint position on the circumference, exactly the same as when viewing the geometric shape at the ideal viewpoint position, It can be ideal without distortion.

  According to the present invention, it is possible to provide a video display system that improves the geometric distortion when a video is viewed at a plurality of viewpoint positions different from the ideal viewpoint position.

  Embodiments of the present invention will be described below using examples.

  Hereinafter, the first embodiment will be described in detail with reference to FIGS.

  FIG. 1 is a plan view showing an outline of a system in a first embodiment of the present invention.

  In FIG. 1, an image display surface 10 has a shape obtained by cutting a part of a cylinder having a height in the vertical direction with a circle 21 having a center 20 and a radius R1 as a base. On the circumference of the same circle 21, an ornamental seat 30, an ornamental seat 31, an ornamental seat 32, an ornamental seat 33, and an ornamental seat 34 are installed. Further, the ideal viewpoint position 42 is set at a height H1 on the circumference of the circle 21. The height H <b> 1 is a height assumed as a viewpoint position when a standard user sits on the ornamental seat 32, and is a given value. Furthermore, the video display surface 10 has a geometrical shape when the video generated from the image projection unit 712, the image projection unit 722, and the image projection unit 732 based on the ideal viewpoint position 42, that is, the image is viewed at the ideal viewpoint position 42. Project images that look undistorted. Since the geometrical relationship between the video display surface 10 and the ideal viewpoint position 42 is known in addition to the shape of the video display surface 10, such a video can be easily generated. The reason why a plurality of image projecting means are provided is to enable high-definition video in focus to be displayed on a wide video display area of a non-planar screen.

  FIG. 2 is a horizontal sectional view of the system according to the first embodiment of the present invention at the height H1. The principle of the present invention will be described with reference to FIG.

  In FIG. 2, the triangle determined by the vertex 512, the vertex 522, and the vertex 532 is a cross section of the object 62 in the virtual world. In order to obtain an image that can be viewed without geometric distortion when the image is viewed at the ideal viewpoint position 42, the image of the vertex 512 is displayed at the display position 51 on the image display surface 10, and the image of the vertex 522 is displayed at the display position 52. And the image of the vertex 532 may be displayed at the display position 53.

  By the way, since the circle has the property that “circular angles with respect to the same arc are equal to each other”, when the display position 52 is seen in the direction of the right angle A1 of the display position 51 at the ideal viewpoint position 42, the viewpoint position. 40, the display position 52 is seen in the direction of the angle A1 in the right direction of the display position 51. For the same reason, when the display position 53 is seen in the direction of the right angle A2 of the display position 52 at the ideal viewpoint position 42, the display position 53 is also in the direction of the right angle A2 of the display position 52 at the viewpoint position 40. appear. That is, at the viewpoint position 40, a virtual world that is exactly the same as the virtual world that is viewed at the ideal viewpoint position 42 is rotated by the circumference angle with respect to the arc determined by the ideal viewpoint position 42 and the viewpoint position 40. You can think that you are watching. That is, when viewing the triangle determined by the vertex 512, the vertex 522, and the vertex 532 that are the cross sections of the object 62 in the virtual world from the ideal viewpoint position 42, the cross section of the object 60 in the virtual world is viewed from the viewpoint position 40. A triangle determined by a vertex 510, vertex 520, and vertex 530 is visible, and the two triangles are congruent.

  However, information other than the “viewing direction” (for example, information such as the distance to the virtual object) disappears at the stage of viewing what is displayed on the video display surface 10, so that the interpretation of the video is performed. May be interpreted differently from the above interpretation. In addition, the above relationship is a relationship that holds only in a plane in which the video display surface and a plurality of viewpoint positions are on the same circumference, and is independent of that direction, that is, in the case of this embodiment. For example, when the vertical relationship is also taken into consideration, the video that can be viewed at the viewpoint position 40 does not match the “rotated virtual world identical to the virtual world viewed at the ideal viewpoint position 42”. That is, even in the present invention, a plurality of ideal viewpoint positions cannot be created, and the present invention does not contradict the fundamental principle.

  FIG. 3 is a system configuration diagram of the system in the first embodiment of the present invention. 3, the same reference numerals as those in FIG. 1 denote the same elements as those in FIG.

  In FIG. 3, an image data supply unit 700 supplies image data to be displayed on a screen to a distortion correction unit 711, a distortion correction unit 721, and a distortion correction unit 731 at given time intervals.

  The distortion correction unit 711 generates corrected image data 7112 obtained by performing conversion based on the distortion correction parameter 7110 on the input image data 7111 supplied from the image data supply unit 700, and outputs the corrected image data 7112 to the image projection unit 712. To do. The image projection unit 712 projects the corrected image data 7112 supplied from the distortion correction unit 711 toward the screen 10. Similarly, the distortion correction unit 721 generates corrected image data 7212 obtained by performing conversion based on the distortion correction parameter 7210 on the input image data 7211 supplied from the image data supply unit 700 to the image projection unit 722. The image projection unit 722 projects the corrected image data 7212 supplied from the distortion correction unit 721 toward the screen 10. Further, the distortion correction unit 731 generates corrected image data 7312 obtained by performing conversion based on the distortion correction parameter 7310 on the input image data 7311 supplied from the image data supply unit 700 and directs the image data to the image projection unit 732. The image projection unit 732 projects the corrected image data 7312 supplied from the distortion correction unit 731 toward the screen 10. The image projecting unit 712 and the image projecting unit 722, and the image projecting unit 722 and the image projecting unit 732 are arranged so that the projected areas overlap each other. This is a measure for preventing a gap between adjacent video areas due to the curved surface of the screen 10.

  Here, the distortion correction parameter 7110, the distortion correction parameter 7210, and the distortion correction parameter 7310 allow the user to view an image in which brightness and color are naturally connected without geometric distortion as a whole when the image is viewed at the ideal viewpoint position 42. Correction parameter. The distortion correction parameter 7110, the distortion correction parameter 7210, and the distortion correction parameter 7310 include an image projecting unit 712 including an element for brightness adjustment called an edge blend for an overlapping projection area that is brightened by overlapping projection. And the optical characteristics of the image projection means 722 and the image projection means 732, the optical characteristics of the screen 10, the geometrical arrangement of the ideal viewpoint position 42 and the screen 10 and the image projection means 62, the input image data 7111 and the input image data. It is determined depending only on the generation method of 7211 and input image data 7311, and can be obtained in advance by measurement or calculation.

  As described above, according to the first embodiment of the present invention, the shape of the video display surface is such that the common part with a certain plane is an arc, and the circle of the circle including the arc on the plane is further provided. By setting an ideal viewpoint position on the circumference and generating an image, when viewing an image displayed on the arc from at least the viewpoint position on the circumference, the geometric shape is It is exactly the same as when viewing at the ideal viewpoint position, that is, ideal without distortion.

  In the above embodiment, the shape of the image display surface is a part of the cylindrical surface. However, in the present invention, the condition essentially required for the shape of the image display surface is that the cut surface on a certain plane is an arc. is there. Therefore, the shape of the video display surface in the present invention is not limited to a part of the cylindrical surface, and may be a part of a spherical surface, for example.

  In the above embodiment, an ornamental seat is installed on the circumference of the circle 21 as means for urging the user's viewpoint position to be arranged on the circumference of the circle 21, but an arcuate handrail or the like is used instead of the ornamental seat. It may be used to guide the user's viewpoint position, or the user's viewpoint position may be guided by installing a transparent wall or the like through which the line of sight passes. Or you may guide | invade a user's viewpoint position by installing the opaque wall which a line of sight does not pass, and making a peephole there.

  In the above-described embodiment, a system including a distortion correction unit, an image projection unit, and a screen is used as the image display unit. However, in the present invention, a condition that is essentially required for the image display unit is an image of a specific shape. The video can be displayed on the display surface. Therefore, the video display means in the present invention is not limited to a system comprising a distortion correction means, an image projection means, and a screen. For example, the video display means may be an array of light emitting diodes or a liquid crystal display. They may be arranged side by side.

  Hereinafter, a second embodiment of the present invention will be described in detail with reference to FIG. The present embodiment is an example suitable for providing an image over a wide range of the user's visual field.

  FIG. 4 is a plan view showing the outline of the system in the second embodiment of the present invention. 4, the same reference numerals as those in FIG. 1 denote the same elements as those in FIG.

  In FIG. 4, the image display surface 11 has a shape obtained by cutting a part of a cylinder having a height in the vertical direction with a circle 21 having a center 20 and a radius R1 as a base. The video display surface 12 and the video display surface 13 have a planar shape and are installed so as to be smoothly connected from the end of the video display surface 11. In this embodiment, the video display surface 11, the video display surface 12, and the video display surface 13 are integrated to form the video display surface 14. The video display surface 14 displays a video generated based on the ideal viewpoint position 42, that is, a video that appears without geometric distortion when the video is viewed at the ideal viewpoint position 42.

  As described above, according to the second embodiment of the present invention, in order to provide an image over a wide range of the field of view of the user, the shape of the image display surface is the same as the arc in the central portion of the image. In the peripheral portion, the shape is such that it is smoothly connected to the central image display surface, and the ideal viewpoint position is set on the circumference of the circle including the arc on the plane. In the same way as in the first embodiment, while improving the geometric distortion in the image of the central portion of the entire image display surface, where it is desired that the image quality is high. Images can be provided over a wide range of the user's field of view.

  Hereinafter, the third embodiment of the present invention will be described in detail with reference to FIGS. This embodiment is an example suitable for implementing a time-division stereo vision system.

  FIG. 5 is a diagram for explaining the purpose of use of the video display system of the present embodiment. FIG. 5 shows the same horizontal cross section as FIG. 2, and in FIG. 5, the same reference numerals as those in FIG. 1 represent the same elements as those in FIG.

  In FIG. 5, the viewpoint position 410 is the right eye position of the user of the viewing seat 31, and the viewpoint position 411 is the left eye position of the user of the viewing seat 31. Similarly, the viewpoint position 430 is the right eye position of the user of the viewing seat 33, and the viewpoint position 431 is the left eye position of the user of the viewing seat 33. The viewpoint position 410 and the viewpoint position 430 are on the circumference of the same circle 21, and the viewpoint position 411 and the viewpoint position 431 are assumed that each user faces the center position 101 of the video display area. Calculation is performed from 430 and the center position 101. That is, the vertical bisector between the viewpoint position 410 and the viewpoint position 411 passes through the center position 101, and the vertical bisector between the viewpoint position 430 and the viewpoint position 431 passes through the center position 101. . Specifically, the distance between the right eye and the left eye is r1, the distance between the center position 101 and the viewpoint position 410 is r2, and a radius having a radius r1 centered on the viewpoint position 410 and a radius centered on the center position 101. What is necessary is just to obtain | require the intersection of the circle | round | yen of r2, and select the suitable one based on the relationship of "right" and "left" from the two obtained intersections.

  In this embodiment, in a time-division stereo vision system for a large number of people, since a video for the right eye and a left eye was conventionally presented to each user, (2 × N) division was necessary. The objective is to present a common video to everyone as the video for the right eye, and to display the video for the left eye for each user, so that (N + 1) division is sufficient. Specifically, in the example of FIG. 5, the purpose is to divide into three divisions by simultaneously presenting the same video to the viewpoint position 410 and the viewpoint position 430, where the conventional division was necessary. And

  FIG. 6 is a system configuration diagram of the video display system of the present embodiment. 6, the same reference numerals as those in FIG. 3 denote the same elements as those in FIG.

  In FIG. 6, an image data supply unit 701 is newly provided with a synchronization signal transmission unit 7010 in addition to the function of the image data supply unit 700, and the timing for starting the supply of image data to the distortion correction unit is determined according to the liquid crystal shutter glasses. 702 and the liquid crystal shutter glasses 703. The liquid crystal shutter glasses 702 are liquid crystal shutter glasses for the user of the viewing seat 31, and include synchronization signal receiving means 7020. Based on the synchronization signal transmitted from the image data supply means 701, the liquid crystal shutter glasses for the right eye and for the left eye The state of the liquid crystal shutter is controlled. Similarly, the liquid crystal shutter glasses 703 are liquid crystal shutter glasses for the user of the viewing seat 33, and include a synchronization signal receiving unit 7030. Based on the synchronization signal transmitted from the image data supply unit 701, the liquid crystal shutter glasses for the right eye. And the state of the liquid crystal shutter for the left eye. Here, the liquid crystal shutter has two states, a “transmission state” and a “blocking state”, and can be controlled independently for each of the left and right sides. In the transparent state, the user can view the image on the screen 10, and in the blocked state, the user cannot see the image on the screen 10. The relationship between the image data supplied by the image data supply means 701 and the synchronization signal to be transmitted will be described in detail with reference to FIGS.

  FIG. 7 is a flowchart illustrating an example of a method for supplying image data according to the present exemplary embodiment.

  When the image data supply process is started, first, in step 800, the frame number n is initialized (n = 0).

  Next, in step 801, image data of the nth frame common to the viewpoint position 410 and the viewpoint position 430 is supplied for T seconds. Here, T is a given time interval, for example, a value of 1/60. At this time, the image data supply means 701 transmits a synchronization signal to the liquid crystal shutter glasses 702 and the liquid crystal shutter glasses 703, and the liquid crystal shutter glasses 702 receives the synchronization signal and sets the liquid crystal shutter for the right eye in a transmissive state. The shutter is shut off, and the liquid crystal shutter glasses 703 also receive the synchronization signal and put the liquid crystal shutter for the right eye into the transmissive state and the liquid crystal shutter for the left eye into the shut off state.

  Next, in step 802, image data of the nth frame for the viewpoint position 411 is supplied for T seconds. At this time, the image data supply means 701 transmits a synchronization signal to the liquid crystal shutter glasses 702 and the liquid crystal shutter glasses 703, and the liquid crystal shutter glasses 702 receives the synchronization signal and puts the liquid crystal shutter for the right eye into a closed state. The shutter is set in the transmissive state, and the liquid crystal shutter glasses 703 receives the synchronization signal, and puts the liquid crystal shutter for the right eye and the liquid crystal shutter for the left eye into the blocking state.

  Next, in step 803, image data of the nth frame for the viewpoint position 431 is supplied for T seconds. At this time, the image data supply means 701 transmits a synchronization signal to the liquid crystal shutter glasses 702 and the liquid crystal shutter glasses 703, and the liquid crystal shutter glasses 703 receives the synchronization signal, and the liquid crystal shutters for the right eye and the left eye are shut off. Then, the liquid crystal shutter glasses 703 receive the synchronization signal and put the liquid crystal shutter for the right eye in a blocking state and the liquid crystal shutter for the left eye in a transmissive state.

  Next, in step 804, 1 is added to the frame number n, and in step 805, end determination is performed based on the value of the frame number n. If the necessary image data has not been supplied, the process returns to step 801 and the above processing is repeated. If all necessary image data has been supplied, the image data supply process ends.

  FIG. 8 is a flowchart showing an example of an image data supply method different from that described with reference to FIG. 8, the same reference numerals as those in FIG. 7 represent the same processes as those in FIG.

  After the image data supply process is started and the initialization process of the frame number n is performed in step 800, the image data of the nth frame common to the viewpoint position 410 and the viewpoint position 430 is (T / 2) in step 8010. ) Supply for seconds. At this time, the image data supply means 701 transmits a synchronization signal to the liquid crystal shutter glasses 702 and the liquid crystal shutter glasses 703, and the liquid crystal shutter glasses 702 receives the synchronization signal and sets the liquid crystal shutter for the right eye in a transmissive state. The shutter is shut off, and the liquid crystal shutter glasses 703 also receive the synchronization signal and put the liquid crystal shutter for the right eye into the transmissive state and the liquid crystal shutter for the left eye into the shut off state.

  Next, after the nth frame image data for the viewpoint position 411 is supplied in step 802, the nth frame image data common to the viewpoint position 410 and the viewpoint position 430 is again obtained in step 8011. Supply for (T / 2) seconds. At this time, the image data supply means 701 transmits a synchronization signal to the liquid crystal shutter glasses 702 and the liquid crystal shutter glasses 703, and the liquid crystal shutter glasses 702 receives the synchronization signal and sets the liquid crystal shutter for the right eye in a transmissive state. The shutter is shut off, and the liquid crystal shutter glasses 703 also receive the synchronization signal and put the liquid crystal shutter for the right eye into the transmissive state and the liquid crystal shutter for the left eye into the shut off state.

  The processing after step 803 is the same as that described in FIG.

  As described above, according to the method of FIG. 8, the maximum length of time during which an image is not visible can be shortened for all users as compared to the method of FIG. 7.

  The time interval (T / 2) seconds in step 8010 and step 8011 is a value when there are two users. When there are N users, this value is expressed as (T / N) seconds. do it. By doing so, the right eye image data common to all and the left eye image data for one person are alternately supplied, and the total supply time of the right eye image data and the left eye image data are supplied. The total supply time can be the same.

  As described above, according to the third embodiment of the present invention, in the time-division stereo vision system for N users, the right-eye video and the left-eye video are conventionally presented to each user (2 × N) Where the division was necessary, a common video was presented to everyone as the right-eye video, and the left-eye video was displayed as an individual video for each user. I can finish it. As a result, it is possible to improve the video quality, such as improving the brightness of the video experienced by the user and improving the frame rate per user of the video. Further, when the image data supply means uses an image database created in advance as the image data to be supplied, the effect of reducing the cost of the storage device by reducing the total data amount can be expected.

It is a top view showing the outline | summary of a video display system. Example 1 It is a horizontal sectional view in height H1 of a picture display system. Example 1 1 is a system configuration diagram of a video display system. Example 1 It is a top view showing the outline | summary of a video display system. (Example 2) It is a figure for demonstrating the intended purpose of a video display system. (Example 3) 1 is a system configuration diagram of a video display system. (Example 3) It is a flowchart which shows an example of the supply method of image data. (Example 3) It is a flowchart which shows an example of the supply method of image data. (Example 3)

Explanation of symbols

10, 11, 12, 13 Video display surface 101 Center position of video display area 21 Center 20 and circle with radius R1 30, 31, 32, 33, 34 Ornamental seat 40 Viewpoint position 42 Ideal viewpoint position 410 User of viewing seat 31 Right eye position 411 User's left eye position of viewing seat 31 430 User's right eye position of viewing seat 33 431 User's left eye position of viewing seat 33 51, 52, 53 Display position of each vertex on the video display screen 510, 520, 530 Vertices on horizontal section at height H1 of object 60 in virtual world 712, 722, 732 Image projection means

Claims (1)

A video display system including a video display surface in which a part of a common part with a certain plane is an arc,
Video display means for displaying video on the video display surface;
First video viewing glasses,
Second glasses for viewing images,
The image display means includes a first display image that can be viewed without distortion when viewed at a first viewpoint position on a circumference of a circle including the arc, and a second viewpoint that is different from the first viewpoint position. A second display image that can be viewed without distortion when viewed at a position, and a third display image that can be viewed without distortion when viewed at a third viewpoint position different from the first viewpoint position and the second viewpoint position. The display video is displayed in a time-sharing manner,
Each of the first video viewing glasses is so that only the first display video can be viewed with one eye and only the second display video can be viewed with the other eye, respectively. The image transmittance of the eyeglasses of the eyes changes in synchronization with the display image,
The second video viewing glasses are arranged so that only the first display video can be viewed with one eye and only the third display video can be viewed with the other eye, respectively. An image display system, wherein the image transmittance of the eyeglasses of the eye changes in synchronization with the display image .

Images