JP3579683B2 - Method for producing stereoscopic printed matter, stereoscopic printed matter - Google Patents

Description

  The present invention relates to a method for producing a stereoscopic printed matter and a stereoscopic printed matter.

Conventionally, an image for the left eye taken by a camera corresponding to the left eye and an image for the right eye taken by a camera corresponding to the right eye are prepared, and these images are synthesized by anaglyph processing and the like, and stereoscopic viewing is performed. For obtaining a business image (stereoscopic printed matter) is known.
JP-A-2000-56411

  Now, humans feel the stereoscopic effect of an object because (1) the binocular parallax (deviation of the visual line angle) in which the image of the retina shifts due to the spatial separation of the left and right eyes, and (2) This is caused by three physiological functions: convergence (congestion) in which the left and right eyes face inward, and (3) focus adjustment (focal length) in which the thickness of the crystalline lens responds to the distance to the object. A human feels a three-dimensional effect by processing these three physiological functions, binocular parallax, convergence, and focus adjustment, in the brain.

  The relationship between these three physiological functions is usually related in the brain. Therefore, if an error or a contradiction occurs in this relationship, the brain may try to associate it with the solid and may feel unnatural or may not be able to recognize it as a solid.

  However, in the conventional stereoscopic vision, stereoscopic vision is expressed using only binocular parallax and convergence. For this reason, the focus (focal length) is almost constant in the plane of the stereoscopic image (stereoscopic printed matter), while the binocular parallax and the shift of the convergence occur in almost all places of the stereoscopic image. However, it was impossible to realize reasonable stereoscopic vision in the human brain.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a method for manufacturing a stereoscopic print that can realize more natural stereoscopic viewing and a stereoscopic print. is there.

  The present invention creates a first left-eye image for stereoscopic vision, creates a first right-eye image for stereoscopic vision, and eliminates a perspective of an image on the reference plane of the first left-eye image. Correction processing for the first left-eye image to create a second left-eye image, and a correction processing for eliminating the perspective of the image on the reference plane of the first right-eye image, A stereoscopic print that is applied to a first right-eye image to create a second right-eye image, and creates a stereoscopic print based on the second left-eye image and the second right-eye image. Related to the manufacturing method.

  According to the present invention, by performing a correction process for eliminating a perspective of an image on a reference plane (for example, an image of the reference plane itself or an image of an object in a portion in contact with the reference plane), the first left-eye image is obtained. A second left-eye image is created from the image, and a second right-eye image is created from the first right-eye image. Then, a stereoscopic printed matter is created based on the second left-eye image and the second right-eye image. Thereby, it is possible to provide a printed material for stereoscopic vision that can realize more natural stereoscopic vision with less contradiction between focus adjustment and sense of depth.

  Further, according to the present invention, the reference plane includes a first reference plane and a second reference plane forming a predetermined angle with respect to the first reference plane, and the first reference plane of the first left-eye image is used. A first correction process for eliminating the perspective of the image is performed on an area corresponding to the first reference plane of the first left-eye image, and the first correction processing is performed on the second reference plane of the first left-eye image. A second correction process for eliminating the perspective of the image of the first image is performed on an area corresponding to the second reference plane of the first image for the left eye, and a second image for the left eye is created. A first correction process for eliminating the perspective of the image on the first reference plane of the right-eye image is performed on an area corresponding to the first reference plane of the first right-eye image, and the first correction processing is performed. The second correction processing for eliminating the perspective of the image on the second reference plane of the image for the right eye is performed by the first correction processing. Subjected to a region corresponding to the second reference surface of the right eye image may be create a second right-eye image.

  By doing so, it is possible to solve the case where the setting of one reference plane causes unnaturalness in the sense of depth or the like. Note that three or more reference planes may be set. Also, a plurality of reference planes (first and second reference planes) can be connected.

  Further, the present invention creates a first left-eye image for stereoscopic viewing by photographing a subject and first to fourth marks forming a rectangle on a reference plane from a left-eye viewpoint position. By capturing the first to fourth marks forming a rectangle on the reference plane from the viewpoint position for the right eye, a first right-eye image for stereoscopic viewing is created, and the first left-eye image By performing a correction process of moving the first to fourth marks to the vertices of the rectangle, a second left-eye image is created from the first left-eye image, and the first to fourth images of the first right-eye image are created. By performing a correction process of moving the fourth mark to the vertex position of the rectangle, a second right-eye image is created from the first right-eye image, and a second left-eye image and a second right-eye image are created. And a method for producing a stereoscopic printed matter based on the above method.

  According to the present invention, the correction processing for moving the first to fourth marks of the first left-eye image to the positions of the vertices of the rectangle (the positions of the first to fourth vertices) is performed. A left-eye image is created, a correction process of moving the first to fourth marks of the first right-eye image to the vertices of the rectangle is performed, and a second right-eye image is created. Then, a stereoscopic print is created based on the obtained second left-eye image and second right-eye image. By performing such a correction process, for example, a process of eliminating a perspective on the reference plane can be realized by a simple process.

The rectangle in the present invention is a rectangle in a broad sense including a square. In addition, the rectangle that forms the first to fourth marks on the reference plane and the rectangle that is formed by the vertices to which the first to fourth marks move can have the same aspect ratio. , The reference plane includes a first reference plane and a second reference plane that forms a predetermined angle with respect to the first reference plane, and the first to the first to the first and the second that form a rectangle in the subject and the first reference plane. A first left-eye image for stereoscopic vision is created by photographing the mark of No. 4 and the fifth to eighth marks forming a rectangle on the second reference plane from the viewpoint position for the left eye. By photographing the first to fourth marks constituting a rectangle on the first reference plane and the fifth to eighth marks constituting a rectangle on the second reference plane from the viewpoint position for the right eye, Create a first right-eye image for stereoscopic viewing, and create a first left-eye image A first correction process for moving the fourth to fourth marks to the vertices of the rectangle, and a second correction for moving the fifth to eighth marks of the first left-eye image to the vertices of the rectangle By performing the processing, a second left-eye image is created from the first left-eye image, and the first to fourth marks of the first right-eye image are moved to the vertex positions of the rectangle. By performing the processing and performing the second correction processing for moving the fifth to eighth marks of the first right-eye image to the positions of the vertices of the rectangle, the first right-eye image is converted to the second right-eye image. An image may be created.

  By doing so, it is possible to solve the case where unnaturalness in the sense of depth or the like occurs with only one reference plane. Note that three or more reference planes may be set. Further, the third and fourth marks may be commonly used as the sixth and fifth marks.

  Further, in the present invention, a first left-eye image is created by photographing the subject from the left-eye viewpoint position, and a first right-eye image is created by photographing the subject from the right-eye viewpoint position. When the distance between the viewpoint position and the viewpoint position is increased, the distance between the viewpoint position for the left eye and the viewpoint position for the right eye may be increased according to the change in the length.

  The viewpoint position is, for example, a middle point between the left-eye viewpoint position and the right-eye viewpoint position.

  Further, in the present invention, a first left-eye image is created by photographing the subject from the left-eye viewpoint position, and a first right-eye image is created by photographing the subject from the right-eye viewpoint position. When changing the distance between and the viewpoint position, the viewpoint position may be moved along a straight line that forms a predetermined angle with respect to the reference plane.

  In the present invention, the surface on which the printed material for stereoscopic viewing is placed during stereoscopic viewing may be set as the reference surface.

  In this way, when the printed matter for stereoscopic vision is placed, for example, in parallel with the placement surface, it is possible to realize an optimal and real stereoscopic vision.

  Further, in the present invention, a stereoscopic print may be created by combining the second left-eye image and the second right-eye image by anaglyph processing.

  In the present invention, a stereoscopic print may be created by a method other than the anaglyph processing.

  The present invention also relates to a stereoscopic printed matter created by any one of the above-described manufacturing methods. The present invention also relates to a stereoscopic printed matter created by duplicating a stereoscopic printed matter created by any of the above-described manufacturing methods.

  Further, the present invention is a stereoscopic printout in which a left-eye image and a right-eye image are synthesized and printed, wherein the left-eye image and the right-eye image include an image of an object arranged on a reference plane, Stereoscopic vision in which the object image of the image for use matches the object image of the image for the right eye at the reference plane position, and the distance between the object image of the image for the left eye and the object image of the image for the right eye increases as the distance from the reference plane increases Related to printed materials.

  According to the present invention, the object image of the left-eye image matches the object image of the right-eye image at the reference plane position. For example, the printing position and the display position match at the reference plane position. Then, as the distance from the reference plane increases (as the distance from the reference plane increases in a predetermined direction), the shift between the object image of the left-eye image and the object image of the right-eye image (for example, the shift of the printing position or the display position) increases. As a result, it is possible to realize a natural and real stereoscopic view which has been difficult to obtain in the conventional stereoscopic view.

  Hereinafter, the present embodiment will be described with reference to the drawings.

  The present embodiment described below does not unduly limit the contents of the present invention described in the claims. In addition, all of the configurations described in the present embodiment are not necessarily essential components of the invention.

  By the way, in the present embodiment, stereoscopic vision is realized by the following two methods.

1. FIG. 1 shows a flowchart of a first stereoscopic viewing method of the present embodiment.

  First, a first left-eye image IL1 and a first right-eye image IR1 for stereoscopic viewing are created (generated) (steps S1 and S2). Specifically, a left-eye image IL1 viewed from the left-eye viewpoint position VPL and a right-eye image IR1 viewed from the right-eye viewpoint position VPR are created (generated).

  Here, the left-eye and right-eye viewpoint positions VPL and VPR are positions assumed as the positions of the left and right eyes of the viewer, as shown in FIG. For example, when the left-eye and right-eye images IL1 and IR1 are created by actual shooting with a camera (digital camera), the cameras are arranged at these VPL and VPR positions, and the left-eye and right-eye images IL1 and IR1 are created. Shoot. In this case, two cameras may be arranged in the VPL and VPR for simultaneous photographing, or the photographing may be performed while changing the position of one camera.

  On the other hand, when the left-eye and right-eye images IL1 and IR1 are generated by a system that generates a CG (computer graphics) image and a game image (real-time moving image), a virtual camera is arranged at the position of these VPL and VPR. To generate left-eye and right-eye images IL1 and IR1. That is, an image viewed from the VPL and VPR in the object space is generated.

  3 and 4 show examples of the left-eye image IL1 and the right-eye image IR1. These are examples in which IL1 and IR1 are created by actual shooting with a camera (digital camera). Various objects (objects or objects in a narrow sense) such as oranges, boxes, ballpoint pens, and staplers are arranged on a reference surface (a mounting surface on which the objects are placed). The left-eye image IL1 is obtained by arranging the camera at the left-eye viewpoint position VPL and directing the line of sight (direction) of the camera toward an object (fixation point, representative point of the object). Further, the right-eye image IR1 is obtained by arranging the camera at the right-eye viewpoint position VPR and shooting with the camera's line of sight facing the object. As shown in FIGS. 3 and 4, the viewing angles (views) of these left-eye and right-eye images IL1 and IR1 are shifted, and stereoscopic viewing is performed using binocular parallax due to the shift of the viewing angles. Is achieved.

  In the present embodiment, a surface on which a printed material for stereoscopic viewing is placed (a surface of a desk or a table; a horizontal surface) during stereoscopic viewing can be set as a reference surface.

  In the case of a CG or a game, an object (an object modeled on a mandarin orange, a box, a ballpoint pen, a stapler, or the like) is arranged on a reference plane set in the object space, and a virtual camera is assigned to the VPL and VPR. Deploy. Then, by directing the line of sight (direction) of the virtual camera toward the object (gaze point, representative point of the object) and generating an image viewed from the virtual camera, an image similar to that shown in FIGS. 3 and 4 can be generated.

  Next, as shown in step S3 of FIG. 1, a correction process for eliminating a perspective of the image on the reference plane BS is performed on the first left-eye image IL1 obtained in step S1, and a second process is performed. A left-eye image IL2 is created (generated). Further, as shown in step S4, a correction process for eliminating a perspective (perspective) of the image on the reference plane BS is performed on the first right-eye image IR1 obtained in step S2, and the second right-eye image is obtained. Create (generate) IR2.

  5 and 6 show examples of the left-eye image IL2 and the right-eye image IR2 obtained by the correction processing. For example, in FIG. 3 and FIG. 4, a perspective is attached to a rectangle RTG (a rectangle in a broad sense including a square, also in the following description) drawn on the reference plane BS. On the other hand, in FIGS. 5 and 6, the perspective of the rectangular RTG is eliminated.

  Here, the correction processing for eliminating the perspective in the present embodiment is, as shown in FIG. 8A, an image of the reference plane BS itself, an image IM1 drawn on the reference plane, and an object OB (object). This is a process for eliminating the perspective (feeling of depth) of the part of the image that is in contact with the reference plane BS. That is, in B1 of FIG. 8A, the distance between the vertices decreases as going from the viewpoint to the back side, but in B2 of FIG. 8A, the distance between the vertices changes even when going from the viewpoint to the back side. Absent. By performing such a correction process, an image of the reference plane BS is created (generated) as if viewed from directly above. In addition, it is not necessary that the perspective completely disappears by this correction processing, and it is sufficient that the perspective disappears to such an extent that a sense of incongruity does not occur in the stereoscopic vision.

  Next, as shown in step S5 in FIG. 1, a stereoscopic image (image data) is created (generated) based on the second left-eye image IL2 and the second right-eye image IR2. More specifically, a stereoscopic image is created (generated) by performing anaglyph processing or the like based on IL2 and IR2.

  Then, the stereoscopic image (actual image or CG image) is printed on a print medium by using a color printer (printer in a broad sense) such as an ink jet system or a laser printer system, whereby a printed material for stereoscopic viewing is obtained. Can be manufactured. It should be noted that a stereoscopic print may be manufactured by duplicating a stereoscopic print as an original printed by a color printer (printing machine). In this case, there is an advantage that a large amount of stereoscopic printed matter can be manufactured in a short period of time.

  Further, if the stereoscopic image is displayed on the display unit of the image generation system, it is possible to generate a game image (moving image) in real time. In this case, the stereoscopic image obtained by the anaglyph processing or the like is directly displayed on the display unit, and is viewed using glasses (apparatus in a broad sense) provided with color filters (red and blue). You may do so. Alternatively, the left-eye and right-eye images IL2 and IR2 may be alternately displayed in different frames, for example, on the display unit, and viewed using glasses provided with a liquid crystal shutter or the like.

  FIG. 7 shows an example of a stereoscopic image obtained by performing anaglyph processing based on the left-eye and right-eye images IL2 and IR2 in FIGS.

  In the stereoscopic image of FIG. 7, a left-eye image IL2 (IL) and a right-eye image IR2 (IR) are combined. The left-eye image IL2 and the right-eye image IR2 each include an image of the object OB arranged on the reference plane BS. It also includes an image of the reference plane BS.

  Then, as shown in A1 of FIG. 9, the object image of the left-eye image IL2 and the object image of the right-eye image IR2 coincide at the position of the reference plane BS (however, they do not necessarily have to coincide completely). . That is, the printing position (display position) of the object image of the left-eye image IL2 and the printing position (display position) of the object image IR2 of the right-eye image match on the reference plane BS.

  On the other hand, as shown by A2 in FIG. 9, the distance between the object image of the left-eye image IL2 and the object image of the right-eye image IR2 increases as the distance from the reference plane BS increases. More specifically, the image of the part located above the reference plane BS in the part of the object OB has a print position (display position) in the left-eye image IL2 and a print position (display position) in the right-eye image IR2. ) Is out of alignment.

  By printing the stereoscopic images of FIGS. 7 and 9 on a print medium, a printed material for stereoscopic viewing can be manufactured. Then, stereoscopic viewing can be realized by viewing the printed matter for stereoscopic viewing with, for example, glasses provided with a red filter on the left eye and a blue filter on the right eye. In addition, by displaying the stereoscopic image of FIGS. 7 and 9 on the display unit, a stereoscopic game image can be generated.

  Now, in the conventional stereoscopic view, as shown in FIG. 8B, the surface of the printed matter PM for stereoscopic view (or the display screen of the display unit; the same applies to the following description) is parallel to the vertical plane. It is assumed that the viewer views the printed matter PM for stereoscopic viewing directly. For this reason, for example, the anaglyph processing is performed on the left-eye and right-eye images IL1 and IR1 as shown in FIGS. 3 and 4 to generate a stereoscopic print PM. Since the perspectives remain in the images of FIGS. 3 and 4, when the printed matter PM for stereoscopic viewing is viewed directly as shown in FIG. 8B, the images are correct as far as the perspective is concerned.

  However, when the viewer looks at the stereoscopic printed matter PM directly as shown in FIG. 8B, the focus (focal length) becomes the same over the entire surface of the PM. Accordingly, in the human brain, inconsistencies and errors occur in the relationship between focus adjustment and binocular parallax and convergence. Therefore, when the brain tries to forcibly associate with the three-dimensional object, the brain feels unnatural and cannot be recognized as a three-dimensional object. In addition, if the stereoscopic printed matter PM created by the conventional method is arranged on a desk so as to be parallel to a horizontal plane, a sense of depth is contradictory, resulting in unnatural stereoscopic vision. That is, the rectangular RTG shown in FIGS. 3 and 4 is a plane having a height of zero, and this rectangular RTG must not look three-dimensional.

  Therefore, in the present embodiment, as shown in FIG. 8C, it is assumed that the viewer views the printed matter PM (display screen) for stereoscopic viewing by arranging it on a desk (a reference plane BS parallel to a horizontal plane). I am trying to do it. That is, such an arrangement is a default arrangement of the present method. When the stereoscopic print PM is arranged in parallel with the horizontal plane as described above, if the images in FIGS. 3 and 4 are anaglyph-processed to create the stereoscopic print PM, inconsistency occurs in perspective.

  Therefore, in the present embodiment, as described with reference to FIGS. 5, 6, and 8A, a correction process for eliminating the perspective of the image of the reference plane is performed. Then, anaglyph processing is performed on the basis of the corrected images of FIGS. 5 and 6 in which the perspective on the reference plane has been eliminated to create a stereoscopic print PM, and the created stereoscopic print PM is shown in FIG. ), The image on the reference plane (rectangular RTG) has an appropriate perspective. Further, if the arrangement is made as shown in FIG. 8C, the focal lengths of the respective points on the surface of the printed material PM for stereoscopic vision are not the same but different. Therefore, the focus adjustment is similar to the focus adjustment in the real world. Accordingly, a shift in the relationship between the focus adjustment and the binocular parallax or convergence is reduced, and a more natural and realistic stereoscopic view can be realized.

  Note that, in the stereoscopic method according to the present embodiment, when the height of the object is high, there is a possibility that the sense of depth or the like may deviate. In such a case, for example, as shown in FIG. 10, two reference planes BS1 and BS2 (a plurality of reference planes in a broad sense) may be provided.

  Here, the reference plane BS1 is, for example, a plane parallel to a horizontal plane. On the other hand, the reference surface BS2 is a surface that forms a predetermined angle (for example, a right angle) with the reference surface BS1. The reference planes BS1 and BS2 are connected at the boundary BD.

  The object OB (object) is arranged above the reference plane BS1 and on the near side (VPL, VPR side) of the reference plane BS2. Then, the processing shown in FIG. 11 is performed instead of FIG.

  Steps S11 and S12 in FIG. 11 are the same as steps S1 and S2 in FIG. In step S13, a correction process for eliminating a perspective on the reference plane BS1 is performed on an area corresponding to the reference plane BS1 of the left-eye image IL1 (a first area of the IL1 on the BS1 side with respect to the boundary BD). Apply to In addition, a correction process for eliminating a perspective on the reference plane BS2 is performed on an area of the IL1 corresponding to the reference plane BS2 (a second area of the IL1 on the BS2 side with respect to the boundary BD). Then, a left-eye image Il2, which is an image obtained by connecting the images generated by these correction processes, is created (generated).

  In step S14, a correction process for eliminating a perspective on the reference plane BS1 is performed on an area corresponding to the reference plane BS1 of the right-eye image IR1 (a first area of the IR1 on the BS1 side with respect to the boundary BD). Apply to In addition, a correction process for eliminating a perspective on the reference plane BS2 is performed on an area of the IR1 corresponding to the reference plane BS2 (a second area of the IR1 on the BS2 side with respect to the boundary BD). Then, a right-eye image IR2, which is an image obtained by connecting the images generated by these correction processes, is created (generated).

  Finally, as in step S15, for example, anaglyph processing is performed based on IL2 and IR2 to create (generate) a stereoscopic image. Then, the obtained stereoscopic image is printed on a print medium to produce a stereoscopic print, or the stereoscopic image is displayed on a display unit to generate a game image as a real-time moving image.

  By doing so, as shown in FIG. 12, even when the OB is an object whose height is higher than the reference plane BS1, a more natural and realistic stereoscopic view can be realized. That is, in an area near the foot of the object OB (a first area below the boundary BS), stereoscopic processing using the reference plane BS1 can realize a stereoscopic view that is reasonable for the sense of depth and focus adjustment. On the other hand, in the other area (the second area above the boundary BS), stereoscopic processing using the reference plane BS2 can be performed to achieve a natural stereoscopic view with a reasonable sense of depth.

  The number of reference planes is not limited to two, and three or more reference planes (a plurality of connected reference planes) may be used.

2. Second Stereoscopic Viewing Method FIG. 13 shows a flowchart of a second stereoscopic viewing method according to the present embodiment. The above-described method of FIG. 1 is an optimal method for creating a stereoscopic print using an image photographed by a camera, whereas the method of FIG. 13 is a method of stereoscopic print using a CG image. This is the best way to create

  First, in the projection direction connecting the viewpoint position VPL for the left eye and each point of the object OB, each point of the OB is projected on the reference plane BS (BS1 or BS2 in FIG. 10) and rendered on the reference plane BS. An image IL is created (generated) (step S21).

  Next, each point of OB is projected on the reference plane BS (BS1 or BS2 in FIG. 10) in a projection direction connecting the viewpoint position VPR for the right eye and each point of the object OB, and rendered on the reference plane BS. An image IR for use is created (generated) (step S22). The reference plane BS is, for example, a plane that is not orthogonal to the line-of-sight direction (the direction connecting the viewpoint position and the gazing point). That is, the reference plane BS is a plane different from the perspective projection screen that is always orthogonal to the line of sight.

  In the processing in steps S21 and S22, virtual light is projected from the VPL (or VPR) toward the object OB, and the light is used to convert the image of the OB into a virtual plane which is the reference plane BS (BS1 or BS2). Render on virtual paper as if printing on paper. Thus, as shown in FIG. 14A, the images (properties such as colors) of the points P1, P2, P3, and P4 of the object OB are changed to the projection points P1 ′, P2 ′, P3 ′, Rendered on P4 '. The images of the points P5 and P6 on the reference plane BS are rendered as they are at the positions of the points P5 and P6. For example, as shown in FIG. 14B, by rendering the entire surface of the reference plane BS (virtual paper) by raster scanning, an image IL for the left eye and a right eye similar to IL2 and IR2 in FIGS. Image IR can be created. That is, it is possible to create left-eye and right-eye images IL and IR in which the perspective of the reference plane image has disappeared.

  Then, based on these left-eye and right-eye images IL and IR, for example, anaglyph processing is performed to create (generate) a stereoscopic image (step S23). Thereby, a stereoscopic image as shown in FIG. 7 can be obtained. Then, the game image can be generated by printing the obtained stereoscopic image on a print medium to produce a stereoscopic print, or displaying the stereoscopic image on a display unit.

  Then, for example, as shown in FIG. 14C, by arranging and viewing the printed matter for stereoscopic viewing PM (or the display screen) so as to be parallel to the horizontal plane (reference plane), a more natural and realistic stereoscopic view is realized. realizable.

  For example, in FIG. 15A, a left-eye image and a right-eye image are created by perspectively projecting the object OB onto a perspective projection screen SCR (a plane orthogonal to the line of sight). Then, the obtained left-eye image and right-eye image are combined to create a stereoscopic print PM. Then, as shown in FIG. 15 (B), the viewer looks at the printed matter PM for stereoscopic vision directly facing the PM.

  In the method shown in FIG. 15A, points P2 and P3 of the object OB are projected onto points P2 "and P3" on the projection screen SCR. Then, since the printed matter PM for stereoscopic viewing is viewed directly as shown in FIG. 15B, the focal length difference L2 between P2 ″ and P3 ″ becomes zero. That is, although the focal length difference L1 between the actual points P2 and P3 is not 0, L2 is 0, so that the focus adjustment is different from the actual one. Therefore, a contradiction occurs between the focus adjustment and the binocular parallax, and confusion occurs in the human brain, resulting in an unnatural stereoscopic view.

  On the other hand, in the present embodiment, since the stereoscopic printed matter PM (display screen) is to be viewed on a desk as shown in FIG. 14C, the point P2 is displayed as shown in FIG. The focal length difference L2 between '1 and P3' is not 0, like the focal length difference L1 between the actual points P1 and P2. Therefore, the front part (point P2) can be seen in front and the back part (P3) can be seen in back, so that there is no inconsistency in the relationship between focus adjustment and binocular parallax, and confusion occurs in the human brain. Therefore, more natural stereoscopic vision can be realized.

  That is, in the present embodiment, since the stereoscopic printed matter PM is placed on the desk and viewed obliquely, the surface of the desk and the reference plane BS (zero plane) on which the object OB to be stereoscopically viewed is placed. , Are the same, are realistic, and do not cause unreasonable stereoscopic vision. The object OB only needs to be able to express a state in which the object OB rises by several centimeters with respect to the reference plane BS (zero plane), so that there is almost no inconsistency in the depth direction. In addition, since the reference surface BS is the surface of the desk, it looks as if a three-dimensional object is truly placed on the desk, and the realism of the object is improved. That is, in the conventional methods shown in FIGS. 15A and 15B, although the reference surface is unsteady, there is certainly a three-dimensional effect, but the real feeling of the object only looks like an illusion.

  In the method of FIG. 13, as described with reference to FIG. 10, a plurality of reference planes may be set to create (generate) a stereoscopic image. In this case, in steps S21 and S22 in FIG. 13, the point projected on the reference plane BS1 may be rendered on the reference plane BS1, and the point projected on the reference plane BS2 may be rendered on the reference plane BS2.

3. Anaglyph Processing Next, the anaglyph processing performed in step S5 in FIG. 1, step S15 in FIG. 11, and step S23 in FIG. 13 will be briefly described.

  In the anaglyph processing, a left-eye image and a right-eye image are printed on a single print medium in different colors to create a stereoscopic print. Then, the printed material for stereoscopic viewing is viewed through left and right eyes through different color filters (for example, the left eye is red and the right eye is blue). At this time, only the image for the left eye can be seen by the left eye, and only the image for the right eye can be seen by the right eye, and stereoscopic vision is realized.

  For example, in the monochrome anaglyph processing, the image for the left eye (IL2, IL) is converted to a gray scale. Then, the converted image data is copied to the R channel of the anaglyph image (RGB). Next, the right-eye image (IR2, IR) is converted to grayscale. Then, the converted image data is copied to the G channel and the B channel of the anaglyph image (RGB). Thereby, a monochrome anaglyph image is created. The right-eye image may be copied only to the B channel.

  In the color anaglyph processing, the R channel of the left-eye image (IL2, IL) is copied to the R channel of the anaglyph image (RGB). Further, the G channel of the right-eye image (IR2, IR) is copied to the G channel of the anaglyph image (RGB). Further, the B channel of the image for the right eye is copied to the B channel of the anaglyph image (RGB). Thereby, a color (pseudo color) anaglyph image can be created.

  Note that the stereoscopic vision realizing method (step S5 in FIG. 1, step S15 in FIG. 11, and step S23 in FIG. 13) uses at least the left-eye image (IL2, IL) and the right-eye image (IR2, IR). What is necessary is just to be realized, and it is not limited to anaglyph processing.

  For example, a special lens called a lenticular lens may be used so that only the left-eye image enters the left eye and only the right-eye image enters the right eye, thereby realizing stereoscopic vision.

  In addition, a polarizing plate is arranged before the left-eye image and the right-eye image, and the polarizing directions are different between the polarizing plate placed before the left-eye image and the polarizing plate placed before the right-eye image. . Then, a stereoscopic view may be realized by a viewer wearing glasses in which a polarizing plate having a deflection direction corresponding to the polarization direction is attached to a lens portion.

  The left-eye image and the right-eye image are alternately displayed, for example, with different frames. The viewer wears glasses provided with a shutter for the left eye (for example, a liquid crystal shutter) that opens in synchronization with the display of the image for the left eye and a shutter for the right eye that opens in synchronization with the display of the image for the right eye. Vision may be realized.

4. Setting of viewpoint position Next, a method of setting the viewpoint position will be described.

  The viewpoint positions VPL and VPR for the left eye and the right eye in FIGS. 2 and 10 are arranged based on the assumed positions of the left and right eyes of the viewer when the viewer actually looks at the printed material for stereoscopic viewing and the display screen for stereoscopic viewing. It is desirable to do. For example, in FIGS. 2 and 10, the distance DVB (for example, 40 cm) between the object OB (object, subject) and the viewer's eyes, the line-of-sight angle θ (line-of-sight direction SL), and the distance DLR between both eyes (for example, 7 cm) Based on this, the viewpoint positions VPL and VPR for the left and right eyes are set.

  However, when performing reduced display or enlarged display, the positions of VPL and VPR are moved in accordance with the reduction ratio and the enlargement ratio. In this case, it is desirable to move the viewpoint position by a method as shown in FIG.

  For example, when the distance DVB between the object OB (subject, object) and the viewpoint position (the midpoint CP between VPL and VPR) is increased, the viewpoint position VPL for the left eye is changed according to the change (ratio) of the length. The distance DLR from the right-eye viewpoint position VPR is increased. That is, for example, the DLR is lengthened in proportion to the change in the DVB length.

  When changing the distance DVB between the object OB (subject, object) and the viewpoint position (the midpoint CP between VPL and VPR), a straight line LN (line of sight) forming a predetermined angle θ with respect to the reference plane BS. The viewpoint position (middle point CP, VPL, VPR) is moved so as to move along.

  By doing so, even when the VPL and VPR are moved, the distance DVB and the distance DLR change at the same magnification ratio, so that it is possible to prevent a situation where the stereoscopic effect is broken. This makes it possible to realize reduced display and enlarged display while maintaining an appropriate three-dimensional effect.

5. Creation of Printed Material for Stereoscopic View Using Real Photograph Image Next, details of a method of creating (manufacturing) a printed material for stereoscopic vision using a real photographed image will be described. In this case, the first method described with reference to FIG. 1 is suitable.

  When using a real image, it is necessary to reproduce the environment at the time of photographing as it is. Therefore, a camera for photographing (such as a digital camera) is arranged in a layout that is close to the positional relationship when viewed by a viewer. For example, a stereoscopic printed matter or the like is placed on a standard desk, and a live-view camera is arranged on the assumption that a viewer sits on a chair and looks at the printed matter.

5.1 When there is one reference plane When there is one reference plane as shown in FIG. 2, the distance DLR between the eyes (about 7 cm), the distance DVB between the viewpoint and the subject OB, the angle of line of sight θ, the printing A paper vertical size D1 and a horizontal size D2 (print range) are set.

  Next, the camera is placed at a position assumed to be the position of the left and right eyes of the viewer. Then, a sheet of paper on which marks MK1 to MK4 (first to fourth marks) are written as indications of the printing range (D1, D2) is placed. The marks MK1 to MK4 form the vertices of a rectangle (a broad rectangle including a square) on the reference plane BS.

  Next, the subject OB is placed on paper. At this time, the OB is placed so that the subject OB does not protrude outside a rectangle (printing range) formed by the marks MK1 to MK4 when viewed from the camera position. Then, using the camera set at the position assumed to be the position of the left eye and the right eye, shooting is performed so that the subject OB and the marks MK1 to MK4 enter, and for the left eye and the right eye as shown in FIGS. The images IL1 and IR1 are created.

  Next, the captured left-eye and right-eye images IL1 and IR1 are taken into an image generation system (a personal computer or an information processing device) and displayed on a screen. Then, paper marks MK1 to MK4 are found from the displayed image.

  Next, as shown in FIG. 17, the marks MK1 to MK4 are moved to the positions of vertices VX1 to VX4 of a rectangle having an aspect ratio of D1 to D2 (a rectangle in a broad sense including a square) to correct the image. Perform processing. This correction process is performed on each of the left-eye and right-eye images IL1 and IR1, thereby creating left-eye and right-eye images IL2 and IR2 as shown in FIGS.

  Next, unnecessary portions other than the print range are trimmed. Then, using anaglyph processing software, a stereoscopic image (anaglyph image) as shown in FIG. 7 is created from the left-eye and right-eye images IL2 and IR2. Then, the obtained stereoscopic image is printed on paper in a print range of D1 and D2 to complete a stereoscopic print.

5.2 When Two Reference Planes are Provided When two reference planes are provided as shown in FIG. 10, the distance DLR between the eyes (about 7 cm), the distance DVB between the viewpoint and the subject OB, the visual line angle θ, the printing paper , A vertical size D1, a horizontal size D2, and a height size D3 (print range) are set.

  Next, the camera is placed at a position assumed to be the position of the left and right eyes of the viewer. Then, the first sheet (reference surface BS1) on which marks MK1 to MK4 (first to fourth marks) serving as indications of the printing range (D1, D2) are placed. The marks MK1 to MK4 form the vertices of a rectangle on the reference plane BS1.

  Next, the second sheet (reference plane BS2) on which marks MK5 to MK8 (fifth to eighth marks) serving as a guide of the printing range (D2, D3) are written is placed behind the first sheet. And set it upright. The marks MK5 to MK8 form the vertices of a rectangle on the reference plane BS2.

  Next, the subject OB is placed on the first sheet of paper. At this time, when viewed from the position of the camera, the OB is placed so that the subject OB does not protrude outside a rectangle formed by the marks MK1 to MK4 and a rectangle (printing range) formed by the marks MK5 to MK8. Then, using the camera set at the position assumed to be the position of the left eye and the right eye, shooting is performed so that the subject OB and the marks MK1 to MK4 and MK5 to MK8 enter, and the images IL1 and IR1 for the left eye and the right eye ( Photo).

  Next, the captured left-eye and right-eye images IL1 and IR1 are taken into an image generation system (personal computer) and displayed on a screen. Then, paper marks MK1 to MK4 and MK5 to MK8 are found from the displayed image. The marks MK3, MK4 and MK6, MK5 can be the same mark.

  Next, as shown in FIG. 18, the marks MK1 to MK4 are moved to the positions of the vertices VX1 to VX4 of the rectangle having an aspect ratio of D1: D2, and a correction process for distorting the image is performed. Further, the marks MK5 to MK8 are moved to the positions of the vertices VX5 to VX8 of the rectangle having an aspect ratio of D3 to D2, and a correction process for distorting the image is performed. Then, the two obtained images are connected. This correction process is performed on each of the left-eye and right-eye images IL1 and IR1 to create left-eye and right-eye images IL2 and IR2.

  Next, unnecessary portions other than the print range are trimmed. Then, a stereoscopic image (anaglyph image) is created from the left-eye and right-eye images IL2 and IR2 using software for anaglyph processing. Then, the obtained stereoscopic image is printed on paper in a print range of D1, D2, and D3 to complete a stereoscopic print.

6. Creation of Stereoscopic Print Using CG Image Next, a method of creating (manufacturing) a stereoscopic print using a CG (computer graphics) image will be described. In this case, the second method described with reference to FIG. 13 is suitable. However, it can also be realized by the first method shown in FIG.

  First, a virtual camera (viewpoint) is arranged in the object space with a layout close to the positional relationship when the viewer views. For example, a virtual camera is arranged on the assumption that the viewer sits on a chair and looks at a stereoscopic print on a standard desk.

  Then, as shown in FIG. 2, the distance DLR between the eyes (about 7 cm), the distance DVB between the viewpoint and the object OB, the angle of sight θ, the vertical size D1 of the printing paper, and the horizontal size D2 (printing range) are set.

  Next, the virtual camera is arranged at a position assumed to be the position of the left and right eyes of the viewer. Then, the object is arranged on the virtual paper (virtual paper object).

  Next, virtual light is projected from the left-eye viewpoint position VPL toward the object OB, and the light is used to render an OB image on virtual paper. Thereby, the left eye image IL is created. This is a process similar to a process of projecting an image viewed from the eyes onto virtual paper on a desk by a projector.

  Next, virtual light is projected from the right-eye viewpoint position VPR toward the object OB, and rendering is performed by using the light to print an OB image on virtual paper. Thereby, a right-eye image IR is created.

  Next, using the software for anaglyph processing, a stereoscopic image (anaglyph image) is created from the left-eye and right-eye images IL and IR. Then, the obtained stereoscopic image is printed on paper in a print range of D1 and D2 to complete a stereoscopic print.

  Note that a plurality of reference planes may be provided as shown in FIG. 10 to create a stereoscopic print using a CG image.

  Further, all of the objects OB projected on the reference plane BS may be objects arranged on the reference plane BS as shown in FIG. 2, or as shown in FIG. A part may be an object arranged on the back side of the reference plane BS. Alternatively, as shown in FIG. 19B, all of the objects may be objects arranged on the back side of the reference plane BS.

  For example, in FIG. 19A, points P1, P2, and P3 on the far side of the reference plane BS are projected to points P1 ', P2', and P3 'on the near side. Thereby, a hole or the like opened in the object OB can be expressed. At the position C1 in FIG. 19A, a state in which the object OB is sunk into the virtual paper can be expressed.

  In FIG. 19B as well, points P1, P2, and P3 on the far side of the reference plane BS are projected to points P1 ', P2', and P3 'on the near side. Thereby, an object such as a fish that dives below the surface of the water can be represented. In the case of expressing a translucent object such as a water surface, a translucent object is arranged at the position of the reference plane BS, and the translucent object and the object OB (points P1 ', P2', P3 ') are combined with each other. It is desirable to carry out.

  As described above, according to the method of the present embodiment using the CG image, it is possible to create a printed matter for stereoscopic viewing that is optimal to be attached to a game manual.

  For example, in a conventional game manual to which only a two-dimensional map picture is attached, there is a problem that it is difficult for a player to grasp the shape of the map and the like.

  On the other hand, if the method of the present embodiment is used, it is possible to attach a printed matter of a map that looks three-dimensional to the game manual. For example, since the map shape data exists as game data, a print material for stereoscopic viewing of the map can be easily created by using the game data. Further, according to the method of the present embodiment, it is possible to provide a printed material for stereoscopic viewing that gives the clearest stereoscopic effect when viewed on a desk or the like. Therefore, it is possible to provide a printed material for stereoscopic viewing that is easy to use and convenient for the player and is most suitable to be attached to the game manual.

  For example, in a car, tank, or airplane game, a printed material for stereoscopic vision in which a car, a tank, and an airplane appearing in a three-dimensional manner may be attached to the game manual. Alternatively, if the method of the present embodiment is applied to a monster card game, a card game in which a monster of a card appears to pop out three-dimensionally can be realized. In particular, in a card game, the player enjoys the game by placing a card on a horizontal surface such as a desk or a table. Therefore, the method according to the present embodiment that enables the most effective stereoscopic viewing when the player is on a horizontal surface (reference surface) is optimal.

7. Generation of Game Image Next, a method of generating a game image that is a real-time moving image will be described. In this case, the first method described with reference to FIG. 1 is suitable. However, it can also be realized by the second method shown in FIG.

  First, a virtual camera (viewpoint) is arranged in the object space with a layout close to the positional relationship when the player views. For example, a virtual camera is arranged on the assumption that the player sits in a chair and looks at the printed matter for stereoscopic viewing on a standard desk.

  Then, as shown in FIG. 2, the distance DLR between the eyes (about 7 cm), the distance DVB between the viewpoint and the object OB, the angle of sight θ, the vertical size D1 of the display screen, and the horizontal size D2 (display screen size) are set.

  Next, the virtual camera is arranged at the left eye and right eye viewpoint positions VPL and VPR which are assumed to be the positions of the left and right eyes of the player. Also, the object OB which is the subject of the virtual camera is arranged in the object space. These virtual cameras are basically pointed from the left-eye and right-eye viewpoint positions VPL and VPR in the direction of the object (gaze object) in the object space.

  Next, the left-eye and right-eye images IL1 and IR1 viewed from the virtual cameras arranged at the left-eye and right-eye viewpoint positions VPL and VPR are generated. Then, the generated left-eye and right-eye images IL1 and IR1 are written in a texture area (texture space) of the VRAM, and these images are set as a texture image TEX as shown in FIG.

  Next, the texture image TEX with the perspective (see FIGS. 3 and 4) is mapped to a polygon PLG (primitive surface) of a rectangle having a size of D1 and D2 (a rectangle in a broad sense including a square). Specifically, the texture coordinates (TX1, TY1), (TX2, TY2), (TX3, TY3), and (TX4, TY4) of the texture image TEX are coordinated with the vertices VX1, VX2, VX3, and VX4 of the polygon PLG. Then, the texture image TEX is mapped to the polygon PLG. As a result, as shown in FIGS. 6 and 7, an image in which the perspective of the image of the reference plane has disappeared can be generated. Then, such a texture mapping process is performed for each of the left-eye and right-eye images IL1 and IR1 to generate left-eye and right-eye images IL2 and IR2.

  Next, the obtained left-eye and right-eye images IL2 and IR2 are combined into one stereoscopic image using anaglyph processing. Then, the synthesized stereoscopic image is output to the display unit.

  When stereoscopic viewing is realized using a liquid crystal shutter or the like, the generated left-eye and right-eye images IL2 and IR2 may be alternately output to the display unit in different frames.

8. FIG. 21 shows an example of a functional block diagram of the image generation system of the present embodiment. Note that the image generation system of the present embodiment does not need to include all of the components (each unit) in FIG. 21 and may have a configuration in which some of them are omitted.

  The image generation system in FIG. 21 can be used as a system for generating a game image (real-time moving image). In addition, a stereoscopic image can be created from a CG image (still image) and used as an image generation system (CG tool) for creating a stereoscopic print. In addition, a real image taken by a camera is taken in, a stereoscopic image is created from the real image, and the image can be used as an image generation system for creating a stereoscopic print.

  The operation unit 160 is used by a player (operator) to input operation data, and its functions include a lever, a button, a steering wheel, a shift lever, an accelerator pedal, a brake pedal, a microphone, a sensor, a touch panel, and a housing. Hardware.

  The storage unit 170 serves as a work area for the processing unit 100, the communication unit 196, and the like, and its function can be realized by hardware such as a RAM.

  The information storage medium 180 (a medium readable by a computer) stores programs, data, and the like, and functions as an optical disk (CD, DVD), a magneto-optical disk (MO), a magnetic disk, a hard disk, a magnetic tape. Alternatively, it can be realized by hardware such as a memory (ROM). The processing unit 100 performs various processes of the present embodiment based on the program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores (records and stores) a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by hardware such as a CRT, an LCD, a touch panel, or an HMD (head-mounted display).

  The sound output unit 192 outputs the sound generated according to the present embodiment, and its function can be realized by hardware such as a speaker or headphones.

  The portable information storage device 194 stores personal data of a player, save data of a game, and the like. Examples of the portable information storage device 194 include a memory card and a portable game device.

  The communication unit 196 performs various types of control for performing communication with the outside (for example, a host device or another image generation system), and functions thereof include hardware such as various processors or a communication ASIC. , And a program. By using the communication unit 196, it becomes possible to take in a real image captured by a camera into an image generation system and output a created stereoscopic image to a printer.

  A program (data) for causing a computer to function as each unit of the present embodiment is distributed from an information storage medium of a host device (server) to an information storage medium 180 (storage unit 170) via a network and a communication unit 196. You may do so. Use of such an information storage medium of the host device (server) is also included in the scope of the present invention.

  The processing unit 100 (processor) performs various processes such as game processing, image generation processing, or sound generation processing based on operation data from the operation unit 160, a program, and the like. In this case, the processing unit 100 performs various processes using the main storage unit 172 in the storage unit 170 as a work area. The function of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.) or ASIC (gate array, etc.), or a program (game program).

  The processing unit 100 includes a game processing unit 110, a first image generation unit 120, a second image generation unit 122, a stereoscopic image generation unit 126, and a sound generation unit 130.

  Here, the game processing unit 110 performs various game processes for generating a game image based on operation data from the operation unit 160 (game controller). The game process includes a process of starting a game based on a game start condition, a process of advancing the game, a process of arranging an object (display object) appearing in the game, movement information (position, speed, acceleration) of the object, The processing includes processing for obtaining motion information (motion information), processing for displaying an object, processing for calculating a game result, and processing for ending a game when a game ending condition is satisfied.

  The first image generation unit 120 performs a process of generating a first left-eye image that is an image viewed from the left-eye viewpoint position (left-eye virtual camera) in the object space. Further, a process of generating a first right-eye image that is an image viewed from the right-eye viewpoint position (right-eye virtual camera) in the object space is performed. In this case, the first left-eye image and the first right-eye image are images for stereoscopic viewing, for example, images with binocular parallax. More specifically, a virtual camera is arranged at the left-eye viewpoint position, and the first left-eye image is generated by pointing the line of sight of the virtual camera toward the object (gaze point). In addition, a virtual camera is arranged at the viewpoint position for the right eye, and the line of sight of the virtual camera is directed toward the object (gaze point) to generate a first right-eye image.

  Note that the image viewed from the virtual camera can be generated as follows. That is, first, geometry processing such as coordinate transformation, clipping processing, perspective transformation or light source processing is performed, and drawing data (position coordinates of vertices of a primitive surface, texture coordinates, color data, normal vectors, α value etc.). Then, based on the drawing data (primitive surface data), the object (one or more primitive surfaces) after the perspective transformation (after the geometry processing) is converted into image information in pixel units such as a drawing buffer 174 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. Thereby, an image viewed from the virtual camera in the object space is generated.

  The second image generating unit 122 performs a correction process on the first left-eye image to eliminate the perspective of the image on the reference plane, and generates a second left-eye image. In addition, the first right-eye image is subjected to a correction process for eliminating a perspective of the image on the reference plane, and a second right-eye image is generated (see FIGS. 1 and 8A).

  The correction process in this case is realized by the texture mapping unit 124 performing the texture mapping process described with reference to FIG. Specifically, the first left-eye image and the first right-eye image generated by the first image generation unit 120 are stored in the texture storage unit 176 as texture images. Then, the texture mapping unit 124 generates a second left-eye image by mapping the stored texture of the first left-eye image to a rectangular polygon. Also, the second right-eye image is generated by mapping the stored texture of the first right-eye image to a rectangular polygon.

  Further, the second image generation unit 122 may generate the left-eye image and the right-eye image based on the method described with reference to FIG. That is, the second image generation unit 122 generates the left-eye image by projecting and rendering each point of the object on the reference plane in the projection direction connecting the viewpoint position for the left eye and each point of the object. In addition, a right-eye image is generated by projecting and rendering each point of the object on the reference plane in a projection direction connecting the viewpoint position for the right eye and each point of the object.

  The stereoscopic image generation unit 126 performs a process of generating a stereoscopic image based on the second left-eye image (left-eye image) and the second right-eye image (right-eye image). For example, the second left-eye image (left-eye image) and the second right-eye image (right-eye image) are synthesized by anaglyph processing to generate a stereoscopic image, and output to the display unit 190. In this case, the player plays the game by wearing, for example, glasses with a red color filter and a blue color filter provided on the left and right eyes.

  Alternatively, the stereoscopic image generation unit 126 performs a process of outputting the second left-eye image (left-eye image) and the second right-eye image (right-eye image) to the display unit 190 in different frames, and performs stereoscopic vision. May be realized. In this case, the player plays the game wearing glasses with shutters whose shutters open and close in synchronization with the frame.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates a game sound such as BGM, sound effect, or voice, and outputs the generated game sound to the sound output unit 192.

  Note that the image generation system according to the present embodiment may be a system dedicated to the single player mode in which only one player can play, or a multi-player mode in which a plurality of players can play in addition to the single player mode. A system may also be provided.

  Further, when a plurality of players play, a game image or a game sound to be provided to the plurality of players may be generated using one terminal, or may be connected via a network (transmission line, communication line) or the like. It may be generated using a plurality of terminals (game machine, mobile phone).

9. Analysis of First and Second Stereoscopic Methods Next, the first and second stereoscopic methods of the present embodiment described with reference to FIGS. 1 and 13 are mathematically analyzed. In the first stereoscopic method, an image of a real-world object that cannot be directly projected (C1) onto a reference plane (desk) screen is obtained by photographing a camera (C2) (FIGS. 3 and 4). It is shown that the post-processing (C3; the processing for eliminating the perspective in FIG. 8A) with respect to can perform reconstruction in a range that does not hinder practical use. Therefore, a mathematical analysis is performed on the difference between the first stereoscopic vision system and the second stereoscopic vision system that directly projects an object point on a reference plane (desk) screen.

9.1 Mathematical analysis of first stereoscopic vision method First, a viewpoint (v), a camera screen (s), an object, and a coordinate system for them are determined as shown in FIG. In FIG. 22, a point (x, y, z) of an object is projected on a point (x ^* , y ^* ) on a screen (camera screen) by projection from a viewpoint.

  First, photographing (C2) by the camera can be represented by combining a matrix of rotation Rx of the following equation (1) and a matrix of projection Pz of the following equation (2).

  Here, the matrix of the rotation Rx is a matrix that rotates the oblique line of sight so as to be parallel to the Z-axis direction. The matrix of the projection Pz is a matrix representing the projection from the viewpoint (Z = v) to the camera screen (Z = s). Here, α is the angle between the line-of-sight direction and the reference plane screen.

  Therefore, photographing (C2) by the camera can be expressed as in the following equation (3).

  The above equation (3) can be expressed by a conversion equation such as the following equation (4).

For example, as shown in FIG. 23, four grid points G1 = ^t (a, a, 0) and G2 = ^t (−a, a, 0) forming a square on a reference plane (Z = 0) of a desk or the like. ), G3 = ^t (−a, −a, 0) and G4 = ^t (a, −a, 0). Note that “t” means transposition.

These grid points G1 to G4 are converted into grid points G1 ′ to G4 ′ as shown in FIG. 23 by the conversion of the above equations (3) and (4). The coordinates of these grid points G1 'to G4' are expressed as ^t (a, a, 0), (-a, a, 0), ^t (x, y, z) in the above equations (3) and (4). By substituting ^t (−a, −a, 0) and ^t (a, −a, 0), calculation is performed as in the following equations (5) to (8).

In the post-processing of the first stereoscopic method (C3: processing for eliminating perspective), these grid points G1 ′ to G4 ′ are converted into grid points F1 = ^t (b, b) constituting a two-dimensional square on the photograph, This is a projection transformation for mapping F2 = ^t (−b, b), F3 = ^t (−b, −b), and F4 = ^t (b, −b). That is, this is projection conversion in which the positions of the markers MK1 to MK4 (corresponding to G1 ′ to G4 ′) in FIG. 3 are mapped to the positions of the markers MK1 to MK4 (corresponding to F1 to F4) in FIG.

A matrix representing such a projection P1 can be obtained as in the following equation (9) by solving simultaneous equations for elements a ₁₁ , a ₁₂ , a ₁₃ ... A ₃₃ of the matrix.

  Therefore, the conversion of the first stereoscopic method, which is a combination of the photographing of the camera (C2) and the post-processing (C3), is a matrix of the rotation Rx of the above equation (1) and a matrix of the projection Pz of the above equation (2). And the matrix of the projection P1 in the above equation (9), and can be expressed as in the following equation (10).

  The above equation (10) can be expressed by a conversion equation such as the following equation (11).

  As described above, the first stereoscopic viewing method in FIG. 1 can be expressed by an equation such as the above equation (10) or the above equation (11).

9.2 Mathematical Analysis of Second Stereoscopic Method The conversion of the second stereoscopic method of FIG. 13 in which the points of the object are directly projected on the reference plane screen is represented by the following equation (12) from FIG. be able to.

  The above equation (12) can also be expressed by a conversion equation such as the following equation (13).

  The conversion of the second stereoscopic method expressed by the above equations (12) and (13) includes a translation Ty of the object OB (a translation of −vcos α in the y direction) as shown in FIG. The projection PZ of the object OB after the translation as shown in FIG. 25B and the translation Ty of the object OB after the projection as shown in FIG. 26 (translation of vcos α in the y direction) It is made up.

9.3 Comparison of First and Second Stereoscopic Methods As described above, mathematically, the conversion of the first stereoscopic method is represented by the following expression (14) or (15), The conversion of the stereoscopic method is expressed by the following expression (16) or (17).

  The differences between the above equations (14) and (16) are the terms indicated by J1 and the terms indicated by K1. In the above equations (15) and (17), this difference is the difference between the term indicated by J2 and the term indicated by K2.

  The differences will be described intuitively with reference to the drawings as follows. That is, as described above, the second stereoscopic viewing method is formed by the three conversions shown in FIGS. The first stereoscopic vision system differs from the second stereoscopic vision system in the amount of deviation in the first parallel movement in FIG. That is, in the first stereoscopic viewing method, this shift amount is zcotα (see J1 and J2 in the above equations (14) and (15)). On the other hand, in the second stereoscopic viewing method, the shift amount is vcosα (see K1 and K2 in the above equations (16) and (17)).

  As described above, in the second stereoscopic viewing method, the shift amount (vcosα) depends on the viewpoint (v) and the line-of-sight direction (α). On the other hand, in the first stereoscopic viewing method, the shift amount (zcotα) depends on the height (z) and the viewing direction (α), and does not depend on the viewpoint (v) itself. As shown in FIG. 27, the shift amount (zcotα) in the first stereoscopic method is a point at which a perpendicular drawn from the point (x, y, z) of the object intersects the reference plane (desk) screen. It is equal to the distance between N1 and a point N2 where the line extending from the point (x, y, z) of the object in the line of sight instead of the projection direction intersects the reference plane screen.

  As described above, in the first stereoscopic viewing method, the translation shift amount (zcotα) in FIG. 25A depends on the height (z). Therefore, according to the height (z) of the point (x, y, z) of the object, the appearance of stereoscopic vision in the first stereoscopic vision system and the appearance of stereoscopic vision in the second stereoscopic vision system In this respect, the first and second stereoscopic viewing methods are different.

  The present invention is not limited to the embodiments described above, and various modifications can be made.

  For example, a term (object / subject, polygon, etc.) cited as a broad term (object, primitive surface, etc.) in the description in the specification or drawing is a broad term in other descriptions in the specification or drawing. Can be replaced.

  Further, the creation (generation) method of the left-eye image, the right-eye image, and the stereoscopic image is not limited to the method described in the present embodiment, and various modifications can be made.

  Further, the stereoscopic image created (generated) by the method of the present invention can be used for purposes other than a stereoscopic printed matter and a game image.

  Further, a case where a stereoscopic image is generated by a method equivalent to the first and second methods described in the present embodiment is also included in the scope of the present invention.

  Further, in the invention according to the dependent claims of the present invention, a configuration in which some of the constituent elements of the dependent claims are omitted may be adopted. In addition, a main part of the invention according to one independent claim of the present invention can be made dependent on another independent claim.

  Further, the present invention can be applied to various games (fighting games, competition games, shooting games, robot battle games, sports games, role playing games, etc.).

  The present invention is also applied to various image generation systems (game systems) such as arcade game systems, home game systems, large attraction systems in which many players participate, simulators, multimedia terminals, and system boards for generating game images. Applicable.

4 is a flowchart of a first stereoscopic viewing method according to the embodiment. FIG. 3 is an explanatory diagram of a first stereoscopic viewing method of the present embodiment. It is an example of the left eye image IL1. It is an example of a right eye image IR1. It is an example of the left eye image IL2. It is an example of a right eye image IR2. It is an example of a stereoscopic image (anaglyph image). FIGS. 8A, 8B, and 8C are explanatory diagrams of a correction process for eliminating a perspective. FIG. 4 is an explanatory diagram of features of a stereoscopic image obtained by the embodiment. FIG. 4 is an explanatory diagram of a method of providing a plurality of reference planes. 9 is a flowchart of a method for providing a plurality of reference planes. FIG. 4 is an explanatory diagram of a method of providing a plurality of reference planes. FIG. 4 is an explanatory diagram of a second stereoscopic viewing method of the present embodiment. FIGS. 14A, 14B, and 14C are explanatory diagrams of the second stereoscopic viewing method. FIGS. 15A and 15B are explanatory diagrams of a conventional system. FIG. 5 is an explanatory diagram of a setting method of a viewpoint position. FIG. 4 is an explanatory diagram of a method for creating a stereoscopic print using a real image. FIG. 4 is an explanatory diagram of a method for creating a stereoscopic print using a real image. FIGS. 19A and 19B are illustrations of a method for creating a stereoscopic print using a CG image. FIG. 4 is an explanatory diagram of a correction process using texture mapping. 1 is a configuration example of an image generation system. It is an explanatory view about a coordinate system. It is explanatory drawing about conversion from G1-G4 to G1'-G4 ', and conversion from G1'-G4' to F1-F4. It is a figure for deriving the conversion formula of the 2nd stereoscopic vision system. FIGS. 25A and 25B are explanatory diagrams of conversions constituting the second stereoscopic viewing method. It is explanatory drawing of the conversion which comprises a 2nd stereoscopic vision system. FIG. 9 is an explanatory diagram of a shift amount in conversion of the first stereoscopic method.

Explanation of reference numerals

VPL left eye viewpoint position, VPR right eye viewpoint position,
OB object (object, subject), BS (BS1, BS2) Reference plane,
RTG rectangle, MK1-MK4 mark, MK5-MK8 mark,
IL1 first left-eye image, IR1 first right-eye image,
IL2 second left-eye image, IR2 second right-eye image,
IL image for left eye, IR image for right eye,
100 processing unit, 110 game processing unit, 120 first image generation unit,
122 second image generation unit, 124 texture mapping unit 126 stereoscopic image generation unit, 130 sound generation unit, 160 operation unit,
170 storage unit, 172 main storage unit, 174 drawing buffer,
176 texture storage unit, 180 information storage medium, 190 display unit 192 sound output unit, 194 portable information storage device, 196 communication unit

Claims (11)

A method for producing a stereoscopic printed matter,
Placing an object on a reference plane that is oblique to the line of sight to create a first left-eye image for stereoscopic vision and a first right-eye image for stereoscopic vision;
A first left-eye image is subjected to a correction process for eliminating a perspective at least in a depth direction of the image on the reference plane of the first left-eye image to create a second left-eye image,
A first right-eye image is subjected to a correction process for eliminating a perspective in at least a depth direction of the image on the reference plane of the first right-eye image to create a second right-eye image,
A method for producing a stereoscopic print, comprising creating a stereoscopic print based on a second left-eye image and a second right-eye image. In claim 1,
The reference plane includes a first reference plane and a second reference plane that forms a predetermined angle with the first reference plane,
The first correction processing for the left eye for eliminating the perspective of the image on the first reference plane of the first left-eye image is performed on an area corresponding to the first reference plane of the first left-eye image. A second correction process for the left eye for eliminating the perspective of the image on the second reference plane of the first left-eye image is performed in an area corresponding to the second reference plane of the first left-eye image. To create a second left-eye image,
The first correction processing for the right eye for eliminating the perspective of the image on the first reference plane of the first right-eye image is performed on an area corresponding to the first reference plane of the first right-eye image. A second correction process for the right eye for eliminating the perspective of the image on the second reference plane of the first right-eye image is performed in an area corresponding to the second reference plane of the first right-eye image. And producing a second right-eye image. A method for producing a stereoscopic printed matter,
The first and fourth marks, which form rectangles on the reference plane that is oblique to the line of sight , are photographed from the viewpoint position for the left eye, so that the first left-eye image for stereoscopic viewing is obtained. make,
By photographing a subject and first to fourth marks that form rectangles on a reference plane that is oblique to the line of sight from the viewpoint position for the right eye, the first right-eye image for stereoscopic viewing is obtained. make,
By performing a correction process of moving the first to fourth marks having a perspective at least in the depth direction in the first left-eye image to the vertex positions of the rectangle, the first left-eye image is converted to the second left-eye image. To create
The first right-eye image is corrected from the first right-eye image to the second right-eye image by performing a correction process of moving the first to fourth marks having a perspective at least in the depth direction to a vertex position of a rectangle. To create
A method for producing a stereoscopic print, comprising creating a stereoscopic print based on a second left-eye image and a second right-eye image. In claim 3,
The reference plane includes a first reference plane and a second reference plane that forms a predetermined angle with the first reference plane,
By photographing the subject, the first to fourth marks forming a rectangle on the first reference plane, and the fifth to eighth marks forming a rectangle on the second reference plane from the viewpoint position for the left eye. Creates a first left eye image for stereoscopic viewing,
By photographing the subject, the first to fourth marks forming a rectangle on the first reference plane, and the fifth to eighth marks forming a rectangle on the second reference plane from the viewpoint position for the right eye. Creates a first right eye image for stereoscopic viewing,
First correction processing for the left eye that moves the first to fourth marks of the first left-eye image to the vertices of the rectangle is performed, and the fifth to eighth marks of the first left-eye image are displayed. By performing a second correction process for the left eye that moves to the vertex position of the rectangle, a second left eye image is created from the first left eye image,
A first correction process for the right eye that moves the first to fourth marks of the first right-eye image to the vertex position of the rectangle is performed, and the fifth to eighth marks of the first right-eye image are changed. Producing a second right-eye image from the first right-eye image by performing a second correction process for the right eye that moves to the vertex position of the rectangle. A method for producing a stereoscopic printed matter,
Creating a first left-eye image for stereoscopic viewing,
Creating a first right eye image for stereoscopic viewing,
The first correction processing for the left eye for eliminating the perspective of the image on the first reference plane of the first left-eye image is performed on an area corresponding to the first reference plane of the first left-eye image. And a second correction process for the left eye for eliminating the perspective of the image of the first left-eye image on the second reference plane forming a predetermined angle with respect to the first reference plane. A second left-eye image is created by applying to the region corresponding to the second reference plane of the left-eye image,
The first correction processing for the right eye for eliminating the perspective of the image on the first reference plane of the first right-eye image is performed on an area corresponding to the first reference plane of the first right-eye image. A second correction process for the right eye for eliminating the perspective of the image on the second reference plane of the first right-eye image is performed in an area corresponding to the second reference plane of the first right-eye image. To create a second right-eye image ,
A method for producing a stereoscopic print, comprising creating a stereoscopic print based on a second left-eye image and a second right-eye image. A method for producing a stereoscopic printed matter,
A subject, first to fourth marks forming a rectangle on a first reference plane, and fifth to eighth forming a rectangle on a second reference plane at a predetermined angle with respect to the first reference plane. By photographing the mark from the viewpoint position for the left eye, a first left-eye image for stereoscopic vision is created,
By photographing the subject, the first to fourth marks forming a rectangle on the first reference plane, and the fifth to eighth marks forming a rectangle on the second reference plane from the viewpoint position for the right eye. Creates a first right eye image for stereoscopic viewing,
First correction processing for the left eye that moves the first to fourth marks of the first left-eye image to the vertices of the rectangle is performed, and the fifth to eighth marks of the first left-eye image are displayed. By performing a second correction process for the left eye that moves to the vertex position of the rectangle, a second left eye image is created from the first left eye image,
A first correction process for the right eye that moves the first to fourth marks of the first right-eye image to the vertex position of the rectangle is performed, and the fifth to eighth marks of the first right-eye image are changed. By performing a second correction process for the right eye that moves to the vertex position of the rectangle, a second right eye image is created from the first right eye image,
A method for producing a stereoscopic print, comprising creating a stereoscopic print based on a second left-eye image and a second right-eye image. In any one of claims 1 to 6,
A first left-eye image is created by photographing the subject from the left-eye viewpoint position,
The first right-eye image is created by photographing the subject from the right-eye viewpoint position,
When the distance between the subject and the viewpoint position is increased, the distance between the left-eye viewpoint position and the right-eye viewpoint position is increased according to a change in the length. Production method. In any one of claims 1 to 7,
A first left-eye image is created by photographing the subject from the left-eye viewpoint position,
The first right-eye image is created by photographing the subject from the right-eye viewpoint position,
A method of manufacturing a stereoscopic print, comprising: moving a viewpoint position along a straight line that forms a predetermined angle with respect to a reference plane when changing a distance between a subject and a viewpoint position. In any one of claims 1 to 8,
A method for producing a stereoscopic printed matter, comprising creating a stereoscopic printed matter by synthesizing a second left-eye image and a second right-eye image by anaglyph processing.   A stereoscopic printed matter produced by the manufacturing method according to claim 1. A stereoscopic printed matter created by duplicating the stereoscopic printed matter created by the manufacturing method according to claim 1.