JP2008276036A - Method of forming stereo images for phantogram - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method of simply forming stereo images to use in a phantogram from the images taken by using a general stereo camera. <P>SOLUTION: First, the right and left images are moved to overlap the extreme front images on the reference plane (lower on the screen) and their lateral moving amount Sp is obtained. The two images are further moved to overlap the rear images on the reference plane (upper on the screen), and their moving amount d from the overlapped position of the front images is calculated. Those images are expanded in the horizontal direction from the center lines with an inclined magnification proportional to 1/(1-y*d/HSp), (H: image height, y: height with the lower side as 0) respectively. Further in the vertical direction, they are expanded according to the inclining angle and also expanded proportionally to the horizontal magnification to form stereo images for the phantogram. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a method of creating a pair of stereo images for use in a so-called phantom, in which a display image is horizontal and a stereoscopic image is observed by perspective.

  In a stereo photograph that realizes stereoscopic viewing by showing images taken from different viewpoints on the left and right eyes, a horizontal display surface is observed from an oblique direction, and a realistic stereoscopic image is displayed as if the subject is present there. A special type to be provided is disclosed in US Pat. This type of stereophoto is called a phantomgram and is often provided as an anaglyph, but there are very few examples of actual distribution in printed materials and the like, and in general, it is not widely used.

  First, an outline of a phantomgram will be described with reference to FIG. On the phantomgram 1 made as a printed matter, an image 2L for the left eye and an image 2R for the right eye are printed in two different independent colors such as red-cyan. When this is placed on a horizontal surface and observed from diagonally above through glasses 3 each having a filter of a corresponding color as a lens, a stereoscopic image 4 that looks as if something exists is seen.

  Features that distinguish phantoms from general anaglyphs (stereophotos) are based on the premise of observing with an oblique line of sight, and the surface (distance) of the display surface when viewed stereoscopically is the surface on which the subject is placed (Hereinafter referred to as the reference plane). In this example, it is assumed that the subject is above the reference plane. However, even if there is a dent on the reference plane, or the reference plane is the glass surface of the showcase, The description of applies similarly.

  Next, a general photographing method for photographs used for the phantom will be described with reference to FIG. A subject 6 is placed on a reference surface 5 corresponding to the display surface, and is photographed from above by two cameras 7 placed at positions corresponding to both eyes. If the subject is a stationary object, one camera may be moved sideways and taken twice.

  It is different if you shoot with a special camera dedicated to phantoms that can be shot, but the photo taken with a normal camera has the shooting surface perpendicular to the optical axis, so the photo taken with the method of Fig. 2 as it is An anaglyph is not a phantomgram. Therefore, as shown in FIG. 3, coordinate conversion is performed in the form of projecting the photographed image 8 onto a plane parallel to the reference plane to create a phantom image 10. At this time, the point 9 has no perspective on the reference plane. In addition, the position of the reference plane must be selected separately so that the left and right images have the same reference plane image.

  In order to perform this work, information such as the angle of view of the photographed image, the distance S between the two cameras, and the angle of photographing α is required, but such information is obtained with sufficient accuracy and is practically accurate. Therefore, it is not easy to transform the image (coordinate conversion). Therefore, conventionally, a method of performing perspective deformation so that a lattice pattern or a rectangle, which is a reference for deformation (coordinate conversion), is drawn in advance on a reference plane at the time of shooting and then restored to its original shape has been widely used. .

One of the causes that hinders the spread of phantomgrams is that it is more complicated and difficult to create than ordinary stereo photographs. A method for creating a phantom is also described in Patent Document 1, but a stereo photograph taken by a normal method is created by deforming it by geometric projection (may be called perspective transformation). . Such deformation is performed on the PC using digital image data, and the calculation itself is not difficult. However, in the phantom, the perspective plane is set so that the reference plane included in the subject matches the display plane. In addition, it is necessary to remove an inclination of a large magnification and to overlap the left and right reference plane images on the display surface without deviation, and adjustment to satisfy this condition is not easy. Actually, a grid-like reference line or rectangular frame was drawn on the reference plane to be photographed, and adjustment work was performed using this.
US 6,389,236

    An object of the present invention is to provide a procedure for easily creating an image for a phantom, and at the same time to provide a method for making a phantom even for a general subject without a reference line or a rectangular frame. is there.

  Claim 1 of the present invention aims at stereoscopic viewing from two images obtained by photographing an object including a reference plane obliquely from above with two cameras having the same angle of view and arranged in parallel at a predetermined interval with the optical axes in parallel. Create a pair of images. First, the two images are shifted and overlapped so that the images closest to the reference plane (bottom of the screen) coincide with each other. At this time, the shifted lateral amount Sp is obtained. The two images are shifted until the images match to determine the amount of movement d from the position where the previous images match, and both images are 1 / (1-y · d / HSp) from the center line in the horizontal direction. , (H: vertical width of the image, y: height where the lower side is 0) is enlarged with an inclination, and in addition to the enlargement attributed to the angle between the reference plane and the shooting plane in the vertical direction In this method, the left and right images are created by performing enlargement in proportion to the magnification in the horizontal direction.

  Claim 2 of the present invention aims at stereoscopic viewing from two images obtained by photographing a subject including a reference plane obliquely from above with two cameras having the same angle of view and arranged in parallel with a predetermined interval between the optical axes. Create a pair of images. First, the two images are shifted and overlapped so that the images closest to the reference plane (bottom of the screen) coincide with each other. At this time, the shifted lateral amount Sp is obtained, and the lower side is fixed to fix at least one of the images. When the shear deformation that moves the upper side horizontally is performed and the images up to the back of the reference plane (upper screen) match, the relative shear amount d on the upper side is obtained, and both images are moved laterally from the respective center lines. 1 / (1-y · d / HSp), (H: vertical width of the image, y: height with the lower side being 0) This is a method for creating a stereo image for a phantogram, characterized in that, in addition to enlargement caused by the angle formed by the planes, enlargement proportional to the lateral magnification is performed to create left and right images.

  Claim 3 of the present invention aims at stereoscopic viewing from two images obtained by photographing an object including a reference plane from obliquely above with two cameras having the same angle of view and arranged in parallel with a predetermined distance between the optical axes. Create a pair of images. First, the two images are shifted and overlapped so that the images closest to the reference plane (bottom of the screen) coincide with each other, the shifted lateral amount Sp is obtained at this time, and further, both images are adjusted while adjusting the value of d. From each center line, the image is enlarged with an inclination at a magnification proportional to 1 / (1-y · d / HSp), where H is the vertical width of the image, and y is the height where the lower side is 0, The images up to the back of the reference plane (on the screen) are matched, and in addition to the enlargement attributed to the angle between the reference plane and the shooting plane in the vertical direction, the image is enlarged in proportion to the magnification in the horizontal direction. This is a method of creating a stereo image for a phantogram characterized by creating an image.

  Claim 4 of the present invention aims at stereoscopic viewing from two images obtained by photographing an object including a reference plane from diagonally above with two cameras having the same angle of view and arranged in parallel with a predetermined distance between the optical axes. Create a pair of images. In advance, the subject includes figures with equal widths placed at different distances in a plane parallel to the reference plane, and measures two widths L1, L2 and heights y1, y2 on the image. Shift the two images so that the image closest to the reference plane (bottom of the screen) matches, and then shift the two images until the images behind the reference plane (top of the screen) match. Then, the movement amount d from the position where the front image coincides is obtained, and the distance of Sp = (L1y2-L2y1) d / (L1H-L2H), where H is the vertical width of the image at the coordinates where the front image coincides. The left image is proportional to 1 / (1−y · d / HSp), (y: height with the lower side being 0) from the center line shifted to the left and the right image to the right. In addition to enlargement due to the angle between the reference plane and the shooting plane, the horizontal direction This is a method for creating a phantomogram stereo image, wherein left and right images are created by performing enlargement in proportion to the magnification.

  Claim 5 of the present invention aims at stereoscopic viewing from two images obtained by photographing a subject including a reference plane obliquely from above with two cameras having the same angle of view and arranged in parallel with a predetermined interval between the optical axes. Create a pair of images. In advance, the subject includes figures with equal widths placed at different distances in a plane parallel to the reference plane, and measures two widths L1, L2 and heights y1, y2 on the image. Shift the two images so that the image closest to the reference plane (bottom of the screen) matches, and then fix the lower side and perform shear deformation to move the upper side of at least one of the images sideways. The relative shearing amount d on the upper side when the images up to the back of the image (upper screen) match is obtained, and Sp = (L1y2-L2y1) d / (L1H-L2H) , (H: vertical width of the image), the left image is shifted to the left, and the right image is shifted to the right from the respective center lines, 1 / (1-y · d / HSp), (y : Enlarged with an inclination at a magnification proportional to the height of the lower side (0), and taken with the reference plane above and below This is a method for creating a stereo image for a phantogram, characterized in that, in addition to enlargement caused by the angle formed by the planes, enlargement proportional to the lateral magnification is performed to create left and right images.

  According to the present invention, from two pieces of image data obtained by photographing a subject including a reference plane from obliquely above with two cameras having the same angle of view and arranged in parallel at a predetermined interval in parallel with an optical axis, according to a predetermined procedure. Stereo images for phantomgrams can be created easily. At this time, since the reference plane does not require a reference grid or frame, it is not necessary to prepare a subject that satisfies special conditions for photographing, and it is possible to freely select and photograph the subject.

  In addition to being used as an anaglyph material, the stereo image created by the method of the present invention can also be used as a material for a display method using a polarizing projector and polarized glasses, a display method using a lenticular lens, and a parallax barrier. .

  In the present invention, as shown in FIG. 2, a photograph taken by two cameras 7 at a position shifted laterally by a distance S with the optical axes in parallel is used as image data, which is processed on a PC. To create a stereo image for the phantomgram. Although it is desirable that the two cameras 7 are basically the same, they can be regarded as substantially the same if the angle of view and the magnification are equal. Further, as described above, when the subject is a stationary object, the camera may be moved twice to take a picture twice. The distance S is generally called a stereo base.

  The target function of the present invention will be described with reference to FIG. Although the photographed images of the camera 7 are shown in the figure as L0 and R0, in order to make the explanation easy to understand, a lattice pattern with an interval S is drawn on the reference plane on which the subject is placed with lines parallel to and perpendicular to the photographing surface. It was assumed that This lattice pattern is drawn for explanation only, and is unnecessary in actual work. L1 and R1 are obtained by performing the coordinate transformation shown in FIG. 3 according to the procedure of the present invention based on these photographed images. In L1 and R1, since the figure existing on the plane parallel to the reference plane is displayed without distortion, the grid pattern on the display plane is a square grid intersecting at right angles. Note that both images are laterally shifted by a distance S. Further, L1 and R1 are superimposed as images of different colors, and an anaglyph A is created as a phantomgram.

  First, a procedure for creating a stereo image for a phantom according to claim 1 of the present invention will be described. In FIG. 5, the reference planes of the captured images L0 and R0 are represented by only a lattice, and the portion that finally becomes a phantomgram is displayed by a dotted line. When these two images are overlapped on the PC and the front (bottom) of the image on the reference plane is aligned, they are overlapped by being shifted by a length Sp corresponding to the lattice spacing S as shown in S1. Even if the front (bottom) of the left and right images are combined, the two images are shifted toward the back (upper) of the image. Here, the two images L0 and R0 are centered on the centerlines 11L and 11R, respectively. If the image is enlarged to the left and right at a tilted magnification so that the vertical grid lines are parallel, the two images will coincide and the dotted area will be rectangular.

  The region sandwiched between 11L and 11R of S1 is shown enlarged in FIG. 6, but it is enlarged at a magnification with a slope of Sp / (Sp-d) at the uppermost side which is the farthest from this figure and 1 at the lower side. I understand that When this is expressed as a function of height y with the lower side being 0, 1 / (1-y · d / HSp) is obtained. Furthermore, it can be seen from the state of the figure that when the left image is shifted to the left and the right image is shifted to the right by d, both images coincide with each other on the upper side.

  If the horizontal enlargement magnification is obtained as a function of y, the image is enlarged in the vertical direction at a magnification proportional thereto. However, for the vertical enlargement, an angle α (FIG. 3) formed with the viewpoint must be added. Summarizing these results, the coordinates (x, y) of the original image 8 (L0, R0) and the coordinates (x ′, y ′) of the projection image (L1, R1) to be created are taken as shown in FIG. Is expressed in the form of obtaining x and y from x ′ and y ′.

  That is, as long as the angle α is known, it can be understood that Sp and d can be obtained by using the original images L0 and R0 to perform coordinate conversion. Furthermore, if the angle α is measured in advance or adjusted so as not to become unnatural while observing the converted image, all the conditions necessary for creating the projection images L1 and R1 can be met.

  The actual procedure is to first obtain the Sp by superimposing the original images L0 and R0 so that the lower side images match as shown in S1 of FIG. 5, and then shift to the position where the upper side images match as shown in S2 and shift S1. The deviation d from is obtained. After that, use the measured angle α, deform L0 and R0 according to the formula (1), or if you don't know α, try transforming it using an appropriate value (for example, α = 45 degrees) What is necessary is just to adjust the value of (alpha) so that it may not feel unnatural while seeing the result.

If there is a reference figure in the subject, it is possible to determine α using that figure. FIG. 10 shows a case where a cylinder like a can is on the subject. When the value of α is not correct, the aspect ratio is not correct like N. At this time, if there is a square lattice pattern on the reference surface, α may be adjusted so that the square of the lattice is correctly displayed as in M, but even if there is no reference lattice as in n, the surface of the subject is adjusted. If is used to be a true circle, the correct result can be obtained as in m. Specifically, if the horizontal width a and the vertical width b of the circle are measured on the image n and α _old is changed to α _new using the equation (2), the image m becomes a = b.

  The operations described above can be performed on a PC by a program created for this purpose. Since it is not difficult to move, transform, and superimpose images on a personal PC that is currently in general circulation, virtually any person can easily create a phantomgram according to the present invention.

  Next, claim 2 of the present invention will be described with reference to FIG. First, L0 and R0 are overlapped to determine Sp so that the lower side reference plane images coincide with each other. Next, the lower side of both images is fixed, and the upper side is shifted in the horizontal direction to perform shear deformation so that the reference plane image up to the upper side is obtained. Make sure they match. At this time, both images may be deformed and combined in opposite directions as in A, or only one image may be deformed while leaving one as it is as in B. D is obtained as (total in case of A). After that, L0 and R0 may be modified by the formula 1 as in the first aspect. The only difference from claim 1 is how to obtain d, but S2 in FIG. 5 matches the reference plane image only on the upper side, whereas in FIGS. 8A and 8B, it matches on the entire surface from the lower side to the upper side. Therefore, the visibility is good and the work becomes easier.

  Further, claim 3 of the present invention will be described with reference to FIG. The process up to the point where Sp is obtained by superimposing L0 and R0 is the same, but both images are enlarged at the position with a magnification of 1 / (1-y · d / HSp) in the horizontal direction with reference to the center line of each image. . As a result, both images have a trapezoidal shape with a long upper side as in C. However, by adjusting d in the expression 1 / (1-y · d / HSp) that gives a magnification, the reference plane images coincide on the entire surface from the lower side to the upper side. Can be layered like Using the value of d at this time, L0 and R0 can be transformed by the formula 1 as in the first aspect. Even when d is obtained by this method, the reference plane images coincide with each other as in the second aspect.

  As apparent from the above description, the method of claims 1 to 3 needs to correctly determine the displacement Sp when the left and right images are superimposed. There is no problem if a digital camera is used as the camera 7 to shoot, but in the case of a photograph printed on a DPE using a film camera, the frame is usually trimmed appropriately, and the position may vary. Even if Sp is obtained from such a trimmed photograph, a correct value cannot be obtained. Thus, when Sp is not obtained from the frame of the original image, claims 4 and 5 are intended to obtain information that changes from the subject. These will be described with reference to FIG.

  In claims 4 and 5, an object having the same width in a plane parallel to the reference plane is placed in advance at different distances so as to enter the photographing frame. For example, a strip-shaped subject 12 having parallel sides or subjects 13 and 14 having the same shape. It is known that the magnification of the lateral image is 1 / (1-y · d / HSp), and d can be obtained by the method of claim 1 or claim 2, so that the widths are equal. Sp can be obtained from Sp = (L1y2−L2y1) d / (L1H−L2H) by measuring the heights y1 and y2 of the known portion and the widths L1 and L2 on the image (13, 14). Sp = (L3y4-L4y3) d / (L3H-L4H)). After that, each center line is determined at a position separated by Sp on the left and right, and the origin (x = 0) is used as the origin (x = 0) to perform coordinate transformation expressed by the equation (1).

  Since the exact position cannot be determined only by the center line spacing Sp, in practice, a deformed image is first created with the center line at a position separated by Sp / 2 from the center of the overlapping part of the left and right images. If it is unnatural, it can be redrawn and adjusted while moving the position of the center line.

  In the methods according to claims 4 and 5, the subject to be used as a reference for the enlargement magnification must be included in the image, so the degree of freedom of subject selection is inferior to that of the methods according to claims 1 to 3, but still a square lattice or Compared to the conventional method that requires a rectangular frame, the degree of freedom is high and the range of expression is widened.

  The present invention can be used to create an anaglyph as a printed matter, and also creates the necessary left and right images in stereoscopic display using polarized light and stereoscopic display using a lenticular lens and a parallax barrier. Can be used for. The present invention can be commercialized as image processing software that can be used on a general PC.

It looks like observing a phantomgram. It is a state of taking an original image for creating a phantomgram. It is a figure which shows producing the image for phantograms by projecting the image | photographed original image. It is a figure which shows the procedure which produces a phantomgram from an original image. It is a figure explaining the procedure of Claim 1. It is a figure explaining the principle of this invention, and is the elements on larger scale of FIG. It is a figure explaining the coordinate system of an original image and a creation image. It is a figure explaining the procedure of Claim 2. It is a figure explaining the procedure of Claim 3. It is a figure explaining the method to adjust angle (alpha). It is a figure explaining the procedure of Claim 4 and Claim 5.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Phantomgram 2L, 2R ... Left-right image 3 drawn with different colors ...... Glasses 4 for anaglyph observation ... Three-dimensional image 5 ... Reference plane 6 on which subject is placed ... Subject 7 ... Camera 8 ... Original image 9 ... Projection center 10 ... Projection (deformation) images 11L, 11R ... Original image center line 12 ... Band-like subject 13 having a constant width, 14 ・ ・ ・ Subjects with equal width

Claims (5)

A pair of images for the purpose of stereoscopic viewing is created from two images obtained by photographing an object including a reference plane obliquely from above with two cameras having the same angle of view and arranged in parallel with a predetermined distance between the optical axes. With things. First, the two images are shifted and overlapped so that the images closest to the reference plane (bottom of the screen) coincide with each other. At this time, the shifted lateral amount Sp is obtained. The two images are shifted until the images match to determine the amount of movement d from the position where the previous images match, and both images are 1 / (1-y · d / HSp) from the center line in the horizontal direction. , (H: vertical width of the image, y: height where the lower side is 0) is enlarged with an inclination, and in addition to the enlargement attributed to the angle between the reference plane and the shooting plane in the vertical direction A method for creating a stereo image for a phantogram, wherein left and right images are created by performing enlargement in proportion to the magnification in the horizontal direction. A pair of images for the purpose of stereoscopic viewing is created from two images obtained by photographing an object including a reference plane obliquely from above with two cameras having the same angle of view and arranged in parallel with a predetermined distance between the optical axes. With things. First, the two images are shifted and overlapped so that the images closest to the reference plane (bottom of the screen) coincide with each other. At this time, the shifted lateral amount Sp is obtained, and the lower side is fixed to fix at least one of the images. When the shear deformation that moves the upper side horizontally is performed and the images up to the back of the reference plane (upper screen) match, the relative shear amount d on the upper side is obtained, and both images are moved laterally from the respective center lines. 1 / (1-y · d / HSp), (H: vertical width of the image, y: height with the lower side being 0) A method for creating a stereo image for a phantogram, wherein left and right images are created by performing enlargement in proportion to a lateral magnification in addition to enlargement caused by an angle formed by a plane. A pair of images for the purpose of stereoscopic viewing is created from two images obtained by photographing an object including a reference plane obliquely from above with two cameras having the same angle of view and arranged in parallel with a predetermined distance between the optical axes. With things. First, the two images are shifted and overlapped so that the images closest to the reference plane (bottom of the screen) coincide with each other. At this time, the shifted lateral amount Sp is obtained, and both images are adjusted while adjusting the value of d. From each center line, the image is enlarged with an inclination at a magnification proportional to 1 / (1-y · d / HSp), where H is the vertical width of the image, and y is the height where the lower side is 0, The images up to the back of the reference plane (on the screen) are matched, and in addition to the enlargement attributed to the angle between the reference plane and the shooting plane in the vertical direction, the image is enlarged in proportion to the magnification in the horizontal direction. A method for creating a stereo image for a phantom, characterized by creating an image. A pair of images for the purpose of stereoscopic viewing is created from two images obtained by photographing an object including a reference plane obliquely from above with two cameras having the same angle of view and arranged in parallel with a predetermined distance between the optical axes. With things. In advance, the subject includes figures with equal widths placed at different distances in a plane parallel to the reference plane, and measures two widths L1, L2 and heights y1, y2 on the image. Shift the two images so that the images closest to the reference plane (bottom of the screen) match, and then shift the two images until the images behind the reference plane (top of the screen) match. Then, the movement amount d from the position where the front image coincides is obtained, and the distance of Sp = (L1y2-L2y1) d / (L1H-L2H), where H is the vertical width of the image at the coordinates where the front image coincides. The left image is proportional to 1 / (1−y · d / HSp), (y: height with the lower side being 0) from the center line shifted to the left and the right image to the right. In addition to enlargement due to the angle between the reference plane and the shooting plane, the horizontal direction A method for creating a stereo image for a phantogram, wherein left and right images are created by performing enlargement in proportion to magnification. A pair of images for the purpose of stereoscopic viewing is created from two images obtained by photographing an object including a reference plane obliquely from above with two cameras having the same angle of view and arranged in parallel with a predetermined distance between the optical axes. With things. In advance, the subject includes figures with equal widths placed at different distances in a plane parallel to the reference plane, and measures two widths L1, L2 and heights y1, y2 on the image. Shift the two images so that the images closest to the reference plane (bottom of the screen) are aligned with each other, then fix the lower side and perform shear deformation to move the upper side of at least one of the images sideways. The relative shearing amount d on the upper side when the images up to the back of the image (upper screen) match is obtained, and Sp = (L1y2-L2y1) d / (L1H-L2H) , (H: vertical width of the image), the left image is shifted to the left, and the right image is shifted to the right from the respective center lines, 1 / (1-y · d / HSp), (y : Enlarged with an inclination at a magnification proportional to the height of the lower side (0), and taken with the reference plane above and below A method for creating a stereo image for a phantogram, wherein left and right images are created by performing enlargement in proportion to a lateral magnification in addition to enlargement caused by an angle formed by a plane.

Images