JP2005157910A - Pseudo three-dimensional image creating device for imparting pseudo depth to image having discrete depth, and method and program for creating pseudo three-dimensional image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To impart a relief-like depth to an image having a discrete depth. <P>SOLUTION: A pseudo three-dimensional image creating device imparts a pseudo depth to the image having a discrete depth. The device consists of an object creating means creating an object by connecting adjacent pixels which are included in the image and whose discrete depths are equal and unifying the adjacent created objects when they exist, a depth imparting method deciding means for drawing segments on the created integrated object and a pseudo depth operating means for imparting continuous and a smooth depth on the pixel on the segments drawn densely by defining a depth function on the segments drawn densely. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a pseudo three-dimensional image generation device, a generation method, a generation program, and a recording medium on which the program is recorded. More specifically, a pseudo three-dimensional image generation device, a pseudo three-dimensional image generation method, a pseudo three-dimensional image generation program, and a program for providing a continuous and smooth depth to an image having a discrete depth are recorded. The recording medium.

  With the development of image processing technology, three-dimensional image input technology has been actively studied. As a method for inputting a 3D image, there are various methods such as a stereo method and a light cutting method as a method for inputting a 3D image to be photographed. However, both methods have a problem that the input device is expensive and large.

  On the other hand, a method for inputting an image having a discrete depth relatively easily has been proposed. For example, an image shot with the flash fired and an image shot without the flash are compared to determine the rate of change in luminance of the shooting target. If the rate of change is equal to or greater than a predetermined threshold, the shooting target is near. If the rate of change is smaller than a threshold value, it is possible to determine a relatively but discrete depth by determining that the distance is far.

  When an image having a discrete depth is displayed on the three-dimensional image display device in this way, since the change in the depth of the subject to be photographed is discrete, a so-called book breaking phenomenon occurs, giving the viewer an unnatural impression. There is a problem of end. In order to solve this problem, it is only necessary to provide a continuous and smooth depth to an image having a discrete depth.

  A method for providing a relief-like depth to an image having a discrete depth has been proposed.

  For example, a relief pattern using a binary image composed of a background portion and a pattern portion as a motif can be created using a computer. A binary image serving as a motif is prepared in the computer as raster data or contour data. A plurality of reference lines are defined on the binary image, and lines are created based on the reference lines. The line is created so as to bend at the boundary line between the background portion and the pattern portion of the binary image as a motif. If the relief pattern is formed by this line, the original motif appears to be visually raised (see, for example, Patent Document 1).

  In addition, a relief pattern using a gradation image composed of a plurality of pixels as a motif can be created using a computer. A gradation image as a motif is prepared in a computer as pixel array data in which density values are defined. A binary image is created based on the gradation image, and a contour line included in the image can be extracted based on the binary image. In addition, a plurality of reference lines are defined on the gradation image, and all lines are created based on the reference lines. The created line is a curved line corresponding to the density value of the pixel in the pattern portion included in the gradation image as the motif. If the relief pattern is formed by this line, the original motif appears to be visually raised (see, for example, Patent Document 2).

  In addition, a method has been proposed that can easily create a relief pattern having a smooth three-dimensional effect using a line drawing as a motif. In this method, a line drawing as a motif is prepared in a computer as digital data. On this line drawing, a plurality of reference lines are defined, and lines are created based on the reference lines. A line is created so that it bends in the vicinity where it intersects with a line drawing as a motif. If the relief pattern is made up of these lines, the original motif appears to be visually raised. In addition, when the line drawing used as a motif has a pattern of multiple lines that intersect each other, a process that combines the bending state of all the lines for each line is performed near the intersection of each line, so a relief with a three-dimensional effect A pattern can be created (see, for example, Patent Documents 3, 4, and 5).

In addition, a method has been proposed in which an arbitrary area of a photograph is designated and the designated area is cut out to make a book-like accessory. In this method, a photographic sheet having a desired extracted region image extracted from the original photographic image of the original photographic sheet is cut out from the original photographic sheet to create a cut-out photographic sheet. The cut-out photographic sheet is disposed in front of the original photographic sheet, or in front of the remaining photographic sheet having the remaining cut-out residual area image, through sheet holding means for holding the photographic sheets appropriately separated from each other. In addition, a three-dimensional workpiece including a remaining photographic sheet, a sheet holding unit, and a cut-out photographic sheet is accommodated in a case having at least a front surface made of a transparent body (see, for example, Patent Document 6).
Japanese Patent Laid-Open No. 5-120450 Japanese Patent Laid-Open No. 5-158207 JP-A-5-158208 Japanese Patent Laid-Open No. 5-158209 Japanese Patent Laid-Open No. 5-158210 JP 2000-153700 A

  These methods generate a relief pattern from a two-dimensional image. The relief pattern is a pattern in which a three-dimensional shape is expressed in a two-dimensional plane, and expresses the depth by the inclination of a line. If the reference line is made dense when the relief pattern is generated by these methods, the depth of the entire image can be generated.

  However, the method described in Patent Document 1 only supports images having two levels of depth, and cannot support images having multiple levels of depth. Moreover, what is generated is a linearly changing depth, which causes a book breaking phenomenon. Even if the relief pattern is sufficient, the depth of the pseudo three-dimensional image is insufficient.

  Similarly, the method described in Patent Document 2 only supports images having two levels of depth, and cannot handle images having multiple levels of depth. In addition, since the unevenness depends on the density of the texture, the depth of the portion without the pattern becomes linear, and there is a possibility that the cracking phenomenon may occur. On the contrary, a portion where the density of the texture repeats an extreme change like a checkered pattern does not have a continuous depth and tends to give an unnatural impression to the viewer.

  In addition, in the methods described in Patent Documents 3 to 5, since a relief pattern is applied to a line segment, only the contour portion is lifted, which is unnatural.

  Further, the method described in Patent Document 6 has a problem that a smooth stereoscopic effect cannot be expressed.

  The present invention has been invented in view of the above problems, and a pseudo three-dimensional image generation apparatus and pseudo three-dimensional image generation capable of easily or automatically creating a relief-like depth having a smooth stereoscopic effect. It is an object to provide a method and a pseudo three-dimensional image generation program.

  In order to achieve the above object, a pseudo three-dimensional image generation apparatus according to the present invention is a pseudo three-dimensional image generation apparatus that gives a pseudo depth to an image having a discrete depth, and the image having the discrete depth. An object is generated by connecting adjacent pixels having the same discrete depth and the same depth, and if there are adjacent objects, an integrated object is generated by integrating them. When there is no adjacent object, an object generating unit that directly uses the object as an integrated object, a depth giving method determining unit that draws a line segment densely on the integrated object, and a depth function is defined on the line segment Thus, there is provided pseudo depth calculation means for providing a continuous and smooth depth to the pixels on the line segment. The features.

  In the pseudo three-dimensional image generating apparatus according to the present invention, a depth giving method determining unit determines a center or a reference direction of each integrated object with respect to the integrated object generated by the object generating unit, and radiation starting from the determined center Minutes or determined parallel lines in the reference direction are drawn so as to cover the pixels constituting each integrated object. By this operation, the pixels constituting the object are associated with at least one radiation component or parallel line segment. The depth calculation means defines a smooth continuous function (depth function) on this radiation component or parallel line segment, and gives the function value to each pixel as a continuous and smooth depth.

  By positioning the pixels constituting each integrated object on the one-dimensional radiation component or the parallel line segment in the reference direction, it becomes easy to give a smooth continuous depth. In addition, by giving a smooth and continuous depth to an object having multiple levels of depth, it is possible to give a relief-like depth to the object, to prevent the picture-breaking phenomenon, and to those who see a more natural three-dimensional effect Can be given.

The best mode for carrying out the present invention will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a diagram illustrating a configuration of a pseudo three-dimensional image generation apparatus according to the first embodiment. With reference to FIG. 1, an outline of a pseudo three-dimensional image generation apparatus 100 according to the first embodiment will be described.

  The pseudo three-dimensional image generation apparatus 100 illustrated in FIG. 1 includes an input unit 110, an object generation unit 120, a depth setting method determination unit 130, a pseudo depth calculation unit 140, and an output unit 150. When the image 10 having a discrete depth is input, the input unit 110 reduces the resolution as necessary. The object generation unit 120 generates an object by extracting adjacent pixels having the same discrete depth from the image 10. If a plurality of objects are adjacent to each other, the objects are integrated into an integrated object. Note that a pixel having a farthest discrete depth or a pixel having a depth farther than a predetermined depth is regarded as a pixel constituting the background, and is excluded from a target for providing a pseudo depth. An object surrounded by a background and having no adjacent object is directly used as an integrated object.

  The depth setting method determination unit 130 determines a center on the integrated object generated by the object generation unit 120, and draws a dense radiation component having the determined center as a start point and an outline of the integrated object as an end point. The radiation component is drawn so that the pixels constituting the object are on at least one radiation component. The pseudo depth calculation unit 140 defines a smooth continuous function (depth function) based on the discrete depth of the object on the radiation densely drawn by the depth setting method determination unit 130, and determines the function value of the depth function as the radiation component. A pseudo depth is given to the upper pixel. The output unit 150 outputs the image 10 to which the pseudo depth is given by the pseudo depth calculation unit 140 as a pseudo three-dimensional image, for example, to a file or a display device (not shown).

  FIG. 2 is a flowchart showing the operation of the pseudo 3D image generation apparatus 100 according to the first embodiment. With reference to FIG. 2, functions and operations of each component of the pseudo three-dimensional image generation apparatus 100 will be described in more detail.

  In step S11, the input unit 110 captures the image 10 having a discrete depth. Each pixel of the image 10 has a discrete depth. Here, “depth” represents the position in the depth direction of the image, that is, the perspective in the line of sight of the viewer of the image. Pixels that are “near” in the depth are near the viewer and pixels that are “far” in the depth are far from the viewer. Depth may specifically indicate the distance of perspective, or may indicate the relative perspective numerically. “Discrete depth” means that this depth is discrete data and not continuous data.

  The input unit 110 may reduce the resolution of the captured image 10 as necessary. For example, if a pixel to be processed every other pixel in the vertical and horizontal directions is selected from all the pixels constituting the image, the resolution becomes ¼. By reducing the resolution, the calculation amount of data processed by the pseudo 3D image generation apparatus 100 can be reduced. Therefore, the pseudo three-dimensional image generation apparatus according to the present invention can be realized using a central processing unit (CPU) having a small processing capability. The input unit 110 corresponds to resolution reduction means.

  In step S <b> 12, the object generation unit 120 generates an object from the image 10 transferred from the input unit 110. For example, the object is generated by extracting adjacent pixels having the same discrete depth among the pixels included in the image 10 and registering them as components of the object. It should be noted that a pixel with the farthest discrete depth or a pixel with a depth farther than a predetermined depth is a pixel constituting the background, and no pseudo depth is given.

  In step S13, when there are a plurality of adjacent objects that are generated objects, the object generation unit 120 integrates the plurality of objects to generate an integrated object. The integrated object has a plurality of regions having different discrete depths therein. An isolated object having no adjacent object may also constitute an integrated object alone. An integrated object made up of isolated objects has only a single region made up of pixels with the same discrete depth. For example, the integrated object is generated by registering a plurality of adjacent objects as one integrated object.

  With reference to FIG. 3, the process until the integrated object is generated in steps S12 and S13 will be described. FIG. 3 is a diagram for explaining object generation / integration in the first embodiment. In an image 10 having a discrete depth, regions 11 to 18 having pixels having the same discrete depth and adjacent to each other. It is shown. For example, the object generation unit 120 extracts the region 11 having the same discrete depth and composed of adjacent pixels as the object 11. A region 12 having the same discrete depth and composed of adjacent pixels is extracted as an object 12. However, since the discrete depths of the pixels constituting the object 11 are different from the discrete depths of the pixels constituting the object 12, the objects 11 and 12 are two different objects.

  In step S13, since the objects 11 and 12 are further adjacent to each other, the object generation unit 120 integrates the adjacent objects 11 and 12 to generate one integrated object. In the following description, an integrated object generated by integrating the objects 11 and 12 is referred to as an integrated object (11, 12). The integrated object (11, 12) has two regions 11, 12 having different discrete depths therein. Similarly, the object generation unit 120 extracts the regions 13 to 16 and generates the objects 13 to 16. Since these are adjacent, they are integrated to generate an integrated object (13, 14, 15, 16). Here, for example, the object 15 and the object 16 are not directly adjacent to each other, but are indirectly adjacent via the object 13, so that they are integrated as an integrated object (13, 14, 15, 16). The

  The region 18 is a pixel having the longest discrete depth among the pixels included in the image 10 or a group of pixels farther than a predetermined depth. The region 18 is not set as a depth addition target as the background 18.

  The object 17 is an object isolated in the background 18. The isolated object may not be integrated with other objects but may be used alone as the integrated object 17. Accordingly, the integrated object 17 is composed of pixels having a single discrete depth. The object 17 has a donut shape, and the inside is a background 18.

  In steps S <b> 14 and S <b> 15, the depth setting method determination unit 130 determines a method for giving a pseudo depth to each integrated object of the image 10. There are various methods for providing the pseudo depth. In the first embodiment, a method is used in which the center of each integrated object is determined, and a plurality of radiation components are drawn with the determined center as the start point and the contour line of the integrated object as the end point.

  Specifically, in step S <b> 14, the depth setting method determination unit 130 obtains the center of each integrated object in the image 10. In step S15, the radiation component having the center obtained in step S14 as the start point and the contour line of the integrated object as the end point is drawn densely.

  FIG. 4 is a diagram for explaining the operation of drawing the radiation for the center of each integrated object in the first embodiment. In FIG. 4, the centers of the integrated objects (11, 12), (13, 14, 15, 16), and 17 are indicated by “x” marks. Further, radiation components 21, 22, and 23 starting from the centers of the integrated objects (11, 12), (13, 14, 15, 16), and 17 are drawn. Here, “draw” means that the pixels constituting the integrated object correspond to the radiation component, and it is not always necessary to physically draw the radiation component on the integrated object.

  There are many ways to define the center of an object. For example, the image center of the object, the midpoint of the vertical dividing line of the object, and the center of gravity of the object. FIG. 5 is a diagram for explaining a method of determining the center of an object. FIG. 5A shows the shape of the object 50 whose center is to be obtained. FIG. 5B is a diagram for explaining how to obtain the image center 51 of the object 50. The image center 51 can be obtained as the intersection 51 of the smallest rectangular diagonal lines surrounding the object 50. FIG. 5C is a diagram for explaining how to obtain the midpoint 52 of the vertical dividing line of the object 50. The vertical dividing line of the object 50 is a set of midpoints of horizontal lines that cut the object 50 in the horizontal direction. The midpoint 52 of the vertical dividing line is set as the center of the object 50. FIG. 5D is a diagram for explaining how to obtain the center of gravity of the object 50. The center of gravity can be obtained as an average value of the positions of the pixels constituting the object 50.

  If necessary, an appropriate center may be selected and used. Also, a specific type of center may be used for all integrated objects, or the type of center used may be changed for each integrated object.

When the type of the center to be used is selected, the operator may be able to select it, or for example, it may be automatically selected based on the feature amount of the integrated object. The feature amount is a numerical value indicating the feature of the integrated object, and includes, for example, circularity, area, length, symmetry, and the like. Circularity is a numerical value that determines the complexity of the shape of an integrated object based on the ratio of the area and circumference of the integrated object.
Feature (circularity) e = 4π × (area) ÷ (perimeter)
Defined by Here, π is the circumference ratio. The circularity has a maximum value of 1 in the case of a circle. In the case of a square, the circularity is 0.79.

  For example, the center type applied to the integrated object can be changed based on the circularity of the integrated object. The center type used can be changed depending on the range of the feature amount, such as using the image center for a circularity of 0.7 or more and using the center of gravity for a circularity of less than 0.7.

  In step 16, the pseudo depth calculation unit 140 appropriately determines a smooth continuous function (depth function) along the radiation component in order to add a depth to each pixel on the radiation component. Based on the above, a depth is given to the pixel on the radiation component.

  FIG. 6 is a diagram for explaining the depth function 32 defined on the radiation component 22 of the integrated object (13, 14, 15, 16) of the image 10. In FIG. 6, the other integrated objects (11, 12) and 17 are not shown (the same applies to FIGS. 7 and 8). The discrete depth of the integrated object (13, 14, 15, 16) is Y1 at a position (start point) corresponding to A1 on the radiation component 22, and from Y1 at positions corresponding to A2, A3, and A4, respectively. Y2, Y2 to Y3, and Y3 to the depth of the background 18 are changed. In other words, the discrete depth is Y1 in the region between A1 and A2 on the radiation component 22, Y2 in the region between A2 and A3, and Y3 in the region between A3 and A4.

  Here, in order to define the depth function 32 on the radiation component 22, pass points P1, P2, P3, and P4 through which the depth function 32 should pass are designated on the radiation component 22. The passing point can be specified by determining a specific position on the radiation component 22 representing the discrete depth. For example, the passing point P1 is a position A1 on the radiation component 22 and has a depth of Y1. The passing point P2 is a midpoint between the positions A2 and A3 and has a depth of Y2. The passing point P3 is a midpoint between the positions A3 and A4 and has a depth of Y3. A passing point P4 is a point having a depth of the background 18 at a position A4. The passing point does not necessarily need to be the middle point, and can be any point between A2 and A3 or between A3 and A4.

  Further, in step S16, the pseudo depth calculation unit 140 determines a smooth continuous function that passes through the designated passing points P1, P2, P3, and P4, and sets it as a depth function. As the smooth continuous function, for example, a Bezier curve, a B-spline curve, and a higher-order function (having orders corresponding to the number of passing points) can be used, but the invention is not limited to these. When a Bezier curve is used, the smoothest depth function can be obtained, but the calculation load increases.

  The function value of the depth function 32 is set as the pseudo depth of the pixel on the radiation component 22. The radiation component is drawn densely so as to pass over all the pixels constituting the integrated object (13, 14, 15, 16). Here, “densely draw” means that the radiation component is drawn at such a density that all the pixels constituting the integrated object (13, 14, 15, 16) ride on at least one radiation component. By defining the depth function on each radiation component, a pseudo depth can be given to all the pixels constituting the integrated object (13, 14, 15, 16).

  By drawing a radiation component densely on the integrated object and defining a depth function on each radiation component, it is possible to give a continuous depth to an image having a discrete depth. Accordingly, unnaturalness such as book splits is eliminated, and a relief-like pseudo three-dimensional image having a smooth stereoscopic effect can be easily created. Automation is also possible.

  As described above, each time the radiation component 22 passes through a region having a different discrete depth between the start point and the end point, one passing point may be designated. In some cases, it is also possible to omit specification of a passing point. FIG. 7 is a diagram for explaining a case where pseudo depth is given by omitting designation of a passing point. In FIG. 7, the integrated objects (11, 12) and 17 are omitted (the same applies to FIG. 8). For example, a passing point (corresponding to P3 in FIG. 6) between A3 and A4 on the radiation component 22 is omitted. Therefore, the shape of the depth function 33 is different from the shape of the depth function 32 shown in FIG. By omitting the designation of the passing point, the depth function does not faithfully represent the discrete depth change of the integrated object, but the calculation load can be reduced.

  It is also possible to give the closest depth to a center region including the center of the object and having a width. FIG. 8 gives a depth Y1 closest to a pixel in a region corresponding to a length of 30% from the start point to the end point on the radiation component 22 starting from the center of the object (13, 14, 15, 16). It is a figure which shows the case where it does. The depth function 34 shown in FIG. 8 has a constant value Y1 in a range (C1 to C3) of 30% of the distance from C1 corresponding to the start point to C6 corresponding to the end point, and this range is at the closest position. Show. Here, the central region refers to a region in the object in which the depth function 13 is constant.

  By providing the depth closest to the center region having the width, the integrated object is more popped out when outputting the relief-like three-dimensional shape, and the three-dimensional effect can be emphasized. In addition, when there are a plurality of integrated objects having different depths, the integrated object can be emphasized by performing this process only on objects having a short distance.

  In FIG. 8, the radiation component 22 enters the background 18 from the integrated object (13, 14, 15, 16) at C4, and enters the integrated object (13, 14, 15, 16) from the background 18 again at C5. Yes. In this case, the discrete depth of the pixel is equal to the depth of the background 18 between C4 and C5. In such a case, if the depth of the background 18 between C4 and C5 is used for the calculation of the depth function, the given depth becomes steep and may give an unnatural impression to the viewer. Therefore, the depth function 34 may be determined without specifying a passing point between C4 and C5.

  The image 10 to which the pseudo depth is given based on the depth function may be smoothed using a low-pass filter. FIG. 9 is a diagram illustrating an example of a low-pass filter. In the low-pass filter of FIG. 9, the depth of each pixel is an average value of the depths of the surrounding 7 × 7 pixels centered on the pixel. That is, the depth of all pixels included in the 7 × 7 pixel is multiplied by 1/49, and the result of addition is set as the depth of the center pixel. Here, the size of the low-pass filter is arbitrary, but the processing result is smoother when a low-pass filter having a relatively large size, for example, about 0.05 to 0.1% of the area of the entire image is used.

  In order to reduce the amount of calculation, a low-pass filter may be applied to only a part of the region instead of the entire image. For example, the area to be subjected to the low-pass filter may be selected from areas such as only the inside of the integrated object, only the outline of the integrated object, only the outline of the integrated object and its neighboring pixels. Further, the size and shape of the low-pass filter used for each region may be changed. For example, when a low-pass filter is applied only to the inside of an object, there is a method of using a rectangular low-pass filter having a size that is 1/4 of the size of the object in the vertical and horizontal directions.

It is possible to realize a smoother pseudo three-dimensional image that cannot be obtained simply by adding a pseudo depth based on the depth function.
[Second Embodiment]
A second embodiment will be described. The configuration of the pseudo 3D image generation apparatus according to the second embodiment is basically the same as that of the pseudo 3D image generation apparatus according to the first embodiment shown in FIG. The difference is that the depth setting method determination unit 130 of the pseudo three-dimensional image generation device according to the second embodiment determines the reference direction of each object and draws parallel lines of the determined reference direction.

  FIG. 10 is a flowchart illustrating a process of the pseudo 3D image generation device according to the second embodiment. In step S21, the input unit 110 captures the image 10 having a discrete depth. Similar to the first embodiment, the resolution of the image 10 may be reduced in step S21. In step S22, the object generation unit 120 extracts adjacent pixels having the same discrete depth from the image 10, and generates an object.

  In step S23, if there are a plurality of adjacent objects among the generated objects, an integrated object is generated by integrating them. In step S24, the depth setting method determination unit 130 determines the reference direction of each integrated object. In step S25, a parallel line segment is drawn densely, starting from the point where the parallel line in the reference direction first intersects with the outline of the integrated object, and ending at the point where the last line intersects. Here, “densely draw” means to determine a set of line segments that cover the pixels constituting the integrated object, and to correspond each pixel to at least one line segment, and is not necessarily a physical object. There is no need to draw line segments.

  FIGS. 11A and 11B are diagrams for explaining the operation of determining the reference direction of the image 10. FIG. 11A is a diagram illustrating a case where a specific direction of the image 10 is determined in advance as a reference direction. In this case, the reference directions of all the integrated objects (11, 12), (13, 14, 15, 16), and 17 included in the image 10 are determined to be the same direction. In another embodiment, as shown in FIG. 11B, the reference direction of each integrated object may be a different direction for each object. At that time, as described in the first embodiment, the determination may be made based on the feature amount of each integrated object. In the case of FIG. 11B, the reference direction of the integrated object (13, 14, 15, 16) is determined based on the length of the object which is a kind of the feature amount. Since the integrated objects (13, 14, 15, 16) are long in the vertical direction, the horizontal direction perpendicular thereto is also set as the reference direction.

  FIG. 12 is a diagram for explaining the operation of densely drawing parallel lines on each integrated object in the second embodiment. In FIG. 12, the reference directions of the integrated objects (11, 12), (13, 14, 15, 16) and 17 included in the image 10 are all horizontal. For example, in the integrated object (13, 14, 15, 16), the horizontal parallel line is the contour line of the integrated object (13, 14, 15, 16) at the leftmost point (start point) S1 of the parallel line segment 62. It intersects first, and finally intersects with the outline of the integrated object (13, 14, 15, 16) at the right end point (end point) S2 of the parallel line segment 62. The start point and end point of the parallel line segment are collectively called end points. Such a parallel line segment may be drawn at such a density that at least one parallel line segment passes through all the pixels constituting the integrated object (13, 14, 15, 16).

  Returning to FIG. 10, in step S26, the pseudo depth calculation unit 140 gives a pseudo depth to each pixel on the parallel line segment densely drawn in step S25, so that a smooth continuous function on the parallel line segment is obtained. (Depth function) is determined.

  FIG. 13 is a diagram for explaining the depth function 72 defined on the parallel line segment 62 of the integrated object (13, 14, 15, 16) of the image 10. In FIG. 13, the other integrated objects (11, 12) and 17 are not shown (the same applies to FIGS. 14 and 15). The discrete depths of the integrated objects (13, 14, 15, 16) are respectively determined at positions corresponding to D1 (corresponding to the start point), D2, D3, D4, and D5 (corresponding to the end point) on the horizontal line segment 62. The depth of the background 18 changes to Y2, Y2 to Y1, Y1 to Y2, Y2 to Y3, and Y3 to the depth of the background 18. In other words, the discrete depth on the parallel line segment 62 is Y2 in the region between D1 and D2, Y1 in the region between D2 and D3, Y2 in the region between D3 and D4, and between D2, D4 and D5. Y3 in this area.

  Here, in order to define the depth function 72 on the parallel line segment 62, passing points R1, R2, R3, R4, R5, and R6 through which the depth function 72 should pass are specified on the parallel line segment 62. The passing point can be specified by determining a specific position on the parallel line segment 62 representing the discrete depth. For example, the passing point R1 is a point having a depth of the background 18 at a position D1 on the parallel line segment 62. The passing point R2 is a midpoint between the positions D1 and D2 and has a depth of Y2. The passing point R3 is a midpoint between the positions D2 and D3 and has a depth of Y1. The passing point R4 is a midpoint between the positions D3 and D4 and has a depth of Y2. The passing point R5 is a midpoint between the positions D4 and D5 and has a depth of Y3.

  Furthermore, in step S26, the pseudo depth calculation unit 140 determines a smooth continuous function that passes through the designated passing points R1, R2, R3, R4, R5, and R6, and sets it as a depth function. As the smooth continuous function, as in the first embodiment, for example, a Bezier curve, a B-spline curve, or a higher-order function (having a degree corresponding to the number of passing points) can be used, but is not limited thereto. It is not a thing.

  The function value of the depth function 72 is set as the pseudo depth of the pixel on the parallel line segment 62. The parallel line segments are drawn densely so as to pass over all the pixels constituting the integrated object (13, 14, 15, 16). By defining the depth function on each radiation component, a pseudo depth can be given to all the pixels constituting the integrated object (13, 14, 15, 16).

  By drawing parallel lines densely on the integrated object and defining a depth function on each densely drawn parallel line, continuous depth can be given to an image having discrete depths. Accordingly, unnaturalness such as book splits is eliminated, and a relief-like pseudo three-dimensional image having a smooth stereoscopic effect can be easily created. Automation is also possible.

  As described above, each time the parallel line segment 62 passes through a region having a different discrete depth between the start point and the end point, one passing point may be designated, but a region where the discrete depth of the integrated object is different. It is also possible to omit the designation of the passing point in a part of. FIG. 14 is a diagram for explaining a case where pseudo depth is given by omitting designation of a passing point. In FIG. 14, the integrated objects (11, 12) and 17 are not shown (the same applies to FIG. 15). For example, a passing point (corresponding to R5 in FIG. 13) between D4 and D5 is omitted on the parallel line segment 62 of the integrated object (13, 14, 15, 16). Therefore, the shape of the depth function 73 is different from the shape of the depth function 72 shown in FIG. By omitting the designation of the passing point, the depth function does not faithfully represent the discrete depth change in the integrated object, but the calculation load can be reduced.

  It is also possible to give the closest depth to the central region including the center of the integrated object and having a width. FIG. 15 shows that on the parallel line segment 62 of the integrated object (13, 14, 15, 16), the closest depth Y1 is given to the pixels constituting the central region corresponding to the length of 30% of the parallel line segment 62. It is a figure which shows the case where it does. The depth function 74 shown in FIG. 15 has a constant value Y1 in a region (center region) between E1 and E2 corresponding to 30% of the length of the parallel line segment 62, and this range is the closest position. Show. Here, the central region refers to a region in the integrated object in which the depth function 74 is constant.

  By providing the depth closest to the center region having the width, the integrated object is more popped out when outputting the relief-like three-dimensional shape, and the three-dimensional effect can be emphasized. Further, when there are a plurality of integrated objects having different depths, the integrated object can be emphasized by performing this process only on the integrated objects having a short distance.

  Similarly to the first embodiment, the image 10 to which the pseudo depth is given based on the depth function may be smoothed using the low-pass filter shown in FIG. If a low-pass filter is applied to an image to which a pseudo depth is added, a smoother pseudo three-dimensional image that cannot be obtained simply by adding a depth by a depth function can be realized.

  It should be noted that the depth adding method determination unit 130 includes, for each integrated object, a depth adding method according to the radiation component according to the first embodiment and a depth adding method according to the parallel line segment according to the second embodiment. May be used in combination. The method for adding depth to each integrated object may be determined by the feature amount or may be selected by the operator.

The pseudo three-dimensional image apparatus according to the first and second embodiments can be realized as a computer and a program executed by the computer. It is also possible to provide the program by recording it on a computer-readable recording medium.
[Third Embodiment]
A pseudo three-dimensional image generation system according to the third embodiment will be described.

  FIG. 16 is a block diagram showing a configuration of a pseudo 3D image generation system 200 according to the third embodiment. The pseudo three-dimensional image generation system is, for example, a digital camera, and may be incorporated in a mobile phone, a personal data assistant (PDA), a personal computer (PC) or the like as well as a single digital camera. 16 includes an imaging unit 210, an image storage unit 220, a discrete depth image generation unit 230, a pseudo depth image generation unit 240, a display unit 250, and an illumination unit 260.

  The illumination unit 260 is, for example, a flash that illuminates a subject to be photographed according to a control signal from a control unit (not shown). The imaging unit 210 includes, for example, a CCD image sensor or a CMOS image sensor, and captures an image to be captured as data in accordance with a control signal from a control unit (not shown). The image storage unit 220 includes a plurality of frame memories (not shown) that store a plurality of images, and stores images captured by the imaging unit 210. The discrete depth image generation unit 230 processes the image stored in the frame memory of the image storage unit 220, and generates an image with a discrete depth. The generated image having discrete depth is sent to the pseudo depth image generation unit 240. The pseudo depth image generation unit 240 is, for example, a pseudo three-dimensional image generation apparatus according to the first or second embodiment of the present invention. A continuous and smooth depth is given to the input image having a discrete depth. An image to which continuous and smooth depth is given is displayed on the display unit 250. The display unit 250 is, for example, a true three-dimensional display device.

  The pseudo three-dimensional image generation system 200 can capture a two-dimensional image to be photographed, and the pseudo depth image generation unit 240 can give a continuous and smooth depth to the captured two-dimensional image. Therefore, it is possible to easily generate a pseudo three-dimensional image having a relief-like depth that gives a smooth three-dimensional effect to the viewer.

  The embodiment of the present invention has been described above. The present invention is not limited to the specifically disclosed embodiments described above, and various modifications and improvements may be made without departing from the scope of the present invention.

  A pseudo three-dimensional image generation apparatus that can easily generate a pseudo three-dimensional image from an image having a discrete depth can be produced. In addition, a pseudo 3D image generation system capable of shooting a shooting target and outputting a pseudo 3D image can be created.

It is a block diagram which shows the structure of the pseudo | simulated three-dimensional image generation apparatus which concerns on 1st Embodiment. It is a flowchart which shows operation | movement of the pseudo | simulation three-dimensional image generation apparatus which concerns on 1st Embodiment. It is a figure for demonstrating the operation | movement which produces | generates and integrates an object in 1st Embodiment. It is a figure for demonstrating the operation | movement which determines the center of each integrated object in 1st Embodiment. It is a figure for demonstrating the method to determine the center of an integrated object in 1st Embodiment. It is a figure for demonstrating the method to provide pseudo depth to the pixel on radiation in 1st Embodiment. It is a figure for demonstrating the case where a passing point is abbreviate | omitted in FIG. 6, and giving pseudo depth. It is a figure for demonstrating the case where the distance from the starting point in FIG. 6 provides the closest depth to the pixel of a predetermined ratio. It is a figure which shows an example of the low-pass filter used in order to make the pseudo depth provided in 1st Embodiment further smooth. It is a flowchart which shows operation | movement of the pseudo | simulation three-dimensional image generation apparatus which concerns on 2nd Embodiment. It is a figure for demonstrating the operation | movement which determines the reference | standard direction of each integrated object in 2nd Embodiment. It is a figure for demonstrating the operation | movement which draws a parallel line in each integrated object in 2nd Embodiment. It is a figure for demonstrating the method to provide pseudo depth to the pixel on a parallel line in 2nd Embodiment. It is a figure for demonstrating the case where a passing point is abbreviate | omitted in FIG. 13, and giving pseudo depth. It is a figure for demonstrating the case where the distance from the midpoint of a parallel line gives the depth nearest to the pixel of a predetermined ratio in FIG. It is a block diagram which shows the structure of the pseudo | simulated three-dimensional image generation system which concerns on 3rd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image with discrete depth 11, 12, 13 Object 14, 15, 16 Object 17 Object 18 Background 21, 22, 23 Radiation component 62 Parallel line segment 32, 33, 34 Depth function 72, 73 Depth function 50 Object shape example 51 Intersection 52 Midpoint 100 Pseudo 3D Image Generation Device 110 Input Unit 120 Object Generation Unit 130 Depth Method Determination Unit 140 Pseudo Depth Calculation Unit 150 Output Unit 200 Pseudo 3D Image Generation System 210 Imaging Unit 220 Image Storage Unit 230 Discrete depth image generation unit 240 Pseudo depth image generation unit 250 Display unit 260 Illumination unit

Claims (35)

A pseudo three-dimensional image generation device that gives a pseudo depth to an image having a discrete depth,
An object is generated by connecting adjacent pixels that are included in the image having the discrete depth and have the same discrete depth, and if there is an adjacent object, these are integrated. To generate an integrated object, and when there is no adjacent object, an object generating means that directly uses the object as an integrated object;
Depth providing method determining means for densely drawing a line segment on the integrated object;
A pseudo three-dimensional image generation apparatus provided with pseudo depth calculation means for providing a continuous and smooth depth to pixels on the line segment by defining a depth function on the line segment. The pseudo three-dimensional image generation device according to claim 1,
Furthermore, a pseudo three-dimensional image generation apparatus provided with resolution reduction means for acquiring an image having the discrete depth and reducing the resolution. The pseudo three-dimensional image generation device according to claim 1 or 2,
The depth imparting method determining means obtains the center of the integrated object, and densely draws a radiation component having the center as a start point and the outline of the integrated object as an end point. The pseudo three-dimensional image generation device according to claim 3,
The pseudo three-dimensional image generation apparatus, wherein the center is one of an image center of an integrated object, a midpoint of a vertical dividing line, and a center of gravity. The pseudo three-dimensional image generation device according to claim 1 or 2,
The depth imparting method determining means determines a reference direction of the integrated object, and draws a line segment that is parallel to the reference direction and that has a contour line of the integrated object as an end point. 3D image generator. The pseudo three-dimensional image generation device according to any one of claims 3 to 5,
The depth imparting method determining means selects a center type or a reference direction based on a feature amount of the integrated object, and a pseudo three-dimensional image generating apparatus. The pseudo three-dimensional image generation device according to any one of claims 1 to 6,
The pseudo three-dimensional image generation apparatus, wherein the object generation means uses a pixel whose discrete depth is farther than a predetermined depth as a background. The pseudo three-dimensional image generation device according to any one of claims 1 to 7,
When the line segment passes through an area where the discrete depth of the integrated object is different, the pseudo depth calculation means sets a passing point in a part or all of the passing area, and smoothly passes through the passing point. A pseudo three-dimensional image generation apparatus characterized in that a continuous function is a depth function. The pseudo three-dimensional image generation device according to claim 8,
The pseudo depth calculation means sets a midpoint of the region as the passing point in a part or all of the region where the discrete depth of the integrated object through which the line passes passes, and the integrated object through which the line passes. A pseudo three-dimensional image generation apparatus, characterized in that a farthest depth is given to a pixel on the contour line of. The pseudo three-dimensional image generation apparatus according to any one of claims 1 to 9,
The pseudo three-dimensional image generation apparatus, wherein the pseudo depth calculation unit gives a depth closest to a pixel in a central region of the integrated object. The pseudo three-dimensional image generation device according to any one of claims 1 to 10,
The depth calculation means smoothes the given depth data using a low-pass filter, and the pseudo three-dimensional image generation apparatus characterized by the above-mentioned. A pseudo three-dimensional image generation method for adding a pseudo depth to an image having a discrete depth,
An object is generated by connecting adjacent pixels that are included in the image having the discrete depth and have the same discrete depth, and if there is an adjacent object, these are integrated. To generate an integrated object, and when there is no adjacent object, an object generation process using the object as an integrated object as it is,
Depth imparting method determination process for drawing a line segment densely on the integrated object;
A pseudo three-dimensional image generation method comprising: a pseudo depth calculation process for providing a continuous and smooth depth to pixels on the line segment by defining a depth function on the line segment. A pseudo three-dimensional image generation method according to claim 12,
A pseudo three-dimensional image generation method further comprising a resolution reduction process of acquiring an image having the discrete depth and reducing the resolution. The pseudo three-dimensional image generation method according to claim 12 or 13,
A pseudo three-dimensional image generation method characterized in that, in the depth providing method determination step, a center of the integrated object is obtained, and a radiation component having the center as a start point and the outline of the integrated object as an end point is densely drawn. 15. The pseudo three-dimensional image generation method according to claim 14,
The pseudo three-dimensional image generation method, wherein the center is one of an image center of an integrated object, a midpoint of a vertical dividing line, and a center of gravity. The pseudo three-dimensional image generation method according to claim 12 or 13,
In the depth determination method determining step, a reference direction of the integrated object is determined, and a line segment that is parallel to the reference direction and that has a contour line of the integrated object as an end point is drawn. 3D image generation method. The pseudo three-dimensional image generation method according to any one of claims 14 to 16,
A pseudo three-dimensional image generation method, characterized in that, in the depth assignment method determination step, a center type or a reference direction is selected based on a feature amount of the integrated object. The pseudo three-dimensional image generation method according to any one of claims 12 to 17,
In the object generation process, a pseudo three-dimensional image generation method characterized in that a pixel having a discrete depth farther than a predetermined depth is used as a background. The pseudo three-dimensional image generation method according to any one of claims 12 to 18,
In the pseudo depth calculation process, when the line segment passes through a region where the discrete depth of the integrated object is different, a passing point is set in the region in part or all of the passing region, and the smooth passing through the passing point is set. A pseudo three-dimensional image generation method, wherein a continuous function is a depth function. The pseudo three-dimensional image generation method according to claim 19,
In the pseudo depth calculation process, the integrated object through which the line segment passes is set by setting a midpoint of the area as the passing point in a part or all of the area where the discrete depth of the integrated object through which the line segment passes differs. A pseudo three-dimensional image generation method, characterized in that a farthest depth is given to a pixel on the contour line of. A pseudo three-dimensional image generation method according to any one of claims 12 to 20,
A pseudo three-dimensional image generation method, wherein a depth closest to a pixel in a central region of the integrated object is given in the pseudo depth calculation process. The pseudo three-dimensional image generation method according to any one of claims 12 to 21,
A pseudo three-dimensional image generation method characterized in that, in the depth calculation process, the applied depth data is smoothed using a low-pass filter. A pseudo three-dimensional image generation program for adding a pseudo depth to an image having a discrete depth, the computer comprising:
An object is generated by connecting adjacent pixels that are included in the image having the discrete depth and have the same discrete depth, and if there is an adjacent object, these are integrated. To generate an integrated object, and when there is no adjacent object, an object generating means that directly uses the object as an integrated object;
Depth providing method determining means for densely drawing a line segment on the integrated object;
A pseudo three-dimensional image generation program that functions as a pseudo depth calculation unit that gives a continuous and smooth depth to pixels on the line segment by defining a depth function on the line segment.   24. The pseudo three-dimensional image generation program according to claim 23, further causing a computer to function as resolution reduction means for reducing the resolution of the image having the discrete depth. A pseudo three-dimensional image generation program according to claim 23 or 24,
The computer as the depth assigning method determining means finds the center of the integrated object and draws a radiation component starting from the center and ending with the outline of the integrated object. . A pseudo three-dimensional image generation program according to claim 25,
The pseudo three-dimensional image generation program, wherein the center is one of an image center of an integrated object, a midpoint of a vertical dividing line, and a center of gravity. A pseudo three-dimensional image generation program according to claim 23 or 24,
The computer as the depth assigning method determining unit determines a reference direction of the integrated object, and draws a line segment parallel to the reference direction, the line segment having the outline of the integrated object as an end point. A pseudo three-dimensional image generation program. A pseudo three-dimensional image generation program according to any one of claims 25 to 27,
The computer as the depth giving method determining means selects a center type or a reference direction based on a feature amount of the integrated object, and a pseudo three-dimensional image generation program. A pseudo three-dimensional image generation program according to any one of claims 23 to 28,
The computer as the object generating means uses a pseudo three-dimensional image generation program as a background of pixels whose discrete depth is farther than a predetermined depth. A pseudo three-dimensional image generation program according to any one of claims 23 to 29,
When the line segment passes through an area where the discrete depth of the integrated object is different, the computer as the pseudo depth calculation means sets a passing point in a part or all of the passing area, and the passing point A pseudo three-dimensional image generation program, characterized in that a smooth continuous function passing through is a depth function. A pseudo three-dimensional image generation program according to claim 30,
The computer as the pseudo depth calculation means sets a midpoint of the region as the passing point in a part or all of the region where the discrete depth of the integrated object through which the line passes differs, and the line passes. A pseudo three-dimensional image generation program, wherein a farthest depth is given to a pixel on the outline of the integrated object. A pseudo three-dimensional image generation program according to any one of claims 23 to 31,
The pseudo three-dimensional image generation program characterized in that the computer as the pseudo depth calculation means gives the depth closest to the pixel in the central region of the integrated object. A pseudo three-dimensional image generation program according to any one of claims 23 to 32, wherein
The computer as the depth calculation means smoothes the given depth data using a low-pass filter.   34. A computer-readable recording medium on which the pseudo three-dimensional image generation program according to any one of claims 23 to 33 is recorded. An image generation system for generating a pseudo three-dimensional image to be photographed,
A discrete depth image generating unit for generating an image having a discrete depth from the image data to be imaged;
A pseudo depth image generating unit for providing pseudo depth data to the image having the discrete depth,
The pseudo depth image generation unit generates an object by connecting adjacent pixels that are included in the image having the discrete depth and have the same discrete depth, and the object is an adjacent object If there is, an integrated object is generated by integrating the object, and if there is no adjacent object, an object generating means that directly uses the object as an integrated object;
Depth providing method determining means for densely drawing a line segment on the integrated object;
An image generation system provided with pseudo depth calculation means for providing a continuous and smooth depth to pixels on the line segment by defining a depth function on the line segment.