JP2008084338A - Pseudo three-dimensional image forming device, pseudo three-dimensional image forming method and pseudo three-dimensional image forming program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To impart a relief-like depth to texture data divided into objects. <P>SOLUTION: This pseudo three-dimensional image forming device imparts pseudo depth data to the texture data divided into objects. The device has a depth imparting method determining means for drawing line segments to cover all of each object of the texture data divided into objects, and a depth computing means for imparting continuous depth data to pixels on the drawn line segments. The depth imparting method determining means selects the kind of the center based on the feature amount of each object, determines the center of each object and draws a radiation line segment using the determined center starting point and using the outline of the object as a terminal point. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a pseudo three-dimensional image generation device, a generation method, a generation program, and a recording medium on which the program is recorded. More specifically, a pseudo three-dimensional image generation device, a pseudo three-dimensional image generation method, a pseudo three-dimensional image generation program, and a program for adding continuous depth data to texture data obtained by dividing an object are recorded. The present invention relates to a recording medium.

  With the development of image processing technology, three-dimensional image input technology has been actively studied. There are various methods for inputting a three-dimensional image, such as a stereo method and a light cutting method. Further, in any of the methods, there is a problem that the input device is expensive and large.

  On the other hand, as a method for easily generating a three-dimensional image, there has been proposed a method for generating a pseudo three-dimensional image by adding depth data to a two-dimensional image instead of inputting the three-dimensional image. .

  For example, a relief pattern using a binary image composed of a background portion and a pattern portion as a motif can be created using a computer. A binary image serving as a motif is prepared in the computer as raster data or contour data. A plurality of reference lines are defined on the binary image, and lines are created based on the reference lines. The line is created so as to bend at the boundary line between the background portion and the pattern portion of the binary image as a motif. If the relief pattern is formed by this line, the original motif appears to be visually raised (see, for example, Patent Document 1).

  In addition, a relief pattern using a gradation image composed of a plurality of pixels as a motif can be created using a computer. A gradation image as a motif is prepared in a computer as pixel array data in which density values are defined. A binary image is created based on the gradation image, and a contour line included in the image can be extracted based on the binary image. In addition, a plurality of reference lines are defined on the gradation image, and all lines are created based on the reference lines. The created line is a curved line corresponding to the density value of the pixel in the pattern portion included in the gradation image as the motif. If the relief pattern is formed by this line, the original motif appears to be visually raised (see, for example, Patent Document 2).

  In addition, a method has been proposed that can easily create a relief pattern having a smooth three-dimensional effect using a line drawing as a motif. In this method, a line drawing as a motif is prepared in a computer as digital data. On this line drawing, a plurality of reference lines are defined, and lines are created based on the reference lines. A line is created so that it bends in the vicinity where it intersects with a line drawing as a motif. If the relief pattern is made up of these lines, the original motif appears to be visually raised. In addition, when the line drawing used as a motif has a pattern of multiple lines that intersect with each other, a process in which the bent state of each line is integrated near the intersection of each line is performed, so a relief with a three-dimensional effect A pattern can be created (see, for example, Patent Documents 3, 4, and 5).

In addition, a method has been proposed in which an arbitrary area of a photograph is designated and the designated area is cut out to make a book-like accessory. In this method, a photographic sheet having a desired extracted region image extracted from the original photographic image of the original photographic sheet is cut out from the original photographic sheet to create a cut-out photographic sheet. The cut-out photographic sheet is disposed in front of the original photographic sheet, or in front of the remaining photographic sheet having the remaining cut-out residual area image, through sheet holding means for holding the photographic sheets appropriately separated from each other. In addition, a three-dimensional workpiece including a remaining photographic sheet, a sheet holding unit, and a cut-out photographic sheet is accommodated in a case having at least a front surface made of a transparent body (see, for example, Patent Document 6).
Japanese Patent Laid-Open No. 5-120450 Japanese Patent Laid-Open No. 5-158207 JP-A-5-158208 Japanese Patent Laid-Open No. 5-158209 Japanese Patent Laid-Open No. 5-158210 JP 2000-153700 A

  These methods generate a relief pattern from a two-dimensional image. The relief pattern is a pattern in which a three-dimensional shape is expressed in a two-dimensional plane, and expresses the depth by the inclination of a line. If the reference line is made dense when the relief pattern is generated by these methods, the depth data of the entire image can be generated.

  However, in the method described in Patent Document 1, it is the depth data that changes linearly, and a cracking phenomenon occurs. Even if the relief pattern is sufficient, the depth of the pseudo three-dimensional image is insufficient.

  Further, in the method described in Patent Document 2, since the unevenness depends on the density of the texture, the depth data of the portion without the pattern becomes linear, and there is a possibility that a cracking phenomenon may occur. On the contrary, a portion where the density of the texture repeats an extreme change like a checkered pattern does not have a continuous depth and tends to give an unnatural impression to the viewer.

  In addition, in the methods described in Patent Documents 3 to 5, since a relief pattern is applied to a line segment, only the contour portion is lifted, which is unnatural.

  Further, the method described in Patent Document 6 has a problem that a smooth stereoscopic effect cannot be expressed.

  The present invention has been invented in view of the above problems, and a pseudo three-dimensional image generation apparatus and pseudo three-dimensional image generation capable of easily or automatically creating a relief-like depth having a smooth stereoscopic effect It is an object to provide a method and a pseudo three-dimensional image generation program.

  A pseudo three-dimensional image generation apparatus according to the present invention is a pseudo three-dimensional image generation apparatus that adds pseudo depth data to texture data obtained by dividing an object, and includes a line so as to cover the texture data obtained by dividing the object. A depth providing method determining means for drawing a minute and a depth calculating means for giving continuous depth data to the pixels on the drawn line segment are provided.

  In the pseudo three-dimensional image generation apparatus according to the present invention, the depth imparting method determining means determines the center or reference direction of the object for each object of the texture data, and determines the radiation component or the determination starting from the determined center. Draw parallel lines in the reference direction and cover the pixels that make up each object. By this operation, the pixels constituting the object are positioned on at least one radiation component or parallel line segment. The depth calculation means defines an appropriate continuous function on the radiation or parallel line segment, and gives the function value to each pixel as depth data.

  By positioning the pixels constituting each object on the one-dimensional radiation component or the parallel line segment in the reference direction, it becomes easy to apply continuous depth data. Also, by giving the pixels on the outline of the object the same farthest depth as the background, it is possible to give the object a relief-like depth, which prevents the cracking phenomenon and gives a more natural three-dimensional effect Can be given to.

The best mode for carrying out the present invention will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a diagram illustrating a configuration of a pseudo three-dimensional image generation apparatus according to the first embodiment. The pseudo three-dimensional image generation apparatus 100 illustrated in FIG. 1 includes an input unit 110, a depth provision method determination unit 120, a pseudo depth calculation unit 130, and an output unit 140. The pseudo three-dimensional image generation apparatus 100 takes in the texture data 10 obtained by dividing the object, adds pseudo depth data to the input texture data 10, and outputs it as a pseudo three-dimensional image.

  The object-divided texture data 10 is a color or monochrome grayscale image. The object-divided texture data 10 will be described in more detail later.

  Each component of the pseudo 3D image generation apparatus 100 will be described.

  The input unit 110 captures the texture data 10 obtained by dividing the object, and sends the texture data 10 to the depth assignment method determination unit 120. The input unit 110 may reduce the resolution of the captured texture data obtained by dividing the object as necessary. By reducing the resolution, the calculation amount of data processed by the pseudo 3D image generation apparatus 100 can be reduced. The input unit 110 that reduces the resolution of the texture data corresponds to a resolution reduction unit.

  The depth giving method determining unit 120 determines a method for giving depth data according to each object of the texture data 10. There are various methods for adding depth data. In the first embodiment, a method is used in which the center of each object is determined, and a plurality of radiation components having the determined center as the start point and the contour line of the object as the end point are drawn. A method of giving depth data will be described in detail later.

  The pseudo depth calculation unit 130 gives depth data to each pixel on the radiation component. Specifically, an appropriate continuous function (depth function) is determined along the radiation component, and depth data is given to pixels on the radiation component based on the depth function.

  The output unit 140 outputs the texture data 10 to which the depth data is added by the pseudo depth calculation unit 130 as a pseudo three-dimensional image, for example, to a file or a display device (not shown).

  The functions of the depth imparting method determination unit 120 and the pseudo depth calculation unit 130 of the pseudo 3D image generation device according to the first embodiment will be described in more detail.

  FIG. 2 is a flowchart for explaining processing by the pseudo three-dimensional image generation apparatus according to the first embodiment.

  In step S10, texture data obtained by dividing an object is fetched. FIG. 3 is a diagram illustrating an example of the texture data 10 captured in step S10. The texture data 10 is divided into six objects 1 to 6 in advance by an appropriate method. A method of dividing texture data into objects will be described later.

  If necessary, the resolution of the captured texture data may be reduced. For example, if a pixel to be processed every other pixel in the vertical and horizontal directions is selected from all the pixels constituting the texture data, the resolution is 1/4. By reducing the resolution, the calculation amount of data to be processed can be reduced. Therefore, the pseudo three-dimensional image generation apparatus according to the present invention can be realized using a central processing unit (CPU) having a small processing capability.

  Returning to FIG. 2, in step S11, the center of each object of the texture data is obtained. In step S12, a dense radiation component is drawn starting from the center obtained in step S11 and ending with the contour of the object. Here, “drawing” does not necessarily need to physically draw a line segment, and it is only necessary to associate the pixels constituting the object in the texture data 10 with the line segment.

  FIG. 4 is a diagram in which the centers of the objects 1 to 6 in the texture data 10 are obtained and the centers of the obtained objects 1 to 6 are indicated by “x” marks. In addition, one radiation component 11 starting from the center of the object 1 is shown. There are many ways to define the center of an object. For example, the image center of the object, the midpoint of the vertical dividing line of the object, and the center of gravity of the object.

  FIG. 5 is a diagram for explaining the center of an object. FIG. 5A shows the shape of the object 50 whose center is to be obtained. FIG. 5B is a diagram for explaining how to obtain the image center 51 of the object 50. The image center 51 can be obtained as an intersection 51 of diagonal lines of a rectangle obtained by obtaining a minimum rectangle surrounding the object 50. FIG. 5C is a diagram for explaining how to obtain the midpoint 52 of the vertical dividing line of the object 50. The vertical dividing line of the object 50 is a set of midpoints of horizontal lines that cut the object 50 in the horizontal direction. The midpoint 52 of the vertical dividing line is set as the center of the object 50. FIG. 5D is a diagram for explaining how to obtain the center of gravity of the object 50. The center of gravity can be obtained as an average value of the positions of the pixels constituting the object 50.

  If necessary, an appropriate center may be selected and used. Further, for all objects, one type of center may be used, or the type of center used for each object may be changed.

When selecting the type of the center to be used, the user may be able to select it, or it may be automatically selected on the basis of the feature amount of the object. The feature amount is a numerical value indicating the feature of the object, and includes, for example, circularity, area, length, symmetry, and the like. Circularity is a numerical value that determines the complexity of the shape of an object based on the ratio of the area of the object to the perimeter.
Feature amount e = 4π × (Area) ÷ (Perimeter length)
Defined by Here, π is the circumference ratio. The circularity has a maximum value of 1 in the case of a circle. In the case of a square, the circularity is 0.79. The type of center used can be changed based on the circularity of the object. For example, the center of the image can be used when the circularity is 0.7 or more, and the center of gravity can be used when the circularity is less than 0.7.

  FIG. 6 is a diagram depicting the radiation component 11 starting from the center of gravity of the objects 1 to 6 and the center of the object 1 in the texture data 10 divided into objects. The density of the radiation component is a density at which all pixels constituting the object 1 are placed on at least one radiation component. That is, the radiation component 11 is drawn so as to cover the pixels constituting the object 1. Here, “drawing” does not necessarily physically draw a line segment, but considers a set of line segments that cover the pixels constituting the object in the texture data 10, and each pixel is represented by at least one pixel. To correspond to a line segment.

  Returning to FIG. 2, in step 13, an appropriate function (depth function) is determined in order to give depth data to each pixel on the radiation component 11. The depth function will be described with reference to FIG.

  FIG. 7 is a diagram for explaining the depth function 12 defined on the radiation component 11 of the object 1. The depth function 12 is a function that associates depth data with the pixels on the radiation component 11. Any function may be used as long as the depth data of the pixel on the contour line of the object is the farthest. This is because the depth data is continuously connected to a portion (background portion) that is not an object of the texture data. The depth function 12 is, for example, a high-order function such as a quadratic function or a step function.

  Here, “depth” represents the position of the texture data in the depth direction, that is, the perspective of the person viewing the texture data in the line of sight. Pixels with “near” depth data are near the viewer and pixels with depth data “far” are far from the viewer. The depth data may specifically indicate the distance of perspective, or may be a numerical value of relative perspective.

  By considering the radiation component on the object and defining the depth function on the radiation component, continuous depth data can be added to the texture data. Accordingly, unnaturalness such as book splits is eliminated, and a relief-like pseudo three-dimensional image having a smooth stereoscopic effect can be easily created. Automation is also possible.

  The closest depth data can also be given to a center region including the center of the object and having a width. FIG. 8 is a diagram showing a case where depth data closest to a pixel having a length of 30% is given from the start point to the end point on the radiation component 11 starting from the center of gravity of the object 1. The depth function 13 shown in FIG. 8A is constant in the range of 30% from the start point to the end point, and indicates that it is at the closest position. Here, the central region refers to a region in the object in which the depth function 13 is constant.

  FIG. 8B is a diagram in which the center area of each object is indicated by hatching. By giving the depth data closest to the center area having the width, the object is more popped out when outputting the relief-like three-dimensional shape, and the three-dimensional effect can be emphasized. In addition, when there are a plurality of objects, by processing only the object to be emphasized, it is possible to make the stereoscopic effect of each object different and make the viewer feel the difference in distance in a pseudo manner. The object to be emphasized may be arbitrarily selected manually by the operator, or the object having the largest area or the object at the center of the image may be automatically selected.

  The texture data to which the depth data is added may be smoothed using a low-pass filter. FIG. 9 is a diagram illustrating an example of a low-pass filter. The low-pass filter of FIG. 9 uses the depth data of each pixel as an average value of the depth data of 7 × 7 pixels around the pixel. That is, the depth data of all the pixels included in the 7 × 7 pixels is multiplied by 1/49, and the result of addition is set as the depth data of the center pixel. Here, the size of the low-pass filter is arbitrary, but the processing result becomes smoother when a relatively large low-pass filter of about 0.05 to 0.1% of the area of the entire texture data is used, for example.

  In order to reduce the amount of calculation, a low-pass filter may be applied to only a part of the area instead of the entire texture data. When the low-pass filter is applied only to a part of the area of the texture data, for example, only the inside of the object, only the outline of the object, or only the outline of the object and a few pixels in the vicinity may be selected. Further, the size and shape of the low-pass filter may be changed for each region. For example, when a low-pass filter is applied only to the inside of an object, there is a method of using a rectangular low-pass filter having a size that is 1/4 of the size of the object in the vertical and horizontal directions.

  If a low-pass filter is applied to the texture data to which the depth data is added, a smooth pseudo three-dimensional image that cannot be obtained only by adding continuous depth data can be realized.

  Here, the object division of the texture data will be described with reference to FIGS. FIG. 10 is a diagram showing texture data before object division. The texture data is a color or monochrome grayscale image. FIG. 11 is a diagram for explaining a process of dividing the objects 1 to 6 from the texture data of FIG. FIG. 11A shows a method in which an operator operates a pointing device such as a mouse to manually input the contours of the objects 1 to 6 and extract the objects 1 to 6. In FIG. 11B, an operator operates a pointing device to manually specify a point on an area to be converted into an object, and the hue, brightness, saturation, or a combination of these, which will be described later, is a vector feature. This is a method of dividing an object as a reference. In FIG. 11C, instead of manually specifying the points on the region to be converted into an object by the operator, grid points are set in advance on the texture data, and the object is divided based on the characteristics of the pixels on each grid point. The method is shown.

  Here, an example of image features used for object division will be described. Each pixel of the color texture data usually has RGB density information. In FIG. 10, since the regions that become the objects 1 to 6 after the object division have RGB density information that approximates each other, the RGB density information is directly used as image features, and the object 1 is obtained from the texture data. ~ 6 can be divided. Alternatively, a method is generally used in which the hue, luminance, and saturation of a pixel are obtained from RGB density information, and these are used as image features to divide the object.

First, the luminance signal Y and the color difference signals C ₁ and C ₂ are obtained from the RGB density information using the following relational expression.

Luminance signal: Y = 0.299R + 0.587G + 0.114B
Color difference signal: C ₁ = RY, C ₂ = BY
Next, in order to quantitatively represent the color, a hue H, luminance L, and saturation S are obtained. Hue H represents the type of color, luminance L represents the brightness of the color, and saturation S represents the color density.

In the case of a monochrome image, the luminance signal is used as the density value.

  As a method of dividing texture data into objects using image characteristics such as hue, luminance, and saturation obtained in this way, there are, for example, a binarization method and an approximate region method.

The binarization method is, for example, a method in which the hue, luminance, and saturation of a pixel are compared with a predetermined threshold value and divided into pixels that are higher and lower than the threshold value. The method using the approximate region is a method of dividing a pixel having a value close to a predetermined hue, luminance, and saturation as an object. For example, a pixel whose hue is within a predetermined value ± 2 ° is divided as an object. Further, for example, a pixel whose luminance is within ± 10 gradations of a predetermined value may be divided as a component of the object. The same applies to saturation. Alternatively, the hue, luminance, and saturation may be considered as a vector, and a pixel having a vector direction and size close to each other may be divided as a component of the object.
[Second Embodiment]
A second embodiment will be described. The configuration of the pseudo 3D image generation apparatus according to the second embodiment is basically the same as that of the pseudo 3D image generation apparatus according to the first embodiment shown in FIG. The difference is that the depth imparting method determination unit 120 of the pseudo three-dimensional image generation device according to the second embodiment determines the reference direction of each object and draws a parallel line segment of the determined reference direction. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted.

  FIG. 12 is a flowchart illustrating processing of the pseudo 3D image generation device according to the second embodiment. In step S20, the object-divided texture data 10 is captured. As in the first embodiment, the resolution of the texture data may be reduced in step S20.

  In step S21, the reference direction of the texture data is determined, and in step S22, a dense parallel line segment is drawn starting from the point where the parallel line in the reference direction first intersects the contour of the object, and ending at the last point. . Here, “drawing” does not necessarily need to physically draw a line segment, but considers a set of line segments that cover the pixels constituting the object in the texture data 10, and each pixel is represented by at least one line. What is necessary is just to make it respond | correspond to a line segment.

  FIG. 13 is a diagram illustrating a case where the horizontal direction of the texture data 10 is determined as the reference direction. In this way, a common reference direction may be determined for all objects of texture data.

  In another embodiment, different reference directions may be determined for each of the objects 1 to 6 as shown in FIG. The reference direction of the object may be determined based on the feature amount of each object, as described with respect to the first embodiment. In the case of FIG. 14, the reference direction of the object 1 is the vertical direction, and the reference direction of the object 2 is the horizontal direction.

  Returning to FIG. 12, in step 22, a dense line segment is drawn starting from the point where the parallel line in the reference direction first intersects with the contour of the object and ending at the last intersecting point. In FIG. 15, the reference direction of the texture data 10 is the horizontal direction. For example, in object 1, the horizontal parallel line first intersects with the outline of object 1 at point 23, and finally intersects with the outline of object 1 at point 22. Therefore, a parallel line segment 21 starting from the point 23 and ending at the point 22 is drawn. The start point and end point are collectively called end points.

  The parallel line segments may be drawn at a density such that at least one parallel line segment passes through all the pixels constituting the object 1.

  Returning to FIG. 12, in step S23, an appropriate function (depth function) is determined on the parallel line segment 21 in order to give depth data to each pixel on the parallel line segment 21. This will be described with reference to FIG.

  FIG. 16 is a diagram for explaining the depth function 24 defined on the parallel line segment 21 of the object 1. The depth function 24 gives depth data to each pixel on the parallel line segment 21. The depth function may be a function that makes the depth data of the pixel on the contour line of the object the farthest. This is because the depth data is continuously connected to a portion (background portion) that is not an object of the texture data. The depth function 12 includes a high-order function such as a quadratic function or a step function. Although the depth function 24 in FIG. 16 is a symmetric function with respect to the midpoint of the parallel line segment 21, it does not necessarily have to be symmetric. In addition, the function is such that the depth is closest to the midpoint, but this is not always necessary.

  Thus, continuous depth data can be given to texture data by considering parallel line segments on the object and defining a depth function on the parallel line segments. Accordingly, unnaturalness such as book splits is eliminated, and a relief-like pseudo three-dimensional image having a smooth stereoscopic effect can be easily created. Automation is also possible.

  The closest depth data can also be given to a center region including the center of the object and having a width. FIG. 17 is a diagram illustrating a case in which the closest depth data is given to a pixel having a length of, for example, 30% of the central portion on the parallel line segment 21 of the object 1. The depth function 25 shown in FIG. 17A is constant within the range of the central portion 30% of the parallel line segment 21 and indicates that it is at the closest position.

  FIG. 17B is a diagram showing the texture data 10 to which the depth data closest to the central region having the width is given by the depth function shown in FIG. The central region to which the closest depth data is assigned is indicated by hatching. By making the depth data of the center region having the width closest, the object is more popped out when outputting the relief-like three-dimensional shape, and the three-dimensional effect can be emphasized. In addition, when there are a plurality of objects, the above processing is performed only on the object to be emphasized, so that the stereoscopic effect for each object can be made different, and the viewer can feel a pseudo distance difference. An object to be emphasized may be arbitrarily selected manually by an operator, or an object having the largest area or an object at the center of texture data may be automatically selected.

  Similarly to the first embodiment, texture data to which depth data is added may be made smoother by using, for example, a low-pass filter shown in FIG. If a low-pass filter is applied to the texture data to which depth data is added, a smooth pseudo three-dimensional image that cannot be obtained only by adding continuous depth data can be realized.

The pseudo three-dimensional image apparatus according to the first and second embodiments can be realized as a computer and a program executed by the computer. It is also possible to provide the program by recording it on a computer-readable recording medium.
[Third Embodiment]
A pseudo three-dimensional image generation system according to the third embodiment will be described.

  FIG. 18 is a block diagram illustrating a configuration of a pseudo 3D image generation system 200 according to the third embodiment. The pseudo three-dimensional image generation system is, for example, a digital camera and may be incorporated in a mobile phone, a personal data assistant (PDA), or a personal computer (PC) as well as a single digital camera. The pseudo three-dimensional image generation system 200 in FIG. 18 includes an imaging unit 210, an image storage unit 220, a texture data generation unit 230, a depth data generation unit 240, a display unit 250, and an illumination unit 260.

  The illumination unit 260 is, for example, a flash that illuminates a subject to be photographed according to a control signal from a control unit (not shown). The imaging unit 210 includes, for example, a CCD image sensor or a CMOS image sensor, and captures an image to be captured as data in accordance with a control signal from a control unit (not shown). The image storage unit 220 includes a plurality of frame memories (not shown) that store a plurality of images, and stores images captured by the imaging unit 210. The texture data generation unit processes an image stored in the frame memory of the image storage unit 220, divides an object in the image using an appropriate object division method, and generates texture data obtained by dividing the object.

  As a method for dividing texture data into objects, there is a method based on hue, luminance, saturation, etc. described in connection with the first embodiment. As yet another embodiment, there is a method using a plurality of images obtained by photographing the same subject. If a plurality of images are used, the object can be divided using a standard other than the color. References other than color include, for example, the distance to the object and the movement of the object. When using the distance to the object, for example, comparing an image shot with the flash on and an image shot without the flash on, the area brightened by the flash is a nearby shooting target Since they can be regarded, they can be cut out into objects for each distance. Alternatively, when the shooting target is moving, the moving shooting target 210 is fixed, the moving shooting target is shot, a difference is taken between a plurality of frames, and the changed area can be cut out as an object.

  The generated object-divided texture data is sent to the depth data generation unit 240. The depth data generation unit 240 is a pseudo 3D image generation apparatus according to the first or second embodiment, for example, and adds depth data to the input texture data. The texture data to which the depth data is assigned is displayed on the display unit 250. The display unit 250 is, for example, a true three-dimensional display device.

  The pseudo three-dimensional image generation system 200 can capture a two-dimensional image to be captured, and the depth data generation unit 240 can add pseudo depth data to the captured two-dimensional image. Therefore, it is possible to easily generate a pseudo three-dimensional image having a relief-like depth that gives a smooth three-dimensional effect to the viewer.

  The embodiment of the present invention has been described above. The present invention is not limited to the specifically disclosed embodiments described above, and various modifications and improvements may be made without departing from the scope of the present invention.

Some aspects of the present invention are summarized as follows.
(Supplementary Note 1) A pseudo three-dimensional image generation apparatus that adds pseudo depth data to texture data obtained by dividing an object,
Depth providing method determining means for drawing a line segment so as to cover each object of the texture data divided into objects,
A pseudo three-dimensional image generation apparatus provided with depth calculation means for providing continuous depth data to pixels on the drawn line segment.
(Supplementary note 2) The pseudo three-dimensional image generation device according to supplementary note 1, wherein
The depth imparting method determining means obtains the center of each object, and draws a radiation component having the obtained center as a start point and the contour line of the object as an end point.
(Supplementary note 3) The pseudo three-dimensional image generation device according to supplementary note 2,
The pseudo three-dimensional image generating apparatus, wherein the center is any one of an image center of an object, a midpoint of a vertical dividing line, and a center of gravity.
(Supplementary note 4) The pseudo three-dimensional image generation device according to supplementary note 1,
The depth imparting method determining means determines a reference direction of each object, and draws a line segment that is parallel to the determined reference direction and that has a contour line of each object as an end point. 3D image generator.
(Supplementary note 5) The pseudo three-dimensional image generation device according to any one of supplementary notes 1 to 4,
The pseudo-three-dimensional image generation apparatus characterized in that the depth providing method determining means selects a center type or a reference direction based on a feature amount of each object.
(Supplementary note 6) The pseudo three-dimensional image generation device according to any one of supplementary notes 1 to 5,
The depth calculation means assigns the furthest depth data to the pixels on the contour line of the object.
(Supplementary note 7) The pseudo three-dimensional image generation device according to any one of supplementary notes 1 to 6,
The pseudo three-dimensional image generation apparatus, wherein the depth calculation means gives depth data using a continuous function.
(Supplementary note 8) The pseudo three-dimensional image generation device according to any one of supplementary notes 1 to 7,
The pseudo three-dimensional image generation apparatus, wherein the depth calculation unit gives depth data closest to a pixel in a central region of the object.
(Supplementary note 9) The pseudo three-dimensional image generation device according to any one of supplementary notes 1 to 8,
The depth calculation means smoothes the given depth data using a low-pass filter, and the pseudo three-dimensional image generation apparatus characterized by the above-mentioned.
(Supplementary note 10) The pseudo three-dimensional image generation device according to any one of supplementary notes 1 to 9,
A pseudo three-dimensional image generation apparatus, further comprising resolution reduction means for reducing the resolution of the texture data divided into objects.
(Supplementary Note 11) A pseudo three-dimensional image generation method for adding pseudo depth data to texture data obtained by dividing an object,
Depth imparting method determination step of drawing a line segment so as to cover each object of the texture data divided into objects,
A pseudo three-dimensional image generation method comprising: a depth calculation process for providing continuous depth data to pixels on the drawn line segment.
(Supplementary note 12) The pseudo three-dimensional image generation method according to supplementary note 11,
A pseudo three-dimensional image generation method characterized in that, in the depth giving method determining step, a center of each object is obtained, and a radiation component having the obtained center as a start point and an outline of the object as an end point is drawn.
(Supplementary note 13) The pseudo three-dimensional image generation method according to supplementary note 12,
The pseudo three-dimensional image generation method, wherein the center is one of an image center of an object, a midpoint of a vertical dividing line, and a center of gravity.
(Supplementary note 14) The pseudo three-dimensional image generation method according to supplementary note 11,
In the depth giving method determining step, a reference direction of each object is determined, and a line segment parallel to the determined reference direction and having a contour line of each object as an end point is drawn. 3D image generation method.
(Supplementary note 15) The pseudo three-dimensional image generation method according to any one of supplementary notes 11 to 14,
A pseudo three-dimensional image generation method, characterized in that, in the depth determination method determination step, a center type or a reference direction is selected based on a feature amount of each object.
(Supplementary note 16) The pseudo three-dimensional image generation method according to any one of supplementary notes 11 to 15,
A pseudo three-dimensional image generation method, characterized in that, in the depth calculation process, depth data farthest is given to a pixel on the contour line of the object.
(Supplementary note 17) The pseudo three-dimensional image generation method according to any one of supplementary notes 11 to 16,
In the depth calculation process, depth data is given using a continuous function.
(Supplementary note 18) The pseudo three-dimensional image generation method according to any one of supplementary notes 11 to 17,
In the depth calculation process, depth data closest to a pixel in a central area of the object is given, and a pseudo three-dimensional image generation method is provided.
(Supplementary note 19) The pseudo three-dimensional image generation method according to any one of supplementary notes 11 to 18,
A pseudo three-dimensional image generation method characterized in that, in the depth calculation process, the applied depth data is smoothed using a low-pass filter.
(Supplementary note 20) The pseudo three-dimensional image generation method according to any one of supplementary notes 11 to 19,
A pseudo three-dimensional image generation method further comprising a resolution reduction process for reducing the resolution of the texture data divided into objects.
(Supplementary note 21) A pseudo three-dimensional image generation program for adding pseudo depth data to texture data obtained by dividing an object.
Depth providing method determining means for drawing a line segment so as to cover the object-divided texture data;
A pseudo three-dimensional image generation program that functions as a depth calculation unit that gives continuous depth data to pixels on the drawn line segment.
(Supplementary note 22) The pseudo three-dimensional image generation program according to supplementary note 21,
A computer as the depth assigning method determining means finds the center of each object and draws a radiation component starting from the center and ending with the contour of the object.
(Supplementary note 23) A pseudo three-dimensional image generation program according to supplementary note 22,
The pseudo three-dimensional image generation program, wherein the center is any one of an image center of an object, a midpoint of a vertical dividing line, and a center of gravity.
(Supplementary Note 24) A pseudo three-dimensional image generation program according to supplementary note 21,
The computer as the depth giving method determining means determines a reference direction of each object, and draws a line segment that is parallel to the determined reference direction and that has a contour line of each object as an end point. A pseudo three-dimensional image generation program.
(Supplementary note 25) The pseudo three-dimensional image generation program according to any one of supplementary notes 21 to 24,
A pseudo three-dimensional image generation program characterized in that the computer as the depth assigning method determination means selects a center type based on a feature amount of each object.
(Supplementary note 26) The pseudo three-dimensional image generation program according to any one of supplementary notes 21 to 25,
A pseudo three-dimensional image generation program characterized in that the computer as the depth calculation means gives the furthest depth data to the pixels on the contour line of the object.
(Supplementary note 27) The pseudo three-dimensional image generation program according to any one of supplementary notes 21 to 26,
A computer as the depth calculation means assigns depth data using a continuous function, and a pseudo three-dimensional image generation program.
(Supplementary note 28) The pseudo three-dimensional image generation program according to any one of supplementary notes 21 to 27,
A computer as the depth calculation means assigns depth data closest to a pixel in a central area of the object, and a pseudo three-dimensional image generation program.
(Supplementary note 29) The pseudo three-dimensional image generation program according to any one of supplementary notes 21 to 28,
The computer as the depth calculation means smoothes the given depth data using a low-pass filter.
(Supplementary note 30) The pseudo three-dimensional image generation program according to any one of supplementary notes 21 to 29, wherein the computer functions as a resolution reduction unit that reduces the resolution of the texture data divided into objects. Generation program.
(Additional remark 31) The computer-readable recording medium which recorded the pseudo | simulation three-dimensional image generation program as described in any one of additional remark 21 thru | or 30.
(Supplementary Note 32) An image generation system for generating a pseudo three-dimensional image from texture data to be imaged,
A texture data generating unit that generates texture data obtained by dividing an object from the image data to be imaged;
A pseudo three-dimensional image generation unit that adds pseudo depth data to the texture data obtained by the object division;
The pseudo three-dimensional image generation unit includes an input unit that inputs the texture data from the texture data generation unit;
Depth providing method determining means for drawing a line segment so as to cover the input texture data;
An image generation system provided with depth calculation means for providing continuous depth data to pixels on the drawn line segment.

  A pseudo three-dimensional image generation apparatus that can easily generate a pseudo three-dimensional image from texture data obtained by dividing an object can be created. In addition, a pseudo 3D image generation system capable of shooting a shooting target and outputting a pseudo 3D image can be created.

It is a block diagram which shows the structure of the pseudo | simulated three-dimensional image generation apparatus which concerns on 1st Embodiment. It is a flowchart which shows the process by the pseudo | simulation three-dimensional image generation apparatus which concerns on 1st Embodiment. It is a figure for demonstrating the texture data by which the object division | segmentation input into the pseudo | simulation three-dimensional image generation apparatus which concerns on 1st Embodiment was input. In a 1st embodiment, it is a figure for deciding the center of each object, and explaining the method of drawing radiation from the center as a starting point. It is a figure for demonstrating the method to determine the center of an object in 1st Embodiment. In 1st Embodiment, it is a figure for demonstrating the method of drawing a radiation from a gravity center as a starting point. In 1st Embodiment, it is a figure for demonstrating the method to provide depth data to each pixel on radiation. In 1st Embodiment, it is a figure for demonstrating the case where the depth data of a center area | region are the nearest. It is a figure which shows an example of the low pass filter used in 1st Embodiment. It is a figure which shows the texture data before isolate | separating an object. It is a figure for demonstrating the process which isolate | separates the object of the texture data shown in FIG. It is a flowchart which shows the process by the pseudo | simulated three-dimensional image generation apparatus which concerns on 2nd Embodiment. In 2nd Embodiment, it is a figure for demonstrating the case where the reference direction is predetermined. It is a figure for demonstrating the case where a reference direction is determined for every object in 2nd Embodiment. In a 2nd embodiment, it is a figure for explaining drawing of a dense parallel line segment. It is a figure for demonstrating the method to provide depth data to each pixel on a parallel line segment in 2nd Embodiment. In 2nd Embodiment, it is a figure for demonstrating the case where the depth data of a center area | region are the nearest. It is a block diagram which shows the structure of the pseudo | simulated three-dimensional image generation system which concerns on 3rd Embodiment.

Explanation of symbols

1, 2, 3, 4, 5, 6 Object 10 Texture data divided into objects 11 Radiation component 12, 13 Depth function 21 Parallel segment 22, 23 Intersection point of parallel line and object outline 24, 25 Depth function 50 Object Shape Example 51 Intersection 52 Midpoint 100 Pseudo 3D Image Generation Device 110 Input Unit 120 Depth Assignment Method Determination Unit 130 Pseudo Depth Calculation Unit 140 Output Unit 200 Pseudo 3D Image Generation System 210 Imaging Unit 220 Image Storage Unit 230 Texture Data generation unit 240 Depth data generation unit 250 Display unit 260 Illumination unit

Claims (23)

A pseudo three-dimensional image generation apparatus that adds pseudo depth data to texture data obtained by dividing an object,
Depth providing method determining means for drawing a line segment so as to cover each object of the texture data divided into objects,
Depth calculation means for giving continuous depth data to pixels on the drawn line segment,
The depth providing method determining means selects a center type based on a feature amount of each object, obtains the center of each object, and draws a radiation component having the obtained center as a start point and the contour line of the object as an end point. A pseudo three-dimensional image generation device as a feature. The pseudo three-dimensional image generation device according to claim 1,
The pseudo three-dimensional image generating apparatus, wherein the center is any one of an image center of an object, a midpoint of a vertical dividing line, and a center of gravity. The pseudo three-dimensional image generation apparatus according to claim 1 or 2,
The depth calculation means assigns the furthest depth data to the pixels on the contour line of the object. The pseudo three-dimensional image generation device according to any one of claims 1 to 3,
The pseudo three-dimensional image generation apparatus, wherein the depth calculation means gives depth data using a continuous function. The pseudo three-dimensional image generation device according to any one of claims 1 to 4,
The pseudo three-dimensional image generation apparatus, wherein the depth calculation unit gives depth data closest to a pixel in a central region of the object. The pseudo three-dimensional image generation device according to any one of claims 1 to 5,
The depth calculation means smoothes the given depth data using a low-pass filter, and the pseudo three-dimensional image generation apparatus characterized by the above-mentioned. The pseudo three-dimensional image generation device according to any one of claims 1 to 6,
A pseudo three-dimensional image generation apparatus, further comprising resolution reduction means for reducing the resolution of the texture data divided into objects. A pseudo three-dimensional image generation method for adding pseudo depth data to texture data divided into objects,
Depth providing method determining means, a depth adding method determining step for drawing a line segment so as to cover each object of the texture data divided into objects,
A depth calculation means having a depth calculation process of giving continuous depth data to pixels on the drawn line segment;
In the depth giving method determining step, the depth giving method determining means selects a center type based on the feature amount of each object, obtains the center of each object, uses the found center as a start point, and sets the contour line of the object as an end point A pseudo three-dimensional image generation method characterized by drawing a radiation component. The pseudo three-dimensional image generation method according to claim 8,
The pseudo three-dimensional image generation method, wherein the center is one of an image center of an object, a midpoint of a vertical dividing line, and a center of gravity. The pseudo three-dimensional image generation method according to claim 8 or 9,
The method for generating a pseudo three-dimensional image, wherein the depth calculation step further includes a step of giving depth data farthest to the pixels on the contour line of the object. A pseudo three-dimensional image generation method according to any one of claims 8 to 10,
The pseudo three-dimensional image generation method, wherein the depth calculation process further includes a process of adding depth data using a continuous function. A pseudo three-dimensional image generation method according to any one of claims 8 to 11,
The pseudo three-dimensional image generation method, wherein the depth calculation step further includes a step of giving depth data closest to a pixel in a central region of the object. A pseudo three-dimensional image generation method according to any one of claims 8 to 12,
The depth calculation process further includes a process of smoothing the given depth data using a low-pass filter. A pseudo three-dimensional image generation method according to any one of claims 8 to 13,
A pseudo three-dimensional image generation method, wherein the resolution reduction means further includes a resolution reduction process for reducing the resolution of the texture data divided by the object. A pseudo three-dimensional image generation program for adding pseudo depth data to texture data obtained by dividing an object, the computer comprising:
Depth providing method determining means for drawing a line segment so as to cover the object-divided texture data;
Function as depth calculation means for giving continuous depth data to pixels on the drawn line segment,
The depth providing method determining means selects a center type based on a feature amount of each object, obtains the center of each object, and draws a radiation component having the obtained center as a start point and the contour line of the object as an end point. A pseudo three-dimensional image generation program characterized. A pseudo three-dimensional image generation program according to claim 15,
The pseudo three-dimensional image generation program, wherein the center is any one of an image center of an object, a midpoint of a vertical dividing line, and a center of gravity. A pseudo three-dimensional image generation program according to claim 15 or 16,
A pseudo three-dimensional image generation program characterized in that the computer as the depth calculation means gives the furthest depth data to the pixels on the contour line of the object. A pseudo three-dimensional image generation program according to any one of claims 15 to 17,
A computer as the depth calculation means assigns depth data using a continuous function, and a pseudo three-dimensional image generation program. A pseudo three-dimensional image generation program according to any one of claims 15 to 18,
A computer as the depth calculation means assigns depth data closest to a pixel in a central area of the object, and a pseudo three-dimensional image generation program. A pseudo three-dimensional image generation program according to any one of claims 15 to 19,
The computer as the depth calculation means smoothes the given depth data using a low-pass filter. The pseudo three-dimensional image generation program according to any one of claims 15 to 20, wherein the computer functions as a resolution reduction unit that reduces the resolution of the texture data divided into objects.   A computer-readable recording medium on which the pseudo three-dimensional image generation program according to any one of claims 15 to 21 is recorded. An image generation system that generates a pseudo three-dimensional image from texture data to be imaged,
A texture data generating unit that generates texture data obtained by dividing an object from the image data to be imaged;
A pseudo three-dimensional image generation unit that adds pseudo depth data to the texture data obtained by the object division;
The pseudo three-dimensional image generation unit includes an input unit that inputs the texture data from the texture data generation unit;
Depth providing method determining means for drawing a line segment so as to cover the input texture data;
Depth calculation means for providing continuous depth data to pixels on the drawn line segment is provided, and the depth assignment method determination means selects a center type based on the feature amount of each object, and An image generation system characterized in that a center is obtained and a radiation component is drawn with the obtained center as a start point and the contour line of the object as an end point.