JP2000293667A - Picture synthesizing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a user to easily prepare a synthetic picture without any feeling of incongruity without any special experience or intuition in synthesizing a textures picture with a original picture. SOLUTION: A picture synthesizing device which synthesizes a textures picture with part of an original picture is provided with a picture inputting device 10 which inputs the original picture and the texture picture, an instruction inputting device 12 which designates a synthetic region with which the texture picture is synthesized in the original picture, and designates the parameters for operating the projective normal transformation of the coordinate values of the synthetic region into the coordinate values on the texture picture, and a picture synthesizing device 14 which generates mask data indicating the synthetic region, and operates the projective normal transformation to the coordinates in the synthetic region on the basis of the designated parameters for calculating relative coordinate values, and calculates the texture coordinate values on the texture picture from the relative coordinate values, and synthesizes the texture picture in the synthetic region on the basis of the texture coordinate values.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image synthesizing apparatus which is suitable for synthesizing another texture image with a desired area in an original image to create a synthetic image.

[0002]

2. Description of the Related Art In the catalog of products such as building exterior and interior materials, kitchen and storage doors, actual construction examples are listed only for some products, and for other products, only color and material samples are used. In many cases, the customer has to look at actual construction examples and samples, imagine the appearance when a desired sample is applied to the construction examples, and select a product.

[0003]

As described above, since there is no actual construction example for each product in the catalog, there is a problem that it is difficult for a customer to grasp an image in order to select a product. . The above problem can be solved by actually creating a construction example for all products and creating a catalog, but for that purpose, the cost is too high and impractical.

[0004] As another solution, there is a method of combining another product sample image with an image of an actual construction example. However, in order to obtain a combined image without a sense of incongruity, a skilled operator uses experience and intuition. It is necessary to perform synthesis by trial and error, and it is difficult to perform this operation on many product samples, and the cost increases.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned conventional problems, and has a special experience in synthesizing a texture image such as a sample product image with an original image such as a construction example of an arbitrary product. An object of the present invention is to provide an image synthesizing apparatus that can easily create a synthetic image without a sense of incongruity without any intuition.

[0006]

According to the present invention, there is provided an image synthesizing apparatus for synthesizing a texture image with a part of an original image, a means for inputting the original image, and a means for inputting the texture image to be synthesized with the original image. Means for designating a synthesis area in which the texture image is synthesized in the original image; means for specifying parameters for performing coordinate conversion of the coordinate values of the synthesis area into coordinate values on the texture image; Means for performing coordinate transformation on the coordinates in the synthesis area to calculate relative coordinate values, means for calculating texture coordinate values on the texture image from the relative coordinate values, and the synthesis based on the texture coordinate values This problem has been solved by providing a configuration including a synthesizing unit that synthesizes a texture image in an area.

In the present invention, a parameter for converting the coordinate value of the synthesis area specified on the original image into the coordinate value on the texture image is specified, and the coordinates in the synthesis area are determined based on the parameter. Since coordinate conversion is performed to calculate relative coordinate values, texture coordinate values on the texture image are calculated from the relative coordinate values, and a texture image is synthesized in the synthesis area based on the texture coordinate values. By utilizing the correspondence between these three coordinate systems, a texture image of an arbitrary size can be synthesized with the synthesis area, and a synthesized image without a sense of incongruity can be created.

[0008]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a block diagram showing a schematic configuration of an image synthesizing system (image synthesizing apparatus) according to an embodiment of the present invention. The image composition system according to the present embodiment includes an image input device 10, an instruction input device 12, an image composition device 14, a display device 16, and an image output device 18.

The image input device 10 includes an image scanner for inputting an original image and a texture image to be synthesized with the original image, and a storage device such as a hard disk capable of storing and reading these image data. The instruction input device 12 includes a keyboard, a mouse, and the like. The instruction input device 12 is used to specify a synthesis area for synthesizing the texture image in the original image, or to convert the coordinate value of the synthesis area into a coordinate value on the texture image. Parameter can be specified.

The image synthesizing device 14 is constituted by a computer. The image synthesizing device 14 includes means for performing coordinate conversion on coordinates in a synthesizing area based on designated parameters and calculating relative coordinate values. Means for calculating a texture coordinate value on the texture image from the relative coordinate value and means for synthesizing the texture image in the synthesis area based on the texture coordinate value are realized by software. The display device 16 is composed of a display such as a CRT or a liquid crystal, and displays an original image, a texture image, a composite image, and the like.
The output device 18 is composed of a printer or the like, and can output a composite image or the like.

More specifically, the image synthesizing apparatus 14 includes means for generating original image luminance data consisting only of luminance information of each pixel of the original image by software; A luminance changing means for changing the luminance of the original image based on the original image luminance data and a parameter for controlling the difference between light and dark is realized. Similarly, mask data created in consideration of the obstruction view area is applied to the synthesis area, and the parameters used for the coordinate transformation include the rectangular shape in an actual three-dimensional space. Four-vertex coordinates for defining a rectangular area on the image are included, and the means for calculating the relative coordinate values can perform coordinate conversion based on the parameters in consideration of the mask data. ing.

Similarly, the parameters used for the coordinate transformation include the actual size in the three-dimensional space of the square representing the synthesis area on the original image which is rectangular in the actual three-dimensional space. Sx, Sy), wherein the synthesizing means comprises:
The texture image can be repeatedly synthesized in the synthesis area a number of times according to the relative ratio between the actual size of the rectangle (Sx, Sy) and the actual size of the texture image (Strx, Stry). It has become. Further, a plurality of the texture images are prepared, and the means for calculating the texture coordinate values includes, when another new texture image is selected, the texture coordinate values based on the relative coordinate values already obtained. It can be calculated.

Next, the operation of this embodiment will be described with reference to the flowchart shown in FIG.

First, an original image (FIG. 3) and a texture image (FIG. 4) are input by an image input device (steps 1 and 2).
In FIG. 3, the two-dot chain line attached to the front surface of the rear object (cube) indicates the boundary of the shadow generated by the front cube, because it is difficult to identify the shadow.

Next, mask data representing an area where a texture image is to be synthesized is created (step 3). This mask data represents an effective area for synthesizing a texture in the original image.
Or Perspect is different.
That is, the original image is created by setting a different identification number for each area that does not become the same plane when considering the actual three-dimensional space.

As an example of the mask data, array data having the same coordinate values in the vertical and horizontal directions as the original image is prepared, and a value of 0 is set for pixels for which texture synthesis is not performed. The above-mentioned identification number is set to the pixel for performing the above. Here, as an example of this mask data creation procedure, as shown in FIGS. 5 and 6, an image in which only the synthesis area is processed into an arbitrary color (here, white) based on the original image is prepared. Mask data as shown in FIG. 7 was created from the image. Here, for the sake of convenience, the area in which synthesis is not performed is shown as white, and different colors (black and gray) are shown for each effective area in which synthesis is performed. Further, in the present embodiment, in the original image of FIG. 3 described above, in the case of a rear cube in which there is an obstruction area in which the visual field is obstructed by the cube in front, as shown in FIG. Then, the mask data in the range excluding the light-shielded area is created.

Next, a parameter for projectively normalizing conversion of the coordinate value of the synthesized area on the original image into which the texture image is synthesized to the coordinate value on the texture image is designated (step 4). In this operation, the coordinates of the vertices P1 to P4 of the rectangle on the same plane in the actual three-dimensional space and the x-direction of the rectangle in the actual three-dimensional real space are calculated. , Y-direction sizes Sx and Sy are designated by the instruction input device 12. In this case, if the actual size of the rectangle is known or can be estimated, the value may be specified, but the size of the rectangle is not known,
If the size in the original image cannot be estimated from a known size or the like, how many texture images are arranged in the vertical and horizontal directions in the area surrounded by the designated vertices P1 to P4. There is no problem using relative values,
In this case, it is only necessary to specify 1 when specifying the actual sizes Strx and Stry of the texture image described later.

Here, the coordinates (parameters) of the designated four vertices will be supplemented. These coordinate values are determined by the synthesis area itself for synthesis or the mask area (defined by the mask data) as shown in FIG. It is needless to say that it can be specified for the effective area, but it is not directly related to the mask area and it is an area on the original image that is on the same plane in the actual three-dimensional space, that is, if the perspective is the same. For example, there is no problem even if it is specified outside the mask area, and even if it is specified outside the area of the original image.

FIG. 8 shows an example of specifying a coordinate value for a mask area corresponding to the composite area shown in FIG. 5 as a specific example of parameter specification. In this figure, the vertices of the square on the original image, which is rectangular in the actual three-dimensional space, are P1
The coordinates (x1, y1) to (x4, y4) of .about.P4 are specified, and the sizes Sx and Sy of the quadrangle in the respective x and y directions on the actual three-dimensional space are specified. Regarding P2, it is hidden by the object in front, and the vicinity (obstruction area) is outside the effective area in the mask data shown in FIG. 7, but the parameter designation is not directly related to the mask area as described above. Any point on an area that will become a rectangle in the actual three-dimensional space can be used without any problem. It is necessary to specify the parameters for all the mask areas to be combined. However, if the parameters are on the same plane in the actual three-dimensional space, that is, if the original image has the same perspective, The same parameters can be applied.

Next, various kinds of arithmetic processing described in detail below are performed by the image synthesizing device 14. First, a projective normalization transformation is performed on the coordinates in the synthesis area based on the parameters (this coordinate transformation is described in detail, for example, in “Computer Geometry and Geographic Information Processing” bit separate volume Kyoritsu Shuppan (1986)). Do. More specifically, according to equations (3) and (4) including c and d defined by the following equations (1) and (2), all pixels included in a region where texture synthesis described later is performed Then, projective normalization conversion is performed to calculate relative coordinate values α and β (step 5). Here, the relative coordinate value is given by a value normalized to a rectangular coordinate composed of the actual sizes Sx and Sy in the x and y directions.

[0022]

(Equation 1)

In the calculation of the relative coordinate value in step 5,
Using the above-mentioned vertex coordinates (x1, y1) to (x4, y4) and the parameters of the actual sizes Sx and Sy, the above (1) to (4)
At the time of coordinate conversion by the formula, processing is performed in consideration of the mask data (mask area). This eliminates the need to perform the coordinate conversion calculation process on the range of the obstruction view area, if any, so that the amount of calculation can be reduced and the processing can be speeded up.

Next, a texture image to be synthesized is selected (designated) from those already input by the instruction input device 12 (step 6), and a synthesis area (one area or a plurality of areas) for synthesizing the texture image is selected. Is acceptable) (step 7). At this time, if the texture image to be synthesized is reduced and synthesized, it is necessary to perform low-pass filtering or the like on the texture image in advance to suppress the occurrence of moire.

Next, the actual size of the texture image to be synthesized is specified (as described above, 1 is specified when the size of the rectangle is specified by the relative value of how many texture images are arranged). Then, the relative coordinate values (α, β) calculated by performing the above-described projective normalization transformation on the coordinate values in the synthesis area to be synthesized are used as the actual size of the texture image and the pixel unit of the texture image. Coordinate values (x _t , y _t ) on the texture image to be actually synthesized from the size
Then, texture coordinate conversion is performed by the following equation (step 8). At this time, when x _t and y _t are less than 0 (when α and β are negative in a relative coordinate system as shown in FIG. 11 to be described later) or are greater than Stpx and Stpy, the remainder obtained by dividing by Stpx and Stpy is used. Calculate and set the coordinate value on the texture image with the number of surplus pixels.

[0026]

(Equation 2)

Next, the pixel value of each pixel constituting the texture image of the coordinates converted in step 8 is replaced with the pixel value of the pixel to be synthesized (the pixel corresponding to the synthesized area in the mask area). Then, a texture image is synthesized with the selected synthesis area (step 9). At this time, the actual size (S in the three-dimensional space of the square representing the synthesis area on the original image which is rectangular in the actual three-dimensional space
x, Sy) and the actual size of the texture image (Str
x, Stry), and the texture image is repeatedly synthesized in the synthesis area the number of times given as a relative ratio obtained by the above-described method. The details of this repetitive synthesis will be described later for convenience.

Next, the luminance of the synthesized texture image is changed based on the luminance data of the original image (step 1).
0). Specifically, the luminance of each pixel in the area where the texture image has been synthesized by the synthesis processing in step 9 is changed by the following equation (7). This makes it possible to increase or decrease the difference in lightness and darkness in the combined area of the original
By adjusting the difference between the average luminance of the original image and the average luminance of the synthesized texture image to be larger or smaller, it is possible to obtain a more natural synthesized image. Here, by changing each parameter, even when it is desired to synthesize a texture image having an extremely different material and reflectance on the synthesis area of the original image, a natural synthesized image without a sense of incongruity can be obtained. If there is another texture image to be synthesized, step 6
Steps 10 to 10 are repeated (step 11).

FIG. 9 actually shows the original image of FIG.
FIG. 4 shows a composite image created by setting the mask data of FIG. 4 and combining the texture image of FIG. In FIG. 9, it is difficult to understand because the gradation difference is not clear, but a shadow indicated by a two-dot chain line as in FIG. 3 is reflected in the composite image.

[0030]

(Equation 3)

Next, for the sake of convenience, in calculating the coordinate values on the texture image as described above, the relative coordinate values α and β are calculated once, and then the reason for calculating x _t and y _t is as follows. Will be described in detail with reference to the drawings.

Now, assuming that the actual size of the composite area shown in FIG. 10 is, for example, a width of 5 and a height of 3 in m units, the coordinates after being converted into α and β are as shown in FIG. (The calculation up to this point is the size of the texture in pixel units,
Can be calculated regardless of the actual size). Here, in this area, the texture image (the size in pixel unit: 100 × 100, the actual size: 1 × 1) schematically shown in FIG. 12 is converted into the coordinate value on the texture image. FIG. 14 shows the result obtained as a result of repeatedly synthesizing the texture image. The result of converting the texture image (size in pixel unit: 150 × 150, actual size: 2 × 2) schematically shown in FIG. 13 into coordinate values on the texture image is shown in FIG. FIG. 15 shows the result of repeated synthesis.

As is apparent from this example, by specifying the actual size of the areas P1 to P4, the size of the texture image in pixel units, and the actual size, the image is synthesized with an actual size. It is possible to Further, once α and β are calculated, α and β can be calculated independently of the size of the texture image. Therefore, even when texture images having different actual sizes are synthesized in pixel units, α and β are calculated. Can be reused, so that the amount of calculation can be reduced.

Although the present invention has been specifically described above, the present invention is not limited to the above-described embodiment, and can be variously modified without departing from the gist thereof.

For example, in the above-described embodiment, the projective normalization transformation is adopted as the coordinate transformation. However, the present invention is not limited to this. There is no limitation as long as the coordinate transformation is performed.
Further, the specific configuration of the image synthesizing device is not limited to that shown in FIG.

[0036]

As described above, according to the present invention, when combining a texture image such as a product sample image with an original image such as an example of construction of an arbitrary product, even if there is no special experience or intuition. Thus, it is possible to easily create a composite image without a sense of discomfort.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a schematic configuration of an image synthesizing apparatus according to an embodiment of the present invention;

FIG. 2 is a flowchart showing the operation of the embodiment;

FIG. 3 is an explanatory diagram showing an example of an original image.

FIG. 4 is an explanatory diagram showing an example of a texture image.

FIG. 5 is an explanatory diagram showing a procedure for creating mask data.

FIG. 6 is another explanatory diagram showing a procedure for creating mask data.

FIG. 7 is an explanatory diagram showing an example of created mask data.

FIG. 8 is an explanatory diagram showing how to specify parameters.

FIG. 9 is an explanatory diagram illustrating an example of a composite image.

FIG. 10 is a diagram showing an example of a composite area in which parameters are set.

FIG. 11 is a diagram showing a state where the synthesis area is converted into relative coordinates.

FIG. 12 is a diagram schematically illustrating an example of a texture image;

FIG. 13 is a diagram schematically showing another example of the texture image.

FIG. 14 is a diagram showing an image obtained by synthesizing the texture image of FIG. 12;

FIG. 15 is a diagram showing an image obtained by synthesizing the texture image of FIG. 13;

[Explanation of symbols]

 REFERENCE SIGNS LIST 10 image input device 12 instruction input device 14 image synthesis device 16 display device 18 image output device

Continuation of the front page F term (reference) 5B057 AA01 CA08 CA12 CA16 CB08 CB13 CB16 CC03 CD14 CE08 CE11 5B080 AA15 BA07 FA08 GA22

Claims (6)

[Claims] An image synthesizing apparatus for synthesizing a texture image with a part of an original image, means for inputting an original image, means for inputting a texture image to be synthesized with the original image, Means for specifying a synthesis area for synthesizing an image; means for specifying a parameter for performing coordinate conversion of the coordinate value of the synthesis area into a coordinate value on the texture image; Means for performing coordinate transformation to calculate relative coordinate values, means for calculating texture coordinate values on the texture image from the relative coordinate values, and synthesizing a texture image in the synthesis area based on the texture coordinate values. An image synthesizing apparatus, comprising: synthesizing means. 2. A means for generating original image luminance data consisting only of luminance information of each pixel of the original image, and controlling a difference between the luminance of the synthesized texture image and the luminance data of the original image. An image synthesizing apparatus characterized in that the image synthesizing apparatus is provided with a luminance changing unit that changes based on a parameter for performing the operation. 3. The method according to claim 1, wherein mask data created in consideration of the obstruction view area is applied to the synthesis area, and parameters used for the coordinate transformation include an actual three-dimensional space. Four-vertex coordinates for defining a rectangular area on the original image to be a rectangle are included, and the means for calculating the relative coordinate values performs coordinate conversion based on the parameters in consideration of the mask data. An image synthesizing apparatus characterized by the above-mentioned. 4. A method according to claim 1, wherein the parameters used for the coordinate transformation include a rectangle representing a synthesis area on the original image which is rectangular in an actual three-dimensional space, and an actual size in the three-dimensional space. Sa (Sx, Sy)
The combining means determines that the actual size of the rectangle (Sx, Sx
y) and the actual size of the texture image (Strx, Str)
an image synthesizing apparatus, wherein the texture image is repeatedly synthesized in the synthesis area a number of times corresponding to a relative ratio to y. 5. The apparatus according to claim 1, wherein a plurality of the texture images are prepared, and the means for calculating the texture coordinate value is a new one for a combined area that is on the same plane in an actual three-dimensional space. An image synthesizing apparatus characterized in that when a texture image is selected, the texture coordinate value is calculated based on the relative coordinate values already obtained. 6. The coordinate transformation according to claim 1, wherein the parameter used for the coordinate transformation is a parameter for performing a projective normalization transformation, and the coordinate transformation by means for calculating the relative coordinate value. Is a projective normalization transformation.