JP2000011201A - Image simulation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable even an unskilled operator to easily operate and to form a composite image of high quality without spoiling its perspective feeling by mapping a pasted image which is converted into data of a view point coordinate system in a masking area. SOLUTION: The operator specifies a masking area by matching an area whose pattern is changed in a three-dimensional image I at a 1st display part 14a with its broken line 21. Namely, the orthogonal three-dimensional coordinates X, Y, and Z of the masking area and the three-dimensional coordinates of view point are specified. A controller stores pasted images with mutually different patterns corresponding to respective parts of a house. Then the controller converts the orthogonal three-dimensional coordinate data of (x), (y), and (z) of the specified pasted images to data of the orthogonal three-dimensional coordinates of X, Y, and Z so that the specified pasted images and specified masking area are superposed on each other. Further, the controller maps the pasted images converted to the data of the view point coordinate system in the masking area.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image simulation apparatus for creating a composite image.

[0002]

BACKGROUND OF THE INVENTION Problems to be Solved by the Invention
The three-dimensional photo image 1 of the house as shown in FIG. 1 is displayed on the screen of the image display device, and further, a composite image in which a part of the image 1 is changed in pattern and color is created, so that the house can be displayed. An image simulation device capable of confirming an image of an actual building is used.

In the conventional image simulation apparatus, when changing a pattern of a part of the image 1, masking for designating an area to be changed on the screen is performed, and an image having another pattern is pasted on the masking area. It was done by mapping to attach.

[0004] The pattern in such a three-dimensional photographic image 1 changes depending on the viewpoint position when the image 1 is photographed. For example, in a three-dimensional photographic image of a house having a roof pattern made up of a number of rectangular tiles, the shape of each tile differs depending on the viewpoint position when the image was taken.

However, in the conventional image simulation apparatus, the pattern of the pasted image cannot be changed to an accurate three-dimensional image. For example, when the roof portion 1a of the three-dimensional image 1 is changed from slate roofing to rectangular tile roofing, the shape of the tile after the change is always rectangular. For this reason, it was not possible to confirm an accurate image when the house was actually built.

[0006] Therefore, the pattern of the pasted image is changed before the mapping, and the image after the change is mapped to the masking area. The change of the pattern of the pasted image is performed by transforming the image data of the two-dimensional coordinate system before the change based on, for example, a coordinate transformation formula called affine transformation.

[0007] However, since the conversion simply matches the outer shape, it is difficult to obtain an accurate image, and the actual appearance is different. For example, a pasted image 2 having a pattern of a plurality of equally-sized rectangles 2a as shown in (1) of FIG. 2 is changed to a pasted image 2 'as shown in (2) of FIG. 2 by affine transformation. When making it, each rectangle 2 of the pasted image 2 before the change
Side K ′ of pasted image 2 ′ after change corresponding to side K of a
Becomes longer as the distance from the viewpoint increases (to the right in the figure). This actually contradicts the appearance that the distance becomes shorter as the distance from the viewpoint increases, and the perspective is impaired.

An object of the present invention is to provide an image simulation apparatus capable of solving the above-mentioned problem.

[0009]

According to the present invention, there is provided an image simulation apparatus comprising: an image display unit; a unit for specifying a masking region in a display image by orthogonal three-dimensional coordinates; and a viewpoint coordinate in the specified masking region. Means for specifying, means for storing the data of the pasted image in the masking area as data of the rectangular coordinate system, means for converting the data of the pasted image to the data of the specified viewpoint coordinate system, Means for mapping the pasted image converted to the coordinate system data to the masking area. According to the present invention, since the pasted image can be converted into data in the viewpoint coordinate system and mapped to the masking area, it is possible to prevent the perspective from being hindered when the pattern is changed.

[0010]

Embodiments of the present invention will be described below with reference to the drawings.

An image simulation apparatus 11 shown in FIG.
Is a control device 12 constituted by a computer, and a first input device 1 such as a mouse connected to the control device 12.
3a, second input device 13b such as keyboard, display device 1
And an image input device 15 such as an image scanner.

FIG. 4 shows a screen of the display device 14, which has first to third display portions 14a, 14b and 14c.

On the first display section 14a, a three-dimensional image input from the image input device 15 or a three-dimensional image stored in the control device 12 in advance is displayed. In the present embodiment, a three-dimensional image 1 of a house as shown in FIG. 1 is displayed.

The second display section 14b displays an XYZ orthogonal 3
It corresponds to the XZ plane in the dimensional coordinate system. A cursor image 18a that moves in response to an input from the first input device 13a is displayed on the second display unit 14b. The control device 1
2 is switched between a masking region specifying mode and a viewpoint specifying mode by an input from the second input device 13b.
In the masking region specifying mode, XZ coordinates for specifying the masking region can be input to the control device 12 corresponding to the position of the cursor. In the viewpoint specifying mode, XZ coordinates for specifying the viewpoint can be input to the control device 12 corresponding to the position of the cursor.

The third display section 14c displays the XYZ orthogonal 3
It corresponds to the XY plane in the dimensional coordinate system. The cursor image 18a that moves in response to an input from the first input device 13a is also displayed on the third display unit 14c. The cursor image 18a is displayed on the second display unit 14b and the third display unit 1
4c can be selectively displayed. In the masking region specifying mode, XY coordinates for specifying the masking region can be input to the control device 12 corresponding to the position of the cursor. In the viewpoint specifying mode, XY coordinates for specifying the viewpoint can be input to the control device 12 corresponding to the position of the cursor.

Note that the X coordinate of the masking area or viewpoint specified in accordance with the position of the cursor in the second display unit 14b and the masking area or viewpoint specified in accordance with the position of the cursor in the third display unit 14c. Is different from the X coordinate, the masking area or the viewpoint is specified by the X coordinate input later.

The pixels of the image displayed on the first display section 14a correspond to XYZ orthogonal three-dimensional coordinates, and the correspondence changes according to the viewpoint position. The correspondence between the pixels that change according to the viewpoint position and the three-dimensional orthogonal coordinates is stored in the control device 12. Based on the correspondence, the control device 12
The outline of the masking region corresponding to the masking region and the viewpoint specified on the display unit 14b and the third display unit 14c is displayed on the first display unit 14a by, for example, a dashed line 21 as illustrated.
Display by

The operator specifies the masking area by matching the area where the pattern is to be changed in the three-dimensional image 1 on the first display section 14a with the broken line 21. In the illustrated example, the roof portion 1a of the image 1 is specified. That is, the XYZ orthogonal 3 of the masking area
The three-dimensional coordinate system and the three-dimensional coordinate system of the viewpoint are specified.

The control device 12 stores a plurality of pasted images having different patterns corresponding to each part of the house. Each pasted image is, for example, a rectangle having a predetermined size on the xy plane, and is stored as xyz orthogonal three-dimensional orthogonal coordinate data having a zero size in the z-axis direction. The size of the pasted image is set singly or plurally so as to match the size of the masking area. The operator can specify one of the pasted images having the same size as the masking area or smaller than the masking area by the input from the second input device 13b.

The control device 12 converts the data of the xyz orthogonal three-dimensional coordinates of the specified pasted image into the XYZ orthogonal three-dimensional coordinates so that the specified pasted image and the specified masking area overlap. Convert to coordinate data. If the size of the pasted image is smaller than the masking area, first, the image data is converted so that, for example, the masking area closest to the origin and the pasted image overlap. Next, the data of the XYZ orthogonal three-dimensional coordinates of the pasted image is converted into data of a viewpoint coordinate system corresponding to the image when the pasted image is viewed from the specified viewpoint. The conversion can be performed by a known method. For example, the coordinates in the line-of-sight direction are W, the coordinates of the perpendicular foot lowered from the W on the XY plane are U, the coordinates of the perpendicular foot lowered from the W on the XZ plane are V, and the coordinate of the perpendicular foot is W on the XY plane. The horizontal declination that the line connecting the foot of the lowered perpendicular and the origin makes the X axis in the XY plane is θ, and the line connecting the foot of the perpendicular dropped from the W to the XZ plane and the origin is in the XZ plane. Is the vertical declination with the X axis, and the viewpoint coordinates are (Xs, Ys, Zs)
Can be converted by the following conversion formula. U = − (X−Xs) sin θ + (Y−Ys) cos θ V = − ｛− (X−Xs) cos θ + (Y−Ys) sin
θ｝ sinψ + (Z−Zs) cosψ W = ｛− (X−Xs) cos θ + (Y−Ys) sin
θ｝ cosψ + (Z−Zs) sinθ Alternatively, the line-of-sight vector E = (Ex, Ey, Ez), viewpoint coordinates (Vx, Vy, Vz), pixel value (Px, P
y, Pz) can be converted by the following conversion formula. Ex = (Px−Vx) / L, Ey = (Py−Vy) /
L, Ez = (Pz−Vz) / L L = ｛(Px−Vx) ² + (Py−Vy) ² + (Pz−
Vz) ² ｝ ^1/2

The control device 12 maps the pasted image converted into the data of the viewpoint coordinate system onto the masking area. If the size of the pasted image is smaller than the masking area, this mapping is repeated, for example, in order from the masking area closest to the origin.

In the above embodiment, not only the pattern in the masking area but also the color change is made possible. For example,
The control device 12 stores the color data in the masking area as density values (RGB values) of the three primary colors of red (R) green (G) and blue (B), and stores the RGB values in hue (H) and saturation (S). ), The value is converted into a value of lightness (V), only the value of the hue is changed, and then the value is inversely converted into an RGB value.

For the shadow in the masking area, the RGB values are converted into hue H, saturation (S), and lightness (V) values, and only the saturation and lightness values are changed.
This is performed by a well-known method of converting back to a value.

The present invention is not limited to the above embodiment. For example, the image to which the present invention can be applied is not limited to a house image.

[0025]

According to the image simulation apparatus of the present invention, it is possible to easily operate even an unskilled operator,
It is possible to obtain a high-quality composite image that does not impair the perspective.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example of a three-dimensional image.

FIGS. 2A and 2B are explanatory diagrams of a conventional problem.

FIG. 3 is a configuration explanatory view of an image simulation apparatus according to the embodiment of the present invention;

FIG. 4 is an explanatory diagram of a screen of a display device of the image simulation device according to the embodiment of the present invention.

[Explanation of symbols]

 11 image simulation device 12 control device

Claims (1)

[Claims] 1. A means for displaying an image, a means for specifying a masking area in the display image by orthogonal three-dimensional coordinates, a means for specifying viewpoint coordinates in the specified masking area, and a pasting image in the masking area Means for storing the data of the coordinate system as data in the rectangular coordinate system, means for converting the data of the pasted image to the data of the specified viewpoint coordinate system, and means for pasting the image converted to the data of the viewpoint coordinate system. , A means for mapping to the masking area.