JP2002245486A - Device, method and program for three-dimensional model generation - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a three-dimensional model generating device which can easily generate space in a complicated shape such as a shape with recessed and projection parts, a curved shape, and a branched shape through few input operations. SOLUTION: This device is equipped with a background area specification part 1 which generates background area data according to plane coordinates corresponding to an end point of an area in a partial space, a spatial three- dimensional information generation part 11 which generates spatial three- dimensional data by connecting partial spaces according to the background area data, a connection information setting part 12 which sets the connection relation among the partial spaces, and a space texture information generation part 13 which generates partial space texture data according to a still picture and the background area data, maps texture to surfaces other than connection surfaces according to the connection relation and spatial three-dimensional data when the texture data generation processing for all the partial spaces is completed, and generates a three-dimensional model by connecting the spaces.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional model generating apparatus and a three-dimensional model generating method for generating a three-dimensional model of an object or a three-dimensional model of a space in which objects are arranged, using an image of the space. It relates to a three-dimensional model generation program.

[0002]

2. Description of the Related Art The prior art will be described below. For example, as a conventional three-dimensional model generating apparatus that three-dimensionally models an indoor space using a panoramic image captured from one viewpoint, Japanese Patent Application Laid-Open No. 2000-11172 discloses a “virtual environment generating method and apparatus, And a recording medium on which a virtual environment program is recorded. Here, when the operator specifies a feature point on a panoramic image of the indoor space, the viewpoint position, the viewpoint and the floor, and the relative positional relationship between the viewpoint and the ceiling are obtained from the specified feature point, and the indoor three-dimensional model is obtained. Is simply created.

As a conventional three-dimensional model generating apparatus for generating a space with an object, for example, there is a “virtual building experience method and apparatus” described in JP-A-9-244522. Here, the operator creates a three-dimensional model of the building (virtual space of the building) simply by interactively operating while specifying the line segment to be the wall on the plan view of the building. You can experience the created virtual space virtually. In this apparatus, objects to be arranged inside a building are created in advance by modeling software or the like, and are arranged inside the building.

[0004]

SUMMARY OF THE INVENTION However,
The conventional 3 described in Japanese Patent Application Laid-Open No. 2000-11172
In the three-dimensional model generation device, since the space is created as one rectangular parallelepiped, the rectangular parallelepipeds have, for example, a case where there is a missing space such as being connected in an L-shape, a case where the rectangular shape has a bent shape, There is a problem that it is difficult to create a space having a complicated shape when the space is branched in an arbitrary direction.

Further, in the conventional three-dimensional model generating apparatus described in the above-mentioned Japanese Patent Application Laid-Open No. 9-244522, there is a problem that an object to be placed in a room needs to be created in advance by another modeling software. Was. In addition, in the modeling work, there is a problem that it is difficult for a beginner to easily create a three-dimensional model of the object because a complicated work such as inputting many feature points of the object is required. Also, in order to place an object in a room, it is necessary to scale the size of the object according to the space in which it is to be placed,
There is a problem that no one can easily create a three-dimensional model of a room in which objects are arranged.

The present invention has been made in view of the above, and it is possible to easily create a space having a complicated shape such as a shape having a concave / convex portion, a curved shape, or a branch shape with a small number of input operations. It is an object to obtain a three-dimensional model generation device, a three-dimensional model generation method, and a three-dimensional model generation program.

[0007]

Means for Solving the Problems The above-mentioned problems are solved,
In order to achieve the object, a three-dimensional model generation device according to the present invention has a configuration in which a three-dimensional model of a space is created using an image of a space, and for example, a still image of a subspace is displayed. A background area data generating means (corresponding to a background area specifying unit 1 of an embodiment described later) for generating background area data based on plane coordinates corresponding to an end point of an area in the subspace; Means for generating spatial three-dimensional data by connecting a plurality of subspaces (a spatial three-dimensional information generating unit 1).
1), connection information setting means (corresponding to the connection information setting unit 12) for setting a connection relationship between subspaces (including predetermined size information on each surface and three-dimensional coordinates of end points), and the still image And generating the subspace texture data based on the background area data, and at the stage where the texture data generation processing for all the subspaces is completed, the texture is applied to a surface other than the connection surface based on the connection relationship and the spatial three-dimensional data. A three-dimensional model generation means (corresponding to the space texture information generation unit 13) for generating a three-dimensional model by mapping and connecting a plurality of spaces;
It is characterized by having.

In the three-dimensional model generating apparatus according to the next invention, a configuration is used in which a three-dimensional model of the space is created by using an image of the space, for example, a still image of the subspace is displayed, Background area data generating means for generating background area data based on the plane coordinates corresponding to the end points of the area within, and subspace three-dimensional data generating means for generating subspace three-dimensional data based on the background area data ( A connection information setting unit for setting a connection relationship between the subspaces (including predetermined size information on each surface and three-dimensional coordinates of an end point); Generating subspace texture data based on the background region data, and further mapping a texture on the subspace based on the subspace three-dimensional data; When the subspace three-dimensional model generation means (corresponding to the subspace texture information generation unit 42) for generating a three-dimensional model of the subspace and all the subspace three-dimensional model generation processes are completed, the subspace three-dimensional model And three-dimensional model connection means (corresponding to the subspace connection unit 33) for generating a three-dimensional model by cutting out the texture of the connection surface between the subspaces based on the connection relationship and connecting a plurality of spaces. It is characterized by having.

In the three-dimensional model generating apparatus according to the next invention, the shape of the object is approximated by a rectangular parallelepiped based on the still image, and designated vertex data as plane coordinates of the designated vertex; Vertex data generating means (corresponding to the object two-dimensional information generating unit 81) for generating non-designated vertex data which is plane coordinates of vertices other than.
A subspace-with-object three-dimensional data generating means (object) that generates subspace-with-object three-dimensional data in which objects are arranged in a subspace based on the subspace three-dimensional data, the background region data, and the designated vertex data And generates object texture data based on the still image, the background area data, and the vertex data, and further generates the object texture data, the object-added subspace three-dimensional information. A subspace three-dimensional model with object for generating a subspace three-dimensional model with an object by mapping a texture based on the data, the three-dimensional subspace data, and the subspace texture data; And corresponding to 112), wherein the three-dimensional model connecting means (space with the object generation unit 12
5), at the stage when all the subspace 3D model generation processes are completed, a plurality of subspaces are created based on the subspace 3D model, the subspace 3D model with objects, and the connection relation. It is characterized in that a connected three-dimensional model is generated.

[0010] In the three-dimensional model generating apparatus according to the next invention, a still image including an object to be modeled is displayed from the still images, and the still image is displayed in parallel with the back surface of the object. A virtual background area data generating means (corresponding to the virtual background area designating section 171) for generating virtual background area data corresponding to a virtual background area that touches and intersects the wall surface, based on the height and width of the virtual background area; Means for generating virtual background area three-dimensional data representing three-dimensional coordinates of all vertices of the virtual background area (corresponding to virtual background area three-dimensional data generation unit 172); Tilt calculating means (tilt meter) for generating object tilt data representing an angle between a real wall surface and a virtual wall surface based on the data and the three-dimensional data of the virtual background region. And a specified vertex data as plane coordinates of specified vertices, and non-designated vertex data as plane coordinates of other vertices, based on the still image. , And vertex data generating means (corresponding to the object two-dimensional information generating unit 81), based on the subspace three-dimensional data, the virtual background region three-dimensional data, the specified vertex data, and the object inclination data, A subspace three-dimensional data with object generating means for generating subspace three-dimensional data with objects in which objects are arranged in a subspace (corresponding to the object three-dimensional information generating unit 82)
Generating object texture data based on the still image, the virtual background area data, and the vertex data;
A subspace three-dimensional model with object generating unit that maps a texture based on the three-dimensional subspace data with object, the three-dimensional subspace data, and the subspace texture data to generate a three-dimensional subspace model with objects The three-dimensional model connection means (corresponding to the space-with-object generation unit 125) is provided at the stage where all the subspace three-dimensional model generation processing is completed. Based on the three-dimensional model, the three-dimensional subspace model with objects, and the connection relationship,
It is characterized in that a three-dimensional model in which a plurality of subspaces are connected is generated.

[0011] In the three-dimensional model generating apparatus according to the next invention, the subspace number of the subspace in operation, the surface number of the surface serving as the background of the object, and predetermined object size information are further stored in the object management table. An object management table setting means for setting (corresponding to the object management table setting unit 202) and an object for acquiring predetermined object size information from the object management table when the number of vertices of the specified object is less than four A size information obtaining unit (corresponding to the object information obtaining unit 201), wherein the subspace with object three-dimensional data generating unit is configured to perform processing based on the background area data, the designated vertex data, and the predetermined object size information. , An object with objects placed in a subspace And generating a subspace 3-dimensional data with-object.

A three-dimensional model generating apparatus according to the next invention is characterized in that the space is regarded as a set of rectangular parallelepipeds, and a three-dimensional model of the space is generated.

A three-dimensional model generating apparatus according to the next invention is characterized in that a space having a branch is regarded as a set of triangular prisms and a three-dimensional model of the space is generated.

A three-dimensional model generating apparatus according to the next invention is characterized in that a curved space is regarded as a collection of hexahedrons and a three-dimensional model of the space is generated.

In a three-dimensional model generating apparatus according to the next invention, a three-dimensional model of an object is created using a photographed image. For example, a still image of the object is displayed, and a specified partial Background area data generating means for generating background area data based on the plane coordinates corresponding to the end point of the object, and specified vertex data which is the plane coordinates of the specified vertex by approximating the shape of the object with a rectangular parallelepiped based on the still image And vertex data generating means for generating non-designated vertex data which are plane coordinates of other vertices, and object three-dimensional data for generating three-dimensional data of an object based on the background area data and the designated vertex data Generating means, the still image,
Generating object texture data based on the background area data and the vertex data;
Object three-dimensional model generating means for mapping a texture based on the dimensional data and generating a three-dimensional model of the object.

In a three-dimensional model generation method according to the next invention, a background image for displaying a still image in a partial space and generating background region data based on plane coordinates corresponding to an end point of the region in the partial space. A data generation step, based on the background area data, a subspace size data generation step of generating subspace size data representing a height and a width of a predetermined surface forming the subspace, and based on the subspace size data. To calculate the three-dimensional shape of the subspace,
A spatial three-dimensional data generating step of generating spatial three-dimensional data by connecting the three-dimensional shapes of the created partial spaces; A space management table setting step of setting predetermined size information and three-dimensional coordinates of an end point on the surface in the space management table;
A connection information setting step of setting a connection relationship between the subspaces in the connection table in accordance with the designation of the new connection surface; and, based on the connection relationship, predetermined size information on all surfaces of the newly connected subspace and A space management table adding step of adding the three-dimensional coordinates of the end point to the space management table; a subspace texture generating step of generating subspace texture data based on the still image and the background area data; At the end of the data generation process, a texture is mapped on a surface other than the connection surface based on the space management table, the connection table, and the space three-dimensional data, and a three-dimensional model in which a plurality of spaces are connected is generated. And generating a three-dimensional model.

In a three-dimensional model generation method according to the next invention, a background image for displaying a still image in a subspace and generating background region data based on plane coordinates corresponding to an end point of the region in the subspace. A data generation step, based on the background area data, a subspace size data generation step of generating subspace size data representing a height and a width of a predetermined surface forming the subspace, and based on the subspace size data. A subspace three-dimensional data generating step of generating subspace three-dimensional data that is a three-dimensional shape of the subspace, and all subspace three-dimensional data based on the subspace size data and the subspace three-dimensional data. A space management table setting step of setting predetermined size information and three-dimensional coordinates of an end point on the surface in the space management table; Connection information setting step of setting a connection relationship between subspaces in a connection table in accordance with the designation of a connection surface, and predetermined size information and end points for all surfaces of the newly connected subspace based on the connection relationship Adding a three-dimensional coordinate to the space management table; a subspace texture generating step of generating subspace texture data based on the still image and the background area data; A subspace three-dimensional model generation step of mapping a texture to the subspace based on the subspace three-dimensional model and generating a three-dimensional model of the subspace; Connection between subspaces based on the space management table and the connection table After cutting out the texture, characterized in that it comprises a three-dimensional model connection step of generating a three-dimensional model was Awa connecting a plurality of spaces, the.

In the method for generating a three-dimensional model according to the next invention, the shape of the object is approximated by a rectangular parallelepiped based on the still image, and designated vertex data as plane coordinates of the designated vertex; Vertex data generation step of generating vertex data other than the designated vertex data, which is the plane coordinates of the vertices, and, based on the background area data and the vertex data, determine whether the object is separated from the front and floor surfaces, Further, an object size data generating step of generating object size data representing the width, height and depth of the object, and, when the object is away from the front and floor, based on the background area data and the vertex data, An offset data generation step of generating offset data representing a distance; A subspace-with-objects three-dimensional data generating step of generating subspace-with-objects three-dimensional data in which objects are arranged in a subspace based on the subspace three-dimensional data, the offset data, and the object size data; An object texture generating step of generating object texture data based on the background region data and the vertex data; and the object texture data, the subspace three-dimensional data with objects, the subspace three-dimensional data, and the subspace texture data A texture-based subspace three-dimensional model with an object, and generating a subspace-with-object three-dimensional model based on the three-dimensional model. Subspace 3 of all
At the stage where the dimensional model generation processing is completed, the subspace 3
A three-dimensional model in which a plurality of subspaces are connected is generated based on the three-dimensional model, the three-dimensional subspace model with objects, the space management table, and the connection table.

[0019] In the three-dimensional model generation method according to the next invention, a still image including an object to be modeled is displayed from the still images, and the still image is displayed in parallel with the back surface of the object. A virtual background area data generating step of generating virtual background area data corresponding to a virtual background area that is in contact with and intersects the wall surface, and based on the height and width of the virtual background area,
A virtual background region three-dimensional data generating step of generating virtual background region three-dimensional data representing three-dimensional coordinates; And a tilt calculation step of generating object tilt data representing the shape of the object, and approximating the shape of the object with a rectangular parallelepiped based on the still image, using designated vertex data which is plane coordinates of a specified vertex, and plane coordinates of other vertices. A vertex data generating step of generating vertex data other than the designated vertex data; and an object size representing the width, height, and depth of the object based on the height and width of the virtual background region, the virtual background region data and the specified vertex data An object size data generating step of generating data; the subspace three-dimensional data; A subspace-with-object three-dimensional data generating step of generating subspace-with-object three-dimensional data in which objects are arranged in a subspace based on background region three-dimensional data, the specified vertex data, and the object inclination data; An object texture generating step of generating object texture data based on an image, the virtual background region data and the vertex data, the object texture data, the subspace with object three-dimensional data,
Generating a subspace three-dimensional model with an object by mapping a texture based on the subspace three-dimensional data and the subspace texture data to generate a subspace three-dimensional model with an object. In the step, at the stage when all the subspace 3D model generation processes are completed, based on the subspace 3D model, the subspace 3D model with objects, the space management table, and the connection table, It is characterized in that a three-dimensional model in which a plurality of subspaces are connected is generated.

In the three-dimensional model generation method according to the next invention, the subspace number of the subspace being worked on, the surface number of the surface serving as the background of the object, and predetermined object size information are further stored in the object management table. An object management table setting step to be set, and when the number of vertices of the specified object is less than four,
An object size information obtaining step of obtaining predetermined object size information from the object management table. In the step of generating a subspace three-dimensional data with objects, the background area data, the designated vertex data, and It is characterized by generating subspace three-dimensional data with an object in which objects are arranged in a subspace based on predetermined object size information.

[0021] In the three-dimensional model generation method according to the next invention, a background image is generated by displaying a still image of an object and generating background region data based on plane coordinates corresponding to an end point of a specified partial region. Generating step;
Vertex data generation that approximates the shape of an object with a rectangular parallelepiped based on the still image and generates specified vertex data that is plane coordinates of the specified vertex and non-designated vertex data that is plane coordinates of other vertices A step of generating object size data representing the width, height and depth of the object based on the background area data and the designated vertex data; and a three-dimensional object based on the object size data. An object three-dimensional data generating step of generating object three-dimensional data as coordinates; an object texture generating step of generating object texture data based on the still image, the background area data and the vertex data; The texture mapping based on chromatography data and the object 3-dimensional data, characterized in that it comprises a, and object 3-dimensional model generating step of generating a 3-dimensional model of the object.

A three-dimensional model generation program according to the next invention displays a still image in a subspace and generates background region data based on plane coordinates corresponding to an end point of the region in the subspace. A data generating means, a spatial three-dimensional data generating means for generating spatial three-dimensional data by connecting a plurality of partial spaces based on the background area data, and a connection relationship between the partial spaces (a predetermined size information on each surface) And connection information setting means for setting sub-space texture data based on the still image and the background area data, and completing the texture data generation processing for all sub-spaces. A texture is mapped on a surface other than the connection surface based on the connection relationship and the spatial three-dimensional data, And a three-dimensional model generating means for generating a three-dimensional model that has Awa connecting, and characterized by causing a computer to execute the.

In a three-dimensional model generation program according to the next invention, a background image for displaying a still image in a subspace and generating background region data based on plane coordinates corresponding to an end point of the region in the subspace. A data generation unit, a subspace three-dimensional data generation unit that generates three-dimensional data of the subspace based on the background area data, and a connection relationship between the subspaces (predetermined size information on each surface and three-dimensional coordinates of an end point) Connection information setting means for setting), generating partial space texture data based on the still image and the background area data, and further mapping a texture to a partial space based on the partial space three-dimensional data; Subspace 3D model generation means for generating a 3D model of the subspace, and all subspace 3D model generation processing are completed At a stage, after extracting a texture of a connecting surface between the subspaces based on the subspace three-dimensional model and the connection relation, a three-dimensional model connecting means for generating a three-dimensional model connecting a plurality of spaces; , On a computer.

According to another aspect of the present invention, there is provided a three-dimensional model generating program for displaying a still image in a subspace and generating background region data based on plane coordinates corresponding to an end point of the region in the subspace. A data generation unit, a subspace three-dimensional data generation unit that generates three-dimensional data of the subspace based on the background area data, and a connection relationship between the subspaces (predetermined size information on each surface and three-dimensional coordinates of an end point) Connection information setting means for setting), generating partial space texture data based on the still image and the background area data, and further mapping a texture to a partial space based on the partial space three-dimensional data; A subspace three-dimensional model generating means for generating a three-dimensional model of the subspace; Vertex data generating means for generating specified vertex data which is approximated by a cube and is plane coordinates of a specified vertex, and non-designated vertex data which is plane coordinates of other vertices; A subspace with object three-dimensional data generating means for generating subspace with object in which an object is arranged in a subspace based on the background region data and the designated vertex data; and the still image and the background region data And generating object texture data based on the vertex data, and furthermore, the object texture data, the subspace with object three-dimensional data,
A subspace three-dimensional model with object generating means for mapping a texture based on the subspace three-dimensional data and the subspace texture data to generate a subspace three-dimensional model with object; A three-dimensional model connection unit that generates a three-dimensional model by connecting a plurality of subspaces based on the subspace three-dimensional model, the subspace three-dimensional model with objects, and the connection relationship at a stage where the processing is completed. Are executed by a computer.

In the three-dimensional model generation program according to the next invention, a background image for displaying a still image in a subspace and generating background region data based on plane coordinates corresponding to an end point of the region in the subspace. A data generation unit, a subspace three-dimensional data generation unit that generates three-dimensional data of the subspace based on the background area data, and a connection relationship between the subspaces (predetermined size information on each surface and three-dimensional coordinates of an end point) Connection information setting means for setting), generating partial space texture data based on the still image and the background area data, and further mapping a texture to a partial space based on the partial space three-dimensional data; A subspace three-dimensional model generating means for generating a three-dimensional model of the subspace, and an object for performing modeling from the still image Virtual background area data generating means for displaying a still image in which the object is captured, and generating virtual background area data corresponding to a virtual background area that is in parallel with the back surface of the object and intersects with the wall surface, Virtual background area three-dimensional data generating means for generating virtual background area three-dimensional data representing three-dimensional coordinates of all vertices of the virtual background area based on the height and width of the virtual background area; Tilt calculating means for generating object tilt data representing an angle between a real wall surface and a virtual wall surface based on the virtual background region three-dimensional data; and a rectangular parallelepiped approximating the shape of the object based on the still image. Vertex data generating means for generating designated vertex data which is plane coordinates of vertices and non-designated vertex data which is plane coordinates of other vertices; Spatial three-dimensional data, the virtual background area three-dimensional data, the designated vertex data, and on the basis of the object inclination data,
Subspace with object 3 for generating three-dimensional subspace with object in which objects are arranged in subspace
Dimensional data generating means for generating object texture data based on the still image, the virtual background area data and the vertex data, further comprising the object texture data, the subspace three-dimensional data with objects, and the subspace three-dimensional A subspace three-dimensional model with object generating means for mapping a texture based on the data and the subspace texture data to generate a subspace three-dimensional model with object, and a stage in which all the subspace three-dimensional model generation processing is completed And a three-dimensional model connection means for generating a three-dimensional model in which a plurality of subspaces are connected based on the subspace three-dimensional model, the subspace three-dimensional model with objects, and the connection relationship. It is characterized by being executed.

According to a three-dimensional model generation program of the next invention, a still image of an object is displayed,
Background area data generating means for generating background area data based on the plane coordinates corresponding to the end point of the specified partial area; and the plane coordinates of the specified vertex which approximates the shape of the object as a rectangular parallelepiped based on the still image Vertex data generating means for generating specified vertex data which is the following, and non-designated vertex data which is plane coordinates of other vertices, and generates three-dimensional data of the object based on the background area data and the specified vertex data Object three-dimensional data generating means for generating object texture data based on the still image, the background area data, and the vertex data, and further mapping a texture based on the object texture data and the object three-dimensional data. , An object that generates a three-dimensional model of the object And-object 3-dimensional model generating means,
Is executed by a computer.

[0027]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a three-dimensional model generating apparatus according to the present invention will be described in detail with reference to the drawings. The present invention is not limited by the embodiment.

Embodiment 1 FIG.
FIG. 1 is a diagram illustrating a configuration of a first embodiment of a dimensional model generation device. In FIG. 1, reference numeral 1 denotes a background area specifying unit that outputs a background area of a specified subspace as background area data, and 2 denotes a subspace that outputs the size of a surface forming the subspace as subspace size data. 3 is a size acquisition unit, and 3 is the size of the subspace based on the subspace size data.
A spatial three-dimensional data generation unit that calculates a three-dimensional shape and outputs the three-dimensional geometric data of the space after joining with the already created subspace as three-dimensional spatial data, and 4 is the three-dimensional coordinate and size of the space Is a space management table setting unit that creates a space management table for managing the data, and 5 is a connection setting unit that sets a partial space number and a surface number of another partial space to be connected to the specified surface in the connection table. Reference numeral 6 denotes a space management table recording unit that additionally records a subspace number, a plane number, three-dimensional coordinates of the connection plane, and a subspace size in the space management table based on the connection table, and 7 denotes a still image corresponding to the background of the subspace. Is a subspace texture generation unit that outputs subspace texture data by extracting / processing a part of the subspace, and 8 is a subspace texture unit that connects a plurality of subspaces. Generating a three-dimensional model of the mapping of Kusucha a space texture mapping unit for outputting it as a space model data.

Reference numeral 9 denotes a space management table for storing three-dimensional coordinates of planes constituting the subspace and subspace size data, and reference numeral 10 denotes a connection table for storing a subspace number and a plane number of a connection destination.

Numeral 11 denotes a spatial three-dimensional information generator for generating three-dimensional geometric data (spatial three-dimensional data) based on the background area data and the three-dimensional data of the already created subspace, and obtains a partial space size. It comprises a unit 2, a space three-dimensional data generation unit 3, and a space management table setting unit 4. Reference numeral 12 denotes a connection information setting unit for setting a connection relationship as to which surface of which subspace connects to which surface of which subspace. Reference numeral 13 denotes a spatial texture information generating unit that outputs a three-dimensional model in which textures are mapped to a plurality of connected partial spaces as spatial model data, and includes a partial space texture generating unit 7 and a spatial texture mapping unit 8. .

Here, the operation of the three-dimensional model generating apparatus according to the present embodiment will be described. In the present embodiment, the space to be modeled is regarded as an aggregate of a plurality of rectangular parallelepipeds, and each rectangular parallelepiped is defined as a partial space. The six faces inside the rectangular parallelepiped are “front”, “right”, “back”, “left”,
They are distinguished by the names of “ceiling” and “floor”. further,
The six names are defined in one direction with respect to the entire space, and the rectangular parallelepipeds forming the space have the same name when they are in the same direction.

FIG. 2 is a view showing an example of a set of rectangular parallelepipeds constituting a space. Here, for each rectangular parallelepiped, six internal surfaces (front, right, back, left, floor, and ceiling) are photographed with a digital camera, and front 21a, left 21b, and rear 2
1c, a left surface 21d, a floor surface 21e, and a ceiling image 21f are obtained.

In the present embodiment, the case where the rectangular solid 21 is formed first and then the rectangular solid 22 is connected to the right side of the rectangular solid 21 will be described as an example. The cuboid created first is arbitrary.

First, in the background area designating section 1, the still image 2
1a to 21f are displayed on the display. FIG. 3 is a diagram illustrating the displayed still image. Here, the operator designates a partial area corresponding to the front surface 21a, the right surface 21b, the back surface 21c, the left surface 21d, the floor surface 21e, and the ceiling 21f on each image using a mouse or the like. At this time, the background region specifying unit 1 generates background region data based on the plane coordinates corresponding to the end point of the specified region, and sends the background region data to the partial space size obtaining unit 2 and the partial space texture generating unit 7. Notify to. However, the origin in the plane coordinate system is the center of the still image, and the unit is dot (dot)
And

When receiving the height of the rectangular parallelepiped and the background area data input by the operator, the subspace size obtaining unit 2 calculates the width of the front surface 21a and the width of the right surface 21b of the rectangular parallelepiped. Then, partial space size data is generated based on the calculated height and width, and the partial space size data is notified to the space three-dimensional data generation unit 3 and the space management table setting unit 4. Floor 21e, ceiling 21f, left 2
1d and the width of the back surface 21c are determined because the whole is a rectangular parallelepiped.

When the first rectangular parallelepiped is created, the partial space size obtaining unit 2 automatically calculates the width of the front surface 21a and the right surface 21b of the rectangular parallelepiped at the stage of receiving the background area data, and calculates the partial space size. Output data. On the other hand, when the second and subsequent rectangular parallelepipeds are created, at the stage where the background area data is received, the space management table output by the space management table appending unit 6 described later is referred to, and the front surface 21a or the right surface 21b is referred to. If the width is not set, the width is calculated and output as space size data. However, if the height and width are known in the space management table, these are used as space size data.

Here, a method of calculating the width W of the front surface 21a and the right surface 21b will be described with reference to the drawings. FIG. 4 shows the width W
FIG. 6 is a diagram for explaining a calculation method of (1). This calculation method is described in Hideaki Maehara, Wataru Nakamura, Satoshi Tanaka, "Simple production of virtual room space for real-time CG using live-action still images",
This is described in detail in Denki Kagaku C, Vol. 120-C, No. 7, pp. 977-985, 2000. Here, it is assumed that each photograph is taken with the center point included in the designated partial area and with the camera substantially horizontal. The angle unit is degree.

W = √ (Drt ² + Dlt ² -2 * Drt * Dlt * cos θt) (1) where θr = cos ⁻¹ ((drt ² + drb ² + 2 * F ² −drt_rb ² ) / (2 * √ ( drt ² + F ² ) √ (drb ² + F ² ))) (2) F = Cx / (2 * tan (Ca / 2)) (3) Dr = (√ (4 * h (H−h) * tan ² ) θr + H ² ) + H) / (2 * tan θr) (4) Drt = √ (Dr ² + (H−h) ² ) (5) It is assumed that Drb = √ (Dr ² + h ² ) (6).

Note that drt represents the distance (unit: dot) from Vrt to the center of the still image, where Vrt is the vertex above the right vertical line forming the background area. Also, dr
b indicates the vertex below the right vertical line constituting the background area as Vrb
Represents the distance (unit: dot) from Vrb to the center of the still image. In addition, drt_rb is Vrt and V
rb represents the distance (unit: dot) on the still image. Also,
h represents the height of the camera from the floor. Drt represents the distance between Vrt and the camera. Drb represents the distance between Vrb and the camera. Dr represents the distance between the camera and the right vertical line constituting the background area. The number of pixels Cx in the horizontal direction of the still image (the unit is dot) and the viewing angle Ca in the horizontal direction of the camera (unit is digi) Ca differ depending on the digital camera.

At this time, θr is determined by the focal length F of the camera and the distances drt, drb, drt_rb on the still image.
Using this θr, Drt and Drb can be represented as variables of h. Similarly, Dlt and Dlb are also expressed as variables of h in the left vertical line constituting the background area, so that the following equation (7) is obtained using the width W as a medium. Drt ² + Dlt ² -2 * Drt * Dlt * cos θt = Drb ² + Dlb ² -2 * Drb * Dlb * cos θb (7) Since this equation is a one-variable equation of h, W is obtained using the obtained h. be able to.

Next, the spatial three-dimensional data generator 3 which has received the partial space size data calculates the three-dimensional shape of the partial space based on the data. Then, it generates “space three-dimensional geometric data” that is connected to the already created subspace, that is, generates space three-dimensional data, and notifies the space management table setting unit 4 and the space texture mapping unit 8 of the space three-dimensional data. I do. At this time, with respect to the cuboid to be created first, a reference point for arranging the cuboid at an appropriate position in space is designated by an operator's instruction.
Select from each vertex. Then, after setting the three-dimensional coordinates of the reference point, the spatial three-dimensional data generation unit 3 generates the rectangular solid 21.
Is calculated for all the vertices, and spatial three-dimensional data is output as the calculation result.

In the space management table setting unit 4, based on the partial space size data generated by the partial space size acquiring unit 2 and the spatial three-dimensional data generated by the spatial three-dimensional data generating unit 3, the front 21a , Right side 21b, back 2
The three-dimensional coordinates of the end points, the height of the rectangular parallelepiped, and the respective widths corresponding to the front and right sides are set in the space management table 9 in units of 1c, left surface 21d, floor surface 21e, and ceiling 21f. This space management table 9 is referred to in a space management table appending unit 6 described later.

FIG. 5 is a diagram showing an example of the space management table 9. Here, the subspace number is a number unique to each rectangular parallelepiped. In the surface numbers, a to f are the front,
Right side, back side, left side, floor, ceiling
The number part is a partial space number.

Next, for example, the right surface 21 of the rectangular parallelepiped 21
When another rectangular parallelepiped 22 is connected to b, the connection setting unit 5 specifies another surface to be connected to another rectangular parallelepiped out of the six working surfaces by the operator. Are automatically set in the connection table 10. FIG. 6 is a diagram illustrating an example of the connection table 10. The connection source partial space number is set to the partial space number of the rectangular parallelepiped in operation. This connection source partial space number is the same as the partial space number set in the space management table setting unit 4. As the connection source surface number, a surface number corresponding to the six surfaces inside the rectangular parallelepiped of the connection source partial space number is set. This connection source surface number is the same as the surface number set in the space management table setting unit 4.

Then, for example, the right surface 21 is used as a connection surface.
When “b” is designated, the connection table 10 stores “2” as the connection destination partial space number in the column next to the connection source surface number (21b).
2 and 22d are automatically set as the connection destination surface number. The connection table 10 is referred to in a space management table additional unit 6 and a space texture mapping unit 8 described later.

The space management table appending section 6 refers to the connection table 10 and refers to the rectangular parallelepiped 22 connected to the rectangular parallelepiped 21.
Are added to the space management table 9 with the subspace number, surface number, and three-dimensional coordinates and width of the connection surface. here,
Since 22 is set as the connection destination partial space number in the connection table 10, 22 is added to the space management table 9 as the partial space number, and 2 is added as the surface number.
2a to 22f (not shown) are added. Further, since 22d is set in the connection table 10 as the connection destination surface number (21b) corresponding to the connection source surface number (21b), the width of the surface corresponding to the connection destination surface number (22d) is determined by the connection source surface number (22d). 21
It becomes equal to the width of the surface of b). Therefore, in the space management table 9, the same value as the right side width of the partial space number (21) is added to the right side width of the partial space number (22). In addition, the height is similarly added. Also, the three-dimensional coordinates of the surface number (21b) are added to the three-dimensional coordinates of the surface number (22b).

The partial space texture generation section 7 cuts out a quadrilateral partial area specified as a background area for each plane of a rectangular parallelepiped based on the still image and the background area data received from the background area specifying section 1. Further, by processing the cut-out portion into a rectangle, subspace texture data is generated. Then, the subspace texture data is notified to the spatial texture mapping unit 8.

Here, the texture processing method will be described. This method is described in detail in JP-A-11-144076. In the subspace texture generation unit 7,
Based on the background area data, parameters such as the viewpoint position (Vx, Vy, Vz), the angle θ between the line of sight and the polygon, and the vertical size wy (dot) of the window are calculated as shown in the following (8) to (21). I do. Here, the coordinates are the values of the coordinates in the virtual three-dimensional space, and the unit of the angle is degree (degree).
And

Vx = ((X ₂ * Y ₄ −X ₄ * Y ₂ ) / (X ₂ −X ₄ ) − (X ₁ * Y ₃ −X ₃ * Y ₁ ) / (X ₁ −X ₃ )) _{/ ((Y 1 -Y 3)} / (X 1 -X 3) - (Y 2 -Y 4) / (X 2 -X 4)) (8) Vy = (Y 1 -Y 3) / (X 1 −X ₃ ) * Vx + (X ₁ * Y ₃ −X ₃ * Y ₁ ) / (X ₁ −X ₃ ) (9) Vz = √ (Hl ² + Dl ² -2 * Hl * Dl * cos (90− Ca + θ)) (10) θ = − (90−Ca) + cos ⁻¹ (((Hr + Hl) ² + Dl ² −Dr ² ) / (2 * (Hr + Hl))) (11) Dr = √ (Vr ² * (Hr) + Hl) ² / (Vr ² + Vl ² -2 * Vr * Vl * cos (2 * Ca))) (12) Dl = √ (Vl ² * (Hr + Hl) ² / (Vr ² + Vl ² -2 *) Vr * Vl * cos (2 * Ca))) (13) Hl _{Vx- (X 1 + X 4)} / 2 (14) Hr = (X 2 + X 3) / 2-Vx (15) Vr = Y 3 -Y 2 (16) Vl = Y 4 -Y 1 (17) Wy = cy / Pl * (Cd + Cu ) (18) Cu = (Y 3 -Y 4) / (X 3 -X 4) * Vx + (X 3 * Y 4 -X 4 * Y 3) / (X 3 -X 4 ) -Vy (19) Cd = - (Y 1 -Y 2) / (X 1 -X 2) * Vx + (X 1 * Y 2 -X 2 * Y 1) / (X 1 -X 2) + Vy ( 20) Pl = Vz * tanCa (21)

Here, (X ₁ , Y ₁ ) represents the coordinates of the lower left corner of the area data, (X ₂ , Y ₂ ) represents the coordinates of the lower right corner of the area data, and (X ₃ , Y ₃ ) represents the area. It represents the coordinates of the upper right corner of the data, (X ₄ , Y ₄ ) represents the coordinates of the upper left corner of the area data, and Cy represents the number of horizontal pixels of the window.

Then, the partial space texture generating section 7 generates partial space texture data in which the partial region is transformed into a rectangle by utilizing the function of perspective projection transformation.
More specifically, first, the partial space texture generation unit 7 performs perspective projection conversion to execute a width of 640 dots and a width of Wy.
A display window of the dot and the viewing angle Ca is displayed on the display. Next, four vertices (−320.0, 0, 2
40.0), (320.0, 0, 240.0), (32
0.0, 0, −240.0), (−320.0, 0, −
240.0) is arranged in a provisional three-dimensional space, rotated counterclockwise about the Y axis by θ, the viewpoint is moved to a point (Vx, Vy, Vz), and the line of sight is The inclination of the direction is set to 0.0 and parallel to the Z axis, and the origin is made visible. Finally, the entire contents displayed in the display window are output as subspace texture data.

Next, the operation of the three-dimensional model generating apparatus when the rectangular parallelepiped 22 is connected to the right side of the rectangular parallelepiped 21 will be described. Here, only the operation different from the operation for generating the cuboid 21 will be described. First, after outputting the background area data in the same operation as described above, the partial space size obtaining unit 2 refers to the space management table 9 set by the space management table appending unit 6 and determines the width corresponding to the front or right side. If not set, calculate the width and generate partial space size data. Then, the subspace size data is notified to the space three-dimensional data generation unit 3 and the space management table setting unit 4.

The spatial three-dimensional data generator 3 calculates the three-dimensional shape of the subspace based on the received subspace size data. Then, “space three-dimensional geometric data” that is connected to the already created subspace, that is, space three-dimensional data, is generated. Here, 22 is used as the surface number.
Regarding the left surface of the rectangular parallelepiped 22 to which d is set, since the three-dimensional coordinates of the four vertices are already set in the space management table 9, one of the three points is set as the reference point. Therefore,
Based on the three-dimensional coordinates of this reference point and the above-mentioned subspace size data, three-dimensional coordinates corresponding to all vertices of the rectangular parallelepiped 22 are calculated, and the three-dimensional data in a state where the rectangular parallelepiped 21 and the rectangular parallelepiped 22 are connected is converted into spatial three-dimensional data. Output as data.

Thereafter, the space management table setting unit 4, the connection setting unit 5, the space management table appending unit 6, and the partial space texture generation unit 7 perform processing in the same procedure as when the rectangular solid 21 is generated.

Next, in the space texture mapping section 8, when the processing for all the rectangular parallelepipeds is completed (corresponding to the processing for the rectangular parallelepipeds 21 and 22 in this case),
It receives the spatial three-dimensional data and the subspace texture data of all the rectangular parallelepipeds constituting the space, refers to the space management table 9 and the connection table 10, maps the texture to a surface other than the surface to be connected, and maps a plurality of subspaces. Generate connected spatial model data. This space model data is output, for example, in a VRML format,
Display using the ML browser.

As described above, in the present embodiment, a plurality of spaces are generated using still images obtained from a digital camera or the like, and the plurality of spaces are freely connected in the plane direction and the vertical direction. did. Specifically,
A texture is mapped to spatial three-dimensional data in a state where a plurality of rectangular parallelepipeds are connected to generate space model data in which a plurality of partial spaces are connected. Thereby, a three-dimensional model having a complicated shape can be generated. Further, by displacing the rectangular parallelepipeds forming the outline of the space, the present invention can be applied to a circular room such as an observation room or a spherical space such as a dome.

Embodiment 2 In the first embodiment described above,
The space model data is generated by mapping a texture on the spatial three-dimensional data in a state where a plurality of rectangular parallelepipeds are connected. On the other hand, in the second embodiment, textures are mapped to individual rectangular solids constituting a space,
At the stage where mapping processing has been completed for all the rectangular parallelepipeds, spatial model data is generated by connecting all the rectangular parallelepipeds.

FIG. 7 is a diagram showing the configuration of the second embodiment of the three-dimensional model generating apparatus according to the present invention. Note that the same components as those in the first embodiment are denoted by the same reference numerals, and description thereof is omitted. In FIG. 7, reference numeral 31 denotes a subspace three-dimensional data generation unit that calculates the three-dimensional shape of the subspace based on the subspace size data, and outputs the calculation result as subspace three-dimensional data. A subspace texture mapping unit that generates a three-dimensional model in which a texture is mapped to a subspace based on the dimensional data and the subspace texture data, and outputs the generated three-dimensional model as subspace model data. 10 to generate three-dimensional data of a space in which the respective subspaces are connected, cut out the texture of the connecting surface between the subspaces, generate a three-dimensional model of the space, and output it as spatial three-dimensional model data. This is a partial space connection part.

Reference numeral 41 denotes a subspace three-dimensional information generation unit for generating three-dimensional data of the subspace based on the background area data. The subspace size acquisition unit 2, the subspace three-dimensional data generation unit 31, It is composed of a table setting section 4. Reference numeral 42 denotes a subspace texture information generation unit that outputs a three-dimensional model in which texture is mapped to the subspace as subspace model data. The subspace texture generation unit 7 and the subspace texture mapping unit 32
It consists of.

Here, the operation of the three-dimensional model generating apparatus according to the present embodiment will be described. In the present embodiment, as in the first embodiment, a space in which the rectangular parallelepiped 21 and the rectangular parallelepiped 22 are connected is created (see FIG. 2). Here, only operations different from those of the first embodiment will be described.

First, after the background area data generation processing and the partial space size data generation processing are executed in the same operation as in the first embodiment, the partial space three-dimensional data generation section 31 performs partial data generation based on the partial space size data. The subspace three-dimensional data is generated by calculating the three-dimensional shape of the space, and the subspace three-dimensional data is notified to the space management table setting unit 4 and the subspace texture mapping unit 32. At this time, with respect to the rectangular solid 21 to be created first, after setting the three-dimensional coordinates of the reference point in the same procedure as in the first embodiment, 3D is set for all the vertices of the rectangular solid 21.
The dimensional coordinates are calculated, and the subspace three-dimensional data is output as the calculation result. On the other hand, the rectangular solid 22 to be created thereafter
With regard to, the reference point is arbitrary, and subspace three-dimensional data is generated according to the size of the rectangular parallelepiped 22.

In the space management table setting unit 4, based on the subspace size data generated by the subspace size acquisition unit 2 and the subspace three-dimensional data generated by the subspace three-dimensional data generation unit 31, 21a, right side 21b,
The three-dimensional coordinates of the end points, the height of the rectangular parallelepiped, and the respective widths corresponding to the front and right sides are set in the space management table 9 for each of the back surface 21c, the left surface 21d, the floor surface 21e, and the ceiling 21f (FIG. 5). reference). This space management table 9
Is referred to in the space management table appending unit 6 as in the first embodiment.

Next, in the same operation as in the first embodiment, after performing the setting processing to the connection table 10 (see FIG. 6), the additional writing processing to the space management table 9, and the partial space texture data generating processing, The space texture mapping unit 32 maps a texture to a subspace based on the subspace three-dimensional data and the subspace texture data, and generates subspace model data. In the present embodiment, a three-dimensional model of the rectangular parallelepiped 21 is created at the time when the processing on the rectangular parallelepiped 21 is completed.

Next, the operation of the three-dimensional model generating apparatus when the rectangular parallelepiped 22 is connected to the right side of the rectangular parallelepiped 21 will be described. Here, only the operation different from the operation for generating the cuboid 21 will be described. After executing the background area data generation processing and the partial space size data generation processing in the same procedure as above, the subspace three-dimensional data generation unit 31
Based on the subspace size data, the subspace three-dimensional data is generated by calculating the three-dimensional geometric data of the rectangular parallelepiped 22 based on an arbitrary point. Then, the subspace three-dimensional data is notified to the space management table setting unit 4 and the subspace texture mapping unit 32.

Next, in the same procedure as the processing for the rectangular parallelepiped 21, the processing for setting the space management table 9, the processing for setting the connection table 10, the processing for appending to the space management table 9, the processing for generating partial space texture data, and After executing the subspace model data generation process, the subspace connection unit 33
Then, based on the space management table 9 and the connection table 10, the space 3 in which the rectangular parallelepiped 21 and the rectangular
Generate dimensional data.

For example, referring to the connection table 10, it can be seen that the surface 21b of the rectangular parallelepiped 21 is in contact with the surface 22d of the rectangular parallelepiped 22. The three-dimensional coordinates of the rectangular parallelepiped 21 are generated based on the reference points.
Since is located at an appropriate position in the space, the subspace connection unit 33 may convert the three-dimensional coordinates of the rectangular parallelepiped 22 so that the left surface 22d and the right surface 21b are connected.

Then, the subspace connection unit 33 acquires the three-dimensional coordinates of the right surface 21b and the left surface 22d from the space management table 9, and sets the three-dimensional coordinates of the left surface 22d to be equal to the coordinates of the right surface 21b. By converting the three-dimensional coordinates of all vertices, three-dimensional coordinates of a space in which the rectangular parallelepipeds 21 and 22 are connected are generated. Further, since the right surface 21b and the left surface 22d are connected, texture data mapped to these two surfaces is cut out, and spatial three-dimensional model data in which the rectangular parallelepiped 21 and the rectangular parallelepiped 22 are connected is generated.

As described above, in the present embodiment, a plurality of spaces are generated by using still images obtained from a digital camera or the like, and the plurality of spaces are freely connected in a plane direction and a vertical direction. did. Specifically,
The texture is mapped to each of the rectangular parallelepipeds constituting the space, and at the stage where the mapping process is completed for all the rectangular parallelepipeds, all the rectangular parallelepipeds are connected to generate the space model data. Thereby, a three-dimensional model having a complicated shape can be generated. Further, by displacing the rectangular parallelepipeds forming the outline of the space, the present invention can be applied to a circular room such as an observation room or a spherical space such as a dome.

Embodiment 3 In the third embodiment, a three-dimensional model of a space having a branch is generated. The configuration of the present embodiment is the same as that of the first embodiment described above with reference to FIG.
Therefore, the same reference numerals are given and the description is omitted. Here, only operations different from those in the first embodiment will be described.

Hereinafter, the operation of the three-dimensional model generating apparatus according to the present embodiment will be described. FIG. 8 is a diagram illustrating an example of a space having a branch. In the present embodiment, a space with a branch is regarded as an aggregate of a plurality of triangular prisms, and each triangular prism is defined as a subspace. Then, for each triangular prism, the inner five surfaces (side surface 3)
And the ceiling and floor) with a digital camera to obtain a still image.

FIG. 9 is a diagram showing a three-dimensional model of a space according to the third embodiment. In the present embodiment, first, a triangular prism 51 shown in FIG.
A case where the triangular prism 52 shown in FIG. 9B is connected to the side surface of one (see FIG. 9C) will be described as an example. The triangular prism created first is optional.

First, in the background area designating section 1, the triangular prism 51
A still image of the inside surface of is displayed on the display. Here, when the operator specifies a partial area using a mouse or the like, the background area specifying unit 1 generates background area data based on the plane coordinates corresponding to the end point of the specified partial area, and generates the background area data. To the subspace size acquisition unit 2 and the subspace texture generation unit 7. For example, for a side surface, a partial region of the side surface on the image is designated by a quadrilateral, and for a ceiling and a floor surface, a partial region of the ceiling and floor surface on the image is designated by a triangle.

The subspace size obtaining unit 2 generates subspace size data based on the width and height of the side surface of the triangular prism 51 input by the operator and the background area data, and converts the subspace size data into space. The notification is sent to the three-dimensional data generation unit 3 and the space management table setting unit 4.

The spatial three-dimensional data generator 3 calculates the three-dimensional shape of the triangular prism 51 based on the received partial space size data. Then, similarly to the first embodiment, spatial three-dimensional data is generated, and the spatial three-dimensional data is notified to the spatial management table setting unit 4 and the spatial texture mapping unit 8. At this time, with respect to the triangular prism 51 to be created first, a reference point (U) for arranging the triangular prism 51 at an appropriate position in the space is selected from the vertexes according to the instruction of the operator. After setting the three-dimensional coordinates of the reference point, the spatial three-dimensional data generator 3 calculates three-dimensional coordinates for all vertices of the triangular prism 51 and outputs spatial three-dimensional data as a calculation result. On the other hand, for the triangular prisms created after the second, the space management table 9 set by the space management table setting unit 4 and the connection setting unit 5
The reference point is automatically set based on the connection table 10 set in.

In the space management table setting unit 4, based on the partial space size data generated by the partial space size acquiring unit 2 and the spatial three-dimensional data generated by the spatial three-dimensional data generating unit 3, 3 of the end points on each side of
The dimensional coordinates and the width of the plane are set in the space management table 9. This space management table 9 is referred to in the space texture mapping unit 8.

FIG. 10 is a diagram showing an example of the space management table 9. Here, each partial space number is a number unique to each triangular prism. The side surface (1) has a reference point at the lower left end of the surface when viewed from the outside of the triangular prism, and the side surface (2) and the side surface (3) are clockwise as viewed from the side surface (1). , Side (2) and side (3). In the surface numbers, a to e are assigned in order of the side surface (1), the side surface (2), the side surface (3), the ceiling, and the floor surface, and the numeral portion represents a partial space number.

Next, for example, when another triangular prism 52 is connected to the side surface (1) of the triangular prism 51, the connection setting section 5
Then, when the operator specifies a surface to which another triangular prism is to be connected from the five working surfaces, the surface number of another triangular prism to be connected to the specified surface is automatically set in the connection table 10. . FIG. 11 is a diagram illustrating an example of the connection table 10. The connection source subspace number and connection destination subspace number are
It is the same as the partial space number in the space management table 9.

For example, when the side surface (1) is designated as the connection surface, the connection table 10 stores 52 as the connection destination partial space number in the column next to the connection source surface number (51a), and 52a is automatically set as the front face number. In this case, the surface to be connected may be the side surface (1).

The space management table appending unit 6 refers to the connection table 10 and refers to the triangular prism 52 connected to the triangular prism 51.
Are added to the space management table 9 with the subspace number, surface number, three-dimensional coordinates, width and height of the connection surface. Here, since 52 is set as the connection destination space number in the connection table 10, 52 is added to the space management table 9 as the partial space number, and 5 is set as the surface number.
2a to 52e are added. Also, in the connection table 10,
Since 52a is set as the connection destination surface number corresponding to the connection source surface number (51a), the connection destination surface number (52a) is set.
Are respectively equal to the width and height of the connection source surface number (51a). Therefore, the space management table 9
, The width and height of the side surface (1) of the subspace number (51) are added to the width and height of the side surface (1) of the subspace number (52). Also, the three-dimensional coordinates of the surface number (51a) are additionally written in the field of the three-dimensional coordinates of the surface number (52a).

The partial space texture generating section 7 cuts out a partial area designated as a background area for each surface of the triangular prism based on the still image and the background area data received from the background area specifying section 1, and further cuts out. The processed part is processed to generate subspace texture data. And
The subspace texture data is notified to the space texture mapping unit 8. In processing the image, other photo processing software that generates distortion in the image may be used.

Next, the operation of the three-dimensional model generation device when the triangular prism 52 is connected to the side surface (1) of the triangular prism 51 will be described. Here, only the operation different from the operation for generating the triangular prism 51 will be described. First, after outputting the background area data in the same operation as described above, the subspace size acquisition unit 2
With reference to the space management table 9 set by the space management table appending unit 6, when the width corresponding to the side surface (1), the side surface (2) or the side surface (3) is not set, the partial space size is set. Generate data. Then, the subspace size data is notified to the space three-dimensional data generation unit 3 and the space management table setting unit 4.

The spatial three-dimensional data generator 3 calculates the three-dimensional shape of the partial space based on the received partial space size data. Then, spatial three-dimensional data connected to the already created partial space is generated. Here, as for the side surface (1) of the triangular prism 52 for which the surface number 52a is set, since the three-dimensional coordinates of the end points forming the surface are already set in the space management table 9, one of the three points is set as a reference. Point. Therefore, three-dimensional coordinates corresponding to all vertices of the triangular prism 52 are calculated based on the three-dimensional coordinates of the reference point and the partial space size data, and are calculated as spatial three-dimensional data in a state where the triangular prism 51 and the triangular prism 52 are connected. Output.

Thereafter, the space management table setting unit 4, the connection setting unit 5, the space management table appending unit 6, and the partial space texture generation unit 7 perform processing in the same procedure as when the triangular prism 51 is generated.

Next, in the space texture mapping section 8, when the processing for all the triangular prisms is completed (corresponding to the processing of the triangular prism 51 and the triangular prism 52 here),
It receives the spatial three-dimensional data and the partial space texture data of all the triangular prisms forming the space, refers to the space management table 9 and the connection table 10, maps the texture to a surface other than the surface to be connected, and connects the plurality of triangular prisms. Generate spatial model data of the combined branch shape. This space model data is output, for example, in a VRML format and displayed using a VRML browser.

As described above, in the present embodiment, since a plurality of triangular prisms are generated by using still images obtained from a digital camera or the like, a three-dimensional model of a space having a branch shape can be easily generated. can do.

In the present embodiment, the three-dimensional data of the space having a branch is generated using the configuration of the first embodiment. However, the present invention is not limited to this. It may be.

Embodiment 4 In the fourth embodiment, a three-dimensional model of a curved space is generated. Note that the configuration of the present embodiment is the same as that of FIG. 1 of Embodiment 1 described above, and thus the same reference numerals are given and the description thereof will be omitted. Here, only operations different from those in the first embodiment will be described.

Hereinafter, the operation of the three-dimensional model generating apparatus according to the present embodiment will be described. FIG. 12 is a diagram illustrating an example of a curved space according to the fourth embodiment. In the present embodiment, a curved space is regarded as an aggregate of a plurality of hexahedrons, and each hexahedron is defined as a subspace. Then, for each hexahedron, six internal surfaces are photographed by a digital camera to obtain a still image. Here, the surface along the curved shape is defined as the right surface or the left surface, and the front surface, the rear surface, the ceiling, and the floor surface are defined based on the positional relationship between the right surface and the left surface.

In the present embodiment, a case where the hexahedron 61 shown in FIG. The hexahedron created first is arbitrary.

The background area designating section 1 displays a still image on the display in the same procedure as in the first embodiment described above, and then sets the background area based on the plane coordinates corresponding to the end point of the designated area. Data is generated, and the background area data is notified to the subspace size acquisition unit 2 and the subspace texture generation unit 7.

The subspace size obtaining unit 2 generates subspace size data based on the width and height of each side surface of the hexahedron 61 input by the operator and the background area data, and converts the subspace size data. The space 3D data generating unit 3 and the space management table setting unit 4 are notified.

The spatial three-dimensional data generator 3 calculates the three-dimensional shape of the hexahedron 61 based on the received partial space size data. Then, similarly to the first embodiment, spatial three-dimensional data is generated, and the spatial three-dimensional data is notified to the spatial management table setting unit 4 and the spatial texture mapping unit 8. The method for setting the reference point is the same as that in the third embodiment.

Next, the space management table setting unit 4, the connection setting unit 5, the space management table appending unit 6, and the subspace texture generation unit 7 perform processing in the same procedure as in the first embodiment. Complete the process. Also, when the hexahedron 62 is connected to the front of the hexahedron 61, each unit of the three-dimensional model generating device performs the processing in the same procedure as in the first embodiment described above. Hereinafter, in the present embodiment, the above-described processing is performed on all the hexahedrons forming the curved space.

Next, in the space texture mapping section 8, in the same procedure as in the first embodiment described above, when processing on all triangular prisms is completed, the spatial three-dimensional data and all hexahedrons constituting the space are obtained. Based on the subspace texture data, a curved space model data in which a plurality of hexahedrons are connected is generated.

As described above, in this embodiment, since a plurality of hexahedrons are generated by using still images obtained from a digital camera or the like, a three-dimensional model of a curved space can be easily generated. be able to.

In the present embodiment, three-dimensional data of a curved space is generated using the configuration of the first embodiment. However, the present invention is not limited to this. For example, the configuration of the second embodiment may be applied. It may be.

Embodiment 5 FIG. In the fifth embodiment, a three-dimensional model of an object arranged in a space is generated.
Note that the same components as those in the first embodiment described above are denoted by the same reference numerals, and description thereof will be omitted.

FIG. 13 is a diagram showing the configuration of the fifth embodiment of the three-dimensional model generating apparatus according to the present invention. In FIG. 13, reference numeral 71 denotes an object specifying unit that generates specified vertex data based on the plane coordinates of the specified object vertex, and 72 denotes a vertex that generates calculated vertex data based on the unspecified vertex plane coordinates. Calculation part,
Reference numeral 73 denotes an object size calculation unit that generates object size data based on the width, height, and depth of the object. Reference numeral 74 denotes object three-dimensional data that generates three-dimensional data of the object based on background region data and designated vertex data. A generation unit 75 is an object texture generation unit that cuts out / processes a portion corresponding to an object from a still image and generates object texture data. An object texture mapping unit that generates mapped object model data.

Reference numeral 81 denotes an object two-dimensional information generation unit for displaying a still image on a display and outputting, as designated vertex data, plane coordinates of a specified rectangular parallelepiped vertex approximating the object; and 82, background area data And an object three-dimensional information generating unit that generates three-dimensional data of a rectangular parallelepiped that approximates an object based on the specified vertex data.
An object texture information generating unit that outputs object model data obtained by mapping a texture based on the dimension data and the object texture data.

Here, the operation of the three-dimensional model generating apparatus according to the present embodiment will be described. FIG. 14 shows Embodiment 5
FIG. 3 is a diagram showing a three-dimensional model of the space in FIG. First, the background area specifying unit 1 displays a still image 91 in which an object is shown with a wall as a background on a display. Here, when the operator uses a mouse or the like to specify a partial area corresponding to the wall surface serving as the background of the object as a quadrilateral, the background area specifying unit 1 sets the background area based on the specified plane coordinates of the four points. The area data is generated, and the background area data is notified to the object size calculation unit 73 and the object texture generation unit 75.

In the object specifying section 71, the shape of the object is approximated by a rectangular parallelepiped based on the still image 91 displayed in the background area specifying section 1. Here, when the operator specifies the vertex of the rectangular parallelepiped with a mouse or the like, the object specifying unit 71 generates specified vertex data based on the plane coordinates of the specified vertex, and transmits the specified vertex data to the vertex calculation unit 72 and the object The size calculator 73 and the object texture generator 75 are notified.

However, the number of designated vertices is at least four. The four vertices at this time are assumed to correspond to the width, height, and depth of the rectangular parallelepiped, and are specified so that the vertices correspond to the three axes of the three-dimensional orthogonal coordinate system. For example, in FIG. 14, the vertices 91c, 91f, 91g, and 91h
Is specified. As another specification example, for example,
The vertices 91b, 91c, 91d, and 91g may be specified. Alternatively, all the vertices of the rectangular parallelepiped in the image may be specified. Or later,
A rectangular parallelepiped approximating an object is simply called an “object”.

The vertex calculation section 72 generates calculated vertex data based on the plane coordinates of the vertices not output as the specified vertex data among all the vertices constituting the object, and converts the calculated vertex data to the object size. The calculation unit 73 and the object texture generation unit 75 are notified. In FIG. 14, the vertices 91a, 91b,
The plane coordinates of the vertices 91d and 91e are output. The plane coordinates of these vertices are calculated using the designated vertex data and the fact that the shape of the object is a rectangular parallelepiped.

The object size calculator 73 automatically calculates the width, height, and depth of the object based on the background area data and the designated vertex data, thereby generating object size data. Then, the object size data is notified to the object three-dimensional data generation unit 74.

Here, a method of calculating the width M, height N, and depth K of an object will be described. FIG. 15 is a diagram illustrating a method of calculating the width, height, and depth of an object (an example in the case of Dl <Dr). In addition. It is assumed that the height H and the width W of the wall surface are already known by the method described in the first embodiment. The object is assumed to be in contact with the wall surface and not inclined with respect to the wall surface.

First, the width M is calculated using the wall width W, background area data, designated vertex data, and calculated vertex data. Specifically, on a still image, a line segment corresponding to the width of the object on the wall surface and a line segment corresponding to the width of the wall surface are calculated, and calculated from a ratio of the length of the line segment to the width W of the wall surface. I do. Similarly, the height N is calculated using the height H of the wall surface, the background area data, the designated vertex data, and the calculated vertex data. More specifically, in the still image, a ratio between the length of the line segment and the height H of the wall is set for a line corresponding to the height of the object on the wall and a line corresponding to the height of the wall. Calculate from

Next, the depth K is calculated by the following formula (2)
Some parameters are calculated based on 2) to (28). _{Cx = ((X 2 * Y} 4 -X 4 * Y 2) * (X 4 -X 2) - (X 1 * Y 3 -X 3 * Y 1) * (X 3 -X 1)) / (( Y ₁ −Y ₃ ) * (X ₃ −X ₁ ) − (Y ₂ −Y ₄ ) * (X ₄ −X ₂ )) (22) s = H / (Y ₅ −Y ₆ ) (23) θ = cos ^-1 (Pz / L) (24) δo = tan ^-1 (x ₀ / F) (25) δc = tan ^-1 (x ₃ / F) (26) Po = Pz * tan (∠o) (27) Pc = Pz * tan (∠c) (28)

However, (X₁, Y₁) Of background area data
Represents the coordinates of the lower left corner, (X_Two, Y_Two) Of background area data
Represents the coordinates of the lower right corner, (X_Three, Y_Three) Of background area data
Represents the coordinates of the upper right corner, (X_Four, Y_Four) Of background area data
The coordinates of the upper left corner are represented, and Cx is a point (X₁, Y₁) And dots
(X_Three, Y_Three) And a point (X_Four, Y_Four) And point (X
_Two, Y_Two) Represents the x-coordinate of the intersection with the straight line connecting_FiveIs a point
(X_Four, Y_Four) And point (X_Three, Y_Three) On the line connecting x)
Represents the y coordinate where Cx is₆Is the point (X₁,
Y₁) And point (X_Two, Y_Two) On the straight line connecting C)
Represents the y coordinate when₀Is in the specified vertex data
Represents the x coordinate of the vertex corresponding to the origin of the rectangular parallelepiped of_ThreeIs
A vertex corresponding to the depth direction of the rectangular parallelepiped in the specified vertex data
Represents the x coordinate of the point.

If Dl> Dr, the calculation is performed using the following equations (29) to (34). β = cos ⁻¹ ((W ² + Dr ² −Dl ² ) / (2 * W * Dr)) (29) Pz = Dr * sin (π−β) (30) Wr = W / 2 + Cx * s (31) L = √ (Dr ² + Wr ² -2 * Dr * Wr * cosβ) (32) ∠o = θ-δo (33) ∠c = θ-δc (34)

When Dl <Dr, the calculation is performed by the following equations (35) to (40). β = cos ⁻¹ ((W ² + Dl ² −Dr ² ) / (2 * W * Dl)) (35) Pz = Dl * sin (π−β) (36) Wl = W / 2−Cx * s ( 37) L = √ (Dl ² + Wl ² -2 * Dl * Wl * cosβ) (38) ∠o = θ + δo (39) ∠c = θ + δc (40)

Using the above parameters, the depth K is calculated by the following equation (41). K = (Po−Pc) / (tan (∠o)) (41)

Next, after calculating the width M, height N, and depth K of the object, the object three-dimensional data generation unit 74
Then, the three-dimensional coordinates of the object are calculated based on the received object size data, and the calculation result is output as object three-dimensional data.

In the object texture generating section 75,
Based on the background region data, the designated vertex data, and the calculated vertex data, a portion corresponding to the object is cut out from the still image, and the image is further processed to generate object texture data. Then, the object texture data and the object texture mapping unit 76 are notified. Each surface of the object is given a name based on the wall surface. For example, as shown in FIG. 13, the surface facing the wall surface is the back surface, the surface facing the back surface is the front of the hand, and the surfaces located on the left, right, up and down with respect to the front of the hand are the left, right, and top surfaces, respectively. Call it the lower surface.

For example, upon receiving the image, designated vertex data, and calculated vertex data displayed in the background area designating section 1, the object texture generating section 75 cuts out a portion corresponding to the surface of the object from the image, and further cuts out the portion. Is processed into a rectangle to generate object texture data. When the operator specifies a region corresponding to the surface of the object in the still image with a quadrilateral for a surface that is not shown in the image displayed in the background region specifying unit 1, plane coordinates of the specified vertex are calculated. Therefore, the object texture generation unit 7
In step 5, the partial area is cut out, and the cut out part is processed so as to be a rectangle to generate object texture data.

Object texture mapping unit 76
Then, based on the received object 3D data and object texture data, a 3D model of the object to which the texture is mapped, that is,
Generate object model data. This object model data is output, for example, in a VRML format,
Display using a VRML browser.

As described above, in the present embodiment, since a three-dimensional model of an object arranged in space is generated by using a still image obtained from a digital camera or the like, a rectangular parallelepiped object is generated. Can be easily created. Further, even when the real object does not have a rectangular parallelepiped shape, the real object can be easily modeled by approximating the shape of the object including the protruding portion, the dent, and the like with a rectangular parallelepiped.

In the present embodiment, the expression “wall surface” is used for the sake of simplicity of explanation. However, even if the object does not touch the wall in the real space, the expression “wall surface” may be used. By assuming a virtual wall surface in contact with the real space, the object can be similarly formed into a three-dimensional model in a rectangular parallelepiped shape.

Also, in this embodiment, the front of the rectangular parallelepiped hand is assumed to be parallel to the wall for the sake of simplicity of explanation. By assuming a virtual wall parallel to the front surface in the real space, the object can be similarly formed into a three-dimensional model in a rectangular parallelepiped shape.

Embodiment 6 FIG. In the sixth embodiment, a three-dimensional model of a space in which objects are arranged is generated. The same components as those in the first, second, and fifth embodiments described above are denoted by the same reference numerals, and description thereof is omitted.

FIG. 16 is a diagram showing the configuration of the sixth embodiment of the three-dimensional model generating apparatus according to the present invention. In FIG. 16, reference numeral 101 denotes a space processing unit that generates a three-dimensional model of a subspace; Is an object processing unit that generates a three-dimensional model of.

Reference numeral 111 denotes a subspace with an object for generating three-dimensional data of a subspace, a size such as a width and a height of a rectangular parallelepiped approximating the object, and three-dimensional data of a subspace in which the object is arranged. A three-dimensional information generation unit 112; three-dimensional data of a subspace;
A subspace texture information generating unit with an object for generating texture data of the subspace, three-dimensional data of the object, and a three-dimensional model of the subspace in which the object is arranged.

Reference numeral 121 denotes an object width, height,
An object size calculation unit that generates object size data based on the depth, calculates a distance of the object away from the wall based on the background area data and the specified vertex data, and outputs the calculation result as offset data. Offset calculation unit,
Reference numeral 123 denotes a subspace with object in which the three-dimensional coordinates of the object are calculated and the object is arranged in the subspace.
A subspace three-dimensional data generator with object for generating dimensional data, based on texture data of the object, three-dimensional data of the object, texture data of the subspace, and three-dimensional data of the subspace;
A subspace texture mapping unit with object for mapping a texture to the object and generating subspace model data with an object in which the object is arranged in the subspace. Reference numeral 125 denotes the texture data of the object, the three-dimensional data of the object, and the The object-attached space generation unit generates a three-dimensional model of a space in which objects are arranged by cutting out a texture of a surface connecting the partial spaces based on texture data of the space and three-dimensional data of the partial space.

Here, the operation of the three-dimensional model generating apparatus according to the present embodiment will be described. The spatial processing unit 101
The processing inside is the same as that in the second embodiment described above, and thus the description thereof is omitted. Also, the processing of the object designating section 71, the vertex calculating section 72, and the object texture generating section 75 in the object processing section 102 is the same as that of the above-described fifth embodiment, and thus the description thereof is omitted.

After executing the specified vertex data generation processing and the calculated vertex data generation processing in the same procedure as in the above-described fifth embodiment, the object size calculation unit 121 checks whether the object is in contact with the floor surface 130 or the front surface 132.
Find out if you are away. FIG. 17 is a diagram illustrating a three-dimensional model of a space according to the sixth embodiment. In FIG. 17, the background area data is the plane coordinates of the vertices 133 to 136. The plane coordinates of the vertices 131a to 131h are
It is obtained by the object specifying unit 71 or the vertex calculating unit 72.

First, it is checked whether or not the object is away from the front 130. Here, the threshold value γ is set to an arbitrary value in advance, and the inclination is equal to the straight line connecting the vertices 133 and 134 (hereinafter, referred to as a straight line 133-134), and the lower part of the y-axis is reduced by the threshold value γ. A straight line 137-138 translated in the direction is set. Then, one of the vertices 131e or 131h is represented by a straight line 133-
If the object exists in the area between 134 and 137-138, the object is considered to be in contact with the front surface 130. In this embodiment, it is assumed that the object is not inclined with respect to the wall surface.

Also, whether or not the vehicle is separated from the floor 132 can be estimated by calculating the distances between a plurality of vertices and a straight line, as described above.

Next, the object size calculation unit 121
Then, the width M, height N, and depth K of the object are calculated. If the object touches the front 130, the width M
In the same manner as in the above-described fifth embodiment, on the still image displayed by the background region specifying unit 1, a line segment corresponding to the width of the object on the wall surface and a line segment corresponding to the width of the wall surface are targeted. It is calculated from the ratio between the length of the line segment on the image and the width of the wall.

On the other hand, as shown in FIG. 17, when the object is away from the front 130, the vertices 133, 13
4, 131e, 131f, 131g, and 131h, the coordinates of the vertices 139 and 140 in the plane coordinate system are calculated, and the line segment between the vertices 139 and 140 is regarded as the width of the object. M can be calculated.

When the object is in contact with the front surface 130, the height N is the height of the object on the wall surface on the still image displayed by the background area designating section 1, as in the fifth embodiment. And a line segment corresponding to the height of the wall surface, and is calculated from the ratio of the length of the line segment on the image to the height of the wall surface.

On the other hand, as shown in FIG. 17, when the object is away from the front 130, the vertices 135, 13
6, 131c, 131d, 131g, and 131h are used to calculate the coordinates of the vertices 139, 141, and 142 in the plane coordinate system. The height N can be calculated in the same manner as described above by regarding the sandwiched line segment as the height of the wall surface. Note that the depth K can be obtained by the same procedure as in the fifth embodiment.

Next, the offset calculation unit 122 calculates the distance of the object away from the wall based on the background area data and the designated vertex data, and generates offset data. Then, the offset data is notified to the subspace with object three-dimensional data generation unit 123.

For example, in the case of FIG. 17, the distance between the object and the front surface 130 corresponds to the distance in the real space of the line segment sandwiched between the vertices 131h and 139. This is because the line segment sandwiched between the vertices 131h and 139 and the vertices 131g and 13g
It can be obtained from the ratio of the length in the image to the distance in the real space, targeting the line segment sandwiched by 1h. on the other hand,
The same applies to the case where the object is separated from the floor 132. The distance from the floor 132 is determined by a line segment corresponding to the distance of the object from the floor 132 on the front surface 130 and an extension of the line segment. It can be obtained from the ratio of the length in the image to the distance in the real space, with respect to a line segment which is present and corresponds to the height of the front face 130.

Next, the subspace with object three-dimensional data generation unit 123 calculates the three-dimensional shape of the object based on the three-dimensional data of the subspace, the offset data, and the object size data, and arranges the object in the subspace. Generate subspace three-dimensional data with objects. Then, the subspace with object 3D data is notified to the subspace with object texture mapping unit 124.

Next, after executing the object texture data generation processing, the subspace with object texture mapping unit 124 performs the processing based on the subspace three-dimensional data with object, the object texture data, the subspace three-dimensional data, and the subspace texture data. The texture is mapped, and subspace model data with objects in which objects are arranged in the subspace is generated. Then, the subspace-with-object model data is notified to the space-with-object generation unit 125.

Thereafter, the space processing unit 101 executes the same processing as in the second embodiment for all the subspaces constituting the space, and executes the object processing for the subspace in which the object to be modeled exists. The processing unit 102 executes the above processing.

Finally, the space generation unit with object 125
Receives the subspace model data that is a three-dimensional model of the subspace in which no object is placed and the subspace model data with objects that is the three-dimensional model of the subspace in which the object is placed, and receives the space management table 9.
Based on the connection table 10 (not shown) and the connection table 10 (not shown), space 3D model data with objects of a space obtained by connecting a plurality of partial spaces is generated. Note that a method of connecting a plurality of subspaces is performed in the same procedure as the process of the subspace connection unit 33 of the second embodiment.

As described above, in the present embodiment, the three-dimensional model of the space in which the objects are arranged is generated by using the still images obtained from the digital camera or the like. A three-dimensional model can be easily created with a small amount of work. In addition, the configuration is such that the size of the object and the arrangement in the space are acquired in the process of creating the three-dimensional model of the space, and the configuration in which the object and the space are separately created and then combined is not used. A three-dimensional model of the space can be created.

Although the “wall surface” shown in the present embodiment is a real wall, by assuming a virtual transparent wall behind the object, the object placed at the center of the room The above operation can also be applied. That is, in the present embodiment, a three-dimensional model of a space in which an object is placed at the center of the room can be generated.

In the present embodiment, the three-dimensional data and the texture data of the subspace are generated by the method described in the second embodiment. However, the present invention is not limited to this. The method may generate three-dimensional data and texture data of the subspace.

Embodiment 7 FIG. In the seventh embodiment, a three-dimensional model of the space in which the objects are arranged is generated when the objects are arranged obliquely with respect to the background area. The same components as those in the first, second, fifth, and sixth embodiments described above are denoted by the same reference numerals, and description thereof is omitted.

FIG. 18 is a diagram showing the configuration of the seventh embodiment of the three-dimensional model generating apparatus according to the present invention. In FIG. 18, reference numeral 151 denotes a tilt object processing unit that acquires a three-dimensional shape of an object and generates a three-dimensional model of the partial space in which the object is arranged when the object is arranged in the partial space.

An object tilt information generation unit 161 calculates how much an object is tilted with respect to an existing wall surface based on the received three-dimensional subspace data.

[0143] Reference numeral 171 denotes a still image in which an object to be modeled is displayed on the display from among the images displayed by the background area specifying unit 1, and the plane coordinates of four points of the specified virtual background area. A virtual background area designating unit that outputs coordinate values in the system as virtual background area data; 172 calculates the three-dimensional coordinates of the vertices of the virtual background area by inputting the height and width of the virtual background area; A virtual background area three-dimensional data generation unit that outputs the result as virtual background area three-dimensional data, and 173 is based on the subspace three-dimensional data output from the subspace three-dimensional data generation unit 31 and the virtual background area three-dimensional data A tilt calculating unit that calculates an angle between an actual wall surface and a virtual wall surface that is a virtual background area, and outputs the calculation result as object tilt data. .

Here, the operation of the three-dimensional model generating apparatus according to the present embodiment will be described. The spatial processing unit 101
The processing inside is the same as that in the second embodiment described above, and thus the description thereof is omitted.

The virtual background area designating section 171 displays a still image of the object to be modeled on the display from the images displayed by the background area designating section 1. Here, when the operator specifies a virtual background area on the image that is in parallel with the back surface of the object and intersects the wall with a quadrilateral using a mouse or the like, a virtual background area specifying unit In step 171, coordinate values of the designated four points in the plane coordinate system, that is, virtual background area data are generated. Then, the virtual background area data is notified to the object size calculation unit 73. Note that a virtual background area (virtual background area) can be designated on a still image by photographing a still image with an object or marker serving as a mark. The height and width of the virtual background area are measured in advance.

The virtual background region three-dimensional data generation unit 172 generates virtual background region three-dimensional data by calculating the three-dimensional coordinates of all vertices of the virtual background region based on the height and width of the virtual background region. . Then, the virtual background region three-dimensional data is notified to the inclination calculation unit 173.

The inclination calculator 173 calculates the normal vector of the surface for the actual wall surface and the virtual wall surface based on the subspace three-dimensional data output from the subspace three-dimensional data generator 31 and the virtual background region three-dimensional data. By doing
An angle between the wall surface and the virtual wall surface, that is, object inclination data is generated. Then, the object inclination data is converted into a subspace with object three-dimensional data generation unit 74.
Notify to FIG. 19 is a diagram illustrating a state in which the object is arranged to be inclined with respect to the background area. Therefore, here, the normal vector of the surface is calculated for the wall surface 181 and the virtual wall surface 182 which is a virtual background area, and the angle formed between the wall surface 181 and the virtual wall surface 182 is obtained.

Next, after executing the designated vertex data generation processing and the calculation vertex data generation processing in the same procedure as in the fifth embodiment described above, the object size calculation section 73 sets the height and width of the virtual background area, The object size data is generated by automatically calculating the width, height, and depth of the object based on the virtual background area data and the designated vertex data. Then, the object size data is converted into a subspace with object three-dimensional data generation unit 7.
4 is notified. Note that the width, height,
The depth is calculated in the same procedure as in the sixth embodiment described above.

The subspace with object three-dimensional data generation unit 74 calculates the three-dimensional shape of the object based on the three-dimensional data of the subspace, the three-dimensional data of the virtual background area, the designated vertex data, and the object inclination data. Generate subspace three-dimensional data with objects. Then, the three-dimensional data of the subspace with object is converted into the subspace texture mapping unit with object 76.
Notify to

Thereafter, the space processing unit 101 executes the same processing as in the second embodiment for all the subspaces that compose the space, and executes the inclination for the subspace in which the object to be modeled exists. The object processing unit 151 executes the above processing.

Finally, the space generation unit with object 125
Then, in the same procedure as in the above-described sixth embodiment, subspace model data that is a three-dimensional model of a subspace in which no object is placed, and 3
The object-attached subspace data, which is a dimensional model, is received, and based on the space management table 9 (not shown) and the connection table 10 (not shown), the object-attached space 3 in which a plurality of partial spaces are connected. Generate dimensional model data.

As described above, in the present embodiment, a configuration in which a three-dimensional model of an object arranged at an angle to the background area can be generated using a still image obtained from a digital camera or the like. Therefore, even when the objects are arranged at an arbitrary angle, a three-dimensional model of the space can be easily created with a small amount of work.

Further, in the present embodiment, the three-dimensional data and the texture data of the subspace are generated by the method shown in the second embodiment. However, the present invention is not limited to this. The method may generate three-dimensional data and texture data of the subspace.

Embodiment 8 FIG. In the eighth embodiment, a three-dimensional model of the space when the same object is arranged over a plurality of subspaces is generated (Embodiment 6).
Application example). It should be noted that Embodiments 1, 2,
The same components as 5, 6, and 7 are denoted by the same reference numerals, and description thereof is omitted.

FIG. 20 is a diagram showing the configuration of the eighth embodiment of the three-dimensional model generating apparatus according to the present invention. In FIG. 20, reference numeral 201 denotes the connection setting table 10 when the number of vertices of the object specified by the operator is less than four.
Referring to, obtain the subspace number of the subspace that has already been connected to the subspace that is being worked on, and the surface number of the surface that is continuous with the surface for which an object is to be generated from this, , An object information acquisition unit that acquires the depth and offset of the object by referring to the object management table. Reference numeral 202 denotes a partial space number of a working partial space, a surface number of a surface serving as a background of the object, and an object width. , Height, depth, and distance of the object away from the wall in the object management table.

It should be noted that the continuous object processing unit 191
The object information acquisition unit 201 and the object management table setting unit 202 are added to the object processing unit 102 according to the sixth embodiment for generating a three-dimensional model of a subspace in which objects are arranged.

Here, the operation of the three-dimensional model generating apparatus according to the present embodiment will be described. Here, only operations different from those of the first to seventh embodiments described above will be described.

In the object management table setting unit 202, the subspace number of the subspace being worked on by the input of the operator, the surface of the object background obtained based on the still image corresponding to the vertex of the specified object, The number (object belonging surface number), the object size data (object width, object height, object depth) output from the object size calculator 121 and the offset data (offset) output from the offset calculator 122 are set in the object management table. . FIG. 21 is a diagram illustrating an example of the object management table.

In the object information acquisition unit 201, when the number of vertices of the object specified by the operator is less than four, a part of the object to be generated from now on is already created in the already worked subspace. I assume it. Then, referring to the connection setting table 10, the subspace number of the already-operated subspace connected to the subspace in operation and the surface number of the surface that is continuous with the surface for which an object is to be generated from now on And get. Further, in the object information acquisition unit 201,
The object depth and the offset are acquired with reference to the object management table. And about the depth and offset of the acquired object,
This is notified to the subspace with object three-dimensional data generation unit 123.

Here, the operation of the object information acquisition unit 201 will be described in detail using a specific example. FIG.
FIG. 5 is a diagram for explaining an operation of an object information acquisition unit 201. Here, it is assumed that the work on the rectangular parallelepiped 211 has already been completed, and that the work on the rectangular parallelepiped 212 is to be performed. In addition, if it is not the first rectangular parallelepiped, the number of specified vertices may be less than four. On a still image 212a (not shown) photographing the front, vertices 221 and 22 are used as vertices of the object.
2. It is assumed that three points, vertex 223, are specified.

In such a case, in the object information acquisition unit 201, since the number of designated vertices is less than four,
Refer to the connection setting table 10. FIG. 23 is a diagram illustrating an example of the connection table 10. Then, an item whose connection destination partial space number is the working partial space number (212) of the rectangular parallelepiped is searched, and the connection source partial space number (211) is acquired here.

Since the surface being worked on is the front surface 212a, it means that the object to be created has already been processed at the time of working on the front surface 211a of the rectangular parallelepiped 211. Therefore, the object information acquisition unit 201 refers to the object management table and obtains the depth and offset of the object based on the partial space number (211) and the object belonging surface number (211a). Note that the width and height of the object can be obtained using the method described in Embodiment 4, and are not obtained from the object management table.

As described above, in the present embodiment, a configuration capable of generating a three-dimensional model of an object arranged over a plurality of subspaces using a still image obtained from a digital camera or the like is provided. Therefore, for example, a three-dimensional model can be efficiently created even for an object that spans a plurality of spaces, such as a pillar or a long shelf.

FIG. 24 is a diagram showing the configuration of a general computer system which operates as the three-dimensional model generation device shown in the first to eighth embodiments and can realize the above-described three-dimensional model generation processing. is there.

This computer system includes a control unit 301 including a CPU, a memory unit 302, a display unit 303, an input unit 304, a CD-ROM drive unit 305, a disk unit 306,
These units are connected via a system bus A, respectively. In FIG. 24, the control unit 301 executes a three-dimensional model generation process described in the first to eighth aspects. The memory unit 302 includes a RAM,
It includes a memory such as a ROM, and stores programs to be executed by the control unit 301, necessary data obtained in the course of processing, and the like. The display unit 303 is a CRT or LCD
(Liquid crystal display panel) and the like, and displays various screens to the user of the computer system. Input unit 30
Reference numeral 4 includes a keyboard, a mouse, and the like, and is used by a user of the computer system to input various information.
The illustrated CD-ROM 400 includes the first to third embodiments.
A program describing each process shown in FIG.

In the computer system configured as described above, first, the program is installed in the disk unit 306 from the CD-ROM 400 set in the CD-ROM drive unit 305. Then, the program read from the disk unit 306 when starting up the computer system is stored in the memory unit 302. In this state, the control unit 301 (CP
U) executes the processing described in the first to eighth embodiments according to the program stored in the memory unit 302.

In the present invention, the CD-ROM 4
00, a program describing each process is provided. However, the recording medium of the program is not limited to this, and may be, for example, a floppy (registered trademark) disk or the like depending on the computer constituting the system. Other recording media such as a magnetic disk, a magneto-optical disk, and a magnetic tape can be used.

[0168]

As described above, according to the present invention, a plurality of spaces are generated by using still images obtained from a digital camera or the like, and the plurality of spaces are freely connected in a plane direction and a vertical direction. It was set to match. Specifically, the texture is mapped to the spatial three-dimensional data in a state where a plurality of rectangular parallelepipeds are connected to generate space model data in which a plurality of partial spaces are connected. Thus, there is an effect that a three-dimensional model generation device capable of generating a three-dimensional model having a complicated shape can be obtained.

According to the next invention, a plurality of spaces are generated by using still images obtained from a digital camera or the like,
A plurality of spaces are freely connected in the plane direction and the vertical direction. Specifically, the space model data is generated by mapping textures to individual rectangular parallelepipeds constituting the space and connecting all the rectangular parallelepipeds at the stage when the mapping process is completed for all rectangular parallelepipeds. The configuration was adopted. Thus, there is an effect that a three-dimensional model generation device capable of generating a three-dimensional model having a complicated shape can be obtained.

According to the next invention, since the three-dimensional model of the space in which the objects are arranged is generated by using the still image obtained from the digital camera or the like, the three-dimensional model of the space in which the objects are arranged is used. There is an effect that a three-dimensional model generation device that can be easily created with a small amount of work can be obtained. In addition, the configuration is such that the size of the object and the arrangement in the space are acquired in the process of creating the three-dimensional model of the space, and the configuration in which the object and the space are separately created and then combined is not used. There is an effect that it is possible to obtain a three-dimensional model generation device capable of creating a three-dimensional model of the space that has been set.

According to the next invention, since a three-dimensional model of an object arranged at an angle to the background area can be generated using a still image obtained from a digital camera or the like, Is arranged at an arbitrary angle, it is possible to obtain a three-dimensional model generating apparatus capable of easily creating a three-dimensional model of a space with a small amount of work.

According to the next invention, since a three-dimensional model of an object placed over a plurality of subspaces can be generated using a still image obtained from a digital camera or the like, for example, It is possible to efficiently create a three-dimensional model even for objects that span multiple spaces, such as columns and long shelves.
There is an effect that a dimensional model generation device can be obtained.

According to the next invention, by displacing the rectangular parallelepipeds forming the outline of the space, the present invention can be applied to a circular room such as an observation room or a spherical space such as a dome. An effect is obtained that a three-dimensional model generation device can be obtained.

According to the next invention, since a plurality of triangular prisms are generated by using a still image obtained from a digital camera or the like, a three-dimensional model of a space having a branching shape can be easily generated. An effect is obtained that a three-dimensional model generation device can be obtained.

According to the next invention, since a plurality of hexahedrons are generated by using still images obtained from a digital camera or the like, a three-dimensional model of a curved space can be easily generated. There is an effect that a three-dimensional model generation device can be obtained.

According to the next invention, since a three-dimensional model of an object arranged in space is generated using a still image obtained from a digital camera or the like, the three-dimensional model of a rectangular parallelepiped object is generated. Is obtained in that a three-dimensional model generation device capable of easily creating a three-dimensional model can be obtained. Further, even when the real object does not have a rectangular parallelepiped shape, a three-dimensional model generation that can easily model the real object by approximating the shape of the object including the protrusions and dents with a rectangular parallelepiped. An effect is obtained that a device can be obtained.

According to the next invention, by mapping a texture to spatial three-dimensional data in a state where a plurality of rectangular parallelepipeds are connected, space model data in which a plurality of partial spaces are connected is generated. . This allows
There is an effect that a three-dimensional model generation method capable of generating a three-dimensional model having a complicated shape can be obtained.

According to the next invention, the texture is mapped to each of the rectangular parallelepipeds constituting the space, and all the rectangular parallelepipeds are connected at the stage when the mapping processing is completed for all the rectangular parallelepipeds, so that the space model is connected. We decided to generate data. Accordingly, there is an effect that a three-dimensional model generation method capable of generating a three-dimensional model having a complicated shape can be obtained.

According to the next invention, it is possible to obtain a three-dimensional model generation method capable of easily creating a three-dimensional model of a space in which objects are arranged with a small amount of work.

According to the next invention, it is possible to obtain a three-dimensional model generation method capable of easily creating a three-dimensional model of a space with a small amount of work even when objects are arranged at an arbitrary angle. The effect is as follows.

According to the next invention, there is provided a three-dimensional model generation method capable of efficiently creating a three-dimensional model even for an object such as a pillar or a long shelf extending over a plurality of spaces. The effect is that it can be done.

According to the next invention, it is possible to easily create a three-dimensional model of a rectangular parallelepiped object.
There is an effect that a dimensional model generation method can be obtained.

According to the next invention, a process of mapping a texture to spatial three-dimensional data in a state in which a plurality of rectangular parallelepipeds are connected and generating space model data in which a plurality of partial spaces are connected is performed by a computer. I decided to run it. Thereby, there is an effect that a three-dimensional model generation program capable of generating a three-dimensional model having a complicated shape can be obtained.

According to the next invention, the texture is mapped to each of the rectangular parallelepipeds constituting the space, and when the mapping processing is completed for all the rectangular parallelepipeds, the processing for connecting all the rectangular parallelepipeds is performed by the computer. I decided to run it. Thereby, there is an effect that a three-dimensional model generation program capable of generating a three-dimensional model having a complicated shape can be obtained.

According to the next invention, it is possible to obtain a three-dimensional model generation program capable of easily creating a three-dimensional model of a space in which objects are arranged with a small amount of work.

According to the next invention, it is possible to obtain a three-dimensional model generation program capable of easily creating a three-dimensional model of a space with a small amount of work even when objects are arranged at an arbitrary angle. The effect is as follows.

According to the next invention, it is possible to easily create a three-dimensional model of a rectangular parallelepiped object.
There is an effect that a dimensional model generation program can be obtained.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of a first embodiment of a three-dimensional model generation device according to the present invention.

FIG. 2 is a diagram illustrating an example of a set of rectangular parallelepipeds that form a space.

FIG. 3 is a diagram illustrating a displayed still image.

FIG. 4 is a diagram for explaining a method of calculating a width W.

FIG. 5 is a diagram showing an example of a space management table 9;

FIG. 6 is a diagram illustrating an example of a connection table 10;

FIG. 7 is a diagram illustrating a configuration of a three-dimensional model generation device according to a second embodiment of the present invention;

FIG. 8 is a diagram illustrating an example of a space with a branch according to the third embodiment.

FIG. 9 is a diagram showing a three-dimensional model of a space according to the third embodiment.

FIG. 10 is a diagram showing an example of a space management table 9;

11 is a diagram illustrating an example of a connection table 10. FIG.

12 illustrates an example of a curved space according to Embodiment 4. FIG.

FIG. 13 is a diagram showing a configuration of a three-dimensional model generating apparatus according to a fifth embodiment of the present invention.

FIG. 14 is a diagram showing a three-dimensional model of a space according to the fifth embodiment.

FIG. 15 is a diagram illustrating a method for calculating the width, height, and depth of an object.

FIG. 16 is a diagram showing a configuration of a three-dimensional model generating apparatus according to a sixth embodiment of the present invention.

FIG. 17 is a diagram showing a three-dimensional model of a space according to the sixth embodiment.

FIG. 18 is a diagram showing a configuration of a seventh embodiment of a three-dimensional model generation device according to the present invention.

FIG. 19 is a diagram illustrating a state in which objects are arranged obliquely with respect to a background area.

FIG. 20 is a diagram showing a configuration of an eighth embodiment of the three-dimensional model generation device according to the present invention.

FIG. 21 illustrates an example of an object management table.

FIG. 22 is a diagram for explaining the operation of the object information acquisition unit 201.

FIG. 23 is a diagram showing an example of a connection table 10.

FIG. 24 is a diagram showing a configuration of a general computer system.

[Explanation of symbols]

1 background area designation section, 2 partial space size acquisition section, 3
Space 3D data generation unit, 4 space management table setting unit, 5 connection setting unit, 6 space management table postscript unit, 7
Subspace texture generation unit, 8 space texture mapping unit, 9 space management table, 10 connection table, 11 space 3D information generation unit, 12 connection information setting unit, 13 space texture information generation unit, 31 subspace 3D data generation unit , 32 subspace texture mapping unit, 33 subspace connection unit, 41 subspace 3D information generation unit, 42 subspace texture information generation unit, 71
Object designator, 72 vertex calculator, 73 object size calculator, 74 object three-dimensional data generator, 75 object texture generator, 76
Object texture mapping section, 81 object 2D information generation section, 82 object 3D information generation section, 83 object texture information generation section, 1
02 Object processing unit, 111 Subspace 3D information generation unit with object, 112 Subspace texture information generation unit with object, 121 Object size calculation unit, 122 Offset calculation unit, 123 Subspace 3D data generation unit with object, 124 Objects Attached subspace texture mapping section, 125 object-attached space generation section, 151 tilt object processing section, 161 object tilt information generation section, 171 virtual background area designation section, 172 virtual background area 3D data generation section, 173 tilt calculation section, 191 Continuous object processing unit 191, 201 Object information acquisition unit, 2
02 Object management table setting unit.

Claims (20)

[Claims] 1. A three-dimensional model generating apparatus for creating a three-dimensional model of a space by using an image of a space, displaying a still image of the subspace, and converting the still image of the subspace into plane coordinates corresponding to an end point of an area in the subspace. A background region data generating unit that generates background region data based on the background region data; a spatial three-dimensional data generating unit that generates spatial three-dimensional data by connecting a plurality of subspaces based on the background region data; Connection information setting means for setting a connection relationship (including predetermined size information and three-dimensional coordinates of an end point on each surface); and generating partial space texture data based on the still image and the background area data; At the stage where the texture data generation processing for the space has been completed, a surface other than the connection surface is determined based on the connection relationship and the space 3D data. Maps Kusucha, three-dimensional model generation apparatus characterized by comprising: a three-dimensional model generating means for generating a three-dimensional model was Awa connecting a plurality of spaces, the. 2. A three-dimensional model generating apparatus for creating a three-dimensional model of a space using an image obtained by photographing a space, wherein a still image of the subspace is displayed, and a plane coordinate corresponding to an end point of the region in the subspace is displayed. A background area data generating means for generating background area data based on the subspace three-dimensional data generating means for generating three-dimensional data of the subspace based on the background area data; Connection information setting means for setting predetermined size information and three-dimensional coordinates of end points); generating partial space texture data based on the still image and the background area data; A subspace 3 that maps a texture to a subspace based on the subspace and generates a three-dimensional model of the subspace
At the stage where all the subspace three-dimensional model generation processing is completed, based on the subspace three-dimensional model and the connection relationship, after cutting out the texture of the connection surface between the subspaces, a plurality of And a three-dimensional model connection means for generating a three-dimensional model by connecting the spaces. 3. The method according to claim 1, further comprising: approximating a shape of the object with a rectangular parallelepiped based on the still image, and specifying designated vertex data as plane coordinates of designated vertices and non-designated vertex data as plane coordinates of other vertices. And a vertex data generating means for generating, based on the subspace three-dimensional data, the background area data, and the specified vertex data, an object-attached part which generates an object-attached subspace three-dimensional data in which objects are arranged in a subspace. Spatial three-dimensional data generating means, generating object texture data based on the still image, the background area data, and the vertex data,
Further, a texture mapping is performed based on the object texture data, the three-dimensional data with subspace with the object, the three-dimensional data with subspace, and the subspace texture data, and a part with an object that generates a three-dimensional subspace model with objects. Space three-dimensional model generation means, and the three-dimensional model connection means, when all the subspace three-dimensional model generation processes are completed, the subspace three-dimensional model, the subspace three-dimensional model with objects, The three-dimensional model generation device according to claim 2, wherein a three-dimensional model in which a plurality of subspaces are connected is generated based on the connection relationship. 4. A still image in which an object to be modeled is displayed from among the still images, and corresponds to a virtual background region which is in parallel with the back surface of the object and intersects the wall surface. Virtual background area data generating means for generating virtual background area data to be created; and virtual background area three-dimensional data representing three-dimensional coordinates of all vertices of the virtual background area based on the height and width of the virtual background area. Background region three-dimensional data generation means; inclination calculation means for generating object inclination data representing an angle between a real wall surface and a virtual wall surface based on the subspace three-dimensional data and the virtual background region three-dimensional data; The shape of the object is approximated as a rectangular parallelepiped based on the still image, and the specified vertex data, which is the plane coordinates of the specified vertex, and the plane coordinates of the other vertices Vertex data generation means for generating vertex data other than the specified vertex data; and an object in the subspace based on the subspace three-dimensional data, the virtual background region three-dimensional data, the specified vertex data, and the object inclination data. A subspace with object three-dimensional data generating means for generating three-dimensional subspace with object data; generating object texture data based on the still image, the virtual background area data, and the vertex data; Texture data, the subspace with object three-dimensional data, the subspace 3
Subspace with object 3 for mapping a texture based on dimensional data and the subspace texture data to generate a subspace with object 3D model
And a three-dimensional model connection unit, wherein the three-dimensional model connection unit, when all the subspace three-dimensional model generation processes are completed, the subspace three-dimensional model, the subspace three-dimensional model with objects, The three-dimensional model generation device according to claim 2, wherein a three-dimensional model in which a plurality of subspaces are connected is generated based on the connection relationship. 5. An object management table setting means for setting a partial space number of a working partial space, a surface number of a surface serving as a background of an object, and predetermined object size information in an object management table, When the number of vertices is less than four, an object size information obtaining unit that obtains predetermined object size information from the object management table.
4. The 3D data according to claim 3, wherein object-based subspace three-dimensional data in which objects are arranged in a subspace is generated based on the background area data, the specified vertex data, and the predetermined object size information.
Dimensional model generator. 6. Considering the space as a set of rectangular parallelepipeds,
The three-dimensional model generation device according to claim 1, wherein the three-dimensional model generation unit generates a three-dimensional model of a space. 7. The three-dimensional model generation apparatus according to claim 1, wherein a three-dimensional model of the space is generated by regarding a space having a branch as a set of triangular prisms. 8. The three-dimensional model generating apparatus according to claim 1, wherein a three-dimensional model of the space is generated by regarding a curved space as a set of hexahedrons. 9. An object 3 using the captured image
A three-dimensional model generating apparatus for generating a three-dimensional model, wherein a still image of the object is displayed, and background region data generating means for generating background region data based on plane coordinates corresponding to an end point of the specified partial region; Vertex data generating means for approximating the shape of the object with a rectangular parallelepiped based on the image and generating specified vertex data which is plane coordinates of a specified vertex and non-designated vertex data which is plane coordinates of other vertices; Object three-dimensional data generating means for generating three-dimensional data of an object based on the background area data and the designated vertex data; and generating object texture data based on the still image, the background area data, and the vertex data. ,
Further, an object three-dimensional model generating means for mapping a texture based on the object texture data and the object three-dimensional data to generate a three-dimensional model of the object. 10. A background region data generating step of displaying a still image of the subspace and generating background region data based on plane coordinates corresponding to an end point of the region in the subspace, based on the background region data, A subspace size data generation step of generating subspace size data representing the height and width of a predetermined surface constituting the subspace; and calculating a three-dimensional shape of the subspace based on the subspace size data, and A spatial three-dimensional data generating step of generating spatial three-dimensional data in which three-dimensional shapes of the subspaces are joined together; and, based on the subspace size data and the spatial three-dimensional data, all the surfaces constituting the subspace. A space management table setting step of setting predetermined size information and three-dimensional coordinates of an end point in the space management table; A connection information setting step of setting a connection relationship between subspaces in a connection table in accordance with the specification of: a predetermined size information on all surfaces of the newly connected subspace and a three-dimensional end point based on the connection relationship A space management table adding step of adding coordinates to a space management table; a subspace texture generating step of generating subspace texture data based on the still image and the background area data; and a texture data generation process for all subspaces. At the end, a texture is mapped on a surface other than the connection surface based on the space management table, the connection table, and the space three-dimensional data, and a three-dimensional model generation that generates a three-dimensional model connecting a plurality of spaces is performed. And a method for generating a three-dimensional model, comprising: . 11. A background area data generating step of displaying a still image of the subspace and generating background area data based on plane coordinates corresponding to an end point of the area in the subspace, based on the background area data, A subspace size data generation step of generating subspace size data representing the height and width of a predetermined surface forming the subspace; and a subspace 3 that is a three-dimensional shape of the subspace based on the subspace size data. Subspace three-dimensional data generating step of generating three-dimensional data; and, based on the subspace size data and the subspace three-dimensional data, predetermined size information and three-dimensional coordinates of end points on all surfaces constituting the subspace. A space management table setting step to be set in the space management table, and a connection A connection information setting step of setting, in a connection table, predetermined size information and three-dimensional coordinates of an end point on all surfaces of a newly connected subspace based on the connection relationship. A table appending step; a subspace texture generating step of generating subspace texture data based on the still image and the background area data; and mapping a texture to the subspace based on the subspace three-dimensional data. When a subspace three-dimensional model generation step of generating a three-dimensional model and all the subspace three-dimensional model generation processes are completed, a partial space three-dimensional model is generated based on the subspace three-dimensional model, the space management table, and the connection table. After cutting out the texture of the connecting surface between the spaces, 3D model generation method, which comprises a three-dimensional model connection step of generating a three-dimensional model that has Awa calm, the. 12. The method according to claim 10, further comprising: approximating the shape of the object with a rectangular parallelepiped based on the still image, and specifying designated vertex data as plane coordinates of designated vertices and non-designated vertex data as plane coordinates of other vertices. A vertex data generating step of generating, based on the background area data and the vertex data,
An object size data generating step for determining whether the object is at a distance from the front and the floor, and generating object size data representing the width, height and depth of the object; and when the object is at a distance from the front and the floor. To
Based on the background area data and the vertex data,
An offset data generating step of generating offset data representing the distance; and generating, based on the subspace three-dimensional data, the offset data and the object size data, subspace three-dimensional data with an object in which an object is arranged in the subspace. Generating an object texture data based on the still image, the background area data, and the vertex data; and generating the object texture data based on the still image, the background area data, and the vertex data. Dimensional data, the subspace three-dimensional data,
And a subspace with object three-dimensional model generating step of mapping a texture based on the subspace texture data to generate a subspace with object three-dimensional model. When the subspace three-dimensional model generation processing is completed, a plurality of subspaces are joined based on the subspace three-dimensional model, the subspace three-dimensional model with objects, the space management table, and the connection table. The three-dimensional model generation method according to claim 11, wherein the generated three-dimensional model is generated. 13. A still image in which an object to be modeled is displayed from among the still images, and corresponds to a virtual background region that is in parallel with the back surface of the object and intersects the wall surface. A virtual background area data generating step of generating virtual background area data to be generated, and generating virtual background area three-dimensional data representing three-dimensional coordinates of all vertices of the virtual background area based on the height and width of the virtual background area. A background region three-dimensional data generating step; a tilt calculating step of generating object tilt data representing an angle between an actual wall surface and a virtual wall surface based on the subspace three-dimensional data and the virtual background region three-dimensional data; The shape of the object is approximated by a rectangular parallelepiped based on the still image, and the specified vertex data, which is the plane coordinates of the specified vertex, and other A vertex data generating step of generating vertex data other than designated vertex data, which is plane coordinates of a point; a height and a width of the virtual background area; a width and a height of an object based on the virtual background area data and the designated vertex data; An object size data generation step of generating object size data representing depth; and an object in a subspace based on the subspace three-dimensional data, the virtual background region three-dimensional data, the designated vertex data, and the object inclination data. A subspace three-dimensional data with object generating object arranged subspace three-dimensional data; an object texture generating step generating object texture data based on the still image, the virtual background area data and the vertex data; , Previous Object texture data, said object with subspaces 3-dimensional data, said subspace 3-dimensional data,
And a subspace with object three-dimensional model generating step of mapping a texture based on the subspace texture data to generate a subspace with object three-dimensional model. When the subspace three-dimensional model generation processing is completed, a plurality of subspaces are joined based on the subspace three-dimensional model, the subspace three-dimensional model with objects, the space management table, and the connection table. The three-dimensional model generation method according to claim 11, wherein the generated three-dimensional model is generated. 14. An object management table setting step of setting a partial space number of a working partial space, a surface number of a surface serving as a background of an object, and predetermined object size information in an object management table; An object size information obtaining step of obtaining predetermined object size information from the object management table when the number of vertices is less than 4; and 13. The three-dimensional data with sub-objects in which objects are arranged in sub-spaces, based on the background area data, the specified vertex data, and the predetermined object size information. 3D model generation method. 15. A background area data generating step of displaying a still image of an object and generating background area data based on plane coordinates corresponding to an end point of a specified partial area; and a shape of the object based on the still image. Is approximated by a rectangular parallelepiped, the specified vertex data which is the plane coordinates of the specified vertex, and the non-designated vertex data which is the plane coordinates of the other vertices, and a vertex data generating step of generating the vertex data, the background area data and the An object size data generating step of generating object size data representing the width, height and depth of the object based on the designated vertex data; and generating object three-dimensional data as three-dimensional coordinates of the object based on the object size data. Object three-dimensional data generating step; An object texture generating step of generating object texture data based on the image, the background area data, and the vertex data; and generating a three-dimensional model of the object by mapping a texture based on the object texture data and the object three-dimensional data. A three-dimensional model generation method, comprising: generating an object three-dimensional model. 16. A background area data generating means for displaying a still image in a subspace and generating background area data based on plane coordinates corresponding to an end point of the area in the subspace; A spatial three-dimensional data generating means for generating spatial three-dimensional data by connecting a plurality of subspaces; and a connection for setting a connection relationship between the subspaces (including predetermined size information on each surface and three-dimensional coordinates of an end point). Information setting means for generating partial space texture data based on the still image and the background area data, and at the stage where the texture data generation processing for all the partial spaces is completed, based on the connection relation and the spatial three-dimensional data. 3D model generation that maps textures on surfaces other than the connection surface and generates a 3D model that connects multiple spaces A three-dimensional model generation program characterized by causing a computer to execute: 17. A background region data generating means for displaying a still image in a subspace and generating background region data based on plane coordinates corresponding to an end point of the region in the subspace; A subspace three-dimensional data generating unit that generates three-dimensional data of the space; a connection information setting unit that sets a connection relationship between the subspaces (including predetermined size information on each surface and three-dimensional coordinates of an end point); A subspace 3 for generating subspace texture data based on a still image and the background area data, and further mapping a texture in the subspace based on the subspace 3D data to generate a 3D model of the subspace.
At the stage where all the subspace three-dimensional model generation processing is completed, based on the subspace three-dimensional model and the connection relationship, after cutting out the texture of the connection surface between the subspaces, a plurality of A three-dimensional model generation program, characterized by causing a computer to execute: three-dimensional model connection means for generating a three-dimensional model by connecting spaces. 18. A background region data generating means for displaying a still image in a subspace and generating background region data based on plane coordinates corresponding to an end point of the region in the subspace; A subspace three-dimensional data generating unit that generates three-dimensional data of the space; a connection information setting unit that sets a connection relationship between the subspaces (including predetermined size information on each surface and three-dimensional coordinates of an end point); A subspace 3 for generating subspace texture data based on a still image and the background area data, and further mapping a texture in the subspace based on the subspace 3D data to generate a 3D model of the subspace.
Dimensional model generation means, the shape of the object is approximated by a rectangular parallelepiped based on the still image, the specified vertex data which is the plane coordinates of the specified vertex, and the non-designated vertex data which is the plane coordinates of the other vertices, Vertex data generating means for generating a subspace with an object for generating subspace with an object in which an object is arranged in a subspace based on the subspace three-dimensional data, the background area data, and the designated vertex data Three-dimensional data generating means, generating object texture data based on the still image, the background area data, and the vertex data,
Further, a texture mapping is performed based on the object texture data, the three-dimensional data with subspace with the object, the three-dimensional data with subspace, and the subspace texture data, and a part with an object that generates a three-dimensional subspace model with objects. A space three-dimensional model generating means, and at a stage where all the subspace three-dimensional model generation processes are completed, based on the subspace three-dimensional model, the subspace three-dimensional model with objects, and the connection relationship,
A three-dimensional model connection means for generating a three-dimensional model by connecting a plurality of subspaces; and a computer executing the program. 19. A background area data generating means for displaying a still image in a subspace and generating background area data based on plane coordinates corresponding to an end point of the area in the subspace; A subspace three-dimensional data generating unit that generates three-dimensional data of the space; a connection information setting unit that sets a connection relationship between the subspaces (including predetermined size information on each surface and three-dimensional coordinates of an end point); A subspace 3 for generating subspace texture data based on a still image and the background area data, and further mapping a texture in the subspace based on the subspace 3D data to generate a 3D model of the subspace.
A dimensional model generating means for displaying a still image in which an object to be modeled is displayed from the still images, and corresponding to a virtual background area which is in parallel with the back surface of the object and intersects the wall surface Virtual background area data generating means for generating virtual background area data; and virtual background for generating virtual background area three-dimensional data representing three-dimensional coordinates of all vertices of the virtual background area based on the height and width of the virtual background area. Area three-dimensional data generation means; inclination calculation means for generating object inclination data representing an angle between an actual wall surface and a virtual wall surface based on the subspace three-dimensional data and the virtual background area three-dimensional data; Approximate the shape of the object with a rectangular parallelepiped based on the image, the specified vertex data which is the plane coordinates of the specified vertex, and the plane coordinates of other vertices A vertex data generating means for generating vertex data other than the specified vertex data; and an object in a subspace based on the subspace three-dimensional data, the virtual background region three-dimensional data, the specified vertex data, and the object inclination data. A subspace with object three-dimensional data generating means for generating subspace with object three-dimensional data in which the object is arranged; and generating object texture data based on the still image, the virtual background area data, and the vertex data. Object texture data, subspace with object three-dimensional data, subspace 3
Subspace with object 3 for mapping a texture based on dimensional data and the subspace texture data to generate a subspace with object 3D model
At the stage where all the subspace three-dimensional model generation processes have been completed, based on the subspace three-dimensional model, the subspace three-dimensional model with objects, and the connection relationship,
A three-dimensional model connection means for generating a three-dimensional model by connecting a plurality of subspaces; and a computer executing the program. 20. A background area data generating means for displaying a still image of an object and generating background area data based on plane coordinates corresponding to an end point of a specified partial area, and a shape of the object based on the still image Is approximated by a rectangular parallelepiped, and vertex data generating means for generating designated vertex data which is plane coordinates of a designated vertex and non-designated vertex data which is plane coordinates of other vertices, and the background area data and the Object three-dimensional data generating means for generating three-dimensional data of the object based on the designated vertex data; and generating object texture data based on the still image, the background area data, and the vertex data,
And a computer that executes texture mapping based on the object texture data and the object three-dimensional data to generate a three-dimensional model of the object. program.