JP2018092300A - Three-dimensional model generation device, program thereof, and method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a three-dimensional model generation device capable of easily generating an indoor three-dimensional model without measurement by a measurer.SOLUTION: A three-dimensional model generation device 40 includes: three-dimensional base model generation means 43, which generates a three-dimensional base model by three-dimensionally measuring measurement points in a panoramic image; polygon generation means 44, which causes line segments to be selected and generates polygons in the three-dimensional base model on the basis of the selected line segments; cut-out range selection means 45, which selects a cut-out range from the panoramic image, for each of polygons in the three-dimensional base model; image cut-out means 46, which cuts out an image of the cut-out range from the panoramic image; and three-dimensional model generation means 47 which generates a three-dimensional model by associating the image of the cut-out range with the polygons in the three-dimensional base model.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a three-dimensional model generation apparatus that generates a three-dimensional model representing an indoor using an indoor panoramic image, a program thereof, and a method thereof.

  Indoor drawings of buildings are widely used for building maintenance and repair work. However, when field surveys are conducted on buildings, indoor drawings may be lost or there may be a discrepancy between the indoor drawings and the current state of the building. In this case, a surveyor having a surveying technique has to survey the building to generate an indoor drawing, which takes extra time and costs.

  In view of this, a technique for three-dimensional measurement indoors without performing surveying by a surveyor has been proposed (Patent Document 1). The method described in Patent Document 1 captures an indoor panoramic image and horizontally adjusts the captured panoramic image to measure the interior three-dimensionally.

JP2015-125002A

  However, in the method described in Patent Document 1, it is necessary to master the dedicated software for 3D measurement to acquire the coordinates of all measurement points, which is a threshold for general users. For this reason, there is a demand for a method capable of generating an indoor drawing by incorporating a three-dimensional model into general BIM (Building Information Modeling) software familiar to general users.

  Therefore, the present invention generates a three-dimensional model in which a general user can generate a three-dimensional model without performing surveying by a surveyor without using dedicated software, and the generated three-dimensional model can be used with general BIM software. It is an object to provide an apparatus, a program thereof, and a method thereof.

  In view of the above-described problems, a 3D model generation apparatus according to the present invention is a 3D model generation apparatus that generates a 3D model representing an indoor using an indoor panoramic image, and includes the inside of the panoramic image. Three-dimensional base model generation means for generating a three-dimensional base model representing the indoor three-dimensional shape in association with the panoramic image by three-dimensional measurement of the measurement points set in the above, and the measurement points Selecting a connecting line segment, and based on the selected line segment, a surface area generating means for generating the indoor surface area in the three-dimensional base model, and for each surface area of the three-dimensional base model, Cutout range selection means for selecting a cutout range from a panoramic image, image cutout means for cutting out an image of the cutout range from the panoramic image, and an image of the cutout range By associating the surface area of the three-dimensional base model, and a configuration and a three-dimensional model generating means for generating the 3-dimensional model.

  According to such a three-dimensional model generation device, a three-dimensional model is generated by associating a cut-out image from the panoramic image with each surface area of the three-dimensional base model generated from the indoor panoramic image.

  In view of the above-described problems, the three-dimensional model generation method according to the present invention includes an omnidirectional image capturing step in which an omnidirectional camera captures an indoor omnidirectional image, and a transmission device including the omnidirectional image. A celestial sphere image transmitting step for transmitting the celestial sphere image to the cloud server, a omnidirectional image receiving step for receiving the omnidirectional image from the cloud server, and the three-dimensional model generating device, A panorama image conversion step for converting an omnidirectional image into the indoor panorama image, and the three-dimensional model generation device three-dimensionally measures the measurement points set in the panorama image, thereby supporting the panorama image. In addition, a three-dimensional base model generation step for generating a three-dimensional base model representing the indoor three-dimensional shape, and the three-dimensional model generation device includes a line segment connecting the measurement points. A surface region generation step for generating the indoor surface region in the three-dimensional base model based on the selected line segment, and the three-dimensional model generation device includes a surface region of the three-dimensional base model. A cutout range selection step for selecting a cutout range from the panoramic image for each time, an image cutout step for the 3D model generation device to cut out an image of the cutout range from the panoramic image, and the 3D model generation device The 3D model generation step of generating the 3D model representing the indoor by associating the image of the cutout range with the surface area of the 3D base model is performed.

  According to such a three-dimensional model generation method, a three-dimensional model is generated by associating a cut-out image from the panoramic image with each surface area of the three-dimensional base model generated from the indoor panoramic image.

  The present invention associates a cut-out image from a panoramic image with each surface area of a three-dimensional base model generated from an indoor panoramic image. As a result, the present invention can generate a 3D model without a survey by a surveyor, without a general user using dedicated software, and can use the generated 3D model with general BIM software. .

1 is a schematic configuration diagram of a three-dimensional model generation system according to an embodiment of the present invention. It is an external view of a spherical camera. It is explanatory drawing explaining an example of an omnidirectional image. It is a block diagram which shows the structure of a three-dimensional model production | generation apparatus. It is explanatory drawing explaining conversion to a cubic panoramic image. It is explanatory drawing explaining an example of a cubic panoramic image, (a) is a front surface, (b) is a right surface, (c) is a left surface, (d) is a rear surface, (e) is a lower surface. (F) is the upper surface. It is explanatory drawing explaining the example of a display of a cubic panoramic image. It is explanatory drawing explaining the setting of the measurement point on a cubic panoramic image. It is explanatory drawing explaining an example of a three-dimensional base model. It is explanatory drawing explaining selection of a line segment, and the production | generation of a polygon. It is explanatory drawing explaining the correlation with a polygon and a cut-out image, (a) is a polygon, (b) is a cut-out image. It is explanatory drawing explaining the projection of a polygon, (a) is before projection, (b) is after projection. It is explanatory drawing explaining the deformation | transformation of a cutout range, (a) is before a deformation | transformation, (b) is after a deformation | transformation. It is explanatory drawing explaining an example of a three-dimensional model. It is a sequence diagram which shows operation | movement of a three-dimensional model production | generation system.

[Outline of 3D model generation system]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate.
With reference to FIG. 1, the outline of the three-dimensional model generation system 1 according to the embodiment of the present invention will be described.

  The three-dimensional model generation system 1 generates an indoor three-dimensional model using an omnidirectional image taken indoors with the omnidirectional camera 10. As shown in FIG. 1, the three-dimensional model generation system 1 includes an omnidirectional camera 10, a transmission device 20, a cloud server 30, a three-dimensional model generation device 40, and a PC (Personal Computer) 50.

First, how to use the three-dimensional model generation system 1 will be briefly described.
The person in charge of photography arranges a scale (not shown) inside the building to be repaired. A scale (for example, a cross rod) represents a length and is necessary for three-dimensional measurement described later. This scale is arranged vertically along the wall surface or horizontally along the floor surface. Next, the person in charge of photographing takes an omnidirectional image with the omnidirectional camera 10. Then, the person in charge of photographing operates the transmission device 20 to upload the photographed omnidirectional image to the cloud server 30.

  The operator of the 3D model generation device 40 downloads the omnidirectional image from the cloud server 30 to the 3D model generation device 40. Next, the operator operates the three-dimensional model generation device 40 to convert the omnidirectional image into a cubic panoramic image (panoramic image). Then, the operator operates the 3D model generation device 40 to generate an indoor 3D model from the cubic panoramic image. Further, the operator uploads the 3D model generated by the 3D model generation device 40 to the cloud server 30.

  A user (general user) of the PC 50 downloads the three-dimensional model from the cloud server 30 to the PC 50. Then, the general user takes the downloaded three-dimensional model into the BIM software of the PC 50 and generates an indoor drawing. In such a procedure, the 3D model generation system 1 can provide a 3D model to a general user via the cloud server 30, so that the general user does not need to use dedicated software.

[Configuration of 3D model generation system]
Hereinafter, the configuration of the three-dimensional model generation system 1 will be described.
The omnidirectional camera 10 captures an indoor celestial sphere image and outputs the captured omnidirectional image to the transmission device 20. For example, the omnidirectional camera 10 outputs an omnidirectional image (omnidirectional image file 90) via a recording medium such as an SD card or using wireless communication.

  As shown in FIG. 2, the omnidirectional camera 10 includes an omnidirectional camera main body 11 that captures an omnidirectional image, and a tripod 13 on which the omnidirectional camera main body 11 is placed. In addition, as shown in FIG. 3, the omnidirectional image is an image obtained by photographing the entire circumference of 360 degrees and 180 degrees up and down with the omnidirectional camera body 11 as the center.

The transmission device 20 transmits the omnidirectional image captured by the omnidirectional camera 10 to the cloud server 30. For example, examples of the transmission device 20 include a portable terminal 21 and a PC 23 having a communication function such as wireless communication and wired communication.
Note that it is only necessary to provide one of the mobile terminal 21 or the PC 23 as the transmission device 20, and it is not necessary to provide both.

  The cloud server 30 is a server group constructed in a cloud environment, and accumulates and transmits / receives omnidirectional images and cubic panoramic images. Specifically, the cloud server 30 accumulates the omnidirectional image received from the transmission device 20 and transmits it to the three-dimensional model generation device 40. In addition, the cloud server 30 accumulates the three-dimensional model received from the three-dimensional model generation device 40 and transmits it to the PC 50.

The three-dimensional model generation apparatus 40 converts the omnidirectional image received from the cloud server 30 into a cubic panoramic image, and generates an indoor three-dimensional model using the converted cubic panoramic image. Then, the three-dimensional model generation device 40 transmits the generated three-dimensional model to the cloud server 30.
Details of the three-dimensional model generation device 40 will be described later.

  The PC 50 receives a three-dimensional model from the three-dimensional model generation device 40, takes the received three-dimensional model into BIM software, and generates an indoor drawing. For example, the PC 50 may be a computer having a communication function such as wireless communication or wired communication and having general BIM software installed.

[Configuration of 3D model generator]
The configuration of the three-dimensional model generation device 40 will be described with reference to FIG.
As shown in FIG. 4, the three-dimensional model generation device 40 includes an image transmission / reception means 41, a cubic panoramic image conversion means 42, a three-dimensional base model generation means 43, a polygon generation means (surface area generation means) 44, A cutout range selection unit 45, an image cutout unit 46, and a three-dimensional model generation unit 47 are provided.

  The image transmission / reception means 41 transmits / receives an omnidirectional image and a panoramic image to / from the cloud server 30. Specifically, the image transmission / reception unit 41 receives the omnidirectional image from the cloud server 30 and outputs the received omnidirectional image to the panoramic image conversion unit 42. The image transmission / reception unit 41 transmits the 3D model input from the 3D model generation unit 47 to the cloud server 30.

  The cubic panoramic image converting unit 42 converts the omnidirectional image input from the image transmitting / receiving unit 41 into a cubic panoramic image. As shown in FIG. 3, the omnidirectional image is distorted and is not suitable for generating a three-dimensional model. For this reason, the cubic panoramic image conversion means 42 converts the omnidirectional image into a cubic panoramic image without distortion.

  As shown in FIG. 5, the cubic panoramic image is an image obtained by projecting an omnidirectional image inside each surface (upper surface, lower surface, left surface, right surface, front surface, rear surface) of a regular hexahedron. For example, as shown in FIG. 6, the cubic panoramic image is obtained by pasting the omnidirectional image inside each surface of the regular hexahedron of FIG. 6A is the front surface of the cubic panoramic image, FIG. 6B is the right surface of the cubic panoramic image, and FIG. 6C is the left surface of the cubic panoramic image. 6D is a rear surface of the cubic panoramic image, FIG. 6E is a lower surface of the cubic panoramic image, and FIG. 6F is an upper surface of the cubic panoramic image.

  The three-dimensional base model generation unit 43 receives a cubic panoramic image from the cubic panoramic image conversion unit 42. Then, the three-dimensional base model generation means 43 generates a three-dimensional base model representing the indoor three-dimensional shape in association with the panoramic image by three-dimensionally measuring the measurement points set in the cubic panoramic image. To do.

  Specifically, the three-dimensional base model generation unit 43 horizontally adjusts the cubic panoramic image and sets measurement points on the horizontally adjusted cubic panoramic image. Here, the three-dimensional base model generation means 43 performs the horizontal adjustment accurately by software.

  Next, the three-dimensional base model generating unit 43 displays the horizontally adjusted cubic panoramic image on a display unit such as a display (not shown) as shown in FIG. Then, the operator sets (inputs) the measurement point P on the cubic panoramic image as shown in FIG. 8 via an operation unit such as a mouse or a keyboard (not shown). Further, the operator sets a line segment connecting the measurement points P on the cubic panoramic image via the operation means. This line segment represents an indoor boundary (for example, a boundary between a floor surface and a wall surface).

In the example of FIG. 8, the operator has set the measurement points P1 to P4 in the indoor corner. Further, the operator sets a line segment connecting the measurement points P1 and P2, a line segment connecting the measurement points P2 and P3, a line segment connecting the measurement points P3 and P4, and a line segment connecting the measurement points P4 and P1. (Shown with bold lines).
Although FIG. 8 illustrates an example in which the measurement points P1 to P4 and these line segments are set, it goes without saying that the operator sets all necessary measurement points P and line segments.

Then, the three-dimensional base model generation unit 43 three-dimensionally measures the coordinates of the measurement points P1 to P4 on the horizontal plane by back projecting the measurement points P1 to P4 onto a horizontal plane whose height is known. Further, the three-dimensional base model generation unit 43 projects back the points located on the vertical lines of the measured measurement points P1 to P4 onto the vertical lines, so that the coordinates in the height direction of the measurement points P1 to P4 are 3 Dimension measurement. And the three-dimensional base model production | generation means 43 calculates | requires the three-dimensional coordinate of the measurement points P1-P4 combining the coordinate of a horizontal surface and a height direction.
Note that details of the three-dimensional measurement are described in, for example, Japanese Patent Application Laid-Open No. 2015-125002, and thus further description thereof is omitted.

  Since the measurement points P1 to P4 are set on the cubic panoramic image, the image coordinates of the measurement points P1 to P4 are known. Further, the three-dimensional coordinates of the measurement points P1 to P4 are obtained at the time of three-dimensional measurement. That is, the measurement points P1 to P4 associate the image coordinates of the cubic panoramic image with the three-dimensional coordinates of the three-dimensional base model.

  As shown in FIG. 9, the three-dimensional base model BM is a model that represents an indoor shape with measurement points P and line segments connecting the measurement points P. That is, the three-dimensional base model BM represents only the indoor shape, and does not represent information other than the shape (for example, floor surface material).

  The polygon generating unit 44 causes the operator to select a line segment connecting the measurement points P, and generates a polygon in the three-dimensional base model BM based on the selected line segment. For example, the polygon generating unit 44 displays the cubic panoramic image and the three-dimensional base model BM on the display unit (see FIG. 8). Then, the operator selects a line segment on the three-dimensional base model BM through the operation means.

<Line segment selection, polygon generation>
With reference to FIG. 10, selection of line segments and generation of polygons by the polygon generation means 44 will be described in detail.
In the present embodiment, the operator selects all the line segments L necessary for generating the polygon A among the line segments set by the three-dimensional base model generating unit 43. At this time, the operator selects a continuous line segment L so as to surround the polygon of the three-dimensional base model BM clockwise. For example, as shown in FIG. 10, the operator sequentially selects a line segment L1 connecting the measurement points P1 and P2 and a line segment L2 connecting the measurement points P2 and P3. Next, the operator sequentially selects a line segment L3 connecting the measurement points P3 and P4 and a line segment L4 connecting the measurement points P4 and P1. Thereby, the polygon generating means 44 generates a surface area surrounded by the clockwise line segments L1 to L4 as the polygon A.

Although the example in which the line segment L1 is first selected has been described, any of the line segments L2, L3, and L4 may be selected first as long as the line segment L1 is continuous in the clockwise direction.
Further, when the selection order of the line segment L is counterclockwise like the line segments L4 to L1, the polygon generation unit 44 does not accept the selection. Furthermore, the polygon generation unit 44 is configured so that the line segment L does not enclose a specific area when the line segment L is discontinuous like the line segments L1, L3, L2, and L4, or like the line segments L1 and L2. If it does not accept that choice.
The polygon generation unit 44 does not accept the selection even when the number of continuous line segments L is three or less, that is, when the region surrounded by the line segments L is a triangle. On the other hand, when there are four or more continuous line segments L, the polygon generation unit 44 accepts the selection.

  Each polygon A is added with identification information (for example, “100”, “101”) for uniquely identifying the polygon A. Further, the polygon A can be expressed by a combination of four or more line segments L as shown in FIG. For example, the polygon A1 can be expressed by a combination of line segments L1 to L4. Here, the polygon A has a front surface and a back surface, and becomes a front surface in the order in which the line segment L is selected clockwise. For example, the side of the polygon A1 lined up in the order of the line segments L1 to L4 is the surface. Further, a cut-out image to be described later can be associated (pasted) on the surface of the polygon A. As described above, the three-dimensional base model BM can express the indoor shape by the combination of the polygons A.

<Polygon projection>
With reference to FIG. 12, the projection of the polygon A by the polygon generation means 44 will be described in detail.
As shown in FIG. 12A, in the polygon A, the measurement point P and the line segment L may not be located on the same reference plane due to a three-dimensional measurement error. Here, the reference plane is a vertical plane (XY plane in FIG. 12) or a horizontal plane (XZ plane in FIG. 12). In FIG. 12A, the measurement point P2 and the line segments L1 and L2 are not located on the vertical plane that is the reference plane. In this case, the polygon generation means 44 refers to the coordinates of the measurement point P2, and determines that the measurement point P2 is not located on the vertical plane. Then, as shown in FIG. 12B, the polygon generation unit 44 projects the measurement points P2 determined not to be located on the vertical plane and the line segments L1 and L2 having the measurement points P2 as end points on the vertical plane. To do.
Note that FIG. 12 shows only the three-dimensional base model BM and makes the cubic panoramic image not shown for easy viewing of the drawing.

Returning to FIG. 4, the description of the configuration of the three-dimensional model generation device 40 will be continued.
The cutout range selection unit 45 is for causing the operator to select a cutout range from the panoramic image for each polygon of the three-dimensional base model BM. For example, the cutout range selection unit 45 displays the cubic panoramic image and the three-dimensional base model BM on the display unit in a superimposed manner. Then, the operator selects a polygon to be cut out on the three-dimensional base model BM via the operation means. At this time, it goes without saying that the operator selects all necessary polygons.

The image cutout unit 46 cuts out the image of the cutout range input from the cutout range selection unit 45 from the cubic panoramic image.
As described above, the measurement point P associates the three-dimensional coordinates of the three-dimensional base model BM with the image coordinates of the cubic panoramic image. Therefore, as shown in FIG. 11B, the image cutout unit 46 obtains image coordinates of the measurement points P1 to P4 constituting the polygon A selected as the cutout range. Then, the image cutout unit 46 cuts out the image of the cutout range specified by the image coordinates of the measurement points P1 to P4 from the cubic panoramic image.

<Deformation of cutout range>
With reference to FIG. 13, the modification of the cutout range by the image cutout means 46 will be described in detail.
As shown in FIG. 13A, the cutout range may be five or more sides. In this case, as shown in FIG. 13B, the image cutout unit 46 converts the cutout range into a quadrangular shape circumscribing the cutout range. Then, the image cutout unit 46 cuts out the image of the cutout range converted into the rectangular shape from the cubic panoramic image.

  Here, when the cutout range of FIG. 13A corresponds to the floor surface, the region B expanded when deformed into a quadrangular shape is a structure (for example, a pillar) other than the floor surface in the three-dimensional base model BM. Is present. That is, the structure other than the floor is included in an image in another cutout range. For this reason, the image cutout means 46 does not use the expanded area B.

Returning to FIG. 4, the description of the configuration of the three-dimensional model generation device 40 will be continued.
The three-dimensional model generation unit 47 associates the cut-out image input from the image cut-out unit 46 with the polygon of the three-dimensional base model BM input from the three-dimensional base model generation unit 43, so that the indoor three-dimensional model M (FIG. 14) is generated. As shown in FIG. 14, the three-dimensional model M includes a three-dimensional base model BM, an image file of each polygon, and an image arrangement location file.

  As described above, the polygon of the three-dimensional base model BM and the cutout range of the cubic panoramic image are associated with each other at the measurement point P. Therefore, as shown in FIG. 14, the three-dimensional model generation unit 47 associates an indoor wall in the three-dimensional base model BM with a cut-out image of the wall. Furthermore, the three-dimensional model generation means 47 associates the floor and ceiling in the three-dimensional base model BM with the cut image of the floor and ceiling, as with the wall. Thereafter, the three-dimensional model generation unit 47 generates an image arrangement location file representing an arrangement location of an image file (for example, “wall.jpg”) corresponding to each polygon such as a wall, a floor, and a ceiling.

  As described above, the three-dimensional model generation device 40 according to the embodiment of the present invention converts an indoor omnidirectional image into a cubic panoramic image, and generates a three-dimensional base model BM from the converted cubic panoramic image. Then, the three-dimensional model generation device 40 generates the three-dimensional model M by associating the cut-out image from the cubic panoramic image with each polygon of the generated three-dimensional base model BM. As described above, the three-dimensional model generation apparatus 40 does not need to perform surveying by the surveyor, and does not require the surveyor's arrangement or the time adjustment of the surveying work, and can generate the three-dimensional model M in a short time and at low cost.

  Furthermore, unlike the conventional dedicated software, the three-dimensional model generation device 40 can efficiently generate the three-dimensional model M without generating a return operation when acquiring the coordinates of all measurement points.

[Operation of 3D model generation system]
The operation of the three-dimensional model generation system 1 will be described with reference to FIG. 15 (see FIG. 4 as appropriate).
The omnidirectional camera 10 captures an indoor celestial sphere image (step S1: omnidirectional image capturing step), and outputs the captured omnidirectional image to the transmission device 20 (step S2).
The transmission device 20 transmits the omnidirectional image input in step S2 to the cloud server 30 (step S3: omnidirectional image transmission step).

The image transmission / reception means 41 of the three-dimensional model generation device 40 receives the omnidirectional image from the cloud server 30 (step S4: omnidirectional image reception step).
The cubic panoramic image conversion means 42 of the three-dimensional model generation device 40 converts the omnidirectional image received in step S4 into a cubic panoramic image (step S5: panoramic image conversion step).

The three-dimensional base model generation unit 43 of the three-dimensional model generation device 40 sets the measurement point P and the line segment on the cubic panoramic image, and measures the set measurement point P three-dimensionally, thereby the indoor three-dimensional base model. A BM is generated (step S6: three-dimensional base model generation step).
The polygon generation unit 44 of the three-dimensional model generation device 40 causes the operator to select a line segment L connecting the measurement points P, and generates a polygon in the three-dimensional base model BM based on the selected line segment L. (Step S7: Polygon generation step).

The cutout range selection unit 45 of the three-dimensional model generation apparatus 40 causes the operator to select a cutout range for each polygon of the three-dimensional base model BM (step S8: cutout range selection step).
The image cutout unit 46 of the three-dimensional model generation apparatus 40 cuts out an image in the cutout range selected in step S8 from the cubic panoramic image (step S9: image cutout step).

The three-dimensional model generation means 47 of the three-dimensional model generation apparatus 40 generates the indoor three-dimensional model M by associating the image cut out in step S9 with the polygon of the three-dimensional base model BM generated in step S7. (Step S10: Three-dimensional model generation step).
The image transmission / reception means 41 of the three-dimensional model generation device 40 transmits the three-dimensional model M generated in step S10 to the cloud server 30 (step S11).

The PC 50 receives the three-dimensional model M from the cloud server 30 (step S12).
The PC 50 takes the three-dimensional model M received in step S12 into the BIM software, and generates an indoor drawing (step S13).

  As described above, the 3D model generation system 1 according to the embodiment of the present invention converts an indoor celestial sphere image into a cubic panoramic image, and generates a 3D base model BM from the converted cubic panoramic image. Then, the three-dimensional model generation system 1 generates a three-dimensional model M by associating a cut-out image from the cubic panoramic image with each polygon of the generated three-dimensional base model BM. As described above, the three-dimensional model generation system 1 does not need to perform surveying by the surveyor, and it is not necessary to arrange the surveyor or adjust the time of the surveying work, and can generate the three-dimensional model M in a short time and at low cost.

  Further, the 3D model generation system 1 generates a 3D model by the 3D model generation device 40 without using a dedicated software by a general user, and uses the generated 3D model in the BIM software of the PC 50. be able to.

Furthermore, the three-dimensional model generation system 1 can provide a mechanism for performing a series of operations from taking an omnidirectional image to generating a three-dimensional model M and generating an indoor drawing in a simple and short time.
Furthermore, since the 3D model generation system 1 can transmit and receive the omnidirectional image and the 3D model M in a secure environment via the cloud server 30, it is excellent in safety.
Furthermore, since the three-dimensional model generation system 1 can take a celestial sphere image in a short time, it is not necessary to perform a surveying operation for a long time indoors, and is excellent in convenience.

[Modification]
As mentioned above, although embodiment of this invention was explained in full detail, this invention is not limited to above-described embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included.
In the above-described embodiment, the three-dimensional model is described as being transmitted to the delivery destination, but the transmission destination of the three-dimensional model is not particularly limited.

  In the above-described embodiment, the three-dimensional model generation apparatus may edit, delete, and divide polygons. For example, the operator can move, add, or delete a node (measurement point) of a polygon as a polygon editing operation.

  In the above-described embodiment, the three-dimensional model generation device may display the generated three-dimensional model on the display unit. Thereby, since the operator can confirm the generated three-dimensional model, it is excellent in convenience.

  In the above-described embodiment, the three-dimensional model generation device has been described as independent hardware, but the present invention is not limited to this. For example, the three-dimensional model generation apparatus can also be realized by a three-dimensional model generation program that causes hardware resources such as a CPU, a memory, and a hard disk included in a computer to cooperate with each other as described above. This program may be distributed through a communication line, or may be distributed by writing in a recording medium such as a CD-ROM or a flash memory.

DESCRIPTION OF SYMBOLS 1 3D model production | generation system 10 Spherical camera 20 Transmission apparatus 30 Cloud server 40 3D model production | generation apparatus 41 Image transmission / reception means 42 Cubic panorama image conversion means 43 3D base model production | generation means 44 Polygon production means (surface area production | generation means)
45 cutout range selection means 46 image cutout means 47 three-dimensional model generation means

Claims (6)

A three-dimensional model generation device that generates a three-dimensional model representing the indoor using an indoor panoramic image,
Three-dimensional base model generation means for generating a three-dimensional base model representing the indoor three-dimensional shape in association with the panoramic image by three-dimensionally measuring measurement points set in the panoramic image;
A surface area generating means for selecting a line segment connecting the measurement points and generating the indoor surface area in the three-dimensional base model based on the selected line segment;
Clipping range selection means for selecting a clipping range from the panoramic image for each surface area of the three-dimensional base model;
Image cutout means for cutting out the image of the cutout range from the panoramic image;
3D model generation means for generating the 3D model by associating the image of the cutout range with the surface area of the 3D base model;
A three-dimensional model generation device comprising:   The surface area generation means selects the continuous line segment so as to surround the surface area of the three-dimensional base model in a clockwise direction, and selects the surface area surrounded by the line segment continuous in the clockwise direction as the three-dimensional base. The three-dimensional model generation apparatus according to claim 1, wherein the three-dimensional model generation apparatus is generated in a model.   The surface region generation unit projects the line segment and the measurement point onto the same reference plane when the clockwise continuous line segment and the measurement point of the line segment are not located on the same reference plane. The three-dimensional model generation apparatus according to claim 2.   The image cutout means, when the cutout range is five or more sides, converts the cutout range into a quadrangular shape circumscribing the cutout range, and cuts out the converted image of the cutout range from the panoramic image. The three-dimensional model generation device according to any one of claims 1 to 3.   A three-dimensional model generation program for causing a computer to function as the three-dimensional model generation device according to any one of claims 1 to 4. An omnidirectional camera captures an omnidirectional image of an indoor celestial sphere image,
A celestial sphere image transmitting step in which the transmitting device transmits the omnidirectional image to a cloud server;
A three-dimensional model generation device receiving an omnidirectional image from the cloud server;
A panoramic image conversion step in which the three-dimensional model generation device converts the omnidirectional image into the indoor panoramic image;
The three-dimensional model generation device generates a three-dimensional base model representing the indoor three-dimensional shape in association with the panoramic image by three-dimensionally measuring measurement points set in the panoramic image. A dimension-based model generation step;
A surface region generating step in which the three-dimensional model generation device selects a line segment connecting the measurement points and generates the indoor surface region in the three-dimensional base model based on the selected line segment; ,
A cutout range selection step in which the 3D model generation device selects a cutout range from the panoramic image for each surface area of the 3D base model;
An image cutout step in which the three-dimensional model generation device cuts out an image of the cutout range from the panoramic image;
A three-dimensional model generation step in which the three-dimensional model generation device generates a three-dimensional model representing the indoor by associating the image of the cut-out range with the surface area of the three-dimensional base model;
A three-dimensional model generation method characterized by executing

Images