JP2017130049A5 - - Google Patents

Description

An object of the present invention is to provide a technique capable you to view the image and the three-dimensional model efficiently.

The image processing apparatus according to the present invention includes an acquisition unit configured to acquire a three-dimensional model of the structure generated based on feature points in a plurality of images included in an image group obtained by imaging the structure from a plurality of different positions. Display control for displaying on the display device an image obtained by capturing a part of the structure corresponding to a portion specified by a user in the three-dimensional model among the plurality of images included in the three-dimensional model and the image group Ru and means.

According to the present invention, an image and a three-dimensional model can efficiently display to Rukoto.

Claims (17)

Acquisition means for acquiring a three-dimensional model of the structure generated based on feature points in a plurality of images included in an image group obtained by imaging the structure from a plurality of different positions;
Display control for displaying on the display device an image obtained by capturing a part of the structure corresponding to a portion specified by a user in the three-dimensional model among the plurality of images included in the three-dimensional model and the image group the image processing apparatus according to claim Rukoto provided with <br/> and means. The image group includes a first image group in which the structure is imaged from a close position, and a second image group in which the structure is imaged in a wider imaging range than the first image group,
Of the plurality of images included in the image group displayed by the display control means, an image obtained by capturing a part of the structure corresponding to a portion specified by the user in the three-dimensional model is the first image. The image processing apparatus according to claim 1, wherein the image processing apparatus includes an image included in the image group. The image processing apparatus according to claim 2, wherein the three-dimensional model is a wide-area three-dimensional model of the structure generated based on at least a feature point in an image of the second image group. The display control means displays an image obtained by capturing a part of the structure corresponding to a portion specified by the user in the displayed three-dimensional model so as to be superimposed on the three-dimensional model. The image processing apparatus according to any one of 1 to 3. The display control means displays a list of images obtained by capturing a part of the structure corresponding to a portion designated by the user in the displayed three-dimensional model together with the three-dimensional model. The image processing apparatus according to any one of 1 to 4. Associating means for performing a first process of associating a feature point in an arbitrary image included in the second image group with a feature point in another image included in the second image group ;
On the basis of the first processing result, the image processing apparatus according to any one of claims 2-4, characterized in further comprising Rukoto a generation unit, a generating the three-dimensional model. Said associating means further performs a feature point in the image included in the first image group, the second processing for associating the feature points in the image included in the second image group,
The image processing apparatus according to claim 6 , wherein the generation unit generates the three-dimensional model based on a result of the second process. A feature point in any of the images included in the first image group, a process of Ru correspondence between feature points in the other image included in the first image group, optionally included in the second image group a feature point in the image, and correlating means intends rows and processing for associating the feature point in the second image group to another image included,
The image processing apparatus according to claim 2, further comprising: a generating unit that generates the three-dimensional model based on a result of processing by the association unit . The association unit associates feature points in images included in the first image group with feature points in other images included in the first image group, and is included in the second image group. further performed a feature point in an arbitrary image, the third processing Ru correspondence between feature points in the other image included in the second image group,
The image processing apparatus according to claim 6 , wherein the generation unit generates the three-dimensional model based on a result of the first process and a result of the third process. Detecting means for detecting a feature point in an image included in the second image group;
Determining means for determining a three-dimensional point group of the structure based on the feature points detected by the detecting means;
The image processing apparatus according to claim 2, wherein the three-dimensional model is generated based on the three-dimensional point group. The determining unit is configured to apply the cubic to the three-dimensional point group of the structure corresponding to the feature point in the image included in the first image group and the feature point in the image included in the second image group. Evaluate whether or not the feature point association in the image included in the first image group with respect to the original point group is incorrect, and if it is incorrect, in the first image group with respect to the three-dimensional point group The image processing apparatus according to claim 10 , wherein the association of the feature points in the included image is removed. Further comprising a classification means for classifying an input image into the image of the image and the second image group of the first image group,
Wherein the display control unit, out of the images sorted as an image of the first image group by the classifying means, and displaying the image corresponding to the user-specified portion in the three-dimensional model The image processing apparatus according to any one of claims 2 to 11 . The image processing apparatus according to any one of claims 10 to 12 , wherein the display control unit displays the three-dimensional point group on the three-dimensional model. When the three-dimensional point in the three-dimensional point group displayed on the three-dimensional model is designated by the user , the display control means is configured to correspond to the first three-dimensional point corresponding to the designated three-dimensional point. The image processing apparatus according to claim 13, wherein an image included in the image group is displayed. The display control means constitutes an approximate surface at a three-dimensional point designated by the user among the three-dimensional point group displayed on the three-dimensional model, and corresponds to the designated three-dimensional point. The image processing apparatus according to claim 14, wherein an image included in the first image group is displayed by being pasted on the approximate plane. Obtaining a three-dimensional model of the structure generated based on feature points in a plurality of images included in an image group obtained by imaging the structure from a plurality of different positions;
Displaying on the display device an image obtained by capturing a part of the structure corresponding to a portion designated by the user in the three-dimensional model among the plurality of images included in the three-dimensional model and the image group; image processing method according to claim Rukoto comprises a <br/>. The program for functioning a computer as each means of the image processing apparatus as described in any one of Claims 1-15 .