JPH09190550A - Generation method and device for omnidirectional image display data - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily generate omnidirectional data by photographing an image that covers the entire circumference of a measurement position, producing a spherical polygon plane model around the measurement position and then photographing a texture image that is stuck to the polygon plane model. SOLUTION: An observer photographs the peripheral scenes with an omnidirectional photographing device 1, and the image data are stored in a frame buffer 2 and then in a photographing data storage area d1 of a 2nd storage 6 together with the data in the optical axis directions. When the number of devices constructing the device 1 is set at N pieces, N sheets of images are obtained. Then, a polygon patch is produced based on the optical axis directions of devices constructing the device 1 to approximately show a peripheral shape around the measurement spot. The counter which designates the polygon patch is initialized and the count value is set at 1. Then, a texture image to be stuck to the polygon patch designated by the counter is generated. Thereby, the omnidirectional scene images can be produced in response to the lines of sight.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and apparatus for generating omnidirectional image display data, and more particularly to the use of computer graphics techniques to determine the surroundings of an observation position according to the direction of the observer's line of sight. The present invention relates to an omnidirectional image display data generation method and a generation method thereof, which are suitable for generating data for displaying a landscape.

[0002]

2. Description of the Related Art Conventionally, as a method of obtaining a landscape image around an observation position in a three-dimensional space, there is a method of capturing a landscape over a wide range into one image by using a wide-angle lens, for example. In addition to the method using the wide-angle lens, 3
There is a Voronoi diagram construction method that divides a three-dimensional space into non-overlapping regions based on the positions of a plurality of points (generic points) distributed in the three-dimensional space (reference: "Computational Geometry and Geographic Information Processing" (Kyoritsu Publication, separate volume, pp.126-132, "Numerically stable sequential addition method for 3D Voronoi diagram construction"
(Journal of Information Processing Society of Japan, Vol.35, No.1 pp.1-10 1994)).

Furthermore, the shape of a three-dimensional object is approximately expressed as a set of minute polygonal planes (polygon patches), and an image (texture image) is created by projecting an image of the object onto each polygon patch. Computer graphics that create an image of an object viewed from an arbitrary observation direction by transforming and combining texture images based on the projective relationship determined from the positional relationship between the observer's line of sight and each polygon patch. Is known (texture mapping).

[0004]

By the way, in order to present a landscape image around the observer in accordance with the direction of the observer's line of sight, the landscape is photographed using a conventional image photographing method using a wide-angle lens. A method of extracting and presenting a part of a captured image can be considered. However, in this method, it is necessary to correct the image distortion before presenting the image to the observer, and when a wide-angle lens is used, the image distortion is significant, so it is difficult to correct the image distortion. There was a problem.

Therefore, in order to solve the above-mentioned problems, an image pickup device equipped with a lens that does not require correction of image distortion or is simple in correction work is used while changing the optical axis direction. After dividing the surrounding landscape into multiple images and shooting them, the shape of the sphere centered at the observation position is expressed by a set of minute polygonal planes (polygon patches), and appropriate images in each polygon patch are captured. It is conceivable to generate an image to be presented to the observer by pasting such portions (texture mapping).

However, when the above-mentioned image pickup device is used, there has been a problem that a method for generating a polygon patch model according to the arrangement of the image pickup device at the time of shooting each image has not been developed yet. Even if a polygon patch model expressing a spherical surface could be generated, there was a problem that a method for generating a texture image to be attached to each polygon patch forming the polygon patch model has not been developed yet.

The present invention has been made in view of the above points, and simply creates data for displaying a landscape in all directions around an observation position in a three-dimensional space without performing image distortion correction. It is an object of the present invention to provide an omnidirectional image display data generation method and a generation device that enable the above.

[0008]

In order to achieve the above object, the invention of claim 1 is an omnidirectional image display for generating data for displaying a captured image around an observation position according to the direction of the line of sight of an observer. Image data generating method, a step of capturing a set of images covering the entire circumference of an observation position in a three-dimensional space, and a polygonal plane that approximately expresses the shape of a spherical surface centered on the observation position. A polygonal plane creating step for creating a model, and a texture image for producing a texture image to be attached to each polygonal plane of the polygonal plane model created in the polygonal plane creating step based on the image group taken in the image taking step. And a generation step.

In order to achieve the above-mentioned object, the invention of claim 2 is the method for generating omnidirectional image display data according to claim 1, wherein in the polygonal plane creating step, each image in the image taking step is taken. It is characterized in that the polygonal plane model is created by using a three-dimensional Voronoi diagram configured with the intersection of the optical axis and the spherical surface as a generating point.

In order to achieve the above object, the invention of claim 3 is the method of generating data for omnidirectional image display according to claim 1 or 2, wherein in the texture image generating step, each image capturing in the image capturing step is performed. It is characterized in that the texture image is generated using a three-dimensional Voronoi diagram configured with the intersection of the optical axis and the spherical surface as the generating point.

In order to achieve the above object, the invention of claim 4 is an omnidirectional image display data generating apparatus for generating data for displaying a photographed image around an observation position according to the direction of the line of sight of an observer. Image capturing means for capturing a set of images covering the entire circumference of the observation position in the three-dimensional space, and a polygon for creating a polygonal plane model that approximately expresses the shape of a spherical surface centered on the observation position. And a texture image generation unit for generating a texture image to be attached to each polygonal plane of the polygonal plane model created by the polygonal plane creation unit based on an image group photographed by the image photographing unit. It is characterized by

In order to achieve the above object, a fifth aspect of the present invention is the omnidirectional image display data generating apparatus according to the fourth aspect, wherein the polygonal plane creating means is provided for each of the image taking means. It is characterized in that the polygonal plane model is created by using a three-dimensional Voronoi diagram configured with the intersection of the optical axis and the spherical surface as a generating point.

In order to achieve the above object, the invention of claim 6 is the omnidirectional image display data generating apparatus according to claim 4 or 5, wherein the texture image generating means is one of the image capturing means. It is characterized in that the texture image is generated using a three-dimensional Voronoi diagram configured with the intersection of the optical axis and the spherical surface as the generating point.

In order to achieve the above object, the invention of claim 7 is the omnidirectional image display data generating device according to claim 4, 5 or 6, wherein the image capturing means is a sphere of a casing such as a sphere. It is characterized by comprising a plurality of image pickup units arranged along the direction.

In order to achieve the above object, the invention of claim 8 is the omnidirectional image display data generating apparatus according to claim 4, 5 or 6, wherein the image capturing means comprises a plurality of CCD cameras. It is characterized by being configured.

In order to achieve the above object, the invention of claim 9 is the omnidirectional image display data generating apparatus according to claim 4, 5 or 6, wherein the image capturing means is capable of changing the optical axis direction. It is characterized by being configured with a single possible camera.

[0017]

Embodiments of the present invention will be described below with reference to the drawings.

(1) First embodiment.

First, the basic configuration of the omnidirectional image display data generating apparatus according to the first embodiment will be described with reference to FIG. The omnidirectional image display data generation device includes an omnidirectional imaging device 1, a frame buffer 2, a CPU (central processing unit) 3, and an interface (an input / output unit with an external device) 4.
And a first storage device 5 and a second storage device 6.

Explaining in detail the configuration of each of the above parts, the omnidirectional photographing device 1 photographs a group of images covering the periphery of the observation point. The frame buffer 2 temporarily stores the image photographed by the photographing device 1. The CPU 3 performs the processing of FIGS. 4 and 5 described later based on the processing procedure stored in the first storage device 5, and includes a counter i (described later). The interface 4 sends and receives data between the omnidirectional image display data generating device and an external device (not shown).

The first storage device 5 stores the processing procedure of the CPU 3, and includes a storage area r1 for the image capturing routine of the omnidirectional image display data generation program, a storage area r2 for the polygon patch generation routine, and a texture. A storage area r3 for an image generation routine is provided. The second storage device 6 stores information necessary for the processing of the CPU 3 and input / output data, and is a storage area d1 for shooting data.
A storage area d2 for Voronoi diagram data, a storage area d3 for polygon patch data, and a storage area d4 for texture image data.

FIG. 2 is a sectional view of the omnidirectional photographing device 1 of the omnidirectional image display data generating device. Omnidirectional imaging device 1
Is configured to include a housing 7 and a plurality of imaging devices 8 ... The housing 7 of the omnidirectional imaging device 1 is configured as a sphere, and the housing 7 is equipped with a plurality of image pickup devices 8 ... All of these imaging devices 8 have their optical axes 9
Are arranged so as to pass through the center 10 of the housing 7. It should be noted that the image pickup devices 8 do not necessarily have to be arranged inside the housing 7 at a uniform density.

FIG. 3 is a diagram showing the data structure of a polygon patch data file stored in the second storage device 6 of the omnidirectional image display data generation device. In FIG. 3, 11
Indicates vertex data, which is data in which the identifier IDv is assigned to the three-dimensional coordinates (X, Y, Z) of the vertices of all polygon patches (polygonal planes). Reference numeral 12 denotes a delimiter (a symbol that limits a character string), which represents a partition between vertex data (vertex coordinates) 11 and connection information 13 between vertices. Reference numeral 13 denotes polygon connection information, which represents one polygon patch with a combination of a polygon identifier IDv, a texture image identifier IDt attached to the polygon patch, and a vertex identifier. Reference numeral 14 is a code indicating the end of the shape data file.

Next, the procedure for generating the omnidirectional image display data using the program stored in the first storage device 5 of the omnidirectional image display data generating device will be described with reference to FIG.

First, in step SA1, the observer uses the omnidirectional photographing device 1 to photograph the scenery around the observation point.
The image data captured by the omnidirectional image capture device 1 is temporarily stored in the frame buffer 2 and then stored in the second storage device 6.
Is stored in the shooting data storage area d1 together with the data in the optical axis direction. Here, assuming that the number of image capturing devices 8 forming the omnidirectional image capturing device 1 is N, N images (I1 to I2)
Is obtained.

In step SA2, a polygon patch that approximately expresses the shape of a spherical surface centered at the observation point is created based on the optical axis direction of the image pickup device 8 which constitutes the omnidirectional image pickup device 1. That is, in step SA2, the same number (N) of polygon patches as the number of imaging devices 8 are generated. Step SA2 will be described later in detail.

At step SA3, a counter i for designating a specific polygon patch is initialized to a value of 1. At Step SA4, a texture image to be attached to the polygon patch designated by the counter i is generated. Step SA4 will be described in detail later. Step SA5
Then, the value of the counter i is incremented.

At step SA6, the value of the counter i and N
It is determined whether the magnitude relation with and is i> N or i ≦ N. If i> N, it is determined that the texture image generation processing has been completed for all polygon patches, and the process proceeds to step SA7. On the other hand, if it is determined that i ≦ N, it is determined that there is a polygon patch for which the texture image generation processing has not been performed, and step SA4
Return to In step SA7, the polygon patch data and the texture data are output to the external device via the interface (input / output unit with the external device) 4, and the process ends.

Next, the polygon patch creation processing (step SA2 in FIG. 4) will be described with reference to FIG.

First, in step SB1, a spherical surface S having an appropriate radius centered on the observation position of the observer is set. In step SB2, a counter j for designating a specific image pickup device in the omnidirectional photographing device 1 is initialized to a value of 1. In step SB3, the coordinates of the intersection Gj between the optical axis of the j-th image pickup device and the spherical surface S are calculated. The calculated coordinates of the intersection point Gj are storage areas d2 of the Voronoi diagram data of the second storage device 6 as mother points when constructing the three-dimensional Voronoi diagram.
Is accumulated in

Here, FIG. 6 is a diagram schematically showing the processing of step SB3. In FIG. 6, reference numeral 21 is one of a plurality of image pickup apparatuses, and 22 is an image pickup apparatus 21.
Is the optical axis of the optical axis, and 23 is the intersection of the optical axis 22 and the spherical surface 24.

At step SB4, the counter j is incremented. In step SB5, it is determined whether the magnitude relationship between the value of the counter j and N is j> N or j ≦ N. If it is determined that j> N, it is determined that the mother point calculation processing has been completed for all the imaging devices, and the process proceeds to step SB6. On the other hand, if it is determined that j ≦ N, it is determined that there is an image pickup device for which the mother point calculation process is not performed, and the process returns to step SB3.

At step SB6, a three-dimensional Voronoi diagram is constructed with the points G1 and G2 as generating points. Step SB6
The data of the direction and the position of the Voronoi side belonging to each Voronoi region obtained in step 3 are stored in the Voronoi diagram data storage region d2 of the second storage device 6. In step SB7, a counter k for designating a specific Voronoi region is initialized to a value of 1.

In step SB8, the coordinates of the intersection of the Voronoi side belonging to the k-th Voronoi region and the spherical surface S are calculated and used as the vertices of the polygon patch. In step SB9, a set of vertices connected by the sides of the polygon patch is calculated. Specifically, by determining that the vertices existing on the same Voronoi surface are connected by the sides of the polygon patch, two end points of the sides of the polygon patch are searched. At Step SB10, Step SB8
The vertex data and connection information of the polygon patch calculated in step SB9 are accumulated in the polygon patch data storage area d3 of the second storage device 6.

At step SB11, the counter k is incremented. In step SB12, it is determined whether the magnitude relation between the value of the counter k and N is k> N or k ≦ N. When it is determined that k> N, it is determined that the vertex coordinate calculation process has been completed for all Voronoi regions, and the polygon patch creation process is terminated. On the other hand, k ≦
If it is determined to be N, it is determined that there is a Voronoi region in which the calculation process of the vertex coordinates of the polygon is not performed, and the process returns to step SB8.

FIG. 7 shows an example of generating a polygon patch model that represents the spherical surface obtained by the above-mentioned processing.

Next, the texture image generation process (step SA4 in FIG. 4) will be described with reference to FIG.

First, in step SC1, a region R on the image surface corresponding to the designated polygon patch is extracted.
Specifically, focusing on the m-th Voronoi region for the m-th polygon patch, the coordinates of the intersection of each Voronoi side belonging to the m-th Voronoi region and the image plane of the image Im (image In the two-dimensional coordinate system). By this processing, a set of points on the image plane corresponding to the vertices of the polygon patch can be obtained.

In step SC2, the image Im is deformed so that the shape of the region R and the shape of the polygon patch match. The image obtained as a result of the deformation is accumulated in the storage area d4 of the texture image data of the second storage device 6 as a texture image to be attached to the polygon patch.

Next, with reference to FIG. 9 as an example, the processing for obtaining a polygon patch and a corresponding area R on the image plane for a certain Voronoi area will be described again. The shaded portion 32 in the figure is the Voronoi region, and the surface that becomes the boundary of the Voronoi region is the Voronoi surface. Further, in the example of FIG. 9, four Voronoi sides (34, 35, 36, 37) belong to the Voronoi region.

In step SB8 of FIG. 5, the vertex coordinates of the polygon patch are obtained. In the example of FIG. 9, the Voronoi side 3
By finding the intersection of 4 and the spherical surface 31, the coordinates of the vertex P1 of the polygon patch can be found. Similarly,
The vertices P2, P3, P4 of the polygon patch are obtained as the intersections of the Voronoi sides 35, 36, 37 and the spherical surface 31, respectively.

Further, a set of vertices of the polygon patch (P1,
P2), (P2, P3), (P3, P4) and (P4, P1)
Are present on the same Voronoi surface, it is possible to obtain the information that the set of vertices are connected by the sides of the polygon patch by performing the processing of step SB9 in FIG. 5 described above.

Further, by performing the processing of step SC1 in FIG. 8, the Voronoi sides 34, 35, 36 and 37 are obtained.
The coordinates of the intersections Q1, Q2, Q3, and Q4 of the image plane 38 are calculated, and it is found that the area on the image plane corresponding to the polygon patch P1P2P3P4 is a quadrangle Q1Q2Q3Q4 (39).

By using the data created by the above-mentioned processing, it is possible to create an omnidirectional landscape image according to the direction of the line of sight of the observer by the texture mapping method of computer graphics.

As described above, according to the first embodiment, a set of images covering the entire circumference of the observation position in the three-dimensional space is photographed, and the shape of the spherical surface centered on the observation position is approximated. 3D Voronoi diagram is used to create a polygonal patch model that is expressed dynamically, and a texture image to be attached to each polygon patch of the created polygon patch model is generated based on the captured image group using the 3D Voronoi diagram. It is possible to divide the dimensional space into non-overlapping regions, thus
It is possible to easily create data for displaying a landscape in all directions around the observation position in the three-dimensional space without performing image distortion correction. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

(2) Second embodiment.

In the first embodiment, the above method is used to obtain a still image in all directions around the observation point where the observer is located. On the other hand, in the second embodiment, for example, a plurality of CCD (charge coupled device) cameras are synchronized to capture a moving image around an observation point, and a texture image generation process is performed for each frame. As a result, data for displaying moving images in all directions is created.

According to the second embodiment, a plurality of C
In order to create omnidirectional video image display data based on the video images around the observation point, which were taken by synchronizing the CD cameras,
As in the case of the first embodiment, it is possible to easily create data for displaying a landscape in all directions around an observation position in a three-dimensional space without performing image distortion correction. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

(3) Third embodiment.

In the first embodiment, a plurality of image pickup devices (cameras) are used to photograph a group of images covering the observation point. On the other hand, in the third embodiment, a single camera equipped with an observation mechanism in the optical axis direction is used to capture a plurality of images while changing the optical axis direction, and thus the surroundings of the observation point are measured. The image group covering the is photographed.

According to the third embodiment, since a single camera equipped with an optical axis observation mechanism is used to take an image group covering the periphery of the observation point while changing the optical axis direction,
As in the case of the first embodiment, it is possible to easily create data for displaying a landscape in all directions around an observation position in a three-dimensional space without performing image distortion correction. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

[0052]

As described above, according to the first aspect of the invention, the omnidirectional image display data generating method captures a set of images covering the entire circumference of the observation position in the three-dimensional space. Each polygon of the polygonal plane model created in the image capturing step, the polygonal plane creation step that creates a polygonal plane model that approximately expresses the shape of the spherical surface around the observation position, and the polygonal plane model created in the polygon plane creation step A texture image generation process for generating a texture image to be pasted on a plane based on an image group photographed in the image photographing process is performed, so that data for displaying a landscape in all directions around an observation position in a three-dimensional space is imaged. It is possible to easily create the image without correcting the distortion. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

According to the second aspect of the present invention, in the omnidirectional image display data generating method according to the first aspect, in the polygonal plane creating step, the intersection point between the optical axis and the spherical surface of each image taking step in the image taking step is defined. Since the polygonal plane model is created using the three-dimensional Voronoi diagram configured as the generating points, the three-dimensional space can be divided into non-overlapping regions. Therefore, like the invention of claim 1, the three-dimensional space can be divided. It is possible to easily create data for displaying a landscape in all directions around the observation position inside without correcting the image distortion.
As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

According to the invention of claim 3, in the method for generating omnidirectional image display data according to claim 1 or 2,
In the texture image generation step, since the texture image is generated using the three-dimensional Voronoi diagram configured with the intersection of the optical axis of each photographing in the image photographing step and the spherical surface as the generating point, 3
The three-dimensional space can be divided into non-overlapping regions, and therefore, like the invention of claim 1, the data for displaying the landscape in all directions around the observation position in the three-dimensional space is subjected to image distortion correction. It is possible to easily create it without performing. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

According to the fourth aspect of the present invention, the omnidirectional image display data generating apparatus sets the image taking means for taking a set of images covering the entire circumference of the observing position in the three-dimensional space, and the observing position. Image the polygonal plane creating means for creating a polygonal plane model that approximately represents the shape of the centered sphere, and the texture image to be attached to each polygonal plane of the polygonal plane model created by the polygon plane creating means. The image distortion correction is performed for the data for displaying the landscape in all directions around the observation position in the three-dimensional space because the image data is generated based on the image group photographed by the photographing unit. It is possible to easily create it without As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

According to the fifth aspect of the present invention, in the omnidirectional image display data generating apparatus according to the fourth aspect, the polygonal plane creating means defines the intersection between the optical axis of each image taking in the image taking means and the spherical surface. Since the polygonal plane model is created using the three-dimensional Voronoi diagram configured as the generating points, the three-dimensional space can be divided into non-overlapping regions.
Similarly to the invention described above, it becomes possible to easily create data for displaying a landscape in all directions around an observation position in a three-dimensional space without performing image distortion correction. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

According to the invention of claim 6, in the omnidirectional image display data generating device according to claim 4 or 5,
Since the texture image generation means generates a texture image using a three-dimensional Voronoi diagram configured with the intersection of the optical axis of each photographing in the image photographing means and the spherical surface as the mother point, the three-dimensional space is divided into non-overlapping regions. Therefore, like the invention of claim 4, it is possible to simply create data for displaying a landscape in all directions around an observation position in a three-dimensional space without performing image distortion correction. Is possible. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

According to a seventh aspect of the invention, in the omnidirectional image display data generating apparatus according to the fourth, fifth or sixth aspect, the image photographing means is arranged along the circumferential direction of the casing such as a sphere. Since it is configured to include a plurality of imaging units, 3
An image covering the entire circumference of the observation position in the dimensional space can be accurately captured, and therefore, as in the invention of claim 4, 3
It is possible to easily create the data for displaying the landscape in all directions around the observation position in the dimensional space without correcting the image distortion. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

According to the eighth aspect of the present invention, in the omnidirectional image display data generating apparatus according to the fourth, fifth or sixth aspect, the image capturing means comprises a plurality of CCD cameras. By capturing a moving image around the observation point by synchronizing a plurality of CCD cameras and performing a texture image generation process for each frame, it is possible to create data for displaying the moving image in all directions. Claim 4
Similarly to the invention described above, it becomes possible to easily create data for displaying a landscape in all directions around an observation position in a three-dimensional space without performing image distortion correction. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

According to a ninth aspect of the invention, in the omnidirectional image display data generating apparatus according to the fourth, fifth or sixth aspect, the image photographing means is a single camera capable of changing the optical axis direction. Since it is configured to be provided, by capturing a plurality of images while changing the optical axis direction of the camera, it is possible to capture an image group covering the periphery of the observation point. Therefore, the same as in the invention of claim 4. In addition, it is possible to easily create data for displaying a landscape in all directions around the observation position in the three-dimensional space without performing image distortion correction. As a result, it is possible to eliminate the complexity of having to perform image distortion correction when capturing a landscape image around an observation position in a three-dimensional space as in the conventional art.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a basic configuration of an omnidirectional image display data generation device according to a first embodiment of the present invention.

FIG. 2 is a cross-sectional view showing an arrangement state of image pickup devices in the omnidirectional photographing device according to the first embodiment.

FIG. 3 is an explanatory diagram showing a data structure of a polygon patch data file stored in a second storage device according to the first embodiment.

FIG. 4 is a flowchart showing a procedure for generating omnidirectional image display data based on a program stored in the first storage device according to the first embodiment.

FIG. 5 is a flowchart showing a polygon patch creation process according to the first embodiment.

FIG. 6 is an explanatory diagram showing a concept of generating points of a three-dimensional Voronoi diagram according to the first embodiment.

FIG. 7 is an explanatory diagram showing a generation example of a polygon patch according to the first embodiment.

FIG. 8 is a flowchart showing texture image generation processing according to the first embodiment.

FIG. 9 is an explanatory diagram schematically showing the positional relationship between the Voronoi region, the polygon patch, and the image plane according to the first embodiment.

[Explanation of symbols]

1 omnidirectional photographing device (image photographing means) 3 CPU (polygonal plane generating means, texture image generating means) 8 imaging device (imaging unit)

Claims (9)

[Claims] 1. A method for generating omnidirectional image display data for generating data for displaying a captured image around an observation position according to an observer's line-of-sight direction. An image capturing step of capturing a set of images to cover, a polygonal plane creating step of creating a polygonal plane model that approximately expresses the shape of a spherical surface centered on the observation position, and a polygonal plane creating step. Generating omnidirectional image display data, comprising: a texture image generating step of generating a texture image to be attached to each polygonal plane of the created polygonal plane model based on the image group photographed in the image photographing step. Method. 2. The method for generating omnidirectional image display data according to claim 1, wherein in the polygonal plane creating step, an intersection of an optical axis of each shooting in the image shooting step and a spherical surface is used as a mother point. A method for generating omnidirectional image display data, characterized in that the polygonal plane model is created using the three-dimensional Voronoi diagram. 3. The method for generating omnidirectional image display data according to claim 1 or 2, wherein in the texture image generating step, an intersection between an optical axis of each photographing in the image photographing step and a spherical surface is a mother point. A method of generating omnidirectional image display data, characterized in that the texture image is generated using the constructed three-dimensional Voronoi diagram. 4. An omnidirectional image display data generation device for generating data for displaying a captured image around an observation position according to the direction of the observer's line of sight. Image capturing means for capturing a set of images to cover, polygonal plane creating means for creating a polygonal plane model that approximately expresses the shape of a spherical surface centered on the observation position, and the polygonal plane creating means. Omnidirectional image display data, comprising: a texture image generation means for generating a texture image to be attached to each polygonal plane of the created polygonal plane model based on an image group photographed by the image photographing means. Generator. 5. The omnidirectional image display data generating device according to claim 4, wherein the polygonal plane creating means includes:
An omnidirectional image display data generation device, wherein the polygonal plane model is created using a three-dimensional Voronoi diagram configured with intersections between the optical axis of each shooting and the spherical surface in the image shooting means as generating points. . 6. The omnidirectional image display data generating apparatus according to claim 4 or 5, wherein the texture image generating means uses an intersection of an optical axis of each photographing in the image photographing means and a spherical surface as a mother point. An omnidirectional image display data generating device, wherein the texture image is generated using the constructed three-dimensional Voronoi diagram. 7. The omnidirectional image display data generating apparatus according to claim 4, 5 or 6, wherein the image capturing means includes a plurality of image capturing units arranged along a circumferential direction of a housing such as a sphere. An omnidirectional image display data generation device characterized in that it is provided with. 8. The omnidirectional image display data generating apparatus according to claim 4, 5 or 6, wherein the image capturing means is provided with a plurality of CCD cameras. Image display data generation device. 9. The omnidirectional image display data generating apparatus according to claim 4, 5 or 6, wherein said image capturing means comprises a single camera capable of changing the optical axis direction. An apparatus for generating data for omnidirectional image display, characterized in that