JP2005275482A - Image preparation method and image preparation program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a new image preparation technology to realize an image to be viewed from an arbitrary point of view between two images without preparing a three-dimensional model. <P>SOLUTION: At first, DP matching is operated between the image columns arranged in a certain processing direction of two images to be processed, so that costs between the two image columns arranged in the processing direction can be calculated. Then, the calculated costs are assigned to a matrix position pointed by the processing directional position being the origin of calculation, so that a DP cost lattice space can be generated. Then, a DP path in the generated DP cost lattice space is calculated, so that a corresponding relation between the image columns arranged in the processing direction of the two images can be decided. Finally, an image viewed from the designated point of view is prepared based on the decided corresponding relation between the image columns and the corresponding relation between the image column elements calculated by the DP matching performed at the time of calculating the costs of the image columns. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image creation method for creating an image viewed from an arbitrary viewpoint between two images, and an image creation program used for realizing the image creation method.

  Processing of displaying an image of an object viewed from an arbitrary viewpoint direction is performed by a computer.

In order to perform such processing, the prior art constructs a three-dimensional model of an object to be displayed and uses it to display an image of the object viewed from an arbitrary viewpoint direction. (For example, refer to Patent Document 1).
JP 2001-243497 A

  However, according to such a conventional technique, in order to be able to display an image of an object viewed from an arbitrary viewpoint direction, a three-dimensional model of the object must be created.

  The creation of this three-dimensional model requires a large amount of calculation. From now on, there is a problem that an image of an object viewed from an arbitrary viewpoint direction cannot be easily displayed according to the conventional technique. .

  The present invention has been made in view of such circumstances, and is a new image creation technique that realizes creation of an image viewed from an arbitrary viewpoint between two images without creating a three-dimensional model. The purpose is to provide.

  In order to achieve this object, the image creating apparatus of the present invention performs (1) a processing target in order to perform a process of creating an image viewed from an arbitrary viewpoint between the two images. By performing matching (DP matching) using dynamic programming (DP programming) between image sequences arranged in a certain processing direction of the two images, the cost between the two image sequences arranged in the processing direction can be reduced. (2) generation means for generating a DP cost lattice space by assigning the cost calculated by the calculation means to the matrix position indicated by the processing direction position that is the calculation source; Determining means for determining a DP path in the DP cost lattice space generated by the means, and determining a correspondence relationship between the image sequences arranged in the processing direction of the two images; and (4) the image sequence determined by the determining means. Creating means for creating an image viewed from a specified viewpoint based on the correspondence relationship between the image sequence elements and the correspondence relationship between the image sequence elements obtained by the DP munchig performed at the time of calculating the cost between the image sequences; And (5) input means for inputting information expressed by a ratio value indicating a ratio of two images as position information of a viewpoint to be an image creation target.

  The image creating method of the present invention realized by the operation of each of the above processing means can be realized by a computer program, and this computer program is provided by being recorded on an appropriate recording medium such as a semiconductor memory. Alternatively, the present invention is realized by being provided via a network, installed when the present invention is carried out, and operating on a control means such as a CPU.

  In the image creating apparatus of the present invention configured as described above, first, DP matching is performed between image sequences arranged in a certain processing direction of two images to be processed, so that they are arranged in the processing direction. The cost between two image sequences is calculated.

  Subsequently, a DP cost lattice space is generated by assigning the calculated cost to a matrix position indicated by the processing direction position that is the calculation source.

  Subsequently, by determining the DP path in the generated DP cost lattice space, the correspondence relationship between the image sequences arranged in the processing direction of the two images is determined.

  Finally, based on the determined correspondence between the image sequences and the correspondence between the image sequence elements obtained by the DP munchig performed when calculating the cost between the image sequences, As the position information, an image viewed from, for example, a ratio value indicating the ratio of two images is created.

  As described above, in the present invention, DP matching is used in multiple stages, a correspondence between two images is obtained in consideration of vertical and horizontal shifts, and two based on the correspondence. Since processing is performed to create an image viewed from an arbitrary viewpoint between images, an image viewed from an arbitrary viewpoint between two images can be created without creating a three-dimensional model. Become.

  Thus, according to the present invention, an image viewed from an arbitrary viewpoint between two images can be created very easily.

  Hereinafter, the present invention will be described in detail according to embodiments.

  FIG. 1 illustrates an embodiment of an apparatus configuration of an image creating apparatus 1 including the present invention.

  As shown in this figure, an image creating apparatus 1 according to the present invention includes an image memory 10 for storing two images, a first image and a second image, a gridding means 11, and a first processed image memory. 12, second processed image memory 13, column image selection unit 14, i column j column cost calculation unit 15, DP path recording unit 16, DP cost lattice space generation unit 17, DP path determination unit 18, image creation means 19, and viewpoint position information input means 20.

  The grid forming means 11 grids the first image stored in the image memory 10 to generate a first processed image, writes the first processed image in the first processed image memory 12, and stores the first processed image in the image memory 10. The second processed image is formed into a grid by writing the second processed image into the second processed image memory 13.

  In this way, the first processed image divided into (n + 1) × (m + 1) grids, for example, as shown in FIG. In the second processed image memory 13, for example, as shown in FIG. 3, the second processed image divided into (q + 1) × (p + 1) grids is stored.

  The column image selection means 14 is a column image of the i-th column (i = 0 to m) of the first processed image stored in the first processed image memory 12 (an image column image aligned in the i-th column). Is selected and read, and the j-th column image (j = 0 to p) of the second processed image stored in the second processed image memory 13 (image column image arranged in the j-th column) Select and read.

  As shown in FIG. 4, the i column j column cost calculation unit 15 includes the i th column image of the first processed image output from the column image selection unit 14 and the second column output from the column image selection unit 14. A DP path corresponding to the shortest path is obtained by performing DP matching with the j-th column image of the processed image, and a minimum cost d [i, j] corresponding to the DP path is calculated. .

  According to the DP path obtained at this time, between the image element constituting the i-th column image possessed by the first processed image and the image element constituting the j-th column image possessed by the second processed image. Correspondence is required.

  The DP path recording unit 16 records the information of the DP path obtained by the i column j column cost calculating unit 15.

  The DP cost lattice space generation means 17 assigns the minimum cost d [i, j] calculated by the i column j column cost calculation means 15 to the matrix position (i, j), thereby generating a DP cost lattice space.

  In this way, the minimum cost d [i, j] calculated by the i-column / j-column cost calculation means 15 is assigned to the matrix position (i, j) according to the processing of the DP cost lattice space generation means 17, FIG. A DP cost lattice space having a size of (m + 1) × (p + 1) as shown in FIG.

  The DP path determination means 18 performs DP matching and sets the minimum cost d [i, j] of various paths from the matrix position (0,0) to the matrix position (m, p) in the DP cost lattice space. By evaluating the sum, a DP path having the smallest sum is obtained.

  In this way, according to the processing of the DP path determination means 18, the DP path in the DP cost lattice space as shown in FIG. 6 is obtained, and this DP path is the same as the column image of the first processed image. The correspondence relationship with the column image which the 2nd processing image has is shown.

  That is, in the DP path shown in FIG. 6, the 0th to 2nd column images of the first processed image correspond to the 0th column image of the 2nd processed image, and the 1st processed image The column image of the first processed image and the column image of the second processed image are such that the column image of the third column possessed by corresponds to the column image of the first column possessed by the second processed image. It shows the correspondence.

  The image creation means 19 receives the viewpoint position information input by the viewpoint position information input means 20 and receives the correspondence between the column images defined by the DP path determined by the DP path determination means 18 and the cost between the column images. Between the first processed image and the second processed image based on the correspondence between the column image elements obtained by the DP munchig performed by the i column j column cost calculating means 15 when calculating Create an image viewed from that viewpoint.

  The viewpoint position information input unit 20 inputs position information of an arbitrary viewpoint between the first processed image and the second processed image by interacting with the user. This viewpoint position information is expressed by a ratio value indicating the ratio of two images.

  FIG. 7 shows a flowchart executed by the image creating apparatus 1 of the present invention configured as described above.

  Next, according to this flowchart, processing executed by the image creating apparatus 1 of the present invention will be described in detail.

  When there is a request for creating a viewpoint image (an image viewed from a viewpoint between two images) from the user, the image creating apparatus 1 according to the present invention, first, as shown in this flowchart, first, in step 10, 2 images (stored in the image memory 10) to be used for creation of the viewpoint image are selected in accordance with the instruction from.

  Subsequently, in step 11, viewpoint position information expressed by a ratio value (internal division ratio) indicating the ratio of two images is input. For example, viewpoint position information expressed by a ratio value of “0.5: 0.5” is input.

  Subsequently, in step 12, the two images used for creating the viewpoint image are read from the image memory 10 and gridded to generate two processed images, a first processed image and a second processed image. .

  Subsequently, in step 13, DP matching is performed on each of the i-th column (i = 0 to m) of the first processed image and the j-th column (j = 0 to p) of the second processed image. A DP path is obtained, and a minimum cost d [i, j] corresponding to the DP path is calculated.

  Subsequently, in step 14, the obtained DP path information (representing the correspondence between the image elements constituting the two row images) is recorded in the DP path recording means 16.

  Subsequently, in step 15, a DP cost lattice space as shown in FIG. 5 is generated by assigning the minimum cost d [i, j] to the matrix position (i, j).

  Subsequently, in step 16, the DP path in the DP cost lattice space is obtained to determine the correspondence between the column image possessed by the first processed image and the column image possessed by the second processed image.

  Subsequently, in step 17, the input viewpoint position information, the information on the column images in the correspondence relationship, and the information on the DP path between the column images in the correspondence relationship (recorded in the DP path recording means 16). Based on this, a viewpoint image viewed from the viewpoint specified by the input viewpoint position information is created, and the process ends.

  FIG. 8 illustrates an example of the viewpoint image creation process.

  As shown in this figure, when creating a viewpoint image, a line segment connecting columns in correspondence is divided according to the ratio value specified by the viewpoint position information, and a new image sequence is arranged in the cutting direction. As a result, a viewpoint image is generated. Regarding the arrangement width, the arrangement height, and the arrangement image value, the values of the two processed images are mixed according to the ratio value specified by the viewpoint position information. Will be calculated.

  In this way, as shown in FIG. 9, an image viewed from an arbitrary viewpoint between two images can be created without creating a three-dimensional model.

It is an example of an apparatus structure of the image creation apparatus of this invention. It is explanatory drawing of a 1st process image. It is explanatory drawing of a 2nd process image. It is explanatory drawing of the process which an i column j column cost calculation means performs. It is explanatory drawing of DP cost lattice space. It is explanatory drawing of the DP path which a DP path determination means determines. It is a flowchart which the image preparation apparatus of this invention performs. It is explanatory drawing of the creation process of a viewpoint image. It is explanatory drawing of the creation process of a viewpoint image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image creation apparatus 10 Image memory 11 Gridding means 12 1st process image memory 13 2nd process image memory 14 Column image selection means 15 i column j column cost calculation means 16 DP path recording means 17 DP cost grid space Generation means 18 DP path determination means 19 Image creation means 20 Viewpoint position information input means

Claims (3)

An image creation method for creating an image viewed from an arbitrary viewpoint between two images from two images,
A process of calculating the cost between two image sequences arranged in the processing direction by performing DP matching between the image sequences arranged in a certain processing direction of the two images to be processed;
A process of generating a DP cost lattice space by assigning the cost to a matrix position indicated by the processing direction position that is the calculation source;
Determining a correspondence relationship between image sequences arranged in the processing direction of two images by obtaining a DP path in the DP cost lattice space;
Based on the determined correspondence between the image sequences and the correspondence between the image sequence elements obtained by the DP munchig performed when calculating the cost between the image sequences, the image viewed from the designated viewpoint The process of creating
A featured image creation method. The image creation method according to claim 1,
Having a process of inputting what is represented by a ratio value indicating a ratio of two images as position information of a viewpoint to be an image creation target,
A featured image creation method.   An image creation program for causing a computer to execute processing used to realize the image creation method according to claim 1.

Images