JP2000069408A - Device for expressing space by video image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate a video image that correctly reproduces motions of objects in existence in space as a virtual video image by using video image data. SOLUTION: The device is provided with a speed adjustment device 17 that enters a moving amount of a designated visual point that is designated for a photographing path of video image data, a frame selector 18 that selects an image frame to be presented among the stored video image data, an image converter 19 that converts the selected image frame into the presentation image at the designated visual point, and an image display device 20 that displays the converted presentation image and expresses a video space representing a scene that is matched with the movement of the designated visual point.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a space representation device using video images which presents a space in which a motion is reproduced as a virtual image by using a video image of a moving space.

[0002]

2. Description of the Related Art As a conventional space expressing device, Japanese Patent Laid-Open No.
Although there are techniques disclosed in Japanese Patent Application Laid-Open No. 16772 and Japanese Patent Application Laid-Open No. 9-220308, FIG. 32 is a block diagram showing such a conventional space representation device. In FIG. 32, reference numeral 1 denotes a storage device for storing the video image data and the shooting viewpoint position and the optical axis direction of each frame of the video image data; 2, a viewpoint input device for inputting a viewpoint position to be displayed;
Is a frame selection device for selecting one image frame of video image data for a viewpoint specified by the viewpoint input device 2, and 4 is an image display device for displaying the selected image frame.

FIG. 33, FIG. 34, FIG. 35 and FIG.
FIG. 6 is an explanatory diagram showing the operation of the conventional space expression device. In the figure, 5 is a video camera, 6 is a photographing route of the video camera 5, 7 is video image data photographed by the video camera 5, 8 is a designated viewpoint position designated by the user,
Reference numeral 9 denotes an image frame photographed at the photographing viewpoint position 10 in the video image data 7, 10 denotes a photographing viewpoint position at the time of photographing each frame on the photographing path 6, 11 denotes a designated viewpoint position 8 in the photographing viewpoint position 10. , 12 is an image frame taken at the close-up viewpoint 11 in the video image data 7, 13 is a presentation image, 14 is to update the presentation image 13 at any time according to a change in the designated viewpoint position 8. The generated image 15 represented by is a tree which is an example of a moving object existing in the space.

Next, the operation will be described. This conventional space representation device generates a scene image at a specified viewpoint position 8 designated by a user from video video data 7 captured on a capturing path 6 in a target space by a video camera 5 as needed. , Using the video image data 7 to represent the target space.

[0005] Further, in this space representation device, as shown in FIG.
It is stored in. As shown in FIG. 34, when the designated viewpoint position 8 is designated by the viewpoint input device 2, the photographing viewpoint position 1 stored in the storage device 1 is designated by the frame selecting device 3.
With reference to the position information of 0, if there is a photographing viewpoint position that matches the designated viewpoint position 8 from the photographing viewpoint positions 10, it is determined. If there is no matching photographing viewpoint position, the closest photographing viewpoint closest to the designated viewpoint position 8 is determined. 11 is detected. Then, for example, video image data 7 captured at the close-up viewpoint 11
The image frame 12 as one of the frames is read from the storage device 1. The read image frame 12 is presented to the user as the presentation image 13 by the image display device 4.

[0006]

The conventional video image space rendering apparatus is constructed as described above, so that the image frame 12 is formed only by the positional relationship between the designated viewpoint position 8 and the photographing viewpoint position 10 designated by the user. Since the selected and selected image frame is used as the presentation image 13, the frame order of the video image data 7, that is, the shooting time is not considered, and the image frame 12 is selected regardless of the shooting time and presented as the presentation image 13. Will be. On the other hand, when the photographed target space is a real environment such as a cityscape or a natural scenery, there is a moving object in the real environment. However, there is a problem that the movement cannot be faithfully reproduced, and the space represented by the generated image 14 does not have a sense of reality.

More specifically, as shown in FIG. 35, when the designated viewpoint position 8 moves to 8a, 8b, 8c in the figure, the close-up photographing viewpoints 11a, 11b, 11c are sequentially selected, and the image frames 12a, 12b and 12c constitute the generated video 14 as the presentation images 13a, 13b and 13c. For this reason, when the designated viewpoint position 8 is moved on the photographing path 6 faster than at the time of photographing, the video image data 7 is moved.
Frames are decimated in the inside to generate a generated image 14, and an object in the space, for example, trees 15 swaying in the wind
Movement is faster than the actual movement.

Conversely, as shown in FIG. 36, the designated viewpoint position 8 on the photographing path 6 is lower at a lower speed than at the time of photographing.
8b and 8c, the same close-up viewpoint 11 is selected, and the image frames 12 are successively presented images 13a, 13b and 13c.
In 4, the trees 15 come to a standstill. Thus, there has been a problem that a real environment cannot be faithfully reproduced.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problem, and uses video image data obtained by shooting a target space and considers the shooting order of each image frame of a video, thereby obtaining a space. It is an object of the present invention to obtain a video image space expression device capable of generating a video image in which a motion of an object present therein is correctly reproduced as a virtual video image.

[0010]

According to the present invention, there is provided an apparatus for expressing a space by a video image, comprising: a storage means for storing video image data and a photographing viewpoint position, an optical axis direction, and an angle of view of each image frame of the video image data; Speed adjusting means for inputting a movement amount of a designated viewpoint designated with respect to a shooting path of video image data; frame selecting means for selecting an image frame to be presented from the video image data stored in the storage means; Image conversion means for converting the image frame selected by the means into a presentation image at the designated viewpoint, and displaying the presentation image image-converted by the image conversion means to show a scene matching the movement of the designated viewpoint Image display means for expressing a video space by a presentation image.

The video image spatial expression apparatus according to the present invention is provided with a frame selecting means for sequentially selecting successive image frames from the video image data one by one.

[0012] In the apparatus for expressing a space based on a video image according to the present invention, a distance between a designated viewpoint position updated by an amount of movement of a designated viewpoint given by a speed adjusting means and a photographing viewpoint position of a selected image frame. Is further provided with a frame selecting means for reselecting an image frame at a photographing viewpoint position close to the designated viewpoint position when the images are separated by a predetermined distance or more.

[0013] According to the present invention, there is provided an apparatus for expressing a space by a video image, comprising: a transition point setting means for presetting a transition point corresponding to an image frame selected by a frame selection means;
The image processing apparatus further includes a frame selection unit that reselects an image frame at a shooting viewpoint position close to the designated viewpoint position among image frames at a transition point set in advance by the transition point setting unit.

According to the present invention, there is provided an apparatus for expressing a space based on a video image, comprising: an image converting means for converting an image frame already selected by the frame selecting means and an image frame reselected, and a converted image converted by the image converting means. And an image synthesizing means for interpolating the presented image and gradually increasing the ratio in the interpolation with respect to the reselected image frame.

According to the present invention, there is provided an apparatus for expressing a space based on a video image, comprising: a viewpoint position setting means for initially setting a start viewpoint, an optical axis direction, and an angle of view in a space where the video image data is photographed. The frame selection means selects an image frame that is optimal for the start viewpoint set by the above-described method, and selects the image frame selected by the frame selection means with the start viewpoint, the optical axis direction, and the angle of view set by the viewpoint position setting means. The image conversion means converts the image to the presentation image based on the above.

In the video image space expression apparatus according to the present invention, the image conversion means converts the selected image frame so that a subject located at a fixed distance on the optical axis of the presentation image is correctly drawn on the presentation image. It is like that.

In the video image space expression apparatus according to the present invention, the image conversion means performs image conversion by parallel movement and enlargement or reduction of the selected image frame.

In the apparatus for expressing a space by video image according to the present invention, the shooting viewpoint positions of the video image data are arranged on a straight line, and the optical axis is directed along the straight line in the traveling direction of the shooting viewpoint position. The image conversion means performs image conversion by enlarging or reducing the image frame, which is determined by the distance between the selected image frame and the shooting viewpoint position.

In the apparatus for expressing a space by a video image according to the present invention, the shooting viewpoint positions of the video image data are aligned on a straight line, the optical axis is orthogonal to the straight line, and the designated viewpoint position and the selected image frame. The image conversion means performs the image conversion by the parallel movement of the image frame determined by the distance from the photographing viewpoint position.

In the video image space expression apparatus according to the present invention, the size of a presentation image is made smaller than the size of an image frame.

[0021]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below. Embodiment 1 FIG. FIG. 1 is a block diagram showing the configuration of a video image spatial expression apparatus according to Embodiment 1 of the present invention. In FIG. 1, reference numeral 16 denotes video image data, a frame number of each frame of the video image data, and a photographing viewpoint position. Storage device (storage means) for storing the optical axis direction and the angle of view,
17 is a speed adjusting device (speed adjusting means) for inputting the moving speed of the viewpoint, 18 is a frame selecting device (frame selecting means) for sequentially selecting a frame to be presented next to the video image data, and 19 is a selected image frame. An image conversion device (image conversion means) 20 for performing the conversion is an image display device (image display means) for displaying the converted image frame as a presentation image.

FIGS. 2 to 14 are explanatory diagrams showing the operation of the space representation apparatus using video images according to the first embodiment of the present invention. In the figure, 5 is a video camera, 6 is a shooting path of the video camera 5, 7 is video image data shot by the video camera 5, 8 is a designated viewpoint position specified by the user, and 9 is, for example, one of the video image data 7. An image frame shot at the shooting viewpoint position 10 has a shooting path 6
The photographing viewpoint position at the time of each frame photographing above, 11 is a close-up photographing viewpoint closest to the designated viewpoint position 8 in the photographing viewpoint position 10, and 12 is an image frame photographed at the close-up photographing viewpoint 11 in the video image data 7. , 13 are presentation images, and 15 is trees that are examples of moving objects existing in the space.

Reference numeral 21 denotes a start point of the photographing path 6, 22 denotes a previous position of the designated viewpoint position 8, 23 denotes an image frame used for the previous presentation, 24 denotes an image frame selected by the frame selection device 18, and 25 denotes an image frame. 24 is the converted image, 26 is the gazing point in the presentation image 13, 27 is the optical axis, 28 is the viewpoint position of the selected image frame 24, 2
9 is an image plane.

In the video image space rendering apparatus thus constructed, in order to faithfully reproduce the movement of the object, the image frames 9 of the video image data 7 are converted into presentation images 13 in accordance with the photographing order, thereby converting the image. Generate.
For this reason, the motion of the object is reproduced at the same speed as that stored in the video image data 7, so that the sense of space in the generated image is not reduced.

Next, the operation will be described. As shown in FIG. 2, video image data 7 composed of N image frames 9 is represented by I _n (n = 0, 1, 2,... N) and I _i
Represents the i-th image frame. The video image data 7 is data obtained by moving the video camera 5 on the shooting path 6. Here, a distance measured along the photographing path 6 from the start point 21 of the photographing path 6 is represented by t, and a point that is a distance t from the start point 21 is C (t). Let the horizontal plane be an xy plane, and as shown in FIG.
Both the angle of view φ are defined in the xy plane. In the video image data 7, the optical axis is parallel to the xy plane, and the horizontal axis is x.
Consider that the image is taken parallel to the y-plane. The presentation image 13 is set to J.

Further, as shown in FIG.
The generated video 14 composed of 3 generates the same video speed as the video video data 7 at the same frame speed (the number of image frames shot or presented per unit time). Then, the designated viewpoint position 8 is moved on the photographing route 6 at a speed different from that at the time of photographing, and the image at that time is converted into video image data 7.
Generate from The designated viewpoint position 8 is represented by q, and the photographing viewpoint position 10 of the image frame is represented by p _i .

After the above definition, first, the designated viewpoint position 8 indicated by q is moved from the photographing viewpoint p _i of the image frame on the photographing path 6. In this case, the image frame I _i to shooting viewpoint of p _i is selected as the presentation image J,
That becomes the presentation image 13. Hereafter, the image frame I
_The image frame following _i is sequentially selected and presented as the next presentation image J.

[0028] However, since the moving speed of the viewpoint is variable, designated viewpoint position 8 at the time of presenting the presentation image J does not coincide necessarily with the shooting viewpoint p _i of the image frame I _i selected at that time. These were corrected, the image frame I _i is subjected to conversion to the image frame I _i as much as possible matches the scene at the specified viewpoint position 8, which presents images J
And As a result, the generated image 14 having the moving speed of the target object and variable moving speed is synthesized.

FIG. 15 is a flowchart showing the procedure of the video generation described above, and the description will be made with reference to this flowchart. First, as an initial state, the position of the shooting viewpoint of each image frame at the time of shooting and the number of frames N shown in the video image data 7 and 5 p _i to the photographing optical axis direction theta, the data of the shooting angle φ is the storage device 16 It is remembered. The video image data 7 is captured by the video camera 5.
The photographing viewpoint position and the optical axis direction are input, for example, measured by a GPS device or a gyro sensor, or calculated from the image content of the previously input video image data 7 from the position of a known point in the image. Is also good. In addition, when it can be considered that the user has moved on a predetermined route at a constant speed, the route may be equally divided by the number of image frames in which the route has been shot and set as the shooting viewpoint position. The angle of view is also obtained in advance by copying an existing pattern. If the angle of view is kept constant, the subsequent processing is facilitated.

First, in step ST1, a variable i indicating the number of an image frame used for presentation is initialized. This is to indicate the presentation video and viewpoint position at the start of processing,
For example, the first frame is set. At the same time, the designated viewpoint position q on the photographing route 6 is initialized to p _i , and a variable t indicating the distance from the starting point 21 of the photographing route is set to C (t) = q.
The initial value is t, that is, the distance on the imaging route 6 from the start point 21 to the designated viewpoint position q.

In step ST2, the frame selection device 1
8, the video image data 7 stored in the storage device 16
Read the i-th image frame I _i from. Further, the viewpoint position p _i , the optical axis direction θ _i , and the angle of view φ _i are read.

[0032] At step ST3, the performs image conversion on the image frame I _i by the image converter 19, generates a converted image K that matches the scene from the designated viewpoint position q. The details will be described later.

In step ST4, the converted image K is displayed as the presentation image J by the image display device 20. However,
Here, in order to make the frame drawing speed of the video the same, the drawing is switched from the image at the previous drawing to the current image at a predetermined timing. That is, when video image data having a frame drawing speed of 30 frames per second is used, a new image is drawn every 1/30 second. Here, it is assumed that the processing cycle from step ST2 to step ST7 can be sufficiently executed within 1/30 second.

In step ST5, the moving distance d of the designated viewpoint position 8 on the photographing path 6 is input by the speed adjusting device 17 to set a new designated viewpoint. This is performed by, for example, an input device such as a mouse or a keyboard. When the process reaches step ST5, for example, a default value of d is determined, and if there is a specific key input, d is changed to be larger or smaller, so that there is no waiting for input of d.

In step ST6, "1" is added to i. That is, an image frame that is continuous with the used image frame is used to generate the next presentation image.

In step ST7, it is determined whether or not to continue the processing. For this, it is checked whether or not a keyboard input or the like indicating the end specified in advance has been made, and if it has been made, the process ends.
It is configured to return to T2. The processing is also terminated when i becomes larger than N.

In order to perform the above processing, as shown in FIG. 4, when the image frame 23 photographed at the viewpoint position 22 is used first, the "1" addition processing of i in step ST6 causes the following processing. In step ST2, an image frame 24 photographed continuously from the image frame 23 is read.
This is different from the image frame 12 used in the conventional spatial expression device when the arrangement of the designated viewpoint positions 8 is as shown in FIG. By presenting the image frame 24 following the image frame 23, it is possible to express the correct movement of the object such as the trees 15.

Here, the image conversion in step ST3 will be described. The read image frame I _i represents a scene at the viewpoint position p _i at the optical axis direction θ _i and the angle of view φ _i . On the other hand, what is desired to be generated is a scene at the specified viewpoint position q at the same time in the same space. Here, the optical axis and the angle of view are the same as θ _i and φ _i , respectively. Various methods can be considered for generating the scene. Here, for simplicity, the position of the subject at a predetermined distance D on the optical axis 27 is appropriate at the center of the presentation image J as shown in FIG. Convert to be drawn in size. The predetermined distance D is set to, for example, 10 meters. At this time, the gazing point 26 of the presentation image is drawn in a correct size at the center of the presentation image. Here, p _i (p _ix , p _iy ,
p _iz ), q (q _x , q _y , q _z ), a = D (cos
_{θ i, sinθ i, 0)} + q = (a x, a y, and a _z). In order to draw the fixation point 26 correctly, the following horizontal movement r with respect to the image frame 24 is performed.
_h (movement to the right of the image is positive), vertical movement r _v
(The upward movement of the image is positive) and the magnification r _z is scaled. As shown in FIG. 7, in the xy plane, r _h and f
Is the optical axis 27a of the image frame 24 at the gazing point 26.
Is equal to the ratio of the distance from the viewpoint position 28 of the foot perpendicular to the optical axis 27a of the gazing point 26,

[0039]

(Equation 1)

## EQU4 ## × indicates the outer product of the vectors, • indicates the inner product of the vectors. Note that _Mx is the number of pixels of the image frame 24 in the horizontal direction. f is the focal length and f = M _x /
{2 tan (φ _i / 2)}. Than this,

[0041]

(Equation 2)

Is obtained. Further, in the z direction, at a point where the line of sight from the viewpoint position 28 to the gazing point 26 intersects the image plane 29, the distance from the viewpoint position 28 on the xy plane is different from the focal length f. When put this and f _v,

[0043]

(Equation 3)

Is as follows. Than this,

[0045]

(Equation 4)

Therefore,

[0047]

(Equation 5)

Is obtained. Here, M _y image frame 24
Is the number of pixels in the horizontal direction. Next, r _z is given by the ratio of the distance from the viewpoint position to the gazing point 26.

[0049]

(Equation 6)

Assume that Thus, as shown in FIG. 8, performs a translation of r _h and r _v in the image frame 24, the magnification r
By subjecting the center 26b to the center of the image by expanding or reducing _z , a converted image 25 in which the size of the target subject at the gazing point 26 is correctly drawn is generated.

In particular, as shown in FIG. 9, when the photographing path is a straight line and the optical axis is directed straight ahead, if the x-axis is taken in the traveling direction on the linear path, a _x = q _x + D, a _y = P _iy = 0
Therefore, the magnification r _z is

[0052]

(Equation 7)

As shown in FIG. 10, it can be handled only by enlargement or reduction.

Further, when the photographing path 6 is a straight line and the optical axis 27 is perpendicular to the straight line as shown in FIG. 11, if the x-axis is taken along the straight line in the traveling direction, a _x = q _x , q _y =
Since p _iy = 0, the image conversion is performed as shown in FIG.

[0055]

(Equation 8)

The horizontal translation is as follows. In such a case,
It is necessary to determine in advance how much magnification or the amount of parallel movement is appropriate according to the difference in distance between the viewpoint positions.
, It is possible to obtain a higher quality image. Of course, if the detailed shape and position of the subject are known, the conversion can be performed so as to more precisely match the subject.

When the image frame 24 is moved in parallel or reduced, an uncorrelated area is generated around the converted image 25. To deal with this, FIG.
As shown in (2), only the center portion of the presentation image 13 is displayed. The appropriate size varies depending on the video image data 7, but for example, 90% of the whole is displayed.

As described above, the first embodiment
According to the method, even when the moving speed of the viewpoint position is changed, the generated video is synthesized without changing the order and the frame speed of the image frames to be used, so that the subtle movement of the object shown in the video video data 7, for example, There is an effect that a space representation device using a video image can be obtained which can be reproduced in a generated image in a state where the degree of swaying of the leaves is not unnatural.

FIG. 14 shows an example of the generated image 14, which corresponds to the example shown in FIG. The generated image 1 shown in FIG. 14 is compared with the generated image 14 shown in FIG.
4 shows that the subtle movement of the object, for example, the degree of swaying of the leaves, is reproduced in an unnatural state. As a result, for example, there is an effect that a space representation device using a video image can be obtained, which can give a feeling of, for example, strolling in an environment surrounded by trees while changing the pace without unnaturalness.

Embodiment 2 FIG. 16 is a block diagram showing a configuration of a video image spatial expression device according to Embodiment 2 of the present invention. 16, the same or corresponding parts as those in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted.
In FIG. 16, reference numeral 30 denotes a frame selection device (frame selection means) for selecting one frame to be presented next to the video image data, and when the difference in the distance between the viewpoint positions exceeds a predetermined value, the designated point position is designated. The image frame having the viewpoint position closest to is selected.

FIG. 17 is an explanatory diagram showing the operation of the space representation device using video images according to the second embodiment of the present invention.
The same or corresponding parts as those in FIG. 4 are denoted by the same reference numerals and description thereof is omitted. In the figure, 31 is a newly selected viewpoint position, and 32 is an image frame photographed at the viewpoint position 31.

In the second embodiment, the first embodiment is used.
I _{n (n} = 0,1,2 video image data 7 as well as,
.. N), and the presentation image 13 is J. In addition, it is assumed that the designated viewpoint position 8 is on the photographing route 6 and moves on the photographing route. At this time, if the designated viewpoint position q is greatly separated from the shooting viewpoint position p _{i of the} currently selected image frame in the process of video generation, distortion may increase even after conversion, and the scene may not be correctly represented. Comes out. Therefore, a mechanism for reselecting an appropriate image frame so as to cope with the case where the designated viewpoint is moved at a speed greatly different from the viewpoint moving speed at the time of capturing the video image data is added.

As a result, when the difference between the designated viewpoint position and the photographing viewpoint position of the selected image frame of the video image data 7 becomes large, a new appropriate image frame is selected again, thereby improving the image quality of the generated image. Can be maintained.

Next, the operation will be described. FIG. 18 is a flowchart showing an image generation operation of the video image spatial expression device according to the second embodiment of the present invention. In this flowchart, steps ST201 and ST202 are added to the flowchart shown in FIG. 15 described in the first embodiment, and the same or corresponding steps as those in FIG. 15 are denoted by the same reference numerals and description thereof is omitted. .

In step ST201, it is determined whether or not the difference | q-p _i | between the viewpoint positions is equal to or smaller than a predetermined threshold L. The threshold value L may be set as appropriate, but is set as, for example, an average value of a moving distance for one second on a shooting path when shooting video image data. If L or less, the process returns to step ST2, and if not, the process proceeds to step ST202.

In step ST202, a new image frame is set in the frame selection device 30. This is an image frame that minimizes the distance | q−p _i | between p _i and q. The variable i is replaced with the new image frame number, and the process proceeds to step ST2.

That is, the image frame 23 shown in FIG.
Is used for display, and then "NO" in step ST201.
When the process proceeds to step ST202, the frame selection device 30 selects the image frame 32 having the viewpoint position 31 closest to the designated viewpoint position 8. Therefore, in the next step ST2, the image frame 32 is read instead of the image frame 24 that is continuous with the image frame 23.
Image frames are successively selected starting from the image frame 32.

As described above, the second embodiment
In the case, when the distance between the designated viewpoint position and the shooting viewpoint position of the image frame is significantly large, an appropriate image frame is selected again and the image is shifted to the image from the image frame. However, there is an effect that a spatial expression device can be obtained in which the distortion of the scene is not increased and the scene is not correctly represented.

Embodiment 3 FIG. 19 is a block diagram showing a configuration of a video image spatial expression device according to Embodiment 3 of the present invention. In FIG. 19, the same or corresponding parts as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.
In FIG. 19, reference numeral 33 denotes a transition point setting device (transition point setting means) for predetermining a transition point when switching an image frame to be used for video image data, and reference numeral 34 denotes a frame to which a function for selecting an image frame to be used next time at the transition point is added. A selection device (frame selection means).

FIGS. 20, 21, and 22 are explanatory diagrams showing the operation of the space representation device using video images according to the third embodiment of the present invention, and the same or corresponding parts as in FIG. And the description is omitted. In the figure, 35 is a viewpoint position at a transition point, 36 is an image frame at the viewpoint position 35, 37 is a viewpoint position at the transition destination, 38 is an image frame at the viewpoint position 37, 39 is an image frame related to the transition point, Reference numeral 40 denotes a distance for determining the forward transition of the video image data 7, and reference numeral 41 denotes a distance for determining the backward transition of the video image data 7.

In the third embodiment, as in the first embodiment, the video image data 7 is converted to I _n (n = 0, 1, 2, 2).
.. N), and the presentation image 13 is J. Also, it is assumed that the designated viewpoint position 8 is on the photographing path 6 and moves on the photographing path 6. As described in the second embodiment, in the process of image generation, if the specified viewpoint position q leaves large as shooting viewpoint position p _i of the image frame that is currently selected, also the distortion is increased after conversion, There is a possibility that the scene will not be correctly represented. Therefore, in the third embodiment, a transition point, which is a check point, is provided so as to be able to cope with a case where the designated viewpoint is moved at a speed greatly different from the viewpoint moving speed at the time of capturing video image data. Configure to migrate.

As a result, when the difference between the designated viewpoint position and the photographing viewpoint position of the selected image frame of the video image data 7 becomes large, the image frame is re-selected between the preset image frames. Thus, it is possible to maintain the quality of the generated video.

Next, the operation will be described. First, a method of setting a transition point by the transition point setting device 33 will be described. FIG. 23 is a flowchart showing a method of setting the transition point. Besides the numerical values shown in the first embodiment in the initial state is been obtained, for each p _i, the distance from the starting point 21 on the imaging path is been determined by sequence X [i]. This example, differences in the viewpoint position of the image frame adjacent _{| p i -p (i-1} ) | can be obtained integrating to the.

In step ST301, a variable i indicating an image frame of video image data is initialized to "1".
Also, a variable h indicating a temporary transition point image frame is set to Hmi.
Initialize to n. Hmin represents the minimum frame difference between the transition points, and is set in advance, for example, to 30 frames per second. A variable H indicating the transition point frame is also initialized to Hmin. Further, a variable n indicating the number of transition points is initialized to “1” and stored as a distance from the starting point 21 on the first imaging path of the array T storing the variable n. Further, the variable E indicating the error is set to a sufficiently large value (for example, a value obtained by multiplying the square of a possible pixel value by the number of pixels).
Initialize to

In step ST302, the degree of mismatch between the i-th image frame and the h-th image frame is calculated. This converts the i-th image frame to scene from shooting viewpoint p _h, carried out by taking the sum of squares of the pixel value error between the transformed image K and I _h. This value is set to e. The conversion of the image used at this time is the conversion described in the first embodiment.

In step ST303, it is determined whether E> e. If "YES", step ST304
The process proceeds to step ST305 if “NO”.

In step ST304, the variable H indicating the transition point is updated to h, and the error E is updated to e. Step ST30
At 5, "1" is added to h.

In step ST306, it is determined whether or not h is not more than N. If "NO", step ST30 is executed.
In step 7, n is incremented by "1", the last transition point H is set to T [n], and the transition point setting process ends. As a result, n transition points are set in the video image data, and their frame numbers are stored in the array T.

In step ST308, hi is set to Hma.
It is determined whether it is less than or equal to x. Hmax represents the maximum frame difference between the transition points, and is set in advance, for example, as 5 × 30 = 150 frames per 5 seconds. If “YES” in the step ST308, the process returns to the step ST302. If “NO”, a step ST30
Go to 9.

In step ST309, the variable n indicating the number of transition points H is incremented by "1" and stored in the array T. The transition point H is an image frame in which the degree of inconsistency with the image frame at the immediately preceding transition point is the smallest in the range of the frame width Hmin to Hmax from the immediately preceding transition point.

In step ST310, the transition point H is set to a new i, a value obtained by adding Hmin to the new i is set to a new h, and reinitialization of E and H is performed.

In step ST311, h is the number of frames N
It is determined whether or not the following conditions are satisfied. If “YES”, the process returns to step ST302. If “NO”, the transition point setting process ends.

By the above processing, the minimum Hmin and the maximum H
n transition points with max intervals are set. This example is shown in FIG. On the video image data 7, viewpoint positions 21, 35b, 35c, and 35d, which are transition points, and their image frames 39a, 39b, 39c, and 39d are set.
As a result, when the image frame is switched between adjacent transition points, the generated video can be configured so that the error becomes small and no significant discontinuity occurs.

Next, the operation of generating an image according to the third embodiment will be described. FIG. 24 is a flowchart showing this video generation operation. 24, steps that are the same as or correspond to steps in FIG. 15 are given the same reference numerals, and descriptions thereof are omitted. In step ST351, m indicating the number of the transition point is set to 1, and the transition point is set to h. In step ST352, it is determined whether or not h is greater than i. If "NO", the transition point is sequentially changed in step ST353 until "YES". Step ST
At 354, it is determined whether i is the transition point h. If the result is "YES", the process proceeds to step ST355 and "N
If "O", the process returns to step ST2.

In step ST355, it is determined whether or not t−X [T [m + 1]] ≧ 0 between the viewpoint positions. As a result, if "YES", the process proceeds to step ST356.
The process proceeds to step ST357 if “NO”.
However, when m + 1 is larger than n, T [m +
1], there is no transition point, so step ST35
Proceed to 7.

In step ST356, image frame i
Is the transition point, and from the point of view of p _i , the designated viewpoint q is located further than the next transition point T [m + 1] on the photographing route. Therefore, it can be expected that generating an image using a frame at the next transition point represented by T [m + 1] will reduce distortion. Therefore, T [m + 1] is replaced with i.
Further, T [m + 2] is set to h, and m + 2 is newly set to m. However, when m + 2 is larger than n, h and m
Is not updated. This is shown in FIG. If the distance 40 used for the determination is positive or “0”, the image frame 23 used for the previous display is replaced by the image frame 3
6 (viewpoint position 35) is canceled, and an image frame 38 (viewpoint position 37) close to the specified viewpoint position 8 is used for display. Since the image frame 36 and the image frame 38 are the image frames at the transition points, smooth replacement and transition are possible.

In step ST357, it is determined whether or not X [T [m-1]]-t ≧ 0 between the viewpoint positions. As a result, if “YES”, the process proceeds to step ST35.
Proceed to 8. However, when m is “1”, T [m−1]
Does not exist, the process proceeds to step ST359 as in the case of "NO". In step ST359, the transition point is updated. However, when m + 1 is larger than n, the update is not performed.

In step ST358, the image frame i
Is the transition point, and the specified viewpoint q is located beyond the previous transition point T [m-1] on the photographing path from the viewpoint of p _i . Therefore, it can be expected that generating an image using a frame at the transition point before T [m-1] will reduce distortion. Therefore, T [m-1] is replaced with i.
This is shown in FIG. If the distance 41 used for the determination is positive or “0”, the image frame 36 (viewpoint position 35) subsequent to the image frame 23 used for the previous display is canceled and the image frame 38 ( The viewpoint position 37) is used for display. Since the image frame 36 and the image frame 38 are the image frames at the transition points, smooth replacement and transition are possible.

As described above, the third embodiment
According to, the transition point at which the video is switched is set in advance so as not to cause discontinuity in the video, and the video is switched only between the set transition points. Even if a crossing scene occurs, no transition point is set in the meantime, and the car does not suddenly appear or disappear during the transition. Therefore, there is an effect that a space expression device capable of expressing a space without temporal discontinuity can be obtained even when video image data including moving objects is used.

Embodiment 4 FIG. 25 is a block diagram showing a configuration of a video image spatial expression device according to Embodiment 4 of the present invention. In FIG. 25, the same or corresponding parts as in FIG. 16 are denoted by the same reference numerals, and description thereof is omitted. In FIG. 25, reference numeral 42 denotes a combination of a presentation image from two image frames and interpolation, and a ratio in the interpolation is set to a large value with respect to the reselected image frame, and the presentation image is gradually changed to the reselected image frame. Is an image synthesizing device (image synthesizing means) for preventing discontinuity of the image from becoming noticeable.

FIG. 26 is an explanatory diagram showing the operation of the space representation device using video images. In the figure, reference numeral 43 denotes a second converted image obtained by converting an image frame.

In this space representation device, the transition is made such that the image is gradually changed at a transition point in the generated image with a predetermined frame width. However, scenes cannot always be matched at the transition point of video image data. Therefore, in this embodiment, the video is generated by gradually changing from one video to the other video in order not to make discontinuity noticeable.

Next, the operation will be described. FIG. 27 is a flowchart showing an image generation operation by the video image spatial expression device according to the fourth embodiment of the present invention. In FIG. 27, steps that are the same as or correspond to those in FIG. 18 are denoted by the same reference numerals, and description thereof is omitted. In step ST401, a variable F indicating whether or not the area is a transition area is set to “0”.
Initialize to When the variable F is “0”, normal image generation is performed. When the variable F is positive, a presentation image is obtained by combining two image frames as a transition area.

After the processing from step ST2 to step ST7, in step ST402, it is determined whether or not the variable F is "0". If “YES”, step ST2
In step 01, it is determined whether to shift the video. If the variable F is not “0”, since the area is already the transition area, the processing of the transition area from step ST404 is performed.

If the process proceeds to step ST201 and it is determined that the image is to be transferred, that is, if “NO”, the process proceeds to step ST403. In step ST403, the image frame number i is stored in j, and the variable F is set to W. W is a positive integer, and is the number of frames of the presentation image generated by combining the two image frames, that is, the width of the transition area. This value is predetermined, for example, 15 seconds for 0.5 seconds.
Make it a frame. After the end of step ST202, the destination image frame 32 is newly represented by i.
The process proceeds from step ST202 to step ST404. In step ST404 and subsequent steps, the new image frame 3
2 and an image frame 24 (j) that is continuous with the previously displayed image frame 23, and the generated video is synthesized so as to gradually change to the video of the transition destination. In step ST404, which is the processing of the transition area, the j-th image frame 24 and the variables are read from the storage device in addition to the normal i-th image frame 32 and the variables.

In step ST405, the i-th image frame 32 and the j-th image frame 24 are respectively converted to generate a converted image 25 (K) and a second converted image 43 (K ') shown in FIG. This conversion is the same as described above.

In step ST406, the image synthesizing device 4
In equation (2), each converted video frame is expressed as shown in equation (9).

(Equation 9) 26 to obtain a presentation image 13 (J) shown in FIG. This is to gradually increase the ratio of the video frames after the transition according to the variable F, and the video is completely switched after the Wth frame. Here, K,
The coefficient for K ′ represents multiplying the pixel value of the image by the coefficient.

In step ST407, J is displayed on the image display device 20. Also in this case, the frame speed is made to match the value at the time of shooting. In step ST408, the variable F
Is reduced by “1”, and “1” is added to j. The process up to this point is the process of the transition area, and thereafter, the process proceeds to step ST5.

As described above, Embodiment 4
According to the method, the transition area of the width W frame is set at the transition point at which the video is switched, and the video before and after the transition is smoothly and gradually changed in the transition area, so that the generated video in which the transition portion does not appear remarkably can be synthesized. There is an effect that a spatial expression device can be obtained.

Embodiment 5 FIG. FIG. 28 is a block diagram showing a configuration of a space representation device using video images according to Embodiment 5 of the present invention. In FIG. 28, the same or corresponding parts as those in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted.
In FIG. 28, reference numeral 61 denotes a frame selecting device (frame selecting means) for selecting the most appropriate image frame for the designated start viewpoint position q, and 62 denotes a designated start viewpoint position q.
And a viewpoint position setting device (viewpoint position setting means) for initially setting the optical axis direction and the angle of view.

FIGS. 29 and 30 are explanatory diagrams showing the operation of the space representation apparatus using video images according to the fifth embodiment of the present invention. The same or corresponding parts as in FIGS. 4 and 7 are denoted by the same reference numerals. The description is omitted. In the figure, reference numeral 47 denotes an image frame selected at an initial stage by the frame selection device 61, and reference numeral 48 denotes a viewpoint position of the image frame 47.

In the fifth embodiment, the designated viewpoint position q can be freely designated not only on the photographing route.

Next, the operation will be described. FIG. 31 is a flowchart showing an image generation operation by the video image spatial expression device according to the fifth embodiment of the present invention. In FIG. 31, steps that are the same as or correspond to those in FIG. 15 are given the same reference numerals, and descriptions thereof will be omitted. First, in step ST501, the viewpoint position setting device 62 initializes a designated start viewpoint position q, an optical axis direction Θ, and an angle of view Φ on an imaging route. In this case, the start designated viewpoint position q
Is not limited to the shooting route. Subsequent step ST502
Then, the frame selection device 61 selects the most appropriate image frame 47 (I _i ) for the designated start viewpoint position q. In this case, for example, the image frame I _{i in} which the angle formed in the optical axis direction is equal to or smaller than a predetermined threshold value, for example, 15 degrees, and the difference | q-p _i |
And so on. The number of the image frame 47 is stored in a variable i.

Note that the steps ST2 to ST4
The operations up to this point are the same as the operations described in the first embodiment. In step ST503, the viewpoint position setting device 6
2, a movement v of the viewpoint, a movement u in the optical axis direction, and a change s in the angle of view are specified. Subsequent steps ST6 and ST7 are the same as the operations described in the first embodiment.

Here, step ST3 of this embodiment
Will be described. Embodiment 1
Similarly to this, also in this embodiment, the gazing point 2 of the presentation image 13
Make sure 6 is centered correctly. To do this,
As shown in FIG. 30, the gazing point a = D (co
sΘ, sinΘ, 0) + q = (a x, a y, as a _z),

[0106]

(Equation 10)

## EQU11 ##

[0108]

[Equation 11]

Is obtained. Regarding _rv , the first embodiment
Is the same as The magnification r _z is determined by the ratio of the distance from the viewpoint position to the gazing point 26 and the difference in the angle of view.

[0110]

(Equation 12)

Is obtained.

As described above, the fifth embodiment
According to the present invention, a space expression device capable of giving a feeling such as changing the pace in a moving environment and taking a stroll regardless of the shooting path at the time of shooting the video image data and the designated viewpoint position on the shooting path The effect is obtained. In particular, if the designated viewpoint position 8 is moved along the photographing path 6 and the optical axis direction of the presentation image 13 is changed near the optical axis direction of the image frame 47, the movement captured in the video image data 7 It is possible to generate a video that walks in a free space while looking around in a certain space.

The storage device 16 in each embodiment described above is a main storage device of a computer, a magnetic disk device, a video tape device, and a video tape.

Embodiment 6 FIG. In each of the embodiments described above, the speed adjusting device 17, the frame selecting device 18,
The image conversion device 19 is provided as a component, the second embodiment is provided with a frame selection device 30 as a characteristic component, and the third embodiment is provided with a transition point setting device 33 and a frame as a characteristic component. In the fourth embodiment, the image synthesizing device 42 is provided as a characteristic component. In the fifth embodiment, a frame selecting device 61 and a viewpoint position setting device 62 are provided. Although the configuration is provided, the operation of each of these components may be realized by software using a computer.

Embodiment 7 FIG. In the above embodiments, the frame rate of the generated video 14 is the same as that of the video video data 7. However, the frame speed may be different. In this case, if the frame speed of the generated video 14 is 1 / n of the video video data 7 (the frame presented in the unit time is 1 / n)
Then, the operation in step ST6 becomes i ← i + n.
Conversely, if the frame speed of the generated video 14 is n times the video video data 7 (the number of frames presented in a unit time is n times), the operation of step ST6 is such that every time step ST6 is executed n times, i The operation is such that “1” is added.

Embodiment 8 FIG. In the fifth embodiment, the continuous video image data 7 is used. However, the video image data 7 may be configured by using a plurality of video image data 7 which are separately shot.

Embodiment 9 FIG. In each of the above embodiments, the horizontal plane is described as being within the xy plane. However, the horizontal plane may be set to another plane such as a vertical plane, and the same operation and the same effect can be expected.

Embodiment 10 FIG. In the above embodiments,
The optical axis of the video image data and the presentation image has been described as being parallel to the xy plane. However, the present invention is not limited to this. Even when the optical axis of the video image data and the presentation image is not parallel to the xy plane, a simple image conversion can be used. I can deal with it.

Embodiment 11 FIG. In the above embodiments,
Although the horizontal axis of the video image data and the presentation image is described as being parallel to the xy plane, the present invention is not limited to this. Even when the horizontal axis of the video image data and the presentation image is not parallel to the xy plane, a simple image conversion can be used. I can deal with it.

Embodiment 12 FIG. In the fourth embodiment,
Although the calculation performed by the image synthesizing device 42 has been described as the interpolation and mixing of the pixel values shown in Expression (9), feature points representing the same point in the subject are associated between the two converted images to be synthesized, and the same It may be configured to perform so-called morphing in which pixel values are mixed after moving and deforming each other so as to be placed in pixels.

Embodiment 13 FIG. In the above embodiments,
The image frames are sequentially selected and presented one by one, but when the moving speed of the object is not determined, or when the movement of the designated viewpoint position is fast, for example, up to one frame is thinned out and selected. Further, when the movement of the designated viewpoint position is slow, for example, the same image frame may be continuously presented up to twice.

[0122]

As described above, according to the present invention, the image frame selected from the video image data is subjected to image conversion so as to match the scene at the designated viewpoint position designated with respect to the photographing path. With this configuration, it is possible to select an image frame that has a different viewpoint position but correctly indicates the motion of the subject, and has an effect of generating a video that accurately reproduces the motion of the subject.

According to the present invention, a structure is provided in which the frame selecting means sequentially selects successive image frames from the video image data one frame at a time. There is an effect that an image in which the motion of the subject is correctly reproduced is selected by selecting one frame at a time in order.

According to the present invention, the distance between the designated viewpoint position updated by the movement amount of the designated viewpoint given by the speed adjusting means and the shooting viewpoint position of the selected image frame is more than a predetermined distance. Is provided, a frame selecting means for reselecting an image frame at a shooting viewpoint position close to the designated viewpoint position is provided, so that an image space can be reproduced without a scene to be reproduced being significantly different from an actual scene. There is.

According to the present invention, there is provided transition point setting means for presetting a transition point corresponding to an image frame selected by the frame selection means, and the image frame at the photographing viewpoint position close to the designated viewpoint position is set to the transition point setting means. Since the frame selecting means is configured to select between the image frames at the transition point set in advance by the means, there is an effect that an image in which the discontinuity of the reproduced image space at the transition point does not significantly appear can be generated.

According to the present invention, the image conversion means performs image conversion on both the image frame already selected by the frame selection means and the reselected image frame, and combines the converted images obtained by the image conversion means into a presentation image. And an image synthesizing means for gradually increasing the ratio in the interpolation with respect to the reselected image frame, so that the image can be smoothly shifted, and the image in which discontinuity does not become noticeable can be generated. There is an effect that can be done.

According to the present invention, there is provided a viewpoint position setting means for initially setting a start viewpoint, an optical axis direction, and an angle of view in a space where video image data is captured, and the start position set by the viewpoint position setting means is provided. The frame selecting means selects an image frame optimal for the viewpoint, and converts the image frame selected by the frame selecting means into an image based on the start viewpoint, the optical axis direction, and the angle of view set by the viewpoint position setting means. Since the means is configured to convert the image to the presentation image, regardless of the shooting path at the time of shooting the video image data, and the designated viewpoint position on the shooting path, in the space with the movement shot by the video image data, There is an effect that an image corresponding to the initially set start viewpoint, optical axis direction, and angle of view can be generated.

According to the present invention, the selected image frame is converted by the image conversion means so that the subject at a certain distance on the optical axis of the presented image is correctly drawn on the presented image. There is an effect that a presentation image in which the vicinity of the gazing point is correctly drawn can be generated.

According to the present invention, the image conversion means performs the image conversion by the parallel movement and the enlargement or reduction of the selected image frame. Therefore, the presented image that accurately reproduces the motion of the subject by a simple calculation can be obtained. There is an effect that can be generated.

According to the present invention, the photographing viewpoint positions of the video image data are arranged on a straight line, and the optical axis is directed along the straight line in the traveling direction of the photographing viewpoint position. Since the image conversion means is configured to perform image conversion by enlarging or reducing an image frame, which is determined by the distance from the shooting viewpoint position, it is possible to generate an image in which the forward speed is arbitrarily changed by a simple calculation.

According to the present invention, in processing using video image data shot in a direction orthogonal to the straight line on a straight shooting path, image frame conversion is performed by parallel movement of the image. Therefore, there is an effect that a video image whose translation speed is arbitrarily changed can be generated by a simple calculation.

According to the present invention, since the image conversion means is configured to generate a converted image smaller than the image frame of the video image data, an area where the peripheral portion of the converted image generated in the conversion of the image frame cannot be corresponded. There is an effect that a video which is not affected can be generated.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a space representation device using video images according to Embodiment 1 of the present invention.

FIG. 2 is an explanatory diagram illustrating an operation of the space representation device using video images according to the first embodiment of the present invention;

FIG. 3 is an explanatory diagram showing a camera arrangement in an operation of the video image spatial expression device according to the first embodiment of the present invention;

FIG. 4 is an explanatory diagram illustrating an operation of the space representation device using video images according to the first embodiment of the present invention;

FIG. 5 is an explanatory diagram showing data stored in a storage device of the video image spatial expression device according to the first embodiment of the present invention.

FIG. 6 is an explanatory diagram showing an operation of the video image spatial expression device according to the first embodiment of the present invention;

FIG. 7 is an explanatory diagram showing a viewpoint arrangement in the movement of the video image spatial expression device according to the first embodiment of the present invention;

FIG. 8 is an explanatory diagram showing image conversion in the operation of the space representation device using video images according to the first embodiment of the present invention;

FIG. 9 is an explanatory diagram showing an operation of the space representation device using video images according to the first embodiment of the present invention;

FIG. 10 is an explanatory diagram illustrating an example of image conversion in the operation of the space representation device using video images according to the first embodiment of the present invention;

FIG. 11 is an explanatory diagram showing an operation of the video image spatial expression device according to the first embodiment of the present invention.

FIG. 12 is an explanatory diagram illustrating an example of image conversion in the operation of the video image spatial expression device according to Embodiment 1 of the present invention;

FIG. 13 is an explanatory diagram illustrating an example of image conversion in the operation of the video image spatial expression device according to the first embodiment of the present invention.

FIG. 14 is an explanatory diagram illustrating an example of a generated image in the video image spatial expression device according to the first embodiment of the present invention.

FIG. 15 is a flowchart illustrating an image generation operation of the video image spatial expression device according to the first embodiment of the present invention.

FIG. 16 is a block diagram illustrating a configuration of a space representation device using video images according to Embodiment 2 of the present invention.

FIG. 17 is an explanatory diagram showing an example of image conversion in the operation of the video image spatial expression device according to Embodiment 2 of the present invention;

FIG. 18 is a flowchart illustrating an image generation operation of the video image spatial expression device according to the second embodiment of the present invention.

FIG. 19 is a block diagram illustrating a configuration of a space representation device using video images according to Embodiment 3 of the present invention.

FIG. 20 is an explanatory diagram showing an operation of the video image spatial expression device according to the third embodiment of the present invention.

FIG. 21 is an explanatory diagram showing an operation of the video image spatial expression device according to the third embodiment of the present invention.

FIG. 22 is an explanatory diagram showing an operation of the video image spatial expression device according to the third embodiment of the present invention.

FIG. 23 is a flowchart showing a procedure for setting a transition point of the space representation device using video images according to Embodiment 3 of the present invention;

FIG. 24 is a flowchart showing an image generation operation of the space expression device using video images according to Embodiment 3 of the present invention;

FIG. 25 is a block diagram showing a configuration of a space representation device using video images according to Embodiment 4 of the present invention.

FIG. 26 is an explanatory diagram showing an operation of the video image spatial expression device according to the fourth embodiment of the present invention.

FIG. 27 is a flowchart showing an image generation operation of the video image spatial expression device according to the fourth embodiment of the present invention.

FIG. 28 is a block diagram showing a configuration of a video image spatial expression device according to Embodiment 5 of the present invention.

FIG. 29 is an explanatory diagram showing an operation of the video image spatial expression device according to the fifth embodiment of the present invention.

FIG. 30 is an explanatory diagram showing a viewpoint arrangement in an operation of the video image spatial expression device according to the fifth embodiment of the present invention.

FIG. 31 is a flowchart showing an image generation operation of the video image spatial expression device according to the fifth embodiment of the present invention.

FIG. 32 is a block diagram illustrating a configuration of a conventional space expression device.

FIG. 33 is an explanatory diagram showing an operation of a conventional space expression device.

FIG. 34 is an explanatory diagram showing an operation of a conventional space expression device.

FIG. 35 is an explanatory diagram showing an example of a video generated by a conventional space expression device.

FIG. 36 is an explanatory diagram showing an example of a video generated by a conventional spatial expression device.

[Explanation of symbols]

16 storage device (storage device), 17 speed adjustment device (speed adjustment device), 18, 30, 34, 61 frame selection device (frame selection device), 19 image conversion device (image conversion device), 20 image display device (image Display means), 3
3 transition point setting device (transition point setting means), 42 image synthesizing device (image synthesizing means), 62 viewpoint position setting device (visual point position setting means).

 ────────────────────────────────────────────────── ─── Continued on the front page F-term (reference)

Claims (11)

[Claims] 1. A storage means for storing video image data and a shooting viewpoint position, an optical axis direction, and an angle of view of each image frame of the video image data, and a moving amount of a specified viewpoint specified with respect to a shooting path of the video image data. Speed adjusting means for inputting an image frame, frame selecting means for selecting an image frame to be presented from the video image data stored in the storage means, and an image frame selected by the frame selecting means as an image to be presented at the designated viewpoint. A video comprising: image conversion means for converting; and image display means for displaying the presentation image converted by the image conversion means and expressing a video space by a presentation image showing a scene matching the movement of the designated viewpoint. A space expression device using images. 2. The apparatus according to claim 1, wherein the frame selecting means selects successive image frames from the video image data one by one in order. 3. The method according to claim 1, wherein the distance between the designated viewpoint position updated by the movement amount of the designated viewpoint provided by the speed adjusting unit and the photographing viewpoint position of the selected image frame is a predetermined distance or more. 2. The space representation apparatus according to claim 1, wherein if the distance is far, an image frame at a shooting viewpoint position close to the designated viewpoint position is reselected. 4. A transition point setting means for setting a transition point corresponding to an image frame selected by the frame selection means in advance, wherein the frame selection means converts an image frame at a shooting viewpoint position close to a designated viewpoint position into the transition point. 4. The space representation apparatus according to claim 3, wherein a selection is made between image frames at a transition point set in advance by the setting means. 5. The image conversion means converts the image frame already selected by the frame selection means and the reselected image frame together, synthesizes the converted image obtained by the image conversion means, and interpolates the presentation image. 5. An apparatus according to claim 3, further comprising image synthesizing means for gradually increasing a ratio in interpolation with respect to the reselected image frame. 6. A viewpoint position setting means for initially setting a start viewpoint, an optical axis direction, and an angle of view in a space where video image data is captured, and a frame selecting means, wherein the frame setting means is set by the viewpoint position setting means. An image frame that is optimal for the start viewpoint is selected, and the image conversion unit converts the image frame selected by the frame selection unit based on the start viewpoint, the optical axis direction, and the angle of view set by the viewpoint position setting unit. 2. The apparatus according to claim 1, wherein the image is converted into a presentation image. 7. The image conversion unit according to claim 1, wherein the image conversion unit converts the selected image frame so that a subject located at a fixed distance on the optical axis of the designated image is correctly drawn on the presentation image. A space representation device using a video image according to claim 6. 8. The apparatus according to claim 7, wherein the image conversion means performs the image conversion by translating and enlarging or reducing the selected image frame. 9. The shooting viewpoint position of the video image data is aligned on a straight line, and the optical axis is directed on the straight line in the traveling direction of the shooting viewpoint position. 7. The apparatus according to claim 1, wherein image conversion is performed by enlarging or reducing an image frame determined by a distance from the shooting viewpoint position. 10. The shooting viewpoint position of the video image data is arranged on a straight line, the optical axis is orthogonal to the straight line, and the image conversion means is configured to determine a designated viewpoint position and the shooting viewpoint position of a selected image frame. 7. The apparatus according to claim 1, wherein the image conversion is performed by a parallel movement of an image frame determined by a distance. 11. The apparatus according to claim 1, wherein the image conversion unit generates a converted image smaller than an image frame of the video image data. .