JP2003009180A - Display device, display method and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device capable of displaying a moving image or an actually photographed image in a real time according to the point of sight position of a viewer, even in the case of the moving image or actually photographed image whose contents are complicate requiring a huge calculating time in a conventional point of sight follow-up type display device. SOLUTION: Image data which are preliminarily made correspond to the point of sight position of a viewer are stored in an image data storing part by frame units. Also, a time number is calculated by quantizing time information generated by a time information generating part 1. Then, a horizontal position number, vertical position number, and far-and-near position number for specifying the image data corresponding to the point of sight position of the viewer are calculated. A frame number is calculated based on the calculated time number, horizontal position number, vertical position number, and far-and-near position number. Thus, image data corresponding to the calculated frame number are displayed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device,
In particular, the present invention relates to a display device capable of displaying an image according to a viewer's viewpoint position.

[0002]

2. Description of the Related Art Conventionally, there is a walk-through type virtual reality reproducing device that gives a viewer a sense of reality by displaying an image that matches the viewpoint of the viewer by following the viewpoint position of the viewer. An example of this virtual reality reproducing device is a CAVE (registered trademark) system (Cruz-Neira, San) which is a surrounding type stereoscopic display device using a plurality of large screens.
din, DJ, and DeFanti, TA, Virtual Rea
lity: “The Designand Implementation of the
CAVE ”, in Proceeding off SIGGRAP
H'93 Computers Conference, AC
M SIGGRAPH, August 1993, pp.13
5-142) and so on.

In the above-described conventional viewpoint-following display device, an image to be displayed is generated by computer graphics according to the viewpoint position of the viewer, so that three-dimensional position information of the object to be displayed can be set in advance. For example, it is possible to generate an image according to an arbitrary viewpoint position of the viewer.

[0004]

However, since the conventional viewpoint tracking type display device generates an image to be displayed according to the viewer's viewpoint position by computer graphics,
When the image content is complicated, there is a problem that it takes a considerable amount of calculation time to generate an image according to the viewer's viewpoint position.

That is, the conventional viewpoint-following display device has a problem that it is difficult to display a moving image or a real image which requires a considerable amount of calculation time.

The present invention has been made in order to solve the above-mentioned problems of the prior art, and its purpose is to provide a moving image with complicated contents which requires a considerable amount of calculation time in the conventional viewpoint tracking type display device. It is an object of the present invention to provide a display device capable of displaying a moving image or a live-action video in real time according to the viewpoint position of a viewer even for a live-action video or a live-action video.

[0007]

In order to achieve the above-mentioned object, a display device according to the present invention is a display device for displaying an image, wherein image data associated with three-dimensional position data indicating a viewer's viewpoint position. Based on the three-dimensional position data input from the three-dimensional position data input unit and the three-dimensional position data input unit inputting the three-dimensional position data An image data selection unit that selects specific image data from a plurality of image data stored in the image data storage unit.

With such a configuration, even in the case of a moving image or a live-action video having a complicated content which requires a considerable amount of calculation time in the conventional viewpoint-following display device, it can be realized in real time according to the viewpoint position of the viewer. It can display moving images and live-action videos.

Further, the display device further comprises a time information generating section for generating time information, and the image data selecting section indicates a time number obtained by quantizing the time information generated by the time information generating section in frame units. A time number calculation unit for calculating, a three-dimensional position number calculation unit for calculating a three-dimensional position number obtained by quantizing the three-dimensional position data input from the three-dimensional position data input unit in frame units, and the time number calculation unit. A frame number calculation unit that calculates a frame number of the image data stored in the image data storage unit based on the calculated time number and the three-dimensional position number calculated by the three-dimensional position number calculation unit. Characterize.

Further, the display device further includes a horizontal component data calculation unit for calculating horizontal component data indicating a horizontal component from the three-dimensional position data input from the three-dimensional position data input unit, and the three-dimensional position data input unit. Entered more 3
A vertical component data calculation unit for calculating vertical component data indicating a vertical component from the dimensional position data, and a perspective component data calculation for calculating perspective component data indicating a perspective component from the 3D position data input from the 3D position data input unit. The three-dimensional position number calculation unit includes a horizontal position number calculation unit that calculates a horizontal position number by quantizing the horizontal component data calculated by the horizontal component data calculation unit in frame units; and the vertical component. A vertical position number calculation unit that quantizes the vertical component number calculated by the data calculation unit in frame units to calculate a vertical position number, and quantizes the perspective component data calculated by the perspective component data calculation unit in frame units. And a perspective position number calculation unit for calculating a perspective position number,
The frame number calculating unit may calculate a frame number based on the time number, the horizontal position number, the vertical position number, and the perspective position number.

The display method according to the present invention is the display method for displaying an image, wherein image data in which a plurality of image data associated with three-dimensional position data indicating a viewer's viewpoint position are stored in units of frames. An accumulation step,
Based on the three-dimensional position data input step of inputting the three-dimensional position data and the three-dimensional position data input in the three-dimensional position data input step, from among the plurality of image data accumulated in the image data accumulation step, And an image data selecting step of selecting specific image data.

By such a method, even in the case of a moving image or a live-action image having complicated contents which requires a considerable amount of calculation time in a conventional viewpoint-following display device, the moving image can be displayed in real time according to the viewer's viewpoint position. It is possible to display live-action video.

Further, the program according to the present invention includes an image data accumulation process for accumulating a plurality of image data associated with three-dimensional position data indicating a viewer's viewpoint position in units of frames, and the above three-dimensional position data. Based on the three-dimensional position data input process for inputting the three-dimensional position data input process and the three-dimensional position data input by the three-dimensional position data input process. It is characterized in that it is a program for causing a computer to execute the image data selection processing to be selected.

With such a program,
Even in the case of a moving image or a live-action video having complicated contents that requires a considerable amount of calculation time in the conventional viewpoint-following display device, the moving-image or the live-action video can be displayed in real time according to the viewpoint position of the viewer. .

[0015]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of a display device according to the present invention will be described with reference to the drawings. First, Fig. 1
FIG. 3 schematically shows the positional relationship between the viewer and the display screen of the display device which displays an image according to the viewpoint position of the viewer to give a virtual reality.

In FIG. 1, a screen displaying an image is arranged so as to surround a viewer.

The image displayed on this screen changes in accordance with the change in the viewer's viewpoint position. Therefore, the viewer who views the image feels virtual reality. The viewpoint position P is the position of the observer's head, and the coordinate origin is O.

[0018]

[Equation 1] Is the viewpoint position vector.

Next, FIG. 2 is a configuration diagram showing a configuration of the display device according to the embodiment. 2, the display device according to the embodiment includes a time information generation unit 1, a time number calculation unit 2, a three-dimensional position data input unit 3, a horizontal reference position data storage unit 4, a horizontal component data calculation unit 5, and a horizontal position number. Calculation unit 6, vertical reference position data storage unit 7, vertical component data calculation unit 8, vertical position number calculation unit 9, perspective reference position data storage unit 10, perspective component data calculation unit 11, reciprocal number calculation unit 12, perspective position number calculation. It is composed of a unit 13, a frame number calculation unit 14, an image data storage unit 15, and the like.

An example of the image data selection unit 17 is a combination of the time number calculation unit 2, the horizontal position number calculation unit 6, the vertical position number calculation unit 9, the perspective position number calculation unit 13, and the frame number calculation unit 14. Is.

The image data storage unit 15 is configured to store a plurality of image data and is composed of, for example, a hard disk.

The image data storage unit 15 stores image data in frame units. For example, as shown in FIG. 3, image data is stored in frame units in association with frame numbers. The image data 1 is stored in the frame number 1, the image data 2 is stored in the frame number 2, and so on.

This frame number is a time number described later,
It is specified by the horizontal position number, vertical position number, and perspective position number. Of these, the horizontal position number, vertical position number, and perspective position number are calculated based on the three-dimensional position data indicating the viewpoint position of the viewer. Therefore, the image data stored in the image data storage unit 15 is associated with the three-dimensional position data indicating the viewer's viewpoint position via the frame number.

Time number, horizontal position number, vertical position number,
The perspective position numbers are numbers assigned in frame units as described later, but for example, one image data cannot be specified with only one time number, and the frame number cannot be obtained until four numbers are gathered. Is specified. Figure 4
FIG. 6 is a diagram schematically showing how a frame number is specified by a horizontal position number, a vertical position number, and a perspective position number. Note that, in FIG. 4, since the four-dimensional diagram cannot be written, the time numbers are omitted. As can be seen from FIG. 4, for example, there are a plurality of frame numbers having the same vertical position number. A combination of the horizontal position number, the vertical position number, and the perspective position number is an example of the three-dimensional position number.

Next, the time information generator 1 is configured to generate time information updated at the frame frequency of the moving image to be displayed. For example, assuming that the display time of one frame is 1/60 second, the time information generating unit 1
Generates time information that is updated in 1/60 seconds.

The time number calculation unit 2 is configured to calculate a time number which is a number within the range of the length (the number of frames) of the moving image sequence regarding the time from the time information generated by the time information generation unit 1. ing. In other words, the time information is quantized in units of frames to calculate the time number.

Here, the quantization means to discretize a certain amount in units of frames.

For example, the display time for one frame is 1/60
If there are seconds, there are 60 frame images for 1 second, and if there are moving images for 10 seconds, there are 600 frame images in total. In this case, the length (the number of frames) of the moving image sequence regarding time is 600, and the time number calculation unit 2 quantizes the time information, for example, from 1 to 600.
Assign a number in the range of as the time number. Here, the length (the number of frames) of the moving image sequence regarding the time is the total number of frames in the time direction.

When the time number assigned to the time information exceeds 600, if the time numbers are again assigned in order from 1 and are played back in the order of the time number, the moving image sequence will be repeatedly played.

It is possible to assign time numbers corresponding to reverse rotation reproduction, shuttle reproduction, and high speed reproduction by simple calculation.

Next, the three-dimensional position data input unit 3 is configured to input the three-dimensional position data indicating the viewpoint position of the viewer from the three-dimensional position data measuring instrument. As the three-dimensional position data measuring device, for example, a magnetic sensor (for example,
US Polhemus "FASTRAK system" and infrared sensor (for example Origin Instruments US DynaS)
ight system ”) and other position sensors.

The horizontal reference position data storage unit 4 is configured to store horizontal reference position data indicating the horizontal direction by using the switches 4a and 4b.

The switches 4a and 4b are switches that give a trigger for setting the horizontal reference position.

The horizontal reference position data storage unit 4 stores, for example, horizontal reference coordinate data of a position sensor placed at the leftmost end of the viewpoint position where an image can be displayed by the switch 4a.
Further, the horizontal reference coordinate data of the position sensor placed at the right end of the viewpoint position where the image can be displayed is stored by the switch 4b.

Next, the horizontal component data calculation unit 5 calculates the three-dimensional position data input from the three-dimensional position data input unit 3 based on the two horizontal reference coordinate data stored in the horizontal reference position data storage unit 4. It is configured to calculate horizontal component data.

For example, from the horizontal reference position data storage unit 4
Each of the two acquired horizontal reference coordinate data is P_L(X
_L, Y_L, Z_L), P_R(X_R, Y_R, Z_R) And direct
Line P _LP_RUpper unit vector e_LRAnd 3D position data
3D position data P (X,
P of Y, Z)_LPosition vector P with origin as_LWithin P
Calculate the horizontal component data by taking the product
Is configured.

Next, the horizontal position number calculating section 6 is configured to quantize the horizontal component data calculated by the horizontal component data calculating section 5 in units of frames to calculate the horizontal position number. Here, quantization refers to discretizing a certain amount in units of frames.

For example, the input horizontal component data is compared with a plurality of preset threshold values. Then, the number assigned to the maximum threshold value that does not exceed the value of the horizontal component data is
Clipping can be performed within the range of the total number of frames in the horizontal direction to obtain the horizontal position number.

Further, the horizontal position number calculation unit 6 calculates the horizontal position number by quantizing the data obtained by multiplying the horizontal component data by the reciprocal data indicating the reciprocal of the perspective position, which will be described later, in the multiplier 5a in frame units. Is also configured to be able to. This switching is performed by the switch 6a.

The vertical reference position data storage unit 7 is configured to store vertical reference position data indicating the vertical direction by using the switches 7a and 7b.

The switches 7a and 7b are switches which give a trigger for setting the vertical reference position.

The vertical reference position data storage unit 7 stores, for example, the three-dimensional position coordinate data of the position sensor placed at the bottom of the viewpoint position where an image can be displayed by the switch 7a. Also, the switch 7b stores the three-dimensional position coordinate data of the position sensor placed at the uppermost end of the viewpoint position where the image can be displayed.

The vertical component data calculation unit 8 calculates the vertical component data from the three-dimensional position data input from the three-dimensional position data input unit 3 based on the two vertical reference coordinate data stored in the vertical reference position data storage unit 7. Is configured to calculate

For example, from the vertical reference position data storage unit 7
Each of the acquired two vertical reference coordinate data is P_D(X
_D, Y_D, Z_D), P_U(X_U, Y_U, Z_U) And direct
Line P _DP_UUpper unit vector e_DUAnd 3D position data
3D position data P (X,
P of Y, Z)_DPosition vector P with origin as_DWithin P
To calculate vertical component data by taking the product
Is configured.

The vertical position number calculation unit 9 is configured to quantize the vertical component data calculated by the vertical component data calculation unit 8 in frame units to calculate the vertical position number.

For example, the input vertical component data is compared with a plurality of preset threshold values. Then, the number assigned to the maximum threshold value that does not exceed the value of the vertical component data is
Clipping can be performed within the range of the total number of frames in the vertical direction, and the vertical position number can be set.

Further, the vertical position number calculation unit 9 multiplies the vertical component data by the reciprocal data indicating the reciprocal of the vertical position.
The vertical position number can also be calculated by quantizing the data multiplied by.
This switching is performed by the switch 9a.

Next, the perspective reference position data storage unit 10
The switch 10a and the switch 10b are used to store the perspective reference position data indicating the perspective direction.

The switches 10a and 10b are switches which give a trigger for setting the perspective reference position.

The perspective reference position data storage unit 10 stores, for example, the perspective reference coordinate data of the position sensor placed closest to the screen among the viewpoint positions where images can be displayed by the switch 10a. Further, the perspective reference coordinate data of the position sensor placed at the farthest position on the screen among the viewpoint positions where images can be displayed is stored by the switch 10b.

Next, the perspective component data calculation unit 11 calculates the three-dimensional position data input from the three-dimensional position data input unit 3 based on the two perspective reference coordinate data stored in the perspective reference position data storage unit 10. It is configured to calculate the perspective component data.

For example, the two perspective reference coordinate data acquired from the perspective reference position data storage unit 10 are respectively P
_N (X _N , Y _N , Z _N ) and P _F (X _F , Y _F , Z _F ), and the unit vector e _NF on the straight line P _N P _F and the three-dimensional position data input unit 3 input 3 Dimensional position data P
Position vector P _N P with P _N of (X, Y, Z) as the origin
And the dot product with. Then, the perspective component data, which is the sum of this inner product and the distance from the screen to the reference position P _N , is calculated.

The reciprocal calculation unit 12 is configured to calculate reciprocal data indicating the reciprocal of the value of the perspective component data calculated by the perspective component data calculation unit 11.

The reciprocal data calculated by the reciprocal calculation unit 12 is sent to the multiplier 5a and the multiplier 8a, and is multiplied by the horizontal component data and the vertical component data, respectively, as described above.

With this configuration, for example, when the viewer is near the screen displaying the image and the viewpoint position is moved, it is the same as when the viewer is far from the screen displaying the image. Only when the viewpoint position is moved, it is possible to display with a sense of reality.

That is, when the viewer is near the screen, the displayed image needs to be changed greatly, but when the viewer is far from the screen, the displayed image need not be changed so much. It was done.

Next, the perspective position number calculation unit 13 is configured to quantize the perspective component data calculated by the perspective component data calculation unit 11 on a frame-by-frame basis to calculate the perspective position number.

For example, the input perspective component data is compared with a plurality of preset threshold values. Then, the number assigned to the maximum threshold value that does not exceed the value of the perspective component data,
Clipping may be performed within the range of the total number of frames in the perspective direction to form the perspective position number.

The perspective position number calculating unit 13 is also configured to calculate the horizontal position number by quantizing the data obtained by multiplying the perspective component data by the reciprocal data indicating the reciprocal of the perspective position in frame units. ing. This switching is performed by the switch 12a.

Next, the frame number calculation unit 14 calculates the time number calculated by the time number calculation unit 2, the horizontal position number calculated by the horizontal position number calculation unit 6, and the vertical position calculated by the vertical position number calculation unit 9. The number and the perspective position number calculated by the perspective position number calculation unit 13 are input, and the image data storage unit 15
It is configured to calculate a frame number for specifying the image data to be displayed from the image data stored in.

For example, the frame number is calculated by the following formula.

Frame number = N _T + (N _H + (N _V + N
_D × vsize) × hsize) × tsize Here, the input time number is N _T , the horizontal position number is N _H , the vertical position number is N _V , and the perspective position number is N _D.

Then, the total number of frames of image data in the time direction is tsize, and the total number of frames of image data that can be displayed when the viewer's viewpoint position is changed to the horizontal position is hsiz.
e, vsize is the total number of frames of image data that can be displayed when the viewer's viewpoint position changes in the vertical direction.

In this way, the frame number specified by the four variables can be calculated by a one-dimensional formula.

The frame number specified by the four variables is 1
When calculated by the dimensional equation, a set of four variables (N _T ,
The same frame number may be calculated even if N _H , N _V , and N _D ) are different, but the same frame number is not calculated in the above formula.

For example, assuming that tsize, vsize, and hsize are 10, N _T , N _H , and N _V are values in the range of 0 to 9, and variables N _T , N _H , and N _V have different digits. Since they are calculated as numerical values, they are not mixed and calculated.

Specifically, a set of variables (N _T , N _H , N _V ,
When only the sum N _D) a (8,5,3,1) and (9,4,2,2) Then simply becomes the same value 17 but calculates the frame number by the above-mentioned formula,
1358 and 2249 are not the same value.

In the present embodiment, the one-dimensional equation has 4
Although the frame number is calculated by including two variables, the frame number may be calculated by including two variables in two expressions. Further, the one-dimensional equation is not limited to the above-mentioned equation, and other equations may be used.

Further, N _T is a constant regardless of time information,
If tsize = 1, a still image can be displayed.
Similarly a constant irrespective of N _V in a vertical position information, vsize =
When set to 1, the frame number calculation unit follows only the horizontal and perspective movements of the observer. In this way, the capacity of the image data storage unit can be saved by partially utilizing the acquired information.

The display unit 16 is configured to display the image data corresponding to the frame number calculated by the frame number calculation unit 14.

The display device in the embodiment is configured as described above, and its operation and action will be described below with reference to FIGS. 2 and 5. Image data storage unit 1
It is assumed that a plurality of image data are stored in advance in 5 in units of frames (image data storage step).

The horizontal reference position data storage unit 4 stores
It is assumed that the horizontal reference position data has already been stored by the switches 4a and 4b. Similarly, the vertical reference position data storage unit 7 and the perspective reference position data storage unit 10 store vertical reference position data and perspective reference position data, respectively. Although only the flow for calculating the horizontal position number is shown in FIG. 5B, the flow for calculating the vertical position number and the perspective position number is the same.

First, as shown in FIG. 5A, the time information (S101) generated by the time information generator 1 is input to the time number calculator 2. Then, the time number calculation unit 2
The input time information is quantized in frame units to calculate the time number (S102).

As shown in FIG. 5B, the 3D position data input unit 3 inputs 3D position data indicating the viewer's viewpoint position from the 3D position data measuring device (3D position data). Input step) (S103). This three-dimensional position data is output to the horizontal component data calculation unit 5, the vertical component data calculation unit 8, and the perspective component data calculation unit 11.

Next, the horizontal component data calculation unit 5 calculates the three-dimensional position vector created from the three-dimensional position data and the horizontal reference vector created from the horizontal reference position data stored in the horizontal reference position data storage unit 4. The inner product is taken and the horizontal component data is calculated (S104).

Although not shown, the vertical component data calculation unit 8 and the perspective component data calculation unit 11 similarly calculate vertical component data and perspective component data, respectively. In addition, the reciprocal data calculation unit 12 calculates reciprocal data having a reciprocal value of the value of the perspective component data calculated by the perspective component data calculation unit 11.

Then, when the reciprocal data is not multiplied (S105), the horizontal position number calculating section 6 calculates the horizontal position number by quantizing the horizontal component data in frame units (S).
107).

On the other hand, when the reciprocal data is multiplied (S10
5), the horizontal component data is multiplied by the reciprocal data (S10).
6). Then, the horizontal position number obtained by quantizing the multiplied data in frame units is calculated (S107).

Similarly, the vertical position number calculation unit 9 and the perspective position number calculation unit 13 calculate the vertical position number and the perspective position number.

Next, the frame number calculation section 14 calculates the time number calculated by the time number calculation section 2 and the horizontal position number calculation section 6
The frame number is calculated based on the horizontal position number calculated in step 1, the vertical position number calculated by the vertical position number calculator 9, and the perspective position number calculated by the perspective position number calculator 13 (S108).

Then, the frame number calculation unit 14 acquires the image data corresponding to the calculated frame number from the image data storage unit 15 (image data selection step), and outputs the acquired image data to the display unit 16. Display unit 16
Displays the acquired image data (S109).

In this way, even in the case where an image, a moving image, or a live-action video having a complicated content which requires a considerable amount of calculation time is changed in accordance with the viewer's viewpoint position, the display in the embodiment is displayed. According to the apparatus, an image, a moving image, and a live-action video corresponding to the viewer's viewpoint position are accumulated in advance, and a simple process of calculating a frame number from three-dimensional position data indicating the viewer's viewpoint position during operation. Therefore, it is possible to display in real time an image, a moving image, and a live-action video according to the viewer's viewpoint position.

The image handled by the display device in the embodiment is a moving image, but it may be a normal still image. In this case, the time number is unnecessary.

[0084]

According to the display device of the present invention, in the conventional viewpoint-following display device, the viewpoint position of the viewer can be adjusted even for a moving image or a live-action video having complicated contents which requires a considerable amount of calculation time. According to the above, a moving image or a live-action video can be displayed in real time.

[0085]

[Brief description of drawings]

FIG. 1 schematically shows a positional relationship between a display screen and a viewer.

FIG. 2 is a configuration diagram showing a configuration of a display device according to an embodiment.

FIG. 3 is a diagram schematically showing a storage state of image data stored in an image data storage unit.

FIG. 4 is a diagram showing how a frame number is specified by a horizontal position number, a vertical position number, and a perspective position number.

FIG. 5 is a flowchart showing one operation of the display device in the embodiment.

[Explanation of symbols]

1 Time information generator 2 Time number calculator 3 3D position data input section 4 Horizontal reference position data storage 5 Horizontal component data calculation unit 6 Horizontal position number calculator 7 Vertical reference position data storage 8 Vertical component data calculator 9 Vertical position number calculator 10 Perspective reference position data storage 11 Perspective component data calculation unit 12 Reciprocal calculator 13 Perspective position number calculator 14 Frame number calculator 15 Image data storage 16 Display 17 Image data selection section

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Yuichi Iwadate             1-10-11 Kinuta, Setagaya-ku, Tokyo, Japan             Broadcasting Association Broadcast Technology Institute F-term (reference) 5B050 BA07 BA10 CA06 DA07 EA17                       FA02 FA06 GA08                 5C061 AA20

Claims (5)

[Claims] 1. A display device for displaying an image, comprising: an image data storage unit for storing a plurality of image data associated with three-dimensional position data indicating a viewpoint position of a viewer in units of frames; and the three-dimensional position. A three-dimensional position data input unit for inputting data, and a specific image from a plurality of image data stored in the image data storage unit based on the three-dimensional position data input from the three-dimensional position data input unit A display device comprising: an image data selection unit that selects data. 2. The display device further comprises a time information generating section for generating time information, and the image data selecting section indicates a time number obtained by quantizing the time information generated by the time information generating section in frame units. A time number calculating section for calculating, a three-dimensional position number calculating section for calculating a three-dimensional position number obtained by quantizing the three-dimensional position data input from the three-dimensional position data input section in frame units, and the time number calculating section. A frame number calculation unit that calculates a frame number of the image data stored in the image data storage unit based on the calculated time number and the three-dimensional position number calculated by the three-dimensional position number calculation unit. The display device according to claim 1, wherein the display device is a display device. 3. The display device further includes a horizontal component data calculation unit that calculates horizontal component data indicating a horizontal component from the three-dimensional position data input from the three-dimensional position data input unit, and the three-dimensional position data input unit. A vertical component data calculation unit that calculates vertical component data indicating a vertical component from the input three-dimensional position data, and a perspective component data indicating a perspective component from the three-dimensional position data input from the three-dimensional position data input unit. A perspective component data calculating unit, wherein the three-dimensional position number calculating unit quantizes the horizontal component data calculated by the horizontal component data calculating unit in frame units to calculate a horizontal position number; , Vertical position number calculation for calculating vertical position number by quantizing the vertical component data calculated by the vertical component data calculation unit in frame units And a perspective position number calculation unit that calculates the perspective position number by quantizing the perspective component data calculated by the perspective component data calculation unit in frame units, and the frame number calculation unit includes the time number and the The frame number is calculated based on the horizontal position number, the vertical position number, and the perspective position number.
Display device according to. 4. A display method for displaying an image, the image data storing step of storing a plurality of image data associated with three-dimensional position data indicating a viewpoint position of a viewer in units of frames, and the three-dimensional position. Based on the three-dimensional position data input step of inputting data and the three-dimensional position data input in the three-dimensional position data input step, specific image data is selected from the plurality of image data accumulated in the image data accumulation step. And a step of selecting image data for selecting. 5. Image data accumulation processing for accumulating a plurality of image data associated with three-dimensional position data indicating a viewer's viewpoint position in units of frames, and three-dimensional position data for inputting the three-dimensional position data. An input process, and an image data selection process of selecting specific image data from a plurality of image data accumulated by the image data accumulation process based on the three-dimensional position data inputted by the three-dimensional position data input process. An image data display program that causes a computer to execute.