JP2003179867A - Data processing apparatus, data processing method, information storage medium, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a data processing apparatus and an information storage medium capable of attaining viewpoint switching processing for a multi- viewpoint image at a high-speed without intermission. <P>SOLUTION: The data processing apparatus is configured such that coded data blocks from different viewpoints comprise frame data shifted to each other and the apparatus stores the blocks to a storage medium such as a DVD. Through the configuration above, when the data processing apparatus executes reading of data from the medium and decoding and reproduction processing for the data, the data processing apparatus can reduce the time from the occurrence of a switching request until reproduction of block data after reproducible viewpoint switching so as to display a viewpoint switching image at a high- speed. Further, the data processing apparatus can surely execute discrimination of the block data after the reproducible viewpoint switching from the occurrence of the viewpoint switching request so as to prevent an error such as interruption of a display image due to the viewpoint switching from taking place. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a data processing device,
The present invention relates to a data processing method, an information storage medium, and a computer program. More specifically, the present invention relates to a data processing device, a data processing method, an information storage medium, and a computer program that enable smooth viewpoint switching in viewpoint switching reproduction processing of different viewpoint image data.

[0002]

2. Description of the Related Art In recent years, image data such as panorama images and spherical images, which can be moved in various directions, has been actively used. For example, when a storage medium such as a DVD or a CD stores an image of a subject captured from a plurality of viewpoint positions and line-of-sight directions, and the stored image is displayed on a CRT, a liquid crystal display device, or the like, the user operates the controller. A system for observing an image of a subject by moving a viewpoint to a free position has been realized. Further, an image obtained by photographing a certain subject from a plurality of viewpoint positions and line-of-sight directions is distributed via a communication system such as the Internet, and the user operates the mouse on a PC or the like to display images from the desired viewpoint position and line-of-sight direction on the display. A display system, etc. is built.

Image data in which the viewpoint can be moved in various ways is generated by, for example, combining and combining a plurality of images taken by cameras arranged at a plurality of different viewpoint positions. The image between the cameras can be generated based on the image captured by the adjacent camera by a method such as view interpolation as a correction process of the image data. In a moving image, moving image data captured by a plurality of cameras can be similarly generated after temporally synchronizing the moving image data. Such an omnidirectional video generation method is disclosed in, for example, the document “SE Chen” ck t.
ime VR-An Image-Based Approach to virtual Environm
ent Navigation ", Computer Graphics SIGGRAPH, pp.29-
38, 1995 ”and the like.

An image whose viewpoint can be freely changed is, for example, D
When the data is read from a storage medium such as a VD and played back on the display, the user selects either from which viewpoint position the data is displayed, or the data is displayed according to a program attached to the image data in advance. Will be executed. In a data distribution system such as the Internet or a broadcast via satellite, a user selects and displays one viewpoint image from images from a plurality of viewpoint images transmitted from a data distributor. Originally, processing such as displaying only a representative image predetermined on the display is executed.

As a content that is supposed to use such a viewpoint switching process, a viewer can select a story instead of a single story as in the conventional movie / TV drama broadcasting, and various video expressions can be realized. However, new video contents are being developed and proposed that can increase the enjoyment of viewers. In particular, applications such as sports videos and music concert videos can be enjoyed by switching cameras with different viewpoints, or viewing and enjoying 360-degree panoramic videos from the same viewpoint from the user's favorite line of sight (angle).

Since these video contents require a plurality of videos, the amount of video information to be recorded increases. In addition, it is necessary to avoid the occurrence of video / audio interruptions when the viewer performs an operation of switching video of multiple angles. That is, in such display processing of multi-view image content, it is required to display a video having a desired viewpoint or angle from a large amount of video data without causing delay or interruption.

There is also a display method in which not only the viewer switches between a plurality of viewpoints or angles, but also the viewer is shown along a preprogrammed viewpoint / angle. By displaying images using such programmed viewpoint switching processing, for example, when a plurality of singers are singing on the stage at the same time, a series of images in which a specific singer is always in the center of the image. When the viewer wants to view the scene, the optimum viewpoint or angle is automatically switched according to the program, so that the viewer can continuously watch the favorite singer's video without switching the viewpoint or angle. in this case,
By including a plurality of programs so that each of a plurality of singers can be selected and making the programs selectable, it is possible to respond to each user's preference and various video expressions are possible.

FIG. 1 shows an example of storing moving image data streams from a plurality of viewpoints on a recording medium such as a DVD.
FIG. 1 shows a data storage configuration in which the video data from the viewpoint A, the video data from the viewpoint B, and the video data from the viewpoint C are serially stored in units of a plurality of frames. For example, the video data A storage portion 101 stores frame data 0 to 120 as a captured image from the viewpoint A, and the video data B storage portion 102 stores frames 0 to 120 as a captured image from the viewpoint B. Then, the video data C storage portion 103 stores frames 0 to 120 as a captured image from the viewpoint C.

It is assumed that viewpoint switching is performed in the reproduction processing of a disc storing such multi-view image data. The viewpoint switching process will be described with reference to FIG. In FIG. 2, a video data A storage portion 1 in which frames 0 to 120 as captured images from a viewpoint A are stored
01 and frames 0 to 1 as captured images from the viewpoint B
20 shows the video data B storage portion 102 in which 20 is stored.

When the viewpoint switching processing request from the viewpoint A to the viewpoint B is input by the user during the reproduction of the viewpoint A of the frame 60 while the video data A is being reproduced, the reproducing head causes the frame 60 to reproduce. It is necessary to move from the data storage position 201 of the viewpoint A to the data storage position 202 of the viewpoint B of the frame 61. There is a physical distance between the data storage positions 201 to 202, and a moving time of the head, that is, a seek time is required according to the physical distance. Depending on the seek time and the decoding processing time of the data for the subsequent display processing, the data reproduction time of the frame 60 of the viewpoint A and the viewpoint B
The data reproduction time of the frame 61 is interrupted, that is, interrupted, and an unnatural moving image is presented to the viewer.

The relationship between the moving time (th) of the reproducing head, the data reading time (tr), and the processing for displaying data, for example, the decoding processing time (td), is 1 for video data.
Assuming that the frame rate as the frame display time is tf, viewpoint movement reproduction processing without interruption between frames is possible if Expression 1 below is satisfied.

[0012]

[Formula 1] tf> = th + tr + td (Equation 1)

As a conventional technique relating to a recording medium and a reproducing method for reproducing a multi-story and multi-angle video without interruption, for example, Japanese Patent Publication No. 2857 is available.
119 and 2857123. Each of these publications discloses a data recording structure for storing moving image data from a plurality of viewpoints on an optical disc and for shortening a seek time to different viewpoint image data in order to prevent interruption of video in the viewpoint switching processing. is doing. In these publications, video data from a plurality of viewpoints are mixed and recorded in an interleave block as one block area on a disc, and control information is provided in each interleave block so that a viewer can select a scene. In this case, the scene jump is performed based on the control information. The interleave block is set as one narrow area, the seek time is short, the time for switching processing between images with different viewpoints can be shortened, and switching between multi-story can be performed without interruption. .

That is, as shown in FIG. 3, a certain time interval (n
Interleave every frame) and arrange them alternately. At this time, the temporal length (value of n in FIG. 3) of each interleave block is determined so that (Equation 1) is satisfied. Furthermore, instead of allowing the video stream to be switched at an arbitrary position, by separating the interleave blocks only at a predetermined switchable position, the video can be switched without interruption.

However, the methods described in these publications set a predetermined viewpoint switchable processing portion,
Video data from a plurality of viewpoints is recorded only in the scene portion in an interleave block as one area on the disc, and no consideration is given to the correspondence to the viewpoint switching processing in an arbitrary scene. Further, the consideration of the decoding processing time when each data is encoded is not sufficient.

The technique described in the above publication is not applicable to the case where the user interactively freely moves the viewpoint at a desired time, and when the viewpoint switching process is performed at an arbitrary position, the conventional configuration is used. Similar to the above, a scene break will occur due to the viewpoint switching.

Moving image data stored in a storage medium such as a disk is usually stored with a reduced amount of data by an encoding (compression) process. In addition, the data transmitted via networks such as the Internet is also transmitted by reducing the data amount by encoding (compression) processing, and the encoded data is stored in a storage medium on the receiving side and decoded (decompression) processing at playback. Often run.

MPE is the most known method of image compression processing.
There is G (Moving Pictures Experts Group) compression technology. The MPEG stream generated by this MPEG compression is stored in a recording medium such as a DVD, or IP
Processing for storing the IP packet in accordance with (Internet Protocol) and transferring it on the Internet is performed.

MPEG is a technique for realizing high-quality image compression processing. The most used MPEG currently
The compression method of No. 2 is the compression using the correlation in the screen, which is Discrete Cosine Transform (DCT),
This is a compression method that combines motion compensation as compression based on correlation between screens and Huffman coding as compression based on correlation of code sequences. In MPEG2, in order to perform predictive coding using motion compensation, Picture, P-picture,
It has a GOP (Group Of Pictures) structure, which is a group consisting of a plurality of frames made up of three elements called B pictures.

When reproducing frame data consisting of such groups, group data, that is, GO
A P-unit decoding process is required. Therefore, in order to enable the smooth viewpoint movement by storing the multi-viewpoint image stream in the MPEG medium by compressing it, it is necessary to consider the decoding process in GOP units.

[0021]

SUMMARY OF THE INVENTION According to the present invention, in a configuration in which a multi-view image stream is subjected to compression processing to reproduce data stored in a storage medium such as a DVD, viewpoint switching at arbitrary timing causes a problem of video interruption. It is an object of the present invention to provide a data processing device, a data processing method, an information storage medium, and a computer program that can be performed without causing a problem.

[0022]

The first aspect of the present invention is as follows.
A data processing device for executing reproduction processing of multi-view image data, a storage means for encoding and storing a plurality of moving image data captured from different viewpoints, and a decoding means for decoding encoded data read from the storage means. A display unit for displaying the data decoded by the decoding unit; an input unit for inputting a viewpoint switching command for moving image data to be displayed on the display unit; and a viewpoint switching command from the input unit. Control means for deciding read data from the storage means, wherein the storage means stores each of the plurality of moving image data in units of encoded data blocks consisting of a plurality of frames, and switches by the viewpoint switching command. There is a discrepancy in the storage frames of encoded data blocks that correspond to multiple moving image data that are in the front-back relationship. The control means is configured to execute a read coded data block determination process based on a data read process and a data display process state at the time of detecting the input of the viewpoint switching command. A data processing device characterized by the above.

Further, in an embodiment of the data processing device of the present invention, the control means sets the remaining time required for the read processing of the coded data block being read from the storage means when the input of the viewpoint switching command is detected. , A total time of the subsequent one encoded data block read processing required time, a remaining frame display processing time of the display data block in the display means when the input of the viewpoint switching command is detected, and the encoded data block before and after the viewpoint switching. It is characterized in that the read coded data block determination process is performed by performing a comparison process with a total time of the frame display processing time corresponding to the storage frame shift amount of.

Further, in one embodiment of the data processing device of the present invention, the storage means is configured to compress each of the plurality of moving image data by MPEG and to store in GOP ((Group Of Pictures) units composed of a plurality of frames. It is characterized in that it has a configuration in which encoded data blocks are formed and stored.

Further, in one embodiment of the data processing apparatus of the present invention, the storage means sets each of the plurality of moving image data as an encoded data block composed of a plurality of frames, and a plurality of moving images from different viewpoints. It is characterized in that it has a configuration in which coded data blocks corresponding to image data are interleaved and arranged.

Further, in an embodiment of the data processing device of the present invention, the storage means stores each of the plurality of moving image data in units of encoded data blocks composed of a plurality of frames, and stores the plurality of moving image data according to the viewpoint switching command. The present invention is characterized in that a predetermined amount is a shift amount of a storage frame of encoded data blocks corresponding to a plurality of moving image data having a relationship before and after switching.

Further, in an embodiment of the data processing apparatus of the present invention, the shift amount is configured to be half the storage frame of the encoded data block.

Further, in one embodiment of the data processing device of the present invention, the control means determines the read coded data block based on the data read processing and the data display processing state when the input of the viewpoint switching command is detected. The present invention is characterized in that the processing is executed, and the image display stop processing before the viewpoint switching is executed based on the image display start after the viewpoint switching based on the viewpoint switching command.

Further, a second aspect of the present invention is a data processing method for executing reproduction processing of multi-view image data,
A decoding step of decoding the encoded data read from the storage means, a display step of displaying the data decoded in the decoding step, and a command input step of inputting a viewpoint switching command of the moving image data displayed in the display step. And a control step of determining read data from the storage means based on a viewpoint switching command from the command input step, wherein the storage means includes each of the plurality of moving image data in a plurality of frames. The encoded data blocks are stored in units of encoded data blocks, and the stored frames of the encoded data blocks corresponding to a plurality of moving image data before and after switching by the viewpoint switching command are stored with a shift, The control step is when the input of the viewpoint switching command is detected. Based on the definitive data read process and the data display processing state, in the data processing method and executes the determination processing of the read encoded data blocks.

Further, in an embodiment of the data processing method of the present invention, the control step includes a remaining time required for the read processing of the encoded data block being read from the storage means when the input of the viewpoint switching command is detected. , A total time of the subsequent one encoded data block read processing required time, a remaining frame display processing time of the display data block in the display means when the input of the viewpoint switching command is detected, and the encoded data block before and after the viewpoint switching. It is characterized in that the read coded data block determination process is executed by performing a comparison process with a total time of the frame display processing time corresponding to the storage frame shift amount of.

Further, in an embodiment of the data processing method of the present invention, the control step determines the read coded data block based on the data read processing and the data display processing state at the time of detecting the input of the viewpoint switching command. The processing is executed, and the image display stop processing before the viewpoint switching is executed based on the start of the image display after the viewpoint switching based on the viewpoint switching command.

Further, a third aspect of the present invention is an information storage medium in which a plurality of moving image data captured from different viewpoints are encoded and stored, and each of the plurality of moving image data captured from the different viewpoints is stored. Stored in units of encoded data blocks consisting of multiple frames, and at least storing the encoded data blocks corresponding to a plurality of moving image data that have a relationship before and after switching by the viewpoint switching command with a shift. An information storage medium characterized by having.

Furthermore, in an embodiment of the information storage medium of the present invention, the information storage medium is a GOP ((Group Of Pictures) unit formed by a plurality of frames by MPEG-compressing each of the plurality of moving image data. It is characterized by having a structure in which an encoded data block is formed and stored in.

Further, in one embodiment of the information storage medium of the present invention, the information storage medium uses each of the plurality of moving image data as an encoded data block composed of a plurality of frames, and a plurality of viewpoints from different viewpoints. It is characterized by having a configuration in which coded data blocks corresponding to moving image data are interleaved and arranged.

Further, in an embodiment of the information storage medium of the present invention, the information storage medium stores each of the plurality of moving image data in units of encoded data blocks composed of a plurality of frames, and the viewpoint switching command. The present invention is characterized in that a predetermined amount is a shift amount of a storage frame of encoded data blocks corresponding to a plurality of moving image data which has a relationship before and after switching by.

Further, in an embodiment of the information storage medium of the present invention, the shift amount is configured to be one half of the storage frame of the encoded data block.

Further, a fourth aspect of the present invention is a computer program for executing data processing for executing reproduction processing of multi-view image data, the decoding step for decoding coded data read from a storage means; Based on a display step of displaying the data decoded in the decoding step, a command input step of inputting a viewpoint switching command of the moving image data displayed in the display step, and a viewpoint switching command from the command input step, And a step of executing a read coded data block determination process based on a data read process and a data display process state when a command input is detected.

The computer program of the present invention is, for example, a storage medium or communication medium provided in a computer-readable format to a general-purpose computer system capable of executing various program codes, such as a CD or FD. , MO, etc., or a computer program that can be provided by a communication medium such as a network. By providing such a program in a computer-readable format, processing according to the program is realized on the computer system.

Further objects, features and advantages of the present invention are as follows.
It will be clarified by a more detailed description based on embodiments of the present invention described below and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to a device in which each configuration is provided in the same housing.

[0040]

FIG. 4 is a block diagram showing the configuration of an embodiment of the data processing apparatus of the present invention. The data processing apparatus according to the present embodiment reproduces multi-view image data stored in a recording medium such as a DVD or a CD, or multi-view image data distributed via a data communication network such as the Internet. It is stored in a writable storage medium such as a hard disk, and a process for reproducing the storage medium is executed.

The data to be reproduced in the system of the present invention is encoded data, and is reproduced on the display after the decoding process is executed. Therefore, the data processing device 450 shown in FIG. 4 has a codec 451 that executes a decoding process. In addition,
The configuration example shown in FIG. 4 has a video camera 433 and a microphone 43.
A codec 451 is also capable of encoding input data from an AV data input device such as a DVD 4, and the encoded data generated by the codec 451 is a DVD,
It has a writable structure for a CD, a hard disk, and the like.

The configuration of the data processing device 450 shown in FIG. 4 will be described. CPU (Central processing Unit) 4
56 is various application programs and OS (Op
erating system), which will be described later in detail in the system of the present invention, but the determination processing of the read data from the storage unit at the time of detecting the input of the viewpoint switching command input from the controller or the like. Alternatively, it functions as a control unit that executes control of display processing. The memory 457 is a ROM (Read-Only-Memor
y), a RAM (Random Access Memory), etc., and a storage area for storing a program executed by the CPU 456 or fixed data as a calculation parameter, a program executed in the processing of the CPU 456, and a parameter appropriately changed in the program processing. , Used as a work area. The recording medium 458 is DV
It is a recording medium such as a D, a hard disk, or a CD, and stores encoded data of multi-viewpoint images to be reproduced.

Further, the data processing device 450 has a network interface 452 which functions as an interface with a communication network, receives multi-view image coded data via the network, and the received data is a DVD or a hard disk. Recording media such as 4
58. Alternatively, unencoded data is received, the received data is encoded by the codec 451, and the generated encoded data is stored in the recording medium 458 such as a DVD, a CD, a hard disk.

A data processing command from the user or a viewpoint switching command for display image data on the display 432 is input through the input interface 453 from various input devices such as the mouse 437, the keyboard 436, and the controller 438. Data input from the AV data input device such as the video camera 433 and the microphone 434 via the AV interface 454 is encoded (MPEG) by the codec 451 and stored in the recording medium 458 such as a DVD or a hard disk.

The coded data stored in the recording medium 458 such as a DVD or a hard disk is the codec 451.
The decoding process is executed in step S1, and the image data is stored in the frame memory 461 on a frame-by-frame basis, and after the conversion process via the D / A converter 462, the display 432 is performed.
Is displayed in. On the other hand, the audio data is also decoded by the codec, stored in the audio buffer 463, converted by the D / A converter 464, and then reproduced and output by the speaker 435.

One of the reproduction processing target data in the data processing device 450 of the present embodiment is the compressed data of the multi-viewpoint moving image data, which is the MPEG compressed image data known as the technique for realizing the high quality image compression processing. is there. The compression method of MPEG2 is the Discrete Cosine Transform (DCT) which is a compression using the correlation in the screen, the motion compensation as the compression based on the correlation between the screens, and the Huffman code as the compression based on the correlation of the code strings. This is a compression method that combines the encoding. In MPEG2, in order to perform predictive coding using motion compensation, image frames forming a moving image are classified into three elements called I picture, P picture, and B picture as shown in FIG. I picture, P
A GOP (Group Of Pictures) structure is adopted as a group consisting of picture and B picture frames.

An I picture (Intra coded image) is an image frame data which is created by intra-field coding and is not subjected to predictive coding from the previous image. If only images created using predictive coding are lined up, when random access is performed, the screen cannot be instantly displayed accordingly. Therefore, we make a standard for access regularly so that we can deal with random access. The I-picture exists because it has GOP independence.

The frequency of appearance of I-pictures is determined by the performance of random access required for each application, but normally one picture per field (1
The ratio is 2 per frame), that is, 1 per 15 images. The amount of data for one I picture is 2 for one P picture.
.About.3 times, which corresponds to 5 times to 6 times that of one B picture. GOP
Is a group of pictures between one I picture and the next I picture. Therefore, image prediction is performed between the pictures in this group.

P picture (Predictive coded image) is
An image created by performing predictive coding from the previous image,
It is created based on the I picture. The P picture is defined as an “inter-frame quasi-directional predictive coded image” as opposed to the I picture which is an “intra-frame coded image”.

B picture (Bidirectionally predictive
A coded image) is a “bidirectional predictive coded image”. B
The picture is created by performing prediction from the two preceding and following I picture or P picture.

The data processing apparatus of the present invention is configured to execute the reproduction processing of MPEG compressed data of moving image data taken from a plurality of different viewpoints. For example, as shown in FIG. 6, a DVD in which MPEG compressed data is stored for captured images from three different viewpoints A to C, respectively.
The data is read from the recording medium such as the above, the decoding process is executed, and the reproduction process of the decoded data is executed.

In a temporally continuous compression method such as MPEG, temporally consecutive image blocks, that is,
Since it is necessary to collectively read and decode in GOP units as a frame group composed of a plurality of frames as described above, it is difficult to instantaneously switch to another viewpoint within the block. Data reading, decoding processing, and reproduction processing are performed in GOP units, and if the switching timing to each viewpoint is performed at frame delimiters in GOP units, seamless viewpoint switching processing is possible, but in GOP units. If an attempt is made to switch the viewpoint in a frame other than the frame delimiter, the display image is interrupted due to the processing time problem.

The interruption of the reproduced image will be described with reference to FIG. It is assumed that the moving image data of the two viewpoints A and B is processed for each GOP of 15 frames. It is assumed that the viewpoint A is switched to the viewpoint B in a frame other than a frame delimiter in GOP units. During reproduction of frames 15 to 29 of viewpoint A in FIG. 7, for example, in frame 20, the user views viewpoint A to viewpoint B.
When the viewpoint switching processing command to the input is input from the input device such as the controller, the decoding processing data of the frames 15 to 29 of the viewpoint B to be reproduced is not generated, and the decoding processing is sequentially performed from the GOP start frame. View B, which is data that is necessary as playback data, because it is executed
It takes a long processing time to display the frame 21. As a result, discontinuity of the reproduced image occurs as shown in the figure.

In the example of FIG. 7, GO in units of 15 frames
GO for each P by executing data read, decryption, and display processing
Letting T be the time required to display the start frame of P, the user issues a viewpoint switching processing command from viewpoint A to viewpoint B in frame 20 during reproduction of frames 15 to 29 of viewpoint A and an input device such as a controller. When input from, the frames 15 to 2 of the viewpoint B to be reproduced are
Time required until the frame 15 of the viewpoint B becomes reproducible by the decoding process of 9: T, and further, decoding is performed sequentially from the frame 15 and time until the frame 21 of the viewpoint B becomes reproducible: α will be required. As a result, T + α is required as the time from the input of the viewpoint switching command until the reproduction of the frame 21 of the viewpoint B becomes possible, and the reproduced image is interrupted as shown in the figure.

FIG. 8 shows an example of the storage configuration of the two viewpoint images on the disc. In MPEG2, as described above, G
Encoding is performed in OP units. FIG. 8 shows an example in which 12 frames are used as a unit of GOP. In FIG. 8, Cam01 is the camera 01 and Cam02 is the camera 02.
Block001 indicates GOP block 0.
01, and [cam01 0000
(I)] is the frame 0 captured by the camera 01.
000 encoded data and an I picture. (P) is a P picture, and (B) is a B picture.

[Header001] is header information set for each GOP block. [Audi
o01 0000-0011] indicates audio data reproduced corresponding to the image data of each block.

Here, as shown in FIG. 8, it is assumed that the image of the camera 01 is displayed from the 0000th frame to the 0005th frame, and the image of the camera 02 is displayed in the 0006th frame. The image data of each camera is subjected to MPEG2 encoding processing with 12 frames as a GOP unit.

Therefore, even if an attempt is made to display from the 0006th frame of the camera 02, since MPEG2 is compressed in the time axis direction, the GOP to which the 0006th frame of the camera 02 belongs, that is, [Cam02, Block].
It is necessary to decode in GOP units of [0001]. Also,
The decoding process is sequentially executed from the frame 0000 in the decoding of [Cam02, Block0001], and it takes a processing time to display the 0006th frame of the camera 02, which is originally necessary as reproduction data. .

If the unit of GOP is set as a small number of frames, the degree of freedom of moving the viewpoint is increased without inevitably reading extra data or decoding extra data. FIG. 9 shows an example in which the GOP unit is set as a small frame unit. The example of FIG. 9 is an example in which GOP is set in units of 6 frames. However, if the unit of GOP is made small and reading and decoding are possible in that unit, it is necessary to add voice and management information to each GOP, which is redundant.

Therefore, in the configuration of the present invention, FIG.
As shown in, instead of reducing the unit of GOP,
The start frame number of the GOP corresponding to the encoded data block for each viewpoint camera image is changed.
In the example shown in FIG. 10, the first GOP of the encoded data block of the viewpoint A image of the camera 01 has a 12-frame structure that starts from the 0000th frame and ends at the 0011th frame. The first GOP of the encoded data is composed of 12 frames starting from the 0006th frame and ending at the 0017th frame. That is, it has a configuration in which the storage frames of the encoded data blocks corresponding to a plurality of moving image data before and after the switching by the viewpoint switching command are stored with a shift.

Viewpoint A image coded data of camera 01,
The GOP of the viewpoint B image encoded data of the camera 02 is composed of frames that are shifted by 6 frames. Ie G
This means that the GOP start is shifted between the cameras by 1/2 of the OP frame length (12 frames). Although only two cameras are shown here, when the number of cameras is three or more, the camera 3 starts from the same start frame number as the camera 1 and the camera 4 starts from the same frame as the camera 2 so that each camera can be started. By alternately arranging in the time axis direction, the viewpoints are continuously moved between a plurality of cameras, that is, even when the viewpoints are moved in the order of camera 1 → camera 2 → camera 3 → camera 4 → camera 1,
GOP length is shortened and image quality is not deteriorated.
It becomes possible to perform processing in a small time interval that is 1/2 the OP length. These examples will be described later.

FIG. 11 shows the storage configuration of the image data from the two different viewpoints shown in FIG. 10 on the disc. Figure 1
In 1, the [Cam01] is the camera 01 and the [Cam02] is
Indicates that the moving image data is captured by the camera 02 at a viewpoint position different from that of the camera 01.
001 is each coded data block, here 1
It is composed of two frames of GOP. [Cam01
0000 (I)] is the encoded frame data of frame 0000 captured by camera 01, and I
It indicates that it is a picture. (P) is a P picture, and (B) is a picture. [Header001]
Is header information set for each GOP block. [Audio01 0000-0011] indicates audio data reproduced corresponding to the image data of each block. As shown in FIG. 11, each of a plurality of moving image data from different viewpoints is an encoded data block composed of a plurality of frames, and an encoded data block corresponding to a plurality of moving image data from different viewpoints. Are interleaved and stored on the disk as a configuration.

Here, as shown in FIG. 11, it is assumed that the image of the camera 01 is displayed from the 0000th frame to the 0005th frame, and the image of the camera 02 is displayed in the 0006th frame. The image data of each camera is subjected to MPEG2 encoding processing with 12 frames as a GOP unit, but the image of the camera 01 and the image of the camera 02 have a GOP structure which is shifted by 6 frames.

Therefore, when an attempt is made to display from the 0006th frame of the camera 02, the 0006th frame of the camera 02 is displayed.
The GOP to which the frame belongs, namely [Cam02,
When decoding the encoded data block of Block 001] in GOP units, since the GOP as the first encoded data block of the viewpoint B image encoded data of the camera 02 starts from the 0006th frame, the viewpoint switching request causes The time until the 0006th frame decoding of the viewpoint B image encoded data of the camera 02 is completed is shortened. As a result, it is possible to perform a smooth viewpoint switching process without causing a break in the reproduced image. Since the physical positions of the data storage distances are close to each other, the seek time of the read head can be shortened.

A specific example of data reading, decoding, and reproduction processing from a disk storing image data from two different viewpoints shown in FIGS. 10 and 11 will be described with reference to the time chart of FIG.

The time chart of FIG. 12 shows the passage of time in the right direction as shown on the time axis at the bottom, the upper part (a) shows the decoding and display processing time of each frame in the display, and the middle part of the time chart. (B) shows the read processing timing of GOP as each encoded data block stored in the disk. After the GOP as each encoded data block in the middle row (b) is read out, the decoding and display processing in the upper row (a) is started.

In the processing example of FIG. 12, the following preconditions are set. The display time for one frame is 33 ms. One encoded data block is composed of images of 12 frames (for displaying processing of 12 frames, there are 396
ms). A coded data block (GOP) set as coded data between adjacent cameras has a start offset by 6 frames. It is assumed that 300 ms is required to read the data of one block. For safety, buffer one block of data. The user presses the viewpoint change switch only once

The horizontal axis of FIG. 12 is time. First, time t =
At 0, the data of the 001th block of the camera 01 is read. After the reading of the 001th block of the camera 01 is completed at t = 300 ms, the data of the 002st block of the camera 01 is read. When these are completed at t = 600 ms, the decoding process and the display process start. At the same time, the reading process of the 003rd block of the camera 01 is executed in parallel.

When the decoding process and the display process are proceeding smoothly, the user presses the switch for moving the camera viewpoint at t = 1.1 s, and the camera viewpoint of the display image is switched from the image of camera 01 to the image of camera 02. Suppose a request is entered. At this key input timing, as understood from the figure, the GOP encoded data of the camera 01 block 004 is being read. If this reading is not completed, the camera 02 requested by the user
The image data of cannot be read.

Here, it is necessary to perform processing for determining which frame of the camera 02 in which GOP data should be read. When the viewpoint switching input is made, the camera 01 block 004, that is, the frame number 00
36-0047 is being read. Considering the processing time, the safest is the camera 02 block 004,
That is, the GOP block of the camera 02 including the frame numbers 0042-0053 is read next, and the camera 01
The reproduction of the block 004 is interrupted at 0041 frames, and the image reproduction of the camera 02 is started.

However, in this case, it takes a long time until the camera is switched after the viewpoint switching switch is pressed by the user. Therefore, as shown in the figure, the camera 02 block 003, that is, the frame numbers 0030-004
1 is stored in the encoded data block of the camera 02 (GO
P) is read out next, and the camera 01 block 003
After the reproduction of the frame numbers 0024-0035 that belong to the
Block 003, that is, frame number 0030-0
A determination process is performed as to whether or not it is possible to switch to playback of 041. The determination process is executed by the CPU 456 as the control unit shown in FIG. The determination process will be described below.

Display time per frame: t (ds
p) = 0.033s Time when the viewpoint change switch is pressed: t (s
w) = 1.1 s Expected remaining read time of the coded data block read when the viewpoint change switch is pressed: t (r
dend) = 0.15s The number of display remaining frames of the coded data block displayed when the viewpoint change switch is pressed: f (res
t) = 9 Expected read time of the encoded data block: t (bl
k) = 0.3s Frame shift amount of GOP at the switching viewpoint: f (ab) =
When it is set to 6, it is determined whether the following expression 2 is satisfied.

[0073]

[Equation 2]     t (rdend) + t (blk)     <(F (rest) + f (ab)) × t (dsp) (Equation 2)

In the above expression 2, the left side shows the total time of the remaining time required for reading the coded data block during the reading at the time the viewpoint change switch is pressed and the reading time of one block after that, and the right side. Shows the total time of the display time of the remaining frames of the display block at the time when the viewpoint changeover switch is pressed and the display time of the frame corresponding to the frame shift amount of the coded data block (GOP) of the changeover viewpoint. If the condition shown in Equation 2 above is satisfied, the frame number 003 of the camera 02 block 003
0-0041 is read out next, the reproduction of the frame numbers 0024-0035 of the camera 01 block 003 is performed only by the frame numbers 0024-0029, and then the camera 0
It is possible to switch to 2 and execute the reproduction of the frame numbers 0030-0041 of the camera 02 block 003.

When the value based on the above condition is put into the above equation 2 to calculate, it becomes 0.15 + 0.3 <(9 + 6) × 0.033, the left side = 0.45s, and the time when the switch is pressed is If it is 1.1 s, it can be predicted that the reading of the camera 02 block 003 will be completed at time 1.55 s. The right side of the above equation 2 is (9 + 6) × 0.033
= 0.495, and the time when the switch was pressed is 1.1
Therefore, the display is switched at time 1.595 s.

Therefore, 0.33 <0.495 holds,
It is concluded that the data can be prepared before the display switching based on the determination result of applying the expression 2. At this time, the data of the camera 01 block 004 already read may be discarded.

Actually, the expected read time of the disc is
Since it depends on the position on the disk and the seek amount, it is necessary to find the expected access time that includes these parameters. It is also necessary to consider the decoding processing time for each frame in the block.

In the example shown in FIG. 12, there are only two different viewpoint image data, and the user inputs the viewpoint switching command only once. Referring to FIG. 14, in a reproducing process from a disc having a data storage structure in which five different viewpoint image data are encoded data blocks (GOP), a viewpoint switching command input by a user is continuously executed. The processing will be described.

FIG. 13 shows a data storage structure in which five different viewpoint image data are coded data blocks (GOP). In the example shown in FIG. 13, the first encoded data block (GOP) of the encoded data of the viewpoint A image of the camera 01, the encoded data of the viewpoint C image of the camera 03, and the encoded data of the viewpoint E image of the camera 05 is , Starts at the 0000th frame and ends at the 0011th frame 1
Although it has a two-frame structure, the first GOP of the encoded data block of the viewpoint B image of the camera 02 and the encoded data block of the viewpoint D image of the camera 04 starts with the 0006th frame and ends with the 12th frame. Composed.

The viewpoint image coded data of the camera 01, the camera 03, and the camera 05 and the viewpoint image coded data block (GOP) of the camera 02, camera 04 are composed of frames that are shifted by 6 frames. That is, the start frames of the coded data block (GOP) are deviated between the respective cameras by 1/2 of the storage frame length (12 frames) of the coded data block (GOP).

Referring to FIG. 14, with respect to the data stored as a coded data block (GOP) having the frame shift of the five different viewpoint image data shown in FIG.
The processing when the user continuously inputs the viewpoint change switch will be described. Camera 01 → Camera 0 by input of viewpoint switch by user
2 → camera 03 → camera 04 → camera 05 → camera 01
Shall be switched in this order. Note that the viewpoint switching switch by the user is processed as an intermittent continuous command for each Δt when the switch of the controller is continuously kept in the ON state, as shown in FIG.
It is recognized as inputs (a) to (d) at predetermined intervals Δt.

In the example of FIG. 14, the viewpoint switching switch (a) is pressed by the user at time 1.1 s, and then the switch is continuously turned on until time 1.7 s, and the input (a) is output at predetermined intervals Δt. ) To (d) will be described. As described above with reference to FIG. 12, the first viewpoint switching command (a)
Accordingly, the camera 02 block 003 is read out and the displayed image is displayed on the display screen of the frame 0024-0029 of the block 003 of the camera 01, and then the frame 0030-of the block 003 of the camera 02 of the camera 02. It is possible to switch to the display of, and this switching process is executed.

Further, when the input of the viewpoint switching command (b) by the user is detected during the reading process of the block 003 of the camera 02, the data reading of the block 003 of the camera 02 is not performed for the entire block, After reading frames up to the frame numbers 0030 to 0035 in the first half of the GOP block of the block 003 of the camera 02, from the first half of the image block of the block 003 of the camera 03 which is the viewpoint movement destination data by the viewpoint switching command (b) by the user. Start the reading process.

Further, when the input of the viewpoint switching command (c) by the user is detected during the reading process of the image block of the block 003 of the camera 03, the camera which is the viewpoint moving destination data by the viewpoint switching command (c) by the user. The reading process from the first half of the image block of block 004 of 04 is started. Furthermore, camera 0
When the input of the viewpoint switching command (d) by the user is detected during the execution of the image block reading process of the block 004 of No. 4, the image of the block 005 of the camera 05, which is the viewpoint movement destination data by the viewpoint switching command (d) by the user. The reading process from the first half of the block is started.

The above processing makes it possible to continuously move the viewpoint between cameras. If the user does not detect the input of the viewpoint changeover switch while reading the encoded block data, that is, if the user releases the viewpoint changeover switch such as the controller, the next read block does not read only 1/2. The entire block will be read. As a result, camera 05
The image block read processing of block 005 is executed as the read processing of the entire frame data (f: 0048-0059). The data read control and the data display control are executed under the control of the CPU 456 as the control means shown in FIG.

It should be noted that GO configured by MPEG compression
In P, not only frame image data from each picture of I, B, and P but also audio data (Audio) may be stored as shown in the data structure of FIG. 11 described above. In this case, Even if only the first half frame of each camera video block is read out, the audio data of the entire block is attached. Therefore, even if by any chance the data block is delayed from the expected read time and the image temporarily stops,
Only the audio data can be continuously output (only for 6 frames).

Therefore, the configuration in which the storage frames of the blocks of the respective viewpoint image data are displaced as in the present configuration is the audio in the case where the predicted read time fluctuates in the image switching process between the adjacent cameras. This also brings about an effect of reducing the possibility of output stoppage.

FIG. 15 shows the storage configuration of image data from three different viewpoints on the disc. In FIG. 15, [C
am01] is camera 01, [Cam02] is camera 0
2, [Cam03] indicates that it is moving image data captured by the camera 03, and [Block001]
Indicates that the GOP block is 001,
[Cam01 0000 (I)] indicates that it is the encoded data of the frame 0000 captured by the camera 01 and that it is an I picture. (P) is a P picture, and (B) is a B picture. [Header00
1] is header information set for each GOP block. [Audio01 0000-0011]
Indicates audio data reproduced corresponding to the image data of each block.

In the configuration of FIG. 15, one coded data block (GOP) unit has a 12-frame configuration, and the first GOP of the coded data of the viewpoint image of camera 01 and the coded data of the viewpoint image of camera 03 is The 12-frame structure starts from the 0000th frame and ends at the 0011th frame, but the first GOP of the encoded data of the viewpoint image of the camera 02 is composed of 12 frames starting from the 0006th frame and ending at the 0017th frame. The following is an example in which the GOP structure is similarly shifted by 6 frames.

Thus, the GOPs of the viewpoint image coded data of the cameras 01 and 03 and the GOP of the viewpoint image coded data of the camera 02 are composed of frames that are shifted by 6 frames, so that camera 01 → camera 02 → camera 0
The switching process in the order of 3 → camera 01 is smoothly executed.

FIG. 16 shows a configuration in which image data from three different viewpoints are similarly stored in the disk, but an example in which the GOP is in units of 6 frames is shown. Also in FIG. 16, C
am01 is camera 01, Cam02 is camera 02, Ca
Although m03 indicates moving image data captured by the camera 03, two GOPs exist in one encoded data block. That is, two 6-frame GOPs are stored in one block and one 12-frame
It is structured as a block.

When data is stored according to the configuration shown in FIG. 16, an I picture is included in each GOP consisting of 6 frames in the first half and the second half of each block, and the read process of only the second half frame of one block is performed. Even if the above is performed, highly accurate decoding is possible.

Next, with reference to FIG. 17, a processing procedure for decoding and reproducing data stored in GOP units in the data processing apparatus of the present invention will be described.

First, in step S101, an encoded data block storing image data from a viewpoint designated by a user or a preset preset viewpoint is read. In step S102,
It is determined whether or not a viewpoint switching command has been input. If no command has been input, the process proceeds to step S105, and decoding processing of the read viewpoint image encoded data block is performed.
Display processing is executed.

If it is determined in step S102 that the viewpoint switching command has been input, the process proceeds to step S103, and the read block determination processing after viewpoint switching is executed. This processing is executed as the determination processing using the equation 2 described above, and the viewpoint switching command has the following values when the input is detected, the display time per frame: t (dsp), and the viewpoint switching switch is pressed. Time of day: t (s
w), the expected remaining read time of the data block being read when the viewpoint switch is pressed: t (rden
d), the number of remaining display frames of the data block displayed when the viewpoint change switch is pressed: f (rest), expected read time of the data block: t (blk), frame of the coded data block of the change viewpoint Based on the shift amount: f (ab), the calculation is performed by applying the above-described Expression 2.

In step S104, step S103
As a result of the determination processing in step S1, the selected code or block after switching the viewpoint is read out, and the process proceeds to step S105 to execute the decoding and display of the read out viewpoint image encoded data block.

By executing the above processing, the reading, decoding, and reproducing processing from the storage medium such as the DVD in which the multi-viewpoint image data is stored as the encoded data can be smoothly performed without causing the image display interruption. To be done.

In the embodiment described above, the camera 01 →
Although a configuration example in which the viewpoints are switched by setting the order of camera 02 → camera 03 → camera 01 has been shown, for example, by adopting the block configuration shown in FIG. 18, the viewpoint switching order is not set and the viewpoints are randomly selected. A smooth display is possible even when moving.

In the example shown in FIG. 18, the encoded data blocks of the viewpoint A image of the camera 01 are stored as two streams in a storage medium such as a disk. One starts at the 0000th frame and ends at the 0011th frame 1
It has a 2-frame structure, and the other is composed of 12 frames starting from the 0006th frame and ending at the 0017th frame. Similarly, the encoded data of the viewpoint B image of the camera 02 and the encoded data of the viewpoint C image of the camera 03 similarly have a 12-frame structure starting from the 0000th frame and ending at the 0011th frame, and starting from the 0006th frame. The encoded data block consisting of 12 frames ending at the 0017th frame is stored on the disc.

With this configuration, not only when the viewpoints are switched by setting the order of camera 01 → camera 02 → camera 03 → camera 01, but also camera 01 → camera 03 → camera 02 → camera 01. Even when random viewpoint switching is performed as described above, the time required for the switching processing can be shortened, and smooth image display without discontinuity of images at the time of viewpoint switching becomes possible.

The series of processes described in the specification can be executed by hardware, software, or a combined configuration of both. When executing the processing by software, the program recording the processing sequence is installed in the memory in the computer incorporated in the dedicated hardware and executed, or the program is stored in a general-purpose computer capable of executing various processing. It can be installed and run.

For example, the program can be recorded in advance in a hard disk or a ROM (Read Only Memory) as a recording medium. Alternatively, the program may be a floppy (registered trademark) disc or a CD-ROM (Compact Disc).
Read Only Memory), MO (Magneto optical) disk,
It can be temporarily or permanently stored (recorded) in a removable recording medium such as a DVD (Digital Versatile Disc), a magnetic disk, or a semiconductor memory. Such a removable recording medium can be provided as so-called package software.

The program is installed in the computer from the removable recording medium as described above, is wirelessly transferred from the download site to the computer, or is wired to the computer via a network such as LAN (Local Area Network) or the Internet. Then, the computer can receive the program thus transferred and install it in a recording medium such as a built-in hard disk.

The various processes described in the specification are
The processing may be executed not only in time series according to the description, but also in parallel or individually according to the processing capability of the device that executes the processing or the need. Further, the system in the present specification is a logical set configuration of a plurality of devices,
The devices of the respective configurations are not limited to being in the same housing.

The present invention has been described in detail above with reference to the specific embodiments. However, it is obvious that those skilled in the art can modify or substitute the embodiments without departing from the scope of the present invention. That is, the present invention has been disclosed in the form of exemplification, and should not be limitedly interpreted. In order to determine the gist of the present invention, the section of the claims described at the beginning should be taken into consideration.

[0106]

As described above, according to the data processing device, the data processing method, and the information storage medium of the present invention, the data reading and decoding from the medium in which the image data from a plurality of viewpoints are encoded and stored. In the configuration for executing the reproduction process, the determination of the reproducible block data after the viewpoint switching is surely executed from the generation of the viewpoint switching request, and the error occurrence such as the interruption of the display image due to the viewpoint switching is prevented. It becomes possible.

Further, according to the data processing device, the data processing method, and the information storage medium of the present invention, the coded data blocks from different viewpoints are composed of frame data having a shift and stored in a storage medium such as a DVD. Since the configuration is adopted, when the data reading from the medium, the decoding, and the reproduction processing are executed, the time from the generation of the switching request to the reproduction of the block data after the reproducible viewpoint switching can be shortened, and a higher speed can be achieved. It is possible to display a viewpoint switching image.

[Brief description of drawings]

FIG. 1 is a diagram illustrating a disk storage configuration of conventional multi-view image data.

FIG. 2 is a diagram illustrating a seek time in a conventional reproduction process of multi-view image data from a disc.

FIG. 3 is a diagram illustrating a seek time in a conventional reproduction process of multi-view image data from a disc.

FIG. 4 is a diagram showing a configuration of a data processing device of the present invention.

FIG. 5 is a diagram illustrating a structure of MPEG image data.

FIG. 6 is a diagram illustrating the structure of MPEG image data in a multi-view image.

FIG. 7: Decoding of encoded image data in a multi-view image,
It is a figure explaining the occurrence of the discontinuity of the image in reproduction processing.

FIG. 8 is a diagram illustrating a disc storage configuration example of MPEG image data in a multi-view image.

FIG. 9 is a diagram illustrating a disc storage configuration example of MPEG image data in a multi-view image.

FIG. 10 is a diagram illustrating a configuration example of a coded data block of a multi-viewpoint image in the configuration of the present invention.

FIG. 11 is a diagram illustrating an example of a disk storage configuration of encoded data blocks of a multi-view image in the configuration of the present invention.

FIG. 12 is a diagram illustrating a reproduction processing sequence of a coded data block of a multi-view image in the configuration of the present invention.

FIG. 13 is a diagram illustrating a configuration example of a coded data block of a multi-view image in the configuration of the present invention.

FIG. 14 is a diagram illustrating a reproduction processing sequence of a coded data block of a multi-view image in the configuration of the present invention.

[Fig. 15] Fig. 15 is a diagram for describing a disk storage configuration example of encoded data blocks of a multi-view image in the configuration of the present invention.

[Fig. 16] Fig. 16 is a diagram for describing a disk storage configuration example of encoded data blocks of a multi-view image in the configuration of the present invention.

FIG. 17 is a processing flow diagram of the data processing apparatus according to the present invention for executing reproduction of a coded data block of a multi-view image.

FIG. 18 is a diagram illustrating a configuration example of a coded data block of a multi-view image in the configuration of the present invention.

[Explanation of symbols]

101, 102, 103 video data 301-304 video data 432 display 433 video camera 434 microphone 435 speaker 436 keyboard 437 mouse 438 controller 450 data processor 451 codec 452 network interface 453 input interface 454 AV interface 456 CPU 457 memory 458 recording media 461 frame memory 462 D / A converter 463 audio buffer 464 D / A converter

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 5C052 AA01 AB03 CC11 DD04                 5C053 FA23 GB01 GB06 GB11 GB37                       JA01 KA04 KA24 KA25 LA01                       LA06                 5D044 AB07 BC01 BC04 CC04 DE14                       DE37 FG10 GK08

Claims (16)

[Claims] 1. A data processing device for executing reproduction processing of multi-view image data, comprising: storage means for encoding and storing a plurality of moving image data captured from different viewpoints; and encoded data read from the storage means. Decoding means, a display means for displaying the data decoded by the decoding means, an input means for inputting a viewpoint switching command of moving image data displayed on the display means, and a viewpoint switching command from the input means. On the basis of,
And a control unit that determines read data from the storage unit, wherein the storage unit stores each of the plurality of moving image data in units of encoded data blocks including a plurality of frames,
And a configuration in which the storage frames of the coded data blocks corresponding to a plurality of moving image data that have a relationship before and after switching by the viewpoint switching command are stored with a shift, and the control unit is configured to store the viewpoint switching command. A data processing device having a configuration for executing a read coded data block determination process based on a data read process and a data display process state when an input is detected. 2. The control means has a remaining time required for the read processing of the encoded data block being read from the storage means at the time of detecting the input of the viewpoint switching command, and a required time for the subsequent one encoded data block read processing. , The remaining frame display processing time of the display data block in the display unit at the time of detecting the input of the viewpoint switching command, and the frame display processing time corresponding to the stored frame shift amount of the encoded data block before and after the viewpoint switching. 2. The data processing apparatus according to claim 1, wherein the data processing apparatus has a configuration for executing the determination processing of the read coded data block by performing the comparison processing of: 3. The storage means has a structure in which each of the plurality of moving image data is MPEG-compressed to form and store a coded data block in units of GOP ((Group Of Pictures)) formed of a plurality of frames. The data processing device according to claim 1, further comprising: 4. The storage means sets each of the plurality of moving image data as an encoded data block composed of a plurality of frames, and interleaves the encoded data blocks corresponding to the plurality of moving image data from different viewpoints. The data processing apparatus according to claim 1, wherein the data processing apparatus has a configuration in which the data processing apparatus is arranged. 5. The storage means stores each of the plurality of moving image data in units of encoded data blocks composed of a plurality of frames, and stores the plurality of moving image data in a relationship before and after switching by the viewpoint switching command. The data processing device according to claim 1, wherein the data processing device has a configuration in which a shift amount of a storage frame of a corresponding encoded data block is set to a predetermined amount. 6. The data processing apparatus according to claim 5, wherein the shift amount has a configuration of ½ of a storage frame of the encoded data block. 7. The control means executes a read coded data block determination process based on a data read process and a data display process state when an input of the view point change command is detected, and also based on the view point change command. The data processing apparatus according to claim 1, wherein the data processing apparatus has a configuration for executing the image display stop processing before the viewpoint switching based on the image display start after the viewpoint switching. 8. A data processing method for executing reproduction processing of multi-view image data, comprising a decoding step of decoding encoded data read from a storage means, and a display step of displaying the data decoded in the decoding step. A command input step of inputting a viewpoint switching command of the moving image data displayed in the display step, and a control step of determining read data from the storage means based on the viewpoint switching command from the command input step. Comprising, the storage means stores each of the plurality of moving image data in units of encoded data blocks composed of a plurality of frames,
And a configuration in which the storage frames of the encoded data blocks corresponding to a plurality of moving image data that have a relationship before and after switching by the viewpoint switching command are stored with a shift, and the control step includes A data processing method, characterized in that a read coded data block determination process is executed based on a data read process and a data display process state when an input is detected. 9. The control step comprises the remaining time required for the read processing of the encoded data block being read from the storage means at the time of detecting the input of the viewpoint switching command, and the time required for the subsequent one encoded data block read processing. , The remaining frame display processing time of the display data block in the display unit at the time of detecting the input of the viewpoint switching command, and the frame display processing time corresponding to the stored frame shift amount of the encoded data block before and after the viewpoint switching. 9. The data processing method according to claim 8, wherein the read coded data block determination process is executed by executing a comparison process of the total time of 10. The control step executes a read coded data block determination process based on a data read process and a data display process state at the time of detecting an input of the view point change command, and based on the view point change command. 9. The data processing method according to claim 8, wherein the image display stop processing before the viewpoint switching is executed based on the start of the image display after the viewpoint switching. 11. An information storage medium in which a plurality of moving image data captured from different viewpoints are encoded and stored, and each of the plurality of moving image data captured from different viewpoints is an encoded data block unit composed of a plurality of frames. And an information storage medium having a configuration in which the storage frames of encoded data blocks corresponding to a plurality of moving image data having a relationship before and after switching by a viewpoint switching command are stored with a shift. . 12. The information storage medium has a structure in which each of the plurality of moving image data is MPEG-compressed to form and store a coded data block in units of GOP ((Group Of Pictures)) formed of a plurality of frames. The information storage medium according to claim 11, further comprising: 13. The information storage medium uses each of the plurality of moving image data as an encoded data block composed of a plurality of frames, and interleaves encoded data blocks corresponding to the plurality of moving image data from different viewpoints. The information storage medium according to claim 11, wherein the information storage medium has a configuration in which the information storage medium is arranged. 14. The information storage medium stores each of the plurality of moving image data in units of encoded data blocks composed of a plurality of frames, and stores a plurality of moving image data in a relationship before and after switching by a viewpoint switching command. The information storage medium according to claim 11, wherein the information storage medium has a configuration in which a shift amount of a storage frame of a corresponding encoded data block is set to a predetermined amount. 15. The data processing apparatus according to claim 14, wherein the shift amount has a configuration of ½ of a storage frame of the encoded data block. 16. A computer program for executing data processing for executing reproduction processing of multi-view image data, comprising a decoding step of decoding encoded data read from a storage means, and displaying the data decoded in the decoding step. Display step, a command input step for inputting a viewpoint switching command of the moving image data displayed in the display step, and a data reading process at the time of detecting the input of the command based on the viewpoint switching command from the command input step And a step of executing a read coded data block determination process based on a data display process state, a computer program.