JP2012222399A - Video playback system, video playback method, and video playback device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a free movement of a focused zone and scaling thereof for multiple screens within a single large panoramic video, and realize a temporal synchronization of a focused zone in multiple screens within the single large panoramic video.SOLUTION: A video playback system includes control means that determines whether panoramic free viewpoint video data to be displayed is retained by a common reception buffer when an operation to change a view point is performed by operation means, and reads the panoramic free viewpoint video data to be displayed, from the common reception buffer, if the data is retained, to output the read data to decoding means synchronously with panoramic free viewpoint video data of another zone, while, obtaining panoramic free viewpoint video data to be displayed, from a panoramic free viewpoint video server, if the data is not retained, to output the read date to the decoding means synchronously with panoramic free viewpoint video data of another zone.

Description

  The present invention relates to a video playback system, a video playback method, and a video playback device that display a plurality of free viewpoint videos and time-synchronize a multi-screen gaze area in an apparatus that connects to a network and plays back panoramic video information from a server. And programs.

  Conventionally, one screen standard H.264 corresponding to one high-definition video. A technique for transmitting H.264 video information via a network is known (see, for example, Non-Patent Document 1).

“Global Deployment of Hi-Vision Transmission System IP-9500”, Fujitsu, 2009.01, Vol. 60, pages 69-75

  However, in the technique described in Non-Patent Document 1, when a plurality of display devices are arranged in a panorama, the panorama fixed image is such that each image corresponding to each device is sent, and the gaze area is free. There is a problem that it is not possible to reproduce so-called free-viewpoint images such as simple movement and enlargement / reduction. Also, when you want to panoramic multiple display devices side by side, especially in situations where delays or fluctuations occur in public networks, video time synchronization becomes a problem, and you must have a video time synchronization device or control device. There is a problem of not becoming.

  The present invention has been made in view of such circumstances, and can realize free movement and enlargement / reduction of a gaze area on a multi-screen in one large panoramic image, and can also be performed in one large panoramic image. An object of the present invention is to provide a video playback system, a video playback method, a video playback device, and a program capable of realizing time synchronization of a multi-screen gaze area.

  The present invention provides a panoramic free viewpoint video server that holds panoramic free viewpoint video data in which a single panoramic video is divided into a plurality of areas, a plurality of display devices that display video, and the plurality of panoramic freedoms that are divided into areas. Video playback comprising: a playback device that plays back one video image by playing back viewpoint video data and displaying it on the plurality of display devices; and a network connecting the panorama free viewpoint video server and the playback device The playback apparatus includes: a video data receiving unit that receives the panoramic free viewpoint video data distributed from the panoramic free viewpoint video server via the network; and the panoramic free viewpoint received by the receiving unit. A common reception buffer for holding video data, and the panorama divided into the plurality of areas. When a plurality of decoding means for decoding each of the free viewpoint video data and outputting to the display device, an operation means for performing an operation for changing the viewpoint of the panoramic video, and an operation for changing the viewpoint by the operation means Determining whether the panoramic free viewpoint video data to be displayed is held in the common reception buffer, and if so, the panoramic free viewpoint video data to be displayed from the common reception buffer. The panoramic free viewpoint video data to be displayed from the panoramic free viewpoint video server when it is read out, synchronized with the panoramic free viewpoint video data of the other area, and output to the decoding means. And a control means for outputting to the decoding means in synchronization with the panoramic free viewpoint video data of other areas Characterized in that it comprises a.

  The present invention provides a panoramic free viewpoint video server that holds panoramic free viewpoint video data in which a single panoramic video is divided into a plurality of areas, a plurality of display devices that display video, and the plurality of panoramic freedoms that are divided into areas. A video comprising a video playback device for playing back the one panoramic video by playing back the viewpoint video data and displaying it on the plurality of display devices, and a network connecting the panorama free viewpoint video server and the playback device. A video playback method in a playback system, wherein the video playback device receives the panoramic free viewpoint video data distributed from the panoramic free viewpoint video server via the network, and the receiving means. A common reception buffer for holding the received panoramic free viewpoint video data; A plurality of decoding means for decoding each of the panoramic free viewpoint video data divided into regions and outputting the decoded data to the display device, an operating means for performing an operation for changing the viewpoint of the panoramic video, and a control means, When the control means determines whether or not the panoramic free viewpoint video data to be displayed is held in the common reception buffer when the operation means is operated to change the viewpoint. If the panoramic free viewpoint video data to be displayed is read from the common reception buffer, and is output to the decoding means in synchronization with the panoramic free viewpoint video data in another area, if not held. The panorama free viewpoint video data to be displayed is acquired from the panorama free viewpoint video server, and the panorama of another area is acquired. In synchronization with the derived viewpoint video data, and outputs to the decoding means.

  The present invention provides a panoramic free viewpoint video server that holds panoramic free viewpoint video data in which a single panoramic video is divided into a plurality of areas, a plurality of display devices that display video, and the plurality of panoramic freedoms that are divided into areas. A video comprising a video playback device for playing back the one panoramic video by playing back the viewpoint video data and displaying it on the plurality of display devices, and a network connecting the panorama free viewpoint video server and the playback device. A video playback apparatus in a playback system, wherein the panorama free viewpoint video data distributed from the panorama free viewpoint video server is received via the network, and the panorama free viewpoint received by the receiving means. A common reception buffer for holding video data, and A plurality of decoding means for decoding each panoramic free viewpoint video data and outputting it to the display device, an operating means for changing the viewpoint of the panoramic video, and an operation for changing the viewpoint by the operating means. In this case, it is determined whether or not the panoramic free viewpoint video data to be displayed is held in the common reception buffer, and if held, the panoramic free viewpoint video data to be displayed from the common reception buffer. Is output to the decoding means in synchronization with the panoramic free viewpoint video data of another area, and if not held, the panoramic free viewpoint video to be displayed from the panoramic free viewpoint video server Acquire data, synchronize with the panoramic free viewpoint video data of other areas, and output to the decoding means Characterized in that it comprises a control means.

  The present invention provides a panoramic free viewpoint video server that holds panoramic free viewpoint video data in which a single panoramic video is divided into a plurality of areas, a plurality of display devices that display video, and the plurality of panoramic freedoms that are divided into areas. A video comprising a video playback device for playing back the one panoramic video by playing back the viewpoint video data and displaying it on the plurality of display devices, and a network connecting the panorama free viewpoint video server and the playback device. A video playback program for causing a computer on a video playback device in a playback system to perform video playback processing, wherein the video playback device receives the panoramic free viewpoint video data distributed from the panoramic free viewpoint video server via the network. Receiving the video data and the panorama received by the receiving means. A common reception buffer for holding free-viewpoint video data, a plurality of decoding means for decoding each of the plurality of panoramic free-viewpoint video data divided into a plurality of regions and outputting the decoded data to the display device, and a viewpoint of the panoramic video An operation means for performing a change operation, and when the operation means changes the viewpoint, it is determined whether or not the panoramic free viewpoint video data to be displayed is held in the common reception buffer. If it is held, the panoramic free viewpoint video data to be displayed is read from the common reception buffer, and is output to the decoding means in synchronization with the panoramic free viewpoint video data of other areas, and held. If not, the panoramic free viewpoint video data to be displayed is acquired from the panoramic free viewpoint video server. And, in synchronization with the panoramic images synthesized data of the other regions, characterized in that to perform control step of outputting to the decoding means to the computer.

  According to the present invention, when each device is panoramad side by side, the problem of being a panorama fixed image is solved, and a free viewpoint image of a gaze area can be obtained on multiple screens in one large panorama image. The effect that it can be obtained. In addition, there is an effect that the time synchronization of the gaze area of the multi-screen in one large panoramic image can be synchronized instead of the time synchronization of the video of each device.

It is a block diagram which shows the structure of one Embodiment of this invention. It is explanatory drawing which shows the screen structure (all area stream and tile structure) of a panoramic free viewpoint image | video. It is explanatory drawing which shows the screen structure (all area | region stream, tile structure, and multiscreen gaze area | region) of a panoramic free viewpoint image | video. FIG. 2 is an explanatory diagram illustrating a configuration of a common reception buffer 135 illustrated in FIG. 1. It is a sequence diagram which shows the processing operation of the reproducing | regenerating apparatus 13 shown in FIG. It is a sequence diagram which shows the processing operation of the reproducing | regenerating apparatus 13 shown in FIG. It is a sequence diagram which shows the processing operation of the reproducing | regenerating apparatus 13 shown in FIG. It is a sequence diagram which shows the processing operation of the reproducing | regenerating apparatus 13 shown in FIG.

  Hereinafter, a video playback system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the embodiment. In this figure, reference numeral 11 denotes a panoramic free viewpoint video server. Reference numeral 12 denotes a network. Reference numeral 13 denotes a playback device that plays back video. Reference numerals 14 and 15 are display devices for displaying the video reproduced by the reproduction device 13. Here, an example in which two display devices A and B are connected is shown, but three or more display devices are connected as necessary.

  Reference numeral 131 denotes a communication bus inside the playback apparatus 13. Reference numeral 132 denotes a control unit that controls the operation of the playback apparatus 13. Reference numeral 133 denotes an operation unit that performs a manual operation. Reference numeral 134 denotes a transmission / reception unit that transmits / receives information to / from the panoramic free viewpoint video server 11 via the network 12. Reference numeral 135 denotes a common reception buffer for accumulating video data. Reference numerals 136 and 137 denote decoding units that perform decoding processing of video data in GOP (Group Of Picture) units. Reference numerals 138 and 139 are interfaces for connecting the two display devices A14 and B15. Decoding units and interfaces are provided at least as many as the number of display devices.

  Next, with reference to FIG. 2, the screen configuration of the panoramic free viewpoint video (all region stream and tile configuration) will be described. FIG. 2 is a diagram showing a screen configuration (all area stream and tile configuration) of panoramic free viewpoint video data held by the panoramic free viewpoint video server 11. The entire area video 21 is composed of video data of the tile 22. The tile 22 is a standard H.264 standard. H.264 video data, each having a time code. A general panoramic free viewpoint video gaze area 23 is displayed in association with one display device.

  Next, the screen configuration of the panoramic free viewpoint video (all region stream, tile configuration, and multi-screen gaze region) will be described with reference to FIG. FIG. 3 is a diagram illustrating a screen configuration of the panoramic free viewpoint video (all region stream, tile configuration, and multi-screen gaze region). The all-region video 21 is video data held by the panoramic free viewpoint video server 11. The tile 22 is a standard H.264 standard. H.264 video data, each having a time code. The gaze area 31 of the display A is a video displayed on the display device A14 of the playback device 13. The gaze area 32 of the display B is a video displayed on the display device B15 of the playback device 13. The gazing area 31 of the display A and the gazing area 32 of the display B can be set as free movement or enlargement / reduction so-called free viewpoint video by the operation unit 133. The gaze area is generated by decoding the tile number and the reproduction area value in the decoding unit A136 and the decoding unit B137.

  The reproduction area information is the tile number, and the reproduction area value is the vertical and horizontal area values of the gaze area. If there is no reproduction area information or reproduction area value specified by the operation unit 133, the initial value held in the control unit 132 has priority. Is done. For example, only the display A can freely move and enlarge / reduce the gaze area 31. Further, only the display B can freely move and enlarge / reduce the gaze area 32. If the network bandwidth is sufficiently large for video distribution, all distributions that distribute all tiles can be performed. If the network bandwidth is not large enough for video distribution, only partial tile distribution is performed.

  Next, the configuration of the common reception buffer 135 shown in FIG. 1 will be described with reference to FIG. FIG. 4 is a diagram showing the configuration of the common reception buffer 135 for panoramic free viewpoint video. The common reception buffer 135 includes the all-region video 21 shown in FIG. The video data of tiles synchronized in units of GOP based on the time code of the video such as H.264 is held. The IBP picture in the GOP has a role, and the I picture is obtained by compressing only one screen. The B picture is encoded by prediction using image samples of two different screens (for example, past and future). The P picture is encoded by prediction using an image sample of one different screen (for example, the past). Accordingly, in a state where there is no video data, playback cannot be performed from the middle of the GOP. In order to immediately display free movement, enlargement / reduction, and the like after the operation, the video data of the tiles around the gaze area is also stored in the common reception buffer 135, and sent to the decoding unit A131 and the decoding unit B137. The video data of the tile is also decoded. Then, the video of the gaze area of the reproduction area value is cut out and displayed on the display device.

  By doing this, it is possible to perform time synchronization of a multi-screen gaze area in one large panoramic image instead of time synchronization of a conventional fixed image. In addition, by providing the common reception buffer 135, it is possible to obtain a free viewpoint video of the gaze area on multiple screens in one large panoramic video. In addition, when there is video data when operating the gaze area with the operation unit 133, the video data of the screen A of the next GOP can be immediately acquired, and when the video data of the gaze area is present when playing the screen B, the next The video data of the screen B of the GOP can be acquired immediately.

  Next, the operation of the playback apparatus 13 shown in FIG. 1 will be described with reference to FIG. FIG. 5 is a sequence diagram showing an operation when there is video data to be displayed in the common reception buffer 135 at the start of reproduction of the decoding unit B137. First, video data stream-distributed from the panoramic free viewpoint video server 11 (step S <b> 1) is received via the transmission / reception unit 134 and stored in the common reception buffer 135. In the common reception buffer 135, the synchronization is adjusted in units of GOP based on the time code of the video data, and the stream is distributed from the common reception buffer 135 (step S2). The streamed video data is sent to the decoding unit A131 and reproduced and displayed on the display device A14 via the interface 138. In step S1, the video data stream-distributed is affected by fluctuation delay or the like by the network 12, but the video data stream-distributed from the common reception buffer 135 in step S2 is adjusted for synchronization.

  Next, when a reproduction start request operation for the gaze area B is performed from the operation unit 133, the operation unit 133 sends a reproduction start request to the control unit 132 (step S3). The control unit 132 sends a reproduction preparation notification including the reproduction area information of the tile number and the reproduction area values of the vertical and horizontal points of the gaze area to the decoding unit B137 (step S4). Receiving this, the decoding unit B137 activates the decoder and sends a reproduction preparation completion notification to the control unit 132 (step S5). Subsequently, the control unit 132 sends a video data request including the frame number request of the GOP of the decoding unit A131, the playback region information, and the playback region value to the common reception buffer 135 (step S6). If there is requested video data, the common reception buffer 135 sends information indicating the presence of video data to the control unit 132 (step S7). Then, in the common reception buffer 135, GOP reproduction is performed in accordance with the frame number of the decoding unit A131, and the synchronized stream distribution between the decoding unit A131 and the decoding unit B137 is performed (step S8). As a result, the video data stream-distributed on the display device B15 is reproduced and displayed.

  Next, the operation of the playback apparatus 13 shown in FIG. 1 will be described with reference to FIG. FIG. 6 is a sequence diagram showing an operation when there is no video data to be displayed in the common reception buffer 135 at the start of reproduction of the decoding unit B137. First, video data stream-distributed from the panoramic free viewpoint video server 11 (step S11) is received via the transmission / reception unit 134 and stored in the common reception buffer 135. In the common reception buffer 135, the synchronization is adjusted in units of GOP based on the time code of the video data, and the stream is delivered from the common reception buffer 135 (step S12). The streamed video data is sent to the decoding unit A131 and reproduced and displayed on the display device A14 via the interface 138. In step S1, the video data stream-distributed is affected by fluctuation delay or the like by the network 12, but the video data stream-distributed from the common reception buffer 135 is synchronously adjusted.

  Next, when a reproduction start request operation for the gaze area B is performed from the operation unit 133, the operation unit 133 sends a reproduction start request to the control unit 132 (step S13). The control unit 132 sends a reproduction preparation notification including the reproduction area information of the tile number and the reproduction area values of the vertical and horizontal points of the gaze area to the decoding unit B137 (step S14). Receiving this, the decoding unit B137 activates the decoder and sends a reproduction preparation completion notification to the control unit 132 (step S15). Subsequently, the control unit 132 sends a video data request including the frame number request of the GOP of the decoding unit A131, the playback region information, and the playback region value to the common reception buffer 135 (step S16).

  Next, when there is no requested video data, the common reception buffer 135 sends information indicating no video data to the control unit 132 (step S17). In response to this, the control unit 132 sends the frame number request of the GOP of the decoding unit A131, the reproduction area information of the tile number, and the vertical and horizontal points of the gaze area to the panoramic free viewpoint video server 11 via the transmission / reception unit 134. A reproduction start request including the reproduction area value is sent (step S18). The panoramic free viewpoint video server 11 sends a reproduction preparation completion notification to the control unit 132 (step S19), and sends a GOP to the common reception buffer 135 via the transmission / reception unit 134 in accordance with the frame number of the decoding unit A131. Stream distribution is performed (step S20). The common reception buffer 135 performs GOP stream distribution in accordance with the frame number of the decoding unit A131 (step S21), and synchronized stream distribution is performed in the decoding unit A131 and the decoding unit B137, which is reproduced and displayed on the display device B137. Will be.

  Next, the operation of the playback device 13 shown in FIG. 1 will be described with reference to FIG. FIG. 7 is a sequence diagram showing an operation when there is a video in the common reception buffer 135 when a screen operation is performed during playback of the decoding unit A136 and the decoding unit B137. First, video data stream-distributed from the panoramic free viewpoint video server 11 (step S31) is received via the transmission / reception unit 134 and stored in the common reception buffer 135. In the common reception buffer 135, synchronization adjustment is performed in units of GOP based on the time code of the video data, and the stream is delivered from the common reception buffer 135 to the decoding unit A131 and the decoding unit B137 (steps S32 and S33). The streamed video data is reproduced and displayed on the display device A14 and the display device B15 via the interfaces 138 and 139, respectively.

  Next, when a movement or enlargement / reduction operation is performed from the operation unit 133, the operation unit 133 sends operation information to the control unit 132 (step S34). The control unit 132 sends operation information including the reproduction area information of the tile number and the reproduction area values of the vertical and horizontal points of the gaze area to the decoding unit B137 (step S35). Subsequently, the control unit 132 sends a video data request including the frame number request of the GOP of the decoding unit A131, the playback region information, and the playback region value to the common reception buffer 135 (step S36). If there is requested video data, the common reception buffer 135 sends information indicating the presence of video data to the control unit 132 (step S37). Then, in the common reception buffer 135, GOP reproduction is performed in accordance with the frame number of the decoding unit A131, and synchronized stream distribution between the decoding unit A131 and the decoding unit B137 is performed (step S38). As a result, the video data stream-distributed on the display device B15 is reproduced and displayed.

  Next, the operation of the playback device 13 shown in FIG. 1 will be described with reference to FIG. FIG. 8 is a sequence diagram illustrating an operation when there is no video in the common reception buffer 135 when a screen operation is performed during playback of the decoding unit A136 and the decoding unit B137. First, the video data stream-distributed from the panoramic free viewpoint video server 11 (step S41) is received via the transmission / reception unit 134 and stored in the common reception buffer 135. In the common reception buffer 135, the synchronization is adjusted in units of GOP based on the time code of the video data, and the stream is delivered from the common reception buffer 135 to the decoding unit A131 and the decoding unit B137 (steps S42 and S43). The streamed video data is reproduced and displayed on the display device A14 and the display device B15 via the interfaces 138 and 139, respectively.

  Next, when a movement or enlargement / reduction operation is performed from the operation unit 133, the operation unit 133 sends operation information to the control unit 132 (step S44). The control unit 132 sends operation information including the reproduction area information of the tile number and the reproduction area values of the vertical and horizontal points of the gaze area to the decoding unit B137 (step S45). Subsequently, the control unit 132 sends a video data request including the frame number request of the GOP of the decoding unit A131, the playback region information, and the playback region value to the common reception buffer 135 (step S46). When there is no requested video data, the common reception buffer 135 sends information indicating no video data to the control unit 132 (step S47). In response to this, the control unit 132 sends the frame number request of the GOP of the decoding unit A131, the reproduction area information of the tile number, and the vertical and horizontal points of the gaze area to the panoramic free viewpoint video server 11 via the transmission / reception unit 134. A reproduction start request including the reproduction area value is sent (step S48). The panoramic free viewpoint video server 11 sends a reproduction preparation completion notification to the control unit 132 (step S49), and sends the GOP to the common reception buffer 135 via the transmission / reception unit 134 according to the frame number of the decoding unit A131. Stream distribution is performed (step S50). The common reception buffer 135 performs GOP stream distribution in accordance with the frame number of the decoding unit A131 (step S51), and synchronized stream distribution is performed between the decoding unit A131 and the decoding unit B137, which is reproduced and displayed on the display device B137. Will be.

  In the above description, the processing operation shown in FIGS. 7 and 8 shows the processing operation when the display B is operated when the screen is operated during playback of the decoding unit A136 and the decoding unit B137. The same processing operation is performed when is operated. In the above description, an example of displaying on two display devices has been described. However, the same applies to the case where there are three or more display devices. In FIG. 2, an example in which the tiles are 4 × 10 in the vertical direction is shown, but the same applies even if the number of tiles is changed. Moreover, although the example of the vertical and horizontal area values of the gaze area is shown in FIG. 3, the horizontal and vertical areas may be freely changed. Moreover, although the example of the vertical / horizontal area value of the gaze area is shown in FIG. 3, the gaze area may be freely movable vertically and horizontally.

  As described above, in order to solve the problem of panorama fixed video when display devices are arranged in a panorama, a free viewpoint video of a gaze area is set on multiple screens in one large panoramic video. Is possible. It is possible to perform time synchronization of a multi-screen gaze area in one large panoramic image instead of time synchronization of the video on the display device.

  1 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed, thereby executing video reproduction processing. May be performed. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer system” includes a WWW system having a homepage providing environment (or display environment). The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Further, the “computer-readable recording medium” refers to a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In addition, those holding programs for a certain period of time are also included. The computer includes a game machine having an Internet connection function and a net TV (including an external adapter having the function).

  The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

  In an apparatus that connects to a network and reproduces panoramic video information from a server, it can be applied to an indispensable use in which a plurality of free viewpoint videos are displayed and time synchronization of a multi-screen gaze area is performed.

  DESCRIPTION OF SYMBOLS 11 ... Panorama free viewpoint video server, 12 ... Network, 13 ... Playback apparatus, 31 ... Internal communication bus, 132 ... Control part, 133 ... Operation part, 134 ... Transmission / reception 135, common reception buffer, 136 ... decoding unit A, 137 ... decoding unit B, 138 ... interface A, 139 ... interface B, 14 ... display device A, 15 ..Display device B

Claims (4)

A panoramic free viewpoint video server that holds panoramic free viewpoint video data in which one panoramic video is divided into a plurality of regions;
A plurality of display devices for displaying images;
A playback device for playing back the one panoramic video by playing back the plurality of panoramic free viewpoint video data divided into the regions and displaying the data on the plurality of display devices;
A video playback system comprising a network connecting the panoramic free viewpoint video server and the playback device,
The playback device
Video data receiving means for receiving the panoramic free viewpoint video data distributed from the panoramic free viewpoint video server via the network;
A common reception buffer for holding the panoramic free viewpoint video data received by the receiving means;
A plurality of decoding means for decoding each of the panoramic free viewpoint video data divided into the plurality of regions and outputting the decoded data to the display device;
Operation means for performing an operation of changing the viewpoint of the panoramic image;
When an operation for changing the viewpoint is performed by the operation means, it is determined whether or not the panoramic free viewpoint video data to be displayed is held in the common reception buffer. Read the panoramic free viewpoint video data to be displayed from the common reception buffer, synchronize with the panoramic free viewpoint video data of other areas, output to the decoding means, and if not held, the panorama free viewpoint video data Control means for obtaining the panoramic free viewpoint video data to be displayed from a viewpoint video server, synchronizing with the panoramic free viewpoint video data of another area, and outputting the data to the decoding means. Video playback system. A panoramic free viewpoint video server that holds panoramic free viewpoint video data in which one panoramic video is divided into a plurality of regions, a plurality of display devices that display video, and a plurality of the panoramic free viewpoint video data that are divided into regions. Video in a video playback system comprising: a video playback device that plays back and displays the one panoramic video by playing back and displaying on the plurality of display devices; and a network connecting the panorama free viewpoint video server and the playback device A playback method,
The video reproduction apparatus holds video data receiving means for receiving the panoramic free viewpoint video data distributed from the panoramic free viewpoint video server via the network, and holds the panoramic free viewpoint video data received by the receiving means. A common receiving buffer, a plurality of decoding means for decoding each of the plurality of panoramic free viewpoint video data divided into a plurality of regions and outputting the decoded data to the display device, and an operating means for performing an operation of changing the viewpoint of the panoramic video And control means,
The control means determines whether or not the panoramic free viewpoint video data to be displayed is held in the common reception buffer when the operation means is operated to change the viewpoint. In this case, the panoramic free viewpoint video data to be displayed is read out from the common reception buffer, and is output to the decoding means in synchronization with the panoramic free viewpoint video data in another area. The panorama free viewpoint video data to be displayed is acquired from the panorama free viewpoint video server, and is synchronized with the panoramic free viewpoint video data of another area and output to the decoding means. Video playback method. A panoramic free viewpoint video server that holds panoramic free viewpoint video data in which one panoramic video is divided into a plurality of regions, a plurality of display devices that display video, and a plurality of the panoramic free viewpoint video data that are divided into regions. Video in a video playback system comprising: a video playback device that plays back and displays the one panoramic video by playing back and displaying on the plurality of display devices; and a network connecting the panorama free viewpoint video server and the playback device A playback device,
Video data receiving means for receiving the panoramic free viewpoint video data distributed from the panoramic free viewpoint video server via the network;
A common reception buffer for holding the panoramic free viewpoint video data received by the receiving means;
A plurality of decoding means for decoding each of the panoramic free viewpoint video data divided into the plurality of regions and outputting the decoded data to the display device;
Operation means for performing an operation of changing the viewpoint of the panoramic image;
When an operation for changing the viewpoint is performed by the operation means, it is determined whether or not the panoramic free viewpoint video data to be displayed is held in the common reception buffer. Read the panoramic free viewpoint video data to be displayed from the common reception buffer, synchronize with the panoramic free viewpoint video data of other areas, output to the decoding means, and if not held, the panorama free viewpoint video data Control means for obtaining the panoramic free viewpoint video data to be displayed from a viewpoint video server, synchronizing with the panoramic free viewpoint video data of another area, and outputting the data to the decoding means. Video playback device. A panoramic free viewpoint video server that holds panoramic free viewpoint video data in which one panoramic video is divided into a plurality of regions, a plurality of display devices that display video, and a plurality of the panoramic free viewpoint video data that are divided into regions. Video in a video playback system comprising: a video playback device that plays back and displays the one panoramic video by playing back and displaying on the plurality of display devices; and a network connecting the panorama free viewpoint video server and the playback device A video playback program for causing a computer on a playback device to perform video playback processing,
The video playback device
Video data receiving means for receiving the panoramic free viewpoint video data distributed from the panoramic free viewpoint video server via the network;
A common reception buffer for holding the panoramic free viewpoint video data received by the receiving means;
A plurality of decoding means for decoding each of the panoramic free viewpoint video data divided into the plurality of regions and outputting the decoded data to the display device;
Operation means for performing an operation of changing the viewpoint of the panoramic video,
When an operation for changing the viewpoint is performed by the operation means, it is determined whether or not the panoramic free viewpoint video data to be displayed is held in the common reception buffer. Read the panoramic free viewpoint video data to be displayed from the common reception buffer, synchronize with the panoramic free viewpoint video data of other areas, output to the decoding means, and if not held, the panorama free viewpoint video data Obtaining the panoramic free viewpoint video data to be displayed from the viewpoint video server, synchronizing the panoramic free viewpoint video data of another area with the panoramic free viewpoint video data, and outputting the data to the decoding unit. Feature video playback program.

Images