JP6506084B2 - Movie playback device and program - Google Patents

Description

  The present invention relates to a video playback device and program.

In recent years, provision of broadcast communication cooperation services such as hybrid cast has been promoted. In the hybrid cast, HTML5 which is a new Web technology is adopted as the application platform, and a highly interactive Web application (application) is also provided in which the content contents change according to the user operation.
In this HTML5, MSE (Media Source Extensions), which is an API (Application Interface) for reproducing the distributed moving image by the Web browser application, is defined. As a result, the moving image player of the client can reproduce the moving image of MPEG-4 and MPEG-DASH (non-patent document 1) distributed using HTTP (Hypertext Transfer Protocol) by the Web application without using the plug-in. It became so.

  In this MPEG-DASH, an MPD file is defined. Information (metadata) of a moving image or an audio file is described in an MPD (Media Presentation Description) file, and the client reproduces the moving image by referring to the MPD file. By describing information of a plurality of moving pictures of different rates in this MPD file, the client can reproduce moving pictures of different rates according to the network quality and the terminal load.

“Information technology-Dynamic adaptive streaming over HTTP (DASH)-Part 1: Media presentation description and segment formats” ISO / IEC 23009-1: 2014

  However, when switching a moving image interactively according to the operation of the user, neither the timing nor the moving image of the switching destination is known until the user performs an operation of selecting the moving image of the switching destination. In the prior art, when switching the moving image of the switching source and the moving image of the switching destination in the middle of the reproduction of the moving image, synchronization of the reproduction time can not be secured with high accuracy.

  The present invention has been made in consideration of such circumstances, and provides a moving image reproducing apparatus and program capable of switching moving images while securing synchronization accuracy.

(1) According to one aspect of the present invention, when an instruction to switch the display of the first moving image to the display of the second moving image is received, a moving image reproduction unit that reproduces the first moving image and the second moving image The video playback unit is controlled to start playback, and the video playback unit is controlled so that playback of the first video and playback of the second video are synchronized, and playback of the first video and the second And a switching control unit for switching the moving image to be displayed and output from the moving image reproduction unit from the first moving image to the second moving image after synchronization with the reproduction of the moving image.

(2) One aspect of the present invention is the moving image reproduction apparatus according to (1) described above, wherein the switching control unit instructs the moving image reproduction unit to reproduce the second moving image, The synchronization in the moving image reproduction unit is controlled based on the time difference until the moving image reproduction unit starts the reproduction of the second moving image.

(3) One aspect of the present invention is characterized in that the moving image reproducing apparatus according to (1) or (2) described above further includes a moving image determination unit that determines the second moving image based on an external input. I assume.

(4) In one aspect of the present invention, in the moving picture reproducing apparatus according to (3) described above, the second moving picture is a moving picture obtained by enlarging a part of a display area of the first moving picture, and the moving picture determination unit Is characterized in that the second moving image is determined based on an input for selecting a display area of the first moving image being displayed.

(5) According to one aspect of the present invention, when the computer receives a first moving image reproduction step of reproducing the first moving image and an instruction to switch the display of the first moving image to the display of the second moving image, the second moving image A second moving image reproduction step for starting reproduction; a synchronization control step for controlling synchronization of the reproduction of the first moving image and the reproduction of the second moving image; reproduction of the first moving image and reproduction of the second moving image And a switching control step of switching a moving image to be displayed and output from the first moving image to the second moving image after being synchronized.

  According to the present invention, a moving image can be switched while securing synchronization accuracy.

It is a schematic diagram which shows the outline | summary of switching of the moving image by the moving image reproduction apparatus which concerns on the 1st Embodiment of this invention. It is a schematic diagram which shows the whole structure of the moving image delivery system which concerns on the embodiment. It is a figure which shows the structure of the MPD file which concerns on the embodiment. FIG. 7 is a block diagram showing a schematic functional configuration of a video playback device according to the same embodiment. It is a sequence chart which shows the flow of the display start process by the moving image delivery system which concerns on the embodiment. It is a sequence chart which shows the flow of the switching process by the moving image delivery system which concerns on the embodiment. It is a flowchart which shows the flow of the synchronous process by the moving image reproduction apparatus which concerns on the embodiment.

First Embodiment
[Overview of video distribution system]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
First, an outline of the video distribution system 1 according to the present embodiment will be described.
The moving image distribution system 1 according to the present embodiment is a system for distributing moving images using HTTP. There are several moving image delivery methods using HTTP, such as HLS (HTTP Live Streaming), but as an example, a case where moving images are delivered using MPEG-DASH will be described. In the video distribution system 1, the video reproduced by the video distribution device 30 is displayed by the video reproduction device 10. The user operates the video playback device 10 to view the displayed video. Hereinafter, the case where the user is a user of the video playback device 10 will be described.

  The video playback device 10 according to the present embodiment includes a display unit such as, for example, a television, a personal computer, a mobile phone, a tablet, a smartphone, a PHS (Personal Handy-phone System) terminal device, or a PDA (Personal Digital Assistant). It is an electronic device. The video playback device 10 includes a video player application, and can display a video distributed in the MPEG-DASH format. This video player application may be implemented in any form such as a native application of the OS. Here, as an example, a case where a video player application is implemented as a web application will be described. This web application operates, for example, in a web browser application compatible with HTML5, and is described by JavaScript (registered trademark). In the following, as an example, the case where the video playback device 10 is a personal computer will be described.

FIG. 1 is a schematic view showing an outline of switching of a moving image by the moving image reproduction apparatus 10 according to the present embodiment.
Three kinds of moving pictures V10, V20 and V31 to V34 are shown in FIG.
The moving image V10 is a moving image with a resolution of 4K (for example, 3840 × 2160 px).
The moving image V20 is a moving image obtained by down converting the moving image V10 to a resolution of 2K (for example, 1920 × 1080 px).
The moving images V31 to V34 are cut out moving images obtained by dividing the moving image V10 into four by the center line in the horizontal direction and the center line in the vertical direction. Therefore, the resolution of the moving images V31 to V34 is 2K.

  The moving image reproduction apparatus 10 displays one of the moving images V20 and V31 to V34 with 2K resolution among the moving images shown in FIG. Then, the video playback device 10 switches the video to be displayed according to the user's operation. Specifically, when displaying the moving image V20, the moving image player 10 virtually divides the moving image V20 into four regions by the horizontal center line LH and the vertical center line LV. When an operation for specifying the upper left region is received from the user, the display is switched to the moving image V31 corresponding to the upper left region. Similarly, in accordance with an operation of designating upper right, lower left, and lower right, respectively, of virtual divided areas by the horizontal center line LH and the vertical center line LV of the moving image V20, the video playback device 10 The display is switched to each of the moving images V32, V33, and V34 obtained by enlarging the designated area. In addition, when the moving image reproduction device 10 receives an operation of specifying any of the display regions while displaying the moving images V31 to V34, the display is switched to the moving image V20 representing the whole of the moving images V31 to V34 before division.

Each of the moving image V20 and the moving images V31 to V34 has a resolution of 2K. Therefore, the moving image reproduction apparatus 10 can perform the enlargement and reduction of the moving image without changing the resolution by switching the above-described moving image. Further, in providing the enlarged moving image, the moving image reproducing apparatus 10 provides one of the moving images V31 to V34 corresponding to the area selected by the user with high resolution, not the moving image V10 of 4K resolution. Therefore, the video playback device 10 can reduce the load on the network N and the video distribution device 30.
Hereinafter, the process of switching the moving image displayed on the display unit is referred to as a switching process. Also, in the following, an operation for instructing a user to switch a moving image is referred to as a switching operation. Here, as an example, the case where the moving image of the switching destination is specified by the switching operation described above will be described.

  Here, since the moving image V20 and the moving images V31 to 34 are images obtained by down-converting or dividing the same moving image V10, the time lengths of the moving images are the same. Therefore, when switching the moving image, the moving image reproduction apparatus 10 switches the display after synchronizing so as not to shift the reproduction time. Here, the "reproduction time" refers to the time position of reproduction within the moving image. More specifically, the reproduction time refers to the reproduction position with respect to the time length of the moving image. Also, "synchronization" is to align the playback times of a plurality of moving pictures.

Here, an outline of the switching process by the video playback device 10 will be described.
First, the video playback device 10 plays back the video V20 and the video V31 having the same time length. Here, reproduction includes reproduction in the foreground and reproduction in the background. In reproduction in the foreground, a moving image is displayed on the display unit. On the other hand, in playback in the background, the moving image is not displayed on the display unit. Foreground and background can be swapped at any time. In the example described above, the switching source moving image V10 is reproduced and displayed in the foreground, and the switching destination moving image V31 is reproduced in the background.

Next, the moving picture reproduction apparatus 10 switches the moving picture to be displayed on the display unit from the moving picture V20 to the moving picture V31 based on the time difference between the reproduction time of the moving picture V20 and the reproduction time of the moving picture V31. Specifically, when the time difference between the reproduction time of the moving picture V20 and the reproduction time of the moving picture V31 is less than a predetermined value, the moving picture V31 being reproduced in the background is switched to the reproduction in the foreground. Thereby, the moving image reproduction apparatus 10 can switch a plurality of moving images while securing high synchronization accuracy.
Hereinafter, the first moving image displayed on the display unit before the switching process is referred to as a switching source moving image. In addition, the second moving image displayed on the display unit after the switching process is referred to as a after-switching moving image.

[Configuration of video distribution system]
Next, the configuration of the video distribution system 1 will be described.
FIG. 2 is a schematic view showing an entire configuration of the moving picture distribution system 1 according to the present embodiment.
The moving image distribution system 1 according to the present embodiment includes one or more moving image reproduction devices 10-1, 10-2, 10-3, ..., and a moving image distribution device 30. Hereinafter, the moving image reproduction devices 10-1, 10-2, 10-3,... The video reproduction device 10 and the video distribution device 30 are connected to the network N, respectively, and can mutually transmit and receive information.

  The network N is an information communication network configured by a wide area network (WAN), a local area network (LAN), and the like. The WAN is formed of, for example, one or more combinations of a cellular phone network, a PHS network, a public switched telephone network (PSTN), a private communication network, a VPN (Virtual Private Network), and the like.

  The video distribution device 30 is a device that manages the MPD file and the video file. Although the MPD file and the moving image file may be managed by separate devices, here, as an example, a case where the MPD file and the moving image file are managed by the moving image distribution device 30 which is an integrated device will be described. .

Here, the configuration of the MPD file will be described.
FIG. 3 is a diagram showing the configuration of the MPD file according to the present embodiment.
In the MPD file according to the present embodiment, media file information is described in a hierarchical structure of XML (Extensible Markup Language) format. An MPD file has one or more Period elements.
The Period element is a moving image divided by time. Reproduction of the moving image is performed in the order of the start time described in each Period element. The Period element has one or more AdaptationSet elements.
In the AdaptationSet element, coding related information such as video, audio and subtitles is described. The AdaptationSet element has one or more Representation elements.

  The Representaion element describes information such as video / audio bit rate, resolution and aspect ratio. In addition, in the Representaion element, segment information regarding a segment obtained by dividing the media into minimum units is described. The Segment information includes, for example, a URL (Uniform Resource Locator) of a segment acquisition destination. The video playback device 10 analyzes the MPD file and acquires a video file in units of segments. Then, the video playback device 10 plays back the acquired video files in order.

[Configuration of video playback device]
Next, the configuration of the video playback device 10 will be described.
FIG. 4 is a block diagram showing a schematic functional configuration of the video playback device 10 according to the present embodiment.
The video distribution device 30 according to the present embodiment includes an input unit 110, a communication unit 120, a display unit 130, an audio output unit 140, a storage unit 150, and a control unit 160.

  The input unit 110 includes an input device such as a pointing device such as a mouse and a touch pad, a keyboard, a touch panel, and a television remote control, and detects an operation by the user. The input unit 110 outputs information representing the content of the detected operation to the control unit 160. The operations received by the input unit 110 include, for example, a display start operation and a switching operation. The display start operation is an operation for instructing display start of a new moving image. The switching operation is an operation for instructing switching of a moving image already displayed as described above to another moving image. When the display start operation is received, the input unit 110 outputs a display start request corresponding to the display start operation to the control unit 160. When the switching operation is received, the input unit 110 outputs a switching request corresponding to the switching operation to the control unit 160. The switching request includes information for specifying the switching destination moving image. Here, as an example of the switching operation, a case will be described in which the pointing device accepts an operation of specifying an area in a moving image displayed by the display unit 130. In this case, the input unit 110 notifies the control unit 160 of coordinates designated by the user as information for identifying the switching destination moving image.

The communication unit 120 includes a communication interface, and connects to the network N. The communication unit 120 communicates with an external device such as the video distribution device 30 connected to the network N.
The display unit 130 includes a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 130 displays the moving image distributed from the moving image distribution device 30.
The audio output unit 140 includes a speaker. The audio output unit 140 reproduces the audio of the moving image distributed from the moving image distribution device 30.

  The storage unit 150 includes a read only memory (ROM), a random access memory (RAM), and the like. The storage unit 150 may also include a hard disc drive (HDD), an electrically erasable programmable read only memory (EEPROM), a flash memory, and the like. The storage unit 150 stores various programs to be executed by a CPU (Central Processing Unit) included in the video playback device 10, results of processing executed by the CPU, and the like.

  The storage unit 150 also includes a web browser storage unit 151 that stores a web browser application program. The Web browser application program incorporates an XML parser. Also, the Web browser application program provides various APIs (Application Programming Interfaces) related to moving image acquisition and reproduction to the Web application operating on the program.

The storage unit 150 also includes a web application storage unit 152 that stores web applications.
The web application operates in a web browser application program. The web application is, for example, an HTML5 file acquired from the moving picture distribution device 30, and its operation algorithm is described by JavaScript (registered trademark). In this HTML5 file, a video element corresponding to the switching source moving image and a video element corresponding to the switching destination moving image are described. Further, in this HTML5 file, allocation of MPD files of a switching source moving image or a switching destination moving image to be reproduced for each video element is described. Further, in the HTML5 file, a URL indicating an acquisition destination of the switching source moving image and the switching destination moving image is described. Further, in the HTML5 file, correspondence relationships corresponding to operations of the switching source moving image and the switching destination moving image are described. The correspondence relationship is, for example, a switching operation at the time of display of the switching source moving image (designation of any of the virtual four divided areas of the moving image V20 of FIG. 1) and a switching destination moving image (FIG. It is a relationship with moving images V31 to V34). In the present embodiment, the relationship between the virtual division area of the switching source moving image and the switching destination moving image is described for the switching processing corresponding to the moving image enlargement operation. Further, in the case of the switching process corresponding to the reduction operation of the moving image, the switching destination moving image corresponding to the switching source moving image is described.

The control unit 160 controls various components included in the video playback device 10.
The control unit 160 includes a moving image reproduction unit 161, a moving image determination unit 162, an MPD acquisition unit 163, a moving image acquisition unit 164, and a switching control unit 165. The moving image reproduction unit 161, the moving image determination unit 162, the MPD acquisition unit 163, the moving image acquisition unit 164, and the switching control unit 165 operate, for example, when the CPU included in the moving image reproduction apparatus 10 executes the Web application. .

  The video playback unit 161 plays back a video based on the video file acquired from the video acquisition unit 164. The video playback unit 161 can play back a video in the foreground and the background. For example, in the video played in the foreground, in the Cascading Style Sheets (CSS), the value of the visibility of the video element of the video is set to “visible”. In this case, the moving image reproduction unit 161 sequentially reads out the image data and the audio data included in the moving image file according to the elapse of the reproduction time. Then, the read image data is output to the display unit 130 to display a moving image. In addition, the video reproduction unit 161 outputs the read audio data to the audio output unit 140, and causes the audio to be output. Also, in the animation played back in the background, the value of visiblity of the video element of the animation is set to “hidden” in CSS. In this case, the moving image reproduction unit 161 sequentially reads out the image data and the audio data included in the moving image file according to the elapse of the reproduction time, as in the foreground reproduction. However, the output of the read image data to the display unit 130 and the output of the audio data to the audio output unit 140 are not performed.

  The moving image reproduction unit 161 reproduces the moving image in response to the reproduction request acquired from the switching control unit 165. In the reproduction request, the reproduction time is specified, and the moving image reproduction unit 161 reproduces the moving image from the specified reproduction time. When starting the reproduction of the moving image, the moving image reproduction unit 161 notifies the switching control unit 165 of the start of the reproduction. Specifically, the video playback unit 161 notifies, for example, the occurrence of the Playing event. By receiving this notification, the switching control unit 165 can confirm that reproduction of the requested moving image has actually been performed.

When the moving image determination unit 162 receives a display request for a moving image from the input unit 110, the moving image determination unit 162 notifies the MPD acquisition unit 163 of the moving image instructed to be displayed. In addition, upon receiving a switching request of a moving image from the input unit 110, the moving image determining unit 162 identifies a switching destination moving image, and notifies the MPD acquiring unit 163 of the switching destination moving image.
The MPD acquisition unit 163 acquires the MPD file for the moving picture notified from the moving picture determination unit 162 from the moving picture distribution device 30 via the communication unit 120. The MPD acquisition unit 163 outputs the acquired MPD file to the moving image acquisition unit 164.

  The moving image acquisition unit 164 analyzes the MPD file acquired from the MPD acquisition unit 163, and specifies the acquisition destination of the moving image. The moving image acquisition unit 164 acquires a moving image file from the moving image distribution apparatus 30 via the communication unit 120 based on the identification result. Here, the moving image acquisition unit 164 can acquire a moving image file corresponding to an arbitrary playback time. When the operation accepted by the input unit 110 is a display start request for a moving image, the moving image acquisition unit 164 acquires, for example, a moving image file corresponding to the reproduction time of the head of the moving image. Also, when the operation accepted by the input unit 110 is a moving image switching request, the moving image acquisition unit 164, for example, a moving image file of the switching destination moving image corresponding to the reproduction time of the moving image being played in the foreground, ie, the switching source moving image. To get The moving picture acquisition unit 164 outputs the acquired moving picture file to the moving picture reproduction unit 161.

The switching control unit 165 executes switching processing of the moving image to be reproduced by the moving image reproduction unit 161.
When the operation accepted by the input unit 110 is a moving image display start request, the switching control unit 165 outputs a moving image reproduction request to the moving image reproduction unit 161 and causes the moving image to be reproduced in the foreground. Specifically, for example, in CSS, the value of the visiblity of the video element of the moving image to be reproduced in the foreground is set to “visible”.

  If the operation accepted by the input unit 110 is a moving image switching request, that is, if an instruction to switch the display to the switching destination moving image is received, the switching control unit 165 executes the switching process. At the start time of the switching process, that is, at the time when the moving image file of the switching destination moving image is acquired, the moving image reproducing unit 161 is reproducing the switching source moving image in the foreground. At the same time, the moving image acquisition unit 164 outputs a reproduction request of the switching destination moving image to the moving image reproduction unit 161, and causes the switching destination moving image to be reproduced in the background. Specifically, for example, in the CSS, the value of the visibility of the video element of the moving image to be background-reproduced is set to "hidden". The switching control unit 165 determines whether the time difference between the reproduction time of the switching source moving image and the reproduction time of the after-switching moving image is within a predetermined range.

If the time difference between the playback time of the switching source moving image and the playback time of the moving image after switching is within the predetermined range, the switching control unit 165 switches the moving image to be displayed from the switching source moving image to the switching destination moving image. Specifically, the switching control unit 165 causes the moving image reproduction unit 161 to reproduce the switching destination moving image in the foreground and causes the switching source moving image to be reproduced in the background. Thereafter, the switching control unit 165 causes the moving image reproduction unit 161 to stop the reproduction of the switching source moving image. Also, the switching control unit 165 causes the moving image acquisition unit 164 to stop acquisition of the switching source moving image.
If the time difference between the playback time of the switching source moving image and the playback time of the moving image after switching is not within the predetermined range, the switching control unit 165 corrects the playback time of the switching destination moving image. Then, the switching control unit 165 outputs a reproduction request for the switching destination moving image from the reproduction time after correction to the moving image reproduction unit 161. Then, the switching control unit 165 determines whether the time difference between the reproduction time of the switching source moving image and the reproduction time of the switching destination moving image is within a predetermined range.

The correction of the reproduction time by the switching control unit 165 will be described. Here, as an example, after the switching control unit 165 requests the moving image reproduction unit 161 to reproduce the switching destination moving image, reproduction of the switching destination moving image is performed based on the time difference from when the moving image reproduction unit 161 starts reproduction. The case of correcting the time will be described.
First, when the switching control unit 165 outputs a reproduction request of the switching destination moving image to the moving image reproduction unit 161, the switching control unit 165 records the reproduction request output time. Next, when the switching control unit 165 acquires from the video playback unit 161 a notification of playback start according to the playback request, the switching control unit 165 records the playback start time. The reproduction request output time and the reproduction start time are times on a time scale such as world time, and are different from the times in the moving image. Next, the switching control unit 165 calculates a time difference between the reproduction request output time and the reproduction start time (hereinafter referred to as “reproduction time lag”). Then, when the time difference between the playback time of the switching source moving image and the playback time of the moving image after switching is not within the predetermined range, the switching control unit 165 adds the playback time lag to the playback time of the switching destination moving image. Thereby, the video playback unit 161 corrects the playback time of the switching destination video.

[Operation of video distribution system]
Next, the operation of the video distribution system 1 will be described.
FIG. 5 is a sequence chart showing the flow of processing by the moving picture distribution system 1 according to the present embodiment.
The process illustrated in FIG. 5 illustrates the flow of the process when the video playback device 10 receives a display start operation from the user.

(Step S100) The video playback device 10 receives a display start operation of a video (first video). Thereafter, the moving picture distribution system 1 advances the process to step S102.
(Step S102) The moving picture reproduction device 10 transmits an MPD file acquisition request for the first moving picture to the moving picture distribution device 30. Thereafter, the moving picture distribution system 1 advances the process to step S104.
(Step S104) The moving picture distribution apparatus 30 transmits the MPD file requested from the moving picture reproduction apparatus 10 to the moving picture reproduction apparatus 10. Thereafter, the moving picture distribution system 1 advances the process to step S106.

(Step S106) The moving image player 10 acquires the MPD file, and interprets the contents of the acquired MPD file. Thereafter, the moving picture distribution system 1 advances the process to step S108.
(Step S108) The moving image player 10 transmits a moving image file acquisition request for the first moving image to the moving image distribution device 30 based on the contents of the MPD file. Thereafter, the moving picture distribution system 1 advances the process to step S110.

(Step S110) The moving picture distribution device 30 transmits the moving picture file of the first moving picture requested from the moving picture reproduction device 10 to the moving picture reproduction device 10. Thereafter, the moving picture distribution system 1 advances the process to step S112. The processing in steps S108 and S110 is repeatedly executed until all moving image files of the first moving image are acquired or until the switching processing to the second moving image is completed.
(Step S112) The moving picture reproduction device 10 acquires a moving picture file of the first moving picture, and reproduces the first moving picture in the foreground based on the acquired moving picture file. Then, the moving picture distribution system 1 ends the process shown in FIG.

FIG. 6 is a sequence chart showing the flow of the switching process by the moving picture distribution system 1 according to the present embodiment.
The process illustrated in FIG. 6 illustrates the flow of the process when the video playback device 10 receives a switching operation from the user.

(Step S200) The video playback device 10 receives a video switching operation from the user. Specifically, for example, the video playback device 10 receives an operation of selecting an arbitrary position of the display area of the first video. Thereafter, the moving picture distribution system 1 advances the process to step S202.
(Step S202) The moving image player 10 determines a switching destination moving image (second moving image) in accordance with the switching operation received from the user. Thereafter, the moving picture distribution system 1 proceeds with the process to step S204.
(Step S204) The moving picture reproduction device 10 transmits an MPD file acquisition request for the second moving picture to the moving picture distribution device 30. Thereafter, the moving picture distribution system 1 advances the process to step S206.

(Step S206) The moving picture distribution apparatus 30 transmits the MPD file requested from the moving picture reproduction apparatus 10 to the moving picture reproduction apparatus 10. Thereafter, the moving picture distribution system 1 advances the process to step S208.
(Step S208) The moving image player 10 acquires the MPD file, and interprets the contents of the acquired MPD file. Thereafter, the moving picture distribution system 1 advances the process to step S210.

(Step S210) The moving image player 10 transmits a moving image file acquisition request for the second moving image to the moving image distribution device 30 based on the contents of the MPD file. Thereafter, the moving picture distribution system 1 advances the process to step S212.
(Step S 212) The moving picture distribution device 30 transmits the moving picture file of the second moving picture requested from the moving picture reproduction device 10 to the moving picture reproduction device 10. Thereafter, the moving picture distribution system 1 proceeds with the process to step S214. Note that the processing in steps S210 and S212 is performed until all moving image files of the second moving image are acquired or until the switching processing from the second moving image to another moving image different from the second moving image is completed. , Repeatedly executed.

(Step S214) The video playback device 10 acquires a video file of the second video. Thereafter, the moving picture distribution system 1 proceeds with the process to step S216.
(Step S216) The moving picture reproduction apparatus 10 executes synchronization processing of the first moving picture and the second moving picture. Until the synchronization process is completed, the video playback device 10 plays the first video in the foreground and plays the second video in the background. Thereafter, the moving picture distribution system 1 proceeds with the process to step S218.

(Step S218) The video playback device 10 switches the display from the first video to the second video. Specifically, the second moving image is reproduced in the foreground, and the first moving image is reproduced in the background. Thereafter, the moving picture distribution system 1 advances the process to step S220.
(Step S220) The moving picture reproduction apparatus 10 stops the reproduction of the first moving picture. Also, the video playback device 10 stops acquisition of the first video file. Then, the moving picture distribution system 1 ends the process shown in FIG.

FIG. 7 is a flowchart showing a flow of synchronization processing by the video playback device 10 according to the present embodiment.
The process shown in FIG. 7 corresponds to the process of step S130 in FIG.
(Step S300) The switching control unit 165 of the control unit 160 sets the reproduction time of the second moving image to an initial value. Specifically, the video playback device 10 sets, for example, the same playback time as the playback time of the first video as the playback time of the second video. Thereafter, the control unit 160 advances the process to step S302.

(Step S302) The switching control unit 165 outputs a reproduction request for reproducing the second moving image in the background from the set reproduction time to the moving image reproduction unit 161 of the control unit 160. Thereafter, the control unit 160 proceeds with the process to step S304.
(Step S304) The switching control unit 165 acquires and records the reproduction request output time (Ta) at which the reproduction request is output. Thereafter, the control unit 160 advances the process to step S306.
(Step S306) The switching control unit 165 determines whether or not the reproduction of the second moving image has been started. Specifically, the switching control unit 165 determines whether or not the occurrence of the Playing event has been notified from the video playback unit 161. When the reproduction of the second moving image is started (step S306; YES), the control unit 160 advances the process to step S308. In addition, when the reproduction of the second moving image is not started (step S306; NO), the control unit 160 repeats the process of step S306.

(Step S308) The switching control unit 165 acquires and records the reproduction start time (Tb). Specifically, the switching control unit 165 acquires the time when the occurrence of the Playing event is notified from the video reproduction unit 161. Thereafter, the control unit 160 advances the process to step S310.
(Step S310) The switching control unit 165 calculates the time difference from the time when the reproduction request is made to the start of reproduction, that is, the reproduction time lag (Tb−Ta). Thereafter, the control unit 160 advances the process to step S312.

(Step S312) The switching control unit 165 acquires the reproduction time (Tm) of the first moving image. Specifically, the switching control unit 165 may, for example, set video. Get the value of currentTime. Thereafter, the control unit 160 advances the process to step S314.
(Step S314) The switching control unit 165 acquires the reproduction time (Tn) of the second moving image. Specifically, the switching control unit 165 may, for example, set video. Get the value of currentTime. Thereafter, the control unit 160 proceeds with the process to step S316.

(Step S316) The switching control unit 165 determines whether or not the absolute value (| Tm-Tn |) of the time difference between the playback time of the first moving image and the playback time of the second moving image is less than the synchronization accuracy threshold (α). . If the absolute value of the time difference between the reproduction times is less than the synchronization accuracy threshold (| Tm-Tn | <α), the control unit 160 ends the process shown in FIG. If the absolute value of the time difference between the reproduction times is equal to or greater than the synchronization accuracy threshold (| Tm-Tn | ≧ α), the control unit 160 proceeds to step S318.
(Step S318) The switching control unit 165 corrects the playback time of the second moving image. Specifically, the switching control unit 165 sets, as the playback time of the second moving image, a time obtained by adding the playback time lag (Tb−Ta) to the current playback time (Tn). Thereafter, the control unit 160 returns the process to step S302.

[Summary of First Embodiment]
As described above, the moving image reproduction unit 161 that reproduces the first moving image (for example, switching source moving image) and the second moving image (for example, switching destination moving image) according to the present embodiment, and the display of the first moving image to the second moving image When receiving an instruction to switch to the display of the video, the video playback unit 161 is controlled to start playback of the second video, and the video playback unit 161 is controlled to synchronize the playback of the first video and the playback of the second video. And a switching control unit 165 for switching the moving image to be displayed and output from the moving image reproduction unit 161 from the first moving image to the second moving image after the reproduction of the first moving image and the reproduction of the second moving image are synchronized.

Here, as a comparison with the moving picture reproduction apparatus 10 according to the present embodiment, a process in the case of switching a moving picture while securing synchronization accuracy will be described using a conventional technique.
Conventionally, in the MPD file, by previously describing the organization such as the distribution order and time of a plurality of moving pictures, the plurality of moving pictures can be reproduced continuously. When providing interactive video switching in accordance with the user's operation, neither the timing when the user's operation occurs nor the video of the switching destination is known. Therefore, to provide interactive video switching according to the user's operation by this technology, assuming all switching patterns such as switching operation occurrence timing, switching destination etc., prepare MPD files corresponding to all these patterns in advance. It must be done. It was practically difficult to prepare an MPD file corresponding to all such switching patterns.

  On the other hand, while reproducing the two moving images of the first moving image and the second moving image, the moving image reproduction apparatus 10 selects the moving image to be displayed on the display unit based on the time difference between the reproduction times. Therefore, the video playback device 10 can switch the video while securing the synchronization accuracy.

  In addition, the switching control unit 165 instructs the moving image reproduction unit 161 to reproduce the second moving image, and then the moving image reproduction unit 161 based on the time difference from when the moving image reproduction unit 161 starts the reproduction of the second moving image. Control synchronization in

  The time lag from when the reproduction request is made to when the reproduction is actually started depends on, for example, the performance of the computer system included in the moving image reproduction apparatus 10, the processing state, and the like. Therefore, by correcting the reproduction time based on the time lag, the moving picture reproduction apparatus 10 properly corrects the deviation of the reproduction time which occurs due to different factors for each moving picture reproduction apparatus 10, and the reproduction time of the first moving picture and the first reproduction time (2) It is possible to align the playback time of the moving image. Moreover, for example, compared with the case of correcting the playback time with a fixed time length, it is possible to make the playback time of the first moving image and the playback time of the second moving image uniform with relatively less processing.

  In addition, the video playback device 10 further includes a video determination unit 162 that determines a second video based on an input from the outside.

  Thereby, the moving image reproducing apparatus 10 can switch between a plurality of moving images while securing the synchronization accuracy based on the user's instruction.

  In addition, the second moving image is a moving image obtained by enlarging a part of the display region of the first moving image, and the moving image determination unit 162 determines the first moving image based on the input for selecting the inside of the display region of the first moving image being displayed. 2 Determine the movie.

  Thus, the user can display the moving image in which the selected area is enlarged by an intuitive operation of selecting the display area of the moving image.

  In addition, the selection method of a switching destination moving image is not limited to the aspect mentioned above. Specifically, for example, the moving image player 10 may select the switching destination moving image from the list of moving images displayed on the display unit 130 by using the pointing device. Also, the switching destination moving image may be assigned to the key of the keyboard.

  In addition, a 1st moving image and a 2nd moving image are not limited to the aspect mentioned above. Specifically, for example, the first moving image and the second moving image may be moving images of different resolutions. Also, for example, the contents of the first moving image and the second moving image may be different. Specifically, for example, the first moving image and the second moving image may be moving images captured from a plurality of different viewpoints, and may be moving images constituting a so-called multiview program. Also, for example, the first moving image and the second moving image may be moving images having mutually different time lengths.

  In addition, a program for realizing the functions of the above-described moving image reproducing apparatus 10 is recorded in a computer readable recording medium, and the computer system reads the program recorded in the recording medium and executes the program. The processing as 10 may be performed. Here, "to read and execute the program recorded on the recording medium into the computer system" includes installing the program on the computer system. The “computer system” mentioned here includes an OS and hardware such as peripheral devices.

  Also, the “computer system” may include a plurality of computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. The term "computer-readable recording medium" refers to a storage medium such as a flexible disk, a magneto-optical disk, a ROM, a portable medium such as a ROM or a CD-ROM, or a hard disk built in a computer system. As described above, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM. The recording medium also includes a recording medium provided internally or externally accessible from the distribution server for distributing the program.

  The code of the program stored in the recording medium of the distribution server may be different from the code of the program executable in the terminal device. That is, the format stored in the distribution server does not matter as long as it can be downloaded from the distribution server and installed in a form that can be executed by the terminal device. Note that the program may be divided into a plurality of parts, and the configuration may be such that the terminal device integrates after being downloaded at different timings, or the distribution server that distributes each of the divided programs may be different. Furthermore, "computer-readable recording medium" holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system serving as a server or a client when the program is transmitted via a network. We shall include things. Further, the program may be for realizing a part of the functions described above. Furthermore, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

  In addition, a part or all of the video playback device 10 in the above-described embodiment may be realized as an integrated circuit such as a large scale integration (LSI). Each functional unit of the video playback device 10 may be individually processorized, or part or all may be integrated and processorized. Further, the method of circuit integration is not limited to LSI's, and implementation using dedicated circuitry or general purpose processors is also possible. In the case where an integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology, integrated circuits based on such technology may also be used.

  As mentioned above, although one embodiment of this invention was described in detail with reference to drawings, a specific structure is not restricted to the above-mentioned thing, Various design changes etc. in the range which does not deviate from the summary of this invention It is possible to

DESCRIPTION OF SYMBOLS 1 movie distribution system 10 movie playback device 110 input unit 120 communication unit 130 display unit 140 audio output unit 150 storage unit 151 browser storage unit 152 web application storage unit 160 control unit 161 movie playback unit 162 movie determination unit 163 MPD acquisition unit 164 movie Acquisition unit 165 switching control unit 30 video distribution device N network

Claims (4)

A moving image reproduction unit that reproduces a first moving image and a second moving image respectively obtained by down-converting or dividing the same moving image ;
When the instruction to switch the display of the first moving image to the display of the second moving image is received, the moving image reproduction unit is controlled to start the reproduction of the second moving image, and the time position of the reproduction in the first moving image and the after the second controls the video reproduction unit to perform synchronization for aligning the time position of reproduction in the video, the time position of the first video playback and time position of the second video playback is synchronized, A switching control unit configured to switch a moving image to be displayed and output from the moving image reproduction unit from the first moving image to the second moving image;
Equipped with
The switching control unit instructs the moving image reproduction unit to reproduce the second moving image, and then the moving image reproduction unit is started based on a time difference from when the moving image reproduction unit starts reproduction of the second moving image. Controlling synchronization in order to align the time position of reproduction in the first moving image and the time position of reproduction in the second moving image ,
Video reproducing apparatus you wherein a. A moving image determination unit that determines the second moving image based on an external input;
The video playback apparatus according to claim 1 , further comprising: The second moving image is a moving image obtained by enlarging a part of the display area of the first moving image,
The moving image determination unit determines the second moving image based on an input for selecting the inside of the display area of the first moving image being displayed.
The video playback apparatus according to claim 2 , wherein On the computer
A first moving image reproduction step of reproducing a first moving image obtained by down-converting or dividing a predetermined moving image ;
A second moving image reproduction step of starting reproduction of the second moving image when an instruction to switch to display of a second moving image obtained by down-converting or dividing the predetermined moving image from display of the first moving image is received ;
A synchronization control step of controlling to perform synchronization for aligning the time position of reproduction in the second moving and the time position of reproduction in the first video,
After the time position of the first video playback and time position of the second video playback is synchronized, and a switching control step of switching the video to be displayed output from the first video to the second video,
A program for executing,
The time position of the reproduction in the first moving image and the time position of the reproduction in the second moving image are aligned based on the time difference from when the reproduction of the second moving image is instructed to the start of the reproduction of the second moving image Program to control synchronization.

Images