JP2012151688A - Video reproduction device and method of controlling the same, program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a technique of switching over to a suitable sound with ease depending on a result of changing a view point of a video in the case that a plurality of sounds exist in a video whose view point is switched over.SOLUTION: A video reproduction device reproducing video data and sound data received via a network, has: arbitrary view point video acquisition means acquiring arbitrary view point video data obtained by photographing at least one photographic area from a plurality of different view point positions, and sound data allocated for each photographic area; operation means accepting a change instruction of the view point position of the photographic area by a user; calculation means calculating the number of photographic areas in the arbitrary view point video photographed from the view point position changed by the operation means; and sound switching means selecting the sound data depending on a priority order decided for each arbitrary view point video in the case that, as a result of calculation by the calculation means, there are a plurality of sound data allocated for each of the plurality of photographic areas in the arbitrary view point video.

Description

  The present invention relates to a technique for receiving and reproducing digital broadcast waves and the like.

  Currently, by interpolating and reconstructing images at arbitrary viewpoint positions using multiple images (hereinafter referred to as multi-view images) obtained by shooting subjects from different viewpoint positions with multiple cameras, Research on arbitrary viewpoint video generation technology that generates video has been conducted.

  In addition, it is also considered that the arbitrary viewpoint video is actually serviced in cooperation with a standard video broadcast program. Patent Document 1 discloses a technology for switching between a standard video broadcast program and an arbitrary viewpoint video. Yes. Japanese Patent Laid-Open No. 2004-133867 generates the arbitrary viewpoint information when the user switches from the standard video to the arbitrary viewpoint video by transmitting the position of the standard video camera as metadata, and obtains the arbitrary viewpoint video from the information. Is.

  Patent Document 2 discloses a technique that allows a user to select and view desired video and audio from multi-view video and multi-view audio obtained by recording a subject from a plurality of directions using a plurality of cameras and a plurality of microphones. Is disclosed.

JP 2007-150747 A JP 2005-155952 A

  By using the above-described conventional technology, the user can freely change the viewpoint position and view a specific game or video or sound of a subject from a desired angle of view. For example, taking a sports broadcast as an example, you can always track and watch your favorite players and competitions. In addition, even in the case where a plurality of competitions proceed simultaneously in one stadium such as the Olympics, the competition areas can be freely switched and viewed at any time.

  However, when viewing an arbitrary viewpoint video in a location or direction arbitrarily specified by the user, if there are multiple audio data when switching audio according to the video viewpoint switching, which audio should be selected? There is a problem of not knowing.

  The present invention has been made in view of the above problems, and its purpose is to easily switch to a suitable sound according to the result of changing the viewpoint of the video when there are multiple sounds in the video whose viewpoint has been switched. It is to realize a possible voice switching technology.

  In order to solve the above problems and achieve the object, a video playback apparatus according to the present invention is a video playback apparatus that plays back video data and audio data received via a network, and at least one from a plurality of different viewpoint positions. Arbitrary viewpoint video data that captures one shooting area and audio data assigned to each shooting area, operation means that receives an instruction to change the viewpoint position of the shooting area by a user, Calculation means for calculating the number of shooting areas existing in an arbitrary viewpoint video shot from the viewpoint position changed by the operation means, and a plurality of shooting areas existing in the arbitrary viewpoint video as a result of calculation by the calculation means If there are multiple pieces of audio data assigned to each video, the audio data corresponding to the priority order determined for each arbitrary viewpoint video Having a voice switching means for selecting.

  According to the present invention, since the audio switching method changes according to the content of the arbitrary viewpoint video being viewed, the user can easily switch the audio. Further, it is possible to prevent switching to sound unrelated to the video being viewed.

The figure which illustrates the structure of the digital broadcast receiver of Embodiment 1 which concerns on this invention. FIG. 5 is a diagram illustrating a specific example of area information in the first embodiment. 5 is a flowchart showing arbitrary viewpoint video display processing including audio switching processing according to the first embodiment. 5 is a flowchart illustrating voice switching list creation processing according to the first embodiment. FIG. 6 is a diagram for explaining a coordinate calculation process of an angle of view area according to the first embodiment. The figure which shows a mode that the audio | voice switches when there is one competition area in the arbitrary viewpoint images | videos which the user is viewing as a specific example of the audio | voice switching process of Embodiment 1. FIG. The figure which shows a mode that the audio | voice when a plurality of competition areas exist in the arbitrary viewpoint image | video which the user is viewing as a specific example of the audio | voice switching process of Embodiment 1 switches. The figure which illustrates the structure of the digital broadcast receiver of Embodiment 2 which concerns on this invention. 9 is a flowchart illustrating arbitrary viewpoint video display processing including audio switching processing according to the second embodiment. 10 is a flowchart illustrating voice switching processing according to the second embodiment. The figure which illustrates the structure of the digital broadcast receiver of Embodiment 3 which concerns on this invention. 10 is a flowchart illustrating voice switching processing according to the third embodiment.

  The best mode for carrying out the present invention will be described in detail below. The embodiment described below is an example for realizing the present invention, and should be appropriately modified or changed according to the configuration and various conditions of the apparatus to which the present invention is applied. It is not limited to the embodiment. Moreover, you may comprise combining suitably one part of each embodiment mentioned later.

  [Embodiment 1] A digital broadcast receiving apparatus according to Embodiment 1 for realizing the video reproduction apparatus of the present invention will be described below.

  In the first embodiment, a configuration in which a standard video broadcast program is received by a digital broadcast wave and arbitrary viewpoint video data obtained by photographing a subject from different directions with a plurality of cameras will be described. In addition, the acquisition method and acquisition path | route of arbitrary viewpoint video data are not limited to the method demonstrated in this embodiment, The other method and path | route may be sufficient if the same information can be acquired.

  <Configuration of Digital Broadcast Receiving Apparatus> The configuration of the digital broadcast receiving apparatus according to the first embodiment will be described with reference to FIG.

  In FIG. 1, a digital broadcast receiving apparatus 100 receives a standard video broadcast from a broadcasting station, displays a block, receives arbitrary viewpoint video data, generates an arbitrary viewpoint video, and displays a block. And a block for switching voices in accordance with the change.

  Here, a block for receiving and displaying a standard video will be described.

  The digital broadcast receiving apparatus 100 receives a broadcast program broadcast from a digital broadcast station by the tuner unit 101.

  The remote control 116 and the remote control code reception / interpretation unit 115 interpret the input operation from the user, and send a channel selection instruction to the tuner unit 101 in the case of a channel channel selection instruction.

  The tuner unit 101 performs frequency tuning according to the set frequency information, receives a digital broadcast signal, and outputs the signal to the demodulation unit 102.

  The demodulator 102 performs processes such as demodulation and error correction on the input digital broadcast signal to form a transport stream (TS). Then, the TS is input to the TS processing unit 103.

  The TS processing unit 103 separates video, audio, program information, and the like from the input TS. Among the separated video data, the standard video is output to the standard video processing unit 106 to perform video decoding processing, and is sent to the video output unit 107. Also, the audio data is output to the audio processing unit 104, decoded, and sent to the audio output unit 105.

  The video output unit 107 converts the decoded video data into a display resolution, the number of display colors, a refresh rate, and a display timing suitable for a display unit (not shown), and outputs the converted data to a display unit (a monitor or the like) not shown. .

  The audio output unit 105 has a function of changing an output level (sound volume) of audio data and outputs audio data to a speaker or the like.

  Next, a block that receives arbitrary viewpoint video data and generates and displays an arbitrary viewpoint video will be described.

  When the TS processing unit 103 receives a user's instruction to display an arbitrary viewpoint video from the remote controller 116 and the remote control code reception / interpretation unit 115, the TS processing unit 103 sends the arbitrary viewpoint video data from the separated video data to the arbitrary viewpoint video generation unit 108. .

  The arbitrary viewpoint video generation unit 108 acquires viewpoint information such as a viewpoint position and a viewing angle from the viewpoint control unit 110, and generates an arbitrary viewpoint video from the viewpoint information and arbitrary viewpoint video data. Then, the video is sent to the video output unit 107.

  When the viewpoint control unit 110 receives an instruction to change from the standard video to an arbitrary viewpoint or an instruction to change the arbitrary viewpoint position from the remote control 116 and the remote control code reception / interpretation unit 115, the viewpoint control unit 110 uses the coordinate space acquired from the area information acquisition unit 109. The viewpoint information of the change destination is calculated and sent to the arbitrary viewpoint video generation unit 108.

  The video output unit 107 outputs the arbitrary viewpoint video sent from the arbitrary viewpoint video generation unit 108 so as to be displayed on a display unit (not shown).

  Next, a block for switching sound along with a change in viewpoint will be described.

  When the TS processing unit 103 receives a user's instruction to display an arbitrary viewpoint video from the remote control 116 and the remote control code reception / interpretation unit 115, the TS processing unit 103 sends program information to the area information acquisition unit 109.

  When the viewpoint control unit 110 receives an instruction to determine the position of the viewpoint of the arbitrary viewpoint video through the remote control 116 and the remote control code reception / interpretation unit 115, the viewpoint control unit 110 sends the viewpoint information to the area number calculation unit 111.

  The area information acquisition unit 109 acquires area information within a range displayed on an arbitrary viewpoint video from the acquired program information. In the present embodiment, description will be made assuming that coordinate information as shown in FIG. 2 is acquired as area information. FIG. 2 is a view of the stadium viewed from directly above (view of the XY plane from the Z-axis direction), and a coordinate space centered on the origin (X coordinate, Y coordinate, Z coordinate = 0, 0, 0). Is shown. Also, in this example, information indicating the audio streams corresponding to the coordinates of the three competition areas (shooting areas) and the competition item names in each area is also included.

  The area number calculation unit 111 receives the viewpoint information from the viewpoint control unit 110 and the area information from the area information acquisition unit 109, and calculates the number of competition areas shown in the arbitrary viewpoint video that the user is viewing.

  The audio switching control unit 112 performs audio switching according to the number of competition areas received from the area number calculation unit 111. When the number of competition areas is one, it receives area information from the area information acquisition unit 109 and instructs the tuner unit 101 to receive an audio stream corresponding to the area. On the other hand, when there are a plurality of areas, a voice switching list creation request is sent to the voice switching list creation unit 113. Then, the voice switching list display control unit 114 performs control so that the list created by the voice switching list creation unit 113 is displayed on the display screen so that the user can select it. The audio switching control unit 112 receives information on the audio stream selected by the user from the displayed list from the remote control code receiving unit, and instructs the tuner unit 101 to receive the audio stream.

  The audio switching list creation unit 113 receives area information from the area information acquisition unit 109, acquires the number of competition areas being viewed and the competition item names from the area number calculation unit 111, and lists audio streams corresponding to the competition areas Create Then, a list display request is sent to the voice switching list display control unit 114. In addition, the priority setting of how the list is arranged is received from the user through the remote control 116 and the remote control code reception / interpretation unit 115, and the list is rearranged according to the setting.

  <Arbitrary viewpoint video display processing> Next, the arbitrary viewpoint video display processing and audio switching processing of the first embodiment will be described with reference to FIGS.

  In FIG. 3, the digital broadcast receiving apparatus 100 first outputs standard video and standard audio broadcast from a digital broadcasting station to a display unit, a speaker, etc. (not shown) (S101, S102).

  Next, it is determined whether or not there is an instruction to change to an arbitrary viewpoint video from the user through the remote controller 116 and the remote control code reception / interpretation unit 115 (S103).

  If there is a change instruction, the area information of the arbitrary viewpoint video is acquired from the program information (S104).

  Next, an arbitrary viewpoint video is generated from the arbitrary viewpoint video data and the viewpoint information of the arbitrary viewpoint (S105). In the present embodiment, the arbitrary viewpoint video data is data for generating an arbitrary viewpoint video based on the coordinates of FIG. Also, viewpoint information of an arbitrary viewpoint is calculated on the coordinate space of FIG.

  Subsequently, the generated arbitrary viewpoint video is displayed (S106). In steps S105 and S106, an arbitrary viewpoint video is generated by the digital broadcast receiving device. However, an arbitrary viewpoint video generated by another server or the like acquiring viewpoint information by a user or the like is received by the digital broadcast receiving device. It may be displayed. That is, the arbitrary viewpoint video generation unit 108 may be provided outside.

  Next, it is determined whether the viewpoint position of the arbitrary viewpoint has been determined by the user (S107).

  If determined, the number of competition areas in the arbitrary viewpoint video viewed by the user is calculated (S108). The number of competition areas is calculated from viewpoint information such as the position of the viewpoint and the viewing angle. Details will be described later.

  Next, as a result of the calculation, it is determined whether the number of competition areas is one or more (number of areas> 1) (S109).

  As a result of the determination, if the number of competition areas is one, information indicating an audio stream corresponding to the area is acquired (S110), and the sound is switched to be output (S111).

  On the other hand, when there are a plurality of competition areas, an audio switching list is created (S112). Details will be described with reference to FIG.

  Next, a voice switching list is displayed (S113), and it is determined whether the user switches voices (S114).

  When switching, it switches to the voice selected by the user from the voice switching list and outputs (S115).

  Next, it is determined whether the user has performed an operation to end the arbitrary viewpoint video (S116). When the process ends, the process proceeds to S101. When the process does not end, it is determined whether the viewpoint position of the arbitrary viewpoint has been changed by the user (S117).

  If the viewpoint has not been changed, the process proceeds to S112. If the viewpoint has been changed, the process proceeds to S105.

  Next, a voice switching list creation process executed by the voice switching list creation unit 113 will be described with reference to FIG.

  In FIG. 4, the audio switching list creation unit 113 first acquires the number of competition areas in the arbitrary viewpoint video being viewed and the competition name (S201).

  Next, the list creation method is changed according to the order of priority of the voice switching list set by the user (S202).

  When the priority setting is such that a competition area with a short distance from the current viewpoint position is preferentially arranged in the list, the distance to each competition area of the viewpoint position and the acquired competition name is calculated (S203).

  And the audio | voice switching list which arranged the audio | voice stream name corresponding to each competition area in order with a short distance is produced (S204).

  On the other hand, when the priority areas are arranged in the list with priority given to the competition areas with a high proportion of the area displayed in the arbitrary viewpoint video, the entire area area for each competition area is calculated for each acquired competition name. (S205).

  Further, the area shown in the arbitrary viewpoint video being viewed is calculated for each area (S206), and the ratio is calculated by dividing the area by the total area area calculated for each competition area (S206). S207).

  And the audio | voice switching list which arranged the audio | voice stream name corresponding to each competition area in order with a high ratio is produced (S208).

  Next, a method for calculating the number of competition areas calculated by the area number calculation unit 111 will be described.

  The area number calculation unit 111 acquires coordinate information from the area information acquisition unit 109. The coordinate information is composed of a three-dimensional coordinate space (X axis, Y axis, Z axis). Further, viewpoint information such as the position of the viewpoint and the viewing angle calculated in the coordinate space is acquired from the viewpoint control unit 110. From these pieces of information, the coordinates of the field angle area of the arbitrary viewpoint video that the user is viewing can be calculated. Therefore, since the competition area included in the angle of view area can be determined from the coordinates and the coordinates of the competition area, the number of the competition areas reflected in the arbitrary viewpoint video can be obtained.

With reference to FIG. 5, a method for obtaining the coordinates of the view angle region will be described. FIG. 5A illustrates the position and viewing angle of an arbitrary viewpoint in the coordinate space of the X axis and the Z axis. X1 and Z1 indicate viewpoint positions on the X-axis and the Z-axis, respectively. ΘX is an angle from the Z axis to the field of view in the XZ plane, and φX represents a field angle. Xα and Xβ are the X coordinates of the field angle region of an arbitrary viewpoint. Coordinates can be calculated by the following formulas 1 and 2, respectively.

Xα = X1 + Z1 × tan θX (1)
Xβ = X1 + Z1 × tan (θX + φX) (2)

Similarly, also in FIG. 5B, in the coordinate space of the Y axis and the Z axis, Yα and Yβ that are the Y coordinates of the field angle region can be calculated by the following equations 3 and 4.

Yα = Y1 + Z1 × tan θY (3)
Yβ = Y1 + Z1 × tan (θY + φY) (4)

From the coordinate values of Xα, Xβ, Yα, and Yβ calculated as described above, the area surrounded by the intersection of the coordinates as shown in FIG. The angle of view area.

  FIGS. 6 and 7 show a state where the sound is switched when one or a plurality of competition areas exist in the arbitrary viewpoint video that the user is viewing as a specific example of the sound switching process of the first embodiment. As shown in the drawing, the audio switching list is displayed (superimposed) together with the standard video and the arbitrary viewpoint video.

  In FIG. 6, since there is one competition area, it can be determined that the user is watching a medium-distance run. Therefore, the audio stream is automatically switched to the middle-distance running audio stream and output.

  On the other hand, in FIG. 7, since there are three competition areas in the arbitrary viewpoint video, the user can select the audio stream by displaying the audio switching list. And it switches to the audio | voice of the selected competition and is output.

  FIG. 7A shows an example in which the competition names in the audio switching list are arranged in the order of short distance from the viewpoint position of the arbitrary viewpoint. FIG. 7B is an example in which the areas are arranged in the descending order of the area area shown in the arbitrary viewpoint video calculated for each competition area.

  By the series of processes described above, when an audio stream is assigned to each area, it is possible to easily switch to an appropriate audio according to a change in the viewpoint position of the user.

  The present invention is not limited to the contents of area information, the acquisition method, and the coordinate calculation method described as the first embodiment, and the priority of the arrangement of the audio switching lists is the distance from the viewpoint and the area area. It is not limited to.

  In the above-described embodiment, the competition area having a certain area and the sound are associated with each other. However, a point (shooting point) where the sound is recorded instead of the competition area may be used. . In this case, the list of “area area priority” is not created in S112 of FIG. 3 (voice switching list creation processing of FIG. 4).

  Also, in S109 of FIG. 3, when there are a plurality of competition areas (audio recording points) within the angle of view of the video to be viewed, the audio switching list is not necessarily displayed. That is, it may be configured to automatically switch to the one with the highest priority when creating the list (sound that is closer to the viewpoint if distance priority is given, or voice that has a wider area if area priority is given).

  [Second Embodiment] Next, a second embodiment will be described. In addition, below, the description which overlaps with Embodiment 1 is abbreviate | omitted.

  In the first embodiment, the sound is switched after the viewpoint position of the arbitrary viewpoint is determined. However, in the second embodiment, the sound is switched during the movement of the viewpoint. That is, in Embodiment 2, when the user moves the viewpoint position of an arbitrary viewpoint, the number of competition areas reflected in the arbitrary viewpoint video is calculated every time a certain distance is moved, and the number of competition areas is calculated. Change the sound accordingly.

  <Apparatus Configuration> The configuration of the digital broadcast receiving apparatus according to the second embodiment will be described with reference to FIG.

  In FIG. 8, when the viewpoint control unit 210 receives an instruction to change the position of an arbitrary viewpoint through the remote controller 216 and the remote control code reception / interpretation unit 215, the viewpoint control unit 210 obtains the destination viewpoint information from the coordinate space acquired from the area information acquisition unit 209. calculate. Then, the information is sent to the arbitrary viewpoint video generation unit 208, and the viewpoint information before the change and the viewpoint information after the change are sent to the viewpoint movement distance calculation unit 217. When the viewpoint movement distance calculation unit 217 notifies that the movement distance of the viewpoint has exceeded a predetermined threshold, the viewpoint information is sent to the area number calculation unit 111 in order to switch the sound.

  The viewpoint movement distance calculation unit 217 calculates the movement distance from the position coordinates of the viewpoint using the viewpoint information before and after the viewpoint change sent from the viewpoint control unit 210, and further accumulates the movement distance. Then, when the accumulated value of the movement distance exceeds a predetermined threshold value, the viewpoint control unit 210 is notified.

  <Arbitrary viewpoint video display processing> Next, the arbitrary viewpoint video display processing and audio switching processing of the second embodiment will be described with reference to FIGS. Note that S301 to S306 and S314 in FIG. 9 are the same as S101 to S106 and S116 in FIG.

  In FIG. 9, after the arbitrary viewpoint video is displayed in S306, it is determined whether the viewpoint position of the arbitrary viewpoint has been moved by the user (S307), and if moved, the viewpoint moving distance is calculated (S308).

  If the moving distance exceeds a predetermined threshold value, voice switching processing is performed (S310). On the other hand, if the movement distance does not exceed the predetermined threshold, the movement distance is accumulated (S311).

  Next, when the movement of the arbitrary viewpoint is completed and an instruction to determine the viewpoint position is received from the user (S312), a voice switching process is performed as in S310 (S313).

  Next, the voice switching process in S310 and S313 in FIG. 9 will be described. Note that the processes other than S409 in FIG. 10 are the same as S108 to S115 in FIG.

  In FIG. 10, since the voice is switched in S409, the viewpoint movement distance calculated in S308 is reset to “0”.

  With the series of processes as described above, even when the user is moving the viewpoint position of an arbitrary viewpoint, the sound can be easily switched.

  [Third Embodiment] Next, a third embodiment will be described.

  The third embodiment receives and displays multi-view video captured at a plurality of viewpoint positions with digital broadcast waves, and switches audio according to the number of audio streams corresponding to the multi-view video.

  <Apparatus Configuration> The configuration of the digital broadcast receiving apparatus according to the third embodiment will be described with reference to FIG.

  In FIG. 11, the digital broadcast receiving apparatus 300 includes a block that receives and displays a standard video and a multi-view video broadcast from a broadcasting station, and a block that switches audio in response to a change in the multi-view video to be displayed. .

  Here, a block for receiving and displaying standard video and multi-view video will be described.

  The digital broadcast receiving apparatus 300 receives a broadcast program broadcast from a digital broadcast station by the tuner unit 301.

  The remote control 313 and the remote control code reception / interpretation unit 312 interpret the input operation from the user, and send a channel selection instruction to the tuner unit 301 in the case of a channel channel selection instruction. Also, an instruction to switch between standard video and multi-view video is sent out.

  The tuner unit 301 tunes the frequency according to the set frequency information, receives a digital broadcast signal, and outputs the signal to the demodulation unit 302.

  The demodulator 302 performs processing such as demodulation and error correction on the input digital broadcast signal, forms a transport stream (TS), and sends the transport stream (TS) to the TS processor 303.

  The TS processing unit 303 separates standard video, multi-view video, audio, program information, and the like from the input TS.

  Among the separated video data, the standard video and the multi-view video are output to the video processing unit 305 to perform video decoding processing and are sent to the video output unit 307. Also, the audio data is output to the audio processing unit 304, decoded, and sent to the audio output unit 306.

  The video output unit 307 converts the decoded video data into display data and timing suitable for the display resolution, the number of display colors, and the refresh rate, and performs video display.

  The audio output unit 306 has a function of changing the output level (volume) of audio data.

  Next, a description will be given of a block for switching audio in accordance with a change in the multi-view video to be displayed.

  The remote control 313 and the remote control code reception / interpretation unit 312 send an instruction to the tuner unit 301 so as to select one from a plurality of multi-view images. Also, a voice switching instruction is sent to the voice switching control unit 309.

  The audio information acquisition unit 308 acquires audio information corresponding to the multi-view video selected from the program information, and extracts the number of audio streams.

  The audio switching control unit 309 performs audio switching according to the number of audio streams acquired by the audio information acquisition unit 308. When the number of audio streams is one, the tuner unit 301 is instructed to receive the audio streams. On the other hand, when the number of audio streams is plural, a request for creating an audio switching list is sent to the audio switching list creating unit 310. Then, the audio switching list display control unit 311 receives information on the audio stream selected by the user, and instructs the tuner unit 301 to receive the audio stream.

  The voice switching list creation unit 310 obtains the number of voice streams and the voice name from the voice information acquisition unit 308 and creates a list of voice streams. Then, a list display request is sent to the voice switching list display control unit 311.

  The voice switching list display control unit 311 controls the voice switching list generated by the voice switching list creation unit 310 to be displayed on the display screen, and waits for a voice selection instruction from the user. When the user's voice selection instruction is received from the remote control 313 and the remote control code reception / interpretation unit 312, information on the selected audio stream is sent to the audio switching control unit 309.

  <Multi-View Video Display Processing> Next, with reference to FIG. 12, multi-view video display processing and audio switching processing according to the third embodiment will be described.

  In FIG. 12, the digital broadcast receiving apparatus 300 first outputs standard video and standard audio broadcast from a digital broadcast station (S501, S502).

  Next, it is determined whether or not there is an instruction to change to the multi-view video from the user (S503).

  If there is a change instruction, one video of the multi-view video is selected (S504).

  Subsequently, the selected multi-view video is displayed (S505).

  Next, the number of audio streams corresponding to the selected multi-view video is extracted (S506).

  Next, it is determined whether the number of extracted audio streams is one or more (the number of audio streams> 1?) (S507).

  If the number of audio streams is one, the audio is switched and output (S508).

  On the other hand, if the number of extracted audio streams is plural, an audio switching list is created (S509).

  Next, a voice switching list is displayed (S510), and it is determined whether the user switches voices (S511).

  When switching, it switches to the voice selected by the user from the voice switching list and outputs (S512).

  Next, it is determined whether or not an operation for returning to the standard video has been performed by the user (S513). If the user returns, the process proceeds to S501.

  If not returned, it is determined whether or not the multi-view video has been changed by the user (S514). If not changed, the process proceeds to S513. If the multi-view video has been changed, the process proceeds to S505.

  Through a series of processes as described above, it is possible to easily switch to an appropriate sound in accordance with a multi-view video channel selection operation.

  In each of the above-described embodiments, the example in which the present invention is applied to a digital broadcast receiving apparatus has been described. However, the present invention is not limited to this. That is, the same effect as the present invention can be obtained by applying the present invention when a plurality of audio data exists for one video content in a video playback apparatus that acquires video content via a network. Further, an example in which one audio data is associated with one competition area has been described, but a plurality of audio data may be associated with one competition area. In this case, an audio switching list is created even if there is one competition area included in the arbitrary viewpoint video.

  [Other Embodiments] The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads and executes the program code. It is processing to do. In this case, the program and the storage medium storing the program constitute the present invention.

Claims (18)

A video playback device for playing back video data and audio data received via a network,
Acquisition means for acquiring arbitrary viewpoint video data obtained by imaging at least one imaging area from different viewpoint positions, and audio data assigned to each imaging area;
Operation means for accepting an instruction to change the viewpoint position of the shooting area by the user;
Calculating means for calculating the number of shooting areas existing in an arbitrary viewpoint video shot from the viewpoint position changed by the operation means;
As a result of the calculation by the calculation means, when there are a plurality of audio data assigned to each of a plurality of shooting areas existing in the arbitrary viewpoint video, the audio data corresponding to the priority order determined for each arbitrary viewpoint video is selected. And an audio switching means.   2. The video reproduction apparatus according to claim 1, wherein when the number of shooting areas calculated by the calculation unit is one, the audio switching unit automatically switches to audio data assigned to the shooting area. .   2. The video reproducing apparatus according to claim 1, wherein the calculating unit calculates the number of shooting areas in the video determined by an angle of view at the viewpoint position of the shooting area changed by the operation unit.   2. The video reproduction apparatus according to claim 1, wherein the priority order is determined in order of increasing distance from the viewpoint position or increasing area of the photographing area.   5. The video reproduction apparatus according to claim 4, further comprising display means for selectively displaying an audio switching list in which a plurality of audio data for each shooting area are arranged according to the priority order. A determination unit for determining whether the viewpoint position designated by the user via the operation unit is moving;
The display means creates and displays an audio switching list according to the number of shooting areas present in the arbitrary viewpoint video calculated by the calculation means every time the viewpoint position moves by a predetermined distance. The video reproduction apparatus according to claim 1. A change means for changing from the arbitrary viewpoint video to a multi-view video;
The calculating means calculates the number of audio data corresponding to the multi-view video;
2. The video reproduction apparatus according to claim 1, wherein the display unit creates and displays an audio switching list according to the number of audio data corresponding to the multi-view video. A video playback device for playing back video data and audio data received via a network,
Acquisition means for acquiring arbitrary viewpoint video data obtained by shooting at least one shooting point from different viewpoint positions, and audio data assigned to each shooting point;
Operation means for accepting an instruction to change the viewpoint position of the shooting point by the user;
Calculating means for calculating the number of shooting points present in an arbitrary viewpoint video shot from the viewpoint position changed by the operation means;
As a result of the calculation by the calculation means, when there are a plurality of audio data assigned to each of a plurality of shooting points existing in the arbitrary viewpoint video, the audio data corresponding to the priority order determined for each arbitrary viewpoint video is selected. And an audio switching means.   9. The video reproduction apparatus according to claim 8, wherein when the number of shooting points calculated by the calculation unit is one, the audio switching unit automatically switches to audio data assigned to the shooting point. .   9. The video reproduction apparatus according to claim 8, wherein the calculation unit calculates the number of shooting points in the video determined by an angle of view at the viewpoint position of the shooting point changed by the operation unit.   9. The video reproduction apparatus according to claim 8, wherein the priority order is determined in order of increasing distance from the viewpoint position.   12. The video reproduction apparatus according to claim 11, further comprising display means for selectively displaying an audio switching list in which a plurality of audio data for each shooting point are arranged according to the priority order. A determination unit for determining whether the viewpoint position designated by the user via the operation unit is moving;
The display means creates and displays an audio switching list according to the number of shooting points present in the arbitrary viewpoint video calculated by the calculation means each time the viewpoint position moves by a predetermined distance. The video reproduction apparatus according to claim 8. A change means for changing from the arbitrary viewpoint video to a multi-view video;
The calculating means calculates the number of audio data corresponding to the multi-view video;
9. The video reproduction apparatus according to claim 8, wherein the display unit creates and displays an audio switching list according to the number of audio data corresponding to the multi-view video. A control method of a video playback device for playing back video data and audio data received via a network,
An acquisition step of acquiring arbitrary viewpoint video data obtained by shooting at least one shooting area from different viewpoint positions, and audio data assigned to each shooting area;
An operation step of receiving an instruction to change the viewpoint position of the shooting area by the user;
A calculation step of calculating the number of shooting areas existing in an arbitrary viewpoint video shot from the viewpoint position changed by the operation step;
As a result of the calculation in the calculation step, when there are a plurality of audio data assigned to each of a plurality of shooting areas existing in the arbitrary viewpoint video, the audio data corresponding to the priority order determined for each arbitrary viewpoint video is selected. And a voice switching step for controlling the video reproduction apparatus. A control method of a video playback device for playing back video data and audio data received via a network,
An acquisition step of acquiring arbitrary viewpoint video data obtained by imaging at least one shooting point from different viewpoint positions and audio data assigned to each shooting point;
An operation step of receiving an instruction to change the viewpoint position of the shooting point by the user;
A calculation step of calculating the number of shooting points present in an arbitrary viewpoint video shot from the viewpoint position changed by the operation step;
As a result of the calculation in the calculation step, when there are a plurality of audio data assigned to each of a plurality of shooting points existing in the arbitrary viewpoint video, the audio data corresponding to the priority order determined for each arbitrary viewpoint video is selected. And a voice switching step for controlling the video reproduction apparatus.   The program for functioning a computer as each means of the video reproduction apparatus of any one of Claims 1 thru | or 14.   A computer-readable storage medium storing a program for causing a computer to function as each unit of the video playback device according to claim 1.