WO2018070092A1 - Information provision device, information provision method, information reproduction device and information reproduction method - Google Patents

Abstract

An information provision device 30 uses a video material and an audio material that are acquired from a sensor device 20 to generate provision information that enables the movement of a viewpoint during reproduction. Moreover, the information provision device 30 associates, with the provision information, viewpoint switching information for switching the reproduction of the provision information to specific viewpoint reproduction. An information reproduction device 40 performs viewpoint switching from free viewpoint reproduction to specific viewpoint reproduction on the basis of the viewpoint switching information when the provision information is reproduced. Thus, an information provider, by associating the viewpoint switching information about a specific viewpoint for presenting intended video and the like with the presented information, is enabled to present the video and the like intended by the information provider to a user even when the user is reproducing the presented information from a free viewpoint.

Description

Information providing apparatus, information providing method, information reproducing apparatus, and information reproducing method

This technology relates to an information providing apparatus, an information providing method, an information reproducing apparatus, and an information reproducing method, and enables the information provider to switch to reproduction of a specific viewpoint intended by the information provider when reproducing the provided information from a free viewpoint.

Conventionally, in video playback, a video of a desired viewpoint is selected and provided from a video of an arbitrary viewpoint. For example, in Patent Document 1, one of the most watched video materials among a plurality of video materials created from different viewpoints is selected and delivered to the viewer. In Patent Document 2, when any one of a plurality of videos taken from different viewpoints by a plurality of users is distributed to a terminal device, the first video requested by the terminal device is one of the plurality of videos. During distribution to the terminal device, transmission of the second video that is likely to be requested next from the terminal device to the terminal device is started.

JP 2013-175888 A Japanese Unexamined Patent Publication No. 2016-010145

By the way, although the cited document 1 and the cited document 2 are techniques for presenting information provided by selection to a user, in recent years, viewing the provided information from a free viewpoint has been performed. For example, according to the movement of the user wearing the head mounted display, the video presented to the user is changed to the video of the viewpoint moved in accordance with the movement of the user. When viewing with such a free viewpoint, if the user is viewing while paying attention to a specific subject, for example, an important scene is not included in the presented video, and an important scene is missed. Occurs. In addition, when viewing is performed from a free viewpoint, for example, an image intended by an information provider is not always presented to the user.

Therefore, this technology provides an information providing apparatus, an information providing method, an information reproducing apparatus, and an information reproducing method capable of switching the reproduction of a free viewpoint to the reproduction of a specific viewpoint.

The first aspect of this technology is
The information providing apparatus includes an information processing unit that associates viewpoint switching information for switching the reproduction of the provision information to reproduction of a specific viewpoint with the provision information whose viewpoint at the time of reproduction is movable.

In this technique, viewpoint switching information is associated by the information processing unit with presentation information whose viewpoint at the time of reproduction is movable, such as video content or video content and audio content. The viewpoint switching information is information for switching the reproduction of the provided information to the reproduction of the specific viewpoint. The priority of the specific viewpoint, the viewing area information indicating the specific viewpoint viewing area viewed at the specific viewpoint, and the application area to which the viewpoint switching information is applied. The second aspect of this technology regarding information, time information indicating switching time to a specific viewpoint, and provided information
Associating viewpoint switching information for switching playback of the provided information to playback of a specific viewpoint in the information processing unit with respect to the provided information whose viewpoint at the time of playback is movable;
And outputting the provision information associated with the viewpoint switching information from an output unit.

The third aspect of this technology is
Playback that switches from playback of the free viewpoint of the provided information to playback of the specific viewpoint based on viewpoint switching information that switches playback of the provided information associated with the provided information whose viewpoint at the time of playback is movable to playback of the specific viewpoint The information reproducing apparatus includes a control unit.

In this technology, the playback control unit switches from playback of a free viewpoint of provided information to playback of a specific viewpoint based on viewpoint switching information associated with the provided information whose viewpoint at the time of playback is movable. The viewpoint switching information is information for switching the reproduction of the provided information to the reproduction of the specific viewpoint, and the reproduction control unit is specified when the priority of the specific viewpoint included in the viewpoint switching information is equal to or higher than a preset switching threshold. Switch to viewpoint playback. In addition, when the priority of the specific viewpoint included in the viewpoint switching information is equal to or higher than a predetermined switching confirmation threshold, the playback control unit makes an inquiry about switching to the specific viewpoint to the viewer of the provided information, When a switching instruction is received, switching to a specific viewpoint is performed. The playback control unit also switches the viewpoint when the application area information to which the viewpoint switching information is applied is included in the viewpoint switching information, and the viewpoint being reproduced of the provided information is within the area indicated by the application area information. Switch to a specific viewpoint based on information. In addition, when the time information indicating the switching time to the specific viewpoint is included in the viewpoint switching information, the reproduction control unit performs switching to the specific viewpoint based on the viewpoint switching information when the switching time is reached. Further, the reproduction control unit collates the attribute information related to the provided information included in the viewpoint switching information with information registered in advance, and performs switching to a specific viewpoint based on the collation result. Further, after switching to the specific viewpoint, the reproduction control unit can move the viewpoint from the specific viewpoint, restrict the viewpoint movement from the specific viewpoint, or fix the viewpoint to the specific viewpoint.

The fourth aspect of this technology is
Playback control from playback of the free viewpoint of the provided information to playback of the specified viewpoint based on viewpoint switching information for switching the playback of the provided information associated with the provided information whose viewpoint at the time of playback is movable to playback of the specific viewpoint The information reproduction method includes switching in a section.

According to this technique, the viewpoint switching information for switching the reproduction of the provided information to the reproduction of the specific viewpoint is associated with the provided information whose viewpoint at the time of reproduction is movable. For this reason, even if the provided information is reproduced from a free viewpoint, it is possible to switch to reproduction of a specific viewpoint by the viewpoint switching information. Note that the effects described in the present specification are merely examples and are not limited, and may have additional effects.

It is the figure which illustrated the composition of the information presentation system. It is the figure which illustrated the composition of the information service device. It is the figure which illustrated the structure of the information reproduction apparatus. It is a figure for demonstrating viewpoint switching information. It is a figure for demonstrating specific viewpoint area | region information (in the case of three dimensions). It is a figure for demonstrating specific viewpoint area | region information (in the case of two dimensions). It is the flowchart which illustrated operation | movement of the information provision apparatus. It is the flowchart which illustrated operation | movement of the information reproduction apparatus. It is the sequence diagram which illustrated operation | movement of the information presentation system. It is the figure which showed the example of reproduction | regeneration operation | movement of the free viewpoint information which shows a performance hall. It is the figure which showed the reproduction | regeneration operation example of the free viewpoint information which shows a stadium. It is the figure which showed the example of reproduction | regeneration operation | movement of a spherical image.

Hereinafter, embodiments for carrying out the present technology will be described. The description will be given in the following order.
1. 1. Configuration of information presentation system 2. Viewpoint switching information 3. Operation of information providing device 4. Operation of information reproducing apparatus 5. Playback operation using viewpoint switching information Reproduction operation example 7. Other playback operations

<1. Configuration of information presentation system>
FIG. 1 illustrates the configuration of the information presentation system. The information presentation system 10 includes a sensor device 20, an information providing device 30, an information reproducing device 40, a display device 51, and an audio output device 52. The sensor device 20 acquires video and audio material information and outputs the information to the information providing device 30. The information providing device 30 generates the provided information to be provided to the information reproducing device 40 using the material information acquired by the sensor device 20 and outputs the generated provided information. The information reproducing device 40 extracts information to be viewed from a desired viewpoint from the provided information, and generates a video output signal and an audio output signal based on the extracted information. Further, the information reproducing device 40 outputs the generated video output signal to the display device 51 to present a video of a desired viewpoint. In addition, the information reproducing device 40 outputs the generated audio output signal to the audio output device 52 and presents audio corresponding to a desired viewpoint.

The sensor device 20 is configured using an imaging device, a microphone, and the like, and acquires video information and audio information and outputs them to the information providing device 30. The imaging device that acquires the video information may be configured by a plurality of imaging devices that capture images from different viewpoint positions, for example, an imaging device equipped with a special lens capable of photographing the omnidirectional sphere. A device such as a depth camera that can acquire depth information or a lidar (LIDAR) that can perform three-dimensional surveying may be used. Furthermore, the sensor device 20 is a sensor that acquires information that can be used to generate viewpoint switching information, which will be described later, in the information providing device 30, for example, a sensor that detects the number of people in the venue where the imaging device is provided, You may use the sensor etc. which detect. The sensor device 20 outputs the acquired material information and the like to the information providing device 30.

FIG. 2 illustrates the configuration of the information providing apparatus. The information providing apparatus 30 includes an information input unit 31, an information processing unit 32, and an information output unit 33. The information input unit 31 acquires material information and the like from the sensor device 20 and outputs them to the information processing unit 32.

The information processing unit 32 has a free viewpoint information generation function and a viewpoint switching information generation addition function. The free viewpoint information generation function is free viewpoint information that is provided information to the information reproducing apparatus 40 from video information or audio information of one or more viewpoints acquired from the sensor device 20, for example, free viewpoint video information or free viewpoint audio information. It is a function to generate. The free viewpoint video information is, for example, three-dimensional model data composed of meshes and textures generated by three-dimensional reconstruction using video information acquired from the sensor device 20. The free-viewpoint video information may be video information obtained by morphing an intermediate video between multi-viewpoint videos, or a different system. Furthermore, the free viewpoint video information is a wide-angle video such as a omnidirectional video, and the information playback device 40 is a video of a desired viewpoint that is a part of the video provided from the information providing device 30. May be video information that can be presented. Free viewpoint audio information is audio information for presenting audio corresponding to the user's viewpoint position. That is, by using the free viewpoint audio information, when the user's viewpoint is moved, the audio presented to the user changes to the audio corresponding to the viewpoint according to the movement of the viewpoint. As free viewpoint audio information, audio information that presents sound that can be heard from a fixed viewpoint as in the past may be used, and audio information that can present sound that can be heard from a free viewpoint and sound that can be heard from a fixed viewpoint are presented. The audio information to be played may be included in the free viewpoint audio information. The information processing unit 32 outputs the generated free viewpoint information (free viewpoint video information and / or free viewpoint audio information) to the information output unit 33.

The viewpoint switching information generation / addition function is a function that generates viewpoint switching information that is metadata relating to viewpoint switching to a priority viewpoint and associates it with free viewpoint video information and free viewpoint audio information. Details of the viewpoint switching information will be described later. The information processing unit 32 outputs the viewpoint switching information generated based on the instruction information from the information provider to the information output unit 33. Further, as the viewpoint switching information, several viewpoint switching information may be generated at the same time. For example, when there are a plurality of viewpoints that have priority over the free viewpoint information, the viewpoint switching information is generated by the number of priority viewpoints.

The information output unit 33 associates the free viewpoint information generated by the information processing unit 32 and the viewpoint switching information and outputs the information to the information reproducing device 40. The association between the free viewpoint information and the viewpoint switching information only needs to be able to use the viewpoint switching information when reproducing the free viewpoint information. For example, the information output unit 33 multiplexes the viewpoint switching information with the encoded data generated by performing the encoding process of the free viewpoint information, and outputs the multiplexed information to the information reproducing device 40. Further, the viewpoint switching information may be added to the encoded data as tag information and output to the information reproducing device 40. Further, the information providing apparatus 30 may be configured to output the encoded data and the viewpoint switching information individually to the information reproducing apparatus 40 and use the viewpoint switching information associated with the reproduction of the encoded data. Further, the information providing apparatus 30 may be configured to associate the free viewpoint information and the viewpoint switching information via the recording medium or the like and provide them to the information reproducing apparatus 40.

FIG. 3 illustrates the configuration of the information reproducing apparatus. The information reproduction apparatus 40 includes an information acquisition unit 41, a reproduction control unit 42, a video / audio output unit 43, a communication unit 44, and a user interface unit 45.

The information acquisition unit 41 acquires the free viewpoint information (provided information) and the viewpoint switching information associated with the free viewpoint information from the information providing apparatus 30 via the communication line or the recording medium, and acquires the acquired free viewpoint information and the viewpoint. The switching information is output to the reproduction control unit 42.

The playback control unit 42 selects or extracts video information of a viewpoint designated by the user based on an operation signal from the user interface unit 45 and outputs the selected video information to the video / audio output unit 43. Further, the playback control unit 42 selects or synthesizes audio information corresponding to the designated viewpoint and outputs it to the video / audio output unit 43. Further, the playback control unit 42 determines viewpoint switching based on the viewpoint switching information and the user information stored in the playback control unit 42, selects viewpoint video information and audio information according to the determination result, and the like. Output to the video / audio output unit 43.

The video / audio output unit 43 generates a video output signal of a predetermined format based on the video information output from the playback control unit 42. Further, the video / audio output unit 43 generates an audio output signal based on the audio information output from the reproduction control unit 42. The video / audio output unit 43 outputs the generated video output signal to the display device 51, and outputs the generated audio output signal to the audio output device 52.

The communication unit 44 communicates with the information providing apparatus 30 and requests the information providing apparatus 30 for free viewpoint information desired by the user. The user interface unit 45 is configured using at least one of an operation switch, a touch panel, a sensor that detects a user's movement (for example, a gyro sensor or an acceleration sensor), a sensor that detects a user's line of sight, and the like. The user interface unit 45 generates an operation signal according to the user's operation or movement and outputs it to the reproduction control unit 42.

The display device 51 performs video display based on the video output signal output from the information reproducing device 40. The display device 51 may be any device having a display function such as a head mounted display, a television device, a sheath glass, a projector, or a hologram. The audio output device 52 performs audio output based on the audio output signal output from the information reproducing device 40. The audio output device 52 is configured using a speaker, headphones, or the like. The display device 51 and the audio output device 52 may be provided separately from the information reproduction device 40 or may be configured integrally with the information reproduction device 40.

<2. About viewpoint switching information>
Next, viewpoint switching information generated by the information providing apparatus 30 will be described. FIG. 4 is a diagram for explaining viewpoint switching information. The viewpoint switching information is, for example, a kind of metadata associated with free viewpoint information that is provided information, and is generated for each of one or more specific viewpoints and associated with the free viewpoint information. The viewpoint switching information includes information regarding viewpoint switching to a specific viewpoint that the user should view. For example, in the viewpoint switching information, the specific viewpoint ID, the priority, and the specific viewpoint viewing area information are described, but the time stamp indicating the priority start time, the application area information corresponding to the viewpoint switching information, and other information are used as necessary. May be added.

The specific viewpoint ID in the viewpoint switching information is an identifier for identifying the viewpoint switching information, and a unique identifier is assigned to each specific viewpoint. Accordingly, when requesting free viewpoint information from the information reproducing apparatus 40 to the information providing apparatus 30, the free viewpoint information corresponding to the specific viewpoint ID is transmitted from the information providing apparatus 30 to the information reproducing apparatus 40 by using the specific viewpoint ID. Can be provided.

Priority is a value representing the degree of priority. Therefore, it can be determined whether to switch viewpoints based on priority. It is also possible to designate which area in the video is important by priority. For example, if you want to show the video intended by the information provider with a priority in the range of “0 (lowest value) to 100 (highest value)”, switch the viewpoint of the specific viewpoint corresponding to the intended video. In the information, the priority is set to a value higher than the switching threshold, for example, “100”. If the priority is set in this way, the video presented to the user can be switched to the video intended by the information provider. Also, when recommending viewing of the video intended by the information provider, the priority is set to a value higher than the switching confirmation position. In this case, in the information reproducing apparatus 40, when it is determined that the priority is equal to or higher than the switching confirmation threshold, the information provider intends when the switching is performed and the user is inquired about whether to switch the viewpoint and receives the switching instruction. It is possible to switch the viewpoint to the viewpoint to be performed. The switching threshold has a higher priority than the switching confirmation threshold.

The specific viewpoint area information is information describing a specific viewpoint area that is a viewing area of the specific viewpoint intended by the information provider. 5 and 6 are diagrams for explaining the specific viewpoint area information. When the free viewpoint video is viewed in three dimensions, the specific viewpoint area is expressed by, for example, a three-dimensional viewing frustum as shown in FIG. In this case, the specific viewpoint area information includes information such as a viewpoint position, posture information of the imaging apparatus, and FOV. Specifically, the three-dimensional position (px, py, pz) of the viewpoint, the attitude information of the imaging device (quaternions qx, qy, qz, qw), FOV (Field Of View), Near Clip (near in the figure) The 3D viewpoint area is specified by the distance) and Far Clip (far distance in the figure). The specific viewpoint area information is not limited to specifying the viewpoint area based on the viewpoint position and orientation, and specifies a specific area in the video as in the case of viewing a free viewpoint video described later as a two-dimensional video. Also good. When viewing a free viewpoint video in two dimensions (panorama, omnidirectional sphere, general camera video), a partial area in the video is set as a specific viewpoint area, and this partial area is designated by an angle or coordinates. For example, as shown in FIG. 6A, the specific region is designated by an angle (for example, θL, θR, θT, θB) with the assumed user position as a reference. Further, as shown in FIG. 6B, the vertices (upper right, upper left, lower left, lower right) of the specific area are represented by image coordinates (for example, P11, P12, P13, P14, P21, P22, P23, P24). May be specified.

The time stamp is information indicating the priority start time. For example, the information reproduction device 40 determines when to switch to the specific viewpoint by describing the start time of switching to the specific viewpoint indicated by the specific viewpoint area information. become able to.

The application area information is information indicating an area to which the viewpoint switching information is applied, and a viewpoint in the area indicated by the application area information is set as a viewpoint switching target to a specific viewpoint. For example, when performances are performed at a plurality of venues at the same time, it is possible to specify which venue user is to be a viewpoint switching target by applying area information. When the application area is specified in three dimensions, the application area can be determined by specifying a certain vertex group. For example, the application area is designated by eight three-dimensional coordinates. The designation of the application area is not limited to 8 points, but may be any number of points. In addition, it is possible to determine whether the viewpoint is within the application region by performing inclusion determination of the position of the virtual imaging device or the above-described viewing frustum and the above-described point group (verticies). When the free viewpoint video is a two-dimensional video, if the viewpoint switching information including the video of the viewpoint that the user is viewing is included in the viewpoint area, the viewpoint is switched to a specific viewpoint. The application area is designated by specifying an area (for example, an area indicated by coordinates of four points) specified in the two-dimensional video.

Priority reason describes the reason for adding viewpoint switching information. For example, the reason why the content information provider wants to show, comments about the video, and the like can be given.

Priority destination content information describes information for accessing a video from a specific viewpoint. For example, when a video intended by the information provider is to be presented to the user, access information for accessing the video edited in accordance with the intention of the information provider is described.

The attribute information is information related to free viewpoint information. When the free viewpoint information is, for example, viewing of a performance venue, the name of the performer, the name of the band, the type of instrument, the gender, age, and name recognition of the performer are represented in a matrix. Express. If such attribute information is included in the viewpoint switching information, the information reproducing apparatus 40 collates the user information registered in advance with the attribute information included in the viewpoint switching information, and determines the favorite player based on the collation result. It is possible to switch the viewpoint to a specific viewpoint of interest.

The viewpoint switching information is not limited to information defined by one method, but may be information defined by a plurality of methods. For example, some viewpoint switching information has a viewpoint region designated by a method using a viewing frustum. In other viewpoint switching information, an area in the video may be designated as the viewpoint area.

Next, generation of viewpoint switching information will be described. In the first method for generating viewpoint switching information, viewpoint switching information is generated based on instruction information from the information provider. For example, the information processing unit 32 of the information providing apparatus 30 receives the instruction information indicating the instruction operation of the video desired to be presented to the user intended by the information provider of the free viewpoint information, and the viewpoint so that the instructed video can be presented to the user. Generate switching information. Based on the instruction information, the information processing unit 32 arranges a virtual imaging device, for example, in a three-dimensional space, and changes the position, orientation, angle of view, etc. of the imaging device, and sets the priority. Generate switching information. Further, the information processing unit 32 may generate viewpoint switching information by setting a priority by designating a partial area of the captured video.

The second method for generating viewpoint switching information generates viewpoint switching information regardless of the instruction information. The information processing unit 32 of the information providing device 30 determines which region the audience or the like is paying attention to based on the sensor information acquired from the sensor device 20, and provides viewpoint switching information according to the attention state for the determined region. Generate. For example, a lot of people gathered in which performance hall based on the gaze information collected by the sensor device 20 installed in a performance hall, a stadium, etc. Or the degree of excitement of the audience. The information processing unit 32 generates viewpoint switching information by assigning a priority as a viewpoint area of a specific viewpoint to an area where the line of sight, a lot of people are gathered, or an area where the degree of excitement is high.

Further, the viewpoint switching information may be generated based on information acquired via a network or the like without being limited to information acquired by the sensor device 20. For example, the information processing unit 32 estimates the excitement status based on writing using an external service such as SNS (social networking service) or the impression of the user who is viewing the free viewpoint information. Further, the information processing unit 32 sets the viewpoint area of the specific viewpoint so as to include an area where the degree of excitement is high, assigns priority, and generates viewpoint switching information.

The information processing unit 32 may register the generated viewpoint switching information in a database provided in the information processing unit 32, for example. Further, the information processing unit 32 may update the information registered in the database using the generated viewpoint switching information.

<3. Operation of information providing device>
FIG. 7 is a flowchart illustrating the operation of the information providing apparatus. In step ST1, the information providing apparatus starts generating free viewpoint information. The information providing apparatus 30 starts generating free viewpoint information including free viewpoint video information and free viewpoint audio information using the video material and audio material acquired from the sensor apparatus 20, and proceeds to step ST2.

In step ST2, the information providing apparatus associates viewpoint switching information with free viewpoint information. The information providing apparatus 30 associates the viewpoint switching information with the free viewpoint information at predetermined time intervals, a desired time interval, or a period specified by the information provider, and proceeds to step ST3.

In step ST3, the information providing apparatus determines whether to update the viewpoint switching information. If the information providing apparatus 30 determines to update the viewpoint switching information based on the instruction information or the like, the information providing apparatus 30 proceeds to step ST4. If the information providing apparatus 30 determines not to update the viewpoint switching information, the information providing apparatus 30 proceeds to step ST5.

In step ST4, the information providing apparatus performs viewpoint switching information update processing. The information providing apparatus 30 updates the viewpoint switching information based on the instruction information and the like, sets the updated viewpoint switching information to be associated with the free viewpoint information, and proceeds to step ST5.

In step ST5, the information providing apparatus determines whether to end the generation of free viewpoint information. When the generation of the free viewpoint information to be provided to the user is not completed, the information providing apparatus 30 returns to step ST2 and continues to associate the viewpoint switching information with the free viewpoint information. Further, the information providing apparatus 30 ends the process when the generation of the free viewpoint information is completed.

In this way, the information providing apparatus 30 generates free viewpoint information associated with the viewpoint switching information and outputs it to the information reproducing apparatus 40. Further, the information providing apparatus 30 generates free viewpoint information associated with viewpoint switching information for each of various contents, and the freedom associated with the viewpoint switching information in response to a request from the information reproducing apparatus 40. Viewpoint information may be output.

<4. Operation of information reproducing apparatus>
In the normal viewing state, the information reproducing apparatus enables viewing of a free viewpoint by a user's manual viewpoint movement operation or automatic viewpoint movement operation. The automatic viewpoint movement is movement of the viewpoint linked to the face direction based on the detection result when a change in the face direction is detected by a sensor when a head mounted display is used, for example. Further, the information reproducing apparatus performs viewpoint switching based on the viewpoint switching information, and presents the user with video and audio at a specific viewpoint intended by the information provider.

FIG. 8 is a flowchart illustrating the operation of the information reproducing apparatus. In step ST11, the information reproducing apparatus performs viewpoint movement processing according to the operation. When the user's manual viewpoint moving operation or the automatic viewpoint moving operation according to the user's movement or posture is performed, the information reproducing device 40 displays the video and audio of the viewpoint after the viewpoint moving operation on the display device 51 and the audio. The output device 52 presents it to the user and proceeds to step ST12.

In step ST12, the information reproducing apparatus determines whether there is associated viewpoint switching information. The information reproducing device 40 determines whether the viewpoint switching information is associated with the free viewpoint information to be reproduced. The information reproducing device 40 proceeds to step ST13 when the viewpoint switching information is associated, and returns to step ST11 when it is not associated.

In step ST13, the information reproducing apparatus determines whether or not the condition for switching to the specific viewpoint indicated by the viewpoint switching information is satisfied. For example, when the current viewpoint is included in the application area and the priority is equal to or higher than a preset switching threshold, the information reproducing device 40 proceeds to step ST14 when determining that the switching condition is satisfied. Further, the information reproducing apparatus 40, for example, when the current viewpoint is not included in the application area, when the priority is lower than a preset switching threshold, or when it is determined that the switching condition is not satisfied, the information reproducing apparatus 40 proceeds to step ST11. Return.

In step ST14, the information reproducing apparatus determines whether or not the time stamp has been reached. The information reproducing apparatus 40 proceeds to step ST16 when the time stamp indicated by the viewpoint switching information determined to satisfy the switching condition is not reached, and proceeds to step ST15 when the time stamp is reached.

In step ST15, the information reproducing apparatus performs switching to the specific viewpoint indicated by the viewpoint switching information. The information reproducing device 40 switches the viewpoint to a specific viewpoint determined to satisfy the viewing state change condition, and presents the video and audio of the specific viewpoint after the switching from the display device 51 and the audio output device 52 to the user. In addition, the user may be notified by video or audio from the display device 51 or the audio output device 52 that the viewpoint switching based on the viewpoint switching information has been performed. The information reproducing apparatus performs switching to the specific viewpoint indicated by the viewpoint switching information, and returns to step ST12.

In step ST16, the information reproducing apparatus determines whether reproduction of free viewpoint information has been completed. When the information reproducing apparatus 40 determines that the reproduction of the free viewpoint information has been completed, the information reproducing apparatus 40 ends the reproducing operation. If the information reproducing apparatus 40 has not determined that the reproduction of the free viewpoint information has been completed, the information reproducing apparatus 40 returns to step ST11.

In this way, when the priority indicated by the viewpoint switching information is equal to or higher than the switching threshold, the information reproducing apparatus 40 can display the video or audio presented to the user from the display apparatus 51 or the audio output apparatus 52 as the specific viewpoint. Change to video or audio. That is, the information reproducing apparatus 40 can avoid a situation in which the video or audio intended by the information provider is not viewed. Further, the information reproducing apparatus 40 uses the priority as the switching condition to the specific viewpoint, but other switching conditions may be provided. For example, the information reproducing apparatus 40 sets a switching confirmation threshold in advance and inquires the user of switching when the priority is equal to or higher than the switching confirmation threshold, and switches to a specific viewpoint when a switching instruction is received. Also good.

<5. Playback operation using viewpoint switching information>
Next, a reproduction operation using viewpoint switching information will be described. FIG. 9 is a sequence diagram illustrating the operation of the information presentation system. In step ST21, the information reproducing device 40 outputs the free viewpoint information and the viewpoint switching information to the information providing device 30. It is assumed that the viewpoint switching information output in step ST21 has a lower priority than the switching threshold.

In step ST22, the information reproducing device 40 generates a video output signal and an audio output signal from the free viewpoint information acquired from the information providing device 30, and outputs the video output signal to the display device 51 and the audio output signal to the audio output device 52, respectively. Output. Here, since the priority of the viewpoint switching information is lower than the switching threshold, the information reproducing apparatus 40 generates a video output signal and an audio output signal corresponding to the viewpoint of the user. Therefore, the video and audio corresponding to the user's viewpoint are presented to the user on the display device 51 and the audio output device 52.

When an operation signal corresponding to the viewpoint movement operation is supplied to the information reproduction apparatus 40 in step ST23, the information reproduction apparatus 40 performs viewpoint movement based on the operation signal. As the viewpoint is moved, the information reproducing device 40 generates a video output signal and an audio output signal of the moved viewpoint from the free viewpoint information, and displays the video output signal that is the moved viewpoint as shown in step ST24. The audio output signal is output to the apparatus 51 and the audio output signal is output to the audio output apparatus 52. Therefore, the user is presented with video and audio corresponding to the user's moved viewpoint.

When the information providing apparatus 30 is instructed to change the viewpoint switching information in step ST25, the information providing apparatus 30 updates the viewpoint switching information associated with the free viewpoint information. Note that the updated viewpoint switching information has a priority higher than the switching threshold.

In step ST26, the information reproducing apparatus 40 outputs the free viewpoint information and the updated viewpoint switching information to the information providing apparatus 30. In the updated viewpoint switching information, since the priority is equal to or higher than the switching threshold, the information reproducing apparatus 40 determines that the priority is equal to or higher than the switching threshold. When the time of the time stamp indicated by the updated viewpoint switching information is reached, the information reproducing device 40, as shown in step ST27, the video output signal indicating the video of the specific viewpoint indicated by the viewpoint switching information and the specific viewpoint area The audio output signal corresponding to the video is generated, the video output signal is output to the display device 51, and the audio output signal is output to the audio output device 52. Therefore, the user is presented with video and audio of a specific viewpoint intended by the information provider.

When the information providing apparatus 30 is instructed to change the viewpoint switching information in step ST28, the information providing apparatus 30 updates the viewpoint switching information associated with the free viewpoint information. Note that the updated viewpoint switching information has a lower priority than the switching threshold.

In step ST29, the information reproducing apparatus 40 outputs the free viewpoint information and the updated viewpoint switching information to the information providing apparatus 30. Further, since the priority is lower than the switching threshold in the updated viewpoint switching information, the viewpoint moving operation is accepted.

When an operation signal corresponding to the viewpoint movement operation is supplied to the information reproducing apparatus 40 in step ST30, the information reproducing apparatus 40 performs viewpoint movement based on the operation signal. The information reproduction device 40 generates a video output signal and an audio output signal of the moved viewpoint from the free viewpoint information as the viewpoint is moved, and displays the video output signal after the movement of the viewpoint as shown in step ST31. The audio output signal is output to the audio output device 52. Therefore, the video and audio presented to the user are changed from the video and audio intended by the information provider to the video and audio of the viewpoint moved according to the user's viewpoint movement operation.

As described above, when the information presentation system is configured using the information presentation device and the information reproduction device of the present technology, information on a specific viewpoint intended by the information provider is given to the user based on the viewpoint switching information associated with the provision information. Can present. For this reason, since the user can prevent an important scene from being missed, for example, the user can be immersed in viewing a free viewpoint with peace of mind.

<6. Example of playback operation>
Hereinafter, in order to facilitate understanding of the present technology, a reproduction operation in the case where the provided information is, for example, free viewpoint information of a performance venue will be exemplified. In reproduction of free viewpoint information not associated with viewpoint switching information, viewing from a free viewpoint is enabled by a user's manual viewpoint movement operation or automatic viewpoint movement operation. Also, for example, when the information provider wants to present the video of a specific viewpoint to the user at the climax of the song, the viewpoint switching information for switching to the reproduction of the specific viewpoint is associated with the free viewpoint information, and the priority of the viewpoint switching information is equal to or higher than the switching threshold. And When the viewpoint switching information is associated in this way, the viewpoint is automatically switched to the specific viewpoint based on the viewpoint switching information in the climax part of the song, and the video intended by the information provider is presented to the user. Therefore, it is possible to avoid a situation where the video intended by the information provider is not viewed.

FIG. 10 shows an example of the reproduction operation of the free viewpoint information indicating the performance venue. (A) of FIG. 10 shows a performance hall, viewing by a free viewpoint is performed by a viewpoint moving operation, and for example, a viewpoint video as shown in (b) of FIG. 10 can be presented to the user. When the information provider wants to present to the user a video showing the singer at the rising part of the song, the information provider outputs instruction information to the information providing device 30 and switches the viewpoint to free viewpoint information before the rising part of the song. Associate information. The associated viewpoint switching information is information indicating that the specific viewpoint is the front of the singer, the specific viewpoint area information includes the singer area, the priority is equal to or higher than the switching threshold, and the time stamp indicates the timing of the rising part of the song. When the specific viewpoint information is associated in this way, the information reproducing apparatus 40 performs viewpoint switching based on the viewpoint switching information, and the user displays the video shown in FIG. 10C intended by the information provider at the timing of the rising portion of the song. Can be presented.

Also, the information providing device 30 updates the viewpoint switching information at the end of the climax part of the song based on the instruction information from the information provider, and deletes the priority lower than the switching threshold or the viewpoint switching information. Therefore, when the climax part of the song ends, the reproduction from the specific viewpoint is canceled, and the viewing from the free viewpoint can be performed by, for example, the viewpoint movement operation.

Next, the reproduction operation when the provided information is, for example, free viewpoint information indicating a stadium will be exemplified. In the reproduction of free viewpoint information that is not associated with viewpoint switching information, viewing from a free viewpoint is enabled by a viewpoint movement operation. Also, for example, when an information provider wants to present an important scene as a video of a specific viewpoint to the user, the viewpoint switching information for switching to playback of the specific viewpoint is associated with the free viewpoint information, and the priority of the viewpoint switching information is set to a switching threshold or higher. To do. By associating viewpoint switching information in this way, in an important scene, the viewpoint is automatically switched to a specific viewpoint based on the viewpoint switching information, and the video intended by the information provider is presented to the user. A situation where the intended video is not viewed can be avoided.

FIG. 11 shows a reproduction operation example of free viewpoint information indicating a stadium. FIG. 11 (a) shows a soccer stadium, which is viewed from a free viewpoint by a viewpoint movement operation. For example, as shown in FIG. Can present. When the information provider wants to present an important scene, for example, a video of a scoring scene, to the user, the information provider outputs instruction information to the information providing device 30 to associate the viewpoint switching information with the free viewpoint information of the scoring scene timing. The viewpoint switching information to be associated includes the specific viewpoint area information including the soccer goal area, and the priority is set to a switching threshold or more. When the specific viewpoint information is associated in this way, the information reproducing device 40 performs viewpoint switching based on the viewpoint switching information, and the scoring scene video shown in FIG. 11C intended by the information provider at the timing of the scoring scene. Present to the user. In addition, if the viewpoint switching information is associated with different viewpoints as specific viewpoints, the information reproducing apparatus 40 uses a favorite viewpoint (for example, a goal net as a background) specified in advance by the user in the scoring scene when reproducing with a free viewpoint. (Viewpoint, keeper viewpoint, etc.) can be presented.

In addition, when the information providing apparatus 30 detects the climax of the audience in the stadium based on the sensor information or the like, the information providing apparatus 30 generates specific viewpoint area information using the area that the audience is paying attention to as the viewpoint area of the specific viewpoint. Associate with information. In the associated viewpoint switching information, the priority is set lower than that of an important scene, and is set to be lower than the switching threshold and higher than the switching confirmation threshold. The switching confirmation threshold is a value lower than the switching threshold. When the specific viewpoint information is associated in this way, the information reproducing apparatus 40 makes an inquiry to the viewer to switch to the specific viewpoint because the priority is lower than the switching threshold and higher than the switching confirmation threshold. When the information reproducing apparatus 40 receives the switching instruction, the information reproducing apparatus 40 presents the video of the exciting scene shown in (d) of FIG. 11 to the user. Furthermore, if viewpoint switching information is generated based on sensor information or the like, it is possible to present an exciting scene without knowing the timing of the important scene, so it is possible to prevent the important scene from being missed. . Note that FIG. 11E illustrates a case where a video of a climax scene is displayed on a reduced screen and an inquiry about switching to a specific viewpoint is made.

The viewpoint switching is not limited to the above case, and the viewpoint switching may be performed in the direction indicated by the arrow in FIG. 10 or FIG. The viewpoint switching is not limited to the same content, and switching to a specific viewpoint may be performed between different contents. For example, when watching a soccer game, if a climax occurs in a baseball game, the baseball video is displayed on a reduced screen on the soccer video and the viewer is asked to switch to a specific viewpoint. Switch to baseball video when an instruction is accepted. In this way, it becomes possible to perform viewpoint switching to a specific viewpoint among a plurality of contents.

Next, the reproduction operation when the provided information is, for example, a two-dimensional omnidirectional video will be exemplified. In the reproduction of the provided information not associated with the viewpoint switching information, the video of the area corresponding to the user's viewpoint is selected and presented from the omnidirectional video by the viewpoint moving operation. In addition, for example, when an information provider wants to present an important area as a video of a specific viewpoint to the user, the viewpoint switching information is associated with the provided information, and the viewpoint switching information indicates the important area in the specific viewpoint area information and gives priority. The degree is equal to or greater than the switching threshold. When the viewpoint switching information is associated in this way, the viewpoint is automatically switched to the specific viewpoint based on the viewpoint switching information, and the video of the area specified by the information provider is presented to the user. The situation where the video to be played is not viewed can be avoided.

FIG. 12 shows a reproduction operation example of a two-dimensional spherical image. (A) of FIG. 12 has shown the imaging state of the omnidirectional image, for example, the omnidirectional image which shows the earth and outer space is acquired with the sensor apparatus 20. FIG. Viewing from a free viewpoint is performed by the user's manual viewpoint movement operation or automatic viewpoint movement operation, and for example, as shown in FIG. Further, as shown in FIG. 12C, an image of an area on the earth that the user pays attention to can be presented. For example, the information provider uses a commentary on the stars and a commentary on the region on the earth as a free viewpoint sound in the presentation information. Furthermore, the information provider associates the viewpoint switching information to the specific viewpoint with the free viewpoint information at the timing of the commentary about the specific star. In this viewpoint switching information, an area including a specific star is a viewpoint area of a specific viewpoint, and in the application area information, a viewpoint of a star area in the omnidirectional video is a viewpoint switching target. In addition, the information provider associates the viewpoint switching information to the specific viewpoint with the free viewpoint information at the timing of the explanation about the specific area of the earth. In this viewpoint switching information, a specific area is a viewpoint area of a specific viewpoint, and in the application area information, a viewpoint of an area on the earth in the omnidirectional video is a viewpoint switching target.

In this way, when the viewpoint switching information is associated with the presentation information, when the user is watching the video of the star region, the commentary sound about the star is output and the commentary sound about the specific star is output. The viewpoint is switched to the specific viewpoint based on the viewpoint switching information. Therefore, the image shown in (b) of FIG. 12 is switched to the image of a specific star shown in (d) of FIG. In addition, since the user who is viewing the image of the region on the earth is out of the viewpoint switching application region, the viewpoint switching is not performed on the image of the specific star. Accordingly, when reproducing the free viewpoint information, for example, it is possible to present without missing the video linked to the explanation of a specific star.

Also, if the user is viewing a video of an area on the earth, the audio of the commentary about the area on the earth is output, and at the timing of the audio of the commentary about the specific area, the specific viewpoint based on the viewpoint switching information Change the viewpoint to. Accordingly, the video shown in (c) of FIG. 12 is switched to a video of a specific area shown in (e) of FIG. In addition, since the user who is viewing the video of the star region is out of the viewpoint switching application region, the viewpoint switching is not performed on the video of a specific region on the earth. Therefore, at the time of reproducing free viewpoint information, for example, it is possible to present without missing a video linked to a description of a specific area on the earth.

Note that the information reproducing apparatus 40 may notify that the video is switched, or provide a pre-processing time so that the video is switched continuously from the free viewpoint video to the specific viewpoint video.

In addition, by performing the above-described reproduction operation, the information presentation system 10 can specify, for example, which part of the two-dimensional omnidirectional video is to be preferentially presented by the viewpoint switching information, and the three-dimensional model. Is given, the viewpoint of the three-dimensional virtual imaging device can be designated.

<7. Other playback operations>
Next, another playback operation will be described. In the above-described reproduction operation, viewpoint switching is performed using the priority, application area, and time stamp. However, the information reproducing apparatus 40 may perform viewpoint switching using other information. For example, the determination of whether to switch viewpoints is not limited to priority, and attribute information of free viewpoint information may be used. The attribute information of the free viewpoint information is, for example, information related to the artist shown in the video (for example, player name, instrument name, band name, sex, age, name recognition by age, etc.). The viewpoint is switched based on the collation result of user information registered in advance. The viewpoint switching information associates, for example, viewpoint switching information for each performer with respect to the rising part of the song. The information reproducing device 40 collates the registered user information and the viewpoint switching information, and when the user can select the viewpoint switching information regarding the favorite performer, the information reproducing apparatus 40 performs the viewpoint switching based on the selected viewpoint switching information. . Therefore, in the information reproducing apparatus 40, the user can present the favorite player's video and audio at the rising part of the song. As described above, when the attribute information or the like is included in the viewpoint switching information, the information reproducing apparatus 40 can perform the viewpoint switching to the specific viewpoint according to the user based on the attribute information or the like.

In the above-described playback operation example, based on the viewpoint switching information, the video and audio of the free viewpoint are presented based on the information such as the position and orientation of the virtual imaging device. However, the free viewpoint information is displayed using another method. May be viewed. For example, as a video intended by the information provider, a two-dimensional video edited by the information provider may be presented after switching the viewpoint to a specific viewpoint. In this case, when the viewpoint is switched to the specific viewpoint, the 3D video from the free viewpoint is switched to the 2D video.

The information reproducing apparatus 40 may provide a plurality of patterns indicating which viewpoint to return to after switching the viewpoint and completing the presentation of the video intended by the information provider. The information reproducing device 40 stores, for example, the position / posture of the virtual imaging device that is the viewpoint before switching, or the presented video area, and after the presentation of the video intended by the information provider is completed, switching is performed. You may return to the previous viewpoint. In addition, for example, when the viewpoint is moved following a specific player while watching a sport, the information reproducing apparatus 40 can display the video of the viewpoint focused on the specific player after completing the presentation of the video intended by the information provider. May be presented. Further, the information reproducing apparatus 40 may continue the state of the specific viewpoint as it is after the presentation of the video intended by the information provider is completed.

Further, the information reproducing apparatus 40 may move the viewpoint from the specific viewpoint after the completion of the presentation of the video intended by the information provider in accordance with the subsequent manual viewpoint movement operation or automatic viewpoint movement operation of the user. You may give a restriction | limiting to subsequent viewpoint movement. For example, the position and orientation of a virtual imaging device are set so that a target point is provided on a target to be noticed and a video of the target point is presented. In addition, after the video of the gazing point is presented, the movement of the viewpoint is limited so that the viewpoint rotates around the gazing point. By restricting the viewpoint movement in this way, it is possible to present an image in which the target point of interest to be noticed is viewed from different viewpoints. In addition, the limitation on the viewpoint movement is not limited to the case where the viewpoint movement is limited so that the viewpoint rotates around the gazing point. For example, the viewpoint movement may be limited to a fixed parallel movement. In this way, if the viewpoint movement is limited to a fixed parallel movement, an image as if on a vehicle can be presented.

Further, an image sensor may be provided in the information reproducing apparatus 40, and a viewer may be identified by using a face identification technology or an iris authentication technology, and the viewpoint may be switched according to the identified viewer. For example, viewpoint switching can be performed when the viewer is a child, and viewpoint switching is not performed when the viewer is an adult. By switching the viewpoint, for example, if the provided information is content for children, the video intended by the information provider can be presented by switching the viewpoint to a specific viewpoint, and the child's interest in important scenes. Can be attracted.

Furthermore, in the above-described reproduction operation example, switching of video is mainly described as viewpoint switching, but audio may be switched in viewpoint switching. For example, when the provided information indicates the performance of music, the climax part of the song may present the user with a voice that emphasizes the voice of the singer. Further, when the provided information is a sports broadcast, in an important scene, the audience and surrounding sounds may be attenuated to present a voice that emphasizes the breathing of the player.

In the above-described playback operation example, the information provider sets in advance the time stamp indicating the viewpoint switching timing. However, the viewpoint switching timing may be determined using a delay in providing free viewing information. For example, it is difficult to completely predict an event (an important scene such as a soccer goal scene) that has occurred during a sports broadcast. However, the viewpoint switching information at the time of the event occurrence before the image at the time of the event occurrence is presented to the user by using the delay of the provided video (for example, the delay due to the encoding process of the video or the delay added intentionally) May be output to the information reproducing apparatus 40.

The series of processes described in the specification can be executed by hardware, software, or a combined configuration of both. When processing by software is executed, a program in which a processing sequence is recorded is installed and executed in a memory in a computer incorporated in dedicated hardware. Alternatively, the program can be installed and executed on a general-purpose computer capable of executing various processes.

For example, the program can be recorded in advance on a hard disk, SSD (Solid State Drive), or ROM (Read Only Memory) as a recording medium. Alternatively, the program is a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto optical disc), a DVD (Digital Versatile Disc), a BD (Blu-Ray Disc (registered trademark)), a magnetic disk, or a semiconductor memory card. It can be stored (recorded) in a removable recording medium such as temporarily or permanently. Such a removable recording medium can be provided as so-called package software.

In addition to installing the program from the removable recording medium to the computer, the program may be transferred from the download site to the computer wirelessly or by wire via a network such as a LAN (Local Area Network) or the Internet. The computer can receive the program transferred in this way and install it on a recording medium such as a built-in hard disk.

In addition, the effect described in this specification is an illustration to the last, and is not limited, There may be an additional effect which is not described. Further, the present technology should not be construed as being limited to the embodiments of the technology described above. The embodiments of this technology disclose the present technology in the form of examples, and it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present technology. In other words, the scope of the claims should be considered in order to determine the gist of the present technology.

In addition, the information providing apparatus of the present technology can also have the following configuration.
(1) An information providing apparatus including an information processing unit that associates viewpoint switching information for switching reproduction of the provided information to reproduction of a specific viewpoint with provided information whose viewpoint at the time of reproduction is movable.
(2) The information processing apparatus according to (1), wherein the information processing unit includes a priority of the specific viewpoint in the viewpoint switching information.
(3) The information providing apparatus according to (1) or (2), wherein the information processing unit includes viewing area information indicating a specific viewpoint viewing area viewed from the specific viewpoint in the viewpoint switching information.
(4) The information processing apparatus according to any one of (1) to (3), wherein the information processing unit includes application area information to which the viewpoint switching information is applied in the viewpoint switching information.
(5) The information processing apparatus according to any one of (1) to (4), wherein the information processing unit includes time information indicating a switching time to the specific viewpoint in the viewpoint switching information.
(6) The information processing apparatus according to any one of (1) to (5), wherein the information processing unit includes attribute information related to the provided information in the viewpoint switching information.
(7) The information processing apparatus according to any one of (1) to (6), wherein the information processing unit generates the viewpoint switching information for each of one or more specific viewpoints.
(8) The information providing apparatus according to any one of (1) to (7), wherein the provided information is information on video content or video content and audio content.

In addition, the information reproducing apparatus according to the present technology may have the following configuration.
(1) Based on the viewpoint switching information for switching the reproduction of the provided information associated with the provided information whose viewpoint at the time of reproduction is movable to the reproduction of the specific viewpoint, the reproduction of the specific viewpoint from the reproduction of the free viewpoint of the provision information An information reproducing apparatus comprising a reproduction control unit for switching to.
(2) The viewpoint switching information includes the priority of the specific viewpoint,
The information reproduction apparatus according to (1), wherein the reproduction control unit switches to reproduction of the specific viewpoint when the priority is equal to or higher than a preset switching threshold.
(3) The viewpoint switching information includes the priority of the specific viewpoint,
When the priority is equal to or higher than a preset switching confirmation threshold, the playback control unit makes an inquiry about switching to the specific viewpoint to the viewer of the provided information, and when the switching instruction is received, The information reproducing apparatus according to (1) or (2), wherein switching to a specific viewpoint is performed.
(4) The viewpoint switching information includes application area information to which the viewpoint switching information is applied,
The reproduction control unit performs switching to the specific viewpoint based on the viewpoint switching information when the viewpoint being reproduced of the provided information is within the area indicated by the application area information (1) to (3) An information reproducing apparatus according to any one of the above.
(5) The viewpoint switching information includes time information indicating a switching time to the specific viewpoint, and the reproduction control unit performs switching to the specific viewpoint based on the viewpoint switching information when the switching time is reached ( The information reproducing apparatus according to any one of 1) to (4).
(6) The viewpoint switching information includes attribute information related to the provided information,
The information reproduction apparatus according to any one of (1) to (5), wherein the reproduction control unit collates information registered in advance with the attribute information, and performs switching to the specific viewpoint based on a collation result.
(7) The information reproduction device according to any one of (1) to (6), wherein the reproduction control unit is capable of moving the viewpoint from the specific viewpoint after switching to the specific viewpoint.
(8) The information reproduction device according to any one of (1) to (7), wherein the reproduction control unit restricts movement of the viewpoint from the specific viewpoint after switching to the specific viewpoint.
(9) The information reproduction device according to any one of (1) to (6), wherein the reproduction control unit fixes the viewpoint to the specific viewpoint after switching to the specific viewpoint.

According to the information providing apparatus, the information providing method, the information reproducing apparatus, and the information reproducing method of this technique, the viewpoint switching for switching the reproduction of the provided information to the reproduction of the specific viewpoint for the provided information whose viewpoint at the time of reproduction is movable Information is associated. Further, when the provided information is reproduced, the viewpoint is switched from the reproduction of the free viewpoint to the reproduction of the specific viewpoint based on the viewpoint switching information. For this reason, even if the provided information is played back from a free viewpoint, it is possible to switch to playback of a specific viewpoint by the viewpoint switching information, and the video etc. intended by the information provider even if playback is performed from the free viewpoint It is suitable for a system that allows users to view content from a free viewpoint.

DESCRIPTION OF SYMBOLS 10 ... Information presentation system 20 ... Sensor apparatus 30 ... Information provision apparatus 31 ... Information input part 32 ... Information processing part 33 ... Information output part 40 ... Information reproduction apparatus 41. ··· Information acquisition unit 42 ··· Reproduction control unit 43 ··· Video / audio output unit 44 ··· Communication unit 45 ··· User interface unit 51 ··· Display device 52 ··· Audio output device

Claims (19)

1. An information providing apparatus comprising an information processing unit that associates viewpoint switching information for switching reproduction of the provided information to reproduction of a specific viewpoint with provided information whose viewpoint at the time of reproduction is movable.
2. The information providing apparatus according to claim 1, wherein the information processing unit includes a priority of the specific viewpoint in the viewpoint switching information.
3. The information providing apparatus according to claim 1, wherein the information processing unit includes viewing area information indicating a specific viewpoint viewing area viewed from the specific viewpoint in the viewpoint switching information.
4. The information providing apparatus according to claim 1, wherein the information processing unit includes application area information for applying the viewpoint switching information to the viewpoint switching information.
5. The information providing apparatus according to claim 1, wherein the information processing unit includes time information indicating a switching time to the specific viewpoint in the viewpoint switching information.
6. The information providing apparatus according to claim 1, wherein the information processing unit includes attribute information regarding the provided information in the viewpoint switching information.
7. The information providing apparatus according to claim 1, wherein the information processing unit generates the viewpoint switching information for each of one or more specific viewpoints.
8. The information providing apparatus according to claim 1, wherein the provision information is video content or video content and audio content information.
9. Associating viewpoint switching information for switching playback of the provided information to playback of a specific viewpoint in the information processing unit with respect to the provided information whose viewpoint at the time of playback is movable;
   Outputting the provision information associated with the viewpoint switching information from an output unit.
10. Playback that switches from playback of the free viewpoint of the provided information to playback of the specific viewpoint based on viewpoint switching information that switches playback of the provided information associated with the provided information whose viewpoint at the time of playback is movable to playback of the specific viewpoint An information reproducing apparatus including a control unit.
11. The viewpoint switching information includes the priority of the specific viewpoint,
    The information reproduction device according to claim 10, wherein the reproduction control unit switches to reproduction of the specific viewpoint when the priority is equal to or higher than a preset switching threshold.
12. The viewpoint switching information includes the priority of the specific viewpoint,
    When the priority is equal to or higher than a preset switching confirmation threshold, the playback control unit makes an inquiry about switching to the specific viewpoint to the viewer of the provided information, and when the switching instruction is received, The information reproducing apparatus according to claim 10, wherein switching to a specific viewpoint is performed.
13. The viewpoint switching information includes application area information to which the viewpoint switching information is applied,
    The information according to claim 10, wherein the reproduction control unit performs switching to the specific viewpoint based on the viewpoint switching information when a viewpoint being reproduced of provided information is within an area indicated by the application area information. Playback device.
14. The viewpoint switching information includes time information indicating a switching time to the specific viewpoint. The reproduction control unit switches to the specific viewpoint based on the viewpoint switching information when the switching time comes. The information reproducing apparatus described.
15. The viewpoint switching information includes attribute information related to the provided information,
    The information reproduction apparatus according to claim 10, wherein the reproduction control unit collates information registered in advance with the attribute information, and switches to the specific viewpoint based on a collation result.
16. The information reproduction apparatus according to claim 10, wherein the reproduction control unit is capable of moving the viewpoint from the specific viewpoint after switching to the specific viewpoint.
17. The information reproduction apparatus according to claim 10, wherein the reproduction control unit restricts viewpoint movement from the specific viewpoint after switching to the specific viewpoint.
18. The information reproduction apparatus according to claim 10, wherein the reproduction control unit fixes the viewpoint to the specific viewpoint after switching to the specific viewpoint.
19. Playback control from playback of the free viewpoint of the provided information to playback of the specified viewpoint based on viewpoint switching information for switching the playback of the provided information associated with the provided information whose viewpoint at the time of playback is movable to playback of the specific viewpoint Information reproducing method including switching in a section.

Images