WO2018070092A1 - Dispositif de dimensionnement d'informations, procédé de dimensionnement d'informations, dispositif de reproduction d'informations, et procédé de reproduction d'informations - Google Patents

Dispositif de dimensionnement d'informations, procédé de dimensionnement d'informations, dispositif de reproduction d'informations, et procédé de reproduction d'informations Download PDF

Info

Publication number
WO2018070092A1
WO2018070092A1 PCT/JP2017/027661 JP2017027661W WO2018070092A1 WO 2018070092 A1 WO2018070092 A1 WO 2018070092A1 JP 2017027661 W JP2017027661 W JP 2017027661W WO 2018070092 A1 WO2018070092 A1 WO 2018070092A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
viewpoint
switching
specific
reproduction
Prior art date
Application number
PCT/JP2017/027661
Other languages
English (en)
Japanese (ja)
Inventor
脩 繁田
徹 知念
小川　浩司
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2018070092A1 publication Critical patent/WO2018070092A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • This technology relates to an information providing apparatus, an information providing method, an information reproducing apparatus, and an information reproducing method, and enables the information provider to switch to reproduction of a specific viewpoint intended by the information provider when reproducing the provided information from a free viewpoint.
  • a video of a desired viewpoint is selected and provided from a video of an arbitrary viewpoint.
  • a video of an arbitrary viewpoint For example, in Patent Document 1, one of the most watched video materials among a plurality of video materials created from different viewpoints is selected and delivered to the viewer.
  • Patent Document 2 when any one of a plurality of videos taken from different viewpoints by a plurality of users is distributed to a terminal device, the first video requested by the terminal device is one of the plurality of videos. During distribution to the terminal device, transmission of the second video that is likely to be requested next from the terminal device to the terminal device is started.
  • JP 2013-175888 A Japanese Unexamined Patent Publication No. 2016-010145
  • the cited document 1 and the cited document 2 are techniques for presenting information provided by selection to a user
  • viewing the provided information from a free viewpoint has been performed.
  • the video presented to the user is changed to the video of the viewpoint moved in accordance with the movement of the user.
  • a free viewpoint if the user is viewing while paying attention to a specific subject, for example, an important scene is not included in the presented video, and an important scene is missed. Occurs.
  • an image intended by an information provider is not always presented to the user.
  • this technology provides an information providing apparatus, an information providing method, an information reproducing apparatus, and an information reproducing method capable of switching the reproduction of a free viewpoint to the reproduction of a specific viewpoint.
  • the information providing apparatus includes an information processing unit that associates viewpoint switching information for switching the reproduction of the provision information to reproduction of a specific viewpoint with the provision information whose viewpoint at the time of reproduction is movable.
  • viewpoint switching information is associated by the information processing unit with presentation information whose viewpoint at the time of reproduction is movable, such as video content or video content and audio content.
  • the viewpoint switching information is information for switching the reproduction of the provided information to the reproduction of the specific viewpoint.
  • the priority of the specific viewpoint the viewing area information indicating the specific viewpoint viewing area viewed at the specific viewpoint, and the application area to which the viewpoint switching information is applied.
  • the second aspect of this technology regarding information, time information indicating switching time to a specific viewpoint, and provided information Associating viewpoint switching information for switching playback of the provided information to playback of a specific viewpoint in the information processing unit with respect to the provided information whose viewpoint at the time of playback is movable; And outputting the provision information associated with the viewpoint switching information from an output unit.
  • the third aspect of this technology is Playback that switches from playback of the free viewpoint of the provided information to playback of the specific viewpoint based on viewpoint switching information that switches playback of the provided information associated with the provided information whose viewpoint at the time of playback is movable to playback of the specific viewpoint
  • the information reproducing apparatus includes a control unit.
  • the playback control unit switches from playback of a free viewpoint of provided information to playback of a specific viewpoint based on viewpoint switching information associated with the provided information whose viewpoint at the time of playback is movable.
  • the viewpoint switching information is information for switching the reproduction of the provided information to the reproduction of the specific viewpoint
  • the reproduction control unit is specified when the priority of the specific viewpoint included in the viewpoint switching information is equal to or higher than a preset switching threshold. Switch to viewpoint playback.
  • the playback control unit makes an inquiry about switching to the specific viewpoint to the viewer of the provided information, When a switching instruction is received, switching to a specific viewpoint is performed.
  • the playback control unit also switches the viewpoint when the application area information to which the viewpoint switching information is applied is included in the viewpoint switching information, and the viewpoint being reproduced of the provided information is within the area indicated by the application area information. Switch to a specific viewpoint based on information.
  • the reproduction control unit performs switching to the specific viewpoint based on the viewpoint switching information when the switching time is reached.
  • the reproduction control unit collates the attribute information related to the provided information included in the viewpoint switching information with information registered in advance, and performs switching to a specific viewpoint based on the collation result. Further, after switching to the specific viewpoint, the reproduction control unit can move the viewpoint from the specific viewpoint, restrict the viewpoint movement from the specific viewpoint, or fix the viewpoint to the specific viewpoint.
  • the fourth aspect of this technology is Playback control from playback of the free viewpoint of the provided information to playback of the specified viewpoint based on viewpoint switching information for switching the playback of the provided information associated with the provided information whose viewpoint at the time of playback is movable to playback of the specific viewpoint
  • the information reproduction method includes switching in a section.
  • the viewpoint switching information for switching the reproduction of the provided information to the reproduction of the specific viewpoint is associated with the provided information whose viewpoint at the time of reproduction is movable. For this reason, even if the provided information is reproduced from a free viewpoint, it is possible to switch to reproduction of a specific viewpoint by the viewpoint switching information. Note that the effects described in the present specification are merely examples and are not limited, and may have additional effects.
  • FIG. 1 illustrates the configuration of the information presentation system.
  • the information presentation system 10 includes a sensor device 20, an information providing device 30, an information reproducing device 40, a display device 51, and an audio output device 52.
  • the sensor device 20 acquires video and audio material information and outputs the information to the information providing device 30.
  • the information providing device 30 generates the provided information to be provided to the information reproducing device 40 using the material information acquired by the sensor device 20 and outputs the generated provided information.
  • the information reproducing device 40 extracts information to be viewed from a desired viewpoint from the provided information, and generates a video output signal and an audio output signal based on the extracted information.
  • the information reproducing device 40 outputs the generated video output signal to the display device 51 to present a video of a desired viewpoint.
  • the information reproducing device 40 outputs the generated audio output signal to the audio output device 52 and presents audio corresponding to a desired viewpoint.
  • the sensor device 20 is configured using an imaging device, a microphone, and the like, and acquires video information and audio information and outputs them to the information providing device 30.
  • the imaging device that acquires the video information may be configured by a plurality of imaging devices that capture images from different viewpoint positions, for example, an imaging device equipped with a special lens capable of photographing the omnidirectional sphere.
  • a device such as a depth camera that can acquire depth information or a lidar (LIDAR) that can perform three-dimensional surveying may be used.
  • the sensor device 20 is a sensor that acquires information that can be used to generate viewpoint switching information, which will be described later, in the information providing device 30, for example, a sensor that detects the number of people in the venue where the imaging device is provided, You may use the sensor etc. which detect.
  • the sensor device 20 outputs the acquired material information and the like to the information providing device 30.
  • FIG. 2 illustrates the configuration of the information providing apparatus.
  • the information providing apparatus 30 includes an information input unit 31, an information processing unit 32, and an information output unit 33.
  • the information input unit 31 acquires material information and the like from the sensor device 20 and outputs them to the information processing unit 32.
  • the information processing unit 32 has a free viewpoint information generation function and a viewpoint switching information generation addition function.
  • the free viewpoint information generation function is free viewpoint information that is provided information to the information reproducing apparatus 40 from video information or audio information of one or more viewpoints acquired from the sensor device 20, for example, free viewpoint video information or free viewpoint audio information. It is a function to generate.
  • the free viewpoint video information is, for example, three-dimensional model data composed of meshes and textures generated by three-dimensional reconstruction using video information acquired from the sensor device 20.
  • the free-viewpoint video information may be video information obtained by morphing an intermediate video between multi-viewpoint videos, or a different system.
  • the free viewpoint video information is a wide-angle video such as a omnidirectional video
  • the information playback device 40 is a video of a desired viewpoint that is a part of the video provided from the information providing device 30.
  • Free viewpoint audio information is audio information for presenting audio corresponding to the user's viewpoint position. That is, by using the free viewpoint audio information, when the user's viewpoint is moved, the audio presented to the user changes to the audio corresponding to the viewpoint according to the movement of the viewpoint.
  • free viewpoint audio information audio information that presents sound that can be heard from a fixed viewpoint as in the past may be used, and audio information that can present sound that can be heard from a free viewpoint and sound that can be heard from a fixed viewpoint are presented.
  • the audio information to be played may be included in the free viewpoint audio information.
  • the information processing unit 32 outputs the generated free viewpoint information (free viewpoint video information and / or free viewpoint audio information) to the information output unit 33.
  • the viewpoint switching information generation / addition function is a function that generates viewpoint switching information that is metadata relating to viewpoint switching to a priority viewpoint and associates it with free viewpoint video information and free viewpoint audio information. Details of the viewpoint switching information will be described later.
  • the information processing unit 32 outputs the viewpoint switching information generated based on the instruction information from the information provider to the information output unit 33. Further, as the viewpoint switching information, several viewpoint switching information may be generated at the same time. For example, when there are a plurality of viewpoints that have priority over the free viewpoint information, the viewpoint switching information is generated by the number of priority viewpoints.
  • the information output unit 33 associates the free viewpoint information generated by the information processing unit 32 and the viewpoint switching information and outputs the information to the information reproducing device 40.
  • the association between the free viewpoint information and the viewpoint switching information only needs to be able to use the viewpoint switching information when reproducing the free viewpoint information.
  • the information output unit 33 multiplexes the viewpoint switching information with the encoded data generated by performing the encoding process of the free viewpoint information, and outputs the multiplexed information to the information reproducing device 40.
  • the viewpoint switching information may be added to the encoded data as tag information and output to the information reproducing device 40.
  • the information providing apparatus 30 may be configured to output the encoded data and the viewpoint switching information individually to the information reproducing apparatus 40 and use the viewpoint switching information associated with the reproduction of the encoded data.
  • the information providing apparatus 30 may be configured to associate the free viewpoint information and the viewpoint switching information via the recording medium or the like and provide them to the information reproducing apparatus 40.
  • FIG. 3 illustrates the configuration of the information reproducing apparatus.
  • the information reproduction apparatus 40 includes an information acquisition unit 41, a reproduction control unit 42, a video / audio output unit 43, a communication unit 44, and a user interface unit 45.
  • the information acquisition unit 41 acquires the free viewpoint information (provided information) and the viewpoint switching information associated with the free viewpoint information from the information providing apparatus 30 via the communication line or the recording medium, and acquires the acquired free viewpoint information and the viewpoint.
  • the switching information is output to the reproduction control unit 42.
  • the playback control unit 42 selects or extracts video information of a viewpoint designated by the user based on an operation signal from the user interface unit 45 and outputs the selected video information to the video / audio output unit 43. Further, the playback control unit 42 selects or synthesizes audio information corresponding to the designated viewpoint and outputs it to the video / audio output unit 43. Further, the playback control unit 42 determines viewpoint switching based on the viewpoint switching information and the user information stored in the playback control unit 42, selects viewpoint video information and audio information according to the determination result, and the like. Output to the video / audio output unit 43.
  • the video / audio output unit 43 generates a video output signal of a predetermined format based on the video information output from the playback control unit 42. Further, the video / audio output unit 43 generates an audio output signal based on the audio information output from the reproduction control unit 42. The video / audio output unit 43 outputs the generated video output signal to the display device 51, and outputs the generated audio output signal to the audio output device 52.
  • the communication unit 44 communicates with the information providing apparatus 30 and requests the information providing apparatus 30 for free viewpoint information desired by the user.
  • the user interface unit 45 is configured using at least one of an operation switch, a touch panel, a sensor that detects a user's movement (for example, a gyro sensor or an acceleration sensor), a sensor that detects a user's line of sight, and the like.
  • the user interface unit 45 generates an operation signal according to the user's operation or movement and outputs it to the reproduction control unit 42.
  • the display device 51 performs video display based on the video output signal output from the information reproducing device 40.
  • the display device 51 may be any device having a display function such as a head mounted display, a television device, a sheath glass, a projector, or a hologram.
  • the audio output device 52 performs audio output based on the audio output signal output from the information reproducing device 40.
  • the audio output device 52 is configured using a speaker, headphones, or the like.
  • the display device 51 and the audio output device 52 may be provided separately from the information reproduction device 40 or may be configured integrally with the information reproduction device 40.
  • FIG. 4 is a diagram for explaining viewpoint switching information.
  • the viewpoint switching information is, for example, a kind of metadata associated with free viewpoint information that is provided information, and is generated for each of one or more specific viewpoints and associated with the free viewpoint information.
  • the viewpoint switching information includes information regarding viewpoint switching to a specific viewpoint that the user should view. For example, in the viewpoint switching information, the specific viewpoint ID, the priority, and the specific viewpoint viewing area information are described, but the time stamp indicating the priority start time, the application area information corresponding to the viewpoint switching information, and other information are used as necessary. May be added.
  • the specific viewpoint ID in the viewpoint switching information is an identifier for identifying the viewpoint switching information, and a unique identifier is assigned to each specific viewpoint. Accordingly, when requesting free viewpoint information from the information reproducing apparatus 40 to the information providing apparatus 30, the free viewpoint information corresponding to the specific viewpoint ID is transmitted from the information providing apparatus 30 to the information reproducing apparatus 40 by using the specific viewpoint ID. Can be provided.
  • Priority is a value representing the degree of priority. Therefore, it can be determined whether to switch viewpoints based on priority. It is also possible to designate which area in the video is important by priority. For example, if you want to show the video intended by the information provider with a priority in the range of “0 (lowest value) to 100 (highest value)”, switch the viewpoint of the specific viewpoint corresponding to the intended video. In the information, the priority is set to a value higher than the switching threshold, for example, “100”. If the priority is set in this way, the video presented to the user can be switched to the video intended by the information provider. Also, when recommending viewing of the video intended by the information provider, the priority is set to a value higher than the switching confirmation position.
  • the information provider when it is determined that the priority is equal to or higher than the switching confirmation threshold, the information provider intends when the switching is performed and the user is inquired about whether to switch the viewpoint and receives the switching instruction. It is possible to switch the viewpoint to the viewpoint to be performed.
  • the switching threshold has a higher priority than the switching confirmation threshold.
  • the specific viewpoint area information is information describing a specific viewpoint area that is a viewing area of the specific viewpoint intended by the information provider.
  • 5 and 6 are diagrams for explaining the specific viewpoint area information.
  • the specific viewpoint area is expressed by, for example, a three-dimensional viewing frustum as shown in FIG.
  • the specific viewpoint area information includes information such as a viewpoint position, posture information of the imaging apparatus, and FOV.
  • the 3D viewpoint area is specified by the distance) and Far Clip (far distance in the figure).
  • the specific viewpoint area information is not limited to specifying the viewpoint area based on the viewpoint position and orientation, and specifies a specific area in the video as in the case of viewing a free viewpoint video described later as a two-dimensional video. Also good.
  • a partial area in the video is set as a specific viewpoint area, and this partial area is designated by an angle or coordinates.
  • the specific region is designated by an angle (for example, ⁇ L, ⁇ R, ⁇ T, ⁇ B) with the assumed user position as a reference.
  • the vertices (upper right, upper left, lower left, lower right) of the specific area are represented by image coordinates (for example, P11, P12, P13, P14, P21, P22, P23, P24). May be specified.
  • the time stamp is information indicating the priority start time.
  • the information reproduction device 40 determines when to switch to the specific viewpoint by describing the start time of switching to the specific viewpoint indicated by the specific viewpoint area information. become able to.
  • the application area information is information indicating an area to which the viewpoint switching information is applied, and a viewpoint in the area indicated by the application area information is set as a viewpoint switching target to a specific viewpoint. For example, when performances are performed at a plurality of venues at the same time, it is possible to specify which venue user is to be a viewpoint switching target by applying area information.
  • the application area can be determined by specifying a certain vertex group.
  • the application area is designated by eight three-dimensional coordinates. The designation of the application area is not limited to 8 points, but may be any number of points.
  • the viewpoint is within the application region by performing inclusion determination of the position of the virtual imaging device or the above-described viewing frustum and the above-described point group (verticies).
  • the free viewpoint video is a two-dimensional video
  • the viewpoint switching information including the video of the viewpoint that the user is viewing is included in the viewpoint area
  • the viewpoint is switched to a specific viewpoint.
  • the application area is designated by specifying an area (for example, an area indicated by coordinates of four points) specified in the two-dimensional video.
  • Priority reason describes the reason for adding viewpoint switching information. For example, the reason why the content information provider wants to show, comments about the video, and the like can be given.
  • Priority destination content information describes information for accessing a video from a specific viewpoint. For example, when a video intended by the information provider is to be presented to the user, access information for accessing the video edited in accordance with the intention of the information provider is described.
  • the attribute information is information related to free viewpoint information.
  • the free viewpoint information is, for example, viewing of a performance venue
  • the name of the performer, the name of the band, the type of instrument, the gender, age, and name recognition of the performer are represented in a matrix. Express. If such attribute information is included in the viewpoint switching information, the information reproducing apparatus 40 collates the user information registered in advance with the attribute information included in the viewpoint switching information, and determines the favorite player based on the collation result. It is possible to switch the viewpoint to a specific viewpoint of interest.
  • the viewpoint switching information is not limited to information defined by one method, but may be information defined by a plurality of methods. For example, some viewpoint switching information has a viewpoint region designated by a method using a viewing frustum. In other viewpoint switching information, an area in the video may be designated as the viewpoint area.
  • viewpoint switching information is generated based on instruction information from the information provider.
  • the information processing unit 32 of the information providing apparatus 30 receives the instruction information indicating the instruction operation of the video desired to be presented to the user intended by the information provider of the free viewpoint information, and the viewpoint so that the instructed video can be presented to the user.
  • Generate switching information Based on the instruction information, the information processing unit 32 arranges a virtual imaging device, for example, in a three-dimensional space, and changes the position, orientation, angle of view, etc. of the imaging device, and sets the priority. Generate switching information. Further, the information processing unit 32 may generate viewpoint switching information by setting a priority by designating a partial area of the captured video.
  • the second method for generating viewpoint switching information generates viewpoint switching information regardless of the instruction information.
  • the information processing unit 32 of the information providing device 30 determines which region the audience or the like is paying attention to based on the sensor information acquired from the sensor device 20, and provides viewpoint switching information according to the attention state for the determined region. Generate. For example, a lot of people gathered in which performance hall based on the gaze information collected by the sensor device 20 installed in a performance hall, a stadium, etc. Or the degree of excitement of the audience.
  • the information processing unit 32 generates viewpoint switching information by assigning a priority as a viewpoint area of a specific viewpoint to an area where the line of sight, a lot of people are gathered, or an area where the degree of excitement is high.
  • the viewpoint switching information may be generated based on information acquired via a network or the like without being limited to information acquired by the sensor device 20.
  • the information processing unit 32 estimates the excitement status based on writing using an external service such as SNS (social networking service) or the impression of the user who is viewing the free viewpoint information. Further, the information processing unit 32 sets the viewpoint area of the specific viewpoint so as to include an area where the degree of excitement is high, assigns priority, and generates viewpoint switching information.
  • SNS social networking service
  • the information processing unit 32 may register the generated viewpoint switching information in a database provided in the information processing unit 32, for example. Further, the information processing unit 32 may update the information registered in the database using the generated viewpoint switching information.
  • FIG. 7 is a flowchart illustrating the operation of the information providing apparatus.
  • the information providing apparatus starts generating free viewpoint information.
  • the information providing apparatus 30 starts generating free viewpoint information including free viewpoint video information and free viewpoint audio information using the video material and audio material acquired from the sensor apparatus 20, and proceeds to step ST2.
  • step ST2 the information providing apparatus associates viewpoint switching information with free viewpoint information.
  • the information providing apparatus 30 associates the viewpoint switching information with the free viewpoint information at predetermined time intervals, a desired time interval, or a period specified by the information provider, and proceeds to step ST3.
  • step ST3 the information providing apparatus determines whether to update the viewpoint switching information. If the information providing apparatus 30 determines to update the viewpoint switching information based on the instruction information or the like, the information providing apparatus 30 proceeds to step ST4. If the information providing apparatus 30 determines not to update the viewpoint switching information, the information providing apparatus 30 proceeds to step ST5.
  • step ST4 the information providing apparatus performs viewpoint switching information update processing.
  • the information providing apparatus 30 updates the viewpoint switching information based on the instruction information and the like, sets the updated viewpoint switching information to be associated with the free viewpoint information, and proceeds to step ST5.
  • step ST5 the information providing apparatus determines whether to end the generation of free viewpoint information.
  • the information providing apparatus 30 returns to step ST2 and continues to associate the viewpoint switching information with the free viewpoint information. Further, the information providing apparatus 30 ends the process when the generation of the free viewpoint information is completed.
  • the information providing apparatus 30 generates free viewpoint information associated with the viewpoint switching information and outputs it to the information reproducing apparatus 40. Further, the information providing apparatus 30 generates free viewpoint information associated with viewpoint switching information for each of various contents, and the freedom associated with the viewpoint switching information in response to a request from the information reproducing apparatus 40. Viewpoint information may be output.
  • the information reproducing apparatus enables viewing of a free viewpoint by a user's manual viewpoint movement operation or automatic viewpoint movement operation.
  • the automatic viewpoint movement is movement of the viewpoint linked to the face direction based on the detection result when a change in the face direction is detected by a sensor when a head mounted display is used, for example.
  • the information reproducing apparatus performs viewpoint switching based on the viewpoint switching information, and presents the user with video and audio at a specific viewpoint intended by the information provider.
  • FIG. 8 is a flowchart illustrating the operation of the information reproducing apparatus.
  • the information reproducing apparatus performs viewpoint movement processing according to the operation.
  • the information reproducing device 40 displays the video and audio of the viewpoint after the viewpoint moving operation on the display device 51 and the audio.
  • the output device 52 presents it to the user and proceeds to step ST12.
  • step ST12 the information reproducing apparatus determines whether there is associated viewpoint switching information.
  • the information reproducing device 40 determines whether the viewpoint switching information is associated with the free viewpoint information to be reproduced.
  • the information reproducing device 40 proceeds to step ST13 when the viewpoint switching information is associated, and returns to step ST11 when it is not associated.
  • step ST13 the information reproducing apparatus determines whether or not the condition for switching to the specific viewpoint indicated by the viewpoint switching information is satisfied. For example, when the current viewpoint is included in the application area and the priority is equal to or higher than a preset switching threshold, the information reproducing device 40 proceeds to step ST14 when determining that the switching condition is satisfied. Further, the information reproducing apparatus 40, for example, when the current viewpoint is not included in the application area, when the priority is lower than a preset switching threshold, or when it is determined that the switching condition is not satisfied, the information reproducing apparatus 40 proceeds to step ST11. Return.
  • step ST14 the information reproducing apparatus determines whether or not the time stamp has been reached.
  • the information reproducing apparatus 40 proceeds to step ST16 when the time stamp indicated by the viewpoint switching information determined to satisfy the switching condition is not reached, and proceeds to step ST15 when the time stamp is reached.
  • step ST15 the information reproducing apparatus performs switching to the specific viewpoint indicated by the viewpoint switching information.
  • the information reproducing device 40 switches the viewpoint to a specific viewpoint determined to satisfy the viewing state change condition, and presents the video and audio of the specific viewpoint after the switching from the display device 51 and the audio output device 52 to the user.
  • the user may be notified by video or audio from the display device 51 or the audio output device 52 that the viewpoint switching based on the viewpoint switching information has been performed.
  • the information reproducing apparatus performs switching to the specific viewpoint indicated by the viewpoint switching information, and returns to step ST12.
  • step ST16 the information reproducing apparatus determines whether reproduction of free viewpoint information has been completed. When the information reproducing apparatus 40 determines that the reproduction of the free viewpoint information has been completed, the information reproducing apparatus 40 ends the reproducing operation. If the information reproducing apparatus 40 has not determined that the reproduction of the free viewpoint information has been completed, the information reproducing apparatus 40 returns to step ST11.
  • the information reproducing apparatus 40 can display the video or audio presented to the user from the display apparatus 51 or the audio output apparatus 52 as the specific viewpoint. Change to video or audio. That is, the information reproducing apparatus 40 can avoid a situation in which the video or audio intended by the information provider is not viewed. Further, the information reproducing apparatus 40 uses the priority as the switching condition to the specific viewpoint, but other switching conditions may be provided. For example, the information reproducing apparatus 40 sets a switching confirmation threshold in advance and inquires the user of switching when the priority is equal to or higher than the switching confirmation threshold, and switches to a specific viewpoint when a switching instruction is received. Also good.
  • FIG. 9 is a sequence diagram illustrating the operation of the information presentation system.
  • the information reproducing device 40 outputs the free viewpoint information and the viewpoint switching information to the information providing device 30. It is assumed that the viewpoint switching information output in step ST21 has a lower priority than the switching threshold.
  • step ST22 the information reproducing device 40 generates a video output signal and an audio output signal from the free viewpoint information acquired from the information providing device 30, and outputs the video output signal to the display device 51 and the audio output signal to the audio output device 52, respectively. Output.
  • the information reproducing apparatus 40 since the priority of the viewpoint switching information is lower than the switching threshold, the information reproducing apparatus 40 generates a video output signal and an audio output signal corresponding to the viewpoint of the user. Therefore, the video and audio corresponding to the user's viewpoint are presented to the user on the display device 51 and the audio output device 52.
  • the information reproduction apparatus 40 When an operation signal corresponding to the viewpoint movement operation is supplied to the information reproduction apparatus 40 in step ST23, the information reproduction apparatus 40 performs viewpoint movement based on the operation signal. As the viewpoint is moved, the information reproducing device 40 generates a video output signal and an audio output signal of the moved viewpoint from the free viewpoint information, and displays the video output signal that is the moved viewpoint as shown in step ST24.
  • the audio output signal is output to the apparatus 51 and the audio output signal is output to the audio output apparatus 52. Therefore, the user is presented with video and audio corresponding to the user's moved viewpoint.
  • the information providing apparatus 30 When the information providing apparatus 30 is instructed to change the viewpoint switching information in step ST25, the information providing apparatus 30 updates the viewpoint switching information associated with the free viewpoint information. Note that the updated viewpoint switching information has a priority higher than the switching threshold.
  • step ST26 the information reproducing apparatus 40 outputs the free viewpoint information and the updated viewpoint switching information to the information providing apparatus 30.
  • the information reproducing apparatus 40 determines that the priority is equal to or higher than the switching threshold.
  • the information reproducing device 40 As shown in step ST27, the video output signal indicating the video of the specific viewpoint indicated by the viewpoint switching information and the specific viewpoint area The audio output signal corresponding to the video is generated, the video output signal is output to the display device 51, and the audio output signal is output to the audio output device 52. Therefore, the user is presented with video and audio of a specific viewpoint intended by the information provider.
  • the information providing apparatus 30 When the information providing apparatus 30 is instructed to change the viewpoint switching information in step ST28, the information providing apparatus 30 updates the viewpoint switching information associated with the free viewpoint information. Note that the updated viewpoint switching information has a lower priority than the switching threshold.
  • step ST29 the information reproducing apparatus 40 outputs the free viewpoint information and the updated viewpoint switching information to the information providing apparatus 30. Further, since the priority is lower than the switching threshold in the updated viewpoint switching information, the viewpoint moving operation is accepted.
  • the information reproducing apparatus 40 When an operation signal corresponding to the viewpoint movement operation is supplied to the information reproducing apparatus 40 in step ST30, the information reproducing apparatus 40 performs viewpoint movement based on the operation signal.
  • the information reproduction device 40 generates a video output signal and an audio output signal of the moved viewpoint from the free viewpoint information as the viewpoint is moved, and displays the video output signal after the movement of the viewpoint as shown in step ST31.
  • the audio output signal is output to the audio output device 52. Therefore, the video and audio presented to the user are changed from the video and audio intended by the information provider to the video and audio of the viewpoint moved according to the user's viewpoint movement operation.
  • the information presentation system when configured using the information presentation device and the information reproduction device of the present technology, information on a specific viewpoint intended by the information provider is given to the user based on the viewpoint switching information associated with the provision information. Can present. For this reason, since the user can prevent an important scene from being missed, for example, the user can be immersed in viewing a free viewpoint with peace of mind.
  • Example of playback operation> in order to facilitate understanding of the present technology, a reproduction operation in the case where the provided information is, for example, free viewpoint information of a performance venue will be exemplified.
  • the provided information is, for example, free viewpoint information of a performance venue
  • viewing from a free viewpoint is enabled by a user's manual viewpoint movement operation or automatic viewpoint movement operation.
  • the viewpoint switching information for switching to the reproduction of the specific viewpoint is associated with the free viewpoint information, and the priority of the viewpoint switching information is equal to or higher than the switching threshold.
  • the viewpoint switching information is associated in this way, the viewpoint is automatically switched to the specific viewpoint based on the viewpoint switching information in the climax part of the song, and the video intended by the information provider is presented to the user. Therefore, it is possible to avoid a situation where the video intended by the information provider is not viewed.
  • FIG. 10 shows an example of the reproduction operation of the free viewpoint information indicating the performance venue.
  • (A) of FIG. 10 shows a performance hall, viewing by a free viewpoint is performed by a viewpoint moving operation, and for example, a viewpoint video as shown in (b) of FIG. 10 can be presented to the user.
  • the information provider wants to present to the user a video showing the singer at the rising part of the song
  • the information provider outputs instruction information to the information providing device 30 and switches the viewpoint to free viewpoint information before the rising part of the song.
  • Associate information is information indicating that the specific viewpoint is the front of the singer, the specific viewpoint area information includes the singer area, the priority is equal to or higher than the switching threshold, and the time stamp indicates the timing of the rising part of the song.
  • the information reproducing apparatus 40 performs viewpoint switching based on the viewpoint switching information, and the user displays the video shown in FIG. 10C intended by the information provider at the timing of the rising portion of the song. Can be presented.
  • the information providing device 30 updates the viewpoint switching information at the end of the climax part of the song based on the instruction information from the information provider, and deletes the priority lower than the switching threshold or the viewpoint switching information. Therefore, when the climax part of the song ends, the reproduction from the specific viewpoint is canceled, and the viewing from the free viewpoint can be performed by, for example, the viewpoint movement operation.
  • the reproduction operation when the provided information is, for example, free viewpoint information indicating a stadium will be exemplified.
  • viewing from a free viewpoint is enabled by a viewpoint movement operation.
  • the viewpoint switching information for switching to playback of the specific viewpoint is associated with the free viewpoint information, and the priority of the viewpoint switching information is set to a switching threshold or higher. To do.
  • the viewpoint switching information By associating viewpoint switching information in this way, in an important scene, the viewpoint is automatically switched to a specific viewpoint based on the viewpoint switching information, and the video intended by the information provider is presented to the user. A situation where the intended video is not viewed can be avoided.
  • FIG. 11 shows a reproduction operation example of free viewpoint information indicating a stadium.
  • FIG. 11 (a) shows a soccer stadium, which is viewed from a free viewpoint by a viewpoint movement operation. For example, as shown in FIG. Can present.
  • the information provider wants to present an important scene, for example, a video of a scoring scene, to the user, the information provider outputs instruction information to the information providing device 30 to associate the viewpoint switching information with the free viewpoint information of the scoring scene timing.
  • the viewpoint switching information to be associated includes the specific viewpoint area information including the soccer goal area, and the priority is set to a switching threshold or more.
  • the information reproducing device 40 performs viewpoint switching based on the viewpoint switching information, and the scoring scene video shown in FIG.
  • the information reproducing apparatus 40 uses a favorite viewpoint (for example, a goal net as a background) specified in advance by the user in the scoring scene when reproducing with a free viewpoint. (Viewpoint, keeper viewpoint, etc.) can be presented.
  • the information providing apparatus 30 detects the climax of the audience in the stadium based on the sensor information or the like, the information providing apparatus 30 generates specific viewpoint area information using the area that the audience is paying attention to as the viewpoint area of the specific viewpoint.
  • the information providing apparatus 30 associates information.
  • the priority is set lower than that of an important scene, and is set to be lower than the switching threshold and higher than the switching confirmation threshold.
  • the switching confirmation threshold is a value lower than the switching threshold.
  • the information reproducing apparatus 40 When the information reproducing apparatus 40 receives the switching instruction, the information reproducing apparatus 40 presents the video of the exciting scene shown in (d) of FIG. 11 to the user. Furthermore, if viewpoint switching information is generated based on sensor information or the like, it is possible to present an exciting scene without knowing the timing of the important scene, so it is possible to prevent the important scene from being missed. . Note that FIG. 11E illustrates a case where a video of a climax scene is displayed on a reduced screen and an inquiry about switching to a specific viewpoint is made.
  • the viewpoint switching is not limited to the above case, and the viewpoint switching may be performed in the direction indicated by the arrow in FIG. 10 or FIG.
  • the viewpoint switching is not limited to the same content, and switching to a specific viewpoint may be performed between different contents. For example, when watching a soccer game, if a climax occurs in a baseball game, the baseball video is displayed on a reduced screen on the soccer video and the viewer is asked to switch to a specific viewpoint. Switch to baseball video when an instruction is accepted. In this way, it becomes possible to perform viewpoint switching to a specific viewpoint among a plurality of contents.
  • the reproduction operation when the provided information is, for example, a two-dimensional omnidirectional video will be exemplified.
  • the video of the area corresponding to the user's viewpoint is selected and presented from the omnidirectional video by the viewpoint moving operation.
  • the viewpoint switching information is associated with the provided information, and the viewpoint switching information indicates the important area in the specific viewpoint area information and gives priority. The degree is equal to or greater than the switching threshold.
  • FIG. 12 shows a reproduction operation example of a two-dimensional spherical image.
  • A of FIG. 12 has shown the imaging state of the omnidirectional image, for example, the omnidirectional image which shows the earth and outer space is acquired with the sensor apparatus 20.
  • FIG. Viewing from a free viewpoint is performed by the user's manual viewpoint movement operation or automatic viewpoint movement operation, and for example, as shown in FIG.
  • FIG. 12C an image of an area on the earth that the user pays attention to can be presented.
  • the information provider uses a commentary on the stars and a commentary on the region on the earth as a free viewpoint sound in the presentation information. Furthermore, the information provider associates the viewpoint switching information to the specific viewpoint with the free viewpoint information at the timing of the commentary about the specific star.
  • an area including a specific star is a viewpoint area of a specific viewpoint
  • a viewpoint of a star area in the omnidirectional video is a viewpoint switching target.
  • the information provider associates the viewpoint switching information to the specific viewpoint with the free viewpoint information at the timing of the explanation about the specific area of the earth.
  • a specific area is a viewpoint area of a specific viewpoint
  • a viewpoint of an area on the earth in the omnidirectional video is a viewpoint switching target.
  • the viewpoint switching information is associated with the presentation information
  • the commentary sound about the star is output and the commentary sound about the specific star is output.
  • the viewpoint is switched to the specific viewpoint based on the viewpoint switching information. Therefore, the image shown in (b) of FIG. 12 is switched to the image of a specific star shown in (d) of FIG.
  • the viewpoint switching is not performed on the image of the specific star. Accordingly, when reproducing the free viewpoint information, for example, it is possible to present without missing the video linked to the explanation of a specific star.
  • the audio of the commentary about the area on the earth is output, and at the timing of the audio of the commentary about the specific area, the specific viewpoint based on the viewpoint switching information Change the viewpoint to. Accordingly, the video shown in (c) of FIG. 12 is switched to a video of a specific area shown in (e) of FIG.
  • the viewpoint switching is not performed on the video of a specific region on the earth. Therefore, at the time of reproducing free viewpoint information, for example, it is possible to present without missing a video linked to a description of a specific area on the earth.
  • the information reproducing apparatus 40 may notify that the video is switched, or provide a pre-processing time so that the video is switched continuously from the free viewpoint video to the specific viewpoint video.
  • the information presentation system 10 can specify, for example, which part of the two-dimensional omnidirectional video is to be preferentially presented by the viewpoint switching information, and the three-dimensional model. Is given, the viewpoint of the three-dimensional virtual imaging device can be designated.
  • viewpoint switching is performed using the priority, application area, and time stamp.
  • the information reproducing apparatus 40 may perform viewpoint switching using other information.
  • the determination of whether to switch viewpoints is not limited to priority, and attribute information of free viewpoint information may be used.
  • the attribute information of the free viewpoint information is, for example, information related to the artist shown in the video (for example, player name, instrument name, band name, sex, age, name recognition by age, etc.).
  • the viewpoint is switched based on the collation result of user information registered in advance.
  • the viewpoint switching information associates, for example, viewpoint switching information for each performer with respect to the rising part of the song.
  • the information reproducing device 40 collates the registered user information and the viewpoint switching information, and when the user can select the viewpoint switching information regarding the favorite performer, the information reproducing apparatus 40 performs the viewpoint switching based on the selected viewpoint switching information. . Therefore, in the information reproducing apparatus 40, the user can present the favorite player's video and audio at the rising part of the song. As described above, when the attribute information or the like is included in the viewpoint switching information, the information reproducing apparatus 40 can perform the viewpoint switching to the specific viewpoint according to the user based on the attribute information or the like.
  • the video and audio of the free viewpoint are presented based on the information such as the position and orientation of the virtual imaging device.
  • the free viewpoint information is displayed using another method. May be viewed.
  • a two-dimensional video edited by the information provider may be presented after switching the viewpoint to a specific viewpoint.
  • the viewpoint is switched to the specific viewpoint, the 3D video from the free viewpoint is switched to the 2D video.
  • the information reproducing apparatus 40 may provide a plurality of patterns indicating which viewpoint to return to after switching the viewpoint and completing the presentation of the video intended by the information provider.
  • the information reproducing device 40 stores, for example, the position / posture of the virtual imaging device that is the viewpoint before switching, or the presented video area, and after the presentation of the video intended by the information provider is completed, switching is performed. You may return to the previous viewpoint.
  • the information reproducing apparatus 40 can display the video of the viewpoint focused on the specific player after completing the presentation of the video intended by the information provider. May be presented. Further, the information reproducing apparatus 40 may continue the state of the specific viewpoint as it is after the presentation of the video intended by the information provider is completed.
  • the information reproducing apparatus 40 may move the viewpoint from the specific viewpoint after the completion of the presentation of the video intended by the information provider in accordance with the subsequent manual viewpoint movement operation or automatic viewpoint movement operation of the user.
  • You may give a restriction
  • the position and orientation of a virtual imaging device are set so that a target point is provided on a target to be noticed and a video of the target point is presented.
  • the movement of the viewpoint is limited so that the viewpoint rotates around the gazing point.
  • the limitation on the viewpoint movement is not limited to the case where the viewpoint movement is limited so that the viewpoint rotates around the gazing point.
  • the viewpoint movement may be limited to a fixed parallel movement. In this way, if the viewpoint movement is limited to a fixed parallel movement, an image as if on a vehicle can be presented.
  • an image sensor may be provided in the information reproducing apparatus 40, and a viewer may be identified by using a face identification technology or an iris authentication technology, and the viewpoint may be switched according to the identified viewer. For example, viewpoint switching can be performed when the viewer is a child, and viewpoint switching is not performed when the viewer is an adult. By switching the viewpoint, for example, if the provided information is content for children, the video intended by the information provider can be presented by switching the viewpoint to a specific viewpoint, and the child's interest in important scenes. Can be attracted.
  • switching of video is mainly described as viewpoint switching, but audio may be switched in viewpoint switching.
  • the provided information indicates the performance of music
  • the climax part of the song may present the user with a voice that emphasizes the voice of the singer.
  • the provided information is a sports broadcast, in an important scene, the audience and surrounding sounds may be attenuated to present a voice that emphasizes the breathing of the player.
  • the information provider sets in advance the time stamp indicating the viewpoint switching timing.
  • the viewpoint switching timing may be determined using a delay in providing free viewing information. For example, it is difficult to completely predict an event (an important scene such as a soccer goal scene) that has occurred during a sports broadcast.
  • the viewpoint switching information at the time of the event occurrence before the image at the time of the event occurrence is presented to the user by using the delay of the provided video (for example, the delay due to the encoding process of the video or the delay added intentionally) May be output to the information reproducing apparatus 40.
  • the series of processes described in the specification can be executed by hardware, software, or a combined configuration of both.
  • a program in which a processing sequence is recorded is installed and executed in a memory in a computer incorporated in dedicated hardware.
  • the program can be installed and executed on a general-purpose computer capable of executing various processes.
  • the program can be recorded in advance on a hard disk, SSD (Solid State Drive), or ROM (Read Only Memory) as a recording medium.
  • the program is a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto optical disc), a DVD (Digital Versatile Disc), a BD (Blu-Ray Disc (registered trademark)), a magnetic disk, or a semiconductor memory card. It can be stored (recorded) in a removable recording medium such as temporarily or permanently. Such a removable recording medium can be provided as so-called package software.
  • the program may be transferred from the download site to the computer wirelessly or by wire via a network such as a LAN (Local Area Network) or the Internet.
  • the computer can receive the program transferred in this way and install it on a recording medium such as a built-in hard disk.
  • the information providing apparatus of the present technology can also have the following configuration.
  • An information providing apparatus including an information processing unit that associates viewpoint switching information for switching reproduction of the provided information to reproduction of a specific viewpoint with provided information whose viewpoint at the time of reproduction is movable.
  • the information processing apparatus according to (1) wherein the information processing unit includes a priority of the specific viewpoint in the viewpoint switching information.
  • the information processing unit includes viewing area information indicating a specific viewpoint viewing area viewed from the specific viewpoint in the viewpoint switching information.
  • the information processing unit includes application area information to which the viewpoint switching information is applied in the viewpoint switching information.
  • the information processing apparatus includes time information indicating a switching time to the specific viewpoint in the viewpoint switching information.
  • the information processing unit includes attribute information related to the provided information in the viewpoint switching information.
  • the information processing unit generates the viewpoint switching information for each of one or more specific viewpoints.
  • the information providing apparatus according to any one of (1) to (7), wherein the provided information is information on video content or video content and audio content.
  • the information reproducing apparatus may have the following configuration.
  • (1) Based on the viewpoint switching information for switching the reproduction of the provided information associated with the provided information whose viewpoint at the time of reproduction is movable to the reproduction of the specific viewpoint, the reproduction of the specific viewpoint from the reproduction of the free viewpoint of the provision information
  • An information reproducing apparatus comprising a reproduction control unit for switching to.
  • the viewpoint switching information includes the priority of the specific viewpoint,
  • the information reproduction apparatus according to (1) wherein the reproduction control unit switches to reproduction of the specific viewpoint when the priority is equal to or higher than a preset switching threshold.
  • the viewpoint switching information includes the priority of the specific viewpoint, When the priority is equal to or higher than a preset switching confirmation threshold, the playback control unit makes an inquiry about switching to the specific viewpoint to the viewer of the provided information, and when the switching instruction is received, The information reproducing apparatus according to (1) or (2), wherein switching to a specific viewpoint is performed.
  • the viewpoint switching information includes application area information to which the viewpoint switching information is applied, The reproduction control unit performs switching to the specific viewpoint based on the viewpoint switching information when the viewpoint being reproduced of the provided information is within the area indicated by the application area information (1) to (3) An information reproducing apparatus according to any one of the above.
  • the viewpoint switching information includes time information indicating a switching time to the specific viewpoint, and the reproduction control unit performs switching to the specific viewpoint based on the viewpoint switching information when the switching time is reached ( The information reproducing apparatus according to any one of 1) to (4).
  • the viewpoint switching information includes attribute information related to the provided information, The information reproduction apparatus according to any one of (1) to (5), wherein the reproduction control unit collates information registered in advance with the attribute information, and performs switching to the specific viewpoint based on a collation result.
  • the information reproduction device according to any one of (1) to (6), wherein the reproduction control unit is capable of moving the viewpoint from the specific viewpoint after switching to the specific viewpoint.
  • the viewpoint switching for switching the reproduction of the provided information to the reproduction of the specific viewpoint for the provided information whose viewpoint at the time of reproduction is movable Information is associated. Further, when the provided information is reproduced, the viewpoint is switched from the reproduction of the free viewpoint to the reproduction of the specific viewpoint based on the viewpoint switching information. For this reason, even if the provided information is played back from a free viewpoint, it is possible to switch to playback of a specific viewpoint by the viewpoint switching information, and the video etc. intended by the information provider even if playback is performed from the free viewpoint It is suitable for a system that allows users to view content from a free viewpoint.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Selon l'invention, un dispositif de dimensionnement d'informations 30 utilise un matériel vidéo et un matériel audio qui sont acquis à partir d'un dispositif capteur 20 pour générer des informations de dimensionnement qui permettent le mouvement d'un point de vue pendant la reproduction. De plus, le dispositif de dimensionnement d'informations 30 associe, aux informations de dimensionnement, des informations de commutation de point de vue pour commuter la reproduction des informations de dimensionnement à une reproduction de point de vue spécifique. Un dispositif de reproduction d'informations 40 exécute une commutation de point de vue, d'une reproduction de point de vue libre à une reproduction de point de vue spécifique, sur la base des informations de commutation de point de vue, lorsque les informations de dimensionnement sont reproduites. De cette façon, en associant, aux informations présentées, les informations de commutation de point de vue relatives à un point de vue spécifique pour présenter une vidéo prévue et similaire, un fournisseur d'informations peut présenter la vidéo et similaire, prévue par le fournisseur d'informations, à un utilisateur, même lorsque l'utilisateur reproduit les informations présentées à partir d'un point de vue libre.
PCT/JP2017/027661 2016-10-11 2017-07-31 Dispositif de dimensionnement d'informations, procédé de dimensionnement d'informations, dispositif de reproduction d'informations, et procédé de reproduction d'informations WO2018070092A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-199901 2016-10-11
JP2016199901 2016-10-11

Publications (1)

Publication Number Publication Date
WO2018070092A1 true WO2018070092A1 (fr) 2018-04-19

Family

ID=61905372

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/027661 WO2018070092A1 (fr) 2016-10-11 2017-07-31 Dispositif de dimensionnement d'informations, procédé de dimensionnement d'informations, dispositif de reproduction d'informations, et procédé de reproduction d'informations

Country Status (1)

Country Link
WO (1) WO2018070092A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020162218A1 (fr) * 2019-02-08 2020-08-13 ソニー株式会社 Dispositif de reproduction, procédé de reproduction et programme
JPWO2021152758A1 (fr) * 2020-01-30 2021-08-05
WO2023182026A1 (fr) * 2022-03-24 2023-09-28 パナソニックＩｐマネジメント株式会社 Dispositif de traitement d'informations, système de traitement d'informations et procédé de commande de dispositif de traitement d'informations
EP3703384B1 (fr) * 2016-02-16 2024-02-14 Nokia Technologies Oy Encapsulation et décapsulation de milieux

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010088017A (ja) * 2008-10-02 2010-04-15 Canon Inc 放送受信装置及びその制御方法
WO2012039404A1 (fr) * 2010-09-24 2012-03-29 株式会社Gnzo Système de transmission d'un train de bits vidéo
JP2016123069A (ja) * 2014-12-25 2016-07-07 パナソニックＩｐマネジメント株式会社 映像配信方法、映像受信方法、サーバ及び端末装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010088017A (ja) * 2008-10-02 2010-04-15 Canon Inc 放送受信装置及びその制御方法
WO2012039404A1 (fr) * 2010-09-24 2012-03-29 株式会社Gnzo Système de transmission d'un train de bits vidéo
JP2016123069A (ja) * 2014-12-25 2016-07-07 パナソニックＩｐマネジメント株式会社 映像配信方法、映像受信方法、サーバ及び端末装置

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3703384B1 (fr) * 2016-02-16 2024-02-14 Nokia Technologies Oy Encapsulation et décapsulation de milieux
WO2020162218A1 (fr) * 2019-02-08 2020-08-13 ソニー株式会社 Dispositif de reproduction, procédé de reproduction et programme
JPWO2020162218A1 (ja) * 2019-02-08 2021-12-09 ソニーグループ株式会社 再生装置、および再生方法、並びにプログラム
US11477396B2 (en) 2019-02-08 2022-10-18 Sony Group Corporation Reproducing device, reproducing method, and program
JP7484729B2 (ja) 2019-02-08 2024-05-16 ソニーグループ株式会社 再生装置、および再生方法、並びにプログラム
JPWO2021152758A1 (fr) * 2020-01-30 2021-08-05
JP7054287B2 (ja) 2020-01-30 2022-04-13 Ａｍａｔｅｌｕｓ株式会社 映像配信装置、映像配信システム、映像配信方法、及びプログラム
JP2022075940A (ja) * 2020-01-30 2022-05-18 Ａｍａｔｅｌｕｓ株式会社 映像配信装置、映像配信システム、映像配信方法、及びプログラム
EP4099687A4 (fr) * 2020-01-30 2023-10-11 Amatelus Inc. Dispositif de distribution de vidéo, système de distribution de vidéo, procédé de distribution de vidéo et programme
JP7365076B2 (ja) 2020-01-30 2023-10-19 Ａｍａｔｅｌｕｓ株式会社 映像配信装置、映像配信システム、映像配信方法、及びプログラム
WO2023182026A1 (fr) * 2022-03-24 2023-09-28 パナソニックＩｐマネジメント株式会社 Dispositif de traitement d'informations, système de traitement d'informations et procédé de commande de dispositif de traitement d'informations

Similar Documents

Publication Publication Date Title
US10819969B2 (en) Method and apparatus for generating media presentation content with environmentally modified audio components
JP6558587B2 (ja) 情報処理装置、表示装置、情報処理方法、プログラム、および情報処理システム
CN111742353B (zh) 信息处理装置、信息处理方法和程序
JP6309749B2 (ja) 画像データ再生装置および画像データ生成装置
JP6178524B2 (ja) パノラマ動画再生装置、パノラマ動画編集装置、パノラマ動画再生方法、パノラマ動画再生プログラム、パノラマ動画再生システム及びパノラマ動画送信装置
US20230402067A1 (en) Integration of audio into a multi-view interactive digital media representation
US9026596B2 (en) Sharing of event media streams
WO2018070092A1 (fr) Dispositif de dimensionnement d'informations, procédé de dimensionnement d'informations, dispositif de reproduction d'informations, et procédé de reproduction d'informations
JP2015187797A (ja) 画像データ生成装置および画像データ再生装置
WO2017205637A1 (fr) Procédé et appareil de génération de présentations de réalité virtuelle ou augmentée avec positionnement audio 3d
KR102390208B1 (ko) 멀티미디어 데이터를 전송하는 방법 및 장치
JP6126271B1 (ja) 仮想空間を提供する方法、プログラム及び記録媒体
JP6882634B2 (ja) 再生装置と再生方法および情報生成装置と情報生成方法
WO2020021651A1 (fr) Dispositif de production automatique de vidéo, procédé de production automatique de vidéo, et support d'enregistrement vidéo utilisé pour ceux-ci
WO2016167160A1 (fr) Dispositif de production de données et dispositif de reproduction
WO2016203896A1 (fr) Dispositif de génération
JP2017208808A (ja) 仮想空間を提供する方法、プログラム及び記録媒体
JP7065708B2 (ja) 録画再生装置及びプログラム
JP2019145161A (ja) プログラム、情報処理装置、及び情報処理方法
JP6970143B2 (ja) 配信サーバ、配信方法及びプログラム
WO2022102446A1 (fr) Dispositif, procédé et système de traitement d'informations et procédé de génération de données
KR102612605B1 (ko) 다수 전방위 영상 기반 프로젝션 다중화 영상 생성 및 재현을 위한 방법 및 그 장치
JP2023130246A (ja) 立体像表示システム及び立体像表示方法
JP2024056581A (ja) 映像生成装置およびその制御方法
JP2023153120A (ja) 情報処理装置及び情報処理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17859910

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17859910

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP