JP7544048B2 - 情報処理装置、情報処理方法、再生処理装置及び再生処理方法 - Google Patents

情報処理装置、情報処理方法、再生処理装置及び再生処理方法 Download PDF

Info

Publication number
JP7544048B2
JP7544048B2 JP2021527391A JP2021527391A JP7544048B2 JP 7544048 B2 JP7544048 B2 JP 7544048B2 JP 2021527391 A JP2021527391 A JP 2021527391A JP 2021527391 A JP2021527391 A JP 2021527391A JP 7544048 B2 JP7544048 B2 JP 7544048B2
Authority
JP
Japan
Prior art keywords
file
information
content
selection information
dimensional object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021527391A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2020261689A1 (https=
Inventor
充 勝股
遼平 高橋
光浩 平林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Sony Group Corp
Original Assignee
Sony Corp
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp, Sony Group Corp filed Critical Sony Corp
Publication of JPWO2020261689A1 publication Critical patent/JPWO2020261689A1/ja
Priority to JP2024134918A priority Critical patent/JP7823691B2/ja
Application granted granted Critical
Publication of JP7544048B2 publication Critical patent/JP7544048B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2362Generation or processing of Service Information [SI]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4345Extraction or processing of SI, e.g. extracting service information from an MPEG stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347Demultiplexing of several video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management e.g. creating a master electronic programme guide from data received from the Internet and a Head-end or controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/85406Content authoring involving a specific file format, e.g. MP4 format

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Graphics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
JP2021527391A 2019-06-25 2020-03-31 情報処理装置、情報処理方法、再生処理装置及び再生処理方法 Active JP7544048B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024134918A JP7823691B2 (ja) 2019-06-25 2024-08-13 情報処理装置、情報処理方法、再生処理装置及び再生処理方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962866430P 2019-06-25 2019-06-25
US62/866,430 2019-06-25
PCT/JP2020/014884 WO2020261689A1 (ja) 2019-06-25 2020-03-31 情報処理装置、情報処理方法、再生処理装置及び再生処理方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024134918A Division JP7823691B2 (ja) 2019-06-25 2024-08-13 情報処理装置、情報処理方法、再生処理装置及び再生処理方法

Publications (2)

Publication Number Publication Date
JPWO2020261689A1 JPWO2020261689A1 (https=) 2020-12-30
JP7544048B2 true JP7544048B2 (ja) 2024-09-03

Family

ID=74060549

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021527391A Active JP7544048B2 (ja) 2019-06-25 2020-03-31 情報処理装置、情報処理方法、再生処理装置及び再生処理方法
JP2024134918A Active JP7823691B2 (ja) 2019-06-25 2024-08-13 情報処理装置、情報処理方法、再生処理装置及び再生処理方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024134918A Active JP7823691B2 (ja) 2019-06-25 2024-08-13 情報処理装置、情報処理方法、再生処理装置及び再生処理方法

Country Status (5)

Country Link
US (2) US20220239994A1 (https=)
EP (1) EP3982638A4 (https=)
JP (2) JP7544048B2 (https=)
CN (1) CN114026875B (https=)
WO (1) WO2020261689A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024155948A (ja) * 2019-06-25 2024-10-31 ソニーグループ株式会社 情報処理装置、情報処理方法、再生処理装置及び再生処理方法

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7782550B2 (ja) * 2021-04-15 2025-12-09 ソニーグループ株式会社 情報処理装置および方法
US12346291B2 (en) * 2021-11-03 2025-07-01 Vimeo.Com, Inc. On-the-fly/transparent fragmented ISOBMFF to progressive ISOBMFF transmultiplexing proxy
US12204499B2 (en) 2023-03-30 2025-01-21 Dropbox, Inc. Virtual space platform for a content block browser
US12093299B1 (en) 2023-03-30 2024-09-17 Dropbox, Inc. Generating and summarizing content blocks within a virtual space interface
US12088667B1 (en) 2023-03-30 2024-09-10 Dropbox, Inc. Generating and managing multilocational data blocks

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007158591A (ja) 2005-12-02 2007-06-21 Sharp Corp コンテンツ切替判定システム及び切替指示端末、並びに、コンテンツ切替判定方法
US20140168218A1 (en) 2011-04-19 2014-06-19 Institut Mines-Telecom Methods and Devices for Producing and Processing Representations of Multimedia Scenes
JP2015111897A (ja) 2010-08-05 2015-06-18 クゥアルコム・インコーポレイテッドQualcomm Incorporated ネットワークストリーミングされるビデオデータについての属性をシグナリングすること
US20150363977A1 (en) 2012-10-31 2015-12-17 Outward, Inc. Virtualizing content
US20160171743A1 (en) 2007-10-29 2016-06-16 Julian Michael Urbach Efficiently implementing and displaying independent 3-dimensional interactive viewports of a virtual world on multliple client devices
JP6316387B2 (ja) 2011-05-06 2018-04-25 マジック リープ, インコーポレイテッドMagic Leap,Inc. 広範囲同時遠隔ディジタル提示世界
WO2019064853A1 (ja) 2017-09-26 2019-04-04 キヤノン株式会社 情報処理装置、情報提供装置、制御方法、及びプログラム

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6654931B1 (en) * 1998-01-27 2003-11-25 At&T Corp. Systems and methods for playing, browsing and interacting with MPEG-4 coded audio-visual objects
US7330186B2 (en) * 1999-08-03 2008-02-12 Sony Corporation Methods and systems for scoring multiple time-based assets and events
US20080019398A1 (en) * 2006-07-20 2008-01-24 Adimos Systems Ltd. Clock recovery in wireless media streaming
KR101167246B1 (ko) * 2007-07-23 2012-07-23 삼성전자주식회사 3차원 콘텐츠 재생 장치 및 그 제어 방법
TW201005583A (en) * 2008-07-01 2010-02-01 Yoostar Entertainment Group Inc Interactive systems and methods for video compositing
WO2010095838A2 (ko) * 2009-02-17 2010-08-26 삼성전자 주식회사 그래픽 화면 처리 방법 및 장치
US10448083B2 (en) * 2010-04-06 2019-10-15 Comcast Cable Communications, Llc Streaming and rendering of 3-dimensional video
WO2011151959A1 (ja) * 2010-06-02 2011-12-08 日立コンシューマエレクトロニクス株式会社 受信装置、表示制御方法、送信装置および送信方法
US8957920B2 (en) * 2010-06-25 2015-02-17 Microsoft Corporation Alternative semantics for zoom operations in a zoomable scene
US20150189367A1 (en) * 2012-08-31 2015-07-02 Funke Digital Tv Guide Gmbh Electronic media content guide
JP6555263B2 (ja) * 2014-06-30 2019-08-07 ソニー株式会社 情報処理装置および方法
RU2728534C2 (ru) * 2016-02-12 2020-07-30 Сони Корпорейшн Устройство обработки информации и способ обработки информации
CN107801083A (zh) * 2016-09-06 2018-03-13 星播网(深圳)信息有限公司 一种基于三维虚拟技术的网络实时互动直播方法及装置
CN107292965B (zh) * 2017-08-03 2020-10-13 北京航空航天大学青岛研究院 一种基于深度图像数据流的虚实遮挡处理方法
US10559126B2 (en) * 2017-10-13 2020-02-11 Samsung Electronics Co., Ltd. 6DoF media consumption architecture using 2D video decoder
US11606576B2 (en) * 2018-10-08 2023-03-14 Samsung Electronics Co., Ltd. Method and apparatus for generating media file comprising 3-dimensional video content, and method and apparatus for replaying 3-dimensional video content
US11488633B2 (en) * 2019-04-11 2022-11-01 Sony Group Corporation Playback device
US10924875B2 (en) * 2019-05-24 2021-02-16 Zack Settel Augmented reality platform for navigable, immersive audio experience
JP7544048B2 (ja) 2019-06-25 2024-09-03 ソニーグループ株式会社 情報処理装置、情報処理方法、再生処理装置及び再生処理方法
EP4013042A1 (en) * 2019-09-30 2022-06-15 Sony Group Corporation Information processing device, reproduction processing device, and information processing method
WO2021117859A1 (ja) * 2019-12-13 2021-06-17 ソニーグループ株式会社 画像処理装置および方法
EP4224864A4 (en) * 2020-09-29 2024-04-03 Sony Group Corporation DEVICE AND METHOD FOR PROCESSING INFORMATION
EP4227906A4 (en) * 2020-10-07 2024-04-10 Sony Group Corporation DEVICE AND METHOD FOR PROCESSING INFORMATION

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007158591A (ja) 2005-12-02 2007-06-21 Sharp Corp コンテンツ切替判定システム及び切替指示端末、並びに、コンテンツ切替判定方法
US20160171743A1 (en) 2007-10-29 2016-06-16 Julian Michael Urbach Efficiently implementing and displaying independent 3-dimensional interactive viewports of a virtual world on multliple client devices
JP2015111897A (ja) 2010-08-05 2015-06-18 クゥアルコム・インコーポレイテッドQualcomm Incorporated ネットワークストリーミングされるビデオデータについての属性をシグナリングすること
US20140168218A1 (en) 2011-04-19 2014-06-19 Institut Mines-Telecom Methods and Devices for Producing and Processing Representations of Multimedia Scenes
JP6316387B2 (ja) 2011-05-06 2018-04-25 マジック リープ, インコーポレイテッドMagic Leap,Inc. 広範囲同時遠隔ディジタル提示世界
US20150363977A1 (en) 2012-10-31 2015-12-17 Outward, Inc. Virtualizing content
WO2019064853A1 (ja) 2017-09-26 2019-04-04 キヤノン株式会社 情報処理装置、情報提供装置、制御方法、及びプログラム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024155948A (ja) * 2019-06-25 2024-10-31 ソニーグループ株式会社 情報処理装置、情報処理方法、再生処理装置及び再生処理方法
JP7823691B2 (ja) 2019-06-25 2026-03-04 ソニーグループ株式会社 情報処理装置、情報処理方法、再生処理装置及び再生処理方法

Also Published As

Publication number Publication date
JP2024155948A (ja) 2024-10-31
JP7823691B2 (ja) 2026-03-04
US20220239994A1 (en) 2022-07-28
CN114026875A (zh) 2022-02-08
WO2020261689A1 (ja) 2020-12-30
JPWO2020261689A1 (https=) 2020-12-30
US20250380037A1 (en) 2025-12-11
EP3982638A4 (en) 2023-03-29
EP3982638A1 (en) 2022-04-13
CN114026875B (zh) 2025-02-18

Similar Documents

Publication Publication Date Title
JP7544048B2 (ja) 情報処理装置、情報処理方法、再生処理装置及び再生処理方法
JP7708229B2 (ja) 情報処理装置および情報処理方法
JP7439762B2 (ja) 情報処理装置および情報処理方法、並びにプログラム
WO2019202207A1 (en) Processing video patches for three-dimensional content
US10931930B2 (en) Methods and apparatus for immersive media content overlays
JP7415936B2 (ja) 情報処理装置および情報処理方法
JP7501372B2 (ja) 情報処理装置および情報処理方法
JP7480773B2 (ja) 情報処理装置、情報処理方法、再生処理装置及び再生処理方法
US11922561B2 (en) Methods and systems for implementing scene descriptions using derived visual tracks
US11967153B2 (en) Information processing apparatus, reproduction processing apparatus, and information processing method
JP7287454B2 (ja) 情報処理装置、再生処理装置、情報処理方法及び再生処理方法
CN114223211A (zh) 信息处理装置和信息处理方法
KR20200101349A (ko) 정보 처리 장치, 정보 처리 방법 및 프로그램
JP6632550B2 (ja) タイムピリオドにまたがってオブジェクトを識別する方法および対応デバイス
JP7647554B2 (ja) ファイル生成装置、ファイル生成方法、再生処理装置及び再生処理方法
GB2567485A (en) Method and device for exchanging data between a web application and an associated web engine
US20220369005A1 (en) Information processing device, information processing method, reproduction processing device, and reproduction processing method
KR102791998B1 (ko) 미디어 스트리밍 및 재생 동안 프리롤 및 미드롤을 지원하기 위한 방법 및 장치

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230210

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240305

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240425

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240723

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240805

R150 Certificate of patent or registration of utility model

Ref document number: 7544048

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150