CN104854861B - 现实视点视频方法及设备 - Google Patents

现实视点视频方法及设备 Download PDF

Info

Publication number
CN104854861B
CN104854861B CN201380065460.6A CN201380065460A CN104854861B CN 104854861 B CN104854861 B CN 104854861B CN 201380065460 A CN201380065460 A CN 201380065460A CN 104854861 B CN104854861 B CN 104854861B
Authority
CN
China
Prior art keywords
view
viewing
capture
views
scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201380065460.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN104854861A (zh
Inventor
杰拉尔德·保罗·米夏拉克
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN104854861A publication Critical patent/CN104854861A/zh
Application granted granted Critical
Publication of CN104854861B publication Critical patent/CN104854861B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Library & Information Science (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Controls And Circuits For Display Device (AREA)
CN201380065460.6A 2012-12-18 2013-11-21 现实视点视频方法及设备 Active CN104854861B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/718,957 2012-12-18
US13/718,957 US10116911B2 (en) 2012-12-18 2012-12-18 Realistic point of view video method and apparatus
PCT/US2013/071304 WO2014099251A1 (en) 2012-12-18 2013-11-21 Realistic point of view video method and apparatus

Publications (2)

Publication Number Publication Date
CN104854861A CN104854861A (zh) 2015-08-19
CN104854861B true CN104854861B (zh) 2017-03-15

Family

ID=49759571

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380065460.6A Active CN104854861B (zh) 2012-12-18 2013-11-21 现实视点视频方法及设备

Country Status (5)

Country Link
US (1) US10116911B2 (enExample)
EP (1) EP2936806B1 (enExample)
JP (1) JP2016507929A (enExample)
CN (1) CN104854861B (enExample)
WO (1) WO2014099251A1 (enExample)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2977113A1 (en) * 2015-03-01 2016-09-09 Nextvr Inc. Methods and apparatus for making environmental measurements and/or using such measurements in 3d image rendering
KR20160135660A (ko) * 2015-05-18 2016-11-28 한국전자통신연구원 헤드 마운트 디스플레이를 위한 입체 영상을 제공하는 방법 및 장치
EP3151554A1 (en) 2015-09-30 2017-04-05 Calay Venture S.a.r.l. Presence camera
US10110802B2 (en) * 2016-12-30 2018-10-23 Axis Ab Historical gaze heat map for a video stream

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102342100A (zh) * 2009-03-09 2012-02-01 思科技术公司 用于在网络环境中提供三维成像的系统和方法
CN102547323A (zh) * 2010-08-16 2012-07-04 Lg电子株式会社 从三维显示装置输出图像的方法及三维显示装置
CN102695065A (zh) * 2011-03-23 2012-09-26 索尼公司 图像处理装置、图像处理方法和程序

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5495576A (en) * 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
US5729471A (en) * 1995-03-31 1998-03-17 The Regents Of The University Of California Machine dynamic selection of one video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene
JPH09200715A (ja) 1996-01-19 1997-07-31 Canon Inc 通信装置、通信方法及び通信システム
US6573912B1 (en) 2000-11-07 2003-06-03 Zaxel Systems, Inc. Internet system for virtual telepresence
JP4539015B2 (ja) 2002-12-11 2010-09-08 ソニー株式会社 画像通信装置、および画像通信方法、並びにコンピュータ・プログラム
US9030532B2 (en) * 2004-08-19 2015-05-12 Microsoft Technology Licensing, Llc Stereoscopic image display
CN1984295A (zh) 2005-12-15 2007-06-20 皇家飞利浦电子股份有限公司 用于处理视频传输流的方法和处理单元
US20080178232A1 (en) * 2007-01-18 2008-07-24 Verizon Data Services Inc. Method and apparatus for providing user control of video views
JP2008217243A (ja) * 2007-03-01 2008-09-18 Mitsubishi Electric Corp 画像生成装置
US10063848B2 (en) * 2007-08-24 2018-08-28 John G. Posa Perspective altering display system
CN101472190B (zh) 2007-12-28 2013-01-23 华为终端有限公司 多视角摄像及图像处理装置、系统
US20100053310A1 (en) * 2008-08-31 2010-03-04 Maxson Brian D Transforming 3d video content to match viewer position
US20100259595A1 (en) * 2009-04-10 2010-10-14 Nokia Corporation Methods and Apparatuses for Efficient Streaming of Free View Point Video
US20100321482A1 (en) * 2009-06-17 2010-12-23 Lc Technologies Inc. Eye/head controls for camera pointing
JP2013502617A (ja) * 2009-08-25 2013-01-24 ドルビー ラボラトリーズ ライセンシング コーポレイション ３ｄディスプレイシステム
US8762846B2 (en) * 2009-11-16 2014-06-24 Broadcom Corporation Method and system for adaptive viewport for a mobile device based on viewing angle
JP5570284B2 (ja) * 2010-04-16 2014-08-13 キヤノン株式会社 画像処理装置および方法
US9167289B2 (en) * 2010-09-02 2015-10-20 Verizon Patent And Licensing Inc. Perspective display systems and methods
JP5364666B2 (ja) * 2010-09-13 2013-12-11 株式会社東芝 立体画像表示装置、方法およびプログラム
JP2012094990A (ja) 2010-10-25 2012-05-17 Duse Technologies Co Ltd 視点連動画像表示システム
US8842168B2 (en) * 2010-10-29 2014-09-23 Sony Corporation Multi-view video and still 3D capture system
US20120162384A1 (en) * 2010-12-22 2012-06-28 Vesely Michael A Three-Dimensional Collaboration
JP5067477B2 (ja) 2010-12-28 2012-11-07 カシオ計算機株式会社 撮像パラメータ取得装置、撮像パラメータ取得方法、及び、プログラム
US20120200676A1 (en) 2011-02-08 2012-08-09 Microsoft Corporation Three-Dimensional Display with Motion Parallax
US9558687B2 (en) * 2011-03-11 2017-01-31 Semiconductor Energy Laboratory Co., Ltd. Display device and method for driving the same
KR20140045349A (ko) * 2011-05-19 2014-04-16 삼성전자주식회사 3d컨텐츠제공장치 및 3d컨텐츠제공방법
WO2013093176A1 (en) * 2011-12-23 2013-06-27 Nokia Corporation Aligning videos representing different viewpoints

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102342100A (zh) * 2009-03-09 2012-02-01 思科技术公司 用于在网络环境中提供三维成像的系统和方法
CN102547323A (zh) * 2010-08-16 2012-07-04 Lg电子株式会社 从三维显示装置输出图像的方法及三维显示装置
CN102695065A (zh) * 2011-03-23 2012-09-26 索尼公司 图像处理装置、图像处理方法和程序

Also Published As

Publication number Publication date
JP2016507929A (ja) 2016-03-10
CN104854861A (zh) 2015-08-19
EP2936806B1 (en) 2023-03-29
US10116911B2 (en) 2018-10-30
WO2014099251A1 (en) 2014-06-26
EP2936806A1 (en) 2015-10-28
US20140168359A1 (en) 2014-06-19

Similar Documents

Publication Publication Date Title
US10540818B2 (en) Stereo image generation and interactive playback
US10499033B2 (en) Apparatus, a method and a computer program for coding and rendering volumetric video
US10474227B2 (en) Generation of virtual reality with 6 degrees of freedom from limited viewer data
RU2711591C1 (ru) Способ, устройство и компьютерная программа для адаптивной потоковой передачи мультимедийного контента виртуальной реальности
EP3516882B1 (en) Content based stream splitting of video data
US9846960B2 (en) Automated camera array calibration
US12033355B2 (en) Client/server distributed camera calibration
US20130044192A1 (en) Converting 3d video into 2d video based on identification of format type of 3d video and providing either 2d or 3d video based on identification of display device type
CN113873264A (zh) 显示图像的方法、装置、电子设备及存储介质
JP2019062390A (ja) 情報処理装置、情報提供装置、制御方法、及びプログラム
US10444931B2 (en) Vantage generation and interactive playback
JP2016537901A (ja) ライトフィールド処理方法
US11055917B2 (en) Methods and systems for generating a customized view of a real-world scene
CN104854861B (zh) 现实视点视频方法及设备
CN107396085A (zh) 一种全视点视频图像的处理方法及系统
JP7447266B2 (ja) ボリュメトリック画像データに関するビューの符号化及び復号
KR20200020913A (ko) 미디어 정보를 처리하는 방법 및 장치
JP6360389B2 (ja) 映像提示装置及びプログラム
WO2022193875A1 (zh) 多视角视频的处理方法、装置、设备及存储介质
Adhikarla et al. View synthesis for lightfield displays using region based non-linear image warping
CN114339034A (zh) 一种基于自由视角视频数据的传输方法及接收处理方法
HK40083059B (zh) 媒体文件封装与解封装方法、装置、设备及存储介质

Legal Events

Date Code Title Description
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant