WO2012059280A3 - System and method for multiperspective telepresence communication - Google Patents

System and method for multiperspective telepresence communication Download PDF

Info

Publication number
WO2012059280A3
WO2012059280A3 PCT/EP2011/067091 EP2011067091W WO2012059280A3 WO 2012059280 A3 WO2012059280 A3 WO 2012059280A3 EP 2011067091 W EP2011067091 W EP 2011067091W WO 2012059280 A3 WO2012059280 A3 WO 2012059280A3
Authority
WO
WIPO (PCT)
Prior art keywords
users
location
user
image
multiperspective
Prior art date
Application number
PCT/EP2011/067091
Other languages
French (fr)
Other versions
WO2012059280A2 (en
Inventor
Jaume Civit
Ken Zangelin
Mattias Barthel
Oscar Divorra
Pablo Rodriguez Rodriguez
Nuria Oliver Ramirez
Original Assignee
Telefonica, S.A.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonica, S.A. filed Critical Telefonica, S.A.
Publication of WO2012059280A2 publication Critical patent/WO2012059280A2/en
Publication of WO2012059280A3 publication Critical patent/WO2012059280A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N7/144—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Abstract

The invention refers to a method and system for processing, transmitting and receiving images of a first set of users in a first location in communication with a second set of users in a second location. The method comprising the steps: recording the first set of users with a plurality of cameras distributed according to the position of the second set of user in the second location, recording each camera a image of the first set of users; - separating the part of the image belonging to each user of the first set of users from the parts belonging to other users recorded by the same camera, obtaining therefore for each user and for each camera a image of the user; - encoding of multiple video signals, each containing the images of each user and sending the encoded video signals to a receiving module in the second location; - sending control signals form a control module for managing a communication between a location of the second set of users and the location of the first set of users; - decoding the encoded video signal received by the receiving module; - composing one multiperspective image of the first set of users containing all the images of each user; - showing the multiperspective image of the first set of users to the second set of users by mean of a display.
PCT/EP2011/067091 2010-11-05 2011-09-30 System and method for multiperspective telepresence communication WO2012059280A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US41053510P 2010-11-05 2010-11-05
US61/410,535 2010-11-05

Publications (2)

Publication Number Publication Date
WO2012059280A2 WO2012059280A2 (en) 2012-05-10
WO2012059280A3 true WO2012059280A3 (en) 2012-08-16

Family

ID=44720896

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2011/067091 WO2012059280A2 (en) 2010-11-05 2011-09-30 System and method for multiperspective telepresence communication

Country Status (1)

Country Link
WO (1) WO2012059280A2 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103581609B (en) 2012-07-23 2018-09-28 中兴通讯股份有限公司 A kind of method for processing video frequency and device, system
CN103634563A (en) 2012-08-24 2014-03-12 中兴通讯股份有限公司 Video conference display method and device
EP2901667B1 (en) 2012-09-27 2018-06-27 Dolby Laboratories Licensing Corporation Spatial multiplexing in a soundfield teleconferencing system
US10075656B2 (en) 2013-10-30 2018-09-11 At&T Intellectual Property I, L.P. Methods, systems, and products for telepresence visualizations
US9210377B2 (en) 2013-10-30 2015-12-08 At&T Intellectual Property I, L.P. Methods, systems, and products for telepresence visualizations
GB2582251B (en) * 2019-01-31 2023-04-19 Wacey Adam Volumetric communication system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020105483A1 (en) * 1995-10-05 2002-08-08 Shunpei Yamazaki Three dimensional display unit and display method
US20020191071A1 (en) * 2001-06-14 2002-12-19 Yong Rui Automated online broadcasting system and method using an omni-directional camera system for viewing meetings over a computer network
US7515174B1 (en) * 2004-12-06 2009-04-07 Dreamworks Animation L.L.C. Multi-user video conferencing with perspective correct eye-to-eye contact
US20090207233A1 (en) * 2008-02-14 2009-08-20 Mauchly J William Method and system for videoconference configuration
US20090295835A1 (en) * 2008-05-30 2009-12-03 Tandberg Telecom As Method for displaying an image on a display

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020105483A1 (en) * 1995-10-05 2002-08-08 Shunpei Yamazaki Three dimensional display unit and display method
US20020191071A1 (en) * 2001-06-14 2002-12-19 Yong Rui Automated online broadcasting system and method using an omni-directional camera system for viewing meetings over a computer network
US7515174B1 (en) * 2004-12-06 2009-04-07 Dreamworks Animation L.L.C. Multi-user video conferencing with perspective correct eye-to-eye contact
US20090207233A1 (en) * 2008-02-14 2009-08-20 Mauchly J William Method and system for videoconference configuration
US20090295835A1 (en) * 2008-05-30 2009-12-03 Tandberg Telecom As Method for displaying an image on a display

Also Published As

Publication number Publication date
WO2012059280A2 (en) 2012-05-10

Similar Documents

Publication Publication Date Title
US9602859B2 (en) Apparatus, systems and methods for shared viewing experience using head mounted displays
WO2012059280A3 (en) System and method for multiperspective telepresence communication
JP6598109B2 (en) Video receiving method and terminal device
WO2008045198A3 (en) Providing multiple video signals from single sensor
WO2012092144A3 (en) Tracking moving objects using a camera network
WO2008008578A3 (en) System and method for dynamic control of image capture in a video conference system
WO2011101454A3 (en) Data compression for video
WO2014070927A3 (en) Expanded-field-of-view image and video capture
US20110115906A1 (en) Monitoring system and control method thereof
WO2007127590A3 (en) Method and system for fingerprinting digital video object based on multiresolution, multirate spatial and temporal signatures
TW200943936A (en) Fusing of images captured by a multi-aperture imaging system
WO2007095526A3 (en) System and method to combine multiple video streams
PL2173106T3 (en) Three-dimensional television system, three-dimensional television receiver and three-dimensional image watching glasses
WO2006014469A3 (en) 3d television broadcasting system
NL1029968A1 (en) Digital stereo camera / digital stereo video camera, 3-dimensional display, 3-dimensional projector, and printer and stereo viewer.
WO2008110158A3 (en) Surveillance system
WO2011102699A3 (en) Electronic device and method for reproducing three-dimensional images
WO2008107976A1 (en) Video reproducing apparatus for av equipment
WO2008107783A3 (en) Image capture and playback
WO2011084015A3 (en) Apparatus and method for broadcasting services in digital video broadcasting system
US20140092218A1 (en) Apparatus and method for stereoscopic video with motion sensors
WO2006078788A3 (en) Remote witness testing system
WO2011152633A3 (en) Method and apparatus for processing and receiving digital broadcast signal for 3-dimensional subtitle
WO2011005317A3 (en) Methods and apparatus for collaborative partition coding for region based filters
WO2009124181A3 (en) Gesture based control using three-dimensional information extracted over an extended depth of field

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11763935

Country of ref document: EP

Kind code of ref document: A2

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11763935

Country of ref document: EP

Kind code of ref document: A2