WO2011071478A1 - Vidéo-conférence 3d - Google Patents

Vidéo-conférence 3d Download PDF

Info

Publication number
WO2011071478A1
WO2011071478A1 PCT/US2009/066921 US2009066921W WO2011071478A1 WO 2011071478 A1 WO2011071478 A1 WO 2011071478A1 US 2009066921 W US2009066921 W US 2009066921W WO 2011071478 A1 WO2011071478 A1 WO 2011071478A1
Authority
WO
WIPO (PCT)
Prior art keywords
participant
user
video
parallel
video streams
Prior art date
Application number
PCT/US2009/066921
Other languages
English (en)
Inventor
Eric Gagneraud
Original Assignee
Hewlett-Packard Development Company, L.P.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett-Packard Development Company, L.P. filed Critical Hewlett-Packard Development Company, L.P.
Priority to US13/387,113 priority Critical patent/US8970663B2/en
Priority to PCT/US2009/066921 priority patent/WO2011071478A1/fr
Publication of WO2011071478A1 publication Critical patent/WO2011071478A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems

Definitions

  • one or more cameras can be configured to capture video streams of one or more participants of the video conference. Once the video streams have been captured, the captured video streams can be shared with additional participants of the video conference and rendered for display on one or more digital display devices as a video conference.
  • Figure 1 illustrates a machine coupled to at least two cameras and a 3D display device according to an embodiment of the invention.
  • Figure 2 illustrates at least two cameras coupled to a 3D display device according to an embodiment of the invention.
  • Figure 3 illustrates a view of a user and a view of a participant being modified in response to the user and the participant repositioning according to an embodiment of the invention.
  • Figure 4 illustrates a block diagram of a video application using modified parallel participant video streams to render a 3D video conference according to an embodiment of the invention.
  • Figure 5 illustrates a machine with an embedded video application and a video application stored on a removable medium being accessed by the machine according to an embodiment of the invention.
  • Figure 6 is a flow chart illustrating a method for rendering a 3D video conference according to an embodiment of the invention.
  • Figure 7 is a flow chart illustrating a method for rendering a 3D video conference according to another embodiment of the invention.
  • Figure 1 illustrates a machine 100 coupled to at least two cameras 130 and a 3D display device 180 according to an embodiment of the invention, in one embodiment, the machine 100 is a desktop, laptop/notebook, netbook, and/or any other computing device. In another embodiment, the machine 100 is a video conference center and/or the machine 100 is included as part of the video conference center.
  • the machine 100 is coupled to at least two cameras 130, a 3D display device 180, a processor 120, a storage device 170, and a communication bus 150 for the machine 100 and/or one or more components of the machine 100 to communicate with one another. Additionally, as illustrated in Figure 1 , the storage device 140 stores a video application 1 10. In other embodiments, the machine 100 includes additional components and/or is coupled to additional components in addition to and/or in lieu of those noted above and as illustrated in Figure 1 . [0012] As noted above, the machine 100 includes a processor 120.
  • the processor 120 sends data and/or instructions to one or more components of the machine 100, such as the storage device 140, one or more of the cameras 130, the 3D display device 180, and the video application 1 10. Additionally, the processor 120 receives data and/or instruction from one or more components of the machine 100, such as one or more of the cameras 130 and the video application 1 10.
  • the video application 1 10 is an application which can be utilized in conjunction with the processor 120 and at least two cameras 160 to track a position of a user. When tracking the position of the user, the video application 1 10 can utilize the cameras 160 to track a head of the user using facial detection
  • the video application 1 10 can transmit the position of the user to one or more participants of a 3D video conference.
  • one or more parallel participant video streams are modified.
  • one or more parallel participant video streams are parallel video streams of the participant which have been captured from at least two participant cameras.
  • the video application 1 10 can render a 3D video conference for display on the 3D display device 180.
  • the video application 1 10 can be firmware which is embedded onto the machine 100.
  • the video application 1 10 is a software application stored on the machine 100 within ROM or on the storage device 140 accessible by the machine 100 or the video application 1 10 is stored on a computer readable medium readable and accessible by the machine 100 from a different location.
  • the storage device 140 is included in the machine 100. in other embodiments, the storage device 140 is not included in the machine 100, but is accessible to the machine 100 utilizing a network interface of the machine 100.
  • the network interface can be a wired or wireless network interface card.
  • the video application 1 10 is stored and/or accessed through a server coupled through a local area network or a wide area network. The video application 1 10 communicates with devices and/or components coupled to the machine 100 physically or wirelessiy through a communication bus 150 included in or attached to the machine 100. In one embodiment the
  • communication bus 150 is a memory bus. In other embodiments, the
  • communication bus 150 is a data bus.
  • the video application 1 10 can be utilized in conjunction with the processor 120 and at least two cameras 130 to track a position of a user.
  • a position of the user corresponds to a location of the user when viewing the 3D video conference in front of the 3D display device 160. While viewing the 3D video conference, the position of the user can change and/or be updated in response to the user repositioning in front of the 3D display device 160.
  • At least two of the cameras 130 are image capturing devices which are configured to capture parallel video streams of the user and can be configured to track the user.
  • the video application 1 10 can send one or more instructions for the cameras 130 to capture parallel video streams of the user and track the user
  • the video application 1 10 can configure the processor 120 to send one or more of the instructions for the cameras 130 to capture parallel video streams of the user and track the user.
  • one or more of the cameras 130 can be configured to reposition when capturing parallel video streams of the user and/or when tracking a position of the user. Further, one or more of the cameras 130 can include one or more camera viewing modes and switch between one or more of the camera viewing modes when capturing parallel video streams of the user and/or when tracking a position of the user. In addition, one or more of the cameras 130 can zoom in and/or out to modify a magnification level of the user when capturing parallel video streams of the user and/or when tracking a position of the user. [0021] In one embodiment, one or more of the cameras 130 can be integrated as part of the machine 100 and/or the 3D display device 180. In another
  • one or more of the cameras 130 can be mounted and/or positioned at different positions or locations around the machine 100 and/or the 3D display device 160.
  • the video application 1 10 can use a head or the eyes of the user as a reference point. Additionally, the video application 1 10 can utilize facial recognition technology and/or infra red technology with the captured parallel video streams of the user to locate and track a location of the user's head or eyes.
  • the facial detection technology and/or the infra red technology can be hardware based and can be included in one or more of the cameras 130. In another embodiment, the facial detection technology and/or the infra red
  • the facial detection technology is software based.
  • technology and/or the infra red technology can include both hardware and software technology.
  • the video application 1 10 additionally creates a map of the user's position and updates the map accordingly as the user repositions.
  • the video application 1 10 can update the position of the user on the map by marking points of where the user currently is and unmarking coordinates of where the user is no longer.
  • the video application 1 10 can accurately track and update the location of the user as the user repositions.
  • the video application 1 10 and one or more of the cameras 130 track and update a position of the user
  • the video application 1 10 can transmit the position of the user or coordinates from the map to a participant of the 3D video conference. Additionally, the video application 1 10 can send updates of the user's position to the participant as the user repositions. In one embodiment, the video application 1 10 additionally transmits the map to the participant. In other embodiments, the video application 1 10 can send the position or the coordinates to any additional participants of the 3D video conference.
  • parallel participant video streams can be modified.
  • a magnification level of one or more participant cameras can be modified.
  • one or more of the participant cameras can switch camera viewing modes.
  • one or more of the participant cameras can be configured to reposition along and/or around one or more axes.
  • the participant video cameras are image capturing devices configured to track a position of the participant and capture parallel video streams of the participant. Additionally, one or more of the participant cameras can be controlled remotely by the video application 1 10 or the video application 1 10 can send instruction for a machine of the participant to control one or more of the participant cameras.
  • one or more of the parallel participant video streams when modifying parallel participant video streams, can be modified by cropping one or more of the parallel participant video streams, scaling one or more of the parallel participant video streams, and/or skewing one or more of the parallel participant video streams. Additionally, one or more of the parallel participant video streams can be modified by the video application 1 10 once they have been received from the machine of the participant. In other embodiments, one or more of the parallel participant video streams are modified by the machine of the participant before being shared with the video application 1 10.
  • the video application 1 10 can utilize the modified parallel participant video streams to render the 3D video conference for display on the 3D display device 160.
  • the 3D display device 160 is a display device that can create and/or project one or more images and/or videos for 3D display, such as a 3D video conference. Additionally, the 3D display device 180 can be a monitor and/or a television. In another other embodiments, the 3D display device 160 is a projector that can project one or more images and/or videos.
  • the 3D display device 160 utilizes polarized glass as a panel for the 3D display device 160.
  • the 3D display device 160 can include one or more polarized filters and/or one or more lenticular filters to create the 3D effect, in other embodiments, when viewing the 3D video
  • the user and/or the participant can wear polarized glasses as an accessory.
  • the video application 1 10 can synchronize the modified parallel participant video streams to create the 3D video conference.
  • the video application 1 10 will utilize one of the parallel participant video streams as a left video stream and utilize another parallel participant video stream as a right video stream.
  • stereo video can be created and rendered on the 3D display device 160 as the 3D video conference, in other embodiments, the video application 1 10 can utilize additional methods with the modified parallel participant video streams to render the 3D video conference.
  • a position of the participant can be tracked by the participant cameras. Additionally, the position of the participant can be shared with the video application 1 10. In one embodiment, the position of the participant can be sent to the video application by the machine of the participant. In another embodiment, the video application 1 10 can remotely access the machine of the participant to access the position of the user.
  • the video application 1 10 can proceed to modify one or more parallel video streams of the user in response to the position of the participant, in modifying one or more parallel video streams of the user, the video application 1 10 can utilizing one or more of the methods disclosed above. Once one or more of the parallel video streams of the user has been modified, the modified parallel video streams can be shared with the participant and the modified parallel video streams of the user can be utilized by the participant for rendering a 3D video conference on a 3D display device of the participant.
  • Figure 2 illustrates at least two cameras 230 coupled to a 3D display device 260 according to an embodiment of the invention.
  • one or more of the cameras 230 can be coupled to the 3D display device 260.
  • one or more of the cameras 230 can be integrated with the 3D display device 280 and/or a machine coupled to the 3D display device 260.
  • one or more of the cameras 230 can be located at additional locations in addition to and/or in lieu of those noted above and illustrated in Figure 2.
  • the cameras 230 are image capturing devices which can be utilized in conjunction with a video application and/or a processor to capture parallel video streams of the user and to track a position of a user as the user is viewing the 3D video conference. Additionally, as illustrated in Figure 2, the cameras 230 can be configured to capture a view of the user as parallel video streams of the user. As noted above, when utilizing the cameras 230, the video application can send one or more instructions for the cameras 230 to track to the user and capture parallel video streams of the user. In other
  • the video application can instruct a processor to send one or more of the instructions.
  • the video application and/or one or more of the cameras 230 can utilize face tracking technology and/or infra red technology to track a head or eyes of the user.
  • the user can reposition in front of the 3D display device 260 during the 3D video conference and the position of the user can be updated, in one embodiment, as the position of the user is tracked and/or updated, the position of the user can be captured on a map with coordinates.
  • one or more of the cameras 230 can reposition along and/or around one or more axes, in another embodiment, one or more of the cameras 230 can be configured to switch between one or more camera viewing modes. One or more of the viewing modes can include a wide angle viewing mode. In other embodiments, in modifying a view of the user, one or more of the cameras 230 can be configured to modify a
  • One or more of the cameras 230 are configured by the video application to reposition, modify a magnification level, and/or switch to one or more camera viewing modes when the user repositions beyond a default viewing area of one or more of the cameras 230.
  • the default viewing area corresponds to a default position of a camera, a default magnification level of a camera, and/or a default viewing mode of a camera.
  • the video application can transmit the position and/or updates of the position of the user to a participant of the 3D video conference.
  • one or more of the cameras 230 are configured to reposition, modify a magnification level, and/or switch to one or more camera viewing modes when modifying one or more parallel video streams of the user in response to a position of a participant.
  • Figure 3 illustrates a view of a user 300 and a view of a participant 310 being modified in response to the user 300 and the participant 310 repositioning according to an embodiment of the invention.
  • a video application can utilize at least two cameras 330 to track a position of the user 300 and capture parallel video streams of the user 300.
  • a machine of the participant 310 also includes at least two cameras configured to track the position of the participant 310 and capture parallel participant video streams.
  • the user 300 can reposition by moving to the right in front of a 3D display device 380 configured to display a 3D video conference.
  • the video application and at least two of the cameras 330 continue to track and update a position of the user 300.
  • the video application and the cameras 330 track and update the position of the user 300, the video application sends the position of the user 300 and updates of the position to the participant 310 of the 3D video conference.
  • the parallel participant video streams can be modified.
  • modifying one or more parallel participant video streams includes repositioning one or more of the participant cameras 340.
  • the participant cameras 340 are configured to reposition to the right in response to the position of the user.
  • one of the participant cameras has switched to a different camera viewing mode.
  • the participant video camera 340 has switched to a wide angle viewing mode.
  • information of the position of the user can be utilized to modify the parallel participant video streams.
  • modifying the parallel participant video streams can include modifying a magnification level of one or more of the participant cameras 340.
  • modifying the parallel participant video streams includes cropping one or more of the parallel participant video streams, scaling one or more of the parallel participant video streams, and/or skewing one or more of the parallel participant video streams.
  • the participant cameras 340 capture parallel participant video streams and track a position of the participant 310 as the participant 310 repositions. As shown in Figure 3, the participant cameras 340 capture the participant 310 repositioning to the right and proceed to share the participant position data with the video application.
  • the parallel video streams of the user are modified.
  • the cameras 330 switch to a wide angle viewing mode.
  • one of the cameras 330 are configure to reposition by rotating to simulate the participant 310 looking around the user 300.
  • the parallel video streams of the user can be modified utilizing additional methods in addition to and/or in lieu of those noted above and illustrated in Figure 3.
  • Figure 4 illustrates a block diagram of a video application 410 using modified parallel participant video streams 420 to render a 3D video conference according to an embodiment of the invention.
  • parallei participant video streams 420 are parallel video streams of a participant captured by the participant's cameras. Additionally, as noted above and as illustrated in Figure 4, the parallel participant video streams are modified in response to a position of a user.
  • the video application 410 when the video application 410 detects the user moving and/or repositioning, the video application 410 will proceed to update the position of the user and send the updated position of the user to a participant of the 3D video conference. Additionally, as noted above, in response to the position of the user, one or more parallel participant video streams are modified.
  • modifying one or more of the parallei participant video streams can include configuring one or more participant cameras to reposition along and/or around one or more axis, switch one or more camera viewing modes, and/or magnify a zoom level of the participant. Additionally, as illustrated in Figure 4, modifying one or more of the parallel participant video streams can inciude cropping, scaling, and/or skewing one or more of the parallel participant video streams.
  • the video application 410 can proceed to utilize the modified parallel participant video streams 420 to render the 3D video conference on the 3D display device 430.
  • the video application 410 can synchronize the modified parallel participant video streams to create the 3D video conference.
  • the video application 410 will utilize one of the parallel participant video streams as a left video stream and utilize another parallel participant video stream as a right video stream.
  • FIG. 5 illustrates a machine 500 with an embedded video application 510 and a video application 510 stored on a removable medium being accessed by the machine 500 according to an embodiment of the invention.
  • a removable medium is any tangible apparatus that contains, stores, communicates, or transports the application for use by or in connection with the machine 500.
  • the video application 510 is firmware that is embedded into one or more components of the machine 500 as ROM.
  • the video application 510 is a software application which is stored and accessed from a hard drive, a compact disc, a flash disk, a network drive or any other form of computer readable medium that is coupled to the machine 500.
  • Figure 6 is a flow chart illustrating a method for rendering a 3D video conference according to an embodiment of the invention.
  • the method of Figure 6 uses a machine coupled to two or more cameras, a 3D display device, a processor, and a video application.
  • the video application can be stored on a storage device coupled to the machine, in other embodiments, the method of Figure 6 uses additional components and/or devices in addition to and/or in lieu of those noted above and illustrated in Figures 1 , 2, 3, 4, and 5.
  • At least two cameras can initially be configured by the video application and/or the processor to track a position of a user 800.
  • two or more cameras are image capturing devices which can be configured to capture a view of the user as parallel video streams and track a position of the user.
  • the video application and/or the processor can send one or more instructions to the cameras to capture the parallel video streams and track the position of the user.
  • the video application and/or the cameras update the position of the user as the user repositions in front the 3D display device.
  • one or more of the cameras can additionally be configured to reposition along and/or around one or more axes, modify a magnification level of the user, and/or switch to one or more camera viewing modes.
  • the video application and/or the cameras utilize a head or the eyes of the user as a reference point.
  • the video application can utilize facial tracking technology and/or infra red technology to identify a location or position of the user.
  • the facial tracking technology and/or the infra red technology can be hardware and/or software based and can be included in the cameras.
  • the video application can additionally create a map with coordinates and proceed to mark and unmark coordinates on the map as the user repositions.
  • the video application can transmit the position of the user to a participant of the 3D video conference 810.
  • the video application can send the position of the user as a coordinate to the participant, in another embodiment, the video application can send the map with coordinates to the participant.
  • the participant of the 3D video conference can be viewing the 3D video conference with a machine configuration similar to the user. Additionally, the machine can be coupled to participant cameras which are configured to capture a view of the user as parallel video streams and track the position of the participant. [0059]
  • parallel participant video streams can be modified. As noted above, parallel participant video streams are parallel video streams of the participant captures by the participant cameras.
  • modifying the parallel participant video streams includes configuring one or more participant cameras to reposition, switch to one or more additional camera viewing modes, and/or modify a magnification level of a view of the participant.
  • the video application can remotely control one or more of the participant cameras to modify one or more of the parallel participant video streams or the video application can send instructions for the machine of the participant to configure one or more of the participant cameras to modify one or more of the parallel participant video streams.
  • modifying one or more of the parallel participant video streams can include cropping, scaling, and/or skewing one or more of the parallel participant video streams.
  • the video application can directly modify one or more of the parallel participant video streams once the parallel participant video streams are received from the participant or the video application can send an instruction for the machine of the participant to modify the parallel participant video streams before transmitting them to the video application.
  • the video application can render the modified parallel participant video streams for display as a 3D video conference for display on the 3D display device 820.
  • the video application can utilize one of the parallel participant video streams as a left video stream and utilize another parallel participant video stream as a right video stream.
  • the modified parallel participant video streams are synchronized as stereo video and can be rendered as a 3D video conference on the 3D display device.
  • the 3D display device can include a polarized panel, a polarized filter, and/or a lenticular filter. Additionally, as noted above, in one embodiment, the video application can also receive participant position data for the participant. Using the participant position data, the video application can proceed to modify parallel video streams of the user utilizing one or more of the methods disclosed above.
  • the method is then complete or the video application can continue to track the position of the user and render the 3D video conference with parallel participant video streams which have been modified in response to the position of the user.
  • the method of Figure 8 indudes additional steps in addition to and/or in lieu of those depicted in Figure 8.
  • Figure 7 is a flow chart illustrating a method for rendering a 3D video conference according to another embodiment of the invention. Similar to the method disclosed in Figure 8, the method of Figure 7 uses a machine coupled to two or more cameras, a 3D display device, a processor, and a video application. In other embodiments, the method of Figure 7 uses additional components and/or devices in addition to and/or in lieu of those noted above and illustrated in Figures 1 , 2, 3, 4, and 5.
  • the video application can initially be utilized in conjunction with a processor and two or more of the cameras to track a position of the user and capture parallel video streams of the user 700.
  • the video application and/or the processor can send instructions for the cameras to track a position of the user and capture parallel video streams of the user.
  • tracking the position of the user includes tracking the user repositioning in front of the 3D display device.
  • the video application can continue to update the position of the user, in one embodiment, one or more of the cameras can be configured by the video application and/or the processor to reposition, modify a magnification level of the user, and/or switch to one or more camera viewing modes.
  • the video application and or the cameras can utilize a head of the user or the eyes of the user as a reference point and track the head or the eyes of the user with facial recognition technology and or infra red technology.
  • the video appiication additionally creates a map with coordinates when tracking the position of the user as the user repositions. As the user repositions, new coordinates on the map are marked to show where the user currently is while old coordinates of where the user was on the map are unmarked.
  • the video application can transmit the position of the user and the parallel video streams to the participant 710.
  • the video application can transmit a coordinate of the user to the participant or the video application can send the map of coordinates to the participant.
  • one or more parallel participant video streams can be modified in response to the position of the user 720.
  • the participant can be stationed at a machine with a configuration similar to the user's machine.
  • one or more of the participant cameras can be configured to reposition along and/or around one or more axis, modify a magnification level of the participant, and/or switch to one or more camera viewing modes.
  • one or more of the camera viewing modes can include a wide angle mode.
  • the video appiication can configure them remotely or send an instruction for the machine of the participant to configure them.
  • modifying one or more of the participant video streams includes cropping, scaling, and/or skewing one or more of the parallel participant video streams.
  • one or more of the participant video streams can be cropped, scaled, and/or skewed by the video application and/or by the machine of the participant.
  • the modified parallel participant video streams are rendered by the video application as the 3D video conference for display on the 3D dispiay device 730.
  • the 3D display device can include polarized glass as a panel for the 3D display device, in another embodiment, the 3D dispiay device can include a polarized filter and/or a lenticular filter. In other embodiments, the user and/or the participant can wear polarized glasses when viewing the 3D video conference.
  • the video application when rendering the 3D video conference, the video application will synchronize the parallei participant video streams. Further, as noted above, while the video application is tracking and transmitting the position of the user, the video application can additionally receive the position of the participant. As noted above, the position of the participant is identified by the participant cameras tracking a position of the participant as the participant repositions.
  • the video application can proceed to modify a view of the user in response to the position of the participant utilizing one or more of the methods disclosed above 740.
  • the method is then complete or the video application and the machine of the participant can continue to track positions of the user and the participant and proceed to modify a view of the user and/or the participant.
  • the method of Figure 7 includes additional steps in addition to and/or in lieu of those depicted in Figure 7.
  • a view of the participant can be modified and parallel video streams of the participant can be modified. Additionally, by receiving a position of the participant, a view of the user can be modified and parallei video streams of the user can be modified. As a result, a realistic and user friendly 3D video conference can be created for the user and the participant by continuing to render the 3D video conference for the user and the participant with parallel video streams of the user and the participant which have been modified.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

L'invention concerne un procédé de rendu de vidéo-conférence 3D consistant à configurer au moins deux caméras afin de suivre la position d'un utilisateur, à transmettre la position de l'utilisateur à un participant de la vidéo-conférence 3D, et à effectuer un rendu, en vue d'un affichage sur un dispositif d'affichage 3D, de flux vidéo parallèles du participant qui ont été modifiés en fonction de la position de l'utilisateur.
PCT/US2009/066921 2009-12-07 2009-12-07 Vidéo-conférence 3d WO2011071478A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/387,113 US8970663B2 (en) 2009-12-07 2009-12-07 3D video conference
PCT/US2009/066921 WO2011071478A1 (fr) 2009-12-07 2009-12-07 Vidéo-conférence 3d

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2009/066921 WO2011071478A1 (fr) 2009-12-07 2009-12-07 Vidéo-conférence 3d

Publications (1)

Publication Number Publication Date
WO2011071478A1 true WO2011071478A1 (fr) 2011-06-16

Family

ID=44145809

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2009/066921 WO2011071478A1 (fr) 2009-12-07 2009-12-07 Vidéo-conférence 3d

Country Status (2)

Country Link
US (1) US8970663B2 (fr)
WO (1) WO2011071478A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102647606A (zh) * 2012-02-17 2012-08-22 钰创科技股份有限公司 立体影像处理器、立体影像互动系统及立体影像显示方法
WO2014127841A1 (fr) * 2013-02-25 2014-08-28 Telefonaktiebolaget L M Ericsson (Publ) Appareil vidéo 3d et procédé
CN104584575A (zh) * 2012-05-16 2015-04-29 悠蒂欧公司 用于多媒体来源的具有调节机制的实时复合广播的系统和方法

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120206568A1 (en) * 2011-02-10 2012-08-16 Google Inc. Computing device having multiple image capture devices and image modes
US8803941B2 (en) 2011-06-15 2014-08-12 Cisco Technology, Inc. Method and apparatus for hands-free control of a far end camera
FR2989244B1 (fr) * 2012-04-05 2014-04-25 Current Productions Interface et navigation video multi sources
EP2685732A1 (fr) * 2012-07-12 2014-01-15 ESSILOR INTERNATIONAL (Compagnie Générale d'Optique) Génération d'images stéréoscopiques
KR101982075B1 (ko) 2012-09-28 2019-05-24 엘지이노텍 주식회사 Ｔｖ 장치
US20180176628A1 (en) * 2015-06-30 2018-06-21 Sharp Kabushiki Kaisha Information device and display processing method
JP7067481B2 (ja) * 2016-10-20 2022-05-16 ソニーグループ株式会社 情報処理装置、情報処理方法、プログラム、およびコミュニケーションシステム
CN110324553B (zh) * 2018-03-28 2021-02-26 北京富纳特创新科技有限公司 基于视频通信的实景窗系统
CN110324554B (zh) * 2018-03-28 2021-08-13 北京富纳特创新科技有限公司 视频通信装置及方法
CN110324555B (zh) * 2018-03-28 2021-02-26 北京富纳特创新科技有限公司 视频通信装置及方法
CN110324559B (zh) 2018-03-28 2021-11-30 北京富纳特创新科技有限公司 视频通信装置及方法
CN110324556B (zh) * 2018-03-28 2023-01-31 北京富纳特创新科技有限公司 视频通信装置及方法
JP7256491B2 (ja) * 2018-09-13 2023-04-12 凸版印刷株式会社 映像伝送システム、映像伝送装置、および、映像伝送プログラム
US10848836B2 (en) * 2018-12-28 2020-11-24 Dish Network L.L.C. Wager information based prioritized live event display system
KR20210087263A (ko) * 2020-01-02 2021-07-12 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
US20210286507A1 (en) * 2021-05-27 2021-09-16 Kishore Daggubati System enabling magnification of a video stream during an online event

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6980697B1 (en) * 2001-02-01 2005-12-27 At&T Corp. Digitally-generated lighting for video conferencing applications

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7515173B2 (en) * 2002-05-23 2009-04-07 Microsoft Corporation Head pose tracking system
US7129981B2 (en) * 2002-06-27 2006-10-31 International Business Machines Corporation Rendering system and method for images having differing foveal area and peripheral view area resolutions
US20060285832A1 (en) 2005-06-16 2006-12-21 River Past Corporation Systems and methods for creating and recording digital three-dimensional video streams
US8130260B2 (en) * 2005-11-09 2012-03-06 Johns Hopkins University System and method for 3-dimensional display of image data
US20070171275A1 (en) * 2006-01-24 2007-07-26 Kenoyer Michael L Three Dimensional Videoconferencing
US20080106591A1 (en) * 2006-11-02 2008-05-08 Border John N Two way communication system
US8063929B2 (en) * 2007-05-31 2011-11-22 Eastman Kodak Company Managing scene transitions for video communication
NO327899B1 (no) * 2007-07-13 2009-10-19 Tandberg Telecom As Fremgangsmate og system for automatisk kamerakontroll
KR20090036734A (ko) * 2007-10-10 2009-04-15 삼성전자주식회사 화상 통신단말기 및 그 화상 통신단말기의 화상카메라트래킹 방법
US8155479B2 (en) * 2008-03-28 2012-04-10 Intuitive Surgical Operations Inc. Automated panning and digital zooming for robotic surgical systems
US8405706B2 (en) * 2008-12-17 2013-03-26 Microsoft Corporation Visual feedback for natural head positioning
US8477175B2 (en) * 2009-03-09 2013-07-02 Cisco Technology, Inc. System and method for providing three dimensional imaging in a network environment
US8330793B2 (en) * 2009-10-09 2012-12-11 Hewlett-Packard Development Company, L.P. Video conference
US8384760B2 (en) * 2009-10-29 2013-02-26 Hewlett-Packard Development Company, L.P. Systems for establishing eye contact through a display
US8803941B2 (en) * 2011-06-15 2014-08-12 Cisco Technology, Inc. Method and apparatus for hands-free control of a far end camera
US8970653B2 (en) * 2011-06-16 2015-03-03 Vtel Products Corporation, Inc. Video conference control system and method

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6980697B1 (en) * 2001-02-01 2005-12-27 At&T Corp. Digitally-generated lighting for video conferencing applications

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
OLIVER SCHREER ET AL.: "3DPresence - A system concept for multi-user and multi-party immersive 3D videoconferencing", 5TH EUROPEAN CONF. ON VISUAL MEDIA PRODUCTION (CVMP 2008), November 2008 (2008-11-01), LONDON, UK *
OLIVER SCHREER ET AL.: "A Virtual 3D Video-Conference System Providing Semi- Immersive Telepresence: A Real-Time Solution in Hardware and Software", PROCEEDINGS OF EBUSINESS AND EWORK 2001, October 2001 (2001-10-01), VENICE, ITALY, pages 184 - 190 *
PETER EISERT ET AL.: "Immersive 3-D video Conferencing: Challenges, Concepts, and Implementations", PROC. SPIE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), July 2003 (2003-07-01), LUGANO, SWITZERLAND *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102647606A (zh) * 2012-02-17 2012-08-22 钰创科技股份有限公司 立体影像处理器、立体影像互动系统及立体影像显示方法
CN102647606B (zh) * 2012-02-17 2015-01-07 钰创科技股份有限公司 立体影像处理器、立体影像互动系统及立体影像显示方法
CN104584575A (zh) * 2012-05-16 2015-04-29 悠蒂欧公司 用于多媒体来源的具有调节机制的实时复合广播的系统和方法
WO2014127841A1 (fr) * 2013-02-25 2014-08-28 Telefonaktiebolaget L M Ericsson (Publ) Appareil vidéo 3d et procédé

Also Published As

Publication number Publication date
US8970663B2 (en) 2015-03-03
US20120120183A1 (en) 2012-05-17

Similar Documents

Publication Publication Date Title
US8970663B2 (en) 3D video conference
US11729342B2 (en) Designated view within a multi-view composited webcam signal
US10013805B2 (en) Control of enhanced communication between remote participants using augmented and virtual reality
US8994780B2 (en) Video conferencing enhanced with 3-D perspective control
US9955209B2 (en) Immersive viewer, a method of providing scenes on a display and an immersive viewing system
CN105787884A (zh) 一种图像处理方法及电子设备
JP2023541551A (ja) 複数のカメラからのウェブカム信号のマージ
CN105190695B (zh) 图像处理装置、图像处理方法及计算机可读介质
CN110537208B (zh) 头戴式显示器和方法
US10841533B2 (en) Telepresence system with virtual reality
JP5963006B2 (ja) 画像変換装置、カメラ、映像システム、画像変換方法およびプログラムを記録した記録媒体
US20150244984A1 (en) Information processing method and device
CN105939497A (zh) 媒体串流系统及媒体串流方法
KR20110132260A (ko) 모니터 기반 증강현실 시스템
CN110324553A (zh) 基于视频通信的实景窗系统
US20190138803A1 (en) Image processing apparatus, image processing system, and image processing method, and program
JP2007158680A (ja) 追尾撮像装置およびこれを利用した追尾撮像システム
CN113286138A (zh) 一种全景视频显示方法及显示设备
KR101281314B1 (ko) 증강현실시스템 및 증강현실구현방법
CN103634525A (zh) 移动终端旋转摄像头显示系统切换方法
US9392223B2 (en) Method for controlling visual light source, terminal, and video conference system
JP2018033107A (ja) 動画の配信装置及び配信方法
WO2018074262A1 (fr) Dispositif de communication, procédé de communication et programme
US20200252585A1 (en) Systems, Algorithms, and Designs for See-through Experiences With Wide-Angle Cameras
Grogorick et al. Gaze and motion-aware real-time dome projection system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09852122

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 13387113

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09852122

Country of ref document: EP

Kind code of ref document: A1