CN103269423A - Expandable three-dimensional display remote video communication method - Google Patents

Expandable three-dimensional display remote video communication method Download PDF

Info

Publication number
CN103269423A
CN103269423A CN2013101767177A CN201310176717A CN103269423A CN 103269423 A CN103269423 A CN 103269423A CN 2013101767177 A CN2013101767177 A CN 2013101767177A CN 201310176717 A CN201310176717 A CN 201310176717A CN 103269423 A CN103269423 A CN 103269423A
Authority
CN
China
Prior art keywords
data
dimensional display
user
characteristic information
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013101767177A
Other languages
Chinese (zh)
Other versions
CN103269423B (en
Inventor
袁立
彭祎帆
韩祥
王锐
李海峰
刘旭
鲍虎军
钟擎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN201310176717.7A priority Critical patent/CN103269423B/en
Publication of CN103269423A publication Critical patent/CN103269423A/en
Application granted granted Critical
Publication of CN103269423B publication Critical patent/CN103269423B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention discloses an expandable three-dimensional display remote video communication method. According to the expandable three-dimensional display remote video communication method, the image of a first user is obtained by means of an RGB-D camera at the data transmission end, the image of the first user comprises a texture image and a depth image, facial feature information and expression feature information are extracted from the texture image, physical feature information is extracted from the depth image, and point clouds of the first user are reconstructed; all the feature information is optimized by means of the point clouds, the optimized feature information is obtained to generate a three-dimensional model A, the three-dimensional model A is projected on a corresponding texture image, the corresponding texture information is extracted, and acquired voice information, the optimized feature information and texture data are sent to a second user; at the data receiving end, the second user receives the data from the first user and extracts the optimized feature information from the received data to generate a three-dimensional model B, the three-dimensional model B is rendered by means of the texture data, and a rendering result is output through a three-dimensional display device, and the voice information is played.

Description

Can expand formula three-dimensional display remote video communication method
Technical field
The present invention relates to the remote video communication field, relate in particular to a kind of formula three-dimensional display remote video communication method of expanding.
Background technology
Remote video communication system is being brought into play more and more important effect in current society, and industry has adopted a lot of technology to improve the effect of system virtualization reality, makes the participant of teleconference obtain experience more on the spot in person.Dimension display technologies has all experienced unprecedented development in academia and industrial circle, just can use in remote video communication system.Because up-to-date dimension display technologies can provide the effect of visualization of nature and important visual cues, for example expression in the eyes is understanding, facial expression, and body language etc. is applied to it in the remote video communication system, and advantage is self-evident.
Academia has some and is applied to the dimension display technologies of remote video communication, and wherein parallax type is a kind of comparatively ripe method from stereoscopic three-dimensional display.This various visual angles provide high-resolution 3-D view from stereoscopic three-dimensional display at some fixing visual angles.Yet along with the lifting of observation place quantity, the display effect of this method can go wrong, and it can not provide smooth motion parallax in bigger viewing angle scope, this means that the degree of freedom that the remote video communication participant walks about has seriously been limited.Other rotates the volumetric 3 D display system of principle design owing to the structural design of its pivoting mechanism based on screen, has limited it and has shown volume, and also from cost, the aspect of terseness and scalability has limited its application in commercial remote video communication system.
Market-oriented three-dimensional remote video communication system need satisfy some functional requirements.At first, the most basic requirement is to make participants can talk, walk about, do some actions, and restriction in this respect is more few more good.Secondly, need provide nature, have the three-dimensional display effect of level and smooth binocular parallax and motion parallax.Simultaneously, also need to catch rapidly information such as participant's profile and language, in order to present in real time.From commercial angle, require again any end-to-end three-dimensional display remote video communication system cost lower, succinct, be easy to dispose, so that carry out large-scale marketing.
Aspect personage's three-dimensional information seizure in real time, this problem that appears as of RGB-D camera provides potential solution convenient and with low cost, yet applies it to the video communication occasion, and especially the report of three-dimensional video communication occasion is considerably less.
Summary of the invention
The objective of the invention is to overcome the deficiency of existing remote video communication solution on virtual reality effect, user's degree of freedom and realization cost, a kind of market-oriented formula three-dimensional display remote video communication system and method expanded is provided.
A kind of formula three-dimensional display remote video communication method of expanding, implementation step is as follows:
Data sending terminal: obtain first user's character image and voice messaging, and extract characteristic information and texture in the character image
1) utilizes the RGB-D camera to obtain first user's character image, comprised texture image and depth image in this character image;
From texture image, extract facial characteristics information and expressive features information;
From depth image, extract the limbs characteristic information and reconstruct people's object point cloud;
2) utilize described people's object point cloud that each characteristic information in the step 1) is optimized characteristic information after being optimized, the characteristic information after optimizing by this generates threedimensional model A;
3) described threedimensional model A is projected to corresponding texture image, the corresponding data texturing of this threedimensional model A is extracted; Obtain voice messaging when gathering character image, together with the characteristic information after optimizing, and the data texturing that extracts sends to second user with this voice messaging;
4) cycling step 1)~3), utilize back one data constantly that the data of previous moment are upgraded and send to second user;
Data receiver:
Second user receives from after first user's data by network, characteristic information after the extraction optimization wherein generates threedimensional model B, utilize the described data texturing that extracts that threedimensional model B is played up, by three-dimensional display apparatus output rendering result, and play described voice messaging.
Obtain first user's character image and voice messaging at data sending terminal, and extract characteristic information and data texturing in the character image, be sent to data receiver then, second user of data receiver carries out modeling and plays up processing according to the data that receive, and export by three-dimensional display apparatus, and play corresponding voice messaging, realize the remote video communication of data sending terminal and data receiver.
At data sending terminal, when utilizing the RGB-D camera to obtain first user's character image, visual angle relative first user of different time changing RGB-D cameras, obtain the character image of first user under the different angles, then according to each characteristic information in the character image, make up threedimensional model, realize the effect of three-dimensional display.
Characteristic information after described voice messaging, the optimization and the data texturing that extracts are compressed, the processing back of packing sends to described second user by network.Wherein, the data volume of the characteristic information after voice messaging and the optimization is less, also can not compress processing, speed to transfer of data influences very much not, but the data volume of data texturing is bigger, and the resource that takies is more, as not simplifying and compressing processing, its transmitting speed is slower, has the bigger time difference between first user and second user, influences the real-time of video communication.
When utilizing back one data constantly that the data of previous moment are upgraded, characteristic information after utilizing characteristic information after the optimization constantly of back one to the optimization of previous moment upgrades processing, and the corresponding threedimensional model A that generates after upgrading, threedimensional model A after upgrading is projected to the texture image in this back moment, extract the data texturing after the renewal.
Preferably, described three-dimensional display apparatus comprises projection module and directional scattering panel module, and described directional scattering panel module is to have two screens to scattering properties, and described projection module is projected array.Described projected array is the array that projecting apparatus is formed, or is made up of two dimensional display and lens array.Three-dimensional display apparatus is to use the real-time space three-dimensional of integrated light field dimension display technologies to present system, the space three-dimensional scene image that the output field of view angle is very big and motion parallax is continuous, make the observer form 3D vision by binocular parallax, reach real 3 D video effect.
The present invention combines with integrated light field dimension display technologies with based on real-time personage's capturing technology of RGB-D camera, each terminal equipment uses integrated light field dimension display technologies so that the real-time sense of reality to be provided, and has the 3-D effect of fine and smooth binocular parallax and motion parallax; Simultaneously, use the RGB-D camera to catch people information, and interconnected by the Internet, brought into play the visual dominance of three-dimensional display system and the RGB-D camera is with low cost and the personage catches advantage efficiently.
Major advantage of the present invention is:
Integrated related resource, use the cheap and convenient RGB-D degree of depth camera that uses to gather in real time and handle, obtain quality personage's interactive information preferably, and these information are simplified and compress and reduce its network transmission bandwidth requirement, it can be transmitted in real time on the internet, used high performance real-time light field three-dimensional display apparatus simultaneously, can realize good virtual reality effect, made the participant of remote video communication can obtain interactive experience on the spot in person.
Description of drawings
Fig. 1 is the basic logical structure schematic diagram of three-dimensional display remote video communication method among the present invention.
Fig. 2 obtains the flow chart of interaction data for data sending terminal.
Fig. 3 generates the flow chart of virtual reality scenario for data receiver utilizes interaction data.
Embodiment
As shown in Figure 1, the system that realizes three-dimensional display remote video communication method of the present invention comprises data sending terminal 1 and the data receiver 2 that is connected with data sending terminal 1 by network, data sending terminal 1 and data receiver 2 carry out data interaction in real time, realize remote video communication.Data sending terminal 1 and data receiver 2 all carry out reception and the transmission of data simultaneously, and the logical construction of two terminals is identical, for making things convenient for description of the invention, and artificial data sending terminal 1 and the data receiver 2 of being divided into.
Data sending terminal 1 comprises main control computer 8, three-dimensional display apparatus 5, personage's capture device 6, and wherein, main control computer 8 comprises network transmission module 9, three-dimensional display software module 4 and personage and catches software module 3.Three-dimensional display software module 4 and personage that three-dimensional display apparatus 5 and personage's capture device 6 enter main control computer 8 respectively catch software module 3, three-dimensional display software module 4 is caught software module 3 with the personage and is connected with network transmission module 9 respectively, network transmission module 9 is connected to data receiver 2 by the Internet, three-dimensional display apparatus 5 is at communication interaction zone 7 output image datas, the personage catches the character image that software module 3 is used in the obtaining communication interaction area 7, and the capture region of the viewing area of three-dimensional display apparatus 5 and personage's capture device 6 is all wanted to cover communication interaction zone 7.
9 pairs of network transmission modules need be simplified and compress in the data of transmission over networks, are sent to data receiver 2 by the Internet; Accept the data that other-end sends over by the Internet simultaneously.Data comprise personage's expression parameter, the limb action parameter, and personage's texture and the voice messaging that need upgrade, data volume is smaller, can satisfy the network real-time Transmission after the compression.
Three-dimensional display apparatus 5 is to use the real-time space three-dimensional of integrated light field dimension display technologies to present system, and this is one of advantage of the present invention.The spatial distribution of the light that the principle of light field three-dimensional display is sent for the reconstruct three-dimensional scenic uses the three-dimensional display apparatus of this principle mainly to comprise projection module and directional scattering panel module.Projection module and directional scattering panel module have multiple arrangement model, are example with the many projections light field display system that realizes 360 degree full views watchings here.Around the projecting apparatus of screen annular distribution with the combination image projection imaging of all angles projection of space three-dimensional model to display or three-dimensional scenic in the central area of ring-type screen, this ring-type screen is to have the two directional scattering screens to scattering properties, namely laterally have specific scattering angle, vertically having than large scattering angle degree characteristic, be the diffuser screen curtain structure that rotation is symmetrically distributed.Thus, the image of the projecting apparatus projection of annular distribution just is converted into the space three-dimensional scene image of 360 degree panorama visibles, watches for the spectators that are centered around in the screen periphery viewing area.According to the principle of light field reconstruction and the characteristic of circular-oriented diffuser screen, the fillet image that each position in viewing area only can watch a projector projects corresponding to this position to go out, and each position can see that the combination image of a plurality of fillet images that a plurality of projector projects go out just forms the complete picture in this position, presents complete image information by this pattern that is similar to integrated splicing light field.Diverse location in viewing area all can be watched the different images corresponding to the relevant position so, this just can guarantee that the image information that the eyes of the spectators in viewing area are watched is different, form 3D vision by binocular parallax, can also be by the mobile motion parallax that obtains between horizontal diverse location.Three-dimensional display apparatus 5 only is that for the dependence of three-dimensional display software module 4 three-dimensional display apparatus 5 needs the necessary data of drawing three-dimensional effect and parameters such as three-dimensional display software module 4 supplies a model, texture.The specific implementation method of three-dimensional display software module 4 and three-dimensional display apparatus 5 are irrelevant.
The major function of three-dimensional display remote video communication system is the real time information exchange that realizes on the both direction.First direction is that the certificate of mutual number such as video communication participant's profile, expression, voice, action obtains and sends.Profile, action, the voice of the communication participating user in 6 pairs of communication interaction zones 7 of personage's capture device catch, and obtain basic image, voice data.These data are transmitted to the personage and catch software module 3, the personage catches software module 3 therefrom calculates the personage by some algorithms profile, voice and expression action message, and it is optimized and accumulates, being met the information of real scene situation more, and these data are sent to network transmission module 9.9 pairs of data of network transmission module are compressed and are packed, and send it to another telecommunication terminal (being data receiver) by the Internet, thereby finish the transfer of data on this direction.Interaction datas such as the profile that second direction is receiver, video communication participant, expression, voice, action, and generate virtual reality scenario.Network transmission module 9 obtains the communication user data that another terminal sends over by the Internet, and the data after will decompressing send three-dimensional display software module 4 to.Three-dimensional display software module 4 is by the user profile that obtains and expression, action, speech data, calculate threedimensional model and texture information that three-dimensional display apparatus 5 need present, send three-dimensional image display device 5 to, make it present corresponding 3-D effect and play voice, watch for the participant in the communication interaction zone 7.Finishing of the real time information exchange of this both direction, make the users of three-dimensional display remote video communication system different terminals can observe 3-D effects such as the other side's profile, expression, action in real time, hear the other side's voice, and also can give the other side these feedback information of oneself in real time.
Below introduce in detail above the specific implementation process of real time information exchange on the both direction, may further comprise the steps:
As shown in Figure 2, data sending terminal:
1) utilizes the RGB-D camera to obtain first user's character image, comprised texture image and depth image in this character image;
From texture image, extract facial characteristics information and expressive features information;
From depth image, extract the limbs characteristic information and reconstruct people's object point cloud.
Personage's capture device is selected cheapness, the easy-to-use and RGB-D camera being convenient to dispose for use, when utilizing the RGB-D camera to obtain first user's character image, at relative first user's of different time changing RGB-D cameras visual angle, the concrete RGB-D camera that uses is Kinect in the present embodiment.Kinect can gather the color of scene and depth data stream in real time, and is delivered to the personage as color frame and degree of depth frame and catches software module.These data flow itself are exactly texture information and the depth information of scene part, have wherein comprised personage's texture and depth data.The personage catches software module 3 extracts the personage in real time from personage's data texturing facial characteristics and expressive features information, from personage's depth data, extract the human limbs characteristic information, these information definitions personage's geometric shape, facial expression and limb action information, from depth data, can reconstruct personage's some cloud, can reflect personage's original geometry data.
In the present embodiment, use Kinect as the RGB-D camera, at the Kinect software development, Microsoft provides the Software Development Kit(SDK of Kinect), use the interface among the Kinect SDK namely can characteristic information extraction, rebuild people's object point cloud.
2) utilize described people's object point cloud that each characteristic information in the step 1) is optimized characteristic information after being optimized, the characteristic information after optimizing by this generates threedimensional model A.
Each characteristic information here comprises above-mentioned facial characteristics information, expressive features information and limbs characteristic information, utilize people's object point cloud of rebuilding to claim information to the spy that each characteristic signal is optimized after being optimized, the characteristic information after optimizing by this again generates threedimensional model A.
Characteristic information is optimized: the definition energy equation, with the characteristic information after optimizing as unknown number.Equation has been described model and cloud data the two sum of difference degree on geometry of the model of the characteristic information generation after optimizing and the characteristic information generation of model after the difference degree on the geometry and optimization that the characteristic information before the optimization generates.Ask the solution that makes this energy equation obtain minimum value, the characteristic information after namely being optimized.
Generate threedimensional model according to characteristic information: used model deformation method, comprised Morph technology and Skinned Mesh technology.Be the routine techniques means.
3) described threedimensional model A is projected to corresponding texture image, the corresponding data texturing of this threedimensional model A is extracted; Obtain voice messaging when gathering character image, together with the characteristic information after optimizing, and the data texturing that extracts sends to second user with this voice messaging.
Threedimensional model A is projected in the texture image that Kinect collects, extract the corresponding data texturing of threedimensional model A, wherein, voice messaging can directly obtain by the sound collection equipment among the Kinect, then network transmission module 9 with voice messaging, after optimizing characteristic information and the data texturing that extracts is compressed, packing sends to described second user after handling.For each color frame that Kinect catches, can extract the personage's original texture that collects, we accumulate the personage's original texture data that repeatedly collect and optimize, and improve its robustness, obtain quality personage's texture preferably.
The optimization of texture: each personage has a base texture, extracts new data texturing at every turn and all can be used for upgrading the base texture data, and this renewal is a kind of mode of accumulation, can optimize texture.Concrete update method is: for each pixel, the data texturing that collects according to its accumulative total estimates a probability distribution, upgrades this color of pixel value with the desired value of this probability distribution.
4) cycling step 1)~3), utilize back one data constantly that the data of previous moment are upgraded and send to second user.
Obtain character image by repeatedly changing the visual angle, and the personage's original texture data that repeatedly collect are accumulated and optimize, in conjunction with corresponding threedimensional model, just can obtain complete personage's profile, expression, action data.
As shown in Figure 3, data receiver:
Second user receives from after first user's data by network, characteristic information after the extraction optimization wherein generates threedimensional model B, utilize the described data texturing that extracts that threedimensional model B is played up, by three-dimensional display apparatus output rendering result, and play described voice messaging.
Network transmission module in the data receiver receives the packet that sends over by the Internet, wherein data is decompressed, and finish the work of data sync.Network transmission module carries out the data that virtual reality presents with current needs and offers the three-dimensional display software module, and these data comprise the characteristic information of personage's geometric shape, the characteristic information of facial expression, the characteristic information of limb action, personage's texture information, the personage's voice messaging that needs upgrade.The implementation process of three-dimensional display software module is: the characteristic information of the characteristic information of the characteristic information of personage's geometric shape, facial expression, limb action is brought in the algorithm as parameter, the normal man's object model that prestores in the three-dimensional display software module is out of shape.By deformation operation, can obtain meeting the person model of above-mentioned static state and behavioral characteristics description.Original stored the base texture of person model in the three-dimensional display software module, when obtaining needing personage's texture information of renewal each time, the three-dimensional display software module will be upgraded the base texture of person model, and accumulation constantly, obtains current operable personage's texture.Personage's speech data can directly use.The three-dimensional display software module is submitted to three-dimensional display apparatus to the person model data, the personage's data texturing that calculate, carries out virtual reality and presents, and plays personage's voice simultaneously.

Claims (5)

1. can expand formula three-dimensional display remote video communication method for one kind, it is characterized in that implementation step is as follows:
Data sending terminal:
1) utilizes the RGB-D camera to obtain first user's character image, comprised texture image and depth image in this character image;
From texture image, extract facial characteristics information and expressive features information;
From depth image, extract the limbs characteristic information and reconstruct people's object point cloud;
2) utilize described people's object point cloud that each characteristic information in the step 1) is optimized characteristic information after being optimized, the characteristic information after optimizing by this generates threedimensional model A;
3) described threedimensional model A is projected to corresponding texture image, the corresponding data texturing of this threedimensional model A is extracted; Obtain voice messaging when gathering character image, together with the characteristic information after optimizing, and the data texturing that extracts sends to second user with this voice messaging;
4) cycling step 1)~3), utilize back one data constantly that the data of previous moment are upgraded and send to second user;
Data receiver:
Second user receives from after first user's data by network, characteristic information after the extraction optimization wherein generates threedimensional model B, utilize the described data texturing that extracts that threedimensional model B is played up, by three-dimensional display apparatus output rendering result, and play described voice messaging.
2. the formula three-dimensional display remote video communication method of expanding as claimed in claim 1, it is characterized in that, when utilizing back one data constantly that the data of previous moment are upgraded, characteristic information after utilizing characteristic information after the optimization constantly of back one to the optimization of previous moment upgrades processing, and the corresponding threedimensional model A that generates after upgrading, threedimensional model A after upgrading is projected to the texture image in this back moment, extract the data texturing after the renewal.
3. the formula three-dimensional display remote video communication method of expanding as claimed in claim 2 is characterized in that, when utilizing the RGB-D camera to obtain first user's character image, at relative first user's of different time changing RGB-D cameras visual angle.
4. the formula three-dimensional display remote video communication method of expanding as claimed in claim 3, it is characterized in that the characteristic information after described voice messaging, the optimization and the data texturing that extracts are compressed, the processing back of packing sends to described second user by network.
5. the formula three-dimensional display remote video communication method of expanding as claimed in claim 4, it is characterized in that, described three-dimensional display apparatus comprises projection module and directional scattering panel module, described directional scattering panel module is to have two screens to scattering properties, and described projection module is projected array.
CN201310176717.7A 2013-05-13 2013-05-13 Can expansion type three dimensional display remote video communication method Active CN103269423B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310176717.7A CN103269423B (en) 2013-05-13 2013-05-13 Can expansion type three dimensional display remote video communication method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310176717.7A CN103269423B (en) 2013-05-13 2013-05-13 Can expansion type three dimensional display remote video communication method

Publications (2)

Publication Number Publication Date
CN103269423A true CN103269423A (en) 2013-08-28
CN103269423B CN103269423B (en) 2016-07-06

Family

ID=49013031

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310176717.7A Active CN103269423B (en) 2013-05-13 2013-05-13 Can expansion type three dimensional display remote video communication method

Country Status (1)

Country Link
CN (1) CN103269423B (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104853134A (en) * 2014-02-13 2015-08-19 腾讯科技(深圳)有限公司 Video communication method and video communication device
CN104935860A (en) * 2014-03-18 2015-09-23 北京三星通信技术研究有限公司 Method and device for realizing video calling
CN105763828A (en) * 2014-12-18 2016-07-13 中兴通讯股份有限公司 Instant communication method and device
CN105812708A (en) * 2016-03-18 2016-07-27 严俊涛 Video call method and system
CN106412562A (en) * 2015-07-31 2017-02-15 深圳创锐思科技有限公司 Method and system for displaying stereoscopic content in three-dimensional scene
CN107846566A (en) * 2017-10-31 2018-03-27 努比亚技术有限公司 A kind of information processing method, equipment and computer-readable recording medium
CN108139801A (en) * 2015-12-22 2018-06-08 谷歌有限责任公司 For performing the system and method for electronical display stabilization via light field rendering is retained
WO2018120657A1 (en) * 2016-12-27 2018-07-05 华为技术有限公司 Method and device for sharing virtual reality data
CN109299184A (en) * 2018-07-31 2019-02-01 武汉大学 A kind of terrestrial space three-dimensional point cloud Unified coding method for visualizing
JP2019512173A (en) * 2016-01-22 2019-05-09 上海肇觀電子科技有限公司NextVPU (Shanghai) Co., Ltd. Method and apparatus for displaying multimedia information
CN109814718A (en) * 2019-01-30 2019-05-28 天津大学 A kind of multi-modal information acquisition system based on Kinect V2
CN113784109A (en) * 2021-09-07 2021-12-10 太仓中科信息技术研究院 Projection system and method for script killing environment
CN114339190A (en) * 2021-12-29 2022-04-12 中国电信股份有限公司 Communication method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101101672A (en) * 2007-07-13 2008-01-09 中国科学技术大学 Stereo vision three-dimensional human face modelling approach based on dummy image
CN101668219B (en) * 2008-09-02 2012-05-23 华为终端有限公司 Communication method, transmitting equipment and system for 3D video
CN102520787A (en) * 2011-11-09 2012-06-27 浙江大学 Real-time spatial three-dimensional presentation system and real-time spatial three-dimensional presentation method
WO2012126135A1 (en) * 2011-03-21 2012-09-27 Intel Corporation Method of augmented makeover with 3d face modeling and landmark alignment
US20120274745A1 (en) * 2011-04-29 2012-11-01 Austin Russell Three-dimensional imager and projection device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101101672A (en) * 2007-07-13 2008-01-09 中国科学技术大学 Stereo vision three-dimensional human face modelling approach based on dummy image
CN101668219B (en) * 2008-09-02 2012-05-23 华为终端有限公司 Communication method, transmitting equipment and system for 3D video
WO2012126135A1 (en) * 2011-03-21 2012-09-27 Intel Corporation Method of augmented makeover with 3d face modeling and landmark alignment
US20120274745A1 (en) * 2011-04-29 2012-11-01 Austin Russell Three-dimensional imager and projection device
CN102520787A (en) * 2011-11-09 2012-06-27 浙江大学 Real-time spatial three-dimensional presentation system and real-time spatial three-dimensional presentation method

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104853134B (en) * 2014-02-13 2019-05-07 腾讯科技(深圳)有限公司 A kind of video communication method and device
CN104853134A (en) * 2014-02-13 2015-08-19 腾讯科技(深圳)有限公司 Video communication method and video communication device
CN104935860A (en) * 2014-03-18 2015-09-23 北京三星通信技术研究有限公司 Method and device for realizing video calling
CN105763828A (en) * 2014-12-18 2016-07-13 中兴通讯股份有限公司 Instant communication method and device
CN106412562B (en) * 2015-07-31 2019-10-25 深圳超多维科技有限公司 The method and its system of stereo content are shown in three-dimensional scenic
CN106412562A (en) * 2015-07-31 2017-02-15 深圳创锐思科技有限公司 Method and system for displaying stereoscopic content in three-dimensional scene
CN108139801A (en) * 2015-12-22 2018-06-08 谷歌有限责任公司 For performing the system and method for electronical display stabilization via light field rendering is retained
CN108139801B (en) * 2015-12-22 2021-03-16 谷歌有限责任公司 System and method for performing electronic display stabilization via preserving light field rendering
JP2019512173A (en) * 2016-01-22 2019-05-09 上海肇觀電子科技有限公司NextVPU (Shanghai) Co., Ltd. Method and apparatus for displaying multimedia information
CN105812708A (en) * 2016-03-18 2016-07-27 严俊涛 Video call method and system
WO2018120657A1 (en) * 2016-12-27 2018-07-05 华为技术有限公司 Method and device for sharing virtual reality data
CN107846566A (en) * 2017-10-31 2018-03-27 努比亚技术有限公司 A kind of information processing method, equipment and computer-readable recording medium
CN109299184B (en) * 2018-07-31 2022-04-29 武汉大学 Unified coding visualization method for three-dimensional point cloud in near-earth space
CN109299184A (en) * 2018-07-31 2019-02-01 武汉大学 A kind of terrestrial space three-dimensional point cloud Unified coding method for visualizing
CN109814718A (en) * 2019-01-30 2019-05-28 天津大学 A kind of multi-modal information acquisition system based on Kinect V2
CN113784109A (en) * 2021-09-07 2021-12-10 太仓中科信息技术研究院 Projection system and method for script killing environment
CN114339190A (en) * 2021-12-29 2022-04-12 中国电信股份有限公司 Communication method, device, equipment and storage medium
CN114339190B (en) * 2021-12-29 2023-06-23 中国电信股份有限公司 Communication method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN103269423B (en) 2016-07-06

Similar Documents

Publication Publication Date Title
CN103269423B (en) Can expansion type three dimensional display remote video communication method
CN104782122B (en) Controlled three-dimensional communication point-to-point system and method
CN109976690A (en) AR glasses remote interaction method, device and computer-readable medium
JP2023181217A (en) Information processing system, information processing method, and information processing program
US20220264068A1 (en) Telepresence system and method
CN113313818B (en) Three-dimensional reconstruction method, device and system
CN109829977A (en) Method, apparatus, electronic equipment and the medium in room are seen in virtual three-dimensional space
JP6384940B2 (en) 3D image display method and head mounted device
CN109752951B (en) Control system processing method and device, storage medium and electronic device
CN107924589A (en) Communication system
CN106302132A (en) A kind of 3D instant communicating system based on augmented reality and method
CN205068298U (en) Interaction system is wandered to three -dimensional scene
KR101329057B1 (en) An apparatus and method for transmitting multi-view stereoscopic video
CN106204751B (en) Real object and virtual scene real-time integration method and integration system
CN107371012A (en) A kind of VR image procossings and display methods and device
CN207051853U (en) A kind of immersive VR experiencing system
CN108989784A (en) Image display method, device, equipment and the storage medium of virtual reality device
WO2022209129A1 (en) Information processing device, information processing method and program
JP2014164537A (en) Virtual reality service providing system and virtual reality service providing method
CN106651759A (en) VR (Virtual Reality) scene optimization method and device based on fixed position camera
CN116744027A (en) Meta universe live broadcast system
KR20160136160A (en) Virtual Reality Performance System and Performance Method
CN210605808U (en) Three-dimensional image reconstruction system
CN116012509A (en) Virtual image driving method, system, equipment and storage medium
US12112426B2 (en) Augmenting a view of a real-world environment with a view of a volumetric video object

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant