CN106302132A - A kind of 3D instant communicating system based on augmented reality and method - Google Patents
A kind of 3D instant communicating system based on augmented reality and method Download PDFInfo
- Publication number
- CN106302132A CN106302132A CN201610827179.7A CN201610827179A CN106302132A CN 106302132 A CN106302132 A CN 106302132A CN 201610827179 A CN201610827179 A CN 201610827179A CN 106302132 A CN106302132 A CN 106302132A
- Authority
- CN
- China
- Prior art keywords
- unit
- user
- image
- real
- real scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/046—Interoperability with other network applications or services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of 3D instant communicating system based on augmented reality and method；System A identical including structure and system B, they include user image and audio collection unit respectively, transmit and receive unit, image procossing and reconfiguration unit, real scene three-dimensional reconstruction unit, motion capture unit and image output unit；User image and audio collection unit are sequentially connected with transmission and receive unit, image procossing and reconfiguration unit, image output unit；Image and audio collection unit are for gathering the image used by communication and audio-frequency information；With receiving unit, image is converted into depth information by transmission, builds depth map, and carry out three-dimensional reconstruction by depth map；By image-display units, the three-dimensional body of structure is projected in user eye, and superimposed with real scene, form compound scene.Traditional instant messaging mode is converted into 3D instant messaging mode, beneficially user and improves the experience of communication by native system, optimizes communication effect.
Description
Technical field
The present invention relates to telecommunications field, particularly relate to a kind of 3D instant communicating system based on augmented reality and side
Method.
Background technology
The prehuman main instant messaging mode of mesh utilizes mobile phone communication, video, mail etc., a kind of IMU
News mode is all to support that in the way of text, audio frequency, video user carries out Communication.But the most any instant messaging
Mode can substantially experience the restriction that communication is experienced by communication tool, it is impossible to reaches immersing of the face-to-face chat communication of people
Sense.
Augmented reality, i.e. (Augmented Reality) technology, refer to that one is added to user Intel Virtualization Technology
The mode in the world is observed again, by being added to real world again by the sense of the mankind after science and technology analog simulation on sensory perception
The perception of official institute, thus reach the sensory experience of exceeding reality.The most general augmented reality system is to be mounted with photographic head
Mobile device, such as smart mobile phone.User is shot by the photographic head on smart mobile phone, then obtains in background process
Information, adds the information that cannot directly obtain in some photos, and operating process is complex and loaded down with trivial details, and it is flat to be only limitted to two dimension
Face operates.
Summary of the invention
The restriction that it is an object of the invention to overcome existing instant messaging mode to experience communication due to communication tool causes
Instant messaging feeling of immersion is not enough, it is provided that a kind of 3D instant communicating system based on augmented reality and method, allows user immediately
Communication obtains sense of reality and third dimension, optimizes communication effect, increase instant messaging feeling of immersion.
The present invention is achieved through the following technical solutions:
A kind of 3D instant communicating system based on augmented reality, it is characterised in that: include system A and system that structure is identical
B, the two system includes user image and audio collection unit respectively, transmits and receive unit, image procossing and reconstruct list
Unit, real scene three-dimensional reconstruction unit, motion capture unit and image output unit；
Described user image and audio collection unit are sequentially connected with transmission and receive unit, image procossing and reconstruct list
Unit, image output unit；Real scene three-dimensional reconstruction unit connects image output unit；Motion capture unit connects image output
Unit；
Described user image and audio collection unit, be used for gathering user omnidirectional images and user audio frequency letter
Breath, and in real time user image and audio-frequency information are carried out record；
Described transmission and reception unit, for carrying out the transmission of image and audio frequency between system A and system B；
Described image procossing and reconfiguration unit are used for reconstructing virtual 3d model, i.e. receive and adopt from user image and audio frequency
The user image that collection unit gathers, eliminates picture noise and pattern distortion by Image semantic classification；By image characteristics extraction,
Characteristic point is found to mate；The depth information of object is obtained, according to the object feature point obtained and deep by images match
Degree information carries out model reconstruction；By graphic process unit, the model of reconstruct is carried out real-time rendering, generate virtual 3d model；
The movement by user of the described real scene three-dimensional reconstruction unit, photographic head obtains the real scene of multiple angles
Depth map；By instant iteration, different depth maps is added up, accurately calculate the three-dimensional mould of real scene and object
Type, determines virtual 3D project objects position, size and real-time direction.
Described motion capture unit is used for perception user and system A and the position of system B and kinestate, catches and uses
Person's head movement track and eyeball tracking, adjust the virtual 3D object space generated and interior according to the viewing area of user
Hold；
Described image output unit, for the image after three-dimensional reconstruction is drawn on viewing area according to scene depth figure, is thrown
It is mapped in user eye, and virtual 3D object is shown together with the object information of real scene.
Described user image and audio collection unit include multiple omnidirectional camera, earphone and mike；Wherein,
Photographic head obtains the omnidirectional images of multiple user, and earphone gathers user audio-frequency information with mike, and real time record uses
Person's image and audio-frequency information.
Described transmission and reception unit use wireless network mode to connect, and make instant between system A and system B reception and biography
Defeated image and audio-frequency information.
Described image procossing and reconfiguration unit, including central processing unit and graphic process unit.
Described real scene three-dimensional reconstruction unit, including two and above photographic head, central processing unit and graphic process unit.
Described motion capture unit, including three-axis gyroscope, accelerometer and thermal camera.
Described image output unit include display 1, optics turn as battery of lens 2, wedge reflector 3, holographic mirror 4,
Rear holographic assemblies lens 5, front holographic assemblies lens 6；
The light that display 1 sends enters optics by unthreaded hole and turns as battery of lens 2, by wedge reflector 3 by light line reflection
On upper holographic mirror 4.Holographic group before the image that display 1 is constituted being imaged on by the rear holographic assemblies lens 5 tilted
Close on the focal plane of lens 6；Holographic mirror 4 diffraction that light is made by the bend glass with little etched line enters in human eye 7；
By diffraction of light effect, form multi beam directional light and enter in human eye 7, thus the image slices constituted by display 1 is away from projection
At infinity；Third dimension is obtained, to the image projecting user images of left and right eyes by imitating eye-observation real scene things
Interpupillary distance according to user carries out the process in terms of parallax, and the dummy object allowing user see produces certain parallax information,
Obtain the 3D third dimension as observing real space things.
Present invention 3D based on augmented reality instant communication method is as follows:
Step (1): system A is connected by wireless network with transmission and the reception unit of system B, carries out instant messaging；
Step (2): omnidirectional images and the sound of user by its transmission and are received unit by system A, immediately send
To system B, and real-time reception is from the omnidirectional images of system B user and acoustic information；
Step (3): system B is comprehensive by its image procossing and reconfiguration unit and the system A user that receives
Image, generates the virtual 3D rendering of system A user；
Step (: 4): system B obtains the depth map of real scene by its real scene three-dimensional reconstruction unit, and carries out true
The three-dimensional reconstruction of real field scape, calculates the threedimensional model of real scene and object, determines the virtual 3D rendering of system A user
Projected position, size and real-time direction；
Step (5): system B passes through its image output unit, by the system A user omnidirectional images of reconstruct through parallax
The process of aspect, is projected in system B user eye with directional light form by holographic assemblies lens, allows system B user see
The dummy object arrived produces parallax information, it is thus achieved that the 3D third dimension as observing real space things, thus realizes virtual object
The 3D instant messaging that body is superimposed with real scene；
Step (6): user Rotation of eyeball, head rotation and position are moved by system B by motion capture unit
Kinestate carries out perception and tracking；According to the change of user viewing area, by the graphic process unit virtual 3D to generating
Object carries out real-time rendering, changes the position of the virtual 3D rendering of system A user and real-time direction；
Step (7): system A and system B constantly circulate and carry out above step, it is achieved 3D instant messaging.
The present invention and traditional mode without instant messaging support that in the way of text, audio frequency, video user carries out communication
Exchange is compared, and uses 3D instant messaging mode based on augmented reality to relieve the restriction that communication is experienced by communication tool, increases
The feeling of immersion of instant messaging, optimizes communication and experiences.
Accompanying drawing explanation
Fig. 1 is the configuration diagram of present invention 3D based on augmented reality instant communicating system.
Fig. 2 is image procossing of the present invention and reconfiguration unit workflow diagram.
Fig. 3 is real scene three-dimensional reconstruction unit workflow diagram of the present invention.
Fig. 4 is image display pattern schematic diagram of the present invention.
Detailed description of the invention
Below in conjunction with specific embodiment, the present invention is more specifically described in detail.
Embodiment
As shown in Figures 1 to 4.The invention discloses a kind of 3D instant communicating system based on augmented reality, it is characterised in that:
System A identical including structure and system B, the two system include respectively user image and audio collection unit, transmission and
Receive unit, image procossing and reconfiguration unit, real scene three-dimensional reconstruction unit, motion capture unit and image output single
Unit；
Described user image and audio collection unit are sequentially connected with transmission and receive unit, image procossing and reconstruct list
Unit, image output unit；Real scene three-dimensional reconstruction unit connects image output unit；Motion capture unit connects image output
Unit；
Described user image and audio collection unit, be used for gathering user omnidirectional images and user audio frequency letter
Breath, and in real time user image and audio-frequency information are carried out record；
Described transmission and reception unit, for carrying out the transmission of image and audio frequency between system A and system B；
Described image procossing and reconfiguration unit are used for reconstructing virtual 3d model, i.e. receive and adopt from user image and audio frequency
The user image that collection unit gathers, eliminates picture noise and (significantly) pattern distortion by Image semantic classification；Pass through image
Feature extraction, finds characteristic point to mate；The depth information of object is obtained, according to the object features obtained by images match
Point and depth information carry out model reconstruction；By graphic process unit, the model of reconstruct is carried out real-time rendering, generate virtual 3D
Model；
The movement by user of the described real scene three-dimensional reconstruction unit, photographic head obtains the real scene of multiple angles
Depth map；By instant iteration, different depth maps is added up, accurately calculate the three-dimensional mould of real scene and object
Type, determines virtual 3D project objects position, size and real-time direction；
Described motion capture unit is used for perception user and system A and the position of system B and kinestate, catches and uses
Person's head movement track and eyeball tracking, adjust the virtual 3D object space generated and interior according to the viewing area of user
Hold；
Described image output unit, for the image after three-dimensional reconstruction is drawn on viewing area according to scene depth figure, is thrown
It is mapped in user eye, and virtual 3D object is shown together with the object information of real scene.
Described user image and audio collection unit include multiple omnidirectional camera, earphone and mike；Wherein,
Photographic head obtains the omnidirectional images of multiple user, and earphone gathers user audio-frequency information with mike, and real time record uses
Person's image and audio-frequency information.
Described transmission and reception unit use wireless network mode to connect, and make instant between system A and system B reception and biography
Defeated image and audio-frequency information.
Described image procossing and reconfiguration unit, including central processing unit and graphic process unit.
Described real scene three-dimensional reconstruction unit, including two and above photographic head (binocular camera), central processing unit
And graphic process unit.Photographic head can use two photographic head to carry out the acquisition of real scene information, the method for Depth Information Acquistion
It is: two photographic head calculate camera internal reference number and outer parameter after demarcating；Obtain the most simultaneously and there is phase
Image with region；Two width images, through image procossing and images match, calculate based on two photographic head shootings of principle of parallax
The depth information of the same area real scene gone out；Utilize the viewing area figure that the binocular camera of a series of different angles shoots
Sheet, obtains the depth information that whole viewing area is complete, builds viewing area depth map.
Described motion capture unit, including three-axis gyroscope, accelerometer and thermal camera.
Described image output unit include (high brightness is miniature) display 1, optics turn as battery of lens 2, wedge reflector 3,
Holographic mirror 4, rear holographic assemblies lens 5, front holographic assemblies lens 6；
The light that display 1 sends enters optics by unthreaded hole and turns as battery of lens 2, by wedge reflector 3 by light line reflection
On upper holographic mirror 4.Holographic group before the image that display 1 is constituted being imaged on by the rear holographic assemblies lens 5 tilted
Close on the focal plane of lens 6；Holographic mirror 4 diffraction that light is made by the bend glass with little etched line enters in human eye 7；
By diffraction of light effect, form multi beam directional light and enter in human eye 7, thus the image slices constituted by display 1 is away from projection
At infinity；Third dimension is obtained, to the image projecting user images of left and right eyes by imitating eye-observation real scene things
Interpupillary distance according to user carries out the process in terms of parallax, and the dummy object allowing user see produces certain parallax information,
Obtain the 3D third dimension as observing real space things.
The augmented reality realizing three-dimensional scenic needs to ensure, by location data and scene information, the virtual 3D that generated
Object is accurately in real scene, and therefore realizing the augmented reality under three-dimensional scenic needs to comprise several basic handling step:
Obtain real scene information, including depth information；
The real scene information obtained is processed, obtains scene depth figure；
Virtual 3D object is generated by image procossing and three-dimensional reconstruction；
According to scene depth figure, the 3D object of generation is drawn on viewing area, projects in user eye, and by virtual
3D object shows together with the object information of real scene.
Present invention 3D based on augmented reality instant communication method is as follows:
Step (1): system A is connected by wireless network with transmission and the reception unit of system B, carries out instant messaging；
Step (2): omnidirectional images and the sound of user by its transmission and are received unit by system A, immediately send
To system B, and real-time reception is from the omnidirectional images of system B user and acoustic information；
Step (3): system B is comprehensive by its image procossing and reconfiguration unit and the system A user that receives
Image, generates the virtual 3D rendering of system A user；
Step (: 4): system B obtains the depth map of real scene by its real scene three-dimensional reconstruction unit, and carries out true
The three-dimensional reconstruction of real field scape, calculates the threedimensional model of real scene and object, determines the virtual 3D rendering of system A user
Projected position, size and real-time direction；
Step (5): system B passes through its image output unit, by the system A user omnidirectional images of reconstruct through parallax
The process of aspect, is projected in system B user eye with directional light form by holographic assemblies lens, allows system B user see
The dummy object arrived produces (certain) parallax information, it is thus achieved that the 3D third dimension as observing real space things, thus real
The 3D instant messaging that existing dummy object is superimposed with real scene；
Step (6): user Rotation of eyeball, head rotation and position are moved by system B by motion capture unit
Kinestate carries out perception and tracking；According to the change of user viewing area, by the graphic process unit virtual 3D to generating
Object carries out real-time rendering, changes the position of the virtual 3D rendering of system A user and real-time direction；
Step (7): system A and system B constantly circulate and carry out above step, it is achieved 3D instant messaging.
As it has been described above, image of the present invention and audio collection unit are for gathering the image used by communication and audio-frequency information；Logical
Cross transmission, with receiving unit, image is converted into depth information, build depth map, and carry out three-dimensional reconstruction by depth map；By structure
The three-dimensional body built projects in user eye, and superimposed with real scene, forms compound scene.Traditional is by native system
Time communication modes be converted into 3D instant messaging mode, beneficially user improves the experience of communication, optimizes communication effect.
Embodiments of the present invention are also not restricted to the described embodiments, other any spirit without departing from the present invention
With the change made under principle, modify, substitute, combine, simplify, all should be the substitute mode of equivalence, be included in the present invention's
Within protection domain.
Claims (8)
1. a 3D instant communicating system based on augmented reality, it is characterised in that: include system A and system B that structure is identical,
The two system include respectively user image and audio collection unit, transmit and receive unit, image procossing and reconfiguration unit,
Real scene three-dimensional reconstruction unit, motion capture unit and image output unit；
Described user image and audio collection unit are sequentially connected with transmission and receive unit, image procossing and reconfiguration unit, figure
As output unit；Real scene three-dimensional reconstruction unit connects image output unit；Motion capture unit connects image output unit；
Described user image and audio collection unit, be used for gathering user omnidirectional images and user audio-frequency information, and
In real time user image and audio-frequency information are carried out record；
Described transmission and reception unit, for carrying out the transmission of image and audio frequency between system A and system B；
Described image procossing and reconfiguration unit are used for reconstructing virtual 3d model, i.e. receive from user image and audio collection list
The user image that unit gathers, eliminates picture noise and pattern distortion by Image semantic classification；By image characteristics extraction, find
Characteristic point is mated；The depth information of object is obtained, according to the object feature point obtained and degree of depth letter by images match
Breath carries out model reconstruction；By graphic process unit, the model of reconstruct is carried out real-time rendering, generate virtual 3d model；
The movement by user of the described real scene three-dimensional reconstruction unit, photographic head obtains the real scene degree of depth of multiple angles
Figure；By instant iteration, different depth maps is added up, accurately calculate the threedimensional model of real scene and object, really
Fixed virtual 3D project objects position, size and real-time direction；
Described motion capture unit is used for perception user and system A and the position of system B and kinestate, catches user head
Portion's movement locus and eyeball tracking, adjust the virtual 3D object space and content generated according to the viewing area of user；
Described image output unit, for the image after three-dimensional reconstruction is drawn on viewing area according to scene depth figure, projects
In user eye, and virtual 3D object is shown together with the object information of real scene.
3D instant communicating system based on augmented reality the most according to claim 1, it is characterised in that: described user image
And audio collection unit includes multiple omnidirectional camera, earphone and mike；Wherein, photographic head obtains multiple user
Omnidirectional images, earphone gathers user audio-frequency information, real time record user image and audio-frequency information with mike.
3D instant communicating system based on augmented reality the most according to claim 1, it is characterised in that: described transmission and reception
Unit uses wireless network mode to connect, and makes immediately receive between system A and system B and transmit image and audio-frequency information.
3D instant communicating system based on augmented reality the most according to claim 1, it is characterised in that: described image procossing with
Reconfiguration unit, including central processing unit and graphic process unit.
3D instant communicating system based on augmented reality the most according to claim 1, it is characterised in that: described real scene three
Dimension reconstruction unit, including two and above photographic head, central processing unit and graphic process unit.
3D instant communicating system based on augmented reality the most according to claim 1, it is characterised in that: described motion capture list
Unit, including three-axis gyroscope, accelerometer and thermal camera.
3D instant communicating system based on augmented reality the most according to claim 1, it is characterised in that: the output of described image is single
Unit includes that display (1), optics turn as battery of lens (2), wedge reflector (3), holographic mirror (4), rear holographic assemblies lens
(5), front holographic assemblies lens (6)；
The light that display (1) sends enters optics by unthreaded hole and turns as battery of lens (2), by wedge reflector (3), light is anti-
It is mapped on holographic mirror (4)；By the rear holographic assemblies lens (5) tilted, the image that display (1) is constituted is imaged on
On the focal plane of front holographic assemblies lens (6)；Holographic mirror (4) diffraction that light is made by the bend glass with little etched line
Enter in human eye (7)；By diffraction of light effect, form multi beam directional light and enter in human eye (7), thus by display (1)
The image slices constituted is away from being projected in infinite point；Third dimension is obtained, to projecting by imitating eye-observation real scene things
The image of user images of left and right eyes carries out the process in terms of parallax according to the interpupillary distance of user, allows the dummy object that user is seen
The parallax information produced, it is thus achieved that the 3D third dimension as observing real space things.
8. a 3D instant communication method based on augmented reality, it is characterised in that use according to any one of claim 1 to 7
3D instant communicating system based on augmented reality realizes, and it comprises the steps:
Step (1): system A is connected by wireless network with transmission and the reception unit of system B, carries out instant messaging；
Step (2): the omnidirectional images of user and sound by its transmission and are received unit by system A, be immediately sent to be
System B, and real-time reception is from the omnidirectional images of system B user and acoustic information；
Step (3): system B by its image procossing and reconfiguration unit and the omnidirectional images of system A user received,
The virtual 3D rendering of generation system A user；
Step (: 4): system B obtains the depth map of real scene by its real scene three-dimensional reconstruction unit, and carries out true field
The three-dimensional reconstruction of scape, calculates the threedimensional model of real scene and object, determines the projection of the virtual 3D rendering of system A user
Position, size and real-time direction；
Step (5): system B passes through its image output unit, by the system A user omnidirectional images of reconstruct through parallax aspect
Process, projected in system B user eye with directional light form by holographic assemblies lens, allow system B user see
Dummy object produces parallax information, it is thus achieved that with the 3D third dimension observed as real space things, thus realize dummy object with
The 3D instant messaging that real scene is superimposed；
Step (6): the motion such as is moved in user Rotation of eyeball, head rotation and position by system B by motion capture unit
State carries out perception and tracking；According to the change of user viewing area, by the graphic process unit virtual 3D object to generating
Carry out real-time rendering, change the position of the virtual 3D rendering of system A user and real-time direction；
Step (7): system A and system B constantly circulate and carry out above step, it is achieved 3D instant messaging.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610827179.7A CN106302132A (en) | 2016-09-14 | 2016-09-14 | A kind of 3D instant communicating system based on augmented reality and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610827179.7A CN106302132A (en) | 2016-09-14 | 2016-09-14 | A kind of 3D instant communicating system based on augmented reality and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106302132A true CN106302132A (en) | 2017-01-04 |
Family
ID=57711922
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610827179.7A Pending CN106302132A (en) | 2016-09-14 | 2016-09-14 | A kind of 3D instant communicating system based on augmented reality and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106302132A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107070784A (en) * | 2017-06-14 | 2017-08-18 | 李云 | A kind of 3D instant communicating systems based on WebGL and VR technologies |
| CN107463248A (en) * | 2017-06-20 | 2017-12-12 | 昆明理工大学 | A kind of remote interaction method caught based on dynamic with line holographic projections |
| CN107678538A (en) * | 2017-09-05 | 2018-02-09 | 北京原力创新科技有限公司 | Augmented reality system and information processing method therein, storage medium, processor |
| CN107885016A (en) * | 2017-11-30 | 2018-04-06 | 北京小米移动软件有限公司 | Holographic projection methods and device |
| CN108133654A (en) * | 2018-01-10 | 2018-06-08 | 河北农业大学 | The method of cotton plant type contrived experiment teaching based on AR mobile phones |
| WO2018149266A1 (en) * | 2017-02-14 | 2018-08-23 | 深圳梦境视觉智能科技有限公司 | Information processing method and device based on augmented reality |
| CN108924540A (en) * | 2017-08-08 | 2018-11-30 | 罗克韦尔柯林斯公司 | Low latency mixed reality head wearable device |
| CN109274575A (en) * | 2018-08-08 | 2019-01-25 | 阿里巴巴集团控股有限公司 | Message method and device and electronic equipment |
| CN109615703A (en) * | 2018-09-28 | 2019-04-12 | 阿里巴巴集团控股有限公司 | Image presentation method, device and the equipment of augmented reality |
| CN109884793A (en) * | 2017-12-06 | 2019-06-14 | 三星电子株式会社 | Method and apparatus for estimating the parameter of virtual screen |
| CN109978945A (en) * | 2019-02-26 | 2019-07-05 | 浙江舜宇光学有限公司 | A kind of information processing method and device of augmented reality |
| CN111161408A (en) * | 2019-12-27 | 2020-05-15 | 华南理工大学 | Method for realizing augmented reality, application thereof and computing equipment |
| CN112383767A (en) * | 2020-12-28 | 2021-02-19 | 广州志胜游艺设备有限公司 | New media AR interactive projection system |
| CN113949929A (en) * | 2021-10-15 | 2022-01-18 | 保升(中国)科技实业有限公司 | Video communication lifelike technology |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103220543A (en) * | 2013-04-25 | 2013-07-24 | 同济大学 | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect |
| TWM467133U (en) * | 2013-03-12 | 2013-12-01 | Imar Technology Co Ltd | Real-time social system combining real-time communication and mobile augmented reality |
| CN104793743A (en) * | 2015-04-10 | 2015-07-22 | 深圳市虚拟现实科技有限公司 | Virtual social contact system and control method thereof |
| CN105516639A (en) * | 2015-12-09 | 2016-04-20 | 北京小鸟看看科技有限公司 | Headset device, three-dimensional video call system and three-dimensional video call implementing method |
-
2016
- 2016-09-14 CN CN201610827179.7A patent/CN106302132A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWM467133U (en) * | 2013-03-12 | 2013-12-01 | Imar Technology Co Ltd | Real-time social system combining real-time communication and mobile augmented reality |
| CN103220543A (en) * | 2013-04-25 | 2013-07-24 | 同济大学 | Real time three dimensional (3D) video communication system and implement method thereof based on Kinect |
| CN104793743A (en) * | 2015-04-10 | 2015-07-22 | 深圳市虚拟现实科技有限公司 | Virtual social contact system and control method thereof |
| CN105516639A (en) * | 2015-12-09 | 2016-04-20 | 北京小鸟看看科技有限公司 | Headset device, three-dimensional video call system and three-dimensional video call implementing method |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018149266A1 (en) * | 2017-02-14 | 2018-08-23 | 深圳梦境视觉智能科技有限公司 | Information processing method and device based on augmented reality |
| CN107070784A (en) * | 2017-06-14 | 2017-08-18 | 李云 | A kind of 3D instant communicating systems based on WebGL and VR technologies |
| CN107463248A (en) * | 2017-06-20 | 2017-12-12 | 昆明理工大学 | A kind of remote interaction method caught based on dynamic with line holographic projections |
| CN108924540A (en) * | 2017-08-08 | 2018-11-30 | 罗克韦尔柯林斯公司 | Low latency mixed reality head wearable device |
| CN107678538A (en) * | 2017-09-05 | 2018-02-09 | 北京原力创新科技有限公司 | Augmented reality system and information processing method therein, storage medium, processor |
| CN107885016A (en) * | 2017-11-30 | 2018-04-06 | 北京小米移动软件有限公司 | Holographic projection methods and device |
| CN109884793A (en) * | 2017-12-06 | 2019-06-14 | 三星电子株式会社 | Method and apparatus for estimating the parameter of virtual screen |
| CN109884793B (en) * | 2017-12-06 | 2022-07-19 | 三星电子株式会社 | Method and apparatus for estimating parameters of virtual screen |
| CN108133654A (en) * | 2018-01-10 | 2018-06-08 | 河北农业大学 | The method of cotton plant type contrived experiment teaching based on AR mobile phones |
| CN109274575B (en) * | 2018-08-08 | 2020-07-24 | 阿里巴巴集团控股有限公司 | Message sending method and device and electronic equipment |
| CN109274575A (en) * | 2018-08-08 | 2019-01-25 | 阿里巴巴集团控股有限公司 | Message method and device and electronic equipment |
| CN109615703A (en) * | 2018-09-28 | 2019-04-12 | 阿里巴巴集团控股有限公司 | Image presentation method, device and the equipment of augmented reality |
| CN109615703B (en) * | 2018-09-28 | 2020-04-14 | 阿里巴巴集团控股有限公司 | Augmented reality image display method, device and equipment |
| CN109978945B (en) * | 2019-02-26 | 2021-08-31 | 浙江舜宇光学有限公司 | Augmented reality information processing method and device |
| CN109978945A (en) * | 2019-02-26 | 2019-07-05 | 浙江舜宇光学有限公司 | A kind of information processing method and device of augmented reality |
| CN111161408A (en) * | 2019-12-27 | 2020-05-15 | 华南理工大学 | Method for realizing augmented reality, application thereof and computing equipment |
| CN111161408B (en) * | 2019-12-27 | 2021-12-21 | 华南理工大学 | Method for realizing augmented reality, application thereof and computing equipment |
| CN112383767A (en) * | 2020-12-28 | 2021-02-19 | 广州志胜游艺设备有限公司 | New media AR interactive projection system |
| CN113949929A (en) * | 2021-10-15 | 2022-01-18 | 保升(中国)科技实业有限公司 | Video communication lifelike technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106302132A (en) | A kind of 3D instant communicating system based on augmented reality and method | |
| US11711504B2 (en) | Enabling motion parallax with multilayer 360-degree video | |
| AU2019240661B2 (en) | System and method for augmented and virtual reality | |
| JP2022502800A (en) | Systems and methods for augmented reality | |
| JP6813501B2 (en) | Privacy-sensitive consumer cameras coupled to augmented reality systems | |
| WO2014002346A1 (en) | Video processing device, video processing method, and video processing system | |
| CN103269423B (en) | Can expansion type three dimensional display remote video communication method | |
| CN114885274B (en) | Spatialization audio system and method for rendering spatialization audio | |
| CN108983982A (en) | AR aobvious equipment and terminal device combined system | |
| CN105653020A (en) | Time traveling method and apparatus and glasses or helmet using same | |
| TW201828258A (en) | Method and device for rendering scene | |
| CN105391984A (en) | UAV (Unmanned Aerial Vehicle) driving experience system and method | |
| CN110324555A (en) | Video communication device and method | |
| CN110324559A (en) | Video communication device and method | |
| CN103731526A (en) | Smartphone capable of achieving virtual imaging of three-dimensional frames suspended in the air | |
| CN209057332U (en) | A kind of earphone | |
| GB2571286A (en) | Virtual reality | |
| GB2558279A (en) | Head mountable display system | |
| WO2023035911A1 (en) | Display method and electronic device | |
| CN109068207A (en) | A kind of earphone and earphone system | |
| CN114460750A (en) | 3D holographic head-wearing intelligent communication glasses equipment and control method | |
| GB2556114A (en) | Virtual reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170104 |