CN106773054A - A kind of device and method for realizing that augmented reality is interactive - Google Patents

A kind of device and method for realizing that augmented reality is interactive Download PDF

Info

Publication number
CN106773054A
CN106773054A CN201611241676.5A CN201611241676A CN106773054A CN 106773054 A CN106773054 A CN 106773054A CN 201611241676 A CN201611241676 A CN 201611241676A CN 106773054 A CN106773054 A CN 106773054A
Authority
CN
China
Prior art keywords
virtual
user
loading unit
scene
eyeglass
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611241676.5A
Other languages
Chinese (zh)
Inventor
马思玄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING LOCOJOY TECHNOLOGY Co Ltd
Original Assignee
BEIJING LOCOJOY TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING LOCOJOY TECHNOLOGY Co Ltd filed Critical BEIJING LOCOJOY TECHNOLOGY Co Ltd
Priority to CN201611241676.5A priority Critical patent/CN106773054A/en
Publication of CN106773054A publication Critical patent/CN106773054A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality

Abstract

The present invention provides a kind of device for realizing that augmented reality is interactive, including real image transmission unit, virtual image loading unit, wherein, the real image transmission unit is by two groups of periscopes by real world image force transfer to user's sight line, the concave arrangement of two groups of periscopes, its recessed position is provided with the carrying virtual image loading unit;Last a piece of periscope eyeglass in periscope is semi-transflective reflective eyeglass, the virtual image loading unit is used to generate and show virtual content image, and through the semi-transflective reflective eyeglass by the virtual content image transmission to user's sight line, the virtual content excludes scene parts;Through this, real world image and virtual content image are superimposed naturally, so as to realize realizing the integrated of real world information and virtual world information not isolating on the premise of real world shows, while also customer service influence of the equipment to user's sight line.The present invention also provides a kind of method for realizing that augmented reality is interactive.

Description

A kind of device and method for realizing that augmented reality is interactive
Technical field
The present invention relates to augmented reality (Augmented Reality, abbreviation AR) technical field, more particularly to a kind of realization The interactive device and method of augmented reality.
Background technology
Virtual reality (Virtual Reality, abbreviation VR), is a kind of computer that can be created with the experiencing virtual world Analogue system, it is being generated a virtual environment, for user provides imagination space, is being imitated therewith by using person using computer Really interact, give user experience true to nature, be allowed to immerse wherein.
As VR technologies moved towards reality from concept is more in recent years, VR technologies turn into the focus of scientific and technological industry;It is particularly big Amount VR equipment (the predominantly appearance of VR helmets).However, the application of VR technologies, also the defect because of its technology in itself, makes it In the big heavy discount of the effect of the aspects such as feeling of immersion.Such as, VR equipment generally requires to cover the visual field of user comprehensively, could obtain Preferable feeling of immersion (particularly VR helmets), but the reasons such as technology are an advantage over, virtual world scene is still unable to reach truly The visual effect in the world.Further, since the visual field is blocked, consider for personal safety, the user of VR equipment is often fixed VR technologies are used and experienced in certain safety zone.This all constrains the application and popularization of VR technologies significantly.
The experience that cannot be realized in that real world that virtual world brings both was pursued in view of some users, again Region, the arbitrary experience in real world are not only restricted to when asking real world actual visual effect, and requirement to use, in VR In the case of technology is unable to reach height reduction real world and the demand contradiction logically, above-mentioned effect is realized Really, it is necessary to which certain technological means makes real world and virtual world " seamless " integrated.
Augmented reality (Augmented Reality, abbreviation AR), is exactly that one kind believes real world information and virtual world The integrated technology of breath " seamless ", script is difficult the content experienced by technologies such as computers by it in real world, and simulation is imitative Very, and the virtual content application that will obtain and real world is attached to, is allowed to be perceived, so as to reach exceeding reality Experience.Although augmented reality has started to realize application, some augmented reality functions such as in Google's glasses, come in it is fashionable Augmented reality game Pokemon Go;But, due to being limited to prior art, augmented reality in application process, or it is empty Intend content effect it is stiff, rigid, it is impossible to meet user experience, or generation virtual content can not well with truly Dock (including mobile phone frame is in real world and indisposed sense of the integrated generation of virtual world) in the world.Further, since equipment calculating, The error of display etc., AR equipment there is also the influence to the user visual field, still suffer from larger potential safety hazard.
The content of the invention
In order to solve the above problems, the present invention provides a kind of easy AR devices, virtual content is realized with real world It is integrated well, while the accurate transmission of real world image is realized using periscope principle, so that customer service equipment is to user The influence of sight line, meanwhile, the semi-transflective reflective eyeglass of setting has the loading for not influenceing virtual content, and then is not isolating true generation The integrated of real world information and virtual world information is realized on the premise of showing in boundary.
The present invention provides a kind of device for realizing that augmented reality is interactive, including real image transmission unit, virtual image add Carrier unit, wherein, the real image transmission unit is made up of housing and the two groups of periscopes for setting on the housing, and leads to Two groups of periscopes are crossed by real world image force transfer to user's sight line, the concave arrangement of two groups of periscopes, its Recessed position is provided with the slot for carrying the virtual image loading unit;First piece eyeglass in the periscope, last The viewing area central area of the central area of piece eyeglass and the virtual image loading unit is in the level of user's sight line On extended line, the viewing area of the virtual image loading unit falls in the visual field of the first piece eyeglass, last a piece of eyeglass In region;Wherein, the last a piece of periscope eyeglass is semi-transflective reflective eyeglass, and the virtual image loading unit is used to give birth to Into with display virtual content image, and through the semi-transflective reflective eyeglass by the virtual content image transmission to user's sight line In, the virtual content excludes scene parts;Through above-mentioned treatment, real world image and virtual content image are superimposed naturally, from And realize realizing the integrated of real world information and virtual world information on the premise of real world shows not isolating, while Customer service influence of the equipment to user's sight line.The present invention also provides a kind of method for realizing that augmented reality is interactive.
The embodiment of the present invention provides a kind of device for realizing that augmented reality is interactive, and it is single that the device includes that real image is transmitted Unit, virtual image loading unit;Wherein,
The real image transmission unit is made up of housing and the two groups of periscopes for setting on the housing;
The concave arrangement of two groups of periscopes;Recessed position of the housing between two groups of described periscopes is set There is the slot for carrying the virtual image loading unit;
Two groups of described periscopes can obtain real world image information, and by its force transfer to user's sight line In;
To the first piece eyeglass of user's transmission real world image information, (i.e. real world image enters in the periscope Fashionable first piece eyeglass, is arranged on the back side of the virtual image loading unit), believe to user's transmission real world image (i.e. real world image is delivered to the last a piece of eyeglass in user's sight line to the last a piece of eyeglass of breath, is arranged on the void Intend image loading unit before) central area make with the viewing area central area of the virtual image loading unit On the horizontal extension line of user's sight line;
The viewing area of the virtual image loading unit falls in the field of vision of the first piece eyeglass, last a piece of eyeglass In domain;
Preferably, the first piece eyeglass, the area of visual field and the virtual image loading unit of last a piece of eyeglass Viewing area overlaps;
The last a piece of periscope eyeglass is semi-transflective reflective eyeglass;
The virtual image loading unit is used to generate and show virtual content image, and passes through the semi-permeable and semi-reflecting mirror Piece is by the virtual content image transmission to user's sight line;The virtual content excludes scene parts, it is to avoid with real scene It is not inconsistent;The virtual content generally comprises virtual role, virtual special efficacy, virtual objects etc..
Further, in said apparatus,
The housing by carry the periscope and the virtual image loading unit housing body and can be by institute State the housing fixed part composition that housing is fixed on user's head.
Further, in said apparatus,
The virtual image loading unit is held including module of finding a view, movement locus acquisition module, virtual scene module, computing Row module, display module;The virtual image loading unit, can be have wherein have take pictures, movement locus acquisition function Intelligent mobile equipment, such as mobile phone, flat board;Wherein,
The module of finding a view, for finding a view real scene, obtains real scene information;
The movement locus acquisition module, the movement locus for catching described device generates motion track information;
The virtual scene module, for initial virtual position (the i.e. user for creating virtual scene, determining user Initial position of the virtual role in the virtual scene);
The computing performing module, obtains the initial void of the motion track information and the virtual scene and user Intend position, and the virtual scene of dynamic load user virtual location and its surrounding accordingly;It is simultaneously virtual according to the user Position, virtual scene and preset rules, control the generation (such as generating time, position, trigger condition etc.) of the virtual content, And the dynamic load of the virtual content is controlled in the movement locus of the virtual scene according to the virtual content;
The display module, can receive and show the virtual content and user's virtual location and the void around it Intend scene;
Further,
Before using described device, the virtual image loading unit is taken out, adjust it and enter correction mode;This pattern Under, the display module is only used for receiving and showing the virtual scene, user's virtual location;
Then, the real scene that will be used is found a view, and creates virtual scene accordingly and determine that user's is initial Virtual location;
And then, user moves some distances and (is sufficiently large to be gathered and in void by the movement locus acquisition module Intend showing motion track in scene), while virtual scene and user described in the virtual image loading unit dynamic load Virtual location;If motion track of motion track of the user in the virtual scene with it in real scene is not inconsistent, The virtual scene is adjusted by the visualization interface for being arranged on the display module and (is mainly adjusted by direction and virtual scene The engineer's scale of displacement/real world displacement), it is allowed to be consistent with the virtual motion track in real scene;
After the completion of correction, the virtual image loading unit is adjusted to use pattern, and be placed back into the slot;This Under pattern, the display module is only used for receiving and showing the virtual content;
Further,
The module of finding a view, is the filming apparatus of the virtual image loading unit;It is arranged on and the display module phase To dorsal part;
The movement locus acquisition module, is realized by the sensor for being fixed on the virtual image loading unit;
The virtual scene module, based on computer graphics principle, finds a view according to real scene information and user Position, builds three-dimensional virtual scene, and determine the initial virtual position of user;
Further,
In the computing performing module, the virtual content is performed in the movement locus of the virtual scene by the computing The pre-set programs control of module, the pre-set programs are generally basede on behavior tree writes and forms.
Additionally, on the basis of said apparatus, adjusting accordingly, real time correction is realized, specifically, by the first piece mirror Piece replaces with semi-transflective reflective eyeglass, while setting module of finding a view at the back side of the virtual image loading unit, makes its real-time Find a view, and ensure that its framing information is consistent with the real scene that the real image transmission unit is delivered in user's sight line, lead to The virtual location that live view information constantly corrects user is crossed, and corrects virtual content image accordingly, be allowed to true with described World's image information is consistent.
The embodiment of the present invention also provides a kind of method for realizing that augmented reality is interactive, it is characterised in that the method includes:
User obtains real world image information by two groups of periscope force transfers;Meanwhile, two groups of periscopes Concave arrangement;
Recessed position between two groups of described periscopes is provided with for generating and showing the virtual of virtual content image Image loading unit, and the virtual image loading unit can remove;The virtual image loading unit can be any of the above-described The virtual image loading unit of device;
Transmit true in the periscope to the first piece eyeglass of user's transmission real world image information, to user The viewing area central area of the central area of the last a piece of eyeglass of world's image information and the virtual image loading unit On the horizontal extension line of user's sight line;The viewing area of the virtual image loading unit falls in the first piece mirror In piece, the area of visual field of last a piece of eyeglass;
The last a piece of periscope eyeglass is semi-transflective reflective eyeglass, to make virtual content image be transferred to through it In user's sight line;The virtual content excludes scene parts.
Further, on the basis of the above method, the first piece eyeglass is replaced with into semi-transflective reflective eyeglass, while in institute The back side for stating virtual image loading unit sets module of finding a view, and passes it through semi-transflective reflective eyeglass live view, and ensure it Framing information is consistent with the real scene that the real image transmission unit is delivered in user's sight line, by live view information The constantly virtual location of correction user, and correction virtual content image accordingly, is allowed to and the real world image information phase Symbol.
The present invention provides a kind of device for realizing that augmented reality is interactive, and the device includes real image transmission unit, virtual Image loading unit, wherein, the real image transmission unit is arrived real world image force transfer by two groups of periscopes In user's sight line, the concave arrangement of two groups of periscopes, it is single that its recessed position is provided with the carrying virtual image loading Unit;Last a piece of periscope eyeglass in periscope is semi-transflective reflective eyeglass, and the virtual image loading unit is used to generate With display virtual content image, and through the semi-transflective reflective eyeglass by the virtual content image transmission to user's sight line, The virtual content excludes scene parts.The present invention also provides a kind of method for realizing that augmented reality is interactive.By using above-mentioned Device or method, real world image and virtual content image are superimposed naturally, so as to realize not isolating real world displaying Under the premise of realize the integrated of real world information and virtual world information, while also customer service shadow of the equipment to user's sight line Ring.
Brief description of the drawings
Fig. 1 is a kind of institutional framework schematic diagram of device for realizing that augmented reality is interactive that the embodiment of the present invention 1 is provided;
Fig. 2 is virtual image loading unit in a kind of device for realizing that augmented reality is interactive that the embodiment of the present invention 2 is provided Institutional framework schematic diagram;
Note:In Fig. 1, regular point represents the transmission path of real image;Arrow tail arrow represents the biography of virtual content image Defeated path.
Specific embodiment
To make the beneficial effect of purpose, technical scheme and the acquirement of the embodiment of the present invention clearer, below in conjunction with the accompanying drawings, Technical scheme in the embodiment of the present invention is clearly and completely stated.It is understood that embodiment described herein is only For instruction and explanation of the present invention, it is not intended to limit the present invention.Based on the embodiment in the present invention, those skilled in the art The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
A kind of device for realizing that augmented reality is interactive that the embodiment of the present invention 1 is provided, as shown in figure 1, the device is included very Real image transmission unit 101, virtual image loading unit 102;Wherein,
The real image transmission unit is made up of housing 1011 and the two groups of periscopes 1012 for setting on the housing;
The concave arrangement of two groups of periscopes;Recessed position of the housing between two groups of described periscopes is set There is the slot 1011a for carrying the virtual image loading unit;
Two groups of described periscopes can obtain real world image information, and by its force transfer to user's sight line (referring to the instruction path of regular point in Fig. 1);
To the first piece eyeglass of user's transmission real world image information, (i.e. real world image enters in the periscope Fashionable first piece eyeglass, is arranged on the back side of the virtual image loading unit), believe to user's transmission real world image (i.e. real world image is delivered to the last a piece of eyeglass in user's sight line to the last a piece of eyeglass of breath, is arranged on the void Intend image loading unit before) central area make with the viewing area central area of the virtual image loading unit On the horizontal extension line of user's sight line;
The viewing area of the virtual image loading unit falls in the field of vision of the first piece eyeglass, last a piece of eyeglass In domain;
Preferably, the first piece eyeglass, the area of visual field and the virtual image loading unit of last a piece of eyeglass Viewing area overlaps;
The last a piece of periscope eyeglass is semi-transflective reflective eyeglass;
The virtual image loading unit is used to generate and show virtual content image, and passes through the semi-permeable and semi-reflecting mirror Piece by the virtual content image transmission to user's sight line (referring to the instruction path of arrow tail arrow in Fig. 1);It is described virtual interior Hold and exclude scene parts, it is to avoid be not inconsistent with real scene;The virtual content generally comprises virtual role, virtual special efficacy, virtual Article etc..
A kind of device for realizing that augmented reality is interactive that the embodiment of the present invention 2 is provided, it is described on the basis of embodiment 1 Virtual image loading unit, as shown in Fig. 2 including module 201 of finding a view, movement locus acquisition module 202, virtual scene module 203rd, computing performing module 204, display module 205;The virtual image loading unit, can be have wherein have take pictures, The Intelligent mobile equipment of movement locus acquisition function, such as mobile phone, flat board;Wherein,
The module of finding a view, for finding a view real scene, obtains real scene information;
The movement locus acquisition module, the movement locus for catching described device generates motion track information;
The virtual scene module, for initial virtual position (the i.e. user for creating virtual scene, determining user Initial position of the virtual role in the virtual scene);
The computing performing module, obtains the initial void of the motion track information and the virtual scene and user Intend position, and the virtual scene of dynamic load user virtual location and its surrounding accordingly;It is simultaneously virtual according to the user Position, virtual scene and preset rules, control the generation (such as generating time, position, trigger condition etc.) of the virtual content, And the dynamic load of the virtual content is controlled in the movement locus of the virtual scene according to the virtual content;
The display module, can receive and show the virtual content and user's virtual location and the void around it Intend scene.
A kind of device for realizing that augmented reality is interactive that the embodiment of the present invention 3 is provided, on the basis of embodiment 2,
Before using described device, the virtual image loading unit is taken out, adjust it and enter correction mode;This pattern Under, the display module is only used for receiving and showing the virtual scene, user's virtual location;
Then, the real scene that will be used is found a view, and creates virtual scene accordingly and determine that user's is initial Virtual location;
And then, user moves some distances and (is sufficiently large to be gathered and in void by the movement locus acquisition module Intend showing motion track in scene), while virtual scene and user described in the virtual image loading unit dynamic load Virtual location;If motion track of motion track of the user in the virtual scene with it in real scene is not inconsistent, The virtual scene is adjusted by the visualization interface for being arranged on the display module and (is mainly adjusted by direction and virtual scene The engineer's scale of displacement/real world displacement), it is allowed to be consistent with the virtual motion track in real scene;
After the completion of correction, the virtual image loading unit is adjusted to use pattern, and be placed back into the slot;This Under pattern, the display module is only used for receiving and showing the virtual content.
A kind of device for realizing that augmented reality is interactive that the embodiment of the present invention 4 is provided, on the basis of embodiment 2,
The module of finding a view, is the filming apparatus of the virtual image loading unit;It is arranged on and the display module phase To dorsal part;
The movement locus acquisition module, is realized by the sensor for being fixed on the virtual image loading unit;
The virtual scene module, based on computer graphics principle, finds a view according to real scene information and user Position, builds three-dimensional virtual scene, and determine the initial virtual position of user.
A kind of device for realizing that augmented reality is interactive that the embodiment of the present invention 5 is provided, on the basis of embodiment 2,
In the computing performing module, the virtual content is performed in the movement locus of the virtual scene by the computing The pre-set programs control of module, the pre-set programs are generally basede on behavior tree writes and forms.
A kind of device for realizing that augmented reality is interactive that the embodiment of the present invention 6 is provided, on the basis of embodiment 1,
The housing by carry the periscope and the virtual image loading unit housing body and can be by institute State the housing fixed part composition that housing is fixed on user's head.
A kind of device for realizing that augmented reality is interactive that the embodiment of the present invention 7 is provided, in embodiment 1-6 any embodiments On the basis of,
Adjust accordingly, realize real time correction, specifically, the first piece eyeglass is replaced with into semi-permeable and semi-reflecting mirror Piece, while setting module of finding a view at the back side of the virtual image loading unit, makes its live view, and ensure its framing information It is consistent with the real scene that the real image transmission unit is delivered in user's sight line, constantly corrected by live view information The virtual location of user, and virtual content image is corrected accordingly, it is allowed to be consistent with the real world image information.
The embodiment of the present invention 8 provides a kind of method for realizing that augmented reality is interactive, it is characterised in that the method includes:
User obtains real world image information by two groups of periscope force transfers;Meanwhile, two groups of periscopes Concave arrangement;
Recessed position between two groups of described periscopes is provided with for generating and showing the virtual of virtual content image Image loading unit, and the virtual image loading unit can remove;The virtual image loading unit can be embodiment 1-7 The virtual image loading unit of middle any device;
Transmit true in the periscope to the first piece eyeglass of user's transmission real world image information, to user The viewing area central area of the central area of the last a piece of eyeglass of world's image information and the virtual image loading unit On the horizontal extension line of user's sight line;The viewing area of the virtual image loading unit falls in the first piece mirror In piece, the area of visual field of last a piece of eyeglass;
The last a piece of periscope eyeglass is semi-transflective reflective eyeglass, to make virtual content image be transferred to through it In user's sight line;The virtual content excludes scene parts.
The embodiment of the present invention 9 provides a kind of method for realizing that augmented reality is interactive, on the basis of embodiment 8,
The first piece eyeglass is replaced with into semi-transflective reflective eyeglass, while at the back side of the virtual image loading unit Setting is found a view module, passes it through semi-transflective reflective eyeglass live view, and ensure that its framing information is passed with the real image The real scene that defeated unit is delivered in user's sight line is consistent, and the virtual bit of user is constantly corrected by live view information Put, and correct virtual content image accordingly, be allowed to be consistent with the real world image information.The above method, being capable of school in real time Just so that virtual content image remains rational position and movement in real scene, it is to avoid the two dislocation occur and give User causes indisposed sense, and then remains that " seamless " of real world information and virtual world information is integrated.
What above-described embodiment was provided realizes the interactive device and method of augmented reality, can make real world image and virtual Content image is superimposed naturally, so as to realize realizing real world information and virtual generation on the premise of real world displaying is not isolated Boundary's information it is integrated, while also customer service influence of the equipment to user's sight line.
Finally it should be noted that:Above example is merely to illustrate technical scheme, rather than its limitations;Although The present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should be understood:It still can be right Technical scheme described in foregoing embodiments is modified, or carries out equivalent to which part technical characteristic;And this A little modifications are replaced, and do not make the spirit and model of the essence disengaging various embodiments of the present invention technical scheme of appropriate technical solution Enclose.

Claims (10)

1. a kind of device for realizing that augmented reality is interactive, it is characterised in that the device includes:
Real image transmission unit and virtual image loading unit;Wherein,
The real image transmission unit is made up of housing and the two groups of periscopes for setting on the housing;
The concave arrangement of two groups of periscopes;Recessed position of the housing between two groups of described periscopes is provided with takes Carry the slot of the virtual image loading unit;
Two groups of described periscopes can obtain real world image information, and by its force transfer to user's sight line;
Real world is transmitted in the periscope to the first piece eyeglass of user's transmission real world image information, to user The central area of the last a piece of eyeglass of image information exists with the viewing area central area of the virtual image loading unit On the horizontal extension line of user's sight line;The viewing area of the virtual image loading unit falls in the first piece eyeglass, most Afterwards in the area of visual field of a piece of eyeglass;
The last a piece of periscope eyeglass is semi-transflective reflective eyeglass;
The virtual image loading unit is used to generate and show virtual content image, and will through the semi-transflective reflective eyeglass The virtual content image transmission is in user's sight line;The virtual content excludes scene parts.
2. a kind of device for realizing that augmented reality is interactive according to claim 1, it is characterised in that
The first piece eyeglass, the area of visual field of last a piece of eyeglass are heavy with the viewing area of the virtual image loading unit Close.
3. a kind of device for realizing that augmented reality is interactive according to claim 1, it is characterised in that
The housing by carry the periscope and the virtual image loading unit housing body and can be by the shell Body is fixed on the housing fixed part composition of user's head.
4. a kind of device for realizing that augmented reality is interactive according to claim 1, it is characterised in that
The virtual image loading unit includes find a view module, movement locus acquisition module, virtual scene module, computing execution mould Block, display module;Wherein,
The module of finding a view, for finding a view real scene, obtains real scene information;
The movement locus acquisition module, the movement locus for catching described device generates motion track information;
The virtual scene module, for the initial virtual position for creating virtual scene, determining user;
The computing performing module, obtains the initial virtual position of the motion track information and the virtual scene and user Put, and the virtual scene of dynamic load user virtual location and its surrounding accordingly;Simultaneously according to user's virtual location, Virtual scene and preset rules, control the generation of the virtual content, and according to the virtual content in the virtual scene Movement locus control the dynamic load of the virtual content;
The display module, can receive and show the virtual content and user's virtual location and the virtual field around it Scape.
5. a kind of device for realizing that augmented reality is interactive according to claim 4, it is characterised in that
Before using described device, the virtual image loading unit is taken out, adjust it and enter correction mode;Under this pattern, institute Display module is stated to be only used for receiving and showing the virtual scene, user's virtual location;
Then, the real scene that will be used is found a view, virtual scene is created accordingly and the initial virtual position of user is determined Put;
And then, user moves some distances, while virtual scene described in the virtual image loading unit dynamic load and making User's virtual location;If motion track of the user in the virtual scene is with its motion track in real scene not Symbol, then adjust the virtual scene by being arranged on the visualization interface of the display module, is allowed to and the void in real scene Intend motion track to be consistent;
After the completion of correction, the virtual image loading unit is adjusted to use pattern, and be placed back into the slot;This pattern Under, the display module is only used for receiving and showing the virtual content.
6. a kind of device for realizing that augmented reality is interactive according to claim 4, it is characterised in that
The module of finding a view, is the filming apparatus of the virtual image loading unit;It is arranged on relative with the display module Dorsal part;
The movement locus acquisition module, is realized by the sensor for being fixed on the virtual image loading unit;
The virtual scene module, based on computer graphics principle, finds a view position according to real scene information and user, Three-dimensional virtual scene is built, and determines the initial virtual position of user.
7. a kind of device for realizing that augmented reality is interactive according to claim 4, it is characterised in that
In the computing performing module, the virtual content the virtual scene movement locus by the computing performing module Pre-set programs control.
8. according to a kind of any described devices for realizing that augmented reality is interactive of claim 1-7, it is characterised in that
Described device being capable of real time correction;Specifically, the first piece eyeglass is replaced with into semi-transflective reflective eyeglass, while in institute The back side for stating virtual image loading unit sets module of finding a view, and makes its live view, and ensure that its framing information is true with described The real scene that image transmission unit is delivered in user's sight line is consistent, and the void of user is constantly corrected by live view information Intend position, and correct virtual content image accordingly, be allowed to be consistent with the real world image information.
9. a kind of method for realizing that augmented reality is interactive, it is characterised in that the method includes:
User obtains real world image information by two groups of periscope force transfers;Meanwhile, two groups of periscopes are in recessed Shape is arranged;
Recessed position between two groups of described periscopes is provided with the virtual image for generating and showing virtual content image Loading unit, and the virtual image loading unit can remove;The virtual image loading unit is any in claim 1-8 The virtual image loading unit of described device;
Real world is transmitted in the periscope to the first piece eyeglass of user's transmission real world image information, to user The central area of the last a piece of eyeglass of image information exists with the viewing area central area of the virtual image loading unit On the horizontal extension line of user's sight line;The viewing area of the virtual image loading unit falls in the first piece eyeglass, most Afterwards in the area of visual field of a piece of eyeglass;
The last a piece of periscope eyeglass is semi-transflective reflective eyeglass, is used to make virtual content image be transferred to through it In person's sight line;The virtual content excludes scene parts.
10. a kind of method for realizing that augmented reality is interactive according to claim 9, it is characterised in that
The first piece eyeglass is replaced with into semi-transflective reflective eyeglass, while being set at the back side of the virtual image loading unit Find a view module, make its live view, and ensure that its framing information is delivered in user's sight line with the real image transmission unit Real scene it is consistent, the virtual location of user is constantly corrected by live view information, and correct virtual content shadow accordingly Picture, is allowed to be consistent with the real world image information.
CN201611241676.5A 2016-12-29 2016-12-29 A kind of device and method for realizing that augmented reality is interactive Pending CN106773054A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611241676.5A CN106773054A (en) 2016-12-29 2016-12-29 A kind of device and method for realizing that augmented reality is interactive

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611241676.5A CN106773054A (en) 2016-12-29 2016-12-29 A kind of device and method for realizing that augmented reality is interactive

Publications (1)

Publication Number Publication Date
CN106773054A true CN106773054A (en) 2017-05-31

Family

ID=58923521

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611241676.5A Pending CN106773054A (en) 2016-12-29 2016-12-29 A kind of device and method for realizing that augmented reality is interactive

Country Status (1)

Country Link
CN (1) CN106773054A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107390370A (en) * 2017-09-21 2017-11-24 中新国际电子有限公司 A kind of VR heads show
CN112509040A (en) * 2019-08-26 2021-03-16 苹果公司 Image-based detection of surfaces providing specular reflection and reflection modification
CN113192373A (en) * 2021-03-18 2021-07-30 徐州九鼎机电总厂 Periscope simulation imaging method based on immersive human-computer interaction simulation system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1802586A (en) * 2003-06-12 2006-07-12 西门子共同研究公司 Calibrating real and virtual views
CN102147658A (en) * 2011-02-12 2011-08-10 华为终端有限公司 Method and device for realizing interaction of augment reality (AR) and mobile terminal
CN102157011A (en) * 2010-12-10 2011-08-17 北京大学 Method for carrying out dynamic texture acquisition and virtuality-reality fusion by using mobile shooting equipment
CN103593044A (en) * 2012-08-13 2014-02-19 鸿富锦精密工业(深圳)有限公司 Electronic device correction system and method
CN104937475A (en) * 2012-04-05 2015-09-23 奇跃公司 Apparatus for optical see-through head mounted display with mutual occlusion and opaqueness control capability
CN105976432A (en) * 2016-07-13 2016-09-28 顽石运动智能科技(北京)有限公司 Football virtual system
CN205787364U (en) * 2016-03-23 2016-12-07 北京三星通信技术研究有限公司 Near-eye display device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1802586A (en) * 2003-06-12 2006-07-12 西门子共同研究公司 Calibrating real and virtual views
CN102157011A (en) * 2010-12-10 2011-08-17 北京大学 Method for carrying out dynamic texture acquisition and virtuality-reality fusion by using mobile shooting equipment
CN102147658A (en) * 2011-02-12 2011-08-10 华为终端有限公司 Method and device for realizing interaction of augment reality (AR) and mobile terminal
CN104937475A (en) * 2012-04-05 2015-09-23 奇跃公司 Apparatus for optical see-through head mounted display with mutual occlusion and opaqueness control capability
CN103593044A (en) * 2012-08-13 2014-02-19 鸿富锦精密工业(深圳)有限公司 Electronic device correction system and method
CN205787364U (en) * 2016-03-23 2016-12-07 北京三星通信技术研究有限公司 Near-eye display device
CN105976432A (en) * 2016-07-13 2016-09-28 顽石运动智能科技(北京)有限公司 Football virtual system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107390370A (en) * 2017-09-21 2017-11-24 中新国际电子有限公司 A kind of VR heads show
CN112509040A (en) * 2019-08-26 2021-03-16 苹果公司 Image-based detection of surfaces providing specular reflection and reflection modification
CN113192373A (en) * 2021-03-18 2021-07-30 徐州九鼎机电总厂 Periscope simulation imaging method based on immersive human-computer interaction simulation system

Similar Documents

Publication Publication Date Title
JP6880174B2 (en) Virtual reality, augmented reality, and mixed reality systems and methods
US10241470B2 (en) No miss cache structure for real-time image transformations with data compression
US9881421B2 (en) Image processing
CN105264478B (en) Holography anchoring and dynamic positioning
US10242654B2 (en) No miss cache structure for real-time image transformations
CN106873767B (en) Operation control method and device for virtual reality application
US20160267720A1 (en) Pleasant and Realistic Virtual/Augmented/Mixed Reality Experience
US20210283496A1 (en) Realistic Virtual/Augmented/Mixed Reality Viewing and Interactions
US10999412B2 (en) Sharing mediated reality content
EP3323111B1 (en) Communication system
CN108090880A (en) The anti-distortion processing method and device of a kind of image
US20180301125A1 (en) No Miss Cache Structure for Real-Time Image Transformations with Multiple LSR Processing Engines
KR102090891B1 (en) Methods and devices for generating eye images
US20200241731A1 (en) Virtual reality vr interface generation method and apparatus
US11682138B2 (en) Localization and mapping using images from multiple devices
CN106773054A (en) A kind of device and method for realizing that augmented reality is interactive
CN205039917U (en) Sea floor world analog system based on CAVE system
CN109696953A (en) The method, apparatus and virtual reality device of virtual reality text importing
CN112926521B (en) Eyeball tracking method and system based on light source on-off
CN106405843A (en) Projection VR glasses
US20230288701A1 (en) Sensor emulation
US20170186218A1 (en) Method for loading 360 degree images, a loading module and mobile terminal
KR102542641B1 (en) Apparatus and operation method for rehabilitation training using hand tracking
CN108958461A (en) Have the virtual reality system and its control method of self adaptive control
CN117765207A (en) Virtual interface display method, device, equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170531

RJ01 Rejection of invention patent application after publication