CN108427194A - A kind of display methods and equipment based on augmented reality - Google Patents
A kind of display methods and equipment based on augmented reality Download PDFInfo
- Publication number
- CN108427194A CN108427194A CN201710079199.5A CN201710079199A CN108427194A CN 108427194 A CN108427194 A CN 108427194A CN 201710079199 A CN201710079199 A CN 201710079199A CN 108427194 A CN108427194 A CN 108427194A
- Authority
- CN
- China
- Prior art keywords
- display
- image
- light
- virtual
- display pattern
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
Embodiment of the present invention discloses a kind of display methods based on augmented reality, including：The first light for including virtual image is sent out, the virtual image is the image that the external equipment received transmits；Obtain the second light of the real scene image comprising outer scene；Second light of first light comprising virtual image and the real scene image comprising outer scene is synthesized.It is different from the prior art, the a kind of of present embodiment offer is combined external real scene image with virtual image based on the display methods of augmented reality, virtual image can provide the big virtual display curtain of indication range or virtual mouse-keyboard for user, and virtual image can be with the display screen in reality, mouse-keyboard, touch screen in reality etc. are used cooperatively, with larger field range, and with privacy.
Description
Technical field
Embodiment of the present invention is related to augmented reality field, more particularly to a kind of display side based on augmented reality
Method and equipment.
Background technology
Head-mounted display (head mounted display) is the new technology developed in recent years, specific to apply
Two kinds of virtual reality (virtual reality) and augmented reality (augmented reality) can be broadly divided into.
Virtual reality：
The 3D visions of the mankind are the collaborative work experiments by eyes.When people sees an actual 3D object
It waits, the image that the image and right eye that left eye is seen are seen has the nuance on visual angle.The optic nerve of human brain will left and right two
The image of eye carries out mixed processing, so that it may to form the vision of 3D.Head-mounted display passes through on display screen at the moment
Show that different images, left eye can only see left side display area, right eye can only see the right display area, can equally simulate
3D visions.If in this process, head-mounted display shelters from the light and image of perimeter simultaneously, allow human eye can only
When seeing display screen, it will generate the effect of virtual reality.
Augmented reality
The principle of augmented reality is to simulate virtual vision by head-mounted display, be superimposed upon the normal vision of user
On.
Both visual informations can be complementary to one another, and more easily can much be worked thereby using family and amusement is stopped
Not busy activity.Figure below is the typical realisation of augmented reality head-mounted display.Currently, augmented reality head-mounted display has
Two kinds of realization methods of optical perspective formula and video perspective type, the main distinction are optics synthesizer (Optical
Combiner) different.
Optical perspective formula：
The optics synthesizer of this kind of head-mounted display is a face semi-transparent semi-reflecting lens, from the light portion for being really environment
By pellicle mirror, and virtual object is then projected in by display on semi-transparent semi-reflecting lens, passes through semi-transparent semi-reflecting lens surface reflection
Into user's eye, to which synthesis is true and virtual world.
Video perspective type：
The optics synthesis of this kind of head-mounted display is realized by photographic device and display screen.It is true to take the photograph the shooting of phase device
Environment, video data are superimposed with virtual article by computer disposal, by showing that screen is presented to the user.Its system structure
It is almost the same with virtual reality head-mounted display, it is only necessary to increase the photographic device of shooting environmental and handle true, virtual world
The software module of synthesis.
Compared to this two classes realization method, optical perspective formula head-mounted display is immediately seen true environment due to the use of person,
Telepresenc is more preferable, has more preferably user experience.
Currently, the capital equipment of mobile office and amusement includes notebook, tablet computer and mobile phone.No matter handle official business or
Amusement, because of the limitation of volume and weight, can not provide desktop computer display, TV or movie theatre can carry these existing equipments
The large scale of confession is shown, reduces office efficiency and recreation experience.Meanwhile if using the larger equipment of screen, in public places,
Privacy when such as airport, station etc., office or amusement is unable to get guarantee.
Invention content
Embodiment of the present invention is mainly solving the technical problems that providing a kind of display methods based on augmented reality and setting
It is standby, with telepresenc, display area greatly and with privacy.
In order to solve the above technical problems, embodiment of the present invention provides a kind of display methods based on augmented reality, including：
The first light for including virtual image is sent out, the virtual image is the image that the external equipment received transmits；Obtain packet
Second light of the real scene image containing outer scene；By first light comprising virtual image and include the reality of outer scene
Second light of scape image is synthesized.
Be different from the prior art, present embodiment provide it is a kind of based on the display methods of augmented reality by external outdoor scene
Image is combined with virtual image, and virtual image can provide the big virtual display curtain of indication range or virtual for user
Mouse-keyboard, and virtual image can be with the screen of the entity in reality, and mouse, keyboard, touch screen, the cooperations such as button make
With with larger field range, and with privacy.
Description of the drawings
One or more embodiments are illustrated by the picture in corresponding attached drawing, these exemplary theorys
The bright restriction not constituted to embodiment, the element with same reference numbers label is expressed as similar element in attached drawing, removes
Non- to have special statement, composition does not limit the figure in attached drawing.
Fig. 1 a are a kind of structural schematic diagrams for display equipment based on augmented reality that the embodiment of the present invention one provides；
Fig. 1 b are that the schematic diagram when wearing on frame is arranged in Clairvoyant type light-guide device shown in Fig. 1 a；
Fig. 1 c are the first relational graphs between the side view angle of display module shown in Fig. 1 a and display brightness；
Fig. 1 d are the second relational graphs between the side view angle of display module shown in Fig. 1 a and display brightness；
Fig. 1 e are the third relational graphs between the side view angle of display module shown in Fig. 1 a and display brightness；
The position of display module and user face when Fig. 2 a are the display equipment based on augmented reality shown in wearing Fig. 1 a
Relation schematic diagram；
Fig. 2 b are the schematic diagrames for rotating display module shown in Fig. 1 a；
Fig. 3 is the image-forming principle schematic diagram of the display equipment based on augmented reality shown in Fig. 1 a；
Schematic diagram when Fig. 4 is the display equipment setting diopter correction eyeglass based on augmented reality shown in Fig. 1 a；
Fig. 5 is the distalmost end of display equipment diagonal line field of view and head frame based on augmented reality shown in Fig. 1 a
To the schematic diagram of the distance relation of user's head front end；
Schematic diagram when Fig. 6 is the display equipment connection external equipment work based on augmented reality shown in Fig. 1 a；
Fig. 7 is a kind of structural schematic diagram of display equipment based on augmented reality provided by Embodiment 2 of the present invention；
Fig. 8 is the schematic diagram when display equipment connection external equipment shown in Fig. 7 based on augmented reality works；
Fig. 9 is the another schematic diagram when display equipment connection external equipment shown in Fig. 7 based on augmented reality works；
Figure 10 is the schematic diagram when display equipment shown in Fig. 7 based on augmented reality works；
Figure 11 is the first display mould in a kind of display methods based on augmented reality that third embodiment of the invention provides
The schematic diagram of formula；
Figure 12 is the second display mould in a kind of display methods based on augmented reality that third embodiment of the invention provides
The schematic diagram of formula；
Figure 13 is a kind of the first application example of display methods based on augmented reality that third embodiment of the invention provides
Figure；
Figure 14 is that the second application in a kind of display methods based on augmented reality that third embodiment of the invention provides is real
The schematic diagram of example；
Figure 15 is that the third application in a kind of display methods based on augmented reality that third embodiment of the invention provides is real
The schematic diagram of example.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that described herein, specific examples are only used to explain the present invention, not
For limiting the present invention.
In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other not
Conflict is constituted to can be combined with each other.
Embodiment one
A refering to fig. 1, a kind of display equipment based on augmented reality provided in an embodiment of the present invention are described existing based on enhancing
The total weight of real display equipment is less than 350 grams comprising：Wear the Clairvoyant type leaded light of display module 12, two of frame 11, two
Element 13.Wherein, Clairvoyant type light-guide device 13 be a kind of fractional transmission, part reflection optics synthesizer.
The display module 12 and perspective figures light-guide device 13 are all arranged on wearing frame 11, and holder 11 is by display module
12 and perspective figures light-guide device 13 be fixed.Display module 12 is arranged in the upside of perspective figures light-guide device 13, display module
12 light sent out can reflect after perspective figures light-guide device 13.Optionally, the display module 13 may be additionally located at
The side of the Clairvoyant type light-guide device 13.
The display equipment based on augmented reality further includes：Mainboard 17, mainboard 17 is arranged on wearing frame 11, and position
Between two display modules 12.Processor is provided on the mainboard 17, the processor is for handling virtual image signal simultaneously
By virtual image presentation of information on display module 12.
In the embodiment of the present invention, head of the frame 11 for being worn on user is worn, each Clairvoyant type light-guide device 13 has
There are a concave surface, the eyes of concave surface towards user to be arranged.Via a Clairvoyant type light-guide device 13 concave reflection the first light into
The left eye of access customer, and via another Clairvoyant type light-guide device 13 concave reflection another first light into the right side of access customer
Eye, to form the vision of 3D virtual scenes in the brains of user.Wherein, the first light is emitted by display module 12, and
First light includes the virtual image information of left eye and right eye.
B refering to fig. 1, two Clairvoyant type light-guide devices 13 are arranged on wearing frame 11, are separately embedded into and wear
On frame 11.Optionally, two areas for corresponding to user's right and left eyes can be set on the raw material for making Clairvoyant type light-guide device
Domain, the shape size in the region are identical as the above-mentioned shape size of each Clairvoyant type light-guide device 13 when being independently arranged；
There are two the regions for corresponding to user's right and left eyes for setting on the Clairvoyant type light-guide device that final effect is one piece big.It is appreciated that
To process two and the Clairvoyant type light-guide device 13 when being independently arranged on the raw material of one piece big of Clairvoyant type light-guide device
The identical region of shape size, i.e. two Clairvoyant type light-guide devices 13 are integrally formed.It is described to be provided with corresponding to user or so
The Clairvoyant type light-guide device in Vitrea eye domain, which is embedded into, to be worn on frame 11.
It should be noted that display module 12 is removably mounted to wear on frame 11, for example, display module be mobile phone,
The intelligent display terminals such as tablet computer；Worn on frame alternatively, display module is fixedly installed in, for example, display module with wear
Frame Integrated design.
Two display modules 12 can be installed by wearing on frame 11, the left eye and right eye of user are respectively correspondingly arranged one
Display module 12 a, for example, display module 12, for emitting the first light for including left eye virtual image information, another is aobvious
Show module 12 for emitting another first light for including right eye virtual image information.Two display modules 12 can respectively one by one
It is correspondingly located at the top of two Clairvoyant type light-guide devices 13, when the display equipment based on augmented reality is worn on the head of user
When, two display modules 12 are located at the top of the left eye and right eye of user correspondingly respectively；Display module 12 can also position
In the side of Clairvoyant type light-guide device, i.e., two Clairvoyant type light-guide devices are located between two display modules, when existing based on enhancing
When real display equipment is worn on the head of user, two display modules are located at the left eye and right eye of user correspondingly respectively
Side.
Single display module 12 can also be installed by wearing on frame 11, there are two viewing areas on the single display module 12
Domain, a display area is for emitting the first light for including left eye virtual image information, another display area is for emitting
Include another first light of right eye virtual image information.
Display module includes but not limited to LCD (Liquid Crystal Display, liquid crystal display), OLED
(Organic Light-Emitting Diode, Organic Light Emitting Diode), LCOS (Liquid Crystal On Silicon,
Liquid crystal on silicon) etc. types display.
C refering to fig. 1, the lateral shaft in figure identify side view angle, and longitudinal axis indicates display brightness.Display module 12 is LCD
When, the brightness of display module 12 is changed with the angle of observer.For common LCD, when display brightness is 50%
Side viewing angle θ it is generally all bigger.
When LCD is applied to for augmented reality display system, then small side viewing angle, such display are relatively specific for
The brightness of module 12 is just concentrated in the angular regions close to center.Because augmented reality display system is mainly used close to center
Angular regions, in this case project to the first light in user's eye and the brightness of the second light can be relatively high.D refering to fig. 1,
Brightness applied to the first light sent out of the LCD in augmented reality display system and the second light is when display brightness is 50%
Side viewing angle θ it is generally all smaller.Also, applied to the first light sent out of the LCD in augmented reality display system and
The distribution of the brightness of second light is symmetrical about 0 degree of side view angle, and side view angle is less than 60 degree.It is that user perspective hangs down
Directly when display module 12, the display brightness of the brightness of the first light and the second light that display module 12 is sent out is maximum, is used
When family visual angle is offset to both sides, display brightness is gradually reduced, when side view angle is less than 60 degree, display brightness 0.
Optionally, e refering to fig. 1, the first light sent out and the second light of the LCD applied to augmented reality display system
Luminance Distribution can be not in relation to that 0 degree of side view angle is symmetrical, and side view angle when display brightness is most bright is not 0 degree.
Refering to Fig. 2 a, two display modules 12 are located at the top of two Clairvoyant type light-guide devices 13 correspondingly respectively,
In user's wearing when the display equipment based on augmented reality, display module 12 and the horizontal frontal plane shape of user's head have angle
The angle of a, the angle a are 0 degree to 180 degree, preferably obtuse angle.Meanwhile the projection of display module 12 in the horizontal plane with just
Plane is vertical.
Refering to Fig. 2 b, in some instances, the position of perspective figures light-guide device 13 can be around a certain with horizontal plane
Shaft rotates by a certain angle b, and the angle of the angle b is 0 degree to 180 degree, preferably 0 degree to 90 degree.Meanwhile corresponding left eye and
The Clairvoyant type light-guide device 13 of right eye can adjust spacing by wearing the mechanical structure on frame 11, to adapt to different user
Interpupillary distance, comfort level and image quality when ensureing to use.Most long distance between the edge of described two Clairvoyant type light-guide devices 13
It is saturating to being arranged corresponding to right eye from the left hand edge for less than 150 millimeters, that is, corresponding to the Clairvoyant type light-guide device 13 of left eye setting
Distance depending on the right hand edge of type light-guide device 13 is less than 150 millimeters.Correspondingly, being connected by mechanical structure between display module 12
It connects, the distance between described display module 12 can also be adjusted, or by adjusting display content on display module 12
Position reach same effect.
The frame structure that frame 11 can be the spectacle for hanging over user ear and nose bridge is worn, is provided with
Nose support 111 and temple 112, the head of user is fixed on by nose support 111 and temple 112, and the temple 112 is foldable knot
Structure, wherein nose support 111 correspondence are fixed on the bridge of the nose of user, and the correspondence of temple 112 is fixed on the ear of user.Further,
It can also be connected by elastic band between leg of spectacles 112, elastic band tightens leg of spectacles when wearing, helps frame consolidating on head
It is fixed.
Optionally, nose support 111 and temple 112 are telescopic mechanism, can adjust separately the height and temple 112 of nose support 111
Collapsing length.Equally, nose support 111 and temple 112 can also be detachable structure, can be to nose support 111 or temple after dismounting
112 are replaced.
Optionally, it wears frame 11 and may include nose support and stretching elastic ring, be fixed on by nose support and stretching elastic ring and use account
Portion；Or user's head is only fixed on by the stretching elastic ring including stretching elastic ring.Optionally, wearing frame 11 can also
It is the helmet-type frame structure for being worn on the user crown and nose bridge.In the embodiment of the present invention, due to wearing frame 11
Main function is head for being worn on user and for light, electrical components such as display module 12, Clairvoyant type light-guide devices 13
Support is provided, it includes but not limited to aforesaid way to wear frame, under the premise of having above-mentioned main function, people in the art
Member can make several deformations according to the needs of practical application to wearing frame.
Refering to Fig. 3, display module 12 emits the first light 121 for including left eye virtual image information, via a Clairvoyant type
Left eye 14 of the first light 121 that the concave surface 131 of light-guide device 13 is reflected into access customer；Similarly, display module transmitting includes the right side
Eye virtual image information another first light, via another Clairvoyant type light-guide device concave reflection another first light into
The right eye of access customer, to form the visual experience of 3D virtual scenes in the brain of user, in addition, different from Google glass
In such a way that one piece of small display screen is directly set before the right eye in user, cause visual zone smaller, the embodiment of the present invention
In, the first light that more display module transmittings are reflected by two Clairvoyant type light-guide devices respectively enters the eyes of user,
Visual zone is larger.
In embodiments of the present invention, when the display equipment based on augmented reality realizes the function of augmented reality, each perspective
The convex surface that type light-guide device 13 is also disposed opposite to each other with one with concave surface；It is transmitted via the convex surface of Clairvoyant type light-guide device 13 and concave surface
The second light comprising external image information into the eyes of access customer, regarded with forming mixing 3D virtual scenes and real scene
Feel.Referring again to Fig. 1 a, a Clairvoyant type light-guide device 13 also has the convex surface 132 being disposed opposite to each other with concave surface 131, via Clairvoyant type
Left eye of the second light 151 comprising external image information that the convex surface 132 of light-guide device 13 and concave surface 131 transmit into access customer
14, similarly, another Clairvoyant type light-guide device also has the convex surface being disposed opposite to each other with its concave surface, via the Clairvoyant type light-guide device
The second light comprising external image information of convex surface and concave surface transmission is into the right eye of access customer, and user is it can be seen that extraneous is true
Real field scape, to form the visual experience of mixing 3D virtual scenes and real scene.
Refering to Fig. 4, optionally, a diopter correction eyeglass 16, institute are set between human eye and Clairvoyant type light-guide device 13
Diopter correction eyeglass 16 is stated perpendicular to horizontal plane to be arranged.Optionally, plane where the diopter correction eyeglass also can be with water
Plane is at 30 degree to 90 degree of angle.Optionally, the diopter correction eyeglass of the different number of degrees can be arbitrarily set.Display module 12 is sent out
The first light 121 for including left eye virtual image information is penetrated, the first light reflected via the concave surface 131 of Clairvoyant type light-guide device 13
Line 121 and the second light for including external image information transmitted via the convex surface 132 of Clairvoyant type light-guide device 13 and concave surface 131
Line 151 first passes through correction of refractive errors eyeglass 16 into before the left eye 14 of access customer.The correction of refractive errors eyeglass 16 is concavees lens, is made
By thereon the first light 121 and the second light 151 diverging, make the first light 121 and the second light 151 in left eye 14
On retrofocus.Equally, the correction of refractive errors eyeglass 16 can also be convex lens, make by thereon the first light 121 and
Second light 151 converges, and makes the focus Forward of the first light 121 and the second light 151 on left eye 14.
Similarly, display module transmitting includes another first light of right eye virtual image information, is led via another Clairvoyant type
Another first light of the concave reflection of optical element and via what the convex surface of the Clairvoyant type light-guide device and concave surface transmitted include
Second light of external image information also first passes through a diopter correction eyeglass into before the right eye of access customer.
Refering to Fig. 5, after the display equipment based on augmented reality is worn in user's head, using the eyeball of user as vertex,
Both sides of the edge structure of the eyeball of user to the virtual display area for the virtual image seen by the Clairvoyant type light-guide device 13
Diagonally linear field region.The distalmost end of head frame can be adjusted as needed to being c at a distance from the contact position of head front end
Save the distance length of the c.The angular dimension of the diagonal line field of view and the distalmost end of the head frame 11 to head
The distance of portion front end contact position is inversely proportional.Preferably, under the premise of ensureing that diagonal line field of view is more than 55 degree, head
The distalmost end of frame at a distance from the contact position of head front end be less than 80mm.
Refering to Fig. 6, two display modules 12 pass through in cable connection to mainboard 17.
Video interface, power interface, communication chip and memory are additionally provided on mainboard 17.
The video interface receives vision signal for connecting computer, mobile phone or other equipment.The wherein described video connects
Mouthful can be：Hmdi, display port, thunderbolt or usb type-c, micro usb, MHL (Mobile High-
Definition Link) etc. interfaces.
The processor, for handling data, wherein being mainly used for decoding video signal transmission and being shown in display module
On 12.
The power interface is used for external power supply or battery powered.The power interface includes USB interface or other connect
Mouthful.
The communication chip, for carrying out data interaction with extraneous by communication protocol, specifically by WiFi, WDMA,
The communication protocols such as TD-LTE connect internet, then obtain data by internet or set with other displays based on augmented reality
Standby connection；Or directly it is connected with other display equipment based on augmented reality by communication protocol.
The memory is mainly used for storing the display data shown in display module 12 for storing data.
Earplug interface, sound card chip or other generating means can be also set on mainboard 17.Earplug interface is used for engaging lug
Plug transmits audio signal to earplug.Sound card chip is for parsing voice signal.Display equipment based on augmented reality wears frame
Loud speaker can also be set on frame 11, and the voice signal that sound card chip parses, which is converted into sound, to be sent out.
When the display equipment based on augmented reality only includes wearing frame 11, two display module 12, two as described above
When Clairvoyant type light-guide device 13 and mainboard 17, all 3D virtual scenes render, the image of corresponding eyes generate with based on
It is carried out in the connected external equipment of the display equipment of augmented reality.The external equipment includes：Computer, mobile phone, tablet computer
Deng.
Specifically, the display equipment based on augmented reality receives the vision signal of external equipment, decoding by video interface
It is shown on display module 12 afterwards.Meanwhile passing through on the external equipments such as computer, mobile phone, tablet computer with the interaction of user
Application software carries out, can by using mouse-keyboard, touch tablet or the button on external equipment with described based on augmented reality
Display equipment interacts.
The application example of this basic structure includes but not limited to large screen portable display.Display based on augmented reality
Display screen can be incident upon a certain fixed position in the user visual field by equipment.User need by with based on augmented reality
Software in the connected equipment of display equipment is adjusted the operations such as the size of projection screen, position.
A kind of display equipment based on augmented reality provided in an embodiment of the present invention passes through two Clairvoyant type light-guide devices
The first light comprising left eye virtual image information and right eye virtual image information is more reflected into use by concave surface respectively
The eyes at family, to form the visual experience of 3D virtual scenes in the brain of user, visual zone is larger.
Embodiment two
Refering to Fig. 7, on the basis of a kind of display equipment based on augmented reality provided in embodiment one, setting is multiple
Sensor perceived to surrounding enviroment.
A kind of display equipment based on augmented reality provided in this embodiment, the display equipment based on augmented reality
Total weight is less than 350 grams comprising：Wear frame 21, two display modules, 22, two Clairvoyant type light-guide devices 23 and mainboard 24.
The display module 22, perspective figures light-guide device 23 and mainboard 24 are all arranged on wearing frame 21, wear frame
21 display module 22, perspective figures light-guide device 23 and mainboard 24 are fixed.The setting of display module 22 is in the guide-lighting member of perspective figures
The upside of part 23, the light that display module 22 is sent out can reflect after perspective figures light-guide device 23.Mainboard 24, mainboard
24 between two display modules 22, processor are provided on the mainboard 24, the processor is for handling virtual image letter
Number and by virtual image presentation of information on display module 22.
It wears described in frame 21, two display modules, 22, two Clairvoyant type light-guide devices 23, mainboard 24 and embodiment one
Wear frame 11, two display modules, 12, two Clairvoyant type light-guide devices 13, the concrete function of mainboard 17, structure and position relationship
It is identical, herein without repeating.
Equally, a diopter correction eyeglass, the diopter correction are set between human eye and Clairvoyant type light-guide device 23
Eyeglass is arranged perpendicular to horizontal plane.Optionally, the diopter correction eyeglass of the different number of degrees can be arbitrarily set.
Monocular cam 211, binocular/more mesh camera 212, eyeball tracking camera are additionally provided on head frame 21
213, gyroscope 214, accelerometer 215, magnetometer 216, depth of field sensor 217, ambient light sensor 218 and/or apart from biography
Sensor 219.
Monocular cam 211, binocular/more mesh camera 212, eyeball tracking camera 213, gyroscope 214, accelerometer
215, magnetometer 216, depth of field sensor 217, ambient light sensor 218 and/or range sensor 219 are all connected electrically in mainboard 24
On.
Specifically, the monocular cam 211 is colored monocular cam, is positioned over the front of head frame 21.User
When wearing the display equipment based on augmented reality, monocular cam 211, can be with towards the other side relative to user face
It is taken pictures using the camera.Further, environment can also be detected with computer vision technique to using the camera
In the known label in position, help the display equipment based on augmented reality to be positioned.
The monocular cam 211 can also be high-resolution camera, for taking pictures or shooting video；Shooting institute
The video of acquisition can also be superimposed dummy object seen in user by software, and reproduction user passes through the display based on augmented reality
The content that equipment is seen.
The binocular/more mesh camera 212 can be monochromatic or colour camera, and 21 front of frame is being worn in setting
Or side, and positioned at side, both sides or the surrounding of monocular cam 211.Further, the binocular/more mesh camera 212
Infrared fileter can be carried.Using binocular camera, can further be obtained on image on the basis of obtaining ambient image
Depth of view information.Using more mesh cameras, then the visual angle of camera can be further expanded, obtain more ambient images and the depth of field
Information.The ambient image and range information that double/more mesh cameras 212 capture can be used for:(1) with gyroscope 214, accelerometer
215, the data of magnetometer 216 blend, and calculate the posture of the display equipment based on augmented reality.(2) user gesture, the palm are captured
Line etc. is used for human-computer interaction.
Optionally, each mesh in above-mentioned monocular cam or binocular/more mesh camera can be RGB cameras, list
One kind in color camera or infrared camera.
The eyeball tracking camera 213 is arranged in the side of Clairvoyant type light-guide device 23, and user wears described based on increasing
When the display equipment of strong reality, eyeball tracking camera 213 is towards the side relative to user face.The eyeball tracking camera shooting
First 213 for tracking human eye focus, the privileged site in the virtual article or virtual screen watched attentively to human eye be tracked and
Specially treated.For example, showing the specifying information etc. of this object automatically beside the object that human eye is watched attentively.In addition human eye is watched attentively
Region can show high-definition virtual article image, and other regions are then only shown with low definition image, this
Sample can effectively reduce the calculation amount of image rendering, without influencing user experience.
Gyroscope 214, accelerometer 215, magnetometer 216 are arranged between two display modules 22.It can be by merging top
The data of spiral shell instrument 214, accelerometer 215 and magnetometer 216 obtain relative attitude between user's head and system initial position.This
The data that the initial data of sensors can be further with binocular/more mesh camera 212 a bit are merged, and are obtained existing based on enhancing
Position and posture of the real display equipment in fixed environment.
The depth of field sensor 217 is arranged in the front for wearing frame 21, can directly obtain the depth of view information in environment.
Compared with double/more mesh cameras 212, depth of field sensor can obtain more acurrate, the higher depth of field data of resolution ratio.Similar,
It can be with using these data：(1) data with gyroscope 214, accelerometer 215, magnetometer 216 blend, and calculate based on increasing
The posture of the display equipment of strong reality.(2) use and the human-computer interactions such as user gesture, palmmprint are captured.(3) user's surrounding objects are detected
Three-dimensional information.
The ambient light sensor 218 is arranged on wearing frame 21, can monitor the power of ambient light in real time.It is based on
The display equipment of augmented reality adjusts the brightness of display module 22 according to the variation of ambient light in real time, to ensure that display effect exists
Consistency under varying environment light.
The range sensor 219 is arranged in the position that the display equipment based on augmented reality is contacted with user's face, uses
Whether it is worn on user's head in display equipment of the detection based on augmented reality.If user has taken the display based on augmented reality
Equipment can then be economized on electricity by closing the modes such as display module 22, processor.
Optionally, the display equipment based on augmented reality further includes：Infrared/near infrared light LED is described infrared/close
Infrared light LED is connected electrically on mainboard 24, and the infrared/near infrared light LED is used to provide light for binocular/more mesh camera 212
Source.Specifically, infrared/the near-infrared LED sends out infrared ray, reaches in infrared ray and obtained by binocular/more mesh camera 212
Object when, the object goes back infrared reflection, and the reception of photosensitive element on binocular/more mesh camera 212 reflects
Infrared ray and be converted into electric signal, then carry out imaging.
For the display equipment based on augmented reality when carrying out human-computer interaction, the operation that can be carried out includes as follows：
(1) display screen can be incident upon a certain fixed bit in the user visual field by the display equipment based on augmented reality
It sets.User can be adjusted the behaviour such as the size of projection screen, position by the sensor in the display equipment based on augmented reality
Make.
(2) gesture, personal recognition can be carried out by various kinds of sensors, is used for human-computer interaction.
(3) intention that user can be judged by eyeball tracking, in virtual article observed by human eye or virtual screen
Privileged site carries out respective handling.
(4) entity or touch button, rocking bar etc. can also be increased on holder, be used for human-computer interaction.
(5) can be furnished with remote controler, have button, rocking bar, Trackpad etc. on remote controler, by wired or wireless mode with
Display equipment based on augmented reality is connected, as human-computer interaction interface.
(6) earphone jack, earplug or loudspeaker can be integrated by increasing audio decoder and power amplifier chip on mainboard
Etc. occurrence of equipment and microphone, allow user interacted using voice and the display equipment based on augmented reality.
Refering to Fig. 8, video interface and processor are provided on mainboard.
When the display equipment based on augmented reality includes wearing frame 21, two display module 22, two as described above thoroughly
When depending on type light-guide device 23, mainboard 24 and multiple sensors as described above, all 3D virtual scenes render, correspond to eyes
Image generate and the processing of data that multiple sensors obtain can be connected with the display equipment based on augmented reality
It is carried out in external equipment.The external equipment includes：Computer, mobile phone, tablet computer etc..
Specifically, the display equipment based on augmented reality receives the vision signal of external equipment, decoding by video interface
It is shown on display module 23 afterwards.External equipment receives the number that multiple sensors in the display equipment based on augmented reality obtain
According to being adjusted to the image that eyes are shown according to data after being handled, carried out on the image shown on display module 23
It embodies.Processor in display equipment based on augmented reality is only used for supporting the transmission of vision signal and display and sensor
The transmission of data.
Refering to Fig. 9, it is provided with the stronger processor of operational capability on mainboard, part or all of computer vision algorithms make is existed
It is completed in display equipment based on augmented reality.
Specifically, the display equipment based on augmented reality receives the vision signal of external equipment, decoding by video interface
It is shown on display module 23 afterwards.External equipment receives the number that the operative sensor in the display equipment based on augmented reality obtains
According to being adjusted to the image that eyes are shown according to sensing data after being handled, the image shown on display module 23
On embodied.The data that remaining sensor obtains then are handled in the display equipment based on augmented reality.For example, monocular images
First 211, binocular/more mesh camera 212, gyroscope 214, accelerometer 215, magnetometer 216 and depth of field sensor 217 obtain
Data are handled in the display equipment based on augmented reality.Eyeball tracking camera 213, ambient light sensor 218 and apart from biography
The data that sensor 219 obtains are handled in external equipment.Processor in display equipment based on augmented reality is regarded for supporting
The transmission of frequency signal and display, the processing of operative sensor data and the transmission of remaining sensing data.
Refering to fig. 10, high performance processor and image processor are provided on mainboard, aobvious based on augmented reality
Show and completes all operations in equipment.In such a mode, augmented reality is shown without connecting external equipment, can be used as one solely
Vertical system operation.
Specifically, after the display equipment based on augmented reality is handled the data that sensor obtains, eyes are shown
Image be adjusted, shown on display module 23 after rendering.Processor in display equipment based on augmented reality is used for
The decoding process of vision signal and display and the processing of sensing data.
The display equipment based on augmented reality described in embodiment one and embodiment two realizes the reality of augmented reality
In, the reflectivity for the first light that the concave surface in order to increase Clairvoyant type light-guide device emits display module, for example, perspective
The concave surface of type light-guide device is coated with reflectance coating, preferably, being coated with the reflectivity of the concave surface of the Clairvoyant type light-guide device of reflectance coating is
20%-80%.For another example, if the first light is linearly polarized light, in order to increase Clairvoyant type light-guide device concave surface reflectivity, perspective
The concave surface of type light-guide device is coated with reflection of polarization film, between the polarization direction of reflection of polarization film and the polarization direction of the first light
Angle is more than 70 ° and less than or equal to 90 °, such as：The polarization direction of reflection of polarization film is vertical with the polarization direction of the first light, real
Almost it is now 100% reflectivity, in addition, since the second light comprising external image information is non-polarized light, if Clairvoyant type
The concave surface of light-guide device is coated with reflection of polarization film, when the second light is via the reflection of polarization film, there is intimate 50% the second light
For line into the eyes of access customer, user remains able to see extraneous real scene.In order to preferably allow comprising external image information
The second light into the eyes of access customer, the convex surface of Clairvoyant type light-guide device is coated with anti-reflection film.
In the practical application of the display equipment based on augmented reality described in embodiment one and embodiment two, for reality
The controllable adjustment of the reflectivity for the first light that the concave surface of existing Clairvoyant type light-guide device emits display module, the guide-lighting member of Clairvoyant type
The concave surface of part is equipped with pressure-sensitive reflectance coating, by changing voltage swing of the load on pressure-sensitive reflectance coating, can adjust pressure-sensitive reflection
The reflectivity of film is between 0 to 100%, and when the reflectivity of pressure-sensitive reflectance coating is 100%, the display based on augmented reality is set
The standby function that virtual reality may be implemented.
In order to realize another surface of Clairvoyant type light-guide device being disposed opposite to each other with concave surface to comprising external image information
The controllable adjustment of the light transmittance of second light, another surface of Clairvoyant type light-guide device being disposed opposite to each other with concave surface is equipped with pressure-sensitive
Black-film can adjust the height of pressure-sensitive black-film light transmittance by changing voltage swing of the load on pressure-sensitive black-film.
A kind of display equipment based on augmented reality provided in an embodiment of the present invention passes through two Clairvoyant type light-guide devices
The first light comprising left eye virtual image information and comprising right eye virtual image information is more reflected by concave surface respectively
The eyes of user, to form the visual experience of 3D virtual scenes in the brain of user, visual zone is larger.Simultaneously based on
Multiple sensors are set in the display equipment of augmented reality, it, can be by the result of perception aobvious after sensor perceives the environment on periphery
Show in the image shown in module and embodied so that telepresenc is by more preferable, and user experience is more preferably.
Embodiment three
The present embodiment provides a kind of display methods based on augmented reality, including：
The first light for including virtual image is sent out, the virtual image is the figure that the external equipment received transmits
Picture；
Obtain the second light of the real scene image comprising outer scene；
Second light of first light comprising virtual image and the real scene image comprising outer scene is closed
At.
The real scene image of the outer scene of the acquisition includes：Wear the user institute of the display equipment based on augmented reality
Locate the real scene image of environment.Exemplary, user is in classroom, then the real scene image of the acquisition includes：Teach indoor
The image that the objects such as life, desk and chair, schooling apparatus show after light reflects；If user is in office,
The real scene image of the acquisition includes：The figure that the objects such as desk, computer, keyboard, mouse show after light reflects
Picture.
The acquisition virtual image includes：Obtain the virtual graph that display module 12 is shown after processor is handled
Picture.The virtual image is the virtual graph for the display data that the equipment being connect with the display equipment based on augmented reality transmits
Picture, the virtual image include：Virtual display, virtual mouse, dummy keyboard etc..The virtual display is external for showing
The data of data, the network data or the storage of local storage the inside that are obtained by internet that equipment transmits.
The first light that two display modules 12 send out the display data comprising virtual image is saturating in conjunction with the process of acquisition
Depending on the second light for including outer scene image information of type light-guide device 13, two kinds of light pass through the display based on augmented reality
It merges in eyes of user after the synthesis of Clairvoyant type light-guide device 13 in equipment, is handled by the human brain of user, can be incited somebody to action
The content of the display data of virtual image is presented on user at the moment in the form of three-dimensional.It can be understood as described based on enhancing
The display data of virtual image is incident upon in the real scene image in the user visual field by the display equipment of reality.
Include the when being shown after the real scene image of the outer scene got is synthesized with the virtual image
One display pattern, the second display pattern or the third mode；First display pattern is between virtual image and real scene image
Relative angle and all unfixed display pattern of relative position；Second display pattern be virtual image and real scene image it
Between all fixed display pattern of relative angle and relative position.The third mode is between virtual image and real scene image
Relative angle is fixed, the unfixed display pattern of relative position.Specifically, refering to fig. 11, user's face table piece, based on enhancing
The display equipment of reality projects one piece of virtual screen and a dummy keyboard, face user, the desktop being placed in real space
On.After the head of user is mobile or rotation, the position of the virtual screen and keyboard of projection before user does not occur
Change, and their positions in real space can and then rotate or mobile, change.This display pattern is known as " first
Display pattern ".Processor is by the second light of the real scene image comprising outer scene and the first light comprising virtual image
Line is shown after being synthesized with the first display pattern.
The display equipment based on augmented reality described in embodiment two in application, monocular cam 211 can be passed through
Detect with computer vision technique and marked known to the position in environment, help the display equipment based on augmented reality into
Row positioning obtains the depth of view information in environment by depth of field sensor 217.Alternatively, the display equipment based on augmented reality may be used also
With by using binocular/more mesh camera 212, on the basis of obtaining ambient image, on the image that is further obtained
Depth of view information.Then, the display equipment based on augmented reality is by by monocular cam 211, depth of field sensor 217 or double
The data that mesh/more mesh camera 212 obtains are handled, and processor carries out 3D to ambient enviroment using computer vision technique and builds
Mould identifies different objects in true environment and determines their positions and posture in space in real time.In this way, being based on augmented reality
Display equipment can analyze obtain user nearby have which space can preferably project virtual screen, dummy keyboard and its
He shows content.In addition, the display equipment based on augmented reality can also pass through gyroscope 214, accelerometer 215, magnetometer
The image that 216 data combination monocular cam 211, depth of field sensor 217 or binocular/the more mesh cameras 212 obtained obtain
And depth of field data, calculate position and posture of the display equipment based on augmented reality in real space, i.e. coordinate system FHWith FI's
Relative position and angular relationship T.Due to the virtual image projected in the display equipment based on augmented reality, as virtual display,
Dummy keyboard etc., in coordinate system FHIn position and posture it is known that by T can obtain projection digital content in real space
(FI) in position and angle.Opposite, if wishing, projecting content appears in real space (FI) some position and angle, then
Projection content can be calculated in the display device coordinate system F based on augmented reality by relationship THIn position and posture, will be empty
The projection content such as quasi- screen is positioned over this.
In this way, the display equipment based on augmented reality may be implemented " the second display pattern ".Refering to fig. 12, user's face
Table piece, the display equipment based on augmented reality project one piece of virtual screen and a dummy keyboard, face user, are placed on true
On desktop in space.After the head of user is mobile or rotation, if using the second display pattern, the dummy keyboard of projection
It does not change with position of the screen in real space, allowing user to generate screen and keyboard is necessary being and is placed on table
Illusion on face.
Display equipment based on augmented reality use gyroscope, accelerometer and magnetometer, obtain user's head with it is residing
" third display pattern " may be implemented under this display pattern in relative angle between environment, dummy object between environment
Relative angle is fixed, but relative position can move.
For example, user's face table piece, the display equipment based on augmented reality projects one piece of virtual screen and one virtual
Keyboard, face user are placed on the desktop in real space.After the head of user is mobile or rotation, if using the
Three display patterns, the relative angle of the dummy keyboard and screen of projection in real space do not change, and are moved in user
When, the relative position of the dummy keyboard and screen of projection in real space changes, and is followed by user and moves.
In conclusion the first display pattern, the second display pattern and third display pattern and true environment and use
Relationship between person head is as shown in the table：
| With environment relative position | With environment relative angle | With head relative position | With head relative angle | |
| First display pattern | It is not fixed | It is not fixed | It is fixed | It is fixed |
| Second display pattern | It is fixed | It is fixed | It is not fixed | It is not fixed |
| Third display pattern | It is not fixed | It is fixed | It is fixed | It is not fixed |
It should be noted that " the first display pattern ", " the second display pattern " or " third display pattern " can be directed to not
Same virtual image is used in mixed way, and can be determined by user can also to be independently arranged by system software.
" first display pattern ", " the second display pattern " or " the third mode " passes through the two dimension that is arranged in real scene image
Code or other aid marks manually set are realized.
Specifically, it scans and knows by monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
The Quick Response Code not being arranged in real scene image, the Quick Response Code include to open the first display pattern, open the second display pattern
Information or the information for opening third display pattern.After the information in identifying Quick Response Code, corresponded to the information of the Quick Response Code
Display pattern shown.Such as, it is to open the information of the first display pattern to scan the information in Quick Response Code, then aobvious with first
Show that pattern is shown；Information in the Quick Response Code for another example scanned is to open the second display pattern or third display pattern
Information is then shown with the second display pattern or the third mode.
Similarly, it can scan and know by monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
The handmarking not being arranged in real scene image, the handmarking include to open the first display pattern or open second to show
The information of pattern.Such as, identify that the information in handmarking is to open the information of the first display pattern, then with the first display pattern
It is shown；Information in the handmarking for another example identified is to open the information of the second display pattern the third mode, then with the
Two display patterns or the third mode are shown.
The handmarking on two dimensional surface being arranged in Quick Response Code or other real scene images can be also used for auxiliary with second
The display equipment based on augmented reality when display pattern is shown is positioned：According to monocular cam 211, depth of field sensor
The shape and size of the 217 either Quick Response Codes or handmarking of binocular/more mesh camera 212 takes, with the Quick Response Code or
Actual size of the person handmarking on two dimensional surface is compared with shape, extrapolates the opposite position between label and camera
It sets and angle.Due to marking position in the environment to fix, then can thus calculate display equipment based on augmented reality with
The relative position and angular relationship T of environment, to realize the second display pattern.
Further, virtual image can be manipulated.Display equipment based on augmented reality can pass through monocular cam
211, depth of field sensor 217 or binocular/more mesh camera 212 track the movement of the gesture of user, analyze the intention of user,
Realization operates the content virtually shown.
It is exemplary, it is tracked by using monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
The position of the finger of user executes the corresponding operational order of finger click action after recognizing the click action of finger.
It is exemplary, it is identified by using monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
To the grasping movement of the gesture of user, drag operation is carried out to the object in virtual screen entirety or virtual screen.
It is exemplary, it is identified by using monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
To the gesture motion zoomed in or out, then the corresponding instruction of the gesture motion zoomed in or out is executed, to virtual screen or void
Object in quasi- screen zooms in and out.
Specifically, refering to fig. 13, user wears the display equipment based on augmented reality described in embodiment one or two, will
Display equipment based on augmented reality is connected to laptop, and laptop is by cable transmission vision signal to based on increasing
The display equipment of strong reality.The cable can also be used for data, the transmission of audio signal and power for head is aobvious.Cable can be
Single (such as USB Type-C) can also be a plurality of (video, audio and data use different cables).It is aobvious based on augmented reality
Show that equipment obtains the vision signal transmitted by laptop, then in the display module of the display equipment based on augmented reality
It is shown on 12.Virtual image includes：One or a few blocks virtual display and the display content showed on a display screen, institute
It is the content that laptop transmits to state display content.Two display modules 12 send out the light for including above-mentioned virtual image
In conjunction with the light of the real scene image information comprising outer scene by Clairvoyant type light-guide device 13 of acquisition, two kinds of light warps
It merges, passes through in eyes of user after the synthesis for the Clairvoyant type light-guide device 13 crossed on the information processing equipment based on augmented reality
The content of virtual image can be presented on user at the moment by human brain processing in the form of three-dimensional.It can be understood as the base
The content shown in virtual display and virtual display user is incident upon in the information processing equipment of augmented reality to regard
In the real scene image of outer scene in open country.As the outer scene in the user visual field real scene image in have the mouse button of entity
The mouse-keyboard of entity can be connected laptop and used, allowed user's input information in a manner of most familiar of, improve by disk
Working efficiency.
Refering to fig. 14, user wears the display equipment based on augmented reality described in embodiment one or two, will be based on increasing
The display equipment of strong reality is connected to mobile phone or other mobile terminals, and mobile phone or other mobile terminals are believed by cable transmission video
Number to the display equipment based on augmented reality.The cable can also be used for data, the transmission of audio signal and power for head is aobvious.
Cable can be that single (such as USB Type-C) can also be a plurality of (video, audio and data use different cables).Based on increasing
The display equipment of strong reality obtains the vision signal of the virtual image by mobile phone or the transmission of other mobile terminals, then based on
It is shown on the display module 12 of the display equipment of augmented reality.Virtual image includes：One or a few blocks virtual display with
And the display content showed on a display screen, the display content are the content that mobile phone or other mobile terminals transmit.Two
A display module 12 sends out the light comprising above-mentioned virtual image
The light of the real scene image information of outer scene, two kinds of light are by the Clairvoyant type on the information processing equipment based on augmented reality
It merges in eyes of user after the synthesis of light-guide device 13, is handled by human brain, it can be by the content of virtual image with three-dimensional
Form is presented on user at the moment.Can be understood as it is described based on the information processing equipment of augmented reality by virtual display with
And the content shown in virtual display is incident upon in the real scene image of the outer scene in the user visual field.Portable mouse and key
Disk is connected by bluetooth or other communication modes with mobile phone or other mobile terminals.The outdoor scene of outer scene in the user visual field
There is the mouse-keyboard of entity in image, that is, the user for wearing the display equipment based on augmented reality can see the mouse of entity
And keyboard, it allows user's input information in a manner of most familiar of, improves work efficiency.
Optionally, refering to fig. 15, user wears the display equipment based on augmented reality described in embodiment one or two, will
Display equipment based on augmented reality is connected to mobile phone or other mobile terminals, and mobile phone or other mobile terminals pass through cable transmission
The vision signal extremely display equipment based on augmented reality.Display equipment based on augmented reality is obtained through mobile phone or other movements
The vision signal of the virtual image of terminal transmission, is then shown on the display module 12 of the display equipment based on augmented reality
Show.Virtual image includes：One or a few blocks virtual display, the display content showed on a display screen and virtual mouse button
Disk etc..It can track user's by using monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
The position of finger executes the corresponding operation of finger click action after recognizing the action for clicking mouse or keyboard of finger
The operational order of key realizes the input of information.
Optionally, when the display screen of above-mentioned projection such as shows multiple display screens, the arrangement side of multiple display screens can be adjusted
Formula.The hand of user can be tracked by using monocular cam 211, depth of field sensor 217 or binocular/more mesh camera 212
The position of finger executes the corresponding operation key of finger moving display screen after the action for the moving display screen for recognizing finger
Operational order realizes the movement to display screen.
When the content of the display equipment projection based on augmented reality is the content with sound, external earplug can be passed through
It is made a sound, or is made a sound by loud speaker.
Optionally, the focus that the eyes of user can be also tracked by eyeball tracking camera 213, to user's eyes coke
Privileged site in point watched attentively virtual article or virtual screen is tracked and specially treated, for example, in user's eyes
Concentrate the regional area of observation, the specifying information etc. of automatic display annotation and observed object.
Be different from the prior art, present embodiment provide it is a kind of based on the display methods of augmented reality by external outdoor scene
Image is combined with virtual image, and virtual image can provide the big virtual display curtain of indication range or virtual for user
Mouse-keyboard, and virtual image can be with the screen of the entity in reality, and mouse, keyboard, touch screen, the cooperations such as button make
With with larger field range, and with privacy.
Mode the above is only the implementation of the present invention is not intended to limit the scope of the invention, every to utilize this
Equivalent structure or equivalent flow shift made by description of the invention and accompanying drawing content, it is relevant to be applied directly or indirectly in other
Technical field is included within the scope of the present invention.
Claims (14)
1. a kind of display methods based on augmented reality, which is characterized in that including：
The first light for including virtual image is sent out, the virtual image is the image that the external equipment received transmits；
Obtain the second light of the real scene image comprising outer scene；
Second light of first light comprising virtual image and the real scene image comprising outer scene is synthesized.
2. according to the method described in claim 1, it is characterized in that, the real scene image of the acquisition is user's local environment
Real scene image；The virtual image includes：Virtual display screen, virtual mouse or dummy keyboard.
3. method according to claim 1 or 2, which is characterized in that close the virtual image of acquisition and the real scene image
Include the first display pattern, the second display pattern or the third mode after；First display pattern is virtual image and outdoor scene
The all unfixed display pattern of relative angle and relative position between image；Second display pattern be virtual image with
The all fixed display pattern of relative angle and relative position between real scene image；The third mode is virtual image and reality
Relative angle between scape image is fixed, the unfixed display pattern of relative position.
4. according to the method described in claim 3, it is characterized in that, first display pattern, the second display pattern or third
Display pattern is realized by the Quick Response Code being arranged in real scene image or other aid marks manually set.
5. method according to claim 1 or 2, which is characterized in that the method further includes：The movement of gesture is tracked, it is right
Virtual image is operated.
6. method according to claim 1 or 2, which is characterized in that the method further includes：Eyes of user is watched attentively
The privileged site of virtual image is tracked and particular procedure.
7. a kind of display equipment based on augmented reality, including：
Display module, for showing virtual image and sending out the first light comprising virtual image, the virtual image is to receive
The image that transmits of external equipment；
Clairvoyant type light-guide device, the second light for obtaining the real scene image comprising outer scene；
Clairvoyant type light-guide device is additionally operable to by first light comprising virtual image and comprising the real scene image of outer scene
The second light synthesized.
8. equipment according to claim 7, which is characterized in that the real scene image that Clairvoyant type light-guide device obtains is user
The real scene image of local environment；The virtual image of display module reality includes：Virtual display screen, virtual mouse or virtual
Keyboard.
9. equipment according to claim 7 or 8, which is characterized in that the equipment further includes processor, gyroscope, acceleration
Meter, magnetometer, monocular cam, depth of field sensor or binocular/more mesh camera are spent, the processor for including by described in
First light of virtual image and the second light of the real scene image comprising outer scene synthesized after with the first display pattern
It is shown；Either processor combination gyroscope, accelerometer, magnetometer, monocular cam, depth of field sensor or binocular/
It is shown with the second display pattern after the data of more mesh cameras；Or processor combination gyroscope, accelerometer or magnetic field
After the data of meter, shown with third display pattern；First display pattern is between virtual image and real scene image
Relative angle and all unfixed display pattern of relative position；Second display pattern be virtual image and real scene image it
Between all fixed display pattern of relative angle and relative position；The third mode is between virtual image and real scene image
Relative angle is fixed, the unfixed display pattern of relative position.
10. equipment according to claim 9, which is characterized in that first display pattern, the second display pattern or third
Display pattern is realized by the Quick Response Code being arranged in real scene image or other aid marks manually set.
11. equipment according to claim 9, which is characterized in that in the monocular cam or binocular/more mesh camera
Each mesh can be one kind in RGB cameras, monochromatic camera or infrared camera.
12. equipment according to claim 7 or 8, which is characterized in that the monocular cam, depth of field sensor or double
Mesh/more mesh camera is additionally operable to the movement of tracking gesture, and identifies gesture motion.
13. equipment according to claim 7 or 8, which is characterized in that the equipment further includes eyeball tracking camera, is used
It is tracked and particular procedure in the privileged site for the virtual image watched attentively to eyes of user.
14. equipment according to claim 7 or 8, which is characterized in that the display equipment based on augmented reality with it is external
When equipment is connected, can by using on external equipment mouse-keyboard, touch tablet or button with it is described aobvious based on augmented reality
Show that equipment interacts.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710079199.5A CN108427194A (en) | 2017-02-14 | 2017-02-14 | A kind of display methods and equipment based on augmented reality |
| PCT/CN2018/073473 WO2018149267A1 (en) | 2017-02-14 | 2018-01-19 | Display method and device based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710079199.5A CN108427194A (en) | 2017-02-14 | 2017-02-14 | A kind of display methods and equipment based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108427194A true CN108427194A (en) | 2018-08-21 |
Family
ID=63155134
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710079199.5A Pending CN108427194A (en) | 2017-02-14 | 2017-02-14 | A kind of display methods and equipment based on augmented reality |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108427194A (en) |
| WO (1) | WO2018149267A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110174939A (en) * | 2019-04-19 | 2019-08-27 | 深圳远为文化有限公司 | Reality system is merged in panoramic scanning |
| CN110362231A (en) * | 2019-07-12 | 2019-10-22 | 腾讯科技（深圳）有限公司 | The method and device that new line touch control device, image are shown |
| CN111664742A (en) * | 2020-06-08 | 2020-09-15 | 中国人民解放军陆军特种作战学院 | Intelligent target system based on air imaging |
| CN111664741A (en) * | 2020-06-08 | 2020-09-15 | 中国人民解放军陆军特种作战学院 | Interaction method of intelligent target system for shooting training |
| CN111736692A (en) * | 2020-06-01 | 2020-10-02 | Oppo广东移动通信有限公司 | Display method, display device, storage medium, and head-mounted device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104407700A (en) * | 2014-11-27 | 2015-03-11 | 曦煌科技(北京)有限公司 | Mobile head-wearing type virtual reality and augmented reality device |
| CN104603865A (en) * | 2012-05-16 | 2015-05-06 | 丹尼尔·格瑞贝格 | A system worn by a user on the move for substantially augmented reality by anchoring virtual objects |
| CN105283825A (en) * | 2013-05-22 | 2016-01-27 | 微软技术许可有限责任公司 | Body-locked placement of augmented reality objects |
| CN105446580A (en) * | 2014-08-13 | 2016-03-30 | 联想(北京)有限公司 | Control method and portable electronic equipment |
| CN105607730A (en) * | 2014-11-03 | 2016-05-25 | 航天信息股份有限公司 | Eyeball tracking based enhanced display method and apparatus |
| CN105809144A (en) * | 2016-03-24 | 2016-07-27 | 重庆邮电大学 | Gesture recognition system and method adopting action segmentation |
| CN105866955A (en) * | 2016-06-16 | 2016-08-17 | 深圳市世尊科技有限公司 | Smart glasses |
| WO2016169221A1 (en) * | 2015-04-20 | 2016-10-27 | 我先有限公司 | Virtual reality device and operating mode |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8760499B2 (en) * | 2011-04-29 | 2014-06-24 | Austin Russell | Three-dimensional imager and projection device |
| CN103019377A (en) * | 2012-12-04 | 2013-04-03 | 天津大学 | Head-mounted visual display equipment-based input method and device |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
| CN105892631A (en) * | 2015-11-16 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Method and device for simplifying operation of virtual reality application |
| CN105955453A (en) * | 2016-04-15 | 2016-09-21 | 北京小鸟看看科技有限公司 | Information input method in 3D immersion environment |
-
2017
- 2017-02-14 CN CN201710079199.5A patent/CN108427194A/en active Pending
-
2018
- 2018-01-19 WO PCT/CN2018/073473 patent/WO2018149267A1/en not_active Ceased
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104603865A (en) * | 2012-05-16 | 2015-05-06 | 丹尼尔·格瑞贝格 | A system worn by a user on the move for substantially augmented reality by anchoring virtual objects |
| CN105283825A (en) * | 2013-05-22 | 2016-01-27 | 微软技术许可有限责任公司 | Body-locked placement of augmented reality objects |
| CN105446580A (en) * | 2014-08-13 | 2016-03-30 | 联想(北京)有限公司 | Control method and portable electronic equipment |
| CN105607730A (en) * | 2014-11-03 | 2016-05-25 | 航天信息股份有限公司 | Eyeball tracking based enhanced display method and apparatus |
| CN104407700A (en) * | 2014-11-27 | 2015-03-11 | 曦煌科技(北京)有限公司 | Mobile head-wearing type virtual reality and augmented reality device |
| WO2016169221A1 (en) * | 2015-04-20 | 2016-10-27 | 我先有限公司 | Virtual reality device and operating mode |
| CN105809144A (en) * | 2016-03-24 | 2016-07-27 | 重庆邮电大学 | Gesture recognition system and method adopting action segmentation |
| CN105866955A (en) * | 2016-06-16 | 2016-08-17 | 深圳市世尊科技有限公司 | Smart glasses |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110174939A (en) * | 2019-04-19 | 2019-08-27 | 深圳远为文化有限公司 | Reality system is merged in panoramic scanning |
| CN110362231A (en) * | 2019-07-12 | 2019-10-22 | 腾讯科技（深圳）有限公司 | The method and device that new line touch control device, image are shown |
| CN110362231B (en) * | 2019-07-12 | 2022-05-20 | 腾讯科技（深圳）有限公司 | Head-up touch device, image display method and device |
| CN111736692A (en) * | 2020-06-01 | 2020-10-02 | Oppo广东移动通信有限公司 | Display method, display device, storage medium, and head-mounted device |
| CN111736692B (en) * | 2020-06-01 | 2023-01-31 | Oppo广东移动通信有限公司 | Display method, display device, storage medium and head-mounted device |
| CN111664742A (en) * | 2020-06-08 | 2020-09-15 | 中国人民解放军陆军特种作战学院 | Intelligent target system based on air imaging |
| CN111664741A (en) * | 2020-06-08 | 2020-09-15 | 中国人民解放军陆军特种作战学院 | Interaction method of intelligent target system for shooting training |
| CN111664742B (en) * | 2020-06-08 | 2023-01-06 | 中国人民解放军陆军特种作战学院 | Intelligent target system based on air imaging |
| CN111664741B (en) * | 2020-06-08 | 2023-01-06 | 中国人民解放军陆军特种作战学院 | Interaction method of intelligent target system for shooting training |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018149267A1 (en) | 2018-08-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10701346B2 (en) | Replacing 2D images with 3D images | |
| CN206497255U (en) | Augmented reality shows system | |
| US10019831B2 (en) | Integrating real world conditions into virtual imagery | |
| US20230418370A1 (en) | Head-mounted vr all-in-one machine | |
| US10691934B2 (en) | Real-time visual feedback for user positioning with respect to a camera and a display | |
| US8976086B2 (en) | Apparatus and method for a bioptic real time video system | |
| JP6177872B2 (en) | Input/output device, input/output program, and input/output method | |
| TWI486631B (en) | Head mounted display and control method thereof | |
| JP6250024B2 (en) | Calibration apparatus, calibration program, and calibration method | |
| CN108428375A (en) | A kind of teaching auxiliary and equipment based on augmented reality | |
| WO2014128773A1 (en) | Gesture registration device, gesture registration program, and gesture registration method | |
| WO2009094643A2 (en) | Systems using eye mounted displays | |
| CA2875261C (en) | Apparatus and method for a bioptic real time video system | |
| CN108427193A (en) | Augmented reality display system | |
| CN108427194A (en) | A kind of display methods and equipment based on augmented reality | |
| CN103150013A (en) | Mobile terminal | |
| CN108446011A (en) | A kind of medical householder method and equipment based on augmented reality | |
| WO2014128750A1 (en) | Input/output device, input/output program, and input/output method | |
| WO2018149266A1 (en) | Information processing method and device based on augmented reality | |
| CN104865704A (en) | Transmission-type and non-transmission-type switchable headwear equipment based on mobile equipment | |
| US10701347B2 (en) | Identifying replacement 3D images for 2D images via ranking criteria | |
| CN107111143B (en) | Vision system and film viewer | |
| WO2016101861A1 (en) | Head-worn display device | |
| US10771774B1 (en) | Display apparatus and method of producing images having spatially-variable angular resolutions | |
| TW201518994A (en) | Viewing angle adjusting method, apparatus and system of liquid crystal display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20191223 Address after: Room a-b102-1229, 198 Qidi Road, Xiaoshan Economic and Technological Development Zone, Xiaoshan District, Hangzhou City, Zhejiang Province Applicant after: Hangzhou rongmeng Intelligent Technology Co., Ltd Address before: 518000 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation zone before Bay Road No. 1 building 201 room A (located in Shenzhen Qianhai business secretary Co. Ltd.) Applicant before: Shenzhen Dream Vision Intelligent Technology Co., Ltd. |
|
| TA01 | Transfer of patent application right | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180821 |
|
| RJ01 | Rejection of invention patent application after publication |