CN107908002A - Enhancing and the device and method of mixed reality - Google Patents
Enhancing and the device and method of mixed reality Download PDFInfo
- Publication number
- CN107908002A CN107908002A CN201711276703.7A CN201711276703A CN107908002A CN 107908002 A CN107908002 A CN 107908002A CN 201711276703 A CN201711276703 A CN 201711276703A CN 107908002 A CN107908002 A CN 107908002A
- Authority
- CN
- China
- Prior art keywords
- microprocessor
- micro display
- display screen
- micro
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 230000002708 enhancing effect Effects 0.000 title claims description 37
- 210000001508 eye Anatomy 0.000 claims abstract description 44
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 35
- 230000003287 optical effect Effects 0.000 claims abstract description 26
- 238000004458 analytical method Methods 0.000 claims description 27
- 230000000875 corresponding effect Effects 0.000 claims description 6
- 230000001276 controlling effect Effects 0.000 claims description 4
- 210000003128 head Anatomy 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 5
- 230000003313 weakening effect Effects 0.000 abstract description 4
- 230000003190 augmentative effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000009738 saturating Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
Abstract
The present invention relates to a kind of device and method strengthened with mixed reality, including rack, object lens, micro display device and eyepiece, microprocessor and micro display screen, divide display, semi-transparent semi-reflecting display, transparent display, the device and method can realize interacting for user and surrounding environment, it is not only no-delay, and the effect weakening during optical propagation can be overcome using the low component of simple in structure, cost, display of high resolution images, in addition, object lens equipped with negative focal length compensate eyepiece so that the real outdoor scene seen is clear indeformable or deformation is minimum；Equipped with gesture receiving control device, it can use gesture and be controlled, it is convenient and efficient；, can be to the eyeball of user into line trace equipped with eye tracking device, the direction movement for being watched attentively picture user oriented, user experience is more preferable；Small, light-weight, cost is low, and real outdoor scene is not required to shoot by camera, processor overlap-add procedure, does not deposit picture delay Caton phenomenon.
Description
Technical field
The present invention relates to enhancing and mixed reality field, more particularly to a kind of device and method strengthened with mixed reality.
Background technology
Augmented reality (Augmented Reality, abbreviation AR), is the new skill to grow up on the basis of virtual reality
Art, is also referred to as mixed reality (Mixed Reality, abbreviation MR).It is that reality is carried out to real scene using dummy object
The technology of enhancing.Augmented reality is based on the actual physical situation for imaging first-class sampler and collecting, by by text, two dimension
The information labeling that image, 3-dimensional image model etc. virtually generate is on the object in the actual physical situation shown by display screen,
Annotation, explanation or enhancing so as to fulfill the real physical environment being in user, some effects for emphasizing actual environment.
The experience that augmented reality is blended to a kind of virtual objects of user and actual environment, it can effectively help user cognition all
Collarette border, increases the information of surrounding environment, realizes interacting for user and surrounding environment.
Existing augmented reality equipment mainly has two kinds of video perspective type and optical perspective formula, and video perspective type utilizes camera
After external environment is filmed, then user is shown to together with virtual environment image co-registration, the problem of this form is maximum
It is the presence of delay；Optical perspective formula is shown to user after the information of virtual environment and actual environment is synthesized using combined lens, uses
Family overcomes video perspective type and there is the problem of delay by combined lens direct viewing external environment, optical perspective formula, current
Technology is to project to virtual environment in the user visual field by combined lens, prism or waveguide piece etc. to be imaged, and can not be overcome
Effect weakening during optical propagation, is not suitable for display of high resolution images, and complicated, of high cost.
The content of the invention
It is an object of the invention to overcome disadvantages described above, there is provided a kind of device and method strengthened with mixed reality, the dress
Put and method can make one to arrive the superposition of virtual image and reality scene soon, realize interacting for user and surrounding environment, not only without
It is delayed, and the effect weakening during optical propagation, display of high resolution can be overcome using the low component of simple in structure, cost
Image, in addition, the object lens equipped with negative focal length compensate eyepiece so that the real outdoor scene seen is clear indeformable or deformation
It is minimum.
What the present invention was realized in：
Scheme (one)：
A kind of device strengthened with mixed reality, it is characterised in that：The device include rack and one group of arrangement above in
Enhancing and mixed reality optical element in rack, every group of enhancing and mixed reality optical element include along light incident direction according to
The secondary object lens being arranged on optical axis, micro display device and eyepiece, the object lens are negative focal length lens, and the eyepiece is saturating for positive focal length
Mirror, the distance between the eyepiece and micro display device are less than the focal length of eyepiece；The micro display device include microprocessor and
Micro display screen, the microprocessor are connected with micro display screen, described micro- for controlling the virtual image on micro display screen to show
Display screen is can the alternately switching between two states are presented in only display microprocessor output image and fully transparent no image
Time-division display, or for that display microprocessor output image but also through micro display screen can see semi-transparent the half of front outdoor scene
Anti- display, or for can display microprocessor output image but also display image portion point does not see front through micro display screen
The transparent display of outdoor scene, or for can display microprocessor output image but also through micro display screen not display image portion point
The transparent display of front outdoor scene is seen with display image portion point.
The present invention has also further done following improvement：The distance of the object lens and micro display device is 0-5mm.
The micro display device further includes data-interface and earphone；The data-interface is connected with microprocessor, is used for
Receive outside sound, image and lteral data and send microprocessor to；The earphone is connected with microprocessor, for broadcasting
Put the voice data that microprocessor is sent；The micro display device further includes rechargeable battery and charging interface or described micro-
Display device further includes power interface；The rechargeable battery is connected with microprocessor, micro display screen and earphone respectively, for
Microprocessor, micro display screen and earphone power supply；The charging interface is connected with rechargeable battery, for connecting external power supply and being
Rechargeable battery charges；The power interface is connected with microprocessor, micro display screen and earphone respectively, for being connected outside
Portion's power supply is powered microprocessor, micro display screen and earphone.
It is controlled in order to use gesture, the device of the enhancing and mixed reality further includes what is be connected with microprocessor
Gesture receiving control device, the gesture receiving control device include：Camera is caught, rack front end is arranged at, for catching
The hand signal of user；Signal analysis device, is connected with catching camera and microprocessor respectively, and shooting is caught for obtaining
The user gesture signal that head captures, microprocessor is sent to after analyzing hand signal；Microprocessor is according to signal point
The signal control micro display screen that analysis apparatus transmits performs corresponding action.
In order to which to the eyeball of user, into line trace, the direction movement for being watched attentively picture user oriented is described to strengthen and mix
The device for closing reality further includes the eye tracking device being connected with microprocessor, and the eye tracking device includes：Eyeball with
Track camera, is arranged in rack and is located at eyeball front end, direction of gaze and eyeball for catching eyeball are look at direction
Residence time information；Analyze judgment means, be connected respectively with eye tracking camera and microprocessor, for obtain eyeball with
Information that track camera captures simultaneously judges residence time of the eyeball in the direction of gaze, when in the direction of gaze
Residence time when not reaching preset time, analysis judgment means do not export signal, when the residence time in the direction of gaze
When reaching preset time, analysis judgment means output signal to microprocessor, and microprocessor controls micro display after receiving signal
Display picture on screen is moved to the direction of gaze.
Preferably, the micro display screen is transparent LCD screen or transparent OLED micro displays screen.
Preferably, the object lens and eyepiece for sphere simple lens or aspherical simple lens or lens group or Fresnel lens or
One kind in microlens array or fly's-eye lens.
Preferably, the rack is spectacle frame, and the quantity of the enhancing and mixed reality optical element for two groups and sets up separately
In the both sides of spectacle frame.
Scheme (two)：
A kind of method strengthened with mixed reality, it is characterised in that：This method comprises the following steps：
1. more than one group of enhancing and mixed reality optical element are arranged in rack, every group of enhancing and mixed reality light
Object lens, micro display device and eyepiece that element includes being set in turn in along light incident direction on optical axis are learned, the object lens are negative
Focal length lenses, the eyepiece are positive focal length lens；The distance between eyepiece and micro display device are arranged on to the focal length model of eyepiece
In enclosing；
2. the micro display device includes microprocessor and micro display screen, microprocessor is connected to control with micro display screen
Following four dispaly state of the virtual image processed on micro display screen：
A. the micro display screen for can display microprocessor output image but also through micro display screen see in front of outdoor scene
Semi-transparent semi-reflecting display, make one to arrive the superposition of virtual image and real scene image soon；
B. the micro display screen is that two kinds of shapes can be presented in only display microprocessor output image and fully transparent no image
The time-division display alternately switched between state, makes human eye that virtual image and outdoor scene be respectively seen in very short time slot, due to
The delay of human eye sense organ, such human eye just see the superposition of seemingly virtual image and outdoor scene；
C. the micro display screen is transparent display, and the part of display microprocessor output image is in the micro display screen
Opaque, micro display screen remainder is transparent, through transparent part it is seen that outdoor scene, makes one to arrive virtual graph soon
The superposition of picture and real scene image；
D. the micro display screen is transparent display, and the part of display microprocessor output image is in the micro display screen
Translucent, micro display screen remainder is transparent, through not display image portion point and display image portion point it is seen that
Outdoor scene, makes one to arrive the superposition of virtual image and real scene image soon.
It is controlled in order to use gesture, the microprocessor is also associated with gesture receiving control device, and the gesture connects
Receiving control device includes：Camera is caught, rack front end is arranged at, for catching the hand signal of user；Signal analysis device,
It is connected respectively with catching camera and microprocessor, for obtaining the user gesture signal for catching camera and capturing, opponent
Gesture signal sends microprocessor to after being analyzed；The signal control that microprocessor is transmitted according to signal analysis device is micro- aobvious
Display screen performs corresponding action.
In order into line trace, move the direction that picture user oriented is watched attentively, the microprocessor on the eyeball of user
Eye tracking device is also associated with, the eye tracking device includes：Eye tracking camera, is arranged in rack and is located at eye
Ball front end, direction of gaze and eyeball for catching eyeball are look at the residence time information in direction；Judgment means are analyzed, respectively
It is connected with eye tracking camera and microprocessor, for obtaining information that eye tracking camera captures and existing to eyeball
The residence time of the direction of gaze is judged, when not reaching preset time in the residence time of the direction of gaze, point
Analysis judgment means do not export signal, and when reaching preset time in the residence time of the direction of gaze, analysis judgment means are defeated
Go out signal to microprocessor, microprocessor controls the display picture on micro display screen to be moved to the direction of gaze after receiving signal
It is dynamic.
For the prior art, the present invention has the following advantages：
(1) device and method of enhancing provided by the invention and mixed reality, the device and method can make one to arrive void soon
Intend the superposition of image and reality scene, realize interacting for user and surrounding environment, it is not only no-delay, but also using it is simple in structure,
The low component of cost can overcome the effect weakening during optical propagation, display of high resolution images, in addition, equipped with negative focal length
Object lens compensate eyepiece so that the real outdoor scene seen is clear indeformable or deformation is minimum；
(2) device and method of enhancing provided by the invention and mixed reality, it is close in micro display screen using micro display screen
Eyes side stacks or equipped with eyepiece, and stacks in the opposite side of micro display screen or can be seen equipped with object lens, human eye by eyepiece
To closely micro display screen by eyepiece produce amplification the virtual image, and pass through micro- significant screen close to outdoor scene side negative lens just
Influence of the eyepiece to eye-observation outdoor scene can be optically offset again, and the micro display screen can be can display microprocessor
Output image can pass through the semi-transparent semi-reflecting display that micro display screen sees front outdoor scene again, make one to arrive virtual image and outdoor scene soon
The superposition of image；The micro display screen can be presented two in only display microprocessor output image and fully transparent no image
The time-division display alternately switched between kind state, makes human eye that virtual image and outdoor scene be respectively seen in very short time slot,
Due to the delay of human eye sense organ, such human eye just sees the superposition of seemingly virtual image and outdoor scene；The micro display screen can be with
Transparent display, the part of display microprocessor output image is opaque in the micro display screen, micro display screen remaining
Part is transparent, through transparent part it is seen that outdoor scene, makes one to arrive the superposition of virtual image and real scene image soon；Institute
It can be transparent display to state micro display screen, and the part of display microprocessor output image is translucent in the micro display screen
, micro display screen remainder is transparent, through not display image portion point and display image portion point it is seen that outdoor scene, makes
Human eye sees the superposition of virtual image and real scene image；
(3) device and method of enhancing provided by the invention and mixed reality, equipped with gesture receiving control device, can use hand
Gesture is controlled, convenient and efficient；
(4) device and method of enhancing provided by the invention and mixed reality, can be to user's equipped with eye tracking device
Eyeball is into line trace, the direction movement for being watched attentively picture user oriented, and user experience is more preferable；
(5) device and method of enhancing provided by the invention and mixed reality, small, light-weight, cost is low, and reality is real
Scape is not required to shoot by camera, processor overlap-add procedure, does not deposit picture delay Caton phenomenon.
Brief description of the drawings
The invention will be further described in conjunction with the embodiments with reference to the accompanying drawings：
Fig. 1 is the structure diagram of the device of present invention enhancing and mixed reality；
Fig. 2 is the functional block diagram of the device and method of present invention enhancing and mixed reality.
Symbol description in figure：1st, rack, 2, object lens, 3, micro display device, 31, microprocessor, 32, micro display screen, 33, number
According to interface, 34, rechargeable battery, 35, earphone, 36, charging interface, 4, eyepiece, 5, gesture receiving control device, 51, catch shooting
Head, 52, signal analysis device, 6, eye tracking device, 61, eye tracking camera, 62, analysis judgment means.
Embodiment
Present invention is described in detail with reference to Figure of description and specific embodiment：
Embodiment (one)：
As shown in Figs. 1-2, it is a kind of device strengthened with mixed reality provided by the invention, it is characterised in that：The device
Including rack 1 and one group of arrangement above in the enhancing in rack 1 and mixed reality optical element, every group of enhancing and mixed reality
Optical element includes object lens 2, micro display device 3 and the eyepiece 4 being set in turn in along light incident direction on optical axis, the object lens
2 be negative focal length lens, and the eyepiece 4 is that the distance between positive focal length lens, the eyepiece 4 and micro display device 3 are less than eyepiece 4
Focal length；The micro display device 3 includes microprocessor 31 and micro display screen 32, the microprocessor 31 and 32 phase of micro display screen
Connection, for controlling the virtual image on micro display screen 32 to show, the micro display screen 32 is can be in only display microprocessor 31
The time-division display alternately switched between two states is presented in output image and fully transparent no image, or micro- for that can show
31 output image of processor can pass through the semi-transparent semi-reflecting display that micro display screen 32 sees front outdoor scene again, or for that can show
31 output image of microprocessor can pass through micro display screen 32 again, and display image portion does not divide the transparent display for seeing front outdoor scene, or
Person is can 31 output image of display microprocessor but also through micro display screen 32 not display image portion point and display image portion point
See the transparent display of front outdoor scene.
The present invention has also further done following improvement：The distance of the object lens 2 and micro display device 3 is 0-5mm.
The micro display device 3 further includes data-interface 33 and earphone 35；The data-interface 33 and 31 phase of microprocessor
Connection, for receiving sound, image and the lteral data of outside and sending microprocessor 31 to；The earphone 35 and microprocessor
31 are connected, the voice data sent for playing microprocessor 31；The micro display device 3 further includes rechargeable battery 34
Power interface is further included with charging interface 36 or the micro display device 3；The rechargeable battery 34 respectively with microprocessor 31,
Micro display screen 32 is connected with earphone 35, for powering to microprocessor 31, micro display screen 32 and earphone 35；The charging interface
36 are connected with rechargeable battery 34, for connecting external power supply and charging for rechargeable battery 34；The power interface difference
It is connected with microprocessor 31, micro display screen 32 and earphone 35, for being connected external power supply to microprocessor 31, micro display screen
32 and earphone 35 be powered.
It is controlled in order to use gesture, the device of the enhancing and mixed reality is further included to be connected with microprocessor 31
Gesture receiving control device 5, the gesture receiving control device 5 includes：Camera 51 is caught, is arranged at 1 front end of rack, is used
In the hand signal for catching user；Signal analysis device 52, is connected with catching camera 51 and microprocessor 31, is used for respectively
Obtain and catch the user gesture signal that camera 51 captures, send microprocessor 31 after analyzing hand signal to；It is micro-
The signal control micro display screen 32 that processor 31 is transmitted according to signal analysis device 52 performs corresponding action.
In order to which to the eyeball of user, into line trace, the direction movement for being watched attentively picture user oriented is described to strengthen and mix
The device for closing reality further includes the eye tracking device 6 being connected with microprocessor 31, and the eye tracking device 6 includes：Eye
Ball tracks camera 61, is arranged in rack 1 and is located at eyeball front end, direction of gaze and eyeball for catching eyeball are look at
The residence time information in direction；Judgment means 62 are analyzed, are connected respectively with eye tracking camera 61 and microprocessor 31, are used
In obtaining the information that captures of eye tracking camera 61 and residence time of the eyeball in the direction of gaze judged, when
When the residence time of the direction of gaze not reaching preset time, analysis judgment means 62 do not export signal, when in the note
When the residence time of apparent direction reaches preset time, analysis judgment means 62 output signal to microprocessor 31, microprocessor 31
The display picture on micro display screen 32 is controlled to be moved to the direction of gaze after receiving signal.
Preferably, the micro display screen 32 is transparent LCD screen or transparent OLED micro displays screen.
Preferably, the object lens 2 and eyepiece 4 are sphere simple lens or aspherical simple lens or lens group or Fresnel lens
Or one kind in microlens array or fly's-eye lens.
Preferably, the rack 1 is spectacle frame, and the quantity of the enhancing and mixed reality optical element for two groups and sets up separately
In the both sides of spectacle frame.
Embodiment (two)：
A kind of method strengthened with mixed reality, it is characterised in that：This method comprises the following steps：
1. more than one group of enhancing and mixed reality optical element are arranged in rack 1, every group of enhancing and mixed reality
Optical element includes object lens 2, micro display device 3 and the eyepiece 4 being set in turn in along light incident direction on optical axis, the object lens
2 be negative focal length lens, and the eyepiece 4 is positive focal length lens；The distance between eyepiece 4 and micro display device 3 are arranged on eyepiece 4
Focal range in；
2. the micro display device 3 includes microprocessor 31 and micro display screen 32, by microprocessor 31 and micro display screen 32
It is connected with the following four dispaly state for controlling virtual image on micro display screen 32：
A. the micro display screen 32 is can 31 output image of display microprocessor but also before seeing through micro display screen 32
The semi-transparent semi-reflecting display of Fang Shijing, makes one to arrive the superposition of virtual image and real scene image soon；
B. the micro display screen 32 is that can be presented two in only 31 output image of display microprocessor and fully transparent no image
The time-division display alternately switched between kind state, makes human eye that virtual image and outdoor scene be respectively seen in very short time slot,
Due to the delay of human eye sense organ, such human eye just sees the superposition of seemingly virtual image and outdoor scene；
C. the micro display screen 32 is transparent display, 31 output image of display microprocessor in the micro display screen 32
Part is opaque, and 32 remainder of micro display screen is transparent, through transparent part it is seen that outdoor scene, makes one soon
To the superposition of virtual image and real scene image；
D. the micro display screen 32 is transparent display, 31 output image of display microprocessor in the micro display screen 32
Part is translucent, and 32 remainder of micro display screen is transparent, through not display image portion point and display image portion point
It can be seen that outdoor scene, makes one to arrive the superposition of virtual image and real scene image soon.
It is controlled in order to use gesture, the microprocessor 31 is also associated with gesture receiving control device 5, the gesture
Receiving control device 5 includes：Camera 51 is caught, 1 front end of rack is arranged at, for catching the hand signal of user；Signal point
Analysis apparatus 52, is connected with catching camera 51 and microprocessor 31 respectively, for obtaining the use for catching camera 51 and capturing
Family hand signal, sends microprocessor 31 to after analyzing hand signal；Microprocessor 31 is according to signal analysis device 52
The signal control micro display screen 32 transmitted performs corresponding action.
In order into line trace, move the direction that picture user oriented is watched attentively, the microprocessor on the eyeball of user
31 are also associated with eye tracking device 6, and the eye tracking device 6 includes：Eye tracking camera 61, is arranged in rack 1
And it is located at eyeball front end, direction of gaze and eyeball for catching eyeball are look at the residence time information in direction；Analysis judges
Device 62, is connected with eye tracking camera 61 and microprocessor 31 respectively, is caught for obtaining eye tracking camera 61
To information and when in the residence time of the direction of gaze is not judged to residence time of the eyeball in the direction of gaze
When reaching preset time, analysis judgment means 62 do not export signal, when reaching default in the residence time of the direction of gaze
Between when, analysis judgment means 62 output signal to microprocessor 31, and microprocessor 31 controls micro display screen 32 after receiving signal
On display picture moved to the direction of gaze.
Above-mentioned embodiment is simply explained in detail technical scheme, the present invention not only only office
It is limited to above-described embodiment, every any improvement or replacement according to the principle of the invention should all be within protection scope of the present invention.
Claims (10)
- A kind of 1. device strengthened with mixed reality, it is characterised in that：The device include rack (1) and one group of arrangement above in Enhancing and mixed reality optical element in rack (1), every group of enhancing and mixed reality optical element are included along light incidence side To the object lens (2), micro display device (3) and eyepiece (4) being set in turn on optical axis, the object lens (2) are negative focal length lens, institute It is positive focal length lens to state eyepiece (4), and the distance between the eyepiece (4) and micro display device (3) are less than the focal length of eyepiece (4)； The micro display device (3) includes microprocessor (31) and micro display screen (32), the microprocessor (31) and micro display screen (32) it is connected, for controlling the virtual image on micro display screen (32) to show, the micro display screen (32) is only to show The time-division display alternately switched between two states is presented in microprocessor (31) output image and fully transparent no image, or For can display microprocessor (31) output image but also through micro display screen (32) see front outdoor scene semi-transparent semi-reflecting display Device, or for can display microprocessor (31) output image but also through micro display screen (32) before display image portion point is not seen The transparent display of Fang Shijing, or for that display microprocessor (31) output image but also can not shown through micro display screen (32) Show that image section and display image portion point see the transparent display of front outdoor scene.
- 2. enhancing according to claim 1 and the device of mixed reality, it is characterised in that：The object lens (2) and micro display The distance of device (3) is 0-5mm.
- 3. enhancing according to claim 1 and the device of mixed reality, it is characterised in that：The micro display device (3) is also Including data-interface (33) and earphone (35)；The data-interface (33) is connected with microprocessor (31), for receiving sound, image and the lteral data of outside simultaneously Send microprocessor (31) to；The earphone (35) is connected with microprocessor (31), the voice data sent for playing microprocessor (31)；The micro display device (3) further includes rechargeable battery (34) and charging interface (36) or the micro display device (3) also Including power interface；The rechargeable battery (34) is connected with microprocessor (31), micro display screen (32) and earphone (35) respectively, for micro- Processor (31), micro display screen (32) and earphone (35) power supply；The charging interface (36) is connected with rechargeable battery (34), for connecting external power supply and being carried out for rechargeable battery (34) Charging；The power interface is connected with microprocessor (31), micro display screen (32) and earphone (35) respectively, for being connected outside Portion's power supply is powered microprocessor (31), micro display screen (32) and earphone (35).
- 4. enhancing according to claim 1 and the device of mixed reality, it is characterised in that：The enhancing and mixed reality Device further includes the gesture receiving control device (5) being connected with microprocessor (31), gesture receiving control device (5) bag Include：Camera (51) is caught, rack (1) front end is arranged at, for catching the hand signal of user；Signal analysis device (52), is connected with catching camera (51) and microprocessor (31), is taken the photograph for obtaining seizure respectively As the user gesture signal that head (51) captures, microprocessor (31) is sent after analyzing hand signal to；Microprocessor (31) the signal control micro display screen (32) transmitted according to signal analysis device (52) performs corresponding action.
- 5. enhancing according to claim 1 and the device of mixed reality, it is characterised in that：The enhancing and mixed reality Device further includes the eye tracking device (6) being connected with microprocessor (31), and the eye tracking device (6) includes：Eye tracking camera (61), is arranged in rack (1) and is located at eyeball front end, for catch eyeball direction of gaze and Eyeball is look at the residence time information in direction；Judgment means (62) are analyzed, are connected respectively with eye tracking camera (61) and microprocessor (31), for obtaining eye Ball tracks the information that camera (61) captures and residence time of the eyeball in the direction of gaze is judged, when described When the residence time of direction of gaze does not reach preset time, analysis judgment means (62) do not export signal, when in the side of watching attentively To residence time reach preset time when, analysis judgment means (62) output signal to microprocessor (31), microprocessor (31) display picture on micro display screen (32) is controlled to be moved to the direction of gaze after receiving signal.
- 6. enhancing according to claim 1 and the device of mixed reality, it is characterised in that：The object lens (2) and eyepiece (4) For one kind in sphere simple lens or aspherical simple lens or lens group or Fresnel lens or microlens array or fly's-eye lens.
- 7. the device of the enhancing and mixed reality according to any one of claim 1-6, it is characterised in that：The rack (1) it is spectacle frame, the quantity of the enhancing and mixed reality optical element is two groups and is divided into the both sides of spectacle frame.
- A kind of 8. method strengthened with mixed reality, it is characterised in that：This method comprises the following steps：1. more than one group of enhancing and mixed reality optical element are arranged in rack (1), every group of enhancing and mixed reality light Object lens (2), micro display device (3) and eyepiece (4) that element includes being set in turn in along light incident direction on optical axis are learned, it is described Object lens (2) are negative focal length lens, and the eyepiece (4) is positive focal length lens；By between eyepiece (4) and micro display device (3) away from From being arranged in the focal range of eyepiece (4)；2. the micro display device (3) includes microprocessor (31) and micro display screen (32), by microprocessor (31) and micro display Screen (32) is connected to control following four dispaly state of the virtual image on micro display screen (32)：A. the micro display screen (32) is display microprocessor (31) output image but also can see through micro display screen (32) The semi-transparent semi-reflecting display of front outdoor scene, makes one to arrive the superposition of virtual image and real scene image soon；B. the micro display screen (32) is that can be presented two in only display microprocessor (31) output image and fully transparent no image The time-division display alternately switched between kind state, makes human eye that virtual image and outdoor scene be respectively seen in very short time slot, Due to the delay of human eye sense organ, such human eye just sees the superposition of seemingly virtual image and outdoor scene；C. the micro display screen (32) is transparent display, display microprocessor (31) output image in the micro display screen (32) Part be opaque, micro display screen (32) remainder is transparent, through transparent part it is seen that outdoor scene, makes one The superposition of virtual image and real scene image is arrived soon；D. the micro display screen (32) is transparent display, display microprocessor (31) output image in the micro display screen (32) Part be translucent, micro display screen (32) remainder is transparent, through not display image portion point and display image portion Divide it is seen that outdoor scene, makes one to arrive the superposition of virtual image and real scene image soon.
- 9. according to the method described in claim 8, it is characterized in that：The microprocessor (31) is also associated with gesture and receives control Device (5), the gesture receiving control device (5) include：Camera (51) is caught, rack (1) front end is arranged at, for catching the hand signal of user；Signal analysis device (52), is connected with catching camera (51) and microprocessor (31), is taken the photograph for obtaining seizure respectively As the user gesture signal that head (51) captures, microprocessor (31) is sent after analyzing hand signal to；Microprocessor (31) the signal control micro display screen (32) transmitted according to signal analysis device (52) performs corresponding action.
- 10. according to the method described in claim 8, it is characterized in that：The microprocessor (31) is also associated with eye tracking dress Put (6), the eye tracking device (6) includes：Eye tracking camera (61), is arranged in rack (1) and is located at eyeball front end, for catch eyeball direction of gaze and Eyeball is look at the residence time information in direction；Judgment means (62) are analyzed, are connected respectively with eye tracking camera (61) and microprocessor (31), for obtaining eye Ball tracks the information that camera (61) captures and residence time of the eyeball in the direction of gaze is judged, when described When the residence time of direction of gaze does not reach preset time, analysis judgment means (62) do not export signal, when in the side of watching attentively To residence time reach preset time when, analysis judgment means (62) output signal to microprocessor (31), microprocessor (31) direction of gaze movement described in the display picture controlled after signal on micro display screen (32) is received.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711276703.7A CN107908002A (en) | 2017-12-06 | 2017-12-06 | Enhancing and the device and method of mixed reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711276703.7A CN107908002A (en) | 2017-12-06 | 2017-12-06 | Enhancing and the device and method of mixed reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107908002A true CN107908002A (en) | 2018-04-13 |
Family
ID=61854631
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711276703.7A Pending CN107908002A (en) | 2017-12-06 | 2017-12-06 | Enhancing and the device and method of mixed reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107908002A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109239924A (en) * | 2018-06-30 | 2019-01-18 | 李迪朋 | A kind of augmented reality eyeglass device |
| CN110580672A (en) * | 2018-06-07 | 2019-12-17 | 刘丹 | Augmented reality thermal intelligent glasses, display method and computer storage medium |
| CN114167616A (en) * | 2021-12-13 | 2022-03-11 | 谷东科技有限公司 | See-through near-eye display optical system and head-mounted display device |
| WO2022133683A1 (en) * | 2020-12-21 | 2022-06-30 | 京东方科技集团股份有限公司 | Mixed reality display method, mixed reality device, and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8582209B1 (en) * | 2010-11-03 | 2013-11-12 | Google Inc. | Curved near-to-eye display |
| CN103852891A (en) * | 2012-12-03 | 2014-06-11 | 纬创资通股份有限公司 | Head-mounted display device |
| CN104898276A (en) * | 2014-12-26 | 2015-09-09 | 成都理想境界科技有限公司 | Head-mounted display device |
| CN105847540A (en) * | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Method and mobile phone for controlling picture movement of VR (Virtual Reality) glasses based on eyeball tracking and VR glasses |
| CN106199962A (en) * | 2014-09-04 | 2016-12-07 | 三星显示有限公司 | Head-mounted display apparatus |
| CN106324841A (en) * | 2016-11-24 | 2017-01-11 | 宁波视睿迪光电有限公司 | Augmented reality display device and augmented reality glasses |
| CN106526859A (en) * | 2016-12-14 | 2017-03-22 | 中国航空工业集团公司洛阳电光设备研究所 | VR and AR compatible head-wearing display equipment |
| CN207663149U (en) * | 2017-12-06 | 2018-07-27 | 黄心铭 | The device of enhancing and mixed reality |
-
2017
- 2017-12-06 CN CN201711276703.7A patent/CN107908002A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8582209B1 (en) * | 2010-11-03 | 2013-11-12 | Google Inc. | Curved near-to-eye display |
| CN103852891A (en) * | 2012-12-03 | 2014-06-11 | 纬创资通股份有限公司 | Head-mounted display device |
| CN106199962A (en) * | 2014-09-04 | 2016-12-07 | 三星显示有限公司 | Head-mounted display apparatus |
| CN104898276A (en) * | 2014-12-26 | 2015-09-09 | 成都理想境界科技有限公司 | Head-mounted display device |
| CN105847540A (en) * | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Method and mobile phone for controlling picture movement of VR (Virtual Reality) glasses based on eyeball tracking and VR glasses |
| CN106324841A (en) * | 2016-11-24 | 2017-01-11 | 宁波视睿迪光电有限公司 | Augmented reality display device and augmented reality glasses |
| CN106526859A (en) * | 2016-12-14 | 2017-03-22 | 中国航空工业集团公司洛阳电光设备研究所 | VR and AR compatible head-wearing display equipment |
| CN207663149U (en) * | 2017-12-06 | 2018-07-27 | 黄心铭 | The device of enhancing and mixed reality |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110580672A (en) * | 2018-06-07 | 2019-12-17 | 刘丹 | Augmented reality thermal intelligent glasses, display method and computer storage medium |
| CN109239924A (en) * | 2018-06-30 | 2019-01-18 | 李迪朋 | A kind of augmented reality eyeglass device |
| WO2020001043A1 (en) * | 2018-06-30 | 2020-01-02 | 李迪朋 | Augmented reality glasses device |
| WO2022133683A1 (en) * | 2020-12-21 | 2022-06-30 | 京东方科技集团股份有限公司 | Mixed reality display method, mixed reality device, and storage medium |
| CN114167616A (en) * | 2021-12-13 | 2022-03-11 | 谷东科技有限公司 | See-through near-eye display optical system and head-mounted display device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103513421B (en) | Image processor, image treatment method and image processing system | |
| US9948863B2 (en) | Self-timer preview image presentation method and apparatus, and terminal | |
| CN107908002A (en) | Enhancing and the device and method of mixed reality | |
| US20150358539A1 (en) | Mobile Virtual Reality Camera, Method, And System | |
| JP5483761B2 (en) | Video output device, stereoscopic video observation device, video presentation system, and video output method | |
| EP2720464B1 (en) | Generating image information | |
| CN106797430B (en) | Distant existing experience | |
| CN105827960A (en) | Imaging method and device | |
| CN108600729B (en) | Dynamic 3D model generation device and image generation method | |
| CN205910418U (en) | Nearly eye formula display of wear -type goggles | |
| TW202141120A (en) | Head wearable device with adjustable image sensing modules and its system | |
| CN106354205A (en) | Wearable virtual reality implementing system | |
| JP5370380B2 (en) | Video display method and video display device | |
| CN108134928A (en) | VR display methods and device | |
| CN104883561A (en) | Three-dimensional panoramic display method and head-mounted display device | |
| CN104539932B (en) | A kind of 3D glasses camera | |
| CN207663149U (en) | The device of enhancing and mixed reality | |
| CN205750141U (en) | A kind of stereo projection display apparatus | |
| CN107430276B (en) | Head-mounted display device | |
| CN209044219U (en) | A kind of amplifying type glasses based on eyeball tracking technology | |
| CN104239877B (en) | The method and image capture device of image procossing | |
| CN106534831A (en) | Three-dimensional video shooting method and user terminal | |
| CN110244837A (en) | Augmented reality and the experience glasses and its imaging method being superimposed with virtual image | |
| CN206258634U (en) | A kind of secondary display virtual real optical system for observing giant-screen | |
| CN111736692B (en) | Display method, display device, storage medium and head-mounted device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |