CN103261944A - Head-mounted display apparatus employing one or more reflective optical surfaces - Google Patents

Head-mounted display apparatus employing one or more reflective optical surfaces Download PDF

Info

Publication number
CN103261944A
CN103261944A CN2011800606603A CN201180060660A CN103261944A CN 103261944 A CN103261944 A CN 103261944A CN 2011800606603 A CN2011800606603 A CN 2011800606603A CN 201180060660 A CN201180060660 A CN 201180060660A CN 103261944 A CN103261944 A CN 103261944A
Authority
CN
China
Prior art keywords
reflected light
light
head
space
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011800606603A
Other languages
Chinese (zh)
Inventor
大卫·艾伦·史密斯
格雷戈里·A·哈里森
加里·E·威斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lockheed Martin Corp
Original Assignee
Lockheed Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/211,372 external-priority patent/US8625200B2/en
Application filed by Lockheed Corp filed Critical Lockheed Corp
Publication of CN103261944A publication Critical patent/CN103261944A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0176Head mounted characterised by mechanical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02Viewing or reading apparatus
    • G02B27/022Viewing apparatus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • H04N13/383Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/35Nc in input of data, input till input file format
    • G05B2219/35503Eye tracking associated with head mounted display to detect eye position

Abstract

Head-mounted displays (100) are disclosed which include a frame (107), an image display system (110) supported by the frame (107), and a reflective surface, e.g., a free-space, ultra-wide angle, reflective optical surface (a FS/UWA/RO surface) (120), supported by the frame (107). In certain embodiments, the reflective surface (120) produces spatially-separated virtual images that are angularly separated by at least 100, 150, or 200 degrees. Methods and apparatus for designing reflective optical surfaces, including FS/UWA/RO surfaces, for use in head-mounted displays (100) are also disclosed.

Description

Adopt the head-mounted display apparatus on one or more reflected light surface
CROSS-REFERENCE TO RELATED PATENT
Present patent application requires in the U. S. application on August 17th, 2011 number 13/211,372, and U.S. Provisional Application number 61/405,440(is entitled as head mounted display, application on October 21st, 2010), U.S. Provisional Patent Application number 61/417, (be entitled as bent folded Fresnel framework No. 325, application on November 26th, 2010), U.S. Provisional Application number 61/417,326(are entitled as bent bundle device framework, application on November 26th, 2010), U.S. Provisional Application number 61/417,327(is entitled as the plane beam splitter of the Fresnel LENSE of combo architectures, on November 26th, 2010 application), U.S. Provisional Application number 61/417,328(be entitled as the combo architectures Fresnel LENSE with spectroscope bending, on November 26th, 2010 application) and U.S. Provisional Application number 61/427,530(is entitled as and changes cephalic flexure mirror dress formula and show, application on Dec 28th, 2010) as right of priority, above full content mode is by reference incorporated this paper into.
Technical field
This paper relates to and adopts one or more reflected light surface, for example, one or more free spaces, super wide-angle, reflected light surface (hereafter is " FS/ UWA RO surface "), head-mounted display apparatus.Especially, in the head-mounted display apparatus that this paper relates to, be provided with FS/ UWA RO surface, be used for from being in close proximity to the dispalying systems show image of user's eyes.
Background technology
Head-mounted display apparatus such as Helmet Mounted Display or glasses type displayer (this paper is abbreviated as " HMD ") are a kind of display device that is worn over the head part, have eyes that are positioned at the user, or near the one or more compact display apparatus the common eyes.Fig. 1 shows the primary element of one type of HMD, comprising 11, one reflected light surfaces 13 of a display, has the eye 15 of a rotation center 17.As shown in the drawing, the light 19 that display device 11 is sent reflects by surface 13, and enters user's eyes 15.
Some HMD is display simulation (computing machine generates) image only, rather than the image of real world, so be commonly called " virtual reality " or HMD on the spot in person.Other HMD add (combination) a non-simulation with analog image, the image of real world.The combination of non-simulation and analog image allows HMD user to pass through, and for example, sunshading board or eyepiece are seen the world, and wherein extra data relevant for will carrying out of task are added to the ken (FOV) in user the place ahead.When being superimposed with, this is called as " augmented reality " or " mixed reality ".
With non-simulation, the view of real world is in conjunction with the view of simulation, can realize by the optical surface (" beam splitter ") of part reflection/part transmission, the reflectivity on surface is used for analog image is shown as virtual image (at optical significance), and the transmission on surface can make the user directly observe real world (being designated hereinafter simply as " x ray fluoroscopy x system ").The combination of real world images and analog image also can be passed through the electronics mode from the video in a real world visual field of camera acceptance, and by using a combiner (being called for short " video perspective system ") electronically it to be mixed mutually with emulating image.Then, virtual image (on optical significance) by the reflected light surface, in this case, composograph can be presented to the user, and the device that does not need to have transmission properties.
As seen from the above, the reflected light surface can be used among some HMD, these HMD offer the user: (i) combination of the real world images of an analog image and non-simulation, (ⅱ) combination of the video image of analog image and real world, or (iii) pure analog image.(last a kind of situation is commonly referred to as " on the spot in person " system.) under above-mentioned every kind of situation, the virtual image that the generation of reflected light surface can be seen by the user (on optical significance) person of being to use observe.In history, such reflected light surface has become the part of optical system, and the emergent pupil of this optical system has not only significantly limited the dynamic ken that offers the user, has also limited the static ken.Particularly, in order to see the image that is produced by optical system, the user need be with the emergent pupil of his/her eye alignment optical system and keep its alignment like this, even like that, also will no longer cover user's the whole static ken to the visible image of user, namely adopting the existing optical system of using among the HMD on reflected light surface, has been the part that the part pupil forms system, has therefore been exported pupil and has limited.
The reason that system is so limited is very large this brass tacks of people's the ken.Therefore, the static ken of human eye comprises the peripheral vision of the central fovea of retina of eyes, is approximately 150 ° and be approximately 130 ° in vertical direction in the horizontal direction.(because the purpose of this paper, 150 degree will be as the static ken in nominal human eye dead ahead.) actually rare through the optical system with the emergent pupil that can hold the so big static ken after proofreading and correct preferably, when using them, this optical system is expensive and heavy.
In addition, because eyes can rotate with regard to its rotation center, that is, human brain can make the central fovea of retina+different direction of peripheral ken aiming of human eye, so the operation ken of human eye (the dynamically ken) be bigger by changing the direction of gaze of eyes.For the eyes of nominal, vertical range is approximately upwards 40 ° and downward 60 °, and the tangential movement scope is approximately forward ± and-50 °.Size for an emergent pupil that is produced by the type of the optical system of previous use in HMD, an even little rotation of eyes, also can significantly reduce overlapping between the static ken of eyes and the emergent pupil, and bigger rotation will make the image complete obiteration.Though possible in theory, in fact emergent pupil and user's eyes are unpractical with moved further, and can be undue costlinesses.
Consider these attributes of human eye, three kens relevant with the optical system that provides are arranged, this optical system allows user to observe the image that produces to check with him that the identical mode of nature universal time is checked by image display system.The minimum ken is rotated his eyes and then the ability in the observation external world of his/her central fovea of retina is determined by the user in three kens.
Maximum rotation is approximately forward ± and 50 °, so this ken (the dynamic ken of central fovea of retina) is approximately 100 °.The centre of three kens is static forward kens, and comprises the ken of user's central fovea of retina and periphery.As discussed above, this ken (static central fovea of retina+peripheral ken) approximately is 150 °.The maximum ken is rotated his eyes by the user and then is made his/her central fovea of retina add the upper periphery ken and observes the ability in the external world and determined in three kens.Based on being approximately ± rotation of 50 ° maximum and central fovea of retina+peripheral static ken of being approximately 150 °, this big ken (the dynamic ken of central fovea of retina+periphery) is about 200 °.The ken that this scale is increasing at least 150 degree, arrives at least 200 degree from least 100 degree then, offers the user and can observe the image that is produced by an image display system in more directly perceived and natural mode.
Therefore, need a kind of head-mounted display apparatus that has improved the static and dynamic ken compatibility of human eye.The disclosure relates to the needs of this respect, and employing reflected light surface is provided, and the head-mounted display apparatus of a super wide-angle ken is provided.
Definition
In the remainder and claim of this paper, phrase " virtual image " is to be used on the optical significance to say, that is, a perceived virtual image is specific local from one, in fact is not that place that perceived light originates from.
A FS/UWA/RO surface is called as " free space " surface in this article, because its local space position, local surfaces curvature, and the local surfaces direction does not rely on a specific substrate, as the xy plane, but, when surface design, determine by using basic optical principle (for example, minimum principle of the time of Fermat and Xi Luo) at three dimensions.
This FS/UWA/RO surface be called as " super wide-angle " surface because in use, at bottom line, it does not limit the ken of the dynamic central fovea of retina of nominal user eyes.Therefore, optical characteristics according to optional optical element, the surface that can be used for " super wide-angle ", for example, system of Fresnel lenses, the overall optical system of HMD can be shaped by non-pupil, namely, the emergent pupil of restricted user's ken unlike traditional optical system, the effective pupil of the optical system of various embodiment disclosed herein will the person's of being to use eyes enter pupil rather than the entrance pupil relevant with external optical system.Attach, among these embodiment, the ken that offers the user will be bigger than conventional optical systems, in the conventional optical systems even a small misalignment of the emergent pupil of user's eyes and external optical system, can significantly reduce the information content that offers the user, and bigger deviation may cause entire image to disappear.
In this article, following phrase/vocabulary has following connotation/scope:
(1) phrase " reflected light surface " (being also referred to as " reflecting surface " in this article) should comprise the surface that is merely able to reflect, and can reflect simultaneously the surface with transmission.In both cases, have only part to have reflectivity, that is, the part of incident light can see through the surface.Similarly, when the surface can be reflected with transmission simultaneously, reflectivity and/or transmittance can be part.Just as discussed below, single reflected light surface can be used for eyes or every eye can its oneself independently reflected light surface.Other variations comprise to be used a plurality of reflected light surface for eyes or is used for every eyes separately.Also can use and mix and the combination of coupling, for example, single reflected light surface can be used for eyes and a plurality of reflected light surface can be used for the another eyes.Select as another kind, one or more reflected light surface can only offer user's eyes.Claim described below is intended to cover these reflected light surface and other application disclosed herein.Especially, the claim of every desired reflected light face of claim is intended to cover head-mounted display apparatus, and it comprises the reflected light surface of the type of one or more appointments.
(2) phrase " image display system with at least one light-emitting area " generally comprises any display system, its have one can be luminous the surface, no matter whether be light transmission surface and transmission, (for example produce light on the surface, by a led array), the surface reflection of the light that sends from another source, or similar other.Image display system can adopt one or more image display devices, for example, and one or more LED and/or LCD array.With the reflected light surface, a given head-mounted display apparatus can comprise that one or more image display systems are used for one or two eyes of user.Equally, the desired image display system of each following claim of listing is intended to cover head-mounted display apparatus, and it comprises the image display system of the type of one or more appointments.Phrase " binocular reader " refers to a kind of device, and it comprises that at least one is the independently optical element (for example, a display device and/or a reflected light surface) of every eyes.
(3) phrase " ken " and its abbreviation FOV refer in image (eyes) space " significantly " ken, rather than in object space " real " ken.
Summary of the invention
According to first aspect, a kind of head-mounted display apparatus (100) is disclosed, comprising:
(I) frame structure (107) that is suitable for being installed on user's head (105);
(II) image display system (110) by this frame structure (107) supporting (for example, frame structure is bearing in a fixing position with image display system, and in using the HMD process, this frame structure is outside user's the ken); With
(III) reflected light surface (120) by this frame structure (107) supporting, the reflected light surface is a continuous surface, rather than around any axes of coordinates rotation symmetry in the three-dimensional cartesian coordinate system (for example, the reflected light surface can be free space, super wide-angle, reflected light surface (120), this reflected light surface be around the x of the three-dimensional cartesian coordinate system with arbitrary origin, rotational symmetric (being not a surface of revolution) of y or z axle);
Wherein:
(a) this graphical presentation system (110) comprises at least one light-emitting area (81);
(b) in use, reflected light surface (120) produces the space of the space separating part of at least one light-emitting area (81) and separates virtual image, the angle intervals of the virtual image that separate at least one at least one space of space separate picture and other is at least 100 degree, and described angle intervals records from the center of rotation (17) of nominal user eyes (15); And
(c) in use, at least one point on reflected light surface (120) reaches at least 100 degree with the angle intervals of other point at least on reflected light surface (120), and described angle intervals records from the surface of user's eyes (15) centers of rotation (17).
According to second aspect, a kind of head-mounted display apparatus (100) is disclosed, comprising:
(I) frame structure (107) that is suitable for being installed on user's head (105);
(II) image display system (110) by this frame structure (107) supporting (for example, frame structure is bearing in a fixing position with image display system, and in using the HMD process, this frame structure is outside user's the ken); With
(III) is by a free space of this frame structure (107) supporting, super wide-angle, reflected light surface (120);
Wherein:
(a) described graphical presentation system (110) comprises at least one light-emitting area (81);
(b) in the use, described free space, super wide-angle, reflected light surface (120) produces the space of the space separating part of at least one light-emitting area (81) and separates virtual image, the angle intervals of the virtual image that separate at least one at least one space of space separate picture and other is at least 100 degree, and described angle intervals records from the center of rotation (15) of nominal user eyes (17).
According to the third aspect, a kind of head-mounted display apparatus (100) is disclosed, comprising:
(I) frame structure (107) that is suitable for being installed on user's head (105);
(II) image display system (110) by this frame structure (107) supporting; With
(III) by a reflecting surface (120) of this frame structure (107) supporting, described reflecting surface (120) offers the ken of nominal user at least 200 degree;
Wherein
(a) this graphical presentation system (110) comprises at least one light-emitting area (81), and described light-emitting area comprises the light-emitting zone (82,83) that at least the first and second segment spaces separate, and described light-emitting zone comprises first and second information contents respectively;
(b) reflecting surface (120) comprises the reflector space (84,86) that separate at least the first and second spaces, comprises first and second surface normals (85,87) that point to different directions in the described reflector space respectively; And
(c) described frame structure (107) supports described image display system (110) and described reflecting surface (120), thereby when the nominal user uses:
(i) at least one direction of gaze of nominal user eyes (71) (among Fig. 8 towards 88), the light that from first light-emitting zone (82), sends, reflect and enter described eyes (71) by first reflector space (84), form the visual virtual image (88) (that is, the nominal user can see this first information content (with the content of second information of choosing wantonly) at this direction of gaze) of first information content;
(ii) at least one direction of gaze of described eyes (71) (among Fig. 8 towards 89), the light that sends from second light-emitting zone (83) is gone forward side by side by second reflector space (86) reflection and is formed the visible virtual image (89) (that is the content (with the first information content of choosing wantonly) of described second information that can see at this direction of gaze of nominal user) of the content of second information into eyes (71);
(ⅲ) at least one direction of gaze (88 directions of watching attentively to the right among Fig. 8) of described eye (71), the light that sends from first light-emitting zone (82) is reflected by first reflector space (84), and enter the visible virtual image (88) that described eye (71) forms first information content, by second reflector space (86) reflection and do not enter described eyes (71), do not form the visible virtual image of second information content from the light of second light-emitting zone (83).(that is, the nominal user can see first information content by nominal user's central fovea of retina or peripheral visual acuity, but can not see second information content on this direction of gaze).
According to a fourth aspect, the method that a kind of computer based is used for design reflectivity optical surface (120) is disclosed, described reflected light surface can a kind of FS/UWA/RO of yes or no surface, be used for comprising the head-mounted display apparatus (100) of image display system (110), in the use of head-mounted display apparatus (100), image display system (110) has a plurality of content regions (82,83) (for example, a plurality of groupings of a plurality of independent pixels or pixel), described method comprises that the one or more computing machines of use are to carry out following steps:
(a) reflected light surface (120) are divided into the reflector space (84,86) of a plurality of parts, each local reflector space (84,86) has surface normal (85,87) (for example, surface normal at the local reflex center);
(b) with each local reflex zone (84 of reflected light surface (120), 86) and one of image display system (110) and have only a content regions (82,83) to be associated, each content regions (82,83) and at least one local reflex district (84,86) be associated; With
(c) setting on adjustment reflected light surface (120) (for example, adjusting the local curvature on local space position and/or surface) is divided each surface normal (85,86) equally and is following two vectors:
(1) from local reflex zone (84,86) to the related content district (82,83) (for example, the center in company associated content zone) of vector (77, the 78) center of local reflex zone (for example, from) to it; And
(2) in the process of using head-mounted display apparatus (100), the vector (79,80) from local reflex zone (84, the 86) center of local reflex zone (for example, from) to nominal user eyes (71) centers of rotation (72) position.
Among some embodiment of above-mentioned aspect in this article, one independently reflecting surface and/or independent image display system are used for each user's eyes.In other embodiments, the reflected light surface, no matter be separately or with other optical element combination (for example, one or more Fresnel lenses), the light that collimation (or collimating basically) sends from image display system, such collimation is realized by the local radius of curvature on surface.
In different embodiment, the HMD device can be the dynamic ken that the user provides a complete central fovea of retina, a complete central fovea of retina+peripheral static ken, or the dynamic ken of complete central fovea of retina+periphery.
In different embodiments, the HMD device can be that the non-pupil of binocular forms system, and in this system, eyes can move freely with regard to its roll center, by the degree of its whole normal acquisition angle, do not see and be not constrained to by outer pupil.Existing HMD equipment it is said, has the ken that a broadness maybe can be provided, but these equipment comprise an outer pupil, and eyes must therefrom be seen.Although there is a large amount of information to offer eyes, if eyes are removed, this information will be lost.This is the root problem that pupil forms system, has been avoided behind the reflecting surface and adopted in the disclosed embodiment of the application, especially adopted the FS/UWA/RO surface after.
Above about the used reference number of content each side summary of the present invention (reference number is representational, rather than comprises all or detailed) only for helping reader, rather than for the scope that should not be construed as limiting the invention.More generally, should be understood that the general description of front and following detailed only are examples of the present invention, purpose provides for general introduction or the framed structure of understanding character of the present invention and feature.
Other features and advantages of the present invention are listed in hereinafter the detailed description, and part is for a person skilled in the art, by instructions, or understand by the summary of the invention that the instructions of implementing by this paper exemplifies, and will be apparent.Include accompanying drawing, be used for providing the present invention is further understood, and be merged in and constitute the part of this instructions.But should be understood that disclosed various features of the present invention can be used in any and all combinations in this instructions and accompanying drawing.
Description of drawings
Fig. 1 is a synoptic diagram, shows the primary element of a HMD, that is, and and a display device, reflecting surface and user's eyes.
Fig. 2 represents a side view according to the head-mounted display apparatus of an exemplary embodiment.
The front view of a head-mounted display apparatus of Fig. 3 presentation graphs 2.
Fig. 4 is a ray plot, shows according to an exemplary embodiment opticpath that sends from display device and external object in head-mounted display apparatus.
Fig. 5 is a ray plot, shows an exemplary embodiment of the reverberator of the display device that adopts a bending and a bending.
Fig. 6 is a vertical view of head-mounted display apparatus, shows according to exemplary embodiment, uses the reflected light surface of two bendings corresponding to user's eyes.
Fig. 7 shows the synoptic diagram of the static ken craspedodrome of nominal human eye direction of gaze.
Fig. 8 is a synoptic diagram, shows the influence that has according between the static ken of the Fig. 7 on the FS/UWA/ RO surface of an exemplary embodiment.Arrow among Fig. 8 shows the direction that light is propagated.
Fig. 9 is a ray plot, shows according to an exemplary embodiment, and pixel given on the display device reflexes to the opticpath of eyes when it.
Figure 10 is a ray plot, shows according to an exemplary embodiment, and fooled its of two pixels on display device reflexes to the opticpath of eyes.
Figure 11 is a synoptic diagram, shows according to an exemplary embodiment, is used for selecting the variable of the local normal direction of reverberator.
Figure 12 representative is according to an exemplary embodiment, along the reverberator of the bending of opticpath.
Figure 13 and Figure 14 show a FS/UWA/RO surface according to an exemplary embodiment from both direction.
Figure 15 and Figure 16 show another FS/UWA/RO surface according to an exemplary embodiment from both direction.
Figure 17 is a synoptic diagram, shows according to an exemplary embodiment, is used for calculating the geometric configuration to the local normal of a reflecting surface.
Embodiment
Fig. 2 and Fig. 3 show head-mounted display apparatus 100 side views and the front view of being worn by a user 105 respectively.Head-mounted display apparatus adopts a FS/UWA/RO surface 120.
In one embodiment, head-mounted display apparatus 100 can be, for example, and an optical perspective formula device, augmented reality device, binocular viewing device.Because optical perspective formula device, augmented reality device, binocular viewing device be the most complicated form of expression of HMD normally, and the application will mainly discuss such embodiment, can be understood that, principle discussed in this article is equally applicable to optical perspective formula device, augmented reality device, monocular observation device, video signal formula arrangement for perspective, the augmented reality device, binocular and monocular observation device, and binocular and monocular " virtual reality " system.
Shown in Fig. 2 and 3, head-mounted display apparatus 100 comprises a frame structure 107, is used for being worn by the user, and is supported in similar mode of wearing glasses by user's nose and ear.In the embodiment of Fig. 2-3, and in other embodiment disclosed herein, head-mounted display apparatus can have various configurations, can, for example, be similar to traditional safety goggles, glasses, the helmet etc.In some embodiments, suspender belt can be used to remain on the HMD frame structure a fixed position with respect to user's eyes.In general, about display device and the user's eyes of HMD, at the outside surface of HMD bag, can suppose that any maintenance optical system is in any form of required direction
This head-mounted display apparatus 100 comprises at least one image display system 110 and at least one optical system, wherein this optical system comprises a reflected light surface, shown in Fig. 2 and 3, this reflected light surface is free space, super wide-angle, reflected light surface 120, i.e. FS/UWA/ RO surface 120, this must be crooked.In certain embodiments, FS/ UWA/ RO surface can be whole optical system.Surface 120 can have pure reflecting properties, or can have reflection and transmission performance simultaneously, and in this case, it can be considered to " beam splitter " as one type.
FS/UWA/RO surface 120 can surround one or two eyes fully, and at least one image display system 110.Particularly, the surface can be round the eyes bending, and towards lateral aspect of face, to enlarge the available horizontal ken.In one embodiment, FS/UWA/RO surface 120 may extend to 180 ° or bigger (for example, more than 200 °), as shown in the Fig. 6 that hereinafter addresses.As shown in Figure 3, HMD can comprise FS/UWA/RO surface 120R and the 120L of two two eyes that are used for the user that separate, the frame structure that this FS/UWA/ RO surface 120R and 120L obtain respectively and/or 210 supportings (seeing below) of nasospinale sheet.Optionally, HMD can adopt a single FS/ UWA RO surface to provide eyes a single structure, and some parts is wherein watched jointly by eyes, and other parts have only eyes to watch.
As mentioned above and as shown in Figure 3, head-mounted display apparatus 100 can comprise a nasospinale sheet 210.The nasospinale sheet can be one makes vertical bar or the wall that separates between two FS/ UWA/ RO surfaces, and each FS/ UWA/ RO is respectively applied to user's eyes.Nasospinale sheet 210 also can make between user's the ken of two eyes and separate.Like this, can first image be shown to user's right eye by first image display device and FS/ UWA/ RO surface, thereby the right eye that makes the user is seen first expression of a three-dimensional physics actual environment, and can second image be shown to user's left eye by second image display device and the 2nd a FS/ UWA/ RO surface, thereby make user's left eye see second expression of a three-dimensional physics actual environment.Therefore, see it with respect to the correct image of position in the three-dimensional physics actual environment by every eyes, the effect of service user's eyes has been played in the combination of an independent display device/reflecting surface.By separating user's eyes, the image optimization that ridge sheet 210 is seen each eye is independent of the another eyes.In one embodiment, the vertical wall of nasospinale sheet can comprise two reverberators, and each one of every side is to allow in the time of to the left or to the right, to see image when the user rotates his/her eye nasally.
At least one described image display system 110 can be installed in the surface 120 of FS/UWA/RO, can arrange with level or with the angle small with respect to the local horizon.Selectable, at least one described image display system just is positioned at the outside on the surface of described FS/UWA/RO.The inclination of at least one described image display system 110 or angle, or more specifically, the angle of inclination of its at least one light-emitting area, normally a kind of pixel, image and/or from the function of the position of the demonstration information of surface 120 reflections.
In certain embodiments, head-mounted display apparatus 100 is set to create an internal cavities, and described FS/ UWA/ RO surface is towards the cavity inner reflection.For the FS/UWA/RO surface with transmissison characteristic, image or the demonstration information sent from least one image display device reflex to described cavity and enter user's eyes from the surface, and simultaneously from the light in the external world also by passing the eyes that reflecting surface enters cavity and user.
As hereinafter institute's argumentation in detail, in certain embodiments, at least one described image display system 110 provides image and/or the fragment of demonstration information, and the image of described demonstration information and/or fragment are adjusted to the low coverage ken before entering user's eyes (inferior).In certain embodiments, optional lens or lens combination 115 can be used for regulating.The U.S. Patent application No.13/211 of common transfer and while pending trial, 365, with G. Harrison, D. the name of Smith and G. Wiese is submitted to simultaneously, be entitled as " head-mounted display apparatus that uses one or more Fresnel lenses ", and mark has attorney docket IS-00307, and its content is incorporated herein this paper as a reference, and it has been described and has been used for this purpose and uses one or more Fresnel lenses.Do not use optional lens or lens combination among other embodiment, but rely on the FS/UWA/RO surface providing by image that display system is formed, in the focal length, near the required optical property of the ken.
Head-mounted display apparatus can comprise an electronic packing piece 140 with control by the shown image of at least one described image display system 110.In one embodiment, electronic packing piece 140 comprises accelerometer and gyroscope, with synchronously from the picture of at least one described image display projection system 110 location, direction and the positional information required with user's activity.Can be by transmission cable 150 or the wireless medium that is connected to electronic packing piece 140, be provided to and from the transmission of electric power and the video of head-mounted display apparatus 100.
One group of camera 170 can be located on the opposite side of head-mounted display apparatus 100, provides input to electronic packing piece, generate to help the control computing machine, for example, the scene of " augmented reality ".One group of camera 170 is connected to receive power supply and control signal with electronic packing piece 140, and provides the video input to the software of electronic packing piece.
The image display system that uses in the head-mounted display apparatus can have many forms, and is now known or be about to exploitation.For example, can adopt little high-resolution LCD (LCD), light emitting diode (LED) display, and/or Organic Light Emitting Diode (OLED) display comprise flexible OLED screen.Particularly, image display system can adopt a high definition, and the display device of little profile specification has high pixel density, can find the example in mobile phone industry.A fibre bundle also can be used in the image display system.In various embodiments, image display system can be considered to as a small screen TV.If image display system (for example produces polarized light, adopted liquid crystal at graphical presentation system, all colors are under the situation of linear polarization in same direction), if and FS/UWA/RO is surperficial and hand over polarization by the light positive of display emission, light can not revealed away from the FS/UWA/RO surface so.The information of Xian Shiing and light source are sightless beyond HMD originally like this.
According to the integrated operation of the application in the exemplary embodiment of the optical system that constitutes, particularly, be used for the optical system of " augmented reality " HMD, illustrated by the opticpath of Fig. 2, particularly light 180,185 and 190.In the present embodiment, FS/UWA/RO surface 120 has reflectivity and transmittance simultaneously.Utilize the transmittance on surface 120, light 190 passes the surface and enters eyes to the user from environment.Same area from surface 120, light 180, by surface reflection (utilizing the reflectivity on surface) thereby and add light 190 and generate and mix light 185, when seeing, the user puts 195 direction, namely, when direction at point 195 of user's direction of gaze, described light 185 can enter user's eyes by light light.When seeing like this, user's peripheral vision function allows the user to see that other points pass surperficial 120 light from environment, has reused surperficial transmissison characteristic.
Fig. 4 is further opticpath figure, shows the exemplary embodiment of the operation of the disclosed head-mounted display apparatus 100 of the application.In the present embodiment, Zheng Ti vision system comprises three parts: (1) at least one image display system 110, (2) FS/UWA RO surface 120 and (3) user's eyes 310.The eyes 310 with an interior lens 330 have been represented.As shown in Figure 2, the light of launching from the pixel of at least one described image display system 110 is represented by light 180.After by surface 120 reflections, this light will appear on the amphiblestroid point of user, the direction that provides the user to watch attentively, and the relevant ken, (consulting Fig. 7 and 8 argumentation hereinafter) comprises the point of light 180 impact surfaces 120.More specifically, as mentioned below, because optical property relates to, to divide equally from FS/ UWA/ RO lip-deeply to eyes with to the normal of the vector of pixel, pixel will only appear at a little 195 places; That is, even the light that sends from pixel radiation in circular cone scope widely, the FS/UWA/RO surface design is for only allowing light enter from a position.
In Fig. 4, the direction of gaze of supposing the user is towards the point of crossing of light 180 with surface 120, shown in light 185 and 340.Yet eyes see, be in the space that appears at its front from the virtual image of eyes one segment distance, this segment distance for example, is illustrated in the distance of infinite distance by vector 345 and 350 expressions by reference number 352.At figure as shown in Figure 4, a chair that is used for illustration purpose, the real image 355 of the chair that is produced by at least one described image display system 110, described real image 355 is becoming virtual image 360 from the light of display system emission after via 120 reflections of FS/ UWA/ RO surface.In the environment of " augmented reality ", optical system comprises the FS/UWA/RO surface, can cause, and appears at the 365 actual residing physical environments as the people, identical position as the virtual image 360 of chair.It should be noted that 345 lines, be parked in the distance than infinite distance, be included among Fig. 4, to show this image, can appear near any distance between and infinitely great optically.For example, the people may stand in 50 meters distant, and that is exactly the position of putting chair.
As shown in Fig. 1-4, at least one described image display system has planar light emitting surface (for example, the surface among Fig. 4 111).Display system also can have crooked light-emitting area.Such embodiment is shown among Fig. 5, and light 405 is by the light-emitting area of the display screen 407(bending of bending) send.This light is by 120 reflections of FS/ UWA/ RO surface, and the pupil 415(that enters user's eyes 310 sees light 410).In the present embodiment, surface 120 also allows the light from external environment condition by light 345 expressions, shows the image stack external image that generates thereby make.It should be noted that in order to realize illustrated purpose, light 345 stray lights 410; In order to realize the stack of pure external image, light 345 will cover light 410.
As mentioned above, the optical system of using among the HMD in the past adopts the pupil on reflected light surface to be shaped, thereby has limited the ken, and a typical ken is about 60 degree or littler.This has greatly limited value and the ability of head-mounted display apparatus in the past.Compare with the HMD with littler ken, in various embodiments, the ken of head mounted display disclosed in this invention (FOV) has the ken widely, thereby allows much more optical information to offer user's head-mounted display apparatus.The wide ken can be greater than 100 °, greater than 150 ° or greater than 200 °.Except more information is provided, the image that shows by coupling better is in physical reality, and the broad ken can be handled additional information by the user in more natural mode, and the reality of immersion and enhancing is experienced better.
Especially, in this exemplary embodiment shown in Fig. 6, for direction of gaze forward, the surface 201 and 202 of FS/UWA/RO by bending, the whole visual zone that eyes can be seen represent among Fig. 6, corresponding every eye level ken (FOV) reaches at least 150 degree (for example, the horizontal ken of about 168 degree).This ken is made up of the ken of eye retina central fovea and its peripheral ken.In addition, eyes can freely rotate around it the center and move the ken+peripheral ken with the fovea centralis that merges at different direction of gaze collimation, just as eyes are done when observing physical world naturally.Optical system disclosed herein, make eyes by a series of as the action acquired information of eyes at the observation of nature universal time.
Observe Fig. 6 in more detail, this pictures is 200 the front portion that the lines simplified represent to look down from the top user that sees.Show the front that FS/UWA/RO surface 201 and 202 is arranged on user's eyes 203 and 204.As mentioned above, FS/UWA/RO surface 201 and 202 can lean against user's nose 205, namely in central the place ahead 214 of user's head 200.As discussed in more detail below, the local normal drawn game portion locus on surface 201 and 202 is adjusted, so that the image that is produced by at least one image display system (not shown among Fig. 6) covers at least 100 ° of the horizontal kens of every eyes, for example, in certain embodiments, at least 150 ℃, in other embodiments, be at least 200 °.(alternatively, also can be according to following discussion, local radius-of-curvature also is adjusted to provide remote virtual mapping when system of Fresnel lenses is combined.) for example, the position in part normal drawn game portion space can be adjusted, to cover complete about 168 degree of user, forward, level, the static ken of every eyes, with 168 degree that extend from the FS/UWA/RO surface 201 or 202 of edge-to-edge, by shown in sight line 210,211 and 212,213 shown in.Therefore, the sight line corresponding to the wide static ken (ken of the fovea centralis+peripheral ken) offers the user.In addition, when continuing to see computer generated image, the user can center of rotation 215 and 216 freely rotate his/her eyes.
At Fig. 6, and at Fig. 4, among Fig. 5 and 12, for the ease of statement, the FS/UWA/RO surface illustrates as the part of spheroid.In practice, the surface is not spherical, but has more complicated configuration, make their local normal drawn game portion space the position (with optionally, local radius of curvature) provide required static state and the dynamic ken (with optionally, to the required distance of virtual image).Equally, as shown in Figure 6, the head-mounted display apparatus on right side is identical with the operation in left side, can be understood that, is used for application-specific if desired, and both sides can be different.
Static state and the dynamic ken that is provided by FS/UWA/RO disclosed herein surface be provided for Fig. 7 and Fig. 8.Fig. 7 has shown that the user has direction of gaze 73 nominal right eye 71 forward.The ken+peripheral the ken of the fovea centralis of eye illustrates by electric arc 75, wherein has one to be about 168 ° angular range.Note that for the ease of statement, in Fig. 6-8, the center of rotation with respect to user's eyes illustrates the ken, rather than the center of user's pupil or edge.In fact, the big ken that human eye is realized (for example, about 168 °) is the result of retina polarizers of big angle scope, allows skew ray highly to enter user's pupil and arrives amphiblestroid.
Fig. 8 schematically shows the interaction of Fig. 7 ken, HMD has: (a) a kind of image display system, at least one light-emitting area 81 of described image display system has first a light-emitting zone 82(and is depicted as a square) and the second light-emitting zone 83(be depicted as a triangle) and (b) FS/UWA/RO surface, have first reflector space 84 and second reflector space 86, wherein said first reflector space 84 has first local normal 85 described second reflector spaces 86 that second a local normal 87 is arranged.
As top pointed in, the FS/UWA/RO surface be one " free space " surface and " super wide-angle " surface.In addition, as indicated above, and below with more detailed argumentation, the surface can participate in the collimation (or part collimation) of light that (or unique source) enters user's eyes.Virtual image and user's apart from each other that such collimation can cause the FS/UWA/RO surface to produce, for example, 30 meters or longer, this allows the user to use the eyes that loosen easily to concentrate on the virtual image.
" free space " on FS/UWA/RO surface and " super wide-angle " aspect can realize by the local normal of adjusting the surface, make user's eyes see the light-emitting zone of at least one image display system, as the presumptive area (lip-deep precalculated position) from the FS/UWA/RO surface.
For example, in Fig. 8, the deviser of HMD may determine, when user's direction of gaze forward the time, it is favourable that foursquare virtual image 88 is partly observed by user's foveal region of retina, and when user's direction of gaze is, for example, about 50 ° the time, it is favourable that leg-of-mutton virtual image 89 is partly observed by user's foveal region of retina to the left front.The deviser can dispose at least one image display system subsequently, the FS/UWA/RO surface, with the assembly of any other optical system (for example, one or more image display systems Fresnel lens between the FS/UWA/RO surface of unifying), in using the HMD process, foursquare virtual image will be forward like this, and leg-of-mutton virtual image will be to left front 50 °.
By this way, when user's direction of gaze (boresight) intersects on the straight line of FS/UWA/RO surface, the virtual image in the square world will be according to demand, be visible at the center of user's eyes, when user's direction of gaze (boresight) intersects on the FS/UWA/RO surface to left front 50 degree, leg-of-mutton virtual image will be visible equally according to demand at the center of user's eyes.Though not shown in Fig. 7 and 8, identical method also can be used for vertical coverage, and the ken that is used for off-axis.More commonly, at design HMD and its optical module, at least one light-emitting area of deviser's " settings " display device, like this when the direction of gaze of eyes be during in specific direction, the part of required display device is visual to user's eyes.Therefore, when the whole ken of people's saccade, on horizontal direction and the vertical direction, the different piece of described at least one light-emitting area of image display system of FS/UWA/RO surface irradiation enters user's eyes.Though the discussion of front according to user's foveal region of retina of nominal, in design process, certainly, if necessary, is replaced the position of using the amphiblestroid central fovea of nominal user.
Should be noted that in Fig. 8, no longer to the user as seen any rotation of turning right of user's eyes can cause leg-of-mutton virtual image 89.Therefore, in Fig. 8, any direction of gaze, forward or to left front, for the user provides the virtual image of squares and triangles, and direction of gaze provide a foursquare virtual image to right front.The eyesight of virtual image, certainly, user's foveal vision or surrounding edge visual experience arrive to depend on virtual image.
If the deviser of HMD is placed on foursquare virtual image the position that takes among Fig. 8, and leg-of-mutton virtual image is placed on the position of taking back among Fig. 8, will there be the direction of gaze that can only see foursquare virtual image and has only visible other direction of gaze of leg-of-mutton virtual image.Similarly, on the basis of principle disclosed herein, the deviser can arrange foursquare virtual image and leg-of-mutton virtual image, make leg-of-mutton virtual image always visible, and on some direction of gaze, foursquare virtual image is visible, but other directions are invisible.As further variation, the deviser of HMD can be placed on foursquare virtual image and leg-of-mutton virtual image on one or more direction of gaze, and image is sightless to the user, for example, the deviser can be placed on virtual image outside the static ken of user on direction of gaze forward.By the dirigibility that the disclosure provides to the HMD deviser, therefore, apparent.
In one embodiment, the aspect of " free space " of described reflecting surface and " super wide-angle " is by using Fermat principle and hero's basis so that light is realized along the shortest optical path (shortest time).The U.S. Patent application No.13/211 of common transfer and while pending trial, 389, with G. Harrison, the name of D.Smith and G. Wiese is submitted to simultaneously, be entitled as " method and system of making free space reflected light surface ", and indicate attorney docket IS-00354, and its content is incorporated herein this paper as a reference, and it has described a kind of embodiment, in this embodiment, the FS/UWA/RO surface of having used Fermat and Xi Luo principle to be adapted at using in the head mounted display with design.
By Fermat and the minimum time principle of Xi Luo, described image display system (for example, the image display system of any pixel) any " part of hope " of at least one light-emitting area, can make any required reflection spot on FS/UWA/RO surface, light path from the required part of at least one described light-emitting area to the reflection spot on FS/UWA/RO surface is provided, then an extreme value to user's eye rotation center.
The extreme value of light path means that the first order derivative of optical path length has reached null value, maximal value or the minimum value of expression optical path length.Extreme value can be by creating a regional area on reflected light surface, its normal (is for example divided (a) vector from regional area to user's eyes equally, from the center of regional area to the vector of user's eye center), and (b) " vector of required part (for example, from the center of regional area to the vector at light-emitting area " required part " center) from the regional area to the light-emitting area.Fig. 9 and Figure 10 show process in the case, and " the required part " of at least one light-emitting area of image display system is pixel.
Particularly, Fig. 9 shows the light-emitting area 510 of the image display system of being made up of the pel array of essentially rectangular, and is luminous towards the front of head-mounted display apparatus light beam 515 directions.Light beam 515 reflects from inverse optical surface 520, for the ease of statement, represents as the plane among Fig. 8.Through reflection, light beam 515 becomes the light beam 525 of the eyeball 530 that enters the user.
Purpose for the normal of the reflecting surface that is identified for each pixel only needs corresponding light beam 515 and 525 to determine the bisector of tri-vector.As shown in Figure 9, this bisector vector is shown as line 535 with two dimensional form.Bisector vector 535 at reflection spot 540 perpendicular to optical surface, the position of surface on 520, namely the pixel 545 of light-emitting area 510 will be visible for HMD user.
Particularly, in operation, light beam 515 in pixel 545 emission of display surface 510, rebound with an angle on reflected light surface 520, described angle is by being established corresponding to the surface normal of dividing vector 535 and vertical plane 550 thereof equally, produce by Fermat and Xi Luo principle, in the reflective pixel of reflection spot 540, seen by eye 530 along light beam 525.
In order accurately to calculate the surface normal at reflection spot 540, light beam 525 approximately passes the center 530 of user's eyes.It is stable that the result keeps substantially, even user's eyeball rotates, becomes peripheral visual acuity, and as mentioned above and Fig. 7 and shown in Figure 8, eye rotation gets too much, to such an extent as to that zone of display device can not be seen by user's eye center recessed eyesight or peripheral visual acuity.
For the position of gauging surface normal, can adopt the method for hypercomplex number, wherein
The direction of ql=light beam 515
The direction of q2=light beam 525
With
The direction of q3=desired surface discovery 535=(ql+q2)/2
Surface normal also can be described as vector representation, as shown in figure 11.In below the formula and Figure 11, some N be one away from the unit of the some M of the regional center that is arranged in reflected light surface as required, and on such direction, namely on the direction of the vertical normal of the tangent plane on the M reflected light surface of selecting.The relation that formula below the tangent plane on the reflected light surface of selecting M is controlled to satisfy is represented, thereby in three dimensions, the surface normal that makes M order is divided the line of ordering to pixel center P as required from the M point equally, and the line from the M point to user's eye rotation center C point.(only for reference, some C is from the eyes front about 13 millimeters backward):
Figure 791265DEST_PATH_IMAGE001
All point wherein, N, M, P and C have [x, y, z] to form, and are illustrated in the position in the three-dimensional cartesian coordinate system arbitrarily.
The normal line vector N-M of gained has Euclid length
Article two, the Euclid length represented of vertical line, calculate by following formula:
Figure 526974DEST_PATH_IMAGE003
As example, consider following M, P and C value:
Figure 635001DEST_PATH_IMAGE004
Point is calculated as follows along normal N:
Figure 310921DEST_PATH_IMAGE005
And
Figure 442081DEST_PATH_IMAGE006
Figure 674699DEST_PATH_IMAGE007
Shown in Figure 17 geometric configuration, bisector is between two long vectors.
The above only is that the Fermat of minimum time and the calculating of Xi Luo principle are used in a kind of representational demonstration certainly, to determine the local tangential plane angle, the surperficial manifold of free space (free form) of local tangential plane angle constraint reflector space, surperficial manifold is made up of the point in the reflector space.Be intended to present to continuous virtual image of observer.The center of the unique real constant person of being to use eyes, and the natural ken of eyes.Every other assembly can be upgraded iteratively, until forming suitable solution, is used for a given graphical presentation system and obtains the reflected light surface orientation.Another kind of mode, the image reflection position of pixel, M1, M2, ..., the matrix (adjustment) that Mn and relevant normal thereof and curvature can be considered to " warpage " makes the surface of FS/UWA/RO reach the required virtual image that forms computer generated image by image display system.
When using Fermat and Xi Luo principle, should be pointed out that in certain embodiments, need avoid such situation, namely adjust normal, make the user see identical pixel reflects above a point.Should also be noted that in certain embodiments the regional area on reflected light surface can be very little, even may be corresponding to a point on the reflection unit, point becomes other points, to produce smooth surface.
Can (for example easily concentrate at least one light-emitting area in order to ensure the user, the virtual image radius-of-curvature of the virtual image of a pixel) " required part ", the radius-of-curvature of the reflection spot of control reflection spot (reflector space) peripheral region makes the image arrival user of a collimation (or approach collimation).Image behind the collimation (or approach collimation) image has more parallel optics light, results from user's a distance far away as image, and for example tens to hundreds of rice.In order to realize such surface, corresponding at least one light-emitting area (required light emitting pixel) " required part ", the radius-of-curvature of the reflector space on reflected light surface, can keep radius approach from the reflector space to the display device on the half-distance of true " required part " of light-emitting area (real pixel).
Therefore, in one embodiment, the normal line vector of internal reflection pixel from relevant pixel to neighbor satisfies relational expression, the radius-of-curvature that they can be set up, approximately be on half the reflecting surface reflective pixel position to the display pixel vector length.The adjustment that influences this parameter comprises the size of described at least one light-emitting area, and whether described at least one light-emitting area is crooked.
Figure 10 shows this embodiment.In order to control the radius-of-curvature around the pixel region, make the image of (or approach collimation) of collimation reach the user, considered the reflector space of two adjacent pixels, as at reflection spot 540.Better balance can be thought in more zone, but two is enough.With reference to Figure 10, the reflection spot 540 and 610 of two pixels shows with respect to two pixels 545 and 615, is presented at display surface 510 respectively.Surface normal calculates along the angle between their directions at point 540 and 610.Know the some angle and distance Calculation of curvature radius between 540 and 610.Particularly, the surface arranges, and if necessary, the locus of adjusting the surface equals half of average length of (or approximating) light beam 515 and 620 up to radius-of-curvature.By this way, zero or approaching zero diopter light can be provided for user's eyes.This is equivalent to from the light of unlimited point at a distance basically, and the wave front of light is flat, causes parallel surface normal to arrive the wave front of light.
Except controlling local radius-of-curvature, in certain embodiments, some solution as first order, (or approach collimation) image with collimation enters intraocular, at least one described light-emitting area, be the distance that nominal ground is positioned at a focal length, away from the FS/UWA/RO surface, focal length wherein is based on the mean value of the radius-of-curvature of each reflector space of forming the FS/UWA/RO surface.
The result who uses Fermat and Xi Luo principle is one group of reflector space, can be combined into smooth reflecting surface.In the ordinary course of things, this surface will not be sphere or symmetrical.Figure 12 is the two-dimensional representation on such FS/UWA/RO surface 520.As mentioned above, surface 520 can constitute like this, and the radius-of-curvature of point 710 and 720 is set to provide image to observe with loosening, and image is from least one light-emitting area of image display system, and the reflection of quilt surface.In this way, when observing the specific direction with line 730 expressions, with (or approach collimation) of collimation virtual image to eyes 530 is provided, the same with the different directions of observing with line 740 expressions.Obtain level and smooth transmission in order to cross over all kens, the FS/UWA/RO surf zone may carry out the transition to another from a reference mark smoothly, can carry out by adopting non-uniform rational B-spline (NURBS) technology to be used for splined surfaces, so just produce the smooth transition on the entire emission surface.In some cases, the FS/UWA/RO surface can comprise the zone of sufficient amount, so that the surface becomes smooth at fine fraction.In certain embodiments, may provide use a progressive gradient to the employed different enlargement ratios of each part (as each pixel) that show, so that better manufacturability, realization, and picture quality.
Figure 13 and 14 shows from two different angles, the FS/UWA/RO surface that the above-mentioned technology of use is created.Figure 15 and 16 shows the version of the further refinement of reflecting surface of Figure 13 and 14 again from two aspects, these digital FS/UWA/RO surfaces are by using common transfer mentioned above and unsettled jointly, the computer based technical design of " being used for creating the method and system on free space reflected light surface " by name.
As from the foregoing, as can be seen, the method for designing of head mounted display is disclosed, in an exemplary embodiment, can comprise: determine the desirable ken, be select a display surface size (for example, width and height dimension), the relative reflecting surface of display surface of the orientation of selecting, each locations of pixels on the display surface of catalogue, and select reflecting surface on the display surface of demonstration of each pixel of a position.Display surface can be placed on the eyes top, and tilts towards reflecting surface, makes surface of emission curvature arrive user's eyes by reflected light.In a further embodiment, display surface can be placed on other positions, as eye side or eyes below, makes the reflection position of selection and curvature can reflect light from display surface or the different angle that tilts suitably.
In certain embodiments, three-dimensional example or the mathematic(al) representation of a reflecting surface can be created, as indicated above, each zone of reflecting surface has one as a regional area and divides equally from the center in zone to user's eyes and to the normal of the vector at display device surface pixels center.As discussed above, can control the radius-of-curvature of pixel reflects peripheral region, pass the ken with (or approach collimation) image of collimation and arrive the user.By the computer based iteration, variable element (for example, local normal, local curvature, the local space position) can be adjusted, be defined as the optical property level that can provide required up to parameter combinations (collection), and can aesthetic acceptance as a designing for manufacturing.
During use, in certain embodiments, asymmetrical FS/UWA/RO surface is made of the spline surface of the regional area of a plurality of focuses, forms the virtual image of at least one light-emitting area of image display system, across the ken of a broadness.The FS/UWA/RO surface may be considered to a progressive mirror or progressive bent beam separation vessel or free-form mirror or reverberator.Since eyes from level and vertical direction examine chamber and, crooked FS/UWA/RO surface with the various piece of at least one light-emitting area of image display system according to reflecting in user's the eyes.In different embodiment, whole optical system can guarantee that simultaneously the quality of image is identical with typical human visual resolution with very low cost production in enormous quantities.
According to the one-piece construction of HMD, listed in the table 1 according to the application, usually satisfy representative, and the nonrestrictive example that constitutes parameter about the HMD display device.In addition, HMD display disclosed herein has a distance between pixel usually, and this distance is enough little, sets up strong image to guarantee the user at visual plane.
Head mounted display disclosed herein can be included various functions, includes but not limited to following content, and some of them are mentioned by top:
(1) in certain embodiments, one or more Fresnel lenses can be used for adjusting the light beam diopter characteristic of sending from display surface.
(2) in certain embodiments, the reflected light surface can be translucent, allows light to enter from external environment condition.The outside image that the image that inner demonstration generates can superpose.By using positioning equipment, gyroscope for example, the software operation of camera and computer generated image, two width of cloth images can mate combination, so that virtual image is in the appropriate location in the external environment condition.Particularly, can use a camera, accelerometer, and/or gyroscope comes the record for servicing unit, it is in physical reality, and superposes its image in external view.In these embodiments, the relative transmittance on reflected light surface and the balance between the reflectivity, can select provides superimposed image attached with the appropriate brightness characteristic to the user.In addition, equally in these embodiments, it approximately is identical apparent distance that the image in the real world can appear at jointly with the image that computing machine generates, thereby makes eyes can concentrate on this two images at once.
(3) in certain embodiments, the reflected light surface keeps thin as much as possible, passes the surface to the influence of position or focus in order to reduce exterior light to greatest extent.
(4) in certain embodiments, head-mounted display apparatus provides every eyes at least 100 degree, at least 150 degree, or the ken of at least 200 degree.
(5) in certain embodiments, the head-mounted display apparatus static ken overlapping user's the nose on any very big degree not that offers every eyes.
(6) in certain embodiments, an optical prescription gradual transition to its whole optics ken can be adopted in the reflected light surface, to keep the focus on the available display area.
(7) in certain embodiments, opticpath can be used to the custom parameter of device, is used for specific enforcement, as military training, and flight simulation, recreation and other commercial application.
(8) in certain embodiments, the surface of reflected light surface and/or display device, and lens curvature (during use), and the distance between display device and the reflected light surface, distance between reflected light surface and the eye, can be with respect to a modulation transfer function (MTF) standard, in retina and/or the operation of center recess.
(9) in certain embodiments, HMD disclosed herein can be implemented in related application, but is not limited to, and for example, snipes detection, commercial training, and military training and operation and CAD make.
In case design finishes, reflected light disclosed herein surface, (for example, on the FS/UWA/RO surface) can produce, and for example, the quantity of manufacturing is used various skill and various different materials now known or exploitation thereafter.For example, the surface can be by the plastic material that has been metallized to carry out suitable reflection.Polishing plastics or glass material also can be used.Be the application of " augmented reality ", the reflected light surface can be made of the transparent material that embeds little reverberator, thereby the part of reflection incident wavefront allows the propagation of light by this material simultaneously.
For prototype parts, acrylics (for example, organic glass) may use together with the part that is formed by diamond turning.For producing parts, for example, can be acrylic compounds or polycarbonate may with, for example, use together by the part that injection molding technology forms.The reflected light surface can be described to a detailed computer-aided mapping (CAD) and describe, or as the non-homogeneous B spline curve nurbs surface, it can be converted into CAD and describe.Have cad file and can make device by using the 3-D printing and making, CAD describes can directly produce a three dimensional object, and does not need processing.
Mathematical technique discussed above can be known or exploitation subsequently now, encodes under different programmed environments and/or the programming language.The programmed environment of current first-selection is Java language, operates in the DLL (dynamic link library) of Eclipse.If necessary, also can be used for other programmed environment, for example among the Microsoft Visual C#.Calculate also can click by paying and use the Massachusetts, the Mathcad platform that Needham, Noel Joseph Terence Montgomery is sold, and/or Massachusetts, United States Natick prefecture, the Matlab platform of Math Works company.The program of gained can be stored in a hard disk drive, memory stick, and CD, or similarly install.Step is to use typical Desktop Computing equipment from various manufacturers, as DELL, and HP, Toshiba etc., optional, if desired, can use more powerful computer equipment, comprise that " cloud " calculates.
Not departing from the scope of the present invention with down spiritual, will be apparent to the various modifications of the present invention to those skilled in the art.For example, although the reflected light surface, for the user provides a big ken, for example, and more than or equal to 100 °, 150 °, or 200 ° the ken, a useful embodiment of formation design aspect of the present invention.The computer-based method and the system that are used for design reflected light disclosed herein surface also can be used for creating the surface with less ken.Following claim is intended to cover these contents and other modification, change, and the equivalent of specific embodiment is set forth in the place therewith.
Table 1
Figure 385035DEST_PATH_IMAGE008

Claims (23)

1. head-mounted display apparatus comprises:
(I) frame structure that is suitable for being installed on user's head;
(II) image display system by described frame structure supporting; With
(III) reflected light surface by described frame structure supporting, described reflected light surface is a continuous surface, rather than around any axes of coordinates rotation symmetry in the three-dimensional cartesian coordinate system;
It is characterized in that:
(a) described graphical presentation system comprises at least one light-emitting area;
(b) in use, the reflected light surface produces the space of the space separating part of at least one light-emitting area and separates virtual image, the angle intervals of at least one space separate picture virtual image that separate in other space with at least one is at least 100 degree, and described angle intervals records from the center of rotation of nominal user eyes; And
(c) in use, at least one point on reflected light surface reaches at least 100 degree with the angle intervals of other point at least on reflected light surface, and described angle intervals records from the surface at nominal user eye rotation center.
2. head-mounted display apparatus as claimed in claim 1 is characterized in that:
The virtual image angle intervals at least 150 that separate in other space of the virtual image and at least one that separate at least one space is spent; And
From other angle intervals at least 150 degree of point on reflected light surface of the point at least one reflected light surface and at least one.
3. head-mounted display apparatus as claimed in claim 1 is characterized in that:
Angular interval at least 200 degree that virtual image is separated in other space of virtual image and at least one are separated at least one space; And
Other angular interval at least 200 degree of point on reflected light surface of the point at least one reflected light surface and at least one.
4. head-mounted display apparatus as claimed in claim 1 is characterized in that, in use:
At least one space is separated virtual image and is positioned on the position of direction of gaze, and described direction of gaze passes lip-deep at least one point of described reflected light; And
At least one other space is separated virtual image and is positioned at position on the direction of gaze, and described direction of gaze passes lip-deep at least one other the point of described at least reflected light.
5. head-mounted display apparatus as claimed in claim 1 is characterized in that, described reflected light surface is translucent.
6. head-mounted display apparatus as claimed in claim 1 is characterized in that, described device has one or have only a reflected light surface.
7. head-mounted display apparatus as claimed in claim 1 is characterized in that, described device has two or have only two reflected light surfaces, corresponds respectively to every eyes of user.
8. wear-type real device comprises:
(I) frame structure that is suitable for being installed on user's head;
(II) image display system by described frame structure supporting; With
(III) is by a free space of described frame structure supporting, super wide-angle, reflected light surface;
It is characterized in that:
(a) described graphical presentation system comprises at least one light-emitting area;
(b) in use, described free space, super wide-angle, the reflected light surface produces the space of the space separating part of at least one light-emitting area and separates virtual image, the angle intervals of at least one space separate picture virtual image that separate in other space with at least one is at least 100 degree, and described angle intervals records from the center of rotation of user's eyes.
9. head-mounted display apparatus as claimed in claim 8 is characterized in that, at least one space is separated other space of virtual image and at least one and separated the angle intervals of virtual image and be at least 150 degree.
10. head-mounted display apparatus as claimed in claim 8 is characterized in that, at least one space interval virtual image angle intervals that virtual image is separated in other space with at least one is at least 200 degree.
11. head-mounted display apparatus as claimed in claim 8, it is characterized in that, described device comprise first image display system unify second image display system and with fixing corresponding first free space of described first image display system, super wide-angle, reflected light surface and with the fixing second corresponding free space of described second image display system, super wide-angle, the reflected light surface.
12. head-mounted display apparatus as claimed in claim 8 is characterized in that, described free space, and super wide-angle, the reflected light surface is translucent.
13. head-mounted display apparatus as claimed in claim 8 is characterized in that, described free space, and super wide-angle, to be at least part of collimation send light from least one light-emitting area of image display system to the reflected light surface configuration.
14. a wear-type real device comprises:
(I) frame structure that is suitable for being installed on user's head;
(II) image display system by described frame structure supporting; With
(III) by a reflecting surface of described frame structure supporting, described reflecting surface offers the ken of user's at least 200 degree;
It is characterized in that:
(a) described graphical presentation system comprises at least one light-emitting area, and described light-emitting area comprises the light-emitting zone that separate at least the first and second spaces, and the light-emitting zone that separate in described first and second spaces comprises first and second information contents respectively;
(b) described reflecting surface comprises the reflector space that separate at least the first and second spaces, comprises first and second surface normals that point to different directions respectively in the reflector space that separate in described first and second spaces; And
(c) described frame structure supports described image display system and described reflecting surface, makes the nominal user like this in using use:
(i) at least one direction of gaze of nominal user eyes, the light that sends from first light-emitting zone is by the reflection of first reflector space and enter the visual virtual image that described eyes form first information content;
(ii) at least one direction of gaze of described eyes, the light that sends from second light-emitting zone is gone forward side by side by the reflection of second reflector space and is formed the visual virtual image of the content of second information into eyes;
(ⅲ) at least one direction of gaze of described eyes, the light that sends from first light-emitting zone is gone forward side by side by the reflection of first reflector space and is formed the visual virtual image of first information content into eyes, thereby the light that sends from second light-emitting zone does not enter the visual virtual image that described eyes do not form second information content by the reflection of second reflector space.
15. the head-mounted display apparatus according to claim 14, it is characterized in that described device comprises unify second graphical presentation system and fix corresponding second reflecting surface with fixing corresponding first reflecting surface of described first image display system with described second image display system of first image display system.
16. the described head-mounted display apparatus according to claim 14 is characterized in that described reflecting surface is translucent.
17. the described head-mounted display apparatus according to claim 14 is characterized in that, reflecting surface is configured to collimate at least in part the light from least one light-emitting area emission of image display system.
18. computer-based method that is used for the design reflectivity optical surface, described reflected light surface is used for head-mounted display apparatus, described head-mounted display apparatus comprises image display system, in the use of head-mounted display apparatus, described image display system has a plurality of content regions, and described method comprises uses one or more computing machines to carry out following steps:
(a) the reflected light zone is divided into the reflector space of a plurality of parts, each local reflector space has surface normal;
(b) with each local reflex zone on reflected light surface and image display system one and have only a content regions to be associated, each content regions is associated with at least one local reflex district;
(c) setting on adjustment reflected light surface is divided each surface normal equally and is following two vectors:
(1) from the local reflex zone to the vector in its related content zone; And
(2) in using the process of head-mounted display apparatus, from the local reflex zone to the vector of nominal user eye rotation center.
19. method as claimed in claim 18 is characterized in that, the setting on described reflected light surface is adjusted to the light that at least part of collimation sends from image display device.
20. method as claimed in claim 18 is characterized in that, also comprises making the reflected light surface.
21. a computer program that is embodied in the tangible computer-readable medium is used for carrying out the method according to claim 18.
22. the computer system of a design is used for enforcement of rights and requires 18.
23. a system comprises:
(a) a kind of processor;
(b) be attached to the memory cell of described processor, described cell stores is used for the computer program that enforcement of rights requires 18 method, comprising programming instruction.
CN2011800606603A 2010-12-28 2011-12-20 Head-mounted display apparatus employing one or more reflective optical surfaces Pending CN103261944A (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201061427530P 2010-12-28 2010-12-28
US61/427,530 2010-12-28
US13/211,372 US8625200B2 (en) 2010-10-21 2011-08-17 Head-mounted display apparatus employing one or more reflective optical surfaces
US13/211,372 2011-08-17
PCT/IB2011/055820 WO2012052979A2 (en) 2010-10-21 2011-12-20 Head-mounted display apparatus employing one or more reflective optical surfaces

Publications (1)

Publication Number Publication Date
CN103261944A true CN103261944A (en) 2013-08-21

Family

ID=48964008

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011800606603A Pending CN103261944A (en) 2010-12-28 2011-12-20 Head-mounted display apparatus employing one or more reflective optical surfaces

Country Status (2)

Country Link
KR (1) KR101928764B1 (en)
CN (1) CN103261944A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103784298A (en) * 2013-11-20 2014-05-14 中国科学院光电技术研究所 Head-mounted individualized eye aberration correcting and vision training device
WO2015058625A1 (en) * 2013-10-23 2015-04-30 卫荣杰 Head mounted perspective display device
CN106842573A (en) * 2017-01-26 2017-06-13 西安可视可觉网络科技有限公司 A kind of AR or VR imaging methods and can be used for the glasses of AR or VR
CN106842569A (en) * 2016-12-30 2017-06-13 北京七鑫易维信息技术有限公司 A kind of head-mounted display apparatus and its display methods
CN107300769A (en) * 2013-11-27 2017-10-27 奇跃公司 Virtual and augmented reality System and method for
CN107797278A (en) * 2016-09-07 2018-03-13 美国梦境视觉公司 Head mounted display
CN108427193A (en) * 2017-02-14 2018-08-21 深圳梦境视觉智能科技有限公司 Augmented reality display system
CN109661687A (en) * 2016-08-02 2019-04-19 奇跃公司 Fixed range is virtual and augmented reality system and method
US10359545B2 (en) 2010-10-21 2019-07-23 Lockheed Martin Corporation Fresnel lens with reduced draft facet visibility
CN110488489A (en) * 2018-05-15 2019-11-22 苹果公司 Eyes for wearing sandwich type element are registered
US10495790B2 (en) 2010-10-21 2019-12-03 Lockheed Martin Corporation Head-mounted display apparatus employing one or more Fresnel lenses
TWI679450B (en) * 2014-10-17 2019-12-11 美商洛伊馬汀公司 Head-wearable ultra-wide field of view display device
WO2020034837A1 (en) * 2018-08-17 2020-02-20 杨建明 Augmented reality glasses
US10754156B2 (en) 2015-10-20 2020-08-25 Lockheed Martin Corporation Multiple-eye, single-display, ultrawide-field-of-view optical see-through augmented reality system

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190087061A (en) 2018-01-16 2019-07-24 주식회사 씨에스위모 Head mounted display device for a smart phone
WO2020050496A1 (en) * 2018-09-04 2020-03-12 주식회사 엠투에스 Optometric head mounted display device and ophthalmologic examination method using same
KR102455306B1 (en) 2022-05-16 2022-10-19 주식회사 라훔나노테크 Apparatus, method, and computer program for providing vision using head mount working with a smartphone

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4026641A (en) * 1975-12-30 1977-05-31 The United States Of America As Represented By The Secretary Of The Army Toric reflector display
WO1992016867A1 (en) * 1991-03-12 1992-10-01 B.V. Optische Industrie 'de Oude Delft' Helmet mountable display system and helmet provided with such a display system
CN1082228A (en) * 1992-04-21 1994-02-16 班德加普技术公司 Vertical-cavity surface-emitting laser array display system
CN1391126A (en) * 2001-06-11 2003-01-15 伊斯曼柯达公司 Optical headworn device for stereo display
US7119965B1 (en) * 2003-02-24 2006-10-10 University Of Central Florida Research Foundation, Inc. Head mounted projection display with a wide field of view
US20070091447A1 (en) * 2005-10-03 2007-04-26 Kazutaka Inoguchi Image display apparatus
CN101038598A (en) * 2006-03-17 2007-09-19 清华大学 Freeform curved surface reflector design system and method thereof
US20070236800A1 (en) * 2006-03-03 2007-10-11 Ozan Cakmakci Imaging systems for eyeglass-based display devices
CN103348278A (en) * 2010-12-16 2013-10-09 洛克希德马丁公司 Collimating display with pixel lenses

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NZ537849A (en) * 2005-01-21 2007-09-28 Peter James Hilton Direct Retinal Display projecting a scanned optical beam via diverging and converging reflectors
JP2010020065A (en) * 2008-07-10 2010-01-28 Olympus Corp Image display apparatus

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4026641A (en) * 1975-12-30 1977-05-31 The United States Of America As Represented By The Secretary Of The Army Toric reflector display
WO1992016867A1 (en) * 1991-03-12 1992-10-01 B.V. Optische Industrie 'de Oude Delft' Helmet mountable display system and helmet provided with such a display system
CN1082228A (en) * 1992-04-21 1994-02-16 班德加普技术公司 Vertical-cavity surface-emitting laser array display system
CN1391126A (en) * 2001-06-11 2003-01-15 伊斯曼柯达公司 Optical headworn device for stereo display
US7119965B1 (en) * 2003-02-24 2006-10-10 University Of Central Florida Research Foundation, Inc. Head mounted projection display with a wide field of view
US20070091447A1 (en) * 2005-10-03 2007-04-26 Kazutaka Inoguchi Image display apparatus
US20070236800A1 (en) * 2006-03-03 2007-10-11 Ozan Cakmakci Imaging systems for eyeglass-based display devices
CN101038598A (en) * 2006-03-17 2007-09-19 清华大学 Freeform curved surface reflector design system and method thereof
CN103348278A (en) * 2010-12-16 2013-10-09 洛克希德马丁公司 Collimating display with pixel lenses

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10495790B2 (en) 2010-10-21 2019-12-03 Lockheed Martin Corporation Head-mounted display apparatus employing one or more Fresnel lenses
US10359545B2 (en) 2010-10-21 2019-07-23 Lockheed Martin Corporation Fresnel lens with reduced draft facet visibility
WO2015058625A1 (en) * 2013-10-23 2015-04-30 卫荣杰 Head mounted perspective display device
CN103784298A (en) * 2013-11-20 2014-05-14 中国科学院光电技术研究所 Head-mounted individualized eye aberration correcting and vision training device
CN107300769A (en) * 2013-11-27 2017-10-27 奇跃公司 Virtual and augmented reality System and method for
CN107300769B (en) * 2013-11-27 2019-12-13 奇跃公司 Virtual and augmented reality systems and methods
TWI679450B (en) * 2014-10-17 2019-12-11 美商洛伊馬汀公司 Head-wearable ultra-wide field of view display device
US10684476B2 (en) 2014-10-17 2020-06-16 Lockheed Martin Corporation Head-wearable ultra-wide field of view display device
US10754156B2 (en) 2015-10-20 2020-08-25 Lockheed Martin Corporation Multiple-eye, single-display, ultrawide-field-of-view optical see-through augmented reality system
CN109661687A (en) * 2016-08-02 2019-04-19 奇跃公司 Fixed range is virtual and augmented reality system and method
CN109661687B (en) * 2016-08-02 2023-11-24 奇跃公司 Fixed distance virtual and augmented reality system and method
CN107797278A (en) * 2016-09-07 2018-03-13 美国梦境视觉公司 Head mounted display
CN106842569A (en) * 2016-12-30 2017-06-13 北京七鑫易维信息技术有限公司 A kind of head-mounted display apparatus and its display methods
CN106842573A (en) * 2017-01-26 2017-06-13 西安可视可觉网络科技有限公司 A kind of AR or VR imaging methods and can be used for the glasses of AR or VR
CN108427193A (en) * 2017-02-14 2018-08-21 深圳梦境视觉智能科技有限公司 Augmented reality display system
CN110488489A (en) * 2018-05-15 2019-11-22 苹果公司 Eyes for wearing sandwich type element are registered
WO2020034837A1 (en) * 2018-08-17 2020-02-20 杨建明 Augmented reality glasses

Also Published As

Publication number Publication date
KR101928764B1 (en) 2018-12-13
KR20140045291A (en) 2014-04-16

Similar Documents

Publication Publication Date Title
US10495790B2 (en) Head-mounted display apparatus employing one or more Fresnel lenses
JP6262530B2 (en) Head mounted display device using one or more reflective optical surfaces
CN103261944A (en) Head-mounted display apparatus employing one or more reflective optical surfaces
CA2815461C (en) Head-mounted display apparatus employing one or more fresnel lenses
US9720228B2 (en) Collimating display with pixel lenses
TWI553344B (en) Head-mounted display apparatus employing one or more fresnel lenses
TWI559034B (en) Head-mounted display apparatus employing one or more reflective optical surfaces
AU2015249168B2 (en) Collimating display with pixel lenses
BR112013009855B1 (en) HEAD MOUNTED DISPLAY DEVICE

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130821