GB2615825A - Improvements in or relating to waveguide display systems - Google Patents
Improvements in or relating to waveguide display systems Download PDFInfo
- Publication number
- GB2615825A GB2615825A GB2202395.6A GB202202395A GB2615825A GB 2615825 A GB2615825 A GB 2615825A GB 202202395 A GB202202395 A GB 202202395A GB 2615825 A GB2615825 A GB 2615825A
- Authority
- GB
- United Kingdom
- Prior art keywords
- image
- collimated image
- collimated
- waveguide
- discrepancy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
- G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
An image is delivered to a user and the integrity of the image is determined via a waveguide display system. The system comprises a combination waveguide, in coupling 104 and out coupling 106, 107 assembly. An in coupling region receives the collimated image and an out coupling region is configured to direct at least a portion of a received collimated image 110 toward a user’s eye 116. The waveguide system comprises a waveguide region 102 and splitter such that another portion of the collimated image is directed toward an integrity monitoring module 108 to determine discrepancies between the collimated image and the image such to correct the first portion of the collimated image. The in coupling region may direct the first portion of the collimated image to the out coupling region and the second portion to the integrity monitoring module which may comprise a sensor (figure 3, 304). The in and out coupling regions may comprise a reflective surface and a saw-tooth profile wherein the collimated image may be output to an exit pupil. The system may comprise a HUD or HMD and in a binocular arrangement.
Description
IMPROVEMENTS IN OR RELATING TO WAVEGUIDE DISPLAY SYSTEMS
[0001] The present invention relates to improvements in or relating to waveguide display systems, including but not limited to a display integrity scheme.
[0002] A display system may be required to operate with a high level of integrity. This is relevant in many situations, including for example for a flight critical display system, for use with avionics or for a targeting system used by the military. Display systems used to present safety critical information to a user are required to operate with a very high level of integrity. The display system must be able to detect when hazardously misleading information is presented to the user and act to mitigate the issue.
[0003] Often the display's integrity is monitored solely in the electronic side of the display path with no optical inspection of the display. This is possible where the display path electronics are fully understood from the generation of the image content through to the construction of the image on the display device. This typically requires a full understanding of the design and function of each component in the display path. This is not always possible, especially with the use of complex COTS (commercial off the shelf) components, such as display chipsets. With the use of COTS components within the system full access to the underlying processes and designs of the COTS items may not be possible which may lead to a more basic integrity monitoring system implemented within the display system giving inaccurate information. In these scenarios optical monitoring of the display would provide a method of closing the display path integrity loop.
[0004] Optical integrity monitoring systems previously implemented with various display systems can rely on a separate display path within the display projection optic. These optical integrity monitoring systems add mass and volume to the projection system.
When used in display systems such as a head up display (HUDs) this is not a major issue as size and weight are not key design parameters. However, in other systems where mass and volume are a key design parameter, for example in a head worn display (HWD), this type of optical integrity monitoring system is inadequate.
[0005] Existing integrity monitoring schemes which allow for basic integrity monitoring of the display device within an optical system, can perform this task by checking whether rows or columns of the display are functioning as expected.
[0006] There is thus a need for a higher fidelity integrity monitoring system, capable of detecting complex display faults and scaled appropriately such that the integrity monitoring system is usable in smaller form factor applications, such as a head worn -2 -display system. The invention provides a scheme which overcomes at least some of the disadvantages of present systems and for implementing a lightweight, low volume optical monitoring package. The invention allows for more detailed pixel level monitoring to take place.
[0007] Accordingly, one object of the present invention is to provide a waveguide display system that is able to determine the integrity of an image.
SUMMARY
[0008] According to one aspect of the present invention there is provided a system for delivering an image to a user via a waveguide display system and for determining integrity of an image, the system comprising: a combination waveguide, in coupling and out coupling assembly comprising: a waveguide region; an in coupling region configured to receive a collimated image from an imaging system and an out coupling region configured to direct the collimated image toward an eye of a user, wherein the waveguide is configured to direct at least a first portion of the collimated image from the in coupling region towards the out coupling region to be directed to the user; and wherein prior to the collimated image being directed towards the eye, a second portion of the collimated image is configured to be directed towards an integrity monitoring module which is configured to determine at least one discrepancy between the collimated image and the image to thereby correct the first portion of the collimated image.
[0009] In an aspect the in coupling and out coupling regions each comprise a surface of the waveguide assembly providing a predetermined optical effect.
[0010] In an aspect each surface of the waveguide assembly comprises a reflective coating.
[0011] In an aspect each surface of the waveguide assembly is a predetermined shape.
[0012] In an aspect the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into a +1R diffracted beam and a -1R diffracted beam. [0013] In an aspect the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into different order beams.
[0014] In an aspect the out coupling region includes a reflective surface having a saw-tooth profile.
[0015] In an aspect the collimated image comes from a collimation optic configured to output an exit pupil comprising the collimated image.
[0016] In an aspect the in coupling region directs the first portion of the collimated image towards the out coupling region and the second portion of the collimated image towards the integrity monitoring module. -3 -
[0017] In an aspect the integrity monitoring module comprises an optical arrangement configured to direct the second portion of the collimated image to a sensor.
[0018] In an aspect the integrity monitoring module is further configured to analyse the second portion of the collimated image to determine the at least one discrepancy between the collimated image and the image and to send to the system information related to at least one of the nature of the at least one discrepancy between the collimated image and the image and one or more corrections to mitigate or overcome the at least one discrepancy between the collimated image and the image.
[0019] In an aspect the system of is for use in a binocular arrangement comprising one combination waveguide, in coupling and out coupling assembly for each eye.
[0020] In an aspect a correction system is configured to implement a correction to the image such that a discrepancy between the collimated image and the image is reduced. [0021] In an aspect the discrepancy is reduced based on comparison with a threshold discrepancy.
[0022] In an aspect the integrity monitoring module comprises an optical arrangement configured to direct the second portion of the collimated image to a sensor.
[0023] In an aspect the integrity monitoring module comprises a lens element and a sensor to provide the second portion of the collimated image to a monitoring loop in which discrepancies between the collimated image and image are determined.
[0024] In an aspect the integrity monitoring module is further configured to analyse the second portion of the collimated image to determine the at least one discrepancy between the collimated image and the image and to send to the system information related to at least one of the nature of the at least one discrepancy between the collimated image and the image and one or more corrections to mitigate or overcome the at least one discrepancy between the collimated image and the image.
[0025] According to another aspect of the present invention there is provided a Heads Up Display including the system of another aspect of the invention.
[0026] According to another aspect of the present invention there is provided a head worn display system of another aspect of the invention.
[0027] According to another aspect of the present invention there is provided an integrity monitoring module for use in the system of any preceding claim, the integrity monitoring module comprising: optics configured to receive the second potion of the collimated image; direct the second potion of the collimated image towards one or more sensors configured to determine at least one discrepancy between the collimated image and the image on the second potion of the collimated image; generate an output indicative of at least one of the at least one discrepancy between the collimated image and the image -4 -and a correction to the at least one discrepancy between the collimated image and the image.
[0028] According to another aspect of the present invention there is provided a combination waveguide, in coupling and out coupling assembly for a system for delivering an image to a user via a waveguide display system and for determining integrity of an image, the combination waveguide, in coupling and out coupling assembly comprising: a waveguide region; an in coupling region configured to receive a collimated image from a display system and an out coupling region configured to direct the collimated image to an eye of a user.
[0029] In an aspect the in coupling and out coupling regions each comprise a surface of the waveguide assembly providing a predetermined optical effect.
[0030] In an aspect each surface comprises at least one of: a reflective coating, is of a predetermined shape.
[0031] In an aspect the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into different order diffractive beams.
[0032] According to another aspect of the present invention there is provided a method for delivering an image to a user via a waveguide display system and for determining integrity of an image, the method comprising: receiving via a combination waveguide, in coupling and out coupling assembly a collimated image from an imaging system; splitting the collimated image into first and second portions; directing via an out coupling region the first portion of the collimated image to an eye of a user, directing the second portion of the collimated image to an integrity monitoring module which determines at least one discrepancy between the collimated image and the image in the collimated image to DESCRIPTION OF THE DRAWINGS [0033] Figure 1 is a schematic diagram of a waveguide assembly, according to an aspect of the present invention.
[0034] Figure 2 is a schematic diagram of a waveguide assembly, according to an aspect of the present invention.
[0035] Figure 3 is a schematic diagram of an optical arrangement for an integrity monitoring optic package, according to an aspect of the present invention.
[0036] Figure 4 is a schematic diagram of an arrangement for a binocular display system utilising a single optical integrity monitoring module, according to an aspect of the present invention. -5 -
[0037] Figure 5 is a schematic diagram of an arrangement for a further binocular display system utilising a single integrity monitoring module, according to an aspect of the present invention.
[0038] Figure 6 is a schematic diagram of an arrangement for a further binocular display system utilising a single integrity monitoring module, according to an aspect of the present invention.
[0039] Figure 7 is a schematic diagram of a reflective in coupling element, according to an aspect of the present invention.
[0040] Figure 8 is a flow diagram for using the single integrity monitoring module, according to an aspect of the present invention.
[0041] Figure 9 is a flow diagram for using the single integrity monitoring module for a particular correction, according to an aspect of the present invention.
DESCRIPTION OF THE INVENTION
[0042] In general, the present invention relates to an integrity monitoring scheme (also referred to as an optical integrity monitoring system) used with waveguide-based displays which provides a scheme for checking the optical output of the display system and bypassing any issues with the use of existing components within the display path which cannot be interrogated or modified. A number of examples are presented, which make use of diffractive optical elements for an in coupling element and an out coupling element. The invention could also encompass other optical methods for the coupling of light into and out of the waveguide assembly, such as reflective structures. The image bearing light is then collected by an optical sensing element which provides a way to analyse the display content as part of the optical integrity monitoring system.
[0043] Integrity monitoring systems have been implemented in Avionic display systems or imaging which are used as primary flight instruments for some time. In some cases, the displays integrity is monitored solely in the electronic side of the display path with no optical inspection of the display. This is possible where the display path electronics are fully understood from the generation of the image content through to the construction of the image on the display device. This typically requires a full understanding of the design and function of each component in the display path. This is not always possible, especially with the use of complex COTS components, such as display chipsets. Additionally, these methods do not account for any physical changes within the optical system which might affect the display image, for example optical lenses moving causing the display image to become defocussed. In these scenarios optical monitoring of the display provides a method of closing the display path integrity loop. The optical integrity -6 -monitoring system then feeds back data which can be used to either correct discrepancies between the commanded or original image from a scene and the image displayed to the user, or inform the user of a failure within the device and removing the risk of potentially misleading information being displayed to the user. The original image may comprise a collimated image which is received from a source, such as a display, camera or any other imaging system. The collimated image comes from a collimation optic configured to output an exit pupil comprising the collimated image. This will be described in greater detail below.
[0044] In the figures described below a solid light ray (primary path) represents the part of light directed towards a user and the dotted line (secondary path) represents the part of light directed to an optical integrity monitoring module.
[0045] Referring to Figure 1, an optical system 100 (also referred to as a waveguide assembly) is shown. The optical system includes a pupil expansion device including a waveguide substrate 102, an in coupling region 104 and, in this example, two out coupling regions 106 and 107. The waveguide substrate may also include one or more additional optical elements on or within the substrate for performing additional optical functions. The waveguide substrate (also referred to as the waveguide region) 102 allows light to be directed between and beyond the in and out coupling regions. The waveguide substrate is shown in cross-section and has substantially parallel sides although this is not essential. The waveguide assembly is described in Figure 7 below.
In addition, the system includes an integrity monitoring module 108, which is ideally an optical integrity monitoring module.
[0046] The in coupling region directs the majority of the light 110 along a primary path 112 (shown as a solid line) towards the out coupling region 106 which then expands the pupil and directs light 114 out of the waveguide assembly towards the users eye 116.
In the case of the diffractive in coupling regions, the primary path 112 is created by the +1R diffracted order (reflected order). Simultaneously the in coupling region 104 directs a smaller proportion of the incident light along a secondary path 118 within the waveguide assembly (shown by the dashed line) towards the secondary out coupling region 107. This secondary path is created by the -1R diffracted order (reflected order).
The secondary out coupling region 107 directs the light out of the waveguide assembly which is then collected by the optical integrity monitoring module 108.
[0047] The split of light between the positive and negative diffractive orders can be controlled by the shape of the diffractive structure and any coating applied to the structure. This will be described in more detail below. This aspect of the invention makes -7 -use of the +1 and -1 orders; however, any diffractive orders could be utilised to split the light paths. The out coupling regions may be the conjugate of the in coupling region to conserve the angles of the light paths injected into and ejected from the waveguide assembly. The secondary out coupling region could also be configured to be used in transmission rather than reflection. Other optical systems having the ability to split and transmit the light as required may also be used.
[0048] The optical integrity monitoring module is configured to analyse portion 118 to determine at least one optical discrepancy between an original collimated and received image and to send to the system information related to at least one of the nature of the optical discrepancies between the original and received image and one or more corrections to mitigate or overcome the optical discrepancies between the original and received image. The manner in which the integrity module analyses and determines discrepancies is discussed further below with reference to figure 10 and 11.
[0049] Referring now to Figure 2, which shows a similar arrangement to the Figure 1 scheme. In this arrangement 200 the light traveling along the secondary path 118 is coupled out of the waveguide assembly by a prismatic feature 202. The light coupled from the waveguide assembly is then collected by the optical integrity monitoring module 108. If the in coupling region 104 is diffractive and the incident light bundle 110 is polychromatic or broad in terms of wavelength there may be some limitations. The chromatic spread of light induced by the diffractive region may not be compensated for by the prismatic element, therefore light collected by the optical integrity monitoring module will include some optical discrepancies between the original and received image in comparison to the light injected into the waveguide assembly. This can be overcome by using narrow spectrum light sources and compensating for any lateral colour effects in the optical integrity monitoring module. It is also an option to filter the light collected by the optical integrity monitoring module to a narrower spectrum than the light used within the display path.
[0050] Figure 3 shows an example of an optical arrangement of the optical integrity monitoring module 108. There are several options for the optical integrity monitoring module. In one option the monitor could be a simple camera system, where the light 300 captured is focused by one or more lens elements 302 onto a sensor 304 to provide an image of the displayed content. It is possible to provide a greater complexity of monitoring from pixel level integrity monitoring to a simpler monitoring of specific displayed elements where the resolution of the camera is matched to or greater than that of the display system. The sensing element could also be of a more basic nature and could range from a simple single photodiode capable of measuring light levels to multiple -8 -light detection sites providing resolution across the displayed image. The sensing element could be colour capable. It will be appreciated that many options are possible.
[0051] Figure 4, Figure 5, and Figure 6 show how an arrangement for a binocular display system may work whilst utilising a single optical integrity monitoring module 108 In these figures the same reference applies to corresponding features.
[0052] The arrangement 400 in Figure 4 comprises a wave guide assembly 401a and 401b for each eye. Each waveguide assembly is similar to the assembly shown in either Figure 1 or 2. According each waveguide assembly includes a respective waveguide and pupil expanders, respective in coupler regions 404a and 404b and respective out coupler regions 406a and 406b and 407a, 407b. The arrangement also includes the optical integrity monitoring module 108. Each in coupler region receives light 410a and 410b and splits each into two portions of light 412a, 412b and 414a, 414b. The light 414a and 414b which passes through the waveguide assembly and is collected by the optical integrity monitoring module 108 from both waveguide assemblies 401a and 401b is directed to a desired position on a sensor 416 via lens or lenses 418.
[0053] In Figure 4 light out coupled from the waveguide assemblies is collected by the single optical integrity monitoring module 108. Light from both waveguide assemblies will occupy the same area on the optical integrity monitoring module. In this arrangement it would be possible if the display was bi-ocular (same image presented to both eyes) then integrity monitoring of each channel could be conducted by monitoring luminance intensifies as well as positional content on the sensor. If image content was only being shown to one eye rather than two, the measured intensity would be lower than expected, indicating a fault. In the case of a binocular display system (different image to each eye) the integrity monitoring could make use of time multiplexing to split the images.
For example, the image to the left eye is driven by its display device, and then blanked, during this blanking period the image to the right eye is driven by its display device, and then blanked and so on. In synchronisation with this display drive arrangement, the optical integrity monitoring module is configured to capture sequentially frames 420b, 420a respectively at the same time as the image is displayed to the left eye, and subsequently timed to capture the separate image driven to the right eye.
[0054] The arrangements shown in Figure 5 and Figure 6 solve the problem of the light collected from each waveguide assembly occupying the same area on the sensor by deviating the light paths. In the case of Figure 5, light out coupled by the secondary out couplers passes through a beam deviator 420. This beam deviator acts like a prism, imparting an angular deviation to the light's path. If the angle and refractive index of the -9 -material of the beam deviator are selected correctly, it is possible to separate the field of view from each of the waveguide assemblies so that they are separated physically on the sensor. This results in two images being received by the sensor side by side, allowing for the analysis of both images simultaneously.
[0055] In Figure 6 the secondary out coupling region imposes a deviation to the out coupled light. In the case of diffractive regions, this could be achieved by changing the pitch and/or spacing of the diffractive structure. This may have similar chromatic limitations as described previously in relation to Figure 2. In the case of reflective structures being used in the out coupling region, the angular deviation could be achieved by altering the reflective facet angle.
[0056] In order to provide optical monitoring of the left eye display and right eye display separately the display system may use time multiplexing to split the images or to switch between the left and right displays. For example, each image is displayed at one eye and then the other. In the time the image is being displayed at one eye the other may be blanked In synchronisation with this display drive arrangement the sensor is configured to capture a frame at the same time as the image is displayed to the left eye, and subsequently timed to capture the separate image driven to the right eye. In order to determine the optical discrepancies between the original collimated image and actual image displayed to each eye and caused in the system would thus require a complex analysis.
[0057] Figure 7 shows waveguide assembly 101 including a waveguide substrate 102, an in coupling region 104 and an out coupling region 106. The waveguide substrate includes internal surfaces that are substantially parallel to one another, shown as regions 702, 704 and 706. These surfaces enable internal reflection of light through the waveguide assembly. As previously described light enters the waveguide substrate via the in coupling region and is split and directed proportionately in the primary path and the secondary path. Each of the in coupling and out coupling regions are configured to provide an optical effect to light incident thereon. The effect can be predetermined by the shape, size and nature of the required optical effect. For example, the in coupling region includes an internal reflective surface 700 which splits the light into the +1R and -1R beams 112 and 118. The proportion of light transmitted in each order can be controlled or dictated by the form, shape and/or size of optical surface 700. In the example shown the reflective surface is a saw-tooth wave form. It will be appreciated different forms could be used. It will also be appreciated that the in coupling region could be laser based or any other appropriate type of optic.
-10 - [0058] Similarly, light that passes along the secondary path 118 exits via an out coupling region 106 having a reflective surface 708. This surface again incudes a saw-tooth form. Light is passed to the optical integrity monitoring module 108 for processing as discussed above. As can be seen the saw-tooth form of the out coupler has a different form than that of the in coupler. This changes how the light is directed. It should be noted that the form, shape and size of any optical region can be changed to adapt to the nature of the waveguide assembly and the overall system and/or system intent.
[0059] Figure 7 is not in proportion, and it will be understood that waveguide substrates 702, 704 and 706 will comprise the main proportion of the waveguide assembly and the in coupling and out coupling regions will be sized as required.
[0060] The waveguide assembly of the present invention can be coupled to the optical integrity monitoring module, which may or may not be part of the system. As the waveguide assembly is a combined waveguide substrate, in coupler and out coupler, the assembly is formed as a single compact component which is relatively lighter in weight than the individual separate elements.
[0061] In all schemes the light extracted for integrity monitoring is analysed to determine if there are any optical discrepancies between the original and received image introduced by the display system. Information relating to any such optical discrepancies between the original and received image is fed back to a correction system (not shown) to apply a correction to the light arriving at the eye of the user.
[0062] The integrity monitoring module is able to detect and generate corrections for all optical discrepancies between the original and actual image. There are several possible uses for the integrity monitoring system. In a basic usage scenario, the integrity monitoring system looks for discrepancies between the collimated image and the displayed image, any discrepancy can then be compared to a pre-set threshold value for that discrepancy type. If the discrepancy exceeds the threshold value, then the user is made aware of a fault within the system via a correction or feedback system forming part of the overall system.
[0063] In another scenario it may be the case that the fault is a frozen display i.e. the display is not being updated with the latest image. In this case the user may be made aware of the issue by the display channel being switched oft This would prevent the user being exposed to misleading information. In more complex systems it could be that a portion or section of the image is incorrect, due to "stuck pixels" in the display generator. In this case it may be possible to reposition information which would be displayed over those pixels to another position on the display, therefore still providing the correct information to the user albeit in a different location.
[0064] The integrity monitoring system may be capable of monitoring the following discrepancies in the display path: [0065] Magnification error resulting in incorrect image scaling.
[0066] Image shift causing the image to not align correctly with the outside world. [0067] Image rotation.
[0068] Colour channel failure, causing the loss of some commanded colours and the incorrect rendering of mixed colours.
[0069] Luminance discrepancies, the image being displayed to the eye not corresponding to the set! commanded brightness level.
[0070] Display failure, no image being displayed to the user.
[0071] In some cases, a correction may be able to be applied to the driven image to mitigate the detected failure, such as a luminance adjustment, an image shift/rotation.
However, in some other cases such as colour channel failure, the user could be made aware of the reduced colour palette being made available. The information may still be displayed to the user, but perhaps in monochrome, removing the advantage of colour coded symbols etc. but still allowing the user to see an accurate representation of the image.
[0072] Figure 8 shows and example of a generic monitoring process 800. An image is generated, 802, by the system or any appropriate image generating means. The image is created or drawn 804, so that is can be displayed. The created image is projected 806, though the relevant optical system, in this case system 100. A portion of light is directed towards a user 808 and a portion towards the monitor including the integrity monitoring module 810. The portion directed towards the monitor passes through a monitoring loop 812 in which discrepancies between the original collimated image and actual image are determined or identified. The image is then redrawn, recreated, corrected, blanked or otherwise altered 814 and then returned to step 802 in which the image is generated.
[0073] Figure 9 shows the process for one specific discrepancy by way of example. This this case the example 900 is an image shift fault detection. A position of a symbol in the image is detected 902. The symbol position in the commanded or original image is input (symbology input) 904. The detected image and the original image are compared 906. A determination is made as to whether there is a discrepancy between the images 908.
If no, the process continues to monitor the display 910 and no additional action is taken.
If yes, the process seeks a relevant threshold value 912 which is then compared with the discrepancy, 914. If the discrepancy does not exceed the threshold the process -12 -continues to monitor the display 916 and no additional action is taken. If the discrepancy does exceed the threshold the process sends a fault code to the system 918. The system Control Processing Unit (CPU) causes corrective action (920) to be taken, such as for example blanking the display or otherwise alerting the user.
[0074] The invention is intended to be used in waveguide HWDs, however its use is not limited to HVVDs and could be implemented on the waveguide HUD system. Whilst the invention provides the ability to monitor the integrity of the images displayed to the user, it could also be implemented in a simpler form to monitor display brightness and colour. In these examples the sensor in the optical integrity monitoring module would be appropriate to the intended type of monitoring.
[0075] Although the present invention has been described in connection with some embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the scope of the present invention is limited only by the accompanying claims. Additionally, although a feature may appear to be described in connection with particular embodiments, one skilled in the art would recognize that various features of the described embodiments may be combined in accordance with the invention. In the claims, the term 'comprising' does not exclude the presence of other elements or steps.
[0076] Furthermore, the order of features in the claims does not imply any specific order in which the features must be performed and in particular the order of individual steps in a method claim does not imply that the steps must be performed in this order. Rather, the steps may be performed in any suitable order. In addition, singular references do not exclude a plurality. Thus, references to 'a', 'an', 'first, 'second', etc. do not preclude a plurality. In the claims, the term 'comprising' or "including" does not exclude the presence of other elements.
Claims (25)
- -13 -CLAIMS1. A system for delivering an image to a user via a waveguide display system and for determining integrity of an image, the system comprising: a combination waveguide, in coupling and out coupling assembly comprising: a waveguide region; an in coupling region configured to receive a collimated image from an imaging system and an out coupling region configured to direct the collimated image toward an eye of a user, wherein the waveguide is configured to direct at least a first portion of the collimated image from the in coupling region towards the out coupling region to be directed to the user; and wherein prior to the collimated image being directed towards the eye, a second portion of the collimated image is configured to be directed towards an integrity monitoring module which is configured to determine at least one discrepancy between the collimated image and the image to thereby correct the first portion of the collimated image.
- 2. The system of claim 1, wherein the in coupling and out coupling regions each comprise a surface of the waveguide assembly providing a predetermined optical effect.
- 3. The system of claim 2, wherein each surface of the waveguide assembly comprises a reflective coating.
- 4. The system of claim 2 or claim 3, wherein each surface of the waveguide assembly is a predetermined shape.
- 5. The system of any one of claims 2 to 4, wherein the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into a +1R beam and a -1R beam.
- 6. The system of any one of claims 2 to 4, wherein the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into different order beams.
- 7. The system of any one of claims 2 to 6, wherein the out coupling region includes a reflective surface having a saw-tooth profile.
- 8. The system of any preceding claim, wherein the collimated image comes from a collimation optic configured to output an exit pupil comprising the collimated image.
- 9. The system of any one of claims 1 to 8, wherein the in coupling region directs the first portion of the collimated image towards the out coupling region and the second portion of the collimated image towards the integrity monitoring module.
- 10. The system of any preceding claim, wherein the integrity monitoring module comprises an optical arrangement configured to direct the second portion of the collimated image to a sensor.
- 11. The system of claim 10, wherein the integrity monitoring module is further configured to analyse the second portion of the collimated image to determine the at least one discrepancy between the collimated image and the image and to send to the system information related to at least one of the nature of the at least one discrepancy between the collimated image and the image and one or more corrections to mitigate or overcome the at least one discrepancy between the collimated image and the image.
- 12. The system of any preceding claim for use in a binocular arrangement comprising one combination waveguide, in coupling and out coupling assembly for each eye.
- 13. The system of any preceding claim, further comprising a correction system configured to implement a correction to the image such that a discrepancy between the collimated image and the image is reduced.
- 14. The system of claim 13, wherein the discrepancy is reduced based on comparison with a threshold discrepancy.
- 15. The system of any preceding claim, wherein the integrity monitoring module comprises an optical arrangement configured to direct the second portion of the collimated image to a sensor.
- 16. The system of any preceding claim, wherein the integrity monitoring module comprises a lens element and a sensor to provide the second portion of the collimated image to a monitoring loop in which discrepancies between the collimated image and image are determined.
- 17. The system of claim 16, wherein the integrity monitoring module is further configured to analyse the second portion of the collimated image to determine the at least one discrepancy between the collimated image and the image and to send to the system information related to at least one of the nature of the at least one discrepancy between the collimated image and the image and one or more corrections to mitigate or overcome the at least one discrepancy between the collimated image and the image.
- 18. A Heads Up Display including the system of any preceding claim.
- 19. A head worn display system including the system of any one of claims 1 to 17.
- 20. An integrity monitoring module for use in the system of any preceding claim, the integrity monitoring module comprising: optics configured to receive the second potion of the collimated image; -16 -direct the second potion of the collimated image towards one or more sensors configured to determine at least one discrepancy between the collimated image and the image on the second potion of the collimated image; generate an output indicative of at least one of the at least one discrepancy between the collimated image and the image and a correction to the at least one discrepancy between the collimated image and the image.
- 21. A combination waveguide, in coupling and out coupling assembly for a system for delivering an image to a user via a waveguide display system and for determining integrity of an image, the combination waveguide, in coupling and out coupling assembly comprising: a waveguide region; an in coupling region configured to receive a collimated image from a display system and an out coupling region configured to direct the collimated image to an eye of a user.
- 22. The assembly of claim 21, wherein the in coupling and out coupling regions each comprise a surface of the waveguide assembly providing a predetermined optical 20 effect.
- 23. The assembly of claim 22, wherein each surface comprises at least one of: a reflective coating, is of a predetermined shape.
- 24. The assembly of any one of claims 21 to 23, wherein the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into different order diffractive beams.
- 25. A method for delivering an image to a user via a waveguide display system and for determining integrity of an image, the method comprising: receiving via a combination waveguide, in coupling and out coupling assembly a collimated image from an imaging system; -17 -splitting the collimated image into first and second portions; directing via an out coupling region the first portion of the collimated image to an eye of a user, directing the second portion of the collimated image to an integrity monitoring module which determines at least one discrepancy between the collimated image and the image in the collimated image to correct the first portion of the collimated image.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB2202395.6A GB2615825A (en) | 2022-02-22 | 2022-02-22 | Improvements in or relating to waveguide display systems |
PCT/GB2023/050346 WO2023161607A1 (en) | 2022-02-22 | 2023-02-15 | Improvements in or relating to waveguide display systems |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB2202395.6A GB2615825A (en) | 2022-02-22 | 2022-02-22 | Improvements in or relating to waveguide display systems |
Publications (2)
Publication Number | Publication Date |
---|---|
GB202202395D0 GB202202395D0 (en) | 2022-04-06 |
GB2615825A true GB2615825A (en) | 2023-08-23 |
Family
ID=80934441
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
GB2202395.6A Pending GB2615825A (en) | 2022-02-22 | 2022-02-22 | Improvements in or relating to waveguide display systems |
Country Status (1)
Country | Link |
---|---|
GB (1) | GB2615825A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130108229A1 (en) * | 2011-10-28 | 2013-05-02 | Google Inc. | Heads-up display including ambient light control |
WO2017105868A1 (en) * | 2015-12-17 | 2017-06-22 | Microsoft Technology Licensing, Llc | Reducing ghost images in a head mounted display |
US20170357089A1 (en) * | 2016-06-09 | 2017-12-14 | Microsoft Technology Licensing, Llc | Wrapped Waveguide With Large Field Of View |
US20180164583A1 (en) * | 2016-12-09 | 2018-06-14 | R. Andrew Wall | Display device system with tilted lens group to prevent ghost images |
US10606079B1 (en) * | 2017-06-06 | 2020-03-31 | Rockwell Collins, Inc. | Image integrity monitoring systems and methods for light processing based head up displays |
EP3726272A1 (en) * | 2019-04-18 | 2020-10-21 | BAE SYSTEMS plc | Optical arrangement for a display |
-
2022
- 2022-02-22 GB GB2202395.6A patent/GB2615825A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130108229A1 (en) * | 2011-10-28 | 2013-05-02 | Google Inc. | Heads-up display including ambient light control |
WO2017105868A1 (en) * | 2015-12-17 | 2017-06-22 | Microsoft Technology Licensing, Llc | Reducing ghost images in a head mounted display |
US20170357089A1 (en) * | 2016-06-09 | 2017-12-14 | Microsoft Technology Licensing, Llc | Wrapped Waveguide With Large Field Of View |
US20180164583A1 (en) * | 2016-12-09 | 2018-06-14 | R. Andrew Wall | Display device system with tilted lens group to prevent ghost images |
US10606079B1 (en) * | 2017-06-06 | 2020-03-31 | Rockwell Collins, Inc. | Image integrity monitoring systems and methods for light processing based head up displays |
EP3726272A1 (en) * | 2019-04-18 | 2020-10-21 | BAE SYSTEMS plc | Optical arrangement for a display |
Also Published As
Publication number | Publication date |
---|---|
GB202202395D0 (en) | 2022-04-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7023621B2 (en) | Device and method for the laser projection of high-resolution images onto the retina of the eye, superimposed with the image content of the field of vision | |
US11226261B2 (en) | Optical device testing method and apparatus | |
US10685431B1 (en) | Optical measurement system | |
US10205888B2 (en) | Endoscope system | |
CN117055231A (en) | Eye projection system and method | |
US20060131492A1 (en) | Displaying optical system | |
US10495887B1 (en) | Multifocal system with polarizing elements | |
US10606079B1 (en) | Image integrity monitoring systems and methods for light processing based head up displays | |
US10921644B1 (en) | Liquid crystal display backlight utilizing reflective stack | |
US20190019448A1 (en) | Redundant microleds of multiple rows for compensation of defective microled | |
IL292453A (en) | Laser-illuminated displays with enhanced uniformity and/or eye safety | |
CN110596895A (en) | Near-to-eye display device and projection feedback method | |
US20220326655A1 (en) | Optical assembly and method for reducing zero-order light in a holographic display | |
US20130342905A1 (en) | Head-up display and optical projection system for a head-up display | |
CN114008512B (en) | Display with foveal optical correction | |
CN115280218A (en) | High resolution liquid crystal display | |
US20220082835A1 (en) | Image display apparatus and head-mounted display | |
JP2009282085A (en) | Optical device and image display equipped with the same | |
EP4231082A1 (en) | Improvements in or relating to waveguide display systems | |
US20020118449A1 (en) | Device and method for controlling the brightness or color of a superimposed image in an optical viewing device | |
GB2615825A (en) | Improvements in or relating to waveguide display systems | |
WO2023161607A1 (en) | Improvements in or relating to waveguide display systems | |
EP4231081A1 (en) | Improvements in or relating to waveguide display systems | |
WO2023161606A1 (en) | Improvements in or relating to waveguide display systems | |
GB2615824A (en) | Improvements in or relating to waveguide display systems |