GB2615825A - Improvements in or relating to waveguide display systems - Google Patents

Improvements in or relating to waveguide display systems Download PDF

Info

Publication number
GB2615825A
GB2615825A GB2202395.6A GB202202395A GB2615825A GB 2615825 A GB2615825 A GB 2615825A GB 202202395 A GB202202395 A GB 202202395A GB 2615825 A GB2615825 A GB 2615825A
Authority
GB
United Kingdom
Prior art keywords
image
collimated image
collimated
waveguide
discrepancy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
GB2202395.6A
Other versions
GB202202395D0 (en
Inventor
Thomas Macken Ian
Mills Rory
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BAE Systems PLC
Original Assignee
BAE Systems PLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BAE Systems PLC filed Critical BAE Systems PLC
Priority to GB2202395.6A priority Critical patent/GB2615825A/en
Publication of GB202202395D0 publication Critical patent/GB202202395D0/en
Priority to PCT/GB2023/050346 priority patent/WO2023161607A1/en
Publication of GB2615825A publication Critical patent/GB2615825A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0132Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0141Head-up displays characterised by optical features characterised by the informative content of the display

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An image is delivered to a user and the integrity of the image is determined via a waveguide display system. The system comprises a combination waveguide, in coupling 104 and out coupling 106, 107 assembly. An in coupling region receives the collimated image and an out coupling region is configured to direct at least a portion of a received collimated image 110 toward a user’s eye 116. The waveguide system comprises a waveguide region 102 and splitter such that another portion of the collimated image is directed toward an integrity monitoring module 108 to determine discrepancies between the collimated image and the image such to correct the first portion of the collimated image. The in coupling region may direct the first portion of the collimated image to the out coupling region and the second portion to the integrity monitoring module which may comprise a sensor (figure 3, 304). The in and out coupling regions may comprise a reflective surface and a saw-tooth profile wherein the collimated image may be output to an exit pupil. The system may comprise a HUD or HMD and in a binocular arrangement.

Description

IMPROVEMENTS IN OR RELATING TO WAVEGUIDE DISPLAY SYSTEMS
[0001] The present invention relates to improvements in or relating to waveguide display systems, including but not limited to a display integrity scheme.
[0002] A display system may be required to operate with a high level of integrity. This is relevant in many situations, including for example for a flight critical display system, for use with avionics or for a targeting system used by the military. Display systems used to present safety critical information to a user are required to operate with a very high level of integrity. The display system must be able to detect when hazardously misleading information is presented to the user and act to mitigate the issue.
[0003] Often the display's integrity is monitored solely in the electronic side of the display path with no optical inspection of the display. This is possible where the display path electronics are fully understood from the generation of the image content through to the construction of the image on the display device. This typically requires a full understanding of the design and function of each component in the display path. This is not always possible, especially with the use of complex COTS (commercial off the shelf) components, such as display chipsets. With the use of COTS components within the system full access to the underlying processes and designs of the COTS items may not be possible which may lead to a more basic integrity monitoring system implemented within the display system giving inaccurate information. In these scenarios optical monitoring of the display would provide a method of closing the display path integrity loop.
[0004] Optical integrity monitoring systems previously implemented with various display systems can rely on a separate display path within the display projection optic. These optical integrity monitoring systems add mass and volume to the projection system.
When used in display systems such as a head up display (HUDs) this is not a major issue as size and weight are not key design parameters. However, in other systems where mass and volume are a key design parameter, for example in a head worn display (HWD), this type of optical integrity monitoring system is inadequate.
[0005] Existing integrity monitoring schemes which allow for basic integrity monitoring of the display device within an optical system, can perform this task by checking whether rows or columns of the display are functioning as expected.
[0006] There is thus a need for a higher fidelity integrity monitoring system, capable of detecting complex display faults and scaled appropriately such that the integrity monitoring system is usable in smaller form factor applications, such as a head worn -2 -display system. The invention provides a scheme which overcomes at least some of the disadvantages of present systems and for implementing a lightweight, low volume optical monitoring package. The invention allows for more detailed pixel level monitoring to take place.
[0007] Accordingly, one object of the present invention is to provide a waveguide display system that is able to determine the integrity of an image.
SUMMARY
[0008] According to one aspect of the present invention there is provided a system for delivering an image to a user via a waveguide display system and for determining integrity of an image, the system comprising: a combination waveguide, in coupling and out coupling assembly comprising: a waveguide region; an in coupling region configured to receive a collimated image from an imaging system and an out coupling region configured to direct the collimated image toward an eye of a user, wherein the waveguide is configured to direct at least a first portion of the collimated image from the in coupling region towards the out coupling region to be directed to the user; and wherein prior to the collimated image being directed towards the eye, a second portion of the collimated image is configured to be directed towards an integrity monitoring module which is configured to determine at least one discrepancy between the collimated image and the image to thereby correct the first portion of the collimated image.
[0009] In an aspect the in coupling and out coupling regions each comprise a surface of the waveguide assembly providing a predetermined optical effect.
[0010] In an aspect each surface of the waveguide assembly comprises a reflective coating.
[0011] In an aspect each surface of the waveguide assembly is a predetermined shape.
[0012] In an aspect the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into a +1R diffracted beam and a -1R diffracted beam. [0013] In an aspect the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into different order beams.
[0014] In an aspect the out coupling region includes a reflective surface having a saw-tooth profile.
[0015] In an aspect the collimated image comes from a collimation optic configured to output an exit pupil comprising the collimated image.
[0016] In an aspect the in coupling region directs the first portion of the collimated image towards the out coupling region and the second portion of the collimated image towards the integrity monitoring module. -3 -
[0017] In an aspect the integrity monitoring module comprises an optical arrangement configured to direct the second portion of the collimated image to a sensor.
[0018] In an aspect the integrity monitoring module is further configured to analyse the second portion of the collimated image to determine the at least one discrepancy between the collimated image and the image and to send to the system information related to at least one of the nature of the at least one discrepancy between the collimated image and the image and one or more corrections to mitigate or overcome the at least one discrepancy between the collimated image and the image.
[0019] In an aspect the system of is for use in a binocular arrangement comprising one combination waveguide, in coupling and out coupling assembly for each eye.
[0020] In an aspect a correction system is configured to implement a correction to the image such that a discrepancy between the collimated image and the image is reduced. [0021] In an aspect the discrepancy is reduced based on comparison with a threshold discrepancy.
[0022] In an aspect the integrity monitoring module comprises an optical arrangement configured to direct the second portion of the collimated image to a sensor.
[0023] In an aspect the integrity monitoring module comprises a lens element and a sensor to provide the second portion of the collimated image to a monitoring loop in which discrepancies between the collimated image and image are determined.
[0024] In an aspect the integrity monitoring module is further configured to analyse the second portion of the collimated image to determine the at least one discrepancy between the collimated image and the image and to send to the system information related to at least one of the nature of the at least one discrepancy between the collimated image and the image and one or more corrections to mitigate or overcome the at least one discrepancy between the collimated image and the image.
[0025] According to another aspect of the present invention there is provided a Heads Up Display including the system of another aspect of the invention.
[0026] According to another aspect of the present invention there is provided a head worn display system of another aspect of the invention.
[0027] According to another aspect of the present invention there is provided an integrity monitoring module for use in the system of any preceding claim, the integrity monitoring module comprising: optics configured to receive the second potion of the collimated image; direct the second potion of the collimated image towards one or more sensors configured to determine at least one discrepancy between the collimated image and the image on the second potion of the collimated image; generate an output indicative of at least one of the at least one discrepancy between the collimated image and the image -4 -and a correction to the at least one discrepancy between the collimated image and the image.
[0028] According to another aspect of the present invention there is provided a combination waveguide, in coupling and out coupling assembly for a system for delivering an image to a user via a waveguide display system and for determining integrity of an image, the combination waveguide, in coupling and out coupling assembly comprising: a waveguide region; an in coupling region configured to receive a collimated image from a display system and an out coupling region configured to direct the collimated image to an eye of a user.
[0029] In an aspect the in coupling and out coupling regions each comprise a surface of the waveguide assembly providing a predetermined optical effect.
[0030] In an aspect each surface comprises at least one of: a reflective coating, is of a predetermined shape.
[0031] In an aspect the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into different order diffractive beams.
[0032] According to another aspect of the present invention there is provided a method for delivering an image to a user via a waveguide display system and for determining integrity of an image, the method comprising: receiving via a combination waveguide, in coupling and out coupling assembly a collimated image from an imaging system; splitting the collimated image into first and second portions; directing via an out coupling region the first portion of the collimated image to an eye of a user, directing the second portion of the collimated image to an integrity monitoring module which determines at least one discrepancy between the collimated image and the image in the collimated image to DESCRIPTION OF THE DRAWINGS [0033] Figure 1 is a schematic diagram of a waveguide assembly, according to an aspect of the present invention.
[0034] Figure 2 is a schematic diagram of a waveguide assembly, according to an aspect of the present invention.
[0035] Figure 3 is a schematic diagram of an optical arrangement for an integrity monitoring optic package, according to an aspect of the present invention.
[0036] Figure 4 is a schematic diagram of an arrangement for a binocular display system utilising a single optical integrity monitoring module, according to an aspect of the present invention. -5 -
[0037] Figure 5 is a schematic diagram of an arrangement for a further binocular display system utilising a single integrity monitoring module, according to an aspect of the present invention.
[0038] Figure 6 is a schematic diagram of an arrangement for a further binocular display system utilising a single integrity monitoring module, according to an aspect of the present invention.
[0039] Figure 7 is a schematic diagram of a reflective in coupling element, according to an aspect of the present invention.
[0040] Figure 8 is a flow diagram for using the single integrity monitoring module, according to an aspect of the present invention.
[0041] Figure 9 is a flow diagram for using the single integrity monitoring module for a particular correction, according to an aspect of the present invention.
DESCRIPTION OF THE INVENTION
[0042] In general, the present invention relates to an integrity monitoring scheme (also referred to as an optical integrity monitoring system) used with waveguide-based displays which provides a scheme for checking the optical output of the display system and bypassing any issues with the use of existing components within the display path which cannot be interrogated or modified. A number of examples are presented, which make use of diffractive optical elements for an in coupling element and an out coupling element. The invention could also encompass other optical methods for the coupling of light into and out of the waveguide assembly, such as reflective structures. The image bearing light is then collected by an optical sensing element which provides a way to analyse the display content as part of the optical integrity monitoring system.
[0043] Integrity monitoring systems have been implemented in Avionic display systems or imaging which are used as primary flight instruments for some time. In some cases, the displays integrity is monitored solely in the electronic side of the display path with no optical inspection of the display. This is possible where the display path electronics are fully understood from the generation of the image content through to the construction of the image on the display device. This typically requires a full understanding of the design and function of each component in the display path. This is not always possible, especially with the use of complex COTS components, such as display chipsets. Additionally, these methods do not account for any physical changes within the optical system which might affect the display image, for example optical lenses moving causing the display image to become defocussed. In these scenarios optical monitoring of the display provides a method of closing the display path integrity loop. The optical integrity -6 -monitoring system then feeds back data which can be used to either correct discrepancies between the commanded or original image from a scene and the image displayed to the user, or inform the user of a failure within the device and removing the risk of potentially misleading information being displayed to the user. The original image may comprise a collimated image which is received from a source, such as a display, camera or any other imaging system. The collimated image comes from a collimation optic configured to output an exit pupil comprising the collimated image. This will be described in greater detail below.
[0044] In the figures described below a solid light ray (primary path) represents the part of light directed towards a user and the dotted line (secondary path) represents the part of light directed to an optical integrity monitoring module.
[0045] Referring to Figure 1, an optical system 100 (also referred to as a waveguide assembly) is shown. The optical system includes a pupil expansion device including a waveguide substrate 102, an in coupling region 104 and, in this example, two out coupling regions 106 and 107. The waveguide substrate may also include one or more additional optical elements on or within the substrate for performing additional optical functions. The waveguide substrate (also referred to as the waveguide region) 102 allows light to be directed between and beyond the in and out coupling regions. The waveguide substrate is shown in cross-section and has substantially parallel sides although this is not essential. The waveguide assembly is described in Figure 7 below.
In addition, the system includes an integrity monitoring module 108, which is ideally an optical integrity monitoring module.
[0046] The in coupling region directs the majority of the light 110 along a primary path 112 (shown as a solid line) towards the out coupling region 106 which then expands the pupil and directs light 114 out of the waveguide assembly towards the users eye 116.
In the case of the diffractive in coupling regions, the primary path 112 is created by the +1R diffracted order (reflected order). Simultaneously the in coupling region 104 directs a smaller proportion of the incident light along a secondary path 118 within the waveguide assembly (shown by the dashed line) towards the secondary out coupling region 107. This secondary path is created by the -1R diffracted order (reflected order).
The secondary out coupling region 107 directs the light out of the waveguide assembly which is then collected by the optical integrity monitoring module 108.
[0047] The split of light between the positive and negative diffractive orders can be controlled by the shape of the diffractive structure and any coating applied to the structure. This will be described in more detail below. This aspect of the invention makes -7 -use of the +1 and -1 orders; however, any diffractive orders could be utilised to split the light paths. The out coupling regions may be the conjugate of the in coupling region to conserve the angles of the light paths injected into and ejected from the waveguide assembly. The secondary out coupling region could also be configured to be used in transmission rather than reflection. Other optical systems having the ability to split and transmit the light as required may also be used.
[0048] The optical integrity monitoring module is configured to analyse portion 118 to determine at least one optical discrepancy between an original collimated and received image and to send to the system information related to at least one of the nature of the optical discrepancies between the original and received image and one or more corrections to mitigate or overcome the optical discrepancies between the original and received image. The manner in which the integrity module analyses and determines discrepancies is discussed further below with reference to figure 10 and 11.
[0049] Referring now to Figure 2, which shows a similar arrangement to the Figure 1 scheme. In this arrangement 200 the light traveling along the secondary path 118 is coupled out of the waveguide assembly by a prismatic feature 202. The light coupled from the waveguide assembly is then collected by the optical integrity monitoring module 108. If the in coupling region 104 is diffractive and the incident light bundle 110 is polychromatic or broad in terms of wavelength there may be some limitations. The chromatic spread of light induced by the diffractive region may not be compensated for by the prismatic element, therefore light collected by the optical integrity monitoring module will include some optical discrepancies between the original and received image in comparison to the light injected into the waveguide assembly. This can be overcome by using narrow spectrum light sources and compensating for any lateral colour effects in the optical integrity monitoring module. It is also an option to filter the light collected by the optical integrity monitoring module to a narrower spectrum than the light used within the display path.
[0050] Figure 3 shows an example of an optical arrangement of the optical integrity monitoring module 108. There are several options for the optical integrity monitoring module. In one option the monitor could be a simple camera system, where the light 300 captured is focused by one or more lens elements 302 onto a sensor 304 to provide an image of the displayed content. It is possible to provide a greater complexity of monitoring from pixel level integrity monitoring to a simpler monitoring of specific displayed elements where the resolution of the camera is matched to or greater than that of the display system. The sensing element could also be of a more basic nature and could range from a simple single photodiode capable of measuring light levels to multiple -8 -light detection sites providing resolution across the displayed image. The sensing element could be colour capable. It will be appreciated that many options are possible.
[0051] Figure 4, Figure 5, and Figure 6 show how an arrangement for a binocular display system may work whilst utilising a single optical integrity monitoring module 108 In these figures the same reference applies to corresponding features.
[0052] The arrangement 400 in Figure 4 comprises a wave guide assembly 401a and 401b for each eye. Each waveguide assembly is similar to the assembly shown in either Figure 1 or 2. According each waveguide assembly includes a respective waveguide and pupil expanders, respective in coupler regions 404a and 404b and respective out coupler regions 406a and 406b and 407a, 407b. The arrangement also includes the optical integrity monitoring module 108. Each in coupler region receives light 410a and 410b and splits each into two portions of light 412a, 412b and 414a, 414b. The light 414a and 414b which passes through the waveguide assembly and is collected by the optical integrity monitoring module 108 from both waveguide assemblies 401a and 401b is directed to a desired position on a sensor 416 via lens or lenses 418.
[0053] In Figure 4 light out coupled from the waveguide assemblies is collected by the single optical integrity monitoring module 108. Light from both waveguide assemblies will occupy the same area on the optical integrity monitoring module. In this arrangement it would be possible if the display was bi-ocular (same image presented to both eyes) then integrity monitoring of each channel could be conducted by monitoring luminance intensifies as well as positional content on the sensor. If image content was only being shown to one eye rather than two, the measured intensity would be lower than expected, indicating a fault. In the case of a binocular display system (different image to each eye) the integrity monitoring could make use of time multiplexing to split the images.
For example, the image to the left eye is driven by its display device, and then blanked, during this blanking period the image to the right eye is driven by its display device, and then blanked and so on. In synchronisation with this display drive arrangement, the optical integrity monitoring module is configured to capture sequentially frames 420b, 420a respectively at the same time as the image is displayed to the left eye, and subsequently timed to capture the separate image driven to the right eye.
[0054] The arrangements shown in Figure 5 and Figure 6 solve the problem of the light collected from each waveguide assembly occupying the same area on the sensor by deviating the light paths. In the case of Figure 5, light out coupled by the secondary out couplers passes through a beam deviator 420. This beam deviator acts like a prism, imparting an angular deviation to the light's path. If the angle and refractive index of the -9 -material of the beam deviator are selected correctly, it is possible to separate the field of view from each of the waveguide assemblies so that they are separated physically on the sensor. This results in two images being received by the sensor side by side, allowing for the analysis of both images simultaneously.
[0055] In Figure 6 the secondary out coupling region imposes a deviation to the out coupled light. In the case of diffractive regions, this could be achieved by changing the pitch and/or spacing of the diffractive structure. This may have similar chromatic limitations as described previously in relation to Figure 2. In the case of reflective structures being used in the out coupling region, the angular deviation could be achieved by altering the reflective facet angle.
[0056] In order to provide optical monitoring of the left eye display and right eye display separately the display system may use time multiplexing to split the images or to switch between the left and right displays. For example, each image is displayed at one eye and then the other. In the time the image is being displayed at one eye the other may be blanked In synchronisation with this display drive arrangement the sensor is configured to capture a frame at the same time as the image is displayed to the left eye, and subsequently timed to capture the separate image driven to the right eye. In order to determine the optical discrepancies between the original collimated image and actual image displayed to each eye and caused in the system would thus require a complex analysis.
[0057] Figure 7 shows waveguide assembly 101 including a waveguide substrate 102, an in coupling region 104 and an out coupling region 106. The waveguide substrate includes internal surfaces that are substantially parallel to one another, shown as regions 702, 704 and 706. These surfaces enable internal reflection of light through the waveguide assembly. As previously described light enters the waveguide substrate via the in coupling region and is split and directed proportionately in the primary path and the secondary path. Each of the in coupling and out coupling regions are configured to provide an optical effect to light incident thereon. The effect can be predetermined by the shape, size and nature of the required optical effect. For example, the in coupling region includes an internal reflective surface 700 which splits the light into the +1R and -1R beams 112 and 118. The proportion of light transmitted in each order can be controlled or dictated by the form, shape and/or size of optical surface 700. In the example shown the reflective surface is a saw-tooth wave form. It will be appreciated different forms could be used. It will also be appreciated that the in coupling region could be laser based or any other appropriate type of optic.
-10 - [0058] Similarly, light that passes along the secondary path 118 exits via an out coupling region 106 having a reflective surface 708. This surface again incudes a saw-tooth form. Light is passed to the optical integrity monitoring module 108 for processing as discussed above. As can be seen the saw-tooth form of the out coupler has a different form than that of the in coupler. This changes how the light is directed. It should be noted that the form, shape and size of any optical region can be changed to adapt to the nature of the waveguide assembly and the overall system and/or system intent.
[0059] Figure 7 is not in proportion, and it will be understood that waveguide substrates 702, 704 and 706 will comprise the main proportion of the waveguide assembly and the in coupling and out coupling regions will be sized as required.
[0060] The waveguide assembly of the present invention can be coupled to the optical integrity monitoring module, which may or may not be part of the system. As the waveguide assembly is a combined waveguide substrate, in coupler and out coupler, the assembly is formed as a single compact component which is relatively lighter in weight than the individual separate elements.
[0061] In all schemes the light extracted for integrity monitoring is analysed to determine if there are any optical discrepancies between the original and received image introduced by the display system. Information relating to any such optical discrepancies between the original and received image is fed back to a correction system (not shown) to apply a correction to the light arriving at the eye of the user.
[0062] The integrity monitoring module is able to detect and generate corrections for all optical discrepancies between the original and actual image. There are several possible uses for the integrity monitoring system. In a basic usage scenario, the integrity monitoring system looks for discrepancies between the collimated image and the displayed image, any discrepancy can then be compared to a pre-set threshold value for that discrepancy type. If the discrepancy exceeds the threshold value, then the user is made aware of a fault within the system via a correction or feedback system forming part of the overall system.
[0063] In another scenario it may be the case that the fault is a frozen display i.e. the display is not being updated with the latest image. In this case the user may be made aware of the issue by the display channel being switched oft This would prevent the user being exposed to misleading information. In more complex systems it could be that a portion or section of the image is incorrect, due to "stuck pixels" in the display generator. In this case it may be possible to reposition information which would be displayed over those pixels to another position on the display, therefore still providing the correct information to the user albeit in a different location.
[0064] The integrity monitoring system may be capable of monitoring the following discrepancies in the display path: [0065] Magnification error resulting in incorrect image scaling.
[0066] Image shift causing the image to not align correctly with the outside world. [0067] Image rotation.
[0068] Colour channel failure, causing the loss of some commanded colours and the incorrect rendering of mixed colours.
[0069] Luminance discrepancies, the image being displayed to the eye not corresponding to the set! commanded brightness level.
[0070] Display failure, no image being displayed to the user.
[0071] In some cases, a correction may be able to be applied to the driven image to mitigate the detected failure, such as a luminance adjustment, an image shift/rotation.
However, in some other cases such as colour channel failure, the user could be made aware of the reduced colour palette being made available. The information may still be displayed to the user, but perhaps in monochrome, removing the advantage of colour coded symbols etc. but still allowing the user to see an accurate representation of the image.
[0072] Figure 8 shows and example of a generic monitoring process 800. An image is generated, 802, by the system or any appropriate image generating means. The image is created or drawn 804, so that is can be displayed. The created image is projected 806, though the relevant optical system, in this case system 100. A portion of light is directed towards a user 808 and a portion towards the monitor including the integrity monitoring module 810. The portion directed towards the monitor passes through a monitoring loop 812 in which discrepancies between the original collimated image and actual image are determined or identified. The image is then redrawn, recreated, corrected, blanked or otherwise altered 814 and then returned to step 802 in which the image is generated.
[0073] Figure 9 shows the process for one specific discrepancy by way of example. This this case the example 900 is an image shift fault detection. A position of a symbol in the image is detected 902. The symbol position in the commanded or original image is input (symbology input) 904. The detected image and the original image are compared 906. A determination is made as to whether there is a discrepancy between the images 908.
If no, the process continues to monitor the display 910 and no additional action is taken.
If yes, the process seeks a relevant threshold value 912 which is then compared with the discrepancy, 914. If the discrepancy does not exceed the threshold the process -12 -continues to monitor the display 916 and no additional action is taken. If the discrepancy does exceed the threshold the process sends a fault code to the system 918. The system Control Processing Unit (CPU) causes corrective action (920) to be taken, such as for example blanking the display or otherwise alerting the user.
[0074] The invention is intended to be used in waveguide HWDs, however its use is not limited to HVVDs and could be implemented on the waveguide HUD system. Whilst the invention provides the ability to monitor the integrity of the images displayed to the user, it could also be implemented in a simpler form to monitor display brightness and colour. In these examples the sensor in the optical integrity monitoring module would be appropriate to the intended type of monitoring.
[0075] Although the present invention has been described in connection with some embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the scope of the present invention is limited only by the accompanying claims. Additionally, although a feature may appear to be described in connection with particular embodiments, one skilled in the art would recognize that various features of the described embodiments may be combined in accordance with the invention. In the claims, the term 'comprising' does not exclude the presence of other elements or steps.
[0076] Furthermore, the order of features in the claims does not imply any specific order in which the features must be performed and in particular the order of individual steps in a method claim does not imply that the steps must be performed in this order. Rather, the steps may be performed in any suitable order. In addition, singular references do not exclude a plurality. Thus, references to 'a', 'an', 'first, 'second', etc. do not preclude a plurality. In the claims, the term 'comprising' or "including" does not exclude the presence of other elements.

Claims (25)

  1. -13 -CLAIMS1. A system for delivering an image to a user via a waveguide display system and for determining integrity of an image, the system comprising: a combination waveguide, in coupling and out coupling assembly comprising: a waveguide region; an in coupling region configured to receive a collimated image from an imaging system and an out coupling region configured to direct the collimated image toward an eye of a user, wherein the waveguide is configured to direct at least a first portion of the collimated image from the in coupling region towards the out coupling region to be directed to the user; and wherein prior to the collimated image being directed towards the eye, a second portion of the collimated image is configured to be directed towards an integrity monitoring module which is configured to determine at least one discrepancy between the collimated image and the image to thereby correct the first portion of the collimated image.
  2. 2. The system of claim 1, wherein the in coupling and out coupling regions each comprise a surface of the waveguide assembly providing a predetermined optical effect.
  3. 3. The system of claim 2, wherein each surface of the waveguide assembly comprises a reflective coating.
  4. 4. The system of claim 2 or claim 3, wherein each surface of the waveguide assembly is a predetermined shape.
  5. 5. The system of any one of claims 2 to 4, wherein the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into a +1R beam and a -1R beam.
  6. 6. The system of any one of claims 2 to 4, wherein the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into different order beams.
  7. 7. The system of any one of claims 2 to 6, wherein the out coupling region includes a reflective surface having a saw-tooth profile.
  8. 8. The system of any preceding claim, wherein the collimated image comes from a collimation optic configured to output an exit pupil comprising the collimated image.
  9. 9. The system of any one of claims 1 to 8, wherein the in coupling region directs the first portion of the collimated image towards the out coupling region and the second portion of the collimated image towards the integrity monitoring module.
  10. 10. The system of any preceding claim, wherein the integrity monitoring module comprises an optical arrangement configured to direct the second portion of the collimated image to a sensor.
  11. 11. The system of claim 10, wherein the integrity monitoring module is further configured to analyse the second portion of the collimated image to determine the at least one discrepancy between the collimated image and the image and to send to the system information related to at least one of the nature of the at least one discrepancy between the collimated image and the image and one or more corrections to mitigate or overcome the at least one discrepancy between the collimated image and the image.
  12. 12. The system of any preceding claim for use in a binocular arrangement comprising one combination waveguide, in coupling and out coupling assembly for each eye.
  13. 13. The system of any preceding claim, further comprising a correction system configured to implement a correction to the image such that a discrepancy between the collimated image and the image is reduced.
  14. 14. The system of claim 13, wherein the discrepancy is reduced based on comparison with a threshold discrepancy.
  15. 15. The system of any preceding claim, wherein the integrity monitoring module comprises an optical arrangement configured to direct the second portion of the collimated image to a sensor.
  16. 16. The system of any preceding claim, wherein the integrity monitoring module comprises a lens element and a sensor to provide the second portion of the collimated image to a monitoring loop in which discrepancies between the collimated image and image are determined.
  17. 17. The system of claim 16, wherein the integrity monitoring module is further configured to analyse the second portion of the collimated image to determine the at least one discrepancy between the collimated image and the image and to send to the system information related to at least one of the nature of the at least one discrepancy between the collimated image and the image and one or more corrections to mitigate or overcome the at least one discrepancy between the collimated image and the image.
  18. 18. A Heads Up Display including the system of any preceding claim.
  19. 19. A head worn display system including the system of any one of claims 1 to 17.
  20. 20. An integrity monitoring module for use in the system of any preceding claim, the integrity monitoring module comprising: optics configured to receive the second potion of the collimated image; -16 -direct the second potion of the collimated image towards one or more sensors configured to determine at least one discrepancy between the collimated image and the image on the second potion of the collimated image; generate an output indicative of at least one of the at least one discrepancy between the collimated image and the image and a correction to the at least one discrepancy between the collimated image and the image.
  21. 21. A combination waveguide, in coupling and out coupling assembly for a system for delivering an image to a user via a waveguide display system and for determining integrity of an image, the combination waveguide, in coupling and out coupling assembly comprising: a waveguide region; an in coupling region configured to receive a collimated image from a display system and an out coupling region configured to direct the collimated image to an eye of a user.
  22. 22. The assembly of claim 21, wherein the in coupling and out coupling regions each comprise a surface of the waveguide assembly providing a predetermined optical 20 effect.
  23. 23. The assembly of claim 22, wherein each surface comprises at least one of: a reflective coating, is of a predetermined shape.
  24. 24. The assembly of any one of claims 21 to 23, wherein the in coupling region includes a reflective surface having a saw-tooth profile which splits the light into different order diffractive beams.
  25. 25. A method for delivering an image to a user via a waveguide display system and for determining integrity of an image, the method comprising: receiving via a combination waveguide, in coupling and out coupling assembly a collimated image from an imaging system; -17 -splitting the collimated image into first and second portions; directing via an out coupling region the first portion of the collimated image to an eye of a user, directing the second portion of the collimated image to an integrity monitoring module which determines at least one discrepancy between the collimated image and the image in the collimated image to correct the first portion of the collimated image.
GB2202395.6A 2022-02-22 2022-02-22 Improvements in or relating to waveguide display systems Pending GB2615825A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB2202395.6A GB2615825A (en) 2022-02-22 2022-02-22 Improvements in or relating to waveguide display systems
PCT/GB2023/050346 WO2023161607A1 (en) 2022-02-22 2023-02-15 Improvements in or relating to waveguide display systems

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB2202395.6A GB2615825A (en) 2022-02-22 2022-02-22 Improvements in or relating to waveguide display systems

Publications (2)

Publication Number Publication Date
GB202202395D0 GB202202395D0 (en) 2022-04-06
GB2615825A true GB2615825A (en) 2023-08-23

Family

ID=80934441

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2202395.6A Pending GB2615825A (en) 2022-02-22 2022-02-22 Improvements in or relating to waveguide display systems

Country Status (1)

Country Link
GB (1) GB2615825A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130108229A1 (en) * 2011-10-28 2013-05-02 Google Inc. Heads-up display including ambient light control
WO2017105868A1 (en) * 2015-12-17 2017-06-22 Microsoft Technology Licensing, Llc Reducing ghost images in a head mounted display
US20170357089A1 (en) * 2016-06-09 2017-12-14 Microsoft Technology Licensing, Llc Wrapped Waveguide With Large Field Of View
US20180164583A1 (en) * 2016-12-09 2018-06-14 R. Andrew Wall Display device system with tilted lens group to prevent ghost images
US10606079B1 (en) * 2017-06-06 2020-03-31 Rockwell Collins, Inc. Image integrity monitoring systems and methods for light processing based head up displays
EP3726272A1 (en) * 2019-04-18 2020-10-21 BAE SYSTEMS plc Optical arrangement for a display

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130108229A1 (en) * 2011-10-28 2013-05-02 Google Inc. Heads-up display including ambient light control
WO2017105868A1 (en) * 2015-12-17 2017-06-22 Microsoft Technology Licensing, Llc Reducing ghost images in a head mounted display
US20170357089A1 (en) * 2016-06-09 2017-12-14 Microsoft Technology Licensing, Llc Wrapped Waveguide With Large Field Of View
US20180164583A1 (en) * 2016-12-09 2018-06-14 R. Andrew Wall Display device system with tilted lens group to prevent ghost images
US10606079B1 (en) * 2017-06-06 2020-03-31 Rockwell Collins, Inc. Image integrity monitoring systems and methods for light processing based head up displays
EP3726272A1 (en) * 2019-04-18 2020-10-21 BAE SYSTEMS plc Optical arrangement for a display

Also Published As

Publication number Publication date
GB202202395D0 (en) 2022-04-06

Similar Documents

Publication Publication Date Title
US7023621B2 (en) Device and method for the laser projection of high-resolution images onto the retina of the eye, superimposed with the image content of the field of vision
US11226261B2 (en) Optical device testing method and apparatus
US10685431B1 (en) Optical measurement system
US10205888B2 (en) Endoscope system
CN117055231A (en) Eye projection system and method
US20060131492A1 (en) Displaying optical system
US10495887B1 (en) Multifocal system with polarizing elements
US10606079B1 (en) Image integrity monitoring systems and methods for light processing based head up displays
US10921644B1 (en) Liquid crystal display backlight utilizing reflective stack
US20190019448A1 (en) Redundant microleds of multiple rows for compensation of defective microled
IL292453A (en) Laser-illuminated displays with enhanced uniformity and/or eye safety
CN110596895A (en) Near-to-eye display device and projection feedback method
US20220326655A1 (en) Optical assembly and method for reducing zero-order light in a holographic display
US20130342905A1 (en) Head-up display and optical projection system for a head-up display
CN114008512B (en) Display with foveal optical correction
CN115280218A (en) High resolution liquid crystal display
US20220082835A1 (en) Image display apparatus and head-mounted display
JP2009282085A (en) Optical device and image display equipped with the same
EP4231082A1 (en) Improvements in or relating to waveguide display systems
US20020118449A1 (en) Device and method for controlling the brightness or color of a superimposed image in an optical viewing device
GB2615825A (en) Improvements in or relating to waveguide display systems
WO2023161607A1 (en) Improvements in or relating to waveguide display systems
EP4231081A1 (en) Improvements in or relating to waveguide display systems
WO2023161606A1 (en) Improvements in or relating to waveguide display systems
GB2615824A (en) Improvements in or relating to waveguide display systems