WO2020014038A2 - Systèmes d'affichage multicouches et monocouches fantômes - Google Patents

Systèmes d'affichage multicouches et monocouches fantômes Download PDF

Info

Publication number
WO2020014038A2
WO2020014038A2 PCT/US2019/040238 US2019040238W WO2020014038A2 WO 2020014038 A2 WO2020014038 A2 WO 2020014038A2 US 2019040238 W US2019040238 W US 2019040238W WO 2020014038 A2 WO2020014038 A2 WO 2020014038A2
Authority
WO
WIPO (PCT)
Prior art keywords
display
projection
panel
projection plane
content
Prior art date
Application number
PCT/US2019/040238
Other languages
English (en)
Other versions
WO2020014038A3 (fr
Inventor
James S. EMSLIE
Shuyun YAO
Gareth Paul Bell
Darryl Singh
Austin F. O'BRIEN
Vijay R. PREMA
Original Assignee
Pure Depth Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pure Depth Inc. filed Critical Pure Depth Inc.
Publication of WO2020014038A2 publication Critical patent/WO2020014038A2/fr
Publication of WO2020014038A3 publication Critical patent/WO2020014038A3/fr

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Arrangement of adaptations of instruments
    • B60K35/211—
    • B60K35/60—
    • B60K2360/334—

Definitions

  • Displays described herein may be used with single-layer and multi layer display (MLD) systems, including but not limited to in any of the multi display systems described in any of U.S. Patent No. 6,906,762, or U.S. Patent Application Serial Nos. 14/986, 158; 14/855,822; 14/632,999; 15/338,777;
  • This invention relates to display systems and multi-display system (e.g., a display including multiple display panels/display layers), where at least first and second displays (e.g., display panels or display layers) are arranged substantially parallel to each other in order to display three-dimensional (3D) features to a viewer(s). More particularly, the technology relates to providing mid-air projected images generated by single and multi-display systems. Thus, this invention relates generally to displays and, in some embodiments, to display systems and methods for displaying three-dimensional features in space.
  • Images displayed by such displays are planar images that lack depth information. Because people observe the world in three-dimensions, there have been efforts to provide displays that can display objects in three-dimensions. For example, stereo displays convey depth information by displaying offset images that are displayed separately to the left and right eye. When an observer views these planar images they are combined in the brain to give a perception of depth. However, such systems are complex and require increased resolution and processor computation power to provide a realistic perception of the displayed objects.
  • an instrument panel comprising: a multi-layer display including a first display panel and a second display panel arranged in a substantially parallel manner, the second display panel overlapping the first display panel.
  • a processing system comprising at least one processor and memory, may be configured to simultaneously display content on the first display panel and content on the second display panel.
  • a projection system may be configured to project the content displayed on the first display panel to a first projection plane and the content displayed on the second display panel to a second projection plane that is substantially parallel to the first projection plane.
  • a display system comprising: a first display and a second display disposed substantially parallel to the first display; a projection panel configured to project content displayed on the first display to a first projection plane and content displayed on the second display to a second projection plane that is substantially parallel to the first projection plane; a non-transitory computer readable storage medium tangibly storing instructions relevant to operation of the first and second displays; and a controller configured to perform the instructions to perform functionality comprising:
  • generating visual content for output to the first display generating visual content for output to the second display; controlling the first display to display the generated visual content for the first display; and controlling the second display to display the generated visual content for the second display.
  • a display system comprising: a first screen configured to display first content; a projection panel configured to project content displayed on the first display to a first projection plane; a transparent emissive display disposed parallel to the first projection plane.
  • the display system may further include a second screen configured to display second content, and wherein the projection panel is configured to project content displayed on the second display to a second projection plane that is parallel to the first projection plane.
  • the second screen may be disposed parallel to the first screen without overlapping the first screen.
  • the first projection plane is provided between the projection panel wherein the transparent emissive display is disposed between the projection panel and the first projection plane.
  • the projection panel includes a first set of mirrors disposed parallel to each other and a second set of mirrors disposed parallel to each other and orthogonal to the second set of mirrors.
  • FIG. 1 illustrates a mid-air projection display apparatus using a multi layer display according to an embodiment of the present disclosure.
  • Fig. 2 illustrates a multi-layer display system that may be included in a projection display apparatus.
  • FIGs. 3A and 3B illustrate an exemplary projection plate.
  • Fig. 4A-4D illustrates exemplary embodiments of a ghost MLD.
  • Figs. 5A and 5 B illustrate exemplary non-limiting embodiments of a ghost single layer display (SLD).
  • SLD ghost single layer display
  • Figs. 6A and 6B illustrate another exemplary embodiment of a ghost MLD system.
  • Figs. 7 A and 7B illustrate other exemplary embodiments of floating display systems which may provide for a floating and/or popping of displayed content.
  • Fig. 8 illustrates a display of an instrument panel using an MLD system according to an embodiment of the present disclosure.
  • Fig. 9 illustrates an exemplary system upon which embodiments of the present disclosure(s) may be implemented.
  • Multi-component displays including multiple display screens in a stacked arrangement can be used to display real depth.
  • Each display screen may display its own image to provide visual depth due to the physical displacement of the display screens.
  • multi-display systems are disclosed in U.S. Patent Publication Nos. 2015/0323805 and 2016/0012630, the disclosures of which are both hereby incorporated herein by reference.
  • Embodiments of this disclosure provide for mid-air projection of images with depth information using images generated by a Multi-Layer Display (MLD).
  • MLD Multi-Layer Display
  • embodiments of this application use a retro-reflector/beam splitter combination or Aska3D plate to create a mid-air projected image of the MLD, which, with content, can appear like a more physical object (not flat).
  • Certain exemplary embodiments provide for mid-air projection of images generated by single layer displays.
  • a plurality of single layer displays may be provided parallel to each other without overlapping. Images from the plurality of single layer displays may be projected on projection planes that are parallel and do not overlap.
  • Displays according to example embodiments of this application may be used, for example, as displays in vehicle dashes in order to provide 3D images (e.g., for speedometers, vehicle gauges, vehicle navigation displays, etc.) or other vehicle displays to provide content at varying planes of projection.
  • 3D images e.g., for speedometers, vehicle gauges, vehicle navigation displays, etc.
  • other vehicle displays to provide content at varying planes of projection.
  • One or more of the example embodiments disclosed in this application may be used with other display systems and/or techniques which include, for example one or more of:
  • responses the content can be made to react like a physical object (button presses, knob control, layered ripples, popping mind map style menus);
  • An additional transparent emissive display could be positioned in parallel in front or behind the aska3D panel - 3 modes:
  • Mechanical surrounds, diffusers, glass etc could be positioned at the same location as the projected image planes, for a unique usability experience, such as being able to touch a glass plane (e,g touch panel) behind the front projected image; and/or
  • Advertising/Kiosks e.g. Unit is behind shop window but the mid-air
  • LED vehicle tail lights retro-reflector/beam splitter or Aska3D-Plate e.g., light source appears to be external to the vehicle, popping effects during braking for increased following driver awareness
  • Fig. 1 illustrates a mid-air projection display apparatus 100 using a multi-layer display according to an embodiment of the present disclosure.
  • the display apparatus 100 may include a multi-layer display (MLD) and a projection plate 200.
  • the MLD may include a light source 120 (e.g., rear mounted light source, side mounted light source, optionally with a light guide), and a plurality of display screens 130, 140.
  • the display apparatus 100 may be provided in an instrument panel installed in a dashboard of a vehicle, but is not so limited.
  • the instrument panel may be configured to display information to an occupant of the vehicle via one or more displays 130 and/or 140.
  • one or more of the mechanical indicators may be disposed between the displays 130, 140.
  • the information displayed on the displays 130, 140 and/or the mechanical indicators may include vehicle speed, engine coolant temperature, oil pressure, fuel level, charge level, and navigation information, but is not so limited. It should be appreciated that the elements illustrated in the figures are not drawn to scale, and thus, may comprise different shapes, sizes, etc. in other embodiments.
  • the display screens 130, 140 may be disposed parallel (e.g., substantially parallel) to each other and/or a surface (e.g., light guide) of the light source 120 in an overlapping manner.
  • the light source 120 and the display screens 130, 140 may be disposed in a common housing.
  • the light source 120, the display screens 130, 140, and the projection plate 200 may be disposed in a common housing.
  • the light source 120 may be configured to provide illumination for the display apparatus 100.
  • the light source 120 may provide substantially collimated light 122 that is transmitted through the display screens 130, 140 and towards the projection plate 200.
  • the projection plate 200 may be a special glass plate to reflect light from the MLD towards an observer 190.
  • the projection plate 200 may project aerial images of the images displayed by display screens 130, 140.
  • the projection plate 200 may include a retro-reflector and/or a beam splitter, and/or a special glass or plastic plate.
  • the projection plate 200 may include an ASKA3D-Plate, formerly known as "AI Plate", provided by Asukanet Co., Ltd. (see e.g., https://aska3d.com).
  • the MLD may simultaneously generate a first image on the first display screen 130 and a second image on the second display screen 140.
  • the projection plate 200 may be configured to reflect the first and second images towards an observer 190.
  • the projection plate 200 acts as a projection surface for displaying the images generated by the MLD in midair between the projection plate 200 and the observer 190.
  • the projection plate 200 may be configured to reflect the images generated by the MLD to the observer 190 in a 1: 1 ratio.
  • the projection plate 200 may receive light from one side of the projection plate 200 and sends it to the other side of the projection plate 200 at a same distance as from where the light is received.
  • the distance between the surface of the first display screen 130 and the projection plate 200 may be equal to the distance between the projection plate 200 and the projected image corresponding to the image generated on the first display screen 130.
  • the distance between the surface of the second display screen 140 and the projection plate 200 may be equal to the distance between the projection plate 200 and the projected image corresponding to the image generated on the second display screen 140.
  • point Pl is part of an image generated by the first display screen 130.
  • the projection plate 200 projects PI to pint P' l on a first projection plane 230.
  • Point P2 is part of an image generated by the second display screen 140 positioned between the first display screen 130 and the projection plate 200.
  • the projection plate 200 projects P2 to point P'2 on a second projection plane 240, which is between the first projection plane 230 and the projection plate 200.
  • a distance between the two projection planes 230, 240 may correspond to the distance between the first and second display screens 130, 140.
  • the displacement between the projection planes 230, 240 provides depth information for features displayed by the images.
  • the display system 100 may include a sensor 250 for detecting an observer’s 190 interactions with the content displayed on the projection planes 230, 240.
  • the sensor 250 may be a proximity sensor for detecting location of an input to content projected to the first or second projection plane 230, 240.
  • the proximity sensor may be configured to detect an object of interest (e.g., a hand, finger, stylus, and/or the like) as it approaches an area of interest (e.g., content included in the first or second projection plane 230, 240).
  • an object of interest e.g., a hand, finger, stylus, and/or the like
  • an area of interest e.g., content included in the first or second projection plane 230, 240.
  • the proximity sensor may detect a hand or finger approaching and/or interacting with the contented projected to the first or second projection plane 230, 240, e.g., via touching, gestures, and/or the like.
  • the proximity sensor may incorporate known technology including, for example, infrared motion detectors, cameras, and/or the like. Location, gesture, and/or the like may be detected using known techniques.
  • a dedicated object e.g., a stylus or the like
  • the proximity sensor may be configured to detect characteristics of it (e.g., emitted infrared or other energy, size/shape, etc.).
  • a transparent layer may be provide in front of, between, or behind the projected projection planes 230, 240 to provide a touch input surface for receiving touch inputs.
  • the system 100 may include mechanical surrounds, diffusers, glass etc positioned at the same location as the projected image planes (e.g., in front of, between, or behind the projected projection planes 230, 240), for a unique usability experience, such as being able to touch a glass plane (e,g touch panel) behind the front projected image,
  • Signals from the sensor 250 may be used by a processing system to provide gesture feedback and visual interaction with the projected content.
  • Content displayed by the MLD and projected to the projection planes 230 and/or 240 may change in response to the detected inputs.
  • haptics ultrasonic
  • gesture proximity responses the projected content corresponding to the content displayed by the MLD can be made to react like a physical object (button presses, knob control, layered ripples, popping mind map style menus).
  • the MLD may include additional display screens.
  • the display screens 130, 140 of the MLD shown in Fig. 1 are illustrated as being perpendicular to the projection planes 230, 240, but is not so limited. In other embodiments, the angle between the display screens 130, 140 of the MLD and the projection planes 230, 240 may be provided at an angle that is less than 90 degrees.
  • the increased projection distance of the one projection plane 230 from another projection plane 240 may allow for high priority alerts to be provided to the observer 190.
  • a first alerts may be provided on the projection plane 240 by generating an image using the display screen 140.
  • a second alert (e.g., with a higher priority) may be provided on the projection plane 230 by generating an image using the display screen 130.
  • the higher priority alerts may be displayed on a projection plane that is closer to the observer 190.
  • the first and second alerts may be sequentially displayed. In some embodiments, the first alerts may continue to be displayed after the second alert is displayed.
  • Fig. 2 illustrates a multi-layer display system that may be included in a projection display apparatus (e.g., mid-air projection display apparatus illustrated in Fig. 1).
  • the MLD may include a light source 120 (e.g., rear mounted light source, side mounted light source, optionally with a light guide), and a plurality of display screens 130-160.
  • Each of the display screens 130-160 may include multi- domain liquid crystal display cells.
  • the display screens 130-160 may be disposed substantially parallel or parallel to each other and/or a surface (e.g., light guide) of the light source 120 in an overlapping manner.
  • the light source 120 and the display screens 130-160 may be disposed in a common housing (e.g., in an instrument panel installed in a dashboard of a vehicle).
  • the light source 120 may be configured to provide illumination for the display system 100.
  • the light source 120 may provide substantially collimated light 122 that is transmitted through the display screens 130-160.
  • the light source 120 may provide highly collimated light using high brightness LED’s that provide for a near point source.
  • the LED point sources may include pre-collimating optics providing a sharply defined and/or evenly illuminated reflection from their emission areas.
  • the light source 120 may include reflective collimated surfaces such as parabolic mirrors and/or parabolic concentrators.
  • the light source 120 may include refractive surfaces such as convex lenses in front of the point source.
  • the LEDs may be edge mounted and direct light through a light guide which in turn directs the light toward the display panels in certain example embodiments.
  • the light source 120 may comprise a plurality of light sources, with each light source providing backlight to a different region of the display screens 130-160.
  • the light source 120 may be configured to individual provide and control light for each pixels of a panel in front of the light source 120.
  • Each of the display panels/screens 130-160 may include a liquid crystal display (LCD) matrix.
  • one or more of the display screens 130-160 may include organic light emitting diode (OLED) displays, transparent light emitting diode (TOLED) displays, cathode ray tube (CRT) displays, field emission displays (FEDs), field sequential display or projection displays.
  • the display panels 130-160 may be combinations of either full color RGB, RGBW or monochrome panels. Accordingly, one or more of the display panels may be RGB panels, one or more of the display panels may be RGBW panels and/or one or more of the display panels may be monochrome panels.
  • One or more of the display panels may include passive white (W) sub-pixels.
  • the display screens 130-160 are not limited to the listed display technologies and may include other display technologies that allow for the projection of light.
  • the light may be provided by a projection type system including a light source and one or more lenses and/or a transmissive or reflective LCD matrix.
  • the display screens 130-160 may include a multi-layer display unit including multiple stacked or overlapped display layers each configured to render display elements thereon for viewing through the uppermost display layer.
  • each of the display screens 130-160 may be approximately the same size and have a planar surface that is parallel or substantially parallel to one another.
  • the displays screens may be of difference size (e.g., a front display may be smaller than one or more of the displays it overlaps).
  • one or more of the display screens 130-160 may have a curved surface.
  • one or more of the display screens 130-160 may be displaced from the other display screens such that a portion of the display screen is not overlapped and/or is not overlapping another display screen.
  • Each of the display screens 130-160 may be displaced an equal distance from each other in example embodiments.
  • the display screens 130-160 may be provided at different distances from each other.
  • a second display screen 140 may be displaced from the first display screen 130 a first distance
  • a third display screen 150 may be displaced from the second display screen 140 a second distance that is greater than the first distance.
  • the fourth display screen 160 may be displaced from the third display screen 150 a third distance that is equal to the first distance, equal to the second distance, or different from the first and second distances.
  • the display screens 130-160 may be configured to display graphical information for viewing by the observer 190.
  • the viewer/observer 190 may be, for example, a human operator or passenger of a vehicle, or an electrical and/or mechanical optical reception device (e.g., a still image, a moving-image camera, etc.).
  • Graphical information may include visual display content (e.g., objects and/or texts).
  • the display screens 130-160 may be controlled to display content simultaneously on different display screens 130-160. At least a portion of content displayed on one of the display screens 130-160 may overlap content displayed on another one of the display screens 130-160.
  • the graphical information may include displaying images or a sequence of images to provide video or animations.
  • displaying the graphical information may include moving objects and/or text across the screen or changing or providing animations to the objects and/or text.
  • the animations may include changing the color, shape and/or size of the objects or text.
  • displayed objects and/or text may be moved between the display screens 130-160. In moving the content between the display screens 130-160, content displayed on one of the screen may be divided into segments, the segments assigned a position in a time sequence, and the segments may be animated by varying optical properties of each segment on each of the display screens at a time specified by the time sequence. In some embodiments, content may be moved over more than two screens. The distances between the display screens 130-160 may be set to obtain a desired depth perception between features displayed on the display screens 130-160.
  • a position of one or more of the display screens 130-160 may be adjustable by an observer 190 in response to an input.
  • the distance between the display screens 130-160 is adjusted, the distance between corresponding projection planes (e.g., see projection planes 230, 240 in Fig. 1) may also be adjusted.
  • an observer 190 may be able to adjust the three dimension depth of the displayed objects due to the displacement of the display screens 130-160.
  • a processing system may be configured to adjust the displayed graphics and gradients associated with the graphics in accordance with the adjustment.
  • Each of the display screens 130-160 may be configured to receive data and display, based on the data, a different image on each of the display screens 130-160 simultaneously.
  • the images displayed simultaneously on the display screens 130-160 will be projected simultaneously to corresponding projection planes (e.g., via projection plate 200 shown in Fig. 1). Because the images are separated by a physical separation due to the separation of the display screens 130-160, each image is provided at a different focal plane. Similarly, each corresponding projection plane will provide a different focal plane and depth is perceived by the observer 190 in the projections of the displayed images.
  • the images generated by the display screens 130-160 and viewed by the observer may include graphics in different portions of the respective display screen.
  • the display system 100 may include one or more additional projection screens, one or more diffraction elements, and/or one or more filters between an observer 190 and the projection screen 160, between any two display screens 130-160, and/or the display screen 130 and the light source 120.
  • One or more of the display screens 130-160 may be in-plane switching mode liquid crystal display devices (IPS-LCDs).
  • IPS-LCDs in-plane switching mode liquid crystal display devices
  • the IPS-LCD may be a crossed polarizer type with a polarizer on one side of the cells being
  • a pair of crossed polarized layers may be provided with a first polarizer layer provided in front of the display screen 130 and a second polarizer layer provided behind the display screen 160.
  • the projection plate 200 may be configured to receive images generated by the display screens of the MLD and project them towards the observer.
  • the projection plate 200 may include a glass or plastic plate with mirrored surfaces.
  • Figs. 3A and 3B illustrate an exemplary projection plate.
  • the projection plate may include a first set of vertically positioned mirrors 310 that are provided parallel to each other and a second set of vertically positioned mirrors 320 that are provided parallel to each other.
  • the first set of mirrors 310 may be orthogonal to the second set of mirrors 310.
  • the first and second set of mirrors 310, 320 provide for orthogonal specular surfaces that reflect the light to project images to an observer.
  • light from an MLD may be first received and reflected by a mirror of the first set of mirrors 310 towards a mirror of the second set of mirrors 320.
  • the mirror of the second set of mirrors 320 may receive the light reflected by the mirror of the first set of mirrors 310 and reflect it towards the observer.
  • the first angle of incidence and the second angle of emergence may have the same reflection angle.
  • Fig. 4A illustrates an exemplary embodiment of a ghost MLD system including a projection plate 440.
  • the projection plate 440 may include an ASKA3D-Plate.
  • the MLD generates a first and second images 410, 412 using the display screens of the MLD.
  • the projection plate 440 is configured to receive the light from the display screens of the MLD and project first and second aerial images 420, 422 of the first and second images 410, 412, respectively, forming a virtual floating MLD.
  • Each of the aerial images 420 and 422 are provide on different planes that are parallel to each other.
  • the distance between the aerial images 420, 422 may correspond to the distance between the first and second image 410, 412 generated by the MLD.
  • a single projection plate e.g., an ASKA3D-Plate
  • Fig. 4B illustrates an exemplary embodiment of a ghost MLD system including a transparent emissive display 430 provided on a front surface (e.g., surface facing the observer 190) of a projection plate 440.
  • the transparent emissive display 430 may be positioned parallel to the projection plate 440.
  • the transparent emissive display 430 may include a transparent organic light- emitting device (TOLED) , transparent micro LED device, or a scattering liquid crystal array placed on a light guide in combination with a field sequential red, green and blue LEDs.
  • TOLED transparent organic light- emitting device
  • transparent micro LED device transparent micro LED device
  • scattering liquid crystal array placed on a light guide in combination with a field sequential red, green and blue LEDs.
  • said material would have good transparency so that it passes as much light through from the display behind, low or no scattering, and be optimized for minimal distortion of the image behind in illuminated regions.
  • the display may be translucent to prevent bleed through from the image behind.
  • an LCD may be combined with a transparent edge lit backlight and panel that switches from translucent to clear. If this is done fast enough then the alpha of the panel is selectively controllable by adjusting the relative duty cycles between transparent mode and opaque mode for the field switching panel.
  • the MLD generates a first and second images 410, 412, using the display screens of the MLD.
  • the projection plate 440 is configured to receive the light from the display screens of the MLD and project (via the transparent emissive display 430) first and second aerial images 420, 422 of the first and second images 410, 412, respectively, forming a virtual floating MLD.
  • the transparent emissive display should be minimally disruptive to the projected images.
  • Fig. 4C illustrates an exemplary embodiment of a ghost MLD system including a transparent emissive display 430 provided on a back surface (e.g., surface facing the MLD) of a projection plate 440.
  • the transparent emissive display 430 may be positioned parallel to the projection plate 440.
  • the transparent emissive display 430 may include a transparent organic light-emitting device (TOLED) or micro LED.
  • TOLED transparent organic light-emitting device
  • the MLD generates a first and second images 410, 412, using the display screens of the MLD.
  • the projection plate 440 may be configured to receive the light from the display screens of the MLD project (via the transparent emissive display 430) and project first and second aerial images 420, 422 of the first and second images 410, 412, respectively, forming the virtual floating MLD. Having the transparent emissive display in front of the projection plate currently may provide better image quality on that display compared to positioning behind the projection plate.
  • Fig. 4D illustrates an exemplary embodiment of a ghost MLD system including a transparent emissive display 430 displaced from surfaces a projection plate 440.
  • the transparent emissive display 430 may include a transparent organic light-emitting device (TOLED) or micro LED.
  • TOLED transparent organic light-emitting device
  • the MLD generates a first and second images 410, 412, using the display screens of the MLD.
  • the transparent emissive display 430 may be positioned parallel to the first and/or second images 410, 412.
  • the projection plate 440 may be configured to project light from the display screens of the MLD towards the observer 190.
  • the transparent emissive display 430 may be configured to receive the light from the display screens of the MLD and project (via the projection plate 440) first and second aerial images 420, 422 of the first and second images 410, 412, respectively, forming the virtual floating MLD.
  • first and second aerial images 420, 422 of the first and second images 410, 412 respectively, forming the virtual floating MLD.
  • the transparent emissive display 430 is displaced from the projection plate 440 and can be parallel to the first and second aerial images 420, 422.
  • this configuration may allow placement of a physical second or third layer parallel to the projected one or two layers to concurrently supply more display real-estate and a physical plane for touch interaction.
  • the relative positioning of the transparent emissive display 430, projection plate 440, and display screens of the MLD will determine the location of the aerial images 420, 422.
  • the projection plate 440 will project images generated by the MLD a distance towards the observer that is equal to the distance of the display screens of the MLD to the projection plate 440.
  • the position of the transparent emissive display 430 will determine whether the aerial images 420,
  • the transparent emissive display 430 may be provided between the aerial images 420, 422.
  • Figs. 5A and 5 B illustrate exemplary non-limiting embodiments of a ghost single layer display (SLD).
  • SLD ghost single layer display
  • an SLD generates an image 510, using a display screen of the SLD.
  • the projection plate 540 is configured to project light from the display screen of the SLD towards the observer 190.
  • the projection plate 540 may be configured to receive the light from the display screen of the SLD and project an aerial images 520 of the image 510 (via a transparent display 530), forming the virtual floating SLD.
  • the transparent emissive display 430 may include a transparent organic light-emitting device (TOLED) or micro LED. As shown in Fig.
  • TOLED transparent organic light-emitting device
  • the transparent emissive display 530 is displaced from the projection plate 540 and is approximately parallel to the aerial image 520.
  • the transparent emissive display 530 is positioned at a distance away from the projection plate 540 such that the aerial image 520 is projected between the observer and the transparent emissive display 530.
  • Fig. 5B illustrates an exemplary embodiments where the transparent emissive display 530 and/or the SLD may be positioned such that the aerial image 520 is projected between the transparent emissive display 530 and the projection plate 540.
  • the projection plate 540 may be configured to project the aerial image 520 a distance from the projection plate 540 that is equal to a distance from the projection plate 540 to the generated image 510.
  • the relative positioning of the transparent emissive display 530, projection plate 540, and display screen of the SLD will determine whether the aerial image 520 is projected between the observer 190 and the transparent emissive display 530 or between the transparent emissive display 530 and the projection plate 540.
  • a display system may include a plurality of SLDs provided at different distances to the projection plate.
  • the transparent emissive display 530 may be positioned such that at least one aerial image is projected on one side of the transparent emissive display 530 and at least one other aerial image is projected on an opposite side of the transparent emissive display 530.
  • FIG. 6A illustrates another exemplary embodiment of a ghost MLD system.
  • An MLD 600 generates a first and second images 610, 612, using the display screens of the MLD.
  • a projection system including a beam splitter 630 and a retro-reflector 640, may be configured to receive the light from the display screens of the MLD and project first and second aerial images 620, 622 of the first and second images 610, 612, respectively, forming the virtual floating MLD.
  • the beam splitter 630 may be configured to split light from the images generated by the display screens of the MLD such that a portion is reflected directly towards the observer 190 and a portion is directed towards the retro-reflector 640.
  • the retro- reflector 640 may be configured to reflect the received light from the beam splitter 630 towards the observer 190.
  • the retro-reflector 640 may be configured to reflect light along a vector that is parallel to but opposite in direction from the light received from the beam splitter 630.
  • the beam splitter 630 may include a semi-transparent mirrored coating for splitting the received light.
  • the beam splitter is typically 50% reflective and 50% transmissive, however the transmission and reflection ratio can be adjusted by varying the thickness of the metal coating on glass.
  • the retro reflector can be a comer cube type, a spherical bead type or a curved mirror type.
  • the beam splitter in combination with the retro-reflector creates a type of“reversed mirror”.
  • a standard mirror light normally reflects off and the viewer sees a virtual image behind the mirror.
  • the“reversed mirror” the object is placed behind the half silvered mirror, where it is reflected off the mirror and then re-directed by the retro reflector towards the viewer to create a virtual image of the object on the opposite side in front of the half silvered mirror.
  • Figs. 7A and 7B illustrate other exemplary embodiments of floating display systems which may provide for a floating and/or popping of displayed content.
  • the floating and/or popping of displayed content may be provided in vehicle display systems such as a brake light, turn signals, instrument panel, and/or side and/or rear view mirrors.
  • Figs. 7A and 7B illustrate a first display 710 and a second display 712 configured to display content.
  • the first display 710 may be provide on a different plane and be displaced linearly from the second display 712.
  • the first and second displays include LEDs ln an exemplary embodiments, one or both of the first display 710 and the second display 712 may be an MLD.
  • a projection plate 730 which may include an ASKA3D-Plate, may be configured to receive images generated by the first display 710 and the second display 712, and project aerial images 720, 722 of the images displayed by the first display 710 and the second display 712.
  • Aerial image 720 corresponds to the image generated by the first display 710
  • aerial image 722 corresponds to the image generated by the second display 712.
  • Aerial images 720 and/or 722 may include a plurality of parallel images displaced from each other.
  • Aerial image 720 corresponds to the image generated by the first display 710 and aerial image 722 corresponds to the image generated by the second display 712.
  • Aerial images 720 and/or 722 may include a plurality of parallel images displaced from each other.
  • the beam splitter 740 may be configured to split light from the images generated by the display 710, 712 such that a portion is reflected directly towards the observer 190 and a portion is directed towards the retro-reflector 750.
  • the retro-reflector 750 may be configured to reflect the received light from the beam splitter 740 towards the observer 190.
  • the retro-reflector 750 may be configured to reflect light along a vector that is parallel to but opposite in direction from the light received from the beam splitter 740.
  • An optional lens 760 may be provided between the first display 710 and the beam splitter 740.
  • the lens 760 may be configured to adjust location of aerial image 720.
  • the position of the lens between the beam splitter 740 and the first display 710 may be manually or automatically adjusted to change the distance at which the aerial image 720 is provided to the observer 190.
  • the lens 760 may be moved in response to a signal received from processing system and/or sensor (e.g., distance sensor).
  • Figs. 7A and 7B illustrate the one aerial image 720 projected at a plane that is outside of a housing 790 and one image 722 that is projected inside of a housing 790.
  • the position of the first and second displays 710, 712 may be adjustable to adjust the position of where the aerial images 720, 722 are projected.
  • the housing 790 may include a window (e.g., a kiosk window or a shop window).
  • a window e.g., a kiosk window or a shop window.
  • one of the aerial images 720, 722 may be projected on one side of the window and another one of the aerial images 720, 722 may be projected on an opposite side of the window.
  • the different aerial images 720 may be generated upon satisfying specific conditions. For example, when a first condition is satisfied, aerial image 722 may be displayed. When a second condition is satisfied, aerial image 720 may be displayed. The second condition may be a different condition from the first condition or the same condition being detected a predetermined number of times. One of the conditions may include detecting, using one or more sensors, a solid reflective object coming into line with the virtual plane (e.g., parking assist applications).
  • the increased projection distance of the aerial image 720 from the projection plate 730 or the beam splitter 740 may allow for high priority alerts to be provided to the observer 190.
  • content may be displayed on aerial image 722
  • content may be displayed on aerial image 720.
  • the observer 190 in the other vehicle may be alerted by content displayed outside of the housing 790 that the vehicle is coming to a complete stop and/or that the observer is located too close to the vehicle.
  • Figs. 7A and 7B may further include a transparent emissive display (see Figs. 4B-4D, 5A, and 5B) positioned in parallel above or below the projection plate 730 and/or positioned in parallel to the aerial images 720 and/or 722.
  • a transparent emissive display see Figs. 4B-4D, 5A, and 5B
  • the first and second displays 710, 712 are arranged in a substantially parallel manner without overlapping each other.
  • the projection plate 730 or the beam splitter 740 and the retro- reflector 750 will project the aerial images 720, 722 such that they are displayed without overlapping.
  • the first and second displays 710, 712 may partially overlap.
  • the projection plate 730 or the beam splitter 740 and the retro-reflector 750 will project the aerial images 720, 722 such that they partially overlap each other on the respective projection planes as viewed by the observer 190.
  • Fig. 8 illustrates a display of an instrument panel 800 using an MLD system according to an embodiment of the present disclosure.
  • the MLD system according to an embodiment of the present disclosure may be used to simultaneously display content of the instrument panel 800 on different displays of the MLD and project the aerial images of the instrument panel 800 to an observer.
  • the instrument panel 800 may display content simultaneously on different displays.
  • the content may include a tachometer 810, navigation inform tion 820, a speedometer 830, and other information 840.
  • the other information may include vehicle temperature, fuel level, distance left before refueling, contact list, navigation settings, control settings, and warning
  • inform tion may be moved from one display to another to move the content between aerial images displayed to the observer.
  • the tachometer 810 and/or the speedometer 830 may be moved between a front display and a back display of the MLD.
  • the instructions may be issued by the operator or in response to satisfying certain condition(s) (e.g., vehicle is put into drive mode or starts moving).
  • the speedometer 830 may be moved sequentially between the displays according to the embodiments disclosed in this application.
  • the speedometer 830 may be broken up into segments which include inner portion of the speedometer as one segment and outer portion of the speedometer as another segment.
  • the current speed displayed in the center of the speedometer, the needle, and speed pointed to by the needle may each be set to a different segment.
  • the speedometer 830 may be moved from a rear display to a front display when a determination is made that the speed of the vehicle exceeds the speed limit at current location of the vehicle, exceed the speed limit at current location of the vehicle by a preset limit, or exceeds a preset limit.
  • the speedometer 830 may be moved back to the rear display from the front display when a determination is made that the speed of the vehicle is below the speed limit at present location of the vehicle, does not exceed the speed limit at current location of the vehicle by a preset limit, is below a preset limit, or after a predetermined time period.
  • an object e.g., speedometer 830
  • the object may still be moved from a first set of display screens to a second set of display screens according to the embodiments disclosed in this application.
  • the speedometer 830 which is displayed using three displays of an MLD system, portions of the speedometer 830 may be moved in a manner such that all portions of the speedometer are displayed on a single screen. Based on this movement of the content on the displays, the content may be moved between aerial images.
  • the navigation information may transition between multiple displays to alert the driver to something.
  • the processing system may display navigation information on a back display and in response to instructions (e.g., a user input or determining that vehicle is approaching location of a turn), move the navigation information to a front display.
  • Moving the navigation information to the front display may include dividing the navigation information into a plurality of segments, assigning each divided segment a position in a time sequence, and moved the divided segments to the front display with an animation that varies the optical properties of each segment on the first display panel and the second display panel according to a time for the respective segments specified by the time sequence.
  • the navigation information may be divided in real time at the time of the instructions based on the navigation information currently displayed.
  • Fig. 9 illustrates an exemplary system 1000 upon which embodiments of the present disclosure(s) may be implemented.
  • the system 1000 may be a portable electronic device that is commonly housed, but is not so limited.
  • the system 1000 may include a multi-layer display 1002 including a plurality of overlapping displays.
  • the multi-layer system may include a touch screen 1004 and/or a proximity detector 1006 configured to detect user’s interaction with aerial images generated by display systems according to embodiments of this disclosure.
  • the various components in the system 1000 may be coupled to each other and/or to a processing system by one or more communication buses or signal lines 1008.
  • the multi-layer display 1002 may be coupled to a processing system including one or more processors 1012 and memory 1014.
  • the processor 1012 may comprise a central processing unit (CPU) or other type of processor.
  • the memory 1014 may comprise volatile memory (e.g., RAM), non-volatile memory (e.g., ROM, flash memory, etc.), or some combination of the two. Additionally, memory 1014 may be removable, non-removable, etc.
  • volatile memory e.g., RAM
  • non-volatile memory e.g., ROM, flash memory, etc.
  • memory 1014 may be removable, non-removable, etc.
  • the processing system may comprise additional storage (e.g., removable storage 1016, non-removable storage 1018, etc.).
  • Removable storage 1016 and/or non-removable storage 1018 may comprise volatile memory, non-volatile memory, or any combination thereof.
  • removable storage 1016 and/or non-removable storage 1018 may comprise CD- ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store information for access by processing system.
  • the processing system may communicate with other systems, components, or devices via peripherals interface 1020.
  • Peripherals interface 1020 may communicate with an optical sensor 1022, external port 1024, RC circuitry 1026, audio circuity 1028 and/or other devices.
  • the optical sensor 1082 may be a CMOS or CCD image sensor.
  • the RC circuity 1026 may be coupled to an antenna and allow communication with other devices, computers and/or servers using wireless and/or wired networks.
  • the system 1000 may support a variety of communications protocols, including code division multiple access (CDMA), Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wi-Fi (such as IEEE 802.1 la, IEEE 802.1 lb, IEEE 802.1 lg and/or IEEE 802.1 In), BLUETOOTH (BLUETOOTH is a registered trademark of Bluetooth Sig, Inc.), Wi-MAX, a protocol for email, instant messaging, and/or a short message service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
  • the system 1000 may be, at least in part, a mobile phone (e.g., a cellular telephone) or a tablet.
  • a graphics processor 1030 may perform graphics/image processing operations on data stored in a frame buffer 1032 or another memory of the processing system. Data stored in frame buffer 1032 may be accessed, processed, and/or modified by components (e.g., graphics processor 1030, processor 1012, etc.) of the processing system and/or components of other systems/devices.
  • components e.g., graphics processor 1030, processor 1012, etc.
  • memory 1014, removable 1016, non-removable storage 1018, frame buffer 1032, or a combination thereof may comprise instructions that when executed on a processor (e.g., 1012, 1030, etc.) implement a method of processing data (e.g., stored in frame buffer 1032) for improved display quality on a display.
  • a processor e.g., 1012, 1030, etc.
  • the memory 1014 may include one or more applications. Examples of applications that may be stored in memory 1014 include, navigation
  • the applications may include a web browser for rendering pages written in the Hypertext Markup Language (HTML), Wireless Markup Language (WML), or other languages suitable for composing webpages or other online content.
  • the applications may include a program for browsing files stored in memory.
  • the memory 1014 may include a contact point module (or a set of instructions), a closest link module (or a set of instructions), and a link information module (or a set of instructions).
  • the contact point module may determine the centroid or some other reference point in a contact area formed by contact on the touch screen.
  • the closest link module may determine a link that satisfies one or more predefined criteria with respect to a point in a contact area as determined by the contact point module.
  • the link information module may retrieve and display information associated with selected content.
  • Each of the above identified modules and applications may correspond to a set of instructions for performing one or more functions described above. These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures or modules. The various modules and sub- modules may be rearranged and/or combined. Memory 1014 may include additional modules and/or sub-modules, or fewer modules and/or sub-modules. Memory 1014, therefore, may include a subset or a superset of the above identified modules and/or sub-modules. Various functions of the system may be implemented in hardware and/or in software, including in one or more signal processing and/or application specific integrated circuits.
  • Memory 1014 may store an operating system, such as Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VxWorks.
  • the operating system may include procedures (or sets of instructions) for handling basic system services and for performing hardware dependent tasks.
  • Memory 1014 may also store communication procedures (or sets of instructions) in a communication module. The communication procedures may be used for communicating with one or more additional devices, one or more computers and/or one or more servers.
  • the memory 1014 may include a display module (or a set of instructions), a contact/motion module (or a set of instructions) to determine one or more points of contact and/or their movement, and a graphics module (or a set of instructions).
  • the graphics module may support widgets, that is, modules or applications with embedded graphics. The widgets may be implemented using JavaScript, HTML, Adobe Flash, or other suitable computer program languages and technologies.
  • An I/O subsystem 1040 may include a touch screen controller, a proximity controller and/or other input/output controller(s).
  • the touch-screen controller may be coupled to a touch-sensitive screen or touch sensitive display system.
  • the touch screen and touch screen controller may detect contact and any movement or break thereof using any of a plurality of touch sensitivity
  • a touch-sensitive display in some embodiments of the display system may be analogous to the multi-touch sensitive screens.
  • the other input/output controller(s) may be coupled to other input/control devices 1042, such as one or more buttons.
  • input controller(s) may be coupled to any (or none) of the following: a keyboard, infrared port, USB port, and/or a pointer device such as a mouse.
  • the one or more buttons may include an up/down button for volume control of the speaker and/or the microphone.
  • the one or more buttons may include a push button.
  • the user may be able to customize a functionality of one or more of the buttons.
  • the touch screen may be used to implement virtual or soft buttons and/or one or more keyboards.
  • the system 1000 may include circuitry for supporting a location determining capability, such as that provided by the Global Positioning System (GPS).
  • the system 1000 may include a power system 1050 for powering the various components.
  • the power system 1050 may include a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable devices.
  • the system 1000 may also include one or more external ports 1024 for connecting the system 1000 to other devices.
  • Portions of the present invention may be comprised of computer- readable and computer-executable instructions that reside, for example, in a processing system and which may be used as a part of a general purpose computer network (not shown). It is appreciated that processing system is merely exemplary. As such, the embodiment in this application can operate within a number of different systems including, but not limited to, general-purpose computer systems, embedded computer systems, laptop computer systems, hand-held computer systems, portable computer systems, stand-alone computer systems, game consoles, gaming systems or machines (e.g., found in a casino or other gaming establishment), or online gaming systems.
  • the exemplary embodiments of the present disclosure provide the invention(s), including the best mode, and also to enable a person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. While specific exemplary embodiments of the present invention(s) are disclosed herein, it should be understood that modifications, substitutions and alternatives may be apparent to one of ordinary skill in the art and can be made without departing from the scope of this

Abstract

La présente invention concerne un tableau de bord qui peut comprendre un dispositif d'affichage multicouche comprenant un premier panneau d'affichage et un deuxième panneau d'affichage agencés de façon sensiblement parallèle, le deuxième panneau d'affichage chevauchant le premier panneau d'affichage et un système de traitement comprenant au moins un processeur et une mémoire. Le système de traitement peut être configuré pour afficher un contenu sur le premier panneau d'affichage et un contenu sur le deuxième panneau d'affichage. Le tableau de bord peut comprendre en outre un système de projection configuré pour projeter le contenu affiché sur le premier panneau d'affichage vers un premier plan de projection et le contenu affiché sur le deuxième panneau d'affichage vers un deuxième plan de projection qui est sensiblement parallèle au premier plan de projection.
PCT/US2019/040238 2018-07-11 2019-07-02 Systèmes d'affichage multicouches et monocouches fantômes WO2020014038A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862696716P 2018-07-11 2018-07-11
US62/696,716 2018-07-11

Publications (2)

Publication Number Publication Date
WO2020014038A2 true WO2020014038A2 (fr) 2020-01-16
WO2020014038A3 WO2020014038A3 (fr) 2020-07-30

Family

ID=69142487

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/040238 WO2020014038A2 (fr) 2018-07-11 2019-07-02 Systèmes d'affichage multicouches et monocouches fantômes

Country Status (1)

Country Link
WO (1) WO2020014038A2 (fr)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080198459A1 (en) * 2007-01-29 2008-08-21 Fergason Patent Properties, Llc Conjugate optics projection display system and method having improved resolution
KR101595104B1 (ko) * 2008-07-10 2016-02-17 리얼 뷰 이미징 리미티드 광시야각 디스플레이들 및 사용자 인터페이스들
US8941691B2 (en) * 2008-08-26 2015-01-27 Pure Depth Limited Multi-layered displays
CN109445095B (zh) * 2013-11-27 2021-11-23 奇跃公司 虚拟和增强现实系统与方法
KR20180010174A (ko) * 2014-12-31 2018-01-30 퓨어 뎁쓰, 아이엔씨. 다층 디스플레이 시스템에 의해 투영된 가상화된 3차원 객체를 표시하는 초점 주의 영역
US10592188B2 (en) * 2016-12-28 2020-03-17 Pure Death Limited Content bumping in multi-layer display systems

Also Published As

Publication number Publication date
WO2020014038A3 (fr) 2020-07-30

Similar Documents

Publication Publication Date Title
US11150486B2 (en) Method and system for object rippling in a display system including multiple displays
US10726609B2 (en) Perspective distortion in multi-display system
US9195306B2 (en) Virtual window in head-mountable display
US20170364148A1 (en) Control device for vehicle and control method thereof
CN104729519B (zh) 利用三维导航系统的虚拟三维仪表组
WO2019212635A1 (fr) Optique reconfigurable pour affichages tête haute à plans multiples
US10621898B2 (en) Multi-layer display system for vehicle dash or the like
US20190168777A1 (en) Depth based alerts in multi-display system
US10642062B2 (en) Content redirection in a multi-layered display system
JP5985549B2 (ja) アーティキュレーティングインストルメントクラスタ
WO2019143654A1 (fr) Panneau rgbw passif pour affichage multicouche
WO2018204738A1 (fr) Fusion de la profondeur basée sur un suivi de tête
US20100007602A1 (en) Image display device
CN110089112B (zh) 用于车辆仪表板的固定的深度显示器
US10255832B2 (en) Multi-layer display including proximity sensor and depth-changing interface elements, and/or associated methods
WO2019165398A1 (fr) Systèmes d'affichage multicouches avec pixels tournés
WO2020014038A2 (fr) Systèmes d'affichage multicouches et monocouches fantômes
WO2021085028A1 (fr) Dispositif d'affichage d'image
US10146110B1 (en) Three-dimensional floating image system
JP2022150245A (ja) 表示装置
WO2019244326A1 (fr) Dispositif d'affichage vidéo
CN117170097A (zh) 自动眼睛高度调整
JP2012003633A (ja) プログラマブル表示器、その表示画面の拡大方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19833512

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26/05/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19833512

Country of ref document: EP

Kind code of ref document: A2