WO2024096072A1 - Dispositif d'affichage aérien - Google Patents

Dispositif d'affichage aérien Download PDF

Info

Publication number
WO2024096072A1
WO2024096072A1 PCT/JP2023/039475 JP2023039475W WO2024096072A1 WO 2024096072 A1 WO2024096072 A1 WO 2024096072A1 JP 2023039475 W JP2023039475 W JP 2023039475W WO 2024096072 A1 WO2024096072 A1 WO 2024096072A1
Authority
WO
WIPO (PCT)
Prior art keywords
aerial
display device
light
display
optical element
Prior art date
Application number
PCT/JP2023/039475
Other languages
English (en)
Japanese (ja)
Inventor
康宏 代工
Original Assignee
Ｔｏｐｐａｎホールディングス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ｔｏｐｐａｎホールディングス株式会社 filed Critical Ｔｏｐｐａｎホールディングス株式会社
Publication of WO2024096072A1 publication Critical patent/WO2024096072A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/50—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
    • G02B30/56—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels by projecting aerial or floating images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons

Definitions

  • the present invention relates to an aerial display device.
  • Aerial display devices capable of displaying images and videos as aerial images are being researched, and are expected to become a new human-machine interface.
  • An aerial display device for example, is equipped with a two-sided corner reflector array in which two-sided corner reflectors are arranged in an array, and reflects light emitted from the display surface of a display element to form a real image in the air.
  • the display method using a two-sided corner reflector array is aberration-free, and can display a real image (aerial image) in a plane-symmetrical position.
  • Patent Document 1 discloses an optical element in which a transparent square prism protruding from the surface of a transparent flat plate is used as a two-sided corner reflector, and multiple square prisms are arranged in an array on a flat surface.
  • Patent Document 2 discloses an optical element in which each of the first and second light control panels is formed by arranging multiple planar light reflecting sections vertically inside a transparent flat plate, and the first and second light control panels are arranged so that the planar light reflecting sections are orthogonal to each other.
  • the optical elements of Patent Documents 1 and 2 reflect light emitted from a display element twice from orthogonal reflecting surfaces to generate an aerial image.
  • the observer can touch the aerial image displayed by the aerial display device without touching the device.
  • the sensing element of the aerial display device detects objects present in the area of the aerial image and recognizes that the observer has touched the aerial image.
  • the aerial image may move in tandem with the viewpoint.
  • the aerial image and the detection area for detecting the aerial image become misaligned.
  • the sensing element may recognize that an aerial image other than the one the observer intended has been touched.
  • the present invention provides an aerial display device that can more accurately detect touch operations on an aerial image by an observer.
  • a display element that displays an image
  • an optical element that is arranged to receive light from the display element and reflects the light from the display element to an opposite side to the display element to form an aerial image in the air
  • a sensing element that forms a detection area in a spatial region overlapping with the aerial image and detects an object in the detection area
  • Doi is the distance from the display element to the optical element
  • Dao is the distance from the optical element to the detection area
  • Dea is the distance from the detection area to a viewer
  • L is the amount of movement of the viewer from the center of the aerial image in a direction parallel to the optical element
  • Sd is the interval between adjacent aerial images
  • the aerial display device according to the second aspect is provided, which is installed in equipment that is primarily used by persons aged 16 or older.
  • the aerial display device according to the fourth aspect is provided in equipment for wheelchair users.
  • an aerial display device according to the sixth aspect, which is provided in a device that is primarily used by persons aged 15 or younger.
  • an aerial display device further comprising a memory unit that stores information about the distance Sd, and a setting unit that sets the distance between the aerial images based on the information in the memory unit.
  • an aerial display device in which the sensing element includes a light-emitting section that emits light toward the detection area and a light-receiving section that receives the light reflected by the object.
  • an aerial display device in which the optical element includes a planar substrate and a plurality of optical elements disposed below the substrate, each extending in a first direction and aligned in a second direction perpendicular to the first direction, each of the plurality of optical elements being inclined with respect to the normal direction of the substrate and having an entrance surface and a reflection surface that are in contact with each other.
  • an aerial display device according to the first aspect, further comprising an orientation control element disposed between the display element and the optical element, which transmits oblique light components of the light from the display element.
  • an aerial display device in which the alignment control element includes a plurality of transparent members and a plurality of light-shielding members that are alternately arranged, and the plurality of light-shielding members are inclined with respect to the normal to the alignment control element.
  • an aerial display device in which the display element and the optical element are arranged parallel to each other.
  • the present invention provides an aerial display device that can more accurately detect touch operations on an aerial image by an observer.
  • FIG. 1 is a perspective view of an aerial display device according to a first embodiment of the present invention.
  • FIG. 2 is a side view of the aerial display device shown in FIG. 1 in the XZ plane.
  • FIG. 3A is a plan view of the alignment control element shown in FIG.
  • FIG. 3B is a cross-sectional view of the alignment control element taken along line AA' in FIG. 3A.
  • FIG. 4 is a perspective view of the optical element shown in FIG.
  • FIG. 5 is a block diagram of an aerial display device.
  • FIG. 6 is a perspective view illustrating the state of light reflection in an optical element.
  • FIG. 7 is a side view of the XZ plane for explaining how light is reflected in the optical element.
  • FIG. 1 is a perspective view of an aerial display device according to a first embodiment of the present invention.
  • FIG. 2 is a side view of the aerial display device shown in FIG. 1 in the XZ plane.
  • FIG. 3A is a plan view of the alignment control
  • FIG. 8 is a side view of the YZ plane for explaining how light is reflected in the optical element.
  • FIG. 9 is a diagram for explaining the angular conditions of the incident surface and the reflecting surface in the optical element.
  • FIG. 10 is a schematic diagram for explaining a method for setting the interval between aerial images.
  • FIG. 11 is a diagram illustrating the average height of Japanese people aged 16 or over.
  • FIG. 12 is a diagram for explaining the eye level of a wheelchair user.
  • FIG. 13 is a diagram illustrating the average height of Japanese people aged 15 or younger.
  • FIG. 14 is a flowchart explaining the operation of setting the display mode in the aerial display device.
  • FIG. 15 is a flowchart illustrating the display mode setting operation in the aerial display device according to the second embodiment of the present invention.
  • FIG. 1 is a perspective view of the aerial display device 1 according to the first embodiment of the present invention.
  • the X direction is a direction along one side of the aerial display device 1
  • the Y direction is a direction perpendicular to the X direction in a horizontal plane
  • the Z direction is a direction perpendicular to the XY plane (also called the normal direction).
  • Fig. 2 is a side view of the aerial display device 1 shown in Fig. 1 in the XZ plane.
  • the aerial display device 1 is a device that displays images (including videos).
  • the aerial display device 1 displays an aerial image in the air above its own light emission surface. "Displaying an aerial image” has the same meaning as "forming an aerial image.”
  • the light emission surface of the aerial display device 1 refers to the upper surface of the component that is arranged in the uppermost layer among the multiple components that make up the aerial display device 1 and are arranged on the optical path.
  • An aerial image is a real image that is formed in the air.
  • the aerial display device 1 comprises an illumination element (also called a backlight) 10, a display element 20, an orientation control element 30, an optical element 40, and a sensing element 50.
  • the illumination element 10, the display element 20, the orientation control element 30, the optical element 40, and the sensing element 50 are housed in a housing (not shown).
  • the illumination element 10, the display element 20, the orientation control element 30, and the optical element 40 are arranged in this order along the Z direction and parallel to each other.
  • the illumination element 10, the display element 20, the orientation control element 30, and the optical element 40 are fixed at specific positions by fixing members (not shown) with specific intervals between each other.
  • the lighting element 10 emits illumination light and outputs the illumination light toward the display element 20.
  • the lighting element 10 includes a light source unit 11, a light guide plate 12, and a reflective sheet 13.
  • the lighting element 10 is, for example, a side light type lighting element.
  • the lighting element 10 constitutes a surface light source.
  • the lighting element 10 may be configured so that the light intensity reaches a peak in an oblique direction at an angle ⁇ 1 , which will be described later.
  • the light source unit 11 is disposed to face the side of the light guide plate 12.
  • the light source unit 11 emits light toward the side of the light guide plate 12.
  • the light source unit 11 includes a plurality of light-emitting elements, for example, white LEDs (Light Emitting Diodes).
  • the light guide plate 12 guides the illumination light from the light source unit 11 and emits the illumination light from its upper surface.
  • the reflection sheet 13 reflects the illumination light emitted from the bottom surface of the light guide plate 12 back toward the light guide plate 12.
  • the lighting element 10 may be provided with a member (including a prism sheet and a diffusion sheet) that improves optical characteristics on the upper surface of the light guide plate 12.
  • the display element 20 is a transmissive display element.
  • the display element 20 is composed of, for example, a liquid crystal display element.
  • the drive mode of the display element 20 is not particularly limited, and TN (Twisted Nematic) mode, VA (Vertical Alignment) mode, homogeneous mode, or the like can be used.
  • the display element 20 receives illumination light emitted from the illumination element 10.
  • the display element 20 transmits the illumination light from the illumination element 10 and performs optical modulation. Then, the display element 20 displays a specific image on its own screen.
  • the orientation control element 30 has a function of reducing unnecessary light.
  • the unnecessary light is a light component that does not contribute to generating an aerial image, and includes a light component that transmits through the optical element 40 in the normal direction.
  • the orientation control element 30 is configured to transmit light components in a predetermined angular range centered on an oblique direction at an angle ⁇ 1 with respect to the normal direction, and to block light components outside the above-mentioned angular range.
  • the area of the orientation control element 30 is set to be equal to or larger than the area of the display element 20. A detailed configuration of the orientation control element 30 will be described later.
  • the optical element 40 reflects light incident from the bottom side to the top side.
  • the optical element 40 also reflects light incident obliquely from the bottom side, for example, in the front direction (normal direction).
  • the area of the optical element 40 is set to be equal to or larger than the area of the display element 20.
  • the detailed configuration of the optical element 40 will be described later.
  • the optical element 40 forms an aerial image 2 in the air.
  • the aerial image 2 is parallel to the element surface of the optical element 40 and is a two-dimensional image.
  • the element surface refers to a virtual plane on which the optical element 40 extends in the in-plane direction.
  • the element surface has the same meaning as in-plane.
  • the element surfaces of the other elements have the same meaning.
  • An observer 3 standing in front of the optical element 40 can view the aerial image 2.
  • the sensing element 50 is disposed above the optical element 40 and on one side of the aerial display device 1.
  • the sensing element 50 is disposed, for example, at approximately the same level as the aerial image 2.
  • the sensing element 50 may also be disposed below the aerial image 2 so that the light emitted from the sensing element 50 crosses the aerial image 2 diagonally.
  • the sensing element 50 is fixed to a specific position by a fixing member (not shown).
  • the sensing element 50 forms a detection area in a two-dimensional spatial region that includes part or all of the aerial image 2 generated by the aerial display device 1.
  • the sensing element 50 detects an object (body) present in the detection area.
  • the sensing element 50 emits infrared light into the detection area and detects the reflected light reflected by the object.
  • the sensing element 50 includes a light-emitting unit that emits infrared light toward the detection area and a light-receiving unit (sensor) that detects the reflected light reflected by the object.
  • the sensing element 50 is composed of, for example, a line sensor in which multiple light-emitting elements and multiple light-receiving elements are alternately arranged in a row.
  • the line sensor can scan space in a line using infrared light, and can scan a two-dimensional space consisting of the direction in which multiple light-emitting elements are arranged and the direction in which light travels.
  • the direction of the infrared light emitted by the sensing element 50 (emission angle from the XY plane) can be set appropriately.
  • FIG. 3A is a plan view of the alignment control element 30 shown in Fig. 1.
  • Fig. 3B is a cross-sectional view of the alignment control element 30 taken along the line AA' in Fig. 3A.
  • the substrate 31 is configured to be planar in the XY plane and has a rectangular parallelepiped shape.
  • the substrate 31 transmits light.
  • a plurality of transparent members 33 are provided, each extending in the Y direction and aligned in the X direction.
  • a plurality of light-shielding members 34 are provided, each extending in the Y direction and aligned in the X direction.
  • the plurality of transparent members 33 and the plurality of light-shielding members 34 are arranged alternately such that adjacent ones are in contact with each other.
  • a substrate 32 is provided on the plurality of transparent members 33 and the plurality of light-shielding members 34.
  • the substrate 32 is configured to be planar in the XY plane and has a rectangular parallelepiped shape.
  • the substrate 32 transmits light.
  • the transparent member 33 extends in an oblique direction at an angle ⁇ 1 with respect to the normal direction of the base material 31 in the XZ plane.
  • the transparent member 33 is a parallelogram with a side surface inclined by the angle ⁇ 1 in the XZ plane.
  • the transparent member 33 transmits light.
  • the light blocking member 34 extends in an oblique direction at an angle ⁇ 1 with respect to the normal direction of the base material 31 in the XZ plane.
  • the light blocking member 34 is a parallelogram with side surfaces inclined by an angle ⁇ 1 in the XZ plane.
  • the light blocking member 34 blocks light.
  • the thickness of the light blocking member 34 is set to be thinner than the thickness of the transparent member 33.
  • Two adjacent light blocking members 34 are positioned so that their ends slightly overlap in the Z direction.
  • Glass or transparent resin (including acrylic resin) is used for the base materials 31 and 32 and the transparent member 33.
  • resin mixed with black dye or pigment is used for the light blocking member 34.
  • the alignment control element 30 may be constructed by omitting one or both of the substrates 31 and 32.
  • the function of the alignment control element 30 can be realized if multiple transparent members 33 and multiple light blocking members 34 are arranged alternately.
  • the orientation control element 30 configured in this manner can transmit the display light so that the light intensity in the oblique direction at an angle ⁇ 1 with respect to the normal direction becomes a peak.
  • the angle ⁇ 1 is set, for example, to be equal to or greater than 10 degrees and equal to or less than 60 degrees.
  • the orientation control element 30 is configured to block light components other than the range of 30° ⁇ 30° with respect to the normal direction.
  • the orientation control element 30 is configured to block light components other than the range of 30° ⁇ 20° with respect to the normal direction.
  • the orientation control element 30 may be disposed between the lighting element 10 and the display element 20. Also, the orientation control element 30 may be omitted when constructing the aerial display device 1.
  • FIG. 4 is a perspective view of the optical element 40 shown in Fig. 1.
  • Fig. 4 also shows an enlarged view of a portion of the optical element 40.
  • the enlarged view in Fig. 4 is a side view in the XZ plane.
  • the optical element 40 includes a substrate 41 and a plurality of optical elements 42.
  • the substrate 41 is configured to be planar in the XY plane and has a rectangular parallelepiped shape.
  • a plurality of optical elements 42 are provided on the bottom surface of the substrate 41.
  • Each of the plurality of optical elements 42 is composed of a triangular prism.
  • the optical element 42 is arranged so that three side surfaces of the triangular prism are parallel to the XY plane, and one side surface is in contact with the substrate 41.
  • the plurality of optical elements 42 each extend in the Y direction and are arranged side by side in the X direction. In other words, the plurality of optical elements 42 have a sawtooth shape in the XZ plane.
  • Each of the multiple optical elements 42 has an incident surface 43 and a reflective surface 44.
  • the left side surface is the incident surface 43
  • the right side surface is the reflective surface 44.
  • the incident surface 43 is a surface onto which light from the display element 20 is incident.
  • the reflective surface 44 is a surface that reflects light that has been incident on the incident surface 43 from the outside, within the optical element 42.
  • the incident surface 43 and the reflective surface 44 form an angle ⁇ p .
  • the substrate 41 and the optical element 42 are made of a transparent material.
  • the optical element 42 is, for example, formed integrally with the substrate 41 using the same transparent material as the substrate 41.
  • the substrate 41 and the optical element 42 may be formed separately, and the optical element 42 may be adhered to the substrate 41 using a transparent adhesive.
  • the transparent material that constitutes the substrate 41 and the optical element 42 may be glass or a transparent resin (including acrylic resin).
  • the optical element 40 configured in this way internally reflects incident light and forms a real image in the air.
  • the optical element 40 also forms an aerial image 2 at a position in front of the element surface.
  • FIG. 5 Block configuration of the aerial display device 1
  • Figure 5 is a block diagram of the aerial display device 1.
  • the aerial display device 1 includes a control unit 60, a storage unit 61, an input/output interface (input/output IF) 62, a display unit 63, a sensing element 50, and an input unit 64.
  • the control unit 60, the storage unit 61, and the input/output interface 62 are connected to each other via a bus 65.
  • the input/output interface 62 is connected to the display unit 63, the sensing element 50, and the input unit 64.
  • the input/output interface 62 performs interface processing for each of the display unit 63, the sensing element 50, and the input unit 64 in accordance with a predetermined standard.
  • the display unit 63 includes an illumination element 10 and a display element 20.
  • the display unit 63 displays an image.
  • the sensing element 50 includes a light-emitting unit 51 and a light-receiving unit 52.
  • the light-emitting unit 51 emits infrared light toward the detection area.
  • the light-receiving unit 52 detects the light reflected by the object.
  • the control unit 60 is composed of one or more processors, such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit).
  • the control unit 60 realizes various functions by executing programs stored in the memory unit 61.
  • the control unit 60 includes a display processing unit 60A, an information processing unit 60B, a detection position calculation unit 60C, and a display mode setting unit 60D.
  • the display processing unit 60A controls the operation of the display unit 63 (specifically, the lighting element 10 and the display element 20).
  • the display processing unit 60A controls the on and off of the lighting element 10.
  • the display processing unit 60A transmits an image signal to the display element 20, causing the display element 20 to display an image.
  • the information processing unit 60B generates an image to be displayed by the aerial display device 1.
  • the information processing unit 60B can use image data stored in the memory unit 61.
  • the information processing unit 60B may also obtain image data from outside using a communication function (not shown).
  • the detection position calculation unit 60C controls the operation of the sensing element 50.
  • the detection position calculation unit 60C controls the light emitting unit 51 included in the sensing element 50 to emit infrared light, and forms a detection area consisting of infrared light in a specified spatial region.
  • the detection position calculation unit 60C calculates the position of the target object based on multiple detection signals sent from the light receiving unit 52 included in the sensing element 50.
  • the display mode setting unit 60D sets the arrangement of the aerial image 2 according to a display mode that has been set among a plurality of display modes.
  • the display mode setting unit 60D selects a specific display mode based on information related to the display mode that has been stored in advance in the storage unit 61.
  • the memory unit 61 includes non-volatile memory devices such as a ROM (Read Only Memory), a HDD (Hard Disk Drive), and a SSD (Solid State Drive), and volatile memory devices such as a RAM (Random Access Memory) and a register.
  • the memory unit 61 stores programs executed by the control unit 60.
  • the memory unit 61 stores various data necessary for the control of the control unit 60.
  • the memory unit 61 stores data for images to be displayed by the aerial display device 1.
  • the memory unit 61 stores information regarding multiple display modes.
  • the input unit 64 includes, for example, a touch panel or buttons, and receives information input by the user.
  • the information processing unit 60B is capable of selecting an image to be displayed on the display unit 63 based on the information received by the input unit 64.
  • Fig. 2 The arrows in Fig. 2 indicate optical paths.
  • light emitted from an arbitrary point "o" of the display element 20 is incident on the orientation control element 30.
  • a light component at an angle ⁇ 1 (including a light component in a predetermined angle range centered on the angle ⁇ 1 ) is transmitted through the orientation control element 30.
  • the light transmitted through the orientation control element 30 is incident on the optical element 40.
  • the optical element 40 reflects the incident light to the opposite side to the orientation control element 30, and forms an aerial image 2 in the air.
  • Figure 6 is a perspective view illustrating how light is reflected in the optical element 40.
  • Figure 7 is a side view of the XZ plane illustrating how light is reflected in the optical element 40.
  • Figure 7 is a view of the optical element 40 when both eyes of the observer 3 (i.e., the line connecting both eyes) are parallel to the X direction.
  • Figure 8 is a side view of the YZ plane illustrating how light is reflected in the optical element 40.
  • Figure 8 is a view of the optical element 40 when both eyes of the observer 3 are parallel to the Y direction.
  • the critical angle is the smallest incident angle above which total reflection occurs.
  • the critical angle is the angle with respect to the perpendicular to the incident surface.
  • the light emitted from point "o" is totally reflected by the reflecting surface 44 of the optical element 42, and the light is focused in the air to generate an aerial image.
  • the light emitted from point "o" is not reflected by the reflecting surface 44 of the optical element 42, and the light does not form an image in the air, so it does not contribute to the generation of an aerial image.
  • the condition for observer 3 to be able to see the aerial image is that both eyes of observer 3 are parallel to the X direction or close to it (for example, ⁇ 10 degrees with respect to the X direction). Also, if observer 3's eyes are parallel to the X direction or close to it and the viewpoint is moved along the Y direction, the aerial image can always be recognized.
  • FIG. 9 is a diagram explaining the angular conditions of the incident surface 43 and the reflecting surface 44 of the optical element 40.
  • the angle of the incident surface 43 with respect to the Z direction (the direction perpendicular to the element surface) is ⁇ 2
  • the angle of the reflecting surface 44 with respect to the Z direction is ⁇ 3
  • the angle between the incident surface 43 and the reflecting surface 44 is ⁇ p .
  • the refractive index of the material of optical element 40 is n p , and the refractive index of air is 1.
  • the incident angle at incident surface 43 is ⁇ 4 , and the refraction angle is ⁇ 5.
  • the incident angle at the top surface of optical element 40 is ⁇ 8 , and the refraction angle is ⁇ 9.
  • the refraction angle ⁇ 9 is the emission angle.
  • the emission angle ⁇ 9 is expressed by the following equation (2).
  • ⁇ 9 sin ⁇ 1 (n p * sin (sin ⁇ 1 ((1/n p ) * sin (90° - ( ⁇ 1 + ⁇ 2 )))) + ⁇ 2 + 2 ⁇ 3 - 90°)) ...
  • the critical angle at the reflecting surface 44 is expressed by the following formula (3).
  • Critical angle ⁇ ⁇ 6 ( ⁇ 7 )
  • Critical angle sin ⁇ 1 (1/n p ) (3)
  • the angle of incidence ⁇ 6 on the reflecting surface 44 is set to be larger than the critical angle on the reflecting surface 44.
  • the angle ⁇ 3 of the reflecting surface 44 is set so that the angle of incidence of light incident on the reflecting surface 44 is larger than the critical angle.
  • the angle ⁇ 2 of the incident surface 43 is set so that the light incident on the incident surface 43 is not totally reflected by the incident surface 43.
  • the angle ⁇ 2 of the incident surface 43 is set so that the angle of incidence of the light incident on the incident surface 43 is smaller than the critical angle.
  • the angle between the element surface of the optical element 40 and the surface of the aerial image 2, and the distance between the element surface of the optical element 40 and the surface of the aerial image 2 can be adjusted by optimally setting the angle ⁇ 1 of light incident on the optical element 40, the refractive index of the optical element 40, the angle ⁇ 2 of the incident surface 43 of the optical element 40, and the angle ⁇ 3 of the reflecting surface 44 of the optical element 40.
  • FIG. 10 is a schematic diagram explaining a method for setting the spacing of the aerial images 2.
  • the display element 20 and the optical element 40 are extracted and shown.
  • FIG. 10 is a side view in the YZ plane.
  • the aerial display device 1 is placed in front of the observer 3, who is standing upright or sitting in a wheelchair or the like. That is, the Y direction is the vertical direction (direction perpendicular to the ground), the X direction is the horizontal direction (direction parallel to the ground), and the Z direction is the front direction of the observer 3 (direction parallel to the line of sight).
  • the up and down direction of the observer 3 is along the Y direction.
  • the display element 20 displays a display image 21 on its screen.
  • the light of the display image 21 is incident on the optical element 40 via an orientation control element 30 (not shown).
  • the optical element 40 reflects the light of the display image 21 to the opposite side to the display element 20, forming an aerial image 2 in the air.
  • the aerial image 2 is, for example, a push button.
  • Figure 10 illustrates an example of multiple display images 21 and multiple aerial images 2 along the Y direction.
  • the sensing element 50 forms a two-dimensional detection area 53 made of infrared light at the aerial image level, which is the position (level) at which the aerial image 2 is displayed, and is capable of detecting an object present in this detection area 53.
  • FIG. 10 shows a detection partial area 54 corresponding to the aerial image 2. When viewed from the Z direction, the detection partial area 54 overlaps with the aerial image 2 and has the same area as the aerial image 2. When an object (e.g., the finger of the observer 3) is present in a certain detection partial area 54, the sensing element 50 (specifically, the sensing element 50 and the detection position calculation unit 60C) detects that the aerial image 2 overlapping the detection partial area 54 has been touched by the observer 3.
  • the information of the detection partial area 54 is set in advance according to the image of the aerial image 2, and the information is stored in the storage unit 61.
  • the length of the display image 21 on the display element 20 in the Y direction is "Ia", the interval between adjacent display images 21 in the Y direction on the display element 20 is “Id”, the length of the detection partial area 54 in the Y direction is "Sa”, and the interval between adjacent detection partial areas 54 in the Y direction is "Sd”.
  • the length of the aerial image 2 in the Y direction is the same as the length Sa.
  • the interval between adjacent aerial images 2 in the Y direction is the same as the interval Sd.
  • the center (also called the reference point) of the aerial image 2 in the Y direction is "o'", and the movement amount of the observer 3 from the reference point o' in the Y direction is "L".
  • the position of the observer 3 means the position of the eyes of the observer 3.
  • the distance from the display element 20 to the optical element 40 is "Doi"
  • the distance from the optical element 40 to the detection area 53 is "Dao”
  • the distance from the detection area 53 to the observer 3 is "Dea”.
  • Ia Sa
  • Id Sd.
  • the spacing Sd of the aerial images 2 is set to correspond to each of the following first to third display modes, depending on the location where the aerial display device 1 is used.
  • the first display mode is an embodiment of the aerial display device 1 that is provided in a device that is mainly used by persons aged 16 or older.
  • the first display mode includes an aerial display device provided in a service station (SS)-point of sales (POS) terminal for gas stations and a reception system for medical institutions.
  • SS service station
  • POS point of sales
  • Figure 11 explains the average height of Japanese people aged 16 and over.
  • Figure 11 is taken from the 2020 Physical Fitness and Athletic Ability Survey published by the Japan Sports Agency.
  • Figure 11 shows the sample size, average value, and standard deviation for each age.
  • Figure 11 provides information on the average height of Japanese people aged 16 and over.
  • the maximum average height of Japanese people aged 16 and over is 172.13 (cm), and the minimum is 157.26 (cm). From the maximum and minimum values, the range of height is 164.69 ⁇ 7.4 (cm).
  • the first display mode by arranging multiple aerial images 2 so that the minimum spacing between the aerial images 2 in the Y direction is 6.7 (mm), erroneous detection by the sensing element 50 can be suppressed.
  • the spacing between the aerial images 2 in the Y direction is 6.7 (mm) or more, erroneous detection by the sensing element 50 can be suppressed.
  • the upper limit of the spacing between the aerial images 2 in the Y direction is half the size of the aerial display device 1 in the Y direction.
  • the second display mode is an embodiment of the aerial display device 1 provided on equipment for wheelchair users.
  • Figure 12 is a diagram explaining the eye level of a wheelchair user.
  • Figure 12 shows a wheelchair and a user sitting in the wheelchair.
  • erroneous detection by the sensing element 50 can be suppressed by arranging multiple aerial images 2 so that the minimum spacing between the aerial images 2 in the Y direction is 4.5 (mm). In addition, erroneous detection by the sensing element 50 can be suppressed by setting the spacing between the aerial images 2 in the Y direction to 4.5 (mm) or more.
  • the third display mode is an embodiment of the aerial display device 1 provided in a device that is mainly used by people aged 15 or younger.
  • the third display mode includes an aerial display device provided in a game machine for children and an information input device for children.
  • Figure 13 explains the average height of Japanese people under the age of 15.
  • Figure 13 is taken from the 2020 Physical Fitness and Athletic Ability Survey published by the Japan Sports Agency.
  • Figure 13 shows the sample size, average value, and standard deviation for each age.
  • Figure 13 provides information on the average height of Japanese people under the age of 15.
  • the third display mode by arranging multiple aerial images 2 so that the minimum spacing between the aerial images 2 in the Y direction is 28 (mm), it is possible to suppress erroneous detection by the sensing elements 50.
  • the spacing between the aerial images 2 in the Y direction is 28 (mm) or more, it is possible to suppress erroneous detection by the sensing elements 50.
  • the display mode setting unit 60D reads information about the display mode from the storage unit 61 (step S100).
  • the display modes include the first to third display modes described above.
  • the display mode setting unit 60D determines an image according to the display mode based on the information read from the storage unit 61 (step S101).
  • the display processing unit 60A causes the display element 20 to display the image determined by the display mode setting unit 60D (step S102).
  • the optical element 40 reflects light from the display element 20 to display an aerial image 2 in the air. Furthermore, the multiple aerial images 2 are arranged at intervals set by the display mode. This makes it possible to suppress erroneous detection by the sensing element 50.
  • the minimum distance between adjacent aerial images 2 in the Y direction is set by taking into consideration the movement amount L of the observer 3 in advance.
  • the movement amount L is calculated based on the expected height difference between the observers. This makes it possible to suppress erroneous detection in which, when the observer 3 touches a target aerial image, it is recognized that the observer 3 has touched an aerial image adjacent to the target aerial image. As a result, it is possible to realize an aerial display device 1 that can more accurately detect the touch operation on the aerial image 2 by the observer 3.
  • the aerial display device 1 can display an aerial image 2 in the air by reflecting light emitted from the display element 20 by the optical element 40.
  • the aerial display device 1 can also display the aerial image 2 in the front direction, parallel to the element surface of the optical element 40. It is also possible to realize an aerial display device 1 that can improve display quality.
  • the observer 3 when the observer 3 looks at the optical element 40 with both eyes parallel to or close to the X direction (i.e., the direction in which the multiple optical elements 42 are arranged), the observer 3 can see an aerial image. In addition, when the observer 3 moves the viewpoint along the Y direction with both eyes parallel to or close to the X direction, the observer 3 can always see an aerial image. In addition, a wider viewing angle can be achieved when the observer 3's eyes are parallel to or close to the X direction.
  • the multiple elements that make up the aerial display device 1 can be arranged in parallel. This makes it possible to realize an aerial display device 1 that can be made smaller in size in the Z direction.
  • one of a plurality of display modes is selected and executed in response to an instruction from a user.
  • FIG. 15 is a flowchart explaining the operation of setting the display mode in the aerial display device 1 according to the second embodiment of the present invention.
  • the configuration of the aerial display device 1 is the same as in the first embodiment.
  • the input unit 64 includes an operation unit that allows the user to select one of a plurality of display modes.
  • the users include observers of the aerial display device 1 and administrators who manage the aerial display device 1. The users can use the input unit 64 to select one of a plurality of display modes.
  • the display mode setting unit 60D monitors whether a display mode has been selected by the user via the input unit 64 (step S200).
  • the display mode setting unit 60D reads information about the display mode from the storage unit 61 (step S100).
  • the subsequent operations are the same as those in the first embodiment.
  • the aerial display device 1 can automatically execute the optimal display mode by accepting a user's operation.
  • Other effects are the same as those of the first embodiment.
  • the display element 20 and the optical element 40 are arranged parallel to each other.
  • the present invention is not limited to this, and the display element 20 may be arranged obliquely with respect to the optical element 40.
  • the angle between the display element 20 and the optical element 40 is set in the range of more than 0 degrees and less than 45 degrees.
  • the orientation control element 30 can be omitted.
  • the left side of the optical element 42 is defined as the incident surface 43, and the right side is defined as the reflective surface 44.
  • the incident surface 43 and the reflective surface 44 may be configured in reverse. In this case, the function of the aerial display device 1 described in the embodiment will also be reversed.
  • a liquid crystal display element is used as an example of the display element 20, but the present invention is not limited to this.
  • the display element 20 can also be a self-luminous organic EL (electroluminescence) display element or a micro LED (Light Emitting Diode) display element.
  • a micro LED display element is a display element that uses LEDs to emit the R (red), G (green), and B (blue) that make up a pixel. When a self-luminous display element 20 is used, the lighting element 10 is not necessary.
  • the present invention is not limited to the above-described embodiments, and can be modified in various ways during implementation without departing from the gist of the invention.
  • the embodiments may also be implemented in appropriate combination, in which case the combined effects can be obtained.
  • the above-described embodiments include various inventions, and various inventions can be extracted by combinations selected from the multiple constituent elements disclosed. For example, if the problem can be solved and an effect can be obtained even if some constituent elements are deleted from all the constituent elements shown in the embodiments, the configuration from which these constituent elements are deleted can be extracted as an invention.
  • 1...aerial display device 2...aerial image, 3...observer, 10...illumination element, 11...light source unit, 12...light guide plate, 13...reflective sheet, 20...display element, 21...display image, 30...orientation control element, 31...substrate, 32...substrate, 33...transparent member, 34...light shielding member, 40...optical element, 41...substrate, 42...optical element, 43...incident surface, 44...reflective surface, 50...sensing element, 51...light emitting unit, 52...light receiving unit, 53...detection area, 54...detection partial area, 60...control unit, 60A...display processing unit, 60B...information processing unit, 60C...detection position calculation unit, 60D...display mode setting unit, 61...storage unit, 62...input/output interface, 63...display unit, 64...input unit, 65...bus, 70-72...light.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un dispositif d'affichage aérien qui comprend : un élément d'affichage (20) qui affiche une image ; un élément optique (40) qui est disposé de façon à recevoir de la lumière provenant de l'élément d'affichage (20), l'élément optique (40) réfléchissant la lumière provenant de l'élément d'affichage (20) à l'opposé de l'élément d'affichage (20) pour former une image aérienne dans l'air ; et un élément de détection (50) qui forme une zone de détection dans une zone spatiale chevauchant l'image aérienne et détecte un objet dans la zone de détection. L'espacement entre des images aériennes adjacentes est défini sur la base de la quantité de mouvement d'un observateur à partir du centre des images aériennes.
PCT/JP2023/039475 2022-11-04 2023-11-01 Dispositif d'affichage aérien WO2024096072A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-177587 2022-11-04
JP2022177587A JP2024067476A (ja) 2022-11-04 2022-11-04 空中表示装置

Publications (1)

Publication Number Publication Date
WO2024096072A1 true WO2024096072A1 (fr) 2024-05-10

Family

ID=90930557

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/039475 WO2024096072A1 (fr) 2022-11-04 2023-11-01 Dispositif d'affichage aérien

Country Status (2)

Country Link
JP (1) JP2024067476A (fr)
WO (1) WO2024096072A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022100561A (ja) * 2020-12-24 2022-07-06 マクセル株式会社 空間浮遊映像表示装置
JP2022113411A (ja) * 2021-01-25 2022-08-04 マクセル株式会社 空間浮遊映像表示装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022100561A (ja) * 2020-12-24 2022-07-06 マクセル株式会社 空間浮遊映像表示装置
JP2022113411A (ja) * 2021-01-25 2022-08-04 マクセル株式会社 空間浮遊映像表示装置

Also Published As

Publication number Publication date
JP2024067476A (ja) 2024-05-17

Similar Documents

Publication Publication Date Title
JP5174962B2 (ja) タッチパネル、液晶パネル、液晶表示装置、及びタッチパネル一体型の液晶表示装置
US8619062B2 (en) Touch-pressure sensing in a display panel
US6948820B2 (en) Interactive display system having an optical channeling element
JP6757779B2 (ja) 非接触入力装置
JP7547914B2 (ja) 空中表示装置
US20230288724A1 (en) Aerial floating image information display system and light source apparatus used in the same
KR20100134858A (ko) 어레이 방식의 후방 카메라를 이용한 멀티터치 센싱 장치
US20240019715A1 (en) Air floating video display apparatus
WO2022113745A1 (fr) Dispositif d'affichage d'image flottante dans l'espace
WO2024096072A1 (fr) Dispositif d'affichage aérien
WO2023112617A1 (fr) Système d'affichage d'image flottante aérienne
US7062134B2 (en) Interactive display system having a scaled virtual target zone
WO2024101245A1 (fr) Dispositif d'affichage aérien
WO2024154760A1 (fr) Dispositif d'affichage semi-aérien et dispositif d'affichage
WO2024117075A1 (fr) Dispositif d'affichage aérien
WO2024090130A1 (fr) Dispositif d'affichage aérien
WO2024053253A1 (fr) Dispositif d'affichage aérien
WO2023228530A1 (fr) Système d'affichage d'informations d'image flottante spatiale
WO2024018929A1 (fr) Dispositif d'affichage aérien
US20240323343A1 (en) Air floating video display apparatus
WO2023136106A1 (fr) Appareil d'affichage aérien
WO2023199685A1 (fr) Système d'affichage de vidéo flottante spatiale et système de traitement de vidéo flottante spatiale
JP2024039862A (ja) 空中表示装置
CN118382829A (zh) 空间悬浮影像显示系统
JP2023102461A (ja) 空間浮遊映像情報表示システムおよびそれに用いられる光学系

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23885826

Country of ref document: EP

Kind code of ref document: A1