WO2024101245A1 - Dispositif d'affichage aérien - Google Patents

Dispositif d'affichage aérien Download PDF

Info

Publication number
WO2024101245A1
WO2024101245A1 PCT/JP2023/039476 JP2023039476W WO2024101245A1 WO 2024101245 A1 WO2024101245 A1 WO 2024101245A1 JP 2023039476 W JP2023039476 W JP 2023039476W WO 2024101245 A1 WO2024101245 A1 WO 2024101245A1
Authority
WO
WIPO (PCT)
Prior art keywords
aerial
light
display device
detection
display
Prior art date
Application number
PCT/JP2023/039476
Other languages
English (en)
Japanese (ja)
Inventor
康宏 代工
Original Assignee
Ｔｏｐｐａｎホールディングス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ｔｏｐｐａｎホールディングス株式会社 filed Critical Ｔｏｐｐａｎホールディングス株式会社
Publication of WO2024101245A1 publication Critical patent/WO2024101245A1/fr

Links

Images

Definitions

  • the present invention relates to an aerial display device.
  • Aerial display devices capable of displaying images and videos as aerial images are being researched, and are expected to become a new human-machine interface.
  • An aerial display device for example, is equipped with a two-sided corner reflector array in which two-sided corner reflectors are arranged in an array, and reflects light emitted from the display surface of a display element to form a real image in the air.
  • the display method using a two-sided corner reflector array is aberration-free, and can display a real image (aerial image) in a plane-symmetrical position.
  • Patent Document 1 discloses an optical element in which a transparent square prism protruding from the surface of a transparent flat plate is used as a two-sided corner reflector, and multiple square prisms are arranged in an array on a flat surface.
  • Patent Document 2 discloses an optical element in which each of the first and second light control panels is formed by arranging multiple planar light reflecting sections vertically inside a transparent flat plate, and the first and second light control panels are arranged so that the planar light reflecting sections are orthogonal to each other.
  • the optical elements of Patent Documents 1 and 2 reflect light emitted from a display element twice from orthogonal reflecting surfaces to generate an aerial image.
  • the observer can touch the aerial image displayed by the aerial display device without touching the device.
  • the sensing element of the aerial display device detects objects present in the area of the aerial image and recognizes that the observer has touched the aerial image.
  • the aerial image may move in tandem with the viewpoint.
  • the aerial image and the detection area for detecting the aerial image become misaligned.
  • the sensing element may recognize that an aerial image other than the one the observer intended has been touched.
  • the present invention provides an aerial display device that can more accurately detect touch operations on an aerial image by an observer.
  • an aerial display device comprising: a display element for displaying an image; an optical element arranged to receive light from the display element and reflecting the light from the display element to the opposite side to the display element to form an aerial image in the air; and a sensing element for forming a detection area in a spatial region overlapping the aerial image and detecting an object in the detection area, the aerial image including first and second aerial images arranged along a first direction, the detection area including first and second detection areas corresponding to the first and second aerial images, respectively, the first detection area including a plurality of first partial areas each extending in a second direction perpendicular to the first direction and aligned in the first direction, the second detection area including a plurality of second partial areas each extending in the second direction and aligned in the first direction, and the sensing element determining which of the first and second aerial images has been touched based on the relationship between the number of first partial areas turned on among the plurality of first partial areas and the number of second partial areas turned on
  • an aerial display device in which, if the number of turned-on first partial areas among the plurality of first partial areas is m, and the number of turned-on second partial areas among the plurality of second partial areas is n, the sensing element determines that the first aerial image has been touched if m>n, and determines that the second aerial image has been touched if m ⁇ n.
  • an aerial display device in which the sensing element includes a light-emitting section that emits light toward the detection area and a light-receiving section that receives the light reflected by the object.
  • an aerial display device in which the optical element includes a planar substrate and a plurality of optical elements disposed below the substrate, each extending in the first direction and aligned in the second direction, each of the plurality of optical elements being inclined with respect to the normal direction of the substrate and having an entrance surface and a reflection surface that are in contact with each other.
  • an aerial display device according to the first aspect, further comprising an orientation control element disposed between the display element and the optical element, which transmits oblique light components of the light from the display element.
  • an aerial display device in which the alignment control element includes a plurality of transparent members and a plurality of light-shielding members that are alternately arranged, and the plurality of light-shielding members are inclined with respect to the normal to the alignment control element.
  • an aerial display device in which the display element and the optical element are arranged parallel to each other.
  • the present invention provides an aerial display device that can more accurately detect touch operations on an aerial image by an observer.
  • FIG. 1 is a perspective view of an aerial display device according to a first embodiment of the present invention.
  • FIG. 2 is a side view of the aerial display device shown in FIG. 1 in the XZ plane.
  • FIG. 3 is a perspective view illustrating the appearance of the aerial display device.
  • FIG. 4A is a plan view of the alignment control element shown in FIG.
  • FIG. 4B is a cross-sectional view of the alignment control element taken along line AA' in FIG. 4A.
  • FIG. 5 is a perspective view of the optical element shown in FIG.
  • FIG. 6 is a block diagram of an aerial display device.
  • FIG. 7 is a perspective view illustrating the state of light reflection in an optical element.
  • FIG. 8 is a side view of the XZ plane for explaining how light is reflected in the optical element.
  • FIG. 1 is a perspective view of an aerial display device according to a first embodiment of the present invention.
  • FIG. 2 is a side view of the aerial display device shown in FIG. 1 in the
  • FIG. 9 is a side view of the YZ plane for explaining how light is reflected in the optical element.
  • FIG. 10 is a diagram for explaining the angular conditions of the incident surface and the reflecting surface in the optical element.
  • FIG. 11 is a diagram illustrating a state in which an observer touches an aerial image.
  • FIG. 12 is a diagram for explaining the state of an aerial image when an observer moves the viewpoint up and down.
  • FIG. 13 is a diagram illustrating an example of an aerial image displayed by the aerial display device.
  • FIG. 14 is a diagram illustrating an example of a detection region formed by a sensing element.
  • FIG. 15 is a diagram for explaining the detailed configuration of a part of the detection region.
  • FIG. 16 is a schematic diagram illustrating the detection operation by the sensing element.
  • FIG. 17 is a flowchart explaining the overall operation of the aerial display device.
  • FIG. 18 is a flowchart illustrating the overall operation of the aerial display device according to the second embodiment of the present invention.
  • FIG. 19 is a flowchart illustrating the overall operation of the aerial display device according to the third embodiment of the present invention.
  • FIG. 1 is a perspective view of the aerial display device 1 according to the first embodiment of the present invention.
  • the X direction is the direction along one side of the aerial display device 1
  • the Y direction is the direction perpendicular to the X direction in the horizontal plane
  • the Z direction is the direction perpendicular to the XY plane (also called the normal direction).
  • Fig. 2 is a side view of the aerial display device 1 shown in Fig. 1 in the XZ plane.
  • Fig. 3 is a perspective view illustrating the appearance of the aerial display device 1.
  • the aerial display device 1 is a device that displays images (including videos).
  • the aerial display device 1 displays an aerial image in the air above its own light emission surface. "Displaying an aerial image” has the same meaning as "forming an aerial image.”
  • the light emission surface of the aerial display device 1 refers to the upper surface of the component that is arranged in the uppermost layer among the multiple components that make up the aerial display device 1 and are arranged on the optical path.
  • An aerial image is a real image that is formed in the air.
  • the aerial display device 1 comprises an illumination element (also called a backlight) 10, a display element 20, an orientation control element 30, an optical element 40, a sensing element 50, and a housing 60.
  • the illumination element 10, the display element 20, the orientation control element 30, and the optical element 40 are arranged in this order along the Z direction and parallel to one another.
  • the illumination element 10, the display element 20, the orientation control element 30, and the optical element 40 are fixed at specific positions by fixing members (not shown) with specific intervals between them.
  • the lighting element 10 emits illumination light and outputs the illumination light toward the display element 20.
  • the lighting element 10 includes a light source unit 11, a light guide plate 12, and a reflective sheet 13.
  • the lighting element 10 is, for example, a side light type lighting element.
  • the lighting element 10 constitutes a surface light source.
  • the lighting element 10 may be configured so that the light intensity reaches a peak in an oblique direction at an angle ⁇ 1 , which will be described later.
  • the light source unit 11 is disposed to face the side of the light guide plate 12.
  • the light source unit 11 emits light toward the side of the light guide plate 12.
  • the light source unit 11 includes a plurality of light-emitting elements, for example, white LEDs (Light Emitting Diodes).
  • the light guide plate 12 guides the illumination light from the light source unit 11 and emits the illumination light from its upper surface.
  • the reflection sheet 13 reflects the illumination light emitted from the bottom surface of the light guide plate 12 back toward the light guide plate 12.
  • the lighting element 10 may be provided with a member (including a prism sheet and a diffusion sheet) that improves optical characteristics on the upper surface of the light guide plate 12.
  • the display element 20 is a transmissive display element.
  • the display element 20 is composed of, for example, a liquid crystal display element.
  • the drive mode of the display element 20 is not particularly limited, and TN (Twisted Nematic) mode, VA (Vertical Alignment) mode, homogeneous mode, or the like can be used.
  • the display element 20 receives illumination light emitted from the illumination element 10.
  • the display element 20 transmits the illumination light from the illumination element 10 and performs optical modulation. Then, the display element 20 displays a specific image on its own screen.
  • the orientation control element 30 has a function of reducing unnecessary light.
  • the unnecessary light is a light component that does not contribute to generating an aerial image, and includes a light component that transmits through the optical element 40 in the normal direction.
  • the orientation control element 30 is configured to transmit light components in a predetermined angular range centered on an oblique direction at an angle ⁇ 1 with respect to the normal direction, and to block light components outside the above-mentioned angular range.
  • the area of the orientation control element 30 is set to be equal to or larger than the area of the display element 20. A detailed configuration of the orientation control element 30 will be described later.
  • the optical element 40 reflects light incident from the bottom side to the top side.
  • the optical element 40 also reflects light incident obliquely from the bottom side, for example, in the front direction (normal direction).
  • the area of the optical element 40 is set to be equal to or larger than the area of the display element 20.
  • the detailed configuration of the optical element 40 will be described later.
  • the optical element 40 forms an aerial image 2 in the air.
  • the aerial image 2 is parallel to the element surface of the optical element 40 and is a two-dimensional image.
  • the element surface refers to a virtual plane on which the optical element 40 extends in the in-plane direction.
  • the element surface has the same meaning as in-plane.
  • the element surfaces of the other elements have the same meaning.
  • An observer 3 standing in front of the optical element 40 can view the aerial image 2.
  • the sensing element 50 is disposed above the optical element 40 and on one side of the aerial display device 1.
  • the sensing element 50 is disposed, for example, at approximately the same level as the aerial image 2.
  • the sensing element 50 may also be disposed below the aerial image 2 so that the light emitted from the sensing element 50 crosses the aerial image 2 diagonally.
  • the sensing element 50 is fixed to a specific position by a fixing member (not shown).
  • the sensing element 50 forms a detection area 53 in a two-dimensional spatial region that includes part or all of the aerial image 2 generated by the aerial display device 1.
  • the sensing element 50 detects an object (body) present in the detection area 53.
  • the sensing element 50 emits infrared light to the detection area 53 and detects the reflected light reflected by the object.
  • the sensing element 50 includes a light-emitting unit that emits infrared light toward the detection area 53 and a light-receiving unit (sensor) that detects the reflected light reflected by the object.
  • the sensing element 50 is composed of, for example, a line sensor in which multiple light-emitting elements and multiple light-receiving elements are alternately arranged in a row.
  • the line sensor can scan space in a line using infrared light, and can scan a two-dimensional space consisting of the direction in which multiple light-emitting elements are arranged and the direction in which light travels.
  • the direction of the infrared light emitted by the sensing element 50 (emission angle from the XY plane) can be set appropriately.
  • the housing 60 houses the lighting element 10, the display element 20, the orientation control element 30, the optical element 40, and the sensing element 50.
  • the housing 60 has an opening at the top that exposes the optical element 40.
  • the sensing element 50 is attached to one side of the housing 60.
  • the sensing element 50 is not necessarily housed in the housing 60, and may be located at any position outside the housing 60.
  • the sensing element 50 can be located in a position optimal for detection operations.
  • FIG. 4A is a plan view of the alignment control element 30 shown in Fig. 1.
  • Fig. 4B is a cross-sectional view of the alignment control element 30 taken along the line AA' in Fig. 4A.
  • the substrate 31 is configured to be planar in the XY plane and has a rectangular parallelepiped shape.
  • the substrate 31 transmits light.
  • a plurality of transparent members 33 are provided, each extending in the Y direction and aligned in the X direction.
  • a plurality of light-shielding members 34 are provided, each extending in the Y direction and aligned in the X direction.
  • the plurality of transparent members 33 and the plurality of light-shielding members 34 are arranged alternately such that adjacent ones are in contact with each other.
  • a substrate 32 is provided on the plurality of transparent members 33 and the plurality of light-shielding members 34.
  • the substrate 32 is configured to be planar in the XY plane and has a rectangular parallelepiped shape.
  • the substrate 32 transmits light.
  • the transparent member 33 extends in an oblique direction at an angle ⁇ 1 with respect to the normal direction of the base material 31 in the XZ plane.
  • the transparent member 33 is a parallelogram with a side surface inclined by the angle ⁇ 1 in the XZ plane.
  • the transparent member 33 transmits light.
  • the light blocking member 34 extends in an oblique direction at an angle ⁇ 1 with respect to the normal direction of the base material 31 in the XZ plane.
  • the light blocking member 34 is a parallelogram with side surfaces inclined by an angle ⁇ 1 in the XZ plane.
  • the light blocking member 34 blocks light.
  • the thickness of the light blocking member 34 is set to be thinner than the thickness of the transparent member 33.
  • Two adjacent light blocking members 34 are positioned so that their ends slightly overlap in the Z direction.
  • Glass or transparent resin (including acrylic resin) is used for the base materials 31 and 32 and the transparent member 33.
  • resin mixed with black dye or pigment is used for the light blocking member 34.
  • the alignment control element 30 may be constructed by omitting one or both of the substrates 31 and 32.
  • the function of the alignment control element 30 can be realized if multiple transparent members 33 and multiple light blocking members 34 are arranged alternately.
  • the orientation control element 30 configured in this manner can transmit the display light so that the light intensity in the oblique direction at an angle ⁇ 1 with respect to the normal direction becomes a peak.
  • the angle ⁇ 1 is set, for example, to be equal to or greater than 10 degrees and equal to or less than 60 degrees.
  • the orientation control element 30 is configured to block light components other than the range of 30° ⁇ 30° with respect to the normal direction.
  • the orientation control element 30 is configured to block light components other than the range of 30° ⁇ 20° with respect to the normal direction.
  • the orientation control element 30 may be disposed between the lighting element 10 and the display element 20. Also, the orientation control element 30 may be omitted when constructing the aerial display device 1.
  • FIG. 5 is a perspective view of the optical element 40 shown in Fig. 1.
  • Fig. 5 also shows an enlarged view of a portion of the optical element 40.
  • the enlarged view in Fig. 5 is a side view in the XZ plane.
  • the optical element 40 includes a substrate 41 and a plurality of optical elements 42.
  • the substrate 41 is configured to be planar in the XY plane and has a rectangular parallelepiped shape.
  • a plurality of optical elements 42 are provided on the bottom surface of the substrate 41.
  • Each of the plurality of optical elements 42 is composed of a triangular prism.
  • the optical element 42 is arranged so that three side surfaces of the triangular prism are parallel to the XY plane, and one side surface is in contact with the substrate 41.
  • the plurality of optical elements 42 each extend in the Y direction and are arranged side by side in the X direction. In other words, the plurality of optical elements 42 have a sawtooth shape in the XZ plane.
  • Each of the multiple optical elements 42 has an incident surface 43 and a reflective surface 44.
  • the left side surface is the incident surface 43
  • the right side surface is the reflective surface 44.
  • the incident surface 43 is a surface onto which light from the display element 20 is incident.
  • the reflective surface 44 is a surface that reflects light that has been incident on the incident surface 43 from the outside, within the optical element 42.
  • the incident surface 43 and the reflective surface 44 form an angle ⁇ p .
  • the substrate 41 and the optical element 42 are made of a transparent material.
  • the optical element 42 is, for example, formed integrally with the substrate 41 using the same transparent material as the substrate 41.
  • the substrate 41 and the optical element 42 may be formed separately, and the optical element 42 may be adhered to the substrate 41 using a transparent adhesive.
  • the transparent material that constitutes the substrate 41 and the optical element 42 may be glass or a transparent resin (including an acrylic resin).
  • the optical element 40 configured in this way internally reflects incident light and forms a real image in the air.
  • the optical element 40 also forms an aerial image 2 at a position in front of the element surface.
  • FIG. 6 Block configuration of the aerial display device 1
  • Figure 6 is a block diagram of the aerial display device 1.
  • the aerial display device 1 includes a control unit 70, a memory unit 71, an input/output interface (input/output IF) 72, a display unit 73, a sensing element 50, and an input unit 74.
  • the control unit 70, the memory unit 71, and the input/output interface 72 are connected to each other via a bus 75.
  • the input/output interface 72 is connected to the display unit 73, the sensing element 50, and the input unit 74.
  • the input/output interface 72 performs interface processing for each of the display unit 73, the sensing element 50, and the input unit 74 in accordance with a predetermined standard.
  • the display unit 73 includes an illumination element 10 and a display element 20.
  • the display unit 73 displays an image.
  • the sensing element 50 includes a light-emitting unit 51 and a light-receiving unit 52.
  • the light-emitting unit 51 emits infrared light toward the detection area.
  • the light-receiving unit 52 detects the light reflected by the object.
  • the control unit 70 is composed of one or more processors, such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit).
  • the control unit 70 realizes various functions by executing programs stored in the memory unit 71.
  • the control unit 70 includes a display processing unit 70A, an information processing unit 70B, and a detection position calculation unit 70C.
  • the display processing unit 70A controls the operation of the display unit 73 (specifically, the lighting element 10 and the display element 20).
  • the display processing unit 70A controls the on and off of the lighting element 10.
  • the display processing unit 70A transmits an image signal to the display element 20, causing the display element 20 to display an image.
  • the information processing unit 70B generates an image to be displayed by the aerial display device 1.
  • the information processing unit 70B can use image data stored in the memory unit 71.
  • the information processing unit 70B may also obtain image data from outside using a communication function (not shown).
  • the detection position calculation unit 70C controls the operation of the sensing element 50.
  • the detection position calculation unit 70C controls the light emitting unit 51 included in the sensing element 50 to emit infrared light, and forms a detection area consisting of infrared light in a specified spatial region.
  • the detection position calculation unit 70C calculates the position of the target object based on multiple detection signals sent from the light receiving unit 52 included in the sensing element 50.
  • the memory unit 71 includes non-volatile memory devices such as a ROM (Read Only Memory), HDD (Hard Disk Drive), and SSD (Solid State Drive), and volatile memory devices such as a RAM (Random Access Memory) and registers.
  • the memory unit 71 stores programs executed by the control unit 70.
  • the memory unit 71 stores various data necessary for the control of the control unit 70.
  • the memory unit 71 stores data for images displayed by the aerial display device 1.
  • the input unit 74 includes, for example, a touch panel or buttons, and receives information input by the user.
  • the information processing unit 70B is capable of selecting an image to be displayed on the display unit 73 based on the information received by the input unit 74.
  • Fig. 2 The arrows in Fig. 2 indicate optical paths.
  • light emitted from an arbitrary point "o" of the display element 20 is incident on the orientation control element 30.
  • a light component at an angle ⁇ 1 (including a light component in a predetermined angle range centered on the angle ⁇ 1 ) is transmitted through the orientation control element 30.
  • the light transmitted through the orientation control element 30 is incident on the optical element 40.
  • the optical element 40 reflects the incident light to the opposite side to the orientation control element 30, and forms an aerial image 2 in the air.
  • Figure 7 is a perspective view illustrating how light is reflected in the optical element 40.
  • Figure 8 is a side view of the XZ plane illustrating how light is reflected in the optical element 40.
  • Figure 8 is a view of the optical element 40 when both eyes of the observer 3 (i.e., the line connecting both eyes) are parallel to the X direction.
  • Figure 9 is a side view of the YZ plane illustrating how light is reflected in the optical element 40.
  • Figure 9 is a view of the optical element 40 when both eyes of the observer 3 are parallel to the Y direction.
  • the critical angle is the smallest incident angle above which total reflection occurs.
  • the critical angle is the angle with respect to the perpendicular to the incident surface.
  • the light emitted from point "o" is totally reflected by the reflecting surface 44 of the optical element 42, and the light is focused in the air to generate an aerial image.
  • the light emitted from point "o" is not reflected by the reflecting surface 44 of the optical element 42, and the light does not form an image in the air, so it does not contribute to the generation of an aerial image.
  • the condition for observer 3 to be able to see the aerial image is that both eyes of observer 3 are parallel to the X direction or close to it (for example, ⁇ 10 degrees with respect to the X direction). Also, if observer 3's eyes are parallel to the X direction or close to it and the viewpoint is moved along the Y direction, the aerial image can always be recognized.
  • FIG. 10 is a diagram explaining the angular conditions of the incident surface 43 and the reflecting surface 44 of the optical element 40.
  • the angle of the incident surface 43 with respect to the Z direction (the direction perpendicular to the element surface) is ⁇ 2
  • the angle of the reflecting surface 44 with respect to the Z direction is ⁇ 3
  • the angle between the incident surface 43 and the reflecting surface 44 is ⁇ p .
  • the refractive index of the material of optical element 40 is n p , and the refractive index of air is 1.
  • the incident angle at incident surface 43 is ⁇ 4 , and the refraction angle is ⁇ 5.
  • the incident angle at the top surface of optical element 40 is ⁇ 8 , and the refraction angle is ⁇ 9.
  • the refraction angle ⁇ 9 is the emission angle.
  • the emission angle ⁇ 9 is expressed by the following equation (2).
  • ⁇ 9 sin ⁇ 1 (n p * sin (sin ⁇ 1 ((1/n p ) * sin (90° - ( ⁇ 1 + ⁇ 2 )))) + ⁇ 2 + 2 ⁇ 3 - 90°)) ...
  • the critical angle at the reflecting surface 44 is expressed by the following formula (3).
  • Critical angle ⁇ ⁇ 6 ( ⁇ 7 )
  • Critical angle sin ⁇ 1 (1/n p ) (3)
  • the angle of incidence ⁇ 6 on the reflecting surface 44 is set to be larger than the critical angle on the reflecting surface 44.
  • the angle ⁇ 3 of the reflecting surface 44 is set so that the angle of incidence of light incident on the reflecting surface 44 is larger than the critical angle.
  • the angle ⁇ 2 of the incident surface 43 is set so that the light incident on the incident surface 43 is not totally reflected by the incident surface 43.
  • the angle ⁇ 2 of the incident surface 43 is set so that the angle of incidence of the light incident on the incident surface 43 is smaller than the critical angle.
  • the angle between the element surface of the optical element 40 and the surface of the aerial image 2, and the distance between the element surface of the optical element 40 and the surface of the aerial image 2 can be adjusted by optimally setting the angle ⁇ 1 of light incident on the optical element 40, the refractive index of the optical element 40, the angle ⁇ 2 of the incident surface 43 of the optical element 40, and the angle ⁇ 3 of the reflecting surface 44 of the optical element 40.
  • Figure 11 is a diagram explaining how the observer 3 touches the aerial image 2.
  • the Y direction is the vertical direction (direction perpendicular to the ground)
  • the X direction is the horizontal direction (direction parallel to the ground)
  • the Z direction is the front direction of the observer 3 (direction parallel to the line of sight).
  • the up and down direction of the observer 3 is along the Y direction.
  • the aerial display device 1 forms aerial images 2A and 2B in the air.
  • the aerial images 2A and 2B are, for example, rectangular push buttons.
  • the aerial images 2A and 2B are displayed in different two-dimensional spatial regions.
  • the sensing element 50 forms detection areas 53A and 53B in areas that roughly overlap the aerial images 2A and 2B, respectively.
  • Detection areas 53A and 53B are formed with infrared light.
  • the shape of the aerial image is predetermined as the image to be displayed by the aerial display device 1, and information regarding the shape of the aerial image is stored in the memory unit 71 in association with information regarding the image displayed by the aerial display device 1.
  • the area occupied by the aerial image 2A is set as detection area 53A, and information regarding detection area 53A is stored in the memory unit 71.
  • a detection area is set for each of the multiple aerial images.
  • the observer 3 touches the aerial image 2A or 2B with his/her finger 3A.
  • the sensing element 50 detects the finger 3A of the observer 3 present in the detection area 53A or the detection area 53B based on the control of the control unit 70.
  • the detection position calculation unit 70C calculates the position of the object based on the signal sent from the light receiving unit 52 of the sensing element 50. If the calculated position is present in the detection area 53A, for example, the detection position calculation unit 70C determines that the aerial image 2A has been touched.
  • Figure 12 is a diagram explaining the state of the aerial images when observer 3 moves his/her viewpoint up and down.
  • the aerial images 2A, 2B viewed by observer 3 also move upward.
  • Figure 12 illustrates an example in which aerial images 2A, 2B move upward.
  • the aerial images 2A, 2B viewed by observer 3 also move downward.
  • the information on detection areas 53A and 53B is managed in advance by the control unit 70 based on the aerial image to be displayed, and detection areas 53A and 53B are always set to the same position. Therefore, when viewed by the observer 3, there may be a misalignment between the aerial images 2A and 2B and the detection areas 53A and 53B.
  • FIG. 13 is a diagram illustrating an example of an aerial image displayed by the aerial display device 1.
  • the aerial display device 1 displays four aerial images 2A to 2D.
  • Each of the aerial images 2A to 2D is, for example, a rectangular push button.
  • the aerial images 2A to 2D are arranged in a rectangle.
  • the aerial images 2A to 2D are, for example, colored differently from each other.
  • FIG. 14 is a diagram illustrating an example of a detection area formed by the sensing element 50.
  • the sensing element 50 forms four detection areas 53A-53D corresponding to the four aerial images 2A-2D, respectively.
  • the outer shape of the detection area 53A has the same shape as the aerial image 2A.
  • the detection area 53A is positioned so as to overlap with the aerial image 2A and is positioned at approximately the same level as the aerial image 2A.
  • the level of the aerial image 2A and the detection area 53A refers to the height from the light emission surface of the aerial display device 1.
  • the configuration of the detection areas 53B-53D is also similar to that of the detection area 53A.
  • FIG. 15 is a diagram for explaining the detailed configuration of some of the detection regions (detection regions 53A, 53B).
  • Detection region 53A includes multiple detection partial regions 54A, each extending in the X direction and aligned in the Y direction. Each of the multiple detection partial regions 54A has a rectangular shape.
  • the width (length in the Y direction) of the detection partial region 54A can be set as appropriate, and it is preferable that it is narrower from the viewpoint of improving detection accuracy.
  • the interval between adjacent detection partial regions 54A can be set as appropriate, and it is preferable that it is narrower from the viewpoint of improving detection accuracy.
  • the sensing element 50 can detect an object for each detection partial region 54A.
  • detection region 53B includes multiple detection partial regions 54B.
  • the configuration of detection regions 53C and 53D is also the same as that of detection region 53A.
  • the width and interval of the detection partial regions included in detection regions 53A to 53D are the same.
  • FIG. 16 is a schematic diagram explaining the detection operation by the sensing element 50. Two detection areas 53A and 53B are shown in FIG. 16. FIG. 16 shows the detection areas 53A and 53B as viewed from the opposite side to the observer 3 (the aerial display device 1 side).
  • Detection partial region is on refers to the state in which the detection partial region is detecting an object.
  • m is 0 or more and is 0 or less than the total number of detection partial regions 54A.
  • n is 0 or more and is 0 or less than the total number of detection partial regions 54B.
  • the touch operation by the observer 3 can be determined more accurately.
  • FIG. 17 is a flowchart explaining the overall operation in the aerial display device 1.
  • the aerial display device 1 displays two aerial images 2A, 2B and forms two detection areas 53A, 53B.
  • the control unit 70 displays the aerial images 2A and 2B (step S100).
  • the display processing unit 70A displays an image on the screen of the display element 20.
  • the optical element 40 reflects light from the display element 20 and forms the aerial images 2A and 2B in the air.
  • the sensing element 50 executes a sensing operation (step S101).
  • the light-emitting unit 51 included in the sensing element 50 emits infrared light to the detection areas 53A and 53B including the areas where the aerial images 2A and 2B are displayed.
  • the sensing element 50 monitors whether or not an object is present within the detection areas 53A and 53B (step S102). That is, the light receiving unit 52 included in the sensing element 50 monitors the infrared light reflected by the object.
  • the detection position calculation unit 70C determines the number of ON detection partial areas based on the signal detected by the sensing element 50 (step S103). Specifically, the detection position calculation unit 70C determines the relationship between the number m of ON detection partial areas 54A among all detection partial areas 54A included in the detection area 53A and the number n of ON detection partial areas 54B among all detection partial areas 54B included in the detection area 53B. The detection position calculation unit 70C compares the number m with the number n and determines whether the number m is larger or smaller than the number n.
  • step S104 Yes
  • the detection position calculation unit 70C determines that the first aerial image (corresponding to aerial image 2A) has been touched (step S105).
  • step S106 Yes
  • the detection position calculation unit 70C determines that the second aerial image (corresponding to aerial image 2B) has been touched (step S107).
  • step S106 No
  • the detection position calculation unit 70C determines that there is no touch operation by the observer 3 (step S108).
  • the touch operation on the aerial image 2 by the observer 3 is detected.
  • the aerial display device 1 executes an operation according to the touch operation by the observer 3.
  • a detection area 53 is formed corresponding to a certain aerial image 2, and this detection area 53 is composed of a plurality of linear detection partial areas 54. Then, the touch operation of the observer 3 is determined according to the number of detection partial areas 54 that are turned on by an object. This makes it possible to recognize the touch operation of the observer 3 on the targeted aerial image 2 even if an object exists in both of two adjacent detection areas 53. As a result, it is possible to realize an aerial display device 1 that can more accurately detect the touch operation of the observer 3 on the aerial image 2.
  • the aerial display device 1 can display an aerial image 2 in the air by reflecting light emitted from the display element 20 by the optical element 40.
  • the aerial display device 1 can also display the aerial image 2 in the front direction, parallel to the element surface of the optical element 40. It is also possible to realize an aerial display device 1 that can improve display quality.
  • the observer 3 when the observer 3 looks at the optical element 40 with both eyes parallel to or close to the X direction (i.e., the direction in which the multiple optical elements 42 are arranged), the observer 3 can see an aerial image. In addition, when the observer 3 moves the viewpoint along the Y direction with both eyes parallel to or close to the X direction, the observer 3 can always see an aerial image. In addition, a wider viewing angle can be achieved when the observer 3's eyes are parallel to or close to the X direction.
  • the multiple elements that make up the aerial display device 1 can be arranged in parallel. This makes it possible to realize an aerial display device 1 that can be made smaller in size in the Z direction.
  • Second embodiment when the number m of turned-on detection partial areas 54A is the same as the number n of turned-on detection partial areas 54B, the observer 3 is made aware that it is impossible to determine which of the two aerial images 2A, 2B he or she is touching.
  • FIG. 18 is a flowchart explaining the overall operation of the aerial display device 1 according to the second embodiment of the present invention.
  • the operations from steps S100 to S107 are the same as those in the first embodiment.
  • step S106 No
  • the control unit 70 blinks the first and second aerial images (aerial images 2A, 2B) (step S200). Specifically, the display processing unit 70A blinks the image on the display element 20. The optical element 40 forms the blinking first and second aerial images (aerial images 2A, 2B). This operation makes it possible for the observer 3 to recognize that it is impossible to determine which of the first and second aerial images has been touched. This operation also makes it possible to prompt the observer 3 to move his/her finger 3A to the target aerial image.
  • the touch operation of the observer 3 can be determined more accurately.
  • the other effects are the same as those of the first embodiment.
  • the two aerial images of the detection target may be enlarged by a predetermined ratio.
  • FIG. 19 is a flowchart explaining the overall operation of the aerial display device 1 according to the third embodiment of the present invention.
  • the operations from step S100 to S107 are the same as those in the first embodiment.
  • step S106 No
  • the detection position calculation unit 70C waits for a fixed time (step S201). During the fixed time of step S201, the detection position calculation unit 70C stops determining whether the aerial image has been touched. This operation makes it possible for the observer 3 to recognize that it is not possible to determine whether the first or second aerial image has been touched. This operation also makes it possible to encourage the observer 3 to move the finger 3A to the target aerial image.
  • the touch operation of the observer 3 can be determined more accurately.
  • the other effects are the same as those of the first embodiment.
  • the display element 20 and the optical element 40 are arranged parallel to each other. However, this is not limited to this, and the display element 20 may be arranged diagonally relative to the optical element 40.
  • the angle between the display element 20 and the optical element 40 is set in the range greater than 0 degrees and less than 45 degrees.
  • the orientation control element 30 can be omitted.
  • the optical element 40 may be configured as a dihedral corner reflector array in which dihedral corner reflectors are arranged in an array.
  • a dihedral corner reflector array When a dihedral corner reflector array is used, an aerial image is formed at a plane-symmetrical position.
  • the left side of the optical element 42 is defined as the incident surface 43, and the right side is defined as the reflective surface 44.
  • the incident surface 43 and the reflective surface 44 may be configured in reverse. In this case, the function of the aerial display device 1 described in the embodiment will also be reversed.
  • a liquid crystal display element is used as an example of the display element 20, but the present invention is not limited to this.
  • the display element 20 can also be a self-luminous organic EL (electroluminescence) display element or a micro LED (Light Emitting Diode) display element.
  • a micro LED display element is a display element that uses LEDs to emit the R (red), G (green), and B (blue) that make up a pixel. When a self-luminous display element 20 is used, the lighting element 10 is not necessary.
  • the present invention is not limited to the above-described embodiments, and can be modified in various ways during implementation without departing from the gist of the invention.
  • the embodiments may also be implemented in appropriate combination, in which case the combined effects can be obtained.
  • the above-described embodiments include various inventions, and various inventions can be extracted by combinations selected from the multiple constituent elements disclosed. For example, if the problem can be solved and an effect can be obtained even if some constituent elements are deleted from all the constituent elements shown in the embodiments, the configuration from which these constituent elements are deleted can be extracted as an invention.
  • 1...aerial display device 2...aerial image, 3...observer, 10...illumination element, 11...light source unit, 12...light guide plate, 13...reflective sheet, 20...display element, 30...orientation control element, 31...substrate, 32...substrate, 33...transparent member, 34...light-shielding member, 40...optical element, 41...substrate, 42...optical element, 43...incident surface, 44...reflective surface, 50...sensing element, 51...light-emitting unit, 52...light-receiving unit, 53...detection area, 54...detection partial area, 60...housing, 70...control unit, 70A...display processing unit, 70B...information processing unit, 70C...detection position calculation unit, 71...memory unit, 72...input/output interface, 73...display unit, 74...input unit, 75...bus.

Abstract

L'invention concerne un dispositif d'affichage aérien qui comprend : un élément d'affichage (20) qui affiche une image ; un élément optique (40) qui est disposé de façon à recevoir de la lumière provenant de l'élément d'affichage (20), l'élément optique (40) formant une image aérienne dans l'air en réfléchissant la lumière provenant de l'élément d'affichage (20) vers un côté opposé à l'élément d'affichage (20) ; et un élément de détection (50) qui forme une zone de détection dans une zone spatiale chevauchant l'image aérienne et détecte un objet dans la zone de détection. La zone de détection comprend des première et seconde zones de détection correspondant respectivement à des première et seconde images aériennes. La première zone de détection comprend une pluralité de premières zones partielles, et la seconde zone de détection comprend une pluralité de secondes zones partielles. Sur la base d'une relation entre le nombre de premières zones partielles qui sont activées et le nombre de secondes zones partielles qui sont activées, l'élément de détection (50) détermine laquelle des première et seconde images aériennes a été touchée.
PCT/JP2023/039476 2022-11-07 2023-11-01 Dispositif d'affichage aérien WO2024101245A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-178245 2022-11-07
JP2022178245A JP2024067866A (ja) 2022-11-07 2022-11-07 空中表示装置

Publications (1)

Publication Number Publication Date
WO2024101245A1 true WO2024101245A1 (fr) 2024-05-16

Family

ID=91032936

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/039476 WO2024101245A1 (fr) 2022-11-07 2023-11-01 Dispositif d'affichage aérien

Country Status (2)

Country Link
JP (1) JP2024067866A (fr)
WO (1) WO2024101245A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017125984A1 (fr) * 2016-01-21 2017-07-27 パナソニックＩｐマネジメント株式会社 Dispositif d'affichage aérien
JP2021139932A (ja) * 2020-03-02 2021-09-16 凸版印刷株式会社 空中表示装置
JP2022063376A (ja) * 2020-10-12 2022-04-22 凸版印刷株式会社 空中表示装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017125984A1 (fr) * 2016-01-21 2017-07-27 パナソニックＩｐマネジメント株式会社 Dispositif d'affichage aérien
JP2021139932A (ja) * 2020-03-02 2021-09-16 凸版印刷株式会社 空中表示装置
JP2022063376A (ja) * 2020-10-12 2022-04-22 凸版印刷株式会社 空中表示装置

Also Published As

Publication number Publication date
JP2024067866A (ja) 2024-05-17

Similar Documents

Publication Publication Date Title
JP4513918B2 (ja) 照明装置及び電気光学装置
KR101489415B1 (ko) 표시 장치 및 광학 장치
JP6757779B2 (ja) 非接触入力装置
EP2365423A2 (fr) Appareil de détection d'objet tactile et objet proche par lumière de radiation sélective
WO2010137219A1 (fr) Panneau tactile, panneau à cristaux liquides, dispositif d'affichage à cristaux liquides et dispositif d'affichage à cristaux liquides incorporant un panneau tactile
US20110157097A1 (en) Coordinate sensor, electronic device, display device, light-receiving unit
US6948820B2 (en) Interactive display system having an optical channeling element
JP5515280B2 (ja) 位置検出装置及び電気光学装置
JP2011257337A (ja) 光学式位置検出装置および位置検出機能付き表示装置
JP2011257338A (ja) 光学式位置検出装置および位置検出機能付き表示装置
US20230258955A1 (en) Aerial display apparatus
US20150117055A1 (en) Display apparatus
JP2010153256A (ja) 照明装置
WO2024101245A1 (fr) Dispositif d'affichage aérien
WO2023112617A1 (fr) Système d'affichage d'image flottante aérienne
WO2024117075A1 (fr) Dispositif d'affichage aérien
WO2024096072A1 (fr) Dispositif d'affichage aérien
CA2536998A1 (fr) Systeme d'affichage interactif comprenant une zone cible virtuelle a echelle
WO2024090130A1 (fr) Dispositif d'affichage aérien
JP2024077190A (ja) 空中表示装置
TWI475280B (zh) 觸控式面板整合型顯示裝置
WO2023228530A1 (fr) Système d'affichage d'informations d'image flottante spatiale
WO2024053253A1 (fr) Dispositif d'affichage aérien
WO2024018929A1 (fr) Dispositif d'affichage aérien
WO2023136106A1 (fr) Appareil d'affichage aérien