WO2024028929A1 - Système d'affichage d'image aérienne - Google Patents

Système d'affichage d'image aérienne Download PDF

Info

Publication number
WO2024028929A1
WO2024028929A1 PCT/JP2022/029441 JP2022029441W WO2024028929A1 WO 2024028929 A1 WO2024028929 A1 WO 2024028929A1 JP 2022029441 W JP2022029441 W JP 2022029441W WO 2024028929 A1 WO2024028929 A1 WO 2024028929A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
image
display device
aerial image
optical
Prior art date
Application number
PCT/JP2022/029441
Other languages
English (en)
Japanese (ja)
Inventor
誉宗 巻口
文香 佐野
崇裕 松元
隆二 山本
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Priority to PCT/JP2022/029441 priority Critical patent/WO2024028929A1/fr
Publication of WO2024028929A1 publication Critical patent/WO2024028929A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/346—Image reproducers using prisms or semi-transparent mirrors

Definitions

  • One aspect of the present invention relates to an aerial image display system for displaying context information and the like in space, for example.
  • Non-Patent Document 1 uses a special mirror, such as a magic mirror, that has the function of transmitting part of incident light and reflecting part of it, and displays the above-mentioned context information from a display placed on the back side of this mirror.
  • a method is described in which a virtual image of the user and a real image of the above-mentioned context information are presented to the user at the same time by displaying the virtual image in the front direction through a mirror.
  • Non-Patent Document 2 in the field of MR (Mixed Reality) that displays digital information in the real world, for example, an aerial image on the front side and an aerial image on the back side are shown in the real space on the front side of the mirror and the mirror image space on the back side, respectively.
  • MR Magnetic Reality
  • a method for presenting information with high reality by displaying images simultaneously is described.
  • Non-Patent Document 1 information is fixedly presented in either real space or mirror image space.
  • digital information such as context information is inherently independent of the presentation space. Therefore, there is a need to develop an information presentation method with a higher degree of freedom that is not bound by physical phenomena in the real world.
  • This invention was made with attention to the above-mentioned circumstances, and aims to improve the degree of freedom in presenting information by making it possible to present an aerial image of digital information in both real space and mirror image space.
  • the aim is to provide a technology that allows images to be displayed without any discomfort.
  • one aspect of the aerial image display system includes a retroreflective member, first and second optical members that transmit part of incident light and reflect part of the incident light, and display information.
  • a first display device that displays background information
  • a second display device that displays background information.
  • the retroreflective member is arranged with its reflective surface perpendicular to the viewing direction from the viewer.
  • the first optical member is disposed between the viewer and the retroreflective member so that its active surface is parallel to the reflective surface of the retroreflective member, and forms a mirror image space between the first optical member and the retroreflective member. At the same time, a real space is formed in the space where the viewer exists.
  • the second optical member is disposed in the mirror image space with an active surface having a predetermined inclination angle with respect to the viewing direction, and forms a mirror image space moving region between the second optical member and the retroreflective member.
  • the first display device displays display information in the direction of the second optical member at least in the mirror image space movement area.
  • the second display device is disposed in a rear space facing the mirror image space movement region with the second optical member interposed therebetween, and displays background information in the direction of the second optical member.
  • the second display device for background display can be installed even when installation space cannot be secured in the real space where the viewer is present. Furthermore, even if the first display device for displaying the aerial image is placed within the mirror image space movement region in order to form an aerial image in the mirror image space, the first display device may interfere with the virtual image of the background image. There isn't. As a result, it becomes possible to present to the viewer an aerial image with a background in which only the aerial image is superimposed on the background image.
  • an aerial image of digital information in both real space and mirror image space, thereby improving the degree of freedom in information presentation, and furthermore, it is possible to display a background image corresponding to the aerial image without any discomfort.
  • FIG. 1 is a diagram showing a first example of an optical system in an aerial image display system according to a first embodiment of the present invention.
  • FIG. 2 is a perspective view showing an example of the configuration of a display device provided in the aerial image display system shown in FIG.
  • FIG. 3 is a diagram showing an example of the operation when forming an aerial image in real space in the aerial image display system shown in FIG.
  • FIG. 4 is a diagram showing an example of the operation when an aerial image is formed in a mirror image space in the aerial image display system shown in FIG.
  • FIG. 5 is a diagram showing an example of the operation when presenting a direct-view aerial image in the aerial image display system shown in FIG. FIG.
  • FIG. 6 is a diagram showing a second example of the optical system in the aerial image display system according to the first embodiment of the present invention.
  • FIG. 7 is a diagram showing a third example of the optical system in the aerial image display system according to the first embodiment of the present invention.
  • FIG. 8 is a sectional view showing an example of the structure of a beam splitter used in the aerial image display system shown in FIG. 7.
  • FIG. 9 is a diagram showing a fourth example of the optical system in the aerial image display system according to the first embodiment of the present invention.
  • FIG. 10 is a diagram showing a fifth example of the optical system in the aerial image display system according to the first embodiment of the present invention.
  • FIG. 11 is a block diagram showing an example of the functional configuration of a display control device provided in an aerial image display system according to a second embodiment of the present invention.
  • FIG. 12 is a flowchart showing an example of the processing procedure and processing contents of the display control process executed by the control unit of the display control device shown in FIG.
  • FIG. 13 is a diagram for explaining an example of a method for calculating video parameters in the display control process shown in FIG. 12.
  • FIG. 14 is a diagram for explaining another example of a method for calculating video parameters in the display control process shown in FIG. 12.
  • FIG. 15 is a diagram for explaining an overview of an aerial image display system according to a third embodiment of the present invention.
  • FIG. 12 is a flowchart showing an example of the processing procedure and processing contents of the display control process executed by the control unit of the display control device shown in FIG.
  • FIG. 13 is a diagram for explaining an example of a method for calculating video parameters in the display control process shown in FIG. 12.
  • FIG. 14 is a diagram
  • FIG. 16 is a diagram showing an example of the configuration of an optical system of an aerial image display system according to a third embodiment of the present invention.
  • FIG. 17 is a block diagram showing an example of the functional configuration of a display control device provided in an aerial image display system according to a third embodiment of the present invention.
  • FIG. 18 is a flowchart showing an example of the processing procedure and processing contents of the display control process executed by the control unit of the display control device shown in FIG. 17.
  • FIG. 19 is a flowchart illustrating an example of the processing procedure and processing contents of the rotation angle calculation process among the display control processes shown in FIG. 18.
  • FIG. 20 is a diagram illustrating a first example of the rotation angle calculation process shown in FIG. 19.
  • FIG. 19 is a diagram showing a first example of the rotation angle calculation process shown in FIG. 19.
  • FIG. 21 is a diagram illustrating a second example of the rotation angle calculation process shown in FIG. 19.
  • FIG. 22 is a diagram for explaining the outline of an aerial image display system according to the fourth embodiment of the present invention.
  • FIG. 23 is a diagram for explaining an overview of an aerial image display system according to a fourth embodiment of the present invention.
  • FIG. 24 is a diagram showing an example of the configuration of an optical system of an aerial image display system according to the fourth embodiment of the present invention.
  • FIG. 25 is a block diagram showing an example of the functional configuration of a display control device provided in an aerial image display system according to a fourth embodiment of the present invention.
  • FIG. 26 is a flowchart showing an example of the processing procedure and processing contents of the display control process executed by the control unit of the display control device shown in FIG. 25.
  • FIG. 27 is a diagram for explaining an example of the process of calculating the position of the retroreflective member with respect to the display device, of the display control process shown in FIG. 26.
  • FIG. 28 is a diagram for explaining an example of the process of calculating the angle of the retroreflective member among the display control processes shown in FIG. 27.
  • FIG. 29 is a diagram for explaining an example of the process of calculating the angle of the retroreflective member among the display control processes shown in FIG. 27.
  • FIG. 30 is a diagram showing a first example of an optical system in an aerial image display system according to a fifth embodiment of the present invention.
  • FIG. 31 is a diagram showing an example of an aerial image and a background image displayed by the aerial image display system shown in FIG. 30.
  • FIG. 32 is a diagram showing a second example of the optical system in the aerial image display system according to the fifth embodiment of the present invention.
  • FIG. 33 is a diagram showing a third example of the optical system in the aerial image display system according to the fifth embodiment
  • FIG. 1 is a diagram showing a first example of an aerial image display system according to a first embodiment of the present invention.
  • 1A is a retroreflective member, and this retroreflective member 1A is arranged so that its reflective surface is perpendicular to the viewing direction of the viewer (hereinafter also referred to as user) US.
  • a first beam splitter 2 is installed between the user US and the retroreflective member 1A so that its operational surface is orthogonal to the viewing direction of the user US, that is, the reflective surface of the retroreflective member 1A. arranged in parallel.
  • a second beam splitter 3 is arranged in a space between the retroreflective member 1A and the first beam splitter 2. The second beam splitter 3 is disposed obliquely so that its active surface has a predetermined angle, for example, an angle of 45 degrees, with respect to the viewing direction of the user US.
  • the first and second beam splitters 2 and 3 both have optical characteristics of transmitting part of the incident light and reflecting part of the incident light.
  • a real space RS is formed on the user US side of the first beam splitter 2
  • a mirror image space MS is formed between the first beam splitter 2 and the retroreflective member 1A.
  • a mirror image space moving region ME is formed in a triangular region between the retroreflective member 1A and the second beam splitter 3 in the mirror image space MS.
  • a real space movement region RE is formed in an area adjacent to the mirror image space movement region ME on the extension of each surface of the retroreflection member 1A and the first beam splitter 2. The boundary between the mirror image space movement area ME and the real space movement area RE becomes a virtual mirror surface VM.
  • the display device DS is movably arranged within the mirror image space movement area ME and the real space movement area RE.
  • FIG. 2 is a perspective view showing an example of the configuration of the display device DS.
  • the display device DS has a display device main body 51 equipped with, for example, a liquid crystal panel, an organic EL panel, or an LED panel mounted on a base 52, and the display device main body 51 is movable on the lower surface of the display device main body 51. Legs 53 with casters 54 are provided for support. Further, a rotation mechanism section 55 is installed on the upper surface of the base 52. The rotation mechanism section 55 is used to variably set the display direction of the display device main body 51 within a predetermined angular range, for example, within a range of 180 degrees.
  • the aerial image display system operates as follows.
  • FIG. 3 is a diagram for explaining the operation in this case.
  • the display device DS is arranged in the real space movement region RE, and further set so that the display direction is perpendicular to the viewing direction of the user US, for example.
  • the setting of the position of the display device DS and the setting of the display direction may be performed manually by the administrator or the viewer, or may be performed automatically by the illustrated display control device.
  • the display information displayed on the display screen of the display device DS is reflected by the second beam splitter 3 and then retroreflected by the retroreflection member 1A,
  • the light is transmitted sequentially through the second beam splitter 3 and the first beam splitter 2 and is imaged as an aerial image MI1 in the real space RS where the user US exists.
  • the user US can visually recognize, for example, figures, photographs, etc. as aerial images in the real space RS where the user US exists.
  • FIG. 4 is a diagram for explaining the operation in this case.
  • the display device DS is moved from the real space movement area RE to the mirror image space movement area ME. Further, the display direction is set to be perpendicular to the viewing direction of the user US.
  • the display position and display direction of the display device DS are set in this way, the display information displayed on the display screen of the display device DS is reflected by the second beam splitter 3 and then retroreflected by the retroreflection member 1A, It passes through the second beam splitter 3 and is imaged in the mirror image space MS as an aerial image MI2.
  • the user US uses the first beam splitter 2 as a mirror to perform tasks such as brushing teeth, putting on makeup, and grooming, while using the aerial image MI2 formed in the mirror image space MS to obtain traffic information, weather forecasts, etc. It becomes possible to check news information.
  • FIG. 5 is a diagram for explaining the operation in this case.
  • the display device DS is moved from the real space movement area RE to the mirror image space movement area ME. Further, the display direction is set to face the viewing direction of the user US.
  • the display position and display direction of the display device DS are set in this way, the display information displayed on the display screen of the display device DS is transmitted sequentially through the second beam splitter 3 and the first beam splitter 2, and is then It is presented to the user US as a direct-view aerial image RI in the space RS.
  • the user US can view the displayed information in the real space RS as if he were looking directly at the display screen of the display device DS.
  • FIG. 6 is a diagram showing a second example of the aerial image display system according to the first embodiment of the present invention.
  • the same parts as in FIG. 1 are given the same reference numerals and detailed explanations will be omitted.
  • the retroreflective member 1B is located at a position opposite to the virtual mirror surface VM with respect to the second beam splitter 3 in the mirror image space MS, and the reflective surface is arranged in a direction parallel to the viewing direction of the user US. It is arranged so that
  • the display information displayed on the display device DS passes through the second beam splitter 3, is retroreflected by the retroreflective member 1B, is reflected by the second beam splitter 3, and then passes through the first beam splitter 2 to form the real space where the user US exists.
  • the image is formed on the RS as an aerial image MI3.
  • the display information displayed on the display screen of the display device DS is , after passing through the second beam splitter 3, it is retroreflected by the retroreflection member 1B, and is imaged in the mirror image space MS as an aerial image MI2.
  • the display information displayed on the display device DS is displayed in the second beam.
  • the beam is sequentially transmitted through the splitter 3 and the first beam splitter 2 and presented to the user US as a direct-view aerial image RI in the real space RS.
  • the second embodiment also provides effects equivalent to those of the first embodiment.
  • FIG. 7 is a diagram showing a third example of the aerial image display system according to the first embodiment of the present invention.
  • the same parts as in FIGS. 1 and 6 are given the same reference numerals, and detailed explanations will be omitted.
  • a retroreflective member 1A and a retroreflective member 1B are arranged on two mutually orthogonal sides of the mirror image space MS such that their respective reflective surfaces are orthogonal to each other.
  • the second beam splitter 3 for example, as shown in FIG. Those sandwiched between transparent members 3b and 3c such as acrylic plates are used.
  • the display information displayed on the display device DS is reflected by the second beam splitter 3, then retroreflected by the retroreflection member 1A, passes through the second beam splitter 3 and the first beam splitter 2 in sequence, and enters the real space RS where the user US exists.
  • the image is formed as an aerial image.
  • the display information passes through the second beam splitter 3, is retroreflected by the retroreflective member 1B, is reflected by the second beam splitter 3, and then passes through the first beam splitter 2 to the user.
  • An aerial image is formed in the real space RS where the US exists. The same applies to the case where an aerial image is formed in the mirror image space MS.
  • a composite aerial image MI4 is formed in the real space RS and the mirror image space MS, which is a composite of the aerial image retroreflected by the retroreflective member 1A and the aerial image retroreflected by the retroreflective member 1B. become.
  • the third embodiment it is possible to present an aerial image MI4 with higher brightness than when the retroreflective members 1A and 1B are used alone.
  • the second beam splitter 3 has a structure in which both sides of the reflective member 3a are sandwiched between two transparent members 3b and 3c having the same thickness and refractive index, as illustrated in FIG.
  • the optical path lengths corresponding to the second beam splitters 2 and 3 can be set to be equal, thereby making it possible to prevent double imaging of the formed aerial image MI4.
  • FIGS. 9 and 10 are diagrams showing a fourth example of the aerial image display system according to the first embodiment of the present invention.
  • a retardation film 4 is placed on the reflective surface of the retroreflective member 1A.
  • the retardation film 4 is made of, for example, a 1/4 retardation film, and has an optical property of rotating the polarization direction of transmitted light by 45 degrees.
  • optical elements are used that switch between reflection and transmission depending on the polarization direction of the incident light.
  • this optical element for example, a reflective polarizing plate or a wire grid is used.
  • a depolarizing film, a diffusion plate, or a retardation film is attached to the display screen of the display device DS so that the output light of the display information includes unpolarized light or S-polarized light and P-polarized light.
  • a polarizing plate or a retardation film is rotatably arranged in a state facing the display screen of the display device DS, and the polarization direction of the output light is switched by rotation.
  • the display device DS when forming an aerial image in the real space RS, the display device DS is placed in the real space moving region RE with the display direction facing in a direction perpendicular to the viewing direction. do. At the same time, if a polarizing plate is arranged on the display screen of the display device DS, this polarizing plate is rotated to output a polarized light component reflected from the display device DS to the beam splitter 3, for example, S-polarized light. Set it so that
  • the S-polarized light of the display light output from the display device DS is reflected by the second beam splitter 3, and the phase difference disposed in front of the retroreflective member 1A is reflected by the second beam splitter 3.
  • the film 4 By passing through the film 4, the light is converted into circularly polarized light.
  • the rotation direction of the circularly polarized light is reversed by being retroreflected by the retroreflection member 1A, and the circularly polarized light is converted into P-polarized light by passing through the retardation film 4 again.
  • This retroreflected P-polarized light passes through the second beam splitter 3, and further passes through the first beam splitter 2, and is imaged in the real space RS as an aerial image MI5.
  • the display device DS is placed in the mirror image space moving area ME with the display direction facing in a direction perpendicular to the viewing direction.
  • the polarizing plate disposed on the display screen of the display device DS is rotated so that S-polarized light is output from the display device DS.
  • the S-polarized light of the display light output from the display device DS1 is reflected by the second beam splitter 3, which is placed in front of the retroreflective member 1A as described above.
  • the light is retroreflected as P-polarized light by the retardation film 4 and the retroreflection member 1A.
  • the retroreflected P-polarized light passes through the second beam splitter 3 and is imaged in the mirror image space MS as an aerial image MI6.
  • the display device DS when presenting the display information on the display device DS as a direct-view aerial image RI, the display device DS is placed in the mirror image space movement area ME and the display direction is directed toward the user US. At the same time, the polarizing plate/retardation plate disposed on the display screen of the display device DS is rotated to set the display device DS to output P-polarized light.
  • the P-polarized light out of the display light output from the display device DS sequentially passes through the second beam splitter 3 and the first beam splitter 2, and is directly visible to the user US in the real space RS.
  • image RI the image RI.
  • the fourth embodiment by selectively switching the display light output from the display device DS between S-polarized light and P-polarized light, the attenuation of light due to the beam splitter on the optical path is suppressed, and the brightness can be increased. It becomes possible to present a high aerial image.
  • the display device DS1 and the display device DS2 may be arranged in an L-shape, and each may be set to output S-polarized light and P-polarized light. With this configuration, it is possible to simultaneously present a plurality of aerial images with high brightness in the mirror image space MS and the real space RS, respectively.
  • the aerial image can be displayed seamlessly across the boundary between the mirror image space MS and the real space RS, and this has the practical advantage of being able to diversify the display of the aerial image. A very useful effect is produced.
  • the formed aerial image MI undergoes many reflections and transmissions by the beam splitters 2, 3 and retroreflective members 1A, 1B on the optical path until the image is formed, so the contrast etc. decreases and The image quality between the images RI and RI becomes non-uniform.
  • the image quality when displaying the formed aerial image MI, by adjusting the video parameters of the displayed image on the display device DS in advance, the image quality can be made homogenized between the direct-view aerial image RI and the direct-view aerial image RI. It was designed to achieve this goal.
  • FIG. 11 is a block diagram showing the functional configuration of a display control device CS1 provided in an aerial image display system according to a second embodiment of the present invention, together with a display device DS.
  • the display device DS is provided with a moving mechanism section 56 for moving the display position and a rotation mechanism section 55 for changing the display direction. Both of these mechanical units 56 and 55 operate according to control signals output from the display control device CS1.
  • the display control device CS1 is composed of, for example, a personal computer, and includes a control section 100 that uses a hardware processor such as a central processing unit (CPU).
  • a storage unit having a program storage section 200 and a data storage section 300 and an input/output interface (hereinafter referred to as I/F) section 400 are connected to the control section 100 via a bus (not shown). It has become.
  • An input device 500 such as a keyboard and a mouse is connected to the input/output I/F section 400.
  • the input/output I/F section 400 may also be connected to a display device, an external storage medium such as a USB (Universal Serial Bus) memory, or the like. Further, the input/output I/F section 400 may be provided with a communication interface function.
  • the program storage unit 200 is configured by combining a nonvolatile memory such as a solid state drive (SSD) that can be written to and read from at any time as a storage medium, and a nonvolatile memory such as a read only memory (ROM).
  • a nonvolatile memory such as a solid state drive (SSD) that can be written to and read from at any time as a storage medium
  • a nonvolatile memory such as a read only memory (ROM).
  • middleware such as an OS (Operating System)
  • application programs necessary for control according to the second embodiment are stored. Note that hereinafter, the OS and each application program will be collectively referred to as a program.
  • the data storage unit 300 is, for example, a combination of a nonvolatile memory such as an SSD that can be written and read at any time as a storage medium, and a volatile memory such as a RAM (Random Access Memory), and its storage area includes: A display position/direction control data storage section 301, a video parameter storage section 302, and a display information storage section 303 are provided as main storage sections necessary for implementing the second embodiment of the present invention.
  • the display position/direction control data storage unit 301 stores control data necessary for controlling the display position and display direction of the display device DS in accordance with input display instructions.
  • the video parameter storage unit 302 stores control data necessary for controlling video parameters of display information according to the type of aerial image to be displayed.
  • the display information storage unit 303 is used to store information to be displayed, for example, content information.
  • the control unit 100 includes a display instruction acquisition processing unit 101, a display position/direction control processing unit 102, and a video parameter control processing unit 103 as processing functions necessary for implementing the second embodiment of the present invention. We are prepared. These processing units 101 to 103 are all realized by causing the hardware processor of the control unit 100 to execute an application program stored in the program storage unit 200.
  • processing units 101 to 103 may be realized using hardware such as LSI (Large Scale Integration) or ASIC (Application Specific Integrated Circuit).
  • the display instruction acquisition processing unit 101 acquires display instruction information when the aerial image display instruction information is input through the input device 500.
  • the display instruction information instructs either to display an imaged aerial image in the real space RS, to display an imaged aerial image in the mirror image space MS, or to display a direct-view aerial image in the real space RS.
  • the display position/direction control processing unit 102 reads control data from the display position/direction control data storage unit 301 according to the instruction content of the display instruction information. Then, according to the read control data, the input/output I/F section 400 outputs a position control signal and a direction control signal to the moving mechanism section 56 and the rotation mechanism section 55 of the display device DS, respectively, to control the display device DS. Set the display position and display direction.
  • the video parameter control processing unit 103 determines whether the aerial image to be presented is a "formed aerial image” or a "direct-view aerial image” according to the display position and display direction setting data of the display device DS. do. Then, the video parameter control processing section 103 controls the video parameters of the display video displayed on the display device DS, based on the above determination result and the video parameters stored in the video parameter storage section 302. An example of this video parameter control processing will be described in the operation example.
  • FIG. 12 is a flowchart illustrating an example of the processing procedure and processing contents of the display control processing executed by the control unit 100 of the display control device CS1.
  • the control unit 100 of the display control device CS1 monitors the input of display instruction information in step S10 under the control of the display instruction acquisition processing unit 101. In this state, when the display instruction information is input to the input device 500, the control unit 100 of the display control device CS1, under the control of the display position/direction control processing unit 102, determines that the display instruction information is “ It is determined whether the instruction is to display a "formed aerial image" or a "direct-view aerial image.”
  • the display position/direction control processing unit 102 moves to step S12, where the display stored in the display position/direction control data storage unit 301 A display position control signal is generated based on the position/direction control data. Then, the display position/direction control processing unit 102 outputs the generated display position control signal to the movement mechanism unit 56 of the display device DS, thereby changing the display position of the display device DS to the real space movement region RE or mirror image space movement. Move to area ME.
  • the display position/direction control processing unit 102 generates a display direction control signal based on the display position/direction control data. Then, the generated display direction control signal is output to the rotation mechanism section 55 of the display device DS, thereby setting the display direction of the display device DS in a direction perpendicular to the viewing direction.
  • the display position/direction control processing unit 102 moves to step S14, where the display position/direction control data storage unit 301 stores the data. A display position control signal is generated based on position/direction control data. Then, the display position/direction control processing unit 102 outputs the generated display position control signal to the movement mechanism unit 56 of the display device DS, thereby moving the display position of the display device DS to the mirror image space movement area ME.
  • the display position/direction control processing unit 102 generates a display direction control signal based on the position/direction control data. Then, the generated display direction control signal is output to the rotation mechanism section 55 of the display device DS, thereby setting the display direction of the display device DS in the direction of the user US.
  • the display instruction information specifies whether to display a "formed aerial image” or a "direct-view aerial image.” However, for example, if the content included in the display information includes information that specifies the type of aerial image to be displayed, that is, “formed aerial image” or “direct view aerial image,” or information that allows this to be determined. This information may be used for.
  • control unit 100 of the display control device CS1 subsequently performs a process of controlling the video parameters of the display information under the control of the video parameter control processing unit 103. Execute as below.
  • the video parameter control processing unit 103 receives the display instruction (“imaging aerial image” or “direct view aerial image”) from the display position/direction control processing unit 102, and displays the image corresponding to the received display instruction.
  • the display instruction (“imaging aerial image” or “direct view aerial image”) from the display position/direction control processing unit 102, and displays the image corresponding to the received display instruction.
  • the video parameter control data stored in the video parameter storage unit 302 in advance is used as the video parameter.
  • the following two methods can be considered for calculating the control data of the video parameters.
  • contrast is taken as an example of a video parameter to be controlled.
  • FIG. 13 is a diagram used to explain the first calculation method.
  • the imaged aerial image MI is displayed in the mirror image space MS.
  • a chart CIM divided into two parts, white and black, is used as the display image.
  • an area of the formed aerial image MI including the chart CIM is photographed with a camera, and the photographed image CMI is saved.
  • the direct-view aerial image RI is displayed in the mirror image space MS.
  • the displayed image is a chart CRI divided into white and black, which has been subjected to blur processing to represent the intensity of blur ⁇ .
  • the area including the chart CRI of the direct-view aerial image is photographed with a camera, and the photographed image CRI is saved.
  • blur processing refers to image processing using, for example, a Gaussian filter.
  • ⁇ is the standard deviation.
  • SSIM Structuretural Similarity
  • MSE Mel Squared Error
  • PSNR Peak Signal to Noise Ratio
  • FIG. 14 is a diagram used to explain the second calculation method.
  • the imaged aerial image MI is displayed in the mirror image space MS.
  • a chart CIM divided into two parts, white and black is used, as in the first calculation method.
  • an area of the formed aerial image MI including the chart CIM is photographed with a camera, and the photographed image is Fourier-transformed to obtain and save an MSF (Modulation Transfer Function).
  • MSF Modulation Transfer Function
  • the direct-view aerial image RI is displayed in the mirror image space MS.
  • a chart CIM divided into two parts, white and black, is used as the display image.
  • the area including the chart CRI of the direct-view aerial image is photographed with a camera, and the photographed image is Fourier-transformed to obtain and save the MSF.
  • the MTF acquired in the above-mentioned imaged aerial image MI and the MTF acquired in the above-mentioned direct-view aerial image RI are normalized and compared, the attenuation rate ⁇ of the spatial frequency component is calculated, and the calculated ⁇ is It is stored in the video parameter storage unit 302 as a parameter indicating the intensity of blur.
  • the video parameter control processing unit 103 When actually displaying an aerial image, if the aerial image to be displayed is a "formed aerial image", the video parameter control processing unit 103 inputs display information read from the display information storage unit 303 in step S13. The data is directly output from the output I/F section 400 to the display device DS for display. That is, the displayed video is displayed as is without adjusting the video parameters.
  • the video parameter control processing unit 103 controls the video parameters with respect to the display information read from the display information storage unit 303 in step S15.
  • the parameters are adjusted based on data, that is, control data for adjusting the blur strength ⁇ .
  • blur processing is performed on the displayed video using a Gaussian filter.
  • the frequency space image is subjected to processing to attenuate the spatial frequency components. Then, an inverse Fourier transform is performed on the frequency space image after the attenuation process to return it to a two-dimensional display image.
  • step S13 the video parameter control processing unit 103 outputs the display video after adjusting the video parameters from the input/output I/F unit 400 to the display device DS for display. That is, a process of forcibly adding blur ⁇ is performed to display a display image with reduced contrast.
  • the third embodiment of the present invention detects the position of the user US in the real space RS, and changes the display position and display direction of the display device DS according to the detected position of the user US.
  • the control allows the user US to always view the aerial image from the front.
  • both the display position and the display direction of the display device DS are variably controlled, but at least only the display direction may be variably controlled.
  • FIG. 16 is a diagram showing an example of the configuration of an aerial image display system according to the third embodiment of the present invention.
  • the same parts as in FIG. 1 are given the same reference numerals and detailed explanations will be omitted.
  • the system according to the third embodiment includes a display control device CS2 for controlling the display position and display direction of the display device DS. Furthermore, in order to enable control of the display position and display direction, the display device DS is provided with a rotation mechanism section 55 and a movement mechanism section 56. Furthermore, a camera CM is arranged in the optical system.
  • the camera CM is, for example, a depth camera, and photographs the range in which the user US exists in the real space RS, and outputs the photographed image to the display control device CS2.
  • FIG. 17 is a block diagram showing the functional configuration of the display control device CS2 together with the display device DS and camera CM.
  • the display control device CS2 is composed of, for example, a personal computer, and includes a control section 110 that uses a hardware processor such as a CPU.
  • a storage unit having a program storage section 210 and a data storage section 310 and an input/output I/F section 410 are connected to the control section 110 via a bus (not shown).
  • the above-mentioned display device DS and camera CM are connected to the input/output I/F section 410. More specifically, the display device main body 51, the moving mechanism section 56, the rotating mechanism section 55, and the camera CM of the display device DS are connected to each other via a wireless interface such as a signal cable or a wireless LAN (Local Area Network). Connected.
  • a wireless interface such as a signal cable or a wireless LAN (Local Area Network). Connected.
  • the program storage unit 210 is configured by combining a nonvolatile memory such as an SSD that can be written to and read from at any time as a storage medium, and a nonvolatile memory such as a ROM.
  • the application program necessary for the control processing according to the third embodiment is stored. Note that hereinafter, the OS and each application program will be collectively referred to as a program.
  • the data storage unit 310 is, for example, a combination of a nonvolatile memory such as an SSD that can be written to and read from at any time as a storage medium, and a volatile memory such as a RAM. is provided.
  • the display information storage unit 311 stores content information for displaying an aerial image to the user US. This content information is acquired, for example, by being read from an external storage medium, or by downloading from a server device on the Web or cloud, or another information terminal via a network.
  • the control unit 110 includes a user position acquisition processing unit 111, an aerial image display position acquisition processing unit 112, a movement position calculation processing unit 113, as processing functions necessary to implement the third embodiment of the present invention. It includes a rotation angle calculation processing section 114 and a display position/direction control processing section 115. These processing units 111 to 115 are all realized by causing the hardware processor of the control unit 110 to execute an application program stored in the program storage unit 210.
  • processing units 111 to 115 may be realized using hardware such as LSI (Large Scale Integration) or ASIC (Application Specific Integrated Circuit).
  • the user position acquisition processing unit 111 acquires the photographed image output from the camera CM via the input/output I/F unit 410, and calculates the position information of the user US in the real space RS based on the acquired photographed image. do. Note that when the user's viewing position is fixed, the user position acquisition processing unit 111 may obtain and store the fixed viewing position as a parameter in advance. In this case, camera commercials can be omitted.
  • the aerial image display position acquisition processing unit 112 acquires information representing the display position of the aerial image to be displayed from the content information stored in the display information storage unit 311.
  • the movement position calculation processing unit 113 calculates the display position of the display device DS based on the position information of the user US and the display position information of the aerial image.
  • the rotation angle calculation processing unit 114 is based on the position information of the user US, the display position information of the aerial image, and information indicating whether the aerial image to be displayed is a focused aerial image or a direct-view aerial image. Then, the rotation angle ⁇ of the display device DS is calculated. An example of the process of calculating the rotation angle ⁇ will be described in the operation example.
  • the display position/direction control processing unit 115 drives the moving mechanism unit 56 and the rotating mechanism unit 55 of the display device DS, respectively, according to the calculated display position and rotation angle ⁇ of the display device DS, so that the display device DS control the display position and angle of the display.
  • FIG. 18 is a flowchart illustrating an example of the processing procedure and processing contents of the display control processing executed by the control unit 110 of the display control device CS2.
  • the control unit 110 of the display control device CS2 first acquires user position information using the user position acquisition processing unit 111 in step S20.
  • the user position acquisition processing unit 111 acquires a captured image output from the camera CM via the input/output I/F unit 410, and recognizes the image of the user US from the acquired captured image. Then, based on the recognized positional coordinates of the user US in the image, the positional information of the user US in the real space RS is calculated. Note that, as described above, when the user's viewing position is fixed, the user position acquisition processing unit 111 acquires and stores the fixed viewing position as a parameter in advance. You can.
  • step S21 the control unit 110 of the display control device CS2 specifies the display position of the aerial image using the aerial image display position acquisition processing unit 112. For example, if the content information stored in the display information storage unit 311 includes information indicating the display target position of the aerial image, the aerial image display position may be set as the display target position of the aerial image. Obtain the information as is.
  • the control unit 110 of the display control device CS2 next performs a movement position calculation processing unit in step S22. 113, the display position of the display device DS is calculated.
  • the display position of the display device DS can be determined as a position that is plane symmetrical to the display position information of the aerial image.
  • step S23 the control unit 110 of the display control device CS2 causes the rotation angle calculation processing unit 114 to perform rotation for controlling the display direction of the display device DS.
  • the angle ⁇ is calculated as follows.
  • FIG. 19 is a flowchart illustrating an example of the procedure and contents of the rotation angle ⁇ calculation process. That is, first in step S231, the rotation angle calculation processing unit 114 determines the orientation of the user US with respect to the aerial image, that is, the straight line connecting the user US and the aerial image, from the information representing the display position of the aerial image and the position of the user US. The angle ⁇ formed by the perpendicular line drawn from the user US to the first beam splitter 2 is calculated.
  • the rotation angle calculation processing unit 114 then calculates the rotation angle ⁇ .
  • the calculation process for this rotation angle ⁇ differs depending on whether the aerial image is formed on the right side of the user US or on the left side of the user US.
  • the rotation angle calculation processing unit 114 uses the calculated angle ⁇ and the known angles 90° and 45°, as shown in FIG. 21, for example. , calculate the rotation angle ⁇ .
  • step S232 the rotation angle calculation processing unit 114 determines whether the aerial image to be displayed is a "formed aerial image” or a "direct-view aerial image.” Then, if it is a "formed aerial image”, the final rotation angle ⁇ is calculated using -90° as a reference in step S233. On the other hand, if it is a "direct-view aerial image", the final rotation angle ⁇ is calculated using 180° as a reference in step S234.
  • control unit 110 of the display control device CS2 controls the display position/direction control processing unit 115. Under the control, in step S24, a control signal for changing the position and angle by the calculated movement position and rotation angle ⁇ is generated. Then, the display position/direction control processing unit 115 transmits the generated movement position control signal and rotation angle control signal from the input/output I/F unit 410 to the movement mechanism unit 56 and rotation mechanism unit 55 of the display device DS, respectively. Output to.
  • the display position and display direction of the display device DS are controlled, and thereby the image formation position and display direction of the aerial image are set to directly face the user US.
  • the display position and display direction of the display device DS are controlled according to the position of the user US, so that the imaging position and direction of the aerial image are always fixed relative to the user US. It is set to face directly. Therefore, the user US can always view the aerial image reliably and with high brightness no matter where he or she is, without having to adjust his or her position in accordance with the imaging position of the aerial image.
  • This effect is particularly effective when, for example, a viewing area limiting film is attached to the display screen of the display device DS to limit the viewing area in order to reduce the occurrence of stray light.
  • the fourth embodiment of the present invention detects the position of the user US, and adjusts the reflective surface of the retroreflective member 1A according to the detected position of the user US, as shown in FIG. 23, for example.
  • the retroreflective member 1A is prevented from directly facing the user US, so that the virtual image VI of the display device DS is deviated from the viewing direction of the aerial image MI of the user US. It is.
  • FIG. 24 shows an example of the configuration of an aerial image display system according to the fourth embodiment of the present invention.
  • the display device DS is provided with a rotating mechanism section 55 and a moving mechanism section 56
  • the retroreflective member 1A is provided with a moving mechanism section 11 and a rotating mechanism for varying the position and direction of the retroreflective member 1A. 12 (shown in FIG. 25).
  • a display control device CS3 is provided to control the display position and display direction of the display device DS, and the arrangement position and reflection direction of the retroreflective member 1A.
  • a camera CM is arranged in the optical system.
  • the camera CM is composed of, for example, a depth camera, and photographs the range in which the user US exists in the real space RS, and outputs the photographed image to the display control device CS3. Note that if the user's viewing position is fixed, the camera commercial can be omitted.
  • FIG. 25 is a block diagram showing the functional configuration of the display control device CS3 together with the display device DS, the retroreflective member 1A, and the camera CM.
  • the display control device CS3 is composed of, for example, a personal computer, and includes a control section 120 that uses a hardware processor such as a CPU.
  • a storage unit having a program storage section 220 and a data storage section 320 and an input/output I/F section 420 are connected to the control section 120 via a bus (not shown).
  • the input/output I/F section 420 is connected to the display device DS, the mechanical section of the retroreflective member 1A, and the camera CM. More specifically, the display device main body 51, the movement mechanism section 56, and the rotation mechanism section 55 of the display device DS are connected via a wireless interface such as a signal cable or a wireless LAN (Local Area Network), and The mechanical part of the retroreflective member 1A is connected, and further the camera CM is connected.
  • a wireless interface such as a signal cable or a wireless LAN (Local Area Network)
  • the program storage unit 220 is configured by combining, for example, a nonvolatile memory such as an SSD that can be written to and read from at any time as a storage medium, and a nonvolatile memory such as a ROM.
  • the application program necessary for the control according to the fourth embodiment is stored. Note that hereinafter, the OS and each application program will be collectively referred to as a program.
  • the data storage unit 320 is, for example, a combination of a nonvolatile memory such as an SSD that can be written to and read from at any time as a storage medium, and a volatile memory such as a RAM. is provided.
  • the display information storage unit 321 stores content information for displaying an aerial image to the user US.
  • This content information is acquired, for example, by being read from an external storage medium, or by downloading from a server device on the Web or cloud, or another information terminal via a network.
  • the control unit 120 includes a user position acquisition processing unit 121, an aerial image display position acquisition processing unit 122, a display position/angle calculation processing unit 123, and a recursive function as necessary processing functions to implement the fourth embodiment. It includes a reflective member position/angle calculation processing section 124, a display position/direction control processing section 125, and a retroreflective member position/direction control processing section 126. These processing units 121 to 126 are all realized by causing the hardware processor of the control unit 120 to execute an application program stored in the program storage unit 210.
  • processing units 121 to 126 may be realized using hardware such as LSI or ASIC.
  • the user position acquisition processing unit 121 acquires the photographed image output from the camera CM via the input/output I/F unit 420, and calculates the position information of the user US in the real space RS based on the acquired photographed image. do. Note that if the viewing position of the user is fixed, the user position acquisition processing unit 121 may acquire and store the viewing position as a parameter. In this case, camera commercials can be omitted.
  • the aerial image display position acquisition processing unit 122 acquires information representing the display position of the aerial image to be displayed from the content information stored in the display information storage unit 321.
  • the display position/angle calculation processing unit 123 calculates the display position of the display device DS based on the position information of the user US and the display position information of the aerial image. In addition, the display position/angle calculation processing unit 123 stores the position information of the user US, the display position information of the aerial image, and information indicating whether the aerial image to be displayed is a focused aerial image or a direct-view aerial image. Based on this, the rotation angle ⁇ of the display device DS is calculated.
  • the retroreflective member position/angle calculation processing unit 124 further calculates the display position of the display device DS and the known arrangement of the first beam splitter 2 based on the position information of the user US obtained by the user position acquisition processing unit 121. Taking the position into consideration, the position of the retroreflective member 1A is calculated so that the optical path length between the retroreflective member 1A and the user US is the shortest.
  • the retroreflective member position/angle calculation processing unit 124 uses the position information of the user US obtained by the user position acquisition processing unit 121, the display position of the display device DS, and the viewing area of the display device DS defined by the standard. (viewing angle), a rotation angle x/2 of the reflective surface of the retroreflective member 1A for making the reflective surface of the retroreflective member 1A face the user US is calculated.
  • the display position/direction control processing unit 125 drives the moving mechanism unit 56 and the rotating mechanism unit 55 of the display device DS, respectively, according to the calculated display position and rotation angle ⁇ of the display device DS, so that the display device DS control the display position and viewing angle.
  • the retroreflective member position/direction control processing section 126 controls the movement mechanism section of the retroreflective member 1A according to the position and rotation angle x/2 of the retroreflective member 1A calculated by the retroreflective member position/angle calculation processing section 124. 11 and the rotation mechanism section 12 to control the position and reflection direction of the retroreflective member 1A.
  • FIG. 26 is a flowchart illustrating an example of the processing procedure and processing contents of the display control processing executed by the control unit 120 of the display control device CS3.
  • the control unit 120 of the display control device CS3 first acquires user position information using the user position acquisition processing unit 121 in step S30.
  • the user position acquisition processing unit 121 acquires a captured image output from the camera CM via the input/output I/F unit 420, and recognizes the image of the user US from the acquired captured image. Then, based on the recognized positional coordinates of the user US in the image, the positional information of the user US in the real space RS is calculated. Note that, as described above, when the user's viewing position is fixed, the user position acquisition processing unit 121 acquires and stores the fixed viewing position as a parameter in advance. You can.
  • step S31 the control unit 120 of the display control device CS3 specifies the display position of the aerial image using the aerial image display position acquisition processing unit 122.
  • the aerial image display position may be set as the display target position of the aerial image. Obtain the information as is.
  • step S32 the display position/angle calculation processing unit 123 calculates the display position of the display device DS.
  • the display position of the display device DS can be determined as a position that is plane symmetrical to the display position information of the aerial image.
  • step S33 the display position/angle calculation processing unit 123 calculates the rotation angle ⁇ for setting the display direction of the display device DS. Calculate ⁇ as follows. Note that the calculation process of the rotation angle ⁇ is the same as the process described with reference to FIG. 19, so a description thereof will be omitted here.
  • step S34 the position of each retroreflective member 1A and the angle x/2 of the reflective surface are calculated.
  • the retroreflective member position/angle calculation processing unit 124 calculates the moving position of the retroreflective member 1A so as to satisfy the following conditions.
  • FIG. 27 is a diagram for explaining the movement position calculation process.
  • the retroreflective member position/angle calculation processing unit 124 first defines the retroreflective member 1A to be moved on a straight line connecting the user US and the imaging position of the aerial image. Furthermore, safety areas E1 and E2 are set for each of the retroreflective member 1A and the display device DS to prevent collisions.
  • the safe area E1 of the retroreflective member 1A is defined as a circle that includes the maximum width of the reflective surface of the retroreflective member 1A.
  • the safe area E2 of the display device DS is defined as a circle that includes the portion of the display device main body 51 or the base 52 and leg portions 53 that support the display device main body 51 and which has the maximum width.
  • the retroreflective member position/angle calculation processing unit 124 calculates the optimal position of the retroreflective member 1A. For example, the retroreflective member position/angle calculation processing unit 124 first calculates a position where the safe area E1 of the retroreflective member 1A maintains a safe distance from the safe area E2 of the display device DS and the second beam splitter 3. demand. Then, the position where the coordinate value in the y direction of the circle indicating the safety area E1 of the retroreflective member 1A is the minimum is determined, and the position where the coordinate value in the y direction of the circle indicating the safety area E2 of the display device DS is the maximum is determined. The position where the retroreflective member 1A is closest to the user US is calculated within a smaller range. Then, the calculated position is set as the position to which the retroreflective member 1A is to be moved.
  • the retroreflective member position/angle calculation processing unit 124 next calculates that the angle ⁇ calculated by the display position/angle calculation processing unit 12, that is, the user US In addition to the angle ⁇ formed between the direction directly facing the beam splitter 2 and the straight line connecting the user US and the aerial image MI, a rotation angle x/2 for further rotation of the retroreflection member 1A is calculated.
  • FIGS. 28 and 29 are diagrams used in the calculation process of the rotation angle x/2.
  • each value below is a known parameter.
  • a Distance from the display position of the display device DS to the retroreflective member 1A
  • b Distance from the display device DS to the viewpoint of the user US t: Viewing range of the display device DS.
  • the distance b from the display device DS to the viewpoint of the user US is calculated based on the position information of the user US obtained by the user position acquisition processing unit 121. Further, the viewing zone t of the display device DS is expressed by the rating of the viewing zone limiting film, for example, if a viewing zone limiting film is attached to the display screen.
  • the retroreflective member position/angle calculation processing unit 124 calculates the angle x using the above calculated A and B as follows.
  • Control of the movement position and display direction of the display device DS The control unit 120 of the display control device CS3 controls the movement of the display device DS calculated in step S36 under the control of the display position/direction control processing unit 115. A control signal for adjusting the position and angle of the display device DS by the position and rotation angle ⁇ is generated. Then, the display position/direction control processing unit 125 transmits the generated movement position control signal and rotation angle control signal from the input/output I/F unit 420 to the movement mechanism unit 56 and rotation mechanism unit 55 of the display device DS, respectively. Output to. In this way, the display position and display direction of the display device DS are controlled.
  • control section 120 of the display control device CS3 controls the above-mentioned retroreflection calculated in step S37 under the control of the retroreflective member position/direction control processing section 126.
  • a control signal is generated to adjust the position and angle of the retroreflective member 1A by the moving position and rotation angle ⁇ +x/2 of the reflecting member 1A.
  • the retroreflective member position/direction control processing section 126 transmits the generated position control signal and rotation angle control signal from the input/output I/F section 420 to the moving mechanism section 11 and the rotation mechanism of the retroreflective member 1A, respectively. output to section 12. In this way, the position and reflection direction of the retroreflective member 1A are controlled.
  • the display position and display angle of the display device DS are controlled according to the position of the user US and the display position of the aerial image, and the display position and the display angle of the display device DS are The position and reflection direction of the retroreflective member 1A are controlled according to the position of the US, so that the retroreflective member 1A is set not to directly face the user US.
  • the position and angle of the reflective surface of the retroreflective member 1A are controlled, but only the angle of the reflective surface may be controlled. Furthermore, although the position and display direction of the display device DS are also controlled, the position and display direction of the display device DS may not be controlled.
  • a second display device for background display is provided in a space on the opposite side of the second beam splitter with respect to the arrangement position of the first display device for displaying an aerial image.
  • a display device is arranged, and the background image displayed on the second display device is reflected by a second beam splitter and displayed in the direction of the user US.
  • FIG. 30 is a diagram showing a first example of the optical system of the aerial image display system according to the fifth embodiment of the present invention.
  • the same parts as those in FIG. 1 are given the same reference numerals and detailed explanations will be omitted.
  • a display device BD for background display is arranged in a space on the opposite side of the second beam splitter 3 to the arrangement position of the display device DS for displaying an aerial image.
  • the background image displayed on the background display display device BD is reflected by the second beam splitter 3, and then transmitted through the first beam splitter 2 and presented to the user US who is present in the real space RS. .
  • the display device BD for displaying the background can be installed even when installation space cannot be secured in the real space RS where the user US exists. Furthermore, as shown in FIG. 30, even when the display device DS for displaying an aerial image is moved into the mirror image space moving area ME in order to form the aerial image MI in the mirror image space MS, the display device DS is in the background. It does not interfere with the virtual image BI of the image.
  • FIG. 31 shows an example of the display image. Therefore, after solving the problem of the arrangement space of the display device BD for displaying the background, a clear aerial image with a background is presented to the user US without interfering with the display of the aerial image MI displayed by the display device DS. becomes possible.
  • the display of the background range that overlaps with the aerial image MI may be erased based on the position of the user US.
  • FIG. 32 is a diagram showing a second example of the optical system of the aerial image display system according to the fifth embodiment of the present invention.
  • the same parts as in FIG. 30 are given the same reference numerals.
  • an optical element such as a reflective polarizing plate whose transmission and reflection change depending on the polarization direction is used as the second beam splitter 3. Further, a retardation film 4 is disposed on the reflective surface side of the retroreflective member 1A. Note that as the first beam splitter 2, a half mirror whose reflection characteristics do not change depending on the polarization direction, for example, a transparent plate coated with metal vapor deposition is used.
  • FIG. 33 is a diagram showing a third example of the optical system of the aerial image display system according to the fifth embodiment of the present invention.
  • the same parts as in FIG. 30 are given the same reference numerals.
  • a display device VS for displaying a virtual image is used in place of the display device BD for displaying the background.
  • the display device VS for displaying a virtual image like the display device DS for displaying an aerial image, includes a moving mechanism section and a rotation mechanism section for changing the display position and display direction, thereby changing the arrangement position of the display device DS.
  • the display device DS for displaying an aerial image displays a front image of a character or an article
  • the display device VS for displaying a virtual image displays a rear image of the character or article.
  • the aerial image displayed in real space can be displayed using virtual image representation as if it were reflected in a mirror.
  • the gist of the present invention is as follows. It can be modified and implemented in various ways without departing from the above. Furthermore, the functional configurations of the display control devices CS1, CS2, and CS3 and the procedures and contents of their control processing can be modified in various ways without departing from the gist of the present invention.
  • the present invention is not limited to the above-described embodiments as they are, but can be implemented by modifying the constituent elements within the scope of the invention at the implementation stage.
  • various inventions can be formed by appropriately combining the plurality of components disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiments. Furthermore, components from different embodiments may be combined as appropriate.
  • US...Viewer (user) DS...Display device for displaying aerial images RS...Real space MS...Mirror image space RE...Real space movement area ME...Mirror image space movement area RI...Direct view aerial image MI...Imaging aerial image BD...Display device for background display 1A, 1B...Retroreflective member 2...First beam splitter 3...Second beam splitter 4...Retardation film 11, 56...Movement mechanism section 12, 55...Rotation mechanism section 51...Display device main body 52...Base 53... Legs 54... Casters 100, 110, 120... Control section 101... Display instruction acquisition processing section 102... Display position/direction control processing section 103... Video parameter control processing section 111, 121...

Abstract

Selon un aspect de la présente invention, un élément rétroréfléchissant est disposé de manière à ce que sa surface réfléchissante soit perpendiculaire à la direction de vision d'un observateur. Un premier élément optique est placé entre le spectateur et l'élément de rétroréflexion de telle sorte que sa surface de fonctionnement est parallèle à la surface réfléchissante de l'élément de rétroréflexion, formant ainsi un espace d'image miroir entre le premier élément optique et l'élément de rétroréflexion, et formant un espace réel dans un espace dans lequel le spectateur est présent. Un deuxième élément optique est disposé dans l'espace d'image miroir dans un état où sa surface de fonctionnement est inclinée à un angle prescrit par rapport à la direction d'observation, formant ainsi une région de mouvement dans l'espace d'image miroir entre le deuxième élément optique et l'élément de rétroréflexion. Un premier dispositif d'affichage pour l'affichage d'une image aérienne est disposé de manière à afficher des informations dans la direction du deuxième élément optique au moins dans la région de mouvement de l'espace de l'image miroir, et un deuxième dispositif d'affichage pour l'affichage d'informations d'arrière-plan est disposé dans un espace arrière faisant face à la région de mouvement de l'espace de l'image miroir à travers le deuxième élément optique.
PCT/JP2022/029441 2022-08-01 2022-08-01 Système d'affichage d'image aérienne WO2024028929A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/029441 WO2024028929A1 (fr) 2022-08-01 2022-08-01 Système d'affichage d'image aérienne

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/029441 WO2024028929A1 (fr) 2022-08-01 2022-08-01 Système d'affichage d'image aérienne

Publications (1)

Publication Number Publication Date
WO2024028929A1 true WO2024028929A1 (fr) 2024-02-08

Family

ID=89848666

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/029441 WO2024028929A1 (fr) 2022-08-01 2022-08-01 Système d'affichage d'image aérienne

Country Status (1)

Country Link
WO (1) WO2024028929A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012048002A (ja) * 2010-08-27 2012-03-08 Nippon Seiki Co Ltd 結像装置
US20180188550A1 (en) * 2017-01-05 2018-07-05 Looking Glass Factory, Inc. Advanced retroreflecting aerial displays
WO2019073688A1 (fr) * 2017-10-11 2019-04-18 ソニー株式会社 Dispositif d'affichage d'image
JP2020134843A (ja) * 2019-02-22 2020-08-31 日立オムロンターミナルソリューションズ株式会社 空中像表示装置、取引装置、および空中像表示装置における空中像結像制御方法
WO2021079402A1 (fr) * 2019-10-21 2021-04-29 日本電信電話株式会社 Dispositif de traitement vidéo, dispositif d'affichage, procédé de traitement vidéo, et programme

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012048002A (ja) * 2010-08-27 2012-03-08 Nippon Seiki Co Ltd 結像装置
US20180188550A1 (en) * 2017-01-05 2018-07-05 Looking Glass Factory, Inc. Advanced retroreflecting aerial displays
WO2019073688A1 (fr) * 2017-10-11 2019-04-18 ソニー株式会社 Dispositif d'affichage d'image
JP2020134843A (ja) * 2019-02-22 2020-08-31 日立オムロンターミナルソリューションズ株式会社 空中像表示装置、取引装置、および空中像表示装置における空中像結像制御方法
WO2021079402A1 (fr) * 2019-10-21 2021-04-29 日本電信電話株式会社 Dispositif de traitement vidéo, dispositif d'affichage, procédé de traitement vidéo, et programme

Similar Documents

Publication Publication Date Title
US10241344B1 (en) Advanced retroreflecting aerial displays
US9798154B2 (en) Control of polarization and diffractive artifact resolution in retro-imaging systems
CN110300905B (zh) 用于具有集成的偏振器的显示设备的方法和系统
US11644675B2 (en) Ghost image mitigation in see-through displays with pixel arrays
WO2020194699A1 (fr) Dispositif d'affichage vidéo aérien
US10989926B1 (en) Polarization-selective diffusive combiner and near-eye display based thereon
US11835729B2 (en) Illumination system
US10531076B2 (en) Device, system and method for stereoscopic display
US20210349327A1 (en) Eye tracking system
US20190049640A1 (en) Transmissive aerial image display
JP2008165058A (ja) プロジェクタ
CN114371557A (zh) 一种vr光学系统
WO2024028929A1 (fr) Système d'affichage d'image aérienne
WO2024028930A1 (fr) Système d'affichage d'image aérienne, dispositif de commande d'affichage, procédé de commande d'affichage et programme
WO2024028927A1 (fr) Système d'affichage d'image aérienne et dispositif de commande d'affichage associé
WO2024028928A1 (fr) Système d'affichage d'image aérienne, dispositif de commande d'affichage, procédé de commande d'affichage et programme
US9628765B2 (en) Spatial image projection apparatus
US20210263317A1 (en) Angularly selective diffusive combiner
KR101123160B1 (ko) 이미지를 디스플레이하는 디스플레이 디바이스 및 방법
EP3555693B1 (fr) Système d'imagerie
US9869872B2 (en) Three-dimensional display device
Sano et al. Portable Mid-air Imaging Optical System on Glossy Surface
JP2013153421A (ja) 表示装置
TW200422765A (en) Projection system with the capability of projecting two images simultaneously

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22953919

Country of ref document: EP

Kind code of ref document: A1