WO2022270384A1

WO2022270384A1 - Hovering image display system

Info

Publication number: WO2022270384A1
Application number: PCT/JP2022/023995
Authority: WO
Inventors: 克行渡辺; 拓也清水; 浩二平田; 浩司藤田
Original assignee: マクセル株式会社
Priority date: 2021-06-23
Filing date: 2022-06-15
Publication date: 2022-12-29
Also published as: JP2023002989A

Abstract

The present invention addresses the problem of providing a more suitable hovering image display system. The present invention contributes to the sustainable development goals of "3 Healthy lives and well-being for all" and "9 Build the foundation of industry and innovation".　The present invention comprises: a table which includes a light-transmitting top panel 14; a first hovering image display device and a second hovering image display device which are arranged so as to face one another inside the table; an image signal processing device which transmits image signals to the first and second hovering image display devices; a sensor which forms a sensing surface in a hovering image generated by the first hovering image display device; and a controller which is connected to the sensor and the image signal processing device, receives sensing signals from the sensor, which are based on touch operations by a user on the sensing surface, and, on the basis of the received sensing signals, controls the image signal processing device such that the hovering image generated by the first and second hovering image display devices are both desired display images.

Description

Floating image display system

The present invention relates to a floating image display system.

As a floating information display system, a video display device that displays video directly to the outside and a display method that displays as a spatial screen are already known. Further, for example, Patent Document 1 discloses a detection system that reduces erroneous detection of operations on an operation surface of a displayed aerial image.

JP 2019-128722 A

However, the touch operation on the floating image is not performed on a physical button, touch panel, or the like. Therefore, the user may not be able to recognize whether a touch operation has been performed.
Accordingly, it is an object of the present invention to provide a more suitable floating-in-air image display system or floating-in-air image display device.

In order to solve the above problems, for example, the configuration may be as follows.
A floating-in-air image display system includes a table including a light-transmissive top plate, and a first floating-in-air image display device and a second floating-in-air image display device arranged facing each other inside the table. , a video signal processing device for transmitting video signals to the first floating-in-air video display device and the second floating-in-the-air video display device; a sensor forming a surface, connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and based on the received sensing signal, the a controller for controlling the video signal processing device so that the floating images generated by the first floating-in-air image display device and the second floating-in-air image display device are respectively desired display images. .

According to the present invention, a more suitable floating-in-air image display system or floating-in-air image display device can be realized. Problems, configurations, and effects other than this will be clarified in the following description of the embodiments.

1 is a diagram showing an example of a usage pattern of a spatially floating image display device according to an embodiment of the present invention; FIG. It is a figure which shows an example of a principal part structure and a retroreflection part structure of the space floating image display apparatus which concerns on one Example of this invention. It is a figure which shows an example of the installation method of a space floating image display apparatus. FIG. 10 is a diagram showing another example of the installation method of the spatially floating image display device; It is a figure which shows the structural example of a spatial floating image display apparatus. FIG. 4 is a diagram showing another example of the main configuration of the spatially floating image display device according to one embodiment of the present invention; FIG. 4 is an explanatory diagram for explaining functions of a sensing device used in the spatially floating image display device; FIG. 2 is an explanatory diagram of a measurement system for evaluating the characteristics of a reflective polarizing plate; FIG. 4 is a characteristic diagram showing the transmittance characteristic of the transmission axis of the reflective polarizing plate with respect to the light incident angle; FIG. 4 is a characteristic diagram showing transmittance characteristics of a reflection axis of a reflective polarizing plate with respect to a light incident angle; FIG. 4 is a characteristic diagram showing the transmittance characteristic of the transmission axis of the reflective polarizing plate with respect to the light incident angle; FIG. 4 is a characteristic diagram showing transmittance characteristics of a reflection axis of a reflective polarizing plate with respect to a light incident angle; It is a sectional view showing an example of concrete composition of a light source device. It is a sectional view showing an example of concrete composition of a light source device. It is a sectional view showing an example of concrete composition of a light source device. 1 is a layout diagram showing a main part of a spatial floating image display device according to an embodiment of the present invention; FIG. 1 is a cross-sectional view showing the configuration of a display device according to an embodiment of the present invention; FIG. FIG. 4 is an explanatory diagram for explaining light source diffusion characteristics of an image display device; FIG. 4 is an explanatory diagram for explaining diffusion characteristics of an image display device; 1 is a cross-sectional view showing the configuration of a display device according to an embodiment of the present invention; FIG. 1 is a vertical cross-sectional view showing the configuration of a spatial floating image display system according to Example 1. FIG. 1 is a horizontal sectional view showing the configuration of a spatial floating image display system according to Example 1; FIG. FIG. 5 is a vertical cross-sectional view showing the configuration of a spatially floating image display system according to a modification of Example 1; FIG. 11 is a vertical cross-sectional view showing the configuration of a spatially floating image display system according to Example 2; FIG. 10 is a diagram showing a first example of a display screen in the spatially floating image system according to Example 2; FIG. 11 is a diagram showing a second example of a display screen in the spatial floating video system according to the second embodiment; FIG. 11 is a horizontal cross-sectional view showing the configuration of a spatially floating image display system according to Example 3; FIG. 10 is a diagram showing a first example of a display screen in a spatially floating video system according to Example 3; FIG. 11 is a horizontal cross-sectional view showing the configuration of a spatially floating image display system according to Example 4; FIG. 11 is a horizontal cross-sectional view showing the configuration of a spatially floating image display system according to Example 5; FIG. 11 is a horizontal cross-sectional view showing the configuration of a spatially floating image display system according to Example 6; FIG. 11 is a vertical cross-sectional view showing the configuration of a spatially floating image display system according to Example 6; FIG. 21 is a diagram for explaining trapezoidal distortion correction of a spatially floating image by the spatially floating image display system according to the sixth embodiment;

Hereinafter, embodiments of the present invention will be described in detail based on the drawings. The present invention is not limited to the description of the embodiments, and various changes and modifications can be made by those skilled in the art within the scope of the technical ideas disclosed in this specification. Moreover, in all the drawings for explaining the present invention, the same reference numerals are given to the parts having the same functions, and the repeated explanation may be omitted. In the following description of the embodiments, an image floating in space is expressed by the term "space floating image". Instead of this term, the expressions "floating in air", "floating in space optical image of displayed image", and "floating in air optical image of displayed image" may be used. The term "space floating image" used in the description of the embodiments is used as a representative example of these terms.

In the following embodiments, an image by image light from an image light source can be transmitted through a transparent member such as glass that partitions a space, and can be displayed as a spatially floating image outside the transparent member. It relates to a video display device.

According to the following embodiments, for example, a suitable image display device can be realized for ATMs in banks, ticket vending machines in stations, digital signage, and the like. For example, at present, touch panels are usually used in bank ATMs and station ticket vending machines. It is possible to display high-resolution video information in a state of floating in space. At this time, by making the divergence angle of the emitted image light small, that is, by making it acute, and by aligning it with a specific polarized wave, only regular reflected light is efficiently reflected by the retroreflection plate, so that the light utilization efficiency is improved. In addition to the main space floating image, which was a problem with the conventional retroreflection method, the ghost image that occurs can be suppressed, and a clear space floating image can be obtained. In addition, the device including the light source of this embodiment can provide a novel and highly usable spatial floating image display device (space floating image display system) capable of significantly reducing power consumption. Further, for example, it is possible to provide a spatially floating image display device for a vehicle capable of displaying a so-called unidirectional spatially floating image that is visible inside and/or outside the vehicle.
<Spatial floating image display device 1>

FIG. 1 is a diagram showing an example of usage of a spatial floating image display device according to an embodiment of the present invention, and is a diagram showing the overall configuration of the spatial floating image display device according to this embodiment. A specific configuration of the spatially floating image display device will be described in detail with reference to FIG. Once incident on the reflecting plate 2, the light is retroreflected and transmitted through a transparent member 100 (glass or the like) to form an aerial image (space floating image 3), which is a real image, outside the glass surface.

Also, in a store or the like, a space is partitioned by a show window (also called "window glass") 105, which is a translucent member such as glass. According to the spatial floating image display device of this embodiment, it is possible to transmit the transparent member and display the floating image in one direction to the outside and/or inside of the store (space).

In FIG. 1(A), the inside of the window glass 105 (inside the store) is shown in the depth direction, and the outside thereof (for example, the sidewalk) is in front. On the other hand, by providing means for reflecting the specific polarized wave on the window glass 105, it is possible to reflect the specific polarized wave and form an aerial image at a desired position in the store.

FIG. 1(B) is a schematic block diagram showing the configuration of the video display device 1 described above. The video display device 1 includes a video display unit that displays an original image of an aerial image, a video control unit that converts the input video in accordance with the resolution of the panel, and a video signal reception unit that receives video signals. there is The video signal receiving unit supports wired input signals such as HDMI (High-Definition Multimedia Interface) input, and wireless input signals such as Wi-Fi (Wireless Fidelity). It also functions independently, and can also display video information from tablets, smartphones, etc. Furthermore, if a stick PC or the like is connected, it is possible to give it the ability to perform calculation processing and video analysis processing.

FIG. 2 is a diagram showing an example of the configuration of the main part and the configuration of the retroreflective part of the spatially floating image display device according to one embodiment of the present invention. The configuration of the spatially floating image display device will be described more specifically with reference to FIG. As shown in FIG. 2A, a display device 1 for diverging image light of a specific polarized wave at a narrow angle is provided in an oblique direction of a transparent member 100 such as glass. The display device 1 includes a liquid crystal display panel 11 and a light source device 13 that generates specific polarized light having narrow-angle diffusion characteristics.

The image light of the specific polarized wave from the display device 1 is transferred to a polarization separation member 101 (in the drawing, the polarization separation member 101 is formed in a sheet form) provided on the transparent member 100 and has a film that selectively reflects the image light of the specific polarized wave. and is adhered to the transparent member 100 ), and is incident on the retroreflection plate 2 . A λ/4 plate 21 is provided on the image light incident surface of the retroreflection plate. The image light is passed through the λ/4 plate 21 twice, when it enters the retroreflection plate and when it exits, so that the specific polarized wave is polarization-converted into the other polarized wave. Here, since the polarization separating member 101 that selectively reflects the image light of the specific polarized wave has the property of transmitting the other polarized light that has undergone polarization conversion, the image light of the specific polarized wave after the polarization conversion is It is transmitted through the polarization separation member 101 . The image light transmitted through the polarization separation member 101 forms a space floating image 3 which is a real image outside the transparent member 100 .

The light that forms the spatially floating image 3 is a set of light rays converging from the retroreflection plate 2 to the optical image of the spatially floating image 3, and these rays travel straight even after passing through the optical image of the spatially floating image 3. . Therefore, the spatially floating image 3 is an image having high directivity, unlike diffuse image light formed on a screen by a general projector or the like. Therefore, in the configuration of FIG. 2, when the user views from the direction of the arrow A, the spatial floating image 3 is viewed as a bright image. However, when another person visually recognizes from the direction of the arrow B, the spatial floating image 3 cannot be visually recognized as an image at all. This characteristic is very suitable for use in a system that displays a video that requires high security or a highly confidential video that should be kept secret from a person facing the user.

Depending on the performance of the retroreflection plate 2, the polarization axes of the reflected image light may become uneven. In this case, part of the image light whose polarization axes are not aligned is reflected by the polarization separation member 101 described above and returns to the display device 1 . This light may be re-reflected on the image display surface of the liquid crystal display panel 11 constituting the display device 1 to generate a ghost image and degrade the image quality of the spatially floating image. Therefore, in this embodiment, an absorptive polarizing plate 12 is provided on the image display surface of the display device 1 . The image light emitted from the display device 1 is transmitted through the absorptive polarizing plate 12, and the reflected light returning from the polarization separating member 101 is absorbed by the absorptive polarizing plate 12, thereby suppressing the re-reflection. As a result, it is possible to prevent deterioration in image quality due to ghost images of spatially floating images.

The polarization separation member 101 described above may be formed of, for example, a reflective polarizing plate or a metal multilayer film that reflects a specific polarized wave.

Next, FIG. 2(B) shows the surface shape of the retroreflector manufactured by Nippon Carbide Industry Co., Ltd. used in this study as a typical retroreflector 2 . Light rays incident on the inside of the regularly arranged hexagonal prisms are reflected by the wall surface and bottom surface of the hexagonal prisms and emitted as retroreflected light in the direction corresponding to the incident light. Display a certain spatial floating image. The resolution of this spatially floating image largely depends on the resolution of the liquid crystal display panel 11 as well as the outer shape D and the pitch P of the retroreflecting portion of the retroreflecting plate 2 shown in FIG. 2(B). For example, when using a 7-inch WUXGA (1920×1200 pixels) liquid crystal display panel, even if one pixel (one triplet) is about 80 μm, for example, the diameter D of the retroreflective portion is 240 μm and the pitch is 300 μm. For example, one pixel of the spatial floating image corresponds to 300 μm. For this reason, the effective resolution of the spatially floating image is reduced to about 1/3. Therefore, in order to make the resolution of the spatially floating image equal to the resolution of the display device 1, it is desired that the diameter and pitch of the retroreflecting portions be close to one pixel of the liquid crystal display panel. On the other hand, in order to suppress the occurrence of moire caused by the pixels of the retroreflector and the liquid crystal display panel, it is preferable to design the respective pitch ratios outside the integral multiple of one pixel. In addition, it is preferable that the shape of the retroreflective portion is arranged so that no one side of the retroreflective portion overlaps any one side of one pixel of the liquid crystal display panel.

In addition, the surface shape of the retroreflection plate according to the present embodiment is not limited to the above example. It may have various surface geometries that achieve retroreflection. Specifically, retroreflective elements in which triangular pyramidal prisms, hexagonal pyramidal prisms, other polygonal prisms, or combinations thereof are periodically arranged may be provided on the surface of the retroreflective plate of the present embodiment. Alternatively, a retroreflecting element in which these prisms are arranged periodically to form a cube corner may be provided on the surface of the retroreflecting plate of the present embodiment. Alternatively, capsule lens type retroreflective elements in which glass beads are periodically arranged may be provided on the surface of the retroreflective plate of the present embodiment. The detailed configuration of these retroreflecting elements may use existing technology, so detailed description is omitted. Specifically, the technology disclosed in JP-A-2001-33609, JP-A-2001-264525, JP-A-2005-181555, JP-A-2008-70898, JP-A-2009-229942, etc. should be used.
<<How to install a floating image display device>>

Next, we will explain how to install the spatial floating image display device. The installation method of the spatially floating image display device can be freely changed according to the usage pattern. FIG. 3A is a diagram showing an example of a method of installing a spatially floating image display device. The spatially floating image display device shown in FIG. 3A is installed horizontally so that the surface on which the spatially floating image 3 is formed faces upward. That is, in FIG. 3A, the spatial floating image display device is installed such that the transparent member 100 faces upward, and the spatial floating image 3 is formed above the spatial floating image display device.

FIG. 3B is a diagram showing another example of the installation method of the spatially floating image display device. The spatially floating image display device shown in FIG. 3B is installed vertically so that the surface on which the spatially floating image 3 is formed faces the side (toward the user 230). That is, in FIG. 3B, the spatially floating image display device is installed so that the transparent member 100 faces sideways, and the spatially floating image 3 is formed laterally of the spatially floating image display device (in the direction of the user 230). be.
<<Structure of Spatial Floating Image Display>>

Next, the configuration of the spatial floating image display device 1000 will be described. FIG. 4 is a block diagram showing an example of the internal configuration of the spatial floating image display device 1000. As shown in FIG.

The spatial floating image display device 1000 includes a retroreflection unit 1101, an image display unit 1102, a light guide 1104, a light source 1105, a power supply 1106, an operation input unit 1107, a nonvolatile memory 1108, a memory 1109, a control unit 1110, and an image signal input unit. 1131, an audio signal input unit 1133, a communication unit 1132, an air operation detection sensor 1351, an air operation detection unit 1350, an audio output unit 1140, a video control unit 1160, a storage unit 1170, an imaging unit 1180, and the like.

Each component of the spatial floating image display device 1000 is arranged in a housing 1190 . Note that the imaging unit 1180 and the mid-air operation detection sensor 1351 shown in FIG. 4 may be provided outside the housing 1190 .

The retroreflective portion 1101 in FIG. 4 corresponds to the retroreflective plate 2 in FIG. The retroreflection section 1101 retroreflects the light modulated by the image display section 1102 . The spatially floating image 3 is formed by the light output from the spatially floating image display device 1000 out of the reflected light from the retroreflector 1101 .

The image display unit 1102 in FIG. 4 corresponds to the liquid crystal display panel 11 in FIG. A light source 1105 in FIG. 4 corresponds to the light source device 13 in FIG. 4 correspond to the display device 1 in FIG.

The image display unit 1102 is a display unit that modulates transmitted light and generates an image based on a video signal that is input under the control of the image control unit 1160, which will be described later. A video display unit 1102 corresponds to the liquid crystal display panel 11 in FIG. For example, a transmissive liquid crystal panel is used as the image display unit 1102 . As the image display unit 1102, for example, a reflective liquid crystal panel or a DMD (Digital Micromirror Device: registered trademark) panel that modulates reflected light may be used.

A light source 1105 generates light for the image display unit 1102, and is a solid-state light source such as an LED light source or a laser light source. The power supply 1106 converts AC current input from the outside into DC current to power the light source 1105 . In addition, the power supply 1106 supplies necessary DC current to each part in the spatially floating image display device 1000 .

The light guide 1104 guides the light generated by the light source 1105 to illuminate the image display section 1102 . A combination of the light guide 1104 and the light source 1105 can also be called a backlight of the image display section 1102 . Various methods are conceivable for the combination of the light guide 1104 and the light source 1105 . A specific configuration example of the combination of the light guide 1104 and the light source 1105 will be described later in detail.

The mid-air operation detection sensor 1351 is a sensor that detects the operation of the floating image 3 by the user's 230 finger. The mid-air operation detection sensor 1351 senses a range that overlaps with the entire display range of the floating image 3, for example. Note that the mid-air operation detection sensor 1351 may sense only a range that overlaps with at least a part of the display range of the floating image 3 .

Specific examples of the aerial operation detection sensor 1351 include distance sensors that use invisible light such as infrared rays, invisible light lasers, and ultrasonic waves. Also, the aerial operation detection sensor 1351 may be configured to detect coordinates on a two-dimensional plane by combining a plurality of sensors. In addition, the aerial operation detection sensor 1351 may be composed of a ToF (Time of Flight) type LiDAR (Light Detection and Ranging) or an image sensor.

The mid-air operation detection sensor 1351 only needs to be able to perform sensing for detecting a touch operation or the like on an object displayed as the floating image 3 by the user's finger. Such sensing can be performed using existing technology.

The mid-air operation detection unit 1350 acquires a sensing signal from the mid-air operation detection sensor 1351, and based on the sensing signal, determines whether or not the finger of the user 230 touches the object in the floating image 3, and whether the finger of the user 230 touches the object. Calculation of the contact position (contact position) is performed. The aerial operation detection unit 1350 is configured by a circuit such as an FPGA (Field Programmable Gate Array), for example. Also, part of the functions of the aerial operation detection unit 1350 may be realized by software, for example, by a spatial operation detection program executed by the control unit 1110 .

The aerial operation detection sensor 1351 and the aerial operation detection unit 1350 may be built in the floating image display device 1000 or may be provided outside the floating image display device 1000 separately. When provided separately from the spatially floating image display device 1000, the aerial operation detection sensor 1351 and the aerial operation detection unit 1350 transmit information and information to the spatially floating image display device 1000 via a wired or wireless communication connection path or a video signal transmission path. configured to transmit a signal;

Also, the aerial operation detection sensor 1351 and the aerial operation detection unit 1350 may be provided separately. As a result, it is possible to construct a system in which only the aerial operation detection function can be added as an option, using the space floating image display device 1000 without the aerial operation detection function as a main body. Alternatively, only the aerial operation detection sensor 1351 may be provided separately, and the aerial operation detection unit 1350 may be incorporated in the floating image display device 1000 . When it is desired to arrange the air operation detection sensor 1351 more freely with respect to the installation position of the floating image display device 1000, there is an advantage in the configuration in which only the air operation detection sensor 1351 is provided separately.

The imaging unit 1180 is a camera having an image sensor, and images the space near the floating image 3 and/or the face, arms, fingers, etc. of the user 230 . A plurality of imaging units 1180 may be provided. By using a plurality of image pickup units 1180 or by using an image pickup unit with a depth sensor, it is possible to assist the mid-air operation detection unit 1350 when the user 230 detects a touch operation on the floating image 3 . The imaging unit 1180 may be provided separately from the spatial floating image display device 1000 . When the imaging unit 1180 is provided separately from the spatially floating image display device 1000, it may be configured such that an imaging signal can be transmitted to the spatially floating image display device 1000 via a wired or wireless communication connection path.

For example, the aerial operation detection sensor 1351 is configured as an object intrusion sensor that targets a plane (intrusion detection plane) including the display surface of the floating image 3 and detects whether or not an object has entered the intrusion detection plane. In this case, information such as how far away an object (e.g., a user's finger) that has not entered the intrusion detection plane is from the intrusion detection plane, or how close the object is to the intrusion detection plane, is detected by the mid-air operation detection sensor. 1351 may not be detected.

In such a case, the distance between the object and the intrusion detection plane can be calculated by using information such as object depth calculation information based on images captured by a plurality of imaging units 1180 and object depth information obtained by a depth sensor. . These information and various information such as the distance between the object and the intrusion detection plane are used for various display controls for the floating image 3 .

Also, without using the air operation detection sensor 1351, the air operation detection unit 1350 may detect the touch operation of the floating image 3 by the user 230 based on the image captured by the imaging unit 1180.

Alternatively, the image capturing unit 1180 may capture an image of the face of the user 230 who operates the floating image 3, and the control unit 1110 may perform user 230 identification processing. In addition, in order to determine whether or not another person is standing around or behind the user 230 who operates the spatially floating image 3 and is peeping at the operation of the user 230 with respect to the spatially floating image 3, the imaging unit 1180 A range including the user 230 operating the spatial floating image 3 and the surrounding area of the user 230 may be imaged.

The operation input unit 1107 is, for example, an operation button or a light-receiving unit of a remote controller, and inputs a signal for an operation other than an aerial operation (touch operation) by the user 230 . Apart from the above-described user 230 who touch-operates the spatially floating image 3, the operation input unit 1107 may be used, for example, by an administrator to operate the spatially floating image display device 1000. FIG.

The video signal input unit 1131 connects an external video output device and inputs video data. The audio signal input unit 1133 connects an external audio output device to input audio data. The audio output unit 1140 can output audio based on audio data input to the audio signal input unit 1133 . Also, the audio output unit 1140 may output a built-in operation sound or an error warning sound.

The non-volatile memory 1108 stores various data used in the spatial floating image display device 1000 . The data stored in the non-volatile memory 1108 includes, for example, data for various operations to be displayed on the floating image 3, display icons, data of objects to be operated by the user, layout information, and the like. The memory 1109 stores image data to be displayed as the spatial floating image 3, control data for the device, and the like.

The control unit 1110 controls the operation of each connected unit. Further, the control unit 1110 may cooperate with a program stored in the memory 1109 to perform arithmetic processing based on information acquired from each unit in the floating image display device 1000 . The communication unit 1132 communicates with an external device, an external server, or the like via a wired or wireless interface. Various data such as video data, image data, and audio data are transmitted and received through communication via the communication unit 1132 .

The storage unit 1170 is a storage device that records various types of data & information such as video data, image data, and audio data. For example, various types of information such as video data, image data, audio data, etc. may be recorded in the storage unit 1170 in advance at the time of product shipment. Also, the storage unit 1170 may record various types of information such as various data such as video data, image data, and audio data acquired from an external device, an external server, or the like via the communication unit 1132 .

The video data, image data, etc., recorded in the storage unit 1170 are output as the spatially floating video 3 via the video display unit 1102 and the retroreflection unit 1101 . Video data, image data, etc., such as display icons and objects for the user to operate, which are displayed as the space-floating video 3, are also recorded in the storage unit 1170 .

The storage unit 1170 also records layout information such as display icons and objects displayed as the spatial floating image 3, and various metadata information related to the objects. The audio data recorded in the storage unit 1170 is output as audio from the audio output unit 1140, for example.

A video control unit 1160 performs various controls related to video signals input to the video display unit 1102 . The video control unit 1160 controls, for example, the video signal to be stored in the memory 1109 and the video signal (video data) input to the video signal input unit 1131 , which video signal is to be input to the video display unit 1102 . Controls switching, etc.

Further, the video control unit 1160 generates a superimposed video signal by superimposing the video signal to be stored in the memory 1109 and the video signal input from the video signal input unit 1131, and inputs the superimposed video signal to the video display unit 1102. Thus, control may be performed to form the synthesized image as the spatially floating image 3 .

Also, the video control unit 1160 may perform image processing control on the video signal input from the video signal input unit 1131 and the video signal to be stored in the memory 1109 . Examples of image processing include scaling processing for enlarging, reducing, and transforming an image, brightness adjustment processing for changing brightness, contrast adjustment processing for changing the contrast curve of an image, and decomposition of an image into light components for each component. There is Retinex processing that changes the weighting of .

In addition, the image control unit 1160 may perform special effect image processing, etc. for assisting the user 230's aerial operation (touch operation) on the image signal input to the image display unit 1102 . The special effect video processing is performed based on, for example, the detection result of the touch operation of the user 230 by the aerial operation detection unit 1350 and the captured image of the user 230 by the imaging unit 1180 .

As described so far, the spatial floating image display device 1000 is equipped with various functions. However, the spatially floating image display device 1000 does not need to have all of these functions, and may have any configuration as long as it has the function of forming the spatially floating image 3 .
<Spatial Floating Image Display Device 2>

FIG. 5 is a diagram showing another example of the main configuration of the spatial floating image display device according to one embodiment of the present invention. The display device 1 includes a liquid crystal display panel 11 and a light source device 13 that generates specific polarized light having diffusion characteristics with a narrow angle. For example, it is composed of a small liquid crystal display panel with a screen size of about 5 inches to a large liquid crystal display panel with a screen size exceeding 80 inches. The folding mirror 22 uses a transparent member 100 as a substrate. On the surface of the transparent member 100 facing the display device 1, a polarization separating member 101 such as a reflective polarizing plate for selectively reflecting image light of a specific polarized wave is provided, and the image light from the liquid crystal display panel 11 is reflected. It reflects toward the reflector 2 . Thereby, the folding mirror 22 has a function as a mirror. Image light of a specific polarized wave from the display device 1 is reflected by a polarization separation member 101 (in the drawing, a sheet-like polarization separation member 101 is adhered) provided on a transparent member 100 , and is incident on the retroreflection plate 2 . An optical film having a polarization separation characteristic may be vapor-deposited on the surface of the transparent member 100 instead of the polarization separation member 101 .

A λ/4 plate 21 is provided on the light incident surface of the retroreflector, and the image light is passed through twice to convert the polarization of the specific polarized wave into the other polarized wave with a phase difference of 90°. As a result, the retroreflected image light is transmitted through the polarization separation member 101 and the space floating image 3 as a real image is displayed outside the transparent member 100 . Here, since the polarization axes become uneven due to the retroreflection in the polarization separating member 101 described above, part of the image light is reflected and returns to the display device 1 . This light is reflected again by the image display surface of the liquid crystal display panel 11 that constitutes the display device 1, generating a ghost image and significantly deteriorating the image quality of the spatially floating image. Therefore, in this embodiment, the absorptive polarizing plate 12 may be provided on the image display surface of the display device 1 . Image light emitted from the display device 1 is transmitted, and reflected light from the polarization separation member 101 is absorbed, thereby preventing deterioration in image quality due to ghost images of spatially floating images. Also, in order to reduce deterioration in image quality due to sunlight or illumination light outside the set, it is preferable to provide an absorptive polarizing plate 102a on the surface of the transparent member 100 on the image light transmission output side.

Next, a sensor 44 having a TOF (Time Of Fly) function is provided so as to sense the relationship between the distance and the position between the object and the sensor 44 with respect to the space floating image obtained by the space floating image display device described above. 6, it is possible to detect not only the coordinates in the planar direction of the object but also the coordinates in the depth direction and the direction and speed of movement of the object. In order to read the two-dimensional distance and position, a plurality of combinations of infrared light emitting units and light receiving units are arranged in a straight line, the light from the light emitting points is irradiated onto the object, and the reflected light is received by the light receiving unit. The product of the difference between the light emission time and the light reception time and the speed of light makes the distance to the object clear. Further, the coordinates on the plane can be read from the coordinates at the portion where the difference between the light emission time and the light reception time is the smallest among a plurality of light emitting units and light receiving units. As described above, it is also possible to obtain three-dimensional coordinate information by combining the coordinates of an object on a plane (two-dimensional) with a plurality of the sensors described above.
<Reflective polarizing plate>

In the spatially floating image display device of this embodiment, the polarization separating member 101 is used to improve the contrast performance that determines the image quality of the image compared to a general half mirror. Characteristics of a reflective polarizing plate will be described as an example of the polarization separation member 101 of this embodiment. FIG. 7 is an explanatory diagram of a measurement system for evaluating the characteristics of the reflective polarizing plate. 8 and 9 show, as V-AOI, the transmission characteristics and reflection characteristics of the reflective polarizing plate of FIG. Similarly, the transmission characteristics and reflection characteristics of the reflective polarizing plate with respect to the incident angle of light from the horizontal direction with respect to the polarization axis are shown as H-AOI in FIGS. 10 and 11, respectively.

As shown in FIGS. 8 and 9, the reflective polarizing plate having a grid structure deteriorates in characteristics for light from a direction perpendicular to the polarization axis. For this reason, specifications along the polarization axis are desirable, and the light source of this embodiment, which can emit the image light emitted from the liquid crystal display panel at a narrow angle, is an ideal light source. In addition, the characteristics in the horizontal direction are similarly degraded with respect to oblique light. Considering the above characteristics, a configuration example of this embodiment will be described below, in which a light source capable of emitting image light from the liquid crystal display panel at a narrower angle is used as the backlight of the liquid crystal display panel. This makes it possible to provide high-contrast spatial floating images.
<Display device>

Next, the display device 1 of this embodiment will be described with reference to the drawings. The display device 1 of this embodiment includes an image display element 11 (liquid crystal display panel) and a light source device 13 constituting a light source thereof. there is

This liquid crystal display panel (image display element 11) has a narrow-angle diffusion characteristic from the light source device 13, which is a backlight device, as indicated by an arrow 30 in FIG. Also, it receives an illumination light beam having characteristics similar to those of a laser beam whose plane of polarization is aligned in one direction. The liquid crystal display panel (image display element 11) modulates the received illumination light beam according to the input image signal. The modulated image light is reflected by the retroreflection plate 2 and transmitted through the transparent member 100 to form a spatially floating image, which is a real image. (See Figure 1). Further, in FIG. 12, a liquid crystal display panel 11 constituting the display device 1, a light direction conversion panel 54 for controlling the directivity of the light flux emitted from the light source device 13, and, if necessary, a narrow angle diffusion plate ( not shown). That is, polarizing plates are provided on both sides of the liquid crystal display panel 11, and image light of a specific polarized wave is emitted after modulating the intensity of the light according to the image signal (see arrow 30 in FIG. 12). . As a result, a desired image is projected toward the retroreflector 2 through the light direction conversion panel 54 as light of a specific polarized wave with high directivity (straightness). A spatially floating image 3 is formed by being transmitted to the observer's eyes outside the (space). A protective cover 50 (see FIGS. 13 and 14) may be provided on the surface of the light direction conversion panel 54 described above.
<Example 1 of display device>

13 shows an example of a specific configuration of the display device 1. FIG. In FIG. 13, the liquid crystal display panel 11 and the light direction changing panel 54 are arranged on the light source device 13 of FIG. The light source device 13 is formed of, for example, plastic on the case shown in FIG. As shown in FIG. 12 and the like, each LED element 201 has a shape in which the cross-sectional area gradually increases toward the opposite side of the light receiving part in order to convert the divergent light from each LED element 201 into a substantially parallel light flux. A lens shape is provided that has the effect of gradually decreasing the divergence angle by performing total reflection multiple times while propagating inside. A liquid crystal display panel 11 constituting the display device 1 is attached to the upper surface thereof. A light emitting diode (LED) element 201, which is a semiconductor light source, and an LED board 202 on which a control circuit is mounted are attached to one side surface (the left end surface in this example) of the case of the light source device 13. A heat sink, which is a member for cooling the heat generated by the LED elements and the control circuit, may be attached to the outer surface of the LED substrate 202 .

In addition, the liquid crystal display panel 11 attached to the frame (not shown) attached to the upper surface of the case of the light source device 13 is electrically connected to the liquid crystal display panel 11 . A FPC (Flexible Printed Circuits) (not shown) and the like are attached. That is, the liquid crystal display panel 11, which is an image display element, together with the LED element 201, which is a solid-state light source, adjusts the intensity of transmitted light based on a control signal from a control circuit (image control unit 1160 in FIG. 4) that constitutes the electronic device. to generate the displayed image by modulating the At this time, the generated image light has a narrow diffusion angle and only a specific polarized wave component, so a new image display device that has not existed in the past, which is similar to a surface emitting laser image source driven by a video signal, can be obtained. . At present, it is technically and safely impossible to obtain a laser beam having the same size as the image obtained by the display device 1 using a laser device. Therefore, in this embodiment, for example, light close to the above-described surface emitting laser image light is obtained from a luminous flux from a general light source provided with an LED element.

Next, the configuration of the optical system housed in the case of the light source device 13 will be described in detail with reference to FIGS. 13 and 14. FIG.

Since FIGS. 13 and 14 are cross-sectional views, only one of the plurality of LED elements 201 constituting the light source is shown, and these are converted into substantially collimated light by the shape of the light receiving end surface 203a of the light guide 203. . For this reason, the light receiving portion on the end face of the light guide and the LED element are attached while maintaining a predetermined positional relationship. Each of the light guides 203 is made of translucent resin such as acryl. The LED light receiving surface at the end of the light guide has, for example, a conical convex outer peripheral surface obtained by rotating the parabolic cross section, and at the top, a convex portion (that is, a convex lens surface ), and in the central portion of the planar portion, a convex lens surface protruding outward (or a concave lens surface recessed inward) is provided (not shown). The outer shape of the light receiving portion of the light guide to which the LED element 201 is attached has a parabolic shape forming a conical outer peripheral surface, and the light emitted from the LED element in the peripheral direction can be totally reflected inside. It is set within the range of possible angles, or a reflective surface is formed.

On the other hand, the LED elements 201 are arranged at predetermined positions on the surface of the LED board 202, which is the circuit board. The LED substrate 202 is arranged and fixed to the LED collimator (light-receiving end surface 203a) so that the LED elements 201 on the surface thereof are positioned in the central portions of the recesses described above.

According to such a configuration, the shape of the light receiving end surface 203a of the light guide 203 makes it possible to extract the light emitted from the LED element 201 as substantially parallel light, thereby improving the utilization efficiency of the generated light. Become.

As described above, the light source device 13 is configured by attaching a light source unit in which a plurality of LED elements 201 as light sources are arranged on the light receiving end surface 203a, which is a light receiving portion provided on the end surface of the light guide 203. is converted into substantially parallel light by the lens shape of the light receiving end face 203a of the light guide body end face, and guided inside the light guide body 203 as indicated by the arrow (in the direction parallel to the drawing). , toward the liquid crystal display panel 11 arranged substantially parallel to the light guide 203 (direction perpendicular to the front of the drawing). By optimizing the distribution (density) of the luminous flux direction changing means according to the shape of the interior or surface of the light guide, the uniformity of the luminous flux incident on the liquid crystal display panel 11 can be controlled. The light beam direction changing means 204 described above directs the light beam propagated in the light guide 203 substantially parallel to the light guide 203 by providing a portion having a different refractive index, for example, in the shape of the light guide surface or inside the light guide. The light is emitted toward the arranged liquid crystal display panel 11 (in a direction perpendicular to the front of the drawing). At this time, when the liquid crystal display panel 11 faces the center of the screen and the viewpoint is placed at the same position as the diagonal dimension of the screen, the relative brightness ratio of the center of the screen and the peripheral part of the screen is 20% or more for practical use. There is no problem with the above, and if it exceeds 30%, the characteristics are even more excellent.

FIG. 13 is a cross-sectional layout diagram for explaining the configuration and operation of the light source of this embodiment for polarization conversion in the light source device 13 including the light guide 203 and the LED element 201 described above. In FIG. 13, the light source device 13 includes, for example, a light guide 203 formed of plastic or the like and provided with a light beam direction changing means 204 on its surface or inside, an LED element 201 as a light source, a reflection sheet 205, a retardation plate 206, It is composed of a lenticular lens or the like, and a liquid crystal display panel 11 having polarizing plates on the light source light entrance surface and the image light exit surface is attached to the upper surface thereof.

A film or sheet-like reflective polarizing plate 49 is provided on the light source light incident surface (bottom surface in the drawing) of the liquid crystal display panel 11 corresponding to the light source device 13 . A polarized wave (for example, P wave) 212 on one side is selectively reflected. The reflected light is reflected again by a reflective sheet 205 provided on one surface (lower side in the figure) of the light guide 203 and directed toward the liquid crystal display panel 11 . Therefore, a retardation plate (λ/4 plate) is provided between the reflective sheet 205 and the light guide 203 or between the light guide 203 and the reflective polarizing plate 49 so that the light is reflected by the reflective sheet 205 and passed through twice. converts the reflected luminous flux from P-polarized light to S-polarized light to improve the utilization efficiency of the light source light as image light. The image light flux (arrow 213 in FIG. 13) whose light intensity is modulated by the image signal on the liquid crystal display panel 11 is incident on the retroreflection plate 2 . A spatially floating image, which is a real image, can be obtained after being reflected by the retroreflection plate 2 .

FIG. 14 is a cross-sectional layout diagram for explaining the configuration and action of the light source of this embodiment that performs polarization conversion in the light source device 13 including the light guide 203 and the LED element 201, as in FIG. Similarly, the light source device 13 also includes a light guide 203 formed of plastic or the like and provided with a light beam direction changing means 204 on its surface or inside, an LED element 201 as a light source, a reflection sheet 205, a retardation plate 206, and a lenticular lens. A liquid crystal display panel 11 having polarizing plates on the light source light entrance surface and the image light exit surface is attached as an image display element on the upper surface thereof.

In addition, a film or sheet-like reflective polarizing plate 49 is provided on the light source light incident surface (lower surface in the drawing) of the liquid crystal display panel 11 corresponding to the light source device 13 to polarize the natural light beam 210 emitted from the LED light source 201 to one side. Waves (eg, S-waves) 211 are selectively reflected. That is, in the example of FIG. 14, the selective reflection characteristics of the reflective polarizing plate 49 are different from those in FIG. The reflected light is reflected by a reflective sheet 205 provided on one surface (lower side in the drawing) of the light guide 203 and directed toward the liquid crystal display panel 11 again. A retardation plate (λ/4 plate) is provided between the reflective sheet 205 and the light guide 203 or between the light guide 203 and the reflective polarizing plate 49, and the light is reflected by the reflective sheet 205 and passed twice. The luminous flux is converted from S-polarized light to P-polarized light to improve the utilization efficiency of light source light as image light. The image light beam (arrow 214 in FIG. 14) whose light intensity is modulated by the image signal on the liquid crystal display panel 11 is incident on the retroreflection plate 2 . A spatially floating image, which is a real image, can be obtained after being reflected by the retroreflection plate 2 .

In the light source device shown in FIGS. 13 and 14, in addition to the action of the polarizing plate provided on the light incident surface of the corresponding liquid crystal display panel 11, the reflective polarizing plate reflects the polarized component on one side, so theoretically The obtained contrast ratio is obtained by multiplying the reciprocal of the cross transmittance of the reflective polarizing plate by the reciprocal of the cross transmittance obtained by the two polarizing plates attached to the liquid crystal display panel. This provides high contrast performance. In practice, it was confirmed through experiments that the contrast performance of the displayed image is improved by ten times or more. As a result, a high-quality image comparable to that of a self-luminous organic EL was obtained.
<Example 2 of display device>

FIG. 15 shows another example of a specific configuration of the display device 1. FIG. The light source device 13 is configured by housing an LED, a collimator, a synthetic diffusion block, a light guide, etc. in a case made of plastic, for example, and a liquid crystal display panel 11 is attached to the upper surface thereof. In addition, on one side of the case of the light source device 13, LED (Light Emitting Diode) elements 14a and 14b, which are semiconductor light sources, and an LED board on which the control circuit is mounted are attached, and on the outer side of the LED board , a heat sink 103, which is a member for cooling the heat generated by the LED element and the control circuit, is attached.

Further, the liquid crystal display panel frame attached to the upper surface of the case includes the liquid crystal display panel 11 attached to the frame and FPCs (Flexible Printed Circuits: flexible wiring boards) electrically connected to the liquid crystal display panel 11. ) 403 (see FIG. 7) and the like are attached. That is, the liquid crystal display panel 11, which is a liquid crystal display element, together with the LED elements 14a and 14b, which are solid-state light sources, adjusts the intensity of transmitted light based on a control signal from a control circuit (not shown here) that constitutes the electronic device. to generate the displayed image by modulating the
<Example 3 of display device>

Next, another example of the specific configuration of the display device 1 (example 3 of the display device) will be described with reference to FIG. The light source device of this display device 1 converts a divergent light beam (P-polarized light and S-polarized light are mixed) from the LED into a substantially parallel light beam by the collimator 18, and the reflective surface of the reflective light guide 304 converts the light to the liquid crystal display panel 11. reflect towards. The reflected light enters the reflective polarizing plate 49 arranged between the liquid crystal display panel 11 and the reflective light guide 304 . A specific polarized wave (for example, P-polarized light) is transmitted through the reflective polarizing plate 49 and enters the liquid crystal display panel 11 . The other polarized wave (for example, S-polarized light) is reflected by the reflective polarizing plate and directed to the reflective light guide 304 again. The reflective polarizing plate 49 is installed at an angle so as not to be perpendicular to the principal ray of light from the reflecting surface of the reflective light guide 304, and the principal ray of light reflected by the reflective polarizing plate 49 is , is incident on the transmission surface of the reflective light guide 304 . The light incident on the transmissive surface of the reflective light guide 304 is transmitted through the back surface of the reflective light guide 304 , transmitted through the λ/4 plate 270 as a retardation plate, and reflected by the reflector 271 . The light reflected by the reflecting plate 271 passes through the λ/4 plate 270 again and passes through the transmitting surface of the reflective light guide 304 . Light transmitted through the transmissive surface of the reflective light guide 304 enters the reflective polarizing plate 49 again. At this time, the light incident on the reflective polarizing plate 49 again passes through the λ/4 plate 270 twice, so that the polarization is converted into a polarized wave (for example, P-polarized light) that passes through the reflective polarizing plate 49. ing. Therefore, the light whose polarization has been converted passes through the reflective polarizing plate 49 and enters the liquid crystal display panel 11 . Regarding the polarization design related to polarization conversion, the polarization may be reversed (reversing the S-polarized light and the P-polarized light) from the above description.

As a result, the light from the LEDs is aligned with a specific polarized wave (for example, P-polarized light), enters the liquid crystal display panel 11, is luminance-modulated in accordance with the video signal, and displays an image on the panel surface. A plurality of LEDs constituting the light source are shown (only one is shown in FIG. 16 because of the longitudinal section), which are mounted at predetermined positions with respect to the collimator 18, as in the above example. The collimators 18 are made of translucent resin such as acrylic or glass. The collimator 18 may have a convex conical outer peripheral surface obtained by rotating the parabolic section. The top portion may have a concave portion with a convex portion (that is, a convex lens surface) formed in the central portion. In addition, the central portion of the planar portion has an outwardly projecting convex lens surface (or an inwardly recessed concave lens surface may be used). In addition, the paraboloid that forms the conical outer peripheral surface of the collimator 18 is set within an angle range that allows total internal reflection of the light emitted from the LED in the peripheral direction, or the reflecting surface is formed.

Note that the LEDs are arranged at predetermined positions on the surface of the LED board 102, which is the circuit board. The LED substrate 102 is arranged and fixed to the collimator 18 so that the LEDs on the surface thereof are positioned at the central portion of the top of the conical convex shape (if the top has a concave portion, the concave portion). be.

According to such a configuration, of the light emitted from the LED by the collimator 18, particularly the light emitted from the central portion is collected by the convex lens surface forming the outer shape of the collimator 18 and becomes parallel light. Also, the light emitted in the peripheral direction from other portions is reflected by the paraboloid forming the conical outer peripheral surface of the collimator 18, and is similarly condensed into parallel light. In other words, the collimator 18, which has a convex lens in its central portion and a parabolic surface in its peripheral portion, makes it possible to extract almost all of the light generated by the LED as parallel light. It is possible to improve the utilization efficiency of the light.

Furthermore, the light converted into substantially parallel light by the collimator 18 shown in FIG. 16 is reflected by the reflective light guide 304 . Of the light, the light of a specific polarized wave is transmitted through the reflective polarizing plate 49 by the action of the reflective polarizing plate 49, and the light of the other polarized wave reflected by the action of the reflective polarizing plate 49 is again reflected. It passes through the light guide 304 . The light is reflected by the reflector 271 located opposite to the liquid crystal display panel 11 with respect to the reflective light guide 304 . At this time, the light is polarization-converted by passing through the λ/4 plate 270, which is a retardation plate, twice. The light reflected by the reflector 271 passes through the reflective light guide 304 again and enters the reflective polarizing plate 49 provided on the opposite surface. Since the incident light has undergone polarization conversion, it passes through the reflective polarizing plate 49 and enters the liquid crystal display panel 11 with the polarization direction aligned. As a result, all of the light from the light source can be used, and the geometrical optics utilization efficiency of light is doubled. Further, since the degree of polarization (extinction ratio) of the reflective polarizing plate can be added to the extinction ratio of the entire system, the use of the light source device of this embodiment greatly improves the contrast ratio of the entire display device. By adjusting the surface roughness of the reflecting surface of the reflective light guide 304 and the surface roughness of the reflecting plate 271, the reflection diffusion angle of light on each reflecting surface can be adjusted. The surface roughness of the reflective surface of the reflective light guide 304 and the surface roughness of the reflector 271 may be adjusted for each design so that the uniformity of the light incident on the liquid crystal display panel 11 is more favorable.

It should be noted that the λ/4 plate 270, which is the retardation plate in FIG. In the configuration of FIG. 16, any retardation plate that changes the phase by 90° (λ/2) by passing the polarized light twice may be used. The thickness of the retardation plate may be adjusted according to the incident angle distribution of polarized light.
<Display Device Example 4>

Furthermore, another example of the configuration of the optical system such as the light source device of the display device (Example 4 of the display device) will be described with reference to FIG. This is a configuration example in which a diffusion sheet is used in place of the reflective light guide 304 in the light source device of Example 3 of the display device. Specifically, two optical sheets (an optical sheet 207A and an optical sheet 207B), the light from the collimator 18 is made incident between two optical sheets (diffusion sheets). This optical sheet may be composed of one sheet instead of two sheets. In the case of a one-sheet structure, the vertical and horizontal diffusion characteristics are adjusted by the fine shapes of the front and back surfaces of one optical sheet. Also, a plurality of diffusion sheets may be used to share the action. Here, in the example of FIG. 19, the number of LEDs and the number of LEDs and The divergence angle from the LED substrate (optical element) 102 and the optical specifications of the collimator 18 should be used as design parameters for optimal design. That is, the diffusion characteristics are adjusted by the surface shape of a plurality of diffusion sheets instead of the light guide. In the example of FIG. 19, the polarization conversion is performed in the same manner as in Example 3 of the display device described above. That is, in the example of FIG. 19, the reflective polarizing plate 49 may be configured to have the property of reflecting S-polarized light (and transmitting P-polarized light). In that case, the P-polarized light of the light emitted from the LED, which is the light source, is transmitted, and the transmitted light is incident on the liquid crystal display panel 11 . Of the light emitted from the LED, which is the light source, S-polarized light is reflected, and the reflected light passes through the retardation plate 270 shown in FIG. The light that has passed through the retardation plate 270 is reflected by the reflector 271 . The light reflected by the reflector 271 passes through the retardation plate 270 again and is converted into P-polarized light. The polarized light is transmitted through the reflective polarizing plate 49 and enters the liquid crystal display panel 11 . It should be noted that the λ/4 plate 270, which is the retardation plate in FIG. In the configuration of FIG. 19, a retardation plate that changes the phase by 90° (λ/2) by passing the polarized light twice may be used. The thickness of the retardation plate may be adjusted according to the incident angle distribution of polarized light. In FIG. 19 as well, regarding the polarization design related to polarization conversion, the polarized waves may be reversed from the above description (S-polarized light and P-polarized light may be reversed).

Light emitted from the liquid crystal display panel 11 has similar diffusion characteristics in the horizontal direction of the screen (indicated by the X-axis in FIG. 18(a)) and in the vertical direction of the screen (indicated by the Y-axis in FIG. 18(b)) in the conventional TV set. have. On the other hand, the diffusion characteristic of the emitted light flux from the liquid crystal display panel of this embodiment is such that the viewing angle at which the brightness is 50% of the front view (angle of 0 degrees) is 13 degrees, as shown in Example 1 of FIG. As a result, it becomes 1/5 of the conventional 62 degrees. Similarly, the viewing angle in the vertical direction is not uniform in the vertical direction, and the reflection angle of the reflective light guide and the area of the reflecting surface are optimized so that the upper viewing angle is suppressed to about 1/3 of the lower viewing angle. do. As a result, compared with the conventional liquid crystal TV, the amount of image light directed toward the monitoring direction is greatly improved, and the luminance is increased by 50 times or more.

Furthermore, if the viewing angle characteristics shown in Example 2 of FIG. 18 are used, the brightness becomes 50% of the front view (angle of 0 degree). . Similarly, the angle of view in the vertical direction is uniform in the vertical direction, and the angle of reflection and the area of the reflective surface of the reflective light guide are optimized so that the angle of view is suppressed to about 1/12 of the conventional angle. As a result, compared with the conventional liquid crystal TV, the amount of image light directed toward the monitoring direction is greatly improved, and the luminance is increased by 100 times or more. As described above, by narrowing the viewing angle, the amount of luminous flux directed toward the monitoring direction can be concentrated, so that the utilization efficiency of light is greatly improved. As a result, even if a conventional liquid crystal display panel for TVs is used, by controlling the light diffusion characteristics of the light source device, it is possible to realize a significant improvement in brightness with the same power consumption, and to display information for the bright outdoors. A video display device compatible with the system can be provided.

When using a large liquid crystal display panel, the brightness of the screen is improved by directing the light around the screen inward so that when the monitor is facing the center of the screen, the light is directed toward the monitor. do. FIG. 17 shows the convergence angles of the long sides and short sides of the panel when the distance L from the panel of the observer and the panel size (screen ratio 16:10) are used as parameters. If you want to monitor the screen vertically, you can set the convergence angle according to the short side. Image light from the four corners can be effectively directed to the observer.

Similarly, when a 15″ panel is used vertically for monitoring, if the monitoring distance is 0.8 m and the convergence angle is set to 7 degrees, the image light from the four corners of the screen can be effectively directed to the monitor. As described above, depending on the size of the liquid crystal display panel and whether it is used vertically or horizontally, the overall brightness of the screen can be improved by directing the image light at the periphery of the screen to the monitor who is in the optimum position for monitoring the center of the screen. can be improved.

As a basic configuration, as shown in FIG. 16, a luminous flux with a narrow-angle directional characteristic is made incident on the liquid crystal display panel 11 by a light source device, and is displayed on the screen of the liquid crystal display panel 11 by performing luminance modulation in accordance with a video signal. A spatially floating image obtained by reflecting the image information on the retroreflection plate is displayed outside or inside the room through the transparent member 100. - 特許庁

By using the display device and the light source device according to the embodiment of the present invention described above, it is possible to realize a spatially floating image display device with higher light utilization efficiency.

<Embodiment of Spatial Floating Image Display System Using Spatial Floating Image Display Device>
An embodiment of a spatial floating image display system using the spatial floating image display device described above will now be described. The spatial floating image display system described below assumes a case in which a first user and a second user each use a spatially floating image display device provided for their own use. Combinations of the first user and the second user are, for example, a store clerk and a customer, a lecturer and a listener, and a lecturer and a student.

<<Embodiment 1>> (Example in which a master device and a slave device are arranged facing each other)
Embodiment 1 is an example in which a first spatially floating image display device for a first user and a second spatially floating image display device for a second user are configured to face each other. .

It should be noted that in each of the embodiments below, the first user is also called the main user, and the second user is also called the sub-user. The first spatially floating image display device is also called a master device, and the second spatially floating image display device is also called a slave device.

Specifically, the spatially floating image display system according to the first embodiment includes a table including a light-transmissive top plate, a first spatially floating image display device arranged to face each other inside the table, and generated by a second spatially floating image display device, a video signal processing device that transmits video signals to the first spatially floating image display device and the second spatially floating image display device, and the first spatially floating image display device; A sensor that forms a sensing surface in a spatially floating image, and is connected to the sensor and the video signal processing device, receives a sensing signal from the sensor in response to a user's touch operation on the sensing surface, and based on the received sensing signal, a controller for controlling the video signal processing device so that the spatially floating images generated by the first spatially floating image display device and the second spatially floating image display device are respectively desired display images. It is configured.

Further, the controller controls the image so that the spatially floating image generated by the first spatially floating image display device and the spatially floating image generated by the second spatially floating image display device are different from each other. Control the signal processor.

FIG. 20 is a vertical sectional view showing the configuration of the spatial floating image display system according to the first embodiment. Also, FIG. 21 is a horizontal cross-sectional view showing the configuration of the spatial floating image display system according to the first embodiment.

As shown in FIGS. 20 and 21, the spatial floating image display system 501 according to the first embodiment includes a table 10. FIG. Inside the table 10, a master device 2a for the main user 1a and a slave device 2b for the sub-user 1b are arranged so as to face each other. The table 10 has a top plate 14. - 特許庁The top plate 14 is made of a light-transmissive material such as glass or acrylic.

The master device 2a includes a display device 3a, a reflector 4a provided with a λ/4 plate on the light incident surface of the retroreflector, a polarization separation member 6a, and a sensor 7a.

The slave device 2b includes a display device 3b, a reflector 4b provided with a λ/4 plate on the light incident surface of the retroreflector, and a polarization separation member 6b.

In the master device 2a, the display device 3a emits video light based on the video signal input from the video signal processing device 9. The emitted image light is polarized and separated by the polarization separation member 6a and reflected by the reflector 4a to generate the spatially floating image 5a. The main user 1a can visually recognize the generated spatial floating image 5a.

In the slave device 2b, the display device 3a emits video light based on the video signal input from the video signal processing device 9. The emitted image light is polarized and separated by the polarization separation member 6b and reflected by the reflector 4b to generate the spatially floating image 5b. The sub-user 1b can visually recognize the generated spatial floating image 5b.

The spatially floating video display system 501 further includes a controller 8 and a video signal processing device 9 . The controller 8 is connected to the video signal processing device 9 and the sensor 7a. The video signal processing device 9 is connected to the display device 3a and the display device 3b.

The sensor 7a virtually generates a sensing surface 12a on the spatial floating image 5a. The main user 1a can perform non-contact touch screen operations on the sensing surface 12a on the floating image 5a. The sensor 7a outputs a sensing signal to the controller 8 according to the touch screen operation. The controller 8 receives an operation by the main user 1a based on the sensing signal input from the sensor 7a, and outputs a control signal corresponding to the operation to the video signal processing device 9. The video signal processing device 9 outputs video signals to the display device 3a and the display device 3b. Further, the video signal processing device 9 turns on/off the video signal or switches the video signal to be output based on the input control signal.

The video signal processing device 9 is configured so as to be able to output the video signal output to the display device 3a and the video signal output to the display device 3b separately and independently. The controller 8 is configured to be able to output to the video signal processing device 9 a control signal for separately controlling the video signal output to the display device 3a and the video signal output to the display device 3b. It is Therefore, the spatially floating image 5a for the main user 1a and the spatially floating image 5b for the sub user 1b can be different images or the same image.

According to the space-floating image display system 501 according to the first embodiment having such a configuration, the main user 1a can turn on/off the image provided to the sub-user 1b by performing a non-contact touch screen operation. , the video can be switched, and the sub-user 1b can be dealt with smoothly. For example, when the main user 1a is a store clerk and the sub-user 1b is a customer, it is possible to serve customers smoothly.

[Modification of Embodiment 1]
22 is a vertical cross-sectional view showing the configuration of a spatial floating image display system according to a modification of the first embodiment; FIG. As shown in FIG. 22, a spatial floating image display system 501a according to a modification of the first embodiment is based on the spatial floating image display system 501 described above, but differs in the configuration and arrangement of the controller and the video signal processing device. .

Specifically, the controller includes a first controller 8a and a second controller 8b, and the video signal processing device includes a first video signal processing device 9a and a second video signal processing device 9b. The first controller 8a and the first video signal processing device 9a are installed inside the housing of the master device 2a, and the second controller 8b and the second video signal processing device 9b are installed inside the housing of the slave device 2b. is installed in The first video signal processing device 9a transmits video signals to the master device 2a, and the second video signal processing device 9b transmits video signals to the slave device 2b. The first controller 8a is connected to the sensor 7a, the first video signal processing device 9a, and the second controller 8b, and controls the master device 2a and the second controller 8b based on sensing signals. The second controller 8b is connected to the slave device 2b and controls the second video signal processing device 9b according to the control by the first controller 8a.

The master device 2a includes a first controller 8a and a first video signal processing device 9a inside the housing. Similarly, the slave device 2b has a second controller 8b and a second video signal processing device 9b inside the housing. The first controller 8a is connected to the sensor 7a and the first video signal processing device 9a. The first video signal processing device 9a is connected to the display device 3a.

The second controller 8b is connected to the second video signal processing device 9b. The second video signal processing device 9b is connected to the display device 3b.

The first controller 8a is connected to the second controller 8b. The first controller 8a can indirectly control the second video signal processing device 9b by sending a control signal to the second controller 8b.

According to the spatial floating image display system 501a according to the modification of the first embodiment having such a configuration, similarly to the spatial floating image display system 501, when the main user 1a performs a non-contact touch screen operation, The video provided to the sub-user 1b can be turned on/off, or the video can be switched, making it possible to smoothly respond to the sub-user 1b.

That is, the controller 8 controls the first video signal processing device 9a so that the spatially floating video 5a generated by the master device 2a and the spatially floating video 5b generated by the slave device 2b are different from each other. can be controlled.

Also, the master device 2a and the slave device 2b have the same configuration except for the sensor 7a. Therefore, the master device 2a and the slave device 2b can use spatially floating image display devices having the same configuration, reducing costs and man-hours required for designing or manufacturing, and efficiently producing a spatially floating image display system. .

<<Embodiment 2>> (Example of relatively increasing the display screen size on the master device side)
A second embodiment is an example in which the display screen size of the spatially floating image on the master device side is larger than that of the spatially floating image on the slave device side.

Specifically, the spatially floating image display system according to the second embodiment includes a table including a light-transmissive top plate, first spatially floating image display devices arranged to face each other inside the table, and generated by a second spatially floating image display device, a video signal processing device that transmits video signals to the first spatially floating image display device and the second spatially floating image display device, and the first spatially floating image display device; A sensor that forms a sensing surface in the space floating image, is connected to the sensor and the image signal processing device, receives a sensing signal from the sensor in response to a user's touch operation on the sensing surface, and based on the received sensing signal, a controller for controlling the video signal processing device so that the spatial floating video generated by the first spatial floating video display device and the second spatial floating video display device becomes a desired display video; The size of the first image light exit surface of the spatially floating image display device is larger than the size of the second image light exit surface of the second spatially floating image display device.

FIG. 23 is a vertical sectional view showing the configuration of the spatial floating image display system according to the second embodiment. As shown in FIG. 23, the spatial floating image display system 502 according to the second embodiment is based on the spatial floating image display system 501 described above, and the master device 2A has a display device 3A instead of the display device 3a. and has a reflector 4A instead of the reflector 4a. The display device 3A on the master device 2A side has a relatively larger image light exit surface than the display device 3b on the slave device 2b side. Further, the reflecting plate 4A on the master device 2A side has a light reflecting surface relatively larger in size than the reflecting plate 4b on the slave device 2b side. With such a configuration, the display size of the spatially floating image 5A viewed by the main user 1a is larger than the spatially floating image 5b viewed by the sub-user 1b.

The display screen size of the spatial floating image is basically determined by the size of the image light exit surface of the display device. As for the display screen size, for example, the spatial floating image 5A on the master device 2A side has a size of 10 inches, 2160 pixels×1620 pixels, and the spatial floating image 5b on the side of the slave device 2b has a size of 5.5 inches, 1920 pixels×1920 pixels. It can be 1080 pixels.

Further, the controller 8 displays a plurality of screens as the spatial floating image 5A generated by the master device 2A, and displays one of the plurality of screens as the spatial floating image 5b generated by the slave device 2b. Thus, the video signal processing device 9 is controlled.

Alternatively, the controller 8 displays a plurality of pieces of information as the spatial floating image 5A generated by the master device 2A, and displays part of the plurality of pieces of information as the spatial floating image 5b generated by the slave device 2b. The video signal processing device 9 is controlled as follows.

FIG. 24 is a diagram showing a first example of a display screen in the spatial floating video system according to the second embodiment. 24(a) shows the display screen of the spatially floating image 5A on the master device 2A side, and FIG. 24(b) shows the display screen of the spatially floating image 5b on the slave device 2b side.

As shown in FIG. 24, for example, the video signal processing device 9 divides the display screen of the floating image 5A into four, and displays different images or information on each of the divided screens A to D. A video signal is output to the device 3A. Further, the video signal processing device 9 outputs a video signal to the display device 3b so that only one of the screens A to D is displayed on the display screen of the spatially floating video 5b on the slave device 2b side. .

An example of a touch operation by the main user 1a is shown. For example, the main user 1a touches one of the screens A to D on the sensing surface 12a in the spatial floating image 5A on the master device 2A side. The controller 8 receives a sensing signal corresponding to the touch operation of the main user 1a from the sensor 7a, and controls the video signal processing device so that the touched screen is displayed on the display screen of the floating image 5b on the side of the slave device 2b. control 9. Also, the main user 1a touches the same screen again. The controller 8 receives a sensing signal corresponding to the touch operation of the main user 1a from the sensor 7a, and controls the video signal processing device 9 so that the touched screen disappears from the display screen of the spatial floating image 5b on the slave device 2b side. Control.

FIG. 25 is a diagram showing a second example of the display screen in the spatial floating video system according to the second embodiment. 25(a) shows the display screen of the spatially floating image 5A on the master device 2A side, and FIG. 25(b) shows the display screen of the spatially floating image 5b on the slave device 2b side.

As shown in FIG. 25, for example, the video signal processing device 9 divides the display screen of the space floating image 5A into four, and displays information A1, customer information, information such as confirmation items, and store information on each of the divided screens. A video signal is output to the display device 3A so as to display other information such as. Further, the video signal processing device 9 outputs a video signal to the display device 3b so that the screen showing the information A1 is displayed on the display screen of the spatially floating video 5b on the slave device 2b side.

According to the spatially floating image display system 502 according to the second embodiment having such a configuration, the main user 1a can visually recognize the spatially floating image having a display size larger than that of the sub-user 1b, and the sub-user 1b can be notified. It is possible to obtain more information from the spatially floating image 5A without being distorted.

For example, the main user 1a can sequentially present necessary information to the sub-user 1b while grasping a plurality or all of the patterns to be explained to the sub-user 1b. As a result, it becomes possible to improve the efficiency of services such as explanations and customer service, and to automatically acquire skills. As a result, it becomes easier for the main user 1a to provide explanations and serve customers to the sub-user 1b. Also, the main user 1a can input information about the sub-user 1b accurately and smoothly.

The number of screens or information displayed as the spatial floating image 5A on the master device 2A side or the number of screens or information displayed as the spatial floating image 5b on the slave device 2b side is not limited to this embodiment.

<<Embodiment 3>> (Example of providing a plurality of slave devices)
The third embodiment is an example in which one master device is installed and a plurality of slave devices are installed.

FIG. 26 is a horizontal sectional view showing the configuration of the spatial floating image display system according to the third embodiment.

As shown in FIG. 26, the spatial floating image display system 503 according to the third embodiment includes a table 20. As shown in FIG. Inside the table 20, a master device 2a for the main user 1a and

slave devices

2b and 2c for the sub-users 1b and 1c are installed so as to face each other. . The table 20 is provided with a light-transmitting top plate (not shown).

The master device 2a includes a display device 3A, a reflector 4A, a polarization separating member (not shown), and a sensor 7a. The slave device 2b includes a display device 3b, a reflector 4b, and a polarization separating member (not shown). Similarly, the slave device 2c includes a display device 3c, a reflector 4c, and a polarization separating member (not shown).

The controller (not shown) is connected to the sensor 7a and to a video signal processing device (not shown). A video signal processing device (not shown) transmits video signals to the display device 3A, the display device 3b, and the display device 3c.

With such a configuration, a spatially floating image 5A is generated on the master device 2A side. A spatially floating image 5b is generated on the slave device 2b side, and a spatially floating image 5c is generated on the slave device 2c side. The display screen size of the spatial floating image 5A on the master device 2A side is larger than the spatial floating

images

5b, 5c on the

slave devices

2b, 2c side. Alternatively, the display screen size of the spatially floating image 5A on the master device 2A side may be the same as that of the spatially floating

images

5b and 5c on the

slave devices

2b and 2c side. The display screen size and the number of pixels of each spatial floating image may be the same as those in the first and second embodiments, for example.

When the main user 1a performs a touch operation on the floating image 5A, the sensor 7a transmits a sensing signal according to the operation to the controller. The main user 1a performs a touch operation on the spatially floating image 5A to control the contents displayed as the spatially floating

images

5b and 5c on the side of the sub-users 1b and 1c.

FIG. 27 is a diagram showing a first example of the display screen in the spatial floating video system according to the third embodiment. FIG. 27(a) shows the display screen of the spatial floating image 5A on the master device 2A side. FIG. 27(b) shows the display screen of the spatially floating image 5b on the side of the slave device 2b, and FIG. 27(c) shows the display screen of the spatially floating image 5c on the side of the slave device 2c.

As shown in FIG. 27, for example, the video signal processing device divides the display screen of the spatially floating image 5A into four, and displays different images or information on each of the divided screens A to D. outputs the video signal to the Further, the video signal processing device controls the display device so that only one of the divided screens A to D is displayed on the display screens of the spatially floating

images

5b and 5c of the slave devices 2b and 2c. to output the video signal. In this display example, the screen A is displayed in the spatially floating

images

5b and 5c. The display screen as the spatial floating image 5b and the display screen as the spatial floating image 5c may always synchronize and display the same information, or may display independent information. good too. For example, the screen A may be displayed as the spatially floating image 5b, and the screen B may be displayed as the spatially floating image 5c.

According to the spatial floating image display system 503 according to the third embodiment having such a configuration, the main user can simultaneously explain to a plurality of sub-users while sharing the screen, and the sub-users can can provide the same service to each other. In particular, in the scene of customer service at a store or facility, a pair of customers often visit, so this system is suitable for such a scene.

<<Embodiment 4>> (Example of providing a lateral slide mechanism for the master device)
A fourth embodiment is an example configured based on the third embodiment so as to have a slide mechanism for the master device. In this embodiment, movement of the master device means movement of the optical system including the sensor in the master device, and does not mean movement of only the housing of the master device.

Specifically, the spatially floating image display system according to the fourth embodiment includes a table including a light-transmissive top plate, first spatially floating image display devices arranged to face each other inside the table, and A plurality of second spatially floating image display devices, a video signal processing device for transmitting image signals to the first spatially floating image display device and the plurality of second spatially floating image display devices, and a first spatially floating image display A sensor forming a sensing surface in a space-floating image generated by the device, connected to the sensor and the image signal processing device, receiving a sensing signal from the sensor according to a user's touch operation on the sensing surface, and receiving the received sensing A controller for controlling the video signal processing device so that the spatially floating video generated by the first spatially floating video display device and the plurality of second spatially floating video display devices, based on the signal, becomes a desired display video. and a slide mechanism for sliding the first spatially floating image display device horizontally and in a direction parallel to the direction in which the plurality of second spatially floating image display devices are arranged. .

FIG. 28 is a horizontal sectional view showing the configuration of the spatial floating image display system according to the fourth embodiment. As shown in FIG. 28, in the spatial floating image display system 504 according to the fourth embodiment, the master device 2a is initialized in the horizontal direction parallel to the direction (x-axis direction) in which the plurality of

slave devices

2b and 2c are arranged. It has a slide mechanism 35 that can be moved from the position 2as.

The slide mechanism 35 may be composed of, for example, rails provided on the table 20 and wheels provided on the master device 2a. Alternatively, for example, it may be configured by a rack and pinion.

The movement of the master device 2a may be configured to be performed manually, or may be configured to be electrically performed using a drive source such as a motor.

Further, when the master device 2a is electrically moved, the master device 2a may be configured to be automatically moved so as to match the position of the sub-user on the slave device side. For example, a position detection device that detects the position of the sub-user corresponding to the slave device is provided, and a controller (not shown) determines the slide position of the master device 2a based on the detection result of this position detection device, and slides the master device 2a. It controls the drive source provided in the mechanism 35 .

At this time, for example, the controller determines the slide position of the master device 2a to a position facing the slave device 2b corresponding to the sub-user 1b. As a specific example of the method of automatically moving the master device 2a, a motion sensor may be provided on the slave device 2b side, or image recognition processing may be performed based on an image taken by a camera. The position of the sub-user is detected, and the drive source is driven based on the detection result. The position of the master device 2a can be detected and controlled by using a linear scale or the like.

According to the spatial floating image display system 504 according to the fourth embodiment having such a configuration, in the spatial floating image display system capable of supporting two or more sub-users, even if there is only one sub-user, Also, the master device 2a can be slid according to the position of the sub-user. As a result, the main user 1a can stand or sit at a position directly facing the sub-user while viewing the spatially floating image 5a from the front, thereby providing services to the sub-user in a more suitable situation. can be done.

<<Embodiment 5>> (Example of providing a rotating mechanism for the master device)
A fifth embodiment is an example configured based on the third embodiment so as to have a rotation mechanism for the master device. In this embodiment, rotation of the master device means rotation of the optical system including the sensor in the master device, and does not mean rotation of only the housing of the master device.

Specifically, the spatially floating image display system according to the fifth embodiment includes a table including a light-transmissive top plate, first spatially floating image display devices arranged to face each other inside the table, and A plurality of second spatially floating image display devices, a video signal processing device for transmitting image signals to the first spatially floating image display device and the plurality of second spatially floating image display devices, and a first spatially floating image display A sensor forming a sensing surface in the space-floating image generated by the device, connected to the sensor and the video signal processing device, and receiving a sensing signal from the sensor in response to a user's touch operation on the sensing surface. The video signal processing device is operated so that the spatially floating video generated by the first spatially floating video display device and the plurality of second spatially floating video display devices is a desired display video, based on the sensing signal. and a rotating mechanism for rotating the first spatial floating image display device in the swivel direction.

FIG. 29 is a horizontal sectional view showing the configuration of the spatial floating image display system according to the fifth embodiment. As shown in FIG. 29, the spatially floating image display system 505 according to the fifth embodiment has an angle range including an angle in the horizontal direction (swivel direction) at which the master device 2A faces each of the plurality of

slave devices

2b and 2c. , the master device 2A is provided with a rotation mechanism 36 that can rotate from the initial position 2As.

The rotating mechanism 36 may be, for example, a swivel stand or a turntable provided inside the table 20, the lower part of which is fixed to the table 20, and the master device 2A is placed on the upper part. Alternatively, for example, it may be composed of rails provided on the table 20 and wheels provided on the master device 2A. Alternatively, for example, it may be configured by a rack and pinion.

The rotation of the master device 2A may be manual or electric as in the fourth embodiment. In the case of an electric drive, the master device 2A may rotate automatically. For example, a position detection device for detecting the position of the sub-user corresponding to the slave device is provided, and the controller (not shown) determines the rotation position of the master device 2a based on the detection result of the position detection device, It controls the driving source of the rotating mechanism 36 . In this case, for example, the controller determines the rotation position of the master device 2A to a position where the slave device 2b corresponding to the sub-user 1b faces a certain direction. For example, a motion sensor or a camera for image recognition can be used as the position detection device. Alternatively, the position detection device can detect the position of the main user. In this case, the main user stands at a position facing the sub-user, and the controller determines the rotation position of the master device 2A to face the direction corresponding to the main user 1a.

According to the spatial floating image display system 505 according to the fifth embodiment having such a configuration, in the spatial floating image display system capable of supporting two or more sub-users, even if there is only one sub-user, Also, the master device can be rotated to match the position of the sub-user or the main user. As a result, the main user can stand or sit in a position directly facing the sub-user while viewing the spatially floating image from a suitable position, thereby providing services to the sub-user in a more suitable situation. can be done.

<<Embodiment 6>> (Example of providing a depth direction slide mechanism for the slave device)
A sixth embodiment is an example configured based on the third embodiment so as to have a slide mechanism for a slave device. In this embodiment, the movement of the slave device means the movement of the optical system in the slave device, and does not mean the movement of only the housing of the slave device.

Specifically, the spatially floating image display system according to the sixth embodiment includes a table including a light-transmissive top plate, a first spatially floating image display device arranged to face each other inside the table, and A plurality of second spatially floating image display devices, a video signal processing device for transmitting image signals to the first spatially floating image display device and the plurality of second spatially floating image display devices, and a first spatially floating image display A sensor forming a sensing surface in a space-floating image generated by the device, connected to the sensor and the image signal processing device, receiving a sensing signal from the sensor according to a user's touch operation on the sensing surface, and receiving the received sensing A controller for controlling the video signal processing device so that the spatially floating video generated by the first spatially floating video display device and the plurality of second spatially floating video display devices, based on the signal, becomes a desired display video. Then, at least one of the plurality of second spatially floating image display devices is slid horizontally in a direction in which the first spatially floating image display device and the plurality of second spatially floating image display devices face each other. and a sliding mechanism.

FIG. 30 is a horizontal sectional view showing the configuration of the spatial floating image display system according to the sixth embodiment. Also, FIG. 31 is a vertical sectional view showing the configuration of the spatial floating image display system according to the sixth embodiment.

As shown in FIGS. 30 and 31, in the spatially floating image display system 506 according to the sixth embodiment, in the horizontal direction (y-axis direction) in which the master device 2A faces the plurality of

slave devices

2b and 2c, A slide mechanism 37 is provided to allow the

slave devices

2b and 2c to move from the initial positions 2bs and 2cs, respectively.

The slide mechanism 37 may be composed of, for example, rails provided on the table 20 and wheels provided on the

slave devices

2b and 2c. Alternatively, for example, it may be configured by a rack and pinion.

The movement of the

slave devices

2b and 2c may be configured to be performed manually, or may be configured to be electrically performed by providing the slide mechanism 37 with a drive source such as a motor.

Further, when the slave device is electrically moved, the slave device may be automatically moved to match the position, height, or eye level of the sub-user on the side of the slave device. good. As a method of automatically moving the slave device, for example, by providing a distance sensor on the slave device side or performing image recognition processing based on the image taken by the camera, the position of the sub-user on the slave side, Height or eye height is detected, and the driving source is driven based on the detection result. The position of the slave device can be detected by using a linear scale or the like.

In the spatial floating image display system 506 according to this embodiment, the slide mechanism 37 is connected to the controller 8 and the operation unit 33 provided on the sub-user 1b, 1c side of the table 20. The movement of the slave device may be performed by the main user 1a through the controller 8 by performing a touch operation on the spatially floating image 5a, or by the sub-users 1b and 1c themselves by performing an operation on the operation unit 33 to their liking. You may make it move to a position. Note that the operation unit 33 may be of a contact type or may be of a non-contact type.

According to the spatial floating image display system 506 according to the sixth embodiment having such a configuration, the position of the slave device is moved to a position where the sub-user can easily see the spatial floating image according to the height of the sub-user. be able to. That is, the sub-user can select a comfortable posture. For example, if the sub-user is tall, by moving the position of the slave device away from the sub-user, the sub-user can maintain a natural and comfortable angle without lowering the neck too much and float in space. You can see the video.

The positions in the sliding direction of the plurality of

slave devices

2b and 2c may be controlled to be the same, or may be independently controlled so that each position can be set separately. When controlled independently, the operation unit 33 is provided for each of the

slave devices

2b and 2c. In this case, even for a plurality of sub-users whose heights are significantly different from each other, the plurality of sub-users can view the spatially floating image in their respective preferred postures.

Also, the y-axis direction slide mechanism provided in the slave device may also be provided in the master device. In this case, the master device can be moved according to the height of the main user, and the main user can also view the spatially floating image and perform the touch operation while taking a natural and comfortable posture.

[Modification of Embodiment 6]
The controller 8 causes the slave device 2b to project such that the spatially floating image 5b generated by the slave device 2b after sliding is viewed in the same shape as the spatially floating image 5B generated by the slave device 2b before sliding. A video signal processing device is controlled to correct the shape of the video.
FIG. 32 is a diagram for explaining trapezoidal distortion correction of a spatially floating image by the spatially floating image display system according to the sixth embodiment.

In the spatial floating image display system 506, when the slave device is positioned at the initial position and a sub-user of average height views the spatial floating image 5b from an average position, the visible spatial floating image 5b is rectangular. designed to be shaped The shape of the spatially floating image 5b at this time can be represented by, for example, a shape image shown in FIG. 32(a).

On the other hand, when the slave device 2b is moved in the sliding direction (y-axis direction) from the initial position 2bs, and the spatially floating image 5b is caused to appear as the spatially floating image 5B moved in the sliding direction, the sub-user 1b moves in the spatially floating image 5B. The image 5B is viewed from below compared to before the slide movement. Therefore, the sub-user 1b sees the spatially floating image 5B in a trapezoidally distorted state. The shape of the spatially floating image 5B at this time can be represented by, for example, a shape image shown in FIG. 32(b).

Therefore, in the spatial floating image display system 506, the shape of the image is corrected so that the image projected from the display device 3b is an upside down trapezoid so that the sub-user 1b can see the spatial floating image 5B in a rectangular state. do. That is, the video signal processing device 9 controls the video signal sent to the display device 3b so as to apply such correction. The shape of the projected image at this time can be represented by, for example, a shape image shown in FIG. 32(c).

With such correction, the spatially floating image 5B appears rectangular when viewed from the sub-user 1b. The shape of the spatially floating image 5B at this time can be represented by, for example, a shape image shown in FIG. 32(d).

The degree of correction is obtained by calculating back from the position of the slave device 2b (the amount of slide from the initial position), assuming that the sub-user 1b has an average height and is in an average position. good too.

Alternatively, a detection device is provided for detecting the height or eye level of the sub-user 1b viewing the spatially floating image generated by the slave device 2b, and the controller 8 detects the height or eye level of the subuser 1b detected by the detection device. The driving source of the slide mechanism 37 may be controlled in order to adjust the amount of slide (sliding position) of the slave device 2b based on such factors as. For example, an image of the sub-user 1b may be captured by a camera or the like, image recognition processing may be performed on the obtained image, the height and the like of the sub-user 1b may be detected, and the slide amount may be calculated based on the detection result.

According to the modified example of the sixth embodiment having such a configuration, even if the slave device 2b is moved in the facing direction, the sub-user 1b can visually recognize the floating image 5B without distortion.

Although various embodiments have been described in detail above, the present invention is not limited to the above-described embodiments, and includes various modifications. For example, the above-described embodiments describe the entire system in detail in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the configurations described. In addition, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. Moreover, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.

For example, it is possible to combine Example 2, in which the display size of the spatial floating image on the master device side is increased, with Examples 3 to 6. Further, for example, the fourth embodiment in which the master device is provided with a slide mechanism or the fifth embodiment in which the master device is provided with a rotating mechanism can be combined with the sixth embodiment in which the slave device is provided with a slide mechanism.

Possible forms of the invention are noted as follows.
[Appendix 1]
a table including a top plate having optical transparency;
a first floating-in-the-air image display device and a second floating-in-the-air image display device arranged to face each other inside the table;
a video signal processing device that transmits a video signal to the first floating-in-air image display device and the second floating-in-air image display device;
a sensor forming a sensing surface in the floating-in-air image generated by the first floating-in-air image display device;
Connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and displaying the first floating-in-air image based on the received sensing signal. a controller for controlling the video signal processing device so that the floating video generated by the device and the second floating video display device becomes a desired display video,
The floating-in-air image display system, wherein the size of the first image light exit surface of the first floating-in-air image display device is larger than the size of the second image light exit surface of the second floating-in-air image display device. .

[Appendix 2]
In the floating-in-air video display system according to Appendix 1,
The controller displays a plurality of pieces of information as floating-in-air images generated by the first floating-in-air image display device, and displays the plurality of pieces of information as floating-in-air images generated by the second floating-in-air image display device. A floating-in-air video display system that controls the video signal processor so that a portion of the video signal processor is displayed.

[Appendix 3]
In the floating-in-air image display system according to Appendix 2,
The plurality of pieces of information are information indicating confirmation items to be confirmed by the first user corresponding to the first floating-in-air image display device, and related to the second user corresponding to the second floating-in-air image display device. A floating-in-the-air video display system containing information or information indicating a situation in a facility where the first user is.

[Appendix 4]
a table including a top plate having optical transparency;
a first floating-in-air image display device and a plurality of second floating-in-air image display devices arranged to face each other inside the table;
a video signal processing device that transmits a video signal to the first floating-in-air image display device and the plurality of second floating-in-air image display devices;
a sensor forming a sensing surface in the floating-in-air image generated by the first floating-in-air image display device;
Connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and displaying the first floating-in-air image based on the received sensing signal. a controller for controlling the video signal processing device so that the floating-in-air video generated by the device and the plurality of second floating-in-air video display devices becomes a desired display video;
a sliding mechanism for sliding the first floating-in-air image display device horizontally and in a direction parallel to the direction in which the plurality of second floating-in-air image display devices are arranged;
A floating image display system.

[Appendix 5]
In the floating-in-air video display system according to Supplementary Note 4,
A position detection device for detecting a position of a second user corresponding to the second floating-in-air image display device,
The floating-in-air image display system, wherein the controller determines a slide position of the first floating-in-air image display device based on a detection result by the position detection device, and controls the slide mechanism.

[Appendix 6]
In the floating-in-air video display system according to Appendix 5,
The floating-in-air image display system, wherein the controller determines a slide position of the first floating-in-air image display device to a position diagonal to the second floating-in-air image display device corresponding to the second user. .

[Appendix 7]
a table including a top plate having optical transparency;
a first floating-in-air image display device and a plurality of second floating-in-air image display devices arranged to face each other inside the table;
a video signal processing device that transmits a video signal to the first floating-in-air image display device and the plurality of second floating-in-air image display devices;
a sensor forming a sensing surface in the floating-in-air image generated by the first floating-in-air image display device;
Connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and displaying the first floating-in-air image based on the received sensing signal. a controller for controlling the video signal processing device so that the floating-in-air video generated by the device and the plurality of second floating-in-air video display devices becomes a desired display video;
At least one of the plurality of second floating-in-air image display devices is slid horizontally in a direction in which the first floating-in-air image display device and the plurality of second floating-in-air image display devices face each other. A floating image display system, comprising:

[Appendix 8]
In the floating-in-air image display system according to Supplementary Note 7,
A slide amount detection device for detecting a slide amount of the second floating-in-air image display device,
The controller enables the floating image generated by the second floating image display device after sliding to be visually recognized in the same shape as the floating image generated by the second floating image display device before sliding. and controlling the video signal processing device based on the slide amount detected by the slide amount detection device in order to correct the shape of the image projected by the second floating-in-air video display device. video display system.

In the technology according to the present embodiment, by displaying high-resolution and high-brightness video information floating in the air, the user can operate without feeling anxious about contact infection of infectious diseases. to enable. If the technology according to this embodiment is applied to a system used by an unspecified number of users, it will be possible to reduce the risk of contact infection of infectious diseases and provide a non-contact user interface that can be used without anxiety. . In this way, we will contribute to "3 good health and well-being for all" in the Sustainable Development Goals (SDGs) advocated by the United Nations.

In addition, in the technology according to the present embodiment, by making the angle of divergence of emitted image light small and aligning it to a specific polarized wave, only normal reflected light can be efficiently reflected by the retroreflective member. To obtain a bright and clear spatial floating image with high utilization efficiency. According to the technology according to the present embodiment, it is possible to provide a highly usable non-contact user interface capable of significantly reducing power consumption. In this way, we will contribute to the Sustainable Development Goals (SDGs) advocated by the United Nations.

REFERENCE SIGNS LIST 1 display device 2 retroreflector 3 spatial image (space floating image) 105 window glass 100 transparent member 101 polarization separation member 12 absorption polarizing plate 13 light source device 54... Light direction conversion panel 151...

Retroreflector

102, 202... LED board 203... Light guide 205...

Reflective sheet

206, 270... Retardation plate 271... Reflector 230... User 1000... Spatial floating image display device 1110 Control unit 1160 Image control unit 1180 Imaging unit 1102 Image display unit 1350 Mid-air operation detection unit 1351 Mid-air operation detection sensor 1a Main user (first user), 1b... sub-user (second user), 2a... master device (first spatial floating image display device), 2b... slave device (second spatial floating image display device), 3a, 3b... display device , 4a, 4b... Reflector 5a... Spatial floating image (first spatial floating image) 5b... Spatial winter image (second spatial floating image) 6a, 6b... Polarization separation member 7a... Sensor 8... Controller, 9... Video signal processing device, 10... Table

Claims

a table including a top plate having optical transparency;
a first floating-in-the-air image display device and a second floating-in-the-air image display device arranged to face each other inside the table;
a video signal processing device that transmits a video signal to the first floating-in-air image display device and the second floating-in-air image display device;
a sensor forming a sensing surface in the floating-in-air image generated by the first floating-in-air image display device;
Connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and displaying the first floating-in-air image based on the received sensing signal. a controller for controlling the video signal processing device so that the floating images generated by the device and the second floating-in-air image display device are respectively desired display images;
A floating image display system.
The floating-in-air image display system according to claim 1,
The controller controls the floating-in-air image generated by the first floating-in-air image display device and the floating-in-air image generated by the second floating-in-air image display device to be different display images, A floating image display system that controls the image signal processing device.
The floating-in-air image display system according to claim 1,
the controller includes a first controller and a second controller;
The video signal processing device includes a first video signal processing device and a second video signal processing device,
The first controller and the first video signal processing device are installed inside a housing of the first floating-in-air video display device,
The second controller and the second video signal processing device are installed inside a housing of the second floating-in-air video display device,
The first video signal processing device transmits a video signal to the first floating-in-air video display device,
The second video signal processing device transmits a video signal to the second floating-in-air video display device,
The first controller is connected to the sensor, the first video signal processing device, and the second controller, and controls the first video signal processing device and the second controller based on the sensing signal. to control the
The floating-in-air image display system, wherein the second controller is connected to the second image signal processing device and controls the second image signal processing device according to control by the first controller.
a table including a top plate having optical transparency;
a first floating-in-the-air image display device and a second floating-in-the-air image display device arranged to face each other inside the table;
a video signal processing device that transmits a video signal to the first floating-in-air image display device and the second floating-in-air image display device;
a sensor forming a sensing surface in the floating-in-air image generated by the first floating-in-air image display device;
Connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and displaying the first floating-in-air image based on the received sensing signal. a controller for controlling the video signal processing device so that the floating video generated by the device and the second floating video display device becomes a desired display video,
The floating-in-air image display system, wherein the size of the first image light exit surface of the first floating-in-air image display device is larger than the size of the second image light exit surface of the second floating-in-air image display device. .
In the floating-in-air image display system according to claim 1 or claim 4,
The controller displays a plurality of screens as the floating-in-air image generated by the first floating-in-air image display device, and displays the plurality of screens as the floating-in-air image generated by the second floating-in-air image display device. A floating-in-the-air video display system for controlling the video signal processor so that one of them is displayed.
In the floating-in-air image display system according to claim 1 or claim 4,
The controller displays a plurality of pieces of information as floating-in-air images generated by the first floating-in-air image display device, and displays the plurality of pieces of information as floating-in-air images generated by the second floating-in-air image display device. A floating-in-air video display system that controls the video signal processor so that a portion of the video signal processor is displayed.
a table including a top plate having optical transparency;
a first floating-in-air image display device and a plurality of second floating-in-air image display devices arranged to face each other inside the table;
a video signal processing device that transmits a video signal to the first floating-in-air image display device and the plurality of second floating-in-air image display devices;
a sensor forming a sensing surface in the floating-in-air image generated by the first floating-in-air image display device;
Connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and displaying the first floating-in-air image based on the received sensing signal. a controller for controlling the video signal processing device so that the floating-in-air video generated by the device and the plurality of second floating-in-air video display devices becomes a desired display video;
a sliding mechanism for sliding the first floating-in-air image display device horizontally and in a direction parallel to the direction in which the plurality of second floating-in-air image display devices are arranged;
A floating image display system.
In the floating-in-air image display system according to claim 7,
A position detection device for detecting a position of a second user corresponding to the second floating-in-air image display device,
The floating-in-air image display system, wherein the controller determines a slide position of the first floating-in-air image display device based on a detection result by the position detection device, and controls the slide mechanism.
In the floating-in-air image display system according to claim 8,
The floating-in-air image display system, wherein the controller determines a sliding position of the first floating-in-air image display device to a position facing the second floating-in-air image display device corresponding to the second user.
a table including a top plate having optical transparency;
a first floating-in-air image display device and a plurality of second floating-in-air image display devices arranged to face each other inside the table;
a video signal processing device that transmits a video signal to the first floating-in-air image display device and the plurality of second floating-in-air image display devices;
a sensor forming a sensing surface in the floating-in-air image generated by the first floating-in-air image display device;
Connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and displaying the first floating-in-air image based on the received sensing signal. a controller for controlling the video signal processing device so that the floating-in-air video generated by the device and the plurality of second floating-in-air video display devices becomes a desired display video;
At least one of the plurality of second floating-in-air image display devices is slid horizontally in a direction in which the first floating-in-air image display device and the plurality of second floating-in-air image display devices face each other. A floating image display system, comprising:
The floating-in-air image display system according to claim 10,
The controller enables the floating image generated by the second floating image display device after sliding to be visually recognized in the same shape as the floating image generated by the second floating image display device before sliding. A floating-in-air image display system for controlling the image signal processing device to correct the shape of the image projected by the second floating-in-air image display device.
The floating-in-air image display system according to claim 10,
A detection device for detecting the height or eye level of a user viewing the floating image generated by the second floating image display device,
The floating-in-air image display system, wherein the controller controls the slide mechanism to adjust the slide amount of the second floating-in-air image display device based on the height detected by the detection device.
a table including a top plate having optical transparency;
a first floating-in-air image display device and a plurality of second floating-in-air image display devices arranged to face each other inside the table;
a video signal processing device that transmits a video signal to the first floating-in-air image display device and the plurality of second floating-in-air image display devices;
a sensor forming a sensing surface in the floating-in-air image generated by the first floating-in-air image display device;
Connected to the sensor and the video signal processing device, receiving from the sensor a sensing signal corresponding to a user's touch operation on the sensing surface, and displaying the first floating-in-air image based on the received sensing signal. a controller for controlling the video signal processing device so that the floating-in-air video generated by the device and the plurality of second floating-in-air video display devices becomes a desired display video;
A floating-in-air image display system, comprising: a rotation mechanism for rotating the first floating-in-air image display device in a swivel direction.
The floating-in-air video display system according to claim 13,
A position detection device for detecting the position of the second user corresponding to the second floating-in-air image display device or the position of the first user corresponding to the first floating-in-air image display device,
The floating-in-air image display system, wherein the controller determines a rotation position of the first floating-in-air image display device based on a detection result of the position detection device, and controls the rotation mechanism.
The floating-in-air image display system according to claim 14,
The controller directs the rotation position of the first floating-in-air image display device to the direction in which the second floating-in-air image display device corresponding to the second user is present or the direction in which the first user is. A floating image display system that determines the position.