JP2023001955A - Aerial video display device - Google Patents

Abstract

To provide an aerial video display device that allows a user to easily grasp a sense of distance between the position of an aerial video and the position of the user's finger.SOLUTION: An aerial video display device comprises: a housing 2; a video display unit 3 that is arranged inside the housing; a beam splitter 4 that is installed in an opening of the housing and reflects a video displayed on the video display unit; a retroreflection sheet 5 that is installed inside the housing and retroreflects the video reflected by the beam splitter; a sensor 7 that detects the position of the finger 10a of a user 10 in a space area including an aerial video 6 that is the video retroreflected by the retroreflection sheet and formed outside the housing; and a speaker 9 that outputs a sound changing according to a distance between the position of the finger detected by the sensor and the position of the aerial video.SELECTED DRAWING: Figure 1

Description

The present application relates to an aerial image display device.

An aerial image display device is known that does not require special glasses and can display an image in the air without using a screen such as fog. For example, there has been disclosed an aerial image display device that uses a beam splitter and a retroreflective sheet to display an image by forming an image displayed on an image display unit in a space at a plane-symmetrical position with respect to the beam splitter. (See Patent Document 1, for example).

JP 2009-25776 A

There is a method of using an aerial image display device as an aerial touch panel in which a touch panel is displayed as an image displayed in the air (hereinafter referred to as an aerial image) and a user operates the touch panel with a finger. Since the aerial image is floating in the air, there is no object around it that serves as an indicator of the sense of distance. Therefore, there is a problem that it becomes difficult for the user to grasp the sense of distance between the position of the aerial image and the position of his or her finger.

SUMMARY OF THE INVENTION The present application has been made to solve the above-described problems, and an object thereof is to provide an aerial image display device that makes it easy to grasp the sense of distance between the position of the aerial image and the position of the user's finger.

The aerial image display device of the present application includes a housing, an image display unit arranged inside the housing, a beam splitter installed in an opening of the housing for reflecting an image displayed on the image display unit, and a housing. A space area that includes a retroreflective sheet that is installed inside the body and retroreflects the image reflected by the beam splitter, and an aerial image that is formed outside the housing by retroreflecting the image retroreflected by the retroreflective sheet. A sensor for detecting the position of the user's finger, and a speaker for outputting a sound that changes according to the separation distance between the position of the finger detected by the sensor and the position of the aerial image.

The aerial image display device of the present application includes a speaker that outputs a sound that changes according to the distance between the position of the finger detected by the sensor and the position of the aerial image. It becomes easy to grasp the sense of distance from the position of .

1 is a schematic diagram of an aerial image display device according to Embodiments 1 to 3; FIG.

Hereinafter, an aerial image display device according to an embodiment for carrying out the present application will be described in detail with reference to the drawings.

Embodiment 1.
FIG. 1 is a schematic diagram of an aerial image display device according to Embodiment 1. FIG. The aerial image display device 1 of the present embodiment includes a housing 2, an image display unit 3 arranged inside the housing 2, a beam splitter 4 provided at an opening of the housing 2, and a retroreflective sheet 5 disposed inside. The light emitted from the image display unit 3 enters the beam splitter 4 , is partially reflected, and enters the retroreflective sheet 5 . The retroreflective sheet 5 has the property of reflecting incident light in the direction of incidence. The retroreflective sheet 5 reflects the light incident from the beam splitter 4 toward the beam splitter 4 . Part of the light reflected from the retroreflective sheet 5 toward the beam splitter 4 is transmitted through the beam splitter 4 . The image displayed on the image display unit 3 in this way passes through the beam splitter 4 and is imaged outside the housing 2 to become an aerial image 6 . A user 10 can observe this aerial image 6 . For example, a touch panel for operating various devices is displayed as the aerial image 6 . The user 10 can perform a touch operation on the touch panel by bringing the finger 10 a close to the touch panel displayed as the aerial image 6 . The position of the finger 10a can be measured by a three-dimensional distance sensor 7 provided on the housing 2 and detecting the position of an object within the spatial region containing the aerial image 6. FIG. As the image display unit 3, a liquid crystal display, an organic EL display, a display in which LED elements are arranged, or the like can be used. A half mirror, a reflective polarizing plate, or the like can be used as the beam splitter 4 . As the retroreflective sheet 5, a glass bead type sheet in which spherical transparent glass beads are arranged, a microprism type sheet in which transparent triangular pyramids are arranged, or the like can be used. As the three-dimensional distance sensor 7, for example, a ToF sensor (Time of Flight Sensor), a stereo camera, or the like can be used.

The user 10 can bring the finger 10a close to the touch panel displayed as the aerial image 6 to perform a touch operation. The distance between the position of the finger 10 a and the aerial image 6 can be measured by a three-dimensional distance sensor 7 provided on the housing 2 . Since this touch operation is non-contact, it is possible to prevent contamination of fingertips due to contact, diffusion of harmful substances through the touch panel, and the like.

However, since the aerial image is floating in the air, there is no object around it that serves as an index of the sense of distance. Therefore, there is a problem that it becomes difficult for the user to grasp the sense of distance between the position of the aerial image and the position of his or her finger.

The aerial image display device 1 of the present embodiment makes it easy to grasp the sense of distance between the position of the aerial image and the position of the user's finger. Therefore, the aerial image display device 1 of the present embodiment includes a control unit 8 that calculates the separation distance between the position of the user's finger 10a detected by the three-dimensional distance sensor 7 and the position of the aerial image 6, and a speaker 9 connected to the portion 8 . The control unit 8 calculates the separation distance between the position of the finger 10a of the user 10 and the position of the aerial image 6, and causes the speaker 9 to output a sound whose frequency continuously changes according to the separation distance. For example, when the finger 10a of the user 10 approaches the aerial image 6 and the separation distance becomes smaller than a predetermined threshold value, the control unit 8 starts outputting low frequency sound from the speaker 9, and the separation distance becomes small. As the frequency increases, the frequency is gradually increased to change the sound output from the speaker to a higher tone.

In the aerial image display device configured in this way, the user can recognize the separation distance between the position of the aerial image and the position of his/her finger by the change in the frequency of the sound output from the speaker. Therefore, in the aerial image display device of the present embodiment, the user can easily grasp the sense of distance between the position of the aerial image and the position of his or her finger.

The control unit 8 may discontinuously change the frequency of the sound output from the speaker 9 when the position of the finger and the position of the aerial image match. As another method, the control unit 8 may stop the sound output from the speaker 9 when the position of the finger matches the position of the aerial image. By controlling in this way, the user can recognize that his/her finger has reached the position of the aerial image. Note that when the position of the finger and the position of the aerial image match, it is not limited to when the distance between the position of the finger and the position of the aerial image is completely zero. Small cases are also included. When the user's finger passes through the aerial image, the frequency of the sound output from the speaker 9 decreases, so the user can also recognize that his or her finger has passed the aerial image.

In the present embodiment, the control unit 8 gradually increases the frequency as the separation distance becomes smaller and changes the sound output from the speaker to a higher tone. may be lowered to change the sound output from the speaker to a low tone.

Embodiment 2.
In the aerial image display device of Embodiment 1, the control unit calculates the separation distance between the position of the user's finger and the position of the aerial image, and outputs a sound whose frequency continuously changes according to the separation distance from the speaker. I am outputting. In the aerial image display device according to the second embodiment, the control unit calculates the separation distance between the position of the user's finger and the position of the aerial image, and outputs a sound whose volume continuously changes according to the separation distance from the speaker. output from The configuration of the aerial image display device according to the present embodiment is the same as that of the aerial image display device according to the first embodiment shown in FIG.

For example, when the finger 10a of the user 10 approaches the aerial image 6 and the separation distance becomes smaller than a predetermined threshold value, the control unit 8 starts outputting a low-volume sound from the speaker 9. Therefore, the volume of the sound output from the speaker is increased.

In the aerial image display device configured in this manner, the user can recognize the separation distance between the position of the aerial image and the position of the user's finger by the change in volume of the sound output from the speaker. Therefore, in the aerial image display device of the present embodiment, the user can easily grasp the sense of distance between the position of the aerial image and the position of his or her finger.

The control unit 8 may discontinuously change the volume of the sound output from the speaker 9 when the position of the finger and the position of the aerial image match. As another method, the control unit 8 may stop the sound output from the speaker 9 when the position of the finger matches the position of the aerial image. By controlling in this way, the user can recognize that his/her finger has reached the position of the aerial image. Note that when the position of the finger and the position of the aerial image match, it is not limited to when the distance between the position of the finger and the position of the aerial image is completely zero. Small cases are also included. When the user's finger passes through the aerial image, the volume of the sound output from the speaker 9 decreases, so the user can also recognize that his or her finger has passed the aerial image.

In this embodiment, the control unit 8 gradually increases the volume of the sound output from the speaker as the separation distance becomes smaller. can be gradually decreased.

Embodiment 3.
In the aerial image display device of Embodiment 1, the control unit calculates the separation distance between the position of the user's finger and the position of the aerial image, and outputs a sound whose frequency continuously changes according to the separation distance from the speaker. I am outputting. Further, in the aerial image display device of Embodiment 2, the control unit calculates the separation distance between the position of the user's finger and the position of the aerial image, and produces a sound whose volume continuously changes according to the separation distance. Output from speaker. In the aerial image display device of Embodiment 3, the control unit calculates the separation distance between the position of the user's finger and the position of the aerial image, and intermittent sounds continuously change according to the separation distance. is output from the speaker. The configuration of the aerial image display device according to the present embodiment is the same as that of the aerial image display device according to the first embodiment shown in FIG.

For example, when the finger 10a of the user 10 approaches the aerial image 6 and the separation distance becomes smaller than a predetermined threshold value, the control unit 8 starts intermittent sound output from the speaker 9 . At this time, the sound output from the speaker 9 is a sound of a fixed length generated with a stop period intervening, and the control unit 8 gradually shortens the stop period as the separation distance becomes smaller.

In the aerial image display device configured in this manner, the user can recognize the separation distance between the position of the aerial image and the position of his/her finger by the change in the stop period of the sound output from the speaker. Therefore, in the aerial image display device of the present embodiment, the user can easily grasp the sense of distance between the position of the aerial image and the position of his or her finger.

In this embodiment, as the sound output from the speaker 9, a sound of a certain length is generated with a stop period intervening, and the stop period gradually shortens as the separation distance becomes smaller. ing. Alternatively, the stop period may be fixed, and the length of the sound generation period may be gradually shortened as the separation distance becomes smaller. Furthermore, as another method, the period at which intermittent sound generation is started may be constant, and the period during which the sound is generated may be gradually changed within that period as the separation distance becomes smaller. That is, in the aerial image display device of the present embodiment, at least one of the intermittent sound stop period and the intermittent sound generation period continuously changes according to the separation distance between the position of the user's finger and the position of the aerial image. is configured to

The control unit 8 may discontinuously change at least one of the stop period and the generation period of the sound output from the speaker 9 when the position of the finger and the position of the aerial image match. As another method, the control unit 8 may change at least one of the frequency and volume of the sound output from the speaker 9 when the position of the finger and the position of the aerial image match. As another method, the control unit 8 may stop the sound output from the speaker 9 when the position of the finger matches the position of the aerial image. By controlling in this way, the user can recognize that his/her finger has reached the position of the aerial image. Note that when the position of the finger and the position of the aerial image match, it is not limited to when the distance between the position of the finger and the position of the aerial image is completely zero. Small cases are also included. When the user's finger passes through the aerial image, the period during which the sound output from the speaker 9 is stopped or generated becomes longer. recognizable.

Note that the position of the finger 10a is measured by the three-dimensional distance sensor 7 in the first to third embodiments. The aerial image display devices of Embodiments 1 to 3 may include a recognition unit for calculating the position of the fingertip that is the position to touch the touch panel from the position of the finger 10a measured by the three-dimensional distance sensor 7. . Further, in Embodiments 1 to 3, it is assumed that a display image is switched according to a touch operation when using an aerial image as a touch panel. The aerial image display devices of Embodiments 1 to 3 may include a display processing unit for switching the display image of the image display unit based on the position of the fingertip calculated by the recognition unit.

Further, in the first to third embodiments, the aerial image display device using a beam splitter and a retroreflective sheet has been described. Other types of aerial image display devices include a type using an optical plate called a dihedral corner reflector array and a type using an optical plate called an orthogonal mirror array. In these types of aerial image display devices, the retroreflective sheet is removed from the aerial image display device shown in FIG. 1, and an optical plate is arranged at the position of the beam splitter. Such an aerial image display device can display an aerial image by forming an image displayed on the image display unit in a space at a plane-symmetrical position with respect to the optical plate. Even in such an aerial image display device, there is a problem that it is difficult for the user to grasp the sense of distance between the position of the aerial image and the position of his or her finger. Also in the aerial image display device of such a method, by providing a speaker that outputs a sound that changes according to the separation distance between the position of the user's finger and the position of the aerial image, the user can easily hear the position of the aerial image. It becomes easy to grasp the sense of distance from the position of one's own finger.

While this application describes various exemplary embodiments and examples, various features, aspects, and functions described in one or more embodiments may not apply to particular embodiments. can be applied to the embodiments singly or in various combinations.
Therefore, numerous variations not illustrated are envisioned within the scope of the technology disclosed herein. For example, modification, addition or omission of at least one component, extraction of at least one component, and combination with components of other embodiments shall be included.

1 aerial image display device, 2 housing, 3 image display unit, 4 beam splitter, 5 retroreflective sheet, 6 aerial image, 7 three-dimensional distance sensor, 8 control unit, 9 speaker, 10 user, 10a finger.

Claims (9)

a housing;
a video display unit arranged inside the housing;
a beam splitter that is installed in the opening of the housing and reflects the image displayed on the image display unit;
a retroreflective sheet installed inside the housing for retroreflecting the image reflected by the beam splitter;
a sensor for detecting the position of a user's finger in a space area containing an aerial image formed by imaging the image retroreflected by the retroreflective sheet outside the housing;
An aerial image display device comprising a speaker that outputs a sound that changes according to a distance between the position of the finger detected by the sensor and the position of the aerial image. 2. The aerial image display device according to claim 1, wherein the frequency of the sound output from the speaker continuously changes according to the separation distance. 3. The aerial image display device according to claim 2, wherein the frequency of the sound output from the speaker changes discontinuously when the position of the finger coincides with the position of the aerial image. 2. The aerial image display device according to claim 1, wherein the volume of the sound output from the speaker continuously changes according to the separation distance. 5. The aerial image display device according to claim 4, wherein the volume of the sound output from the speaker changes discontinuously when the position of the finger coincides with the position of the aerial image. 2. The sound output from the speaker is an intermittent sound, and at least one of the stop period and the generation period of the intermittent sound continuously changes according to the separation distance. The aerial image display device according to 1. 7. The sound output from the speaker changes discontinuously in at least one of the stop period and the generation period when the position of the finger and the position of the aerial image match. An aerial image display device as described. 7. The aerial image display device according to claim 6, wherein at least one of frequency and volume of the sound output from the speaker changes when the position of the finger and the position of the aerial image match. 7. The aerial image display according to any one of claims 2, 4 and 6, wherein the sound output from the speaker stops when the position of the finger and the position of the aerial image match. Device.

Images