JP2023046471A - Aerial image display device - Google Patents

Abstract

To provide an aerial image display device where it is easy to see which of operation buttons of an aerial image an operation body indicates.SOLUTION: An aerial image display device includes: a video display 3 displaying an operation video on a video display surface 31; an aerial imaging optical system 12 which forms an image of an operation video on an aerial image surface 81 at a plane symmetrical position with respect to a symmetrical surface 41 and displays an aerial image 8; a sensor 6 detecting the position of an operation body 10; and a controller 7 generating data of the operation video displayed on the video display 3 in accordance with an output of the sensor 6. The controller 7 defines a three-dimensional coordinate system with a surface including the aerial image surface 81 as an xy flat surface and with a direction heading for the aerial image surface 81 from the symmetrical surface 41 as a positive direction of a z axis, converts xy coordinates at an operation body position 101 into a corresponding position 32 in the video display surface on the video display surface 31, and performs emphasis processing on a video in an area of an operation button included in a button emphasis region 35 with the position 32 in the video display surface as a center.SELECTED DRAWING: Figure 1

Description

The present application relates to an aerial image display device.

An aerial image display device is known that does not require special glasses and can display an image in the air without using a screen such as fog. For example, a dihedral corner reflector array is used as an aerial imaging optical system, and an image displayed on an image display is formed in a space at a plane-symmetrical position with respect to the dihedral corner reflector array. 2. Description of the Related Art In a video display device, it is disclosed that a video displayed on a video display device is changed according to a three-dimensional relative position of a user detected by a camera (see, for example, Patent Document 1).

Further, there is disclosed a video display device that changes the expression of a pointer displayed on a video display device according to the distance from the input surface to the finger, which is the operating body (see, for example, Patent Document 2).

Japanese Patent No. 5212991 Japanese Patent No. 5933468

When the aerial image display device disclosed in Patent Document 1 is operated with an operating object such as a finger, the operation is performed on an image displayed in the air (hereinafter referred to as an aerial image), and the aerial image is displayed. Since there is no clear standard indicating the position, there is a problem that it is difficult to understand which operation button in the aerial image the operating body is pointing to.

SUMMARY OF THE INVENTION The object of the present application is to provide an aerial image display device that makes it easy to understand which operation button of the aerial image the operator is pointing to.

The aerial image display device disclosed in the present application includes an image display device that displays an operation image including operation buttons on an image display surface, and an image of the operation image formed on the aerial image surface positioned symmetrically with respect to the plane of symmetry. an aerial imaging optical system for displaying an aerial image by means of a controller, a sensor for detecting the position of an operating object, and a controller for generating operation image data to be displayed on an image display device according to the output of the sensor is a three-dimensional coordinate system defined by the x-axis, y-axis, and z-axis, which are three axes orthogonal to each other at the origin. an operating body position calculator that defines a three-dimensional coordinate system including the negative direction of the z-axis as the positive direction of the z-axis, and obtains the xyz coordinates of the operating body in the three-dimensional coordinate system from the output of the sensor as the operating body position; an in-plane position conversion unit for converting the aerial image in-plane position into an image display in-plane position corresponding to the position on the image display plane, and An emphasis area setting unit that sets a button emphasis area whose area decreases as the absolute value of the z-coordinate of the operating body position becomes smaller centering on the position in the display screen, and the area of the operation button included in the button emphasis area on the image display screen. and a button enhancement processing unit that generates operation video data obtained by performing enhancement processing on the video.

The aerial image display device disclosed in the present application includes an image display device that displays an operation image including operation buttons on an image display surface, and an image of the operation image formed on the aerial image surface positioned symmetrically with respect to the plane of symmetry. an aerial imaging optical system for displaying an aerial image by means of a controller, a sensor for detecting the position of an operating object, and a controller for generating operation image data to be displayed on an image display device according to the output of the sensor is a three-dimensional coordinate system defined by the x-axis, y-axis, and z-axis, which are three axes orthogonal to each other at the origin. an operating body position calculation unit that defines a three-dimensional coordinate system including the negative direction of the z-axis as the positive direction of the z-axis and obtains the xyz coordinates of the operating body in the three-dimensional coordinate system as the operating body position from the output of the sensor; an in-plane position conversion unit for converting the aerial image in-plane position into an image display in-plane position corresponding to the position on the image display plane, and An emphasis area setting unit that sets a button emphasis area whose area decreases as the absolute value of the z-coordinate of the operating body position becomes smaller centering on the position in the display screen, and the area of the operation button included in the button emphasis area on the image display screen. Since the button enhancement processing section for generating operation video data obtained by performing image enhancement processing is provided, it is possible to easily recognize the operation button of the aerial image pointed by the operating body.

1 is a schematic diagram of an aerial image display device according to Embodiment 1. FIG. 4 is a schematic diagram showing another example of the aerial image display device according to Embodiment 1. FIG. 2 is a diagram showing the configuration of a controller according to Embodiment 1; FIG. FIG. 4 is a diagram for explaining processing of an operating body position calculation unit and an in-plane position conversion unit according to Embodiment 1; FIG. 4 is a diagram for explaining processing of an emphasis area setting unit and a button emphasis processing unit according to Embodiment 1; FIG. 4 is a diagram for explaining processing of an emphasis area setting unit and a button emphasis processing unit according to Embodiment 1; 2 is a schematic diagram showing an example of hardware of the aerial image display device according to Embodiment 1. FIG.

Hereinafter, an aerial image display device according to an embodiment for carrying out the present application will be described in detail with reference to the drawings. In each figure, the same reference numerals denote the same or corresponding parts.

Embodiment 1.
FIG. 1 is a schematic diagram of an aerial image display device 1 according to Embodiment 1. FIG. The aerial image display device 1 includes a housing 2, an image display 3 arranged inside the housing 2, a beam splitter 4 provided at an opening of the housing 2, and a beam splitter 4 arranged inside the housing 2. a retroreflective sheet 5, a sensor 6 for detecting the position of an operating tool 10 operated by an observer 9, and a controller 7 for generating operation image data to be displayed on the image display 3 according to the output of the sensor 6. It has The image display 3 displays an operation image including operation buttons. In FIG. 1 , the operating body 10 is shown as the finger of the observer 9 . The image display device 3 is, for example, a display, and displays operation images such as still images or moving images.

Light emitted from the image display device 3 is incident on the beam splitter 4 , part of which is reflected and is incident on the retroreflective sheet 5 . The beam splitter 4 reflects part of the incident light and transmits part of the incident light. The retroreflective sheet 5 has the property of reflecting incident light in the direction of incidence. The retroreflective sheet 5 reflects the light incident from the beam splitter 4 toward the beam splitter 4 . Part of the light reflected from the retroreflective sheet 5 toward the beam splitter 4 is transmitted through the beam splitter 4 . In this way, the light emitted from the image display device 3 passes through the beam splitter 4 and forms an image outside the housing 2 to form an aerial image 8 . An observer 9 can observe this aerial image 8 . In the aerial image display device 1 shown in FIG. 1, the surface of the beam splitter 4 is the plane of symmetry 41, and the retroreflective sheet 5 and the beam splitter 4 are symmetrical with respect to the operation image displayed on the image display surface 31 of the image display 3. An aerial imaging optical system 12 is configured to form an image at a plane-symmetrical position with respect to the surface 41 and display the aerial image 8 on the aerial image plane 81 .

In the aerial image display device 1, an operation screen on which operation buttons are arranged is displayed in the aerial image 8, and when the observer 9 puts his or her finger, which is the operating body 10, on the operation button shown in the aerial image 8, perform an operation.

FIG. 2 is a schematic diagram showing another example of the aerial image display device according to the first embodiment. Comparing the aerial image display device 1a shown in FIG. 2 with the aerial image display device 1 shown in FIG. there is Other configurations of the aerial image display device 1 a are the same as those of the aerial image display device 1 .

The plane-symmetrical imaging optical element 11 is an aerial imaging optical system 12 that forms an image of the operation image displayed on the image display device 3 at a plane-symmetrical position with respect to the plane of symmetry 111 to display the aerial image 8. Light incident on the plane-symmetric imaging optical element 11 from the image display device 3 is retroreflected in the plane of the plane of symmetry 111 and is transmitted in the normal direction of the plane of symmetry 111 . The plane-symmetrical imaging optical element 11 is, for example, a combination of two mirror surfaces perpendicular to each other, and is called a dihedral corner reflector array or a dihedral orthogonal reflector.

In the aerial image display device according to Embodiment 1, the aerial imaging optical system 12 forms the operation image displayed on the image display device 3 at a position symmetrical with respect to the plane of symmetry to display the aerial image 8. Anything will do as long as it makes it possible. The operation of the aerial image display apparatus 1 shown in FIG. 1 using the retroreflective sheet 5 and the beam splitter 4 as the aerial imaging optical system 12 will be described below.

The sensor 6 detects the position of the operating tool 10, and is, for example, a three-dimensional distance sensor that detects the position of an object within a spatial domain. A three-dimensional distance sensor is, for example, a ToF sensor (Time of Flight Sensor). From the distance data detected by the ToF sensor, the distance to the object within the range visible from the sensor 6 is known, and the shape of the object is known. Sensor 6 may be, for example, a stereo camera. By using a stereo camera, it is possible to detect the operating body 10 by image recognition and detect the position of the operating body 10 . If the operating body 10 is a finger, the sensor 6 may be, for example, a combination of a normal camera and an infrared distance sensor. The finger may be detected by image recognition from image information obtained by a normal camera, the distance from the sensor 6 to the finger may be measured by an infrared distance sensor, and the position of the finger may be finally determined.

Next, operation of the controller 7 will be described. FIG. 3 shows a configuration of controller 7 according to the first embodiment. The controller 7 includes an operating body position calculation unit 71 , an in-plane position conversion unit 72 , an emphasis area setting unit 73 and a button emphasis processing unit 74 .

FIG. 4 is a diagram for explaining the processing of the operating body position calculator 71 and the in-plane position converter 72 according to the first embodiment. The diagram on the left in FIG. 4 shows a three-dimensional coordinate system defined by the x-axis, y-axis, and z-axis, which are three axes orthogonal to each other at the origin. A three-dimensional coordinate system including the negative direction of the z-axis is defined with the direction from the plane of symmetry 41 shown in FIG. 1 toward the aerial image plane 81 being the positive direction of the z-axis. As shown in FIG. 1, the y-axis is, for example, the vertical direction when the aerial image 8 is viewed by the observer 9, and the upward direction as viewed by the observer 9 is the positive direction. The x-axis is, for example, the horizontal direction when the aerial image 8 is viewed by the observer 9, and the right direction as viewed by the observer is the positive direction. The z-axis is an axis perpendicular to the xy plane, and the direction from the plane of symmetry 41 to the aerial image plane 81, that is, the direction from the aerial image 8 to the observer 9 is the positive direction. The origin of the three-dimensional coordinate system may be anywhere as long as it is on the plane including the aerial image plane 81 .

The operating body position calculation unit 71 obtains the position of the operating body 10 with respect to the aerial image plane 81 from the output of the sensor 6, that is, the xyz coordinates of the operating body 10 in the three-dimensional coordinate system as the operating body position 101, and calculates the in-plane position. Output to the conversion unit 72 . In the left diagram of FIG. 4, the position of the operating tool 10 closest to the aerial image plane 81 is the operating tool position 101, and the xyz coordinates of the operating tool position 101 are (x0, y0, z0). The operating body position 101 may indicate the position of the operating body 10, and if the operating body 10 is a finger, the position of the fingertip may be detected and used as the operating body position 101. FIG. The operation body 10 may be anything that operates the aerial image display device 1, and may be, for example, a pen. When the operating body 10 is a pen, for example, the position of the tip of the pen may be detected as the operating body position 101 .

The in-plane position conversion unit 72 converts the xy coordinates of the operating body position 101 into an aerial image in-plane position 82 , and converts the aerial image in-plane position 82 into an image display in-plane position 32 which is the corresponding position on the image display plane 31 . Convert. First, the in-plane position conversion unit 72 sets the position at which the vertical line drawn from the operating body position 101 to the aerial image plane 81 intersects the aerial image plane 81, that is, the xy coordinates of the operating body position 101 as the aerial image in-plane position 82. demand. In the left diagram of FIG. 4, since the xyz coordinates of the operating body position 101 are (x0, y0, z0), the aerial image plane position 82 is (x0, y0).

Next, the in-plane position conversion unit 72 converts the aerial image in-plane position 82 to the image display in-plane position 32 that is the corresponding position on the image display plane 31 . The right diagram of FIG. 4 is for explaining the position on the image display surface 31. For example, the Y axis is the vertical direction of the image display surface 31, and the X axis is the horizontal direction of the image display surface 31. is. The in-plane position conversion unit 72 converts the aerial image in-plane position 82 at (x0, y0) in the left diagram of FIG. Y0) is converted to the position 32 in the image display plane. As shown in FIG. 1, when only the aerial imaging optical system 12 exists in the optical path from the image display 3 to the aerial image 8, X0=x0 and Y0=y0. 8, if there is an optical process other than the aerial imaging optical system 12 in the optical path up to 8, (x0, y0) is changed to (X0 , Y0). For example, if the optical path from the image display device 3 to the aerial image 8 is subjected to enlargement processing, when (x0, y0) is converted to (X0, Y0), reduction processing according to the enlargement ratio of the enlargement processing is performed. I do.

The emphasis area setting unit 73 uses the information on the operating tool position 101 output from the operating tool position calculating unit 71 and the information on the in-screen position 32 output from the in-plane position converting unit 72 to set the image display surface 31 , the button emphasis area 35 is set so that the smaller the absolute value of the z-coordinate of the operating tool position 101 is, the smaller the area of the button emphasis area 35 is, centering on the image display in-plane position 32 , and the information of the button emphasis area 35 is output to the button emphasis processing unit 74 . . FIG. 5 is a diagram for explaining the processing of the emphasis area setting section 73 and the button emphasis processing section 74. As shown in FIG. FIG. 5 corresponds to the diagram on the right side of FIG. 4, and shows the operation image 33 on the image display screen 31 in the XY coordinate system. In the example of FIG. 5, the operation image 33 includes four operation buttons 34 indicated by numbers. Emphasis area setting unit 73 sets button emphasis area 35 on image display screen 31 . At this time, the center of the button emphasis area 35 is the position 32 in the image display plane, and the area of the button emphasis area 35 is made smaller as the absolute value of the z-coordinate of the operating body position 101 is smaller. In the example shown in FIG. 5, the shape of the button emphasis area 35 is a circle, and the radius of the circle of the button emphasis area 35 decreases as the absolute value of the z-coordinate of the operating body position 101 decreases. The button enhancement area 35 may have any shape, and for example, the geometric center of the button enhancement area 35 may be the center of the button enhancement area 35 .

The button emphasis processing unit 74 emphasizes the image of the operation button 34 area included in the button emphasis area 35 on the image display screen 31 using the information of the button emphasis area 35 output from the emphasis area setting unit 73. It generates operation image data and outputs the operation image data to the image display device 3 . As shown in FIG. 5, the button enhancement processing unit 74 performs enhancement processing of the image of the operation button 34 in each of the four operation button 34 areas included in the button enhancement area 35 on the image display screen 31 . When the entire operation button 34 is included in the button highlighting area, the image of the entire operation button 34 is emphasized. In the example shown in FIG. 5, in the area of the operation button 34 included in the button emphasis area 35, processing is performed to increase the dot density and thicken the outline. Data of an operation image including the operation button 34 subjected to the enhancement process as shown in FIG. In the example shown in FIG. 5, a point indicating the position of the image display screen position 32 and a line indicating the outer periphery of the button emphasis area 35 are superimposed on the operation image. may not be superimposed on A point indicating the position 32 in the image display plane and a line indicating the outer periphery of the button emphasis region 35 are superimposed on the operation image, so that the observer 9 can more clearly recognize the location pointed by the operating body 10. can be done.

FIG. 6 is a diagram for explaining the processing of the emphasis area setting section 73 and the button emphasis processing section 74. As shown in FIG. 6, from left to right, the operating body position 101 of the operating body 10 approaches the aerial image plane 81 of the aerial image 8, and finally the operating body position 101 passes through the aerial image plane 81. showing the situation. The upper five diagrams in FIG. 6 show the state of the three-dimensional coordinate system shown in the left side of FIG. The x-axis is omitted due to overlap. 6 show operation images displayed on the image display screen 31 in the XY coordinate system shown on the right side of FIG. there is Also, for example, when the z-coordinate of the operating body position 101 is z1 in the upper left diagram, it indicates that the button emphasis area 35a is set on the image display screen 31 as shown in the lower left diagram.

The emphasis area setting unit 73 sets a button emphasis area having a smaller area as the absolute value of the z-coordinate of the operating body position 101 is smaller. In the example shown in FIG. 6, comparing the button enhancement region 35a when the z-coordinate of the operating body position 101 is z1 and the button enhancement region 35b when the z-coordinate of the operating body position 101 is z2, the absolute value of z2 is is smaller than the absolute value of z1, the area of the button emphasis area 35b is smaller than the area of the button emphasis area 35a. Further, the button emphasis processing unit 74 performs the emphasis process on the image of the region of the operation button 34 included in the button emphasis region. In the example shown in FIG. 6, the dot density of the area of the operation button 34 included in the button emphasis area is set higher than that of the other areas, and the contour of the area of the operation button 34 included in the button emphasis area is set to be higher than that of the other areas. thicker than Furthermore, in the example shown in FIG. 6, the smaller the absolute value of the z-coordinate of the operating body position 101, the higher the density of dots in the area of the operation button 34 included in the button emphasis area. Furthermore, in the third example from the left in FIG. 6 in which the z-coordinate of the operating body position 101 is zero, the area of the button enhancement region 35c is the same as the area of the button enhancement regions 35a and 35b. It is even smaller in comparison. In this way, by setting a button emphasis region having a smaller area as the absolute value of the z-coordinate of the operating body position 101 becomes smaller, the observer 9 can perceive that the finger, which is the operating body 10, is approaching the aerial image plane 81. can recognize. In addition, by setting a button emphasis region having a smaller area as the absolute value of the z-coordinate of the operating body position 101 becomes smaller, the observer 9 can see the pointing position when the finger as the operating body 10 is farther from the aerial image plane 81 . , and when the finger, which is the operating body 10, approaches from the aerial image plane 81, the location pointed by the finger, which is the operating body 10, can be known more accurately.

In FIG. 6, the density of dots in the area of the operation button 34 included in the button emphasis area is set higher than that of other areas, and the outline of the area of the operation button 34 included in the button emphasis area is set thicker than the other areas. However, the image enhancement processing of the region of the operation button 34 included in the button enhancement region is not limited to this. Processing to reduce transparency, processing to increase contrast with the background, processing to increase the size of operation buttons, processing to add outlines to operation buttons, processing to thicken outlines of operation buttons, darken outline colors of operation buttons At least one of processing, processing for changing hue, and processing for increasing dot density may be included. The process of increasing the contrast with the background is, for example, the process of increasing the difference in color from the background or the process of increasing the difference in luminance from the background, so that the presence of the operation button can be more strongly recognized.

Further, in the example shown in the fourth from the left in FIG. 6 where the z-coordinate of the operating body position 101 is zero, by thickening the frame of the entire operation button including the image display in-plane position 32, The entire image of the operation button including the position 32 within the image display plane is emphasized. In this way, when the z-coordinate of the operating body position 101 is zero, the image of the entire area of the operating button including the image display in-plane position 32 is emphasized, so that the observer 9 can move the operating body 10 It can be seen that a certain finger is on the plane of the aerial image plane 81 . Alternatively, when the absolute value of the z-coordinate of the operating body position 101 is smaller than a predetermined threshold value, the image of the entire area of the operation button including the image display in-plane position 32 may be emphasized. good.

In the example shown on the rightmost side of FIG. The z-coordinate of position 101 is z3, which is a negative value. At this time, the button emphasis region 35d has a smaller area as the absolute value of the z coordinate of the operating body position 101 becomes smaller, for example, similarly to when the z coordinate of the operating body position 101 has a positive value. You can set it. As a result, when the operating body position 101 passes through the aerial image plane 81 and moves away from the aerial image plane 81, the observer 9 can recognize that the finger, which is the operating body 10, has moved away from the aerial image plane 81. can. Further, as shown from left to right in FIG. 5, when the operating body position 101 of the operating body 10 approaches and passes through the aerial image plane 81, the button emphasis area gradually becomes smaller and then becomes larger again. Therefore, the observer 9 can recognize that the operating body position 101 has passed through the aerial image plane 81 .

Furthermore, the emphasis region setting unit 73 may perform different emphasis processing when the z-coordinate of the operating body position 101 has a positive value and emphasis processing when the z-coordinate of the operating body position 101 has a negative value. For example, when the z-coordinate of the operating body position 101 is a negative value, compared to when the z-coordinate of the operating body position 101 is a negative value, the image of the region of the operation button included in the button emphasis region You can change the hue. The emphasis processing when the z-coordinate of the operating body position 101 has a positive value is different from the emphasis processing when the z-coordinate of the operating body position 101 has a negative value. Passing through the surface 81 can be strongly recognized.

The operation image data generated by the button emphasis processing unit 74 is output to the image display device 3, and the operation image is displayed on the image display screen 31 of the image display device 3 as shown in the lower row of FIG. can be observed as an aerial image 8.

As described above, the aerial image display device 1 according to Embodiment 1 includes the image display device 3 that displays the operation image including the operation button 34 on the image display surface 31 and the operation image that is symmetrical with respect to the plane of symmetry 41 . an aerial image forming optical system 12 for forming an image on an aerial image plane 81 at a position to display an aerial image 8; a sensor 6 for detecting the position of the operating body 10; and a controller 7 for generating data of an operation image to be displayed. The controller 7 defines a three-dimensional coordinate system defined by x-axis, y-axis, and z-axis, which are three axes orthogonal to each other at the origin, to the aerial image. A three-dimensional coordinate system including the negative direction of the z-axis is defined by defining a plane including the surface 81 as the xy plane and the direction from the plane of symmetry 41 to the aerial image plane 81 as the positive direction of the z-axis. An operating body position calculation unit 71 that obtains the xyz coordinates of the operating body 10 in the coordinate system as the operating body position 101, the xy coordinates of the operating body position 101 as the aerial image plane position 82, and the aerial image plane position 82 as the image display plane. and an in-plane position conversion unit 72 that converts the image display in-plane position 32 to a corresponding position on the image display plane 31. On the image display plane 31, the absolute z coordinate of the operating body position 101 centered on the image display in-plane position 32 is determined. The emphasis area setting unit 73 sets the button emphasis area 35 having a smaller area as the value is smaller, and the data of the operation image obtained by emphasizing the image of the operation button 34 area included in the button emphasis area 35 on the image display screen 31. Since the generated button emphasis processing unit 74 is provided, the operation button of the aerial image 8 pointed by the operating body 10 can be easily recognized.

FIG. 7 is a schematic diagram showing an example of hardware of the aerial image display device according to the first embodiment. The controller 7 is implemented by a processor 201 such as a CPU (Central Processing Unit) that executes programs stored in a memory 202 . The memory 202 is also used as a temporary storage device for each process executed by the processor 201 . Also, a plurality of processing circuits may work together to perform the functions described above. Furthermore, the above functions may be realized by dedicated hardware. Where dedicated hardware implements the above functions, the dedicated hardware may be, for example, a single circuit, multiple circuits, a programmed processor, an ASIC, an FPGA, or a combination thereof. The above functions may be realized by a combination of dedicated hardware and software, or a combination of dedicated hardware and firmware. The memory 202 is, for example, RAM, ROM, flash memory, non-volatile or volatile semiconductor memory such as EPROM, magnetic disk, optical disk, or a combination thereof. The processor 201, memory 202, sensor 6 and image display 3 are bus-connected to each other. The aerial imaging optical system 12 constitutes a part of an aerial image display device.

Although the present application describes exemplary embodiments, the various features, aspects, and functions described in the embodiments are not limited to application of particular embodiments, alone or Various combinations are applicable to the embodiments.
Therefore, countless modifications not illustrated are envisioned within the scope of the technology disclosed in the present application. For example, the modification, addition, or omission of at least one component shall be included.

Reference Signs List 1, 1a aerial image display device, 2 housing, 3 image display, 4 beam splitter, 5 retroreflective sheet, 6 sensor, 7 controller, 8 aerial image, 9 observer, 10 operating body, 11 plane symmetric imaging Optical element 12 Aerial imaging optical system 31 Image display surface 32 Position within image display surface 33 Operation image 34 Operation button 35, 35a, 35b, 35c, 35d Button emphasis area 41 Symmetry plane 71 Operation object Position calculation unit 72 In-plane position conversion unit 73 Emphasis region setting unit 74 Button enhancement processing unit 81 Aerial image plane 82 Position in aerial image plane 101 Operating body position 111 Symmetry plane 201 Processor 202 Memory.

Claims (3)

a video display that displays an operation video including operation buttons on a video display screen;
an aerial imaging optical system that forms an image of the operation image on an aerial image plane that is symmetrical with respect to the plane of symmetry to display the aerial image;
a sensor that detects the position of the operating body;
a controller that generates data of the operation image to be displayed on the image display according to the output of the sensor;
The controller is
A three-dimensional coordinate system defined by x-axis, y-axis, and z-axis, which are three axes orthogonal to each other at the origin, is defined by a plane including the aerial image plane as an xy plane, and a direction from the symmetry plane toward the aerial image plane. is defined as the positive direction of the z-axis and includes the negative direction of the z-axis, and the xyz coordinates of the operating body in the three-dimensional coordinate system are obtained as the operating body position from the output of the sensor. Department and
an in-plane position conversion unit that sets the xy coordinates of the operating body position to a position within the aerial image plane and converts the aerial position within the image plane to a position within the image display plane that is the corresponding position on the image display plane;
an emphasis area setting unit that sets a button emphasis area on the image display plane centered at a position within the image display plane and having a smaller area as the absolute value of the z-coordinate of the operating body position becomes smaller;
An aerial image display device, further comprising a button enhancement processing unit that generates data of the operation image by performing enhancement processing on the image of the operation button area included in the button enhancement area on the image display screen. The enhancement processing includes processing to increase brightness, processing to increase brightness, processing to increase saturation, processing to decrease transmittance with respect to the background, processing to increase contrast with the background, processing to increase the size of the operation button, and the operation. The processing is characterized by at least one of a process of adding a contour to a button, a process of thickening the contour of the operation button, a process of darkening the color of the contour of the operation button, a process of changing hue, and a process of increasing dot density. 2. The aerial image display device according to claim 1. The button emphasis processing unit is characterized in that the emphasis processing when the z-coordinate of the operating body position is a positive value and the emphasis processing when the z-coordinate of the operating body position is a negative value are different. 3. The aerial image display device according to claim 1 or 2.

Images