JPWO2021001894A1 - Display control device and display control method - Google Patents

Abstract

It is an object of the present invention to provide a technique capable of displaying to a user the range in which an indicator is located. The display control device is an acquisition unit that acquires the range in which the indicator is located among the detection range, the front detection range, and the back detection range, and the acquisition unit among the detection range, the front detection range, and the back detection range. Based on the acquired range, the detection range display object indicating the detection range and the control unit for controlling the display of the display object including the indicator display object indicating the indicator are provided.

Description

The present invention relates to a display control device that controls the display of a first display device that can be moved together with a vehicle, and a display control method.

When the driver operates an in-vehicle information system such as a navigation device or an audio device, it is preferable that the driver's line of sight is maintained in front of the vehicle as much as possible. Therefore, even if an indicator such as a hand or a finger is not touched by the operation input device, when the driver performs a gesture operation in the space in front of the vehicle, the gesture operation is detected and based on the gesture operation. A technique for controlling an in-vehicle information system has been proposed.

In such a technique, the driver needs to perform the gesture operation within the detection range, which is a predetermined space in which the gesture operation should be performed. Therefore, a technique has been proposed for displaying the detection range and the range on the upper, lower, left, and right sides of the detection range for the gesture operation (for example, Patent Document 1 and Patent Document 2). ..

Japanese Unexamined Patent Publication No. 2010-0814666 Japanese Unexamined Patent Publication No. 2009-31981

However, in the techniques of Patent Document 1 and Patent Document 2, the indicator of the driver performing the gesture operation is the detection range, the range on the driver side with respect to the detection range, and the opposite side to the driver with respect to the detection range. The same display is performed regardless of the range of the range of. For this reason, the driver does not know in which direction the indicator should be moved with respect to the detection range, and as a result, the in-vehicle information system is appropriately operated by the gesture operation as a result of performing the gesture operation in the range other than the detection range. Sometimes I couldn't.

Therefore, the present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide a technique capable of displaying to the user the range in which the indicator is located.

The display control device according to the present invention is a display control device that controls the display of the first display device that can be moved together with the vehicle, and has a detection range that is a predetermined space in which the user should perform a gesture operation by an indicator body. Of the front detection range, which is a predetermined space on the user side with respect to the detection range, and the back detection range, which is a predetermined space on the opposite side of the front detection range with respect to the detection range, the indicator is A detection range display object indicating a detection range and an indicator based on the range acquired by the acquisition unit among the acquisition unit for acquiring the position range, the detection range, the front detection range, and the back detection range. It is provided with a control unit that controls the display of display objects including the indicator display object to be different.

According to the present invention, the detection range display object indicating the detection range and the indicator display object indicating the indicator are included based on the acquired range among the detection range, the front detection range, and the back detection range. Controls the display of display objects to be different. According to such a configuration, it is possible to display to the user in what range the indicator is located.

The objects, features, embodiments and advantages of the present invention will be made clearer by the following detailed description and accompanying drawings.

It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 1. FIG. It is a figure which shows the detection range, the front detection range, and the back detection range which concerns on Embodiment 1. FIG. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 2. FIG. It is a figure which shows the display control of the display control apparatus which concerns on Embodiment 2. FIG. It is a figure which shows the display control of the display control apparatus which concerns on Embodiment 2. FIG. It is a figure which shows the display control of the display control apparatus which concerns on Embodiment 2. FIG. It is a figure which shows the display control of the display control apparatus which concerns on Embodiment 2. FIG. It is a flowchart which shows the operation of the display control apparatus which concerns on Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 1 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 1 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 1 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 1 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 2 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 2 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 2 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 2 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 3 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 3 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 3 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 3 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 4 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 4 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 4 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 4 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 5 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 5 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 5 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 5 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 6 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 6 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 6 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 6 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 7 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 7 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 7 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 7 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 8 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 8 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 8 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 8 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 9 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 9 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 9 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 9 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 9 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 10 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 10 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 10 of Embodiment 2. It is a figure which shows the display control of the display control apparatus which concerns on the modification 10 of Embodiment 2. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 3. FIG. It is a figure which shows the display control of the display control apparatus which concerns on Embodiment 3. FIG. It is a block diagram which shows the structure of the display control apparatus which concerns on the modification 1 of Embodiment 3. It is a block diagram which shows the structure of the display control apparatus which concerns on the modification 2 of Embodiment 3. It is a figure which shows the display control of the display control apparatus which concerns on the modification 3 of Embodiment 3. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 4. FIG. It is a figure which shows the display control of the display control apparatus which concerns on Embodiment 4. FIG. It is a figure which shows the display control of the display control apparatus which concerns on the modification 1 of Embodiment 4. It is a block diagram which shows the structure of the display control apparatus which concerns on Embodiment 5. It is a figure which shows the repellent range which concerns on Embodiment 5. It is a figure which shows the display control of the display control apparatus which concerns on Embodiment 5. It is a figure which shows the display control of the display control apparatus which concerns on Embodiment 5. It is a figure which shows the display control of the display control apparatus which concerns on the modification 1 of Embodiment 5. It is a figure which shows the display control of the display control apparatus which concerns on the modification 2 of Embodiment 5. It is a figure which shows the detection range which concerns on Embodiment 2. It is a figure which shows the detection range which concerns on Embodiment 2. It is a figure which shows the detection range which concerns on other modification 1. It is a figure which shows the detection range which concerns on the other modification 2. It is a figure which shows the detection range which concerns on the other modification 2. It is a figure which shows the display control of the display control apparatus which concerns on other modification 2. It is a figure which shows the display control of the display control apparatus which concerns on other modification 2. It is a figure which shows the display control of the display control apparatus which concerns on other modification 2. It is a figure which shows the display control of the display control apparatus which concerns on other modification 2. It is a block diagram which shows the hardware composition of the display control apparatus which concerns on other modification 3. It is a block diagram which shows the hardware composition of the display control apparatus which concerns on other modification 3. It is a block diagram which shows the structure of the server which concerns on other modification example 3. It is a block diagram which shows the structure of the communication terminal which concerns on other modification 3.

<Embodiment 1>
FIG. 1 is a block diagram showing a configuration of a display control device 1 according to a first embodiment of the present invention. The display control device 1 is connected to the first display device 51, which can be moved together with the vehicle, via wireless or wired, and controls the display of the first display device 51.

The first display device 51 may be, for example, a display device such as a head-up display (HUD) that displays an image on the windshield of the vehicle, or may be a display device brought into the vehicle. Further, although the details will be described later, the first display device 51 may be a display device that performs a two-dimensional display (having a two-dimensional display function), or performs a three-dimensional display in which a user such as a driver can perceive the depth. It may be a display device (having a three-dimensional display function). Although the first display device 51 in FIG. 1 is provided outside the display control device 1, the first display device 51 is not limited to this, and may be provided in the display control device 1.

When the user performs a gesture operation for operating the in-vehicle information system without touching an indicator such as the user's hand or finger to the operation input device of the in-vehicle information system, the first display device 51 is the display control device 1. Display related to gesture operation by controlling. The control of the display control device 1 will be described in detail later. It is preferable that the first display device 51 makes the display in front of the vehicle rather than the driver.

The in-vehicle information system referred to here is a system including, for example, an operation input device, a display device, and a voice output device (not shown), and functions of a predetermined application based on a direct operation or a gesture operation in the operation input device. Display and audio output by executing. Such an in-vehicle information system includes, for example, at least one of a navigation device, an audio device, a control device for controlling a vehicle body, a control device for controlling the traveling of the vehicle, and a communication device.

The display control device 1 of FIG. 1 includes an acquisition unit 11 and a control unit 12.

The acquisition unit 11 acquires the range in which the user's indicator is located, out of the detection range, the front detection range, and the back detection range. FIG. 2 is a diagram showing a detection range, a front detection range, and a back detection range. The X-axis direction, the Y-axis direction, and the Z-axis direction correspond to the left-right direction, the up-down direction, and the depth direction with respect to the user, respectively.

The detection range is a predetermined space in which the user should perform a gesture operation by the indicator body. In other words, gesture operations within the detection range are valid, and gesture operations outside the detection range are invalid. The detection range may be set in an area on the front side of the display area of the first display device 51, or may be set in a region other than that area.

In the following description, the detection range has a rectangular parallelepiped shape as shown in FIG. 2, but is not limited to this, and may be any closed space shape. The detection range of FIG. 2 is vertex A (0, Yd, Zd1), vertex B (Xd, Yd, Zd1), vertex C (Xd, 0, Zd1), vertex D (0,0, Zd1), and vertex E ( It has a rectangular parallelepiped shape defined by vertices F (Xd, Yd, Zd2), vertices G (Xd, 0, Zd2), and vertices H (0,0, Zd2). In the following description, any position within the detection range of FIG. 2 may be referred to as P1 (Xp1, Yp1, Zp1). Regarding P1,
0≤Xp1≤Xd, 0≤Yp1≤Yd, Zd1≤Zp1≤Zd2 ... (1)
The relational expression holds.

The front detection range is a predetermined space on the user side with respect to the detection range. In the following description, an arbitrary position within the front detection range of FIG. 2 may be referred to as P2 (Xp2, Yp2, Zp2). Regarding P2,
0≤Xp2≤Xd, 0≤Yp2≤Yd, Zp2> Zd2 ... (2)
The relational expression holds.

The back detection range is a predetermined space on the opposite side of the front detection range with respect to the detection range. In the following description, any position within the depth detection range of FIG. 2 may be referred to as P3 (Xp3, Yp3, Zp3). For P3,
0≤Xp3≤Xd, 0≤Yp3≤Yd, Zp3 <Zd1 ... (3)
The relational expression holds.

The range acquired by the acquisition unit 11 may be ID information that can identify the detection range, the front detection range, and the back detection range, or may be the coordinates of the indicator.

The acquisition unit 11 having the above-mentioned functions includes, for example, an image processing device for detecting the position of an indicator from an image of the vehicle interior captured by a camera, a capacitive position sensor, an optical sensor, and a millimeter-wave sensor. , And at least one of these interfaces is used. Further, the method for detecting the position of the indicator is not limited to the above, and any method that will appear in the future may be used.

The control unit 12 has a detection range display object indicating a detection range and an indicator display indicating an indicator based on the range acquired by the acquisition unit 11 among the detection range, the front detection range, and the back detection range. Controls the display of display objects including objects to be different.

<Summary of Embodiment 1>
According to the display control device 1 according to the first embodiment as described above, the range acquired by the acquisition unit 11 among the detection range, the front detection range, and the back detection range, that is, the range in which the indicator is located. Based on this, control is performed to make the display of the display object different. According to such a configuration, it is possible to display to the user in which range of the detection range, the front detection range, and the back detection range the indicator is located. Since the user can perform the gesture operation while checking such a display, the gesture operation can be easily performed within the detection range.

<Embodiment 2>
FIG. 3 is a block diagram showing the configuration of the display control device 1 according to the second embodiment of the present invention. Hereinafter, among the components according to the second embodiment, the same or similar components as those described above will be designated by the same or similar reference numerals, and different components will be mainly described.

The display control device 1 of FIG. 3 is connected to the projection display device 51a, the spatial operation detection device 52, and the vehicle-mounted information system 53 via wireless or wired.

The projection display device 51a is a device included in the concept of the first display device 51 in FIG. 1, and performs planar display (two-dimensional display). The projection display device 51a is, for example, a HUD capable of displaying a flat surface. The projection display device 51a is not limited to this, and may be, for example, a liquid crystal display device provided on the instrument panel.

The spatial operation detection device 52 is, for example, at least one of an image processing device that detects the position of an indicator from an image of the vehicle interior captured by a camera, a capacitive position sensor, an optical sensor, and a millimeter wave sensor. Is used. Further, the method for detecting the position of the indicator is not limited to the above, and any method that will appear in the future may be used. The spatial operation detection device 52 detects the range in which the indicator is located among the detection range, the front detection range, the back detection range, the lateral detection range, and the peripheral range.

Here, the lateral detection range is a predetermined space on the lateral side of the detection range other than the front detection range and the back detection range, and is, for example, a space on the upper, lower, left, and right sides of the detection range. In the following description, any position within the lateral detection range may be referred to as P4 (Xp4, Yp4, Zp4). Regarding P4, {(Xp4 <0 or Xp4> Xd) or (Yp4 <0 or Yp4> Yd)} and (Zd2 ≧ Zp4 ≧ Zd1) ... 4)
The relational expression holds.

The peripheral range is the range around the detection range, the front detection range, the back detection range, and the lateral detection range. In other words, the peripheral range is a range excluding the detection range, the front detection range, the back detection range, and the lateral detection range from the range in which the spatial operation detection device 52 detects the position of the indicator. Further, although not explicitly described in the equations (1) to (4), P1, P2, P3, and P4 are points that exist within the range in which the spatial operation detection device 52 detects the position of the indicator. Is.

The in-vehicle information system 53 is the same system as the in-vehicle information system described in the first embodiment. For example, the vehicle-mounted information system 53 executes a function of a radio application based on a direct operation input to the operation input device of the vehicle-mounted information system 53 or a gesture operation detected by the spatial operation detection device 52. Specifically, the in-vehicle information system 53 selects a down search when a gesture operation of waving a finger from right to left is performed, and when a gesture operation of waving a finger from left to right is performed. Selects up-search and turns up the volume when a gesture operation such as turning the dial to the right is performed, and lowers the volume when a gesture operation such as turning the dial to the left is performed. The in-vehicle information system 53 may display an icon or a button for controlling the radio application when these gesture operations are performed.

Next, the configuration of the display control device 1 of FIG. 3 will be described. The display control device 1 of FIG. 3 includes a spatial operation acquisition unit 11a, a generation control unit 12a, and a generation unit 12b. The spatial operation acquisition unit 11a is included in the concept of the acquisition unit 11 in FIG. 1, and the generation control unit 12a and the generation unit 12b are included in the concept of the control unit 12 in FIG.

The spatial operation acquisition unit 11a is an interface of the spatial operation detection device 52, and acquires the detection result of the spatial operation detection device 52. That is, the spatial operation acquisition unit 11a acquires the range in which the indicator is located among the detection range, the front detection range, the back detection range, the lateral detection range, and the peripheral range.

The generation control unit 12a is generated by the generation unit 12b so that the display of the display object is different based on the range acquired by the spatial operation acquisition unit 11a among the detection range, the front detection range, and the back detection range. Determine the display object to be displayed. In the second embodiment, the generation control unit 12a acquires the indicator in the front detection range when the spatial operation acquisition unit 11a acquires the indicator in the lateral detection range. Determine a display object similar to the display object in.

The generation unit 12b generates a display object determined by the generation control unit 12a, and controls the projected display device 51a to display the generated display object.

According to the above configuration, the generation control unit 12a substantially controls the display of the projection display device 51a and, by extension, the display object displayed on the projection display device 51a. Therefore, in the following description, it is described that the generation control unit 12a simplifies the control of displaying the display object on the projection display device 51a via the generation unit 12b, and the generation control unit 12a displays the display object. Sometimes.

4 to 7 are diagrams showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the second embodiment. FIG. 4 shows a display when the range in which the indicator is acquired is the detection range, that is, a display when the position of the indicator is P1. FIG. 5 shows a display when the range in which the indicator is acquired is the front detection range, that is, a display when the position of the indicator is P2.

FIG. 6 shows a display when the range in which the indicator is acquired is the back detection range, that is, a display when the position of the indicator is P3. FIG. 7 shows a display when the range in which the indicator is acquired is the horizontal detection range, that is, a display when the position of the indicator is P4.

As shown in FIGS. 4 to 7, the display object includes a planar detection range display object 71 indicating a detection range and an indicator display object 72 indicating an indicator such as a user's hand or finger. Since the detection range display object 71 has a shape corresponding to the detection range, when the detection range has a rectangular parallelepiped three-dimensional shape, the planar shape of the detection range display object 71 becomes a rectangular shape.

As shown in FIG. 4, when the indicator is located within the detection range, the generation control unit 12a makes the color tone of the indicator display object 72 the same as or almost the same as the color tone of the detection range display object 71. do. In this case, the color tone of all of the indicator display object 72 may be changed, or the color tone of only the portion of the indicator display object 72 in the detection range display object 71 may be changed. As shown in FIG. 5, when the indicator is located within the front detection range, the generation control unit 12a changes the color tone of the indicator display object 72 to a default color tone different from the color tone of the detection range display object 71. do.

As shown in FIG. 6, when the indicator is located within the depth detection range, the generation control unit 12a makes the color tone of the indicator display object 72 different from the default color tone and the color tone of the detection range display object 71. Change to a color tone (for example, a color tone like a shadow). Further, in this case, the generation control unit 12a displays the indicator display object 72 as a semi-transparent or broken line. As shown in FIG. 7, when the indicator is located within the lateral detection range, the generation control unit 12a changes the color tone of the indicator display object 72 to the default color tone.

As described above, in the second embodiment, the generation control unit 12a displays the display object based on the range acquired by the spatial operation acquisition unit 11a among the detection range, the front detection range, and the back detection range. Control to make different. Further, in the second embodiment, the control for changing the display mode of the display object includes a control for changing the display mode of the indicator display object 72 without changing the display mode of the detection range display object 71. According to such a configuration, it is possible to display to the user in which range of the detection range, the front detection range, and the back detection range the indicator is located.

In the above, the display mode of the display object changed (controlled) by the generation control unit 12a has been described as assuming that it is the color tone of the display object. However, the display mode of the display object changed (controlled) by the generation control unit 12a is not limited to the color tone of the display object, but may be the shape of the display object, or a combination of the color tone and the shape of the display object. It may be.

<Operation>
FIG. 8 is a flowchart showing the operation of the display control device 1 according to the second embodiment. At the start of the operation of the operation example described here, the indicator is in a range that cannot be detected by the spatial operation detection device 52 (detection range, front detection range, back detection range, lateral detection range, and range outside the peripheral range. ), And it is assumed that the detection range display object 71 and the indicator display object 72 are not displayed on the projection display device 51a.

First, in step S1, the generation control unit 12a determines whether or not the range in which the indicator is located has been acquired by the spatial operation acquisition unit 11a. If it is determined that the range in which the indicator is located has been acquired, the process proceeds to step S2, and if it is determined that the range in which the indicator is located has not been acquired, the process proceeds to step S6.

In step S2, the generation control unit 12a determines whether or not the range in which the indicator is located is one of the detection range, the front detection range, the back detection range, and the lateral detection range. If it is determined that the range in which the indicator is located is one of the detection range, the front detection range, the back detection range, and the lateral detection range, the process proceeds to step S3. If this is not the case, that is, if it is determined that the range in which the indicator is located is the peripheral range, the process proceeds to step S6.

In step S3, the generation control unit 12a is generated by the generation unit 12b based on the range acquired by the spatial operation acquisition unit 11a among the detection range, the front detection range, the back detection range, and the lateral detection range. Determine the display object to be displayed. The display object determined here includes the detection range display object 71 and the indicator display object 72.

In step S4, the generation unit 12b generates the display object determined by the generation control unit 12a.

In step S5, the generation unit 12b controls to display the generated display object on the projection display device 51a, and the projection display device 51a displays the display object. After that, the process returns to step S1. Since the user can perform the gesture operation while checking the display of the display object in step S5, the gesture operation can be easily performed within the detection range. At this time, the vehicle-mounted information system 53 does not execute the application function based on the gesture operation performed outside the detection range, but executes the application function based on the gesture operation performed within the detection range.

When the process proceeds from step S1 or step S2 to step S6 and the projection display device 51a displays the display object including the detection range display object 71 and the indicator display object 72, the generation control unit 12a may display the display object. The display of the display object is stopped via the generation unit 12b. As a result, the display of the display object displayed on the projection display device 51a is stopped. After that, the process returns to step S1.

<Summary of Embodiment 2>
According to the display control device 1 according to the second embodiment as described above, the display mode of the display object is different based on the range in which the indicator is located among the detection range, the front detection range, and the back detection range. Control to make. According to such a configuration, it is possible to display to the user in which range of the detection range, the front detection range, and the back detection range the indicator is located.

<Modification 1 of Embodiment 2>
9 to 12 are diagrams showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 1 in the same manner as in FIGS. 4 to 7. The display object according to the first modification further includes an auxiliary display object 73 that indicates the distance between the detection range and the indicator. The auxiliary display object 73 according to the first modification is a display object in which a circular display object 73a and a linear display object 73b are appropriately combined.

As shown in FIG. 9, when the indicator is located within the detection range, the generation control unit 12a adds the circular display object 73a to the indicator display object 72 without displaying the linear display object 73b. And display. The circular display object 73a is a display object showing the XY coordinates of FIG. 2 of the indicator, and is added on the detection range display object 71. The distance between the circular display object 73a and the indicator display object 72 is appropriately adjusted so that the distance between the detection range and the indicator corresponds to the distance between the detection range and the indicator.

As shown in FIG. 10, when the indicator is located within the front detection range, the generation control unit 12a displays the circular display object 73a and the linear display object 73b. The linear display object 73b is a display object that connects the circular display object 73a and the indicator display object 72.

As shown in FIG. 11, when the indicator is located within the depth detection range, the generation control unit 12a displays the circular display object 73a and the linear display object 73b with a semi-transparent or broken line. Further, in this case, the generation control unit 12a displays the indicator display object 72 as a semi-transparent or broken line. As shown in FIG. 12, when the indicator is located within the lateral detection range, the generation control unit 12a does not display the circular display object 73a and the linear display object 73b.

According to the present modification 1 for displaying the auxiliary display object 73 as described above, the user can know how far the indicator is from the detection range, so that the gesture operation can be easily performed within the detection range. It can be carried out.

Further, in the display control according to the present modification 1 as described above, the combination of the display, the transparent display, and the non-display of the circular display object 73a and the linear display object 73b is the detection range, the front detection range, and the back detection range. And, it is different in each of the horizontal detection ranges. That is, the generation control unit 12a according to the present modification 1 is a display object based on the range acquired by the spatial operation acquisition unit 11a among the detection range, the front detection range, the back detection range, and the lateral detection range. Controls the display to be different. According to such a configuration, it is possible to display to the user in which range of the detection range, the front detection range, the back detection range, and the lateral detection range the indicator is located. Therefore, the user can easily perform the gesture operation within the detection range.

In the above description, the generation control unit 12a is an auxiliary display object based on the range acquired by the spatial operation acquisition unit 11a among the detection range, the front detection range, and the back detection range of the spatial operation acquisition unit 11a. Control was performed to switch between display and non-display of 73. However, the present invention is not limited to this, and for example, the generation control unit 12a may display at least one of the detection range display object 71 and the indicator display object 72 differently based on the range acquired by the spatial operation acquisition unit 11a. The auxiliary display object 73 may always be displayed if it is configured to be such.

<Modification 2 of Embodiment 2>
13 to 16 are views showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the second modification in the same manner as in FIGS. 4 to 7.

Similar to the first modification (FIGS. 9 to 12), the display object according to the second modification further includes an auxiliary display object 73 indicating the distance between the detection range and the indicator. However, unlike the modification 1, the auxiliary display object 73 according to the modification 2 is a display object having the same shape as the indicator display object 72. Then, the positions of the auxiliary display object 73 and the indicator display object 72 are appropriately adjusted so that the deviation between the indicator display object 72 and the auxiliary display object 73 corresponds to the distance between the detection range and the indicator. Will be done.

As shown in FIG. 13, when the indicator is located within the detection range, the generation control unit 12a does not display the auxiliary display object 73. As shown in FIG. 14, when the indicator is located within the front detection range, the generation control unit 12a displays the auxiliary display object 73 in a bright color tone.

As shown in FIG. 15, when the indicator is located within the depth detection range, the generation control unit 12a displays the auxiliary display object 73 in a dark color tone. Further, in this case, the generation control unit 12a displays the indicator display object 72 as a semi-transparent or broken line. As shown in FIG. 16, when the indicator is located within the lateral detection range, the generation control unit 12a does not display the auxiliary display object 73.

According to the present modification 2 for displaying the auxiliary display object 73 as described above, as in the modification 1, the user can know how far the indicator is from the detection range, so that the detection range can be detected. Gesture operation can be easily performed within.

In the above description, the generation control unit 12a displays the color tone of the auxiliary display object 73, etc., based on the range acquired by the spatial operation acquisition unit 11a among the detection range, the front detection range, and the back detection range. Control was performed to change the mode. However, the present invention is not limited to this, and for example, the generation control unit 12a may display at least one of the detection range display object 71 and the indicator display object 72 differently based on the range acquired by the spatial operation acquisition unit 11a. When it is configured to be so, the display mode such as the color tone of the auxiliary display object 73 may always be the same.

<Modification 3 of Embodiment 2>
17 to 20 are views showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the third modification in the same manner as in FIGS. 4 to 7.

The display object according to the third modification further includes the detection range auxiliary display object 74. The detection range auxiliary display object 74 is a display object for preventing the indicator from colliding with the object when there is an object such as the interior of the vehicle behind the detection range. The position of the detection range auxiliary display object 74 with respect to the detection range display object 71 corresponds to the position of an object such as the interior of the vehicle with respect to the detection range. According to the present modification 3 as described above, the limit of movement of the indicator in the depth direction can be displayed to the user.

The detection range auxiliary display object 74 of FIGS. 17 to 20 has a shape in which the detection range is projected, but may have another shape. Further, the detection range auxiliary display object 74 of FIGS. 17 to 20 is a display object having a broken line frame, but is not limited to this. For example, the detection range auxiliary display object 74 has a solid line frame instead of the broken line frame, and the inside thereof is filled. It may be a display object. Further, the detection range auxiliary display object 74 may be appropriately displayed in other modifications and the like.

<Modification 4 of Embodiment 2>
21 to 24 are diagrams showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 4 in the same manner as in FIGS. 4 to 7.

In the present modification 4, the generation unit 12b has a three-dimensional graphics function, and projects a three-dimensional shape display object generated by the three-dimensional graphics function onto a two-dimensional plane. As a result, the detection range display object 71 according to the present modification 4 has a three-dimensional shape such as a rectangular parallelepiped. A pseudo three-dimensional graphics function may be used instead of the three-dimensional graphics function to generate the three-dimensional shape display object. In this pseudo three-dimensional graphics function, a three-dimensional display object is generated by combining a plurality of planar shape display objects generated by the two-dimensional graphics function. That is, in the second embodiment, the configuration in which the display device having the two-dimensional display function performs the two-dimensional display has been described, but in the present modification 4, the display device having the two-dimensional display function has an apparent three-dimensional display (3D). It is configured to perform (also called display).

As shown in FIG. 21, when the indicator is located within the detection range, the generation control unit 12a displays the hidden line 71a, which is a part of the detection range display object 71, with a broken line. As shown in FIG. 22, when the indicator is located within the front detection range, the generation control unit 12a stops the display of the hidden line 71a of the detection range display object 71.

As shown in FIG. 23, when the indicator is located within the depth detection range, the generation control unit 12a displays the hidden line 71a of the detection range display object 71 with a solid line. As shown in FIG. 24, when the indicator is located within the lateral detection range, the generation control unit 12a stops the display of the hidden line 71a of the detection range display object 71.

In the present modification 4 as described above, the control for changing the display mode of the display object includes the control for changing the shape of the display object. Further, the control for changing the display mode of the display object includes a control for changing the display mode of the detection range display object 71 without changing the display mode of the indicator display object 72. Even with such a configuration, the same effect as that of the second embodiment can be obtained.

<Modification 5 of Embodiment 2>
25 to 28 are views showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 5 in the same manner as in FIGS. 4 to 7.

The detection range display object 71 according to the present modification 5 has a three-dimensional shape similar to the modification 4 (FIGS. 21 to 24). Further, in the present modification 5, the control for changing the display mode of the display object includes the control for changing the display mode of the detection range display object 71 and the indicator display object 72.

As shown in FIG. 25, when the indicator is located within the detection range, the generation control unit 12a does not change the color tone of the indicator display object 72 from the default, but is behind the detection range display object 71. Change the color tone of the surface from the default. As shown in FIG. 26, when the indicator is located within the front detection range, the generation control unit 12a does not change the color tone of the indicator display object 72 from the default, and all of the detection range display objects 71. Change the color tone of the surface from the default.

As shown in FIG. 27, when the indicator is located within the depth detection range, the generation control unit 12a has the color tone of the back surface of the detection range display object 71 and at least one of the indicator display objects 72. Change the color tone of the part from the default. Further, in this case, the generation control unit 12a displays the indicator display object 72 as a semi-transparent or broken line. As shown in FIG. 28, when the indicator is located within the horizontal detection range, the generation control unit 12a does not change the color tone of the indicator display object 72 from the default, and all of the detection range display objects 71. Change the color tone of the surface from the default.

In the present modification 5 as described above, the control for changing the display mode of the display object includes the control for changing the display mode of the detection range display object 71 and the indicator display object 72. Even with such a configuration, the same effect as that of the second embodiment can be obtained.

<Variation Example 6 of Embodiment 2>
29 to 32 are views showing the display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 6 in the same manner as in FIGS. 4 to 7.

The detection range display object 71 according to the present modification 6 has a three-dimensional shape similar to the modification 4 (FIGS. 21 to 24), and the display object according to the present modification 6 has been described in the modification 3. Includes the detection range auxiliary display object 74. Further, in the present modification 6, the control for changing the display mode of the display object includes the control for changing the display mode of the indicator display object 72 and the detection range auxiliary display object 74.

As shown in FIG. 29, when the indicator is located within the detection range, the generation control unit 12a of the indicator display object 72 does not change the shape and color tone of the detection range auxiliary display object 74 from the default. Change the color tone from the default. As shown in FIG. 30, when the indicator is located within the front detection range, the generation control unit 12a sets the color tone of the indicator display object 72 and the shape and color tone of the detection range auxiliary display object 74 from the default. Not going to change.

As shown in FIG. 31, when the indicator is located within the depth detection range, the generation control unit 12a has the color tone of at least a part of the indicator display object 72, and the shape and shape of the detection range auxiliary display object 74. Change the color tone from the default. The color tone of the detection range auxiliary display object 74 after the change is, for example, white. Further, in this case, the generation control unit 12a displays the indicator display object 72 as a semi-transparent or broken line. As shown in FIG. 32, when the indicator is located within the horizontal detection range, the generation control unit 12a changes the color tone of the indicator display object 72 and the shape and color tone of the detection range auxiliary display object 74 from the default. Not going to change.

In the present modification 6 as described above, the control for different display modes of the display object includes the control for different display modes of the indicator display object 72 and the detection range auxiliary display object 74. Even with such a configuration, the same effect as that of the second embodiment can be obtained.

<Modification 7 of Embodiment 2>
33 to 36 are views showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 7 in the same manner as in FIGS. 4 to 7.

The detection range display object 71 according to the present modification 7 has a three-dimensional shape similar to the modification 4 (FIGS. 21 to 24). In the present modification 7, the control for changing the display mode of the display object includes the control for changing the display mode of the indicator display object 72 without changing the display mode of the detection range display object 71. That is, the same control as that described with reference to FIGS. 4 to 7 in the second embodiment is performed.

The control for changing the display mode of the indicator display object 72 is not limited to the control for changing the color tone of the indicator display object 72, for example, the control for changing the size of the indicator display object 72. You may. Specifically, the generation control unit 12a enlarges the indicator display object 72 from the default when the indicator is located within the front detection range, and when the indicator is located within the back detection range, the generation control unit 12a increases the size of the indicator display object 72 from the default. The indicator display object 72 may be made smaller than the default. According to such a configuration, the user can be displayed by the perspective method in which range of the detection range, the front detection range, and the back detection range the indicator is located.

<Modification 8 of Embodiment 2>
37 to 40 are views showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 8 in the same manner as in FIGS. 4 to 7.

In the present modification 8, the control for changing the shape of the display object includes a control for changing the shape of the display object to either a planar shape or a three-dimensional shape, and a control for changing the color tone of the display object.

As shown in FIG. 37, when the indicator is located within the detection range, the generation control unit 12a changes the shape of the detection range display object 71 to a planar shape, and changes the color tone of the indicator display object 72 from the default. change. As shown in FIG. 38, when the indicator is located within the front detection range, the generation control unit 12a changes the shape of the detection range display object 71 without changing the color tone of the indicator display object 72 from the default. Change to a three-dimensional shape.

As shown in FIG. 39, when the indicator is located within the depth detection range, the generation control unit 12a changes the color tone of at least a part of the indicator display object 72 from the default, and the detection range display object 71 Change the shape to a three-dimensional shape. Further, in this case, the generation control unit 12a displays the indicator display object 72 as a semi-transparent or broken line. As shown in FIG. 40, when the indicator is located within the horizontal detection range, the generation control unit 12a changes the shape of the detection range display object 71 without changing the color tone of the indicator display object 72 from the default. Change to a planar shape.

In the present modification 8 as described above, the control for changing the shape of the display object includes the control for changing the shape of the display object to either a planar shape or a three-dimensional shape. Even with such a configuration, the same effect as that of the second embodiment can be obtained. In the above description, the control for changing the shape of the display object includes a control for changing the shape of the display object to either a planar shape or a three-dimensional shape and a control for changing the color tone of the display object. However, it may include only the former control.

Further, the control for changing the shape of the display object to either a planar shape or a three-dimensional shape is not limited to the above. For example, in the above description, the control may be such that the planar shape and the three-dimensional shape are interchanged. Further, in the above description, the display object changed to either the planar shape or the three-dimensional shape is the detection range display object 71, but may be the indicator display object 72.

<Modification 9 of Embodiment 2>
41 to 44 are views showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 9 in the same manner as in FIGS. 4 to 7.

The detection range display object 71 according to the present modification 9 has a three-dimensional shape similar to the modification 4 (FIGS. 21 to 24), and the display object according to the present modification 9 has a modification 1 (FIG. 9). -Similar to FIG. 12), the auxiliary display object 73 indicating the distance between the detection range and the indicator is further included.

The auxiliary display object 73 according to the present modification 9 is a display object in which two circular display objects 73c and 73d and a linear display object 73e are appropriately combined. The circular shape display object 73c is attached to the front surface of the detection range display object 71, and the circular shape display object 73d is attached to the back surface of the detection range display object 71. The distances between the circular display objects 73c and 73d and the indicator display object 72 are appropriately adjusted so as to correspond to the distance between the detection range and the indicator.

The linear display object 73b is a display object that connects two circular display objects 73c and 73d and an indicator display object 72 and extends parallel to the Z axis of FIG. The linear portion between the two circular display objects 73c and 73d may be displayed in a color tone different from that of the other portions of the linear display object 73b.

As shown in FIG. 41, when the indicator is located within the detection range, the generation control unit 12a displays the auxiliary display object 73, changes the color tone of the indicator display object 72 from the default, and displays the indicator. The object 72 is displayed between the circular display objects 73c and 73d. As shown in FIG. 42, when the indicator is located within the foreground detection range, the generation control unit 12a displays the auxiliary display object 73 without changing the color tone of the indicator display object 72 from the default. The indicator display object 72 is displayed in front of the circular display object 73c.

As shown in FIG. 43, when the indicator is located within the depth detection range, the generation control unit 12a displays the auxiliary display object 73 without changing the color tone of the indicator display object 72 from the default. The indicator display object 72 is displayed in front of the circular display object 73d. As shown in FIG. 44, when the indicator is located within the horizontal detection range, the generation control unit 12a may display the auxiliary display object 73 or change the color tone of the indicator display object 72 from the default. Also do not do.

According to the present modification 9 for displaying the auxiliary display object 73 as described above, the user can know how far the indicator is from the detection range, so that the gesture operation can be easily performed within the detection range. It can be carried out.

In FIGS. 41 to 44, the detection range display object 71 according to the present modification 9 has a three-dimensional shape such as a rectangular parallelepiped, but as shown in FIG. 45, the detection range display object 71 may have a planar shape such as a rectangular shape. good. Further, the detection range display object 71 of FIG. 45 may be displayed at a position in the detection range display object 71 of FIGS. 41 to 44, for example, at a central position in the Z-axis direction.

<Modification 10 of Embodiment 2>
46 and 47 are diagrams showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 10.

In the present modification 10, the detection range includes the first detection range and the second detection range, and the spatial operation acquisition unit 11a acquires the range in which the indicator is located among the first detection range and the second detection range. The detection range display object 71 includes a first detection range display object 71b indicating a first detection range and a second detection range display object 71c indicating a second detection range. Then, the generation control unit 12a makes the display of the display object different based on the range acquired by the spatial operation acquisition unit 11a among the first detection range and the second detection range.

For example, as shown in FIG. 46, when the indicator is located within the first detection range, the generation control unit 12a sets the color tone of the indicator display object 72 and the first detection range display object 71b from the default to the first. Change to a color tone. As shown in FIG. 47, when the indicator is located within the second detection range, the generation control unit 12a changes the color tone of the indicator display object 72 and the second detection range display object 71c from the default to the second color tone. change. According to such a configuration, the user can perform different gesture operations in each of the plurality of ranges within the detection range, so that the operability can be improved.

In FIGS. 46 and 47, the first detection range and the second detection range are ranges in which the detection range is divided in the Z-axis direction, but the detection range is not limited to this. For example, as shown in FIGS. 48 and 49, the first detection range and the second detection range may be nested ranges. At this time, in order to prevent the indicator from protruding from the first detection range even if the gesture operation becomes slightly large, a range in which a margin is taken in the second detection range may be set as the first detection range. For example, the second detection range may be a range in which the first detection range is narrowed by 5 cm in the vertical, horizontal, and height directions. Further, the number of ranges formed by dividing the detection range is not limited to two, and may be three or more. Further, the shapes of the first detection range display object 71b and the second detection range display object 71c are not limited to the three-dimensional shape, but may be a planar shape.

<Embodiment 3>
FIG. 50 is a block diagram showing the configuration of the display control device 1 according to the third embodiment of the present invention. Hereinafter, among the components according to the third embodiment, the same or similar components as those described above will be designated by the same or similar reference numerals, and different components will be mainly described.

In the third embodiment, the information to be displayed on the projection display device 51a is output from the vehicle-mounted information system 53 to the generation control unit 12a. The generation control unit 12a determines the display object generated by the generation unit 12b in consideration of the information from the in-vehicle information system 53.

FIG. 51 is a diagram showing a display example of the projection display device 51a by display control of the display control device 1 according to the third embodiment. In FIG. 51, the mode display object 75 and the operation display object 76 are displayed. The mode display object 75 indicates an operation mode (radio operation in FIG. 51) performed by the vehicle-mounted information system 53, and the operation display object 76 indicates a gesture operation that the vehicle-mounted information system 53 can accept. The gesture operation that the vehicle-mounted information system 53 can accept may differ depending on the operation mode. The mode display object 75 and the operation display object 76 are determined and generated by the generation control unit 12a and the generation unit 12b in the same manner as the detection range display object 71 and the like.

According to the display control device 1 according to the third embodiment as described above, for example, the current status of the vehicle-mounted information system 53, the gesture operation that the vehicle-mounted information system 53 can accept, and the like are displayed on the projection display device 51a. be able to.

<Modification 1 of Embodiment 3>
FIG. 52 is a block diagram showing the configuration of the display control device 1 according to the present modification 1. In the first modification, the gesture operation that can be accepted by the vehicle-mounted information system 53 is output from the vehicle-mounted information system 53 to the space operation detection device 52. The spatial operation detection device 52 invalidates the detection of a gesture operation different from the gesture operation output from the vehicle-mounted information system 53.

According to such a configuration, it is possible to suppress the spatial operation detecting device 52 from detecting the gesture operation more than necessary, so that the processing load of the spatial operation detecting device 52 can be reduced. The spatial operation detection device 52 may change at least one of the detection range, the front detection range, the back detection range, and the lateral detection range based on the gesture operation output from the in-vehicle information system 53. good. Then, in accordance with this change, the generation control unit 12a may change the shape of the display object.

<Modification 2 of Embodiment 3>
FIG. 53 is a block diagram showing the configuration of the display control device 1 according to the second modification. As shown in FIG. 53, the display control device 1 includes an in-vehicle information system 53, and the in-vehicle information system 53 can control a display device 54, which is a second display device that can move with the vehicle. In such a configuration, the display control device 1 including the vehicle-mounted information system 53 may display the contents executed by the gesture operation such as channel selection and volume on the display device 54.

<Modification 3 of Embodiment 3>
FIG. 54 is a diagram showing a display example of the projection display device 51a by display control of the display control device 1 according to the present modification 3. In the above description, the number of each of the detection range and the detection range display object 71 is one, but in the present modification 3, the number of each of the detection range and the detection range display objects 71m and 71n is a plurality. There is. Hereinafter, a configuration in which a detection range for a radio is provided near the panel surface on which the radio is arranged and a detection range for the air conditioner is provided near the panel surface on which the air conditioner is arranged will be described as an example. ..

As shown in FIG. 54, the display object according to the third modification includes a detection range display object 71m indicating a detection range for a radio and a detection range display object 71n indicating a detection range for an air conditioner. According to such a configuration, the detection range for the radio and the detection range for the air conditioner are different, and the positional relationship between them is displayed by the detection range display objects 71m and 71n. Therefore, the user can perform appropriate gesture operations in each of the detection range for the radio and the detection range for the air conditioner.

<Embodiment 4>
FIG. 55 is a block diagram showing the configuration of the display control device 1 according to the fourth embodiment of the present invention. Hereinafter, among the components according to the fourth embodiment, the same or similar components as those described above will be designated by the same or similar reference numerals, and different components will be mainly described.

In the display control device 1 of FIG. 55, a stereoscopic display device 51b is connected instead of the projection display device 51a. For the stereoscopic display device 51b, for example, a HUD capable of stereoscopically displaying a display object by displaying a display object of a virtual image is used. According to such a HUD, the display object is visually recognized by the user as if it actually exists in the three-dimensional space of the real world, and the position of the display object in the Z-axis direction (depth direction) in FIG. 2, that is, the perspective of the display object is determined. Perceived by the user.

FIG. 56 is a diagram showing a display object displayed by the stereoscopic display device 51b by the display control of the display control device 1 according to the fourth embodiment. In the fourth embodiment, the HUD in which the distances between the plurality of points on one display object and the user 31 are all the same is used in the stereoscopic display device 51b. The distance between the display object and the user 31 is not the distance between the actual position of the display object (the position on the windshield of the vehicle) and the user 31, but the position of the display object in the three-dimensional space. It means the distance between the user 31 and the virtual image distance. In the above-mentioned HUD, a two-dimensional display object is three-dimensionally displayed in the three-dimensional space realized by the three-dimensional display of the three-dimensional display device 51b. Therefore, the detection range display object 71 and the indicator display object 72 of FIG. 56 have a planar shape in the three-dimensional space.

Hereinafter, the distance between the detection range display object 71 that is stereoscopically displayed by the stereoscopic display device 51b and the user 31 may be referred to as a “detection range distance”, and the indicator display object 72 that is stereoscopically displayed by the stereoscopic display device 51b. The distance between the user 31 and the user 31 may be referred to as an "indicator distance". In the fourth embodiment, the control for making the display of the display object different includes the control for changing the indicator distance based on the detection range distance.

For example, when the indicator is located within the detection range, the generation control unit 12a makes the detection range distance the same as the indicator distance (indicator distance = medium). When the indicator is located within the front detection range, the generation control unit 12a makes the indicator distance smaller than the detection range distance (indicator distance = near). When the indicator is located within the depth detection range, the generation control unit 12a makes the indicator distance larger than the detection range distance (indicator distance = far). When the indicator is located within the lateral detection range, the generation control unit 12a makes the detection range distance the same as the indicator distance (indicator distance = medium).

<Summary of Embodiment 4>
According to the display control device 1 according to the fourth embodiment as described above, the stereoscopic display device 51b displays stereoscopically based on the range in which the indicator is located among the detection range, the front detection range, and the back detection range. The distance between the indicator display object 72 and the user is changed. According to such a configuration, the indicator can be included in the detection range, the front detection range, and the back detection range without changing the display mode such as the color tone and shape of the display object as in the second embodiment. It is possible to display to the user which range of the object is located.

<Modification 1 of Embodiment 4>
FIG. 57 is a diagram showing a display object displayed by the stereoscopic display device 51b by the display control of the display control device 1 according to the present modification 1. In the fourth embodiment, the stereoscopic display device 51b uses a HUD in which the distances between the plurality of points on one display object and the user 31 are all the same. On the other hand, in the present modification 1, the stereoscopic display device 51b uses a HUD in which the distances between a plurality of points on one display object and the user 31 are different.

In such a HUD, a three-dimensional display object is three-dimensionally displayed in the three-dimensional space realized by the three-dimensional display of the three-dimensional display device 51b. Therefore, the detection range display object 71 and the indicator display object 72 in FIG. 57 have a three-dimensional shape in the three-dimensional space. With such a configuration, it is possible to display the display closer to the three-dimensional space in the real world.

<Modification 2 of Embodiment 4>
In the above description, the generation control unit 12a controls the indicator distance in three stages (far, medium, and near). However, the present invention is not limited to this, and the indicator distance may be changed in four or more steps. Further, in a configuration in which the indicator distances are substantially continuous, the distance between the detection range display object 71 and the indicator display object 72 may correspond to the distance between the detection range and the indicator.

<Modification 3 of Embodiment 4>
In the above description, the stereoscopic display device 51b uses a HUD capable of stereoscopically displaying a display object, but the present invention is not limited to this. For example, as the stereoscopic display device 51b, a display device having an autostereoscopic display function capable of stereoscopic display may be used. This display device is, for example, a liquid crystal display device capable of stereoscopic display, an aerial display device capable of making a light source or a source image appear in space through a mirror element, a display device using holography, and the like. Even with such a configuration, the same effect as that of the fourth embodiment can be obtained.

<Modification 4 of Embodiment 4>
Also in the fourth embodiment, each embodiment and each modification thereof may be appropriately combined. For example, the display object according to the fourth embodiment may include the auxiliary display object 73 such as FIG. 9 described in the first modification of the second embodiment.

<Embodiment 5>
FIG. 58 is a block diagram showing the configuration of the display control device 1 according to the fifth embodiment of the present invention. Hereinafter, among the components according to the fifth embodiment, the same or similar components as those described above will be designated by the same or similar reference numerals, and different components will be mainly described.

The display control device 1 of FIG. 58 further includes a storage unit 13. The storage unit 13 stores a predetermined arrangement (three-dimensional position) of the device in the vehicle. Predetermined devices include, for example, interiors and equipment in vehicles.

The generation control unit 12a sets the repellent range based on the three-dimensional position stored in the storage unit 13. The repellent range is a predetermined space around the detection range and around the predetermined device, and for example, a range in which the presence of the indicator is not appropriate is set.

FIG. 59 is a top view showing the repellent range 64. For the repellent range 64, for example, a range from a predetermined device 66 to a position separated by a length Xth (for example, 5 cm) in the X-axis direction and a length Zth (for example, 5 cm) in the Z-axis direction is used. Although not shown, the repellent range 64 may include a position separated from the device 66 by a length Yth (for example, 5 cm) in the Y-axis direction and a range between the device 66 and the device 66.

The spatial operation detection device 52 detects the range in which the indicator is located among the detection range, the front detection range, the back detection range, the lateral detection range, and the repellent range 64. As a result, the spatial operation acquisition unit 11a also acquires the range in which the indicator is located among the detection range, the front detection range, the back detection range, the lateral detection range, and the repellent range 64.

60 and 61 are diagrams showing display objects displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the fifth embodiment.

As shown in FIG. 60, when the indicator is located in a range other than the repellent range 64, for example, the back detection range, the generation control unit 12a changes the color tone of at least a part of the indicator display object 72 from the default. .. Further, in this case, the generation control unit 12a displays the indicator display object 72 as a semi-transparent or broken line. As shown in FIG. 61, when the indicator is located within the repellent range 64, the generation control unit 12a displays the repellent range display object 77 having a dark color tone indicating the repellent range 64. The determination and generation of the repellent range display object 77 is performed by the generation control unit 12a and the generation unit 12b in the same manner as the detection range display object 71 and the like.

As described above, in the fifth embodiment, the generation control unit 12a displays and hides the repellent range display object 77 based on whether or not the range acquired by the spatial operation acquisition unit 11a is the repellent range 64. Controls switching.

<Summary of Embodiment 5>
According to the display control device 1 according to the fifth embodiment as described above, when the user confirms the repellent range display object 77, the indicator invades the periphery of the predetermined device 66. Can be suppressed. The repellent range display object 77 may have the same shape as the indicator display object 72 and may have a dark color tone, as in the auxiliary display object 73 of FIG. 15, for example.

<Modification 1 of Embodiment 5>
The repellent range display object 77 in FIGS. 60 and 61 has a planar shape, but is not limited to this. For example, as shown in FIG. 62, the repellent range display object 77 may have a three-dimensional shape.

Further, also in the fifth embodiment, each embodiment and each modification thereof may be appropriately combined. For example, the detection range display object 71 according to the fifth embodiment may have a three-dimensional shape as shown in the modified example 4 (FIGS. 21 to 24) of the second embodiment. Further, the virtual image repellent range display object 77 may be three-dimensionally displayed as in the fourth embodiment.

<Modification 2 of Embodiment 5>
In the second modification, the predetermined device 66 (FIG. 59) includes a contact-type operation input device that can move with the vehicle so as to cause an inconvenience when the indicator comes into contact with the indicator. This operation input device includes, for example, a panel device in which buttons and switches are present, a touch panel, a touch pad, and the like.

FIG. 63 is a diagram showing a display object displayed on the display screen 60 of the projection display device 51a by the display control of the display control device 1 according to the present modification 2. As shown in FIG. 63, when the indicator is located within the repellent range 64, the generation control unit 12a is a repellent range display object in which the display mode of the range around the operation input device and the display mode of the other range are different. 77 is displayed. In FIG. 63, the range without dot hatching is the range around the operation input device.

According to such a configuration, it is possible to prevent the indicator from invading the periphery of the operation input device. When the range acquired by the spatial operation acquisition unit 11a is the range around the operation input device in the repellent range 64, the generation control unit 12a is the portion of the repellent range display object 77 corresponding to the range. The display mode of may be changed. Similarly, when the range acquired by the spatial operation acquisition unit 11a is a range other than the range around the operation input device in the repellent range 64, the generation control unit 12a has the range of the repellent range display object 77. The display mode of the portion corresponding to may be changed. Further, the range around the operation input device in the repellent range 64 may be set to be wider than the other range in the repellent range 64.

<Other variant 1>
FIG. 64 is a view of the detection range 21 according to the second embodiment along the direction from the front to the back (−Z direction in FIG. 2), and FIG. 65 is a view showing the detection range 21 according to the second embodiment. Is a view taken along the direction from the upper side to the lower side (-Y direction in FIG. 2). The detection range 21, the front detection range 22, the back detection range 23, and the lateral detection range 24 shown in FIGS. 64 and 65 are the ranges defined by the above equations (1) to (4). In addition, FIG. 64 and FIG. 65 also show the peripheral range 25 described in the second embodiment.

Here, the detection range 21, the front detection range 22, the back detection range 23, and the lateral detection range 24 are limited to the range shown in FIG. 64, and by extension, the range defined by the above equations (1) to (4). It's not a thing. For example, as shown in FIG. 66, for example, the lateral detection range 24 is a range obtained by hollowing out the detection range 21 from a range such as a cylinder or an elliptical cylinder in which the spatial operation detection device 52 can detect the position of the indicator. May be good. The ranges such as the detection range 21 and the lateral detection range 24 in FIG. 66 when viewed along the direction from the upper side to the lower direction (-Y direction in FIG. 2) are the same as the respective ranges in FIG. 65. It may or may not be different. Further, the lateral detection range 24 may be any range other than the cylindrical shape and the elliptical tubular shape as long as the above equation (4) is satisfied. Further, the lateral detection range 24 may be a range obtained by hollowing out the detection range 21 from the range of a sphere or an ellipsoid as long as the condition of Zd2 ≧ Zp4 ≧ Zd1 is satisfied. Further, the detection range 21 may be a range of a sphere or an ellipsoid.

<Other variants 2>
In the second embodiment, as shown in FIG. 64, the front detection range 22 or the back detection range 23 protrudes from the detection range 21 when viewed along the direction from the front to the back (−Z direction in FIG. 2). An example that is not in the range was explained. More specifically, an example in which the outer shape of the detection range 21, the front detection range 22, and the back detection range 23 are the same when viewed along the relevant direction has been described. However, the outer shapes of the detection range 21, the front detection range 22, and the back detection range 23 may be different.

67 and 68 are views of the detection range 21 according to the second modification as viewed from the same directions as those of FIGS. 64 and 65, respectively. In FIG. 67, of the front detection range 22 or the back detection range 23, the area that overlaps with the detection range 21 is defined as the first area, and the area that does not overlap is defined as the second area.

First, an example in which the present modification 2 is applied to the modification 1 of the second embodiment will be described. In this case, in the present modification 2, when the indicator is located in the second area, the display different from the display of the modification 1 of the second embodiment shown in FIGS. 9 to 12 is performed. For example, when the indicator is located in the first area of the front detection range 22, the same display as in FIG. 10 is performed, and when the indicator is located in the second area of the front detection range 22, FIG. 69 is displayed. Is displayed. Further, for example, when the indicator is located in the first area of the front detection range 23, the same display as in FIG. 11 is performed, and when the indicator is located in the second area of the back detection range 23, the same display is performed. , The display as shown in FIG. 70 is performed.

Next, an example in which the present modification 2 is applied to the modification 5 of the second embodiment will be described. In this case, in the present modification 2, when the indicator is located in the second area, the display different from the display of the modification 1 of the second embodiment shown in FIGS. 25 to 28 is performed.

For example, as shown in FIG. 71, when the indicator is located in the second area of the front detection range 22, the front surface of the detection range display object 71 which is a rectangular parallelepiped (dot hatching with high density in FIG. 71 is attached. A display object 78 indicating a second area, which is an extension of the surface), is added. At this time, the color tone of the indicator display object 72 is not changed from the default. On the other hand, for example, as shown in FIG. 72, when the indicator is located in the second area of the back detection range 23, the back surface of the detection range display object 71 which is a rectangular parallelepiped (dot hatching with high density in FIG. 72). A display object 78 indicating a second area, which is an extension of the attached surface), is added. At this time, at least a part of the color tone of the indicator display object 72 is changed from the default.

In FIG. 67, the outer shape of the lateral detection range 24 and the outer shape of the front detection range 22 or the back detection range 23 are the same, but may be different. Further, the outer shape of the front detection range 22 and the outer shape of the back detection range 23 may be different. Further, the front detection range 22 and the back detection range 23 are not limited to the range of the rectangular parallelepiped, but may be a range obtained by hollowing out the detection range 21 and the lateral detection range 24 from the range of the ellipsoid.

<Other variants 3>
The acquisition unit 11 and the control unit 12 of FIG. 1 described above are hereinafter referred to as “acquisition unit 11 and the like”. The acquisition unit 11 and the like are realized by the processing circuit 81 shown in FIG. 73. That is, the processing circuit 81 includes the acquisition unit 11 that acquires the range in which the indicator is located among the detection range, the front detection range, and the back detection range, and the detection range, the front detection range, and the back detection range. A control unit 12 that controls the display of the display object including the detection range display object and the indicator display object to be different based on the range acquired by the acquisition unit 11 is provided. Dedicated hardware may be applied to the processing circuit 81, or a processor that executes a program stored in the memory may be applied to the processing circuit 81. The processor corresponds to, for example, a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), and the like.

When the processing circuit 81 is dedicated hardware, the processing circuit 81 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate). Array), or a combination of these. Each of the functions of each part such as the acquisition unit 11 may be realized by a circuit in which processing circuits are dispersed, or the functions of each part may be collectively realized by one processing circuit.

When the processing circuit 81 is a processor, the functions of the acquisition unit 11 and the like are realized by combining with software and the like. The software or the like corresponds to, for example, software, firmware, or software and firmware. Software and the like are described as programs and stored in memory. As shown in FIG. 74, the processor 82 applied to the processing circuit 81 realizes the functions of each part by reading and executing the program stored in the memory 83. That is, when the display control device 1 is executed by the processing circuit 81, the step of acquiring the range in which the indicator is located among the detection range, the front detection range, and the back detection range, the detection range, and the front detection range. , And, of the back detection range, the step of controlling the display of the display object including the detection range display object and the indicator display object to be different based on the acquired range is executed as a result. A memory 83 for storing the program is provided. In other words, it can be said that this program causes the computer to execute the procedure or method of the acquisition unit 11 or the like. Here, the memory 83 is, for example, non-volatile such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read Only Memory). Volatile semiconductor memory, HDD (Hard Disk Drive), magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), its drive device, etc., or any storage medium used in the future. You may.

The configuration in which each function of the acquisition unit 11 and the like is realized by either hardware or software has been described above. However, the present invention is not limited to this, and a configuration may be configured in which a part of the acquisition unit 11 or the like is realized by dedicated hardware and another part is realized by software or the like. For example, the acquisition unit 11 realizes its function by a processing circuit 81 as dedicated hardware, an interface, a receiver, and the like, and other than that, the processing circuit 81 as a processor 82 reads a program stored in the memory 83. It is possible to realize the function by executing it.

As described above, the processing circuit 81 can realize each of the above-mentioned functions by hardware, software, or a combination thereof.

Further, the display control device 1 described above includes a vehicle device such as a PND (Portable Navigation Device), a navigation device, and an audio device, a communication terminal including a mobile terminal such as a mobile phone, a smartphone, and a tablet, and the vehicle device and communication. It can also be applied to a display control system constructed as a system by appropriately combining a function of an application installed on at least one of terminals and a server. In this case, each function or each component of the display control device 1 described above may be distributed and arranged in each device for constructing the system, or may be centrally arranged in any of the devices. good.

FIG. 75 is a block diagram showing the configuration of the server 91 according to this modification. The server 91 of FIG. 75 includes a communication unit 91a and a control unit 91b, and can perform wireless communication with a vehicle device 93 such as a navigation device and an audio device of the vehicle 92.

The communication unit 91a, which is an acquisition unit, receives the range acquired by the vehicle device 93 among the detection range, the front detection range, and the back detection range by performing wireless communication with the vehicle device 93.

The control unit 91b has the same function as the control unit 12 of FIG. 1 by having a processor (not shown) of the server 91 or the like execute a program stored in a memory (not shown) of the server 91. That is, the control unit 91b displays the display object including the detection range display object and the indicator display object based on the range received by the communication unit 91a among the detection range, the front detection range, and the back detection range. Generate a control signal to control the difference. Then, the communication unit 91a transmits the control signal generated by the control unit 91b to the vehicle device 93. According to the server 91 configured in this way, the same effect as that of the display control device 1 described in the first embodiment can be obtained.

FIG. 76 is a block diagram showing the configuration of the communication terminal 96 according to this modification. The communication terminal 96 of FIG. 76 includes a communication unit 96a similar to the communication unit 91a and a control unit 96b similar to the control unit 91b, and can perform wireless communication with the vehicle device 98 of the vehicle 97. ing. The communication terminal 96 is, for example, a mobile terminal such as a mobile phone, a smartphone, or a tablet carried by the driver of the vehicle 97. According to the communication terminal 96 configured in this way, the same effect as that of the display control device 1 described in the first embodiment can be obtained.

In the present invention, each embodiment and each modification can be freely combined, and each embodiment and each modification can be appropriately modified or omitted within the scope of the invention.

Although the present invention has been described in detail, the above description is exemplary in all embodiments and the present invention is not limited thereto. It is understood that innumerable variations not illustrated can be assumed without departing from the scope of the present invention.

1 Display control device, 11 Acquisition unit, 12 Control unit, 51 First display device, 64 Repellent range, 71 Detection range display object, 72 Indicator display object, 73 Auxiliary display object, 77 Repellent range display object.

The display control device according to the present invention is a display control device that controls the display of the first display device that can be moved together with the vehicle, and has a detection range that is a predetermined space in which the user should perform a gesture operation by an indicator. Of the front detection range, which is a predetermined space on the user side with respect to the detection range, and the back detection range, which is a predetermined space on the opposite side of the front detection range with respect to the detection range, the indicator is A detection range display object indicating a detection range and an indicator based on the range acquired by the acquisition unit among the acquisition unit for acquiring the position range, the detection range, the front detection range, and the back detection range. The display of the display object including the indicated indicator display object is different , and the 3D position of the indicator and the 3D of the detection range are based on the positional relationship between the 3D position of the indicator and the 3D position of the detection range. and a control unit for performing a positional relationship that displays the control of the position.

Claims (19)

A display control device that controls the display of the first display device that can move with the vehicle.
A detection range that is a predetermined space in which the user should perform a gesture operation by an instruction body, a front detection range that is a predetermined space on the user side with respect to the detection range, and the above-mentioned detection range. Of the front detection range and the back detection range which is a predetermined space on the opposite side, the acquisition unit for acquiring the range in which the indicator is located and the acquisition unit.
A detection range display object indicating the detection range and an indicator display indicating the indicator based on the range acquired by the acquisition unit among the detection range, the front detection range, and the back detection range. A display control device including a control unit that controls display of display objects including objects. The display control device according to claim 1.
The display object has a three-dimensional shape generated by a pseudo three-dimensional graphics function or a three-dimensional graphics function, and the first display device is a display control device that executes a two-dimensional display. The display control device according to claim 1.
The control for changing the display of the display object is a display control device including a control for changing the display mode of the display object. The display control device according to claim 3.
The control for changing the display mode of the display object is a display control device including a control for changing the shape of the display object. The display control device according to claim 1.
The detection range display object has a three-dimensional shape, and the first display device is a display control device that executes three-dimensional display. The display control device according to claim 3.
The control for changing the display mode of the display object includes a control for changing the display mode of the detection range display object without changing the display mode of the indicator display object. The display control device according to claim 3.
The control for changing the display mode of the display object includes a control for changing the display mode of the indicator display object without changing the display mode of the detection range display object. The display control device according to claim 3.
The control for changing the display mode of the display object is a display control device including a control for changing the display mode of the detection range display object and the indicator display object. The display control device according to claim 1.
The acquisition unit
Of the detection range, the front detection range, the back detection range, and the lateral detection range which is a predetermined space on the side of the detection range other than the front detection range and the back detection range. Obtain the range in which the indicator is located and
The control unit
A display control device that controls the display of the display object to be different based on the range acquired by the acquisition unit among the detection range, the front detection range, the back detection range, and the lateral detection range. .. The display control device according to claim 4.
The control for changing the shape of the display object is a display control device including a control for changing the shape of the display object to either a planar shape or a three-dimensional shape. The display control device according to claim 1.
The display object is
A display control device further comprising an auxiliary display object indicating the distance between the detection range and the indicator. The display control device according to claim 1.
The acquisition unit
Of the first detection range and the second detection range included in the detection range, the range in which the indicator is located is acquired.
The control unit
A display control device that changes the display of the display object based on the range acquired by the acquisition unit among the first detection range and the second detection range. The display control device according to claim 1.
The acquisition unit
The indicator is acquired in a repellent range, which is a predetermined space around the detection range and around the predetermined device in the vehicle.
The control unit
A display control device that controls switching between display and non-display of a repellent range display object indicating the repellent range based on whether or not the range acquired by the acquisition unit is the repellent range. The display control device according to claim 13.
The predetermined device is a display control device including a contact-type operation input device that can move with the vehicle. The display control device according to claim 1.
The first display device includes a head-up display capable of planar display, an aerial display, a head-up display capable of stereoscopic display, an aerial display, or a display device having an autostereoscopic display function capable of stereoscopic display. Display control device. The display control device according to claim 1.
The first display device includes a head-up display capable of stereoscopic display, an aerial display, or a display device having a naked-eye stereoscopic display function capable of stereoscopic display.
The control for making the display of the display object different is the control of the three-dimensional display on the first display device based on the distance between the detection range display object stereoscopically displayed on the first display device and the user. A display control device that includes a control that changes the distance between an indicator display object and the user. The display control device according to claim 16.
The head-up display is
A head-up display in which the distances between a plurality of points on one display object and the user are all the same, or a head in which the distances between a plurality of points on the display object and the user are different. Display control devices, including up-displays. The display control device according to claim 1.
The display control device is
A display control device for displaying the content executed by the gesture operation on a second display device that can move with the vehicle. It is a display control method that controls the display of the first display device that can move with the vehicle.
A detection range that is a predetermined space in which the user should perform a gesture operation by an instruction body, a front detection range that is a predetermined space on the user side with respect to the detection range, and the above-mentioned detection range. Of the front detection range and the back detection range, which is a predetermined space on the opposite side, the range in which the indicator is located is acquired.
A display including a detection range display object indicating the detection range and an indicator display object indicating the indicator based on the acquired range of the detection range, the front detection range, and the back detection range. A display control method that controls the display of objects differently.

Images