JP2020067713A - Display controller, display system, method for controlling display, and display control program - Google Patents

Abstract

To provide a display controller which can avoid display information corresponding to the result of operations on an operation target apparatus from being displayed so as to be fixed to the display part of the operation target apparatus.SOLUTION: The controller of the device acquires the result of operations of an operation target apparatus by an operator, determines the position of displaying display information corresponding to the result of operations by projection, and displays the display information in the determined position by projection.SELECTED DRAWING: Figure 10

Description

  The present application relates to a technical field of a display control device that displays an operation result when an operation target device is operated.

  A device that provides a service to a user asks the user to set a predetermined setting item related to the service, and provides the service according to the setting content. At this time, the result of the operation for the user to make settings is generally displayed on the display unit included in the device (for example, Patent Document 1).

JP, 2014-238711, A

  However, in the technique described in Patent Document 1, the operation result is fixedly displayed on the display unit, which may be difficult for the operator to see.

  In view of such circumstances, the present invention provides a display control device and the like that can avoid displaying fixedly the display information corresponding to the operation result on the operation target device on the display unit of the operation target device. As an example.

  The invention according to claim 1 includes: an acquisition unit that acquires an operation result of an operation target device by an operator; a determination unit that determines a position at which display information corresponding to the operation result is displayed by projection; and the determination unit. Display control means for displaying the display information by projection at the determined position.

  The invention according to claim 11 is a display control method by a display control device, comprising an acquisition step of acquiring an operation result of an operation target device by an operator, and a position at which display information corresponding to the operation result is displayed by projection. And a display control step of displaying the display information by projection at the position determined by the determining step.

  According to a twelfth aspect of the present invention, the computer is configured to acquire an operation result of an operation target device operated by an operator, a determination unit that determines a position at which display information corresponding to the operation result is displayed by projection, and the determination unit. It is characterized by causing it to function as display control means for displaying the display information by projection at the position determined by.

It is a block diagram showing an example of composition of display control device 100 in an embodiment. It is a block diagram which shows the structural example of the vehicle-mounted apparatus 200 in 1st Example. It is a figure which shows an example of the hierarchy of the menu screen (menu operation guide image) in 1st Example. (A) is a diagram showing an example of a top menu operation screen 400 displayed on the display 214c in the first embodiment, and (B) is a left example of the top menu operation guide image in the first embodiment. It is a figure which shows a mode projected on the back of a hand. (A) is a diagram showing an example of an A / C menu operation screen 410 displayed on the display 214c in the first embodiment, and (B) is an operation of the A / C menu in the first embodiment. It is a figure which shows a mode that the example of a guide image was projected on the back of a left hand. (A) is a diagram showing an example of an operation screen 420 of the AUDIO menu displayed on the display 214c in the first embodiment, and (B) is an example of an operation guide image of the AUDIO menu in the first embodiment. It is a figure which shows a mode that it projected on the back of a left hand. (A) is a diagram showing an example of a NAVI menu operation screen 430 displayed on the display 214c in the first embodiment, and (B) is an example of a NAVI menu operation guide image in the first embodiment. It is a figure which shows a mode that it projected on the back of a left hand. (A) is a diagram showing an example of a destination menu operation screen 440 displayed on the display 214c in the first embodiment, (B) is a destination menu operation guide image in the first embodiment. It is a figure which shows a mode that one example was projected on the back of the left hand. 6 is a flowchart showing an example of display control processing by a control unit 211 in the first embodiment. 9 is a flowchart showing a part of display control processing by a control unit 211 in the second embodiment. FIG. 11 is a diagram showing a display example when displaying an image showing a trace line 371 on the back of the left hand in the second modification. 21 is a diagram showing a display example when an image representing the voice input notation 381 is displayed on the back of the left hand in Modification 3.

  A mode for carrying out the present invention will be described with reference to FIG.

  As shown in FIG. 1, the display control device 100 includes an acquisition unit 101, a determination unit 102, and a display control unit 103.

  The acquisition unit 101 acquires the operation result of the operation target device by the operator.

  The deciding means 102 decides the position where the display information corresponding to the operation result is displayed by projection.

  The display control means 103 causes the display information to be displayed by projection at the position determined by the determination means 102.

  According to the display control device 100, the position where the display information corresponding to the operation result is displayed by projection is determined, and the display information is displayed at the determined position by projection. Therefore, it is possible to avoid fixedly displaying the display information corresponding to the operation result on the display unit of the operation target device.

[1. First embodiment]
Next, a first example corresponding to the above-described embodiment will be described. The first embodiment described below is an embodiment in which the present invention is applied to an in-vehicle device 200 mounted on a vehicle.

[1.1. Configuration of in-vehicle apparatus 200]
The configuration of the in-vehicle apparatus 200 according to the first embodiment will be described with reference to FIG. As shown in FIG. 2, the in-vehicle apparatus 200 includes a control unit 211, a storage unit 212 including an HDD (Hard Disk Drive) and an SSD (Solid State Drive), and an input unit 213 including a keyboard, a remote controller, a touch panel, or the like. A display unit 214, a bus line 215, an input / output interface unit 220, a vehicle speed sensor 221, an angular velocity sensor 222, an acceleration sensor 223, a steering angle sensor 224, and a GNSS (Global Navigation Satellite System) receiving unit 225. A camera 226, a microphone 227, a speaker 228, and an air conditioner 229. The vehicle-mounted device 200 is also connected to the projector 250. The projector 250 projects the designated image at the designated position based on the control information and the image information received from the control unit 211.

  The storage unit 212 stores information for the display unit 214 and the projector 250 to display an image. For example, an operation screen for touch operation and an image for displaying an operation guide image for gesture operation are stored. The storage unit 212 also stores map data for displaying a map, map information used when searching a route, road link information, and the like for navigation. Further, the storage unit 212 stores sound information for outputting a voice or a music used for navigation. Furthermore, the storage unit 212 stores various programs such as an operating system and application programs. In particular, the storage unit 212 stores a display control program for displaying the operation guide image on the projector 250. The various programs may be acquired from a server device or the like via a network, or may be read from programs recorded in a recording medium such as a CD, a DVD, or a USB memory.

  The input unit 213 receives a user's input operation and transmits an operation signal indicating the operation content to the control unit 211.

  The display unit 214 displays an image based on the image information under the control of the control unit 211. The display unit 214 includes a graphics controller 214a, a buffer memory 214b including a memory such as VRAM (Video RAM), a display 214c including a liquid crystal display, and the like. In this configuration, the graphics controller 214a controls the entire display unit 214 based on the control information sent from the control unit 211 via the bus line 215. Further, the buffer memory 214b temporarily stores image information that can be displayed immediately. Then, an image is displayed on the display 214c based on the image information output from the graphics controller 214a. The display 214c has a touch panel function, detects a touch on the display 214c, and transmits a touch position signal indicating the touched position to the control unit 211. That is, the display 214c may function as a part of the input unit 213. Then, the control unit 211 identifies the operation content from the correspondence relationship between the position indicated by the touch position signal and the display content displayed at the touched position.

  The vehicle speed sensor 221 detects the current speed of the vehicle using speed detection processing or the like using a vehicle speed pulse or the like acquired from the vehicle in which the in-vehicle apparatus 200 is mounted, and outputs speed data. The angular velocity sensor 222 detects, for example, the angular velocity of the direction change of the vehicle, and outputs the angular velocity data and the relative azimuth data per unit time. The acceleration sensor 223 detects, for example, the acceleration in the front-rear direction of the vehicle and outputs acceleration data per unit time or the like. The steering angle sensor 224 detects the steering angle of the vehicle and outputs steering angle data and the like. The GNSS receiving unit 225 receives navigation radio waves from GNSS satellites and outputs GNSS positioning data.

  The camera 226 photographs the inside of the vehicle and transmits camera image information indicating the photographed image to the control unit 211.

  The microphone 227 converts into microphone voice information indicating the voice of the passenger riding in the vehicle and transmits the microphone voice information to the control unit 211.

  The speaker 228 outputs sound based on the electric signal received from the control unit 211. The control unit 211 controls the sound and volume output from the speaker 228 by generating an electric signal to be transmitted to the speaker 228 based on the sound data and the set volume setting.

  The air conditioner 229 is configured to include a control unit, a compressor, an expansion valve, an evaporator, a condenser, a receiver tank, and the like, and based on the air volume information and the temperature information received from the control unit 211, the air volume information indicated by the air volume information is controlled. , The temperature inside the vehicle is controlled by the temperature information.

  The control unit 211 includes a CPU 211a that controls the entire control unit 211, a ROM 211b in which a control program for controlling the control unit 211 is stored in advance, and a RAM 211c that temporarily stores various data. Then, the CPU 211a functions as various means by reading and executing various programs stored in the ROM 211b and the storage unit 212. The control unit 211 or the CPU 211a corresponds to a “computer”.

  The control unit 211 includes a vehicle speed sensor 221, an angular velocity sensor 222, an acceleration sensor 223, a steering angle sensor 224, a GNSS receiving unit 225, a camera 226, a microphone 227, a speaker 228, an air conditioner 229, a bus line 215, and an input / output interface unit 220. Connected through.

  The control unit 211 performs satellite positioning based on GNSS positioning data, independent positioning based on speed data, angular velocity data, relative azimuth data, acceleration data, steering angle data, or hybrid positioning that combines these, and the like. The current position information indicating the current position (latitude, longitude, altitude) of is acquired. Then, when the destination is set, the control unit 211 searches for a route from the current position to the destination and guides the route.

  The control unit 211 causes the vehicle-mounted device 200 to function as a navigation device, outputs a sound by transmitting an electric signal to the speaker 228, and causes the vehicle-mounted device 200 to function as an audio device. On the other hand, by transmitting the air volume information and the temperature information, the air volume and the temperature in the vehicle compartment are changed, and the processing for causing the vehicle-mounted device 200 to function as the air conditioner is executed. Then, the control unit 211 receives an operation by a touch on the display 214c or an operation by a gesture with respect to these functions.

  Specifically, the control unit 211 causes the display 214c to display an operation screen for the operator to perform an operation by touch, and displays an operation guide image for the operator to perform an operation by a gesture on the human body of the operator. For example, it is projected by the projector 250 and displayed on the section. The part of the human body referred to here can be a part for performing a gesture (for example, left hand, right hand, left foot, right foot). In addition, it is preferable that the position of the gesture is particularly visible to the operator (for example, when performing the gesture with the left hand, the back of the left hand or the surface of the palm facing the operator's face). In this embodiment, the operation guide image is projected and displayed on the operator's left hand. Therefore, the control unit 211 analyzes the camera image information using a known image analysis program, always specifies the position and orientation of the left hand of the operator, and stores the left hand information indicating the position and orientation in the RAM 211c and the storage unit 212. Record. In addition, the control unit 211 always detects a gesture made by the operator by analyzing the camera image information, and executes processing according to the operation corresponding to the gesture. The detection of the gesture is not limited to the analysis of the camera image information, and the detection may be performed using an optical sensor or the like. In addition, the operation guide image displays a symbol, a pattern, or the like indicating a method of a gesture corresponding to an operation that can be performed at that time. Further, the operation guide image may be a still image or a moving image, and in this embodiment, a case where it is a still image will be described.

The control unit 211 is an operation screen and an operation guide image that are paired with each other so that the operator can perform both a touch operation and a gesture operation, and an operation screen indicating an operation that can be performed at that time. And the operation guide image are displayed at the same time. This allows the operator to, for example, perform two-step operation when
(1) Touch operation in the first step, gesture operation in the second step,
(2) Touch operation in the first step, touch operation in the second step,
(3) Gesture operation in the first step, touch operation in the second step,
(4) Gesture operation in the first step, gesture operation in the second step,
It can be any of Note that the operation screen and the operation guide image may not be always displayed at the same time, but the operation guide image may be displayed, for example, when a predetermined condition is satisfied. For example, a gesture for displaying the operation guide image may be set in advance, and the control unit 211 may display the operation guide image only when the gesture is detected.

  Here, the hierarchy of the menu displayed as the operation screen or the operation guide image will be described with reference to FIG. FIG. 3 is a diagram showing an example of a menu hierarchy. As shown in FIG. 3, a top menu is provided as the highest layer, and an A / C menu, an AUDIO menu, and a NAVI menu are provided as the second layer below the top menu, and the third layer is one layer below the NAVI menu. As a destination menu is provided. In this embodiment, operation screens and operation guide images corresponding to the respective menus are displayed. The operation screens and operation guide images corresponding to the respective menus will be described below with reference to FIGS.

  FIG. 4A is a diagram showing an example of a top menu operation screen 400 displayed on the display 214c in the first embodiment, and FIG. 4B is a top menu operation guide image in the first embodiment. It is a figure which shows a mode that one example was projected on the back of the left hand.

  As shown in FIG. 4A, the operation screen 400 and the operation guide image respectively corresponding to the top menu are operated by the controller 211 for displaying the top menu by the operator (sometimes referred to as “top menu display operation”). Is displayed when is detected. The method by which the control unit 211 detects the top menu display operation does not matter. For example, the control unit 211 detects a touch on a top menu display button (not shown), detects microphone voice information indicating a voice indicating a top menu display operation, or detects a gesture indicating a top menu display operation as camera image information. It is possible to detect the top menu display operation based on the detection based on the above. When the top menu display operation is performed by a gesture, an operation guide image corresponding to the top menu or the like may be displayed on the body part where the gesture is performed.

  The operation screen 400 corresponding to the top menu includes an A / C button 401, an AUDIO button 402, and a NAVI button 403. When the portion where the A / C button 401 is displayed is touched, the control unit 211 causes the display 214c to display the operation screen corresponding to the A / C menu and operates the operation guide image corresponding to the A / C menu. It is projected and displayed on the left hand of the worker. When the portion where the AUDIO button 402 is displayed is touched, the control unit 211 causes the display 214c to display the operation screen corresponding to the AUDIO menu, and the operation guide image corresponding to the AUDIO menu is displayed on the left hand of the operator. Projected display. Further, when the portion where the NAVI button 403 is displayed is touched, the control unit 211 causes the display 214c to display the operation screen corresponding to the NAVI menu, and the operation guide image corresponding to the NAVI menu is displayed on the left hand of the operator. Projected display.

  As shown in FIG. 4B, the operation guide image corresponding to the top menu includes an arrow 301A, a left-hand symbol 301B, and a NAVI notation 301C indicating a gesture method corresponding to the operation for displaying the NAVI menu. The arrow 301A and the left-hand symbol 301B indicate that the operation method for displaying the NAVI menu is to raise one index finger of the left hand and move it counterclockwise. The NAVI notation 301C is displayed in the vicinity of the arrow 301A and the left-hand symbol 301B, and indicates that these indicate an operation method for displaying the NAVI menu. When the control unit 211 detects the gesture corresponding to the operation for displaying the NAVI menu, the control unit 211 displays the operation screen corresponding to the NAVI menu on the display 214c and projects the operation guide image corresponding to the NAVI menu on the left hand of the operator. Display it.

  Further, the operation guide image corresponding to the top menu includes an arrow 302A, a left-hand pattern 302B, and an AUDIO notation 302C indicating a gesture method corresponding to the operation for displaying the AUDIO menu. The arrow 302A and the left-hand symbol 302B indicate that the operation method for displaying the AUDIO menu is to raise one index finger of the left hand and move it up and down. The AUDIO notation 302C is displayed in the vicinity of the arrow 302A and the left-hand symbol 302B, and indicates that these indicate an operation method for displaying the AUDIO menu. When the control unit 211 detects a gesture corresponding to the operation for displaying the AUDIO menu, the control unit 211 displays an operation screen corresponding to the AUDIO menu on the display 214c and projects an operation guide image corresponding to the AUDIO menu on the left hand of the operator. Display it.

  Further, the operation guide image corresponding to the top menu includes an arrow 303A, a left hand pattern 303B, and an A / C notation 303C indicating a gesture method corresponding to the operation for displaying the A / C menu. The arrow 303A and the left-hand symbol 303B indicate that the operation method for displaying the A / C menu is to raise one index finger of the left hand and move it to the left and right. The A / C notation 303C is displayed in the vicinity of the arrow 303A and the left-hand symbol 303B to indicate that these indicate an operation method for displaying the A / C menu. When detecting the gesture corresponding to the operation for displaying the A / C menu, the control unit 211 causes the display 214c to display the operation screen corresponding to the A / C menu and displays the operation guide image corresponding to the A / C menu. Project it on the left hand of the operator.

  FIG. 5A is a diagram showing an example of the operation screen 410 of the A / C menu displayed on the display 214c in the first embodiment, and FIG. 5B is a view showing A / C in the first embodiment. It is a figure which shows a mode that the example of the operation guide image of C menu was projected on the back of the left hand.

  The operation screen 410 and the operation guide image respectively corresponding to the A / C menu are displayed when the control unit 211 detects a touch on the portion where the A / C button 401 is displayed by the operator, or when the A / C menu is displayed. Displayed when a gesture corresponding to the operation for displaying is detected.

  As shown in FIG. 5A, the operation screen 410 corresponding to the A / C menu has an ON button 411A, an OFF button 411B, an air volume UP button 412A, an air volume DOWN button 412B, an air volume indicator 412C, a temperature UP button 413A, and a temperature. It includes a DOWN button 413B, a temperature indicator 413C, and a top button T. When the portion where the ON button 411A is displayed is touched, the control unit 211 operates the air conditioning equipment 229, and when the portion where the OFF button 411B is displayed is touched, the control portion 211 stops the air conditioning equipment 229. Further, when the portion where the air volume UP button 412A is displayed is touched, the control unit 211 transmits air volume information indicating the air volume increased by one step from the air volume at that time to the air conditioner 229, and the air volume indicator 412C displays. When the memory is incremented by 1 and the portion where the air volume DOWN button 412A is displayed is touched, the air volume information indicating the air volume reduced by one stage from the air volume at that time is transmitted to the air conditioner 229, and the air volume indicator 412C. Decrease your memory by 1. Further, when the portion where the temperature UP button 413A is displayed is touched, the control unit 211 transmits temperature information indicating a temperature increased by 1 ° C. from the temperature at that time to the air conditioner 229, and the temperature indicator 413C displays. When the indicated temperature is incremented by 1 ° C. and the portion where the temperature DOWN button 413A is displayed is touched, the temperature information indicating the temperature reduced by 1 ° C. from the temperature at that time is transmitted to the air conditioner 229, and The temperature indicated by the temperature indicator 413C is subtracted by 1 ° C. Furthermore, when the portion where the top button T is displayed is touched, the control unit 211 causes the display 214c to display the operation screen corresponding to the top menu 400, and the operation guide image corresponding to the top menu is displayed on the left hand of the operator. It is projected and displayed (hereinafter, the same applies to the top button T on other operation screens). The air volume indicator 412C indicates the set air volume. In addition, the temperature indicator 413C indicates the set temperature.

  As shown in FIG. 5B, the operation guide image corresponding to the A / C menu includes an arrow 311A and a left-hand design 311B indicating a gesture method corresponding to the operation for operating the air conditioner 229. The arrow 311A and the left-hand pattern 311B indicate that the operation method for operating the air conditioner 229 is to raise one index finger of the left hand and move it up and down. The ON notation 311C is displayed in the vicinity of the arrow 311A and the left-hand symbol 311B to indicate that these indicate an operation method for operating the air conditioner 229. When the control unit 211 detects a gesture corresponding to an operation for operating the air conditioning equipment 229, the control unit 211 transmits control information for operating the air conditioning equipment 229 to the air conditioning equipment 229.

  The operation guide image corresponding to the A / C menu includes an arrow 312A and a left-hand design 311B indicating a gesture method corresponding to the operation for stopping the air conditioner 229. An arrow 312A and a left-hand pattern 311B indicate that the operation method for stopping the air conditioner 229 is to raise one index finger of the left hand and move it to the left and right. The OFF notation 312C is displayed in the vicinity of the arrow 312A and the left-hand symbol 311B, and indicates that these indicate an operation method for stopping the air conditioner 229. When detecting the gesture corresponding to the operation for stopping the air conditioning equipment 229, the control unit 211 transmits the control information for stopping the air conditioning equipment 229 to the air conditioning equipment 229. Note that in FIG. 5B, the left-hand design 311B is shared instead of displaying the left-hand design for each of the gestures corresponding to the operation for operating the air conditioner 229 and the operation for stopping the air-conditioning equipment 229. The left-hand design may be displayed on. Further, since it is not necessary to perform an operation for operating the air conditioning equipment 229 while the air conditioning equipment 229 is operating, the arrow 311A and the ON notation 311C may be hidden, and while the air conditioning equipment 229 is stopped, the air conditioning equipment 229 may be hidden. Since it is not necessary to perform the operation for stopping 229, the arrow 312A and the OFF notation 312C may be hidden.

  Further, the operation guide image corresponding to the A / C menu includes an arrow 313A and a left-hand design 313B indicating a gesture method corresponding to the operation for changing the temperature. The arrow 313A and the left-hand pattern 313B indicate that the operation method for changing the temperature is to set two index fingers and the middle finger of the left hand and move them clockwise or counterclockwise. UP notation 313C indicates that clockwise indicates an operation method for increasing the temperature, while DOWN notation 313D indicates an operation method for counterclockwise decreasing the temperature. It means that there is. When the control unit 211 detects a gesture corresponding to an operation for raising the temperature, the control unit 211 transmits temperature information indicating a temperature increased by 1 ° C. from the temperature at that time to the air conditioning device 229, and the temperature indicated by the temperature indicator 313E. On the other hand, when a gesture corresponding to the operation for lowering the temperature is detected, the temperature information indicating the temperature reduced by 1 ° C. from the temperature at that time is transmitted to the air conditioner 229, and the temperature indicator 313E displays Subtract 1 ° C from the indicated temperature. The temperature indicator 313E indicates the set temperature.

  Furthermore, the operation guide image corresponding to the A / C menu includes an arrow 314A and a left-hand design 314B indicating a gesture method corresponding to the operation for changing the air volume. The arrow 314A and the left-hand pattern 314B indicate that the method of operation for changing the air volume is to raise one index finger of the left hand and move it clockwise or counterclockwise. UP notation 314C indicates that clockwise indicates an operation method for increasing the air volume, while DOWN notation 314D indicates that counterclockwise indicates an operation method for lowering the air volume. Is represented. When detecting the gesture corresponding to the operation for increasing the air volume, the control unit 211 transmits the air volume information indicating the air volume increased by one step from the air volume at that time to the air conditioner 229, and stores the memory instructed by the air volume indicator 314E. On the other hand, when a gesture corresponding to an operation for increasing the air volume is detected by 1, the air volume information indicating the air volume reduced by one step from the air volume at that time is transmitted to the air conditioner 229, and the memory indicated by the air volume indicator 314E. Decrease by 1. The air volume indicator 314E indicates the set air volume.

  FIG. 6A is a diagram showing an example of the operation screen 420 of the AUDIO menu displayed on the display 214c in the first embodiment, and FIG. 6B is the operation of the AUDIO menu in the first embodiment. It is a figure which shows a mode that the example of a guide image was projected on the back of a left hand.

  The operation screen 420 and the operation guide image respectively corresponding to the AUDIO menu are used when the control unit 211 detects a touch on the part where the AUDIO button 402 is displayed by the operator, or when an operation for displaying the AUDIO menu is performed. Displayed when the corresponding gesture is detected.

  As shown in FIG. 6A, the operation screen 420 corresponding to the AUDIO menu has a play button 421A, a stop button 421B, a feed button 421C, a return button 421D, a volume UP button 422A, a volume DOWN button 422B, a volume indicator 423, It includes a volume bar 424, and a music notation 425 and a top button T. The control unit 211 plays the song when the portion where the play button 421A is displayed is touched, and stops the playing of the song when the portion where the stop button 421B is displayed is touched. Also, the control unit 211 switches the song to be played to the next song when the portion where the feed button 421C is displayed is touched, and when the portion where the return button 421D is displayed is touched, the control unit 211 plays the song. Replay the song inside from the beginning. Further, when the portion where the volume UP button 422A is displayed is touched, the control unit 211 raises the volume of the song to be played back and raises the volume instructed by the volume indicator 423 and the volume bar 424, while the volume DOWN. When the portion where the button 422B is displayed is touched, the volume of the song to be played back is lowered and the volume indicated by the volume indicator 423 and the volume bar 424 is lowered. The volume indicator 423 and the volume bar 424 indicate the set volume. Also, the song title 425 represents the song being played.

  As shown in FIG. 6 (B), the operation guide image corresponding to the AUDIO menu includes an arrow 321A and a left-hand symbol 321B indicating a gesture method corresponding to an operation for reproducing a song. The arrow 321A and the left-hand symbol 321B indicate that the operation method for reproducing the song is to raise one index finger of the left hand and move it up and down. The reproduction symbol 321C is displayed in the vicinity of the arrow 321A and the left-hand symbol 321B to indicate that these indicate an operation method for reproducing the music. When the control unit 211 detects the gesture corresponding to the operation for playing the song, the control unit 211 plays the song.

  Further, the operation guide image corresponding to the AUDIO menu includes an arrow 322A and a left-hand symbol 321B indicating a method of a gesture corresponding to the operation for stopping the reproduction of the music. The arrow 322A and the left-hand symbol 321B indicate that the operation method for stopping the reproduction of the music is to raise one index finger of the left hand and move it to the left and right. The stop symbol 322C is displayed in the vicinity of the arrow 322A and the left-hand symbol 321B to indicate that these indicate an operation method for stopping the reproduction of the music. When the control unit 211 detects the gesture corresponding to the operation for stopping the reproduction of the music, the control unit 211 stops the reproduction of the music. In FIG. 6 (B), the left-hand design 321B is shared instead of displaying the left-hand design for each of the gestures corresponding to the operation for playing the song and the operation for stopping the playback of the song. , The left-hand design may be displayed separately.

  Furthermore, the operation guide image corresponding to the AUDIO menu includes an arrow 323A and a left-hand symbol 323B indicating a method of gesture corresponding to the operation for changing the volume. The arrow 323A and the left-hand symbol 323B indicate that the operation method for changing the volume is to set two index fingers and the middle finger of the left hand and move them clockwise or counterclockwise. UP notation 323C indicates that clockwise indicates an operation method for increasing the volume, while DOWN notation 323D indicates that counterclockwise indicates an operation method for decreasing the volume. Is represented. When the control unit 211 detects the gesture corresponding to the operation for increasing the volume, the control unit 211 raises the volume and raises the volume instructed by the volume indicator 323E, while detecting the gesture corresponding to the operation for lowering the volume, The volume is lowered and the volume indicated by the volume indicator 323E is lowered. The volume indicator 323E indicates the set volume.

  Furthermore, the operation guide image corresponding to the AUDIO menu includes an arrow 324A and a left-hand symbol 324B indicating a gesture method corresponding to the music feed operation and the music return operation. The arrow 324A and the left-hand symbol 324B indicate that the method of the music feeding operation and the music returning operation moves the index finger of the left hand upright and moves it clockwise or counterclockwise. The feed notation 324C indicates that clockwise indicates the method of the music feed operation, while the return notation 324D indicates that counterclockwise indicates the method of the music return operation. When the control unit 211 detects the gesture corresponding to the music piece forwarding operation, it switches the music piece to be reproduced to the next music piece.

  FIG. 7 (A) is a diagram showing an example of the NAVI menu operation screen 430 displayed on the display 214c in the first embodiment, and FIG. 7 (B) is an operation of the NAVI menu in the first embodiment. It is a figure which shows a mode that the example of a guide image was projected on the back of a left hand.

  The operation screen 430 and the operation guide image respectively corresponding to the NAVI menu are used when the control unit 211 detects a touch on the portion where the NAVI button 403 is displayed by the operator, or when the operation for displaying the NAVI menu is performed. Displayed when the corresponding gesture is detected.

  As shown in FIG. 7A, the operation screen 430 corresponding to the NAVI menu includes a map, a current location button 431, a destination button 432, a home button 433, and a top button T. When the part where the current position button 431 is displayed is touched, the control unit 211 causes the display 214c to display an operation screen 430 including a map indicating the current position. Further, when the portion where the destination button 432 is displayed is touched, the control unit 211 causes the display 214c to display the operation screen corresponding to the destination menu, and the operator can display the operation guide image corresponding to the destination menu. It is projected and displayed on the left hand of. Further, when the portion where the home button 433 is displayed is touched, the control unit 211 starts route guidance to the home.

  As shown in FIG. 7B, the operation guide image corresponding to the NAVI menu includes an arrow 331A and a left-hand symbol 331B indicating a gesture method corresponding to an operation for starting route guidance to a home. The arrow 331A and the left-hand pattern 331B indicate that the operation method for starting the route guidance to the home is to set two index fingers and the middle finger of the left hand and move them counterclockwise. The home notation 331C is displayed in the vicinity of the arrow 331A and the left-hand symbol 331B to indicate that these indicate an operation method for starting route guidance to the home. When detecting a gesture corresponding to the operation for starting the route guidance to the home, the control unit 211 starts the route guidance to the home.

  Further, the operation guide image corresponding to the NAVI menu includes an arrow 332A and a left-hand symbol 332B indicating a gesture method corresponding to the operation for displaying the map showing the current location. The arrow 332A and the left-hand pattern 332B indicate that the operation method for displaying the map showing the current position is to raise one index finger of the left hand and move it up and down. The present location notation 332C is displayed in the vicinity of the arrow 332A and the left-hand symbol 332B to indicate that these indicate an operation method for displaying a map showing the present location. When the control unit 211 detects the gesture corresponding to the operation for displaying the map indicating the current position, the control unit 211 causes the display 214c to display the map indicating the current position.

  Furthermore, the operation guide image corresponding to the NAVI menu includes an arrow 333A and a left-hand symbol 333B indicating a gesture method corresponding to the operation for displaying the destination menu. The arrow 333A and the left-hand pattern 333B indicate that the method of operation for displaying the destination menu is to raise one index finger of the left hand and move it to the left and right. The destination notation 333C is displayed in the vicinity of the arrow 333A and the left-hand symbol 333B, and indicates that these indicate an operation method for displaying the destination menu. When detecting the gesture corresponding to the operation for displaying the destination menu, the control unit 211 causes the display 214c to display the operation screen corresponding to the destination menu and displays the operation guide image corresponding to the destination menu of the operator. Project it on the left hand.

  FIG. 8A is a diagram showing an example of a destination menu operation screen 440 displayed on the display 214c in the first embodiment, and FIG. 8B is a destination menu in the first embodiment. FIG. 6 is a diagram showing an example of the operation guide image of FIG.

  The operation screen 440 and the operation guide image respectively corresponding to the destination menu are displayed when the control unit 211 detects a touch on the portion where the destination button 432 is displayed by the operator, or to display the destination menu. This is displayed when the gesture corresponding to the operation of is detected.

  As shown in FIG. 8A, the operation screen 430 corresponding to the destination menu includes a history button 441, a telephone number button 442, a name button 443, and a top button T. When the portion where the history button 441 is displayed is touched, the control unit 211 presents the operator with the history of the point set or searched as the destination. For example, a list of history of points is presented on the display 214c so that one of the points can be selected, and the operator can set it as a destination. In addition, when the portion where the telephone number button 442 is displayed is touched, the control unit 211 presents the operator with a method for inputting the telephone number, and the operator inputs the telephone number to the destination. It is possible to search for a facility to be set and to set the facility as a destination. As a method for inputting a telephone number, a conventionally known method, for example, a method of displaying a ten key on the display 214c for touch input, or a method of inputting voice using the microphone 227 can be adopted. Further, when the portion where the name button 443 is displayed is touched, the control unit 211 presents the operator with a method for inputting the name, and the operator inputs the name to become the destination facility. Can be searched and the facility can be set as the destination. As a method for inputting the name, a conventionally known method, for example, a method of displaying the Japanese syllabary on the display 214c for touch input, or a method of inputting voice using the microphone 227 can be adopted.

  As shown in FIG. 8B, the operation guide image corresponding to the destination menu is an image (an example of “gesture information”) that identifies a portion of the human body that is moved by a gesture, and is an operator who is moved by the gesture. Including a symbol 341A corresponding to the ring finger of the left hand and a history notation 341B, a symbol 342A corresponding to the middle finger moved by the gesture and a telephone number notation 342B, and a symbol 343A corresponding to the index finger moved by the gesture and a name notation 343B. . Symbols 341A, 342A, and 343A indicate that operations relating to history display, telephone number input, and name input can be performed by a gesture of bending the corresponding finger. It should be noted that for the operator, in accordance with the operation guide image displayed on the left hand of the operator in advance, by bending the finger displaying the symbols 341A, 342A, 343A, the items indicated by the corresponding notations 341B, 342B, 343B. I will let you know that you can choose. When detecting the gesture of bending the ring finger, the control unit 211 presents the operator with the history of the point set or searched as the destination. For example, a list of history of points is presented on the display 214c so that one of the points can be selected, and the operator can set it as a destination. In addition, when the control unit 211 detects a gesture of bending the middle finger, the control unit 211 presents the operator with a method for inputting a telephone number. Thereby, the operator can search for the facility which is the destination by inputting the telephone number, and can set the facility as the destination. As a method for inputting a telephone number, a conventionally known method, for example, a method of displaying a ten key on the display 214c for touch input, or a method of inputting voice using the microphone 227 can be adopted. Further, when detecting the gesture of bending the index finger, the control unit 211 presents the operator with a method for inputting a name. Thus, the operator can search for the facility which is the destination by inputting the name, and can set the facility as the destination. As a method for inputting the name, a conventionally known method, for example, a method of displaying the Japanese syllabary on the display 214c for touch input, or a method of inputting voice using the microphone 227 can be adopted.

[1.2. Display Control Processing by Control Unit 211]
Next, the display control processing by the control unit 211 will be described using the flowchart shown in FIG. Note that FIG. 9 is a flowchart showing an example of display control processing by the control unit 211.

  First, when the control unit 211 detects a top menu display operation (step S101), it acquires left-hand information (step S102).

  Next, the control unit 211 specifies the position and orientation of the left hand of the operator based on the left hand information acquired in step S102, and uses the projector 250 to display an operation guide image corresponding to the top menu on the back or palm of the left hand of the operator. The image is projected and displayed (step S103).

  Next, the control unit 211 causes the display 214c to display the operation screen 400 corresponding to the top menu (step S104).

  Next, the control unit 211 detects a touch on the operation screen or a gesture (step S105). Specifically, the control unit 211 touches a portion where any one of the A / C button 401, the AUDIO button 402, and the NAVI button 403 is displayed, or selects one of the A / C menu, the AUDIO menu, and the NAVI menu. The gesture corresponding to the operation for displaying is detected.

  Next, the control unit 211 determines whether NAVI has been selected (step S106). Specifically, the control unit 211 determines whether or not the touch on the portion where the NAVI button 403 is displayed or the gesture corresponding to the operation for displaying the NAVI menu is detected in the process of step S105. .

  When the control unit 211 determines that NAVI is not selected (that is, A / C or AUDIO is selected) in the process of step S106 (step S106: NO), the control unit 211 acquires left-hand information, and the operator The operation guide image corresponding to either the A / C menu or the AUDIO menu selected by the operator is displayed on the left hand of (step S107). Next, the control unit 211 causes the display 214c to display an operation screen corresponding to either the A / C menu or the AUDIO menu selected by the operator (step S108). Next, the control unit 211 detects a touch or gesture on the operation screen (step S109), and shifts to the processing of step S117.

  On the other hand, when the control unit 211 determines that NAVI is selected in the process of step S106 (step S106: YES), it acquires left-hand information and projects an operation guide image corresponding to the NAVI menu on the operator's left hand. The image is projected and displayed by the machine 250 (step S110). Next, the control unit 211 causes the display 214c to display the operation screen 430 corresponding to the NAVI menu (step S111). Next, the control unit 211 detects a touch or a gesture on the operation screen (step S112).

  Next, the control unit 211 determines whether or not the destination has been selected (step S113). Specifically, the control unit 211 determines whether or not a gesture corresponding to the touch on the portion where the destination button 432 is displayed or the operation for displaying the destination menu is detected in the process of step S112. judge.

  When the control unit 211 determines in the process of step S113 that the destination is not selected (that is, the current position or the home is selected) (step S113: NO), the control unit 211 proceeds to the process of step S117.

  On the other hand, when the control unit 211 determines that the destination has been selected in the process of step S113 (step S113: YES), the left hand information is acquired and the operation guide image corresponding to the destination menu is displayed on the left hand of the operator. Is projected and displayed by the projector 250 (step S114). Next, the control unit 211 causes the display 214c to display the operation screen 440 corresponding to the destination menu (step S115). Next, the control unit 211 detects a touch or a gesture on the operation screen (step S116), and shifts to the processing of step S117.

  Next, the control unit 211 executes processing corresponding to the operation corresponding to the touch or gesture detected in the processing of step S105, the processing of step S109, the processing of step S112, or the processing of step S116 (step S117). For example, when the control unit 211 detects a touch on a portion where the temperature UP button 413A of the operation screen 410 (FIG. 5A) corresponding to the A / C menu is detected, or A When the operation guide image (FIG. 5 (B)) corresponding to the / C menu is displayed, when the gesture of moving the index finger and the middle finger of the left hand upright and moving clockwise is detected, the air conditioner 229 is detected. Then, a process of transmitting temperature information indicating a temperature increased by 1 ° C. from the temperature at that time is executed. Further, when the control unit 211 detects a touch on a portion of the operation screen 430 (FIG. 7A) corresponding to the NAVI menu, where the current location button 431 is displayed, or the operation guide image corresponding to the NAVI menu ( 7 (B)) is displayed, if a gesture of raising one index finger of the left hand and moving up and down is detected, an operation screen 430 including a map showing the current position is displayed on the display 214c. Execute the process.

  Next, the control unit 211 acquires the left-hand information and displays the result of the touch or gesture operation detected by the process of step S105, the process of step S109, the process of step S112, or the process of step S116 on the left hand of the operator. The corresponding operation result information is projected by the projector 250 and displayed (step S118). For example, when the control unit 211 executes the process of transmitting the temperature information indicating the temperature obtained by adding 1 ° C. to the current set temperature in the process of step S117 to the air conditioner 229, the controller 211 indicates that the set temperature is added by 1 ° C. In order to display the operation result information shown, the set temperature indicated by the temperature indicator 313E is added by 1 ° C. and displayed.

  Next, the control unit 211 causes the display 214c to display the operation result information corresponding to the result of the operation by the touch or gesture detected in the process of step S105, the process of step S109, the process of step S112, or the process of step S116 ( Step S119). For example, when the control unit 211 executes the process of transmitting the temperature information indicating the temperature obtained by adding 1 ° C. to the current set temperature in the process of step S117 to the air conditioner 229, the controller 211 indicates that the set temperature is added by 1 ° C. In order to display the operation result information shown, the set temperature indicated by the temperature indicator 413C is added by 1 ° C. and displayed.

  Next, the control unit 211 determines whether or not a touch or gesture is further detected (step S120). When the control unit 211 determines that a touch or gesture is further detected (step S120: YES), the control unit 211 proceeds to the process of step S117. For example, the control unit 211 detects the gesture corresponding to the operation for raising the temperature in the process of step S109, and based on the detection of the gesture, the temperature information indicating the temperature obtained by adding 1 ° C. to the current set temperature in the process of step S117. If it is determined that the gesture corresponding to the operation for raising the temperature is further detected after the process of transmitting the temperature to the air conditioner 229 is added, 1 ° C. is added to the current set temperature again in the process of step S117. The temperature information indicating the temperature is transmitted to the air conditioner 229, the set temperature indicated by the temperature indicator 313E is increased by 1 ° C. and displayed (step S118), and the set temperature indicated by the temperature indicator 413C is increased by 1 ° C. Are displayed (step S119). That is, the set temperature is increased by 2 ° C. by repeating the processing of steps S117 to 119 twice. On the other hand, when the control unit 211 determines that the gesture is not further detected (step S120: NO), the display control process by the control unit 211 ends.

[2. Second embodiment]
Next, a second example corresponding to the above-described embodiment will be described. Since the second embodiment described below is substantially the same as the first embodiment, differences from the first embodiment will be mainly described, and the same members and processes as those of the first embodiment are the same. Description will be given using reference numerals.

  In the first embodiment, the control unit 211 of the in-vehicle apparatus 200 performs the processing of step S105, the processing of step S109, the processing of step S112, or the processing of step S116 on the left hand of the operator in the processing of step S118 of FIG. The operation result information corresponding to the operation result by the detected touch or gesture was displayed. On the other hand, the control unit 211 in the second embodiment performs the process of determining the display position for displaying the operation result information, and then displays the operation result information at the display position determined by the process. The process will be described below with reference to FIG. FIG. 11 is a flowchart showing a part of the display control process (the part different from the display control process of the first embodiment (step S118)) by the control unit 211 in the second embodiment.

  As shown in FIG. 10, the control unit 211 follows the process of step S117 of FIG. 9 and then the operation result by the touch or gesture detected in the process of step S105, the process of step S109, the process of step S112, or the process of step S116. The display position for displaying the operation result information corresponding to is determined (step S201).

  Next, the control unit 211 causes the projector 250 to project and display the operation result information at the display position determined in the process of step S201 (step S202), and proceeds to the process of step S119 of FIG.

  Next, regarding the processing of step S201, a display position determination method that is a method for the control unit 211 to determine the display position for displaying the operation result information will be described.

  First, in the first display position determination method, the display position is the position (where the line of sight is focused) seen by the operator or fellow passenger (a person who is in the vehicle equipped with the in-vehicle apparatus 200). A certain viewpoint). In the first display position determination method, the control unit 211 specifies the viewpoint of the operator or fellow passenger and determines the viewpoint as the display position. As a method of specifying the viewpoint, for example, a conventionally known method such as a method of analyzing camera image information from the camera 226 that captures the face (especially eyes) of the operator or the passenger can be adopted. Note that the control unit 211 detects the presence of the fellow passenger and the viewpoint of the fellow passenger by analyzing the camera image information.

  The second display position determination method is a method of setting the display position in the vicinity of the operation target device (within a predetermined range from the operation target device). For example, the display position may be determined at a position within 30 cm from the vehicle-mounted device 200. Further, when the vehicle-mounted device 200 is embedded in the instrument panel of the vehicle, any part of the instrument panel may be determined. May be determined as the display position. At this time, it is preferable to determine a portion where the image projected by the projector 250 is easy to see.

  The third display position determination method is a method of setting the display position so that the operator and fellow passengers can easily see it. For example, to make it easy for the operator to see, the ceiling above the passenger or passenger, the door or window on the side of the passenger or passenger, or a part of the passenger or passenger's body (For example, the upper limb, the lower limb (thigh), etc.) may be determined as the display position. Further, the back portion of the seat in front of the passenger may be determined as the display position so that the passenger riding in the rear seat can easily see the passenger. For these positions, position information indicating the positions may be stored in the storage unit 212 in advance, or the camera image information from the camera 226 that captures the inside of the vehicle may be analyzed and specified.

  Note that the control unit 211 may determine the display position by selecting at least one of the positions listed in the first display position determination method to the third display position determination method. . In addition, the control unit 211 may determine a plurality of display positions and simultaneously display the operation result information at these display positions.

  As described above, in the in-vehicle apparatus 200 according to the second embodiment, the control unit 211 (“acquisition unit”, “determination unit”, “display control unit”) has the in-vehicle apparatus 200 (“operation target device”) operated by the operator. Of the operation result), the position at which the operation result information (an example of “display information”) corresponding to the operation result is displayed by projection is determined, and the operation result information is displayed at the determined position by projection.

  Therefore, according to the in-vehicle apparatus 200 in the second embodiment, the position at which the operation result information is displayed by projection is determined, and the operation result information is displayed at the determined position by projection. Therefore, it is possible to avoid fixedly displaying the operation result information on the display 214c of the in-vehicle apparatus 200.

  In addition, the control unit 211 of the in-vehicle apparatus 200 according to the second embodiment can determine a part of the human body of the operator as the position where the operation result information is displayed. This makes it easier for the operator to see the operation result information. Further, when the control unit 211 determines the upper limb of the operator at the position where the operation result information is displayed, the operator can more easily see the operation result information.

  Further, the control unit 211 (an example of “viewpoint detecting means”) of the vehicle-mounted apparatus 200 in the second embodiment detects a viewpoint where the operator's line of sight is focused, and sets the detected viewpoint as the operation result. The position to display the information can be determined. In this case, since the operation result information is displayed where the operator's line of sight is focused, the operator can easily see the operation result information.

  Furthermore, the control unit 211 of the in-vehicle apparatus 200 in the second embodiment can determine the position where the operation result information is displayed within a predetermined range from the in-vehicle apparatus 200. In this case, the operator can view the operation result information without moving the line of sight from the vehicle-mounted apparatus 200.

  Furthermore, the control unit 211 (an example of “person detecting means”) of the vehicle-mounted apparatus 200 in the second embodiment detects a fellow passenger (an example of “person in the same space as the operator”), and detects from the fellow passenger. The visible position can be determined as the position where the operation result information is displayed. In this case, the passenger can visually recognize the operation result information.

  Furthermore, the control unit 211 of the in-vehicle apparatus 200 according to the second embodiment can determine a plurality of positions for displaying the operation result information and display the operation result information on the plurality of positions by projection. Accordingly, since the operation result information is displayed at a plurality of positions, the operator can see the operation result information displayed at the position that is easy to see, which improves convenience.

  Furthermore, the control unit 211 of the in-vehicle apparatus 200 according to the second embodiment acquires an operation result of a gesture that is a motion of a part of the human body of the operator. Thereby, the operator can confirm whether or not the operation by the gesture, which is difficult to confirm whether or not the operation was correctly performed, can be correctly performed from the operation result information.

[3. Modification]
Next, a modification of the present embodiment will be described. The modifications described below can be combined as appropriate.

[3.1. Modification 1]
In the first and second embodiments, the operation by the gesture of moving the left hand has been described, but the present invention may be applied to the operation by the gesture of moving other body parts (for example, the right hand, the left foot, the right foot). it can. As shown in FIG. 4B, when the operation guide image is displayed on the left hand performing the gesture, the left-hand symbols 301B, 302B, 303B representing the left hand are used. It may be used for the operation guide image. For example, when the gesture is performed with the right hand, the right hand pattern representing the right hand is used as the operation guide image.

[3.2. Modification 2]
In the first and second embodiments, as shown in FIG. 5, as an example of the operation result information, a temperature indicator 313E indicating the result of operating the vehicle-mounted device 200 as the air conditioner by a gesture is displayed. However, the information indicating the gesture performed for the operation may be displayed as the operation result information. For example, when the control unit 211 detects the trajectory of the gesture of rotating the left hand while maintaining the orientation of the palm (or the instep), as illustrated in FIG. 11, an image representing the trace line 371 indicating the trajectory is displayed. It may be displayed on the left hand. The place where the trace line 371 is displayed may be another part of the operator's body. Further, when the gesture is displayed on the part (left hand in this example), it is preferable to display on the part facing the operator's face so that the operator can visually recognize it.

[3.3. Modification 3]
In the first and second embodiments, the control unit 211 displays the operation result information. However, when displaying the operation result information, the control unit 211 displays the operation result by a method other than the gesture operation. Good. For example, the operation result information may be displayed in response to an operation of pressing a button included in the remote controller or the operation target device, an operation by voice, or the like. When displaying the operation result information indicating the result of the operation by voice, as shown in FIG. 12, an image showing the voice input notation 381 indicating the characters corresponding to the voice uttered for the operation should be displayed on the left hand. May be At this time, the control unit 211 performs conventionally known voice recognition processing on the microphone voice information received from the microphone 227, and projects an image representing the voice input notation 381 indicating the character corresponding to the recognized voice with the projector 250. It may be displayed. The place where the voice input notation 381 is displayed may be another part of the operator's body. Further, when displaying on a part of the body, it is preferable to display on a part facing the operator's face so that the operator can visually recognize it.

[3.4. Modification 4]
In the first embodiment and the second embodiment, the operation guide image showing the gesture during the operation and the operation result information showing the result of the operation are displayed on a part of the human body. However, the operation guide image or the operation result is displayed. Either one of the information may be displayed. The place where the operation guide image and the operation result information are displayed may be a part of the operator's body, and may be a part where a gesture is performed, for example. Further, when displaying on a part of the body, it is preferable to display on a part facing the operator's face so that the operator can visually recognize it.

[3.5. Modification 5]
In the first and second embodiments, the control unit 211 displays the top menu based on the top menu display operation, and allows the operator to select the A / C menu, the AUDIO menu, or the NAVI menu. However, if an operation for directly displaying the A / C menu, AUDIO menu, or NAVI menu is defined, and if the operation is detected, the corresponding menu may be displayed without displaying the top menu. Good. For example, the control unit 211 may immediately display the operation screen and the operation guide image corresponding to the A / C menu when the A / C menu display operation for displaying the A / C menu is detected. It should be noted that the A / C menu display operation is to be grasped by the operator in advance. As a result, when an A / C menu is desired to be displayed, the A / C menu can be immediately displayed without the purpose of displaying the top menu based on the top menu display operation, which improves the convenience of the operator. . If the A / C menu display operation is a gesture and the A / C menu is displayed based on the A / C menu display operation, the gesture corresponding to the A / C menu display operation is performed. The A / C menu may be displayed on a part of the body. For example, when the A / C menu display operation is a gesture related to the left hand, the A / C menu is displayed on the left hand. At this time, it is preferable to display in a portion facing the operator's face so that the operator can visually recognize it.

[3.6. Modification 6]
In the first and second embodiments, when the operator starts route guidance to the home, the operator selects the NAVI menu from the top menu and touches the home button 433 on the operation screen 430 corresponding to the NAVI menu or the NAVI menu. Based on the operation guide image corresponding to the menu, I decided to perform the gesture of standing two index fingers and the middle finger of the left hand and making a counterclockwise motion, but instead of this, it corresponds to the preset operation The operation guide image indicating the gesture method to be performed is displayed on a part of the body (preferably at a position visible to the operator), and the control unit 211 is a gesture by the part of the body. Then, when the gesture of the method shown in the operation guide image is detected, the operation corresponding to the gesture is detected. It is also possible to run the management.

[3.7. Modification 7]
In the first and second embodiments, as shown in FIG. 8B, the operation guide image corresponding to the destination menu is an image that identifies a portion of the human body that is moved by a gesture, and Symbol 341A and history notation 341B corresponding to the ring finger of the operator's left hand to be moved, symbol 342A and telephone number notation 342B corresponding to the middle finger moved by the gesture, and symbol 343A and name notation 343B corresponding to the index finger moved by the gesture. It is shown that it is possible to perform operations related to history display, phone number input, and name input by the gestures of bending the corresponding fingers. Instead, for example, an image showing "history" on the operator's right hand (an example of "gesture information"), an image showing a "phone number" on the left hand (an example of "gesture information"), and a "name" on the left foot May be displayed (an example of “gesture information”) to indicate that operations related to history display, telephone number input, and name input are possible with each gesture of moving the right hand, left hand, and left foot.

[3.8. Modification 8]
In FIG. 4B, FIG. 5B, FIG. 6B, and FIG. 7B in the first and second embodiments, the operation guide image indicating the gesture method corresponding to a plurality of operations is shown. 8B, the operation guide image showing the portion of the human body to be moved corresponding to the plurality of operations has been described, but it is not always necessary to display the plurality of operations, and in the former case, at that time An operation guide image representing a gesture method corresponding to some operable (eg, one) operation, and in the latter case, should be moved corresponding to some operable (eg, one) operation at that time. The operation guide image showing the human body part may be used.

100 display control device 101 acquisition means 102 determination means 103 display control means 200 vehicle-mounted device 211 control unit 211a CPU
211b ROM
211c RAM
212 storage unit 213 input unit 214 display unit 214a graphics controller 214b buffer memory 214c display 215 bus line 220 input / output interface unit 221 vehicle speed sensor 222 angular velocity sensor 223 acceleration sensor 224 steering angle sensor 225 GNSS receiver 226 camera 227 microphone 228 speaker 229 Air conditioner 250 Projector

Claims (12)

Acquisition means for acquiring the operation result of the operation target device by the operator,
Determining means for determining the position where the display information corresponding to the operation result is displayed by projection;
Display control means for displaying the display information at a position determined by the determination means by projection;
A display control device comprising: The display control device according to claim 1, wherein
The display control device, wherein the determination means determines a part of the human body of the operator at the position. The display control device according to claim 2, wherein
A display control device, wherein a part of the human body is an upper limb. The display control device according to claim 1, wherein
Further comprising viewpoint detection means for detecting the viewpoint of the operator,
The display control device, wherein the determining means determines the detected viewpoint at the position. The display control device according to claim 1, wherein
The display control device, wherein the determining means determines the position within a predetermined range from the operation target device. The display control device according to claim 1, wherein
Further comprising a person detecting means for detecting a person in the same space as the operator,
The display control device, wherein the determination unit determines the position that can be visually recognized by the person. The display control device according to any one of claims 1 to 6,
The determining means determines a plurality of the positions,
The display control device displays the display information by projection at a plurality of positions determined by the determination device. The display control device according to any one of claims 1 to 7,
The display control device, wherein the acquisition unit acquires the operation result by a gesture that is a motion of a part of the human body of the operator. The display control device according to claim 8,
The operation result is a trajectory of a gesture that is a movement of a part of the human body of the operator,
The display information indicates the locus,
The display control device, wherein the display control means displays the trajectory by projection.   A display system comprising: the display control device according to any one of claims 1 to 9; and a display device that displays the display information by projection. A display control method by a display control device,
An acquisition step of acquiring the operation result of the operation target device by the operator,
A determining step of determining a position at which display information corresponding to the operation result is displayed by projection;
A display control step of displaying the display information by projection at the position determined by the determination step,
A display control method comprising: Computer,
Acquisition means for acquiring the operation result of the operation target device by the operator,
Deciding means for deciding a position where the display information corresponding to the operation result is displayed by projection,
Display control means for displaying the display information at a position determined by the determination means by projection;
A display control program characterized by causing it to function as.