JP6414288B2 - Vehicle control device - Google Patents

Description

  The present disclosure relates to a vehicle operating device.

  While driving, the driver only accepts simple hand gestures that do not need to watch the screen, and passengers other than the driver know the input methods that allow operations such as buttons and touch panels to be watched. (For example, refer to Patent Document 1).

JP 2007-302223 A

  However, in the configuration described in Patent Document 1, since the same operation screen is formed in the vehicle running state and the vehicle stop state, the operability may not be good.

  An object of the present disclosure is to provide an operation device for a vehicle that is an operation screen that can be operated by hand movement and can form different types of operation screens.

According to one aspect of the present disclosure, the image processing apparatus includes a processing device that forms one of a first operation screen related to a predetermined function and a second operation screen different from the first operation screen . It is an operation screen that calculates the coordinate position on the operation screen where the extension lines in the pointing direction intersect and draws a pointer or displays that a selection item is selected , and the second operation screen moves the entire hand up and down or left and right An operation screen for changing the execution selection items by changing the selection items one by one in response to the movement of the vehicle, wherein the first operation screen and the second operation screen are displayed on the same display device. An operating device is provided.

  According to the present disclosure, it is possible to obtain an operation device for a vehicle that is an operation screen that can be operated by hand movement and that can form different types of operation screens.

The figure which shows schematically the structure of the operating device 1 for vehicles by one Example. The figure which shows schematically an example of the mounting state of the hand shake detector 10 and the display 20. FIG. The figure which shows an example of a 1st operation screen. The figure which shows an example of a 2nd operation screen. 5 is a flowchart showing an example of processing executed by the processing apparatus 100.

  Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a diagram schematically showing a configuration of a vehicle operating device 1 according to an embodiment. FIG. 2 is a diagram schematically illustrating an example of the mounting state of the hand shake detector 10 and the display 20. FIG. 2 schematically shows the state of the driver's hand gesture operation.

  The vehicle operation device 1 includes a hand shake detector 10, a determination switch 12, a display 20, a vehicle speed sensor 30, and a processing device 100.

  The hand shake detector 10 detects the movement of a human hand. The hand shake detector 10 is disposed at an appropriate position (for example, an instrument panel) in the vehicle interior. For example, as shown in FIG. 2, the hand shake detector 10 may be disposed on an instrument panel, or may be disposed on an armrest or the like of a center console. The method for detecting the movement of the human hand is arbitrary, and an optical detection method may be employed. For example, the hand shake detector 10 may detect the position and movement of the hand using two or more distance sensors. The hand shake detector 10 may detect hand movement using an image sensor. For example, a method disclosed in Japanese Patent Application Laid-Open No. 2007-302223 may be used as a method of detecting a hand movement.

  The decision switch 12 may be a mechanical switch or a touch switch. The decision switch 12 may be replaced by voice input or the like. The determination switch 12 may be disposed, for example, on the armrest of the center console.

  The display 20 may be an arbitrary display device such as a liquid crystal display or a HUD (head-up display). The display 20 is disposed at an appropriate position (for example, an instrument panel) in the vehicle interior. The display 20 is preferably a type of display that cannot be touched, but may be a touch panel display.

  The vehicle speed sensor 30 outputs an electric signal (vehicle speed pulse) corresponding to the wheel speed to the control ECU 40.

  The processing device 100 may be realized by an ECU (Electronic Control Unit). The ECU includes, for example, a microcomputer including a CPU, a ROM, a RAM, and the like connected to each other via a bus (not shown). The processing device 100 includes a control unit 102, an operation processing unit 104, and a display processing unit 106. Each unit 102, 104, 106 may be realized by the CPU executing a program stored in a storage device such as a ROM. The division of each unit 102, 104, 106 is virtual, and a part or all of a program for realizing a certain unit may be incorporated in another unit. In addition, these units 102, 104, and 106 are not necessarily incorporated in the same ECU unit, and may be realized in cooperation with a plurality of ECUs.

  The control unit 102 controls display on the display 20 in cooperation with the operation processing unit 104 and the display processing unit 106. The control unit 102 controls the function realizing device 40 in cooperation with the operation processing unit 104 and the display processing unit 106. The function realizing device 40 is optional, but may include, for example, an audio device, a TV, a navigation device, an air conditioner, and the like.

  The operation processing unit 104 processes an input from the hand shake detector 10. The operation processing unit 104 detects various hand gesture operations based on the input from the hand gesture detector 10. The various hand shaking operations may be, for example, an operation of shaking the entire hand left and right, an operation of shaking the entire hand up and down, and an operation of pointing an arbitrary specific direction with a finger. Note that the gesture operation to be detected by the operation processing unit 104 may be changed according to the difference in the operation screen on the display 20. That is, the hand gesture operation assigned to each of the first operation screen and the second operation screen described later may be different. In addition, the operation processing unit 104 processes an input from the determination switch 12. The operation processing unit 104 determines the presence / absence of a determination operation based on the input from the determination switch 12.

  The display processing unit 106 cooperates with the control unit 102 to control the display on the display 20 in synchronization with the hand gesture operation and assist the hand gesture operation. Specifically, the display processing unit 106 displays an operation screen on the display 20, and performs selection / determination processing of various selection items based on a detection result of a hand gesture operation or the like. The selected selection item determination process is a process for realizing a function related to the selected selection item. For example, a screen transition process, a character output process, or a command (control signal) to the function realization device 40 is output. Includes processing.

  The selection items constitute virtual operation buttons (meaning that the buttons are not mechanical buttons that are directly operated by hand). The selection item (operation button) may relate to an arbitrary type (function). That is, the function (selection item) that can be executed by the hand gesture operation may be arbitrary. For example, the selection item may include a selection item for displaying (calling) a screen (operation screen) or a map screen (for example, current location display screen) for performing various settings of the navigation device on the display 20. The selection items may include a selection item for performing various settings of the air conditioner and a selection item for displaying the screen on the display 20. The selection items may include a selection item for performing various settings of audio and TV (volume adjustment, etc.) and a selection item for displaying the screen on the display 20. Further, the selection item may be a selection item (icon, launcher, widget) for starting an arbitrary application. Further, the selection item may be a character input button on an operation screen such as a 50 sound input screen.

  The display processing unit 106 cooperates with the control unit 102 to change the operation screen of the display 20 according to the vehicle running state or the stopped state. Specifically, the control unit 102 gives an instruction to form a first operation screen to the display processing unit 106 when the vehicle is stopped. The first operation screen is an operation screen that allows relatively complicated operations by hand gesture operation. The control unit 102 gives an instruction to form a second operation screen to the display processing unit 106 in the vehicle running state. The second operation screen is an operation screen on which only relatively simple operations can be performed by hand gesture operation. The first operation screen and the second operation screen are operation screens (same type operation screens) related to the same function, and may be prepared for each function. For example, a first operation screen and a second operation screen are prepared as operation screens related to the air conditioner. The operation screen related to the same function is, for example, an operation screen related to the same function realization device 40, an operation screen related to the same setting of the same function realization device 40, or a function realization device 40 to be operated (selected). It may be an operation screen (upper layer operation screen) or the like.

  FIG. 3 is a diagram illustrating an example of the first operation screen. FIG. 3 schematically shows the hand S during the hand gesture operation.

  The first operation screen shown in FIG. 3 is an operation screen for selecting music to be played back by the audio device. The first operation screen shown in FIG. 3 includes selection items related to seven pieces of music in three discs (CD, MD, etc.). In this case, the user has 21 choices as selectable selection items by moving the pointer 80 on the first operation screen.

  The display processing unit 106 displays the pointer 80 on the first operation screen. The display processing unit 106 changes the display position of the pointer 80 according to the direction indicated by the finger detected by the operation processing unit 104. For example, the control unit 102 calculates the corresponding coordinate position on the display 20 based on the direction indicated by the finger and the position of the finger detected by the operation processing unit 104. That is, the control unit 102 calculates the coordinate position on the operation screen of the display 20 where the extension line in the direction indicated by the finger intersects. The display processing unit 106 draws the pointer 80 at the coordinate position calculated by the control unit 102. When the user changes the direction indicated by the finger, the control unit 102 calculates a corresponding coordinate position on the display 20 based on the changed direction indicated by the finger and the finger position. The display processing unit 106 draws (moves) the pointer 80 at the coordinate position calculated by the control unit 102. When the user presses the determination switch 12 when the pointer 80 is positioned on a desired selection item, the control unit 102 realizes a function related to the selection item where the pointer 80 is positioned. Thereby, in the example shown in FIG. 3, the user can select and reproduce the song name “Song name 3” in the disc 2, for example.

  In the example illustrated in FIG. 3, the pointer 80 is illustrated, but a cursor may be used instead of the pointer 80. The cursor represents the selection item itself that is selected and displayed. Therefore, the position of the cursor corresponds to the position of the selection item that is selected and displayed. In the initial state of the first operation screen, any one selection item may be selected and displayed by default, or any selection item may be non-selected. The selection display (that is, the mode of the cursor) is arbitrary as long as the operator can recognize that the selection item is selected. For example, the brightness of the display of the selection item to be selected and displayed It may be realized by making a color or the like different from other selection items, or an outer frame of the selection item may be highlighted.

  FIG. 4 is a diagram illustrating an example of the second operation screen. FIG. 4 schematically shows the hands S1 and S2 during the hand gesture operation.

  The display processing unit 106 draws the currently executed selection item at a specific position (center in the example shown in FIG. 4) on the second operation screen. Hereinafter, a selection item drawn at a specific position on the second operation screen (center in the example shown in FIG. 4) is also referred to as “execution selection item”. In the example shown in FIG. 4, “Song name 1” in the disc 2 is the execution selection item. Therefore, the second operation screen shows a state where the song “Song name 1” in the disc 2 is selected and played back. Show. The display processing unit 106 does not display the pointer 80 on the second operation screen.

  The display processing unit 106 changes the execution selection item according to the direction of the hand gesture operation detected by the operation processing unit 104 and realizes a function corresponding to the execution selection item. At this time, the determination operation by the determination switch 12 by the user is unnecessary. That is, the display processing unit 106 simultaneously realizes selection and determination processing according to a hand gesture operation while the second operation screen is displayed. In the example shown in FIG. 4, the selection items related to “Song name 7” in the disk 2 and “Song name 2” in the disk 2 are drawn vertically on the execution selection item (“Song name 1” in the disk 2). Has been. When the operation processing unit 104 detects an up-and-down hand shake operation (movement of moving the entire hand), the control unit 102 cooperates with the display processing unit 106 to change the selection items one by one in the up-down direction. The execution selection item is changed and a function corresponding to the changed execution selection item is realized. For example, when the user performs an upward hand gesture, “Song name 2” in the disc 2 is played as an execution selection item. Similarly, in the example shown in FIG. 4, each selection related to “Song name 1” in disk 1 and “Song name 1” in disk 3 on the left and right with respect to the execution selection item (“Song name 1” in disk 2). The item is drawn. When the operation processing unit 104 detects a left / right hand gesture operation (movement of moving the entire hand), the control unit 102 cooperates with the display processing unit 106 to change the selection items one by one in the left / right direction. The execution selection item is changed and a function corresponding to the changed execution selection item is realized. That is, disk switching is realized. For example, when the user performs a left hand gesture operation as indicated by S1 in FIG. 4, "Song name 1" in the disc 3 is played as an execution selection item. When the user performs a right hand shaking operation as shown by S2 in FIG. 4, "Song name 1" in the disc 1 is played as an execution selection item. As described above, in the example illustrated in FIG. 4, the user has four choices as selection items that can be changed by the hand gesture operation on the second operation screen. However, it is possible to reproduce a desired music piece by repeating the hand gesture operation a plurality of times.

  As described above, the second operation screen can be operated only by a simple hand gesture operation as compared with the first operation screen. Thereby, even in a vehicle running state, the operability of the hand gesture operation can be enhanced in a manner that does not substantially hinder the driver's concentration on driving. In the example shown in FIG. 3 and FIG. 4, the first operation screen and the second operation screen are illustrated as the operation screens related to the playback function of the audio device, but other functions can be similarly realized. However, there may be a function (a function corresponding only to the first operation screen) in which the second operation screen is not formed, such as a 50-sound input function.

  FIG. 5 is a flowchart illustrating an example of processing executed by the processing device 100. The process shown in FIG. 5 is executed while outputting an operation screen related to a function for which both the first operation screen and the second operation screen are prepared.

  In step 501, the processing apparatus 100 enters a waiting state for detecting a hand gesture operation based on the detection result from the hand gesture detector 10. When the processing apparatus 100 detects a hand gesture operation, the processing apparatus 100 proceeds to step 502.

  In step 502, the processing apparatus 100 acquires vehicle speed information from the vehicle speed sensor 30. The vehicle speed information may be acquired from a change in the vehicle position from the GPS receiver, the rotation speed of the output shaft of the transmission, or the like.

  In step 503, the processing apparatus 100 determines whether or not the vehicle is currently traveling based on the vehicle speed information. If the vehicle is currently traveling (that is, if the vehicle is in a traveling state), the process proceeds to step 504. Otherwise (that is, if the vehicle is stopped), the process proceeds to step 506. In step 503, the processing apparatus 100 may determine whether or not the vehicle is currently stopped based on the vehicle speed information. In this case, the processing apparatus 100 may determine that the vehicle is currently stopped when the vehicle speed is 0 and the brake operation is performed.

  In step 504, the processing apparatus 100 displays a second operation screen. The second operation screen is as described above.

  In step 505, the processing apparatus 100 determines whether or not the hand gesture operation detected in step 501 is a predetermined hand gesture operation assigned to the second operation screen currently displayed. The predetermined hand shaking operation assigned to the second operation screen may be, for example, an operation of shaking the entire hand in the left and right and / or up and down directions (see FIG. 4). If the hand gesture operation is a predetermined hand gesture operation assigned to the second operation screen, the process proceeds to step 506. Otherwise, the processing for the hand gesture operation detected this time is terminated as it is (the hand gesture operation detected this time). Is terminated without executing any special processing).

  In step 506, the processing apparatus 100 executes a function corresponding to the hand gesture detected in step 501 (for example, see the description of FIG. 4).

  In step 507, the processing apparatus 100 displays a first operation screen. The first operation screen is as described above.

  In step 508, the processing apparatus 100 determines whether or not the hand gesture operation detected in step 501 is a predetermined hand gesture operation assigned to the first operation screen currently displayed. The predetermined hand gesture operation assigned to the first operation screen may be, for example, an operation of pointing a specific direction with a finger (see FIG. 3). If the hand gesture operation is a predetermined hand gesture operation assigned to the first operation screen, the process proceeds to step 509. Otherwise, the processing for the hand gesture operation detected this time is terminated as it is (the hand gesture operation detected this time). Is terminated without executing any special processing).

  In step 509, the processing apparatus 100 executes a function corresponding to the hand gesture operation detected in step 501 (for example, see the description of FIG. 3).

  According to the process shown in FIG. 5, the second operation screen can be output when the vehicle is running, and the first operation screen can be output when the vehicle is stopped. As described above, the second operation screen is an operation screen having the same function as the first operation screen. However, unlike the second operation screen, the second operation screen is a dedicated operation that enables hand gesture operation in a simpler manner than the first operation screen. It is a screen. Thereby, even in a vehicle running state, the operability of the hand gesture operation can be enhanced in a manner that does not substantially hinder the driver's concentration on driving.

  Although each embodiment has been described in detail above, it is not limited to a specific embodiment, and various modifications and changes can be made within the scope described in the claims. It is also possible to combine all or a plurality of the components of the above-described embodiments.

DESCRIPTION OF SYMBOLS 1 Operation apparatus for vehicles 10 Hand shake detector 20 Display 30 Vehicle speed sensor 40 Function realization apparatus 100 Processing apparatus

Claims (9)

A processing device for forming either a first operation screen related to a predetermined function or a second operation screen different from the first operation screen;
The first operation screen is an operation screen that calculates a coordinate position on the operation screen at which an extension line in a direction indicated by a finger intersects and draws a pointer or displays that a selection item is selected ,
The second operation screen is an operation screen for changing execution selection items by changing selection items one by one in response to an operation of moving the entire hand up and down or left and right.
The vehicle operation device, wherein the first operation screen and the second operation screen are displayed on the same display device.   The vehicle operation device according to claim 1, wherein the processing device forms either the first operation screen or the second operation screen based on the detected vehicle speed.   The vehicle operation device according to claim 2, wherein the processing device forms the first operation screen when the vehicle is stopped, and forms the second operation screen when the vehicle is not stopped. While the first operation screen is being displayed, the processing device performs a selection item determination process where the pointer or cursor is positioned when a determination operation different from the movement of the hand is detected, while the second operation screen is displayed. When an operation for moving the entire hand is detected while an operation screen is displayed, the selection item changed by the operation for moving the entire hand is determined without detecting the determination operation. The vehicle operating device according to any one of 1 to 3 . An operation screen forming step of forming one of a first operation screen related to a predetermined function and a second operation screen different from the first operation screen;
The first operation screen is an operation screen that calculates a coordinate position on the operation screen at which an extension line in a direction indicated by a finger intersects and draws a pointer or displays that a selection item is selected ,
The second operation screen is an operation screen for changing execution selection items by changing selection items one by one in response to an operation of moving the entire hand up and down or left and right,
The operation screen forming method, wherein the first operation screen and the second operation screen are displayed on the same display device. The operation screen forming method according to claim 5 , wherein, in the operation screen forming step, one of the first operation screen and the second operation screen is formed based on the detected vehicle speed. The operation screen forming method according to claim 6 , wherein, in the operation screen forming step, the first operation screen is formed when the vehicle is stopped, and the second operation screen is formed when the vehicle is not stopped. In the operation screen forming step, during the display of the first operation screen, when a determination operation different from the movement of the hand is detected, a determination process of a selection item where the pointer or the cursor is positioned is performed. During the display of the second operation screen, when an operation of moving the entire hand is detected, the selection item changed by the operation of moving the entire hand is performed without detecting the determination operation. The operation screen formation method according to any one of claims 5 to 7 . Causing the in-vehicle computer to execute a process of forming either a first operation screen related to a predetermined function or a second operation screen different from the first operation screen;
The first operation screen is an operation screen that calculates a coordinate position on the operation screen at which an extension line in a direction indicated by a finger intersects and draws a pointer or displays that a selection item is selected ,
The second operation screen is an operation screen for changing execution selection items by changing selection items one by one in response to an operation of moving the entire hand up and down or left and right,
An operation screen formation program in which the first operation screen and the second operation screen are displayed on the same display device.

Images