JP4962387B2 - Pointer display / movement device and program for pointer display / movement device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology for detecting that a driver puts his hand to an on-vehicle device without installing a sensor separately from the on-vehicle device in technology for preventing the driver during driving from using the on-vehicle device for long time. <P>SOLUTION: A vehicle navigation device 1 specifies (step 205) a position of a pointer at every sample time (step 203), and repetitively increments a counter (step 210) without resetting a value of the counter A (step 245&rarr;NO) unless movement of the pointer continues (steps 215 to 245). When the incremented value of the counter A exceeds a reference value (z), namely, when movement of the pointer continues for a first reference time period or more (step 220&rarr;NO), warning is given to the driver (step 255). <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a pointer display / movement device and a program for the pointer display / movement device.

  When a driving driver uses an in-vehicle device such as a navigation device, if the operating device is of the type that is operated with one hand, the driver is driving with the handle held by one hand. Operation of the on-board device for a time may impair the driver's attention. In addition, if the operation continues for a long time, there is a possibility that the driver keeps watching the display.

As a technology to deal with such problems, whether or not the driver who is driving is holding the camera and handle with both hands to monitor the driver's line of sight in order to prevent the driver from touching the vehicle equipment for a long time A technique using a sensor or the like that senses this has been proposed (see, for example, Patent Documents 1 and 2).
JP 2000-322699 A JP 2007-46906 A

  However, in the technology as described above, it is necessary to provide a sensor separately from the in-vehicle device in order to detect that the driver is putting a hand on the in-vehicle device.

  In view of the above points, the present invention is a technique for preventing a driving driver from placing a hand on an in-vehicle device for a long period of time. An object of the present invention is to provide a technique for detecting the above.

  In order to achieve the above object, in the first aspect of the invention, the pointer display / movement device outputs a signal corresponding to the amount of movement of the movable body (52) that the driver moves by hand (15a). And a control unit (15b, 17) for moving a pointer in the screen of the image display device (12) based on a signal from the operation device (15a). And a control part (15b, 17) detects that the pointer is moving continuously more than 1st reference time, and warns a driver based on the detection.

  As described above, the driver uses the information on the operation of the driver with respect to the operation device (15a) provided in advance in the pointer display / movement device as the in-vehicle device and the movement of the pointer based on the operation, and the driver installs the in-vehicle device. It is possible to detect that the driver is operating and, in turn, that the driver is placing a hand on the in-vehicle device. Therefore, a sensor separate from the in-vehicle device is not required, which is advantageous in terms of manufacturing cost and the number of parts.

  In addition, as described in claim 2, the operating device (15a) includes an actuator unit (53) that applies a force for moving the movable body (52) to the movable body (52), and includes a control unit. (15b, 17) may control the force applied by the actuator section (53) to the movable body (52) according to the position of the pointer.

  In this way, by using the operating device (15a) in which a force corresponding to the position of the pointer on the screen is applied to the movable body (52), the state where the driver puts his / her hand on the movable body (52). It becomes possible to detect more sensitively. According to the inventors' investigation, the reason is as follows.

  Normally, even if the driver touches the operating device, it is impossible to detect that the driver is putting a hand on the operating device unless the movable body (52) is moved to such an extent that the pointer moves.

  Here, as a result of the driver moving the movable body (52), the pointer moves, and as a result, a force corresponding to the current position of the pointer (hereinafter referred to as feedback force) is transferred from the actuator section (53) to the movable body (52). ) Is considered. In this case, since the movable body (52) tries to move in the direction of the feedback force, the feedback force is transmitted to the hand attached to the movable body (52). At this time, the driver's hand often applies force to the movable body (52) in a reflective manner.

  For example, as a result of the hand moving by being moved by the movement of the movable body (52) by the feedback force, the movement of the hand does not stop even after the feedback force is lost, and the movable body (52) may be moved. In this case, the pointer moves more than the amount of movement of the pointer by the feedback force.

  Further, for example, there is a case where force is applied in a direction against the feedback force in an attempt to suppress the movement of the movable body (52) unconsciously. In this case, even if a force is applied against the feedback force, it is difficult to adjust the force so that the pointer is completely stopped. Continue to move on.

  As described above, as a result of the feedback force being applied, the driver applies force to the movable body (52) at a timing other than when the driver clearly intends to move the pointer. Therefore, during the period in which the driver puts his / her hand on the movable body (52), the hand moves the movable body (52), and as a result, the opportunity for the pointer to move increases. Therefore, it is possible to detect more sensitively the state in which the driver puts his hand on the movable body (52).

  In addition, as described in claim 3, the control unit (15b, 17) may regard the pointer as moving continuously when the pointer moves without leaving the period of the second reference time or more. It may be.

  This is because if the movement of the pointer is resumed in a short time after the movement of the pointer has stopped, the driver has put his hand on the movable body (52) during the period from the stop to the movement being resumed. This is based on the idea that the possibility is high. Thus, by not considering the stop of the pointer movement for a short time as the interruption of the continuous movement of the pointer, it is possible to more accurately detect the time during which the hand is attached to the movable body (52). .

  As described in claim 4, the invention described in claim 1 can also be understood as a program.

  In addition, the code | symbol in the bracket | parenthesis in the said and the claim shows the correspondence of the term described in the claim, and the concrete thing etc. which illustrate the said term described in embodiment mentioned later. .

  Hereinafter, an embodiment of the present invention will be described. FIG. 1 shows a hardware configuration of a vehicle navigation apparatus 1 according to this embodiment. The vehicle navigation device 1 includes a position detector 11, an image display device 12, an operation unit 13, a speaker 14, a haptic unit 15, a map data acquisition unit 16, and a control circuit 17.

  The position detector 11 has a well-known acceleration sensor, geomagnetic sensor, gyro sensor, vehicle speed sensor, GPS receiver, and other sensors (not shown), and based on the characteristics of each of these sensors, Information for specifying the position, orientation, and speed is output to the control circuit 17.

  The image display device 12 displays a video based on the video signal output from the control circuit 17 on the driver. Examples of the display image include a map centering on the current location.

  The operation unit 13 includes a plurality of mechanical switches provided in the vehicle navigation device 1 and an input device such as a touch panel provided so as to overlap the display surface of the image display device 12. Is output to the control circuit 17.

  The haptic unit 15 is a device that receives a driver's operation and transmits a feedback force to the operating hand in order to assist the driver's operation. FIG. 2 shows the configuration of the haptic unit 15. The haptic unit 15 includes a haptic device 15a and a haptic device control unit 15b that controls the haptic device 15a. In FIG. 2, the haptic device 15a is shown in a sectional view.

  The haptic device 15 a is installed at a position where both the driver and the passenger on the passenger seat can use it, and includes a trackball holding part 51, a trackball part 52, an actuator part 53, and a trackball position detection part 54.

  The trackball holding unit 51 is a housing that holds the trackball unit 52, the actuator unit 53, the trackball position detection unit 54, and the like so as to surround the inside.

  The trackball portion 52 is composed of a semi-transparent hemisphere, and is inclined (corresponding to an example of movement) in all directions including the front-rear direction and the left-right direction, with the center point of the hemisphere as a fulcrum, with a predetermined range as a limit. Is configured to be possible. The driver performs various operations by placing his palm on the hemisphere.

  Further, a protrusion 55 is provided on the uppermost part of the hemisphere so that the driver can easily operate by being caught by the driver's hand. The hemisphere has a return characteristic, and the protrusion 55 returns to a predetermined position when the driver releases his / her hand. The trackball portion 52 is configured to be pressed in the direction of the arrow 57.

  The actuator unit 53 is for applying a force to the trackball unit 52, and generates a force for inclining the trackball unit 52 in a specified direction based on a control signal from the haptic device control unit 15b.

  The trackball position detection unit 54 detects the tilt angle, the tilt direction, and the presence / absence of pressing in the direction 57 of the trackball unit 52, and outputs the detection result to the haptic device control unit 15b.

  The haptic device control unit 15b is a microcomputer that operates by executing a predetermined program recorded in the ROM. In the execution, the haptic device control unit 15b exchanges signals with the actuator unit 53, the trackball position detection unit 54, and the projection unit 55. To do.

  For example, when the haptic device control unit 15b receives a signal indicating the tilt angle, the tilt direction, and the presence / absence of a press from the trackball position detection unit 54, the haptic device control unit 15b controls the received tilt angle, the tilt direction, and the information on the press / not press. Output to the circuit 17. Other processing contents of the haptic device control unit 15b will be described later.

  The map data acquisition unit 16 includes a nonvolatile storage medium such as a DVD, a CD, and an HDD, and a device that reads data (and writes data if possible) to the storage medium. The storage medium stores a program executed by the control circuit 17, map data for route guidance, and the like.

  The map data has road data and facility data. The road data includes link position information, type information (highway, general road, etc.), node position information, type information, and information on the connection relationship between nodes and links. The facility data includes data indicating name information for each facility, location information, facility type information, and the like.

  A control circuit (corresponding to a computer) 17 is a microcomputer having a CPU, RAM, ROM, I / O and the like. The CPU executes a program for the operation of the vehicle navigation device 1 read from the ROM or the map data acquisition unit 16, reads information from the RAM, the ROM, and the map data acquisition unit 16 when executing the program. And, if possible, writes information to the storage medium of the map data acquisition unit 16 and exchanges signals with the position detector 11, the image display device 12, the operation unit 13, the speaker 14, and the haptic unit 15. Do.

  Specific processing performed by the control circuit 17 executing the program includes current position specifying processing, map display processing, guidance route calculation processing, route guidance processing, and operation continuation warning processing. The current position specifying process is a process for specifying the current position and direction of the vehicle based on a signal from the position detector 11 using a known technique such as map matching. The map display process is a process for causing the image display device 12 to display a map of a specific area such as the vicinity of the current position of the vehicle. At this time, information used for map display is acquired from the map data.

  The guidance route calculation process is a process of receiving an input of a destination by the driver from the operation unit 13 and calculating an optimum guidance route from the current position to the destination. In the route guidance process, when the vehicle arrives before a guidance point such as a right-left turn intersection on the guidance route, a guidance voice instructing a right turn, a left turn, etc. is output to the speaker 14, and an enlarged view of the guidance point is displayed. This is a process of guiding the driving of the vehicle along the guidance route by being displayed on the image display device 12.

  The operation continuation warning process is a process for detecting that the driver is continuously touching the trackball unit 52 of the haptic device 15a for a long period of time and warning the driver in response to the detection.

  In each process described above, the control circuit 17 displays a pointer on the screen of the image display device 12, and moves the pointer based on the information on the inclination angle and the inclination direction received from the haptic device control unit 15b. . For example, the pointer is moved in a direction on the screen corresponding to the direction of inclination at a speed that increases as the inclination angle increases.

  Further, when the control circuit 17 receives a signal indicating that the button is pressed from the haptic device control unit 15b in each of the above processes, if the pointer is positioned on the selectable image at that time, the control circuit 17 is assigned to the selectable image. Execute the function.

  Here, the selectable image is an image that can be selected by the driver by pressing the haptic device 15a, such as a button image on the display screen. As a function assigned to the selectable image, for example, a map scale changing function, a function of starting route guidance, a destination input receiving method (for example, 50-sound input, telephone number input, memory point call) is specified. There is a function for starting execution of one.

  Further, the control circuit 17 outputs information on the position of the pointer in the coordinates fixed on the screen to the haptic device control unit 15b. In addition, the control circuit 17 outputs information on a range occupied by one or more selectable images currently displayed on the screen in the screen to the haptic device control unit 15b.

  Hereinafter, the operation of the haptic device control unit 15b and the operation continuation warning process of the control circuit 17 will be described in detail.

  First, the haptic device control unit 15b executes a program 100 as shown in FIG. 3 in order to control the actuator unit 53. In executing the program 100, the haptic device control unit 15b first detects the position of the pointer on the screen based on the signal output from the control circuit 17.

  Subsequently, in step 120, the feedback force applied to the trackball unit 52 is calculated based on the information on the range of the selectable image output from the control circuit 17 and the position information of the pointer detected in step 110.

  For example, as illustrated in FIG. 4, when there are a plurality of button images 21 to 26 in the display screen 20 and the pointer 27 is not located in any of the range of the button images 21 to 26, the button image is displayed from the pointer 27. If the distance to the outer edge of 25 (button image closest to the pointer 27) is less than the reference distance, the direction of the inclination of the trackball unit 52 is set so that the pointer 27 moves in the direction 28 drawn into the button image 25. Determine the direction and strength of the feedback force that will make the decision. Note that the strength of the feedback force may be a fixed value, for example, or may increase as the distance from the pointer 27 to the outer edge of the button image 25 closest to the pointer 27 decreases. Subsequently, in step 130, a control signal is output to the actuator unit 53 so as to realize the calculated feedback force.

  By doing so, the haptic device control unit 15b applies the force applied by the actuator unit 53 to the trackball unit 52 according to the relationship between the position of the pointer 27 and the position of the button images 21 to 26, for example, by the pointer 27. Control is performed so as to be drawn into the closest button image 25.

  Next, the operation continuation warning process of the control circuit 17 will be described. The control circuit 17 executes this operation continuation warning process when the host vehicle starts traveling, and ends when the host vehicle stops traveling. The start and stop of traveling of the host vehicle may be detected based on the vehicle speed acquired from the vehicle speed sensor of the position detector 11, for example.

  FIG. 5 shows a flowchart of the program 200 executed by the control circuit 17 in this operation continuation warning process. In executing the program 200, the control circuit 17 first resets the counters A and B in step 201. Here, the counter A is a counter for accumulating the number of timings at which the pointer position is acquired (hereinafter referred to as sample timing), and the counter B is a counter indicating the number of times the pointer position does not change continuously. is there.

  Subsequently, in step 203, the process waits until a predetermined sample time x (for example, 5 milliseconds) elapses after the last execution of step 205, and then step 205 is executed. However, in step 203 immediately after the execution of the program 200 is started, step 205 is immediately executed. In step 205, the position coordinates of the current pointer in the screen are specified (for example, in pixel units of the screen). Subsequently, at step 210, the value of the counter A is increased by one count.

  Subsequently, in step 215, it is determined whether or not the value of the counter A is 1 count. If it is 1 count, step 203 is executed again. If it is 2 counts or more, step 220 is executed subsequently. This is because when the value of the counter A is 1 count, there is no coordinate comparison target in step 225.

  In step 220, it is determined whether or not the value of the counter A is less than the reference value z. If it is less than the reference value z, then step 225 is executed. Subsequently, step 255 is executed.

  In step 225, coordinate comparison is performed. Specifically, the pointer position coordinates acquired in the immediately preceding step 205 (that is, the pointer position coordinates in the current sample timing) and the previous sample timing acquired in step 205. Compare the position coordinates of the pointer.

  Subsequently, in step 225, it is determined whether or not the two position coordinates are different as a result of the comparison. If they are different, the counter B is reset in step 235 and then step 203 is executed again. Subsequently, at step 240, the counter B is incremented by one count, and then step 245 is executed. Thus, the counter B is the number of times that the pointer position does not change continuously.

  In step 245, it is determined whether or not the value of the counter B has reached the reference value y (for example, 100 counts shorter than the reference value x). If the value has reached the reference value y, then step 250 is executed, If it is less than the value y, step 203 is executed again. In step 250, counter A and counter B are reset, and then step 203 is executed again.

  In step 255 after the value of the counter A becomes equal to or greater than the reference value z, a warning is given to the driver. As a warning method, for example, a warning message sound for prompting safe driving is output to the speaker 14, and a warning message image is displayed on the image display device 12. Subsequently, in step 260, the counter A and the counter B are reset, and then step 203 is executed again.

  In this way, in the operation continuation warning process, the control circuit 17 specifies the position of the pointer for each sample time (see step 203) (see step 205), and as long as the pointer continues to move (steps 215 to 245). Reference) The value of the counter A is not reset (see step 245 → YES), and is repeatedly incremented (see step 210).

  When the incremented counter A value exceeds the reference value z, that is, when the movement of the pointer continues for a reference value z × sample time x (corresponding to an example of the first reference time) or more (see step 220 → NO). ) A warning is given to the driver (see step 255).

  In this way, the control circuit 17 detects that the pointer is continuously moving for the first reference time or more, and warns the driver based on the detection, so that the original function of the vehicle navigation device 1 is achieved. Using the information of the driver's operation on the haptic device 15a provided in advance for the function (that is, the function other than the operation continuation warning process such as the function of the route guidance process) and the movement of the pointer based on the operation, It can be detected that the driver is operating the in-vehicle device, and by extension, that the driver is touching the in-vehicle device. Therefore, a sensor separate from the vehicle navigation device 1 is not required for the operation continuation warning process, which is advantageous in terms of manufacturing cost and the number of parts.

  However, the movement of the pointer is regarded as continuing when the position of the pointer continues to change between adjacent sample timings, or more than the reference value y × sample time x (corresponding to an example of the second reference time) This is a case where the position of the pointer changes without leaving time (see steps 230 to 245). If the position of the pointer does not change for the second reference time or longer, the counter A is reset because the continuation of the pointer movement is interrupted (see step 245 → 250).

  When the movement of the pointer is resumed in a short time after the movement of the pointer is stopped, there is a high possibility that the driver has put his hand on the trackball portion 52 during the period from the stop to the movement being resumed. Therefore, the value of the counter A can also be regarded as the time during which the driver keeps putting his hand on the trackball unit 52.

  As described above, the stop of the pointer movement for a short time is not regarded as an interruption of the continuous movement of the pointer, so that the time during which the hand is attached to the trackball unit 52 can be detected more accurately.

  The haptic device 15a includes an actuator unit 53 that applies a force to the trackball unit 52 to move the trackball unit 52, and the haptic device control unit 15b responds to the position of the pointer with the actuator unit 53. Controls the force applied to the trackball portion 52 (see program 100).

  In this way, by using the haptic device 15a in which a force corresponding to the position of the pointer on the screen is applied to the trackball unit 52, it is possible to more sensitively detect the state where the driver is putting his / her hand on the trackball unit 52. Will be able to. The reason is as follows.

  Normally, even if the driver touches the operating device, it is impossible to detect that the driver is putting his hand on the operating device unless the trackball unit 52 is moved to such an extent that the pointer moves.

  Here, consider a case where the pointer moves as a result of the driver moving the trackball unit 52, and as a result, a feedback force corresponding to the current position of the pointer is applied from the actuator unit 53 to the trackball unit 52. In this case, since the trackball part 52 tries to move in the direction of the feedback force, the feedback force is transmitted to the hand attached to the trackball part 52. At this time, the driver's hand often applies force to the movable trackball portion 52 in a reflective manner.

  For example, as a result of the hand moving by being dragged by the movement of the trackball portion 52 by the feedback force, the movement of the hand may not stop and the trackball portion 52 may be moved even after the feedback force is lost. In this case, the pointer moves more than the amount of movement of the pointer by the feedback force.

  Further, for example, there is a case where a force is applied in a direction against the feedback force in an attempt to suppress the movement of the trackball unit 52 unconsciously. In this case, even if a force is applied against the feedback force, it is difficult to adjust the force so that the pointer is completely stopped. Continue to move on.

  As described above, as a result of the feedback force being applied, the driver applies force to the trackball portion 52 at a timing other than when the driver clearly intends to move the pointer. Therefore, during the period in which the driver puts his / her hand on the trackball portion 52, the hand moves the trackball portion 52 and, as a result, the opportunity for the pointer to move increases. Therefore, it is possible to detect more sensitively the state where the driver puts his / her hand on the trackball portion 52.

  In addition, the haptic device 15a according to the present embodiment is shaped so that the driver can operate with a palm, so that the movement of the pointer when the hand is attached is compared to a joystick that is operated with only a finger attached. Is likely to increase. Therefore, the haptic device 15a as in the present embodiment can more sensitively detect the state in which the driver puts his / her hand on the trackball unit 52.

(Other embodiments)
As mentioned above, although embodiment of this invention was described, the scope of the present invention is not limited only to the said embodiment, The various form which can implement | achieve the function of each invention specific matter of this invention is included. It is.

  For example, the value of the reference value z may be changed according to various conditions. For example, the control circuit 17 determines whether the host vehicle is traveling on a general road or a highway based on the current position of the host vehicle and map data. The reference value z may be set higher than when traveling on a general road.

  As described above, the time from the start of operation of the haptic device 15a until the warning is given because the steering wheel operation is relatively less when driving on a highway than when driving on a general road. It is possible.

  Further, for example, the control circuit 17 determines whether the vehicle speed is high speed or low speed when the host vehicle is traveling on a general road. If the vehicle speed is high, the reference value z is higher than if the vehicle speed is low. The value of may be lowered.

  As described above, on a general road, the time from the start of operating the haptic device 15a to the warning is lengthened during low-speed traveling and shortened during high-speed traveling while the general road is traveling at low speed. However, while driving is relatively easy, while driving on ordinary roads at high speeds, there is no driving allowance, and slight side effects and navigation device 1 operations may interfere with safe driving. Because it is thought that there is.

  Further, for example, the control circuit 17 may reset the counter B when the operation unit 13 is operated during the execution of the program 200 or when the haptic device 15a is pressed. Good. This is because even in such a case, the driver is operating the vehicle navigation device 1.

  For example, the program 100 may be executed by the control circuit 17. In that case, the haptic device control unit 15 b transfers the control signal output from the control circuit 17 to the actuator unit 53 to the actuator unit 53 and outputs the signal received from the trackball position detection unit 54 to the control circuit 17. It only has to be.

  Further, the operating device of the present invention is not necessarily the haptic device 15a as in the present embodiment, and any vehicle that can output a signal corresponding to the amount of movement of the movable body that the driver moves by hand can be used as a vehicle. The effect that it is possible to detect that the driver is putting a hand on the operating device without the need of a sensor different from the navigation device 1 is achieved.

  Further, in the above-described embodiment, each function realized by the haptic device control unit 15b and the control circuit 17 executing a program is hardware having these functions (for example, a circuit configuration can be programmed). (FPGA) may be used.

  Moreover, in the said embodiment, although the navigation apparatus 1 for vehicles is illustrated as a pointer display / movement apparatus, even if it is not the navigation apparatus 1 for vehicles, the pointer display / movement apparatus is mounted in the vehicle, and image Anything that moves by displaying a pointer in the display screen of the display device is sufficient.

It is a lineblock diagram of navigation device 1 for vehicles concerning one embodiment of the present invention. 2 is a diagram illustrating a configuration of a haptic unit 15. FIG. It is a flowchart of the program 100 which the haptic device control part 15b performs. It is a figure which shows an example of the feedback force 28 which concerns on the pointer 27. FIG. It is a flowchart of the program 200 which the control circuit 17 performs.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Vehicle navigation apparatus 11 Position detector 12 Image display apparatus 13 Operation part 14 Speaker 15 Haptic part 15a Haptic device 15b Haptic device control part 16 Map data acquisition part 17 Control circuit 20 Display screen 21-26 Button image 27 Pointer 28 Feedback force 51 Trackball holding section 52 Trackball section 53 Actuator section 54 Trackball position detection section 55 Projection section

Claims (4)

An operating device (15a) for outputting a signal corresponding to the amount of movement of the movable body (52) to be moved by the driver of the vehicle by hand;
A control unit (15b, 17) for moving a pointer in the screen of the image display device (12) based on a signal from the operation device (15a),
The control unit (15b, 17) includes detection means (210-250) for detecting that the pointer is continuously moving for a first reference time or more,
A pointer display / movement device comprising: warning means (255) for giving a warning to the driver based on the detection of the detection means (210-250). The operating device (15a) has an actuator section (53) that applies a force to move the movable body (52) to the movable body (52),
The controller (15b, 17) includes haptic control means (100) for controlling the force applied by the actuator (53) to the movable body (52) according to the position of the pointer. The pointer display / movement apparatus according to claim 1.   The said detection means (210-250) considers that the said pointer is moving continuously, when the said pointer moves without leaving a period more than 2nd reference | standard time. The pointer display / movement device described in 1. Based on the signal from the operating device (15a) and the operating device (15a) that outputs a signal corresponding to the amount of movement of the movable body (52) that the driver of the vehicle moves by hand, A program used for the control units (15b, 17) for moving the pointer,
The control unit (15b, 17) is based on detection means (210-250) for detecting that the pointer is continuously moving for a first reference time or more, and detection by the detection means (210-250). A program for causing the control units (15b, 17) to function as warning means (255) for warning the driver.

Images