JP4706362B2 - Vehicle navigation system - Google Patents

Description

  The present invention relates to a vehicle navigation system, and more particularly to a vehicle navigation system configured to prohibit an input operation by a driver when the vehicle is traveling.

  In recent years, for vehicles such as automobiles, the position information obtained by GPS (Global Positioning System) and map information stored in a storage device such as a hard disk device or a DVD (Digital Video Disk) device are displayed on a display. A navigation system is listed.

  In this type of vehicle navigation system, operations such as changing destinations and entering search conditions are prohibited during driving to ensure safety while the vehicle is running, and when the vehicle is stopped It is set so that the input operation can be performed only in (see, for example, Patent Document 1).

In the vehicle navigation system described in Patent Document 1, when a pressure sensor is provided on a steering wheel and the pressure sensor detects that the driver is holding the steering wheel, input by a passenger other than the driver is performed. The operation is allowed.
JP 2004-271488 A

  However, in the vehicle navigation system described in the above cited document, for example, when the driver is holding the steering wheel at a place other than the pressure sensor, it is not detected that the driver is operating. Even if the person holds the steering wheel, other passengers may not be able to perform input operations such as changing the destination.

  In addition, in a vehicle navigation system, if a passenger in the front passenger seat is performing an input operation such as changing the destination, the driver may change the gripping position by holding the steering wheel. Since it is prohibited, improvement of convenience is demanded.

  In addition, if an input operation is performed by another occupant while it is detected that the steering wheel is being gripped, the driver may be distracted by the input operation by the other occupant and drive aside. was there.

  Therefore, an object of the present invention is to provide a vehicle navigation system that solves the above-described problems by detecting the direction of the driver's face.

  In order to solve the above problems, the present invention has the following means.

  According to the first aspect of the present invention, position measuring means for measuring the position of the vehicle, display means for displaying the position information measured by the position measuring means and map information around the detected position, and any search condition manually A face detection means for detecting a face of a driver of a vehicle in a vehicle navigation system comprising: input means for input by operation; and input prohibition means for prohibiting an input operation by the input means during travel of the vehicle. A face direction determining means for determining whether or not the driver's face detected by the face detecting means is facing the front of the vehicle, and the driver's face determined by the face direction determining means is It has an input permission means for canceling the input prohibition by the input prohibition means and permitting an input operation by the input means when facing the front of the vehicle.

  According to a second aspect of the present invention, the face detection unit is a camera that images the driver's face from the front, and the face orientation determination unit is based on the driver's face image captured by the camera. It is determined whether or not the driver's face is facing the front.

  The invention according to claim 3 is characterized in that the input permission means displays that the input operation is permitted on the display means while the vehicle is traveling.

  According to a fourth aspect of the present invention, the face orientation determination means determines whether the driver's face is facing the front based on the contour of the driver's face imaged by the camera and the position of the face centerline. It is characterized by determining.

  According to the present invention, in order to detect the driver's face of the vehicle, cancel the input prohibition when the driver's face is facing the front of the vehicle, and permit the input operation by the input means. When the driver is looking at the front of the vehicle even while the vehicle is traveling, input operations by other passengers are possible, and it is not necessary to stop the vehicle and perform input operations such as changing the destination. Improvements in convenience are being made.

  In addition, when the driver's face is facing away from the front while the vehicle is running, input operations are prohibited, and the driver's face is distracted by other passengers performing input operations. When is changed, the input operation is prohibited at that time, and the driver's aside driving can be suppressed.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing an embodiment of a vehicle navigation system according to the present invention. FIG. 2 is a plan view of the vehicle as viewed from above. As shown in FIGS. 1 and 2, the vehicle navigation system 10 is controlled by a navigation ECU (electronic control unit) 14 mounted on a vehicle 12 such as an automobile, and the navigation ECU 14 has a GPS antenna (position). When radio waves from a plurality of artificial satellites (not shown) are received by the measuring means 16, the current position is calculated based on the received signals, and the measurement position and its surrounding map are displayed on the liquid crystal display (display means) 18. To do.

  The vehicle navigation system 10 includes a storage device 20 that stores GPS position information, map information, and other search information, and a driver camera (face detection means) that captures the face of the driver 38 when the vehicle travels. 22. The driver camera 22 is provided at a position where the face of the driver 38 is imaged from the front.

  The driver camera 22 is, for example, an in-vehicle camera using a CCD image sensor or a C-MOS image sensor. For example, an upper part of the column cover 26 of the steering wheel 24 that can image the face of the driver 38 from the front lower side, It is attached in front of the meter housing, the inner mirror, or the upper part of the windshield. The mounting position of the driver camera 22 may be any position that does not hinder driving operation. However, since the driver's face image changes depending on the camera position, the face orientation detection calculation processing is performed according to the camera position. The method will be used. As the storage device 20, for example, a hard disk device or a DVD device is used.

  The liquid crystal display 18 is provided at a substantially intermediate position on the dashboard 32 so that it can be seen from both the driver's seat 28 and the passenger seat 30. Therefore, various switches (input means) 34 provided around the liquid crystal display 18 are provided so as to be operated from both the driver seat 28 and the passenger seat 29. The screen of the liquid crystal display 18 is a touch panel type, and various input operations (for example, a destination setting operation) can be performed when the driver or the passenger touches the screen.

  Further, the driver's face image captured by the driver camera 22 is supplied to the face orientation detection ECU 36. As will be described later, the face direction detection ECU 36 generates face direction detection data based on the face contour shape and the position of the face center line, and supplies the face contour data corresponding to the face direction while the vehicle is running to the navigation ECU 14. To do.

  The navigation ECU 14 receives vehicle speed information from the vehicle speed calculation unit 42 that calculates the vehicle speed from the speed detection signal detected by the vehicle speed sensor 40, and enters the input prohibit mode when the vehicle speed exceeds a predetermined value. The driver seat 28 is provided with a driver seat sensor 50 for detecting that the driver 38 is seated, and the passenger seat 30 is provided with a passenger seat sensor 52 for detecting that the passenger 54 is seated. Is provided. When the detection signals from the driver seat sensor 50 and the passenger seat sensor 52 are input even when the vehicle is traveling, the navigation ECU 14 performs an input operation such as a destination on the condition that the driver 38 is facing the front as described later. Switch to the input permission mode that permits As the driver seat sensor 50 and the passenger seat sensor 52, for example, the weight may be detected by a pressure sensor, or it may be detected by a switch that the bracket of the seat belt is coupled to the buckle. .

  The navigation ECU 14 determines whether or not the face of the driver 38 faces the front of the vehicle based on the input prohibiting means 60 that prohibits an input operation while the vehicle is traveling and the face direction detection data supplied from the face direction detection ECU 36. And an input permission means 64 for canceling the input prohibition and permitting the input operation when the face of the driver 38 faces the front of the vehicle.

  FIG. 3 is a block diagram showing the configuration of the vehicle navigation system 10. As shown in FIG. 3, the navigation ECU 14 includes a touch panel (input means) 18a in addition to the GPS antenna 16, the liquid crystal display 18, the storage device 20, the vehicle speed calculation unit 42, the driver seat sensor 50, and the passenger seat sensor 52. The TV tuner 56 is connected.

  The face direction detection ECU 36 is provided separately from the navigation ECU 14, detects the face direction based on the video signal from the driver camera 22, and corresponds to the face direction (angle in the left-right direction). The direction detection data is output to the navigation ECU 14. The navigation ECU 14 may be integrated so that it also serves as the face direction detection ECU 36.

  FIG. 4 is a view showing a display example of the face image of the driver 38, (A) is a view showing a face image in a state where the driver is looking in front, and (B) is a view of the liquid crystal display 18 by the driver. It is a figure which shows the face image of a state.

  As shown in FIG. 4A, in the face image of the driver 38 captured by the driver camera 22 with the driver 38 facing the front, the ratio of the horizontal dimension to the vertical dimension is large. Further, as shown in FIG. 4B, the face image of the driver 38 captured by the driver camera 22 with the driver 38 facing sideways (obliquely lateral direction) is a horizontal image with respect to the vertical dimension. The ratio of dimensions is reduced.

  Therefore, the face direction detection ECU 36 can detect the face direction from the face image of the driver 38 captured by the driver camera 22. As a method for detecting the face orientation of the present embodiment, for example, (1) a method for obtaining a face contour and detecting a change in face width based on the face contour to detect the face orientation, and (2) configuring a driver's face To find the face orientation by detecting the position of the center of the face from the symmetry of the face parts (ears, eyes, nose, etc.), and (3) the face from the horizontal ratio of the face contour and the movement position of the face centerline There are methods for calculating the orientation angle. As other face orientation detection methods, it is also possible to detect the face orientation by pattern matching of face contours and face parts (eyes, ears, nose, etc.).

  Hereinafter, a specific example of the face orientation detection method will be described using a method of calculating the face orientation angle from the ratio of the lateral direction between the face contour and the movement position of the face centerline.

  FIG. 5 is a view showing a display example in which the contour of the face image of the driver 38 is image-processed. (A) is a view showing a face contour image when the driver is looking in front. It is a figure which shows the face outline image of the state which is looking at the liquid crystal display.

  As shown in FIG. 5A, a face contour 38A in a state where the driver 38 faces the front of the vehicle 12 is extracted by edge processing, a virtual centerline O of the face is obtained from the face contour 38A, and this virtual center is obtained. The face orientation ratio a / b between the width a of the left face half and the width b of the right face half, which are the left and right regions of the line O, is obtained. For example, when the driver is facing the front, the face direction ratio is a / b≈1 because the left and right are symmetrical.

  Further, as shown in FIG. 5B, a face contour 38B in a state where the driver 38 faces sideways (obliquely lateral direction) is extracted by edge processing, and the virtual center line O ′ of the face is extracted from the face contour 38A. And a face orientation ratio a / b between the width a ′ of the left face half and the width b ′ of the right face half, which are the left and right regions of the virtual center line O, is obtained. For example, when the driver is facing sideways, the width a ′ of the left face half is large and the width b ′ of the right face half is small, so the face direction ratio is a ′ / b′≈0.3 to 0.5. Become.

  Therefore, it is possible to detect the face direction of the driver by calculating the face direction ratio a / b.

  Here, control processing executed by the navigation ECU 14 will be described with reference to FIGS. 6 and 7.

  When the accessory switch of the vehicle 12 is turned on in S11 shown in FIG. 6, the navigation ECU 14 proceeds to S12 and the face orientation data (for example, face contour data and face orientation supplied from the face orientation detection ECU 36). (Including the ratio and the like) is registered in the storage device 20 as determination reference data when the driver 38 faces the front. Normally, when the driver 38 gets on the vehicle 12 and the accessory switch is turned on to start the engine, the vehicle state is confirmed by looking at a meter arranged in front of the driver's seat 28. At this time, the face image of the driver 38 captured by the driver camera 22 is in a state of facing the front, and thus is registered as determination criterion data of the driver.

  Subsequently, in S13, the current position is obtained based on the position information obtained from the GPS antenna 16, and the current position is displayed on the liquid crystal display 18 together with the map information. In the next S14, it is checked whether or not a destination has been input. In S14, when the destination is input by the input operation of each switch 34 or the touch panel 18a, the process proceeds to S15 to check whether or not the input destination is confirmed.

  When the destination is determined in S15, the process proceeds to S16, where a route (route) from the current position to the determined destination is searched and based on priority conditions (for example, shortest distance, expressway, general road, etc.) A plurality of routes are displayed on the liquid crystal display 18. In S17, it is checked whether one route is selected from a plurality of routes by an input operation of each switch 34 or the touch panel 18a.

  When one route is selected in S17, the process proceeds to S18, in which it is checked whether or not a guidance start input operation has been performed. When the guidance start is input in S18, the process proceeds to S19, and the process shifts to a guidance display mode for guiding and displaying the route so that the vehicle 12 travels along the selected route. If the guidance start is not input in S18, the process returns to S14 and the destination is reset.

  If the destination is not input in S14, the process proceeds to S20, and shifts to a current position display mode (no guidance) for displaying only the current position. In S21, it is checked whether or not the accessory switch of the vehicle 12 is turned off. In S21, when the accessory switch remains on, the process returns to S20 and the current position display mode is continued. If the accessory switch is turned off in S21, the current process is terminated.

  When the mode is shifted to the guidance display mode in S19, the process proceeds to S22 shown in FIG. 7, and the vehicle speed data calculated by the vehicle speed calculation unit 42 is read to check whether or not the current vehicle 12 is stopped (V = 0 km / h). To do. In S22, when the current traveling speed is zero or more and the vehicle is not stopped, the process proceeds to S23, and the mode is shifted to the input prohibit mode for prohibiting the input operation (input prohibition means 60), and the input operation by each switch 34 or the touch panel 18a. Is displayed on the liquid crystal display 18.

  In next S24, it is checked whether or not the driver's seat sensor 50 detects that the driver 38 is seated in the driver's seat 28. In S24, when the driver's seat sensor 50 detects the presence of the driver 38, the process proceeds to S25, and the face orientation data is acquired from the face orientation detection ECU 36.

  Subsequently, in S26, the face orientation data acquired from the current face orientation detection ECU 36 is compared with the face orientation data acquired in S12 described above, and it is determined whether or not the current driver 38 is facing the front ( Face orientation determining means 62). For example, when the current face direction data and the face direction data as the determination reference data substantially match (the face direction ratio is a / b≈1), it is determined that the face of the driver 38 is looking front, If the face orientation data as the determination reference data does not match (the face orientation ratio is a / b≈0.3 to 0.5), the face of the driver 38 faces sideways (direction of the liquid crystal display 18). Is determined.

  In the next S27, it is checked whether or not the result of the face orientation determination process in S26 is the front orientation. In S27, for example, if it is determined that the face orientation determination result in S26 is facing the front, the process proceeds to S28. In next S28, it is checked whether or not the passenger seat sensor 52 detects that the passenger 54 is seated in the passenger seat 30. If the passenger seat sensor 52 detects the presence of the passenger 54 in S28, the process proceeds to S29, the input prohibit mode is canceled, and the vehicle 12 permits the input operation (input permission means 64). It is displayed on the liquid crystal display 18 that the input operation by the switch 34 or the touch panel 18a is possible.

  In next S30, it is checked whether or not there is an input operation such as destination change or route change. In S30, when the passenger 54 in the passenger seat 30 performs an input operation such as a destination change or a route change, the process proceeds to S31, and the input destination change or route change is set. In S30, when there is no input operation, the process of S31 is omitted. Note that when the driver 38 tries to perform an input operation, the face direction is not the front, so the input permission mode is canceled and the input prohibition mode is set at that time.

  In the next S32, the current position is obtained based on the position information obtained from the GPS antenna 16, and it is checked whether or not the destination has been reached. If the destination has not arrived at S32, the process returns to S22, and the processes after S22 are executed again.

  In S22, when the vehicle 12 is stopped, the process returns to S13 described above to enable an input operation. In S24, when the driver's seat sensor 50 is off, in S27, when it is determined that the face orientation determination result in S26 is not facing the front, or in S28, when the passenger seat sensor 52 is off. The normal travel input prohibition mode is continued, and in S33, it is checked whether or not the vehicle 12 is stopped. In S33, if the vehicle 12 is stopped, the process returns to S13 described above to enable input operation.

  If the destination arrives at S32, the process proceeds to S34, the guidance to the destination is terminated, and the current position display mode (no guidance) is displayed at S35 where only the current position is displayed. In S36, it is checked whether or not the accessory switch of the vehicle 12 is off. If the accessory switch is on, the process returns to S13 described above, and the processes in and after S13 are repeated. If the accessory switch is turned off, the current process is terminated.

  As described above, in the vehicle navigation system 10, an input operation is possible on the condition that the driver 38 is seated in the front passenger seat 30 and the driver 38 is seated while the vehicle 12 is traveling. Thus, since the destination changing operation can be performed, the input operation can be performed safely without stopping the vehicle 12, so that convenience is enhanced.

  In the above-described embodiment, the input operation of the vehicle navigation system 10 can be performed on the condition that the face of the driver 38 is facing forward and the passenger 54 is seated on the passenger seat 30 even when the vehicle 12 is traveling. However, for example, it is of course possible to allow input operations other than changing the destination and route.

  In the above embodiment, the route guidance is displayed on the liquid crystal display 18 as an example. However, the present invention is not limited to this. For example, the driver 38 gets on the passenger seat 30 with the face of the driver 38 facing front. It is also possible to display the TV image from the TV tuner 56 on the liquid crystal display 18 by permitting the input operation of the switch of the TV tuner 56 on the condition that the person 54 is seated.

  Further, in the above-described embodiment, the input operation is made possible on condition that the face of the driver 38 is facing front and the passenger seat sensor 52 is on. However, the present invention is not limited to this, and the passenger seat sensor 52 is not limited thereto. Of course, other switches (for example, a switch provided on the passenger seat side that cannot be operated from the driver's seat) may be used.

It is a block diagram which shows one Example of the navigation system for vehicles which becomes this invention. It is the top view which looked at the vehicle from the top. 1 is a block diagram showing a configuration of a vehicle navigation system 10. FIG. FIG. 7 is a diagram showing a display example of a face image of the driver 38, (A) is a diagram showing a face image when the driver is looking at the front, and (B) is a face when the driver is looking at the liquid crystal display 18. It is a figure which shows an image. It is a figure which shows the example of a display which image-processed the outline of the face image of the driver | operator 38, (A) is a figure which shows the face outline image in the state which the driver | operator looks at the front, (B) is a driver | operator's liquid crystal display 18 It is a figure which shows the face outline image of the state which is watching. It is a flowchart for demonstrating the control processing which ECU14 for navigation performs. 7 is a flowchart for explaining a control process executed by the navigation ECU 14 following the process shown in FIG. 6.

Explanation of symbols

10 Vehicle Navigation System 12 Vehicle 14 Navigation ECU
16 GPS antenna 18 Liquid crystal display 20 Storage device 22 Driver camera 28 Driver seat 30 Passenger seat 36 Face orientation detection ECU
42 Vehicle speed calculation unit 50 Driver's seat sensor 52 Passenger's seat sensor 60 Input prohibition means 64 Input permission means 62 Face orientation determination means

Claims (4)

Position measuring means for measuring the position of the vehicle;
Display means for displaying position information measured by the position measuring means and map information around the detected position;
An input means for manually inputting an arbitrary search condition;
In a vehicle navigation system comprising: an input prohibition unit that prohibits an input operation by the input unit during travel of the vehicle;
Face detection means for detecting the face of the driver of the vehicle;
Face orientation determination means for determining whether or not the driver's face detected by the face detection means faces the front of the vehicle;
An input permission means for canceling the input prohibition by the input prohibition means and permitting the input operation by the input means when the driver's face determined by the face orientation determination means faces the front of the vehicle; A vehicle navigation system characterized by that. The face detection means is an imaging camera that images the driver's face from the front,
The vehicle according to claim 1, wherein the face orientation determination unit determines whether or not the driver's face is facing the front based on the driver's face image captured by the camera. For navigation system. The input permission means includes
The input operation is permitted when it is detected that a passenger is seated in a passenger seat of the vehicle and the driver's face is facing the front of the vehicle. The vehicle navigation system described.   The face orientation determining means determines whether or not the driver's face is facing the front based on a contour of the driver's face imaged by the imaging camera and a position of a face center line. The vehicle navigation system according to claim 1.

Images