JP4367624B2 - Vehicle control device and method when using telephone while driving - Google Patents

Description

The present invention relates to a vehicle control apparatus and method for using a telephone while driving, which controls the vehicle when it is detected that a driver is talking on a mobile phone while driving.

  In recent years, with the spread of mobile phones, calls during driving by drivers have become a problem. In view of this problem, the driver's driving phone is prohibited by law, but there are many drivers who are talking while driving, even though they are actually driving.

  As a method for restricting calls during driving, conventionally, the start of a call is determined by a ringing tone, and a message to the effect that driving is in progress is output in response to the ringing tone (see, for example, Patent Document 1). .

  However, according to the conventional method as described above, when a plurality of people are on board, it is impossible to specify which mobile phone rang, and the passenger's mobile phone in the passenger seat or the rear seat cannot be identified. There is a problem that an automatic response is made when it rings. In addition, a configuration in which only the registrant's mobile phone is automatically responded can be adopted, but according to this, there is a problem that the registrant automatically responds even when the passenger is in the passenger seat.

  The technique described in Patent Document 2 determines the start of a call by detecting an electromagnetic field emitted from a mobile phone during a call. This also causes the same problem as described above.

  Furthermore, there is a concern about malfunction due to a telephone ringing sound in a radio program, a telephone ringing sound outside the vehicle when stopping at an intersection, or the like. In recent years, there is a problem that it is difficult to determine whether or not the ringing sound is a telephone ringing tone because the telephone ringing tone can be freely changed according to the user's preference.

JP-A-10-70492

JP-A-10-294970

The present invention has been made to solve the above-mentioned problems, and the object of the present invention is to detect only a call made by a mobile phone of the driver himself, PHS or a similar mobile communication device, and when this is detected. It is an object of the present invention to provide a vehicle control apparatus and method capable of taking a telephone measure while actively driving.

In order to achieve the above object, the present invention observes the posture of a driver seated in a driver's seat of a vehicle, and when detecting the talking posture of the driver, counter means for counting up a setting counter, and the counter When the set counter value counted up by the means exceeds the warning threshold value, warning means for warning the call, and after the warning, the set counter value counted up by the counter means determines the call. Output means for outputting a vehicle control execution command to the vehicle controllers when the threshold value is exceeded .

In the present invention, the counter means further counts down the release counter when detecting the non-calling posture of the driver, and the output means further has a release counter value counted down by the counter means of 0. If it becomes below, you may make it output the cancellation | release command of vehicle control with respect to the controllers of the said vehicle .

According to the above construction, by the driver during running of the vehicle is a call on a cellular phone or the like is continued, it is determined that a call be made vehicle control, then call the driver is traveling Exit, this state continues, it is determined that the non-call so that the vehicle control is released.

In the present invention, “observing the driver's posture” includes photographing and observing the driver sitting on the driver's seat of the vehicle with a camera. “Observing the driver” means observing whether or not the driver is in a posture (calling posture) that makes a call with a portable communication device such as a mobile phone during driving.

  As a specific method of such driver observation, for example, the driver's face and its peripheral part are photographed with a camera, the driver's face area is searched from the image photographed with the camera, and the result of the search is detected. Search for the driver's hand area around the face area.

  When such a driver observation method is adopted, a face area is detected from an image photographed by a camera in advance before searching for a hand area, and it is only necessary to search for a hand area limited to the periphery of the face area. Therefore, the time required for the search can be shortened.

  As the setting counter, for example, a type that counts up from 0 can be applied. In this case, the call determination threshold value is greater than zero. These do not mean that a countdown type cannot be adopted.

  Further, the time until the value of the setting counter is counted up from 0 and exceeds the call determination threshold is the time until the call posture is continuously maintained and it is determined that the call is in progress (hereinafter referred to as “call determination time”). "). Accordingly, the call determination time can be increased or decreased by appropriately changing the call determination threshold as necessary.

  As the release counter, for example, a counter that counts down from a predetermined set value can be applied. In this case, the non-call determination threshold value is 0. These do not mean that a counting-up type cannot be adopted.

  In addition, the time until the value of the release counter counts down from a predetermined set value and becomes 0 or less is the time until the non-calling posture is continuously maintained and it is determined that the non-calling is in progress (hereinafter “non-calling”). Referred to as “determination time”). Therefore, it is possible to adjust the non-call determination time by appropriately changing the setting value of the release counter as necessary.

  The setting counter and the cancellation counter are separately provided as described above, because the call determination time and the non-call determination time do not necessarily have to be the same, so that each time can be adjusted individually. Because. After the setting counter is used, the same storage area may be used as the release counter.

  Further, although the two counters can provide a time difference between the call determination time and the non-call determination time, such a time difference may be provided by means other than these counters. As long as the call determination time and the non-call determination time can be adjusted independently, such a time difference can be provided or not provided.

  When determining whether or not a call is in progress, for example, a hand may be moved near the ear due to the action of scooping up the hair. Therefore, a predetermined time (in the above example, the value of the setting counter is used to (Time until the threshold is exceeded) It is desirable to determine that a call is in progress only when the hand is continuously present near the ear. The same is true for determining whether or not a call is made.

  Since it is conceivable to change the mobile communication device such as a mobile phone to the left and right, it is preferable to search for the hand on both sides of the face area.

  For example, when the mobile communication device held with the right hand is changed to the left hand, the accumulated time from when the mobile communication terminal is started to be held with the right hand is calculated, and this is the predetermined time (in the above example, the setting counter It is necessary to determine that a call is in progress when the value exceeds the time until the call determination threshold is exceeded.

  In addition, when a call is made with a mobile communication device such as a mobile phone, the hand usually exists in the range from the ear to the mouth. It is not necessary to do so, and it is sufficient to carry out within the range from the ear to the mouth, so that the search time can be further shortened.

  Although the camera that shoots the driver is fixed, the driver can take any posture, so each time you shoot a driver with the camera, the driver's face position moves up, down, left, or right from the center of the shooting screen. It is inevitable that they will shift. Thus, although the driver's face position varies, it is normally at the position of the headrest. Therefore, if the position of the headrest on the photographing screen is known in advance, the search can be performed from a portion where the driver's face is highly likely to exist, and the search time can be further reduced. Furthermore, even when the camera position and the sheet position change, it is possible to cope with these changes.

  In the series of search processes described above, the process of “searching for a driver's face area from images taken by a camera” is executed as a face search process of the image processing unit. Further, the process of “searching the driver's hand area around the face area detected as a result of the search” is executed as the hand search process of the image processing unit.

  More specifically, the “face area search” scans an image captured by a camera with a face area detection graph. The above-mentioned “hand area search” is for the purpose of searching for a hand when the driver holds a mobile communication device such as a mobile phone and is in contact with his / her ear, and wrist detection is performed as a specific means for achieving this purpose. A wrist graph is used to scan the periphery of the face area with the wrist detection graph.

The content of the “vehicle control” may be any one of the following (1) to (4) or a combination thereof. The contents of the following vehicle control are exemplifications, and any other vehicle control can be applied as the vehicle control of the present invention as long as it is suitable as a telephone countermeasure during driving. It can also be combined with the vehicle control shown below.
(1) Limit the maximum speed of the vehicle.
(2) Turn on the lane keeping function.
(3) Turn on the ACC function and set the ACC setting value to the safe side. If the ACC function is already ON, the ACC setting value is changed to the safe side.
(4) Set the brake assist to be stronger than it currently is.

  In the above-mentioned “cancellation of vehicle control”, for example, the ACC function set to the safe side by the execution command of the vehicle control as well as the canceling operation such as turning off the ACC function turned ON by the execution command of the vehicle control. A restoration processing operation such as returning the setting value to the original user setting value is also included.

  Furthermore, a warning for a driver's call may be issued in advance before the vehicle control execution command is output. This warning only needs to stimulate the five senses of the driver. For example, a warning that stimulates the hearing of the driver, such as a warning sound with a buzzer, a lighting or blinking of a lamp, or a warning message display. Warnings that stimulate the driver's sensation, such as warnings that stimulate the user's sight, vibrations, and the like are included in this warning.

  By adopting a configuration that issues the above warning, it is possible to prepare the mind by informing the driver in advance that vehicle control will be performed as a countermeasure for calls during driving and that user settings will be changed accordingly, It has the effect of preventing surprises. The vehicle control may be started after the warning starts or after the warning ends. If vehicle control is started after the warning ends, the driver can grasp the control start time.

  As a condition for “the vehicle control execution command is output”, it can be added that the vehicle is in a running state. Here, the state where the vehicle engine is operating, the mission is neutral, and the side brake is applied is the vehicle stop state, and the other state is the vehicle running state.

  As described above, in order to determine whether the vehicle is stopped or in the running state, information on the position of the mission and the state of the side brake is required, but these information are stored in the vehicle controller unit. You may acquire using the signal output from the sensor which detects the position of a mission, and the sensor which detects the state of a side brake among sensors. The mission position information may be obtained from the transmission control controller. In this case, the mission position information may be acquired from the control controller.

  When the conditions described above are added, vehicle control is performed only when the vehicle is in a running state, and no vehicle control is performed when the driver may call. This is because the object of the present invention can be achieved if measures are taken against calls during driving by the driver.

  According to the present invention, since the posture of the driver seated in the driver's seat of the vehicle is observed, only the call with the driver's own mobile phone or the like can be detected, and the call posture of the driver is continuously detected. In this case, it is determined that the call is in progress, and a vehicle control execution command is output to the vehicle controllers. Therefore, when there is a call during driving by the driver, it is possible to take an active driving telephone measure such as vehicle control. .

  In the present invention, since the measures for the telephone during driving are taken based on the attitude of the driver as to whether or not it is a call attitude, it is not limited to the registered driver, and it can deal with an unspecified number of drivers. Even if such a person becomes a driver, if the person starts a call on the mobile phone while driving, vehicle control is automatically performed as a countermeasure against the telephone during driving. Even if the driver himself forgets to set the answering machine mode.

  Hereinafter, the best mode for carrying out the present invention will be described in detail with reference to the accompanying drawings.

  As shown in FIG. 1, the vehicle control device of the present embodiment includes a camera 1, an illumination 2, an image processing unit 3, a vehicle controller unit 4, and sensors 5 and controllers 6 connected to the vehicle controller unit 4. The apparatus configuration including the above is adopted.

  In the present embodiment, the camera 1 functions as a means for photographing and observing the driver seated in the driver's seat of the vehicle. In the camera 1, the face of the driver seated in the driver's seat and its surroundings Shoot the part. Accordingly, the camera 1 is disposed at a position where the driver's face can be photographed, for example, in front of the driver's seat. The illumination 2 is used when the driver takes a picture.

  6 to 8 are images taken by the camera 1, FIG. 6 is a driver image when a call is not being made with a mobile phone, and FIG. 7 is a call by holding the mobile phone with five fingers and a palm. FIG. 8 is a driver image when a telephone call is made by raising a forefinger and holding a mobile phone. Such a driver image is taken by the camera 1.

  As shown in FIG. 2, the image processing unit 3 is configured by using hardware resources such as the CPU 3-1, RAM 3-2, ROM 3-3, camera control unit 3-4, and illumination control unit 3-5. .

  An image processing program is stored in the ROM 3-3. The CPU 3-1 executes the image processing program in the ROM 3-3. Thereby, the image processing unit 3 functions as a device that performs image reading processing, search processing, and the like. FIG. 3 shows that an image reading processing unit and a search processing unit exist in the image processing unit 3 as parts for performing such processing.

  In the image reading process in the image processing unit 3, the camera 1 is controlled via the camera control unit 3-4, and an image photographed by the camera 1 is taken into the RAM 3-2 as data.

  The search processing in the image processing unit 3 includes a face search process and a hand search process. Each process will be described individually below.

  The face search process is a process of searching for a driver's face area from images (see FIGS. 6 to 8) taken by the camera 1. In this process, the face area detection graph G1 shown in FIG. 9 is used as the face area search means.

  The face area detection graph G1 in FIG. 9 represents the face range of a person by a line segment L1, and the relative arrangement relationship of the face, nose and mouth by a plurality of points P. The face area detection graph G1 is stored in advance in the ROM 3-3 as data, and is appropriately read from the ROM 3-3 and used.

  Specifically, the search for the face area in the face area search process is performed by scanning the shot image data in the RAM 3-2 with the face area detection graph G1 in FIG. 9, and taking the shot image data and the face area detection graph. G1 matching processing is performed, and a face area is detected based on the matching result.

  If the face area cannot be detected by scanning with the face area detection graph G1, scanning is performed with a similar graph (not shown) having a different size from the basic graph G1. The similarity graph may be stored in the ROM 3-3 in the same manner as the basic graph G1, but the similarity graph may be generated by converting the basic graph G1 into a similar shape by the processing of the CPU 3-1. . At this time, the basic graph G1 may be transformed into a vertically long shape or a horizontally long shape instead of simply performing similarity conversion.

  10 to 12 schematically show scanning by the face area detection graph G1, FIG. 10 shows a state in which a face area is detected by scanning the driver image of FIG. 6, and FIG. FIG. 12 is an explanatory diagram of a state in which a driver image is scanned to detect a face area, and FIG. 12 is a diagram illustrating a state in which the driver image in FIG. 8 is scanned to detect a face area.

  The hand search process is a process of searching for the driver's hand area around the face area detected by the face search process. In this process, the wrist detection graph G2 shown in FIG. 13 is used as the hand region search means.

  The wrist detection graph G2 in FIG. 13 represents the range of the fist from the wrist when the person holding the mobile phone with his hand and hitting his ear is viewed from the front, as a line segment L2. The wrist detection graph G2 is also stored in advance in the ROM 3-3 as data, and is appropriately read from the ROM 3-3 and used.

  Specifically, the hand area search in the hand search process detects the hand area around the face area detected in the previous process. Therefore, the captured image data in the RAM 3-3 corresponding to the image around the face area is detected. Is scanned with the wrist detection graph G2 in FIG. 13, and the matching processing of the captured image data and the wrist detection graph G2 is performed, and the hand region is detected based on the matching result.

  14 to 16 schematically show scanning by the wrist detection graph G2, and FIG. 14 scans the driver image of FIG. 6 around the face area, but the hand area can be detected. FIG. 15 illustrates a state in which the driver image in FIG. 7 is scanned around the face area to detect a hand area, and FIG. 16 illustrates a state in which the driver image in FIG. FIG.

  14 to 16 use the wrist detection graph G2 shown in FIG. 13 on the assumption that the driver has a mobile phone with the right hand. Although not shown, when the driver searches the hand region on the assumption that the driver has a mobile phone with his left hand, a graph symmetrical to the wrist detection graph G2 shown in FIG. 13 is used. The left-hand search graph may be stored in the ROM 3-3 in advance, or may be generated by the processing of the CPU 3-1 using the wrist detection graph G2.

  By the way, the search for the hand region does not need to scan the entire periphery of the face region with the wrist detection graph G2 of FIG. 13, and it is sufficient to scan within the range from the ear to the mouth. This is to detect the hand holding the mobile phone, and such a hand is present in the range from the ear to the mouth in a normal call posture.

  There may be a hand under the chin or a hand above the temple, but this is not a normal talking posture, so it scans around the chin and the temple. There is no need to expand the range. If the scanning range is limited to the range from the ear to the mouth as described above, the time required for the search process can be reduced.

  The image processing unit 3 performs a series of search processes such as a face area search process and a hand search process, and then sends the processing results to the vehicle controller unit 4. That is, as a result of the above series of search processing, if a hand region can be detected around the face region, information to that effect is sent out, and if that cannot be detected, information to that effect is sent out. .

  The vehicle controller unit 4 is configured using hardware resources such as a CPU 4-1, a RAM 4-2, a ROM 4-3, and an I / F unit 4-4 as shown in FIG. 4. In the ROM 4-3 of the vehicle controller unit 4, in addition to a general program related to vehicle control, a determination program related to a process for countermeasures against a telephone during driving as shown in FIG. 5 is stored. In addition, the CPU 4-1 of the vehicle controller unit 4 executes a general program stored in the ROM 4-3 and also executes a determination program of FIG. 5 stored in the ROM 4-3.

  By executing the above determination program by the CPU 4-1 of the vehicle controller unit 4, the vehicle controller unit 4 determines whether or not the countermeasure should be taken as part of the driving telephone countermeasures, a warning based on the determination result, It functions as a device that executes vehicle control.

  In the following description, the state where the vehicle engine is operating, the mission is neutral, and the side brake is applied is defined as the vehicle stopped state, and the other state is defined as the traveling state. Specifically, the mission is neutral, such as when the mission is driving and the side brakes are not pulled, or when waiting for traffic lights, etc. A state in which the side brake is applied without any trouble is also regarded as a running state.

  As described above, when determining what state the vehicle is in, that is, whether it is in a stopped state or a traveling state, information on the position of the mission and the state of the side brake is required, but these information are stored in the vehicle controller unit 4. This is obtained using signals output from the sensors 5 of the vehicle connected thereto. From the relationship with such an information acquisition method, the sensors 5 of the vehicle include at least a sensor for detecting the position of the mission and a sensor for detecting the state of the side brake. By the way, the mission position information may be obtained from the transmission controller. In this case, the mission position information may be obtained from the control controller. The transmission controller is included in the vehicle controller 6.

  In the vehicle controller unit 4, execution of the determination program of FIG. 5 and the accompanying vehicle control, etc., the following telephone countermeasure processing during driving starts only on the condition that the engine is operating, paying attention only to the state of the vehicle engine. Shall be.

  For example, if the vehicle's ignition switch is in the accessory position and you are listening to the radio in a stopped car, the engine is stopped and you do not have to worry about starting, so you don't have to take phone measures while driving. Therefore, there is no processing of telephone countermeasures while driving.

  When the engine is stopped, the telephone countermeasure processing while driving is automatically stopped. However, if the engine is stopped while in a call state, the predetermined telephone call recovery process is stopped after performing a predetermined recovery process. The predetermined restoration process will be described later.

  When the ignition switch of the vehicle is turned on and the vehicle engine is further operated, the vehicle controller unit starts a telephone countermeasure process during driving. That is, the variables are initialized, and the determination program shown in FIG. 5 is executed at predetermined intervals. The determination program in FIG. 5 is expressed in PAD.

  The determination program of FIG. 5 uses a warning threshold value, a call determination threshold value, and a non-call determination threshold value. These threshold values are stored in a data storage unit such as a ROM 4-3 in the vehicle controller unit 4. Stored.

  The determination program shown in FIG. 5 also uses a call flag, a setting counter, and a cancellation counter. At this time, a storage area for a setting counter and a release counter is provided on the RAM 4-2 in the vehicle controller unit 4. The same applies to the call flag. A predetermined set value for countdown is set in the release counter. The predetermined set value for countdown is determined in advance by, for example, experiments and stored in the ROM 4-3 in the vehicle controller unit 4. ing.

  In the determination program shown in FIG. 5, processing is performed in the following flow (b) and (b).

  According to the determination program of FIG. 5, (a) processing is started (step 100), and flag determination (step 101) is performed. As a result, if the call flag is not in a call, it is determined whether the driver is in a call position. Determine (step 300). Here, if the driver's posture is a talking posture, a setting counter is counted up (step 301), it is determined whether or not the vehicle is in a running state (step 302), and if the vehicle is in a running state, a setting is made. It is determined whether the count value of the counter exceeds the warning threshold value (Y → 303 in step 302), and further, it is determined whether the count value of the setting counter exceeds the call determination threshold value (step). 305).

  (B) If the count value of the setting counter does not exceed the warning threshold value at the time of the determination in step 303, the processing is terminated after taking countermeasures against the overflow of the setting counter (step 311) (step 102), The processing is resumed from step 100 after a predetermined time has elapsed. On the other hand, if the count value of the setting counter exceeds the warning threshold value, a warning for the call is started (step 304).

  Here, a process until the warning is started and a process until the vehicle control is started will be described in detail.

  When the call flag is not busy, if the driver starts a call using a mobile phone while the vehicle is running and the call is ongoing, the steps 100 → 101 → 300 → 301 → 302 → The processing loop of 303 → 305 → 311 → 102 → 100 is repeated, and each time the setting counter is counted up by the CPU 4-1 of the vehicle controller unit 4, so that the count value of the setting counter eventually exceeds the warning threshold value. become. Then, the CPU 4-1 of the vehicle controller unit 4 starts warning for a call, assuming that the time for warning has come. The configuration related to this warning will be exemplified later.

  If the driver continues the ongoing call even after the warning is issued, the setting counter is further counted up, and the count value of the setting counter eventually exceeds the call determination threshold value. Then, in step 305, the CPU 4-1 of the vehicle controller unit 4 determines that the call determination threshold is exceeded, and the process proceeds to the next step 306 (Y → 306 in step 305). That is, in this embodiment, when the driver's hand area is continuously detected as the driver's call posture by the search processing of the image processing unit 3, and the number of detections exceeds the call determination threshold, the vehicle controller unit 4 The CPU 4-1 determines that the time for starting vehicle control has arrived and determines that a call is in progress, and performs predetermined processing (steps 306 to 310).

  The “predetermined processing” performed when it is determined that the call is in progress as described above determines whether or not the warning for the call has ended (step 306). If the warning has ended, the current control is performed. The mode / setting is stored (step 307), vehicle control is started (step 308), the call flag is set during a call (step 309), and the release counter is set (step 310).

  The above-described count-up of the setting counter means that the CPU 4-1 of the unit 4 counts up the value of the counter storage area provided on the RAM 4-2 in the vehicle controller unit 4. . In addition, the release counter set is a counter storage provided on the RAM 4-2 with a predetermined set-down value read out from the ROM 4-3 of the vehicle controller unit 4 by the CPU 4-1. It means storing in the area.

  In the embodiment presented this time, the vehicle control is started after the warning is finished. This is because the driver can recognize that the control is started upon completion of the warning. Instead of such a configuration, it is possible to adopt a configuration in which control is performed without waiting for the end of the warning. It is also possible to have a configuration in which a warning is kept during a call and the warning is stopped when it is determined that the call is over.

  However, the driver is running from when the warning is issued until vehicle control is started, that is, between when the count value of the setting counter exceeds the warning threshold value and exceeds the call determination threshold value. May end the call. In this case, in step 300, the CPU 4-1 of the vehicle controller unit 4 determines that the communication posture is not set, and in step 312, the count value of the setting counter is cleared to 0 (N → 312 in step 300). Therefore, the time to start vehicle control has not arrived, and therefore no vehicle control is performed. The CPU 4-1 of the vehicle controller unit 4 also clears the setting counter to zero.

  In addition, the driver may end the running call before the warning is issued, that is, before the count value of the setting counter exceeds the warning threshold value. Also in this case, it is similarly determined in step 300 that the telephone is not in a talking posture, and the count value of the setting counter is cleared to 0 in step 312 (N → 312 in step 300). Therefore, no warning is given.

  Furthermore, there is a case where the driver stops the vehicle with the engine running and continues the call between the warning and the start of vehicle control. In this case, it is determined in step 302 that the vehicle is not in a traveling state. Therefore, at this time, the process does not proceed to the subsequent steps 303 to 310, and therefore vehicle control is not performed. This is because in such a case, it is possible to make a call. The same applies to the case where the driver stops the vehicle with the engine running before the warning is issued and the call is continued.

  When it is determined in step 302 that the vehicle is not in a running state, when it is determined in step 305 that the count value of the setting counter does not exceed the call determination threshold value, and in step 306, the warning ends. If it is determined that it is not, the processing is terminated after taking an overflow countermeasure in step 311 (step 302 → 311 → 102), and the processing is restarted from step 100 after a predetermined time has elapsed. Further, after setting the release counter in step 310 or after clearing the setting counter to 0 in step 312, the process ends (step 102), and the process is restarted from step 100 after a predetermined time has elapsed.

  The overflow countermeasure in step 311 is provided to prevent the setting counter from overflowing when the driver continues talking while the vehicle is stopped with the engine running. That is, in this case, if step 311 does not exist, the processing loop of step 300 → 301 → 302 → 102 → 100 → 101 → 300 → 301 is repeated unless the driver ends the call. Since the counter is counted up and the setting counter may overflow due to a long call, in order to prevent this, an overflow countermeasure is taken in step 311.

  Whether or not the vehicle is in the running state in step 302 is determined by the CPU 4-1 of the vehicle controller unit 4 using the signals output from the vehicle sensors 5 or the controllers 6 and the position of the mission and the side brake. This is based on information about the state.

  Further, according to the determination program of FIG. 5, if the call flag is in a call as a result of starting the processing (step 100) and performing the flag determination (step 101), the driver is in a non-calling posture. (Step 200), and if it is a non-calling posture, the release counter is counted down (Y → 201 in Step 200), and further, it is determined whether or not the value of the release counter is 0 or less. (Step 202). Here, if the value of the release counter is 0 or less, predetermined processing (steps 203 to 206) is performed. That is, the call flag is set to non-call (step 203), a control release warning is issued (step 204), the control value is restored to the user set value (step 205), and the setting counter is cleared to 0 (step 206). .

  Here, a process until the restoration to the user setting value is performed will be described in detail.

  If the driver ends the running call after the vehicle control is started and the call flag becomes busy, and then the driver does not continue the running call, step 100 → 101 → 200 The process loop of 201 → 202 → 102 → 100 is repeated, and each time the CPU 4-1 of the vehicle controller unit 4 counts down the release counter, and the value of the release counter eventually becomes the non-call determination threshold value. 0 or less. Then, the CPU 4-1 of the vehicle controller unit 4 determines that the call is not in progress, and restores the control value to the user set value on the assumption that it is time to cancel the vehicle control. That is, in this embodiment, when the driver's hand area is not continuously detected as the driver's call posture by the search processing of the image processing unit 3 and the value of the release counter becomes 0, the vehicle controller unit 4 The CPU 4-1 determines that the call is not made, and performs the restoration processing operation as means for canceling the vehicle control.

  However, there may be a case where the driver resumes the call while the vehicle is restored, that is, until the value of the cancellation counter becomes 0 or less. In this case, in step 200, the CPU 4-1 of the vehicle controller unit 4 determines that it is not in the non-calling posture (calling posture), and the release counter is reset by the CPU 4-1 of the vehicle controller unit 4. (N → 207 in Step 200). Accordingly, it is not time to cancel vehicle control, and therefore vehicle control is not canceled or restored to the user set value.

  In the case where the count value of the setting counter is cleared to 0 in step 206, the resetting counter is reset in step 207, and when it is determined in step 202 that the value of the canceling counter is not less than 0. Ends the process (step 102), and resumes the process from step 100 after a predetermined time has elapsed.

  The setting counter counts up each time the driver's hand area is detected, so count how many times the driver's hand area is continuously detected It can be regarded as being. Further, the time until the value of the setting counter is counted up from 0 and exceeds the call determination threshold value is the call determination time. Accordingly, the call determination time can be adjusted in advance by changing the call determination threshold value as necessary.

  When the driver's hand area cannot be detected continuously, the release counter counts down each time, so it counts how many times the driver's hand area has been detected and how many times it has been detected. Can be considered. Further, the time until the value of the cancellation counter counts down from a predetermined set value and becomes 0 or less becomes the non-call determination time. Therefore, the non-call determination time can be adjusted by adjusting the setting value of the release counter as needed.

  As described above, in this embodiment, the call determination time is adjusted by the setting counter, and the non-call determination time is adjusted by the release counter independently of the setting counter. It functions as an adjustment means that can adjust the non-call determination time individually.

  The CPU 4-1 of the vehicle controller unit 4 determines whether or not the call posture is in step 300 based on the detection result of the hand area by the image processing unit 3. The same is true for determining whether or not the non-calling posture is in step 200.

  That is, for the determination in step 300, the CPU 3-1 of the image processing unit 3 performs an image reading process from the camera 1 and a search process. When the driver is not talking on the mobile phone at the time of this determination, there is no hand holding the mobile phone within the range from the driver's ear to the mouth, so the search processing of the image processing unit 3 Thus, the hand region cannot be detected, and information indicating that the hand region cannot be detected is sent from the image processing unit 3 to the vehicle controller unit 4 side. Therefore, in step 300, the CPU 4-1 of the vehicle controller unit 4 determines that the current posture of the driver is not a call posture (non-call posture). The determination of whether or not the non-calling posture is in step 200 is the same.

  On the other hand, if the driver is talking on the mobile phone at the time of the determination in step 300, there is a hand holding the mobile phone within the range from the ear of the driver to the mouth, so the driver in the search processing of the image processing unit 3 The hand region is detected, and information indicating that the hand region has been detected is sent from the image processing unit 3 to the vehicle controller unit 4 side. Therefore, in step 300, the CPU 4-1 of the vehicle controller unit 4 determines that the current posture of the driver is a call posture. The determination of whether or not the non-calling posture is in step 200 is the same.

  The contents of the vehicle control performed in step 308 are as follows.

(1) Limit the maximum speed of the vehicle. In actuality, the vehicle controller unit 4 outputs a command to limit the maximum speed to the engine controller connected thereto, and limits the maximum speed of the vehicle in the engine controller according to the command. It is assumed that processing is performed. In this case, the command to limit the maximum speed as described above corresponds to the vehicle control execution command.

(2) Turn on the lane keeping function. The lane keeping function ON operation is output from the vehicle controller unit 4 to the lane keeping controller connected to the vehicle controller unit 4 to the effect that the same function should be turned on. It is assumed that the process of turning ON is performed. In this case, the command to turn ON as described above corresponds to a vehicle control execution command.

(3) Turn on the ACC (Adaptive Cruise Control) function.
ACC (Adaptive Cruise Control) measures the distance from the vehicle running ahead and the speed of the vehicle with an optical radar, etc. while driving, and uses the computer to process the results to follow the previous vehicle. A system that warns or automatically decelerates when the risk of rear-end collision increases.

  Although it is conceivable to simply turn on the ACC function, in this embodiment, the ACC setting value is further set to the safe side after the ACC function is turned on. Since it is considered that the standard setting for the ACC function as a car or the user's standard setting is set on the condition that the vehicle is operating normally, when the ACC function is newly turned ON, this normal standard setting is set. Adoption alone is not necessarily considered safe. If the ACC function is simply turned ON, the user's ACC setting value of the shortest inter-vehicle distance is applied when the user sets the shortest inter-vehicle distance. However, if the configuration in which the ACC function is turned on and the ACC setting value is set to the safe side as in this embodiment is adopted, the user's ACC setting value such as the shortest inter-vehicle distance is not applied, and therefore The ACC function is activated by setting a long inter-vehicle distance. If the ACC function is already ON, the ACC setting value of the inter-vehicle distance is changed to be longer (safe side) than the current value if there is room for change. It is assumed that this ACC function is also turned on in a manner similar to the operation for turning on the lane keeping function described above.

(4) Set the brake assist to be stronger than it currently is. This change in the brake assist setting is output from the vehicle controller unit 4 to the brake assist controller connected thereto with a command indicating that the assist setting should be changed to a stronger value. It is assumed that processing for changing the assist setting is performed in the brake assist controller according to the following. In this case, the command to change the assist setting as described above is equivalent to the vehicle control execution command.

  In order to start the vehicle control as described above, the vehicle controller unit 4 outputs a vehicle control execution command to the controller 6 of the vehicle connected thereto. Specifically, the CPU 4-1 in the vehicle controller unit 4 outputs a vehicle control execution command to the controllers 6 through the I / F unit 4-4. As a form or form of this output, for example, the connection between the controllers 6 and the vehicle controller unit 4 may be a LAN connection, and a vehicle control execution command may be output as a command, or a control amount may be output as a voltage. As a configuration, a vehicle control execution command may be output by controlling a voltage supplied to a signal line connected to the controllers 6.

  Although the above vehicle control may be performed independently, it can also be performed combining them. Further, the above vehicle control is an example, and vehicle control other than the above example may be appropriately employed as a driving call countermeasure.

  As a specific configuration of the warning performed in the step 304, for example, a chime generator is connected to the vehicle controller unit 4, and the CPU 4-1 of the vehicle controller unit 4 applies I / O to the chime generator. A configuration in which a chime generation command is output through the F unit 4-4 may be employed. The output format or output form of the chime generation command in this configuration can take the same format or form as the vehicle control execution command.

  Even if it is a call countermeasure during driving, if the vehicle control as described above is suddenly started, the user setting will be changed and the driver will be surprised, so that the vehicle control is started and the user setting is thereby The warning given in advance before the vehicle control is important in the sense that the driver is informed in advance that the change will be made.

  Specifically, the restoration process in step 205 is to return the vehicle control mode or the vehicle setting including the user setting to the original state before starting the vehicle control in step 308. For the original vehicle control mode or vehicle setting used in this restoration process, the data in the RAM 4-2 of the vehicle controller unit 4 stored in step 307 is used.

  For example, when the vehicle control is performed to set the brake assist stronger than the present time, the brake assist user setting value before the vehicle control is stored in the RAM 4-2, and the brake assist user is stored. The set value is read from the RAM 4-2. Then, the CPU 4-1 of the vehicle controller unit 4 instructs the brake assist controller connected to the vehicle controller unit 4 to return the brake assist setting to the user set value through the I / F unit 4-4. Output. This command corresponds to a command for canceling vehicle control (command for canceling vehicle control). In addition, even when vehicle control for limiting the maximum speed of the vehicle, vehicle control for turning on the lane keeping function, and vehicle control for turning on the ACC function are performed, each vehicle control is performed in the same manner as in the above example. Is released. However, in the case of vehicle control that limits the maximum speed of the vehicle, the CPU 4-1 of the vehicle controller unit 4 instructs the engine controller connected to the vehicle controller unit 4 to release the restriction. Is output. Further, when the vehicle control for turning on the lane keeping function is performed, the CPU 4-1 of the vehicle controller unit 4 turns off the function for the lane keeping controller connected to the vehicle controller unit 4. A command to that effect is output. The method of turning off the function when vehicle control for turning on the ACC function is performed is similar to the method of turning off the ACC function.

  Further, the recovery process during traveling can be automatically performed regardless of the driver's intention display. However, there may be a case where the road environment changes from an expressway to a general road during the vehicle control described above. In this case, if the vehicle control mode corresponding to the highway that is the original road environment is restored, the general road that is the current road environment cannot be handled. Therefore, it is desirable to give consideration to waiting for the driver's intention before the restoration process. For example, it is preferable that the restoration process is performed only when the driver asks whether or not the restoration may be performed and the driver makes an intention accordingly.

  When the engine of the vehicle is stopped, the currently-executed telephone countermeasure processing during operation, that is, the execution of the determination program in the vehicle controller unit 4 and the associated vehicle control are terminated. At this time, if the driver stops the engine in a talking state, the data stored in the RAM 4-2 of the vehicle controller unit 4 stored in step 307 is used to finish The vehicle control mode including the user setting or the restoration process to the vehicle setting is performed.

  Since the driver's attitude observation and vehicle control described above are started on condition that the vehicle engine is operating, the engine is stopped, the mission is neutral, and the side brake is applied. In a state where there is no fear of running, even the driver's posture is not observed.

  However, if there is a high level of concern about running, know the driver's condition in a parked state in anticipation of the vehicle running, including when the engine is running, the mission is neutral, and the side brake is pulled. Therefore, it is important to observe the driver's posture. On the other hand, there is room for selection as to whether or not to perform vehicle control. When the engine is operating and the driver is talking on the mobile phone before the vehicle starts running, the vehicle control may be performed before traveling, or the vehicle control may be performed after actually starting traveling. When vehicle control is performed before traveling, there is an advantage that there is no sense of incongruity due to vehicle control after starting running. However, in this case, if the telephone call is terminated before traveling, vehicle control is canceled and a return process is required. This return processing is to switch the vehicle control, which was unnecessary, to the original vehicle control mode or vehicle setting.

  When it is possible to start immediately from a state where the engine is not started, such as a hybrid vehicle or an electric vehicle, for example, when the key position can be started, it is desirable to perform posture observation. In addition, it is desirable to perform posture observation from a situation where it is possible to start immediately even in a configuration in which operation is not performed using a physical key, such as smart keyless.

  Instead of searching for a hand area around the driver's face area, a mobile communication device such as a mobile phone may be searched. This is because the presence of a portable communication device around the driver's face is a powerful determination material for determining that a call is in progress, just as a hand is present.

  Also in the case of a hands-free call, it is desirable to carry out the vehicle control described above because the conversation is distracting and the driving awareness is slightly reduced. In this case, by continuously observing the driver with the camera and detecting that the lips are continuously changing, it can be determined that the mobile phone is making a call.

  The CPU, RAM, ROM, etc. of the image processing unit 3 shown in FIG. 3 may be configured as one IC.

The hardware block diagram of the vehicle control apparatus which is one Embodiment of this invention. The hardware block diagram of the image processing unit which comprises the vehicle control apparatus of FIG. The main functional block diagram of the image processing unit which comprises the vehicle control apparatus of FIG. The hardware block diagram of the vehicle controller which comprises the vehicle control apparatus of FIG. The flowchart figure which showed the process in the vehicle controller which comprises the vehicle control apparatus of FIG. Driver posture image taken with the camera. Driver posture image taken with the camera. Driver posture image taken with the camera. Explanatory drawing of the graph for face area detection. The schematic diagram of the scan by the graph for face area detection. The schematic diagram of the scan by the graph for face area detection. The schematic diagram of the scan by the graph for face area detection. Explanatory drawing of the graph for wrist detection. The schematic diagram of the scanning by the wrist detection graph. The schematic diagram of the scanning by the wrist detection graph. The schematic diagram of the scanning by the wrist detection graph.

Explanation of symbols

1 Camera 2 Illumination 3 Image Processing Unit 3-1 CPU
3-2 RAM
3-3 ROM
3-4 Camera Control Unit 3-5 Lighting Control Unit 4 Vehicle Controller Unit 4-1 CPU
4-2 RAM
4-3 ROM
4-4 I / F unit 5 Sensors 6 Controllers

Claims (4)

Counter means for observing the posture of the driver seated in the driver's seat of the vehicle and counting up the setting counter when detecting the driver's talking posture ;
Warning means for giving a warning for a call when the set counter value counted up by the counter means exceeds a warning threshold;
After the warning, an output means for outputting a vehicle control execution command to the vehicle controllers when the set counter value counted up by the counter means exceeds a call determination threshold value. A vehicle control device when using a telephone while driving, characterized by comprising:   The counter means further counts down the release counter when detecting the non-calling posture of the driver,
  The output means further outputs a vehicle control release command to the vehicle controllers when the release counter value counted down by the counter means becomes 0 or less.
  The vehicle control apparatus according to claim 1, wherein the telephone is used during driving.   Observe the posture of the driver sitting in the driver ’s seat of the vehicle,
  When the driver's call posture is detected, the setting counter is counted up,
  When the set counter value counted up exceeds the warning threshold value, a warning is given to the call,
  When the set counter value counted up exceeds the call determination threshold after the warning, a vehicle control execution command is output to the vehicle controllers.
  The vehicle control method at the time of telephone use during driving characterized by the above.   When the driver's non-calling posture is detected, the release counter is counted down,
  When the cancellation counter value counted down becomes 0 or less, a vehicle control cancellation command is output to the vehicle controllers.
  The vehicle control method according to claim 3, wherein the telephone is used during driving.

Images