JP2010214990A - Vehicular control device, vehicular control method, and vehicular control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable an appropriate starting of a vehicle to be carried out in response to a driver's state. <P>SOLUTION: A camera 1 takes an image about a predetermined scope including a headrest at a driver's seat of a vehicle, a human body detecting sensor unit 2 detects whether or not a person is present at the driver's seat of the vehicle, a vehicle starting permission person discriminating unit 3 discriminates whether or not the person is present at the driver's seat of the vehicle and then each of the detected results is supplied to a discriminating unit 4. A driver's existence discriminating unit 11 discriminates whether or not a person is present at the driver's seat, a driver's face discriminating unit 12 discriminates whether or not a face of adult living human being is present at the driver's seat, and a driver's posture discriminating unit 13 discriminates whether or not the driver of the vehicle keeps an appropriate posture. A braking control unit 5 controls either a permission of vehicle starting or an inhibition of vehicle starting in response to a result of discrimination at the discriminating unit 4. This invention can be applied to a vehicular control device. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a vehicle control device and method, and a program, and more particularly, to a vehicle control device and method, and a program capable of appropriately starting a vehicle according to a driver's condition.

  Conventionally, a driver of a vehicle such as an automobile starts a series of processes such as starting an engine, stepping on a brake, releasing a parking brake, putting a gear into a drive (back), and releasing a brake. To work. In other words, if such a series of operations is performed, the vehicle will start regardless of the subject of the operation. Therefore, for example, when a child or an animal is in the vehicle without a driver, the child or the animal may perform the above-described operation regardless of the intention to start the vehicle. . Even in such a case, the conventional vehicle will start.

  For this reason, Patent Document 1 discloses a method in which a driver's face image or the like is registered in advance, and the start is not permitted except for the registered person.

JP 2005-119528 A

  However, the technique disclosed in Patent Document 1 described above is complicated because registration of face images and the like for each driver is necessary in advance, and even a registered driver may be erroneous depending on the state. As a result, there is a possibility that the start of the vehicle is not permitted. As described above, it is difficult to say that the technique disclosed in Patent Document 1 is a technique that can appropriately control the start according to the state of the driver of the vehicle.

  In addition, there is a situation in which no appropriate method can be found as a method for controlling the appropriate start of the vehicle according to the driver's condition.

  The present invention has been made in view of such a situation, and makes it possible to appropriately start a vehicle in accordance with the state of a driver.

  According to another aspect of the present invention, there is provided a vehicle control device that captures a predetermined range including a driver's seat of a vehicle and outputs a captured image obtained as a result, and a person who can permit the vehicle to start. A determination unit that determines whether or not the user is seated in the driver's seat in a drivable posture using the captured image output from the imaging unit, and a determination result of the determination unit is used to determine whether the vehicle is seated. Control means for controlling the start.

  In the vehicle control device according to one aspect of the present invention, a predetermined range including the driver's seat of the vehicle is imaged, and a captured image obtained as a result is output, and a person who can permit the vehicle to start can drive the vehicle. Whether or not the driver is seated in the driver's seat is determined using the output captured image, and the start of the vehicle is controlled using the determination result.

  Therefore, it is possible to start the vehicle appropriately according to the state of the driver.

  The photographing means is constituted by a camera, for example.

  The determination unit includes a face determination unit that determines whether an adult human face is present in the driver's seat using the captured image output from the shooting unit, and the face determination unit The determination is performed using at least the determination result.

  Thereby, for example, erroneous start of the vehicle by a person other than a human can be more reliably prevented.

  The determination means includes an attitude determination means for determining whether an object existing in the driver's seat takes an appropriate attitude capable of driving the vehicle using the captured image output from the imaging means. And performing the determination using at least the determination result of the posture determination means.

  Thereby, for example, the vehicle can be started according to the state of the driver more appropriately.

  It further comprises human body detection means for detecting whether or not a person is present in the driver seat, and the determination means determines whether or not a person is present in the driver seat using a detection result of the human body detection means. Presence determination means for performing the determination using at least the determination result of the presence determination means.

  The human body detection means includes, for example, a pressure sensor, a temperature sensor, a weight sensor, a capacitance sensor, a radio wave sensor, an optical sensor, a vibration sensor, a heart rate sensor, a contact sensor, and the like.

  Thereby, for example, the vehicle can be started according to the state of the driver more appropriately.

  The vehicle start permitter identifying means for detecting a person who can identify a person who can permit the start of the vehicle is further included, and the presence determination means further includes the vehicle start permitter identification in addition to the detection result of the human body detection means. Using the detection result of the means, it is determined whether or not there is a person in the driver's seat.

  Thereby, for example, the vehicle can be started according to the state of the driver more appropriately.

  In the vehicle control method according to one aspect of the present invention, the vehicle control device that controls the vehicle captures a predetermined range including the driver's seat of the vehicle, outputs a captured image obtained as a result, and starts the vehicle. It is determined whether the authorized person is seated in the driver's seat in a posture capable of driving the vehicle, using the output captured image, and using the result of the determination, the start of the vehicle is determined. The step of controlling is included.

  In the vehicle control method according to one aspect of the present invention, a predetermined range including the driver's seat of the vehicle is captured by the vehicle control device that controls the vehicle, and a captured image obtained as a result is output, and the vehicle starts. Whether or not the person who can permit is seated in the driver's seat in a posture capable of driving the vehicle is determined using the output captured image, and the result of the determination is used. The start of the vehicle is controlled.

  Therefore, as in the case of the vehicle control device according to one aspect of the present invention, the vehicle can be started appropriately according to the state of the driver.

  According to another aspect of the present invention, there is provided a program for photographing a predetermined range including a driver's seat of a vehicle, outputting a photographed image obtained as a result, and permitting the start of the vehicle to a computer that controls the vehicle. A step of determining whether or not the vehicle is seated in the driver's seat in a posture capable of driving the vehicle using the output captured image and controlling the start of the vehicle using the determination result Control processing is executed.

  In the program according to one aspect of the present invention, a computer that controls the vehicle captures a predetermined range including the driver's seat of the vehicle, outputs a captured image obtained as a result, and a person who can permit the vehicle to start, It is determined whether or not the vehicle is seated in the driver's seat in a posture capable of driving the vehicle using the output captured image and the determination result is used to control the start of the vehicle. A control process including the steps to be performed is executed.

  Therefore, as in the case of the vehicle control device according to one aspect of the present invention, the vehicle can be started appropriately according to the state of the driver.

  Each of the photographing means, determination means, control means, face determination means, posture determination means, human body detection means, and vehicle start permitter identification means is configured by hardware or software, or a combination thereof. Two or more means may be combined and configured as one piece of hardware or the like.

  As described above, according to the present invention, it is possible to appropriately control the start according to the state of the driver of the vehicle.

It is a functional block diagram which shows the functional structural example of one Embodiment of the control apparatus for vehicles to which this invention is applied. It is a flowchart explaining an example of the start control process which the vehicle control apparatus of FIG. 1 performs. It is a flowchart explaining the detailed example of a face determination process. It is a flowchart explaining the detailed example of an attitude | position determination process. It is a block diagram which shows the hardware structural example of the information processing apparatus with which this invention is applied.

  FIG. 1 is a functional block diagram showing a functional configuration example of an embodiment of a vehicle control device to which the present invention is applied.

  1 includes a camera 1, a human body detection sensor unit 2, a vehicle start permitter identification unit 3, a determination unit 4, a braking control unit 5, an external notification unit 6, and a display unit 7. .

  The camera 1 captures a predetermined range including the headrest of the driver's seat of the vehicle. That is, when a person is seated in the driver's seat, the camera 1 can photograph the face. An image captured by the camera 1 (hereinafter referred to as a captured image) is output to the determination unit 4.

  The human body detection sensor unit 2 detects whether a person is present in the driver's seat of the vehicle. In addition, the detection method by the human body detection sensor part 2 is not specifically limited. For example, a detection method using pressure detection using a pressure sensitive switch, a membrane switch, or the like, or temperature detection using infrared rays or the like can be employed. In addition, for example, a detection method based on weight detection, capacitance detection, radio wave detection, light detection, vibration detection, heartbeat detection, contact detection such as steering, and the like can be employed. The human body detection sensor unit 2 notifies the determination unit 4 of the detection result.

  The vehicle start permitter identifying unit 3 identifies whether the person in the driver's seat of the vehicle is a person who can permit the start of the vehicle (hereinafter referred to as a vehicle start permitter). In the present embodiment, the vehicle start permitter identifying unit 3 identifies whether or not the vehicle start permitter is detected by detecting whether or not the smart entry FOB exists. A smart entry FOB is a portable device (key) that communicates with an ECU (Electronic Control Unit) or BCM (Body Control Unit) installed in the vehicle. Alternatively, unlocking is performed. Therefore, whether or not the vehicle is permitted to start can be identified based on whether or not the smart entry FOB is possessed. The vehicle start permitter identification unit 3 notifies the determination unit 4 of the identification result.

  In addition, the identification method by the vehicle start permission person identification part 3 is not specifically limited to the example of this Embodiment. For example, a wireless tag, a magnetic card, or the like can be adopted as a device that can identify a vehicle start authorized person (hereinafter referred to as an identification means) other than the smart entry FOB. That is, a method of detecting identification means (such as a smart entry FOB or a wireless tag) can be employed as an identification method by the vehicle start permitter identification unit 3.

  The determination unit 4 comprehensively determines whether or not the vehicle start permitter is sitting on the driver's seat in a posture capable of driving the vehicle, using the captured image output from the camera 1.

  Further, for example, in the present embodiment, the determination unit 4 determines whether the vehicle is permitted to start or not based on the determination result. The determination result of permission or non-permission of starting of the vehicle is notified to the brake control unit 5, the external notification unit 6, and the display unit 7, respectively.

  Note that it is not essential that the subject of the vehicle start permission or disapproval determination process is the determination unit 4 as in the present embodiment. For example, the determination unit 4 notifies the braking control unit 5, the external notification unit 6, and the display unit 7 of the determination result as to whether or not the vehicle start permitter is seated in the driver's seat in a posture capable of driving the vehicle. You may make it do. In this case, each of the braking control unit 5, the external notification unit 6, and the display unit 7 performs a process for determining whether the vehicle is permitted to start or not.

  Such a determination unit 4 is provided with a presence determination unit 11, a face determination unit 12, and a posture determination unit 13.

  The presence determination unit 11 determines whether there is a person in the driver's seat.

  For example, the presence determination unit 11 can determine whether there is a person in the driver's seat using the detection result of the human body detection sensor unit 2.

  However, if only the detection result of the human body detection sensor unit 2 is used, the presence determination unit 11 may erroneously detect that a person is present in the driver seat even when luggage, animals, or the like are present in the driver seat. . Of course, the presence determination unit 11 determines that there is a person in the driver's seat not only when the vehicle is permitted to start but also when a child or the like who is not permitted to start the vehicle is present in the driver's seat. When it is determined whether the vehicle is permitted to start or not using such a determination result, the vehicle may be permitted to start even when luggage, animals, children, etc. are present in the driver's seat.

  Therefore, it is preferable that the presence determination unit 11 of the present embodiment determines whether or not a person exists using not only the detection result of the human body detection sensor unit 2 but also the detection result of the vehicle start permitter identification unit 3. It is. Furthermore, in this case, a child who cannot be a driver if a method for detecting and identifying identification means (such as FOB of a smart entry or a wireless tag) is adopted as the identification method by the vehicle start permitter identification unit 3 It is possible to further prevent the vehicle from starting erroneously. However, if the identification means (FOB of smart entry, wireless tag, etc.) are left in the vehicle or taken out by a child, of course, it is not possible to prevent the vehicle from starting accidentally. To do.

  The face determination unit 12 determines whether or not there is a human face in the driver's seat.

  For example, the face determination unit 12 can determine whether or not a human face exists in the vicinity of the headrest of the driver's seat using the captured image of the camera 1.

  However, if only the photographed image of the camera 1 is used, the face determination unit 12 may erroneously determine that a human face exists even when a doll or a photograph exists in the driver's seat. Further, even when a person other than a vehicle start permitter such as a child is present in the driver's seat, the face determination unit 12 determines that a human face exists. Therefore, when such a determination result is used to determine whether or not to allow the vehicle to start, when a doll or photo is present in the driver's seat, or a person other than the vehicle starter such as a child is present in the driver's seat Even if the vehicle exists, the vehicle may be permitted to start.

  Therefore, the face determination unit 12 according to the present embodiment includes an adult result including a determination result of whether or not an adult human face exists in the driver's seat in addition to the determination result of the captured image of the camera 1. It is determined whether or not it is a human face. Hereinafter, the process by the face determination unit 12 of the present embodiment is referred to as a face determination process. Details of the face determination process will be described later with reference to FIG.

  Note that a method for determining whether or not the face is an adult human being is not particularly limited to the example of the present embodiment.

  For example, it is possible to adopt a determination method of determining whether an adult human face is present in the driver's seat based on a response result to an inquiry by voice or screen display. When such a determination method is employed, the face determination unit 12 uses the switch operation result of the person present in the driver's seat, the result of voice recognition, and the detection result of the person's movement by image processing, thereby It is possible to determine whether or not an adult human face exists.

  In addition, for example, a determination method may be adopted in which a biological information sensor or the like is used to detect a body vein pattern, heartbeat, or pulse to determine whether an adult human face is present in the driver's seat. You can also.

  In addition, for example, the feature of the face of the photographed image of the camera 1 is detected to identify each person's face, and only a pre-registered person's face is determined to be an adult human face. Techniques can also be adopted. Of course, it is necessary for the vehicle start permitter to register the face image in advance, so that the convenience is impaired, and there are some vehicle start permitters who do not like to register personal information in the vehicle.

  The posture determination unit 13 determines whether or not the driver of the vehicle is in an appropriate posture.

  For example, the posture determination unit 13 uses the captured image of the camera 1 to determine whether a person in the driver's seat has an appropriate posture as a vehicle driving posture. Hereinafter, such processing is referred to as posture determination processing. Details of the posture determination processing will be described later with reference to FIG.

  The braking control unit 5 controls the start of the vehicle based on the determination result of the determination unit 4, that is, the result of permission or non-permission of the vehicle start. In other words, when permission to start the vehicle is notified from the determination unit 4, the braking control unit 5 performs control so that the vehicle is ready to start. On the other hand, when the determination unit 4 notifies that the vehicle is not permitted to start, the braking control unit 5 controls the vehicle so that the vehicle cannot start, that is, the vehicle is braked.

  The vehicle braking control method itself is not particularly limited.

  For example, a method for preventing the stop state from being released, a method for preventing preparations for traveling, a method for preventing driving force from being supplied to the wheels, and enabling people to deal with by notifying the outside A method or the like can be employed as a vehicle braking control method.

  More specifically, for example, methods such as steering lock, steering pop-up, auxiliary brake lock, and brake control can be adopted as vehicle braking control methods.

  Further, for example, the vehicle braking can be controlled by preventing the engine from starting. As a method to prevent the engine from starting, the key cannot be turned, the start switch cannot be pressed, or the identification means (Smart entry FOB, wireless tag, etc.) cannot be started. A technique such as stopping the supply of fuel can be employed.

  Further, for example, the vehicle braking can be controlled by preventing the vehicle from starting even when the engine is running. As a technique for preventing the vehicle from starting even when the engine is running, a technique such as preventing the select lever from being removed from the parking can be employed.

  Further, for example, when the vehicle is an electric vehicle, the vehicle braking control may be performed by adopting means such as stopping the supply of power for traveling or preventing the traveling motor from rotating. it can.

  The braking control unit 5 controls to release the braking of the vehicle at an appropriate timing after controlling the braking of the vehicle. That is, the braking control unit 5 performs control so that the vehicle can be started. As a technique for releasing the braking of the vehicle, for example, the following technique can be employed. That is, when a predetermined operation is detected in advance, the state inside the vehicle is checked from the outside, a predetermined identification means (such as FOB of a smart entry or a wireless tag) is detected, the face of the driver It is possible to employ a technique for releasing the braking of the vehicle when a person who is identified and registered is detected.

  The external notification unit 6 notifies the determination result of the determination unit 4, that is, permission or non-permission of starting of the vehicle to the outside.

  The external notification method itself by the external notification unit 6 is not particularly limited. Specifically, for example, a notification method is used in which the start or stop of the vehicle is notified to the outside using an indicator light, siren, vibration, direction indicator, room light, headlight, brake lamp, horn, etc. can do. In addition, various notification methods such as notification by voice message, side mirror movement, power window up and down movement, transmission of smart entry to FOB, transmission to remote control, mail transmission, notification to monitoring center, etc. Can be adopted.

  The display unit 7 displays a determination result of the determination unit 4, that is, an image indicating permission or non-permission of starting of the vehicle. That is, the display unit 7 is configured as, for example, a navigation screen or an instrument panel. Further, for example, the display unit 7 can display an image used for inquiring about what is present in the driver's seat during the face determination process.

  The functional configuration example of the embodiment of the vehicle control apparatus to which the present invention is applied has been described above with reference to FIG.

  Next, an example of the operation of the vehicle control device will be described.

  FIG. 2 is a flowchart for explaining an example of a series of processes (hereinafter referred to as a start control process) executed by the vehicle control apparatus having the configuration shown in FIG.

  In step S1, the presence determination unit 11 determines whether or not there is a person in the driver's seat.

  If it is determined in step S1 that there is no person in the driver's seat, the process proceeds to step S7.

  In step S7, the determination unit 4 makes a final determination that the vehicle is not permitted to start. The determination result that the vehicle is not permitted to start is notified to the braking control unit 5, the external notification unit 6, and the display unit 7, respectively. As a result, for example, the above-described braking control of the vehicle is performed by the braking control unit 5, and a determination result that the vehicle start is not permitted is output from the external notification unit 6 or the display unit 7. Thereby, the start control process ends.

  As described above, the process in step S7 may be executed by the braking control unit 5, the external notification unit 6, the display unit 7, and the like.

  On the other hand, if it is determined in step S1 that there is a person in the driver's seat, the process proceeds to step S2.

  In step S2, the face determination unit 12 executes a face determination process. As a result, it is determined whether or not there is an adult human face in the driver's seat. The details of the face determination process will be described later with reference to FIG. 3. In this embodiment, for example, as a result of the face determination process, one of the following two results is output from the face determination unit 12. Is done. That is, the face determination unit 12 outputs a determination result that “it is highly likely that the face is an adult living human face” or “not an adult living human face”. When the determination result of the face determination unit 12 is output, the process proceeds to step S3.

  In step S <b> 3, the determination unit 4 determines whether or not the determination result of the face determination process is a determination result “not an adult human face”.

  If the determination result is “not an adult human face”, it is determined as YES in Step S3, and the process proceeds to Step S7.

  In step S7, the determination unit 4 makes a final determination that the vehicle is not permitted to start. Thereby, the start control process ends.

  On the other hand, in the case of the determination result “high possibility that the face is an adult human being”, it is determined NO in step S3, and the process proceeds to step S4.

  In step S4, the posture determination unit 13 performs posture determination processing. Thereby, it is determined whether or not the driver of the vehicle is in an appropriate posture. The posture determination process will be described later with reference to FIG. 4. For example, in this embodiment, as a result of the posture determination process, one of the following two determination results is output from the posture determination unit 13. . In other words, a determination result “high possibility of an appropriate posture” or “not an appropriate posture” is output from the posture determination unit 13. When the determination result of the posture determination unit 13 is output, the process proceeds to step S5.

  In step S <b> 5, the determination unit 4 determines whether or not the determination result of the posture determination process is a determination result “not an appropriate posture”.

  If the determination result is “not appropriate posture”, it is determined as YES in step S5, and the process proceeds to step S7.

  In step S7, the determination unit 4 makes a final determination that the vehicle is not permitted to start. Thereby, the start control process ends.

  On the other hand, in the case of the determination result “high possibility of being in an appropriate posture”, it is determined NO in step S5, and the process proceeds to step S6.

  In step S <b> 6, the determination unit 4 makes a final determination to permit the vehicle to start. The determination result that the vehicle is permitted to start is notified to the braking control unit 5, the external notification unit 6, and the display unit 7, respectively. As a result, for example, as described above, the braking control unit 5 controls the vehicle to be able to start, and the external notification unit 6 and the display unit 7 output a determination result that permits the vehicle to start. The Thereby, the start control process ends.

  As described above, the process in step S6 may be executed by the braking control unit 5, the external notification unit 6, the display unit 7, and the like.

  Next, details of the face determination process of step S2 in the start control process of FIG. 2 will be described.

  FIG. 3 is a flowchart for explaining a detailed example of the face determination process.

  In step S <b> 21, the face determination unit 12 determines whether or not a person is present in the driver's seat. In other words, the face determination unit 12 determines whether an animal or the like is present in the driver's seat.

  If it is determined in step S21 that the person in the driver's seat is not a human, that is, if it is determined that the person is an animal or the like, the process proceeds to step S25.

  In step S <b> 25, the face determination unit 12 outputs a determination result indicating that “the face of the adult human being is not a human face” exists in the driver's seat. Thereby, the face determination process ends.

  On the other hand, if it is determined in step S21 that the person in the driver's seat is a human, the process proceeds to step S22.

  In step S22, the face determination unit 12 determines whether the face is in the vicinity of the headrest of the driver's seat and has an adult-like feature.

  If it is determined NO in step S22, that is, it is determined that the face is not near the headrest of the driver's seat, or the face is an adult even if the face is near the headrest of the driver's seat. If it is determined that there is not, the process proceeds to step S25. When the determination result “No adult human face” is output in the process of step S25, the face determination process ends.

  In step S22, the face determination unit 12 can determine whether or not the face has a child-like feature, and use the determination result to determine whether or not the face has an adult-like feature. As a technique for detecting having a child-like feature, for example, a technique for detecting that a child-like feature is found when a predetermined condition is satisfied can be employed. As the predetermined condition, for example, various conditions such as the body size being smaller than the predetermined range, the weight being lighter than the predetermined range, and the pressure applied to the seat being smaller than the predetermined range can be adopted. .

  In contrast, if it is determined in step S22 that the face is in the vicinity of the headrest of the driver's seat and has an adult-like feature, the process proceeds to step S23.

  In step S <b> 23, the face determination unit 12 determines whether or not something existing in the driver's seat is moving. That is, the face determination unit 12 determines whether or not what is present in the driver's seat is a doll or a photograph.

  If it is determined in step S23 that what is present in the driver's seat is not moving, that is, if it is determined that something present in the driver's seat is likely to be a doll or a photograph, the process proceeds to step S25. . When the determination result “No adult human face” is output in the process of step S25, the face determination process ends.

  On the other hand, if it is determined in step S23 that something existing in the driver's seat is moving, the process proceeds to step S24.

  In step S <b> 24, the face determination unit 12 outputs a determination result indicating that there is a high possibility that what is in the driver's seat is an adult human face. Thereby, the face determination process ends.

  Thus, in the example of FIG. 3, what is present in the driver's seat is a human being, and its face is in the vicinity of the headrest of the driver's seat, has an adult-like characteristic, and is determined to be moving, A determination result “high possibility that the face is a real adult human face” is output. Therefore, the determination result “high possibility that the face is an adult human being” is highly accurate. However, it goes without saying that the determination condition for deriving the determination result “highly likely to be an adult human face” is not limited to the example of FIG. 3.

  In this way, in the present embodiment, it is determined whether or not an adult human face is present, and the determination result is used to determine whether or not to start (step S3 in FIG. 2). Etc.). As a result, it is possible to more reliably prevent the vehicle from being erroneously started by a person other than a human, such as an animal or a robot.

  Next, details of the posture determination process of step S4 in the start control process of FIG. 2 will be described.

  FIG. 4 is a flowchart for explaining a detailed example of the posture determination process.

  In step S41, the posture determination unit 13 determines whether or not a face exists within a predetermined range for a certain period of time. For example, in the present embodiment, a range in the vicinity of the headrest of the driver's seat is adopted as the predetermined range. That is, in the present embodiment, it is determined whether or not a face is detected near the headrest of the driver's seat for a certain time or more.

  That is, it is considered that the driver who wants to drive does not move his head greatly. In other words, the posture appropriate for the driver is that the head (face) is not moved greatly. Therefore, as one of the determinations as to whether or not the posture is appropriate, in step S41, it is determined whether or not there is a face within a predetermined range for a certain time or more.

  If it is determined in step S41 that the face does not exist within the predetermined range for a certain time or more, the process proceeds to step S47. In addition to the case where the legitimate driver moves his face greatly, for example, when the child is in the lower part of the driver's seat or when the suspicious person is hiding his face, it is determined as NO in step S41. The This also helps to prevent the vehicle from being erroneously started by a person other than the authorized driver.

  In step S <b> 47, the posture determination unit 13 outputs a determination result that the person who drives the vehicle “is not in an appropriate posture”. Thereby, the posture determination process ends.

  On the other hand, if it is determined in step S41 that a face exists within a predetermined range for a certain time or more, the process proceeds to step S42.

  In step S42, the posture determination unit 13 determines whether the face orientation is within a predetermined range.

  Note that the determination method itself in step S42 is not particularly limited. For example, in the present embodiment, when the front direction of the driver's seat is the axis, the angle of the face direction with respect to the axis is within 90 degrees, and the face direction is not reversed. A determination method is adopted in which it is determined that the orientation of the face is within a predetermined range. In addition, for example, when the child is standing on the driver's seat and looking out of the window, or when the child is standing upside down in the driver's seat, the face orientation is within a predetermined range. In this embodiment, a determination method of determining not to be determined is also adopted.

  If it is determined in step S42 that the face orientation is not within the predetermined range, the process proceeds to step S47.

  In step S <b> 47, the posture determination unit 13 outputs a determination result that the person who drives the vehicle “is not in an appropriate posture”. Thereby, the posture determination process ends.

  In contrast, if it is determined in step S42 that the face orientation is within the predetermined range, the process proceeds to step S43.

  In step S43, the posture determination unit 13 determines whether or not there is an abnormal face movement.

  If it is determined in step S43 that there is an abnormal facial movement, the process proceeds to step S47. In addition, when the child is moving around in the vehicle, it is determined as NO in Step S43.

  In step S <b> 47, the posture determination unit 13 outputs a determination result that the person who drives the vehicle “is not in an appropriate posture”. Thereby, the posture determination process ends.

  On the other hand, if it is determined in step S43 that there is no abnormal face movement, the process proceeds to step S44.

  In step S44, the posture determination unit 13 determines whether or not the face has repeatedly made a large movement.

  If it is determined in step S44 that the face has repeatedly moved greatly, the process proceeds to step S47.

  In step S <b> 47, the posture determination unit 13 outputs a determination result that the person who drives the vehicle “is not in an appropriate posture”. Thereby, the posture determination process ends.

  On the other hand, if it is determined in step S44 that the face has not repeated large movements, the process proceeds to step S45.

  In step S45, the posture determination unit 13 determines whether or not there is no movement from other than the boarding direction. That is, it is determined whether or not the face has entered the image acquisition range of the camera 1 from other than the boarding direction.

  If it is determined in step S45 that there is a movement from other than the boarding direction, the process proceeds to step S47. In addition, when the person is moving in the vehicle, it is determined NO in step S45.

  In step S <b> 47, the posture determination unit 13 outputs a determination result that the person who drives the vehicle “is not in an appropriate posture”. Thereby, the posture determination process ends.

  On the other hand, when it determines with there being no movement from directions other than a boarding direction in step S45, a process progresses to step S46.

  In step S <b> 46, the posture determination unit 13 outputs a determination result that the person who drives the vehicle “is highly likely to have an appropriate posture”. Thereby, the posture determination process ends.

  Note that the posture determination method in the posture determination process described above is not particularly limited. For example, it is possible to employ a method of outputting a determination result “not appropriate” when various conditions such as the following are satisfied. That is, for such a method, for example, it is possible to adopt a condition that even if the driver's face is in a predetermined position of the driver's seat, the torso and limbs are not in a predetermined range. For example, a condition that the driver's eyes cannot be detected or remains closed can be employed. For example, a condition that the driver's arousal level is lowered can be employed. For example, the condition that the seat of the driver's seat is not suitable for driving can be employed. In addition, for example, a condition that the door is open can be employed.

  For example, a condition that an operation for driving is not performed in a correct procedure can be adopted. For example, it is possible to adopt a condition that a person is leaning out from an opening of a sunroof. In this case, it is possible to employ a method of detecting a human movement by arranging an object sensor near the sunroof opening. For example, a condition that a prohibited operation such as an operation of opening a hood or a trunk lid is performed can be employed.

  As described above, in the start control process, the determination result of the presence determination unit 11 is “There is a person in the driver's seat”, and the determination result of the face determination unit 12 is “an adult human face is present. Only when the determination result of the posture determination unit 13 is “the person who drives the vehicle is in an appropriate posture”, the determination unit 4 makes a final determination to permit the vehicle to start.

  That is, the determination results of the presence determination unit 11, the face determination unit 12, and the posture determination unit 13 are used as materials, and it is comprehensive whether or not the vehicle start permitter is seated in the driver's seat in a posture capable of driving the vehicle. Will be judged. And when it is comprehensively determined that the vehicle start permitter is seated in the driver's seat in a posture capable of driving the vehicle, a final determination is made to permit the start of the vehicle, otherwise, The final determination that the vehicle start is not permitted is made.

  In other words, it is comprehensively determined that the vehicle start permitter is seated in the driver's seat in a posture capable of driving the vehicle, and as a result, whether the vehicle is permitted to start or not can be finally determined. If it is, the material used for the judgment will not be specifically limited to the example mentioned above. For example, the determination unit 4 uses at least one of the determination results of the presence determination unit 11, the face determination unit 12, and the posture determination unit 13 as a material to make a final determination of permission or non-permission of starting. May be. However, as in the above-described example, the accuracy of the final determination result of permission or non-permission of starting of the vehicle is better when all the determination results of the presence determination unit 11, the face determination unit 12, and the posture determination unit 13 are used as materials. It is preferable because it improves.

  Heretofore, an example of the start control process executed by the vehicle control device having the configuration shown in FIG. 1 has been described.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software is installed in the computer. Here, the computer includes, for example, a general-purpose personal computer capable of executing various functions by installing various programs by installing a computer incorporated in dedicated hardware.

  FIG. 5 is a block diagram illustrating a hardware configuration example of an information processing apparatus to which the present invention is applied.

  In a computer, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103 are connected to each other via a bus 104.

  An input / output interface 105 is further connected to the bus 104. An input unit 106, an output unit 107, a storage unit 108, a communication unit 109, and a drive 110 are connected to the input / output interface 105.

  The input unit 106 includes a keyboard, a mouse, a microphone, and the like. The output unit 107 includes a display, a speaker, and the like. The storage unit 108 includes a hard disk, a nonvolatile memory, and the like. The communication unit 109 includes a network interface or the like. The drive 110 drives a removable medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

  In the computer configured as described above, the CPU 101 loads, for example, the program stored in the storage unit 108 to the RAM 103 via the input / output interface 105 and the bus 104 and executes the program. Is performed.

  The program executed by the computer (CPU 101) can be provided by being recorded on the removable medium 111 as a package medium or the like, for example. The program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

  In the computer, the program can be installed in the storage unit 108 via the input / output interface 105 by attaching the removable medium 111 to the drive 110. Further, the program can be received by the communication unit 109 via a wired or wireless transmission medium and installed in the storage unit 108. In addition, the program can be installed in the ROM 102 or the storage unit 108 in advance.

  The program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.

DESCRIPTION OF SYMBOLS 1 Camera 2 Human body detection sensor 3 Vehicle start permission person identification part 4 Judgment part 5 Braking control part 6 External notification part 7 Display part 11 Presence judgment part 12 Face judgment part 13 Posture judgment part 101 CPU
102 ROM
103 RAM
108 Storage Unit 111 Removable Media

Claims (7)

Photographing means for photographing a predetermined range including a driver's seat of the vehicle and outputting a photographed image obtained as a result;
A determination unit that determines whether or not a person who can permit the start of the vehicle is seated in the driver's seat in a posture capable of driving the vehicle, using the captured image output from the imaging unit;
A vehicle control device comprising: control means for controlling the start of the vehicle using the determination result of the determination means. The determination means includes
Using the photographed image output from the photographing means, and a face determination means for determining whether or not an adult human face is present in the driver's seat,
The vehicle control device according to claim 1, wherein the determination is performed using at least a determination result of the face determination unit. The determination means includes
Using the photographed image output from the photographing means, and having a posture determination means for determining whether the one existing in the driver's seat is taking an appropriate posture capable of driving the vehicle;
The vehicle control device according to claim 1, wherein the determination is performed using at least a determination result of the posture determination unit. Further comprising human body detection means for detecting whether a person is present in the driver's seat,
The determination means includes
Using the detection result of the human body detection means, having presence determination means for determining whether or not there is a person in the driver's seat,
The vehicle control device according to claim 1, wherein the determination is performed using at least a determination result of the presence determination unit. Vehicle start authorized person identifying means for detecting a person capable of identifying a person who can permit the vehicle to start,
The presence determination means includes
The vehicle control device according to claim 4, wherein, in addition to the detection result of the human body detection means, the detection result of the vehicle start permitter identification means is used to determine whether or not a person is present in the driver seat. . A vehicle control device for controlling a vehicle
Capture a predetermined range including the driver's seat of the vehicle, and output a captured image obtained as a result,
Whether a person who can permit the vehicle to start is seated in the driver's seat in a posture capable of driving the vehicle is determined using the output captured image,
A vehicle control method including a step of controlling the start of the vehicle using the result of the determination. In the computer that controls the vehicle,
Capture a predetermined range including the driver's seat of the vehicle, and output a captured image obtained as a result,
Whether a person who can permit the vehicle to start is seated in the driver's seat in a posture capable of driving the vehicle, is determined using the output captured image,
A program for executing a control process including a step of controlling the start of the vehicle using a result of the determination.

Images