JP4858381B2 - Car left behind prevention device - Google Patents

Description

  The present invention relates to an in-vehicle thing-preventing device that prevents an object from being left in the vehicle.

Conventionally, as a device for preventing things left behind in a vehicle, there has been a vehicle left-behind prevention device disclosed in Patent Document 1. This in-vehicle forgotten object prevention device uses a camera to photograph the situation in the passenger compartment when boarding and stores it in the memory of the image processing circuit, and uses the camera to photograph the situation in the passenger compartment when the passenger gets off the image processing circuit. And the situation in the passenger compartment at the time of boarding and the situation in the passenger compartment at the time of getting off are compared to determine the presence or absence of leftover items. When it is determined that there is something left behind, the notification means notifies the driver that there is something left behind.
JP 2005-115911 A

  However, in the in-vehicle forgotten object prevention device disclosed in Patent Document 1, when photographing the state of the passenger compartment when riding, the photographing is performed for a short time after the door is unlocked and the user gets in. Normally, a camera takes time from power-on to a stable state. Therefore, when shooting is performed for a short time after the door is unlocked and the user gets in, an appropriate image may not be captured as a comparative image.

  In addition, the in-vehicle forgotten object prevention device disclosed in Patent Document 1 warns that there is an afterward after the door is locked in a state where the ignition key is not inserted into the key cylinder. However, some vehicles inform the user that the door is locked after the door is locked. Therefore, when warning that there is something left behind after the door is locked, there is a possibility that the user may not be aware of the warning about leftover due to a misunderstanding between the warning about leftover and the notification of door locking.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an in-vehicle left-behind prevention device that can improve the accuracy of left-behind object detection and can reliably notify a user of left-behind.

  In order to achieve the above object, the forgotten-being-prevention device according to claim 1, when it is determined by the getting-off determining means that the user gets off the vehicle, and when the user gets off the vehicle by the getting-off determining means, At least when the user gets in the vehicle, the camera means to take a picture of the interior of the vehicle with a camera supplied with power from the in-vehicle battery, and to detect an image of the interior of the car taken by the camera and the forgotten things in the car. A forgotten object detection means that detects forgotten things in the passenger compartment by comparing the reference image as a reference, and when the forgotten object is detected by the forgotten object detection means, the user is informed while the door of the vehicle is open. And a notification means for notifying that there is something left behind.

  As described above, at least when the user gets on the vehicle, the camera to which power is supplied from the in-vehicle battery reaches a stable state after the power is turned on when the user gets off the vehicle. And since the image compared with a reference | standard image is image | photographed using the camera which reached the stable state after power activation, a forgotten thing can be detected with a suitable image. Therefore, the accuracy of forgotten object detection can be improved. In addition, by notifying a user of a lost item while the door of the vehicle is open, it is possible to prevent mistakes between a lost item notification and other notifications, and to reliably notify the user of the lost item. .

  In addition, as described in claim 2 or claim 3, when the user gets off the vehicle when the position of the shift lever of the vehicle is parking or when the accessory switch and the ignition switch of the vehicle are turned off from on. You may make it determine.

  According to a fourth aspect of the present invention, there is provided storage means for storing an image of the passenger compartment photographed by the photographing means, and the forgotten object detection means is a previous vehicle stored in the storage means as a reference image. An indoor image may be used.

  In this way, forgotten things can be detected even if the image in the passenger compartment taken at the previous disembarkation is used as the reference image.

  According to a fifth aspect of the present invention, the vehicle includes a second storage unit that stores a default image that is an image in a default state in the vehicle interior, and the forgotten object detection unit is an image of the vehicle interior that is captured by the imaging unit. If there is a difference between the image in the vehicle interior and the previous image in the vehicle interior, the vehicle interior image captured by the imaging means is compared with the default image stored in the second storage means. You may make it detect the thing left behind.

  By doing so, it is possible to know whether there is a change in the passenger compartment and whether the number of objects has increased as compared to the default passenger compartment (for example, the passenger compartment at the time of delivery). Can be improved.

  Further, as a notification means for notifying a lost item, as shown in claim 6, it may be configured to notify that there is a lost item by a sound output from a speaker, or by e-mail transmitted to the user's mobile phone. You may make it notify that there exists.

  Further, when notifying that there is a forgotten item by e-mail, as shown in claim 8, an e-mail including an image characterized as a forgotten item may be transmitted. By doing so, it is preferable because a forgotten item can be confirmed at a glance.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a schematic configuration of a vehicle equipped with an in-vehicle thing prevention device according to an embodiment of the present invention. FIG. 2 is a block diagram showing a schematic configuration of the in-vehicle lost article detection control device according to the embodiment of the present invention. FIG. 3 is a flowchart showing the processing operation of the in-vehicle thing prevention apparatus according to the embodiment of the present invention. FIG. 4 is an image diagram illustrating a left-behind object detection area of the in-vehicle left-behind prevention device according to the embodiment of the present invention.

  The forgotten object prevention device in the present embodiment detects misplacement in a passenger compartment such as a bag, a wallet, other luggage, and an infant and notifies the user. As shown in FIG. 1, the thing-left-behind prevention device includes a thing-left-behind detection control device 10, a vehicle interior speaker 20, a vehicle interior display 30, a vehicle exterior speaker 40, a camera device 50, a body ECU 60, a door ECU 70, and the like.

  As shown in FIG. 2, the forgotten object detection control device 10 is configured as a normal computer, and includes a CPU 11, a communication module 12, a camera control circuit 13, an audio output driver 14, a communication circuit 15, a memory 16, an image processing LSI 17, An image output circuit 18, a power supply circuit 19, a bus line connecting these components, and the like are provided. As shown in FIG. 1, the forgotten object detection control device 10 is electrically connected to a vehicle interior speaker 20, a vehicle interior display 30, a vehicle exterior speaker 40, a camera device 50, a body ECU 60, a door ECU 70, and the like. The forgotten object detection control device 10 detects forgotten things based on signals from the camera device 50, the body ECU 60, and the door ECU 70, and notifies the forgotten things using the vehicle interior speaker 20, the vehicle interior display 30, the vehicle exterior speaker 40, and the like. Is. The lost article detection control device 10 will be described in detail later.

  The vehicle interior speaker 20 is provided in the vehicle interior and outputs sound based on a signal from the forgotten object detection control device 10. For example, a vehicle interior speaker used for a navigation device or an audio device can be used.

  The vehicle interior display 30 is provided in the vehicle interior and outputs an image based on a signal from the forgotten object detection control device 10. For example, a vehicle interior display used for a navigation device or an audio device can be used.

  The vehicle exterior speaker 40 is provided outside the vehicle interior, and outputs sound based on a signal from the forgotten object detection control device 10. For example, an out-of-vehicle speaker used for door lock notification (so-called answerback) or the like can be used.

  The camera device 50 captures the interior of the vehicle, captures the interior of the vehicle based on a signal from the forgotten object detection control device 10, and outputs the captured image of the interior of the vehicle to the forgotten object detection control device 10. . The camera device 50 is supplied with power from an in-vehicle battery at least when the user gets on the vehicle. The camera device 50 may be provided with a light for night photography in order to photograph the passenger compartment at night. The camera device 50 can use a security camera or the like.

  The body ECU 60 is configured as a normal computer, and includes a well-known CPU, ROM, RAM, I / O, a bus line connecting these configurations, and the like. The body ECU 60 is connected to a shift position sensor, an accessory switch, an ignition switch, and the like, and outputs signals from the shift position sensor, the accessory switch, and the ignition switch to the forgotten object detection control device 10 by CAN communication.

  The door ECU 70 is configured as a normal computer, and includes a well-known CPU, ROM, RAM, I / O, a bus line connecting these configurations, and the like. The door ECU 70 controls the locking and unlocking of the door lock and is connected to a courtesy switch. The door ECU 70 detects the opening and closing of the door based on a signal from the courtesy switch, and the detection result is obtained by CAN communication. Or output to the forgotten object detection control device 10.

  Here, the forgotten object detection control device 10 will be described with reference to FIG.

  CPU11 outputs an instruction | indication signal with respect to the connected electronic device by performing a calculation process based on the input signal and a predetermined program.

  The communication module 12 performs data communication with the user's mobile phone and mobile terminal. The camera control circuit 13 outputs a camera control signal to the camera device 50 based on an instruction signal from the CPU 11. The audio output driver 14 outputs an audio output signal to the vehicle interior speaker 20 and the vehicle interior speaker 40 based on an instruction signal from the CPU 11. The communication circuit 15 is for performing CAN communication between the body ECU 60 and the door ECU 70.

  The memory 16 stores an image of the passenger compartment photographed by the camera device 50 and an image of the passenger compartment (default image) in a default state (when delivered). The image processing LSI 17 performs image processing. For example, the image processing LSI 17 specifies a detection area 100 for detecting forgotten things from an image in the passenger compartment photographed by the camera device 50 or a passenger compartment photographed by the camera device 50. And the image stored in the memory 16 are compared. The image output circuit 18 outputs an image output signal to the vehicle interior display 30. The power supply circuit 19 controls power supply from the battery (not shown) to the camera device 50.

  The detection area 100 is specified on the upper surface of the seat 80 and the dashboard upper portion 90 as shown in FIG. That is, the detection area 100 is specified as a position that is easily visible from the outside of the vehicle. If something left behind is easily visible from the outside of the vehicle, there is a high possibility that the vehicle will be damaged. However, in the present embodiment, if there is something left behind in the detection area 100, the user is notified, so that damage caused by vandalism can be reduced.

  In addition, in the case of damage caused by vandalism on the vehicle, the vehicle may be damaged, such as a window glass being broken or a door being destroyed. However, as described above, in the present embodiment, the damage caused by the vandalization can be reduced, so that the vehicle damage due to the vandalism can also be reduced.

  Furthermore, since the headrest and the like change depending on the person who gets on the headrest, there is a possibility that the headrest will change every time the user gets off. Therefore, if a headrest or the like is put in the detection area, a change in the position of the headrest may be erroneously determined as a forgotten item. However, such erroneous determination can be suppressed by specifying the detection area 100 on the upper surface of the sheet 80 and the upper portion 90 of the dashboard.

  Next, the processing operation of the left-behind-object detection control device 10 (in-vehicle left-behind thing prevention device) will be described with reference to FIG. Note that the flowchart shown in FIG. 3 is executed when the accessory switch or the ignition switch is turned on.

  First, in step S10, the forgotten object detection control device 10 (CPU 11) determines whether the shift position is “P (parking)” based on a signal from the body ECU 60 in order to determine that the user gets out of the vehicle. It is determined whether or not (get-off determination means). If it is determined that the shift position is “P”, the user is assumed to get off the vehicle and the process proceeds to step S11. If it is determined that the shift position is not “P”, the user is assumed not to get off the vehicle and step S10 is performed. Return to.

  In step S <b> 11, the left-behind object detection control device 10 outputs a camera control signal from the camera control circuit 13 to the camera device 50, thereby starting shooting of the vehicle interior with the camera device 50 (shooting unit).

  Since the power is supplied from the vehicle-mounted battery at least when the user gets on the vehicle, the camera device 50 has reached a stable state since being turned on. And since the image compared with a reference | standard image is image | photographed using the camera apparatus 50 which reached the stable state from power activation, a forgotten thing can be detected with an appropriate image. Therefore, the accuracy of forgotten object detection can be improved.

  In step S <b> 12, the forgotten object detection control device 10 (CPU 11) determines whether the accessory switch and the ignition switch are turned off from on based on a signal from the body ECU 60. If it is determined that the accessory switch and the ignition switch are turned off from on, the process proceeds to step S13. If it is determined that the accessory switch and the ignition switch are not turned off from on, the process returns to step S10.

  In step S13, the image processing LSI 17 of the forgotten object detection control apparatus 10 is set in the image processing preparation state. This specifies the detection area 100 in the image photographed by the camera device 50 in order to detect forgotten things as soon as possible.

  In step S <b> 14, the forgotten object detection control device 10 (CPU 11) determines whether or not the door is opened based on a signal from the door ECU 70. If it is determined that the door is opened, the process proceeds to step S15. If it is determined that the door is not opened, the process returns to step S13.

  In step S15, the forgotten object detection control device 10 (image processing LSI 17) determines whether there is an operating object (moving object) in the detection area 100 in the image captured by the camera device 50, and the operation. If it is determined that there is no object, the process proceeds to step S16. If it is determined that there is a moving object, the determination in step S15 is repeated. More specifically, it is determined that there is no moving object when a predetermined time elapses without a moving object.

  In step S <b> 16, the forgotten object detection control device 10 (image processing LSI 17) performs an image comparison process to detect forgotten things in the passenger compartment. The left-behind object detection control device 10 (image processing LSI 17) captures the vehicle interior image captured by the camera device 50 at the time of getting off this time and the vehicle interior image captured by the camera device 50 at the previous time of departure stored in the memory 16 (reference). Image) (thing left behind detection means).

  Note that the vehicle interior image captured by the camera device 50 when getting off this time is an image that has been determined in step S15 and has no moving object. In other words, it is an image after the user gets off the vehicle. In this way, it is determined whether or not there is a moving object in the detection area 100, and the image determined to have no moving object is compared with the vehicle interior image (reference image) captured by the camera device 50 when the vehicle got off the previous time. And since a forgotten thing is detected, the misjudgment by a user's getting-off operation can be suppressed.

  In step S17, the forgotten object detection control device 10 (image processing LSI 17) compares the current vehicle interior image with the previous vehicle interior image and determines that the difference is equal to or greater than a predetermined value. The process proceeds to step S18, and if it is determined that the difference is not equal to or greater than the predetermined value, the process proceeds to step S22 assuming that there is no forgotten thing (forgotten article detection means).

  In step S <b> 22, the forgotten object detection control device 10 (CPU 11) stores in the memory 16 the vehicle interior image that was captured this time. That is, the forgotten object detection control device 10 (CPU 11) updates the previously captured image stored in the memory 16 to the image captured in the vehicle interior.

  In step S18, the forgotten object detection control device 10 (image processing LSI 17) performs an image comparison process in order to improve the forgotten object detection accuracy. The forgotten object detection control device 10 (image processing LSI 17) compares the vehicle interior image captured by the camera device 50 with the default image stored in the memory 16 when leaving the vehicle this time (the lost object detection means).

  In step S19, the forgotten object detection control device 10 (image processing LSI 17) compares the current interior image with the default image, and if it is determined that the difference is equal to or greater than the predetermined value, the process proceeds to step S20. If it is determined that the value is not equal to or greater than the predetermined value, the process proceeds to step S22 (forgotten object detection means). By doing so, it is possible to know whether there is a change in the passenger compartment and whether or not more objects have been added than in the default passenger compartment, so that the accuracy of forgotten object detection can be further improved.

  In step S <b> 20, the forgotten object detection control device 10 (CPU 11) determines whether or not the door is opened based on a signal from the door ECU 70. And if it determines with the door being opened, it will progress to step S21, and if it determines with the door not being opened, it will progress to step S24.

  In step S <b> 21, the forgotten object detection control device 10 (CPU 11) outputs an audio output signal to the vehicle interior speaker 20 and outputs an image output signal to the vehicle interior display 30. Then, while notifying the user of the forgotten thing by outputting a sound for notifying the forgotten thing from the in-vehicle speaker 20 and outputting an image for notifying the forgotten thing from the in-vehicle display 30 (notification means). In the present embodiment, an example in which the vehicle interior speaker 20 and the vehicle interior display 30 are used is adopted. However, the present invention is not limited to this, and at least the vehicle interior speaker 20 and the vehicle interior display 30 are used. You may make it notify on one side.

  In this way, by notifying the user of a lost item while the vehicle door is open, it is possible to prevent mistakes between the lost item notification and other notifications, and to notify the user of the lost item. Can do.

  In order to notify the user of forgotten things, the communication module 12 performs data communication (for example, sending an e-mail) with the user's mobile phone (not shown) and the mobile terminal (not shown) to notify the user of the forgotten things. You may do it. In addition, when notifying a forgotten item by e-mail, an e-mail including an image characterized as the forgotten item may be transmitted. By doing so, it is preferable because a forgotten item can be confirmed at a glance.

  In step S <b> 23, the forgotten object detection control device 10 (power supply circuit 19) turns off the power supply to the camera device 50.

  On the other hand, if the door is not open, in step S24, the forgotten object detection control device 10 (CPU 11) outputs an audio output signal to the speaker 40 outside the vehicle and notifies the left thing from the speaker 40 outside the vehicle. By outputting sound, the user is notified that there is something left behind (notification means).

  In the above-described embodiment, the example in which the user determines to get off the vehicle when the shift position is “P” has been described, but the present invention is not limited to this. When the accessory switch and the ignition switch of the vehicle are turned from on to off, it may be determined that the user gets out of the vehicle (alighting determination unit).

  In this case, in the process of step S10 in the flowchart shown in FIG. 3, it is determined whether or not the accessory switch and the ignition switch of the vehicle are turned from on to off, and it is determined that the accessory switch and the ignition switch are turned from on to off. Advances to the next process, and if not, repeats this determination. Then, when the process in step S11 is executed, the process proceeds to step S13 without performing the process in step S12. This also makes it possible to determine whether or not the user gets off the vehicle.

It is a block diagram which shows schematic structure of the in-vehicle thing prevention device in embodiment of this invention. It is a block diagram which shows schematic structure of the thing in a vehicle detection control apparatus in embodiment of this invention. It is a flowchart which shows the processing operation of the in-vehicle thing prevention apparatus in embodiment of this invention. It is an image figure which shows the thing-left-behind detection area of the vehicle thing-left-behind prevention apparatus in embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Lost thing detection control apparatus, 20 Car interior speaker, 30 Car interior display, 40 Car exterior speaker, 50 Camera apparatus, 60 Body ECU, 70 Door ECU, 80 seats, 90 Dashboard upper part, 100 Detection area

Claims (8)

Getting-off judging means for judging that the user gets off the vehicle;
When it is determined by the getting-off determining means that the user gets off the vehicle, at least when the user gets on the vehicle, a photographing means for photographing the interior of the vehicle with a camera supplied with power from an in-vehicle battery;
Forgotten thing detection means for detecting forgotten things in the vehicle interior by comparing an image of the passenger compartment imaged by the photographing means with a reference image serving as a reference for detecting forgotten things in the vehicle interior; ,
A notification means for notifying the user that there is a thing left behind while the door of the vehicle is open when the thing left behind is detected by the thing left behind detection means;
A device for preventing left behind items in a vehicle.   2. The in-vehicle left-behind prevention device according to claim 1, wherein the getting-off determining unit determines that the user gets out of the vehicle when the position of the shift lever of the vehicle is parking.   2. The in-car left behind prevention device according to claim 1, wherein the getting-off determining means determines that the user gets out of the vehicle when an accessory switch and an ignition switch of the vehicle are turned off.   Storage means for storing an image of the vehicle interior imaged by the imaging means is provided, and the forgotten object detection means uses the previous image of the vehicle interior stored in the storage means as the reference image. The left-behind thing prevention apparatus as described in any one of Claim 1 thru | or 3 characterized by the above-mentioned.   And a second storage unit that stores a default image that is an image in a default state in the vehicle interior, wherein the forgotten object detection unit includes the image of the vehicle interior captured by the imaging unit and the previous vehicle. If there is a difference between the indoor image and the vehicle image, the vehicle image captured by the imaging means is compared with the default image stored in the second storage means to compare the vehicle image. 5. The thing-left-behind prevention apparatus according to claim 4, wherein a thing left behind is detected.   The in-vehicle left-behind prevention device according to any one of claims 1 to 5, wherein the notifying means notifies that there is the left-behind by sound output from a speaker.   The in-vehicle left-behind prevention device according to any one of claims 1 to 6, wherein the notifying means notifies that there is the left-behind by mail sent to the user's mobile phone.   8. The in-car left-behind prevention apparatus according to claim 7, wherein, when notifying that there is the forgotten item by the e-mail, the notifying unit transmits an e-mail including an image characterized by the forgotten item.

Images