JP2006298130A - Vehicular circumference monitoring device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a vehicular circumference monitoring device capable of finely monitoring an open/close state of an opening/closing portion of a vehicle. <P>SOLUTION: Side cameras 31 are installed on door mirrors at the right and left (side portions) of the vehicle, and can image a front door and a rear door of the vehicle. A detecting portion 40 detects the open/close states of the front door 5 and the rear door 6 on the basis of the images shot by the side cameras 31. When the detecting portion 40 judges that either one of the front door 5 or the rear door 6 is not normally closed, an alarm sound generating portion, an alarm lamp lighting control portion 60, and an display image switching portion 70 execute alarm processing for informing a driver of the vehicle or a fellow passenger about that. Therefore, the driver of the vehicle or the occupants can execute a suitable measure according to the open/close state of the opening/closing portion. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a vehicle periphery monitoring device mounted on a vehicle, and more particularly, to monitoring of an opening / closing state of an opening / closing part of a vehicle.

  The door of the vehicle is opened and closed when the driver or his passenger gets into the vehicle or gets out of the vehicle.

  However, if this door is forgotten to be tightened, for example, a third party can intrude into the vehicle without permission, resulting in security problems.

  Therefore, an object of the present invention is to provide a vehicle periphery monitoring device that can satisfactorily monitor the opening / closing status of the opening / closing part of the vehicle.

  In order to solve the above-mentioned problem, an invention according to claim 1 includes an imaging unit installed in a vehicle, a detection unit that detects an opening / closing state of the opening / closing unit of the vehicle based on an image captured by the imaging unit, A warning unit that executes a warning process based on the open / closed state detected by the detection unit.

  According to a second aspect of the present invention, in the vehicle periphery monitoring device according to the first aspect, the opening / closing portion is provided on a side portion of the vehicle, and the imaging portion is provided in the vicinity of the opening / closing portion. It is characterized by being.

  According to a third aspect of the present invention, in the vehicle periphery monitoring device according to the first aspect, the opening / closing part is provided in a rear part of the vehicle, and the imaging part is provided in the vicinity of the opening / closing part. It is characterized by that.

  According to a fourth aspect of the present invention, in the vehicle periphery monitoring device according to any one of the first to third aspects, the warning unit generates a warning sound based on the detected opening / closing state. And

  The invention according to claim 5 is the vehicle periphery monitoring device according to any one of claims 1 to 3, wherein the warning unit blinks a warning lamp based on the detected opening / closing state. And

  The invention according to claim 6 is the vehicle periphery monitoring device according to any one of claims 1 to 3, further comprising a display unit that displays an image captured by the imaging unit, wherein the warning unit is An image including the opening / closing unit is displayed on the display unit based on the detected opening / closing state.

  According to the present invention, the opening / closing state of the opening / closing part of the vehicle can be detected based on the image picked up by the image pickup part, and when the opening / closing part is not normally closed, the warning part Warning processing can be executed for passengers. Therefore, the driver or passenger of the vehicle can execute an appropriate measure according to the opening / closing state of the opening / closing part.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<1. Configuration of Vehicle Perimeter Monitoring Device>
FIG. 1 is a top view showing an example of a vehicle 1 on which a vehicle periphery monitoring device 2 according to the present embodiment can be mounted. FIG. 2 is a block diagram illustrating a functional configuration of the vehicle periphery monitoring device 2. In addition, in FIG. 1 and each figure after that, in order to clarify those directional relationships, the coordinate axis which shows the front-back direction, the left-right direction, and the up-down direction is attached | subjected as needed.

  The vehicle periphery monitoring device 2 is a device that monitors the open / close status of the front door 5, the rear door 6 and the rear door 8 (see FIG. 1) and executes a predetermined operation based on the open / close status. As shown in FIGS. 1 and 2, the vehicle periphery monitoring device 2 mainly includes a side camera 31, a rear camera 38, a control unit 10, and a display unit 71.

  The side cameras 31 (31 a and 31 b) are imaging units installed on left and right (side) door mirrors (not shown) of the vehicle 1. That is, the side camera 31 is disposed in the vicinity of the front door 5. Moreover, as shown in FIG. 1, the left side camera 31a can image a predetermined wide imaging range 32a including both the front and rear as viewed from the installation position of the left side camera 31a. Similarly, the right side camera 31b can image a predetermined wide imaging range 32b including the front and the rear as viewed from the installation position.

  Therefore, the side camera 31 (31a, 32b) can image an object outside the vehicle 1 such as an obstacle both before and after the vehicle and a guide line (white line) drawn on the road. Moreover, the side camera 31 (31a, 32b) can also image the front door 5 (5a, 5b) and the rear door 6 (6a, 6b) of the vehicle 1.

  Further, a front camera 36 that enables imaging in front of the vehicle 1 is installed in the front portion of the vehicle 1. Further, a rear camera 38 that enables imaging of the rear of the vehicle 1 and the rear door 8 is installed in the vicinity of the rear door 8 at the rear of the vehicle 1. The images captured by the cameras 31, 36, and 38 are input to the image input unit 30 and displayed on the display unit 71 installed in the room of the vehicle 1.

  The control unit 10 detects the opening / closing status of the front door 5, the rear door 6, and the rear door 8 based on images from the side camera 31 and the rear camera 38, and executes a predetermined warning process based on the opening / closing status. Let As shown in FIG. 2, the control unit 10 mainly includes a detection unit 40, a warning sound generation unit 50, a warning lamp lighting control unit 60, and a display image switching unit 70.

  The detection unit 40 detects the open / close state of the front door 5, the rear door 6, and the rear door 8 based on images captured by the side camera 31 and the rear camera 38. 3 and 4 are diagrams illustrating an example of an image displayed on the display unit 71. FIG. Here, a method for detecting the open / closed state of the left front door 5a from an image captured by the side camera 31a on the left side of the vehicle 1 will be described.

  As shown in FIG. 3, when the front door 5a is normally closed, the contour line 72 below the front door 5a and the rear door 6a is a substantially smooth curve. Further, a boundary line 73 between the main body 9 of the vehicle 1 and the front door 5a and the rear door 6a also has a substantially smooth curve.

  On the other hand, as shown in FIG. 4, when the front door 5a is not normally closed (for example, a half door state or the door is opened), the position of the side camera 31a is the same as that of the front door 5a. Will move. Therefore, the contour line 72 and the boundary line 73 are discontinuous across the boundary line 74 between the front door 5a and the rear door 6a.

  That is, since the side camera 31a moves while maintaining the positional relationship with the front door 5a, the positions of the contour line 72a and the boundary line 73a (see FIG. 4) on the front door 5a side in the image are normal. Are substantially the same as the positions of the contour line 72 and the boundary line 73 (see FIG. 3).

  On the other hand, the rear door 6a and the rear tire 4 move relative to the side camera 31a. Therefore, as shown in FIG. 4, the positions of the contour line 72b (solid line part) and the boundary line 73b (solid line part) on the rear door 6a side are the contour line 72 (broken line part) and the boundary line when normally closed. It is not the same as the position 73 (broken line). Further, when the front door 5a is normally closed, the position of the rear tire 4 (broken line portion) displayed at the position P1 on the image moves to the position P2 (solid line portion).

  Therefore, when comparing the position P1 of the rear tire 4a and the position P2 of the rear tire 4b when the front door 5a is normally closed, the positional deviation amount between the position P1 and the position P2 exceeds the allowable value, the detection is performed. The unit 40 determines that the front door 5a is not properly closed. On the other hand, when the amount of positional deviation is less than the allowable value, it is determined that the front door 5a is normally closed. Here, the position P1 of the rear tire 4 when the front door 5a is normally closed is obtained in advance and stored in the RAM 13 (see FIG. 2).

  Further, as shown in FIG. 4, the open / closed state of the front door 5 a can also be detected by the amount of displacement of the front tire 3.

  Thus, the detection unit 40 of the vehicle periphery monitoring device according to the present embodiment is a moving unit (for example, the front tire 3 or the like) that moves relative to the side camera 31 from the image captured by the side camera 31. The rear tire 4 or the like) is extracted, and the position (detection position) of the moving part on the image is calculated. Further, the detection unit 40 reads the position of the moving unit on the image (reference position) from the RAM 13 when the front door 5 is normally closed. And the detection part 40 detects the opening / closing state of the front door 5 based on the amount of position shift of the detection position seen from the reference position.

  The opening / closing state of the front door 5b is detected by the detection unit 40 based on the image captured by the side camera 31b. Similarly, the opening / closing states of the rear door 6 (6a, 6b) and the rear door 8 are detected based on images taken by the side camera 31 (31a, 31b) and the rear camera 38.

  The warning sound generating unit 50, the warning lamp lighting control unit 60, and the display image switching unit 70 are based on the opening / closing states of the opening / closing units (for example, the front door 5, the rear door 6, the rear door 8, and the like) detected by the detection unit 40. The warning unit executes warning processing. As a result, the warning sound generator 50, the warning lamp lighting controller 60, and the display image switching unit 70, when it is determined that any of the opening / closing parts is not normally closed, This can be notified to the person. Therefore, the driver or passenger of the vehicle can execute an appropriate measure according to the opening / closing state of the opening / closing part.

  The warning sound generating unit 50 generates a warning sound when it is determined that one of the opening / closing parts is not normally closed, and performs processing for generating the warning sound from the speaker 51 provided in the vehicle 1. Execute. Further, the warning lamp lighting control unit 60 performs a process of blinking the warning lamp 61 provided in the vehicle 1 when it is determined that any of the opening / closing units is not normally closed. Further, when it is determined that the display image switching unit 70 is not normally closed, the display image switching unit 70 switches the image displayed on the display unit 71 to display an image including an opening / closing unit that is not normally closed on the display unit 71. indicate.

  In the present embodiment, when it is determined that any of the opening / closing parts is not normally closed, at least one of the warning processes executed by the respective parts 50, 60, 70 is executed.

  The RAM 13 is a readable / writable memory (storage unit). The RAM 13 can store, for example, information about the position P1 of the rear tire 4 obtained in advance and an image input to the image input unit 30.

  The ROM 12 is a read-only memory, and the MPU 11 executes control according to a program stored in the ROM 12. In addition, the MPU 11 is electrically connected to the ROM 12, the RAM 13, the image input unit 30, the detection unit 40, the warning sound generation unit 50, the warning lamp lighting control unit 60, and the display image switching unit 70 through the signal line 15. . Therefore, the MPU 11 can execute an opening / closing state detection process, a warning process, and the like of each door 5, 6, 8 at a predetermined timing according to this program.

<2. Advantages of Vehicle Perimeter Monitoring Device of Embodiment>
As described above, the vehicle periphery monitoring device 2 according to the present embodiment opens and closes the front door 5, the rear door 6, and the rear door 8 based on the images captured by the side cameras 31 (31a, 31b) and the rear camera 38. The situation can be detected. When at least one of the doors 5, 6, 8 is not normally closed, at least one of the warning sound generating unit 50, the warning lamp lighting control unit 60, and the display image switching unit 70 is used. Warning processing for notifying the driver and passengers of that fact can be executed. Therefore, the driver and passengers of the vehicle 1 can execute appropriate measures based on the opening / closing states of the doors 5, 6, 8.

<3. Modification>
Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications can be made.

  (1) In the present embodiment, the side camera 31 (31a, 31b) has been described as being installed on the door mirror of the vehicle 1, that is, outside the vehicle 1, but is not limited thereto. For example, when at least one of the front door 5 (5a, 5b) and the rear door 6 (6a, 6b) of the vehicle 1 can be imaged, the side camera 31 may be installed in the vehicle 1.

  (2) In the present embodiment, the method of detecting the opening / closing state of the opening / closing part based on the position information of the rear tire 4 has been described, but the present invention is not limited to this. For example, an image obtained when the opening / closing unit is normally closed may be acquired and stored in the RAM 13, and the opening / closing state may be determined by comparing the stored image with the corresponding camera image. .

  (3) In the present embodiment, the open / close state of the open / close unit is detected based on the camera image, but the present invention is not limited to this. For example, the open / close state of the open / close unit may be monitored based on the camera image and the detection result of a contact sensor (for example, a switch) disposed near the open / close unit.

  (4) Further, in the present embodiment, the side camera 31 captures an image through a lens having a wide angle of view, such as a fish-eye (super wide-angle) lens, in order to enable imaging of a wide imaging range 32. Although described as a thing, it is not limited to this. 5 and 6 are diagrams illustrating another example of the image displayed on the display unit 71. FIG. As shown in FIGS. 5 and 6, the display unit 71 displays an image captured by the side camera 31 a on the left side of the vehicle 1 through a lens having a normal angle of view instead of a fisheye lens.

  As shown in FIG. 5, when the front door 5a is normally closed, the captured image displayed on the display unit 71 includes the front door 5a and the fender unit 9a, and does not include the front tire 3. There is a case.

  On the other hand, as shown in FIG. 6, when the front door 5a is not normally closed (for example, the half door state or the door is opened), the position of the side camera 31a is set together with the front door 5a. Will move. For this reason, the captured image may include the front tire 3 in addition to the front door 5a and the fender portion 9a.

  Further, when the captured image when the front door 5a is normally closed is compared with the captured image when the front door 5a is not normally closed, the side camera 31a moves together with the front door 5a. The position and shape (planar shape) of the front door 5a displayed in both captured images are substantially the same.

  On the other hand, the fender portion 9a is picked up as an image corresponding to the open / close state of the front door 5a. That is, the position and shape (planar shape) of the fender portion 9a displayed in both captured images may be different.

  Accordingly, (a) an image when the front door 5a is closed in advance is stored in the RAM 13 or the like as a reference image, and (b) the detection unit 40 is captured by the side camera 31a and the RAM 13 It is also possible to detect the open / closed state of the front door 5a by evaluating a difference image created from a reference image stored in advance. And warning processing can also be performed based on the opening / closing state of the front door 5a detected by the detection part 40 similarly to the above-mentioned embodiment.

It is a top view which shows an example of the vehicle which can mount the vehicle periphery monitoring apparatus in embodiment of this invention. It is a block diagram which illustrates the functional composition of the vehicle periphery monitoring device. It is a figure which shows an example of the image displayed on the display part. It is a figure which shows an example of the image displayed on the display part. It is a figure which shows another example of the image displayed on the display part. It is a figure which shows another example of the image displayed on the display part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Vehicle 2 Vehicle periphery monitoring apparatus 5 (5a, 5b) Front door 6 (6a, 6b) Rear door 8 Rear door 10 Control part 30 Image input part 31 (31a, 31b) Side camera 32 (32a, 32b) Imaging range 36 Front camera 38 Rear camera 40 Detection unit 50 Warning sound generation unit 60 Warning lamp lighting control unit 70 Display image switching unit 71 Display unit

Claims (6)

(a) an imaging unit installed in the vehicle;
(b) a detection unit that detects an opening / closing state of the opening / closing unit of the vehicle based on an image captured by the imaging unit;
(c) a warning unit that executes a warning process based on the opening / closing state detected by the detection unit;
A vehicle periphery monitoring device comprising: In the vehicle periphery monitoring device according to claim 1,
The opening / closing part is provided on a side part of the vehicle,
The vehicle periphery monitoring device, wherein the imaging unit is provided in the vicinity of the opening / closing unit. In the vehicle periphery monitoring device according to claim 1,
The opening / closing part is provided at a rear part of the vehicle,
The vehicle periphery monitoring device, wherein the imaging unit is provided in the vicinity of the opening / closing unit. In the vehicle periphery monitoring device according to any one of claims 1 to 3,
The vehicle periphery monitoring device, wherein the warning unit generates a warning sound based on the detected opening / closing state. In the vehicle periphery monitoring device according to any one of claims 1 to 3,
The vehicle periphery monitoring device, wherein the warning unit blinks a warning lamp based on the detected opening / closing state. In the vehicle periphery monitoring device according to any one of claims 1 to 3,
(d) a display unit that displays an image captured by the imaging unit;
Further comprising
The vehicle warning device, wherein the warning unit displays an image including the opening / closing unit on the display unit based on the detected opening / closing state.

Images