JP5573220B2 - Drive recorder apparatus, recording method, program, and recording medium - Google Patents

Description

  The present invention relates to a drive recorder device, a recording method, a program, and a recording medium that capture and record a situation around a vehicle.

  In recent years, drive recorder devices that capture and record the situation around a vehicle have become widespread, and have been installed not only in commercial vehicles such as trucks and buses but also in domestic passenger cars. When a traffic accident occurs, if the image at the time of the accident is recorded in the drive recorder device provided in the vehicle, it can be used as a document for verification of the cause of the accident or claim for damages.

  For example, in Patent Document 1, during normal driving, an image obtained from a video camera device or the like is constantly recorded while being overwritten on a recording device such as a semiconductor memory, but a certain level of impact is applied to the vehicle. When this is detected, it is determined that the impact was caused by an accident, and the recording of the image at the time of the accident is maintained by stopping overwriting on the recording device. (Image recording system) is disclosed.

  An acceleration detection sensor is often used as a means for detecting that an impact has been applied to the vehicle. However, even during normal driving conditions, acceleration occurs in the vehicle when starting up or turning, so there is a problem that an unnecessary image is recorded due to erroneous detection even though it is not actually an accident. .

  In addition, since a signal detected after the occurrence of an accident is used, there is a problem that nothing is recorded if an acceleration detection sensor or an electronic circuit related to recording is damaged at the moment of the accident.

  Accordingly, the present invention has been made in view of the above problems, and an object thereof is to provide a highly reliable drive recorder device, recording method, program, and recording medium capable of reliably recording an image at the time of an accident.

In order to solve the above problems, a drive recorder apparatus according to the present invention is a drive recorder apparatus that captures and records a situation around a vehicle, and outputs a video camera that captures at least a situation in front of the host vehicle. Means, image recognition processing means for performing recognition processing based on image data output from the video camera means, image recording means for recording image data output from the video camera means, and acceleration for detecting acceleration generated in the host vehicle An abnormality detection processing means for detecting, as an abnormal state, a characteristic change when the image recognition processing means recognizes that an object in the image data has changed characteristically. The image recording means includes a volatile first recording means and a non-volatile second recording means that is slower than the first recording means. Recording means temporarily records the image data output from the video camera unit, the second recording means, in the abnormality detection time abnormality is detected by the processing means and the acceleration sensor unit at the time the acceleration is detected The recording start time is determined based on the image data recorded temporarily in the first recording means, and the second recording means is predetermined from the time when either an abnormality or acceleration is detected. If the other is not detected within the time, the image data is not recorded .

The recording method of the drive recorder apparatus according to the present invention is a recording method of the drive recorder apparatus that captures and records the situation around the vehicle, and is a video camera that outputs image data that captures at least the situation in front of the host vehicle. A recognition process based on the image data output from the video camera process, an acceleration detection process for detecting acceleration generated in the host vehicle, and a characteristic change in an object in the image data In the case of recognizing that an abnormal state has been detected, an abnormality detection processing step for detecting a characteristic change as an abnormal state, a volatile first recording means, and a non-volatile first that is slower than the first recording means The first recording means detects an abnormality in the step of temporarily recording the image data output by the video camera process and the abnormality detection processing step. A step of time and the acceleration to determine when to start recording based on the time that is detected with the second recording means records the temporarily recorded image data in the first recording means, second The recording means includes a step of not recording image data when the other is not detected within a predetermined time from the time at which one of the abnormality and the acceleration is detected .

A program according to the present invention is a program for causing a computer to execute a recording method of a drive recorder device that captures and records a situation around a vehicle, and a video that outputs image data obtained by imaging at least a situation in front of the host vehicle. Camera processing, image recognition processing that performs recognition processing based on the image data output by the video camera processing, acceleration detection processing that detects acceleration generated in the host vehicle, and a characteristic change in an object in the image data In the case of recognizing that an abnormality has occurred, the abnormality detection process for detecting a characteristic change as an abnormal state and the drive recorder device are slower than the volatile first recording means and the first recording means. A non-volatile second recording means, wherein the first recording means is a process for temporarily recording the image data output by the video camera process; A process of abnormality detection processing time and acceleration abnormality is detected in step determines the time to start the recording based on the time that has been detected, the second recording means is temporarily recorded in the first recording means The second recording means performs a process of not recording the image data when the other is not detected within a predetermined time from the time when either the abnormality or the acceleration is detected. and characterized by causing a computer to execute.

  A recording medium according to the present invention is a computer-readable recording medium on which the program described above is recorded.

  According to the present invention, it is possible to provide a highly reliable drive recorder device, recording method, program, and recording medium capable of reliably recording an image at the time of an accident.

It is a block diagram of the drive recorder apparatus concerning the 1st Embodiment of this invention. It is a figure which shows the flow of operation | movement of the image recording part which concerns on the 1st Embodiment of this invention. It is a figure which shows the image data obtained by imaging the situation ahead of the own vehicle. It is a figure which shows the image data obtained by imaging the situation ahead of the own vehicle. It is a block diagram of the drive recorder apparatus concerning the 2nd Embodiment of this invention. It is a figure which shows the flow of operation | movement of the image recording part which concerns on the 2nd Embodiment of this invention. It is a figure which shows the flow of operation | movement of the image recording part which concerns on the 3rd Embodiment of this invention.

  In the drive recorder apparatus according to the present invention, when the traveling state of the host vehicle or another vehicle is examined from the characteristics of the image data obtained from the video camera unit 10 and it is determined that the traveling state is abnormal leading to an accident, the image Data is recorded. That is, the feature is that the occurrence of an accident is predicted and recorded.

  Hereinafter, embodiments of the drive recorder apparatus of the present invention will be described with reference to the drawings.

  FIG. 1 is a configuration diagram of a drive recorder device 1 according to the first embodiment.

  The drive recorder device 1 includes a video camera unit 10, an image recognition processing unit 20, and an image recording unit 30.

  The video camera unit 10 outputs an image obtained by photographing at least the situation in front of the host vehicle, and includes an optical system such as a lens (not shown) and an image sensor such as an image sensor.

  The image data output from the video camera unit 10 is transferred to the image recognition processing unit 20 and the image recording unit 30.

  The image recognition processing unit 20 performs an image recognition process on the obtained image data, and includes an abnormality detection process for detecting that the vehicle is in an abnormal running state as one of the processes. .

  In the case of the abnormality detection process in the present embodiment, when a characteristic change of an object in the image data is recognized, it is determined that the vehicle is in an abnormal traveling state.

  In the case of abnormality detection processing in another case, when a characteristic change in a part or all of a certain area in the image data is recognized, it is determined that the vehicle is in an abnormal driving state. Specific examples of the characteristic change abnormality detection processing will be described later in detail.

  In addition, when it is detected that the vehicle is in an abnormal running state, a signal indicating that is output to the image recording unit 30. Hereinafter, this signal is referred to as an “abnormality detection signal”.

  The image recording unit 30 includes a recording control device 31, a recording device A32, and a recording device B33.

  The recording control device 31 controls the operation of the recording device A32 and the recording device B33 on the basis of the abnormality detection signal output from the image recognition processing unit 20, and starts or stops recording image data.

  The recording device A32 is for temporarily storing the image data output from the video camera unit 10, and specifically, it operates at high speed but is volatile, such as a DRAM or SRAM.

  The recording device B33 is for copying the image data temporarily stored in the recording device A32 and permanently storing it. Specifically, the recording device B33 operates at a low speed like a flash memory or HDD. It is non-volatile.

  FIG. 2 is a diagram illustrating a flow of operations of the image recording unit 30.

  When the drive recorder device 1 starts operating, the image data output from the video camera unit 10 is successively written in the recording device A32. When the remaining capacity of the recording apparatus A32 becomes smaller than a certain amount during the writing operation, the old image data stored in the recording apparatus A32 is overwritten in order.

  Specifically, when the write address approaches the end, the head address is restored. Although not shown, this overwriting operation is cyclically repeated while the abnormality detection signal is not generated.

  When the abnormality detection signal is transferred from the image recognition processing unit 20 to the recording control device 31, the operation proceeds to an operation of copying the image data temporarily stored in the recording device A32 to the recording device B33. Here, the image data stored in the recording apparatus A32 is determined based on the time at which the abnormality detection signal is generated, from where to where is the copy target period.

  In FIG. 2, the period before and after the time when the abnormality detection signal is generated is the copy target period, but the present invention is not limited to this. It is not always necessary to include the time when the abnormality detection signal is generated during the copy target period. Alternatively, all of the image data temporarily stored in the recording device A32 may be copied.

  During the copying of the image data, the image data read from the recording device A32 is written to the recording device B33. As described above, since the recording apparatus B33 operates at a low speed, a longer time is required than when image data of the same period (data capacity) is written to the recording apparatus A32.

  If a high-speed operation and a non-volatile recording apparatus exist, the configuration and operation of the recording apparatus are not limited as described above.

  Next, the abnormality detection process performed in the image recognition processing unit 20 will be specifically described.

  An example of the abnormality detection process in this embodiment will be described with reference to FIG.

  FIG. 3 is a diagram showing image data obtained by photographing the situation in front of the host vehicle.

  Here, as a characteristic change, attention is paid to the presence and movement of the oncoming vehicle 51 in the image data 50. When the oncoming vehicle recognizes the movement 53 (characteristic change) approaching the center line 52, it determines that the driving is dangerous and there is a risk of collision, and the image recognition processing unit 20 generates an abnormality detection signal. Let

  Next, an example of the abnormality detection process in this embodiment will be described with reference to FIG.

  FIG. 4 is a diagram showing image data obtained by photographing the situation in front of the host vehicle.

  Here, as a characteristic change, attention is paid to the transition of a predetermined area 61 in the image data 60. Each time a certain short period ΔT elapses, the previous image data 62 and the current image data 63 are compared within a predetermined region of interest.

  As a result of the comparison, if there is almost no change between the regions of interest 62 and 63, for example, it is determined that the host vehicle has performed a sudden braking operation to avoid any accident, and the image recognition processing unit 20 Generates an anomaly detection signal. As a specific example of the characteristic change, here is a characteristic change that "if the vehicle is running (moving) in the area of interest, the image data that should have changed does not change" As caught.

  As described above, in the drive recorder device 1 of the present embodiment, the traveling state of the host vehicle or other vehicle is examined from the characteristics of the image data obtained from the video camera unit 10 and is in an abnormal traveling state that leads to an accident. If it is determined, the image data is recorded in a nonvolatile recording device. That is, the occurrence of an accident is predicted and recorded.

  In this way, you can start recording before you encounter an accident, so avoiding the situation where the acceleration detection sensor or electronic circuit related to recording is damaged by the impact of the accident and nothing is recorded. Can do.

  Next, an example of a drive recorder device will be described for the second embodiment.

  FIG. 5 is a configuration diagram of the drive recorder device 1 in the present embodiment.

  The same numbers are assigned to the same components as those in FIG. 1 used in the description of the first embodiment.

  The difference from the configuration of the first embodiment is that an acceleration sensor 40 for detecting the acceleration generated in the host vehicle is provided. Further, not only the abnormality detection signal output by the image recognition processing unit 20 but also the output of the acceleration sensor 40 is passed to the recording control device 31 in the image recording unit 30. Hereinafter, the output of the acceleration sensor 40 is described as an “acceleration detection signal”.

  Next, the operation of the image recording unit 30 will be described with reference to FIG. FIG. 6 is a diagram illustrating a flow of operations of the image recording unit 30. Description of operations equivalent to those of the image recording unit 30 of the first embodiment is omitted.

  In the image recording unit 30 according to the second embodiment, when either the abnormality detection signal or the acceleration detection signal is detected, the image data temporarily stored in the recording device A32 is copied to the recording device B33. Move to the operation.

  In the example of FIG. 6, the first copy operation is started due to the occurrence of the abnormality detection signal A, and the determination of the copy target period is also based on the generation time of the abnormality detection signal A. Although the acceleration detection signal is generated after the occurrence of the abnormality detection signal A, this does not affect the transition to the copy operation or the determination of the copy target period.

  Further, since the abnormality detection signal B is generated, the second copy operation is started, and when the copy target period is determined, it is based on the generation time of the abnormality detection signal B. Here, the acceleration detection signal is not generated after the occurrence of the abnormality detection signal B, but this also does not affect the transition to the copy operation or the determination of the copy target period.

  The contents of the abnormality detection process performed by the image recognition processing unit 20 are the same as those shown in the first embodiment.

  As described above, in the drive recorder device 1 of the present embodiment, when either one of two types of information, that is, an abnormality detection signal and an acceleration detection signal, in other words, an accident prediction and a result, is obtained, image data is obtained. Is recorded.

  By complementing each other in this way, even an accident that cannot be detected by the abnormality detection process or an accident that cannot be detected by the acceleration sensor can be recorded reliably.

  Next, an example of the drive recorder device 1 in the third embodiment will be described.

  Since the configuration of the drive recorder device 1 of the present embodiment is the same as the configuration shown in the second embodiment described above, a description thereof will be omitted.

  Next, the operation of the image recording unit 30 will be described with reference to FIG. Description of operations equivalent to those of the image recording unit 30 of the first embodiment is omitted.

  In the image recording unit 30 in the third embodiment, when both the abnormality detection signal and the acceleration detection signal are detected, the image data temporarily stored in the recording device A32 is copied to the recording device B33. However, if only one of them is detected, copying is not performed.

  In the example of FIG. 7, since the acceleration detection signal is generated within a predetermined time from the time when the abnormality detection signal A is generated, the copying operation is started. The determination of the copy target period is based on the occurrence time of the abnormality detection signal A.

  However, if the acceleration detection signal is not generated within a predetermined time from the time when the abnormality detection signal B is generated, it is determined that the abnormality detection signal B is a false detection, and copying is not performed.

  The contents of the abnormality detection process performed by the image recognition processing unit 20 are the same as those shown in the first embodiment.

  In the third embodiment, no priority is given between the abnormality detection signal and the acceleration detection signal.

  This is because the abnormality detection signal is obtained by performing recognition processing on the image data, so if the processing content is complicated or the performance of the processing device (such as a microcomputer) is low, acceleration detection is performed. This is because an abnormal detection signal may be generated after the signal is generated.

  In the third embodiment, the feature that “no image data is recorded” is realized by “no copying operation from the recording device A32 to the recording device B33”. is not.

  For example, copying to the recording apparatus B33 is performed when one of the signals is detected, but if the remaining one is not detected, the copied data may be erased or overwritten next time. good.

  As described above, in the drive recorder apparatus 1 of the present embodiment, image data is recorded only when both an abnormality detection signal and an acceleration detection signal are generated.

  By doing so, it is possible to avoid a situation where meaningless image data is recorded due to erroneous detection, and it is possible to prevent waste of the capacity of the recording apparatus.

  According to the above embodiment, the drive recorder device examines the running state of the host vehicle and other vehicles from the characteristics of the image data obtained from the video camera unit, and determines that it is an abnormal running state that leads to an accident. In some cases, the image data is recorded (in a non-volatile recording device). That is, the occurrence of an accident is predicted and recorded. In this way, you can start recording before you encounter an accident, so avoiding the situation where the acceleration detection sensor or electronic circuit related to recording is damaged by the impact of the accident and nothing is recorded. Can do.

  Further, according to the above-described embodiment, in the drive recorder device, when one of two types of information, that is, an abnormality detection signal and an acceleration detection signal, in other words, an accident prediction and a result, is obtained, image data is obtained. I try to record. By complementing each other in this way, even an accident that cannot be detected by the abnormality detection process or an accident that cannot be detected by the acceleration sensor can be recorded reliably.

  Further, according to the above embodiment, the drive recorder apparatus records image data only when both the abnormality detection signal and the acceleration detection signal are generated. By doing so, it is possible to avoid a situation where meaningless image data is recorded due to erroneous detection, and it is possible to prevent waste of the capacity of the recording apparatus.

  In the drive recorder device of the present invention, a video camera unit that outputs an image obtained by photographing at least the front situation of the host vehicle, an image recognition processing unit that performs a recognition process based on image data output by the video camera unit, An image recording unit that records image data output by the video camera unit, and the image recognition processing unit recognizes that an object in the image data has changed characteristically. Including an abnormality detection process for detecting an abnormal state, wherein the image recording unit determines a recording start time based on a time when the abnormality is detected in the abnormality detection process, and records image data It is characterized by.

  Further, in the drive recorder device of the present invention, a video camera unit that outputs an image obtained by photographing at least a front situation of the host vehicle, and an image recognition processing unit that performs a recognition process based on image data output from the video camera unit; An image recording unit that records image data output by the video camera unit, and the image recognition processing unit is configured to check that a certain area (part or all) in the image data has changed characteristically. In the case of recognition, it includes an abnormality detection process for detecting it as an abnormal state, and the image recording unit determines the time to start recording based on the time when the abnormality is detected in the abnormality detection process. The image data is recorded.

  The drive recorder apparatus of the present invention further includes an acceleration sensor that detects acceleration generated in the host vehicle in addition to the configuration described above, and the image recording unit detects an abnormality in the abnormality detection process. If acceleration is detected by the acceleration sensor, or at least one of them is detected, the recording start time is determined based on the detected time, and the image data is recorded. It is a feature.

  The drive recorder apparatus of the present invention further includes an acceleration sensor that detects acceleration generated in the host vehicle in addition to the configuration described above, and the image recording unit detects an abnormality in the abnormality detection process. If acceleration is detected by the acceleration sensor, or at least one of the detections is made, a time to start recording is determined based on the detected time, and further from the detected time If one of the remaining images is detected before the predetermined time elapses, the image data is recorded. However, even if a predetermined time elapses from the detected time, the remaining image is detected. If not, the image data is not recorded.

  The image recognition processing means of the drive recorder apparatus according to the present invention detects a characteristic change as an abnormal state when recognizing that a part or all of a certain area in the image data has changed characteristically. An abnormality detection processing unit is provided, and the image recording unit determines a recording start time based on the time when the abnormality is detected by the abnormality detection processing unit, and records the image data.

  The drive recorder apparatus according to the present invention has acceleration sensor means for detecting acceleration generated in the host vehicle, and the image recording means detects abnormality in the abnormality detection process or acceleration is detected by the acceleration sensor means. If at least one of the detections is made, the recording start time is determined based on the detected time, and the image data is recorded.

  The drive recorder apparatus according to the present invention includes an acceleration sensor that detects acceleration generated in the host vehicle, and whether the image recording means detects abnormality by the abnormality detection process or acceleration is detected by the acceleration sensor. When at least one of the detections is made, the recording start time is determined based on the detected time, and the remaining one is detected until a predetermined time elapses from the detected time. In this case, the image data is recorded, but the image data is not recorded when the remaining one is not detected even after a predetermined time has elapsed from the detected time.

  The characteristic change of the drive recorder device according to the present invention is that a certain object in the image data moves out of the center line and approaches the own vehicle, and every time a certain short time ΔT elapses. This is characterized in that the image data does not change by comparing the previous image data with the predetermined area in the current image data.

  The present invention can be applied to uses such as a drive recorder device and an image recording device.

DESCRIPTION OF SYMBOLS 1 Drive recorder apparatus 10 Video camera part 20 Image recognition process part 30 Image recording part 31 Recording control apparatus 32 Recording apparatus A
33 Recording device B
40 Acceleration sensor 50 Entire image data 51 A certain object (attention) 52 Center line 53 Characteristic change (protrusion)
60 Image data 61, 62, 63 Region of interest

Japanese Patent Laid-Open No. 06-237463

Claims (6)

A drive recorder device that captures and records the situation around a vehicle,
Video camera means for outputting image data obtained by imaging at least the situation in front of the host vehicle;
Image recognition processing means for performing recognition processing based on the image data output by the video camera means;
Image recording means for recording the image data output by the video camera means;
Acceleration sensor means for detecting acceleration generated in the host vehicle;
Have
The image recognition processing means comprises an abnormality detection processing means for detecting the characteristic change as an abnormal state when it is recognized that a certain object in the image data has changed characteristically,
The image recording means includes a volatile first recording means and a non-volatile second recording means that is slower than the first recording means,
The first recording means temporarily records the image data output by the video camera means,
The second recording means determines the time to start recording based on the time when the abnormality is detected by the abnormality detection processing means and the time when the acceleration is detected by the acceleration sensor means, and the first recording means The image data temporarily recorded in the
The second recording means does not record image data when one of the abnormality and the acceleration is not detected within a predetermined time from the time when the abnormality is detected. . The image recognition processing means includes an abnormality detection processing means for detecting the characteristic change as an abnormal state when recognizing that a part or all of a certain area in the image data has changed characteristic. Prepared,
2. The drive recorder device according to claim 1, wherein the image recording unit determines a time to start recording based on a time when an abnormality is detected by the abnormality detection processing unit, and records the image data. .   The characteristic change means that a certain object in the image data moves out of the center line and approaches the host vehicle, and every time a short time ΔT passes, the previous image data and this time 3. The drive recorder device according to claim 1, wherein the image data does not change by comparing within a predetermined area of the image data. A recording method of a drive recorder device for photographing and recording a situation around a vehicle,
A video camera process for outputting image data obtained by imaging at least the situation in front of the host vehicle;
An image recognition processing step for performing recognition processing based on the image data output by the video camera step;
An acceleration detection step of detecting an acceleration generated in the host vehicle;
When recognizing that an object in the image data has undergone a characteristic change, an abnormality detection processing step for detecting the characteristic change as an abnormal state;
Volatile first recording means, and non-volatile second recording means that is slower than the first recording means, wherein the first recording means outputs the image output by the video camera process. Temporarily recording data;
Determining a time to start recording based on a time at which an abnormality is detected in the abnormality detection processing step and a time at which acceleration is detected;
The second recording means records the image data temporarily recorded in the first recording means ;
The second recording means does not record image data when the other is not detected within a predetermined time from the time at which one of the abnormality and the acceleration is detected ;
A recording method for a drive recorder apparatus, comprising: A program that causes a computer to execute a recording method of a drive recorder device that captures and records a situation around a vehicle,
Video camera processing for outputting image data obtained by imaging at least the situation in front of the host vehicle;
Image recognition processing for performing recognition processing based on the image data output by the video camera processing;
Acceleration detection processing for detecting acceleration generated in the host vehicle;
When recognizing that an object in the image data has undergone a characteristic change, an abnormality detection process for detecting the characteristic change as an abnormal state;
The drive recorder apparatus includes a volatile first recording unit and a non-volatile second recording unit that is slower than the first recording unit, and the first recording unit includes the video camera. A process of temporarily recording the image data output by the process;
A process for determining a time to start recording based on a time at which an abnormality is detected in the abnormality detection process and a time at which acceleration is detected;
The second recording means records the image data temporarily recorded in the first recording means ;
The second recording means is a process of not recording image data when the other is not detected within a predetermined time from the time at which one of the abnormality and the acceleration is detected ;
A program that causes a computer to execute. A computer-readable recording medium on which the program according to claim 5 is recorded.

Images