JP2021096597A - Vehicle recording controller, vehicle recording control method, and program - Google Patents

Abstract

To store information on an accident appropriately.SOLUTION: A vehicle recording controller 100 comprises: an image data acquisition unit 120 for acquiring image data photographed by a camera 210 for photographing a surrounding of a vehicle; an information acquisition unit 130 for acquiring vehicle acceleration information indicating a vehicle acceleration applied to the vehicle and occupant information indicating a state of a neck or head of an occupant of the vehicle; an event detection unit 133 for detecting that an event has occurred on the vehicle by determining that the vehicle acceleration acquired by the information acquisition unit 130 is equal to or greater than a first threshold; and a recording control unit 123 for storing the image data and occupant information during a period corresponding to the occurrence of a vehicle abnormal value that is less than the first threshold when the vehicle abnormal value has been detected from the vehicle acceleration and an occupant abnormal value of the occupant information synchronizing with the vehicle abnormal value has been detected.SELECTED DRAWING: Figure 1

Description

The present invention relates to a vehicle record control device, a vehicle record control method and a program.

Drive recorders that detect events such as accidents based on the acceleration applied to the vehicle and save images are widely used (see, for example, Patent Document 1). The drive recorder detects events based on the acceleration applied to the vehicle.

Japanese Unexamined Patent Publication No. 06-237463

The threshold value of the acceleration for detecting an event is set to a value that does not erroneously detect an acceleration that is not an event that occurs during normal driving as an event. As a result, for example, the acceleration detected when a rear-end collision is lightly made from the rear of the vehicle may not be detected as an event. Such a minor collision causes little damage to the vehicle. However, since the occupants of the vehicle are suddenly shocked without holding themselves, the neck is strained, and traumatic cervical syndrome, so-called whiplash, may be diagnosed. However, since the accident itself is minor, it may be difficult to confirm the causal relationship between the accident and whiplash.

The present invention has been made in view of the above, and an object of the present invention is to appropriately store information on an accident.

In order to solve the above-mentioned problems and achieve the object, the vehicle recording control device according to the present invention includes a video data acquisition unit that acquires video data taken by a shooting unit that shoots the periphery of the vehicle, and the vehicle. An information acquisition unit that acquires vehicle acceleration information indicating the applied vehicle acceleration and occupant information indicating the state of the neck or head of the occupant of the vehicle, and the vehicle acceleration acquired by the information acquisition unit are equal to or greater than the first threshold value. An event detection unit that detects that an event has occurred in the vehicle based on the value of, and the occupant information that detects a vehicle abnormality value less than the first threshold value from the vehicle acceleration and further synchronizes with the vehicle abnormality value. When an occupant abnormal value is detected, the vehicle includes a recording control unit that stores video data and occupant information for a period corresponding to the occurrence of the vehicle abnormal value.

The vehicle record control method according to the present invention includes a video data acquisition step of acquiring video data taken by a photographing unit that shoots the periphery of the vehicle, vehicle acceleration information indicating the vehicle acceleration applied to the vehicle, and the vehicle. An event has occurred in the vehicle due to an information acquisition step for acquiring occupant information indicating the state of the occupant's neck or head and the vehicle acceleration acquired by the information acquisition step having a value equal to or higher than the first threshold value. When the event detection step for detecting that, the vehicle abnormal value less than the first threshold value is detected from the vehicle acceleration, and the occupant abnormal value of the occupant information synchronized with the vehicle abnormal value is detected, the vehicle abnormal value of the vehicle abnormal value is detected. The vehicle record control device executes a record control step of storing video data and occupant information during the period corresponding to the occurrence.

The program according to the present invention includes a video data acquisition step of acquiring video data taken by a shooting unit that shoots the periphery of the vehicle, vehicle acceleration information indicating the vehicle acceleration applied to the vehicle, and the neck of the occupant of the vehicle. Alternatively, it is detected that an event has occurred in the vehicle due to an information acquisition step for acquiring occupant information indicating the state of the head and the vehicle acceleration acquired by the information acquisition step having a value equal to or higher than the first threshold value. When the event detection step and the vehicle abnormal value less than the first threshold value are detected from the vehicle acceleration, and the occupant abnormal value of the occupant information synchronized with the vehicle abnormal value is detected, the occurrence of the vehicle abnormal value is dealt with. A computer operating as a vehicle recording control device is made to execute a recording control step for storing video data and occupant information of the period.

According to the present invention, there is an effect that information on an accident can be appropriately stored.

FIG. 1 is a block diagram showing a configuration example of a vehicle recording device having a vehicle recording control device according to the first embodiment. FIG. 2 is a block diagram showing a configuration example of the audio output device according to the first embodiment. FIG. 3 is a flowchart showing a processing flow in the vehicle recording control device according to the first embodiment. FIG. 4 is a diagram illustrating an example of vehicle acceleration. FIG. 5 is a diagram illustrating an example of occupant acceleration. FIG. 6 is a diagram illustrating another example of vehicle acceleration. FIG. 7 is a block diagram showing a configuration example of the detection device according to the second embodiment. FIG. 8 is a block diagram showing a configuration example of a vehicle recording device having the vehicle recording control device according to the third embodiment.

Hereinafter, embodiments of a vehicle recording control device, a vehicle recording device, a vehicle recording control method, and a program according to the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the following embodiments.

[First Embodiment]
<Vehicle recording device>
FIG. 1 is a block diagram showing a configuration example of a vehicle recording device 10 having a vehicle recording control device 100 according to the first embodiment. The vehicle recording device 10 is realized, for example, as a drive recorder function of a drive recorder, a navigation system, or a vehicle information system. The vehicle recording device 10 appropriately stores the occupant information applied to the neck or head of the occupant of the vehicle as the information regarding the accident. In the present embodiment, the vehicle recording device 10 acquires the occupant information of the occupant of the vehicle detected by the portable electronic device described later, which is worn by the occupant of the vehicle.

The vehicle recording device 10 may be a portable device that can be used in the vehicle, in addition to the device mounted on the vehicle. The vehicle recording device 10 includes a camera (shooting unit) 210, a recording unit 220, an operation unit 230, a display unit 240, a GPS (Global Positioning System) receiving unit 250, an acceleration sensor 260, and a communication unit 270. , And a vehicle record control device 100.

The camera 210 is a camera that photographs the periphery of the vehicle. The periphery of the vehicle preferably includes the rear of the vehicle, more preferably the front of the vehicle, and further preferably the entire circumference of the vehicle. In the present embodiment, the camera 210 will be described as a camera capable of photographing the entire sky of 360 °, but the present invention is not limited to this, and a plurality of camera groups may be used to photograph each direction. The camera 210 is arranged, for example, in front of the vehicle interior of the vehicle. The camera 210 constantly captures images from the start of the engine to the stop of the engine. The camera 210 outputs the captured video data to the video data acquisition unit 120 of the vehicle recording control device 100. The video data is, for example, a moving image composed of an image of 30 frames per second.

The recording unit 220 is used for temporary storage of data in the vehicle recording device 10. The recording unit 220 is, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a recording unit such as a memory card. Alternatively, it may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 220 records loop recording video data or event recording data based on the control signal output from the recording control unit 123 of the vehicle recording control device 100 of the vehicle recording device 10.

The operation unit 230 can accept various operations on the vehicle recording device 10. For example, the operation unit 230 can accept an operation of manually saving the captured video data in the recording unit 220. For example, the operation unit 230 can accept an operation of reproducing the loop recorded video data or the event recording data recorded in the recording unit 220. For example, the operation unit 230 can accept an operation of erasing the event record data recorded in the recording unit 220. For example, the operation unit 230 can accept an operation to end the loop recording. The operation unit 230 outputs the operation information to the operation control unit 125 of the vehicle record control device 100.

As an example, the display unit 240 is a display device unique to the vehicle recording device 10 or a display device shared with other systems including a navigation system. The display unit 240 may be formed integrally with the camera 210. The display unit 240 is a display including, for example, a liquid crystal display (LCD: Liquid Crystal Display) or an organic EL (Organic Electro-Luminence) display. In the present embodiment, the display unit 240 is arranged on a dashboard, an instrument panel, a center console, or the like in front of the driver of the vehicle. The display unit 240 displays an image based on the image signal output from the display control unit 126 of the vehicle recording control device 100. The display unit 240 displays the image captured by the camera 210 or the image recorded on the recording unit 220.

The GPS receiving unit 250 receives radio waves from positioning satellites such as GPS satellites (not shown). The GPS receiving unit 250 outputs the signal of the received radio wave to the position information acquisition unit 127 of the vehicle recording control device 100.

The acceleration sensor 260 is a sensor that detects the vehicle acceleration of the vehicle. In this embodiment, the acceleration sensor 260 detects the vehicle acceleration applied to the vehicle. The acceleration sensor 260 outputs the detection result to the acceleration information acquisition unit 131 of the information acquisition unit 130 of the vehicle record control device 100. The acceleration sensor 260 is, for example, a sensor that detects vehicle acceleration in three axial directions. The three-axis directions are the front-rear direction, the left-right direction, and the up-down direction of the vehicle.

The communication unit 270 is a communication unit. The communication unit 270 connects data to a voice output device 20 as an example of a portable electronic device so as to be communicable. The communication unit 270 is capable of short-range wireless communication and short-range electromagnetic induction including, for example, Bluetooth (registered trademark) or NFMI (Near Field Communication). In the present embodiment, the communication unit 270 can be paired with the audio output device 20 by Bluetooth connection. The communication method is not limited to these.

The vehicle recording control device 100 is, for example, an arithmetic processing device (control device) composed of a CPU (Central Processing Unit) or the like. The vehicle recording control device 100 loads the stored program into the memory and executes the instructions included in the program. The vehicle record control device 100 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the vehicle record control device 100 and the like. The vehicle recording control device 100 includes a video data acquisition unit 120, a buffer memory 121, a video data processing unit 122, a recording control unit 123, a reproduction control unit 124, and an operation control unit 125 connected to the bus 110. A display control unit 126, a position information acquisition unit 127, an information acquisition unit 130, an event detection unit 133, and a determination unit 134.

The video data acquisition unit 120 acquires video data obtained by photographing the periphery of the vehicle. More specifically, the video data acquisition unit 120 acquires the video data output by the camera 210.

The buffer memory 121 is a memory for temporarily recording the video data captured by the video data acquisition unit 120.

The video data processing unit 122 generates loop recorded video data by converting the video data recorded in the buffer memory 121 into a file of video for a predetermined period such as 60 seconds.

When the event detection unit 133 detects an event, the video data processing unit 122 generates video data including at least the time when the event occurs as the first event recording data from the loop recorded video data. It is preferable that the video data processing unit 122 generates video data including a predetermined period before and after the event occurrence time as the first event recording data. For example, the video data processing unit 122 generates video data obtained by cutting out a predetermined period before and after the event occurrence time as the first event recording data. Alternatively, for example, the video data processing unit 122 may generate video data in loop-recorded video data units including a predetermined time before and after the event occurrence time as the first event recording data.

Even if the event detection unit 133 determines that no event has occurred, the video data processing unit 122 determines from the loop recorded video data that a minor collision has occurred. Video data including the time when a minor collision occurs is generated as the second event recording data.

When it is not necessary to distinguish between the first event record data and the second event record data, it is called event record data.

The recording control unit 123 causes the recording unit 220 to record the loop recording video data generated by the video data processing unit 122. When the capacity of the recording unit 220 is full, the recording control unit 123 overwrites the oldest loop recorded video data and records new loop recorded video data.

Further, when the event detection unit 133 detects an event, the recording control unit 123 records and stores the video data including at least the time when the event occurs in the recording unit 220 as the first event recording data. More specifically, when the event detection unit 133 detects an event, the recording control unit 123 records and saves the first event recording data including the time when the event occurs, which is generated by the video data processing unit 122, in the recording unit 220. To do.

Further, even if the event detection unit 133 determines that an event has not occurred, the recording control unit 123 determines that a minor collision has occurred when the determination unit 134 determines that a minor collision has occurred. The video data of the corresponding period is saved as the second event record data together with the occupant information. More specifically, when the recording control unit 123 detects a vehicle abnormal value less than the first threshold value from the vehicle acceleration and further detects an occupant abnormal value of the occupant information synchronized with the vehicle abnormal value, the event detection unit 133 causes an event. Even if it is determined that the vehicle has not occurred, the second event record data for the period corresponding to the occurrence of the vehicle abnormal value and the occupant information are stored as referenceable information in association with each other on the time axis. The vehicle abnormal value and the occupant abnormal value will be described later.

A minor collision is a collision in which the damage to the vehicle is smaller than the collision detected as an event. However, a minor collision is one in which the neck of the occupant of the vehicle is strained and may be diagnosed with traumatic cervical syndrome, the so-called whiplash.

The corresponding period may be data of the same period as the second event recorded data, or may be a part of the period of the second event recorded data. It is preferable that the period includes before and after the time when the occupant abnormal value is detected. Any period may be sufficient as long as it can be confirmed that the detection of the vehicle abnormal value and the detection of the occupant abnormal value are related.

The recording control unit 123 may make it difficult for the second event recording data and the occupant information to be overwritten by lowering the overwriting priority than the first event recording data. For example, the recording control unit 123 stores the second event recording data and occupant information in a storage-only folder for which overwriting is prohibited, such as a "whiplash folder", in distinction from event detection and other folders. May be good.

The reproduction control unit 124 controls to reproduce the loop recorded video data or the event recording data recorded in the recording unit 220 based on the control signal of the reproduction operation output from the operation control unit 125.

The operation control unit 125 acquires the operation information of the operation received by the operation unit 230. For example, the operation control unit 125 acquires the save operation information indicating the manual save operation of the video data, the reproduction operation information indicating the reproduction operation, or the erase operation information indicating the erase operation of the video data, and outputs the control signal. For example, the operation control unit 125 acquires end operation information indicating an operation for ending loop recording and outputs a control signal.

The display control unit 126 controls the display of video data on the display unit 240. The display control unit 126 outputs a video signal for outputting the video data to the display unit 240. More specifically, the display control unit 126 outputs a video signal for displaying the video captured by the camera 210 or the video recorded by the recording unit 220.

The position information acquisition unit 127 calculates the current position information and the moving speed information of the vehicle by a known method based on the radio waves received by the GPS receiving unit 250.

The information acquisition unit 130 acquires vehicle acceleration information indicating the vehicle acceleration applied to the vehicle and occupant information indicating the state of the neck or head of the occupant of the vehicle. The information acquisition unit 130 may acquire the occupant acceleration applied to the neck or head of the occupant of the vehicle as occupant information. The information acquisition unit 130 may acquire the occupant acceleration from a portable electronic device worn on the neck or head of the occupant of the vehicle. The information acquisition unit 130 may acquire the occupant acceleration when the voice output device 20 which is a portable electronic device is operating. The information acquisition unit 130 may acquire the occupant acceleration corresponding to the horizontal direction as the occupant acceleration in the form when the voice output device 20 is operating. In the present embodiment, the information acquisition unit 130 includes an acceleration information acquisition unit 131 and a communication control unit 132.

When the audio output device 20 is operating, it means that the audio output device 20 is outputting audio, or that the vehicle recording device 10 and the audio output device 20 are connected by Bluetooth. ..

The acceleration information acquisition unit 131 acquires vehicle acceleration information added to the vehicle from the detection result of the acceleration sensor 260.

The communication control unit 132 controls communication via the communication unit 270. In the present embodiment, the communication control unit 132 receives the occupant information from the voice output device 20 via the communication unit 270.

The event detection unit 133 detects an event based on the detection result of the acceleration sensor 260. More specifically, the event detection unit 133 detects that an event has occurred in the vehicle because the vehicle acceleration acquired by the information acquisition unit 130 is a value equal to or higher than the first threshold value.

The first threshold value is larger than the vehicle acceleration generated by sudden braking operation or vibration during normal driving, and larger than the vehicle acceleration generated when sudden braking is applied. The first threshold is, for example, about 1G.

The determination unit 134 determines whether or not a minor collision has occurred that is not detected by a normal event detected as an acceleration equal to or higher than the first threshold value. More specifically, when the determination unit 134 detects a vehicle abnormal value less than the first threshold value and more than the second threshold value from the vehicle acceleration, and further detects an occupant abnormal value from the occupant information synchronized with the vehicle abnormal value, a slight collision occurs. Is determined to have occurred.

The vehicle abnormal value is a value of vehicle acceleration smaller than the first threshold value and equal to or higher than the second threshold value. The second threshold value is a vehicle acceleration that is larger than the vehicle acceleration generated by the braking operation during normal driving, smaller than the vehicle acceleration generated when sudden braking is applied, and is generated during a minor collision that is not detected by a normal event.

The occupant information synchronized with the vehicle abnormal value is the occupant information at the time when the vehicle abnormal value is detected or before and after the detected time.

The occupant abnormal value is a value of occupant acceleration equal to or higher than the third threshold value. The third threshold is larger than the occupant acceleration that occurs during normal driving and smaller than the occupant acceleration that occurs when sudden braking is applied. The third threshold is the occupant acceleration to some extent that the occupant may develop traumatic cervical syndrome, so-called whiplash.

When the determination unit 134 detects the vehicle abnormal value from the vehicle acceleration and detects the occupant abnormal value based on the occupant acceleration in the direction corresponding to the vehicle acceleration, it may determine that a minor collision has occurred. In other words, if the direction of vehicle acceleration and the direction of occupant acceleration do not match, the determination unit 134 may not determine that a minor collision has occurred. For example, the determination unit 134 detects a vehicle abnormal value from the vehicle acceleration, the direction of the vehicle acceleration is from the rear to the front, and detects the occupant abnormal value from the occupant acceleration, and the direction of the occupant acceleration is from the rear. If the direction is toward the front, it is judged that a minor collision has occurred. For example, the determination unit 134 detects a vehicle abnormal value from the vehicle acceleration, the direction of the vehicle acceleration is from the right side to the left side, and detects the occupant abnormal value from the occupant acceleration, and the direction of the occupant acceleration is If the direction is from the right side to the left side, it is judged that a minor collision has occurred.

<Audio output device>
FIG. 2 is a block diagram showing a configuration example of the audio output device 20 according to the first embodiment. A portable electronic device is a device brought into a vehicle by a vehicle occupant. A portable electronic device is a device that can be worn by a vehicle occupant. The portable electronic device is preferably worn on the neck or head of the occupant of the vehicle. The portable electronic device is, for example, a neck-mounted speaker that can be worn around the neck of an occupant, a wearable terminal device such as an eyeglass-type electronic device, or headphones. In the present embodiment, a neck-mounted speaker, which is an example of a portable electronic device, will be described as an audio output device 20.

The voice output device 20 includes a voice output unit 311, an acceleration sensor 312, a communication unit 313, and a voice output control device 300.

The audio output unit 311 is a speaker that outputs audio. The audio output unit 311 outputs audio based on the audio signal from the reproduction control unit 321 of the audio output control device 300. The audio output unit 311 may output audio of audio data stored in a storage unit (not shown) of the audio output device 20, for example, from another device such as a car audio system of a vehicle or a smartphone connected to Bluetooth. The voice of the acquired voice data may be output.

The acceleration sensor 312 is a sensor that detects the acceleration applied to the voice output device 20. When the voice output device 20 is attached to the neck or head of the occupant of the vehicle, the acceleration detected by the acceleration sensor 312 is the occupant acceleration applied to the neck or head of the occupant. The acceleration sensor 312 outputs the detection result to the acceleration information acquisition unit 323 of the voice output control device 300. The acceleration sensor 312 is, for example, a sensor that detects occupant acceleration in three axial directions. The three-axis directions are the front-back direction, the left-right direction, and the up-down direction of the occupant's neck or head when the voice output device 20 is attached to the occupant's neck or head.

The acceleration sensor 312 may detect the occupant acceleration when the voice output device 20 is operating. The acceleration sensor 312 may detect the occupant acceleration corresponding to the horizontal direction in the form when the voice output unit 311 is outputting the voice. When the audio output device 20 is operating or the audio output unit 311 is outputting audio, in most cases, the occupant of the vehicle is wearing the audio output device 20 on the neck or head. It depends on what it is.

The communication unit 313 is a communication unit. The communication unit 313 connects the vehicle recording device 10 and the data so as to be communicable. The communication unit 313 is capable of short-range wireless communication including Bluetooth or NFMI and short-range electromagnetic induction, for example. In the present embodiment, the communication unit 313 can be paired with the vehicle recording device 10 by Bluetooth connection. The communication method is not limited to these.

The audio output control device 300 is, for example, an arithmetic processing unit (control device) composed of a CPU or the like. The voice output control device 300 loads the stored program into the memory and executes the instructions included in the program. The voice output control device 300 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the voice output control device 300 and the like. The voice output control device 300 includes a reproduction control unit 321 connected to the bus 310, a buffer memory 322, an acceleration information acquisition unit 323, and a communication control unit 324.

The reproduction control unit 321 controls to output audio from the audio output unit 311. The reproduction control unit 321 controls to stop the output of the sound from the sound output unit 311. The reproduction control unit 321 controls the volume of the sound output from the sound output unit 311.

The buffer memory 322 temporarily stores the occupant acceleration information acquired by the acceleration information acquisition unit 323. The buffer memory 322 is a memory for temporarily recording audio data of audio output from the audio output unit 311.

The acceleration information acquisition unit 323 acquires acceleration information applied to the voice output device 20 from the detection result of the acceleration sensor 312. When the voice output device 20 is attached to the neck or head of the occupant of the vehicle, the acceleration acquired by the acceleration information acquisition unit 323 is the occupant acceleration information indicating the occupant acceleration applied to the neck or head of the occupant. Can be regarded as. The acceleration information acquisition unit 323 may acquire occupant acceleration information when the voice output unit 311 is operating. The acceleration information acquisition unit 323 may acquire the occupant acceleration corresponding to the horizontal direction as the occupant acceleration information in the form when the voice output unit 311 is operating.

The communication control unit 324 controls communication via the communication unit 313. More specifically, the communication control unit 324 transmits the stored occupant acceleration information as occupant information to the vehicle recording device 10 in a state where the voice output device 20 and the vehicle recording device 10 are connected via Bluetooth. Control. The occupant information to be transmitted is, for example, a period corresponding to a transmission request from the vehicle recording device 10.

<Processing in vehicle recording device>
Next, the flow of processing in the vehicle record control device 100 will be described with reference to FIG. FIG. 3 is an example of a flowchart showing a processing flow in the vehicle record control device 100 according to the first embodiment. While the vehicle recording device 10 is activated, the camera 210 photographs the surroundings of the vehicle. The vehicle recording device 10 acquires the video data captured by the camera 210 and records it in the buffer memory 121.

The vehicle recording control device 100 starts event detection and loop recording (step S101). More specifically, the event detection unit 133 detects an event based on the detection result of the acceleration sensor 260. The vehicle recording control device 100 generates loop recording video data for each video for a predetermined period from the video data recorded in the buffer memory 121 by the video data processing unit 122. The vehicle recording control device 100 causes the recording control unit 123 to record the loop recording video data in the recording unit 220. The vehicle record control device 100 proceeds to step S102.

The vehicle recording control device 100 determines whether or not the voice output device 20 is in operation (step S102). More specifically, the communication control unit 132 determines whether or not the voice output device 20 is operating depending on whether or not the vehicle recording device 10 and the voice output device 20 are connected by Bluetooth. When the Bluetooth connection is made, it is determined that the audio output device 20 is operating (Yes in step S102). If Yes in step S102, the vehicle recording control device 100 proceeds to step S103. If the Bluetooth connection is not established, it is determined that the audio output device 20 is not in operation (No in step S102). If No in step S102, the vehicle recording control device 100 proceeds to step S108.

The vehicle record control device 100 determines whether or not a vehicle abnormal value has occurred (step S103). More specifically, when the vehicle acceleration acquired by the acceleration information acquisition unit 131 is equal to or greater than the second threshold value, the determination unit 134 determines that a vehicle abnormality value has occurred (Yes in step S103). If Yes in step S103, the vehicle recording control device 100 proceeds to step S104. When the vehicle acceleration acquired by the acceleration information acquisition unit 131 is not equal to or higher than the second threshold value by the determination unit 134, it is determined that no vehicle abnormality value has occurred (No in step S103). If No in step S103, the vehicle recording control device 100 proceeds to step S111.

The vehicle record control device 100 acquires occupant information by the information acquisition unit 130 (step S104). More specifically, the information acquisition unit 130 acquires occupant acceleration information applied to the neck or head of the occupant of the vehicle as occupant information from the voice output device 20. In this case, the occupant information when the abnormal value is detected in step S103 is acquired. More specifically, the vehicle record control device 100 acquires occupant acceleration information time-synchronized with the vehicle abnormality value detected in step S103 as occupant information. As an example, the occupant acceleration information for 5 seconds after the vehicle abnormal value is detected in step S103, or the occupant acceleration information for 5 seconds before and after the time when the vehicle abnormal value is detected in step S103 is acquired as occupant information. .. The vehicle record control device 100 proceeds to step S105.

The vehicle recording control device 100 determines whether or not the vehicle acceleration detected in step S103 is equal to or greater than the first threshold value, which is an acceleration greater than the second threshold value (step S105). More specifically, when the vehicle acceleration detected in step S103 by the event detection unit 133 is equal to or greater than the first threshold value (Yes in step S105), the vehicle recording control device 100 proceeds to step S107. When the vehicle acceleration detected in step S103 by the event detection unit 133 is less than the first threshold value (No in step S105), the vehicle recording control device 100 proceeds to step S106.

The vehicle record control device 100 determines whether or not an abnormal occupant value has occurred (step S106). More specifically, when the occupant acceleration acquired by the information acquisition unit 130 is equal to or greater than the third threshold value, the determination unit 134 determines that an occupant abnormal value has occurred (Yes in step S106). If Yes in step S106, the vehicle recording control device 100 proceeds to step S107. When the occupant acceleration acquired by the information acquisition unit 130 is less than the third threshold value, the determination unit 134 determines that no occupant abnormal value has occurred (No in step S106). If No in step S106, the vehicle recording control device 100 proceeds to step S111.

The vehicle record control device 100 stores the video data of the period before and after including the time when the vehicle abnormal value is detected and the occupant acceleration information of the corresponding period as occupant information (step S107). More specifically, the video data processing unit 122 generates video data including at least the time when a vehicle abnormality value is detected from the loop recorded video data recorded in the recording unit 220 as the second event recording data. The recording control unit 123 generates occupant information for the period corresponding to the second event recording data. The recording control unit 123 associates the generated second event recording data with the occupant information, and records and stores the generated second event recording data in the recording unit 220.

As an example, as the second event record data, the video data 60 seconds before and after the time when the vehicle abnormal value is detected in step S103 and the occupant information for the same period as the second event record data are stored. If it can be determined that the occupant information stored in association with the second event recording data is the acceleration, which is the occupant abnormality value, added to the voice output device 20 due to the vehicle abnormality value detected in step S103, Second event record The period may be shorter or different than the period stored as recorded data. For example, the second event recording data stores video data 60 seconds before and after the time when the vehicle abnormal value is detected in step S103, and the occupant information is 30 before and after the time when the vehicle abnormal value is detected in step S103. You may save the seconds. The vehicle record control device 100 proceeds to step S111.

If No in step S102, the vehicle record control device 100 determines whether or not a vehicle abnormal value has occurred (step S108). More specifically, when the vehicle acceleration acquired by the acceleration information acquisition unit 131 is equal to or greater than the second threshold value, the determination unit 134 determines that a vehicle abnormality value has occurred (Yes in step S108). If Yes in step S108, the vehicle recording control device 100 proceeds to step S109. When the vehicle acceleration acquired by the acceleration information acquisition unit 131 is not equal to or higher than the second threshold value by the determination unit 134, it is determined that no vehicle abnormality value has occurred (No in step S108). If No in step S108, the vehicle recording control device 100 proceeds to step S111.

The vehicle recording control device 100 determines whether or not the vehicle acceleration detected in step S108 is equal to or greater than the first threshold value by the event detection unit 133 (step S109). More specifically, when the vehicle acceleration acquired by the acceleration information acquisition unit 131 by the event detection unit 133 is equal to or greater than the first threshold value (Yes in step S109), the vehicle recording control device 100 proceeds to step S110. When the vehicle acceleration acquired by the event detection unit 133 by the acceleration information acquisition unit 131 is less than the first threshold value (No in step S109), the vehicle record control device 100 proceeds to step S111.

The vehicle record control device 100 stores the video data of the period before and after including the time when the vehicle abnormal value is detected as the first event record data (step S110). More specifically, the video data processing unit 122 generates video data including at least the time when a vehicle abnormality value is detected from the loop recorded video data recorded in the recording unit 220 as the first event recording data. The recording control unit 123 records and stores the generated first event recording data in the recording unit 220. The vehicle record control device 100 proceeds to step S111.

The vehicle recording control device 100 determines whether or not to end the event detection and loop recording (step S111). More specifically, when the operation control unit 125 outputs the end operation information, the vehicle recording control device 100 determines that the event detection and the loop recording are ended (Yes in step S111), and ends the process. Alternatively, event detection and loop recording are completed by terminating the operation or use of the vehicle. The vehicle recording control device 100 determines that the event detection and loop recording will not be completed unless the operation control unit 125 outputs the end operation information (No in step S111), and executes the process of step S102 again. To do.

The first event record data and the second event record data to be stored will be described with reference to FIGS. 4 to 6. FIG. 4 is a diagram illustrating an example of vehicle acceleration. FIG. 5 is a diagram illustrating an example of occupant acceleration. FIG. 6 is a diagram illustrating another example of vehicle acceleration. For example, if No is determined in step S102 and Yes is determined in step S109, the voice output device 20 is not operating and the vehicle acceleration is equal to or higher than the first threshold value. In this case, as shown by an arrow in FIG. 4, the video data of the period before and after including the time when the vehicle abnormal value is detected is stored as the first event recording data. For example, if Yes is determined in step S102 and Yes is determined in step S105, the voice output device 20 is in operation and the vehicle acceleration is equal to or higher than the first threshold value. In this case, as shown by the arrow in FIG. 4, it corresponds to the first event recording data which is the video data of the period before and after including the time when the vehicle abnormal value is detected, as shown by the arrow in FIG. The occupant acceleration information for the period is stored as occupant information. For example, if Yes is determined in step S102, No is determined in step S105, and Yes is determined in step S106, the voice output device 20 is operating, the vehicle acceleration is equal to or higher than the second threshold position and the first threshold value. Less than, and the occupant acceleration is greater than or equal to the third threshold. In this case, as shown by the arrow in FIG. 6, it corresponds to the second vent recording data which is the video data of the period before and after including the time when the vehicle abnormal value is detected, as shown by the arrow in FIG. The occupant acceleration information for the period is stored as occupant information. When the acceleration sensor 260 is a sensor that detects the vehicle acceleration in the three axial directions, the vehicle acceleration shown in FIGS. 4 and 6 may be a value obtained by adding the accelerations in all directions or an absolute value. It may be the absolute value of the acceleration in the front-back direction. Further, when the acceleration sensor 312 is a sensor that detects the occupant acceleration in the three axial directions, the occupant acceleration shown in FIG. 5 may be a value obtained by adding the accelerations in all directions or an absolute value, but before and after the occupant. It may be the absolute value of the acceleration in the direction.

As described above, in the present embodiment, in the present embodiment, the voice output device 20 is operating, a vehicle abnormality value equal to or higher than the second threshold position and less than the first threshold is detected from the vehicle acceleration, and an occupant abnormality equal to or higher than the third threshold is detected from the occupant acceleration. When the value is detected, the occupant acceleration information for the corresponding period can be stored as the occupant information together with the second vent recording data. According to the present embodiment, even when a minor collision that is not detected as an event occurs, information on the accident can be appropriately stored. In the present embodiment, when the voice output device 20 is operating and the vehicle acceleration is equal to or higher than the first threshold value, the occupant acceleration information for the corresponding period can be stored as the occupant information together with the first event record data. In this way, according to the present embodiment, information on the accident can be appropriately stored.

In the present embodiment, the occupant acceleration information is stored as the occupant information together with the event record data. According to this embodiment, the relationship between the vehicle acceleration caused by the accident and the occupant acceleration can be shown as objective data. This embodiment can be useful for explaining the causal relationship between an accident and whiplash.

According to this embodiment, the acceleration of the occupant of the vehicle can be detected with high accuracy by a neck-mounted speaker or the like that can be attached to the neck of the occupant of the vehicle. In the present embodiment, as an example of the voice output device 20, a neck-mounted speaker worn by a vehicle driver or another passenger on the neck has been described. As another example, headphones worn on the head by an occupant other than the driver of the vehicle may be used.

[Second Embodiment]
The vehicle recording device 10 according to the present embodiment will be described with reference to FIG. 7. FIG. 7 is a block diagram showing a configuration example of the detection device 30 according to the second embodiment. The basic configuration of the vehicle recording device 10 is the same as that of the vehicle recording device 10 of the first embodiment. In the following description, the same components as those of the vehicle recording device 10 are designated by the same reference numerals or corresponding reference numerals, and detailed description thereof will be omitted. In the present embodiment, the pressure applied to the seat is detected as the occupant information instead of the occupant acceleration. If the occupant's neck or head moves to the extent of whiplash, the pressure exerted on the seat by the occupant's neck or head changes. When an event occurs, the vehicle recording device 10 stores pressure information applied to the seat by the neck or head of the occupant of the vehicle as occupant information as information on the accident.

<Detector>
The detection device 30 is mounted at a position where the pressure applied to the seat by the neck or head of the occupant seated in the seat of the vehicle can be detected. The detection device 30 is, for example, a device mounted on a headrest of a seat on which a vehicle occupant sits, an upper part of a backrest, or the like. The detection device 30 includes a pressure sensor 411, a communication unit 412, and a detection control device 400.

The pressure sensor 411 is a sensor that detects the pressure applied to the seat by the head of the occupant or the like. The pressure sensor 411 outputs the detection result to the pressure information acquisition unit 421 of the detection control device 400.

The communication unit 412 is a communication unit. The communication unit 412 connects the vehicle recording device 10 and the data so as to be communicable. The communication unit 412 is capable of short-range wireless communication including Bluetooth or NFMI and short-range electromagnetic induction, for example. In the present embodiment, the communication unit 412 can be connected to the vehicle recording device 10 by Bluetooth connection. The communication method is not limited to these.

The detection control device 400 is, for example, an arithmetic processing device (control device) composed of a CPU or the like. The detection control device 400 loads the stored program into the memory and executes the instruction included in the program. The detection control device 400 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the detection control device 400 and the like. The detection control device 400 has a pressure information acquisition unit 421 and a communication control unit 422 connected to the bus 410.

The pressure information acquisition unit 421 acquires pressure information indicating the pressure applied to the seat by the neck or head of the occupant from the detection result of the pressure sensor 411.

The communication control unit 422 controls communication via the communication unit 412. More specifically, the communication control unit 422 controls the detection device 30 and the vehicle recording device 10 to be transmitted to the vehicle recording device 10 as occupant information in a state where the detection device 30 and the vehicle recording device 10 are connected via Bluetooth.

<Vehicle record control device>
The information acquisition unit 130 acquires pressure information indicating the pressure applied to the detection device 30 that can detect the pressure applied by the occupant of the vehicle, which is mounted on the seat of the vehicle or around the seat, as occupant information. In the present embodiment, the information acquisition unit 130 acquires pressure information applied to the headrest of the vehicle seat as occupant information.

When the determination unit 134 detects a vehicle abnormal value less than the first threshold value and more than the second threshold value from the vehicle acceleration, and further detects a pressure abnormal value from the pressure information synchronized with the vehicle abnormal value, it is said that a minor collision has occurred. to decide.

The abnormal pressure value is a value of pressure equal to or higher than the fourth threshold value. The outlier pressure value is greater than the pressure normally generated. The fourth threshold is the pressure at which the occupant may develop traumatic cervical syndrome, whiplash.

When the determination unit 134 detects a vehicle abnormal value that is less than the first threshold value and is greater than or equal to the second threshold value from the vehicle acceleration, and further detects a tendency of abnormal changes in pressure information synchronized with the vehicle abnormal value, a minor collision occurs. You may judge that you have done so. The tendency of abnormal changes is the tendency of pressure changes due to cervical or head movements peculiar to whiplash. The movement of the head peculiar to whiplash is, for example, a movement in which the head moves forward so as to move away from the headrest, and then moves backward in reaction to hit the headrest. Such head movements tend to change abnormally when the pressure exerted on the seat decreases and then increases significantly.

As described above, the present embodiment stores the pressure applied to the seat by the neck or head of the occupant seated in the vehicle seat as occupant information together with the event record data, so that it is not detected as a normal event. Even in the case of a serious collision, the relationship between the vehicle acceleration caused by the accident and the occupant acceleration can be shown as objective data. According to the present embodiment, when an event occurs, pressure information applied to the seat by the neck or head of the occupant of the vehicle can be stored as occupant information as information on the accident.

[Third Embodiment]
The vehicle recording device 10A according to the present embodiment will be described with reference to FIG. FIG. 8 is a block diagram showing a configuration example of the vehicle recording device 10A having the vehicle recording control device 100A according to the third embodiment. The basic configuration of the vehicle recording device 10A is the same as that of the vehicle recording device 10 of the first embodiment. The vehicle recording device 10A is different from the first embodiment in that occupant information is detected from the image data of the occupants of the vehicle taken by the vehicle interior camera (vehicle interior photographing unit) 280A. The vehicle recording device 10A is different from the first embodiment in that it does not have the communication unit 270 and the communication control unit 132, and that it includes the vehicle interior camera 280A and the occupant recognition unit 135A.

<Vehicle recording device>
The vehicle interior camera 280A is a camera that photographs the vehicle interior of the vehicle. In the present embodiment, the vehicle interior camera 280A is arranged, for example, in the front or side of the vehicle interior of the vehicle, and photographs the occupants in the vehicle interior. The vehicle interior camera 280A constantly captures images from the start of the engine to the stop of the engine. The vehicle interior camera 280A outputs the captured video data to the video data acquisition unit 120 of the vehicle recording control device 100A. The video data is, for example, a moving image composed of an image of 30 frames per second.

The information acquisition unit 130 recognizes a change in the posture of the occupant's neck or head from the video data taken by the vehicle interior camera 280A that captures the occupant of the vehicle, and recognizes the change in the posture of the occupant's neck or head of the vehicle. The information indicating the state of is acquired as occupant information. The information acquisition unit 130 includes an acceleration information acquisition unit 131 and an occupant recognition unit 135A.

The occupant recognition unit 135A performs image processing on the video data captured by the vehicle interior camera 280A to recognize the occupant of the vehicle. The occupant recognition unit 135A recognizes a change in the position of the occupant's neck or head of the vehicle, and detects whether or not the movement of the occupant's neck or head is a movement that causes whiplash. .. The occupant recognition unit 135A may recognize a change in the position of the neck or head of the occupant of the vehicle and detect the occupant acceleration expected from the change in the position of the neck or head of the occupant of the vehicle. The occupant recognition unit 135A recognizes the change in the position of the neck or head of the occupant of the vehicle, refers to the machine-learned database, and detects whether or not the movement causes whiplash. May be good.

As described above, in the present embodiment, the vehicle occupant information can be acquired from the video data of the vehicle occupant. According to the present embodiment, even when the occupant of the vehicle is not using the voice output device 20, the occupant information of the occupant seated in the seat of the vehicle can be acquired by the vehicle recording device 10A.

Next, the display process when the event record data saved in each of the above-described embodiments is reproduced will be described. The reproduction of the event recording data includes not only the case where the event recording data is reproduced by the processing of the reproduction control unit 124 of the vehicle recording device 10 but also the case where the event recording data is reproduced by another terminal such as a smartphone or a personal computer.

When the event recording data including the occupant information is reproduced by the vehicle recording device 10 or the like, the occupant information at the time of reproduction is displayed in association with the reproduction and display of the video data saved as the event recording data. When the occupant information is the occupant acceleration, for example, the occupant acceleration corresponding to the time axis and its numerical value are displayed so as to be visible in the vicinity of the display range in which the event record data is displayed. Further, when the occupant information is information indicating the movement of the occupant's neck or head described as the third embodiment, for example, whiplash corresponding to the time axis is performed in the vicinity of the display range in which the event record data is displayed. Display the high probability of developing the disease so that it can be visually recognized.

Although the vehicle recording device 10 according to the present invention has been described so far, it may be implemented in various different forms other than the above-described embodiment.

Each component of the vehicle recording device 10 shown is functionally conceptual and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of each device is not limited to the one shown in the figure, and all or part of each device is functionally or physically dispersed or integrated in an arbitrary unit according to the processing load and usage status of each device. You may.

The configuration of the vehicle recording device 10 is realized, for example, by a program loaded in a memory as software. In the above embodiment, it has been described as a functional block realized by linking these hardware or software. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

The above-mentioned components include those that can be easily assumed by those skilled in the art and those that are substantially the same. Further, the above configurations can be combined as appropriate. Further, various omissions, substitutions or changes of the configuration can be made without departing from the gist of the present invention.

In the above, when the occupant information is saved together with the event record data, the portable electronic device possessed by the occupant of the vehicle such as a smartphone or the electronic such as a personal computer connected so that the data can be transmitted from the vehicle recording device 10. Event recording data and occupant information may be transferred to the device. When the occupant information is stored together with the event record data, the event record data and the occupant information may be transferred to the management device of the insurance company connected so that the data can be transmitted from the vehicle recording device 10.

In the above, when the occupant information is saved together with the event record data, the event record data in which the occupant information is saved may be displayed more conspicuously than other video data when the saved event record data is displayed as a thumbnail. .. The event record data in which the occupant information is stored displays, for example, a thumbnail image in which characters, numbers, symbols, icons, graphs, etc. are superimposed, or characters, numbers, symbols, icons, graphs, etc. instead of the thumbnail image. You may.

10 Vehicle recording device 20 Audio output device (portable electronic device)
100 Vehicle record control device 120 Video data acquisition unit 122 Video data processing unit 123 Recording control unit 124 Playback control unit 125 Operation control unit 126 Display control unit 127 Position information acquisition unit 130 Information acquisition unit 131 Acceleration information acquisition unit 132 Communication control unit 133 Event detection unit 134 Judgment unit 210 Camera (shooting unit)
220 Recording unit 230 Operation unit 240 Display unit 250 GPS receiving unit 260 Accelerometer 270 Communication unit 300 Voice output control device 311 Voice output unit 312 Accelerometer 313 Communication unit 321 Playback control unit 323 Accelerometer information acquisition unit 324 Communication control unit

Claims (10)

The video data acquisition unit that acquires the video data taken by the shooting unit that shoots the surroundings of the vehicle,
An information acquisition unit that acquires vehicle acceleration information indicating the vehicle acceleration applied to the vehicle and occupant information indicating the state of the neck or head of the occupant of the vehicle.
An event detection unit that detects that an event has occurred in the vehicle because the vehicle acceleration acquired by the information acquisition unit is a value equal to or higher than the first threshold value.
When a vehicle abnormal value less than the first threshold value is detected from the vehicle acceleration and a occupant abnormal value of the occupant information synchronized with the vehicle abnormal value is detected, video data of a period corresponding to the occurrence of the vehicle abnormal value and video data A record control unit that stores occupant information and
A vehicle record control device. The information acquisition unit acquires the occupant acceleration applied to the neck or head of the occupant of the vehicle as the occupant information.
The vehicle record control device according to claim 1. The information acquisition unit acquires the occupant acceleration from a portable electronic device worn on the neck or head of the occupant of the vehicle.
The vehicle record control device according to claim 2. The information acquisition unit acquires the occupant acceleration when the portable electronic device is operating.
The vehicle record control device according to claim 3. The information acquisition unit acquires the acceleration corresponding to the horizontal direction as the occupant acceleration in the form when the portable electronic device is operating.
The vehicle record control device according to claim 4. The information acquisition unit uses the pressure applied to the detection device, which is mounted on the seat of the vehicle or around the seat and capable of detecting the pressure applied to the neck or the head of the occupant of the vehicle, as the occupant information. get,
The vehicle record control device according to claim 1. The information acquisition unit recognizes a change in the posture of the occupant's neck or head of the vehicle from the video data taken by the vehicle interior photographing unit that photographs the occupant of the vehicle, and recognizes the change in the posture of the occupant of the vehicle. Alternatively, information indicating the state of the head is acquired as the occupant information.
The vehicle record control device according to claim 1. The recording control unit stores the video data and the occupant information as referenceable information in association with each other on the time axis.
The vehicle record control device according to any one of claims 1 to 7. The video data acquisition step to acquire the video data taken by the shooting unit that shoots the surroundings of the vehicle,
An information acquisition step for acquiring vehicle acceleration information indicating the vehicle acceleration applied to the vehicle and occupant information indicating the state of the neck or head of the occupant of the vehicle, and
An event detection step that detects that an event has occurred in the vehicle because the vehicle acceleration acquired by the information acquisition step is a value equal to or higher than the first threshold value.
When a vehicle abnormal value less than the first threshold value is detected from the vehicle acceleration and a occupant abnormal value of the occupant information synchronized with the vehicle abnormal value is detected, video data of a period corresponding to the occurrence of the vehicle abnormal value and video data A record control step to store occupant information and
The vehicle record control method executed by the vehicle record control device. The video data acquisition step to acquire the video data taken by the shooting unit that shoots the surroundings of the vehicle,
An information acquisition step for acquiring vehicle acceleration information indicating the vehicle acceleration applied to the vehicle and occupant information indicating the state of the neck or head of the occupant of the vehicle, and
An event detection step that detects that an event has occurred in the vehicle because the vehicle acceleration acquired by the information acquisition step is a value equal to or higher than the first threshold value.
When a vehicle abnormal value less than the first threshold value is detected from the vehicle acceleration, and further, when a occupant abnormal value of the occupant information synchronized with the vehicle abnormal value is detected, video data of a period corresponding to the occurrence of the vehicle abnormal value and video data A record control step to store occupant information and
Is a program to be executed by a computer that operates as a vehicle record control device.

Images