JP6818103B2 - In-vehicle device and server device - Google Patents

Description

The present invention relates to a technique for processing a moving image recorded by a moving body.

Conventionally, there has been known a drive recorder that photographs the state of the front of a vehicle and cyclically records the image data obtained by photographing in a memory (for example, Patent Document 1). The drive recorder prohibits overwriting and recording of video data before and after the occurrence of a large acceleration due to sudden braking or the like, and uses the video for later verification (for example, Patent Document 2).

Further, in order to secure a cyclic recording area for video data, the recording area for which overwrite recording is prohibited is limited to a certain range. Therefore, even if the video data is prohibited from being overwritten, it is further overwritten by the video data when a larger acceleration occurs.

Japanese Unexamined Patent Publication No. 2013-182573 Japanese Unexamined Patent Publication No. 2012-048606

However, for example, in some traffic accidents caused by vehicles, the acceleration generated is not large because the driver did not apply the brake suddenly. Since the video data in such a case is overwritten with the video data when a larger acceleration occurs, even the video data recording the moment of a traffic accident or the like cannot be used for subsequent verification, which causes a problem. ..

Further, in another example, even if the generated acceleration is large, it may not be video data that contributes to verification at all due to improper mounting of the camera or the like. If the video data in such a case is overwritten, unnecessary data occupies a limited recording area, which causes a problem.

An object of the present invention is to provide a technique for appropriately recording video data.

In order to solve the above problems, the in-vehicle device according to the present invention receives a recording means for cyclically recording video data, a transmission means for transmitting vehicle status data to an external device, and an instruction from the external device. The receiving means is provided, and the control means for storing at least a part of the video data of the recording means as overwrite prohibition based on the instruction for prohibiting overwriting received from the external device.

Further, the server device according to the present invention receives vehicle status data from an in-vehicle device that cyclically records video data in a recording means, analyzes the status data, and based on the results of the analysis means, said the server device. A transmission means for transmitting an instruction prohibiting overwriting of at least a part of the video data recorded in the recording means to the in-vehicle device is provided.

Further, the server device according to the present invention includes a receiving means for receiving vehicle status data from an in-vehicle device that cyclically records video data in a recording means, an input means for receiving input from an operator, and the input means. When there is an input, the vehicle-mounted device includes a transmission means for transmitting an instruction prohibiting overwriting of at least a part of the video data recorded in the recording means.

According to the present invention, it is possible to reliably prohibit overwriting of video data for which overwriting recording should be prohibited.

FIG. 1 shows an outline of a data recording system. FIG. 2 shows the configuration of the drive recorder. FIG. 3 shows the configuration of the server device. FIG. 4 shows the arrangement structure of the moving image file in the recording unit. FIG. 5 shows an example of a status file. FIG. 6 shows an example of an overwrite prohibition list. FIG. 7 shows a processing process of the drive recorder. FIG. 8 shows a processing process of the drive recorder. FIG. 9 shows a processing process of the drive recorder. FIG. 10 shows a processing process of the server device. FIG. 11 shows a modified example of the data recording system.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<1. First Embodiment><1-1.Overview>
FIG. 1 shows an outline of the data recording system 1. The data recording system 1 includes a drive recorder 3 provided in the vehicle 2 and a server device 4 installed outside the vehicle 2.

The vehicle 2 includes a camera 22 for photographing the front of the vehicle 2 and an acceleration sensor 23 for detecting the acceleration generated in the vehicle 2. The camera 22 and the acceleration sensor 23 are connected to the drive recorder 3.

The drive recorder 3 records a moving image file taken by the camera 22 in the memory at any time while the start switch (for example, accessory switch; ACC) of the vehicle 2 is turned on. A moving image of about 10 seconds is input to one file. When a moving image file is recorded in all the recording areas of the memory, the latest moving image file is overwritten on the oldest recorded moving image file and recorded.

When a sudden brake is applied or a collision occurs in the vehicle 2 and a large acceleration (so-called "event") occurs, the occurrence of such acceleration (so-called "trigger") triggers the occurrence of such acceleration for several tens of seconds before and after the occurrence of the acceleration. Save the video file that was shot over the above with overwrite protection. This is to verify the cause of acceleration later.

However, the memory capacity for recording a moving image file that should be overwritten is limited to a certain capacity. This is to prevent all of the memory capacity from being recorded as an overwrite-protected video file.

Therefore, it is necessary to prohibit overwriting only the video files that should be truly overwritten. Therefore, it is desirable to verify the contents of the moving image without simply making the occurrence of acceleration a factor that prohibits overwriting. In other words, even if a large acceleration occurs, if the saved video does not capture the state to be verified, there is no need to prohibit overwriting, and a limited memory capacity is consumed by a useless video file. Become. On the other hand, even if a small acceleration is generated, a video that captures the moment of the collision accident is extremely important for later verification.

The drive recorder 3 of the present embodiment, triggered by the generation of an acceleration of a certain magnitude, transmits the moving image files obtained by shooting before and after the generation of the acceleration to the server device 4 via the network. At this time, in addition to the moving image file, the drive recorder 3 inputs data on the situation generated in the vehicle 2 such as acceleration into the situation file and transmits the data. The server device 4 analyzes the moving image transmitted from the drive recorder 3 and determines whether or not the moving image includes the image capturing the moment such as a collision accident, that is, whether or not the moving image should be truly overwrite-prohibited. Then, when it is determined that overwrite prohibition should be performed, an overwrite prohibition command is transmitted to the drive recorder 3.

When the drive recorder 3 receives the overwrite prohibition command, the drive recorder 3 prohibits overwriting of the corresponding moving image file and saves the file. As a result, only video files that should be truly overwrite-protected can be overwrite-protected. Further, by executing the moving image analysis that requires a large amount of calculation on the server device 4 which is a large-scale arithmetic unit, it is possible to quickly and surely determine the necessity of overwriting prohibition. The processing power of the arithmetic unit mounted on the drive recorder 3 is generally not high, and the moving image analysis cannot be executed quickly. Therefore, it is desirable that the server device 4, which is a large-scale arithmetic unit, performs image recognition of the moving image acquired by the drive recorder 3. Hereinafter, the acceleration generated in the vehicle 2 may be referred to as a “G value”.

<1-2. Configuration>
FIG. 2 is a block diagram showing the configuration of the drive recorder 3. The drive recorder 3 is mounted on the vehicle 2 included in the data recording system 1 and includes a control unit 31 and a storage unit 32. Further, in the vehicle 2 in which the drive recorder 3 is installed, a communication unit 21, a camera 22, an acceleration sensor 23, a vehicle speed sensor 24, and a position detection unit 25 are installed and connected to the drive recorder 3, respectively.

The control unit 31 is a microcomputer provided with a CPU, RAM, and ROM. The control unit 31 controls the entire drive recorder 3. Each function of the control unit 31 will be described later.

The storage unit 32 is a storage medium (or recording medium) for storing (or recording) data. For example, it is a non-volatile memory such as an EEPROM (Electrical Erasable Programmable Read-Only memory), a flash memory, or a hard disk drive equipped with a magnetic disk. The storage unit 32 stores the moving image file 32a, the overwrite prohibition list 32b, and the program 32c.

The moving image file 32a is, for example, DAT (Digital Audio Tape) type moving image data based on a plurality of still image data taken by the camera 22 at a predetermined cycle. A plurality of files are recorded in the storage unit 32 of the moving image file 32a. For example, 3000 files. For one file, moving image data taken in 10 seconds is input. The arrangement structure of the moving image file 32a in the storage unit 32 will be described in detail later. The moving image file 32a includes audio data in addition to the moving image data, and includes a signal for synchronizing the moving image data and the audio data. Further, the moving image file 32a functions as video data in the present invention. When the video data in the present invention is a single or a plurality of still image data, it is preferable to use the still image data in the vicinity where the G value is most increased or decreased. This is because it is considered that the characteristics of the event that occurred in the vehicle 2 are most clearly captured.

The overwrite prohibition list 32b is a matrix-like data table including the address where the moving image file for which overwrite is prohibited is recorded, the type of overwrite prohibition (absolute prohibition or normal prohibition), and the G value generated during shooting. By referring to the overwrite prohibition list 32b, the address where the moving image file is recorded, the type of overwrite prohibition, and the magnitude of the G value generated during shooting can be recognized. The configuration of the overwrite prohibition list 32b will be described in detail later.

The program 32c is firmware that is read by the control unit 31 and executed by the control unit 31 to control the drive recorder 3. The program 32c is input / output to / from the drive recorder 3 via a storage medium such as a memory card or connected to an external device via a line. The program 32c may be stored in advance in the RAM provided in the control unit 31 described above.

Next, each function provided in the above-mentioned control unit 31 will be described. The control unit 31 includes a data acquisition unit 31a, a data recording unit 31b, an event detection unit 31c, a data transmission unit 31d, a determination reception unit 31e, and an overwrite prohibition unit 31f. The functions exhibited by each unit are realized by the control unit 31 executing the program 32c.

The data acquisition unit 31a acquires still image data from the camera 22 and generates a moving image file. Further, the data acquisition unit 31a acquires acceleration data from the acceleration sensor 23, vehicle speed data from the vehicle speed sensor 24, position data from the position detection unit 25, and the address of the moving image file from the storage unit 32, and obtains a status file including the moving image file. Generate. Therefore, the status file includes at least one or more of acceleration, vehicle speed, position, address, and moving image file. The data acquisition unit 31a functions as an acquisition means in the present invention. Further, in the present invention, the situation file functions as situation data indicating the situation at the time of occurrence of the event and / or before and after the occurrence of the event.

The data recording unit 31b records the moving image file generated by the data acquisition unit 31a at an address of the storage unit 32 that is not write-protected. The data recording unit 31b functions as a recording means in the present invention.

The event detection unit 31c calculates the G value generated in the vehicle 2 based on the acceleration data transmitted from the acceleration sensor 23. Then, the G value is compared with a predetermined threshold value to detect whether or not an event that should prohibit overwriting of the moving image file has occurred. That is, when the generated G value exceeds the threshold value, it is determined that an event has occurred. The event may be any event that occurs in the vehicle 2, such as the generation of a G value exceeding a certain size, the generation of an impact, the sudden decrease in speed, the deployment of an airbag, the approach of an object, and the like. .. The event detection unit 31c functions as an event detection means in the present invention.

The data transmission unit 31d transmits the status file generated by the data acquisition unit 31a to the server device 4 via the communication unit 21. The status file to be transmitted is a status file containing data generated in the vehicle 2 at the time and / or before and after the event occurs. By transmitting the data at the time of occurrence of the event and / or before and after the occurrence in the situation file, the situation occurring in the vehicle 2 can be examined in more detail. The data transmission unit 31d functions as a transmission means in the present invention.

The determination receiving unit 31e receives the signal transmitted from the server device 4 to the drive recorder 3. In particular, it receives an overwrite prohibition command, which is a determination result of whether or not overwriting of a specific video file should be prohibited. The determination receiving unit 31e functions as a receiving means in the present invention.

The overwrite prohibition unit 31f prohibits overwrite recording of the moving image file generated at the time and / or before and after the occurrence of the event. The overwrite prohibition unit 31f executes overwrite prohibition by operating a flag on the recording area of the storage unit 32. That is, overwriting of the moving image file recorded at the corresponding address is prohibited by turning on the overwrite prohibition flag, while overwriting is canceled by turning off the overwrite prohibition flag. Further, the overwrite prohibition unit 31f absolutely prohibits overwriting of the moving image file specified by the overwrite prohibition command based on the overwrite prohibition command received by the determination receiving unit 31e. Absolute prohibition of overwriting is set by updating the corresponding part of the overwrite prohibition list. If overwriting of the moving image file is absolutely prohibited, the moving image file generated when a larger G value is generated later will not be overwritten. This is because, as a result of analyzing the contents of the video, overwriting is prohibited, which is extremely important for later verification. The overwrite prohibition unit 31f functions as a prohibition means in the present invention.

Next, each configuration installed in the vehicle 2 will be described. The communication unit 21 is a communication device that transmits / receives data to / from the server device 4 via a network. For example, it is a wireless communication device using WiMAX (Worldwide Interoperability for Microwave Access), LTE (Long Term Evolution), or the like.

The camera 22 is arranged in the vehicle interior with the optical axis facing the front of the vehicle 2. The camera 22 is activated in conjunction with the start switch (for example, accessory switch; ACC) of the vehicle 2 to continuously photograph the state in front of the vehicle 2. The plurality of still image data obtained by shooting with the camera 22 are transmitted to the drive recorder 3. The drive recorder 3 generates a moving image file based on a plurality of still image data transmitted from the camera 22.

The acceleration sensor 23 is a three-axis acceleration sensor that measures the acceleration generated in the front-rear, left-right, and up-down directions of the vehicle 2. When the acceleration sensor 23 measures the acceleration generated in the vehicle 2, the acceleration sensor 23 transmits the acceleration data to the drive recorder 3.

The vehicle speed sensor 24 is a sensor that acquires the speed of the vehicle 2. When the vehicle speed sensor 24 acquires the speed of the vehicle 2, the vehicle speed sensor 24 transmits the speed data to the drive recorder 3.

The position detection unit 25 is a device that detects the current position of the vehicle 2 by using a satellite positioning system such as GPS. When the position detection unit 25 detects the current position of the vehicle 2, the position detection unit 25 transmits the position data to the drive recorder 3.

Next, the configuration of the server device 4 will be described. FIG. 3 is a block diagram showing the configuration of the server device 4. The server device 4 is a large-scale arithmetic unit installed outside the vehicle 2 and connected to the drive recorder 3 via a network. The server device 4 includes a control unit 41, a storage unit 42, and a communication unit 43. The server device 4 functions as an external device in the present invention.

The control unit 41 is a computer including a CPU, RAM, and ROM. The control unit 41 preferably includes a plurality of high-performance CPUs and the like. This is because it is desired that the server device 4 executes a large-scale operation at high speed. The control unit 41 includes a data reception unit 41a, a video analysis unit 41b, a data analysis unit 41c, a determination unit 41d, and a command transmission unit 41e. The functions exhibited by each unit are realized by the control unit 41 executing the program 42a.

The data receiving unit 41a receives the status file transmitted from the drive recorder 3 via the communication unit 43.

The video analysis unit 41b analyzes what kind of video is included in the video file input to the status file. In particular, the presence or absence of a video showing a traffic accident or the like for the vehicle 2 is analyzed. This is because if the vehicle 2 causes an accident or is involved in an accident, the moving image file should be saved as overwrite-protected. The image analysis unit 41b analyzes the moving image file by using, for example, a known pattern matching method. That is, a pattern image related to a traffic accident such as a vehicle rollover, a person's fall, a windshield or a vehicle body is damaged in advance, and when the video file and the pattern image match, the video file indicates a traffic accident or the like. Judge that the image is included.

Such image analysis has an extremely large processing load, and is preferably executed by a large-scale arithmetic processing unit such as a server device. This is because the analysis can be executed quickly. The arithmetic processing unit included in the in-vehicle drive recorder generally does not have the processing ability to rapidly perform such image processing. Therefore, by transmitting the moving image file from the drive recorder to the server device and performing image analysis on the server device, the analysis can be performed quickly and reliably. Then, the drive recorder can quickly perform a process of prohibiting overwriting of such a moving image file.

The data analysis unit 41c analyzes what kind of event has occurred in the vehicle 2 based on the sensor data input to the status file. As described above, the sensor data is the G value, the vehicle speed, and the position data of the vehicle 2. The data analysis unit 41c analyzes whether the G value and the vehicle speed suddenly increase or decrease, whether the vehicle 2 is located in a traffic accident-prone area, an intersection, or other location where an accident is likely to occur.

The determination unit 41d determines whether or not overwriting of the transmitted moving image file should be absolutely prohibited based on the degree of matching between the moving image file and the pattern image, the size of the sensor data value, and the like.

The command transmission unit 41e is a command to the effect that when the determination unit 41d determines that the overwriting of the moving image file should be absolutely prohibited, the drive recorder 3 should absolutely prohibit the overwriting of the corresponding moving image file ( An overwrite prohibition command) is generated and sent to the drive recorder 3. The command includes the name of the corresponding moving image file and the address in the storage unit 32. By referring to both the file name and the address in the drive recorder 3, erroneous operation is prevented. That is, if the corresponding video file is overwritten after the status file is transmitted to the server device 4 and before the drive recorder 3 receives the overwrite prohibition command, if only the address is received, the overwritten and recorded video file is overwritten. This is because (a video file that is not originally prohibited from being overwritten) is absolutely prohibited from being overwritten, which causes inconvenience.

The storage unit 42 is a storage medium (or recording medium) for storing (or recording) data. For example, it is a non-volatile memory such as an EEPROM (Electrical Erasable Programmable Read-Only memory), a flash memory, or a hard disk drive equipped with a magnetic disk. The storage unit 42 stores the program 42a and the map data 42b.

The program 42a is firmware that is read by the control unit 41 and executed by the control unit 41 to control the server device 4. The program 42a also includes software for image processing.

The map data 42b is geographical data relating to the positions and names of roads such as intersections, sites such as parks, and buildings such as buildings, which are specified by latitude and longitude. The map data 42b includes data such as accident-prone points.

The communication unit 43 is a communication device that transmits / receives data to / from the drive recorder 3 via the network. For example, it is a wireless communication device using WiMAX (Worldwide Interoperability for Microwave Access), LTE (Long Term Evolution), or the like.

<1-3. Video files and status files>
Next, the arrangement structure of the moving image file will be described. FIG. 4 shows an example of the arrangement structure of the moving image file 32a in the storage unit 32. The recording area of the storage unit 32 for recording the moving image file 32a includes a plurality of records 32aL. The total number of records 32aL is, for example, 3000. Each record 32aL includes a data area of an address AD, a moving image file FA, and an overwrite prohibition flag FL.

The address AD is an identifier indicating the position of the recording area of the storage unit 32 for recording the moving image file. For example, it is indicated by numerical values such as "0001" and "0002".

One moving image file 32a is recorded in one record 32aL. The moving image file 32a is recorded with the generated date and time as a file name.

The overwrite prohibition flag FL is an identifier that holds an ON or OFF value. When the overwrite prohibition flag FL is turned ON, overwriting of the moving image file 32a located in the same record 32aL is prohibited. When the overwrite prohibition flag FL is turned off, the moving image file 32a located in the same record 32aL is allowed to be overwritten. Since the overwrite prohibition flag FL indicates only ON or OFF, even when the overwrite prohibition flag FL is turned ON, it cannot be determined whether or not the overwrite prohibition flag is absolute. Whether or not the moving image file 32a in which the overwrite prohibition flag FL is turned ON is absolutely overwrite-prohibited is identified by the overwrite-prohibition list 32b (particularly, "overwrite prohibition type") described later.

Next, the status file will be described. FIG. 5 shows an example of the status file JF. The status file JF is a data set including a moving image file 32a and the like. The status file JF is transmitted to the server device 4 and serves as a determination factor as to whether or not overwriting of the moving image file is absolutely prohibited.

The status file JF includes an address AD indicating the position of the recording area of the storage unit 32, three time-consecutive moving image files 32a, a G value GD determined to exceed the threshold Th, and a G value GD within a predetermined period before and after that. , A plurality of vehicle speed SKs within the recording time of the moving image file 32a, and latitude and longitude HT indicating the position of the vehicle 2 at the time when the G value is determined to exceed the threshold Th. These data are transmitted to the server device 4 and referred to, and serve as a determination factor as to whether or not overwriting of the moving image file is absolutely prohibited. At least one G value GD, vehicle speed SK, and longitude HT may be included in the status file JF.

<1-4. Overwrite prohibited list>
Next, the overwrite prohibition list 32b will be described. FIG. 6 shows an example of the overwrite prohibition list 32b. The overwrite prohibition list 32b is a data table including a plurality of records 32bL. The total number of records 32bL is, for example, 100. Each record 32bL includes a data area of an address AD, an overwrite prohibition type PD, and a G value GD.

The address AD is an identifier indicating the position of the recording area of the storage unit 32 for recording the moving image file. For example, it is indicated by numerical values such as "0001" and "0002".

The overwrite prohibition type PD indicates a recording method for overwriting a moving image file recorded in the address AD of the storage unit 32. There are two types of recording methods for overwriting, "absolute prohibition" and "normal prohibition". Absolute prohibition of overwriting is a recording format in which even if a moving image file in which a larger acceleration is generated is generated later, the moving image file does not overwrite the image. Further, the normal prohibition of overwriting is a recording format in which a moving image file generated by cyclically constantly recording to the storage unit 32 is not overwritten, but is overwritten for a moving image file in which a state in which a larger acceleration is generated is overwritten. Is. The number of record group ARs for which the overwrite prohibition type PD is absolutely prohibited is, for example, 10. However, it may be variable within the range of the total number of records 32bL. The number of record group ORs for which the overwrite prohibition type PD is normally prohibited is, for example, 90.

The G value GD is a value of the acceleration generated in the vehicle 2 detected by the acceleration sensor 23.

<1-5. Process>
Next, the processing process executed by the drive recorder 3 will be described. 7, 8 and 9 are flowcharts showing the processing steps executed by the drive recorder 3. The processing step is repeatedly executed at a predetermined cycle.

FIG. 7 is a flowchart showing a main processing process executed by the drive recorder 3. First, the data acquisition unit 31a acquires a plurality of still image data from the camera 22 and generates a moving image file (step S101).

Next, the data acquisition unit 31a acquires acceleration data from the acceleration sensor 23, vehicle speed data from the vehicle speed sensor 24, position data from the position detection unit 25, and an address to record a moving image file from the storage unit 32. Then, a status file including at least one or more of acceleration data, vehicle speed data, and position data, an address, and a moving image file is generated (step S102).

When the data acquisition unit 31a generates the status file, the data recording unit 31b refers to the address of the storage unit 32 for recording the moving image file generated by the data acquisition unit 31a, and determines whether or not the overwrite prohibition flag is ON ( Step S103).

When the data recording unit 31b determines that the overwrite prohibition flag of the referenced address is ON (Yes in step S103), it refers to the next address (step S104) and determines again whether or not the overwrite prohibition flag is ON (Yes). Step S103). For example, if the first referenced address is 0001, then 0002 is referenced as the next address. The data recording unit 31b repeatedly executes steps S103 and S104 until the overwrite prohibition flag is not ON, that is, it refers to an address that is OFF.

On the other hand, when the data recording unit 31b determines that the overwrite prohibition flag of the referenced address is not ON (No in step S103), the data recording unit 31b overwrites the video file generated by the data acquisition unit 31a with the already recorded video file and records it. (Step S105).

Next, the event detection unit 31c determines whether or not the G value generated in the vehicle 2 exceeds the threshold value Th based on the acceleration data transmitted from the acceleration sensor 23 (step S106). That is, the event detection unit 31c determines whether or not an event has occurred that should prohibit overwriting (normally prohibit) the moving image file. The threshold Th is, for example, 0.8 [G].

When the event detection unit 31c determines that the G value does not exceed the threshold value Th (No in step S106), the process ends. This is because, as long as the G value does not exceed the threshold Th and no event has occurred, it is not necessary to execute the overwrite prohibition process.

On the other hand, when the event detection unit 31c determines that the G value exceeds the threshold Th (Yes in step S106), the data transmission unit 31d transmits the status file generated by the data acquisition unit 31a to the server device 4 (Yes). Step S107). At this time, in addition to the moving image file including the moment when the G value exceeds the threshold Th, the situation file includes the moving image files generated before and after that time. That is, three moving image files are input to the status file. Thereby, it is possible to analyze in detail including before and after the moment when the G value exceeds the threshold value Th.

When the data transmission unit 31d transmits the status file to the server device 4, the G occurrence flag processing is executed (step S108). The G generation flag processing is a processing for prohibiting overwriting of the target moving image file when the G value exceeds the threshold value Th. The details of the flag processing when G occurs will be described later.

When the G occurrence flag processing is executed, the determination receiving unit 31e determines whether or not the overwrite prohibition command has been received from the server device 4 (step S109).

When it is determined that the determination receiving unit 31e has not received the overwrite prohibition command from the server device 4 (No in step S109), the process ends.

On the other hand, if it is determined that the determination receiving unit 31e has received the overwrite prohibition command from the server device 4 (Yes in step S109), the command reception flag processing is executed (step S110). The command reception flag processing is a process that absolutely prohibits overwriting of the target moving image file when an overwrite prohibition command is received from the server device 4. The details of the flag processing at the time of command reception will be described later. When the command reception flag processing is executed, the processing ends.

Next, the details of the G occurrence flag processing in step S108 will be described. FIG. 8 is a flowchart showing a processing process of the G generation flag processing.

When the G occurrence flag processing is started, the overwrite prohibition unit 31f refers to the overwrite prohibition flag FL of the storage unit 32 and determines whether or not the number of ONs of the overwrite prohibition flag is less than the upper limit value (step S108a). .. The upper limit is, for example, 100.

When the overwrite prohibition unit 31f determines that the number of ONs of the overwrite prohibition flag is less than the upper limit value (Yes in step S108a), the overwrite prohibition unit 31f sets the overwrite prohibition flag of the target moving image file to ON (step S108b).

On the other hand, when the overwrite prohibition unit 31f determines that the number of ONs of the overwrite prohibition flag is not less than the upper limit value (No in step S108a), the G value generated this time has the overwrite prohibition type "normally prohibited" in the overwrite prohibition list 32b. It is determined whether or not it is larger than the lowest G value among the records 32bL set as "" (step S108c).

When the overwrite prohibition unit 31f determines that the G value generated this time is not larger than the lowest G value among the records 32bL set as "normally prohibited" (No in step S108c), the G occurrence flag processing ends. .. The process returns to FIG. 7, and step S109 is executed. This is because the need for overwriting the target moving image file is low as long as the G value generated this time is not larger (that is, smaller) than the already recorded G value. As a result, the limited recording area can be effectively used.

On the other hand, when the overwrite prohibition unit 31f determines that the G value generated this time is larger than the lowest G value among the records 32bL set as "normally prohibited" (Yes in step S108c), the lowest G value and the storage are stored. The overwrite prohibition flag FL is set to OFF for the record 32aL having the same address in the unit 32 (step S108d).

When the overwrite prohibition flag FL of the lowest G value is set to OFF, the overwrite prohibition unit 31f prohibits overwrite of the record 32aL including the video file generated this time (that is, the video file including the moment when the G value exceeds the threshold Th). The flag FL is set to ON (step S108e).

When the overwrite prohibition flag FL is set to ON in the above steps S108b and S108e, the overwrite prohibition unit 31f sets the overwrite prohibition type of the record 32bL of the target overwrite prohibition list 32b to "normal prohibition" (step S108f). ). Then, the address AD and the G value GD are updated to the address and the G value of the moving image file that is prohibited from being overwritten this time. When a plurality of G values are referenced, the largest G value is adopted. This is because such a G value most clearly shows the event that has occurred in the vehicle 2.

When the overwrite prohibition unit 31f updates the overwrite prohibition list 32b, the process returns to FIG. 7, and step S109 is executed.

By executing such G generation flag processing, it is possible to prohibit overwriting of video files containing a larger G value, and the number of video files that are prohibited from overwriting does not exceed the upper limit, and the recording area is limited. Can be used effectively.

Next, the details of the command reception flag processing in step S110 will be described. FIG. 9 is a flowchart showing a processing process of flag processing at the time of command reception.

When the command reception flag processing is executed, the overwrite prohibition unit 31f refers to the overwrite prohibition flag FL in the storage unit 32 of the target moving image file, and determines whether or not the overwrite prohibition flag is ON (step S110a). ). The overwrite prohibition unit 31f determines whether or not the overwrite prohibition flag of the target video file is ON because the overwrite prohibition flag of the target video file may be ON at this point. .. That is, in step S108c of the G generation flag processing (S108), if it is determined that the G value generated this time is not larger than the other G values, the overwrite prohibition flag of the corresponding moving image file is not turned ON and is turned OFF. Because it becomes. Therefore, in step S110a, the overwrite prohibition unit 31f needs to refer to the overwrite prohibition flag FL in the storage unit 32 of the target moving image file and determine whether or not the overwrite prohibition flag is ON.

When the overwrite prohibition unit 31f determines that the overwrite prohibition flag is ON (Yes in step S110a), the overwrite prohibition unit 31f executes the process of step S110f. The process of step S110f will be described later.

On the other hand, when the overwrite prohibition unit 31f determines that the overwrite prohibition flag is not ON (No in step S110a), it determines whether or not the number of ONs of the overwrite prohibition flag is less than the upper limit value (step S110b). The upper limit is, for example, 100.

When the overwrite prohibition unit 31f determines that the number of ONs of the overwrite prohibition flag is less than the upper limit value (Yes in step S110b), the overwrite prohibition unit 31f sets the overwrite prohibition flag of the target moving image file to ON (step S110c). As a result, in step S108c of the G generation flag processing (S108), the overwrite prohibition flag of the moving image file in which the overwrite prohibition flag is turned OFF can be turned ON.

On the other hand, the overwrite prohibition unit 31f overwrites the record 32aL having the same address in the storage unit 32 as the lowest G value among the records 32bL in which the overwrite prohibition type is set to "normally prohibited" in the overwrite prohibition list 32b. The prohibition flag FL is set to OFF (step S110d). In addition, unlike the above-mentioned G generation flag processing, it is not determined whether or not the G value generated this time is larger than the lowest G value among the records 32bL set as "normally prohibited". This is because, as long as the server device 4 determines that overwriting is absolutely prohibited, overwriting should be absolutely prohibited regardless of the magnitude of the G value.

When the overwrite prohibition flag FL of the lowest G value is set to OFF, the overwrite prohibition unit 31f sets the overwrite prohibition flag FL of the record 32aL including the moving image file generated this time to ON (step S110e).

The overwrite prohibition unit 31f is the target overwrite when it is determined that the overwrite prohibition flag is ON in step S110a (Yes in step S110a) and when the overwrite prohibition flag FL is set to ON in step S110c and step S110e. The overwrite prohibition type of the record 32bL of the prohibition list 32b is set to "absolute prohibition" (step S110f). Then, the address AD and the G value GD are updated to the address and the G value of the moving image file that is prohibited from being overwritten this time. When a plurality of G values are referenced, the largest G value is adopted. This is because such a G value most clearly shows the event that has occurred in the vehicle 2.

When the overwrite prohibition unit 31f updates the overwrite prohibition list 32b, the process returns to FIG. 7 and ends.

By executing such command reception flag processing, overwriting of a moving image file, which is extremely important for later verification, can be absolutely prohibited. If the overwriting of the moving image file is absolutely prohibited, the moving image file will not be overwritten no matter what G value is generated thereafter. This allows you to effectively save truly important video files. Moreover, since overwriting only such a moving image file is absolutely prohibited, the limited recording area can be effectively utilized.

Next, the processing process executed by the server device 4 will be described. FIG. 10 is a flowchart showing a processing process executed by the server device 4. The processing step is repeatedly executed at a predetermined cycle.

First, the data receiving unit 41a receives the status file transmitted from the drive recorder 3 (step S301).

When the data receiving unit 41a receives the status file, the video analysis unit 41b analyzes the moving image file included in the status file and determines whether or not the image related to the traffic accident is included (step S302). As described above, the video analysis unit 41b analyzes the moving image file by using a known image processing method such as pattern matching.

When the video analysis unit 41b determines that the moving image file contains an image related to a traffic accident or the like (Yes in step S302), the command transmission unit 41e transmits an overwrite prohibition command to the drive recorder 3 (step S304). As a result, the target video file can be designated as overwrite-protected. In particular, absolute overwrite protection processing can be executed. Since an image related to a traffic accident or the like in a moving image file is extremely important for later verification, it is preferable to send an overwrite prohibition command to the drive recorder 3.

On the other hand, when the video analysis unit 41b determines that the video file does not include an image related to a traffic accident or the like (No in step S302), the data analysis unit 41c refers to the G value included in the situation file and the G value rises sharply. It is determined whether or not it is done (step S305). If the G value rises sharply, there is a risk of sudden braking or a collision, and there is a high possibility that the video file should be overwritten. By determining whether or not the G value has risen sharply, it is possible to prohibit overwriting of a moving image file that deviates from the target of overwriting prohibition in video analysis and is likely to be in a situation where overwriting is prohibited. By analyzing the rate of rapid increase in the G value, that is, the rate of change in the G value, the behavior of the vehicle 2 can be determined more accurately than in the case of simply determining the magnitude with respect to the threshold value of the G value. This is because when an overwrite protection command is sent, overwriting of a video file is absolutely prohibited, so it should be judged more carefully than a simple overwrite protection process. However, since the amount of calculation is large compared to the judgment of the size of the threshold value, the analysis of the rate of change of the G value is preferably executed by the server device which is a large-scale calculation device rather than the calculation by the on-board unit alone. This is because the calculation result can be obtained quickly and accurately.

When the data analysis unit 41c determines that the G value is rapidly rising (Yes in step S305), the determination unit 41d determines that the analysis result of the video analysis unit 41b and other data (vehicle speed and / or position) included in the status file. ), And it is determined whether or not the overwrite prohibition command should be transmitted to the drive recorder 3 (step S303). At this time, the determination unit 41d refers to other data included in the status file and determines whether or not the overwrite prohibition command should be transmitted to the drive recorder 3. That is, in addition to the determination result that the moving image file contains an image related to a traffic accident or the like, the G value, vehicle speed, and position of the vehicle 2 are taken into consideration, and the necessity of transmitting the overwrite prohibition command is finally determined. By deciding whether or not to send a file by considering not only a single piece of data but also multiple pieces of data, it is multifaceted even if it should be write-protected on one side while overwriting the truly necessary video file. You can avoid overwriting of video files that should not be overwritten. As a result, the recording area of the storage unit 32 can be effectively used. In other words, the determination by the video analysis unit 41b that the video file contains an image related to a traffic accident or the like is only an opportunity to start the determination of whether or not the overwrite prohibition command needs to be transmitted, and finally the determination unit 41d determines. It is necessary to comprehensively judge whether or not the command needs to be transmitted including other data. The determination unit 41d may separately provide determination conditions based on a plurality of data. Judgment conditions are, for example, that the video file includes an image related to a traffic accident, the G value is 1.5 [G] or more, the vehicle speed is 80 [km / h] or more, and the position is an intersection. ..

When the determination unit 41d determines that the overwrite prohibition command should be transmitted to the drive recorder 3 (Yes in step S303), the command transmission unit 41e transmits the overwrite prohibition command (step S304). On the other hand, if the determination unit 41d determines that the overwrite prohibition command should not be transmitted to the drive recorder 3 (No in step S303), the overwrite prohibition command is not transmitted to the drive recorder 3 and the process ends.

In step S305, when the data analysis unit 41c determines that the G value has not risen sharply (No in step S305), it determines whether or not the vehicle speed has dropped sharply (step S306). If the vehicle speed drops sharply, there is a risk of sudden braking or a collision accident as well as a sharp rise in the G value, and there is a high possibility that the video file should be overwritten. By determining whether or not the vehicle speed has dropped sharply, it is possible to prohibit overwriting of a moving image file that deviates from the target of overwriting prohibition in video analysis and G value analysis and is likely to be in a situation where overwriting is prohibited.

When the data analysis unit 41c determines that the vehicle speed is suddenly decreasing (Yes in step S306), the determination unit 41d determines that the analysis result of the video analysis unit 41b and other data (G value and / or) included in the status file. Position) is referred to, and it is determined whether or not the overwrite prohibition command should be transmitted to the drive recorder 3 (step S303). The reasons for referring to the analysis results and other data are as described above.

When the determination unit 41d determines that the overwrite prohibition command should be transmitted (Yes in step S303), the command transmission unit 41e transmits the overwrite prohibition command (step S304), and determines that the overwrite prohibition command should not be transmitted. If (No in step S303), the process ends.

In step S306, when the data analysis unit 41c determines that the vehicle speed has not dropped sharply (No in step S306), it determines whether or not the position of the vehicle 2 is an intersection, an accident-prone point, or the like (step S307). If the position of the vehicle 2 is an intersection, an accident-prone point, or the like, there is a possibility that some kind of accident has occurred in the vehicle 2, and there is a high possibility that the moving image file should be prohibited from being overwritten. By determining whether the position of the vehicle 2 is an intersection, an accident-prone point, etc., it is possible that the situation deviates from the object of overwrite prohibition in video analysis, G value analysis, and vehicle speed analysis, and should be overwrite prohibited. You can prohibit overwriting of highly likely video files. The data analysis unit 41c refers to the latitude and longitude where the vehicle 2 is located and the map data 42b from the situation file, and determines whether or not the position of the vehicle 2 is an intersection, an accident-prone point, or the like.

When the data analysis unit 41c determines that the position of the vehicle 2 is an accident-prone location (Yes in step S307), the determination unit 41d determines other data (G value) included in the analysis result and status file of the video analysis unit 41b. And / or the vehicle speed), and it is determined whether or not the overwrite prohibition command should be transmitted to the drive recorder 3 (step S303). The reasons for referring to the analysis results and other data are as described above.

When the determination unit 41d determines that the overwrite prohibition command should be transmitted (Yes in step S303), the command transmission unit 41e transmits the overwrite prohibition command (step S304), and determines that the overwrite prohibition command should not be transmitted. If (No in step S303), the process ends.

In step S307, when the data analysis unit 41c determines that the position of the vehicle 2 is not an intersection, an accident-prone point, or the like (No in step S307), the process ends.

In this way, whether or not overwriting of video files should be prohibited, especially whether or not overwriting should be absolutely prohibited, should be judged based on a plurality of data, not based on only a single data. Is preferable. In addition, it is preferable to make a judgment including the passage of time of the data rather than the magnitude relationship between a certain data and the threshold value. This is because if the overwriting is absolutely prohibited, the recording area of the storage unit 32 is overwritten and cannot be used, so careful judgment is required. Since a large amount of calculation is required for a plurality of data and a judgment based on the passage of time of the data, it is preferable to make a judgment by a server device which is a large-scale arithmetic unit rather than a single on-board unit.

As described above, the drive recorder 3 of the present embodiment transmits a moving image file showing the situation around the vehicle 2 when a large acceleration is generated to the server device 4. Based on the moving image file, the server device 4 determines whether or not to specify the overwriting prohibition for the moving image file indicating the vicinity of the vehicle 2 at the time and / or before and after the occurrence of the event. Then, based on the determination result, the drive recorder 3 specifies prohibition of overwriting for the video data at the time of occurrence of the event and / or before and after the occurrence of the event. As a result, overwriting of video data for which overwriting recording should be prohibited can be reliably prohibited, and overwriting of video data for which overwriting is not necessarily prohibited is permitted, and the storage area (storage capacity) can be effectively used.

Further, the status data transmitted to the server device 4 includes at least one or more data of the acceleration, speed, and position of the vehicle 2 at the time of occurrence of the event and / or before and after the occurrence of the event. By analyzing the behavior of the vehicle 2 by the server device 4, it is possible to improve the accuracy of determining whether or not overwriting recording of the moving image file should be prohibited.

Further, the status data transmitted to the server device 4 includes a moving image file. As a result, the server device 4 can directly analyze the video to determine whether or not the overwrite recording of the moving image file should be prohibited. Since it is possible to directly analyze the target moving image for which overwrite recording should be prohibited, it is possible to reliably prohibit overwrite recording.

<2. Modification example>
The embodiments of the present invention have been described above. However, the present invention is not limited to the above embodiment. The invention is variable in many ways. Hereinafter, such a modification will be described. All embodiments including the above embodiments and the embodiments described below can be appropriately combined.

In the above embodiment, the server device 4 performs image processing such as pattern matching on the moving image file included in the status file transmitted from the drive recorder, and determines whether or not overwriting should be prohibited. However, the server device 4 does not have to determine whether or not overwriting should be prohibited. A human may visually recognize a moving image (or a still image) to determine whether or not overwriting should be prohibited. FIG. 11 shows a modified example of the data recording system. The server device 4 displays the moving image file received from the drive recorder on the display screen DS, and the operator OP of the server device 4 visually recognizes the moving image (or still image) and determines whether or not the moving image file should be overwritten. In this case, since the situation such as a traffic accident can be scrutinized based on human experience and sensibility, the accuracy of determining whether or not overwriting should be prohibited can be improved as compared with mechanical image processing such as pattern matching.

Further, in the above embodiment, the moving image file including the moment when the G value is generated is prohibited from being overwritten. However, the moving image file including the moment when the G value is generated may be overwritten. In this case, even if the moment when the G value is generated is immediately after the start or the end of the moving image file, it is easy to analyze the cause of the G value.

Further, in the above embodiment, overwriting of the moving image file is prohibited triggered by the generation of acceleration, but the vehicle speed may be changed. Any event may occur.

Further, in the above embodiment, the event occurrence condition is that the G value is higher than the threshold value Th. However, instead of the G value, the occurrence condition of another event may be set. For example, a switch may be provided and the event occurrence condition may be that the user operates the switch. In this case, the user can control whether or not the event has occurred.

Further, in the above embodiment, the drive recorder 3 selects a moving image file for which overwriting prohibition is necessary. However, the server device 4 may select a moving image file for which overwriting prohibition is necessary. In this case, the drive recorder 3 transmits all the generated moving image files to the server device 4.

Further, in the above embodiment, the server device 4 outside the vehicle determines the file to be prohibited from overwriting, but the server device 4 does not have to be. It may be a device installed inside the vehicle. For example, a navigation device. However, a device equipped with a CPU having a relatively high computing power is preferable. This is because the amount of calculation for image processing and the like is large. If image processing or the like is performed by utilizing the interval between calculations of the CPU or the remaining power, the control of navigation or the like will not be hindered.

Further, in the above embodiment, although the acceleration data of the acceleration sensor is used, peripheral monitoring sensors such as millimeter wave radar, infrared radar and clearance sonar, brake sensors, motion control sensors such as accelerator opening sensor and shift sensor, and air Data obtained from safety control sensors such as bags, seat belts, and door locks may be used.

Further, in the above embodiment, the status file includes the moving image file, the acceleration, the vehicle speed, and the position data, but data other than these data may be included. That is, the engine speed, the mileage traveled this time, the number and weight of luggage, the number of passengers (passengers), and the like. By considering the mileage traveled this time, the degree of fatigue of the driver can be measured. By referring to the number and weight of luggage, the running stability of the vehicle can be measured.

Further, in the above embodiment, the moving body has been described as a vehicle such as an automobile. However, it may be a moving body other than a vehicle such as an aircraft, a ship, or a railroad. Further, the moving body may be an unmanned moving body in which no person is on board.

Further, the function described as one block in the above embodiment does not necessarily have to be realized by a single physical element. It may be realized by distributed physical elements. Moreover, the function described as a plurality of blocks in the above embodiment may be realized by a single physical element. Further, even if the device inside the vehicle and the device outside the vehicle share the processing related to any one function and exchange information between these devices by communication, the one function is realized as a whole. Good.

Further, it has been explained that all or a part of the functions described as being realized by software by executing a program in the above embodiment may be realized by an electric hardware circuit, and may be realized by a hardware circuit. All or part of the function may be realized by software. Further, the function described as one block in the above embodiment may be realized by the collaboration between software and hardware.

1 Data recording system 2 Vehicle 3 Drive recorder 4 Server device 21 Communication unit 22 Camera 23 Accelerometer 24 Vehicle speed sensor 25 Position detection unit

Claims (3)

A recording means that cyclically records video data indicating the surroundings of the vehicle on a recording medium,
Detection means to detect the occurrence of an event,
A transmission means for transmitting at least the acceleration, speed, position of the vehicle, and situation data including the video data to an external device at the time of occurrence of the event and / or before and after the occurrence of the event.
A determination based on the situation data whether or not the external device specifies whether to specify overwrite prohibition for the event video data which is the video data indicating the surroundings of the vehicle at the time and / or before and after the event occurs. A receiving means for receiving the result from the external device, and
Based on the determination result, the prohibition means for designating the overwrite prohibition for the event video data, and
With
The prohibited means
The first prohibition process that never allows overwriting with the video data later,
A second prohibition process that allows overwriting based on the situation data of the event video data later, and
A drive recorder characterized by including. The drive recorder according to claim 1, wherein the prohibition means limits the number of event video data for which overwrite prohibition is specified within an upper limit value. When the prohibition means receives the determination result from the external device, the prohibition means determines whether or not the number of the event video data for which the overwrite prohibition is specified has reached the upper limit value.
When the prohibiting means determines that the number of the event video data for which the overwrite prohibition is specified has reached the upper limit value, among the event video data whose overwrite is prohibited by the second prohibition process. The drive recorder according to claim 2, further comprising canceling the overwrite prohibition of the event video data, which is least necessary to overwrite prohibition.