JP7422425B2 - System and program - Google Patents

Description

The present invention relates to a recording control system that controls recording of vehicle behavior information, and a display control system and program that displays recorded vehicle behavior information.

In-vehicle recording devices, such as drive recorders (including those called event data recorders), which record surrounding images and vehicle speed when a vehicle is subjected to an impact due to sudden braking, sudden steering, or a collision, are becoming more and more popular. There is. By equipping a vehicle with such a drive recorder, when an accident occurs, it is possible to verify the cause of the accident by analyzing the recorded information.

In addition, driving information such as camera images, vehicle speed, and GPS (Global Positioning System) position information recorded by drive recorders installed in commercial vehicles such as trucks and taxis is collected, and operation managers etc. There is a driving support device that checks the content and analyzes each crew member's driving style, and utilizes it for driving training for crew members. Such a driving support device can improve the driver's awareness of safe driving, and can also use images recorded of daily driving conditions to provide safe driving guidance.

The drive recorder described in Patent Document 1 does not start recording new video information if a new recording condition is satisfied within a predetermined period after the recording condition is satisfied. Further, if a new recording condition is satisfied during a video information recording period that is longer than a predetermined period after the recording condition is satisfied, the video information recording time is extended. This prevents the same video information from being recorded redundantly in a recording element with a limited capacity if the recording conditions are met consecutively within a short period of time.

In the drive recorder described in Patent Document 2, when a new recording condition is established after a predetermined period of time has passed after the recording condition has been established, the point in time when recording of video data due to the establishment of the new recording condition is changed from the previous point. If it is before the recording end time when the previous recording condition is met, the recording time of the video data is extended until the recording end time when the new recording condition is met. Thereby, even if the recording conditions are met continuously within a certain period of time, it is possible to record the video data continuously without missing it.

Patent No. 4439549 International Publication No. 2007/066613

In the drive recorder described in Patent Document 1, if a new recording condition is established after the recording condition is established and the video information recording period ends, the data is recorded as a separate recording data file. Ru. Therefore, each time a new recording condition is established, a new data file is recorded, and the number of data files increases each time. In addition, if a new recording condition is established within a predetermined period after the recording condition is established, new recording of video information is not started, so the recorded data for that period may be lost, resulting in important There is a risk that video information may fail to be recorded.

In addition, in the drive recorder described in Patent Document 2, if the video data at the time when the new recording condition is met is the data that is really desired, rather than the video data at the time when the previous recording condition was met, Since there is little information to use to specify the point in time when a recording condition is met, for example, in the above-mentioned driving support device, a driving manager or the like can search for the point in time when a large number of recording conditions are met, and select a specific recording condition from among them. When trying to find the point in time when a new recording condition is met, there are problems in that it is difficult to search for the point in time when a new recording condition is met, and it is difficult to find the data that you really want.

The present invention has been made in view of the circumstances exemplified above, and provides recording control that allows one to easily specify vehicle behavior information that the user needs from among vehicle behavior information over a series of periods. It is an object of the present invention to provide a display control system that can easily specify the vehicle behavior that it needs from among the system and vehicle behavior within a predetermined period.

In a first aspect, the present invention performs control to associate and record vehicle behavior information over a predetermined period of time when a predetermined condition is met and identification information that makes it possible to specify the time point at which the predetermined condition is met. In the recording control system, there is an overlap between vehicle behavior information over a first period that has already been recorded and vehicle behavior information over a second period that is newly recorded when a predetermined condition is met. In this case, vehicle behavior over a first period and vehicle behavior over a second period are recorded as vehicle behavior information over a series of periods, and identification information recorded in association with the first period is recorded. A recording control system is provided, characterized in that identifying information that makes it possible to identify the point in time when the new predetermined condition is satisfied is recorded in association with the identifying information.

In the recording control system according to the first aspect, a plurality of identifying information is recorded in association with vehicle behavior information over a series of periods, so based on the plurality of identifying information, vehicle behavior information over a series of periods is recorded. It is possible to easily specify the vehicle behavior information that the user needs from among the behavior information.

In the recording control system according to the first aspect, a plurality of pieces of identification information are recorded in association with vehicle behavior information over a series of periods. Users can easily identify and use the vehicle behavior information they need from among the vehicle behavior information over a series of periods.

Further, for example, it is possible to easily identify and use the vehicle behavior information that the user needs by taking into consideration the relevance of the points in time when a plurality of predetermined conditions are satisfied in a series of periods. For example, based on the relevance (for example, whether it has appeared) of a point in time when multiple predetermined conditions are met in a series of periods, such as a rear-end collision after a sudden steering wheel, followed by being dragged with the same acceleration as the sudden steering wheel. Therefore, for example, it is possible to easily specify the vehicle behavior information that the user needs from among a large number of series of vehicle behavior information.

Further, for example, it is also possible to specify the vehicle behavior information that the vehicle requires based on the number of times when a plurality of predetermined conditions are satisfied in a series of periods. For example, by sequentially extracting vehicle behavior information over a series of periods having a large amount of identification information, for example, the movement of the vehicle behavior information, the identification information, and the vehicle behavior information at the time specified by the identification information are extracted. It is also easy to analyze the contents of

The time when the predetermined condition is satisfied is, for example, the time when the value (magnitude) of the acceleration (G data) detected by the acceleration sensor mounted on the vehicle exceeds the predetermined value, or the value detected in the vehicle is set in advance. It is preferable that the time point is the time point when any one of several predetermined conditions is satisfied, such as the time point when the value matches the value, or the time point when a predetermined switch operation is performed by the user. Further, the time when the predetermined condition is satisfied may be, for example, the time when an event corresponding to an accident occurs. For example, it may be set as the point in time when sudden deceleration corresponding to a collision occurs.

In addition, if there is an overlap between the above-mentioned series of periods and the vehicle behavior information for another period that is recorded when another predetermined condition is met, the vehicle behavior information for the series of periods and another period may overlap. A plurality of pieces of identification information may be recorded, each of which makes it possible to specify the behavior information and the point in time when each predetermined condition is satisfied.

For example, specifying information at the time when the first predetermined condition is met (there is no overlap with the previous period) and the second time when the predetermined condition is met (there is overlap with the previous period). In an example of a configuration that records "vehicle behavior information over the first period that has already been recorded", the first period recorded when the first predetermined condition is met (the overlap with the previous period is "vehicle behavior information over a second period that is recorded when a new predetermined condition is met" is the vehicle behavior information recorded when the second predetermined condition is met. This corresponds to vehicle behavior information during the period (a period that overlaps with the first period), and "vehicle behavior information over a series of periods" continues over the first period and the second period. control to record vehicle behavior information over a series of periods.

In addition, in the example of the configuration in which the identification information at the third time is recorded in addition to the identification information at the first and second times described above, "second information to be recorded when a new predetermined condition is met" If the "period of 2018" is the third period, then the "vehicle behavior information already recorded over the first period" corresponds to the vehicle behavior information over the first and second periods, and "a series of The "vehicle behavior information over a period" is controlled to be recorded as vehicle behavior information over a series of periods that continue over the first, second, and third periods.

Furthermore, in the example of the configuration in which the identification information at the fourth time point is recorded in addition to the identification information at the first to third time points described above, "vehicle behavior information over the first period that has already been recorded" is recorded. By controlling the recording in the same manner as above, the vehicle behavior information is set as the vehicle behavior information for the first to third periods, and the "second period to be recorded when a new predetermined condition is met" is set as the fourth period. It is recorded as vehicle behavior information for a series of periods that continue over the fourth period. Then, it is preferable to do the same for the fifth and subsequent times.

The "time point when the predetermined condition is met" and the subsequent "time point when the predetermined condition is newly met" may be, for example, two or more consecutive time points within a short period of time. Specifically, it may be a point in time when the vehicle is continuously subjected to shocks, such as a collision immediately after a sharp steering wheel.

The identification information is information used to identify the time when a predetermined condition is satisfied, and may be, for example, time information such as in the configuration of the eleventh viewpoint.

Vehicle behavior information includes, for example, acceleration information detected by an acceleration sensor installed in the vehicle, vehicle position information detected by a GPS receiver, speed information detected by a speed sensor installed in the vehicle, and information about the surroundings of the vehicle. It is preferable to use photographed video information.

For example, assume that acceleration information is recorded at 10 millisecond (ms) intervals and position information is recorded at 0.2 second (200 ms) intervals. These vehicle behavior information is recorded as a series of (vehicle behavior information) data (for example, in one file) for, for example, 10 seconds before and 5 seconds after the time when a predetermined condition is satisfied. After that, for example, if a new predetermined condition is satisfied 7 seconds after the above predetermined condition is satisfied, for example, as in the configuration of the ninth aspect, the continuation of the file from the end of the previously closed file is Process to record partial (vehicle behavior information) data. Alternatively, for example, as in the configuration of the tenth aspect, the position 2 seconds before the current new predetermined condition is satisfied in the previous file (i.e., the time when the previous file was closed) can be identified and It is preferable to perform processing to record (vehicle behavior information) data from the position to the subsequent part. Furthermore, if a new predetermined condition is subsequently satisfied, for example, within 10 seconds from the time when the previous predetermined condition was met (i.e., within the preset recording time before the time when the predetermined condition was met), the next predetermined condition is similarly satisfied. It is preferable to perform processing to record partial (vehicle behavior information) data.

Further, it is preferable that a plurality of pieces of vehicle behavior information over the series of periods can be recorded. That is, the vehicle behavior information over a predetermined period in which the periods do not overlap may be recorded as vehicle behavior information over another predetermined period (for example, another series of vehicle behavior information). In this way, among the vehicle behavior information over a plurality of consecutive periods, it is possible to easily specify the vehicle behavior information over a series of periods that the vehicle requires. For example, by focusing on the difference in the length of the period, or by focusing on the relationship between multiple pieces of identifying information included in the vehicle behavior information over each series of periods, it is possible to determine which series of periods the vehicle It is possible to easily find out whether the behavior information corresponds to the behavior information of the vehicle over a series of periods that the user needs. It is also possible to identify vehicle behavior information over a predetermined period of time that you require by comparing vehicle behavior information that spans a series of periods with vehicle behavior information that does not span a series of periods. becomes. Then, as mentioned above, from among the vehicle behavior information that has been identified over a series of periods that the user needs, the vehicle behavior information that the user needs can be easily obtained based on multiple pieces of identification information. It can also be specified.

In a second aspect, the present invention provides the recording control system according to the first aspect, wherein the series of periods is a series of periods that continues from the start of the first period to the end of the second period. It is characterized by a period of

In the recording control system according to the second aspect, the vehicle behavior information required by itself is selected from the vehicle behavior information over a series of periods continuing from the start of the first period to the end of the second period. behavior information can be easily identified.
Further, for example, if a configuration is provided that starts reproducing and displaying the vehicle behavior information from the start of the first period and continues reproducing and displaying the vehicle behavior information until the end of the second period, the predetermined condition It is possible to analyze vehicle behavior information over the entire predetermined period when the following conditions are satisfied.

According to a third aspect, the present invention is characterized in that in the recording control system according to the first or second aspect, the predetermined period is different depending on the type of predetermined condition.

In the recording control system according to the third aspect, the predetermined period can have different lengths depending on the type of predetermined condition. For example, the recording period (time) of vehicle behavior information that is recorded when a predetermined condition is met can be made longer for types that require a long time, and shortened for types that require a short time, depending on the type of predetermined condition. , the length of the recording period (time) of vehicle behavior information can be made different.

Examples of the types of predetermined conditions include (1) when a user performs a predetermined switch operation, and (2) when the value of acceleration (G data) detected by a G sensor mounted on the vehicle due to an impact (collision), etc. (3) when a signal is input from an external port, (4) when a command is received via communication (for example, RS-232C) from an external device such as an AVM-ECU. It is good to say that it is a case.

In a fourth aspect, the present invention provides a recording control system according to any one of the first to third aspects, in which a plurality of identifying information within the series of periods are recorded in association with each other, and It is characterized in that a plurality of identifying information within the series and a plurality of identifying information outside the series are recorded in a distinguishable manner.

In the recording control system according to the fourth aspect, a plurality of identifying information within the series of periods and a plurality of identifying information outside the series of periods are recorded in a distinguishable manner, so that the two can be searched separately. Alternatively, the two can be distinguished and displayed on a display device.

In a fifth aspect, the present invention provides a recording control system according to any one of the first to fourth aspects, in which vehicle behavior information within the series of periods to which each of a plurality of identification information corresponds is specified. It is characterized by being able to record.

In the recording control system according to the fifth aspect, it is possible to specify vehicle behavior information within a series of periods based on a plurality of pieces of identification information, and for example, to separate the vehicle behavior information into each identified vehicle behavior information. It is also possible to cut it out.

According to a sixth aspect, the present invention is characterized in that in the recording control system according to any one of the first to fifth aspects, the behavior information of the vehicle during the series of periods is recorded in one data file. do.

In the recording control system according to the sixth aspect, vehicle behavior information for a series of periods is collected into one data file, making data management easier. For example, vehicle behavior information for a series of periods can be easily moved or copied to another recording medium or recording device, or read into a personal computer (PC).
For example, a configuration in which the information is "recorded as vehicle behavior information over a series of periods" may be adopted in which it is recorded in one data file.

In a seventh aspect, the present invention is characterized in that, in the recording control system according to any one of the first to fifth aspects, the behavior information of the vehicle and the identification information are recorded in one data file. shall be.

In the recording control system according to the seventh aspect, the vehicle behavior information and identification information are combined into one data file, making data management easier. For example, vehicle behavior information for a series of periods can be easily moved or copied to another recording medium or recording device, or read into a personal computer (PC).
For example, information serving as a mark may be added to the vehicle behavior information as identifying information and recorded. Specifically, vehicle behavior information such as time, position (latitude, longitude), X acceleration (vehicle longitudinal direction), Y acceleration (vehicle lateral direction), Z acceleration (vehicle vertical direction), and vehicle speed, Behavior type information may be recorded as the information that serves as the mark. For example, when the behavior type information is "0", "behavior does not occur", when it is "1", "X acceleration is exceeded (that is, a predetermined condition is met)", when it is "2", "Y acceleration is over", ...etc.

In an eighth aspect, the present invention provides a recording control system according to any one of the first to fifth aspects, in which the identification information is stored in a data file different from a data file for recording behavior information of the vehicle. It is characterized by recording the relationship between the two in an identifiable manner.

In the recording control system according to the eighth aspect, the data file for recording the identification information and the data file for recording the vehicle behavior information are separate data files, so the identification information and the vehicle behavior information are separated. data can be managed. For example, only the identification information or only the vehicle behavior information can be easily moved or copied to another recording medium or recording device, or read into a personal computer (PC).

In a ninth aspect, in the recording control system according to any one of the first to eighth aspects, the present invention provides the recording control system according to any one of the first to eighth aspects, in which the vehicle behavior information recorded in the first period is Among the vehicle behavior information for the second period, the vehicle behavior information for the last part is recorded.

In the recording control system according to the ninth aspect, the last part of the vehicle behavior information recorded in the first period is followed by the continuation of the last part of the first period among the vehicle behavior information in the second period. Since the vehicle behavior information of the part is recorded, the vehicle behavior information over a series of periods can be recorded as vehicle behavior information without any omissions or duplications.

In a tenth aspect, in the recording control system according to any one of the first to ninth aspects, the present invention specifies a time point in the second period that coincides with the end point of the first period. Then, the behavior information of the vehicle after the coincidence time is recorded following the behavior information of the vehicle in the first period.

In the recording control system according to the tenth aspect, a time point in the second period that coincides with the end point of the first period is specified, and the behavior information of the vehicle after the coincident point is recorded as the vehicle behavior information in the first period. Since the vehicle behavior information is recorded consecutively to the vehicle behavior information, the vehicle behavior information over a series of periods can be recorded as vehicle behavior information without any omissions or duplications.

In an eleventh aspect, the present invention provides the recording control system according to any one of the first to tenth aspects, wherein the identification information is time information indicating a time when the predetermined condition is satisfied; The present invention is characterized in that the generation time of the vehicle behavior information is recorded in a specifiable manner.

In the recording control system according to the eleventh aspect, the generation time of the vehicle behavior information can be specified based on the time information at the time when the predetermined condition is satisfied. For example, it becomes possible to grasp the generation times of individual vehicle behavior information in vehicle behavior information over a series of periods in chronological order.

In a twelfth aspect, the present invention provides the recording control system according to any one of the first to tenth aspects, in which the identifying information is determined from a reference time to a time when the predetermined condition is satisfied. It is time information up to a time, and is characterized in that the time of occurrence of the vehicle behavior information is recorded so as to be able to specify it.

In the recording control system according to the twelfth aspect, the generation time of the vehicle behavior information can be specified based on the time information from the reference time to the time when the predetermined condition is satisfied. For example, it is possible to grasp the generation time of each vehicle behavior information in vehicle behavior information over a series of periods in chronological order as the elapsed time from a reference point in time.
The reference time may be, for example, the start time of a series of periods, and the elapsed time from this start time to the time when the predetermined condition is satisfied.

In a thirteenth aspect, the present invention provides the recording control system according to any one of the first to twelfth aspects, wherein the vehicle behavior information is information repeatedly acquired at predetermined time intervals, The present invention is characterized in that the time point when the condition is satisfied is a time point that coincides with any one of the predetermined time intervals.

In the recording control system according to the thirteenth aspect, when the vehicle behavior information is repeatedly acquired at predetermined time intervals, the time when the predetermined condition is satisfied can be made to coincide with the time when the vehicle behavior information is acquired. Therefore, it is possible to obtain vehicle behavior information as information at the time specified by the identification information (that is, the time when a predetermined condition is satisfied).
For example, when the vehicle behavior information is position information calculated by GPS (Global Positioning System) at 1 second intervals, for example, the time when a predetermined condition is met is the time when the position information from GPS is acquired. If the time is 0.6 seconds later, it is assumed that a predetermined condition is satisfied at the time when the position information from the GPS is acquired next, and the time information may be generated as identification information, for example.

In a fourteenth aspect, the present invention provides a program for causing a computer to realize the function as a recording control system according to any one of the first to thirteenth aspects.

In a fifteenth aspect, the present invention is capable of specifying vehicle behavior information recorded when a predetermined condition is satisfied over a predetermined period and a point in time when the predetermined condition is satisfied, which is recorded in association with the predetermined period. Based on vehicle behavior data recorded in association with a plurality of pieces of identification information, the plurality of vehicle behaviors within the predetermined period at the time when a predetermined condition specified by each of the plurality of pieces of identification information is satisfied. Provided is a display control system characterized by displaying information based on the following information.

In the display control system according to the fifteenth aspect, information based on the behavior of a plurality of vehicles within a predetermined period at the time when the predetermined condition specified by each of the plurality of identification information is satisfied is displayed. Based on the behavior-based information, it is possible to easily specify the vehicle behavior that the vehicle requires from among the vehicle behaviors within a predetermined period.
For example, by analyzing or searching multiple pieces of identification information, it is possible to easily find multiple vehicle behaviors at the time when a desired predetermined condition is met, from among the times when multiple predetermined conditions are met. .

In the recording control system according to the fifteenth aspect, information based on a plurality of vehicle behaviors within a predetermined period of time specified by a plurality of pieces of identification information is displayed. Based on the information based on the behavior, for example, it is possible to easily identify and utilize the desired vehicle behavior from among a large number of "vehicle behaviors within a predetermined period."

Furthermore, for example, it is possible to easily specify and utilize the vehicle behavior that the user needs by taking into account the relevance of the points in time when a plurality of predetermined conditions are satisfied in a predetermined period. For example, there was a rear-end collision after a sudden steering wheel, and then there was an acceleration equal to that of the sudden steering wheel while being dragged, etc., based on the relationship (for example, whether it has appeared) at the time when multiple predetermined conditions are met in a predetermined period of time. Therefore, for example, it is possible to easily specify the vehicle behavior that the user needs from among a large number of predetermined vehicle behaviors.

Further, for example, it is also possible to specify the vehicle behavior that the vehicle requires based on the number of times when a plurality of predetermined conditions are satisfied in a predetermined period. For example, by sequentially extracting vehicle behavior over a predetermined period that has a large amount of identification information, for example, the contents of the vehicle behavior, the identification information, the vehicle behavior at the time specified by the identification information, etc. It is also easy to analyze.

By verifying vehicle behavior using such a display, it is possible to easily analyze and search for the passage of time and content of vehicle behavior.
Further, for example, such a display may be configured such that each item is displayed, and each item can be searched individually, or a logical sum or logical product of a plurality of items can be searched.
Furthermore, it is also possible to express the events at the time when the recording conditions are met in a tabular format, for example by displaying them in a list or list.

For example, if vehicle behavior information includes start time information, and the identification information is the elapsed time from the start time of the behavior information, the elapsed time itself is not displayed, but the elapsed time is added to the start time. It is a good idea to display the time determined by

In a sixteenth aspect, the present invention provides a display control system according to the fifteenth aspect, in which one vehicle behavior data including the plurality of identifying information is selectably displayed from among a plurality of vehicle behavior data. comprising a display unit, displaying information based on a plurality of vehicle behaviors within the predetermined period at a time when a predetermined condition specified by each of the plurality of identification information is satisfied based on the selected vehicle behavior data; It is characterized by

In the display control system according to the sixteenth aspect, one vehicle behavior data can be selected from a plurality of vehicle behavior data using the selection display section, and a plurality of identification information based on the selected vehicle behavior data can be selected. It is possible to display information based on a plurality of vehicle behaviors at a time point specified by.

In a seventeenth aspect, the present invention provides the display control system according to the sixteenth aspect, wherein the selection display section displays information at a time specified by each of the plurality of identifying information included in the vehicle behavior data. , is characterized in that it is displayed for each selectable unit of vehicle behavior data.

In the display control system according to the seventeenth aspect, the information at the time specified by each of the plurality of identification information is displayed on the selection display section for each selectable unit of vehicle behavior data. Information at a time point that satisfies a predetermined condition obtained from information at a time point can be easily found.

According to an eighteenth aspect, in the display control system according to any one of the fifteenth to seventeenth aspects, the present invention provides a time point specified by each of the plurality of identifying information as the information on the specified time point. It is characterized by including type information indicating the type of the predetermined condition.

In the display control system according to the eighteenth aspect, based on the type information indicating the type of the predetermined condition, it is possible to know the type of the predetermined condition at the time specified by each of the plurality of identifying information.
For example, among the points specified by each piece of identification information, (a) the first point indicates that the value (magnitude) of acceleration (G data) has exceeded a predetermined value due to a collision, etc. (b) At the second point in time, it is preferable to display that the switch operation has been performed.

In a nineteenth aspect, the present invention provides, in the display control system according to the eighteenth aspect, based on the type information, the selection display section displays different information for each time point specified by each of the plurality of identifying information. The method is characterized in that the type information is displayed in a display mode.

In the display control system according to the nineteenth aspect, the type information of the predetermined condition is displayed on the selection display section in a different display mode depending on the time point, so that the type information of the predetermined condition displayed on the selection display section is displayed on the selection display section. One desired vehicle behavior data can be easily selected from among the vehicle behavior data.
For example, in the selection display area, the first type information (characters indicating the type of collision, etc.) is displayed in a yellow font, filled in, background, etc., and the second type information (characters indicating the type of switch, etc.) is displayed. It is a good idea to display it with a green font, fill, or background.

In a twentieth aspect, the present invention provides the display control system according to any one of the fifteenth to seventeenth aspects, wherein the vehicle behavior data indicates a time point specified by each of the plurality of identifying information. It is characterized by including time information indicating.

In the display control system according to the twentieth aspect, based on the time information, it is possible to know the time at the time specified by each of the plurality of identification information.

In a twenty-first aspect, the present invention provides, in the display control system according to the twentieth aspect, based on the time information, the selection display section displays different information for each time point specified by each of the plurality of identifying information. It is characterized by displaying the time in a display mode.

In the display control system according to the twenty-first aspect, the time is displayed on the selection display section in a different display mode for each point in time, so the time is determined from among a plurality of vehicle behavior data based on the time displayed on the selection display section. One vehicle behavior data can be easily selected.
For example, in the selection display area, display the first time (the number indicating the time) in a yellow font, fill, background, etc., and the second time (the number indicating the time) in the green font, fill, background, etc. It is best to display it as

According to a twenty-second aspect, in the display control system according to any one of the sixteenth to twenty-first aspects, when the one vehicle behavior data is selected, the predetermined vehicle behavior data based on the selected vehicle behavior data is The present invention is characterized in that a series of vehicle behavior information over a period of time is displayed in a state in which vehicle behavior information corresponding to a time point specified by each of the plurality of identification information can be specified.

In the display control system according to the twenty-second aspect, a series of vehicle behavior information based on the selected vehicle behavior data can be visually recognized by distinguishing at a glance the vehicle behavior information corresponding to the time point specified by each of the plurality of identification information. can do.
For example, vehicle behavior information corresponding to a specified point in time in a series of vehicle behavior information may be, for example, a series of multiple camera images (thumbnail images) taken around the vehicle over a predetermined period of time. The camera image (thumbnail image) corresponding to the specified time point may be displayed with a yellow line or a yellow frame.
In addition, a series of vehicle behavior information such as acceleration information, vehicle position information, and vehicle speed information other than the above-mentioned camera images may be displayed as a graph of acceleration data or speed data, or the position may be displayed on a map. , Vehicle behavior information corresponding to a specified point in time can be expressed by drawing a line (line) or dot in a different color from other points in time points specified by each of multiple pieces of identification information in a graph or map. It is recommended to display it by marking it with or mark.

According to a twenty-third aspect, in the display control system according to the twenty-second aspect, the present invention provides vehicle behavior information corresponding to a time point specified by each of the plurality of identification information among the series of vehicle behavior information. , and non-corresponding vehicle behavior information are displayed in a different display mode.

In the display control system according to the twenty-third aspect, vehicle behavior information corresponding to the time point specified by each of the plurality of identification information and vehicle behavior information that does not correspond can be distinguished and visually recognized at a glance.
For example, vehicle behavior information that corresponds to a specified point in time is displayed as a yellow line, frame, dot, or mark, and vehicle behavior information that does not correspond to the specified time is displayed as nothing or as a green line, frame, dot, or mark. It is best to display it as

According to a twenty-fourth aspect, in the display control system according to the twenty-second or twenty-third aspect, the display control system corresponds to a time point specified by each of the plurality of identifying information among the series of vehicle behavior information. The vehicle behavior information is characterized in that it is displayed in a different display mode for each specified time point.

In the display control system according to the twenty-fourth aspect, the vehicle behavior information corresponding to the time point specified by each of the plurality of identification information is displayed in a different display mode for each specified time point. Vehicle behavior information can be distinguished and visually recognized at a glance.
For example, vehicle behavior information corresponding to the first point in time is displayed as a yellow line, frame, dot, mark, etc., and vehicle behavior information corresponding to the second point in time is displayed as a green line, frame, dot, or mark. It is best to display it with a mark, etc.

In a twenty-fifth aspect, the present invention provides a display control system according to any one of the twenty-second to twenty-fourth aspects, wherein vehicle behavior information corresponding to a time point specified by each of the plurality of identifying information is It is characterized by displaying the information in the order in which the conditions are met.

In the display control system according to the twenty-fifth aspect, the vehicle behavior information corresponding to the time point specified by each of the plurality of identification information is displayed in the order of the time points when the predetermined conditions are met, so the vehicle behavior information at each time point is displayed. The order of occurrence can be easily understood.

According to a twenty-sixth aspect, the present invention is characterized in that the display control system according to any one of the twenty-second to twenty-fifth aspects includes image information regarding vehicle behavior as the series of vehicle behavior information.

In the display control system according to the twenty-sixth aspect, image information related to vehicle behavior can be visually recognized as a series of vehicle behavior information.
The image information may be, for example, a camera image taken around the vehicle by a camera installed in the vehicle.

In a twenty-seventh aspect, the present invention provides, in the display control system according to any one of the sixteenth to twenty-sixth aspects, each identifying information of a plurality of identifying information included in the selected one vehicle behavior data. The first information to be respectively displayed on the selection display section based on the above, and the second information to be displayed on a display section other than the selection display section based on each of the identification information of the plurality of identification information are: The first and second information based on the identification information specifying the same point in time among the plurality of identification information are displayed in the same display mode.

In the display control system according to the twenty-seventh aspect, the first and second information based on the identification information for specifying the same point in time are displayed in the same display mode on the selection display section and the display section other than the selection display section. In the entire display section including the selection display section and display sections other than the selection display section, the first and second information at the same time point can be distinguished and visually recognized at a glance.
For example, the first information based on the identifying information that identifies the first point in time (for example, type information that indicates the type of predetermined condition) is displayed in a yellow font, filled in, or with a background in the selection display area, and the same The second information (for example, vehicle behavior information such as image information) based on the identification information that specifies the first point in time is displayed as a yellow line, frame, dot, mark, etc. on the display area other than the selection display area. It is a good idea to do something like this. Similarly, the first and second information based on the identification information for specifying the second time point may be displayed in green or the like on the selection display section and the display sections other than the selection display section, respectively.

In a twenty-eighth aspect, the present invention provides the display control system according to any one of the fifteenth to twenty-seventh aspects, in which information at a time specified by each of the plurality of identifying information is stored in the predetermined period. The present invention is characterized by displaying a time series of changes in behavior data included in vehicle behavior information in a specifiable manner.

In the display control system according to the twenty-eighth aspect, the information at the specified time is displayed so that the time series of changes in behavior data can be specified, so that the behavior data at the specified time can be easily grasped.
For example, specified time points may be displayed as dots (marks), vertical lines, etc. on the time axis (horizontal axis) of a time chart that displays changes in behavior data such as G data and vehicle speed data in chronological order.

In a twenty-ninth aspect, the present invention provides the display control system according to any one of the fifteenth to twenty-eighth aspects, wherein the vehicle behavior data is a vehicle position at a time point specified by each of the plurality of identifying information. , and based on the position information, the corresponding position on the map corresponding to the position information is displayed.

In the display control system according to the twenty-ninth aspect, the vehicle position on the map at the specified time is displayed based on the position information, so that the vehicle position at the specified time can be easily grasped.

In a 30th aspect, the present invention provides a program for causing a computer to realize the function as a display control system according to any one of the 15th to 29th aspects.

According to the recording control system and display control system of the present invention, it is possible to easily specify the vehicle behavior information that oneself needs from among the vehicle behavior information over a series of periods, and also to identify the vehicle behavior information that oneself needs within a predetermined period. It is possible to easily specify the vehicle behavior that the user needs from among the vehicle behaviors of the vehicle.

1 is a diagram showing a schematic configuration of a driving support system according to a first embodiment. 2 is a diagram conceptually showing a data structure of contents recorded on a memory card 25. FIG. FIG. 3 is a diagram illustrating a state of acceleration change when a predetermined condition is satisfied and a method of storing images and the like according to the first embodiment. 5 is a flowchart showing storage processing of the drive recorder according to the first embodiment. 7 is a flowchart showing thumbnail image creation and display processing according to the first embodiment. 5 is a flowchart showing time chart image creation and display processing according to the first embodiment. 5 is a flowchart illustrating map image creation and display processing according to the first embodiment. 3 is a screen display diagram showing an example of a display mode of thumbnail images and the like according to the first embodiment. FIG. FIG. 7 is a diagram illustrating a method for storing images and the like according to the second embodiment. FIG. 3 is a diagram showing an example of a display screen such as a thumbnail image.

Hereinafter, a display control system according to an embodiment of the present invention will be described in detail based on the drawings. Note that the present invention is not to be construed as being limited thereto, and various changes, modifications, and improvements can be made based on the knowledge of those skilled in the art without departing from the scope of the present invention.

[Example 1]
<Configuration of driving support system>
FIG. 1 is a diagram showing a schematic configuration of a driving support system according to a first embodiment of a display control system of the present invention.

As shown in FIG. 1, the driving support system includes a drive recorder 10 installed in a vehicle, a memory card 25 that stores images when a predetermined condition is satisfied in the drive recorder 10, and a memory card 25 that plays back images stored in the memory card 25. It is composed of a driving support device 30 for

The drive recorder 10 includes a first control unit 11 , an acceleration sensor (G sensor) 12 , a gyro sensor 13 , an atmospheric pressure sensor 14 , a GPS antenna 15 , and a GPS that measures the GPS position information of the vehicle from the GPS signal received by the GPS antenna 15 (Global Positioning System) A receiver 16, a first operation unit 17 including switches, buttons, etc., a first memory 18 for temporarily storing images, and a slot for inserting a memory card 25. a first IF (interface) 19 for writing images to, etc., a CCD camera 20 installed in the vehicle to continuously capture images in front of the vehicle at a predetermined rate, a vehicle signal acquisition unit 21, and a drive recorder. It has a power supply unit 22 and the like for supplying power to each of the 10 elements.

Further, the drive recorder 10 may be configured to cooperate with a navigation device (not shown) so that images can be reproduced on the display of the navigation device. Furthermore, although the GPS receiver 16 is not necessarily an essential component, it may be configured to acquire position information received by an external device, such as an AVM (Automatic Vehicle Monitoring) system or a navigation device.

The first control unit 11 is composed of a microcomputer including a CPU, ROM, RAM, etc., and controls the entire operation of the drive recorder 10.

The G sensor 12 detects gravitational acceleration (hereinafter simply referred to as acceleration) in two axial directions (X-axis and Y-axis) that are perpendicular to each other, and sends the detected acceleration (also referred to as G data) to the first control unit along with time data. Send to 11. The first control unit 11 can acquire G data (Gx, Gy) output from the G sensor 12 at intervals of, for example, 10 milliseconds, and can determine the value (magnitude) of acceleration from the G data.

Note that Gx is the acceleration in the X-axis direction (the longitudinal direction of the vehicle), and Gy is the acceleration in the Y-axis direction (the left-right direction of the vehicle). Furthermore, the G sensor 12 may be a 3-axis sensor that includes the Z-axis direction (the vertical direction of the vehicle), or a 3-axis sensor that does not use data on the acceleration Gz in the Z-axis direction. Also good.

The gyro sensor 13 detects the angular acceleration (rotation) of the vehicle, mainly detects changes in the traveling direction of the vehicle (i.e., rotation of the yaw (Z axis), which is a vertical axis), and uses the detected angular acceleration data. is transmitted to the first control unit 11 along with the time data. The first control unit 11 can acquire the angular acceleration data output from the gyro sensor 13 at intervals of, for example, 10 milliseconds, and can determine the value (magnitude) of the angular acceleration from the angular acceleration data.

The atmospheric pressure sensor 14 detects the atmospheric pressure outside the vehicle, calculates the altitude based on the detected atmospheric pressure value, and transmits the atmospheric pressure value and altitude value (atmospheric pressure/altitude data) to the first control unit 11 along with time data. . The first control unit 11 can acquire the atmospheric pressure/altitude data output from the atmospheric pressure sensor 14 at intervals of, for example, 10 milliseconds, and can determine the value (magnitude) of the atmospheric pressure/altitude from the atmospheric pressure/altitude data.

The first control unit 11 causes the CCD camera 20 to capture one image every 100 milliseconds, and sequentially and cyclically store the captured image together with time data in the first memory 18 (to a memory card 25 to be described later). primary memory). For example, it is configured such that image data for 24 seconds (240 images) of images captured by the CCD camera 20 is always stored in the first memory 18 . Note that the image taken by the CCD camera 20 may not be taken once every 100 milliseconds, but may be taken once every 50 milliseconds, for example. Further, the configuration may be such that a moving image taken by the CCD camera 20 is stored.

The vehicle signal acquisition unit 21 is connected to a fault diagnosis connector of the vehicle, acquires various signals and information (vehicle data) of the vehicle at intervals of, for example, 100 milliseconds, and uses the acquired vehicle data together with time data in the first control. 11. Vehicle data includes, for example, [1] a signal that detects a brake operation while driving the vehicle, [2] a signal that also detects a blinker operation, [3] a signal that also detects an accelerator operation, and [4] a signal that also detects a steering wheel rotation. the detected signal, [5] the signal that also detected the shift lever position, [6] the signal that also detected the handbrake operation, [7] the vehicle failure diagnosis information obtained from the vehicle failure diagnosis system (OBD) in the vehicle ( [8] Various vehicle information obtained via the in-vehicle LAN (CAN) (various function control data from the own vehicle's ECU (Electronic Control Unit), external networks, etc.) communication data from vehicles, etc.).

As an example, when the vehicle signal acquisition unit 21 acquires a signal that detects a brake operation, the vehicle signal acquisition unit 21 may include brake operation data indicating whether or not the brakes of the vehicle have been operated, and brake operation start time data indicating the time when the brake operation was started. And brake operation end time data indicating the time when the brake operation was ended is transmitted to the first control unit 11 . That is, based on the brake operation data, brake operation start time data, and brake operation end time data from the vehicle signal acquisition section 21, the first control section 11 determines whether or not a brake operation was performed, the time when the brake operation was started, and It is possible to determine the time when the brake operation was completed.

As another example, when the vehicle signal acquisition unit 21 acquires a signal that detects the rotation of the steering wheel, the vehicle signal acquisition unit 21 includes steering wheel rotation data indicating whether the steering wheel of the vehicle has been rotated, and steering wheel rotation start indicating the time when the steering wheel rotation is started. Time data and steering wheel rotation end time data indicating the time when the steering wheel rotation is ended are transmitted to the first control unit 11 . That is, based on the steering wheel rotation data, steering wheel rotation start time data, and steering wheel rotation end time data from the vehicle signal acquisition section 21, the first control section 11 determines whether or not the steering wheel has been rotated, the time when the steering wheel rotation has started, and It is possible to determine the time when the rotation of the steering wheel is completed.

Note that some or all of the GPS antenna 15, the GPS receiver 16, the first IF 19, the CCD camera 20, the vehicle signal acquisition section 21, etc. may be configured separately from the drive recorder 10. For example, when the drive recorder 10 is linked with an existing navigation device having a GPS function, the drive recorder 10 does not need a function such as the GPS receiver 16, so the cost of the drive recorder 10 can be kept low accordingly.

The driving support device 30 includes a second control section 31, a display section 32 composed of a display etc., an output section 33 composed of a printer etc. that prints the display screen on paper, and input devices such as a keyboard and a mouse. a second operation unit 34 for storing images, a second memory 35 for temporarily storing images, and a second IF (interface) 36 that includes a slot for inserting a memory card 25 and for reading images from the memory card 25, etc. , and an image processing unit 37 for performing predetermined image processing on the input image.

The second control unit 31 is a personal computer (PC) that includes a CPU, ROM, RAM, etc., and has driving support software installed therein, and interprets and executes programs included in the driving support software to control the driving support device 30. The various functions related to the characteristic parts of the present invention are realized by operating each component.

The memory card 25 is a rewritable nonvolatile semiconductor memory card having a storage capacity of 2 GB. This memory card 25 is inserted into a slot constituting the first IF 19 to store a predetermined image (for example, a predetermined Images for 10 seconds before and 5 seconds after the time when the condition was satisfied are stored. Thereafter, the memory card 25 is ejected from the slot constituting the first IF 19 and reinserted into the slot constituting the second IF 36 to output the stored image to the driving support device 30.

Although a semiconductor memory card is used as the memory card 25, the present invention is not limited thereto, and semiconductor memories other than card types, portable hard disks (HD), other storage media, etc. can be used. Furthermore, the storage capacity of a memory card or the like is arbitrary and can be freely determined depending on the purpose.

The drive recorder 10 detects when a predetermined condition is satisfied (that is, when an event that should be recorded by the drive recorder 10 occurs), specifically, (a) sudden braking, sudden steering, collision, etc.; , when an impact is applied to the vehicle due to the occurrence of an event equivalent to the occurrence of another accident, and the value (magnitude) of the G data output from the internal G sensor 12 exceeds a predetermined threshold. (b) When the emergency switch of the first operation unit 17 is pressed, etc., it is assumed that a predetermined condition is met and the detection is performed for several seconds to more than ten seconds before and after that point (for example, 10 seconds before, 5 seconds after, etc.) Various data are acquired together with predetermined condition fulfillment time data and recorded in the memory card 25 as one piece of driving information.

The driving information recorded in the memory card 25 includes G data output from the G sensor 12, angular acceleration data output from the gyro sensor 13, atmospheric pressure/altitude data output from the atmospheric pressure sensor 14, and positioning information obtained by the GPS receiver 16. It includes GPS position information, camera image data taken by the CCD camera 20, and various vehicle signals and information (detection data such as brake operation and steering wheel rotation, vehicle speed data, etc.) acquired by the vehicle signal acquisition unit 21.

The drive recorder 10 is capable of handling multiple camera images, one by one, for several seconds to ten seconds before and after (for example, 10 seconds before, 5 seconds after, etc.) from the time when an event to be recorded occurs and a predetermined condition is met. and records various data of driving information on the memory card 25.

<Memory card data structure>
Next, the data structure of the contents recorded on the memory card 25 will be explained with reference to FIG. FIG. 2 is a diagram conceptually showing the data structure of the contents recorded on the memory card 25. As shown in FIG.

As shown in FIG. 2, the corresponding driving information is recorded in the memory card 25 as driving information 1, driving information 2, and driving information 3, each time a predetermined condition is satisfied. Driving information 1 includes 150 camera images 1 to 150 corresponding to 15 seconds before and after the predetermined condition is met (10 seconds before, 5 seconds after) and image-related information including other driving information other than camera images. It consists of The image related information includes main item data including G data when a predetermined condition is satisfied and its time data, and related data 1 to 150 corresponding to each of the 150 camera images 1 to 150. The same applies to driving information 2 and 3.

The main item data includes G data, angular acceleration data, atmospheric pressure/altitude data, and respective time data, and the image-related data includes the shooting date and time of the camera image, and various signals and information of the vehicle at the time the camera image was taken. (Detection data such as brake operation and steering wheel rotation, vehicle speed data, etc.) and vehicle GPS position information.

<Acceleration change when predetermined conditions are met and how to store images, etc.>
Next, with reference to FIGS. 3 and 4, changes in acceleration (G data) detected by the G sensor 12 (see FIG. 1) of the drive recorder 10 when a predetermined condition such as an impact being applied to the vehicle is satisfied. The situation and the method of storing images and the like in the drive recorder 10 will be explained.

FIG. 3(a) shows a time-series change in the G data (combined value of Gx, Gy) output from the G sensor 12, and FIG. 3(b) and FIG. 3(c) show the fulfillment of each predetermined condition. FIG. 3(d) shows an example of an image period to be stored as one file in the memory card 25, and FIG. 3(e) is the source of the thumbnail image to be created. An example of image selection timing is shown. Note that the creation and display of thumbnail images will be described later. Further, FIG. 4 is a flowchart showing the recording process of the drive recorder.

For example, if a driver makes a sudden steering operation and is immediately rear-ended, as shown in FIG. 3(a), (1) First, the G sensor 1 The value (magnitude) of the G data output from the vehicle suddenly increases from almost zero, and (2) next, when the vehicle is rear-ended, an impact is applied to the vehicle again, and the value (magnitude) of the G data rapidly increases. Let me explain the case.

As shown in FIG. 3(a), (1) First, at time tp1 when the value (magnitude) of the G data rapidly increases, the value (magnitude) of the G data of the G sensor 12 changes to the threshold acceleration Gs (for example, 0.3G), the first control unit 11 determines (determines) that the predetermined condition is satisfied (YES in step S11 in FIG. 4), and further starts from the previous time when the predetermined condition was satisfied as described below. It is determined whether a "predetermined time" has elapsed (step S12 in FIG. 4). It is determined that a predetermined period of time has elapsed since the previous time when the predetermined condition was satisfied (YSE in step S12), and the image captured by the CCD camera 20 and always stored cyclically in the first memory 18 is updated. data (new data file) in the memory card 25 (step S13 in FIG. 4), and at the same time, time data (TP1) at time tp1 is stored in the memory card 25 as time data at the time when a predetermined condition is satisfied. Operate.

Specifically, as shown in FIG. 3(b), an image PA1 for TA seconds before time tp1, an image PB1 for TB seconds after time tp1, and time data (TP1) for time tp1, The data is controlled to be stored in the memory card 25 as a new data file. For example, TA can be 10 seconds and TB can be 5 seconds.

Note that the periods of TA and TB can be set freely. For example, while displaying the set time (seconds) on the setting screen (not shown) of the drive recorder 10, operate the time setting button on the first operation section 17 of the drive recorder 10 to set the time, and the set information You can set it to any time by saving it.

(2) Next, at time tp2, when the value (magnitude) of the G data rapidly increases "7 seconds after" time tp1, which is the point in time when the previous predetermined condition was satisfied, the value of the G data of the G sensor 12 is similarly changed. (magnitude) reaches the threshold acceleration Gs (for example, 0.3G), the first control unit 11 determines (determines) that the predetermined condition is satisfied again (YES in step S11 in FIG. 4). Furthermore, it is determined whether a "predetermined time" has elapsed since the previous time when the predetermined condition was met (step S12 in FIG. 4). It is determined that a predetermined period of time has not elapsed since the previous time when the predetermined condition was satisfied (NO in step S12), and the image captured by the CCD camera 20 and always stored cyclically in the first memory 18 is stored as the previous image. is stored in the memory card 25 as data (one data file continuing from the previous data file) (step S14 in FIG. 4) that continues the vehicle behavior data of It operates so as to be stored in the memory card 25 as time data at a certain point in time.

Specifically, if, at time tp2, a "predetermined time" has elapsed since the previous time when the predetermined condition was met, as shown in FIG. 3(c), the image for TA seconds before time tp2 is PA2, an image PB2 for TB seconds after time tp2, and time data (TP2) at time tp2 are controlled to be stored in the memory card 25 as a new data file. However, in this case (that is, when the predetermined time has not passed since the previous time when the predetermined condition was satisfied), as shown in FIG. 3(d), the image PA1[a] for TA seconds before time tp1, Time data TP1[b] at time tp1 and image PB1[c] for TB seconds after time tp1 are stored, and further, following the end of image PB1, image PA2 for TA seconds before time tp2 is stored. Among them, a partial image PA2a[d] subsequent to the last point in time (te1) of image PB1 excluding the overlapping portion with image PB1, time data TP2[e] at time tp2, and time data TP2[e] after time tp2. The image PB2[f] for TB seconds is stored, and [a] to [f] are stored as one data file.

That is, in this case, this one data file includes a series of continuous periods from the start of TA seconds before time tp1 (time ts1) to the end of TB seconds after time tp2 (time te2). At the same time, time data TP1 at time tp1 and time data TP2 at time tp2 are stored.

As described above, for example, in the case where (1) the driver makes a sudden steering operation and (2) is rear-ended immediately after that, a new driver may If the predetermined condition is satisfied, following the end of the image PB1 for TB seconds after the previous time when the predetermined condition was satisfied (tp1), an image for TA seconds before the time when the new predetermined condition was satisfied (tp2) Of PA2, a partial image PA2a subsequent to the last time point (te1) of image PB1 is stored.

Note that the above-mentioned "predetermined time", that is, the time from the time when the previous predetermined condition is satisfied [time tp1] to the time when the next predetermined condition is satisfied [time tp2] is TB seconds after time tp1 (for example, 5 seconds) and TA seconds (for example, 10 seconds) before time tp2 (for example, 15 seconds), and overlaps with TA seconds after time tp1 and TB seconds before time tp2. Suppose that there is. In other words, the end of TB seconds after time tp1 (time te1) is the same as the start of TA seconds before time tp2 (time ts2), or time te1 is earlier than time ts2. (time).

Next, the first control unit 11 determines whether or not a termination signal is received by turning off the ACC switch or power switch (not shown) in the first operation unit 17 (step S15 in FIG. 4). ), if an end signal is received (YES in step S15 in FIG. 4), end processing is performed (S16) and the series of processing ends. If the end signal has not been received (NO in step S15 in FIG. 4), steps S12 to S14 in FIG. 4 are repeatedly executed.

As mentioned above, when an event such as an impact being applied to the vehicle occurs and the value (magnitude) of the G data detected by the G sensor 12 exceeds a predetermined threshold, each time a predetermined condition is met (event occurrence). , the first control unit 11 outputs (a) image data, (b) time data (TP1, TP2) at the time when a predetermined condition is satisfied, and (c) detected G data (Gx, Gy) of the G sensor 12 and (d) angular acceleration data detected by the gyro sensor 13 and its time data, (e) atmospheric pressure/altitude data and its time data by the atmospheric pressure sensor 14, (f) time tp1 acquired by the vehicle signal acquisition unit 21 , vehicle data and its time data for TA seconds before tp2 and TB seconds after times tp1 and tp2 (for example, brake operation data and its time data, steering wheel rotation data and its time data, vehicle speed data and its time data, etc.) ) is stored in the memory card 25. Note that the configuration may be such that only part of the data described above is stored in the memory card 25.

The number of events (number of predetermined condition satisfaction) stored in the memory card 25 can be varied depending on the storage capacity of the memory card 25, but it may be possible to store data for 500 events or more, for example. preferable. In addition, the first control unit 11 saves the data file to the memory card 25 every time the predetermined condition is satisfied, except in the case where it is determined that the predetermined condition is satisfied multiple times within a predetermined period of time as described above. Create image data, time data (TP1, TP2,...) at the time when predetermined conditions are met, G data (Gx, Gy) of the G sensor 12 and its time data, angular acceleration data and its time data, atmospheric pressure/altitude data It is preferable to store the time data, vehicle data, and time data.

Note that when the above-mentioned predetermined condition is satisfied, the predetermined condition is satisfied when the threshold acceleration Gs is exceeded. For example, if the amount of change in acceleration per unit time exceeds a certain value (in 0.1 seconds, It may be determined that the predetermined condition is satisfied when the value (magnitude) of the G data changes by 0.1 G or more.

<Thumbnail image creation and display processing>
Next, the creation and display processing of thumbnail images in the driving support device 30 will be described with reference to FIG. 5. In this example, a process for creating and displaying thumbnail images regarding a series of vehicle behaviors when a predetermined condition is satisfied twice within a predetermined time will be described.

FIG. 5 is a flowchart showing the creation and display processing of thumbnail images according to the first embodiment. This is realized by the CPU executing the control program according to the control program, and is started based on the operation of the second operation unit 34 to start the driving support software. Further, it is assumed that the memory card 25 in which images are stored in the drive recorder 10 is inserted into the second IF 36 constituting the slot at the time when the process of the flowchart shown in FIG. 5 is started.

In step S21, the second control unit 31 acquires time data (TP1, TP2) at the time (time) when a predetermined condition is satisfied from among the data stored in the memory card 25.

In the next step S22, the second control unit 31 selects a plurality of images taken at a plurality of different timings from among the images PA1, PB1, PA2a, and PB2 in the period before and after the times tp1 and tp2 shown in FIG. 3(d). Select an image.

Specifically, this control program includes the TA of time tp1 shown in FIG. The image P1 taken at time ts1 seconds (for example, 10 seconds) before is selected as the "first image", and the images P2 to 7 taken at predetermined intervals after time ts1 are sequentially selected as the "second to seventh images". ” and selects the image P8 photographed at time tp1 as the “eighth image”. Furthermore, images P9 to P11 taken at predetermined intervals after time tp1 are selected as "9th to 11th images", and image P12 taken at time tp2 is selected as "12th image". Furthermore, images P13 to P15 taken at predetermined intervals after time tp2 are selected as "13th to 15th images", and finally images taken at time te2 TB seconds (for example, 5 seconds) after time te2 are selected. Control processing such as selecting image P16 as the "sixteenth image" is programmed. The second control unit 31 performs selection control of the first to sixteenth images from among the images PA1, PB1, PA2a, and PB2 according to such a control program.

Note that "2nd to 7th, 9-11th, and 13th-15th images" other than the 1st, 8th, 12th, and 16th images (images P1, P8, P12, and P16) taken at times ts1, tp1, tp2, and te2 The image interval of images P2 to 7, 9-11, and 13-15 selected as It is recommended that the configuration be configured to select the . For example, while displaying the set time (seconds) on the setting screen (not shown) of the driving support device 30, operate the time setting button on the second operation section 34 of the driving support device 30 to set the time, and then set the time. By saving the information, you can set it at any time.

In the next step S23, the second control unit 201 instructs the image processing unit 37 to select the “first to sixteenth images” selected in step S22 according to the control program stored in the ROM in the second control unit 201. ” (P1 to P16) to perform image processing to create the first to 16th thumbnail images.

In order to create thumbnail images from the selected first to sixteenth images, for example, the thumbnail images are created by performing image processing to reduce the size of the original first to sixteenth images, respectively. In addition to image processing for reduction, other predetermined image processing may be performed, such as image processing for enlarging the selected 1st to 16th images, image processing for cutting out a part of the image, etc. A thumbnail image may be created by applying Alternatively, the selected first to sixteenth images may be used as thumbnail images without any image processing.

In the following step S24, the second control unit 31 instructs the image processing unit 37 to set the times tp1 and tp2 (i.e., predetermined times) created in step S23 according to the control program stored in the ROM in the second control unit 31. Image processing is performed to superimpose color lines, characters, marks, etc. on the eighth and twelfth thumbnail images (at the time the condition is satisfied).
For example, in the eighth thumbnail image, a yellow horizontal line is superimposed on the lower part of the image, and yellow characters are superimposed on the upper right part of the image. Further, in the twelfth thumbnail image, a green horizontal line is superimposed on the lower part of the image, and green characters are superimposed on the upper right part of the image. As for the displayed characters, colored characters such as "impact" and "switch" indicating the type of predetermined condition are superimposed.

In the following step S25, the second control unit 31 sends the first to sixteenth thumbnail images created in step S24 to the display processing unit 38 according to the control program stored in the ROM in the second control unit 31. The display unit 32 causes the display unit 32 to perform display processing. Specifically, as will be described later, thumbnail images are arranged in a matrix structure and displayed as a list on the same screen.
This completes the process of creating and displaying thumbnail images related to a series of vehicle behaviors when the predetermined condition is satisfied twice within a predetermined period of time.

<Time chart image creation and display processing>
Next, the creation and display processing of a time chart image in the driving support device 30 will be described with reference to FIG. 6. In this example, a process for creating and displaying a time chart image regarding a series of vehicle behaviors when a predetermined condition is satisfied twice within a predetermined time will be described.

FIG. 6 is a flowchart showing the creation and display processing of a time chart image according to the first embodiment. This is realized by the CPU executing the control program according to the loaded control program, and is started based on the operation of the second operation unit 34 to start the driving support software. Further, it is assumed that the memory card 25 in which images are stored in the drive recorder 10 is inserted into the second IF 36 constituting the slot at the time when the process of the flowchart shown in FIG. 6 is started.

In step S31, the second control unit 31 acquires time data (TP1, TP2) at the time (time) when a predetermined condition is satisfied from among the data stored in the memory card 25.
In the next step S32, the second control unit 31 instructs the image processing unit 37 to add dots, vertical lines, etc. to the time axis of the time chart image according to the control program stored in the ROM in the second control unit 31. Performs image processing that superimposes text, etc.

For example, the time axis of a time chart image that graphically displays the time-series changes in acceleration values (G data) with time on the horizontal axis and the size of the G data on the vertical axis, such as a line graph,
A yellow dot and a yellow vertical line are superimposed on the corresponding position based on the time data (TP1), and a yellow character is further superimposed. Similarly, a green dot and a green vertical line are superimposed on the time axis of the time chart image at a corresponding position based on the time data (TP2), and green characters are further superimposed.

In the subsequent step S33, the second control unit 31 displays the time chart image subjected to the image processing in step S32 to the display processing unit 38 according to the control program stored in the ROM in the second control unit 31. Perform display processing to display the image.
This completes the process of creating and displaying a time chart image regarding a series of vehicle behaviors when the predetermined condition is satisfied twice within a predetermined period of time.

<Map image creation and display processing>
Next, map image creation and display processing in the driving support device 30 will be described with reference to FIG. 7. In this example, a process for creating and displaying a map image regarding a series of vehicle behaviors when a predetermined condition is satisfied twice within a predetermined time will be described.

FIG. 7 is a flowchart showing the process of creating and displaying a map image according to the first embodiment. This is realized by the CPU executing the control program according to the control program, and is started based on the operation of the second operation unit 34 to start the driving support software. Further, it is assumed that the memory card 25 in which images are stored in the drive recorder 10 is inserted into the second IF 36 constituting the slot at the time when the process of the flowchart shown in FIG. 7 is started.

In step S41, the second control unit 31 acquires time data (TP1, TP2) at the time (time) when a predetermined condition is satisfied from among the data stored in the memory card 25.
In the next step S42, the second control unit 31 obtains GPS position information (GPS position data) at the time of the time data (TP1, TP2) obtained in step S41.

In the subsequent step S43, the second control unit 31 causes the image processing unit 37 to superimpose (superimpose) arrows, characters, etc. on the map image according to the control program stored in the ROM in the second control unit 31. (pause) image processing.
For example, a yellow arrow and yellow text are superimposed on a road map at a corresponding position based on the GPS position data at the time of the time data (TP1). Similarly, a green arrow and green text are superimposed on the corresponding position on the road map based on the GPS position data at the time of the time data (TP2).

In subsequent step S44, the second control unit 31 causes the display processing unit 38 to display the map image processed in step S43 on the display unit 32 according to the control program stored in the ROM in the second control unit 31. Perform display processing to display.
This completes the process of creating and displaying a map image related to a series of vehicle behaviors when the predetermined condition is met twice within a predetermined period of time.

<Display example of thumbnail images, etc.>
Next, one aspect of the display image displayed on the display unit 32 of the driving support device 30 will be described with reference to FIG. 8. FIG. 8 is a screen display diagram showing an example of a display mode of thumbnail images and the like according to the first embodiment.
The display mode of the thumbnail images illustrated in FIG. 8 is a state in which thumbnail images related to a series of vehicle behaviors when a predetermined condition is satisfied twice within a predetermined time are displayed on the display unit 32 of the driving support device 30. It shows.

As shown in FIG. 8, a playlist section 42, a thumbnail image section 43, a time chart section 44, and a map section 45 are displayed on a screen 41 displayed on the display section 32. In addition, the screen 41 also displays acceleration information (G data), speed information (mph), position information (latitude, longitude), etc. when the image to be displayed was taken.

In the playlist section 42, file numbers 46 for distinguishing driving information files recorded each time one or more predetermined conditions are met are listed together with type letters 47 for predetermined conditions such as "impact" and "switch." Is displayed. Further, even if there are two or more times when the predetermined condition is met in one driving information file, the type characters for all the times are displayed. One driving information file can be selected from among the plurality of driving information files listed in the playlist section 42, and the selected second driving information file is surrounded by a thick line frame 48. and is displayed separately from other driving information files that have not been selected.

In the second selected driving information file, there are two times when the predetermined condition is satisfied, and the type of the first predetermined condition is displayed in yellow characters 49 "Impact 1", and the type of the second predetermined condition is displayed. "Shock 2" is displayed in green characters 50. In addition, in the fifth driving information file, there are three times when the predetermined condition is satisfied, and the types of the predetermined conditions for the first to third times are displayed in different colored characters (for example, yellow text, green text, and blue text). ing.

In addition, "Impact 1" indicates that the type of the first predetermined condition is "When an impact is applied to the vehicle," and "Impact 2" indicates that the type of the second predetermined condition is "When an impact was applied to the vehicle." "time". Note that when the type of the predetermined condition is "when an emergency switch is pressed", it is displayed as "switch" or the like.

Thumbnail images created from camera images included in the driving information file selected in the playlist section 42 are displayed in the thumbnail image section 43, which will be described later, and when another driving information file is selected in the playlist section 42, the selected driving information file is displayed. The display is switched to another thumbnail image created from a camera image included in another driving information file.

The thumbnail image section 43 displays a thumbnail image created from the camera image included in the second driving information file selected in the playlist section 42 described above. When another driving information file is selected in the playlist section 42, the display is switched to another thumbnail image created from a camera image included in the selected other driving information file.

In the thumbnail image section 43, 16 thumbnail images 51 (M1 to M16) arranged in a matrix structure of 4 rows in the vertical direction and 4 columns in the horizontal direction are displayed as a list on the same screen. These 16 thumbnail images 51 (M1 to M16) are created from the images P1 to P16 shown in FIG. That is, the thumbnail images are arranged and displayed from left to right in one row, and the thumbnail image at the right end is followed by the thumbnail image at the left end in the row below.

Among the 16 thumbnail images M1 to M16, the thumbnail images M8 and M12 at times tp1 and tp2 when a predetermined condition is satisfied are displayed with colored horizontal lines and colored letters to distinguish them from other thumbnail images. .
The thumbnail image M8 at time tp1 displays a yellow horizontal line 52 and yellow letters 53 indicating the type of predetermined condition "Impact 1", and the thumbnail image M12 displays a green horizontal line 54 and "Impact 2". ” green characters 55 representing the type of predetermined condition are displayed.

In the time chart section 44, time-series changes in acceleration values (G data) acquired from the image-related information included in the second driving information file selected in the playlist section 42 are displayed, with the horizontal axis being time. A time chart is displayed as a line graph or the like, with the vertical axis representing the size of the G data. Specifically, on the horizontal axis of the time chart, when the predetermined condition is satisfied for the first time, a yellow dot 56 and a yellow vertical line 57 are displayed, and the type of the predetermined condition "Impact 1" is displayed. Yellow characters 58 are displayed. Similarly, when the predetermined condition is met for the second time, a green dot 59 and a green vertical line 60 are displayed, as well as green text 61 indicating the type of predetermined condition "Impact 2".

The map section 45 displays a road map showing the vehicle's position at the time when a predetermined condition is met, based on the GPS position information of the vehicle acquired from the image-related information included in the second driving information file selected in the playlist section 42. displayed above. Specifically, on the road map, a yellow arrow 62 and yellow letters 63 indicating the type of predetermined condition "Impact 1" are displayed at the corresponding position when the predetermined condition is satisfied for the first time. Similarly, a green arrow 64 and green characters 65 indicating the type of predetermined condition "Impact 2" are displayed at the corresponding position when the predetermined condition is satisfied for the second time.

Although 16 thumbnail images are displayed in FIG. 8, the number of thumbnail images to be displayed is not limited to this, and it is also possible to select another number of thumbnail images to be displayed. Furthermore, the elements to be displayed may be a thumbnail image, a time chart of G data, a map, or together with other elements (such as a time chart of vehicle speed).

As described above, the driving support device 30 of the first embodiment has the following advantages. That is,
(1) A predetermined condition is met multiple times.The time data at the time the predetermined condition was met multiple times is recorded in association with the vehicle behavior over a series of periods, so the predetermined condition is met multiple times. Based on the time data at the time, the behavior of the vehicle at the time when the predetermined condition is satisfied can be easily specified.
For example, in relation to vehicle behavior over a series of periods in which a predetermined condition is met twice, such as when a sudden steering wheel operation is performed, followed by a rear-end collision and an impact is applied to the vehicle, the time at which the predetermined condition is met twice is determined. Easily identify vehicle behavior at each point in time based on data, and easily identify and use the vehicle behavior information you need from a large number of "vehicle behaviors over a series of periods" be able to.

(2) Like the display mode of thumbnail images etc. illustrated in FIG. 8, the playlist section 42 displays a list of the file numbers of the driving information files and the type characters at all times when a predetermined condition is met. Therefore, one driving information file can be easily selected from a plurality of driving information files by checking the number of times a predetermined condition is satisfied and the type thereof included in one driving information file.
Further, since the type of the predetermined condition is displayed in letters of a different color each time the predetermined condition is established, it is possible to determine that the time is different from the color information. Furthermore, by predetermining the order by color, for example, the first color is "yellow", the next is "green", and the next is "blue", the time when a predetermined condition is satisfied can be determined from the color information. It is also possible to determine the order of

(3) As in the display mode of thumbnail images etc. illustrated in FIG. 8, the thumbnail image section 43 displays thumbnail images M8 at times tp1 and tp2, which are times when a predetermined condition is satisfied, among the 16 thumbnail images M1 to M16. , M12, a yellow or green horizontal line or a predetermined condition type letter is displayed, so that the thumbnail images M8, M12 at the time when the predetermined condition is met and the thumbnail images at a time other than when the predetermined condition is met can be distinguished at a glance. I can see it.
Further, since horizontal lines and predetermined condition type characters of different colors are displayed on the thumbnail images M8 and M12 at different times when the predetermined condition is met, the two can be distinguished at a glance.

Furthermore, the colors of the horizontal lines and predetermined condition type letters (yellow and green) displayed on the thumbnail images M8 and M12 are set to the same colors (yellow and green) as the colors of the predetermined condition type letters displayed in the playlist section 42. Therefore, it is possible to distinguish and visually recognize at a glance the thumbnail images displayed in the same color when the same predetermined condition was met, and the predetermined condition type displayed in the playlist section 42, assuming that the same color was displayed at the time when the same predetermined condition was met. can.

(4) As in the display mode of thumbnail images etc. illustrated in FIG. Since the type characters are displayed, it is possible to easily understand the G data at the time when the predetermined condition is met on the horizontal axis of the time chart.
In addition, on the horizontal axis of the time chart, different color dots, vertical lines, and predetermined condition type letters are displayed at different predetermined condition fulfillment points, so that the two can be distinguished at a glance.

Furthermore, the colors of the dots, vertical lines, and predetermined condition type letters displayed on the horizontal axis of the time chart (yellow and green) are the same as the colors of the predetermined condition type letters displayed in the playlist section 42 (yellow and green). Therefore, it is assumed that the display in the same color is the time when the same predetermined condition was met, and the dots, vertical lines, and predetermined condition type letters in the time chart section 44 and the predetermined condition type letters at the time when the same predetermined condition was met are displayed in the playlist section 42. The predetermined condition types can be distinguished and visually recognized at a glance.

(5) As in the display mode of thumbnail images etc. illustrated in FIG. 8, the map section 45 displays a yellow or green arrow or a predetermined condition type character on the road map, indicating the position at the time when the predetermined condition is satisfied. Therefore, the position on the road map at the time when the predetermined condition is satisfied can be easily grasped.
Further, on the road map, arrows and predetermined condition type characters of different colors are displayed at positions at different predetermined condition fulfillment points, so that the two can be distinguished at a glance.

Furthermore, the colors of the arrows and predetermined condition type letters displayed on the road map (yellow and green) are the same as the colors of the predetermined condition type letters displayed in the playlist section 42 (yellow and green). , assuming that the same color is displayed at the time when the same predetermined condition is met, the arrows and predetermined condition type font colors in the map section 45 and the predetermined condition type displayed in the playlist section 42 at the time when the same predetermined condition is met can be viewed at a glance. They can be distinguished and visually recognized.

[Example 2]
In Example 2, as in Example 1, (1) first, the value (magnitude) of the G data increases rapidly due to the shock applied to the vehicle due to sudden steering wheel operation, and (2) secondly, there is a rear-end collision. Now, the case where an impact is applied to the vehicle again and the value (magnitude) of the G data increases rapidly, and then (3) the emergency switch of the first operation section 17 is pressed will be explained with reference to FIG. do.
Note that (1) first, the value (magnitude) of the G data increases rapidly due to the shock applied to the vehicle due to a sudden steering operation, and (2) secondly, due to the rear-end collision, the vehicle receives another shock and the G data increases. The process is the same as in Example 1 until the value (magnitude) of . , FIG. 3(c), and FIG. 3(d), so the same reference numerals are used and some explanations thereof will be omitted.

(1) First, at time tp1, the first control unit 11 determines (determines) that a predetermined condition is satisfied, stores the image captured by the CCD camera 20 in the memory card 25, and simultaneously stores the time data at time tp1. It operates to store (TP1) in the memory card 25 as time data at the time when a predetermined condition is satisfied. Specifically, as shown in FIG. 9A, image PA1, image PB1, and time data (TP1) at time tp1 are stored in the memory card 25 as a new data file.

(2) Next, at time tp2, which is “7 seconds after” time tp1, the first control unit 11 again determines (determines) that the predetermined condition is satisfied, and changes the image taken by the CCD camera 20 from the previous time. At the same time, the time data (TP2) at time tp2 is stored in the memory card 25 as the time data at the time when a predetermined condition is satisfied. Specifically, as shown in FIG. 9(c), image PA1, time data TP1, image PB1, partial image PA2a excluding the portion of image PA2 that overlaps with image PB1, and time data TP2. , image PB2 are stored as one data file.

(3) Further, at time tp3, which is “11 seconds after” time tp2, when the emergency switch of the first operation unit 17 is pressed, the first control unit 11 again determines that the predetermined condition is satisfied (judgment ) (YES in step S11 in FIG. 4), and further determines whether a "predetermined time" has elapsed since the previous time when the predetermined condition was satisfied (step S12 in FIG. 4). It is determined that a predetermined period of time has not elapsed since the previous time when the predetermined condition was satisfied (NO in step S12), and the image captured by the CCD camera 20 and always stored cyclically in the first memory 18 is stored as the previous image. is stored in the memory card 25 as data (one data file continuing from the previous data file) (step S14 in FIG. 4) that continues the vehicle behavior data of It operates so as to be stored in the memory card 25 as time data at a point in time.

Specifically, if, at time tp3, a "predetermined time" has elapsed since the previous time when the predetermined condition was met, as shown in FIG. 9(d), the image for TA seconds before time tp3 is PA3, an image PB3 for TB seconds after time tp3, and time data (TP3) at time tp3 are controlled to be stored in the memory card 25 as a new data file. However, in this case (that is, when the predetermined time has not passed since the previous time when the predetermined condition was satisfied), as shown in FIG. 9(e), the image PA1[a] for TA seconds before time tp1, Time data TP1[b] at time tp1 and image PB1[c] for TB seconds after time tp1 are stored, and further, following the end of image PB1, image PA2 for TA seconds before time tp2 is stored. Among them, a partial image PA2a[d] subsequent to the last point in time (te1) of image PB1 excluding the overlapping portion with image PB1, time data TP2[e] at time tp2, and subsequent partial image PA2a[e] after time tp2. The image PB2 [f] for TB seconds is stored, and furthermore, following the end of the image PB2, the image PB2 of the image PA3 for TA seconds before time tp3 excluding the overlapping part with the image PB2 is stored. The continuous partial image PA3a[g] after the last time point (te2), the time data TP3[h] at time tp3, and the image PB3[i] for TB seconds after time tp3 are stored, and [a ] to [i] are stored as one data file.

That is, in this case, this one data file includes a series of continuous periods from the start of TA seconds before time tp1 (time ts1) to the end of TB seconds after time tp3 (time te3). It also stores time data TP1 at time tp1, time data TP2 at time tp2, and time data TP3 at time tp3.

As described above, for example, when (1) the steering wheel is suddenly operated, (2) a rear-end collision occurs immediately after that, and (3) the emergency switch is pressed after that, the predetermined condition changes from the time when the previous predetermined condition was met. If a new predetermined condition is satisfied before time has elapsed, and another new predetermined condition is also satisfied before a predetermined time has elapsed from the time when this new predetermined condition is satisfied, the previous predetermined condition is Following the end of the image PB1 for TB seconds after the point in time when the new predetermined condition is established (tp1), the last point in time (te1) of the image PB1 among the images PA2 for TA seconds before the point in time when the new predetermined condition is established (tp2). ) and subsequent partial images PA2a are stored, and subsequent to the last part of the image PB2 for TB seconds after the point in time when a new predetermined condition is met (tp2), another partial image PA2a is stored at the point in time when another new predetermined condition is met (tp3). ), a partial image PA3a subsequent to the last time point (te2) of the image PB2 is stored.

As described above, the driving support device 30 of the second embodiment has the following advantages. That is,
For example, there are two times when a predetermined condition is met, such as when the steering wheel is suddenly turned, and then the vehicle is rear-ended and an impact is applied to the vehicle.In addition, there are three times in total when the emergency switch is pressed and the predetermined condition is met. In relation to the vehicle behavior over a series of periods, the vehicle behavior at each point in time can be easily identified based on the time data at the time when a predetermined condition is satisfied three times, and the behavior of the vehicle over a large number of "series of periods" can be easily identified. From among these, users can easily identify and use the vehicle behavior information they need.

<Display example>
FIG. 10 is a diagram showing an example of a display screen for thumbnail images and the like. In FIG. 10, the same components as in FIG. 8 are given the same numbers and their explanations will be omitted.
This display screen example shows a case where the memory card 25 that is installed in the drive recorder 10 and records driving information including camera images and image-related information is taken out and displayed on the display unit 32 of the driving support device 30. be.

In the display screen example of FIG. 10, the playlist section 42 includes file numbers 1 to 6, and following each file number, the date and time (for example, , "May 21, 2012 14:09:16," etc.) and the type character of the predetermined condition (for example, "impact" etc.) are displayed.
Regarding the time when the predetermined condition is met, if each driving information file contains data at the time when multiple predetermined conditions were met, here, due to the display space, we will use the time when the first predetermined condition was met. However, the times at which all the predetermined conditions included in each driving information file are satisfied may be displayed.
In addition, in the playlist section 42 of FIG. 10, the second driving information file is selected, and the portion of the selected second driving information file (horizontally long strip display section) is displayed as the unselected driving information file ( 1, 3 to 6) (horizontally long strip-shaped display area).

In the display screen example of FIG. 10, the thumbnail image section 43 displays a thumbnail image created from the camera image included in the second driving information file selected in the playlist section 42 described above.

The thumbnail image section 43 displays 16 thumbnail images arranged in a matrix structure of 4 rows x 4 columns and displayed as a list on the same screen. The 16 thumbnail images are arranged and displayed in chronological order from the top left to the bottom right of the display screen. The thumbnail image at the top left of the display screen is the first thumbnail image, and the eighth and twelfth thumbnail images are displayed with colored horizontal lines and colored letters so that they can be distinguished from other thumbnail images. In the eighth thumbnail image, a yellow horizontal line is displayed below the thumbnail image, and yellow characters indicating the type of predetermined condition "Impact 1" are displayed at the upper right of the thumbnail image. Further, in the twelfth thumbnail image, a green horizontal line is displayed below the thumbnail image, and green characters indicating the type of predetermined condition "Impact 2" are displayed at the upper right of the thumbnail image.

In the display screen example of FIG. 10, the time chart section 44 displays the time-series changes in the G data acquired from the image-related information included in the second driving information file selected in the playlist section 42 on the horizontal axis. The time chart is displayed as a line graph with time as the vertical axis and the size of the G data as the vertical axis.
On the time chart horizontal axis, the time chart section 44 displays a vertically elongated yellow frame line when the predetermined condition is met for the first time, and similarly, displays a green vertical frame line when the predetermined condition is met for the second time. A vertically long frame line is displayed.

In the display screen example shown in FIG. 10, the map section 45 displays predetermined conditions based on the vehicle's GPS position data acquired from the image-related information included in the second driving information file selected in the playlist section 42. The location at the time of establishment is displayed on the road map.
The map section 45 displays a yellow arrow 61 on the road map at the corresponding position when the predetermined condition is met for the first time, and similarly, a green arrow 61 is displayed at the corresponding position when the predetermined condition is met for the second time. Displaying an arrow.

<Modified example>
The present invention is not limited to the contents described in the embodiments of the present invention described above, and various modifications are possible. As a modification thereof, for example, it may be implemented as follows.

(1) In the embodiment described above, it is determined that the predetermined condition is satisfied when the value (magnitude) of the G data output from the G sensor 12 reaches the threshold acceleration Gs (times tp1, tp2). However, the present invention is not limited to this, and for example, when the value (magnitude) of the angular acceleration data output from the gyro sensor 13 or the barometric pressure/altitude data output from the barometric pressure sensor 14 reaches a predetermined value, it is determined that the predetermined condition is satisfied. You can judge. Alternatively, it may be determined that a predetermined condition is satisfied based on the result of analyzing the recorded video.
In addition, events occur when a signal is input from an external port, or when a command is received via communication (for example, RS-232C) from an external device such as an AVM-ECU (Automatic Vehicle Monitoring - Engine Control Unit). It may be sometimes.

(2) In the embodiment described above, the G data includes component acceleration (G data) Gx in the X-axis direction (vehicle longitudinal direction) and component acceleration (G data) Gy in the Y-axis direction (vehicle left-right direction). Although the composite value is used to determine whether the predetermined condition is met, the present invention is not limited to this, and each component acceleration (Gx, Gy) may be used individually to determine whether the predetermined condition is met. For example, when the change pattern of the value (magnitude) of each component follows a predetermined pattern, such as when Gy exceeds a predetermined threshold within a predetermined time after Gx exceeds a predetermined threshold, the predetermined condition is met. It may be determined that this has been established. Further, in addition to Gx and Gy, component acceleration Gz in the Z-axis direction (vertical direction of the vehicle) may also be taken into consideration to determine whether the predetermined condition is met.

(3) In the embodiment described above, the TA seconds and TB seconds before and after the times tp1 and tp2 at which it is determined that the predetermined condition is met are different times (in the example, 10 seconds before and 5 seconds after). In particular, the TA seconds before times tp1 and tp2 are lengthened and the subsequent TB seconds are shortened, but the invention is not limited to this, for example, the TA seconds before times tp1 and tp2 are shortened. However, the time of the subsequent TB seconds may be made longer (for example, 5 seconds before and 15 seconds after), or the time of TA seconds and the time of TB seconds may be the same time.

(4) Not limited to the embodiments described above, the time of TA seconds and the time of TB seconds before and after the times tp1 and tp2 determined that the predetermined conditions are met, or the total time of TA seconds and TB seconds, depends on the type of the predetermined condition. It is better to set it at a different time. For example, the recording period (time) of vehicle behavior information that is recorded when a predetermined condition is met may be made longer for types that require a long time, and shorter for types that require a short time.

(5) In the embodiment described above, the time data at the time when the predetermined condition was met was recorded in the same data file as vehicle behavior data such as image data and G data, but the present invention is not limited to this. The time data and the vehicle behavior data may be recorded in a data file separate from the data file recorded with the vehicle behavior data in such a manner that the relationship between the time data and the vehicle behavior data can be specified.

(6) In the embodiment described above, the time data (TP1, TP2) at that time is stored as information that can identify the time when the predetermined condition is satisfied (tp1, tp2), but the present invention is not limited to this. Elapsed time data from the current time may be stored. The time of the reference point is, for example, the start time of a series of periods (that is, the start time of TA seconds before the first predetermined condition is met in the period recorded as one data file), and from this start time It is preferable to use the elapsed time up to the time when the predetermined condition is met.

(7) Not limited to the embodiments described above, when vehicle behavior information such as GPS position data is repeatedly acquired at predetermined time intervals, the time point when the predetermined condition is met is the time point that matches any of the predetermined time intervals. It's good to do that.
For example, if GPS position data is acquired at 1-second intervals, and the time when the predetermined condition is met is 0.6 seconds after the time when the GPS position data is acquired, then the next time is when the GPS position data is acquired. Assuming that the predetermined condition is satisfied, that time is set as the time point when the predetermined condition is satisfied. In this way, the time when the predetermined condition is satisfied can be made to coincide with the time when the GPS position data is obtained, and the time data when the GPS position data is obtained can be obtained as the time data when the predetermined condition is satisfied.

(8) In the above-described embodiment, the type of the predetermined condition is displayed in the playlist section 42 with letters of different colors each time the predetermined condition is satisfied, but the present invention is not limited to this, and for example, It is best to display it with a colored fill or background. The same applies to the type characters of the predetermined conditions displayed in the thumbnail image section 43, time chart section 44, and map section 45.

(9) In the embodiments described above, the display control system of the present invention was explained using an example of a driving support system (driving support device 30), but it can be implemented as a function of various electronic devices. For example, it may be incorporated as a function in a navigation device, drive recorder, radar detector, or car audio.

(10) Not limited to the embodiments described above, the control program pre-stored in the ROM of the second control unit 31 of the driving support device 30 can be transferred to a portable terminal such as a general-purpose personal computer, a mobile phone, a smartphone, or a portable game machine. The computer installed in the mobile terminal executes the control process of the second control unit 31, reads the images and various data stored in the memory card 25, and creates images from the loaded images and various data. Thumbnail images may also be displayed.

(11) Each function of the above embodiment is realized by writing the function in a computer-readable programming language and having the computer of the second control unit 31 execute the program, but the present invention is not limited to this. First, for example, the program may be distributed among a plurality of computers and processed in a distributed manner.

10 Drive recorder 11 First control section 12 Acceleration sensor (G sensor)
13 Gyro sensor 14 Barometric pressure sensor 15 GPS antenna 16 GPS receiver 17 First operation unit 18 First memory 19 First IF (interface)
20 CCD camera 21 Vehicle signal acquisition section 22 Power supply section 25 Memory card 30 Driving support device 31 Second control section 32 Display section 33 Output section 34 Second operation section 35 Second memory 36 Second IF (interface)
37 Image processing section 38 Display processing section 41 Screen 42 Playlist section 43 Thumbnail image section 44 Time chart section 45 Map section 46 File number 47 Type character 48 Thick line frame 49, 53, 58, 63 Yellow character 50, 55, 61, 65 Green text 51 Thumbnail image 52 Yellow horizontal line 54 Green horizontal line 56 Yellow dot 57 Yellow vertical line 59 Green dot 60 Green vertical line 62 Yellow arrow 64 Green arrow

Claims (4)

Based on data recorded in a recording means that records images of the surroundings of the vehicle during a predetermined period including at least one of before and after the time when the predetermined condition is satisfied, the time when the predetermined condition is satisfied can be specified. A system that displays
displaying a list of thumbnail images of images captured at each of a plurality of time points in the predetermined period;
A system having a function of displaying thumbnail images at a time when the predetermined condition is satisfied among the plurality of time points in association with information indicating the type of the predetermined condition . the predetermined period is plural;
The display function is as follows:
Displaying a playlist section provided corresponding to each of the plurality of predetermined periods and including a button for displaying a list of thumbnail images corresponding to images captured during the predetermined period;
The type of the predetermined condition is displayed for each of the button in the playlist section and the thumbnail image that satisfies the predetermined condition among the list of thumbnail images displayed in response to the operation of the button. The system according to claim 1, wherein the system displays information in association with each other. The predetermined conditions are conditions related to behavior that occurs in the vehicle,
The display function is as follows:
further having a function of displaying time-series changes in behavior occurring in the vehicle,
The function to display the above-mentioned time-series changes is
3. A position corresponding to a point in time when the predetermined condition is satisfied in the image showing the time-series change is displayed using the same aspect as information associated with the thumbnail image corresponding to the point in time. The system described. A program for causing a computer to implement the functions of the system according to any one of claims 1 to 3.

Images