JP2020010336A - Display control system, display control method, and program - Google Patents

Abstract

To provide a display control system for performing control to display thumbnail images related to an event unit video recorded by a driver recorder mounted on a vehicle.SOLUTION: A driving support device 30 is a display control system for displaying multiple thumbnail images corresponding to different time points within a range of an event unit video. Contents of an event unit video are enabled to be confirmed from multiple thumbnail images corresponding to different time points within a range of an event unit video. Thus, an event unit video can be more easily found from thumbnail images compared with a case where contents of an event unit video are confirmed from one thumbnail image.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display control system, a display control method, and a program for performing control for displaying a thumbnail image related to an event unit video recorded by a drive recorder mounted on a vehicle.

  Conventionally, an image of the surrounding area of a vehicle is captured by a camera installed on the vehicle, and the in-vehicle image that records the surrounding image and vehicle speed when a shock is applied to the vehicle due to an event such as sudden braking, sudden steering or collision. 2. Description of the Related Art An equal recording device, a so-called drive recorder, has been widely used. By providing such a drive recorder in a vehicle, it is possible to verify the cause of the accident by analyzing the recorded information when an accident occurs. In addition, the driver's awareness of safe driving can be improved, and a video recording the daily driving situation can be used for safe driving guidance and the like.

  Patent Documents 1 and 2 collect operation images such as camera images, vehicle speeds, and GPS (Global Positioning System) position information recorded by a drive recorder mounted on a commercial vehicle such as a truck or a taxi. Discloses a driving support device that checks the content of driving information, analyzes the driving method of each crew member, and utilizes the information for driving education of the crew members.

JP 2010-257483 A JP 2010-257484 A

  In the above-mentioned driving support device, the operation manager or the like can perform sudden braking from a large number of driving information (hereinafter, referred to as an event unit image) recorded for each event (event) such as sudden braking, sudden steering or collision. In order to narrow down and select event-based images of specific events such as, for example, the related data such as magnitude and waveform of acceleration recorded in each event-based image is used. That is, the related data is recognized as a tag for narrowing down the event-based video of the specific event, and the event-based video is classified and narrowed down. However, in order to specify the event-based video of the event that is ultimately required, the operation manager must identify the event-based video by checking the contents of the camera images included in each event-based video one by one. Must.

  Further, in the driving support devices disclosed in Patent Documents 1 and 2, a timing signal indicating that a recording condition by a drive recorder is satisfied among a plurality of camera images included in one event unit video is satisfied. ) Is displayed as a reduced thumbnail image of the camera image recorded at the time when the trigger is detected. This thumbnail image is, for example, a trigger detection after the time when an event such as a sudden braking or a sudden steering wheel occurs. Since the image is a camera image recorded at a point in time, it is difficult to find an event unit image of a desired event from the thumbnail image.

  The present invention has been made in view of the above-described circumstances and the like, and has as its object to provide a display control system, a display control method, and a program capable of easily finding a desired event unit video from a thumbnail image. Is what you do.

  In a first aspect, the present invention relates to a display control system for performing control for displaying a thumbnail image related to an event-based video recorded by a drive recorder mounted on a vehicle, wherein the display control system includes: And a display control unit for displaying a plurality of thumbnail images corresponding to different time points.

  In the display control system according to the first aspect, the content of the event-based video can be confirmed from a plurality of thumbnail images corresponding to different points in the range of the event-based video. This makes it possible to easily find the desired event-based video from the thumbnail image, as compared with a case where the content of the event-based video is confirmed from one thumbnail image.

The event may be, for example, an event specified by a predetermined rule. The event unit may be, for example, a time range of a unit that can manage a certain event separately from another event. For example, as in the configuration of the second aspect, it may be a predetermined period before and after the occurrence of the event. For example, the time range of a certain event unit and another event unit may be set so as not to overlap, or, for example, may be set so as to partially overlap.
The event unit video may be, for example, a video in a unit time range in which a certain event and another event can be managed separately. The event-based video may be recorded as a separate video for each event, for example, or a certain range in one video may be used as the event-based video. That is, the “event-based video recorded by the drive recorder mounted on the vehicle” does not necessarily require recording of the video in event units.

When a certain range in one video is set as an event-based video, for example, the ranges of a plurality of event-based videos may be set so as to allow overlapping of the ranges, or each event may be set in a non-overlapping range. The range of the image may be set. The event unit video may be, for example, a range that may be related to the event in the video.
The “plurality of thumbnail images corresponding to different time points in the range of the event-based video” is, for example, “a plurality of thumbnail images corresponding to videos other than the event-based video at different time points in the range of the event-based video”. , But "a plurality of thumbnail images corresponding to the event unit video at different points in the range of the event unit video". As a specific example of “corresponding to” of “a plurality of thumbnail images corresponding to an event unit video”, “representative” may be set as “representative”. Other examples may include "created from", "image processed", "created by image processing", "created by performing predetermined image processing", and the like.

  In a second aspect, the present invention provides the display control system according to the first aspect, wherein the event unit video is a video for a predetermined period before and after a point in time when an event occurs, and the thumbnail image is a video of the event. It is characterized by having an image recorded before or after the time of occurrence, or at both times.

  In the display control system according to the second aspect, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded before or after the event occurrence time or at both times. Become. As a result, it is possible to more easily find the event unit video related to the event before and after the occurrence of the event.

  The event occurrence time may be, for example, a time point when a predetermined condition is satisfied. The event occurrence time may be, for example, a time point when a predetermined condition representing the event is satisfied. For example, the time when a predetermined condition is satisfied may be set as the event occurrence time, and the range of the event unit video may be determined according to the type of the event. The event may be, for example, a point in time when an event corresponding to the occurrence of an accident has occurred. For example, the location where sudden deceleration corresponding to a collision occurs may be set as the event occurrence time.

  In the drive recorder, for example, a type for recording a video before and after a “trigger indicating that a recording condition is satisfied” or a video is always recorded (for example, always from an engine on to an off), and a trigger is activated. There is a type that stores information for enabling the position of an image to be specified. The “information for enabling identification” is, for example, information on the time when the trigger is activated. For example, from the video recording start time information and the time information at which the trigger was activated, it is specified which position of which video was triggered.

In the case of the former type of drive recorder described above, the `` event unit image '' is, for example, an image recorded over a predetermined period before and after a trigger point indicating that the recording condition by the drive recorder is satisfied. Good.
In the case of the latter type of drive recorder, the “event unit video” is, for example, a trigger occurrence in a video that is a recording unit (in the above example, one unit from engine on to off). The video may be an image of a portion recorded over a predetermined period before and after the time point.

  The predetermined period may be, for example, the entire range of the recorded video (for example, the entire range from turning on the engine to turning off the engine), but is particularly preferably set to a certain limited time range in the video. As the limited time range in the video, it is particularly preferable to set the time range including the occurrence time of the event. Note that the limited time range in the video may be, for example, a fixed time range or a variable time range. Further, the period before the occurrence of the event and the period after the occurrence of the event constituting the predetermined period may be the same period, but may be different periods. In particular, the predetermined period may be a period that is sufficient to enable the cause of the event to be specified. In particular, the predetermined period may be different depending on the type of event.

  In a third aspect, the present invention provides the display control system according to the second aspect, wherein the thumbnail image is determined not to be the time of occurrence of the event within the predetermined period, but to be determined to have occurred. And an image recorded at a point in time determined by a predetermined rule using the information used for the operation.

  The display control system according to the third aspect uses information (for example, acceleration applied to the vehicle) used to determine that an event has occurred at a time other than the occurrence of the event within a predetermined period. The content of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded at the time determined by the predetermined rule (for example, when the acceleration exceeds a predetermined value). As a result, it is possible to easily find the event unit video related to the event at the time point determined by the predetermined rule.

  In a fourth aspect, the present invention provides the display control system according to the second or third aspect, wherein the thumbnail image is used to determine that the event has occurred within the predetermined period. An image recorded at a point in time determined by a predetermined rule using information different from the information is provided.

  In the display control system according to the fourth aspect, the information (for example, the sudden acceleration of the vehicle in the left-right direction) used to determine that the event has occurred within the predetermined period (for example, sudden From the thumbnail image corresponding to the image recorded at the time point determined by the predetermined rule using the vehicle (the longitudinal acceleration of the vehicle due to the brake) (for example, the maximum value within a predetermined period of the longitudinal acceleration of the vehicle). , The content of the event unit video can be confirmed. As a result, it is possible to easily find the event unit video related to the event at the time point determined by the predetermined rule.

  In a fifth aspect, the present invention provides the display control system according to the third or fourth aspect, wherein the predetermined rule is a rule for estimating an occurrence time of a sub-event that has caused the occurrence of the event. There is a feature.

In the display control system according to the fifth aspect, it is possible to easily find the event unit video related to the event at the time point determined by the rule for estimating the occurrence time point of the sub event that caused the event.
The predetermined rule is a rule for estimating a feature point related to the occurrence of the event retroactively from the time when it is determined that the event has occurred. For example, a local maximum point or an inflection point within a predetermined period of the acceleration of the vehicle, and the like. It may be a feature point of the acceleration. Different rules may be used depending on the type of event.
The predetermined period may be set to a time period long enough to consider that the possibility of occurrence of the sub-event causing the event is low.

  In a sixth aspect, the present invention provides the display control system according to any one of the second to fifth aspects, wherein any one or both of the times before or after the time of occurrence of the event is the event of the event. It is characterized in that the time is different depending on the type.

  In the display control system according to the sixth aspect, as a time point before or after the occurrence time of the event or both times, a thumbnail image corresponding to an image recorded at a different time point depending on the type of the event is set in units of an event. You can check the contents of the video. Thus, it is possible to easily find an event unit video related to an event at a different point in time depending on the type of the event.

  According to a seventh aspect, in the display control system according to any one of the second to sixth aspects, the present invention provides the display control system according to any one of the second to sixth aspects, wherein the thumbnail image includes a time immediately before or immediately after the time when the event occurs, or a time immediately after both times Characterized by having an image recorded in the

  In the display control system according to the seventh aspect, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded immediately before or immediately after the occurrence of the event, or both. . As a result, it is possible to more easily and accurately find an event unit video related to an event at a time immediately before or immediately after an event occurrence time.

  In an eighth aspect, the present invention provides the display control system according to any one of the second to seventh aspects, wherein the thumbnail image is recorded at both a time immediately before and immediately after the time when the event occurs. The image is provided, and the acquisition interval of the information used to determine that the event has occurred is set to an interval shorter than the recording interval of the video frame, and is recorded at a time immediately before the event occurrence time. The image is a frame image immediately before the time when the event is determined to have occurred, and the image recorded immediately after the time when the event has occurred is the image immediately after the time when the event is determined to have occurred. It is characterized in that it is a frame image.

  In the display control system according to the eighth aspect, the content of the event unit video can be confirmed from the thumbnail images corresponding to the images recorded immediately before and immediately after the event occurrence time. This makes it possible to more easily and accurately find an event-based video relating to an event at both a point immediately before and immediately after the point of occurrence of the event.

  In a ninth aspect, the present invention provides the display control system according to any one of the first to eighth aspects, wherein, as the thumbnail image, at least one or both of the first and last of the event-unit videos is provided. It is characterized by having an image recorded at a point in time.

  In the display control system according to the ninth aspect, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded at the first or the last or both of the event unit videos. Become. As a result, it is possible to more easily and more accurately find the event unit video related to the event at the first / last point of the event unit video.

  In a tenth aspect, the present invention provides the display control system according to any one of the second to ninth aspects, wherein the thumbnail image includes an image recorded at the time of occurrence of the event. .

  In the display control system according to the tenth aspect, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded at the time of occurrence of the event. This makes it possible to more easily and more accurately find the event unit video related to the event at the time of occurrence of the event.

  In an eleventh aspect, the present invention provides the display control system according to any one of the first to tenth aspects, wherein the thumbnail image is recorded according to a state of the vehicle when the event unit video is recorded. , Characterized by comprising an image of a specific period within the range of the event unit video.

  In the display control system according to the eleventh aspect, the content of the event-based video can be confirmed from the thumbnail image corresponding to the image of the specific period according to the state of the vehicle when the event-based video is recorded. This makes it easier to find an event-based video related to the state of the vehicle when the event-based video was recorded.

The “state of the vehicle when the event unit image is recorded” is, for example, a state of the vehicle such as (1) a sudden braking, (2) a sudden steering, or (3) a vehicle colliding with something. is there.
The “image of a specific period selected from the event unit video” is, for example, (1) in the case of sudden braking, an image recorded at the time from when the brake is depressed until the release, or the acceleration applied to the vehicle Is an image recorded from the time when the event appears to the time when it ends. (2) In the case of a sharp steering wheel, the image is an image recorded from the time when the steering wheel is turned to the time when the steering wheel is completely turned. Further, (3) when the vehicle collides with something, an image or the like recorded at the time when the vehicle stops and the acceleration behavior converges after the acceleration behavior of the vehicle due to the reaction of the bumper, the guardrail, etc. is generated. is there.

  In a twelfth aspect, the present invention provides the display control system according to any one of the first to eleventh aspects, wherein, as the thumbnail image, an image recorded at a time when an acceleration applied to the vehicle exceeds a predetermined value. It is characterized by having.

  In the display control system according to the twelfth aspect, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded when the acceleration applied to the vehicle exceeds a predetermined value. This makes it easier to find an event unit video related to the time when the acceleration applied to the vehicle exceeds a predetermined value.

  In a thirteenth aspect, the present invention provides the display control system according to any one of the second to twelfth aspects, wherein the occurrence of the event is specific behavior information based on information obtained by detecting a behavior of the vehicle. It is characterized by the following.

  In the display control system according to the thirteenth aspect, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image in which the specific behavior information based on the information on the detected behavior of the vehicle is recorded as the event. This makes it easier to find an event-based video in which the specific behavior information is recorded as an event.

  “Information that detects the behavior of the vehicle” may be, for example, any one of a detection result of an acceleration sensor, a gyro sensor, a barometric pressure sensor (or an altitude sensor) mounted on the vehicle, and an analysis result of a recorded video. Information that can be obtained.

  In a fourteenth aspect, the present invention is the display control system according to any one of the second to thirteenth aspects, wherein the occurrence of the event is specific vehicle information based on information on a functional state of the vehicle. It is characterized by.

  In the display control system according to the fourteenth aspect, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image in which the specific vehicle information based on the information on the functional state of the vehicle is recorded as the event. This makes it easier to find an event-based video in which specific vehicle information is recorded as an event.

  "Information on the functional state of the vehicle" includes, for example, operation of any of a brake, a turn signal, an accelerator, a steering wheel rotation, a shift lever position, and a side brake during vehicle operation, and an OBD (On Board) which is a vehicle failure diagnosis system. Diagnosis), information obtained from a CAN (Controller Area Network) which is an in-vehicle LAN, and the like.

  In a fifteenth aspect, the present invention provides the display control system according to any one of the first to fourteenth aspects, wherein the plurality of thumbnail images form different rows of thumbnail images of different event unit videos, and The thumbnail images at the same time point are displayed in a list on the same screen in a matrix structure in which different columns are formed.

  In the display control system according to the fifteenth aspect, a plurality of thumbnail images are displayed in a visually comprehensible list in a state where the thumbnail images are arranged as thumbnail images for different event unit videos or thumbnail images at the same time. This makes it easy to determine the content of the thumbnail image.

  In a sixteenth aspect, the present invention provides the display control system according to any one of the first to fifteenth aspects, wherein the plurality of thumbnail images are arranged such that thumbnail images for the same event unit video are displayed in the same row from left to right. Alternatively, a list is displayed on the same screen by a matrix structure configured to be arranged in a time series from right to left.

  In the display control system according to the sixteenth aspect, a plurality of thumbnail images are displayed in a list in a visually easy-to-understand manner as thumbnail images arranged in the same row in the same line for each same event unit video in chronological order. This makes it easy to determine the content of the thumbnail image.

  It can be considered as an invention of a method having steps corresponding to the components of the display control means according to any of the first to sixteenth aspects. For example, as an invention of a method corresponding to the first aspect, according to a seventeenth aspect, the present invention provides a display for performing control for displaying a thumbnail image related to an event unit video recorded by a drive recorder mounted on a vehicle. A display control method, comprising: displaying a plurality of thumbnail images corresponding to different time points in a range of the event-based video.

  In the display control method according to the seventeenth aspect, the content of the event unit video can be confirmed from a plurality of thumbnail images corresponding to different points in the range of the event unit video. Can be easily found from

  According to an eighteenth aspect, the present invention can provide a program for causing a computer to realize a function as a display control system according to any one of the first to sixteenth aspects.

  According to the display control system of the present invention, a desired event unit video can be easily found from a thumbnail image.

1 is a diagram illustrating a schematic configuration of a driving support system according to a first embodiment. FIG. 3 is a diagram conceptually showing a data structure of contents recorded on a memory card 25. FIG. 6 is a diagram illustrating a state of acceleration change when an event occurs and a method of storing an image and the like according to the first embodiment. 4 is a flowchart illustrating a process of creating and displaying a thumbnail image according to the first embodiment. FIG. 5 is a screen display diagram showing an example of a display mode of a thumbnail image according to the first embodiment. FIG. 9 is a diagram illustrating a change in acceleration in the case of a sudden brake according to the second embodiment. 9 is a flowchart illustrating a process of creating and displaying a thumbnail image according to the second embodiment. FIG. 13 is a diagram illustrating a change in acceleration in the case of a sharp steering wheel according to the third embodiment. 13 is a flowchart illustrating a process of creating and displaying a thumbnail image according to the third embodiment. FIG. 14 is a diagram illustrating a change in acceleration in the case of a vehicle collision according to a fourth embodiment. 14 is a flowchart illustrating a process of creating and displaying a thumbnail image according to the fourth embodiment. It is a figure which shows the example of an experiment of the acceleration change in the case of a car-to-vehicle collision. FIG. 13 is a diagram illustrating a display example of a thumbnail screen according to the experiment example illustrated in FIG. 12.

  Hereinafter, a display control system according to an embodiment of the present invention will be described in detail with reference to the drawings. The present invention is not construed as being limited thereto, and various changes, modifications, and improvements can be made based on the knowledge of those skilled in the art without departing from the scope of the present invention.

[Example 1]
<Configuration of driving support system>
FIG. 1 is a diagram illustrating a schematic configuration of a driving support system according to a first embodiment of the display control system of the present invention.

  As shown in FIG. 1, the driving support system includes a drive recorder 10 mounted on a vehicle, a memory card 25 that stores an image when an event occurs in the drive recorder 10, and reproduces an image stored in the memory card 25. And a driving support device 30 for driving.

  The drive recorder 10 includes a first control unit 11, an acceleration sensor (G sensor) 12, a gyro sensor 13, a pressure sensor 14, a GPS antenna 15, and a GPS that measures GPS position information of a vehicle from a GPS signal received by the GPS antenna 15. (Global Positioning System) A first operation unit 17 including a receiver 16, a switch, a button, and the like; a first memory 18 for temporarily storing an image; a memory card 25 having a slot for inserting a memory card 25; IF (interface) 19 for writing an image to a vehicle, a CCD camera 20 installed in the vehicle so as to continuously capture an image of the front of the vehicle at a predetermined rate, a vehicle signal acquisition unit 21, and a drive recorder It has a power supply unit 22 for supplying power to each of the ten elements.

  Further, the drive recorder 10 may be configured to be able to reproduce an image on a display of the navigation device in cooperation with a navigation device (not shown). Further, the GPS receiver 16 is not necessarily an essential component, but may be a component that acquires position information received by an external device, for example, an AVM (Automatic Vehicle Monitoring) system or a navigation device.

  The first control unit 11 includes a microcomputer including a CPU, a ROM, a RAM, and the like, and controls the entire operation of the drive recorder 10.

  The G sensor 12 detects gravitational acceleration (hereinafter, simply referred to as acceleration) in two axial directions (X axis and Y axis) orthogonal to each other, and detects the detected acceleration (also referred to as G data) together with time data in the first control unit. Send to 11. The first control unit 11 can acquire G data (Gx, Gy) output from the G sensor 12 at intervals of, for example, 10 milliseconds, and determine the value (magnitude) of the acceleration from the G data.

  Note that Gx indicates acceleration in the X-axis direction (the front-back direction of the vehicle), and Gy indicates acceleration in the Y-axis direction (the left-right direction of the vehicle). Further, the G sensor 12 may use a three-axis sensor in which the Z-axis direction (vertical direction of the vehicle) is added, and the three-axis sensor does not use the data of the acceleration Gz in the Z-axis direction. Is also good.

  The gyro sensor 13 detects the angular acceleration (rotation) of the vehicle, mainly detects a change in the traveling direction of the vehicle (that is, rotation of the yaw (Z-axis) which is a vertical axis), and detects the detected angular acceleration data. Is transmitted to the first control unit 11 together with the time data. The first control unit 11 can acquire angular acceleration data output from the gyro sensor 13 at intervals of, for example, 10 milliseconds, and can determine the value (magnitude) of the angular acceleration from the angular acceleration data.

  The atmospheric pressure sensor 14 detects the pressure of the atmosphere outside the vehicle, calculates the altitude based on the detected atmospheric pressure value, and transmits the atmospheric pressure value and the altitude value (atmospheric pressure / altitude data) to the first control unit 11 together with the time data. . The first control unit 11 can acquire the pressure / altitude data output from the pressure sensor 14 at intervals of, for example, 10 milliseconds, and can determine the value (size) of the pressure / altitude from the pressure / altitude data.

  In the first control unit 11, the CCD camera 20 captures one image every 100 milliseconds, and sequentially and cyclically stores the captured image in the first memory 18 together with time data (to the memory card 25 described later). (Primary storage for the storage of the data). For example, the first memory 18 is configured to always store image data for 24 seconds (240 images) captured by the CCD camera 20. The image captured by the CCD camera 20 is not limited to one image every 100 milliseconds, but may be one image every 50 milliseconds. Further, the moving image captured by the CCD camera 20 may be stored.

  The vehicle signal acquisition unit 21 is connected to a failure diagnosis connector of the vehicle, acquires various signals and information (vehicle data) of the vehicle at, for example, 100 millisecond intervals, and performs first control with the acquired vehicle data together with time data. Transmit to the unit 11. The vehicle data includes, for example, [1] a signal for detecting a brake operation during vehicle operation, [2] a signal for detecting a turn signal operation, [3] a signal for detecting an accelerator operation, and [4] a steering wheel rotation. [5] A signal detecting a shift lever position, [6] A signal detecting a side brake operation, and [7] Vehicle failure diagnosis information (OBD) obtained from a vehicle failure diagnosis system (OBD) in the vehicle. [8] Various vehicle information obtained via the vehicle-mounted LAN (CAN) (function control data from the ECU (Electronic Control Unit) of the vehicle, network outside the vehicle, etc. Communication data from the vehicle).

  As an example, when the vehicle signal obtaining unit 21 obtains a signal indicating that a brake operation has been performed, the brake operation data indicating whether the brake of the vehicle has been operated and the brake operation start time data indicating the time at which the brake operation was started And the brake operation end time data indicating the time when the brake operation is ended is transmitted to the first control unit 11. That is, based on the brake operation data, the brake operation start time data, and the brake operation end time data from the vehicle signal acquisition unit 21, the first control unit 11 determines whether or not the brake operation has been performed, the time at which the brake operation was started, and It is possible to determine the time at which the brake operation has been completed.

  As another example, when the vehicle signal obtaining unit 21 obtains a signal indicating that the steering wheel has been rotated, the steering wheel rotation data indicating whether or not the steering wheel of the vehicle has been rotated, and the steering wheel rotation indicating the time at which the steering wheel rotation has been started. The time data and the handle rotation end time data indicating the time when the handlebar rotation has been completed are transmitted to the first control unit 11. That is, according to the steering wheel rotation data, the steering wheel rotation start time data, and the steering wheel rotation end time data from the vehicle signal acquisition unit 21, the first control unit 11 determines whether the steering wheel rotation has been performed, the time when the steering wheel rotation is started, and It is possible to determine the time when the rotation of the steering wheel is completed.

  Note that some or all of the GPS antenna 15, the GPS receiver 16, the first IF 19, the CCD camera 20, the vehicle signal acquisition unit 21, and the like may be configured separately from the drive recorder 10. For example, when linked with an existing navigation device having a GPS function, the function of the GPS recorder 16 and the like is not required in the drive recorder 10, so that the cost of the drive recorder 10 can be reduced accordingly.

  The driving support device 30 includes a second control unit 31, a display unit 32 including a display, an output unit 33 including a printer for printing a display screen on paper, and input devices such as a keyboard and a mouse. A second operation unit 34, a second memory 35 for temporarily storing an image, a second IF (interface) 36 including a slot for inserting the memory card 25, and for reading an image from the memory card 25 and the like. And an image processing unit 37 for performing predetermined image processing on the input image.

  The second control unit 31 is a personal computer (PC) that includes a CPU, a ROM, a RAM, and the like, and has driving support software installed therein. The second control unit 31 interprets and executes a program included in the driving support software, and executes the program. Are operated to realize various functions according to the features of the present invention.

  The driving support device 30 is an embodiment of a display control system that performs control for displaying a thumbnail image related to an event-based video recorded by the drive recorder 10. In the present embodiment, the event unit video is an image recorded during a predetermined period before and after the occurrence of the event. The time when the event occurs is, for example, the time when an event corresponding to the occurrence of an accident occurs, for example, the time when an impact is applied to the vehicle due to the occurrence of sudden deceleration such as sudden braking.

  The memory card 25 is a rewritable nonvolatile semiconductor memory card having a storage capacity of 2 GB. The memory card 25 is inserted into a slot constituting the first IF 19, and periodically stores a predetermined image (for example, an event image) temporarily and cyclically stored in the first memory 18 for a predetermined period before and after the occurrence of the event. An image for 12 seconds before the occurrence and an image for 12 seconds after the time of occurrence are stored. Thereafter, the memory card 25 is ejected from the slot constituting the first IF 19 and re-inserted into the slot constituting the second IF 36, and outputs the stored image to the driving support device 30.

  Although a semiconductor memory card is used as the memory card 25, the present invention is not limited to this, and a semiconductor memory other than a card type, a portable hard disk (HD), other storage media, and the like can be used. The storage capacity of a memory card or the like is arbitrary, and can be freely determined according to the application.

  When a predetermined condition is satisfied (ie, when an event to be recorded by the drive recorder 10 occurs), the drive recorder 10 specifically includes (a) sudden braking, sudden steering, collision, or the like; When a shock is applied to the vehicle due to occurrence of an event corresponding to the occurrence of another accident, and the value (magnitude) of the G data output from the G sensor 12 provided therein exceeds a predetermined threshold value And (b) various data of several seconds to ten and several seconds before and after (for example, 12 seconds before and 12 seconds after) triggered by the detection such as when the emergency switch of the first operation unit 17 is pressed, Acquired together with the event occurrence time data, and recorded in the memory card 25 as one piece of operation information.

  The driving information recorded on the memory card 25 includes the G data output from the G sensor 12, the angular acceleration data output from the gyro sensor 13, the pressure / altitude data output from the pressure sensor 14, and the positioning performed by the GPS receiver 16. The information includes GPS position information, camera image data captured by the CCD camera 20, various types of vehicle signals and information acquired by the vehicle signal acquisition unit 21 (detection data of brake operation and steering wheel rotation, vehicle speed data, and the like).

  The drive recorder 10 corresponds to each of a plurality of camera images of several seconds to several tens of seconds (for example, 12 seconds before, 12 seconds after, etc.) from the time when an event to be recorded occurs and a trigger is detected. In addition, various data of the driving information is recorded on the memory card 25.

<Data structure of memory card>
Next, the data structure of the content recorded on the memory card 25 will be described with reference to FIG. FIG. 2 is a diagram conceptually showing a data structure of the content recorded on the memory card 25.

  As shown in FIG. 2, for each occurrence of each event, the corresponding driving information is recorded in the memory card 25 as being divided into driving information 1, driving information 2, and driving information 3. The driving information 1 is composed of 240 camera images 1 to 240 corresponding to 24 seconds before and after the event occurrence (12 seconds before and 12 seconds after), and image-related information including other driving information other than the camera images. Be composed. The image-related information includes main item data including G data at the time of event occurrence and time data thereof, and related data 1 to 240 corresponding to 240 camera images 1 to 240, respectively. The same applies to the driving information 2 and 3.

  The main item data includes G data, angular acceleration data, barometric pressure / altitude data, and respective time data, and the image-related data includes the shooting date and shooting time of the camera image, various signals and information of the vehicle at the time of shooting the camera image. (Detection data of brake operation and steering wheel rotation, vehicle speed data, etc.), and GPS position information of the vehicle.

<Acceleration change at event occurrence and storage method of images etc.>
Next, referring to FIG. 3, when an event such as an impact on the vehicle occurs, a change in acceleration (G data) detected by the G sensor 12 (see FIG. 1) of the drive recorder 10, A method of storing images and the like in the drive recorder 10 will be described.

  3A shows a time-series change of G data (combined value of Gx and Gy) output from the G sensor 12, and FIG. 3B shows an example of an image period stored in the memory card 25. FIG. 3C shows an example of a selection timing of an image serving as a source of a thumbnail image to be created. The creation and display of the thumbnail image will be described later.

  The value (magnitude) of the G data output from the G sensor 12 sharply increases from almost zero from the time when the impact is applied to the vehicle. Then, as shown in FIG. 3A, at time tp, when the value (magnitude) of the G data of the G sensor 12 reaches the threshold acceleration Gs (for example, 0.3 G) (time tp), The first controller 101 recognizes this as a trigger, determines (determines) that an event has occurred, and takes an image captured by the CCD camera 20 and constantly cyclically temporarily stores the image in the first memory 18 in the memory card 25. And the time tp is stored in the memory card 25 as event occurrence determination time data.

  Specifically, as shown in FIG. 3B, control is performed such that the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp are stored in the memory card 25. For example, TA can be 12 seconds and TB can be 12 seconds. Note that the periods TA and TB can be freely set. For example, while displaying the set time (second) on the setting screen (not shown) of the drive recorder 10, the time is set by operating the time setting button of the first operation unit 17 of the drive recorder 10, and the set information is set. Can be set at any time by storing.

  When an event such as an impact on the vehicle occurs as described above and the value (magnitude) of the G data detected by the G sensor 12 exceeds a predetermined threshold, the first control unit 11 Are event occurrence time data (tp), G data (Gx, Gy) detected by the G sensor 12 and its time data, angular acceleration data detected by the gyro sensor 13 and its time data, barometric pressure / altitude data of the barometric pressure sensor 14, and the like. Time data, vehicle data and its time data for TA seconds before time tp and TB seconds after time tp obtained by the vehicle signal obtaining unit 21 (for example, brake operation data and its time data, steering wheel rotation data and its Time data, vehicle speed data and the time data) are stored in the memory card 25 together with the image data. Note that a configuration may be adopted in which only part of the above-described data is stored in the memory card 25.

  The number of events stored in the memory card 25 can be varied according to the storage capacity of the memory card 25. For example, it is preferable that data for 500 events or more can be stored. Further, the first control unit 11 creates a folder in the memory card 25 for each event, and stores image data, event occurrence time data (tp), G data (Gx, Gy) of the G sensor 12 and its time data, It is preferable to store acceleration data and its time data, pressure and altitude data and its time data, vehicle data and its time data.

  When the event occurs, the event occurrence is triggered by exceeding the threshold acceleration Gs. For example, when the amount of change in acceleration per unit time exceeds a certain value (G It may be determined that an event has occurred when the value (magnitude) of the data has changed by 0.1 G or more.

<Creation and Display of Thumbnail Image (Example 1)>
Next, a process of creating and displaying a thumbnail image in the driving support device 30 will be described with reference to FIG. In this example, the operation of creating and displaying a thumbnail image for one event will be described.
FIG. 4 is a flowchart showing a thumbnail image creation and display process according to the first embodiment. The thumbnail image creation and display process is loaded from the HDD or the like into the RAM of the second control unit 31 of the driving support device 30. The control is executed by the CPU according to the control program, and is started based on an operation of starting the driving support software of the second operation unit 34. It is also assumed that the memory card 25 in which the image is stored in the drive recorder 10 is inserted into the second IF 36 forming the slot at the time when the processing of the flowchart shown in FIG. 4 is started.

  In step S11, the second control unit 31 acquires event occurrence determination time data (tp) from the data stored in the memory card 25.

  Next, in step S12, the second control unit 31 sets a plurality of different timings from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. Select multiple captured images.

  Specifically, the control program includes an image PA for TA seconds before the time tp shown in FIG. 3B and an image PB for TB seconds after the time tp as shown in FIG. The image P1 photographed at the time ts TA seconds (eg, 12 seconds) before the indicated time tp is selected as the “first image”, and immediately before the time tp (a predetermined time TC seconds before, for example, 0.2 seconds before). ) Is selected as the “second image”, and the image P3 shot at the time tp2 immediately after the time tp (after a predetermined time TC, for example, 0.2 seconds) is referred to as the “second image”. A control process is performed such that the image P4 picked up at time te after TB seconds (for example, 12 seconds) after the time tp is selected as the "fourth image". The second control unit 31 controls the selection of the first to fourth images from the images PA and PB according to such a control program.

The time ts TA seconds before the time tp is the time when the storage of the image is started in one event, and the “first image” is also the image captured at the time when the event occurs. The time te after TB seconds from the time tp is also the time when the storage of the image is ended in one event, and the “fourth image” is the image captured at the time when the event detection ends.
Further, the predetermined time TC can be set to, for example, 0.2 seconds, but an optimum value including 0 seconds can be selected according to the application. For example, while the set time (second) is displayed on the setting screen (not shown) of the driving support device 30, the time is set by operating the time setting button of the second operation unit 34 of the driving support device 30 to set the time. The saved information can be set at any time.

  Next, in step S13, the second control unit 201 instructs the image processing unit 37 to select the “first to fourth images” selected in step S12 in accordance with the control program stored in the ROM in the second control unit 201. (P1 to P4) to perform the image processing for creating the first to fourth thumbnail images.

  In order to create a thumbnail image from the selected first to fourth images, for example, image processing for reducing the original first to fourth images is performed to create a thumbnail image. In addition to the image processing for reducing, other predetermined image processing such as performing image processing for enlarging the selected first to fourth images or performing image processing for cutting out a part of the image. May be applied to create a thumbnail image. Alternatively, the selected first to fourth images may be used as thumbnail images without any image processing.

In the following step S14, the second control unit 31 sends the first to fourth thumbnail images created in step S13 to the display processing unit 38 in accordance with the control program stored in the ROM in the second control unit 31. A display process to be displayed on the display unit 32 is performed. Specifically, the thumbnail images are arranged in a matrix structure and displayed as a list on the same screen as described later.
This completes the thumbnail image creation and display processing for one event.

<Thumbnail image display example>
Next, one mode of a display image displayed on the display unit 32 of the driving support device 30 will be described with reference to FIG. FIG. 5 is a screen display diagram illustrating an example of a display mode of a thumbnail image according to the first embodiment.
The display mode of the thumbnail images illustrated in FIG. 5 shows a state in which thumbnail images related to a plurality of events are displayed on the display unit 32 of the driving support device 30.

  In FIG. 5, 16 thumbnail images A1 to D4 arranged in a matrix structure of 4 rows in the vertical direction and 4 columns in the horizontal direction and displayed as a list on the same screen are each composed of an event unit image 51 relating to one event. , 52, 53, 54. That is, each of the event images 51, 52, 53, and 54 displays four thumbnail images related to one event arranged in one row, and four thumbnail images related to different events are displayed in different rows. Four sets of thumbnail images A1 to A4, B1 to B4, C1 to C4, and D1 to D4 are arranged and displayed.

  Note that, at the lower part of the thumbnail images A1 to D4, the photographing time of the image that is the basis of each thumbnail image is displayed. In the illustrated example, when the event occurrence time tp in the event unit image 51 is “11: 46: 14: 60”, the shooting time of the image that is the source of each thumbnail image is displayed.

  In addition, the 16 thumbnail images shown in FIG. 5 are created from the images shot at the same time for each column (more precisely, at the time before and after the event occurrence time tp by the same time for each event). Time unit images 61, 62, 63, 64. That is, each of the time unit images 61, 62, 63, and 64 is displayed such that four thumbnail images related to the same time are arranged in one column and four thumbnail images related to different time are different columns. And four sets of thumbnail images A1 to D1, A2 to D2, A3 to D3, and A4 to D4 that are arranged and displayed in the.

  In the 16 thumbnail images shown in FIG. 5, the first column from the left is a thumbnail image created from the image P1 (first image) shot at the time of the event occurrence (time ts), and the second column is A thumbnail image created from the image P2 (second image) shot immediately before the event occurrence determination time (time tp1), and the third column is an image P3 shot immediately after the event occurrence determination time (time tp2). The thumbnail image created from the (third image), and the fourth column is a thumbnail image created from the image P4 (fourth image) shot at the end of the event detection (time te).

  Further, in FIG. 5, the four thumbnail images arranged in one row are the same event image in the order of X1.fwdarw.X2.fwdarw.X3.fwdarw.X4 (X is any one of A, B, C and D). Each thumbnail image is arranged and displayed in the same line from left to right in chronological order. The display order may be such that the same line is not arranged from left to right, but is arranged in chronological order from right to left.

  In FIG. 5, four events are displayed. However, the number of events to be displayed is not limited to this, and it is possible to select another number to be displayed or to select another element (such as G data or vehicle data). ) Can also be displayed.

As described above, the driving support device 30 of the first embodiment has the following advantages. That is,
(1) When an event such as an impact on a vehicle occurs, a first image P1 photographed TA seconds before the event occurrence time (time tp), a second image P2 photographed immediately before the time tp, time A third image P3 photographed immediately after tp and a fourth image P4 photographed TB seconds after the time tp are selected, and the first to fourth thumbnail images are selected from the selected first to fourth images P1 to P4. It is created and controlled to be displayed on the display unit 32. Thereby, when the event occurs, the first to fourth thumbnail images corresponding to the first to fourth images P1 to P4 photographed at different times in the event unit images photographed for a predetermined period before and after the event are displayed. By confirming, it is possible to easily confirm the content of the event unit image stored every time the event occurs, and it is easy to grasp the cause and situation of the event occurrence.

  For example, when finding an event-based image related to a specific event from among a large number of event-based images stored for each event occurrence, the thumbnail image at one point in time related to the event-based image is searched for the event-based image. In comparison with the case where the content is checked and a specific event-based image is searched for, the desired specific event-based image can be easily found from the thumbnail image.

(2) As shown in the thumbnail image display mode illustrated in FIG. 5, four thumbnail images related to one event are arranged and displayed in one row, and four thumbnails related to different events are displayed. Since the images are arranged and displayed on different lines, the four thumbnail images related to one event can be distinguished at a glance.
Also, the four thumbnail images arranged in one row are arranged and displayed in chronological order from left to right in the same row for each event, so that four thumbnail images related to one event are displayed. The time lapse order of the thumbnail images can be determined at a glance.

  Further, looking at the thumbnail images in the first column, the situation in front of the vehicle at the time of the event occurrence can be understood, and looking in the thumbnail images in the second column, the situation in front of the vehicle immediately before the event occurrence determination time can be understood. By looking at the thumbnail images of, the front of the vehicle immediately after the event occurrence determination time can be seen, and by looking at the thumbnail images in the fourth column, the front of the vehicle at the end of event detection can be seen. By comparing and seeing the images, it is possible to compare and verify the situation in front of the vehicle at the same time when the event occurs.

[Example 2]
The second embodiment is a case of sudden braking as an example of an event such as an impact on a vehicle.
FIG. 6 is a diagram showing a change in acceleration in the case of sudden braking, and shows a time-series change of G data (combined value of Gx and Gy) output from the G sensor 12.

  As shown in FIG. 6, when the sudden brake is depressed (turned on) at time t1, the G sensor 12 mainly detects the acceleration (Gx) in the front-rear direction of the vehicle, and the acceleration changes. The acceleration (G data) of the G sensor 12 gradually increases from time t1 (that is, the acceleration in the reverse direction and the acceleration in the reverse direction increase), and when the acceleration reaches the threshold acceleration Gs (for example, 0.3 G) ( At time tp), the first control unit 11 recognizes this as a trigger, determines (determines) that an event has occurred, captures an image with the CCD camera 20, and constantly stores the image cyclically stored in the first memory 108. Is stored in the memory card 150, and the time tp is stored in the memory card 150 as event occurrence determination time data.

  Specifically, in the second embodiment, similarly to the first embodiment, control is performed such that the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp are stored in the memory card 25. I do.

  After the time tp, the acceleration continues to increase, reaches a maximum value (maximum value), then gradually decreases instead of decreasing (that is, the direction in which the vehicle advances and the reverse acceleration decreases), and rapidly decreases. After the zero point, the value further decreases (ie, the acceleration in the direction in which the vehicle travels increases), reaches a minimum value (minimum value), and increases sharply instead of increasing (ie, the acceleration in the direction in which the vehicle travels decreases). When the vehicle stops and the brake is released (OFF) (time t2), the value becomes zero.

  In FIG. 6, a period Td from time t1 to time tp is “a period from the beginning of dangerous driving to immediately before occurrence of a trigger”, and a period Te from time tp to time t2 is a period of “dangerous driving behavior”.

<Creation and Display of Thumbnail Image (Example 2)>
FIG. 7 is a flowchart illustrating a thumbnail image creation and display process according to the second embodiment. Similar to the first embodiment, the control program loaded from the HDD or the like into the RAM of the second control unit 31 of the driving support device 30 And is started based on the operation of starting the driving support software of the second operation unit 34. It is also assumed that the memory card 25 storing the image in the drive recorder 10 has been inserted into the second IF 36 forming the slot at the time when the processing of the flowchart shown in FIG. 7 is started.

  In step S21, the second control unit 31 acquires event occurrence determination time data (tp) from the data stored in the memory card 25. Subsequently, in step S22, a brake operation detection signal (brake operation data) output from the vehicle signal obtaining unit 21 is obtained from the data stored in the memory card 25.

  Next, in step S23, the second control unit 31 determines, from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. To select a plurality of images taken at different timings.

  Specifically, the control program includes the brake operation data acquired from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. Based on the included brake operation start time data, the image captured at the time t1 when the brake operation is started (that is, the time when the appearance of the acceleration event starts) is selected as the “first image”, and immediately before the time tp (the predetermined time). An image photographed before TC, for example, 0.2 seconds before, is selected as a “second image”, and an image photographed immediately after time tp (after a predetermined time TC, for example, 0.2 seconds) is selected. An image selected at the time t2 when the brake operation is completed based on the brake operation end time data included in the acquired brake operation data (that is, the end time of the appearance of the acceleration event) selected as the “third image”. Control processing such selected as "fourth image" is programmed. The second control unit 31 controls the selection of the first to fourth images from the images PA and PB according to such a control program.

The predetermined time TC can be set to, for example, 0.2 seconds, but an optimum value including 0 seconds can be selected according to the application.
Further, in addition to the time t1, the time immediately before and after the time tp, and the time t2, the time when the acceleration reaches the maximum value (maximum value), the time immediately before and immediately after that, and the acceleration becomes the minimum value (minimum value). An image taken immediately before, immediately before, or immediately after may be selected.

  Next, in step S24, the second control unit 31 instructs the image processing unit 37 to select the “first to fourth images” selected in step S23 according to the control program stored in the ROM in the second control unit 31. ”, Image processing for creating the first to fourth thumbnail images is performed.

In the following step S25, the second control unit 31 sends the first to fourth thumbnail images created in step S24 to the display processing unit 38 according to the control program stored in the ROM in the second control unit 31. A display process to be displayed on the display unit 32 is performed. Specifically, as shown in FIG. 5, thumbnail images are arranged in a matrix structure and displayed as a list on the same screen.
This completes the thumbnail image creation and display processing for one event.

As described above, the driving support device 30 of the second embodiment has the following advantages. That is,
In the event of sudden braking as an example of an event such as an impact on the vehicle, a first image taken at time t1 when the brake operation is started, a second image taken immediately before time tp, and taken immediately after time tp The selected third image and the fourth image captured at the time t2 when the brake operation is finished are selected, and the first to fourth thumbnail images are created from the selected first to fourth images. The display is controlled. Accordingly, in the case of sudden braking, at a different time point in the captured event unit image during a predetermined period before and after the event occurrence time (time tp), in particular, the time t1 at which the brake operation is started and the brake operation end. By confirming the first to fourth thumbnail images corresponding to the first to fourth images captured at the time including the time t2, the content of the event unit image stored in the event of sudden braking as an event example is confirmed. It is easy to confirm and it is easy to grasp the cause and situation of sudden braking.

  For example, when finding an event unit image related to sudden braking from among a large number of event unit images stored for each event occurrence, the content of the event unit image is determined from the thumbnail image at one point in time related to the event unit image. Can be easily found from the thumbnail image in comparison with the case of searching for an event unit image related to sudden braking.

  Also, if you look vertically at the thumbnail images in the first column from the left of the 16 thumbnail images shown in FIG. 5, it is possible to compare the images at the time of sudden braking (at the time of starting the braking operation). Can be. Also, if you look vertically at the thumbnail image in the second column, you can compare and see the image immediately before the event is determined to have occurred due to the sudden brake application. If you look at the thumbnail images vertically, you can compare and see the images immediately after. Further, if the thumbnail images in the fourth column are viewed vertically, it is possible to compare and see the images at the time when the brake is released (when the brake operation is completed).

[Example 3]
In the third embodiment, as an example of an event in which an impact is applied to a vehicle, a sudden steering wheel is used.
FIG. 8 is a diagram showing a change in acceleration in the case of an abrupt steering, and shows a time-series change of G data (combined value of Gx and Gy) output from the G sensor 12.

  As shown in FIG. 8, at time t3, when the driver turns the sharp steering wheel, the G sensor 12 mainly detects the acceleration (Gy) in the left-right direction of the vehicle, and the acceleration changes. The acceleration (G data) from the G sensor 12 gradually increases from time t3 (that is, the acceleration in the direction opposite to the turning direction of the vehicle increases), which becomes the threshold acceleration Gs (for example, 0.3 G). At time (time tp), the first control unit 11 recognizes this as a trigger, determines (determines) that an event has occurred, captures an image with the CCD camera 20, and constantly stores the image in the first memory 108 cyclically. The operation is performed so that the stored image is stored in the memory card 25, and the time tp is stored in the memory card 25 as event occurrence determination time data.

  Specifically, in the third embodiment, similarly to the first and second embodiments, the image PA for TA seconds before time tp and the image PB for TB seconds after time tp are stored in the memory card 25. To control.

  After time tp, the acceleration continues to increase, reaches a local maximum value (maximum value), then gradually decreases instead of decreasing (i.e., the acceleration in the direction opposite to the turning direction of the vehicle decreases) and rapidly decreases. , Through the zero point, further decreases (ie, the acceleration in the turning direction of the vehicle increases), reaches a minimum value (minimum value), and increases sharply instead of increasing (ie, the acceleration in the turning direction of the vehicle decreases). When the vehicle has finished turning and the steering wheel has been turned (that is, the steering wheel has been returned) (time t4), the value becomes zero.

  In FIG. 8, a period Tf from time t3 to time tp is “a period from the beginning of dangerous driving to immediately before occurrence of a trigger”, and a period Tg from time tp to time t4 is a period of “dangerous driving behavior”.

<Creation and Display of Thumbnail Image (Example 3)>
FIG. 9 is a flowchart illustrating a process of creating and displaying a thumbnail image according to the third embodiment. As in the first and second embodiments, the thumbnail image is loaded from the HDD or the like into the RAM of the second control unit 31 of the driving support device 30. This is realized by execution of the CPU according to the control program, and is started based on an operation of starting the driving support software of the second operation unit 34. It is also assumed that the memory card 25 storing the image in the drive recorder 10 has been inserted into the second IF 36 forming the slot at the time when the processing of the flowchart shown in FIG. 9 is started.

  In step S31, the second control unit 31 acquires event occurrence determination time data (tp) from the data stored in the memory card 25. Subsequently, in step S32, a steering wheel rotation detection signal (steering wheel rotation data) output from the vehicle signal obtaining unit 21 is obtained from the data stored in the memory card 25.

  Next, in step S33, the second control unit 31 determines whether or not the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. To select a plurality of images taken at different timings.

  Specifically, the control program includes the acquired handle rotation data from the image PA for TA seconds before time tp and the image PB for TB seconds after time tp shown in FIG. 3B. Based on the included handle rotation start time data, the image picked up at time t3 when the handle rotation is started is selected as the “first image” and immediately before the time tp (before a predetermined time TC, for example, 0.2 seconds before ) Is selected as a “second image”, and an image taken immediately after time tp (after a predetermined time TC, for example, 0.2 seconds) is selected as a “third image” and acquired. Based on the handle rotation end time data included in the handle rotation data, the control process is performed to select the image captured at the time t4 when the handle rotation is completed as the “fourth image”. The second control unit 31 controls the selection of the first to fourth images from the images PA and PB according to such a control program.

The predetermined time TC can be set to, for example, 0.2 seconds, but an optimum value including 0 seconds can be selected according to the application.
Further, in addition to the time t3 and the time immediately before and after the time tp, and the time t4, the time when the acceleration reaches the maximum value (the maximum value), the time immediately before and immediately after the time, and the acceleration becomes the minimum value (the minimum value). An image taken immediately before, immediately before, or immediately after may be selected.

  Next, in step S34, the second control unit 31 instructs the image processing unit 37 to select the “first to fourth images” selected in step S33 according to the control program stored in the ROM in the second control unit 31. ”, Image processing for creating the first to fourth thumbnail images is performed.

In the following step S35, the second control unit 31 sends the first to fourth thumbnail images created in step S34 to the display processing unit 38 in accordance with the control program stored in the ROM in the second control unit 31. A display process to be displayed on the display unit 32 is performed. Specifically, as shown in FIG. 5, thumbnail images are arranged in a matrix structure and displayed as a list on the same screen.
This completes the thumbnail image creation and display processing for one event.

As described above, the driving support device 30 according to the third embodiment has the following advantages. That is,
In the event of an abrupt steering as an example of an event such as an impact on the vehicle, a first image captured at time t3 when the steering wheel rotation is started, a second image captured immediately before time tp, and an image captured immediately after time tp The selected third image, the fourth image captured at the time t4 when the rotation of the steering wheel is completed is selected, and the first to fourth thumbnail images are created from the selected first to fourth images. The display is controlled. Thereby, in the case of a sudden steering wheel, at a different time point in the photographed event unit image during a predetermined period before and after the event occurrence time (time tp), particularly at the time t3 at which the steering wheel rotation is started or the steering wheel rotation ends. By confirming the first to fourth thumbnail images corresponding to the first to fourth images captured at the time including the time t4, the content of the event unit image stored in the case of sudden steering as an event example is determined. It is easy to confirm, and it is easy to grasp the cause and situation of sudden steering.

  For example, when finding an event unit image related to a sharp handle from a large number of event unit images stored for each event occurrence, the content of the event unit image is determined from a thumbnail image at one point in time related to the event unit image. Can be easily found from the thumbnail image, as compared with the case of searching for an event unit image related to a sharp turn.

  Also, if you look vertically at the thumbnail images in the first column from the left of the 16 thumbnail images shown in FIG. 5, it is possible to compare and see the images at the start of the steering operation (at the start of the steering wheel rotation). Can be. If the thumbnail image in the second column is viewed vertically, the image immediately before the event is determined to have occurred due to the operation of the steering wheel can be compared and viewed. If you look at the image vertically, you can compare and see the image immediately after it. Further, if the thumbnail images in the fourth column are viewed vertically, it is possible to compare and see the images at the time when the steering wheel operation is stopped (when the steering wheel rotation is completed).

Further, creating the thumbnail image at the time when the rotation of the steering wheel is started as in the third embodiment has an advantage when the steering operation and the acceleration event are not linked as described below.
For example, when a vehicle collides or runs on a slope, acceleration occurs independently of the operation of the steering wheel, and acceleration occurs by operating a steering wheel such as a sharp steering wheel. The first thumbnail image (the first column from the left in FIG. 5) of the third embodiment is the one at the time when the steering wheel rotation is started, but the steering operation is not linked to the acceleration event. There is.
According to the third embodiment, it is possible to display the thumbnail image at the time when the rotation of the handle is started, and the thumbnail image having a predetermined relationship with the occurrence of the event. When the appearance start time of the acceleration event does not match the start time of the acceleration event, the thumbnail image of the start time of the acceleration event is used instead of the thumbnail image of the start time of the acceleration event. It is possible to confirm the relationship between the event and the cause of the event and to understand the situation.

[Example 4]
The fourth embodiment is a case of a vehicle collision as an example of an event such as an impact on a vehicle.
FIG. 10 is a diagram showing a change in acceleration in the case of a vehicle collision, and shows a time-series change of G data (combined value of Gx and Gy) output from the G sensor 12.

  As shown in FIG. 10, when the vehicle collides with something at time t5, the G sensor 12 detects and changes the acceleration (Gx) in the front-rear direction and the acceleration (Gy) in the left-right direction of the vehicle. The acceleration (G data) from the G sensor 12 rapidly increases and decreases immediately after the time t5, and then repeats a rapid increase and decrease. After that, it rapidly increases and becomes the threshold acceleration Gs (for example, 0.3 G). (Time tp), the first control unit 11 recognizes this as a trigger, determines (determines) that an event has occurred, captures an image with the CCD camera 20, and constantly stores the image in the first memory 108 cyclically. The operation is performed so as to store the stored image in the memory card 25 and store the time tp in the memory card 25 as event occurrence determination time data.

  Specifically, also in the fourth embodiment, the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp are stored in the memory card 25 as in the first, second, and third embodiments. To control.

  Even after time tp, the acceleration increases, suddenly decreases after reaching a maximum value (maximum value), rapidly increases after reaching a minimum value (minimum value) through a zero point, again passes through a zero point, and again reaches a maximum value. After suddenly increasing and decreasing again after reaching the value (maximum value), the vehicle stops again after passing through the zero point again, and then becomes zero when the acceleration converges (t6).

  In FIG. 10, a period Th from time t5 to time tp is a “period of impact before a large impact”, and in this period Th, an impact waveform due to impact reduction due to an effect of a vehicle bumper, a guardrail, or the like appears. A period Ti from time tp to time t6 is a period of “impact behavior”.

<Creation and Display of Thumbnail Image (Example 4)>
FIG. 11 is a flowchart illustrating a process of creating and displaying a thumbnail image according to the fourth embodiment. As in the first, second, and third embodiments, the thumbnail image is loaded from the HDD or the like into the RAM of the second control unit 31 of the driving support device 30. The operation is realized by the CPU executing the control program according to the executed control program, and is started based on the operation of starting the driving support software of the second operation unit 34. It is also assumed that the memory card 25 storing the image in the drive recorder 10 has been inserted into the second IF 36 forming the slot at the time when the processing of the flowchart shown in FIG. 11 is started.

  In step S41, the second control unit 31 acquires event occurrence determination time data (tp) from the data stored in the memory card 25. Subsequently, in step S42, the vehicle speed (vehicle speed data) output from the vehicle signal obtaining unit 21 is obtained from the data stored in the memory card 25. Further, in step S43, the detected G data (Gx, Gy) of the G sensor 12 is obtained from the data stored in the memory card 25.

Next, in step S44, the second control unit 31 determines, from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. To select a plurality of images taken at different timings.
More specifically, the control program includes an image PA for TA seconds before time tp and an image PB for TB seconds after time tp shown in FIG. The image captured at the time point tp3 (that is, the time point at which the acceleration behavior of the vehicle due to the recoil of the bumper, guardrail, etc.) occurs when the magnitude (value) of the G data immediately after that suddenly increases and decreases to the second maximum value is obtained. An image taken just before the time tp (before the predetermined time TC, for example, 0.2 seconds before) is selected as the “first image”, and is selected as the “second image”, and immediately after the time tp (the predetermined time TC Later, for example, after 0.2 seconds), the image captured at the time t6 when the vehicle speed becomes zero (that is, at the time when the acceleration behavior converges) is selected as the “third image”. Select as "4th image" Control processing is programmed. The second control unit 31 controls the selection of the first to fourth images from the images PA and PB according to such a control program.

The predetermined time TC can be set to, for example, 0.2 seconds, but an optimum value including 0 seconds can be selected according to the application.
Immediately after the time t5, immediately before and immediately after the time tp, immediately after the time t6, when the acceleration reaches a maximum value (maximum value), immediately before and immediately after the time, and when the acceleration reaches a minimum value (minimum value). At this point, images taken immediately before or immediately after that may be selected.

  Next, in step S45, the second control unit 31 instructs the image processing unit 37 to select the “first to fourth images” selected in step S44 according to the control program stored in the ROM in the second control unit 31. ”, Image processing for creating the first to fourth thumbnail images is performed.

In the following step S46, the second control unit 31 sends the first to fourth thumbnail images created in step S45 to the display processing unit 38 according to the control program stored in the ROM in the second control unit 31. A display process to be displayed on the display unit 32 is performed. Specifically, as shown in FIG. 5, thumbnail images are arranged in a matrix structure and displayed as a list on the same screen.
This completes the thumbnail image creation and display processing for one event.

As described above, the driving support device 30 according to the fourth embodiment has the following advantages. That is,
In the case of a vehicle collision as an example of an event such as an impact on the vehicle, a first image, a time, which is taken at a point in time when the G data repeatedly sharply increases and decreases immediately after the time t5 at which the vehicle collision occurs (a point of a reaction acceleration behavior). a second image photographed immediately before tp, a third image photographed immediately after time tp, and a fourth image photographed at time t6 (when the acceleration converges) when the vehicle speed becomes zero. First to fourth thumbnail images are created from the first to fourth images thus obtained, and control is performed to display the thumbnail images on the display unit 32. Thereby, in the case of a vehicle collision, the G data suddenly increases or decreases at different times in the captured event unit image during a predetermined period before and after the event occurrence time (time tp), particularly immediately after the vehicle collision time t5. The first to fourth thumbnails corresponding to the first to fourth images photographed at the time including the time point (time point of the acceleration behavior of the recoil) and the time point t6 (time point at which the acceleration converges) when the vehicle speed becomes zero. By confirming the image, it is possible to easily confirm the contents of the event unit image stored in the case of a vehicle collision as an event example, and it is easy to grasp the cause and situation of the vehicle collision.

  For example, when finding an event unit image related to a vehicle collision from a large number of event unit images stored for each event occurrence, the content of the event unit image is determined from a thumbnail image at one point in time related to the event unit image. Can be easily found from the thumbnail image, as compared with the case of searching for an event unit image related to the vehicle collision.

  If the thumbnail images in the first column from the left of the 16 thumbnail images shown in FIG. 5 are vertically viewed, the images at the time of the vehicle collision can be compared and viewed. If the thumbnail images in the second column are viewed vertically, the images immediately before the event is determined to have occurred due to the vehicle collision can be compared and viewed. If you look at it, you can compare and see the images immediately after. Further, if the thumbnail images in the fourth column are viewed vertically, the images at the time when the vehicle speed becomes zero can be compared and viewed.

<Example of experiment>
FIG. 12 is a diagram showing an experimental example of an acceleration change in the case of a car-to-vehicle collision in relation to the acceleration change in the case of a vehicle collision according to the fourth embodiment shown in FIG. The value of the detected acceleration Gx in the X-axis direction (the longitudinal direction of the vehicle), the value of the detected acceleration Gy in the Y-axis direction (the lateral direction of the vehicle), and the value of the detected acceleration Gz in the Z-axis direction (the vertical direction of the vehicle) These are shown as time-series changes.

In this experimental example, as shown in FIG. 12, when the vehicle collides with something at time t7, the values of Gx, Gy, and Gz repeatedly increased and decreased in a relatively short cycle immediately after time t7. Thereafter, when the value of Gx reaches a threshold acceleration Gs (for example, 1.0) (time tp), it is recognized as a trigger, and it is determined that an event has occurred.
After time tp, the value of Gx may increase slightly, but eventually converges to near the zero value (time t8). Further, after time tp, the values of Gy and Gz are relatively small, and eventually converge.

  In FIG. 12, a period Tj from time t7 to time tp is a “period of impact before a large impact”, similar to the period Th in FIG. 10, and during this period Tj, the effect of the effect of the vehicle bumper, guardrail, etc. An impact waveform due to the impact reduction appears. Further, the period Ti from the time tp to the time t8 is a period of “impact behavior” similarly to the period Ti in FIG. 10, and in this period Tk, the vehicle moves by a recoil after the impact.

<Display example>
FIG. 13 is a diagram showing a display example of a thumbnail screen according to the experiment example shown in FIG.
In this display example, the memory card 25 which is mounted in the drive recorder 10 and in which driving information including a camera image and image-related information is recorded is taken out and displayed on the display unit 32 of the driving support device 30. .
In FIG. 13, 16 thumbnail images arranged in a matrix structure of 4 rows × 4 columns and displayed as a list on the same screen are composed of event unit images 71, 72, 73, 74, and a time unit image 71, which is created from an image taken at the same time (to be exact, the same time relative to the event occurrence time tp for each event) for each column. 72, 73 and 74 are displayed.

Next, a method of displaying a list of thumbnail images arranged in a matrix structure as described above will be described below.
First, the user selects files 91, 92, 93, and 94 of a plurality of events (four in this case) to be displayed by the second operation unit 204 from the play list 90 at the upper right of the display image shown in FIG. I do. Next, the event unit images corresponding to the selected event files 91, 92, 93, and 94 are read. Based on the read files, the thumbnail image creation and display processing is performed according to the processing procedure of the flowchart in FIG. Then, the thumbnail images are arranged in a matrix structure and displayed in a list on the same screen.

In the display example of FIG. 13, the event unit image 71 displayed for each row includes four time points of the event of the file 91 (that is, [1] an event occurrence time point which is TA seconds before the event occurrence time tp, [2] ] Thumbnail images created from captured images immediately before time tp (immediately before an event occurs), [3] immediately after time tp (immediately after an event occurs), and [4] at the end of event detection, which is TB seconds at time tp. Is displayed.
Similarly, the event unit image 72 displays the thumbnail images of the event of the file 92 at the above four time points, and the event unit image 73 displays the thumbnail image of the event of the file 93 at the above four time points. The unit image 74 displays the thumbnail images of the event of the file 94 at the above four time points.

In the display example of FIG. 13, the time unit image 81 displayed for each column is [1] TA seconds before the event occurrence time tp in each of the four thumbnail images of the event unit images 71, 72, 73, and 74. The thumbnail image created from the image captured at the time of the event occurrence is displayed.
Similarly, the point-in-time image 82 is created from the image taken immediately before (2) the event occurrence time tp (just before the event occurrence) in each of the four thumbnail images of the event unit images 71, 72, 73, and 74. The time-unit image 83 is captured immediately after (3) the event occurrence time tp (immediately after the event occurrence) in the four thumbnail images of the event-unit images 71, 72, 73, and 74, respectively. The thumbnail image created from the extracted image is displayed, and the time unit image 84 is [4] TB times after the event occurrence time tp in each of the four thumbnail images of the event unit images 71, 72, 73, and 74. A thumbnail image created from the image captured at the end of the event detection is displayed.

<Modification>
The present invention is not limited to the description of the embodiment of the present invention described above, and various modifications are possible. As a modified example, for example, the following may be performed.

(1) In the above-described embodiment, when the value (magnitude) of the G data output from the G sensor 12 reaches the threshold acceleration Gs (time tp), it is recognized as a trigger, and it is determined that an event has occurred. However, the present invention is not limited to this. For example, when the value (magnitude) of the angular acceleration data output from the gyro sensor 13 or the pressure / altitude data output from the pressure sensor 14 reaches a predetermined value, the trigger is recognized. , An event may have occurred. Alternatively, it may be determined that an event has occurred from the result of analyzing the recorded video.
In addition, when an emergency switch of the first operation unit 17 is pressed, when a signal is input from an external port, and communication from an external device such as an AVM-ECU (Automatic Vehicle Monitoring-Engine Control Unit) (for example, RS-232C) may be used as an event occurrence time.

(2) In the above-described embodiment, the first to first images captured at four points in time for each event such as sudden braking, sudden steering, and vehicle collision from the images for a predetermined period stored for each event. Although the first to fourth thumbnail images are created by selecting four images, the present invention is not limited to this, and a plurality of images taken at a plurality of different time points other than the four time points are selected and selected. A thumbnail image corresponding to the image may be created. In addition, the plurality of different time points may be various combinations depending on the type of the event. However, it is preferable to use a combination of time points at which the characteristics of the event appear (a specific period within a predetermined period).
The combination at the point in time when the feature of the event appears is determined by using various data such as “data on detecting the behavior of the vehicle” and “data on the functional state of the vehicle” stored in the memory card 25 together with the image data, alone or in combination. It is preferable that a plurality of images photographed at appropriate timing are selected based on the data, and a thumbnail image corresponding to the selected image is created.

  The “data obtained by detecting the behavior of the vehicle” may be, for example, acceleration data, angular acceleration data, air pressure / altitude data, video analysis data, and the like. The "data relating to the functional state of the vehicle" includes, for example, data relating to operation of one of a brake, a turn signal, an accelerator, a steering wheel rotation, a shift lever position, and a side brake during vehicle operation, and a vehicle failure diagnosis system. The data may be data obtained from an OBD (On Board Diagnosis) or a CAN (Controller Area Network) which is a vehicle-mounted LAN.

(3) In the above-described embodiment, as the G data, a component acceleration (G data) Gx in the X-axis direction (front-back direction of the vehicle) and a component acceleration (G data) Gy in the Y-axis direction (left-right direction of the vehicle) are used. Although the occurrence of the event is determined using the composite value, the present invention is not limited to this, and the occurrence of the event may be determined using each component acceleration (Gx, Gy) individually. For example, when Gx exceeds a predetermined threshold and then Gy exceeds a predetermined threshold within a predetermined time, a trigger is recognized when a change pattern of the value (magnitude) of each component takes a predetermined pattern. Then, it may be determined that an event has occurred. The occurrence of an event may be determined in consideration of the component acceleration Gz in the Z-axis direction (vertical direction of the vehicle) and the like in addition to Gx and Gy.

(4) Not limited to the above-described embodiment, information different from information used for determining that an event has occurred (for example, G data (Gy) in the left-right direction of the vehicle due to a sudden steering) (for example, a vehicle due to a sudden braking). May be selected at the time when the G data (Gx) in the front-rear direction of the image data reaches a predetermined value (for example, a local maximum value), and a thumbnail image may be created. Accordingly, information (eg, G data (Gx) due to sudden braking) different from information used to determine that an event has occurred (eg, G data (Gy) due to sudden steering) becomes a predetermined value. Event-based images related to events can be easily found.

(5) The present invention is not limited to the above-described embodiment. For example, when the value (magnitude) of G data reaches the threshold acceleration Gs and it is determined that an event has occurred (time tp), for example, the G data has a maximum value. A sub-event that caused an event, such as a time when it reaches a minimum value, a time when it becomes an inflection point of the time series change of G data, or a time when the G data repeatedly changes suddenly in a short time. It is also possible to select the image captured at the time when the occurrence time of the event is estimated and create a thumbnail image. As a result, for example, an event unit image related to the event at the time when the occurrence time of the sub-event that caused the event is estimated, such as at the time of a characteristic change such as a sudden increase or decrease of the G data, is easily found. be able to.

(6) In the above-described embodiment, the drive recorder 10 is of the trigger recording type that records the video before and after the “trigger indicating that the recording condition is satisfied”, but is not limited thereto. It is also possible to use a constant recording type in which recording is always performed and information for enabling the position of the triggered video to be specified is stored. In this continuous recording type drive recorder, for example, it is preferable to specify which position of which video is triggered by the video recording start time information and the trigger time information.
In the case of the above-described trigger recording type drive recorder, for example, an image recorded for a predetermined period before and after a trigger that indicates that the recording condition of the drive recorder has been established may be referred to as “event unit image”. . In addition, in the case of the drive recorder of the above-described continuous recording type, for example, in a video in which the unit from the engine on to the off is one recording unit, a part of the video recorded for a predetermined period before and after the trigger is generated is referred to as “ Event unit video ".

(7) In the above-described embodiment, the image PA for TA seconds and the image PB for TB seconds before and after the time tp when it is determined that an event has occurred are stored in the memory card 25. However, the present invention is not limited to this. The image may be stored in the memory card 25 for the entire time from the start to the off, or for a limited time in the entire time. The limited time of the entire time may be a time including the time tp when it is determined that an event has occurred.
The total time of TA seconds and TB seconds before and after the time tp may be a fixed time or a variable time every time an event occurs. The total time of TA seconds and TB seconds may be a period that is sufficient to enable the cause of the event to be specified. In particular, the total time of TA seconds and TB seconds may be different depending on the type of event.

(8) In the above-described embodiment, the time of TA seconds and the time of TB seconds before and after the time tp when it is determined that an event has occurred are set to the same time (in the example, 12 seconds before and 12 seconds after). However, the present invention is not limited to this. In particular, it is preferable to lengthen the time of TA seconds before the time tp and shorten the time of TB seconds after (for example, 15 seconds before and 5 seconds after).

(9) In the above-described embodiment, the image PA for TA seconds and the image PB for TB seconds before and after the time tp when it is determined that an event has occurred are determined before TA, immediately before (before TC), and immediately after (after TC). , The first to fourth images taken after TB seconds are selected, and the first to fourth thumbnail images are created from the selected first to fourth images. However, the present invention is not limited to this. Select two or three of the first to fourth images in combination, or select one or more of the first to fourth images and any one or more of the other images. A thumbnail image may be created from the selected image by selecting a combination of the images.

(10) In the above-described embodiment, an image photographed before and after the time tp when it is determined that an event has occurred is selected. However, the present invention is not limited to this, and an image photographed at the time tp is selected. The image and the images before and after the time tp may be combined.

(11) In the embodiment described above, as in the example of the display mode of the thumbnail images shown in FIG. 5, 16 thumbnail images form an event unit image for one event for each row, and for each column, Although the time unit image at the same time point is configured, the present invention is not limited to this, and the event unit image may be configured for each column by exchanging rows and columns, and the time unit image may be configured for each row. In addition, when an event-based image for one event is configured for each row (or column), simply arranging the event-based images in one row (or within a column) in chronological order, Instead of the same point in time, an image at a point in time according to the type of event may be used. Furthermore, it is not limited to 4 rows in the vertical direction and 4 columns in the horizontal direction, but is arranged in a matrix structure of other combinations of the number of rows and columns, such as 5 rows × 5 columns and 3 rows × 3 columns, and is displayed in a list on the same screen. May be. Furthermore, when the display cannot be completely displayed on the screen, it is preferable that the matrix be scrolled and displayed integrally instead of scrolling left and right for each event.

(12) In the above-described embodiment, the display control system of the present invention has been described as an example of the driving support system (the driving support device 30). However, the display control system can be implemented as functions of various electronic devices. For example, it may be incorporated as a function of a navigation device, a drive recorder, a radar detector, and a car audio.

(13) Not limited to the above-described embodiment, the control program stored in advance in the ROM of the second control unit 31 of the driving support device 30 can be transferred to a portable terminal such as a general-purpose personal computer, a mobile phone, a smartphone, or a portable game machine. It is downloaded, and the computer mounted on the portable terminal is made to execute the control processing of the second control unit 31 to read the image and various data stored in the memory card 25, and is created from the read image and various data. A thumbnail image may be displayed.

(14) Each function of the above embodiment is realized by describing the function in a computer-readable program language and causing the computer of the second control unit 31 to execute the program, but is not limited thereto. Instead, for example, the program may be distributed to a plurality of computers and distributed processing may be performed.

Reference Signs List 10 drive recorder 11 first control unit 12 acceleration sensor (G sensor)
Reference Signs List 13 Gyro sensor 14 Barometric pressure sensor 15 GPS antenna 16 GPS receiver 17 First operation unit 18 First memory 19 First IF (interface)
Reference Signs List 20 CCD camera 21 Vehicle signal acquisition unit 22 Power supply unit 25 Memory card 30 Driving support device 31 Second control unit 32 Display unit 33 Output unit 34 Second operation unit 35 Second memory 36 Second IF (interface)
37 Image processing unit 38 Display processing unit 51-54, 71-74 Event unit image 61-64, 81-84 Time unit image 90 Playlist 91-94 file

Claims (6)

A display control system that performs control for displaying a thumbnail image related to a video recorded by a drive recorder mounted on a vehicle,
A display having a function of displaying a plurality of thumbnail images corresponding to mutually different time points in the video, the plurality of thumbnail images being selected based on data on a sharp steering wheel of the driver of the vehicle recorded by the drive recorder. Control system. The display control system according to claim 1, wherein the plurality of thumbnail images include an image at a time when the sudden steering wheel is started. The display control system according to claim 1, wherein the plurality of thumbnail images include an image at a time when the sharp steering wheel ends. The plurality of thumbnail images, together with the image when the sudden steering wheel ends,
The display control system according to any one of claims 1 to 3, wherein an image when the acceleration reaches a maximum value is displayed. As the plurality of thumbnail images, together with the image when the sudden steering wheel ends,
The display control system according to any one of claims 1 to 4, wherein an image when the acceleration has a minimum value is displayed. A program for causing a computer to realize the functions of the display control system according to any one of claims 1 to 5.