JP6899596B2 - Display control system, display control method and program - Google Patents

Description

The present invention relates to a display control system, a display control method, and a program for controlling the display of thumbnail images related to event unit images recorded by a drive recorder mounted on a vehicle.

Conventionally, an in-vehicle image that captures an image of the surroundings of the vehicle with a camera installed in the vehicle and records the surrounding image and the vehicle speed when an impact is applied to the vehicle due to an event (event) such as sudden braking, sudden steering, or collision. Equal recording devices, so-called drive recorders, are in widespread use. By equipping the vehicle with such a drive recorder, it is possible to verify the cause of the accident by analyzing the recorded information when an accident occurs. In addition, the driver's awareness of safe driving can be improved, and the video recording the daily driving situation can be used for safe driving guidance.

In Patent Documents 1 and 2, driving information such as camera images, vehicle speeds, and GPS (Global Positioning System) position information recorded by drive recorders mounted on commercial vehicles such as trucks and taxis is collected, and the operation manager Etc. discloses a driving support device that checks the contents of driving information, analyzes the driving method of each crew member, and utilizes it for driving training of the crew members.

Japanese Unexamined Patent Publication No. 2010-257843 Japanese Unexamined Patent Publication No. 2010-257484

In the above driving support device, the operation manager, etc. suddenly brakes from a large number of driving information (hereinafter referred to as event unit video) recorded for each event (event) such as sudden braking, sudden steering, or collision. In order to narrow down and select the event unit video of a specific event such as, for example, the related data such as the magnitude and waveform of the acceleration recorded in each event unit video is used. That is, this related data is recognized as a tag for narrowing down the event unit video of a specific event, and the event unit video is classified and narrowed down. However, in order to specify the event-based video of the event that is finally desired, the operation manager or the like must visually check the contents of the camera images included in each event-based video one by one and specify the event-based video. Must be.

Further, in the driving support device disclosed in Patent Documents 1 and 2, among a plurality of camera images included in one event unit image, a timing signal indicating that a trigger (for example, a recording condition by a drive recorder is satisfied) is satisfied. ) Is displayed as a reduced thumbnail image of the camera image recorded at the time of detection, but this thumbnail image is for trigger detection after the time when an event such as sudden braking or sudden steering occurs. Since it is a camera image recorded at a time point, it is difficult to find an event unit image of a desired event from this thumbnail image.

The present invention has been made in view of the above-exemplified circumstances, and an object of the present invention is to provide a display control system, a display control method, and a program capable of easily finding a desired event unit image from thumbnail images. Is what you do.

From the first aspect, the present invention is a display control system that controls to display thumbnail images related to event unit images recorded by a drive recorder mounted on a vehicle, and is within the range of the event unit images. Provided is a display control system including display control means for displaying a plurality of thumbnail images corresponding to different time points.

In the display control system according to the first aspect, the content of the event unit video can be confirmed from a plurality of thumbnail images corresponding to different time points in the range of the event unit video. As a result, the desired event unit video can be easily found from the thumbnail image as compared with the case where the content of the event unit video is confirmed from one thumbnail image.

The event may be, for example, an event specified by a predetermined rule. The event unit may be, for example, a time range of a unit in which one event and another event can be managed separately. For example, it may be a predetermined period before and after the time when the event occurs as in the configuration of the second viewpoint. For example, one event unit and another event unit may be set so that their time ranges do not overlap, or, for example, some of them may be set so as to overlap each other.
The event unit video may be, for example, a video in a time range of a unit that can distinguish and manage a certain event and another event. The event unit video may be recorded as separate video for each event, for example, or a certain range in one video may be recorded as an event unit video. That is, the "event-based video recorded by the drive recorder mounted on the vehicle" does not necessarily have to record the video for each event.

When a certain range in one video is used as an event unit video, for example, the ranges of a plurality of event unit videos may be set so as to allow the overlapping of the ranges, or each event unit within the non-overlapping range. The range of the image may be set. The event unit video may be, for example, a range in the video that may be related to the event.
Further, "a plurality of thumbnail images corresponding to different time points in the range of the event unit video" is, for example, "a plurality of thumbnail images corresponding to videos other than the event unit video at different time points in the range of the event unit video". However, it may be "a plurality of thumbnail images corresponding to the event unit video at different time points in the range of the event unit video". As a specific example of "corresponding to" of "a plurality of thumbnail images corresponding to event unit video", "representing" may be used. In addition, it may be "created from", "image processed", "created by image processing", "created by performing predetermined image processing", and the like.

From the second aspect, in the display control system according to the first aspect, the event unit image is an image over a predetermined period before and after the occurrence of the event, and the thumbnail image of the event is used as the thumbnail image. It is characterized by including images recorded at any or both times before, after, or at the time of occurrence.

In the display control system based on the second aspect, the content of the event unit video can be confirmed from the thumbnail images corresponding to the images recorded at any time before or after the event occurrence, or at both times. Become. As a result, it is possible to more easily find the event unit video related to the event at the time before and after the event occurs.

The time when the event occurs may be, for example, a time when a predetermined condition is satisfied. The time when the event occurs may be, for example, a time when a predetermined condition representing the event is satisfied. For example, the range of the event unit video may be determined according to the type of the event, with the time when a predetermined condition is satisfied as the time when the event occurs. The event may be, for example, a time when an event corresponding to the occurrence of an accident is occurring. For example, the location where the sudden deceleration corresponding to a collision occurs may be the time when the event occurs.

In the drive recorder, for example, a type that records the video before and after the "trigger indicating that the recording condition is satisfied" or the video is constantly recorded (for example, from the engine on to the off) and the trigger is applied. There is a type that stores information to make it possible to identify the position of the image. This "information for making it identifiable" is, for example, time information when a trigger is applied. For example, from the video recording start time information and the time information at which this trigger is applied, it is possible to specify which position of which video is the trigger position.

In the case of the former type of drive recorder described above, the "event unit image" is, for example, an image recorded for a predetermined period before and after the occurrence of the trigger indicating that the recording condition by the drive recorder is satisfied. Good.
Further, in the case of the latter type of drive recorder described above, the "event unit image" is, for example, the occurrence of a trigger in the image in which the recording unit (in the above example, one unit is from engine on to off). It is preferable to use the image of the part recorded over a predetermined period before and after the time point.

The predetermined period may be, for example, the entire range of the recorded video (for example, the entire range from engine on to off), but is particularly preferably a range of a limited time in the video. The limited time range in the video is particularly preferably the time range including the time when the event occurs. The limited time range in the video may be, for example, a fixed time range or a variable time. Further, the period before the occurrence time of the event and the period after the occurrence time of the event constituting the predetermined period may be the same time period, but may be different time periods. In particular, the predetermined period may be a sufficient period so that the cause of the occurrence of the event can be identified. In particular, the predetermined period may be in a different range depending on the type of event.

From the third viewpoint, the present invention determines that the event has occurred as the thumbnail image in the display control system according to the second viewpoint at a time other than the time when the event occurs within the predetermined period. It is characterized by including an image recorded at a time determined by a predetermined rule using the information used for the event.

In the display control system from the third viewpoint, the information (for example, the acceleration applied to the vehicle) used to determine that the event has occurred is used at a time other than the time when the event occurs within a predetermined period. The content of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded at the time determined by the predetermined rule (for example, when the acceleration exceeds the predetermined value). As a result, it is possible to easily find the event unit video related to the event at the time determined by the above predetermined rule.

From the fourth aspect, the present invention is used in the display control system according to the second or third aspect to determine that the event has occurred as the thumbnail image within the predetermined period. It is characterized by including an image recorded at a time determined by a predetermined rule using information different from the information.

In the display control system according to the fourth aspect, information different from the information used for determining that an event has occurred (for example, the acceleration of the vehicle in the left-right direction by a sudden steering wheel) within a predetermined period (for example, sudden). From the thumbnail image corresponding to the image recorded at the time determined by a predetermined rule using the braking acceleration of the vehicle in the front-rear direction (for example, the time of the maximum value of the acceleration in the front-rear direction of the vehicle within a predetermined period). , You will be able to check the contents of the event unit video. As a result, it is possible to easily find the event unit video related to the event at the time determined by the above predetermined rule.

From the fifth aspect, in the display control system according to the third or fourth aspect, the predetermined rule is a rule for estimating the occurrence time of the sub-event that caused the occurrence of the event. It is characterized by being.

In the display control system according to the fifth aspect, it is possible to easily find the event unit image related to the event at the time determined by the rule for estimating the occurrence time of the sub-event that caused the occurrence of the event.
A predetermined rule is a rule for estimating a feature point related to the occurrence of the event retroactively from the time when it is determined that the event has occurred, for example, a maximum point or an inflection point within a predetermined period of the acceleration of the vehicle, and the like. It is good to use it as a characteristic point of acceleration. In addition, it is advisable to use different rules depending on the type of event.
The predetermined period may be set with a sufficient time for the sub-event that causes the event to be considered to be unlikely to occur.

From the sixth aspect, the present invention relates to the display control system according to any one of the second to fifth aspects, and the event occurs at any time before or after the event occurs, or at both times. It is characterized by having different time points depending on the type of.

In the display control system according to the sixth aspect, the event unit is from the thumbnail image corresponding to the image recorded at a time point different depending on the type of event as either before or after the event occurrence time point or both time points. You will be able to check the contents of the video. This makes it possible to easily find event-based images related to events at different time points depending on the type of event.

From the seventh aspect, the present invention presents the present invention as the thumbnail image in the display control system according to any one of the second to sixth aspects, at any time immediately before or immediately after the event occurs, or at both times. It is characterized by having an image recorded in.

In the display control system according to the seventh aspect, the contents of the event unit video can be confirmed from the thumbnail images corresponding to the images recorded immediately before, immediately after, or both of the event occurrence points. .. As a result, it is possible to more easily and accurately find the event-based video related to the event immediately before or after the event occurs.

From the eighth aspect, the present invention was recorded as the thumbnail image in the display control system according to any one of the second to seventh aspects, both immediately before and immediately after the occurrence of the event. The acquisition interval of the information provided with the image and used to determine that the event has occurred is set to an interval shorter than the recording interval of the frame of the video, and is recorded at a time immediately before the event occurs. The image is the image of the frame immediately before the time when it is determined that the event has occurred, and the image recorded immediately after the time when the event has occurred is immediately after the time when it is determined that the event has occurred. The feature is that it is a frame image.

In the display control system according to the eighth aspect, the content of the event unit video can be confirmed from the thumbnail images corresponding to the images recorded at both the time immediately before and immediately after the event occurs. As a result, it is possible to more easily and accurately find the event-based video related to the event at both the time immediately before and immediately after the event occurs.

From the ninth aspect, the present invention, in the display control system according to any one of the first to eighth aspects, as the thumbnail image, either the first or the last in the event unit image, or both. It is characterized by including an image recorded at a time point.

In the display control system according to the ninth aspect, the contents of the event unit video can be confirmed from the thumbnail images corresponding to the images recorded at either the first or the last or both of the event unit video. Become. As a result, it is possible to find the event unit video related to the event at the beginning and the end of the event unit video more easily and more accurately.

From a tenth aspect, the present invention is characterized in that, in the display control system according to any one of the second to ninth aspects, the thumbnail image includes an image recorded at the time of occurrence of the event. ..

In the display control system according to the tenth viewpoint, the contents of the event unit video can be confirmed from the thumbnail images corresponding to the images recorded at the time of event occurrence. As a result, it is possible to more easily and more accurately find the event-based video related to the event at the time of the event occurrence.

From the eleventh viewpoint, the present invention relates to the display control system according to any one of the first to tenth viewpoints, depending on the state of the vehicle when the event unit image is recorded as the thumbnail image. It is characterized in that an image of a specific period within the range of the event unit video is provided.

In the display control system according to the eleventh viewpoint, the content of the event unit image can be confirmed from the thumbnail image corresponding to the image of the specific period according to the state of the vehicle when the event unit image is recorded. As a result, it is possible to more easily find the event unit image related to the state of the vehicle when the event unit image is recorded.

The "state of the vehicle when the event unit image is recorded" is, for example, the state of the vehicle such as (1) sudden braking, (2) sudden steering, and (3) when the vehicle collides with something. is there.
The "image of a specific period selected from the event unit video" is, for example, (1) in the case of sudden braking, the image recorded from the time when the brake is applied to the time when the brake is released, or the acceleration applied to the vehicle. It is an image recorded at the time from the appearance of the event to the end of the event. Further, (2) in the case of a sudden steering wheel, it is an image or the like recorded at a time from the start of turning the steering wheel to the end of turning the steering wheel. Furthermore, (3) when the vehicle collides with something, the images recorded from the time when the acceleration behavior of the vehicle due to the reaction of the bumper, guardrail, etc. is born to the time when the vehicle stops and the acceleration behavior converges, etc. is there.

From the twelfth viewpoint, the present invention is an image recorded as the thumbnail image at a time when the acceleration applied to the vehicle exceeds a predetermined value in the display control system according to any one of the first to eleventh viewpoints. It is characterized by having.

In the display control system according to the twelfth aspect, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image recorded when the acceleration applied to the vehicle exceeds a predetermined value. As a result, it is possible to more easily find the event unit image related to the time when the acceleration applied to the vehicle exceeds a predetermined value.

From the thirteenth aspect, the present invention is the display control system according to any one of the second to twelfth aspects, and the occurrence of the event is specific behavior information based on the information obtained by detecting the behavior of the vehicle. It is characterized by that.

In the display control system according to the thirteenth viewpoint, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image in which the specific behavior information based on the information that detects the behavior of the vehicle is recorded as an event. This makes it easier to find an event-based video in which specific behavior information is recorded as an event.

The "information that detects the behavior of the vehicle" is, for example, from any of the detection results of the acceleration sensor, the gyro sensor, the barometric pressure sensor (or the altitude sensor) mounted on the vehicle, the analysis result of the recorded image, and the like. Information that can be obtained.

From the 14th viewpoint, in the display control system according to any one of the second to thirteenth viewpoints, the present invention means that the occurrence of the event is specific vehicle information based on the information regarding the functional state of the vehicle. It is characterized by.

In the display control system according to the fourteenth viewpoint, the content of the event unit video can be confirmed from the thumbnail image corresponding to the image in which the specific vehicle information based on the information on the functional state of the vehicle is recorded as an event. As a result, it is possible to more easily find the event unit video in which the specific vehicle information is recorded as an event.

"Information on the functional state of the vehicle" is, for example, the operation of any of the brake, blinker, accelerator, handle rotation, shift lever position, and side brake during vehicle driving, and OBD (On Board), which is a vehicle failure diagnosis system. Diagnosis), information obtained from CAN (Controller Area Network), which is an in-vehicle LAN.

From the fifteenth viewpoint, the present invention relates to the display control system according to any one of the first to fourth aspects, wherein the plurality of thumbnail images form different rows of thumbnail images of different event unit images. , It is characterized in that thumbnail images at the same time point are displayed in a list on the same screen by a matrix structure forming different columns.

In the display control system according to the fifteenth viewpoint, a plurality of thumbnail images are displayed in a visually easy-to-understand list in a state of being organized as thumbnail images for different event unit images or thumbnail images at the same time point. This makes it easier to determine the content of the thumbnail image.

From the 16th viewpoint, in the display control system according to any one of the first to fifteenth viewpoints, the present invention has the plurality of thumbnail images in which the thumbnail images for the same event unit video are in the same line from left to right. Alternatively, it is characterized in that it is displayed in a list on the same screen by a matrix structure configured to be arranged in chronological order from right to left.

In the display control system according to the sixteenth viewpoint, a plurality of thumbnail images are visually and easily displayed in a list as thumbnail images in which the same line is arranged in chronological order for each event unit video. This makes it easier to determine the content of the thumbnail image.

It can be regarded as an invention of a method having a step corresponding to a component of the display control means according to any one of the first to sixth aspects. For example, as an invention of a method corresponding to the first aspect, in the seventeenth aspect, the present invention controls to display a thumbnail image related to an event unit image recorded by a drive recorder mounted on a vehicle. The present invention provides a display control method, which comprises a step of displaying a plurality of thumbnail images corresponding to different time points in the range of the event unit video.

In the display control method from the 17th viewpoint, the content of the event unit video can be confirmed from a plurality of thumbnail images corresponding to different time points in the range of the event unit video. Therefore, the desired event unit video can be obtained as a thumbnail image. You can easily find it from.

From the eighteenth aspect, the present invention can provide a program for realizing a function as a display control system according to any one of the first to sixth aspects in a computer.

According to the display control system of the present invention, it is possible to easily find the desired event unit image from the thumbnail image.

It is a figure which shows the schematic structure of the driving support system which concerns on Example 1. FIG. It is a figure which conceptually shows the data structure of the content recorded in the memory card 25. It is a figure explaining the state of the acceleration change at the time of event occurrence and the storage method of an image, etc. according to Example 1. It is a flowchart which shows the creation and display processing of the thumbnail image which concerns on Example 1. FIG. It is a screen display figure which shows an example of the display mode of the thumbnail image which concerns on Example 1. FIG. It is a figure which shows the acceleration change in the case of the sudden braking which concerns on Example 2. FIG. It is a flowchart which shows the creation and display processing of the thumbnail image which concerns on Example 2. It is a figure which shows the acceleration change in the case of the steep steering wheel which concerns on Example 3. FIG. It is a flowchart which shows the creation and display processing of the thumbnail image which concerns on Example 3. FIG. It is a figure which shows the acceleration change in the case of the vehicle collision which concerns on Example 4. FIG. It is a flowchart which shows the creation and display processing of the thumbnail image which concerns on Example 4. FIG. It is a figure which shows the experimental example of the acceleration change in the case of a vehicle-to-vehicle collision. It is a figure which shows the display example of the thumbnail screen which concerns on the experimental example shown in FIG.

Hereinafter, the display control system according to the embodiment of the present invention will be described in detail with reference to the drawings. The present invention is not construed as being limited to this, and various changes, modifications, and improvements can be made based on the knowledge of those skilled in the art without departing from the scope of the present invention.

[Example 1]
<Driving support system configuration>
FIG. 1 is a diagram showing a schematic configuration of a driving support system according to a first embodiment of the display control system of the present invention.

As shown in FIG. 1, the driver assistance system reproduces the drive recorder 10 mounted on the vehicle, the memory card 25 that stores an image when an event occurs in the drive recorder 10, and the image stored in the memory card 25. It is composed of a driving support device 30 for the purpose.

The drive recorder 10 is a first control unit 11, an acceleration sensor (G sensor) 12, a gyro sensor 13, a pressure sensor 14, a GPS antenna 15, and a GPS that positions GPS position information of a vehicle from a GPS signal received by the GPS antenna 15. (Global Positioning System) A first operation unit 17 including a receiver 16, a switch, a button, and the like, a first memory 18 for primary storage of images, a slot for inserting a memory card 25, and a memory card 25. A first IF (interface) 19 for writing an image to, a CCD camera 20 installed in the vehicle so as to continuously image the front of the vehicle at a predetermined rate, a vehicle signal acquisition unit 21, and a drive recorder. It has a power supply unit 22 and the like for supplying power to each element of 10.

Further, the drive recorder 10 may be configured to reproduce an image on the display of the navigation device in cooperation with the navigation device (not shown). Further, although the GPS receiver 16 is not necessarily indispensable, the GPS receiver 16 may be configured to acquire the position information received by an external device such as an AVM (Automatic Vehicle Monitoring) system or a navigation device.

The first control unit 11 is composed of a microcomputer or the like including a CPU, a ROM, a RAM, and the like, and controls the entire operation of the drive recorder 10.

The G-sanser 12 detects gravitational acceleration (hereinafter, simply referred to as acceleration) in two axial directions (X-axis and Y-axis) orthogonal to each other, and the detected acceleration (also referred to as G data) is the first control unit together with time data. Send to 11. The first control unit 11 can acquire the G data (Gx, Gy) output from the G sensor 12 at intervals of 10 milliseconds, for example, and determine the acceleration value (magnitude) from the G data.

Gx is the acceleration in the X-axis direction (front-rear direction of the vehicle), and Gy is the acceleration in the Y-axis direction (left-right direction of the vehicle). Further, the G sensor 12 may be a 3-axis sensor 12 including the Z-axis direction (vertical direction of the vehicle), or the 3-axis sensor 12 does not use the data of the acceleration Gz in the Z-axis direction. Is also good.

The gyro sensor 13 detects the angular acceleration (rotation) of the vehicle, and mainly detects the change in the traveling direction of the vehicle (that is, the rotation of the yaw (Z axis) which is the vertical axis), and the detected angular acceleration data. Is transmitted to the first control unit 11 together with the time data. The first control unit 11 can acquire the angular acceleration data output from the gyro sensor 13 at intervals of 10 milliseconds, for example, and determine the angular acceleration value (magnitude) from the angular acceleration data.

The barometric pressure sensor 14 detects the atmospheric pressure outside the vehicle, calculates the altitude based on the detected barometric pressure value, and transmits the barometric pressure value and the altitude value (barometric pressure / altitude data) to the first control unit 11 together with the time data. .. The first control unit 11 can acquire the barometric pressure / altitude data output from the barometric pressure sensor 14 at intervals of 10 milliseconds, for example, and determine the barometric pressure / altitude value (magnitude) from the barometric pressure / altitude data.

In the first control unit 11, the CCD camera 20 captures one image every 100 milliseconds, and the captured image is sequentially and cyclically stored in the first memory 18 together with the time data (to the memory card 25 described later). It is controlled to be the primary memory for the memory of. For example, the image data for 24 seconds (240 images) captured by the CCD camera 20 is always stored in the first memory 18. The image captured by the CCD camera 20 is not limited to one image every 100 milliseconds, but may be one image every 50 milliseconds, for example. Further, it may be configured to store the moving image taken by the CCD camera 20.

The vehicle signal acquisition unit 21 is connected to a vehicle failure diagnosis connector to acquire various vehicle signals and information (vehicle data) at intervals of, for example, 100 milliseconds, and first controls the acquired vehicle data together with time data. It is transmitted to the part 11. The vehicle data includes, for example, [1] a signal for detecting a brake operation during vehicle driving, [2] a signal for detecting a winker operation, [3] a signal for detecting an accelerator operation, and [4] a signal for rotating the handle. The detected signal, [5] the signal that also detected the shift lever position, [6] the signal that also detected the side brake operation, and [7] the vehicle failure diagnosis information (OBD) obtained from the vehicle failure diagnosis system (OBD) in the vehicle ( Vehicle speed, engine speed, cooling water temperature, etc.), [8] Various vehicle information obtained via the in-vehicle LAN (CAN) (each function control data from the ECU (Electronic Control Unit) of the own vehicle, network outside the vehicle, etc. Communication data from the vehicle, etc.).

As an example, when the vehicle signal acquisition unit 21 acquires a signal for detecting a brake operation, the brake operation data indicating whether or not the brake of the vehicle has been operated and the brake operation start time data indicating the time when the brake operation is started are shown. And the brake operation end time data indicating the time when the brake operation is completed is transmitted to the first control unit 11. That is, based on the brake operation data, the brake operation start time data, and the brake operation end time data from the vehicle signal acquisition unit 21, the first control unit 11 determines whether or not the brake operation has been performed, the time when the brake operation was started, and the time when the brake operation was started. It is possible to determine the time when the brake operation is completed.

As another example, when the vehicle signal acquisition unit 21 acquires a signal for detecting the rotation of the handle, the handle rotation data indicating whether or not the handle of the vehicle has been rotated and the handle rotation start indicating the time when the handle rotation has started are started. The time data and the handle rotation end time data indicating the time when the handle rotation is completed are transmitted to the first control unit 11. That is, based on the steering wheel rotation data, the steering wheel rotation start time data, and the steering wheel rotation end time data from the vehicle signal acquisition unit 21, the first control unit 11 determines whether or not the steering wheel has been rotated, the time when the steering wheel rotation has started, and the time when the steering wheel rotation has started. It is possible to determine the time when the steering wheel rotation is completed.

A part or all of the GPS antenna 15, the GPS receiver 16, the first IF19, the CCD camera 20, the vehicle signal acquisition unit 21, and the like may be configured separately from the drive recorder 10. For example, when linked with an existing navigation device having a GPS function, the drive recorder 10 does not need a function such as a GPS receiver 16, so that the cost of the drive recorder 10 can be kept low by that amount.

The driving support device 30 includes a second control unit 31, a display unit 32 composed of a display and the like, an output unit 33 composed of a printer and the like that prints a display screen on paper, and an input device such as a keyboard and a mouse. A second operation unit 34, a second memory 35 for primary storage of images, and a second IF (interface) 36 for reading an image from the memory card 25, including a slot for inserting the memory card 25. , And an image processing unit 37 and the like for performing predetermined image processing on the input image.

The second control unit 31 is a personal computer (PC) that includes a CPU, ROM, RAM, and the like and has driving support software installed, and interprets and executes a program included in the driving support software to execute the driving support device 30. Each component of the above is operated to realize various functions related to the feature portion of the present invention.

The driving support device 30 is an aspect of a display control system that controls the display of thumbnail images related to the event unit video recorded by the drive recorder 10. Further, in the present embodiment, as the event unit video, an image recorded in a predetermined period before and after the occurrence of the event is used. The time of occurrence of the event is, for example, the time when an event corresponding to the occurrence of an accident is occurring, and the time when an impact is applied to the vehicle due to the occurrence of sudden deceleration such as sudden braking.

The memory card 25 is a rewritable non-volatile semiconductor memory card having a storage capacity of 2 GB. The memory card 25 is inserted into a slot constituting the first IF 19 and is always cyclically and primarily stored in the first memory 18 for a predetermined period before and after the occurrence of the event (for example, of an event). The image for 12 seconds before the time of occurrence and the image for 12 seconds after the occurrence) are stored. After that, the memory card 25 is ejected from the slot constituting the first IF 19 and reinserted into the slot constituting the second IF 36, and outputs the stored image to the driving support device 30.

Although a semiconductor memory card is used as the memory card 25, the semiconductor memory card other than the card type, a portable hard disk (HD), other storage media, and the like can be used without limitation. Further, the storage capacity of the memory card or the like is arbitrary and can be freely determined according to the application.

When the drive recorder 10 satisfies a predetermined condition (that is, when an event to be recorded by the drive recorder 10 occurs), specifically, (a) sudden braking, sudden steering, collision, or the like, or , When an impact is applied to the vehicle due to the occurrence of an event (event) corresponding to the occurrence of another accident, and the value (magnitude) of the G data output from the internal G sensor 12 exceeds a predetermined threshold value. And other (b) When the emergency switch of the first operation unit 17 is pressed, various data for several seconds to ten and several seconds before and after (for example, 12 seconds before, 12 seconds after, etc.) are collected by using the detection as a trigger. It is acquired together with the event occurrence time data and recorded in the memory card 25 as one operation information.

The operation information recorded on the memory card 25 is G data output from the G sensor 12, angular acceleration data output from the gyro sensor 13, pressure / altitude data output from the pressure sensor 14, and GPS receiver 16 positioned. It includes GPS position information, camera image data taken by the CCD camera 20, various vehicle signals and information (detection data such as brake operation and steering wheel rotation, vehicle speed data, etc.) acquired by the vehicle signal acquisition unit 21.

The drive recorder 10 corresponds to each of a plurality of camera images for several seconds to a dozen seconds (for example, 12 seconds before, 12 seconds after, etc.) from the time when the event to be recorded occurs and the trigger is detected. Attached, various data of operation information is recorded in the memory card 25.

<Data structure of memory card>
Next, with reference to FIG. 2, the data structure of the contents recorded in the memory card 25 will be described. FIG. 2 is a diagram conceptually showing the data structure of the contents recorded on the memory card 25.

As shown in FIG. 2, the memory card 25 records the corresponding operation information separately for each event, such as operation information 1, operation information 2, and operation information 3. The driving information 1 is composed of 240 camera images 1 to 240 corresponding to 24 seconds before and after the event occurrence (12 seconds before and 12 seconds after), and image-related information including other driving information other than the camera images. It is composed. The image-related information includes main item data including G data at the time of event occurrence and time data thereof, and related data 1 to 240 corresponding to each of 240 camera images 1 to 240. The same applies to the operation information 2 and 3.

The main item data includes G data, angular acceleration data, pressure / altitude data, and each time data, and the image-related data includes the shooting date and shooting time of the camera image, and various signals and information of the vehicle at the time of shooting the camera image. (Detection data such as brake operation and steering wheel rotation, vehicle speed data, etc.), GPS position information of the vehicle is included.

<Acceleration change when an event occurs and how to store images, etc.>
Next, with reference to FIG. 3, a state of change in acceleration (G data) detected by the G sensor 12 (see FIG. 1) of the drive recorder 10 when an event such as an impact is applied to the vehicle occurs. A method of storing an image or the like in the drive recorder 10 will be described.

FIG. 3A shows time-series changes in G data (combined values of Gx and Gy) output from the G sensor 12, and FIG. 3B shows an example of an image period stored in the memory card 25. As shown, FIG. 3C shows an example of the selection timing of the image that is the source of the created thumbnail image. The creation and display of thumbnail images will be described later.

From the time when the vehicle is impacted, the value (magnitude) of the G data output from the G sensor 12 rapidly increases from almost zero. Then, as shown in FIG. 3A, when the value (magnitude) of the G data of the G sensor 12 reaches the threshold acceleration Gs (for example, 0.3 G) at the time tp (time tp), the th. 1 The control unit 101 recognizes it as a trigger, determines (determines) that an event has occurred, captures an image of the CCD camera 20, and constantly periodically stores the image in the first memory 18 in the primary memory card 25. The time tp is stored in the memory card 25 as event occurrence determination time data.

Specifically, as shown in FIG. 3B, the memory card 25 is controlled to store the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp. For example, TA can be 12 seconds and TB can be 12 seconds. The TA and TB periods can be set freely. For example, while displaying the set time (seconds) on the setting screen (not shown) of the drive recorder 10, the time is set by operating the time setting button of the first operation unit 17 of the drive recorder 10, and the set information is set. Can be set at any time by saving.

When an event such as an impact is applied to the vehicle as described above occurs and the value (magnitude) of the detected G data of the G sensor 12 exceeds a predetermined threshold value, the first control unit 11 is used for each event. Is event occurrence time data (tp), detection G data (Gx, Gy) of G sensor 12 and its time data, detection angle acceleration data of gyro sensor 13 and its time data, pressure / altitude data of pressure sensor 14 and its time. Time data, vehicle data for TA seconds before time tp and TB seconds after time tp acquired by the vehicle signal acquisition unit 21 and its time data (for example, brake operation data and its time data, handle rotation data and its). Time data, vehicle speed data and its time data, etc.) are stored in the memory card 25 together with image data. It should be noted that only a part of the above-mentioned data may be stored in the memory card 25.

The number of events stored in the memory card 25 can be changed according to the storage capacity of the memory card 25, but for example, it is preferable to be able to store data for 500 events or more. Further, the first control unit 11 creates a folder on the memory card 25 for each event, and creates image data, event occurrence time data (tp), G data (Gx, Gy) of the G sensor 12, and the time data, corners. It is preferable to store acceleration data and its time data, pressure / altitude data and its time data, vehicle data and its time data.

When the above-mentioned event occurs, the event occurrence is triggered by exceeding the threshold acceleration Gs. For example, when the amount of change in acceleration per unit time exceeds a certain value (G in 0.1 seconds). It may be determined that the event has occurred when the value (magnitude) of the data changes by 0.1 G or more).

<Creation and display of thumbnail images (Example 1)>
Next, the creation and display processing of the thumbnail image in the driving support device 30 will be described with reference to FIG. In this example, the thumbnail image creation and display processing operation for one event will be described.
FIG. 4 is a flowchart showing the creation and display processing of the thumbnail image according to the first embodiment, and the creation and display processing of the thumbnail image is loaded from the HDD or the like into the RAM of the second control unit 31 of the driving support device 30. It is realized by the CPU executing according to the control program, and is started based on the operation of starting the operation support software of the second operation unit 34. Further, it is assumed that the memory card 25 in which the image is stored in the drive recorder 10 is inserted into the second IF 36 constituting the slot at the time when the processing of the flowchart shown in FIG. 4 is started.

In step S11, the second control unit 31 acquires the event occurrence determination time data (tp) from the data stored in the memory card 25.

Next, in step S12, the second control unit 31 sets a plurality of different timings from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. 3 (b). Select multiple captured images.

Specifically, in this control program, the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. 3 (b) are shown in FIG. 3 (c). The image P1 taken at the time ts before TA seconds (for example, 12 seconds) of the indicated time tp is selected as the "first image", and immediately before the time tp (predetermined time TC seconds before, for example 0.2 seconds). ), The image P2 taken at the time tp1 is selected as the "second image", and the image P3 taken immediately after the time tp (after a predetermined time TC, for example, 0.2 seconds later) is selected as the "second image". A control process is programmed such that the image P4 is selected as the "third image" and the image P4 captured at the time te after TB seconds (for example, 12 seconds) of the time tp is selected as the "fourth image". The second control unit 31 performs selection control of the first to fourth images from the image PA and the image PB according to such a control program.

The time ts, which is TA seconds before the time tp, is the time when the storage of the image is started in one event, and the "first image" is also the image taken at the time when the event occurs. Further, the time te after TB seconds of the time tp is also the time when the memory of the image is finished in one event, and the “fourth image” is the image taken at the time when the event detection is finished.
Further, the predetermined time TC can be set to, for example, 0.2 seconds, but an optimum value including 0 seconds can be selected depending on the application. For example, while displaying the set time (seconds) on the setting screen (not shown) of the driving support device 30, the time is set and set by operating the time setting button of the second operation unit 34 of the driving support device 30. By saving the information, it can be set at any time.

Next, in step S13, the second control unit 201 is stored in the ROM in the second control unit 201, and according to the control program, the image processing unit 37 is subjected to the “first to fourth images” selected in step S12. (P1 to P4) to perform image processing to create the first to fourth thumbnail images.

In order to create a thumbnail image from the selected first to fourth images, for example, the original first to fourth images are subjected to image processing to reduce each image to create a thumbnail image. In addition to the image processing for reducing, other predetermined image processing such as performing image processing for enlarging the selected first to fourth images and performing image processing for cutting out a part of the image. You may create a thumbnail image by applying. Further, the selected first to fourth images may be used as they are as thumbnail images without any image processing.

In the following step S14, the second control unit 31 displays the first to fourth thumbnail images created in step S13 to the display processing unit 38 according to the control program stored in the ROM in the second control unit 31. A display process for displaying on the display unit 32 is performed. Specifically, as will be described later, thumbnail images are arranged in a matrix structure and displayed in a list on the same screen.
This completes the thumbnail image creation and display processing for one event.

<Display example of thumbnail image>
Next, one aspect of the display image displayed on the display unit 32 of the driving support device 30 will be described with reference to FIG. FIG. 5 is a screen display diagram showing an example of the display mode of the thumbnail image according to the first embodiment.
The display mode of the thumbnail image illustrated in FIG. 5 shows a state in which thumbnail images related to a plurality of events are displayed on the display unit 32 of the driving support device 30.

In FIG. 5, 16 thumbnail images A1 to D4 arranged in a matrix structure of 4 rows in the vertical direction and 4 columns in the horizontal direction and displayed in a list on the same screen are event unit images 51 related to one event for each row. , 52, 53, 54. That is, in the event images 51, 52, 53, 54, four thumbnail images related to one event are arranged and displayed in one line, and four thumbnail images related to different events are arranged in different lines. It constitutes four sets of thumbnail images A1 to A4, B1 to B4, C1 to C4, and D1 to D4 that are arranged and displayed.

At the bottom of the thumbnail images A1 to D4, the shooting time of the image that is the source of each thumbnail image is displayed. In the illustrated example, the shooting time of the image that is the source of each thumbnail image when the event occurrence time tp in the event unit image 51 is "11:46:14.60" is displayed.

Further, the 16 thumbnail images shown in FIG. 5 are created from images taken at the same time point for each column (to be exact, at a time point before and after the event occurrence time tp for each event by the same time). The time point unit images 61, 62, 63, 64 are configured. That is, in the time point unit images 61, 62, 63, 64, four thumbnail images related to the same time point are arranged and displayed in one column, and four thumbnail images related to different time points are displayed in different columns. It constitutes four sets of thumbnail images A1 to D1, A2 to D2, A3 to D3, and A4 to D4 arranged and displayed in.

Further, in the 16 thumbnail images shown in FIG. 5, the first column from the left is a thumbnail image created from the image P1 (first image) taken at the time of event occurrence (time ts), and the second column is. It is a thumbnail image created from the image P2 (second image) taken immediately before the event occurrence judgment time (time tp1), and the third column is the image P3 taken immediately after the event occurrence judgment time (time tp2). It is a thumbnail image created from (third image), and the fourth column is a thumbnail image created from image P4 (fourth image) taken at the end of event detection (time te).

Further, in FIG. 5, the four thumbnail images arranged in one line are the same event image in the order of X1 → X2 → X3 → X4 (X is any of A, B, C, and D). Thumbnail images for each are arranged and displayed in the same line from left to right in chronological order. The display order may be arranged in chronological order from right to left instead of left to right in the same line.

Although four events are displayed in FIG. 5, the number of displayed events is not limited to this, and other display numbers can be selected, and other elements (G data, vehicle data, etc.) can be displayed. It is also possible to display it together with).

As described above, the driving support device 30 of the first embodiment has the following advantages. That is,
(1) When an event such as an impact is applied to the vehicle, the first image P1 taken TA seconds before the event occurrence time (time tp), the second image P2 taken immediately before the time tp, and the time. The third image P3 taken immediately after tp and the fourth image P4 taken after TB seconds of the time tp are selected, and the selected first to fourth images P1 to P4 to the first to fourth thumbnail images are selected. It is created and controlled to be displayed on the display unit 32. As a result, when an event occurs, the first to fourth thumbnail images corresponding to the first to fourth images P1 to P4 taken at different time points in the event unit images taken during a predetermined period before and after the event are displayed. By checking, the contents of the event unit image stored for each event occurrence can be easily confirmed, and the cause and situation of the event occurrence can be easily grasped.

For example, when finding an event unit image related to a specific event from a large number of event unit images stored for each event occurrence, the event unit image is selected from the thumbnail image at one time point related to the event unit image. Compared to the case of checking the contents and searching for a specific event unit image, the specific event unit image to be sought can be easily found from the thumbnail image.

(2) As in the display mode of the thumbnail image illustrated in FIG. 5, the thumbnail image is displayed with four thumbnail images related to one event arranged in one line and four thumbnails related to different events. Since the images are arranged and displayed on different lines, four thumbnail images related to one event can be clearly discriminated.
In addition, the four thumbnail images arranged in one line are arranged and displayed in the same line from left to right in chronological order for each event, so that four thumbnail images related to one event are displayed. It is possible to clearly determine the time-lapse order of the thumbnail images of.

Furthermore, if you look at the thumbnail image in the first row, you can see what is in front of the vehicle at the time of the event, and if you look at the thumbnail image in the second row, you can see what is in front of the vehicle just before the event occurrence judgment time. If you look at the thumbnail image of, you can see the state of the front of the vehicle immediately after the event occurrence judgment time, and if you look at the thumbnail image of the fourth row, you can see the state of the front of the vehicle at the end of event detection. By comparing and viewing the images, it is possible to compare and verify the state of the vehicle in front at the same time point when the event occurs.

[Example 2]
The second embodiment is a case of sudden braking as an event example such as an impact being applied to the vehicle.
FIG. 6 is a diagram showing a change in acceleration in the case of sudden braking, and shows a time-series change in G data (combined value of Gx and Gy) output from the G sensor 12.

As shown in FIG. 6, when the sudden brake is stepped on (turned on) at time t1, the G sensor 12 mainly detects the acceleration (Gx) in the front-rear direction of the vehicle, and the acceleration changes. The acceleration (G data) of the G sensor 12 gradually increases from time t1 (that is, the acceleration in the direction opposite to the direction in which the vehicle advances), and when it reaches the threshold acceleration Gs (for example, 0.3 G) (for example, 0.3 G). Time tp), the first control unit 11 recognizes it as a trigger, determines (determines) that an event has occurred, images the image taken by the CCD camera 20, and always periodically stores the image in the first memory 108. Is stored in the memory card 150, and the time tp is stored in the memory card 150 as event occurrence determination time data.

Specifically, also in the second embodiment, as in the first embodiment, the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp are controlled to be stored in the memory card 25. To do.

After the time tp, the acceleration continues to increase, reaches a maximum value (maximum value), then gradually decreases instead of decreasing (that is, the acceleration in the direction opposite to the direction in which the vehicle advances), and then decreases sharply. After the zero point, it further decreases (that is, the acceleration in the direction in which the vehicle advances), becomes a local minimum (minimum value), and instead of increases, it rapidly increases (that is, the acceleration in the direction in which the vehicle advances decreases). When the vehicle is stopped and the brake is released (OFF) (time t2), it becomes zero.

In FIG. 6, the period Td from the time t1 to the time tp is the “period from the beginning of the dangerous driving to immediately before the trigger occurrence”, and the period Te from the time tp to the time t2 is the period of the “dangerous driving behavior”.

<Creation and display of thumbnail images (Example 2)>
FIG. 7 is a flowchart showing the creation and display processing of the thumbnail image according to the second embodiment, and is a control program loaded from the HDD or the like into the RAM of the second control unit 31 of the operation support device 30 as in the first embodiment. It is realized by the CPU executing according to the above, and is started based on the operation of starting the operation support software of the second operation unit 34. Further, it is assumed that the memory card 25 in which the image is stored in the drive recorder 10 is inserted into the second IF 36 constituting the slot at the time when the processing of the flowchart shown in FIG. 7 is started.

In step S21, the second control unit 31 acquires the event occurrence determination time data (tp) from the data stored in the memory card 25. Subsequently, in step S22, the brake operation detection signal (brake operation data) output from the vehicle signal acquisition unit 21 is acquired from the data stored in the memory card 25.

Next, in step S23, the second control unit 31 is related to the brake operation from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. 3 (b). Select multiple images taken at different times.

Specifically, this control program includes the brake operation data acquired from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. 3 (b). The image captured at the time t1 (that is, the time when the acceleration event appears) when the brake operation is started based on the included brake operation start time data is selected as the "first image", and immediately before the time tp (predetermined time). The image taken before TC (for example, 0.2 seconds before) is selected as the "second image", and the image taken immediately after the time tp (after a predetermined time TC, for example, 0.2 seconds) is selected. An image captured at time t2 (that is, at the end of the appearance of the acceleration event) when the brake operation is completed based on the brake operation end time data included in the acquired brake operation data selected as the "third image" is set to "3rd image". A control process such as selecting as the "fourth image" is programmed. The second control unit 31 performs selection control of the first to fourth images from the image PA and the image PB according to such a control program.

The predetermined time TC can be set to, for example, 0.2 seconds, but an optimum value including 0 seconds can be selected depending on the application.
In addition to the above-mentioned time t1, immediately before and after time tp, and time t2, when the acceleration reaches the maximum value (maximum value), immediately before and after that, and the acceleration reaches the minimum value (minimum value). Images captured immediately before or after the time point may be selected.

Next, in step S24, the second control unit 31 is stored in the ROM in the second control unit 31, and according to the control program, the image processing unit 37 is subjected to the “first to fourth images” selected in step S23. The image processing for creating the first to fourth thumbnail images is performed.

In the following step S25, the second control unit 31 displays the first to fourth thumbnail images created in step S24 to the display processing unit 38 according to the control program stored in the ROM in the second control unit 31. A display process for displaying on the display unit 32 is performed. Specifically, as shown in FIG. 5, thumbnail images are arranged in a matrix structure and displayed in a list on the same screen.
This completes the thumbnail image creation and display processing for one event.

As described above, the driving support device 30 of the second embodiment has the following advantages. That is,
In the case of sudden braking as an event example such as an impact on the vehicle, the first image taken at the time t1 when the braking operation was started, the second image taken just before the time tp, and taken immediately after the time tp. The third image and the fourth image captured at the time t2 when the braking operation is completed are selected, the first to fourth thumbnail images are created from the selected first to fourth images, and the display unit 32 is displayed. Control the display. As a result, in the case of sudden braking, at different time points in the event unit image taken during a predetermined period before and after the event occurrence time point (time tp), in particular, the time t1 when the brake operation is started and the brake operation are completed. By confirming the first to fourth thumbnail images corresponding to the first to fourth images taken at the time including the time t2, the contents of the event unit image stored in the case of sudden braking as an event example can be obtained. It can be easily confirmed, and it is easy to understand the cause and situation of sudden braking.

For example, when finding an event unit image related to sudden braking from a large number of event unit images stored for each event occurrence, the content of the event unit image from the thumbnail image at one time point related to the event unit image. You can easily find the event unit image related to the desired sudden braking from the thumbnail image, as compared with the case of searching for the event unit image related to the sudden braking.

Further, if the thumbnail images in the first column from the left of the 16 thumbnail images shown in FIG. 5 are viewed vertically, the images at the time when the brake is suddenly applied (when the braking operation is started) can be compared and viewed. Can be done. Also, if you look at the thumbnail images in the second row vertically, you can compare the images immediately before the time when it was judged that an event occurred due to sudden braking, and you can see it in the third row. If you look at the thumbnail images vertically, you can compare and see the images immediately after that. Furthermore, if the thumbnail images in the fourth row are viewed vertically, the images at the time when the brake is released (when the brake operation is completed) can be compared and viewed.

[Example 3]
The third embodiment is a case where a sudden steering wheel is used as an event example such as an impact being applied to the vehicle.
FIG. 8 is a diagram showing a change in acceleration in the case of a steep steering wheel, and shows a time-series change in G data (combined value of Gx and Gy) output from the G sensor 12.

As shown in FIG. 8, when the steering wheel is suddenly started to be turned at time t3, the G sensor 12 mainly detects the left-right acceleration (Gy) of the vehicle, and the acceleration changes. The acceleration (G data) from the G sensor 12 gradually increased from time t3 (that is, the acceleration in the direction opposite to the turning direction of the vehicle increased), and it became the threshold acceleration Gs (for example, 0.3 G). At the time (time tp), the first control unit 11 recognizes it as a trigger, determines (determines) that an event has occurred, images the image with the CCD camera 20, and always periodically stores it in the first memory 108. The image is stored in the memory card 25, and the time tp is stored in the memory card 25 as event occurrence determination time data.

Specifically, also in the third embodiment, similarly to the first and second embodiments, the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp are stored in the memory card 25. To control.

After the time tp, the acceleration continues to increase, reaches the maximum value (maximum value), then gradually decreases instead of decreasing (that is, the acceleration in the direction opposite to the turning direction of the vehicle becomes smaller), and then suddenly decreases. After the zero point, it further decreases (that is, the acceleration of the vehicle in the bending direction increases), becomes a minimum value (minimum value), and changes to an increase and rapidly increases (that is, the acceleration of the vehicle in the bending direction decreases). , When the vehicle has finished turning and the steering wheel has been turned (that is, the steering wheel has been returned to its original position) (time t4), it becomes zero.

In FIG. 8, the period Tf from the time t3 to the time tp is the “period from the beginning of the dangerous driving to immediately before the trigger occurrence”, and the period Tg from the time tp to the time t4 is the period of the “dangerous driving behavior”.

<Creation and display of thumbnail images (Example 3)>
FIG. 9 is a flowchart showing the creation and display processing of the thumbnail image according to the third embodiment, and is loaded from the HDD or the like into the RAM of the second control unit 31 of the driving support device 30 as in the first and second embodiments. It is realized by the CPU executing according to the control program, and is started based on the operation of starting the operation support software of the second operation unit 34. Further, it is assumed that the memory card 25 in which the image is stored in the drive recorder 10 is inserted into the second IF 36 constituting the slot at the time when the processing of the flowchart shown in FIG. 9 is started.

In step S31, the second control unit 31 acquires the event occurrence determination time data (tp) from the data stored in the memory card 25. Subsequently, in step S32, the steering wheel rotation detection signal (steering wheel rotation data) output from the vehicle signal acquisition unit 21 is acquired from the data stored in the memory card 25.

Next, in step S33, the second control unit 31 is related to the handle rotation from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. 3 (b). Select multiple images taken at different times.

Specifically, in this control program, the handle rotation data acquired from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. 3 (b) is used. The image captured at the time t3 when the handle rotation is started based on the included handle rotation start time data is selected as the "first image", and immediately before the time tp (before the predetermined time TC, for example, 0.2 seconds before). ) Is selected as the "second image", and the image taken immediately after the time tp (after a predetermined time TC, for example, 0.2 seconds later) is selected as the "third image" and acquired. A control process is programmed such that the image captured at the time t4 when the handle rotation is finished is selected as the "fourth image" based on the handle rotation end time data included in the handle rotation data. The second control unit 31 performs selection control of the first to fourth images from the image PA and the image PB according to such a control program.

The predetermined time TC can be set to, for example, 0.2 seconds, but an optimum value including 0 seconds can be selected depending on the application.
In addition to the above-mentioned time t3, immediately before and after time tp, and time t4, when the acceleration reaches the maximum value (maximum value), immediately before and after that, and the acceleration reaches the minimum value (minimum value). Images captured immediately before or after the time point may be selected.

Next, in step S34, the second control unit 31 is stored in the ROM in the second control unit 31, and according to the control program, the image processing unit 37 is subjected to the “first to fourth images” selected in step S33. The image processing for creating the first to fourth thumbnail images is performed.

In the following step S35, the second control unit 31 displays the first to fourth thumbnail images created in step S34 to the display processing unit 38 according to the control program stored in the ROM in the second control unit 31. A display process for displaying on the display unit 32 is performed. Specifically, as shown in FIG. 5, thumbnail images are arranged in a matrix structure and displayed in a list on the same screen.
This completes the thumbnail image creation and display processing for one event.

As described above, the driving support device 30 of the third embodiment has the following advantages. That is,
In the case of a sudden steering as an event example such as an impact on the vehicle, the first image taken at the time t3 when the steering wheel rotation started, the second image taken just before the time tp, and taken immediately after the time tp. The third image and the fourth image captured at the time t4 when the handle rotation is completed are selected, the first to fourth thumbnail images are created from the selected first to fourth images, and the display unit 32 is displayed. Control the display. As a result, in the case of a sudden handle, at different time points in the event unit image taken for a predetermined period before and after the event occurrence time point (time tp), particularly at the time t3 when the handle rotation is started and the handle rotation ends. By confirming the first to fourth thumbnail images corresponding to the first to fourth images taken at the time including the time t4, the contents of the event unit image stored in the case of a sudden handle as an event example can be obtained. It can be easily confirmed, and it is easy to understand the cause and situation of sudden steering.

For example, when finding an event unit image related to a sudden handle from a large number of event unit images stored for each event occurrence, the content of the event unit image from the thumbnail image at one time point related to the event unit image. You can easily find the event unit image related to the desired steep handle from the thumbnail image, as compared with the case of searching for the event unit image related to the steep handle.

Further, if the thumbnail images in the first column from the left of the 16 thumbnail images shown in FIG. 5 are viewed vertically, the images at the time when the steering wheel operation is started (when the steering wheel rotation is started) can be compared and viewed. Can be done. Also, if you look at the thumbnail images in the second row vertically, you can compare and see the images immediately before the time when the event was determined to have occurred due to the handle operation, and the thumbnails in the third row. If you look at the images vertically, you can compare and see the images immediately after that. Furthermore, if the thumbnail images in the fourth row are viewed vertically, the images at the time when the steering wheel operation is stopped (when the steering wheel rotation is completed) can be compared and viewed.

Further, creating a thumbnail image at the time when the steering wheel rotation is started as in the third embodiment is advantageous when the steering wheel operation and the acceleration event are not linked as described below.
For example, there are cases where acceleration is generated regardless of the steering wheel operation, such as when a vehicle collides or travels on a slope, and there are cases where acceleration is generated by steering wheel operation such as a sudden steering wheel. The first thumbnail image of the third embodiment (first column from the left in FIG. 5 above) is the one at the time when the steering wheel rotation is started, but the steering wheel operation and the acceleration event are not linked. There is.
According to the third embodiment, the thumbnail image at the time when the handle rotation is started, and the thumbnail image having a predetermined relationship with the event occurrence can be displayed. Therefore, particularly at the time when the handle rotation is started. And when the start time of the acceleration event does not match, the time when the handle rotation is started and the event occur from the thumbnail image at the time when the handle rotation is started instead of the thumbnail image at the time when the acceleration event starts to appear. You can check the relationship with and use it to understand the cause of the event and the situation.

[Example 4]
The fourth embodiment is a case of a vehicle collision as an example of an event such as an impact being applied to the vehicle.
FIG. 10 is a diagram showing a change in acceleration in the case of a vehicle collision, and shows a time-series change in G data (combined value of Gx and Gy) output from the G sensor 12.

As shown in FIG. 10, when the vehicle collides with something at time t5, the G sensor 12 detects and changes the acceleration in the front-rear direction (Gx) and the acceleration in the left-right direction (Gy) of the vehicle, respectively. The acceleration (G data) from the G sensor 12 rapidly increases immediately after time t5, then rapidly decreases, and then rapidly increases and decreases, and becomes the threshold acceleration Gs (for example, 0.3 G). At that time (time tp), the first control unit 11 recognizes it as a trigger, determines (determines) that an event has occurred, images the image by the CCD camera 20, and always periodically stores it in the first memory 108. The image is stored in the memory card 25, and the time tp is stored in the memory card 25 as event occurrence determination time data.

Specifically, also in the fourth embodiment, as in the first, second, and third embodiments, the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp are stored in the memory card 25. Control to do.

After the time tp, the acceleration increases, decreases sharply after reaching the maximum value (maximum value), rapidly increases after reaching the minimum value (minimum value), passes through the zero point, and reaches the maximum again. After reaching the value (maximum value), it decreases sharply, passes through the zero point again, repeats rapid increase and decrease, and then stops and becomes zero when the acceleration converges (t6).

In FIG. 10, the period Th from the time t5 to the time tp is the “period of the impact before a large impact”, and in this period Th, the impact waveform due to the impact reduction due to the effect of the bumper or guardrail of the vehicle appears. Further, the period Ti from the time tp to the time t6 is the period of "impact behavior".

<Creation and display of thumbnail images (Example 4)>
FIG. 11 is a flowchart showing the creation and display processing of the thumbnail image according to the fourth embodiment, and is loaded from the HDD or the like into the RAM of the second control unit 31 of the operation support device 30 as in the first, second, and third embodiments. It is realized by the CPU executing according to the controlled control program, and is started based on the operation of starting the operation support software of the second operation unit 34. Further, it is assumed that the memory card 25 in which the image is stored in the drive recorder 10 is inserted into the second IF 36 constituting the slot at the time when the processing of the flowchart shown in FIG. 11 is started.

In step S41, the second control unit 31 acquires the event occurrence determination time data (tp) from the data stored in the memory card 25. Subsequently, in step S42, the vehicle speed (vehicle speed data) output from the vehicle signal acquisition unit 21 is acquired from the data stored in the memory card 25. Further, in step S43, the detected G data (Gx, Gy) of the G sensor 12 is acquired from the data stored in the memory card 25.

Next, in step S44, the second control unit 31 is related to the vehicle collision from the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. 3 (b). Select multiple images taken at different times.
Specifically, this control program includes the image PA for TA seconds before the time tp and the image PB for TB seconds after the time tp shown in FIG. 3 (b) at the time t5 when the vehicle collides. Immediately after, the image captured at tp3 (that is, when the acceleration behavior of the vehicle due to the reaction of the bumper, guard rail, etc. is generated) when the size (value) of the G data repeatedly suddenly increases and decreases and reaches the maximum value for the second time. The image selected as the "first image" and taken immediately before the time tp (before the predetermined time TC, for example, 0.2 seconds before) is selected as the "second image", and immediately after the time tp (predetermined time TC). After that, for example, 0.2 seconds later), the image taken is selected as the "third image", and the image taken at the time t6 when the vehicle speed becomes zero (that is, when the acceleration behavior converges) is ". A control process such as selecting as a "fourth image" is programmed. The second control unit 31 performs selection control of the first to fourth images from the image PA and the image PB according to such a control program.

The predetermined time TC can be set to, for example, 0.2 seconds, but an optimum value including 0 seconds can be selected depending on the application.
In addition to the above-mentioned time t5, immediately before and after time tp, and time t6, when the acceleration reaches the maximum value (maximum value), immediately before and after that, and the acceleration reaches the minimum value (minimum value). At that time, the images captured immediately before or after that may be selected.

Next, in step S45, the second control unit 31 is stored in the ROM in the second control unit 31, and according to the control program, the image processing unit 37 is subjected to the “first to fourth images” selected in step S44. The image processing for creating the first to fourth thumbnail images is performed.

In the following step S46, the second control unit 31 displays the first to fourth thumbnail images created in step S45 to the display processing unit 38 according to the control program stored in the ROM in the second control unit 31. A display process for displaying on the display unit 32 is performed. Specifically, as shown in FIG. 5, thumbnail images are arranged in a matrix structure and displayed in a list on the same screen.
This completes the thumbnail image creation and display processing for one event.

As described above, the driving support device 30 of the fourth embodiment has the following advantages. That is,
In the case of a vehicle collision as an event example such as an impact on the vehicle, the first image and time captured at the time when the G data immediately after the vehicle collision time t5 repeatedly rapidly increases and decreases (the time of the reaction acceleration behavior). Select and select the second image taken immediately before tp, the third image taken immediately after time tp, and the fourth image taken at time t6 (when the acceleration converges) when the vehicle speed becomes zero. The first to fourth thumbnail images are created from the first to fourth images, and are controlled to be displayed on the display unit 32. As a result, in the case of a vehicle collision, the G data suddenly increases or decreases at different time points in the event unit image taken during a predetermined period before and after the event occurrence time (time tp), especially immediately after the vehicle collision time t5. 1st to 4th thumbnails corresponding to the 1st to 4th images taken at the time when the above is repeated (the time of the reaction acceleration behavior) and the time when the vehicle speed becomes zero t6 (the time when the acceleration converges). By confirming the image, it is possible to easily confirm the content of the event unit image stored in the case of a vehicle collision as an event example, and it is easy to grasp the cause and situation of the vehicle collision.

For example, when finding an event unit image related to a vehicle collision from a large number of event unit images stored for each event occurrence, the content of the event unit image from the thumbnail image at one time point related to the event unit image. It is possible to easily find the event unit image related to the desired vehicle collision from the thumbnail image as compared with the case of searching for the event unit image related to the vehicle collision.

Further, if the thumbnail images in the first column from the left of the 16 thumbnail images shown in FIG. 5 are viewed vertically, the images at the time of the vehicle collision can be compared and viewed. Also, if you look at the thumbnail images in the second row vertically, you can compare the images immediately before the time when it was determined that an event occurred due to a vehicle collision, and you can see the thumbnail images in the third row vertically. If you look at it, you can compare and see the images immediately after that. Furthermore, if the thumbnail images in the fourth row are viewed vertically, the images at the time when the vehicle speed becomes zero can be compared and viewed.

<Experimental example>
FIG. 12 is a diagram showing an experimental example of the acceleration change in the case of a vehicle-to-vehicle collision in relation to the acceleration change in the case of the vehicle collision according to the fourth embodiment shown in FIG. 10, and is output from the G sensor 12. The value of the detected acceleration Gx in the X-axis direction (front-back direction of the vehicle), the value of the detected acceleration Gy in the Y-axis direction (left-right direction of the vehicle), and the value of the detected acceleration Gz in the Z-axis direction (vertical direction of the vehicle). It is shown as each time-series change.

In this experimental example, as shown in FIG. 12, when a vehicle collides with something at time t7, the Gx value, Gy value, and Gz value repeatedly rapidly increase and decrease in a relatively short cycle immediately after time t7. Later, when the value of Gx reaches the threshold acceleration Gs (for example, 1.0) (time tp), it is recognized as a trigger, and it is determined that an event has occurred.
After the time tp, the value of Gx may become slightly large, but eventually converges to near the zero value (time t8). Further, after the time tp, the values of Gy and Gz are relatively small and eventually converge.

In FIG. 12, the period Tj from the time t7 to the time tp is the “period of impact before a large impact” as in the period Th of FIG. 10, and this period Tj is due to the effect of the bumper, guardrail, etc. of the vehicle. An impact waveform appears due to impact reduction. Further, the period Ti from the time tp to the time t8 is a period of "impact behavior" as in the period Ti of FIG. 10, and in this period Tk, the vehicle moves due to the reaction after the impact.

<Display example>
FIG. 13 is a diagram showing a display example of a thumbnail screen according to the experimental example shown in FIG.
In this display example, the memory card 25, which is mounted in the drive recorder 10 and in which the driving information including the camera image and the image-related information is recorded, is taken out and displayed on the display unit 32 of the driving support device 30. ..
In FIG. 13, 16 thumbnail images arranged in a matrix structure of 4 rows vertically and 4 columns horizontally and displayed in a list on the same screen are event unit images 71, 72, 73 related to one event for each row. 74 is displayed, and the time unit image 71, which is created from the images taken at the same time point (more precisely, the time point which is relatively the same as the event occurrence time tp for each event) for each column. 72, 73, 74 are displayed.

Next, a method of displaying a list of thumbnail images in a form arranged in a matrix structure as described above will be described below.
The user first selects files 91, 92, 93, 94 of a plurality of events (here, four) to be displayed by the second operation unit 204 from the playlist 90 on the upper right of the display image shown in FIG. To do. Next, event unit images corresponding to the selected event files 91, 92, 93, 94 are read, and based on the read files, thumbnail image creation and display processing is performed according to the flow chart processing procedure in FIG. The thumbnail images are arranged in a matrix structure and displayed in a list on the same screen.

In the display example of FIG. 13, the event unit image 71 displayed for each line has four time points for the event in the file 91 (that is, [1] the event occurrence time point, which is TA seconds before the event occurrence time tp, [2]. ] Immediately before the time tp (immediately before the event occurs), [3] immediately after the time tp (immediately after the event occurs), and [4] thumbnail images created from the images taken at the end of the event detection which is the TB second of the time tp. Is displayed.
Similarly, the event unit image 72 displays the thumbnail images of the above four time points for the event of file 92, and the event unit image 73 displays the thumbnail images of the above four time points for the event of file 93. The unit image 74 displays thumbnail images at the above four time points for the event of the file 94.

In the display example of FIG. 13, the time-time unit image 81 displayed for each column is TA seconds before the [1] event occurrence time tp in each of the four thumbnail images of the event unit images 71, 72, 73, and 74. The thumbnail image created from the image taken at the time of the event occurrence is displayed.
Similarly, the time point unit image 82 is created from the images taken immediately before [2] event occurrence time tp (immediately before the event occurrence) in each of the four thumbnail images of the event unit images 71, 72, 73, 74. The time point unit image 83 is taken immediately after [3] event occurrence time tp (immediately after the event occurrence) in each of the four thumbnail images of the event unit images 71, 72, 73, and 74. The thumbnail image created from the above image is displayed, and the time point unit image 84 is TB seconds after the [4] event occurrence time tp in each of the four thumbnail images of the event unit images 71, 72, 73, 74. A thumbnail image created from the image taken at the end of event detection is displayed.

<Modification example>
The present invention is not limited to the contents described in the above-described embodiments of the present invention, and various modifications can be made. As a modification thereof, for example, it may be carried out as follows.

(1) In the above-described embodiment, when the value (magnitude) of the G data output from the G sensor 12 reaches the threshold acceleration Gs (time tp) is recognized as a trigger, and it is determined that an event has occurred. However, the trigger is not limited to this, and for example, when the value (magnitude) of the angular acceleration data output from the gyro sensor 13 or the pressure / altitude data output from the pressure sensor 14 reaches a predetermined value, it is recognized as a trigger. , It may be determined that an event has occurred. Further, it may be determined that the event has occurred from the result of analyzing the recorded video.
In addition, when the emergency switch of the first operation unit 17 is pressed, when there is a signal input from an external port, and communication from an external device such as an AVM-ECU (Automatic Vehicle Monitoring-Engine Control Unit) (for example, The time when a command is received by RS-232C) may be the time when an event occurs.

(2) In the above-described embodiment, the first to first images taken at four time points for each event such as sudden braking, sudden steering, and vehicle collision from the images of a predetermined period stored for each event. 4 images are selected to create the 1st to 4th thumbnail images, but the present invention is not limited to this, and a plurality of images taken at a plurality of different time points other than the four time points are selected and selected. You may create a thumbnail image corresponding to the image. Further, for a plurality of different time points, various combinations may be used depending on the type of event, but it is preferable to use a combination of time points at which the characteristics of the event appear (a specific period within a predetermined period).
As for the combination at the time when the feature of the event appears, various data such as "data for detecting the behavior of the vehicle" and "data for the functional state of the vehicle" stored in the memory card 25 together with the image data are used alone or in combination. , It is preferable that a plurality of images taken at an appropriate timing are selected based on the data, and a thumbnail image corresponding to the selected image is created.

The "data that detects the behavior of the vehicle" may be, for example, acceleration data, angular acceleration data, atmospheric pressure / altitude data, video analysis data, or the like. Further, the "data related to the functional state of the vehicle" includes, for example, data related to any operation of the brake, blinker, accelerator, handle rotation, shift lever position, and side brake during vehicle driving, and a vehicle failure diagnosis system. Data obtained from OBD (On Board Diagnosis) and CAN (Controller Area Network), which is an in-vehicle LAN, may be used.

(3) In the above-described embodiment, as G data, component acceleration (G data) Gx in the X-axis direction (front-rear direction of the vehicle) and component acceleration (G data) Gy in the Y-axis direction (left-right direction of the vehicle) The occurrence of the event is determined using the composite value, but the event is not limited to this, and the occurrence of the event may be determined using each component acceleration (Gx, Gy) individually. For example, when Gx exceeds a predetermined threshold value and then Gy exceeds a predetermined threshold value within a predetermined time, or when the change pattern of the value (magnitude) of each component adopts a predetermined pattern, it is recognized as a trigger. However, it may be determined that an event has occurred. Further, in addition to Gx and Gy, the occurrence of the event may be determined by taking into consideration the component acceleration Gz in the Z-axis direction (vertical direction of the vehicle) and the like.

(4) Not limited to the above-described embodiment, information different from the information used to determine that an event has occurred (for example, G data (Gy) in the left-right direction of the vehicle due to a sudden steering) (for example, a vehicle due to sudden braking). An image captured when the G data (Gx) in the front-rear direction of the above reaches a predetermined value (for example, a maximum value) may be selected to create a thumbnail image. As a result, when the information different from the information used to determine that the event has occurred (for example, G data (Gy) due to sudden steering) and the information different from the information (for example, G data (Gx) due to sudden braking) reaches a predetermined value. You can easily find event-based video related to an event.

(5) Not limited to the above-described embodiment, the G data has a maximum value, for example, going back from the time (time tp) when it is determined that the event has occurred when the value (magnitude) of the G data becomes the threshold acceleration Gs. Sub-events that caused events such as when the value reaches a minimum, when the G data becomes an inflection point of time-series changes, and when the G data undergoes characteristic changes such as rapid increases and decreases in a short period of time. An image captured at the time of estimating the time of occurrence of the above may be selected to create a thumbnail image. This makes it easy to find event-based video related to the event at the time of estimating the time of occurrence of the sub-event that caused the occurrence of the event, for example, the time of characteristic change such as a sudden increase or decrease of G data. be able to.

(6) In the above-described embodiment, the drive recorder 10 is a trigger recording type that records images before and after the "trigger indicating that the recording condition is satisfied", but is not limited to this, for example, from engine on to off. It may be a constant recording type that constantly records and stores information for making it possible to identify the position of the triggered image. In this constant recording type drive recorder, for example, it is preferable to specify which position of which video is the triggered position from the recording start time information of the video and the time information when the trigger is applied.
In the case of the above-mentioned trigger recording type drive recorder, for example, an image recorded for a predetermined period before and after the occurrence of the trigger indicating that the recording condition by the drive recorder is satisfied may be referred to as an "event unit image". .. Further, in the case of the above-mentioned constant recording type drive recorder, for example, in a video in which the engine is turned on and off in one recording unit, the portion recorded for a predetermined period before and after the trigger occurrence time is ". It is good to use "event unit video".

(7) In the above-described embodiment, the image PA for TA seconds and the image PB for TB seconds before and after the time tp determined to generate the event are stored in the memory card 25, but the present invention is not limited to this, and the engine is turned on, for example. An image of the entire time from to off, or an image of a limited time within the entire time may be stored in the memory card 25. The limited time in the total time may be the time including the time tp when it is determined that the event has occurred.
Further, the total time of TA seconds and TB seconds before and after the above-mentioned time tp may be a fixed time or a variable time for each event occurrence. The total time of TA seconds and TB seconds may be sufficient to identify the cause of the occurrence of the event. In particular, the total time of TA seconds and TB seconds may be different depending on the type of event.

(8) In the above-described embodiment, the TA second time and the TB second time before and after the time tp determined to generate the event are the same time (in the embodiment, 12 seconds before and 12 seconds after). , Not limited to this, for example, different times may be used. In particular, it is preferable to lengthen the time of TA seconds before the time tp and shorten the time of TB seconds after the time tp (for example, 15 seconds before and 5 seconds after).

(9) In the above-described embodiment, from the image PA for TA seconds and the image PB for TB seconds before and after the time tp determined that the event has occurred, TA seconds before, immediately before (TC seconds before), and immediately after (after TC). , The first to fourth images taken after TB seconds are selected, and the first to fourth thumbnail images are created from the selected first to fourth images, but the present invention is not limited to this, for example. Select a combination of 2 or 3 images in the 1st to 4th images, or select any number of 1 to 4 images in the 1st to 4th images and one or more images at other time points. You may select a combination of images and create a thumbnail image from the selected images.

(10) In the above-described embodiment, the images taken before and after the time tp when it is determined that the event has occurred are selected, but the present invention is not limited to this, and the images taken at the time tp are selected. The image and the image at the time before and after the time tp may be combined.

(11) In the above-described embodiment, 16 thumbnail images form an event unit image for one event for each row and for each column, as in the example of the display mode of the thumbnail image shown in FIG. The time point unit image at the same time point is configured, but the present invention is not limited to this, and the row and column may be exchanged to form an event unit image for each column and a time point unit image for each row. Also, when an event unit image for one event is configured for each row (or column), the event unit images in one row (or column) can be arranged in chronological order. Instead of setting the same time point for each event, the image may be used as a time point according to the type of event. Furthermore, it is not limited to 4 rows x 4 columns in the vertical direction, but is arranged in a matrix structure of other combinations of the number of rows and columns such as 5 rows x 5 columns and 3 rows x 3 columns and displayed in a list on the same screen. You may. Furthermore, when it cannot be displayed on the screen, it is preferable to scroll the matrix as a whole instead of scrolling left and right for each event.

(12) In the above-described embodiment, the display control system of the present invention has been described with the example of the driving support system (driving support device 30), but it can be implemented as a function of various electronic devices. For example, it may be incorporated as a function of a navigation device, a drive recorder, a radar detector, and a car audio system.

(13) Not limited to the above-described embodiment, a control program stored in advance in the ROM of the second control unit 31 of the driving support device 30 can be applied to a mobile terminal such as a general-purpose personal computer, a mobile phone, a smartphone, or a portable game machine. It was downloaded, and the computer mounted on the mobile terminal was made to execute the control process of the second control unit 31, read the image and various data stored in the memory card 25, and was created from the read image and various data. A thumbnail image may be displayed.

(14) Each function of the above embodiment is realized by describing the function in a computer-readable programming language and causing the computer of the second control unit 31 to execute the program, but the present invention is limited to this. Instead, for example, the program may be distributed and distributed on a plurality of computers for distributed processing.

10 Drive recorder 11 1st control unit 12 Accelerometer (G sensor)
13 Gyro sensor 14 Barometric pressure sensor 15 GPS antenna 16 GPS receiver 17 1st operation unit 18 1st memory 19 1st IF (interface)
20 CCD camera 21 Vehicle signal acquisition unit 22 Power supply unit 25 Memory card 30 Driving support device 31 Second control unit 32 Display unit 33 Output unit 34 Second operation unit 35 Second memory 36 Second IF (interface)
37 Image processing unit 38 Display processing unit 51-54, 71-74 Event unit image 61-64, 81-84 Time unit image 90 Playlist 91-94 file

Claims (6)

It is a display control system that controls the display of thumbnail images related to the video recorded by the drive recorder mounted on the vehicle.
It has a function of displaying a list of a plurality of thumbnail images corresponding to different time points in the video and selected based on the data related to the sudden steering wheel of the driver of the vehicle recorded by the drive recorder. Display control system. The display control system according to claim 1, wherein the plurality of thumbnail images include an image at a time when the sudden steering wheel is started. The display control system according to claim 1 or 2, wherein the plurality of thumbnail images include an image at a time when the sudden steering wheel ends. The plurality of thumbnail images are combined with the image when the sudden steering wheel is finished.
The display control system according to any one of claims 1 to 3, wherein an image is displayed when the acceleration reaches a maximum value. As the plurality of thumbnail images, together with the image when the sudden steering wheel ends,
The display control system according to any one of claims 1 to 4, wherein an image is displayed when the acceleration reaches a minimum value. A program for realizing the function of the display control system according to any one of claims 1 to 5 on a computer.

Images