JP5008100B2 - Driving support device, driving support system, driving support software, and driving support method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a driving support device which further contrives a mode of presenting driving information. <P>SOLUTION: The driving support device reads trigger generation information including a photographed image and date/time information of trigger generation, which are recorded by a drive recorder; selects the image and the date/time information of the trigger generation among the read photographed images and trigger generation information; and displays the selected image in association with the selected date/time information as a thumbnail. <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

  The present invention relates to a driving support device for collecting and analyzing data of a drive recorder to perform driving support for a driver.

  Drive recorders mounted on commercial vehicles such as trucks and taxis collect and collect driving information such as camera images, vehicle speed, and GPS (Global Positioning System) position information recorded when sudden acceleration or braking occurs. Driving assistance devices that are analyzed and used for driver training are becoming increasingly popular with passenger transport operators. Driving education means that, for example, the operation manager collects the driving information recorded in the drive recorder of each vehicle, checks the contents of the driving information, analyzes how to drive each crew member, etc. It teaches how to drive.

  The driving information that the operation manager must check is not limited to the camera image, GPS information, and vehicle speed. Corresponding to the camera image, it includes various data such as date and time, acceleration / deceleration, vehicle dynamics information, voice and the like. In addition, since a plurality of driving information is recorded for each of a plurality of vehicles, the number of driving information is enormous. Therefore, in order to be able to efficiently check these plural pieces of driving information, it is desirable that the driving support device used by the operation manager should display various data in an easy-to-understand manner in an organized state. .

  As a prior art of such a device, Japanese Patent Application No. 2005-329525 displays a list of various data included in driving information collected from each vehicle as characters, and one of the lists is selected with a mouse or the like. A technique for displaying a camera image of selected driving information is proposed.

JP 2007-140616 A

  However, in the character list, it is not easy to recognize intuitively, and displaying the camera image of the selected one is selected from the list to check all the camera images of each driving information. The operation of confirming the displayed camera images one by one must be repeated.

In view of the above problems, an object of the present invention is to provide a driving support device that further devise a mode of presenting driving information.
In order to achieve this object, the driving support apparatus according to the present invention includes a reading unit that reads trigger generation information including a photographed image recorded by a drive recorder, date and time information of trigger generation , trigger type information, and acceleration information , and the reading unit. image and the date and time information at the time of trigger generation from the read captured image and the trigger information, the trigger type information, select the acceleration information, each said selected image and the date and time information, trigger type information, and acceleration information Display control means for displaying thumbnails in association with each other.

  According to this configuration, it is possible to instantly confirm the contents of a plurality of driving information without performing the operation of selecting and displaying each of the information one by one, and each camera image is marked with a mark indicating the conditions under which they were captured. Therefore, the conditions can be recognized intuitively.

It is a figure which shows schematic structure of the driving assistance system which concerns on embodiment of this invention, (a) shows schematic structure of the center side driving assistance apparatus, (b) shows schematic structure of the vehicle-mounted apparatus by the side of a mobile station. . The data structure of the content recorded on the memory card 230 is shown conceptually. (A) and (b) respectively show the data structure of main item data and image related data. One structural example of a display screen is shown. The meaning of each mark and each button is shown. (A) is a flowchart showing an operation when the PC 110 performs thumbnail display, in particular, when a trigger type mark and a camera mark are attached to each camera image, and (b) shows a camera type during playback of the camera image. It is a flowchart which shows operation | movement when a button is pushed.

  FIG. 1 is a diagram showing a schematic configuration of a driving support system according to an embodiment of the present invention. FIG. 1 (a) shows a schematic configuration of a driving support device on the center side, and FIG. 1 (b) shows a mobile station side. The schematic structure of the vehicle-mounted apparatus which consists of a drive recorder and a peripheral device is shown.

  In FIG. 1A, a driving support device includes a personal computer (PC) 110 in which driving support software is installed, a database 120 storing map data, driving information from a memory card, a memory card reader 130, and a display image. The printer 140 is configured to print on paper.

  Although not shown, the PC 110 includes a general PC body configuration such as a CPU and a memory, and input / output devices such as a mouse, a keyboard, and a display. The CPU interprets and executes a program included in the driving support software to operate each component of the driving support device, and realizes various functions according to the features of the present invention. A specific example of this function will be described later with reference to FIG. 4 and subsequent drawings. The following is a brief description.

  That is, driving information is read from a memory card collected from each vehicle, and a representative camera image is reduced and displayed as a list for each driving information. Hereinafter, this list display is referred to as thumbnail display, and each representative camera image is referred to as a thumbnail image. In the lower corner of the thumbnail image, a mark image representing the contents of driving information and the like is displayed. By displaying in this way, it becomes easy to recognize intuitively when checking driving information, and the camera image of each driving information can be confirmed instantaneously.

  In order to facilitate understanding of FIG. 4, the configuration of the in-vehicle device and the data structure of the driving information will be described first with reference to FIGS. 1B, 2, and 3.

  In FIG.1 (b), the vehicle-mounted apparatus is the drive recorder 210, the 1st camera 220 installed in the vehicle so that the front of a vehicle may be continuously image | photographed at a predetermined | prescribed rate, the memory card 230, various information and signals of a vehicle. A vehicle signal acquisition unit 240 that acquires and inputs to the drive recorder, a GPS receiver 250 that measures position information of the vehicle, a second camera 220 installed in the vehicle so as to photograph the rear or inside of the vehicle at a predetermined rate, a vehicle A microphone 270 that collects internal or external sound, an external switch 280 for instructing the memory card 220 to record driving information by a user operation, and an AVM system (Automatic Vehicle Monitoring System) 290 are configured. Here, the configuration of the in-vehicle device shown in FIG. 1B shows a full specification configuration in this embodiment, and some vehicles include an in-vehicle device that is not a full specification configuration. That is, some vehicles include an in-vehicle device that includes the entire configuration of FIG. 1B, and some vehicles include an in-vehicle device that does not partially include the configuration of FIG. Specifically, the in-vehicle device that does not partially include a device that does not include any of the GPS receiver 250, the second camera 220, the microphone 270, the external switch 280, and the AVM system 290.

  The drive recorder 210 is urgent when a predetermined condition is satisfied, specifically, when a detected G value of an internal G sensor exceeds a predetermined threshold, or when a signal is input from an external port. When a switch is pressed, and when a command is received by communication from an external device such as an AVM-ECU (for example, RS-232C), the detection is used as a trigger to acquire various data for several seconds before and after. Recorded in the memory card 230 as operation information.

The driving information recorded in the memory card 230 includes the vehicle number assigned to the vehicle, the crew number identifying the crew of the vehicle, the G value detected by the G sensor, and the camera taken by the first camera 220 (and 260 or 265). The image includes the vehicle speed acquired by the vehicle signal acquisition unit 240 from an external vehicle speed sensor, the GPS position information measured by the GPS receiver 250, the sound collected by the microphone 270, the dynamic information managed by the AVM system 290, and the like. The drive recorder 210 records various data of driving information in association with each of a plurality of camera images for several seconds before and after the trigger detection.
<Data structure of memory card>
FIG. 2 is a diagram conceptually showing the data structure of the contents recorded on the memory card 230.

  As shown in the drawing, in the memory card 230, corresponding driving information is divided and recorded as driving information 1, driving information 2, and driving information 3 for each trigger occurrence. The driving information 1 is composed of 300 camera images 1 to 300 corresponding to several tens of seconds before and after the trigger is generated, and image related information including other driving information other than the camera image. The image related information includes main item data including a vehicle number and a G value when a trigger is generated, and related data 1 to 300 corresponding to 300 camera images 1 to 300, respectively. The same applies to the driving information 2 and 3.

  FIGS. 3A and 3B show the data structures of main item data and image-related data, respectively.

  In FIG. 3 (a), main item data includes a vehicle number, a crew number, a trigger type, a G value X indicating a G value in the vehicle traveling direction when the trigger is generated, and a direction orthogonal to the vehicle traveling direction when the trigger is generated in a horizontal plane. A G value Y indicating the G value is included.

  In FIG. 3B, the image-related data includes a data number indicating which camera image corresponds to, detection information indicating whether the image-related data corresponds to the timing at which the trigger is generated, and trigger generation. The time date, the shooting time of the corresponding camera image, the G value X in the vehicle traveling direction when the corresponding camera image was shot, the G value Y in the orthogonal direction, the vehicle speed, and the GPS information in which the image related data is located Positioning presence / absence information indicating whether or not it is included, the X coordinate, Y coordinate, dynamic information, and external switch (SW) of the measured GPS information are included.

Now, how such recorded contents are displayed on the driving support device will be described. <Configuration of display screen>
FIG. 4 shows a configuration example of the display screen.

  The PC 110 reads a record of the memory card 230 collected from each vehicle by the memory card reader 130 and stores it in the database 120, and then creates and displays a screen as shown in FIG.

  The screen shown in the figure mainly includes a screen information search condition input area 410, a thumbnail display area 470 on the lower left side thereof, and a camera image reproduction display area 480 on the right side thereof.

  The search condition input area 410 is an area for accepting user input of various conditions such as recording date and time and time zone in order to narrow down the operation information to be checked among the operation information recorded in the database 120.

  The thumbnail display area 470 is an area for displaying a camera image of each driving information searched by the input of the search condition input area 410 as a thumbnail.

  Each camera image during thumbnail display is a camera image taken at the trigger detection timing among a plurality of camera images included in the driving information. The PC 110 determines which camera image is taken at the trigger detection timing by looking at detection information in the image-related data. If the detection information is 1, the camera image corresponding to the image-related data is at the trigger detection timing, and if the detection information is 0, it is not at the trigger detection timing.

  At the lower left corner of each camera image, a trigger type mark indicating what trigger is used to capture the camera image is attached. The meaning of each trigger type mark is as shown in FIG. For example, the trigger type mark 430 shown in the lower left corner of the camera image 420 indicates that the photograph was taken by pressing the emergency switch.

  In the lower right corner of the camera image 420, the driving information including the camera image includes images taken by two or more of the first camera 220, the second camera 260, and the third camera 265. A camera mark 440 is attached. During thumbnail display, a camera image without the camera mark 440 indicates that there is no camera image taken by the second camera 260 or the third camera 265 in the driving information. The PC 110 determines whether the driving information includes images taken from two cameras or images taken from one camera by looking at the data numbers of the image-related data. More specifically, the data number includes a code indicating whether the corresponding camera image belongs to the first camera 220, the second camera 260, or the third camera 265, and the PC 110 Determines whether to include only the first camera 220 or both the first camera 220 and the second camera 260 or the third camera 265 by looking at the data number of each image-related data included in the driving information.

  In addition, on the upper side of each camera image, the vehicle number and G value of the vehicle on which the camera image is recorded are shown, and on the lower side, the date and time are shown.

When the camera image 420 is selected with a mouse or the like, a plurality of camera images included in the operation information of the camera image 420 are reproduced in order from the beginning in the camera image reproduction display area 480. At this time, a camera type button 460 is displayed in the lower right corner of the camera image being reproduced. A 1 in the button indicates that the camera image is an image taken by the first camera 220. The PC 110 first plays back each camera image taken by the first camera 220 in order, and when the camera type button 460 is clicked with the mouse during the playback or playback stop, the playback image is displayed on the second camera 260 ( Or it switches to the camera image image | photographed with the 3rd camera 265), and reproduces | regenerates in order. At this time, a camera type button indicating that the image is taken by the second camera 260 (or the third camera 265) is also displayed in the lower right corner, and the button is 2 (or 3). >
FIG. 6A is a flowchart showing an operation when the PC 110 performs thumbnail display, particularly when a trigger type mark and a camera mark are attached to each camera image.

  In FIG. 5A, the PC 110 reads each searched driving information (step S610), identifies the trigger type of each driving information, determines the corresponding trigger type mark, and stores the corresponding trigger type mark from the database. An image is read (step S620). Next, the PC 110 determines whether the camera image includes only the first camera or includes both the first and second cameras from the data type, and if both are included, reads the camera mark from the database (step S630). Finally, the PC 110 displays thumbnails together with camera marks for items including driving information, trigger types, and two types of camera images read out in the process from step S610 to step S630 (step S640).

  FIG. 6B is a flowchart showing the operation when the camera type button is pressed during the reproduction of the camera image.

  If the lower right camera type button is pressed while the camera image is being played back or stopped (step S650), the PC 110 changes to the second camera if the displayed camera image is that of the first camera. In the case of the second camera, the camera image is displayed by switching to the first camera (steps S660 and S670). Then, a camera type button corresponding to the camera image after switching is displayed (step S680).

  Note that each function of each of the above embodiments may be realized by describing the function in a computer-readable program language and causing the computer to execute the program.

110 PC
120 Database 130 Memory Card Reader 140 Printer 210 Drive Recorder 220 First Camera 230 Memory Card 240 Vehicle Signal Acquisition Unit 250 GPS Antenna 260 Second Camera 265 Third Camera 270 Microphone 280 External Switch 290 AVM System

Claims (5)

Reading means for reading out the trigger generation information including the captured image and trigger generation date / time information , trigger type information, and acceleration information recorded by the drive recorder;
The image and date / time information , trigger type information, and acceleration information at the time of trigger generation are selected from the captured image and trigger generation information read by the reading means, and the selected image and date / time information , trigger type information, and acceleration are selected. A driving support device comprising display control means for displaying information in a thumbnail in association with each other .
A drive recorder that records trigger generation information including a captured image captured by a camera mounted on a vehicle and date and time information of trigger generation , trigger type information, and acceleration information on a recording medium;
Reading means for reading a photographed image and trigger generation information from the recording medium , and selecting an image and date / time information , trigger type information, and acceleration information at the time of trigger generation from the photographed image and trigger generation information read by the reading means And a driving support device having a display control means for displaying the selected image and thumbnail information in association with the date and time information , trigger type information, and acceleration information .
The drive recorder records identification information for identifying the vehicle or crew on the recording medium,
The reading means reads identification information from the recording medium,
The driving support system according to claim 2, wherein the display control means displays the identification information corresponding to the selected image as a thumbnail in association with the image.
By computer
A readout function for reading out the trigger generation information including the captured image recorded by the drive recorder and the date and time information of trigger generation , trigger type information, and acceleration information ;
The image and date / time information , trigger type information, and acceleration information at the time of trigger generation are selected from the captured image and trigger generation information read by the reading function, and the selected image and date / time information , trigger type information, and acceleration are selected. A driving support program that realizes a display function of displaying thumbnails in association with information .
Record trigger generation information including a captured image captured by a camera mounted on a vehicle and date and time information of trigger generation , trigger type information, acceleration information on a recording medium,
Read the captured image and trigger occurrence information from the recording medium,
The image and date / time information , trigger type information, and acceleration information at the time of trigger occurrence are selected from the read captured image and trigger generation information, and the selected image and date / time information , trigger type information, and acceleration information are selected. A driving support method, wherein thumbnails are displayed in association with each other .

Images