JP2008033821A - Driving support device, driving support program, and driving support method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a driving support device in which the mode of displaying driving information is improved further. <P>SOLUTION: Driving information including a camera image taken with a camera installed on a vehicle and, in some cases, GPS information showing the position of the vehicle when the image is taken is acquired from a memory card 230. Whether or not the acquired driving information includes the GPS information is determined (Step S920). When it is found as the result of the determination that the GPS information is included, a map image in which the position shown by the GPS information is described is created and displayed in a first display region of a display device. The camera image is displayed in a second region that overlaps with a part of the first display region and at least does not include the position of the GPS information described on the map image (Steps S940 and 950). When the GPS information is not included, the camera image is displayed in the first display region (Step S960). <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a driving support device for collecting and analyzing data of a drive recorder to perform driving support for a driver.

  A driving support device that collects and analyzes driving information such as camera images, vehicle speed, and GPS (Global Positioning System) position information from drive recorders mounted on commercial vehicles such as trucks and taxis, and uses them for driver training Is spreading to passenger carriers. Driving education means that, for example, the operation manager collects the driving information recorded in the drive recorder of each vehicle, checks the contents of the driving information, analyzes how to drive each crew member, etc. It teaches how to drive.

As a conventional example of such a device, in Patent Document 1, the display area is composed of a first area and a second area, a camera image is displayed on the first screen, and a camera image is captured on the second screen. A driving support device that displays a map image showing a vehicle position is proposed. With this device, the recorded camera image and the corresponding vehicle position can be confirmed simultaneously.
JP 2006-120137 A

  However, the driving support device of Patent Document 1 has the following problems. That is, some drive recorders have specifications that do not record GPS information. When GPS information is not recorded, the driving support device disclosed in Patent Document 1 cannot display a map image indicating the vehicle position from the GPS information in the second area, and the second area is completely useless.

  In view of the above problems, an object of the present invention is to provide a driving support device that further devise a mode of presenting driving information.

  The driving support device that achieves the above object includes an acquisition unit that acquires driving information that includes a camera image captured by a camera installed in the vehicle and may include position information indicating a position of the vehicle at the time of shooting, A determination means for determining whether or not the driving information acquired by the acquisition means includes position information, and if the determination result includes position information, the position information is indicated in a predetermined display area of the display device. When the map image and the camera image are displayed and the position information is not included, the display area includes an image display means for displaying the camera image larger than the display when the position information is included.

  With this configuration, even when position information is not included in the driving information and a map image cannot be displayed, the camera image can be displayed in the first area, so that conventional display is not wasted and a map image can be displayed. In this case, the map image and the camera image can be displayed in an appropriate size without being reduced by overlapping the map image and the camera image in an appropriate arrangement.

<Outline configuration>
FIG. 1 is a diagram showing a schematic configuration of a driving support system according to an embodiment of the present invention. FIG. 1 (a) shows a schematic configuration of a driving support device on the center side, and FIG. 1 (b) shows a mobile station side. The schematic structure of the vehicle-mounted apparatus which consists of a drive recorder and a peripheral device is shown.

  In FIG. 1A, a driving support device includes a personal computer (PC) 110 in which driving support software is installed, a database 120 storing map data, driving information from a memory card, a memory card reader 130, and a display image. The printer 140 is configured to print on paper.

  Although not shown, the PC 110 includes a general PC body configuration such as a CPU and a memory, and input / output devices such as a mouse, a keyboard, and a display. The CPU interprets and executes a program included in the driving support software to operate each component of the driving support device, and realizes various functions according to the features of the present invention. A specific example of this function will be described later with reference to FIG. 4 and subsequent drawings. The following is a brief description.

  That is, the driving information is read from the memory card collected from each vehicle, the main items of the driving information are displayed in a list, and the driving information selected with the mouse from this list is displayed in the display area next to the list. Display an image. When displaying the camera image, the presence or absence of GPS information of the driving information is identified, and the display mode of the camera image is changed depending on the presence or absence. More specifically, when there is GPS information, a map image indicating the position is created, and a camera image is displayed on the display area in a corner on the map image. When there is no GPS information, only the camera image is displayed. Display in whole. The present invention is characterized by a display method in which a list of driving information, a camera image, and a map image are displayed in a devised layout on a screen having a limited size.

  In order to facilitate understanding of FIG. 4, the configuration of the in-vehicle device and the data structure of the driving information will be described first with reference to FIGS. 1B, 2, and 3.

  In FIG. 1B, the in-vehicle device acquires various information and signals of the drive recorder 210, the camera 220 installed in the vehicle, the memory card 230, and the vehicle so as to continuously photograph the front of the vehicle at a predetermined rate. A vehicle signal acquisition unit 240 for inputting to the drive recorder, a GPS receiver 250 for positioning the vehicle position information, a camera 260 installed in the vehicle so as to photograph the rear or the inside of the vehicle at a predetermined rate, an inside or outside of the vehicle A microphone 270 that collects sound, an external switch 280 for instructing the memory card 220 to record driving information by a user operation, and an AVM system (Automatic Vehicle Monitoring System) 290 are configured. Here, the configuration of the in-vehicle device shown in FIG. 1B shows a full specification configuration in this embodiment, and some vehicles include an in-vehicle device that is not a full specification configuration. That is, some vehicles include an in-vehicle device that includes the entire configuration of FIG. 1B, and some vehicles include an in-vehicle device that does not partially include the configuration of FIG. Specifically, the in-vehicle device that does not partially include a device that does not include any of the GPS receiver 250, the camera 260, the microphone 270, the external switch 280, and the AVM system 290.

  The drive recorder 210 has a G sensor inside, and triggers the detection when it detects sudden acceleration, sudden deceleration, sudden handle, etc. based on the detected value of the G sensor, and when the operation of the external switch 280 is detected. Then, various data for several seconds before and after are acquired and recorded in the memory card 230 as one operation information.

The driving information recorded in the memory card 230 includes the vehicle number assigned to the vehicle, the crew number identifying the crew of the vehicle, the G value detected by the G sensor, the camera image taken by the camera 220 and / or 260, and the vehicle signal. The vehicle speed acquired by the acquisition unit 240 from an external vehicle speed sensor, the GPS position information measured by the GPS receiver 250, the sound collected by the microphone 270, the dynamic information managed by the AVM system 290, and the like are included. The drive recorder 210 records various data of driving information in association with each of a plurality of camera images for several seconds before and after the trigger detection.
<Data structure of memory card>
FIG. 2 is a diagram conceptually showing the data structure of the contents recorded on the memory card 230.

  As shown in the drawing, in the memory card 230, corresponding driving information is divided and recorded as driving information 1, driving information 2, and driving information 3 for each trigger occurrence. The driving information 1 is composed of 300 camera images 1 to 300 corresponding to several tens of seconds before and after the trigger is generated, and image related information including other driving information other than the camera image. The image related information includes main item data including a vehicle number and a G value when a trigger is generated, and related data 1 to 300 corresponding to 300 camera images 1 to 300, respectively. The same applies to the driving information 2 and 3.

  FIGS. 3A and 3B show the data structures of main item data and image-related data, respectively.

  In FIG. 3 (a), main item data includes a vehicle number, a crew number, a trigger type, a G value X indicating a G value in the vehicle traveling direction when the trigger is generated, and a direction orthogonal to the vehicle traveling direction when the trigger is generated in a horizontal plane. A G value Y indicating the G value is included.

  In FIG. 3B, the image-related data includes a data number indicating which camera image corresponds to, detection information indicating whether the image-related data corresponds to the timing at which the trigger is generated, and trigger generation. The time date, the shooting time of the corresponding camera image, the G value X in the vehicle traveling direction when the corresponding camera image was shot, the G value Y in the orthogonal direction, the vehicle speed, and the GPS information in which the image related data is located Positioning presence / absence information indicating whether or not it is included, the X coordinate, Y coordinate, dynamic information, and external switch (SW) of the measured GPS information are included.

Now, explain how such recorded contents are displayed on the driving support device <Configuration of display screen>
FIG. 4 shows a configuration example of the display screen.

  The PC 110 reads a record of the memory card 230 collected from each vehicle by the memory card reader 130 and stores it in the database 120, and then displays a screen as shown in FIG.

  The screen shown in FIG. 4 mainly includes a search condition input area 410, an operation information list display area 420, and an image display area 440.

  The search condition input area 410 is an area for accepting user input of various conditions such as recording date and time and time zone in order to narrow down the operation information to be checked among the operation information recorded in the database 120.

  The driving information list display area 420 is an area for displaying the driving information searched by the input in the search condition input area 410 as a list. Each row in the list corresponds to the searched driving information, and consists of three items: date and time, G value, and trigger type extracted from the driving information. Here, the date and time is data obtained by combining the date and time extracted from the image-related data at the trigger detection timing. The G value is a composite value of the G value X and the G value Y extracted from the image related data at the trigger detection timing. The G sensor outputs two G values in the X direction and the Y direction, but trigger detection is determined by comparing a value obtained by combining the two G values with a threshold value. The trigger type indicates the type of trigger for which the operation information is recorded. Types include G sensors, external switches, and the like.

  When one of the lists is selected by a mouse operation or the like, a camera image 460 and a map image 450 corresponding to the driving information are displayed in the image display area 440. In the figure, a row 430 in the list is selected, and the PC 110 reversely displays the row to indicate that the row is being selected.

  The camera image 460 is an image taken by the camera 220 or 260 at the trigger generation timing among the camera images included in the driving information in the row 430.

  The map image 450 reads out map data centered on the position of the GPS information from the database 120 using the GPS information measured at the trigger generation timing among the image-related data included in the driving information of the row 430. , Displayed with an icon indicating the position.

  FIG. 5 is an enlarged view of the display content of the image display area 440 in FIG. 4 for explanation.

  As shown in the figure, a camera image 460 is displayed superimposed on the upper right corner of the map image 450. The icon 490 indicates a position on the map image indicated by the GPS information.

  The map image 450 is an image for allowing the user to confirm where the trigger is generated on the map. In order to facilitate confirmation, (1) the icon 490 and the name of the place or road in the vicinity thereof are displayed on the map, and (2) the place name or road in the vicinity of the icon 490 is large enough to be visually recognized by the user. It is the main condition that it is displayed with the right size. In order to display the map image 450 and the camera image 460 so as to satisfy the conditions (1) and (2) within the display range of the image display area 440, a layout as shown in FIG. 5 is preferable. That is, by displaying the map image 450 over the entire frame of the image display area 440, a place name near the icon 490 and a certain size of the road are secured, and the camera image 460 is displayed in the upper right corner of the map image 450. The icon 490 and nearby place names and roads are not obscured. If the map image 450 and the camera image 460 are displayed in the image display area 440 without overlapping each other, the area of the map image 450 is compressed by the area of the camera image 460, resulting in a reduction. However, there is a problem that the visibility of the map image is inferior, but in the case of FIG. 5, since the two images are superimposed, it is not necessary to make the area of the map image smaller in accordance with the area of the camera image, and the visibility is inferior. Absent. The reason why this layout is effective is that the map image 450 image has more important place name and road information in the central part, and corner information such as the upper right corner is not as important as the central part. by.

  However, the layout of FIG. 5 is not always an effective layout. Depending on the content of the driving information, the user may want to confirm a road hidden under the camera image 460 or the camera image 460 may be displayed. You may want to zoom in and check. For such a case, a non-display button 470 and a display switching button 480 are displayed at the upper right corner and the lower left corner of the camera image 460, respectively.

  When the non-display button is clicked with a mouse or the like, the camera image 460 is hidden as shown in FIG. 6, and a portion hidden in the camera image 460 of the map image 450 appears. When the display switching button 480 is clicked, the camera image 460 is displayed in the full frame of the image display area 440 as shown in FIG. At this time, although not shown, the map image 450 may be displayed in the upper right corner of the camera image 460.

  Now, when one line of the driving information list is selected, both the map image and the camera image are displayed in the example of FIG. 4, but in some cases, only the camera image is displayed in the frame of the image display area 440 from the beginning. It may appear full.

  FIG. 8 shows a display example. If one row 810 of the driving information list is selected in the figure, only the camera image 820 is displayed in the image display area, and no map image is displayed. This is because GPS information is not included in the driving information in the row 820.

  There are cases where the GPS information is not included in the driving information, for example, when the in-vehicle device does not include a GPS receiver, or when GPS information cannot be acquired due to an error even if it is provided. In that case, if both the map image and the camera image are displayed as shown in FIG. 4, since there is no GPS information, a map image cannot be created and a black image or the like is displayed on the display portion of the map information. Or, a random value is taken from the storage area corresponding to the GPS information of the driving information, and the random map information is created and displayed. When displaying a black image, most of the image display area 440 becomes a black image, which is inferior to the display mode of FIG. 4, and when displaying random map information, the user check There is a risk of mistakes. Even if it is a black image or a random map image, the display of the area is useless.

  Therefore, in order not to cause such a situation, the PC 110 determines whether or not the GPS information is included in the driving information of the selected row in the driving information list. If it is not included, it is displayed in the display mode as shown in FIG.

  By doing so, even if the map information is not created, it is displayed in an appropriate display mode, the display mode by the black image is not inferior, and there is no worry of a user's check mistake due to the random map image.

  In addition, there are the following effects. That is, the layout occupancy as shown in FIGS. 4 and 8 increases the area occupancy ratio of the camera image and the map image in the image display area as compared with the conventional area. As a result, even if the area of the image display area is smaller than the conventional area, It is now possible to display images with the same image magnification. Thanks to that, an empty space is created next to the image display area, and the driving information list can be displayed here. Thereby, the user can check a list of other driving information while checking a camera image and a map image related to one driving information.

Furthermore, information suitable for character display is collectively displayed in the driving information list, and information suitable for image display is collectively displayed in the image display area, which makes it easier for the user to see. . Specifically, since the GPS information included in the driving information is numerical data, it may be displayed in the driving information list as it is, but even if the GPS information is displayed as numerical data as it is, it is useful for most users. Absent. Therefore, the visibility of the user can be further enhanced by processing and displaying the map image based on the GPS information.
<Operation>
The operation at the time of image display of the driving support device configured as described above will be described with reference to FIG.

  In the figure, the PC 110 creates and displays a driving information list based on the driving information accumulated in the database 120. When one of the lists is selected by a mouse or the like (step S910), GPS information is included in the driving information. Is included (step S930).

  If there is GPS information as a result of determination, map data corresponding to the position of the GPS information is read from the database 120 to generate a map image (step S940). Then, the PC 110 superimposes the camera image on the upper right corner of the map image and displays it in the image display area next to the driving information list (step S950).

On the other hand, if there is no GPS information as a result of the discrimination, only the camera image is read and the camera image is displayed over the entire frame of the image display area (step S960).
<Modification>
The shooting direction of the cameras 220 and 260 need not be limited to the front, rear, or inside, and it is not necessary to fix the shooting in only one direction.

  In this embodiment, the GPS receiver is included in the configuration of the in-vehicle device. However, the GPS information may be acquired from the GPS receiver used in the car navigation system mounted on the vehicle, or the AVM system. The 290 may include a GPS receiver and acquire GPS information from the GPS receiver.

  In the data structure of each driving information recorded in the memory card 230, the number of camera images and image related information is not limited to the above.

  In addition, the various specific numerical values shown in the above embodiment do not necessarily have to be the numerical values, and can be appropriately changed in design according to the actual embodiment.

  In the above embodiment, the camera image is displayed at the upper right corner of the map image, but may be the lower right corner, the upper left corner, and the lower left corner. Further, although the upper right corner vertex of the overlapping map image and the upper right corner vertex of the camera image are displayed so as to coincide with each other, they do not need to coincide with each other and may be shifted. In short, the camera image may be arranged in an area that overlaps a part of the display area of the map image and that excludes the image portion indicating the vehicle position on the map image. Then, the vehicle position can be confirmed from the displayed part of the map image, and the map image and the map image are overlapped, so that the place name and road of the map image are displayed without making it too small. be able to.

  In addition, each function of each of the above embodiments may be realized by describing the function in a computer-readable program language and causing the computer to execute the program.

It is a figure which shows schematic structure of the driving assistance system which concerns on embodiment of this invention, (a) shows schematic structure of the center side driving assistance apparatus, (b) shows schematic structure of the vehicle-mounted apparatus by the side of a mobile station. . The data structure of the content recorded on the memory card 230 is shown conceptually. (A) and (b) respectively show the data structure of main item data and image related data. One structural example of a display screen is shown. One structural example of a display screen is shown. One structural example of a display screen is shown. One structural example of a display screen is shown. One structural example of a display screen is shown. It is a flowchart showing the operation | movement at the time of the image display of a driving assistance device.

Explanation of symbols

110 PC
120 Database 130 Memory Card Reader 140 Printer 210 Drive Recorder 220 Camera 230 Memory Card 240 Vehicle Signal Acquisition Unit 250 GPS Antenna 260 Camera 270 Microphone 280 External Switch 290 AVM System

Claims (3)

An acquisition means for acquiring driving information that includes a camera image captured by a camera installed in the vehicle and may include position information indicating a position of the vehicle at the time of shooting;
Determining means for determining whether or not the driving information acquired by the acquiring means includes position information;
As a result of the determination, when the position information is included, a map image indicating the position of the position information and a camera image are displayed in a predetermined display area of the display device,
An image display means for displaying a camera image larger than the display in the case where the display area includes the position information when the position information is not included. The driving information further includes character information,
The acquisition means acquires a plurality of driving information,
The driving support device further includes:
List display means for listing character information included in each driving information acquired by the acquisition means and displaying it in another display area that does not overlap the display area;
An instruction acquisition means for acquiring a selection instruction by the user of any driving information on the list,
The driving support apparatus according to claim 1, wherein the determination unit and the display control unit perform the determination and the display on the driving information selected by the selection instruction acquisition unit. A computer-readable driving support program, the program being stored in a computer,
An acquisition step of acquiring driving information from a recording medium that includes a camera image captured by a camera installed in the vehicle and may include position information indicating the position of the vehicle at the time of shooting;
A determination step of determining whether or not the driving information acquired by the acquisition step includes position information;
As a result of the determination, when the position information is included, a map image indicating the position of the position information and a camera image are displayed in a predetermined display area of the display device,
An image display step of displaying a camera image larger than the display in the case where the display area includes position information when the position information is not included.