JP7135913B2 - Driving evaluation screen display method, program, driving evaluation system, and driving evaluation screen - Google Patents

Description

The present invention relates to a driving evaluation screen display method, a program, a driving evaluation system, and a driving evaluation screen.

Patent Document 1 discloses a driving record device that can output a report including analysis results of driving data so that it can be viewed by various devices, and FIG. It is The daily report includes charts showing speed, driving conditions, road conditions, etc., which change over time, and a table showing safe driving evaluations for multiple driving items (maximum speed, number of overspeeding, etc.). ing.

[Problems to be solved by the invention]
In the safe driving daily report created by the operation recording device described in Patent Document 1, speed, driving conditions, road conditions, etc., which change with the passage of time, are simply displayed in charts. The relationship with the table is also very difficult to understand. Therefore, for example, when people in the driver management department of a logistics company show the driver a limited time, such as at the morning meeting every morning, when the driver is sent out, it will not be possible to determine when and where It is difficult to make each driver intuitively understand what kind of driving situation it was, and it is difficult for the people in the driver management department to easily explain to each driver in a good manner. was there.

JP 2016-57765 A

Means to solve the problem and its effect

The present invention has been devised in view of the above problems, and enables each driver to more intuitively understand when, where, and what kind of driving situation it was. To provide a method of displaying a driving evaluation screen, a program, a driving evaluation system, and a driving evaluation screen that enable even people of all ages to easily explain to each driver.

In order to achieve the above object, the driving evaluation screen display method (1) according to the present disclosure includes:
A method of displaying a driving evaluation screen created based on a data group in which driving conditions of a vehicle driver transmitted from an in-vehicle device are recorded,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
Using the data group synchronized in time series,
a reproduced image of the driver;
a graph showing the change over time of the detection data;
a first display step of displaying a map showing the travel route of the vehicle on one screen;
a time designation bar displayed on the graph;
a position mark of the vehicle displayed on the map;
and a second display step of displaying the reproduced image of the driver in a time-synchronized manner.

According to the driving evaluation screen display method (1), the reproduced image of the driver, the graph showing the temporal change of the detected data, and the map showing the driving route of the vehicle are displayed on one screen. can be done. Further, the time designation bar displayed on the graph, the position mark of the vehicle displayed on the map, and the reproduced image of the driver can be displayed in a manner synchronized in time series. . Therefore, for example, by showing the driving evaluation screen to each driver, the people in the driver management department can more intuitively understand when, where, and what kind of driving situation it was. can be made In addition, it becomes possible for the people in the driver management department to explain the driving situation to each driver in a simple and convenient manner, which facilitates safety education for each driver.

Further, the driving evaluation screen display method (2) according to the present disclosure is the driving evaluation screen display method (1), wherein the second display step is synchronized with the movement operation of the time designation bar, and the driver is displayed, and the position mark of the vehicle on the map is moved and displayed.

According to the driving evaluation screen display method (2), the position of the vehicle on the map and the state of the driver (e.g., face orientation, driving posture, etc.) at the time when the time designation bar is displayed. ), it is possible to display changes in the driving conditions of the vehicle and the driver in a more comprehensible manner.

Further, a driving evaluation screen display method (3) according to the present disclosure is the driving evaluation screen display method (1), wherein the second display step synchronizes with an operation of moving a position mark of the vehicle to display the driving evaluation screen. It is characterized in that the reproduced image of the person is displayed, and the time designation bar displayed on the graph is moved and displayed.

According to the driving evaluation screen display method (3), the state of the detected data and the state of the driver (for example, face orientation, driving posture, etc.) at the position where the vehicle position mark is displayed are displayed. By synchronizing the display with the shown image, changes in the driving conditions of the vehicle and the driver can be displayed in a more comprehensible manner.

Further, the driving evaluation screen display method (4) according to the present disclosure is the driving evaluation screen display method (1), wherein the second display step synchronizes with the reproduction of the reproduced image of the driver and displays the graph It is characterized in that the time designation bar displayed above is moved and the position mark of the vehicle on the map is moved and displayed.

According to the driving evaluation screen display method (4), the time designation bar displayed on the graph and the position mark of the vehicle on the map are displayed in synchronization with the reproduction of the reproduced image of the driver. By moving and displaying, changes in the driving conditions of the vehicle and the driver can be displayed in a more comprehensible manner.

Further, the driving evaluation screen display method (5) according to the present disclosure is any of the driving evaluation screen display methods (1) to (4), wherein the evaluation event is displayed near the occurrence time of the evaluation event on the graph. The method is characterized by including a third display step of displaying evaluation comments on the event.

According to the display method (5) of the driving evaluation screen, by displaying the evaluation comment about the evaluation event near the occurrence time of the evaluation event on the graph, each driver can be informed at what timing and how. It is possible to easily grasp whether the driving evaluation was performed. In addition, it is possible for the people in the driver management department to explain the driving evaluation to each driver in a convenient and easy manner, which facilitates safety education for each driver.

Further, the driving evaluation screen display method (6) according to the present disclosure is the driving evaluation screen display method (5), wherein the third display step includes: It is characterized in that the evaluation comment is displayed as a pop-up at the timing when the time passes.

According to the display method (6) of the driving evaluation screen, it is possible to obtain the same effect as the display method (5) of the driving evaluation screen, and to avoid excessive information displayed on the screen. In addition, it is possible to make the driver aware of the evaluation comment without fail.

Further, a driving evaluation screen display method (7) according to the present disclosure is, in any one of the driving evaluation screen display methods (1) to (6), near the position of the vehicle where the evaluation event occurred on the map. , includes a fourth display step of displaying an evaluation comment related to the evaluation event.

According to the display method (7) of the driving evaluation screen, by displaying the evaluation comment about the evaluation event near the position of the vehicle on the map where the evaluation event occurred, each driver can tell which position In this way, it is possible to easily grasp what kind of driving evaluation was performed. In addition, it is possible for the people in the driver management department to explain the driving evaluation to each driver in a convenient and easy manner, which facilitates safety education for each driver.

Further, the driving evaluation screen display method (8) according to the present disclosure is the driving evaluation screen display method (7), wherein the fourth display step includes: It is characterized in that the evaluation comment is displayed as a pop-up at the timing when the generated position is passed.

According to the display method (8) of the driving evaluation screen, it is possible to obtain the same effect as the display method (7) of the driving evaluation screen and to avoid excessive information displayed on the screen. In addition, it is possible to make the driver aware of the evaluation comment without fail.

Further, a driving evaluation screen display method (9) according to the present disclosure is any one of the driving evaluation screen display methods (1) to (8), wherein the evaluation event includes the vehicle entering an intersection, a sudden start, a sudden At least one of acceleration, sudden deceleration, sudden stop, sudden steering, and overspeeding is included.

According to the driving evaluation screen display method (9), the evaluation event includes at least one of the vehicle entering an intersection, sudden start, sudden acceleration, sudden deceleration, sudden stop, sudden steering, and excessive speed. Since it is included, each driver can grasp the driving situation when these evaluation events occur, which may lead to accidents, and promote awareness reforms to prevent accidents. It is possible to make the safety education for each driver more useful.

Further, the program (1) according to the present disclosure executes, in at least one computer, a process of displaying a driving evaluation screen created based on a data group in which the driving situation of the vehicle driver transmitted from the in-vehicle device is recorded. A program for
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
on said at least one computer;
Using the data group synchronized in time series,
a reproduced image of the driver;
a graph showing the change over time of the detection data;
a first display step of displaying a map showing the travel route of the vehicle on one screen;
a time designation bar displayed on the graph;
a position mark of the vehicle displayed on the map;
and a second display step of displaying the reproduced image of the driver in a manner synchronized in time series.

According to the above program (1), the computer displays, on one screen, the reproduced image of the driver, the graph showing the temporal change of the detected data, and the map showing the travel route of the vehicle. can be executed. Further, a process of displaying the time designation bar displayed on the graph, the position mark of the vehicle displayed on the map, and the reproduced image of the driver in a time-series synchronized manner is executed. can be made Therefore, for example, by showing the driving evaluation screen to each driver, the people in the driver management department can more intuitively understand when, where, and what kind of driving situation it was. can be made In addition, it becomes possible for the people in the driver management department to explain the driving situation to each driver in a simple and convenient manner, which facilitates safety education for each driver. The program may be a program stored in a storage medium, a program that can be transferred via a communication network, or a program that is executed via a communication network. .

Further, the program (2) according to the present disclosure further causes the program (1) to further execute a third display step of displaying an evaluation comment related to the evaluation event near the occurrence time of the evaluation event on the graph. Characterized by

According to the above program (2), by causing the computer to execute the process of displaying the evaluation comment related to the evaluation event near the occurrence time of the evaluation event on the graph, each driver can be notified at what timing. , it is possible to display a screen on which it is possible to grasp in an easy-to-understand manner what kind of driving evaluation has been made. In addition, it is possible for the people in the driver management department to explain the driving evaluation to each driver in a convenient and easy manner, which facilitates safety education for each driver.

Further, a program (3) according to the present disclosure is a program (1) or (2) in which an evaluation comment regarding the evaluation event is displayed near the position of the vehicle on the map where the evaluation event has occurred. A display step is further executed.

According to the above program (3), by causing the computer to execute a process of displaying an evaluation comment related to the evaluation event near the position of the vehicle on the map where the evaluation event occurred, each driver can , which position and what kind of driving evaluation was made, can be displayed on a screen that allows the driver to grasp in an easy-to-understand manner. In addition, it is possible for the people in the driver management department to explain the driving evaluation to each driver in a convenient and easy manner, which facilitates safety education for each driver.

In addition, the driving evaluation system (1) according to the present disclosure performs driving evaluation of each driver based on a data group that records the driving situation of the vehicle driver transmitted from the vehicle-mounted device, and information of the driving evaluation A driving evaluation system comprising a server device that outputs to an external device,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
The server device
a storage unit that stores the data group in time-series synchronization;
an output unit that processes the data group stored in the storage unit into a predetermined display screen format and outputs the data to the external device;
In the predetermined display screen form,
Including a form in which the reproduced image of the driver, a graph showing the temporal change of the detected data, and a map showing the driving route of the vehicle are displayed on one screen,
Further, the present invention is characterized by including a mode in which the time designation bar displayed on the graph, the position mark of the vehicle displayed on the map, and the reproduced image of the driver are displayed in chronological synchronization. and

According to the driving evaluation system (1), the external device displays a reproduced image of the driver, a graph showing the temporal change of the detected data, and a map showing the travel route of the vehicle on one screen. can be done. Further, the time designation bar displayed on the graph, the position mark of the vehicle displayed on the map, and the reproduced image of the driver can be displayed in a manner synchronized in time series. . Therefore, for example, by showing the driving evaluation screen to each driver using the external device, the people in the driver management department can tell each driver when, where, and what kind of driving situation. can be understood more intuitively. In addition, it becomes possible for the people in the driver management department to explain the driving situation to each driver in a simple and convenient manner, which facilitates safety education for each driver.

Further, the driving evaluation system (2) according to the present disclosure is such that, in the driving evaluation system (1), the predetermined display screen format is the vicinity of the occurrence time of the evaluation event on the graph, or the evaluation event on the map. The method further includes a mode in which an evaluation comment regarding the evaluation event is displayed near the position of the vehicle where the occurrence of the event occurs.

According to the driving evaluation system (2), the vicinity of the occurrence time of the evaluation event on the graph of the driving evaluation screen displayed on the external device, or the vicinity of the location of the vehicle on the map where the evaluation event occurred can display an evaluation comment about the evaluation event. As a result, each driver can understand in an easy-to-understand manner what kind of driving evaluation was made at what timing, or what kind of driving evaluation was made at what position. In addition, it is possible for the people in the driver management department to explain the driving evaluation to each driver in a convenient and easy manner, which facilitates safety education for each driver.

Further, the driving evaluation screen (1) according to the present disclosure is a driving evaluation screen created on a computer screen based on a data group in which the driving situation of the vehicle driver transmitted from the vehicle-mounted device is recorded,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
on one screen,
a reproduced image display area for displaying the reproduced image of the driver;
a graph display area for displaying a graph showing changes over time of the detected data;
a map display area for displaying a map showing the travel route of the vehicle;
a time designation bar on the graph displayed in the graph display area;
a position mark of the vehicle on the map displayed in the map display area;
The reproduction image of the driver to be displayed in the reproduction image display area is displayed in a manner synchronized in time series.

According to the driving evaluation screen (1), the reproduced image display area, the graph display area, and the map display area are provided on one screen, and the time on the graph displayed in the graph display area is A designation bar, a position mark of the vehicle on the map displayed in the map display area, and a reproduced image of the driver displayed in the reproduced image display area are displayed in a manner synchronized in time series. be. Therefore, for example, by showing the driving evaluation screen to each driver, the people in the driver management department can more intuitively understand when, where, and what kind of driving situation it was. can be made In addition, it becomes possible for the people in the driver management department to explain the driving situation to each driver in a simple and convenient manner, which facilitates safety education for each driver.

Further, the driving evaluation screen (2) according to the present disclosure is, in the driving evaluation screen (1), near the occurrence time of the evaluation event on the graph, or near the position of the vehicle where the evaluation event occurred on the map. , an evaluation comment related to the evaluation event is further displayed.

According to the driving evaluation screen (2), an evaluation comment related to the evaluation event is displayed near the occurrence time of the evaluation event on the graph or near the position of the vehicle where the evaluation event occurred on the map. be able to. As a result, each driver can understand in an easy-to-understand manner what kind of driving evaluation was made at what timing, or what kind of driving evaluation was made at what position. In addition, it is possible for the people in the driver management department to explain the driving evaluation to each driver in a convenient and easy manner, which facilitates safety education for each driver.

1 is a schematic configuration diagram of a driving evaluation system to which a driving evaluation screen display method according to an embodiment is applied; FIG. FIG. 2 is a block diagram schematically showing main parts of an in-vehicle device used in the driving evaluation system; FIG. It is a figure which shows an example of the structure of the data group transmitted from a vehicle equipment to a server apparatus. It is a block diagram which shows roughly the principal part of the server apparatus used with a driving evaluation system. It is a figure which shows an example of the structure of the data group file accumulate|stored in the data storage part of a server apparatus. It is a block diagram which shows the functional structural example of the server apparatus used with a driving evaluation system. It is a figure which shows an example of the driving evaluation screen displayed on the screen of a business operator terminal. 4 is a flow chart showing processing operations performed by a driver monitoring unit of the in-vehicle device; 4 is a flow chart showing a processing operation performed by a control unit of an in-vehicle device; 4 is a flowchart showing processing operations performed by a central processing unit of the server device; 4 is a flowchart showing processing operations performed by a business operator terminal and a server device; It is a flowchart which shows the display processing operation|movement of the driving evaluation screen which a business operator terminal performs.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of a driving evaluation screen display method, a program, a driving evaluation system, and a driving evaluation screen according to the present invention will be described with reference to the drawings.

[Application example]
FIG. 1 is a schematic configuration diagram of a driving evaluation system to which a driving evaluation screen display method according to an embodiment is applied.
The driving evaluation system 1 includes an in-vehicle device 10 mounted on at least one vehicle 2 and at least one server device 40 .
The server device 40 performs driving evaluation such as safety confirmation operation of each driver 3 based on the data group in which the driving situation of the vehicle driver transmitted from the vehicle-mounted device 10 is recorded, and the information of the driving evaluation is obtained. It has a function of outputting to an external device (hereinafter referred to as a business terminal) 80 .

The vehicle 2 in which the vehicle-mounted device 10 is mounted is not particularly limited. In this application example, a vehicle managed by a company that runs various businesses can be targeted. For example, trucks managed by transportation companies, buses managed by bus companies, taxis managed by taxi companies, car-share vehicles managed by car-sharing companies, rental cars managed by car-rental companies, company-owned vehicles owned by the company, or company-owned vehicles leased from car leasing companies. Also, the vehicle 2 in which the vehicle-mounted device 10 is mounted may be a general vehicle. For example, the server device 40 is configured to be managed or operated by a safety evaluation/driving training institution such as an insurance company or a driving school, and the safety evaluation/driving training institution executes driving evaluation of each vehicle driver. It is also possible to apply it as a system.

The in-vehicle device 10 and the server device 40 are configured to be able to communicate with each other via the communication network 4 . The communication network 4 may include a wireless communication network such as a mobile phone network including base stations or a wireless LAN (Local Area Network), a wired communication network such as a public telephone network, the Internet, or a telecommunication line such as a dedicated network. may include

Also, a business terminal 80 that manages the vehicle 2 is configured to be able to communicate with the server device 40 via the communication network 4 . The business terminal 80 may be a personal computer with a communication function, or may be a mobile information terminal such as a mobile phone, a smart phone, or a tablet device. Further, the operator terminal 80 may be configured to communicate with the vehicle-mounted device 10 via the communication network 4 .

The server device 40 includes a communication unit 41 , a server computer 50 and a storage unit 60 .

In the driving evaluation system 1, the server device 40 accumulates a data group in which the driving situation of the vehicle driver transmitted from each on-vehicle device 10 is recorded, and using the accumulated data group of each on-vehicle device 10, Each driver 3 is evaluated for driving.

The data group includes image data of the driver 3 captured during a predetermined period including the occurrence of an evaluation event for driving evaluation, and detection of the state of the driver 3 or the running state of the vehicle 2 detected during the predetermined period. data and position data of the vehicle 2 detected during a predetermined period, and these data are stored in synchronization with each other in time series. If the detection time and imaging time of these data are the same, they are stored in synchronization with each other.

In addition, the evaluation event includes at least one of the vehicle 2 entering an intersection, starting suddenly, accelerating suddenly, decelerating suddenly, stopping suddenly, steering abruptly, and exceeding the speed. , an evaluation of the safety checking behavior of the driver 3 at the intersection is made.

The server device 40 uses the data group acquired from each on-vehicle device 10, for example, after each vehicle 2 has finished driving for a day, performs evaluation processing for each evaluation event that occurred while driving that day. The execution timing of the driving evaluation process is not particularly limited. For example, the evaluation process may be executed for each evaluation event occurring within a certain period of time.

In addition, the server device 40 processes various requests from the operator terminal 80 via the communication network 4, and responds to the various requests on the screen 81 of the operator terminal 80 through, for example, a dedicated homepage on a browser. Perform processing to present processing results (driving evaluation screen, etc.).

For example, when the server device 40 receives a transmission request for the driving evaluation results of each driver 3 from the operator terminal 80, the server device 40 displays the driving evaluation data and the data group of each driver 3 stored in the storage unit 60 in a predetermined manner. Processing to create a predetermined driving evaluation screen by processing it into a screen form and displaying the driving evaluation screen on the screen 81 of the operator terminal 80 is executed. FIG. 7, which will be described later, shows an example of a driving evaluation screen 82 displayed on the screen 81 of the operator terminal 80. As shown in FIG.

As illustrated in FIG. 7, the predetermined display screen format includes a reproduced image 83a of the driver 3 during a predetermined period including the occurrence of the evaluation event, and the state of the driver 3 (for example, the orientation of the face or the direction of the line of sight). etc.), or a form in which a graph 84a showing temporal changes in detected data of the running state of the vehicle 2 (for example, vehicle speed, angular velocity, etc.) and a map 85b showing the running route 85a of the vehicle 2 are displayed on one screen. ing.

Furthermore, in this one-screen display form, a time designation bar 84b displayed on the graph, a position mark 85c of the vehicle 2 displayed on the travel route 85a of the map, and a reproduced image 83a of the driver 3 are displayed in chronological order. It is displayed in a synchronized manner. That is, the display mode is such that the position mark 85c of the vehicle 2 moves and the reproduced image 83a of the driver 3 changes in synchronization with the movement of the time designation bar 84b.

Further, the predetermined display screen form further includes a form in which the evaluation comment 86 regarding the evaluation event is displayed near the occurrence time of the evaluation event on the graph or near the position of the vehicle 2 where the evaluation event occurred on the map. is For example, when the evaluation event is entering an intersection, the evaluation comment 86 includes the speed at which the intersection is approached, the state of checking left and right before entering (confirmation time, face angle, etc.), the state of checking left and right while entering (confirmation time, face angle, etc.). (angle of face, etc.) is displayed in a balloon display or a pop-up display.

The provision of such driving evaluation information using the business operator terminal 80 is, for example, before each driver 3 is sent out, such as at the morning assembly of the transportation business, by the people of the driver management department of the transportation business. Based on the operation schedule for the day, points to be noted in driving are shared with each driver 3 and executed for the purpose of providing safe driving guidance. Therefore, by showing each driver 3 the driving evaluation screen 82 having the above-described display screen format, each driver 3 can tell when, where, and in what kind of driving situation (that is, when driving). points, etc.) can be made to understand more intuitively. Safety training for employees becomes easier.

[Configuration example]
FIG. 2 is a block diagram schematically showing a main part of vehicle-mounted device 10 used in driving evaluation system 1 according to the embodiment.
The in-vehicle device 10 includes a platform section 11 and a driver monitoring section 20 . A drive recorder section 30 is also connected to the vehicle-mounted device 10 .

The platform unit 11 is equipped with an acceleration sensor 12 that measures the acceleration of the vehicle 2, an angular velocity sensor 13 that detects the rotational angular velocity of the vehicle 2, and a GPS (Global Positioning System) receiver 14 that detects the position of the vehicle 2. . In addition, the platform unit 11 includes a communication unit 15 that performs communication processing with an external device via the communication network 4, a notification unit 16 that outputs a warning sound such as a beep sound or a sound such as a warning message, and a storage unit. 17 and an external interface (external I/F) 18 are provided. Further, the platform section 11 is equipped with a control section 19 that controls the processing operations of each section.

The acceleration sensor 12 is, for example, a triaxial acceleration sensor that measures acceleration in three directions of the XYZ axes. A two-axis or one-axis acceleration sensor may be used as the acceleration sensor 12 . Acceleration data measured by the acceleration sensor 12 is stored in the RAM 19b of the controller 19 in association with the detection time.

The angular velocity sensor 13 is a sensor capable of detecting at least angular velocity corresponding to rotation about a vertical axis (yaw direction), that is, angular velocity data corresponding to lateral rotation (turning) of the vehicle 2. For example, a gyro sensor (yaw rate It is also called a sensor). The angular velocity sensor 13 detects the angular velocity at a predetermined cycle (for example, a cycle of several tens of milliseconds), and the detected angular velocity data is stored in the RAM 19b of the control unit 19 in association with the detection time, for example.

The GPS receiver 14 receives GPS signals from artificial satellites via an antenna 14a at predetermined intervals, and detects position data (latitude and longitude) of the current location. The position data detected by the GPS receiver 14 is stored in the RAM 19b of the controller 19 in association with the detection time. Note that the device for detecting the position of the vehicle 2 is not limited to the GPS receiver 14 . For example, a positioning device compatible with other satellite positioning systems such as Japan's quasi-zenith satellite, Russia's GLONASS, Europe's Galileo, or China's Compass may be used.

The communication unit 15 includes a communication module that performs data output processing and the like to the server device 40 via the communication network 4 .

The storage unit 17 is composed of, for example, a removable storage device such as a memory card, or one or more storage devices such as a hard disk drive (HDD) or solid state drive (SSD). In addition to data acquired from the driver monitoring unit 20 or the drive recorder unit 30, the storage unit 17 may store data detected by the acceleration sensor 12, the angular velocity sensor 13, the GPS receiving unit 14, and the like.

The external I/F 18 includes an interface circuit, a connector, and the like for exchanging data and signals with onboard equipment such as the drive recorder section 30 .

The control unit 19 is composed of a microcomputer including a CPU (Central Processing Unit) 19a, a RAM (Random Access Memory) 19b, and a ROM (Read Only Memory) 19c. The control unit 19 performs processing for storing the acquired various data in the RAM 19 b or the storage unit 17 . In addition to the programs stored in the ROM 19c, the control unit 19 also reads various data stored in the RAM 19b or the storage unit 17 as necessary, and executes the programs.

The driver monitoring section 20 includes a driver camera 21 , an image analysis section 22 and an interface (I/F) 23 .
The driver camera 21 includes, for example, a lens section, an imaging element section, a light irradiation section, and a camera control section that controls these sections (not shown).

The imaging element unit includes, for example, an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) having sensitivity in the visible light wavelength range or the near infrared wavelength range, a filter, a microlens, and the like. consists of The light irradiation unit includes a light emitting element such as an LED (Light Emitting Diode), and may use a light emitting element that emits near-infrared rays so that the state of the driver can be imaged day and night. The driver camera 21 may be a monocular camera or a stereo camera.

The camera control section includes, for example, a processor. The camera control unit controls the imaging element unit and the light irradiation unit, irradiates light (for example, near infrared rays) from the light irradiation unit, and controls the imaging element unit to image the reflected light. I do. The driver camera 21 captures an image at a predetermined frame rate (eg, 30 to 60 frames per second), and data of the image captured by the driver camera 21 is output to the image analysis section 22 .

The image analysis unit 22 includes, for example, an image processing processor and the like, and determines at least one of the orientation of the face of the driver 3, the direction of the line of sight, and the degree of eye opening from the image captured by the driver camera 21. It performs processing such as detecting information (state of the driver). Data indicating the state of the driver 3 detected by the image analysis unit 22, image data, and imaging date (time) data are sent to the platform unit 11 via an interface (I/F) 23, and the platform unit 11 It is stored in the RAM 19 b or the storage unit 17 .

The orientation of the face of the driver 3 detected by the image analysis unit 22 is, for example, the pitch angle (vertical orientation) around the X-axis (horizontal axis) of the driver's face, the Y-axis of the face. The yaw angle, which is the angle (horizontal orientation) about the (vertical axis), and the roll angle, which is the angle (horizontal tilt) about the Z axis (front-back axis) of the face, may be indicated by at least the left and right contains a yaw angle that indicates the orientation of the Moreover, these angles can be indicated by angles relative to a predetermined reference direction, and for example, the reference direction may be set to the front direction of the driver 3 .

In addition, the direction of the line of sight of the driver 3 detected by the image analysis unit 22 is, for example, the direction of the driver's face detected from the image and the information of the eye region (the position of the inner corner of the eye, the outer corner of the eye, or the position of the pupil, etc.). ), and can be represented by a line-of-sight vector V (three-dimensional vector) on three-dimensional coordinates. The line-of-sight vector V may be estimated from, for example, at least one of the pitch angle, yaw angle, and roll angle of the driver's face, and information on the eye region.

Further, the eye opening degree of the driver 3 detected by the image analysis unit 22 is, for example, the information of the driver's eye region (the inner corners, the outer corners of the eyes, the position of the upper and lower eyelids, or the position of the pupil) detected from the image. etc.).

A drive recorder section 30 is configured to be connectable to the external I/F 18 of the platform section 11 . The drive recorder unit 30 includes an exterior camera 31 and an interior camera 32 . The exterior camera 31 is a camera that captures an image in front of the vehicle 2 , and the interior camera 32 is a camera that captures an image of the interior of the vehicle 2 . The exterior camera 31 and the interior camera 32 may be composed of, for example, visible light cameras, but may also be composed of near-infrared cameras or the like. The vehicle exterior camera 31 and the vehicle interior camera 32 respectively capture images at a predetermined frame rate (eg, 30 to 60 frames per second), and the images captured by the vehicle exterior camera 31 and the vehicle interior camera 32 and data such as the date and time of imaging are sent to the platform unit. 11 and stored in the RAM 19 b of the platform section 11 or the storage section 17 . Note that the drive recorder unit 30 may have a configuration in which only the vehicle exterior camera 31 is provided.

The in-vehicle device 10 can have a compact configuration in which the platform section 11 and the driver monitoring section 20 are accommodated in one housing. In this case, the in-vehicle installation location of the vehicle-mounted device 10 is not particularly limited as long as the driver camera 21 can image the field of view including at least the face of the driver 3 . For example, it may be installed in the vicinity of the center of the dashboard of the vehicle 2, the steering column, the vicinity of the meter panel, the vicinity of the rearview mirror, or the A pillar. In addition, information including the specifications of the driver camera 21 (for example, the angle of view, the number of pixels (vertical x horizontal), etc.) and the position and orientation (for example, the mounting angle, the distance from a predetermined origin (such as the center position of the steering wheel), etc.) It may be stored in the monitoring unit 20 or the platform unit 11 . Further, the driver monitoring section 20 may be configured integrally with the platform section 11 or may be configured separately from the platform section 11 .

FIG. 3 is a diagram showing an example of the structure of a data group transmitted from the vehicle-mounted device 10 to the server device 40. As shown in FIG.
The data group includes identification information (serial number, etc.) of the in-vehicle device 10, transmission date and time, and image data of the driver 3 captured during a predetermined period including the occurrence of the evaluation event. The data group also includes detection data indicating the state of the driver 3 detected during a predetermined period, including the direction of the face of the driver (pitch, yaw, and roll), the direction of the line of sight (pitch and yaw), , and eye opening (right eye and left eye) data. In addition, the data group includes data on the running speed, acceleration (back and forth, left and right, and up and down) and angular velocity (yaw) of the vehicle 2 as detection data indicating the running state of the vehicle 2 detected during a predetermined period. is The data group also includes position data (latitude and longitude) of the vehicle 2 detected during a predetermined period. Furthermore, the data group may include an image outside the vehicle. These data are synchronized chronologically. Note that the structure of the detection data transmitted to the server device 40 is not limited to the structure shown in FIG.

A data group including these data is transmitted, for example, when occurrence of an evaluation event for driving evaluation is detected. The evaluation event includes at least one of the vehicle 2 entering an intersection, starting suddenly, accelerating suddenly, decelerating suddenly, stopping suddenly, turning abruptly, and speeding up. Whether or not an event in which the vehicle 2 has entered an intersection has occurred is determined, for example, by the fact that a predetermined time has passed since the rotational angular velocity value detected by the angular velocity sensor 13 exceeded a predetermined threshold value (threshold value for estimating entry into an intersection). can be determined by detecting

FIG. 4 is a block diagram schematically showing a main part of server device 40 used in driving evaluation system 1 according to the embodiment.
The server device 40 includes a communication unit 41 , a server computer 50 and a storage unit 60 , which are connected via a communication bus 42 .

The communication unit 41 is composed of a communication device for realizing transmission and reception of various data and signals with the vehicle-mounted device 10 and the business terminal 80 via the communication network 4 .

The server computer 50 includes a central processing unit 51 including one or more CPUs, and a main memory 53 in which a control program 52 is stored. The central processing unit 51 executes various processes according to the control program 52 in the main memory 53 .

The storage unit 60 is composed of one or more large-capacity storage devices such as a hard disk drive and a solid state drive. and a driver information storage unit 65 .

A data group transmitted from the vehicle-mounted device 10 is stored in the data storage unit 61 in association with the identification information of each vehicle-mounted device 10 .
FIG. 5 is a diagram showing an example of the structure of a data group file accumulated in the data accumulation unit 61. As shown in FIG.
In the data group file, in association with the identification information (serial number, etc.) of the in-vehicle device 10, the date and time when the data group was transmitted from the in-vehicle device 10, the driver image (image date and time, frame number, and image data), The direction of the driver's face (pitch, yaw, and roll), the direction of the line of sight (pitch and yaw), the degree of eye opening (right eye and left eye), the running speed of the vehicle, the acceleration (back and forth, left and right, and up and down), Information such as angular velocity (yaw), vehicle position data (latitude and longitude), and images outside the vehicle (image date and time, frame number, and image data) are accumulated. These data groups are accumulated chronologically for each evaluation event.

The map data storage unit 62 stores map data. The map data is map data that can display the travel route and position marks of the vehicle 2 on the map on the screen 81 of the business terminal 80, and the map data that can recognize the shape of the road including the intersection. , the type of which is not particularly limited. For example, it may be planar map image data or map image data based on an aerial photograph. Also, color map image data may be used, or map image data obtained by binarizing road portions and other portions may be used.

The evaluation table storage unit 63 stores a table indicating evaluation conditions for each evaluation event. For example, at an intersection, an evaluation table is included in which evaluation conditions for safety confirmation actions to be performed by the driver are set.

The evaluation table for entering an intersection includes, for example, the direction (left or right) in which the driver should confirm safety when passing through the intersection (before or during entry), for each shape of the intersection, for each turning direction at the intersection. , its confirmation angle, confirmation time, etc. are stored. The confirmation angle indicates, for example, the orientation of the face of the driver 3 with respect to the front direction of the vehicle 2 or the direction of the line of sight.

The evaluation data storage unit 64 stores data of driving evaluation results of each driver 3 executed by the server computer 50 . The driving evaluation result data stores, for example, information about evaluation results of safety confirmation actions of the driver 3 at each intersection that the driver 3 has passed through, for each on-vehicle device 10 or each driver 3 . In addition, the driver information storage unit 65 stores various information related to the driver 3 managed by the company.

FIG. 6 is a functional configuration block diagram of the server device 40 according to the embodiment.
The central processing unit 51 of the server computer 50 includes a driving evaluation section 54 , a display output reception section 55 , a display processing section 56 and a display output processing section 57 .

The driving evaluation unit 54 performs driving evaluation processing for each driver 3 based on the data group accumulated in the data accumulation unit 61 and the evaluation conditions stored in the evaluation table storage unit 63 . An example of processing for evaluating the safety confirmation action of the driver when entering an intersection, which is one of the evaluation events, will be described below.

The driving evaluation unit 54 first performs a process of estimating the time at which the vehicle 2 enters the intersection. For example, the driving evaluation unit 54 calculates an integral value of the angular velocity data stored in the data storage unit 61 (angular velocity data transmitted from the vehicle-mounted device 10 when passing through an intersection), and the calculated integral value has a predetermined integral ratio. is detected, and this detection time is estimated as the time of entry into the intersection.

Then, based on the evaluation conditions stored in the evaluation table storage unit 63, the driving evaluation unit 54 performs processing for evaluating the driver's safety confirmation actions within a predetermined time before and after the time when the vehicle enters the intersection. First, based on the data group accumulated in the data accumulation unit 61, the driving evaluation unit 54 determines the swing angle and swing time of at least one of the direction of the driver's face or line of sight within a predetermined time before and after the entry time. to detect

Next, the driving evaluation unit 54 determines the evaluation condition stored in the evaluation table storage unit 63 and the swing angle and the swing time at a predetermined time (before the entry) before the entry time. Perform processing to evaluate the safety confirmation operation. If the evaluation condition includes confirmation behavior in each of the left and right directions, the order of detection in each of the left and right directions does not matter.

For example, regarding the confirmation of safety in the right direction, (1) whether or not the confirmation timing for the right direction is appropriate, (2) whether or not the swing angle to the right direction is equal to or greater than a predetermined angle, and (3) whether or not the predetermined It is determined whether or not the state of the angle or more has continued for a predetermined time or longer. Whether or not (1) the confirmation timing for the right direction is appropriate can be determined, for example, by whether or not the swing angle to the right direction has reached or exceeded a predetermined angle by a predetermined time before the entry time. .

Similarly, regarding the confirmation of safety in the left direction, (4) whether or not the confirmation timing for the left direction is appropriate, (5) whether or not the swing angle to the left direction is equal to or greater than a predetermined angle, and (6) the above-mentioned It is determined whether or not the state of a predetermined angle or more has continued for a predetermined time or longer. Whether or not the above (4) confirmation timing for the left direction is appropriate can be determined, for example, by whether or not the swing angle to the left has reached or exceeded a predetermined angle by a predetermined time before the entry time. .

Further, the driving evaluation unit 54 determines the course change direction at the intersection based on the evaluation conditions stored in the evaluation table storage unit 63 and the swing angle and the swing time during a predetermined time (while entering) after the entry time. , for example, a process of evaluating the safety confirmation operation of the right turn destination or the left turn destination.

For example, regarding safety confirmation of the course change direction, (7) whether the confirmation timing of the course change direction is appropriate; or (9) whether or not the state of the predetermined angle or more has continued for a predetermined time or longer. Whether or not the above (7) confirmation timing of the course change direction is appropriate is determined, for example, by whether or not the swing angle in the course change direction has reached a predetermined angle or more by a predetermined time after the entry time. be able to.

Furthermore, the driving evaluation unit 54 may perform a process of evaluating the driver's deceleration awareness based on the traveling speed of the vehicle 2 at a predetermined time before and after the entry time. For example, (10) deceleration is performed by determining whether the maximum running speed of the vehicle 2 in a predetermined time before and after the entry time is equal to or less than a predetermined speed (for example, the upper limit speed at which the vehicle can safely turn and pass through an intersection). Consciousness may be assessed.

The driving evaluation unit 54 evaluates each confirmation behavior set in the evaluation conditions stored in the evaluation table storage unit 63 based on the determination methods of the above items (1) to (10), and evaluates each intersection passed through. Perform processing for calculating evaluation points. For example, for each confirmation action set in the evaluation conditions, the evaluation results of confirmation timing, confirmation angle, and confirmation time are totaled, necessary statistical processing (averaging, normalization processing, etc.) is performed, and each intersection Calculate the score by points or ranking. Then, the driving evaluation section 54 performs a process of storing the evaluation points and judgment contents for each intersection passed through in the evaluation data storage section 64 of the storage unit 60 .

The display output receiving unit 55 performs a process of receiving a transmission request for the driving evaluation result of each driver from the operator's terminal 80 via the communication network 4 . For example, people in a driver management department of a transportation company operate the operator terminal 80 to access a dedicated homepage on a browser, and after completing login, perform an operation requesting transmission of driving evaluation results for each driver. As a result, reception processing in the display output reception unit 55 is performed.

When the display output reception unit 55 receives a request for transmission of driving evaluation results from the operator terminal 80, the display processing unit 56 stores the requested driving evaluation data and data group of the driver in the data storage unit. 61 and the evaluation data storage unit 64, processing is performed to process it into a predetermined display screen form, and processing necessary for displaying a predetermined driving evaluation screen is performed.

As illustrated in FIG. 7, the predetermined display screen format includes a reproduced image 83a of the driver 3 during a predetermined period including the occurrence of the evaluation event, and the state of the driver 3 (for example, the orientation of the face or the direction of the line of sight). etc.), or a form in which a graph 84a showing temporal changes in detected data of the running state of the vehicle 2 (for example, vehicle speed, angular velocity, etc.) and a map 85b showing the running route 85a of the vehicle 2 are displayed on one screen. ing.

Furthermore, in this one-screen display form, the time designation bar 84b displayed on the graph, the position mark 85c of the vehicle 2 displayed on the map, and the reproduced image 83a of the driver 3 are displayed in synchronism in time series. It is in the form of That is, the display mode is such that the position mark 85c of the vehicle 2 moves and the reproduced image 83a of the driver 3 changes in synchronization with the movement of the time designation bar 84b.

Further, the predetermined display screen form further includes a form in which the evaluation comment 86 regarding the evaluation event is displayed near the occurrence time of the evaluation event on the graph or near the position of the vehicle 2 where the evaluation event occurred on the map. is For example, when the evaluation event is entering an intersection, the evaluation comment 86 includes the speed at which the intersection is approached, the state of checking left and right before entering (confirmation time, face angle, etc.), the state of checking left and right while entering (confirmation time, face angle, etc.). (angle of face, etc.) is displayed in a balloon display or a pop-up display.

The display output processing unit 57 outputs data for displaying the driving evaluation screen in a predetermined format created by the display processing unit 56 to the business operator terminal 80 via the communication network 4, and outputs the data to the business operator terminal 80. A process of displaying a driving evaluation screen 82 in a dedicated home page, for example, displayed on the screen 81 is executed.

FIG. 7 shows an example of a driving evaluation screen 82 displayed on the screen 81 of the operator terminal 80. On one screen, a reproduced image display area 83 displaying a reproduced image 83a of the driver and an image of detected data. A graph display area 84 for displaying a graph 84a showing changes over time and a map display area 85 for displaying a map 85b showing a travel route 85a of the vehicle are provided. The display positions of the reproduced image display area 83, the graph display area 84, and the map display area 85 on one screen are not limited to the example shown in FIG. It is possible to change it appropriately according to the size and shape of the screen 81 to be displayed.

A time designation bar 84b on the graph displayed in the graph display area 84, a vehicle position mark 85c on the map displayed in the map display area 85, and a reproduced image of the driver to be displayed in the reproduced image display area 83. 83a are displayed in a time-synchronized manner.

In synchronism with the moving operation of the time designation bar 84b, the reproduced image 83a of the driver is displayed (reproduced), and the position mark 85c of the vehicle on the map is displayed while moving. The form of the time designation bar 84b is not limited to the form shown in FIG. Any display format may be used as long as the position at which the time is specified can be recognized. The form of the vehicle position mark 85c is also not limited to the form shown in FIG. Any display format may be used as long as the position of the vehicle can be recognized.

In addition, in synchronism with the moving operation of the position mark 85c of the vehicle, the reproduction image 83a of the driver is displayed (reproduced), and the time designation bar 84b displayed on the graph is displayed while moving. good too.

In synchronization with the reproduction (continuous reproduction) of the reproduced image 83a of the driver, the time designation bar 84b displayed on the graph is displayed while moving, and the position mark 85c of the vehicle on the map is displayed while moving. may be displayed.

Also, evaluation comments 86 (approaching speed ◯, right confirmation time ◯, left confirmation time ×, etc.) related to the evaluation event are displayed near the occurrence time of the evaluation event on the graph. Note that the evaluation comment 86 may be displayed in a balloon on the screen together with the graph, or may be displayed in a pop-up at the timing when the time designation bar 84b passes the occurrence time of the evaluation event on the graph.

In addition, an evaluation comment 86 (such as an intersection 5-point evaluation) relating to the evaluation event is displayed near the position of the vehicle (on the travel route) where the evaluation event occurred on the map. The 5-point evaluation of an intersection is the result of evaluating left and right confirmation before entering an intersection, left and right confirmation while entering an intersection, and the speed of approach. The display form and display contents of the evaluation comment 86 are not limited to the form and contents shown in FIG.

For example, the evaluation comment 86 may be balloon-displayed on the screen together with the map, or the position mark 85c of the vehicle may be pop-up-displayed at the timing when the evaluation event occurs on the map. . The pop-up display of the evaluation comment 86 may be displayed for a certain period of time, or may be displayed continuously until the screen is switched.

The driving evaluation screen 82 may also include a switch button 87a for the next evaluation event and a switch button 87b for the previous evaluation event. In this case, when the next evaluation event switching button 87a is selected, the driving evaluation result of the next evaluation event is displayed, and when the previous evaluation event switching button 87b is selected, the previous evaluation event is displayed. Since the driving evaluation result of the evaluation event is displayed, the display switching operation of the driving evaluation result is facilitated.

[Example of operation]
FIG. 8 is a flow chart showing processing operations performed by the driver monitoring unit 20 in the vehicle-mounted device 10 . This processing operation is executed, for example, at the timing when an image is captured by the driver camera 21 (for example, every frame or every frame at a predetermined interval).

First, in step S1, the image analysis unit 22 acquires an image captured by the driver camera 21, and proceeds to step S2.

In step S2, the image analysis unit 22 performs a process of detecting the driver's face or a region of the face from the acquired image, and proceeds to step S3. A method for detecting a face from an image is not particularly limited, but it is preferable to adopt a method for detecting a face at high speed and with high accuracy.

In step S3, the image analysis unit 22 detects the positions and shapes of facial features such as eyes, nose, mouth, and eyebrows from the face area detected in step S2, and proceeds to step S4.
A method for detecting facial features from a facial region in an image is not particularly limited, but it is preferable to adopt a method that can detect facial features at high speed and with high accuracy. For example, the image analysis unit 22 may create a three-dimensional face shape model, fit it to the face region on the two-dimensional image, and detect the position and shape of each organ of the face.

In step S4, the image analysis unit 22 performs processing for detecting the direction of the driver's face based on the position and shape data of each organ of the face obtained in step S3, and advances the processing to step S5. For example, the pitch angle for vertical rotation (around the X-axis), the yaw angle for horizontal rotation (around the Y-axis), and the roll angle for overall rotation (around the Z-axis), which are included in the parameters of the three-dimensional face shape model, are It may be detected as information related to the direction of the driver's face.

In step S5, the image analysis unit 22 determines the orientation of the driver's face obtained in step S4 and the position and shape of the facial organs of the driver obtained in step S3, particularly the characteristic points of the eyes (outer corners of the eyes, inner corners of the eyes, and pupils). ), the direction of the line of sight is detected, and the process proceeds to step S6. The line-of-sight direction is, for example, a feature quantity of eye images in various face orientations and line-of-sight directions (the relative positions of the corners of the eyes, the inner corners of the eyes, and the pupils, or the relative positions of the sclera (so-called white eye) and the iris (so-called black eye)). . Alternatively, using the fitting result of the three-dimensional face shape model, etc., the size and center position of the eyeball are estimated from the size and orientation of the face and the position of the eyes, etc., the position of the pupil is detected, and the center of the eyeball is detected. A vector connecting the center of the pupil may be detected as the line-of-sight direction.

In step S6, the image analysis unit 22 determines the position and shape of the driver's facial organs obtained in step S3, particularly the positions and shapes of the characteristic points of the eyes (outer corners, inner corners, pupils, and eyelids) of the eyes. A degree detection process is performed, and the process proceeds to step S7.

In step S7, the image analysis unit 22 determines the orientation of the driver's face detected in step S4, the direction of the driver's line of sight detected in step S5, the degree of eye opening of the driver detected in step S6, and the driving The image of the person and the imaging time are associated with each other and transmitted to the platform section 11 as image information, after which the image analysis section 22 returns to step S1 and repeats the process.

FIG. 9 is a flowchart showing processing operations performed by the control unit 19 in the vehicle-mounted device 10 . This processing operation is executed, for example, at a predetermined cycle of several tens of ms to several seconds.

In step S11, the control unit 19 acquires acceleration data measured by the acceleration sensor 12 and stores it in the RAM 19b, and proceeds to step S12.

In step S12, the control unit 19 acquires the angular velocity data detected by the angular velocity sensor 13 and stores it in the RAM 19b, and proceeds to step S13.

In step S13, the control section 19 acquires the image information transmitted from the driver monitoring section 20 and stores it in the RAM 19b, and proceeds to step S14.

In step S14, the control section 19 acquires the data (the data of the vehicle exterior image and the vehicle interior image) sent from the drive recorder section 30 and stores the acquired data in the RAM 19b, and proceeds to step S15.

In step S15, the control unit 19 performs a process of acquiring position data detected by the GPS receiving unit 14, and advances the process to step S16. Note that the order of steps S11 to S15 is not limited to this. Also, the process of step S14 may be omitted.

In step S16, the control unit 19 calculates the running speed based on the unit time change of the position data, stores the position data and the running speed in the RAM 19b, and proceeds to step S17.

In step S17, the control unit 19 determines whether or not the vehicle 2 has entered the intersection. For example, the control unit 19 determines whether the integral value of the angular velocity is equal to or greater than a threshold value indicating that the vehicle is entering an intersection, and the traveling speed is equal to or lower than a predetermined upper limit speed indicating that the vehicle is entering an intersection.

In step S17, if the control unit 19 determines that the vehicle 2 has entered the intersection, the process proceeds to step S18, and the control unit 19 determines whether the vehicle 2 has passed through the intersection. For example, it is determined whether the integral value of the angular velocity is equal to or less than a threshold value indicating that the vehicle has passed through the intersection, and the running speed is equal to or higher than a predetermined lower speed limit indicating that the vehicle has passed through the intersection.

In step S18, if the control unit 19 determines that the vehicle 2 has passed through the intersection, the process proceeds to step S19. A data group including the acquired detection data is read from the RAM 19b, and a process of controlling the communication unit 15 to transmit the data group to the server device 40 is executed. After that, the control unit 19 returns to step S11 and repeats the process. FIG. 3 shows an example of the structure of the data group transmitted from the vehicle-mounted device 10 to the server device 40. As shown in FIG.

In addition to the processing of steps S17 and S18, or instead of the processing of steps S17 and S18, the control unit 19 determines whether the vehicle 2 is in a state of emergency based on the data acquired in at least one of the processing of steps S11 to S16. Processing may be performed to detect at least one of start, sudden acceleration, sudden deceleration, sudden stop, sudden steering, and overspeed. When these are detected, in step S19, a data group including detection data acquired in a predetermined period before and after the detection of these is read from the RAM 19b, and the data group is transmitted to the server device 40 by controlling the communication section 15. You may make it perform a process.

Note that the control unit 19 may store the data group read from the RAM 19b in the storage unit 17 (for example, a removable storage medium) instead of performing the process of step S19. After the end of the day's running, the driver 3 removes the storage unit 17 from the vehicle-mounted device 10 and causes the business operator terminal 80 to read the data group stored in the storage unit 17. may be sent to

FIG. 10 is a flow chart showing processing operations performed by the central processing unit 51 in the server device 40 .
First, in step S21, the central processing unit 51 determines whether or not the data group transmitted from the vehicle-mounted device 10 has been received. proceed.
In step S22, the central processing unit 51 stores the data group received from the vehicle-mounted device 10 in the data accumulation unit 61 in association with the identification information of the vehicle-mounted device 10, and proceeds to step S23.

In step S23, the central processing unit 51 determines whether or not it is time to perform driving evaluation of the driver (evaluation of safe driving behavior, etc.). . Whether or not it is time to perform driving evaluation may be determined by, for example, whether or not a signal indicating that driving of the vehicle 2 has ended has been received from the vehicle-mounted device 10 .

On the other hand, in step S23, if the central processing unit 51 determines that it is time to execute the driving evaluation, it advances the process to step S24 to process the driving evaluation for the evaluation event, for example, Then, a process of driving evaluation such as a safety confirmation operation at the intersection of the driver 3 is performed, and the process proceeds to step S25.

In step S25, the central processing unit 51 stores the result of the driving evaluation process in the evaluation data storage section 64 in association with the information of the vehicle-mounted device 10 or the driver 3, and then finishes the process.

FIG. 11 is a flow chart showing an example of processing operations performed by the business operator terminal 80 and the server device 40 . This processing operation is executed based on a request from the operator terminal 80, for example.
First, in step S31, the operator terminal 80 performs a process of transmitting login data to the server device 40 via the communication network 4 based on an input operation by people in the driver management department or the like. The login data is data (for example, login ID, password, etc.) for logging in to the dedicated homepage that can display the driving evaluation screen.

In step S32, the server device 40 receives the login data transmitted from the business operator terminal 80, performs authentication processing of the login data, and then in step S33, includes data such as authentication OK or authentication NG A process of transmitting the authentication result to the operator terminal 80 is performed.

In step S34, the operator terminal 80 receives the authentication result transmitted from the server device 40 and performs display processing based on the authentication result. For example, if the result of authentication is OK, a dedicated home page screen capable of providing driving evaluation information and the like is displayed. Further, if the result of authentication is NG, a screen requesting retransmission of correct login data is displayed.

In step S34, when the business operator terminal 80 receives the authentication OK data, the process proceeds to step S35. In step S35, the operator terminal 80 performs a process of transmitting a driver's driving evaluation information request signal to the server device 40 based on an input operation to the dedicated home page screen by people in the driver management department.

In step S36, the server device 40 receives the request signal for the driving evaluation information transmitted from the operator terminal 80, and stores the data group in which the requested driving situation of the driver is stored in the data accumulation unit 61, A process of reading from the evaluation data storage unit 64 is performed, and the process proceeds to step S37.

In step S37, the server device 40 processes the data group read out from the data storage unit 61 and the evaluation data storage unit 64 so as to have a predetermined display screen form, and proceeds to step S38.

The data group includes image data of the driver 3 captured during a predetermined period including the occurrence of the evaluation event, detection data of the state of the driver 3 and the running state of the vehicle 2 detected during the predetermined period, and predetermined Position data of the vehicle 2 detected during the period are included, and these data are synchronized in time series. Furthermore, in the data group, data of evaluation comments (evaluation contents, evaluation results, matters to be noted, etc.) for evaluation events are synchronized in chronological order.

In addition, as shown in FIG. 7, the predetermined display screen form includes a reproduced image 83a of the driver, a graph 84a showing the temporal change of the detected data, and a map 85b showing the travel route 85a of the vehicle. A time designation bar 84b to be displayed on the graph, a vehicle position mark 85c to be displayed on the map, and a reproduced image 83a of the driver are displayed in synchronization with each other in time series. It contains forms that

In step S38, the server device 40 performs a process of transmitting the data processed in step S37 so as to have a predetermined display screen format to the operator terminal 80 as display data for the driving evaluation screen.

In step S39, the operator terminal 80 receives the display data for the driving evaluation screen transmitted from the server device 40 in step S39, and then proceeds to step S40. Based on the display data, display processing of the driving evaluation screen illustrated in FIG. 7 is performed. A specific example of the display processing operation of the driving evaluation screen will be described with reference to FIG. 12 .

After that, when the operator terminal 80 finishes displaying the driving evaluation screen in step S40 and detects a logoff operation by the people in the driver management department, etc., the process proceeds to step S41. 40 is processed.

In step S42, when the server device 40 receives the log-off signal transmitted from the business operator terminal 80, the server device 40 performs communication termination processing, and then terminates the processing.

FIG. 12 is a flow chart showing an example of the display processing operation of the driving evaluation screen performed by the operator terminal 80. As shown in FIG. Note that FIG. 7 shows an example of the driving evaluation screen.
First, in step S51, the operator terminal 80 stores the received display data of the driving evaluation screen, and then proceeds to step S52.

In step S52, based on the display data for the driving evaluation screen, a reproduced image display area 83 for displaying a reproduced image 83a of the driver, a graph display area 84 for displaying a graph 84a showing temporal changes in detected data, and a vehicle A process of displaying a driving evaluation screen including a map display area 85 displaying a map 85b indicating a driving route 85a of the vehicle is performed (first display step), and the process proceeds to step S53.

In step S53, the operator terminal 80 displays the time designation bar 84b on the graph, the vehicle position mark 85c on the travel route 85a on the map, and the reproduced image 83a of the driver in chronological order (in other words, time). A process of synchronizing and displaying is performed (second display step), and then the process proceeds to step S54. For example, on the initial screen, the time designation bar 84b and the vehicle position mark 85c are displayed at the position of the start time of the predetermined period including the occurrence of the evaluation event, and the reproduced image 83a of the driver at the start time is displayed. do.

In step S54, the operator terminal 80 determines whether or not there has been an operation to move the time designation bar 84b or the position mark 85c of the vehicle, or an operation to reproduce the driver image. If so, the display process is terminated. On the other hand, if it is determined in step S54 that there has been a movement operation or a reproduction operation, the process proceeds to step S55.

In step S55, the operator terminal 80 displays the time designation bar 84b and the vehicle position mark 85c while moving them in synchronization with the movement operation or the reproduction operation, and displays the reproduction image 83a of the driver. is performed (second display step), and the process proceeds to step S56.

In step S56, the operator terminal 80 determines whether or not the time corresponding to the display position of the time designation bar 84b or the vehicle position mark 85c is the evaluation event occurrence time. If not, the process continues to step S55. If it is determined that the evaluation event has occurred, the process proceeds to step S57.

In step S57, the operator terminal 80 pops up the evaluation comment 86 in the form of a balloon display at the position of the occurrence time of the evaluation event on the graph or the position of the occurrence time of the evaluation event on the travel route of the vehicle. is performed (third display step, fourth display step), and then the display processing ends. The evaluation comment 86 may continue to be displayed until the screen is switched to the next screen, or the pop-up display may disappear after a certain period of time.

In this display process, when the time corresponding to the display position of the time designation bar 84b or the vehicle position mark 85c is the occurrence time of the evaluation event, the evaluation comment 86 is popped up. However, in another display processing example, during the synchronous display in step S53, the evaluation comment 86 may be balloon-displayed at the position corresponding to the occurrence time of the evaluation event.

[Action/effect]
According to the driving evaluation system 1 to which the display method of the driving evaluation screen according to the above embodiment is applied, the operator terminal 80 is provided with the reproduced image 83a of the driver 3, the graph 84a showing the temporal change of the detected data, A map 85b showing the travel route 85a of the vehicle 2 can be displayed on one screen. In addition, the time designation bar 84b displayed on the graph, the vehicle position mark 85c displayed on the map, and the reproduced image 83a of the driver 3 can be displayed in a time-synchronized manner. . Therefore, for example, by showing the driving evaluation screen 82 to each driver using the operator's terminal 80, people in the driver management department can tell each driver when, where, and what kind of driving situation. It is possible to make them understand more intuitively. In addition, it becomes possible for the people in the driver management department to explain the driving situation to each driver in a simple and convenient manner, which facilitates safety education for each driver.

Further, according to the driving evaluation system 1, an evaluation event is displayed near the occurrence time of the evaluation event on the graph of the driving evaluation screen displayed on the operator terminal 80, or near the position of the vehicle 2 where the evaluation event occurred on the map. An evaluation comment 86 regarding the event can be displayed in a balloon or popped up. As a result, each driver can understand in an easy-to-understand manner what kind of driving evaluation was made at what timing, or what kind of driving evaluation was made at what position. It is possible to surely make the driver aware of it. Also, for the people in the driver management department, it is possible to explain the driving evaluation to each driver in a convenient and easy manner, which facilitates safety education for each driver and enhances the effect of safe driving guidance. .

In addition, the evaluation event includes at least one of vehicle 2 entering an intersection, starting suddenly, accelerating suddenly, decelerating suddenly, stopping suddenly, turning abruptly, and speeding up. It is possible to make each driver understand the driving situation and the content of the driving evaluation when these evaluation events occur, and promote awareness reforms to prevent accidents. can make safety training more beneficial.

Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various modifications and changes can be made without departing from the scope of the invention.
For example, in another embodiment, the driving evaluation system 1 is applied to the driving evaluation of a driver in a safety evaluation/driving training institution such as an insurance company or a driving school, and a driving evaluation screen as shown in FIG. It is also possible to use it as an analysis evaluation report for toll assessment and the like, an analysis evaluation report of driving training results including training for the elderly, and the like.

[Note]
Embodiments of the present invention can also be described in the following appendices, but are not limited thereto.
(Appendix 1)
A method of displaying a driving evaluation screen created based on a data group in which driving conditions of a vehicle driver transmitted from an in-vehicle device (10) are recorded,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
Using the data group synchronized in time series,
the reproduced image (83a) of the driver;
a graph (84a) showing changes over time in the detection data;
a first display step (S52) of displaying a map (85b) showing the travel route (85a) of the vehicle on one screen;
a time designation bar (84b) displayed on the graph;
a position mark (85c) of the vehicle displayed on the map;
A display method comprising a second display step (S53) of displaying the reproduced image (83a) of the driver in a manner synchronized in time series.

(Appendix 2)
A server that evaluates each driver's driving based on a group of data transmitted from an in-vehicle device (10) and records the driving conditions of the vehicle driver, and outputs information on the driving evaluation to an external device (80). A driving evaluation system (1) comprising a device (40),
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
The server device (40)
a storage unit (61) for storing the data group in time-series synchronization;
an output unit (57) that processes the data group stored in the storage unit (61) into a predetermined display screen format and outputs the data to the external device;
In the predetermined display screen form,
Including a form in which the reproduced image of the driver (83a), the graph (84a) showing the temporal change of the detected data, and the map (85b) showing the driving route (85a) of the vehicle are displayed on one screen,
Furthermore, the time designation bar (84b) displayed on the graph, the vehicle position mark (85c) displayed on the map, and the reproduced image of the driver (83a) are synchronized in time series. A driving evaluation system characterized by including a form to be displayed.

(Appendix 3)
A driving evaluation screen (82) created on a computer screen based on a group of data transmitted from an in-vehicle device (10) recording the driving conditions of the vehicle driver,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
on one screen,
a reproduced image display area (83) for displaying the reproduced image of the driver;
a graph display area (84) for displaying a graph showing changes over time in the detected data;
A map display area (85) for displaying a map showing the travel route of the vehicle,
a time designation bar (84b) on the graph displayed in the graph display area (84);
a position mark (85c) of the vehicle on the map displayed in the map display area (85);
A driving evaluation screen characterized in that the reproduced image (83a) of the driver to be displayed in the reproduced image display area (83) is displayed in a manner synchronized in time series.

1 driving evaluation system 2 vehicle 3 driver 4 communication network 10 in-vehicle device 11 platform unit 12 acceleration sensor 13 angular velocity sensor 14 GPS receiver 15 communication unit 16 notification unit 17 storage unit 18 external interface (external I/F)
19 control unit 19a CPU
19b RAM
19c ROMs
20 driver monitoring unit 21 driver camera 22 image analysis unit 23 interface (I/F)
30 drive recorder unit 31 vehicle exterior camera 32 vehicle interior camera 40 server device 41 communication unit 50 server computer 51 central processing unit 52 main memory 53 control program 54 driving evaluation unit 55 display reception processing unit 56 display processing unit 57 display output processing unit 60 storage Unit 61 Data storage unit 62 Map data storage unit 63 Evaluation table storage unit 64 Evaluation data storage unit 65 Driver information storage unit 80 Business operator terminal (external device)
81 Screen 82 Driving evaluation screen 83 Reproduced image display area 83a Reproduced image 84 Graph display area 84a Graph 84b Time designation bar 85 Map display area 85a Travel route 85b Map 85c Vehicle position mark 86 Evaluation comment

Claims (14)

A method of displaying a driving evaluation screen created based on a data group in which driving conditions of a vehicle driver transmitted from an in-vehicle device are recorded,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
Using the data group synchronized in time series,
a reproduced image of the driver;
a graph showing the change over time of the detection data;
a first display step of displaying a map showing the travel route of the vehicle on one screen;
a time designation bar displayed on the graph;
a position mark of the vehicle displayed on the map;
a second display step of displaying the reproduced image of the driver in a manner synchronized in time series ;
and a third display step of displaying an evaluation comment related to the evaluation event near the occurrence time of the evaluation event on the graph . A method of displaying a driving evaluation screen created based on a data group in which driving conditions of a vehicle driver transmitted from an in-vehicle device are recorded,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
Using the data group synchronized in time series,
a reproduced image of the driver;
a graph showing the change over time of the detection data;
a first display step of displaying a map showing the travel route of the vehicle on one screen;
a time designation bar displayed on the graph;
a position mark of the vehicle displayed on the map;
a second display step of displaying the reproduced image of the driver in a manner synchronized in time series;
and a fourth display step of displaying an evaluation comment related to the evaluation event near the position of the vehicle on the map where the evaluation event occurred. The second display step includes:
Synchronize with the movement operation of the time designation bar,
displaying the reproduced image of the driver;
3. The driving evaluation screen display method according to claim 1, wherein the position mark of the vehicle on the map is moved and displayed. The second display step includes:
Synchronizing with the movement operation of the position mark of the vehicle,
displaying the reproduced image of the driver;
3. The method of displaying a driving evaluation screen according to claim 1, wherein the time designation bar displayed on the graph is displayed by moving. The second display step includes:
Synchronizing with the reproduction of the reproduced image of the driver,
While moving the time designation bar displayed on the graph,
3. The driving evaluation screen display method according to claim 1, wherein the position mark of the vehicle on the map is moved and displayed. The third display step includes:
2. The driving evaluation screen display method according to claim 1 , wherein the evaluation comment is displayed as a pop-up at a timing when the time designation bar passes the occurrence time of the evaluation event on the graph. The fourth display step includes:
3. The driving evaluation screen display method according to claim 2 , wherein the evaluation comment is displayed as a pop-up at a timing when the position mark of the vehicle passes the position on the map where the evaluation event occurred. The evaluation comment according to any one of claims 1 to 7, wherein the evaluation comment includes an evaluation comment on the safety confirmation operation of the driver during a predetermined period including the occurrence of the evaluation event. How to display the driving evaluation screen. 9. The evaluation event includes at least one of entering an intersection, starting suddenly, accelerating, decelerating, stopping, turning abruptly, and exceeding speed of the vehicle. A method of displaying the driving evaluation screen according to any one of the items. A program for causing at least one computer to execute a process of displaying a driving evaluation screen created based on a data group in which a driving situation of a vehicle driver transmitted from an in-vehicle device is recorded,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
on said at least one computer;
Using the data group synchronized in time series,
a reproduced image of the driver;
a graph showing the change over time of the detection data;
a first display step of displaying a map showing the travel route of the vehicle on one screen;
a time designation bar displayed on the graph;
a position mark of the vehicle displayed on the map;
a second display step of displaying the reproduced image of the driver in a manner synchronized in time series ;
and a third display step of displaying an evaluation comment related to the evaluation event near the occurrence time of the evaluation event on the graph . A program for causing at least one computer to execute a process of displaying a driving evaluation screen created based on a data group in which a driving situation of a vehicle driver transmitted from an in-vehicle device is recorded,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
These data are synchronized chronologically,
on said at least one computer;
Using the data group synchronized in time series,
a reproduced image of the driver;
a graph showing the change over time of the detection data;
a first display step of displaying a map showing the travel route of the vehicle on one screen;
a time designation bar displayed on the graph;
a position mark of the vehicle displayed on the map;
a second display step of displaying the reproduced image of the driver in a manner synchronized in time series;
and a fourth display step of displaying an evaluation comment related to the evaluation event near the position of the vehicle on the map where the evaluation event occurred. 12. The program according to claim 10, wherein the evaluation comment includes an evaluation comment on the safety confirmation operation of the driver during a predetermined period including the occurrence of the evaluation event. A driving evaluation provided with a server device that evaluates each driver's driving based on a group of data transmitted from an in-vehicle device and records the driving conditions of the vehicle driver, and outputs information on the driving evaluation to an external device. a system,
In the data group,
image data of the driver captured during a predetermined period of time including the occurrence of the evaluation event;
detection data of the state of the driver or the running state of the vehicle detected during the predetermined period;
location data of the vehicle detected during the predetermined period of time;
The server device
a storage unit that stores the data group in time-series synchronization;
an output unit that processes the data group stored in the storage unit into a predetermined display screen format and outputs the data to the external device;
In the predetermined display screen form,
Including a form in which the reproduced image of the driver, a graph showing the temporal change of the detected data, and a map showing the driving route of the vehicle are displayed on one screen,
Further, a mode in which the time designation bar displayed on the graph, the position mark of the vehicle displayed on the map, and the reproduced image of the driver are displayed in chronological order ;
and a form in which an evaluation comment related to the evaluation event is displayed near the occurrence time of the evaluation event on the graph and/or near the position of the vehicle where the evaluation event occurred on the map. driving evaluation system. 14. The driving evaluation system according to claim 13, wherein the evaluation comment includes an evaluation comment on the safety confirmation action of the driver during a predetermined period including the occurrence of the evaluation event.

Images