JP2021117905A - Analysis control device, record control device, operation support system, and analysis control method - Google Patents

Abstract

To appropriately notify a vehicle's driver of a point where minor contact between the vehicle and a surrounding object is likely to occur.SOLUTION: An analysis control device 90 comprises: an analysis data acquisition unit 92 that acquires image data of a bird's-eye view image around a vehicle and positional information of a position where the bird's-eye view image is taken from recording control devices mounted on a plurality of vehicles as analysis data; an analysis unit 93 that analyzes a point where a slight contact between the vehicle and an object around the vehicle is likely to occur based on the analysis data acquired by the analysis data acquisition unit 92; and a notification control unit 94 that notifies the recording control device of the point information of the contact frequent occurrence points analyzed by the analysis unit 93.SELECTED DRAWING: Figure 1

Description

The present invention relates to an analysis control device, a recording control device, a driving support system, and an analysis control method.

A technique for detecting other vehicles on the right and left sides around the own vehicle in the merging section is known (see, for example, Patent Document 1). A technique for mapping a traffic accident and storing accident history data, real-time accident data, and other accident-related information is known (see, for example, Patent Document 2).

Japanese Unexamined Patent Publication No. 2008-052399 Special Table 2018-505422

For example, there are points where the vehicle can easily rub surrounding objects such as walls, such as corners of alleys. With the techniques described in Patent Document 1 and Patent Document 2, such a point cannot be notified to the driver of the vehicle. It is desirable to appropriately notify the driver of the vehicle of the points where slight contact between the vehicle and surrounding objects is likely to occur.

The present invention has been made in view of the above, and an object of the present invention is to appropriately notify the driver of a vehicle of a point at which a slight contact between the vehicle and a surrounding object is likely to occur.

In order to solve the above-mentioned problems and achieve the object, in the analysis control device according to the present invention, the video data of the bird's-eye view image around the vehicle and the bird's-eye view image are obtained from the recording control device mounted on a plurality of vehicles. An analysis data acquisition unit that acquires the position information of the photographed position as analysis data, and the vehicle and an object around the vehicle based on the analysis data acquired by the analysis data acquisition unit. It is provided with an analysis unit that analyzes a contact frequent occurrence point, which is a point where minor contact is likely to occur, and a notification control unit that notifies the recording control device of the point information of the contact frequent occurrence point analyzed by the analysis unit. ..

The recording control device according to the present invention includes a video data acquisition unit that acquires video data captured by a photographing unit that photographs the periphery of the vehicle, an acceleration information acquisition unit that acquires acceleration information indicating acceleration applied to the vehicle, and the above. A point information acquisition unit that acquires point information of the point from an analysis device that analyzes a point where a slight contact between the vehicle and an object around the vehicle is likely to occur, and the point information acquired by the point information acquisition unit. A threshold setting unit that changes the acceleration threshold for detecting an event based on the position information of the current position of the vehicle, and an acceleration information acquired by the acceleration information acquisition unit are set by the threshold setting unit. An event detection unit that detects that an event has occurred when the value is equal to or greater than the specified threshold, a recording control unit that stores video data corresponding to the detection of the event when the event detection unit detects the occurrence of an event, and the above. When the event detection unit detects the occurrence of an event, the bird's-eye view image generation unit that generates a bird's-eye view image of the surroundings of the vehicle from the video data corresponding to the event detection, and the bird's-eye view image generated by the bird's-eye view image generation unit. It includes a transmission control unit that transmits video data to the analysis device via a communication unit.

The driving support system according to the present invention includes the above-mentioned analysis control device and the above-mentioned recording control device.

In the analysis control method according to the present invention, video data of a bird's-eye view image of the periphery of the vehicle and position information of a position where the bird's-eye view image is taken are acquired as analysis data from a recording control device mounted on a plurality of vehicles. Based on the analysis data acquisition step and the analysis data acquired by the analysis data acquisition step, a contact frequent occurrence point is a point where a slight contact between the vehicle and an object around the vehicle is likely to occur. Includes an analysis step for analyzing the above, and a notification control step for notifying the recording control device of the point information of the contact frequent occurrence point analyzed by the analysis step.

According to the present invention, it is possible to appropriately notify the driver of the vehicle of a point at which a slight contact between the vehicle and a surrounding object is likely to occur.

FIG. 1 is a block diagram showing a configuration example of the driving support system according to the first embodiment. FIG. 2 is a block diagram showing a configuration example of the route guidance device according to the first embodiment. FIG. 3 is a block diagram showing a configuration example of the recording device according to the first embodiment. FIG. 4 is a diagram illustrating an example of a bird's-eye view image. FIG. 5 is a flowchart showing a processing flow in the server device according to the first embodiment. FIG. 6 is a flowchart showing a processing flow in the recording device according to the first embodiment. FIG. 7 is a diagram illustrating a state in which the bottom of the vehicle is rubbed.

Hereinafter, embodiments of an analysis control device, a recording control device, a driving support system, and an analysis control method according to the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the following embodiments.

[First Embodiment]
<Driving support system>
FIG. 1 is a block diagram showing a configuration example of the driving support system 1 according to the first embodiment. The driving support system 1 is a server device (hereinafter referred to as a “contact frequent occurrence point”) that analyzes a point (hereinafter, referred to as a “contact frequent occurrence point”) in which a slight contact between the vehicle and a surrounding object is likely to occur between the in-vehicle device 10 mounted on a plurality of vehicles. It has an analyzer) 80. The driving support system 1 transmits a bird's-eye view image 100 (see FIG. 4) around the vehicle from the in-vehicle device 10 to acquire image data. The driving support system 1 analyzes the contact frequent occurrence points based on the acquired video data.

A slight contact is a contact with an impact smaller than the impact of detecting an accident in a so-called drive recorder. A slight contact is a contact that does not cause a visible dent in the vehicle. The slight contact is such that a vehicle driving slowly rubs a stationary object such as a wall or a branch of a tree, and the vehicle is scratched.

<In-vehicle device>
The in-vehicle device 10 is mounted on each of a plurality of vehicles. The in-vehicle device 10 includes a route guidance device 20 and a recording device 40. The route guidance device 20 and the recording device 40, which are the in-vehicle devices 10, are not limited to those mounted on the vehicle, and may be implemented as functions of a portable electronic device that is brought into the vehicle and used, for example.

<Route guidance device>
FIG. 2 is a block diagram showing a configuration example of the route guidance device 20 according to the first embodiment. The route guidance device 20 is a so-called navigation system. The route guidance device 20 includes a map information storage unit 21, a GPS (Global Positioning System) reception unit 22, a communication unit 23, and a route guidance control device 30.

The map information storage unit 21 stores the map information used by the route guidance unit 31 and the point information indicating the frequent contact points. The map information storage unit 21 updates the map information with the point information acquired from the server device 80 under the control of the update control unit 34. The map information storage unit 21 is, for example, a semiconductor memory element such as a flash memory, a hard disk, an optical disk, or the like. The map information storage unit 21 may be an external storage unit that is wirelessly connected via the communication unit 23.

The point information may be position information indicating a point of a contact frequent occurrence point or position information indicating a predetermined range around a contact frequent occurrence point. In the present embodiment, the map information is position information indicating a predetermined range around a contact frequent occurrence point.

The GPS receiving unit 22 receives radio waves from GPS satellites (not shown). The GPS receiving unit 22 outputs the signal of the received radio wave to the position information acquisition unit 32 of the route guidance control device 30.

The communication unit 23 is a communication unit. The communication unit 23 connects to the server device 80 so as to be able to transmit and receive.

The route guidance control device 30 is, for example, an arithmetic processing unit (control device) composed of a CPU (Central Processing Unit) or the like. The route guidance control device 30 loads a program stored in a storage unit (not shown) into the memory and executes an instruction included in the program. The route guidance control device 30 includes a route guidance unit 31, a position information acquisition unit 32, a point information acquisition unit 33, an update control unit 34, and a communication control unit 35. The route guidance control device 30 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the route guidance control device 30 and the like.

The route guidance unit 31 uses the map information to provide route guidance from the current position of the vehicle to the destination set by the user. The route guidance unit 31 searches for a route based on the position information of the current position of the vehicle and the position information of the destination. As a method for searching a route, a known route search method can be used and is not limited. The route guidance unit 31 provides route guidance along the searched route. As a method of guiding a route, a known route guiding method can be used and is not limited.

The position information acquisition unit 32 calculates the position information of the current position of the vehicle by a known method based on the radio waves received by the GPS reception unit 22.

The point information acquisition unit 33 acquires the point information included in the map information stored in the map information storage unit 21 from the server device 80. The point information acquisition unit 33 may acquire point information from the server device 80 at predetermined intervals. Alternatively, the point information acquisition unit 33 may acquire the point information when the point information is transmitted from the server device 80.

The update control unit 34 controls the point information acquisition unit 33 to update the map information stored in the map information storage unit 21 with the point information acquired from the server device 80.

The communication control unit 35 controls communication via the communication unit 23. The communication control unit 35 communicates with the server device 80 via the communication unit 23.

<Recording device>
FIG. 3 is a block diagram showing a configuration example of the recording device 40 according to the first embodiment. The recording device 40 is a so-called drive recorder. The recording device 40 may be a portable device that can be used in the vehicle, in addition to the device mounted on the vehicle. The recording device 40 includes a camera unit (shooting unit) 41, a recording unit 42, an operation unit 43, a display unit 44, an acceleration sensor 45, a GPS receiving unit 46, a communication unit 47, and a recording control device 50. Has.

The camera unit 41 has a plurality of cameras that photograph the periphery of the vehicle. The camera unit 41 has a plurality of cameras and is a so-called bird's-eye view image camera. In the present embodiment, the camera unit 41 includes a front image camera 411, a rear image camera 412, a left side image camera 413, and a right side image camera 414. In the following description, when it is not necessary to distinguish between the front image camera 411, the rear image camera 412, the left side image camera 413, and the right side image camera 414, the camera unit 41 will be described.

The front image camera 411 is arranged in front of the vehicle and photographs the surroundings centered on the front of the vehicle. The front video camera 411 outputs the captured video data to the video data acquisition unit 51 of the recording control device 50.

The rear image camera 412 is arranged at the rear of the vehicle and photographs the surroundings centered on the rear of the vehicle. The rear video camera 412 outputs the captured video data to the video data acquisition unit 51 of the recording control device 50.

The left-side video camera 413 is arranged on the left side of the vehicle and photographs the surroundings centered on the left side of the vehicle. The left-side video camera 413 outputs the captured video data to the video data acquisition unit 51 of the recording control device 50.

The right-side video camera 414 is arranged on the right side of the vehicle and photographs the surroundings centered on the right side of the vehicle. The right-side video camera 414 outputs the captured video data to the video data acquisition unit 51 of the recording control device 50.

The front image camera 411, the rear image camera 412, the left side image camera 413, and the right side image camera 414 capture all directions of the vehicle.

The recording unit 42 is used for temporary storage and storage of data in the recording device 40. The recording unit 42 is, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a recording unit such as a memory card. Alternatively, it may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 42 records loop recording video data or event recording data based on the control signal output from the recording control unit 54 of the recording control device 50.

The operation unit 43 can accept various operations on the recording device 40. For example, the operation unit 43 can accept an operation of manually saving the captured video data in the recording unit 42 as event recording data. For example, the operation unit 43 can accept an operation of reproducing the loop recorded video data or the event recording data recorded in the recording unit 42. For example, the operation unit 43 can accept an operation of erasing the event record data recorded in the recording unit 42. For example, the operation unit 43 can accept an operation to end the loop recording. The operation unit 43 outputs the operation information to the operation control unit 56 of the recording control device 50.

As an example, the display unit 44 is a display device unique to the recording device 40, a display device shared with other systems including a navigation system, and the like. The display unit 44 may be integrally formed with the camera unit 41. The display unit 44 is a display including, for example, a liquid crystal display (LCD: Liquid Crystal Display) or an organic EL (Electro-luminescence) display. In the present embodiment, the display unit 44 is arranged on a dashboard, an instrument panel, a center console, or the like in front of the driver of the vehicle. The display unit 44 displays an image based on the image signal output from the display control unit 57 of the recording control device 50. The display unit 44 displays the image captured by the camera unit 41, the image recorded on the recording unit 42, or the bird's-eye view image 100 generated by the bird's-eye view image generation unit 63.

The acceleration sensor 45 is a sensor that detects the acceleration generated on the vehicle. The acceleration sensor 45 outputs the detection result to the acceleration information acquisition unit 58 of the recording control device 50. The acceleration sensor 45 is, for example, a sensor that detects acceleration in three axial directions. The three-axis directions are the front-rear direction, the left-right direction, and the up-down direction of the vehicle.

The GPS receiving unit 46 receives radio waves from GPS satellites (not shown). The GPS receiving unit 46 outputs the signal of the received radio wave to the position information acquisition unit 59 of the recording control device 50.

The communication unit 47 is a communication unit. The communication unit 47 connects to the server device 80 so as to be able to transmit and receive data.

The recording control device 50 is, for example, an arithmetic processing device (control device) composed of a CPU or the like. The recording control device 50 loads a program stored in a storage unit (not shown) into the memory and executes an instruction included in the program. The recording control device 50 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the recording control device 50 and the like. The recording control device 50 includes a video data acquisition unit 51, a buffer memory 52, a video data processing unit 53, a recording control unit 54, a playback control unit 55, an operation control unit 56, and the like, which are connected to the bus 50X. Display control unit 57, acceleration information acquisition unit 58, position information acquisition unit 59, point information acquisition unit 60, threshold value setting unit 61, event detection unit 62, bird's-eye view image generation unit 63, and transmission control unit 64. And have.

The video data acquisition unit 51 acquires video data taken by the camera unit 41 that shoots the periphery of the vehicle and outputs the video data to the buffer memory 52.

The buffer memory 52 is an internal memory included in the recording control device 50, and is a memory for temporarily recording the video data for a certain period of time acquired by the video data acquisition unit 51 while updating it.

The video data processing unit 53 stores the video data temporarily stored in the buffer memory 52, for example, by H.I. Convert to any file format encoded by any codec such as 264 or MPEG-4 (Moving Picture Experts Group), for example MP4 format. The video data processing unit 53 generates video data as a file for a certain period of time from the video data temporarily stored in the buffer memory 52. As a specific example, the video data processing unit 53 generates video data temporarily stored in the buffer memory 52 as a file for 60 seconds in the recording order. The video data processing unit 53 outputs the generated video data to the recording control unit 54. Further, the video data processing unit 53 outputs the generated video data to the display control unit 57. The period of the video data generated as a file is set to 60 seconds as an example, but the period is not limited to this.

The recording control unit 54 controls the recording unit 42 to record the video data filed by the video data processing unit 53. During the period when the loop recording process is executed, such as when the accessory power supply of the vehicle is turned on, the recording control unit 54 uses the video data filed by the video data processing unit 53 as overwriteable video data in the recording unit 42. Record in. More specifically, when the recording control unit 54 continues to record the video data generated by the video data processing unit 53 in the recording unit 42 during the period of executing the loop recording processing, and the capacity of the recording unit 42 becomes full, The oldest video data is overwritten with the new video data and recorded.

Further, when the event detection unit 62 detects an event, the recording control unit 54 saves the video data corresponding to the event detection as the event recording data.

The reproduction control unit 55 controls to reproduce the loop recorded video data or the event recording data recorded in the recording unit 42 based on the control signal of the reproduction operation output from the operation control unit 56.

The operation control unit 56 acquires the operation information of the operation received by the operation unit 43. For example, the operation control unit 56 acquires the save operation information indicating the manual save operation of the video data, the reproduction operation information indicating the reproduction operation, or the erase operation information indicating the erase operation of the video data, and outputs the control signal. For example, the operation control unit 56 acquires end operation information indicating an operation for ending loop recording and outputs a control signal.

The display control unit 57 controls the display of video data on the display unit 44. The display control unit 57 outputs a video signal for outputting the video data to the display unit 44. More specifically, the display control unit 57 outputs a video signal captured by the camera unit 41 or a video signal to be displayed by reproducing the loop recorded video data or the event recorded data recorded in the recording unit 42.

The acceleration information acquisition unit 58 acquires acceleration information indicating the acceleration applied to the vehicle from the detection result of the acceleration sensor 45.

The position information acquisition unit 59 calculates the current position information of the vehicle by a known method based on the radio waves received by the GPS reception unit 46.

The point information acquisition unit 60 acquires the point information of the contact frequent occurrence point from the server device 80. In the present embodiment, the point information acquisition unit 60 acquires the point information of the contact-prone points included in the map information stored in the map information storage unit 21 via the route guidance device 20.

The threshold value setting unit 61 changes the acceleration threshold value for detecting an event based on the point information of the contact frequent occurrence point acquired by the point information acquisition unit 60. More specifically, in the threshold value setting unit 61, the current position of the vehicle is around the point information based on the position information of the vehicle acquired by the position information acquisition unit 59 and the point information acquired by the point information acquisition unit 60. If so, change the acceleration threshold for detecting the event. When the current position of the vehicle is around the point information, the threshold value setting unit 61 changes the threshold value to be smaller than the normal first threshold value and sets the threshold value to the second threshold value. For example, when the normal threshold (first threshold) is 1.5G, the second threshold is 0.6G. The threshold value setting unit 61 sets the threshold value as the first threshold value when the current position of the vehicle is not around the point information.

The current position of the vehicle is around the point information when the current position of the vehicle matches the point information, the current position of the vehicle is included in the range of the point information, or the current position of the vehicle is from the point information. This is a case where it is included within a predetermined range.

The event detection unit 62 detects that an event has occurred when the acceleration acquired by the acceleration information acquisition unit 58 is equal to or greater than the threshold value set by the threshold value setting unit 61. More specifically, the event detection unit 62 detects an acceleration equal to or greater than a threshold value in the acceleration detected by the acceleration sensor 45 as an event.

When the event detection unit 62 detects the occurrence of an event, the bird's-eye view image generation unit 63 performs viewpoint conversion processing and composition processing on the peripheral image data corresponding to the event detection, and displays the bird's-eye view image in a predetermined display range from the vehicle. Generate 100. The bird's-eye view image generation unit 63 outputs the generated bird's-eye view image 100 to the transmission control unit 64 and the display control unit 57. The bird's-eye view image generation unit 63 includes a viewpoint conversion processing unit 631, a cutting processing unit 632, and a composition processing unit 633.

The viewpoint conversion processing unit 631 performs viewpoint conversion processing on the peripheral video data acquired by the video data acquisition unit 51 so as to look down from above the vehicle. More specifically, the viewpoint conversion processing unit 631 generates an image that has undergone the viewpoint conversion processing based on the peripheral image data captured by the camera unit 41. The method of the viewpoint conversion process may be any known method and is not limited. The viewpoint conversion processing unit 631 outputs the peripheral video data that has undergone the viewpoint conversion processing to the cutout processing unit 632.

The cutout processing unit 632 performs a cutout process for cutting out a predetermined range of video from the peripheral video data that has undergone the viewpoint conversion process. Which range is to be the cutout range is registered and stored in advance. The cutout processing unit 632 outputs the video data of the cutout processed video to the synthesis processing unit 633.

The compositing processing unit 633 performs a compositing process for synthesizing the cutout processed video data. The composition processing unit 633 generates a bird's-eye view image 100 in which the vehicle icon 110 is displayed on the combined image.

Further, the synthesis processing unit 633 may superimpose and synthesize the traveling route that rubbed the vehicle body and the predicted traveling route of the vehicle at the same contact frequent occurrence point in the past at the contact frequent occurrence point on the bird's-eye view image 100. The traveling route that rubs the vehicle body is transmitted from the server device 80 to the route guidance device 20 together with the point information. The predicted traveling route of the vehicle is predicted from the traveling information indicating the traveling state such as the steering angle of the vehicle.

The bird's-eye view image 100 will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of the bird's-eye view image 100. The bird's-eye view image 100 displays a range of about 2 m from the vehicle. The bird's-eye view image 100 is located in the central portion surrounded by the front image 101, the rear image 102, the left image 103, the right image 104, the front image 101, the rear image 102, the left image 103, and the right image 104. Includes the vehicle icon 110 to be used. The vehicle icon 110 indicates the position and orientation of the vehicle. The vehicle icon 110 is arranged in the central portion so that the front-rear direction is parallel to the front-rear direction of the bird's-eye view image 100.

The transmission control unit 64 transmits the video data of the bird's-eye view image 100 generated by the bird's-eye view image generation unit 63 and the position information of the shooting position of the bird's-eye view image 100 to the server device 80 via the communication unit 47.

<Server device>
Returning to FIG. 1, the server device 80 analyzes the contact frequent occurrence points based on the video data of the bird's-eye view video 100 acquired from the vehicle-mounted devices 10 mounted on the plurality of vehicles. The server device 80 includes a communication unit 81, an analysis data storage unit 82, a point information storage unit 83, and an analysis control device 90.

The communication unit 81 is a communication unit. The communication unit 81 connects to the in-vehicle devices 10 mounted on a plurality of vehicles so as to be able to transmit and receive data.

The analysis data storage unit 82 stores the video data of the bird's-eye view video 100 acquired from the recording device 40 by the analysis data acquisition unit 92 and the analysis data including the position information in association with each other. The analysis data storage unit 82 may be an external storage unit that is wirelessly connected via the communication unit 81.

The point information storage unit 83 stores the point information of the contact frequent occurrence points analyzed by the analysis unit 93. The point information storage unit 83 is, for example, a hard disk, an optical disk, or the like. The point information storage unit 83 may be an external storage unit that is wirelessly connected via the communication unit 81.

The analysis control device 90 is, for example, an arithmetic processing device (control device) composed of a CPU or the like. The analysis control device 90 loads a program stored in a storage unit (not shown) into the memory and executes an instruction included in the program. The analysis control device 90 includes a notification control unit 91, an analysis data acquisition unit 92, an analysis unit 93, and a notification control unit 94. The analysis control device 90 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the analysis control device 90.

The notification control unit 91 controls communication via the communication unit 81. The notification control unit 91 communicates with the in-vehicle device 10 mounted on a plurality of vehicles via the communication unit 81.

The analysis data acquisition unit 92 acquires the video data and the position information of the bird's-eye view video 100 around the vehicle from the recording devices 40 mounted on the plurality of vehicles as analysis data. More specifically, the analysis data acquisition unit 92 acquires the video data and the position information of the bird's-eye view video 100 from the recording devices 40 mounted on the plurality of vehicles. The analysis data acquisition unit 92 stores the acquired video data and position information of the bird's-eye view image 100 in the analysis data storage unit 82.

Based on the analysis data acquired by the analysis data acquisition unit 92, the analysis unit 93 analyzes points where minor contacts are likely to occur, in other words, points where minor contacts occur frequently. More specifically, the analysis unit 93 performs image processing on the video data of the bird's-eye view video 100 stored in the analysis data storage unit 82 to analyze the contact frequent occurrence points. The analysis unit 93 performs image processing on the video data of the bird's-eye view video 100 to determine whether or not the vehicle and surrounding objects have come into contact with each other. Since the determination is made based on the bird's-eye view image 100, it is easy to recognize the relative positional relationship between the vehicle and surrounding objects. As a result, in addition to whether or not the vehicle and the peripheral object are in contact with each other, the degree of contact and the contact point of the contacted vehicle are recognized with high accuracy.

For example, when the bird's-eye view image 100 shown in FIG. 4 is image-processed, it is recognized that the right side portion of the vehicle is in contact with the wall at the corner P. Further, it is recognized that the right side portion of the vehicle and the wall are only in contact with each other, and the vehicle is not in a state of biting into or deforming the wall. As a result, it is recognized that the contact is so slight that the vehicle is scratched.

When the analysis unit 93 indicates that a predetermined number of contacts have occurred at the same position or within a predetermined range in a predetermined period, that point is set as a contact frequent occurrence point. The analysis unit 93 stores the analyzed point information of the contact frequent occurrence point in the point information storage unit 83.

The analysis unit 93 may analyze the contact frequent occurrence points for each vehicle type, each vehicle shape, each time zone, each day of the week, and the like.

The notification control unit 94 notifies the in-vehicle device 10 of the point information of the contact frequent occurrence point analyzed by the analysis unit 93. More specifically, the notification control unit 94 controls to transmit the point information stored in the point information storage unit 83, which indicates the difference between the point information before and after the update, to the route guidance device 20. The notification control unit 94 may transmit the point information to all the route guidance devices 20 every time the point information stored in the point information storage unit 83 is updated. Alternatively, the notification control unit 94 may transmit the point information to all the route guidance devices 20 at predetermined periods such as every day at predetermined times. When the route guidance device 20 requests the transmission of the point information, the notification control unit 94 may transmit the point information to the route guidance device 20.

<Information processing in the server device>
Next, the flow of processing in the server device 80 will be described with reference to FIG. FIG. 5 is a flowchart showing a processing flow in the server device 80 according to the first embodiment.

The analysis control device 90 acquires analysis data including image data and position information of the bird's-eye view image 100 from recording devices 40 mounted on a plurality of vehicles by the analysis data acquisition unit 92 (step S101). The acquired analysis data is stored in the analysis data storage unit 82.

The analysis control device 90 analyzes the contact frequent occurrence points by the analysis unit 93 (step S102). More specifically, the analysis unit 93 acquires the analysis data acquisition unit 92 and stores it in the analysis data storage unit 82. Analyze the point. When the analysis unit 93 indicates that a predetermined number of contacts have occurred at the same position or within a predetermined range in a predetermined period, that point is set as a contact frequent occurrence point. The analysis control device 90 proceeds to step S103.

The analysis control device 90 stores the point information of the contact frequent occurrence points analyzed by the analysis unit 93 in the point information storage unit 83 (step S103). The analysis control device 90 ends the process.

When these processes are completed, the notification control unit 94 transmits the point information indicating the difference between the point information before and after the update stored in the point information storage unit 83 to the route guidance device 20.

<Information processing in the recording device>
Next, the flow of processing in the recording device 40 will be described with reference to FIG. FIG. 6 is a flowchart showing a processing flow in the recording device 40 according to the first embodiment.

The recording control device 50 starts event detection and loop recording (step S111). More specifically, the event detection unit 62 starts event detection based on the detection result of the acceleration sensor 45. The video data processing unit 53 generates loop recorded video data for each video for a predetermined period from the video data recorded in the buffer memory 52. The recording control unit 54 causes the recording unit 42 to record the loop recording video data. The recording control device 50 proceeds to step S112.

The recording control device 50 determines whether or not the current position of the vehicle is a contact frequent occurrence point (step S112). More specifically, the recording control device 50 determines the current position of the vehicle depending on whether or not the position information of the current position of the vehicle acquired by the position information acquisition unit 59 is around the point information acquired by the point information acquisition unit 60. Determines whether or not is a contact frequent occurrence point. When the position information of the current position of the vehicle is around the point information, it is determined that the contact frequently occurs point (Yes in step S112), and the process proceeds to step S116. If the position information of the current position of the vehicle is not around the point information, it is determined that the point is not a contact frequent occurrence point (No in step S112), and the process proceeds to step S113.

When it is determined that it is not a contact frequent occurrence point (No in step S112), the threshold value setting unit 61 sets the threshold value for event detection to the first threshold value (step S113). The recording control device 50 proceeds to step S114.

The recording control device 50 determines whether or not an event has been detected by the event detection unit 62 (step S114). In step S114, an accident or the like is detected as an event at the first threshold value, which is a normal threshold value. If an event is detected by the event detection unit 62 (Yes in step S114), the process proceeds to step S115. If no event is detected by the event detection unit 62 (No in step S114), the process proceeds to step S121.

When an event is detected (Yes in step S114), the recording control device 50 saves the event recording data which is the video data before and after the event detection (step S115). More specifically, the video data processing unit 53 generates video data including at least the time when an event occurs as event recording data from the loop recorded video data recorded in the recording unit 42. The recording control unit 54 saves the event recording data in the recording unit 42. The recording control device 50 proceeds to step S121.

When it is determined that the contact frequently occurs point (Yes in step S112), the threshold value setting unit 61 sets the threshold value for event detection to a second threshold value smaller than the first threshold value (step S116). The recording control device 50 proceeds to step S117.

When it is determined that the contact frequently occurs point (Yes in step S112), the recording control device 50 causes a warning output control unit (not shown) to output a warning voice warning that the contact frequently occurs point from a speaker (not shown). May be good. Further, a sensor (not shown) may be used to measure the distance between the vehicle and a surrounding object, and output a warning voice when the distance becomes equal to or less than a threshold value.

The recording control device 50 determines whether or not an event has been detected by the event detection unit 62 (step S117). In step S117, a second threshold value smaller than the normal threshold value is detected as an event, such as a slight contact between the vehicle and a surrounding object, which is not detected as an accident. More specifically, when an event is detected by the event detection unit 62 (Yes in step S117), the process proceeds to step S118. If no event is detected by the event detection unit 62 (No in step S117), the process proceeds to step S121.

When an event is detected (Yes in step S117), the event recording data and the position information, which are video data before and after the event detection, are saved (step S118). More specifically, the video data processing unit 53 generates video data including at least the time when an event occurs as event recording data from the loop recorded video data recorded in the recording unit 42. The recording control unit 54 saves the event recording data in the recording unit 42. The recording control unit 54 saves the position information together with the event recording data. The recording control device 50 proceeds to step S119.

The recording control device 50 generates the bird's-eye view image 100 corresponding to the event recording data by the bird's-eye view image generation unit 63 (step S119). The recording control device 50 proceeds to step S120.

The bird's-eye view image 100 generated by the bird's-eye view image generation unit 63 may be displayed on the display unit 44 by the display control unit 57. In the bird's-eye view image 100, a traveling route that rubs the vehicle body and a predicted traveling route of the vehicle may be combined.

The recording control device 50 transmits the bird's-eye view image 100 generated by the transmission control unit 64 to the server device 80 together with the position information of the vehicle (step S120). The recording control device 50 proceeds to step S121.

The recording control device 50 determines whether or not to end the event detection and loop recording (step S121). More specifically, it is determined by the operation control unit 56 that the event detection and the loop recording are finished under any conditions such as when the end operation information is output or the operation of the vehicle is finished (Yes in step S121). , End the process. If the operation control unit 56 does not output the end operation information, it is determined that the event detection and the loop recording are not ended (No in step S121), and the process of step S112 is executed again.

In this way, the server device 80 analyzes the contact frequent occurrence points based on the video data of the bird's-eye view video 100 acquired from the vehicle-mounted devices 10 mounted on the plurality of vehicles. The server device 80 transmits the point information indicating the frequent contact points to the route guidance device 20 of the in-vehicle device 10. When the current position of the vehicle is a contact frequent occurrence point, the recording device 40 of the in-vehicle device 10 sets the threshold value for event detection to the second threshold value so that a slight contact can be detected as an event.

As described above, according to the present embodiment, it is possible to analyze the contact frequent occurrence points based on the video data of the bird's-eye view video 100 acquired from the vehicle-mounted devices 10 mounted on the plurality of vehicles. In the present embodiment, since the bird's-eye view image 100 is image-recognized, the relative positional relationship between the vehicle and surrounding objects can be recognized with high accuracy. In the present embodiment, it is possible to notify the in-vehicle device 10 of the point information of the contact frequent occurrence point obtained by analyzing the contact frequent occurrence point with high accuracy. In the present embodiment, when the current position of the vehicle is a contact frequent occurrence point, the driver of the vehicle can be warned. As described above, in the present embodiment, it is possible to appropriately notify the driver of the vehicle of a point at which a slight contact between the vehicle and a surrounding object is likely to occur.

Moreover, in the present embodiment, when the current position of the vehicle is a contact frequent occurrence point, the threshold value for event detection is set to the second threshold value, and a slight contact between the vehicle and a surrounding object is detected as an event. Can be done.

In the present embodiment, when an event is detected at the second threshold value at the contact frequent occurrence point, the bird's-eye view image 100 corresponding to the event record data can be generated and transmitted to the server device 80. According to the present embodiment, it is possible to share information such as a slight contact between the vehicle and a surrounding object.

In the present embodiment, it is possible to display the bird's-eye view image 100 in which the traveling route rubbing the vehicle body and the predicted traveling route of the vehicle are combined at the contact frequent occurrence point. According to the present embodiment, since the driver of the vehicle can recognize an appropriate traveling route, it is possible to suppress the occurrence of slight contact between the vehicle and surrounding objects.

In the present embodiment, the route can be searched and guided so as not to pass through the contact frequent occurrence point. According to this embodiment, it is possible to suppress the occurrence of slight contact between the vehicle and surrounding objects.

[Second Embodiment]
The driving support system 1 according to the present embodiment will be described with reference to FIG. 7. FIG. 7 is a diagram illustrating a state in which the bottom of the vehicle is rubbed. In this embodiment, a point where the bottom of the vehicle is easily rubbed is analyzed. The basic configuration of the driving support system 1 is the same as that of the driving support system 1 of the first embodiment. In the following description, the same components as those of the driving support system 1 are designated by the same reference numerals or corresponding reference numerals, and detailed description thereof will be omitted.

The transmission control unit 64 of the recording control device 50 of the recording device 40 sends the server device 80 the video data of the bird's-eye view image 100 around the vehicle and the position information of the shooting position where the bird's-eye view image 100 was shot, before the viewpoint conversion. Send video data.

The analysis data storage unit 82 of the server device 80 associates the video data of the bird's-eye view video 100 around the vehicle acquired by the analysis data acquisition unit 92 from the recording device 40 with the position information and the video data before the viewpoint conversion. Store as analysis data.

The analysis data acquisition unit 92 acquires the video data of the bird's-eye view video 100 around the vehicle, the position information, and the video data before the viewpoint conversion as analysis data from the recording devices 40 mounted on the plurality of vehicles. The analysis data acquisition unit 92 stores the acquired video data of the bird's-eye view video 100, the position information, and the video data before the viewpoint conversion in the analysis data storage unit 82 as analysis data. The analysis data may include audio data of audio when rubbed, in addition to video data.

The analysis unit 93 processes the image data of the bird's-eye view image 100 and the image data before the viewpoint conversion, and analyzes a point where a slight contact between the bottom of the vehicle and an object on the road surface is likely to occur as a contact frequent occurrence point. do. The analysis unit 93 performs image processing on the video data of the bird's-eye view video 100 and the video data before the viewpoint conversion, and analyzes whether or not the bottom of the vehicle and an object on the road surface are in contact with each other. By image processing the video data before viewpoint conversion, the height of objects on the road surface around the vehicle, such as the snow remaining between the ruts of the snowy road or the steps at the entrance and exit of the parking lot, can be determined. recognize. When the height of the object on the road surface around the vehicle is higher than the height of the bottom of the vehicle from the road surface, the analysis unit 93 determines that the bottom of the vehicle and the object are in contact with each other.

As described above, according to the present embodiment, the bottom of the vehicle and the road surface are based on the image data of the bird's-eye view image 100 and the image data before the viewpoint conversion acquired from the in-vehicle devices 10 mounted on the plurality of vehicles. It is possible to analyze the frequent occurrence points of contact with an object. According to the present embodiment, for example, the height of an object on the road surface around the vehicle, such as the snow remaining between the ruts of a snowy road or the step at the entrance / exit of a parking lot, is recognized with high accuracy. Can be done.

Although the driving support system 1 according to the present invention has been described so far, it may be implemented in various different forms other than the above-described embodiment.

Each component of the illustrated driving support system 1 is a functional concept and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of each device is not limited to the one shown in the figure, and all or part of each device is functionally or physically dispersed or integrated in an arbitrary unit according to the processing load and usage status of each device. You may.

The configuration of the driving support system 1 is realized, for example, by a program loaded in a memory as software. In the above embodiment, it has been described as a functional block realized by cooperation of these hardware or software. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

The above-mentioned components include those that can be easily assumed by those skilled in the art and those that are substantially the same. Further, the above configurations can be combined as appropriate. Further, various omissions, substitutions or changes of the configuration can be made without departing from the gist of the present invention.

1 Driving support system 10 In-vehicle device 20 Route guidance device 21 Map information storage unit 30 Route guidance control device 31 Route guidance unit 33 Point information acquisition unit 34 Update control unit 40 Recording device 41 Camera unit 50 Recording control device 51 Video data acquisition unit 54 Recording control unit 60 Point information acquisition unit 61 Threshold setting unit 62 Event detection unit 63 Bird's-eye view image generation unit 64 Transmission control unit 80 Server device (analysis device)
90 Analysis control device 92 Analysis data acquisition unit 93 Analysis unit 94 Notification control unit 100 Bird's-eye view video

Claims (6)

An analysis data acquisition unit that acquires the image data of the bird's-eye view image around the vehicle and the position information of the position where the bird's-eye view image was taken from the recording control devices mounted on a plurality of vehicles as analysis data.
Based on the analysis data acquired by the analysis data acquisition unit, an analysis unit that analyzes a contact frequent occurrence point, which is a point where a slight contact between the vehicle and an object around the vehicle is likely to occur, and an analysis unit.
A notification control unit that notifies the recording control device of the point information of the contact frequent occurrence point analyzed by the analysis unit, and
An analysis control device comprising. The analysis data acquisition unit further acquires the video data before the viewpoint conversion as the analysis data.
Based on the analysis data acquired by the analysis data acquisition unit, the analysis unit analyzes a point where a slight contact between the bottom of the vehicle and an object on the road surface of the vehicle is likely to occur.
The analysis control device according to claim 1. The video data acquisition unit that acquires the video data taken by the shooting unit that shoots the surroundings of the vehicle,
An acceleration information acquisition unit that acquires acceleration information indicating the acceleration applied to the vehicle, and
A point information acquisition unit that acquires point information of the point from an analysis device that analyzes a point where a slight contact between the vehicle and an object around the vehicle is likely to occur.
A threshold setting unit that changes the acceleration threshold for detecting an event based on the point information acquired by the point information acquisition unit and the position information of the current position of the vehicle.
An event detection unit that detects that an event has occurred when the acceleration information acquired by the acceleration information acquisition unit is equal to or greater than the threshold value set by the threshold value setting unit.
When the event detection unit detects the occurrence of an event, the recording control unit that saves the video data corresponding to the event detection and
When the event detection unit detects the occurrence of an event, the bird's-eye view image generation unit that generates a bird's-eye view image of the surroundings of the vehicle from the video data corresponding to the event detection.
A transmission control unit that transmits the video data of the bird's-eye view video generated by the bird's-eye view video generation unit to the analysis device via the communication unit.
A recording control device comprising. When the current position of the vehicle is around the point information, the threshold value setting unit changes the threshold value to a second threshold value smaller than the normal first threshold value.
The recording control device according to claim 3. The analysis control device according to claim 1 or 2,
The recording control device according to claim 3 or 4,
Driving support system equipped with. An analysis data acquisition step of acquiring the image data of the bird's-eye view image around the vehicle and the position information of the position where the bird's-eye view image was taken from the recording control devices mounted on a plurality of vehicles as analysis data.
Based on the analysis data acquired by the analysis data acquisition step, an analysis step of analyzing a contact frequent occurrence point, which is a point where a slight contact between the vehicle and an object around the vehicle is likely to occur, and an analysis step.
A notification control step for notifying the recording control device of the point information of the contact frequent occurrence point analyzed by the analysis step, and
Analysis control method including.

Images