WO2021153251A1

WO2021153251A1 - Information processing device, information processing method, and information processing program

Info

Publication number: WO2021153251A1
Application number: PCT/JP2021/001024
Authority: WO
Inventors: 友野　瑞基; 直喜光永; 仁太小林
Original assignee: パイオニア株式会社
Priority date: 2020-01-28
Filing date: 2021-01-14
Publication date: 2021-08-05
Also published as: JPWO2021153251A1; JP2023174687A; JP7356520B2

Abstract

Provided is an information processing device or the like capable of reliably starting, without any operation by the driver, the recording of an image or the like obtained by image-capturing another vehicle that is driven dangerously.　An in-vehicle device T extracts vehicle identification information on another vehicle moving around the vehicle, from the surrounding image obtained by image-capturing the surroundings of the vehicle, and when vehicle identification information on a specific vehicle specified in the past as having been dangerously driven, and the extracted vehicle identification information match, the in-vehicle device T starts the storage of the surrounding image obtained by image-capturing the other vehicle from which the matched vehicle identification information is extracted.

Description

Information processing equipment, information processing methods and information processing programs

This application belongs to the technical fields of information processing devices, information processing methods, and information processing programs. More specifically, it belongs to the technical fields of an information processing device and an information processing method that perform information processing on a surrounding image obtained by capturing the surroundings of a moving body, and an information processing program executed by the information processing device.

In recent years, annoying driving such as so-called tilting driving or dangerous driving is often talked about. In the following description, the above dangerous driving or annoying driving is collectively referred to as "dangerous driving". Here, when a situation is encountered in which dangerous driving performed by another vehicle affects the driving of the own vehicle, for example, a so-called drive recorder or the like is used to record an image or the like showing the situation of the other vehicle. It is desirable to keep it. The following Patent Document 1 is mentioned as a prior art document that discloses the prior art related to the recording of such an image or the like.

In the prior art described in Patent Document 1, the own vehicle is provided with a camera to take an image of the surroundings, and when another vehicle drives dangerously in the vicinity of the own vehicle, an image of the situation is captured. It is configured to be saved as one data together with its position, date and time, vehicle registration number of the other vehicle, etc., and transmitted to an external server.

Japanese Unexamined Patent Publication No. 2002-342883

However, when the own vehicle encounters a dangerous situation as described above, in the prior art disclosed in Patent Document 1, the driver himself operates a button installed in the vehicle to start imaging by the camera. It is supposed to be. In such a configuration, the image is not taken unless the driver operates a button (in other words, the corresponding data is not saved), but in the above dangerous situation. , It may be harsh to ask the driver to calmly operate the above buttons.

Therefore, the present application has been made in view of the above problems, and one example of the problem is to reliably start recording images and the like of images of other vehicles that are driving dangerously without any operation by the driver. It is an object of the present invention to provide an information processing apparatus and an information processing method capable of performing information processing, and an information processing program executed in the information processing apparatus.

In order to solve the above problem, the invention according to claim 1 obtains moving body identification information of another moving body moving around the moving body from the surrounding image information corresponding to the surrounding image of the moving body. When the extracted identification information extraction means, the moving body identification information of the specific moving body specified based on the past dangerous driving history, and the extracted moving body identification information match, the matching is made. A recording control means for starting recording of the surrounding image information obtained by imaging the other moving body from which the moving body identification information has been extracted is provided.

In order to solve the above problems, the invention according to claim 9 is an information processing method executed in an information processing apparatus including an extraction means and a recording control means, in which the surroundings of a moving body are imaged. The identification information extraction step of extracting the moving body identification information of another moving body moving around the surrounding image from the surrounding image information corresponding to the surrounding image by the extraction means, and the moving body specified based on the past dangerous driving history. When the moving body identification information of the specific moving body and the extracted moving body identification information match, the other moving body from which the matching moving body identification information is extracted by the recording control means is used. The recording control step of starting the recording of the imaged surrounding image information is included.

In order to solve the above problem, the invention according to claim 10 is to move the computer included in the information processing device from the surrounding image information corresponding to the surrounding image obtained by capturing the surroundings of the moving body. Identification information extracting means for extracting the moving body identification information of the moving body, the moving body identification information of the specific moving body which is the moving body specified based on the past dangerous driving history, and the extracted moving body identification. When the information matches, it functions as a recording control means for starting recording of the surrounding image information obtained by imaging the other moving body from which the matching moving body identification information is extracted.

It is a block diagram which shows the outline structure of the information processing apparatus of embodiment. It is a block diagram which shows the outline structure of the information provision system of an Example. It is a block diagram which shows the outline structure of the in-vehicle device which comprises the information providing system of an Example, (a) is a block diagram which shows the outline structure of the in-vehicle device, and (b) is the information providing system of an Example. It is a block diagram which shows the outline structure of the constituent server apparatus. It is a flowchart which shows the information provision process of an Example.

Next, a mode for carrying out the present application will be described with reference to FIG. Note that FIG. 1 is a block diagram showing an outline configuration of the information processing apparatus of the embodiment.

As shown in FIG. 1, the information processing device T according to the embodiment includes identification information extraction means 11b and recording control means 11a.

In this configuration, the identification information extracting means 11b extracts the moving body identification information of another moving body moving around the moving body from the surrounding image information corresponding to the surrounding image of the moving body.

Then, in the record control means 11a, the moving body identification information of the specific moving body, which is a moving body specified based on the past dangerous driving history, and the moving body identification information extracted by the identification information extracting means 11b match. At that time, the recording of the surrounding image information obtained by imaging the other moving body from which the matching moving body identification information is extracted is started.

As described above, according to the configuration of the information processing device T of the embodiment, when the moving body identification information extracted from the surrounding image information and the moving body identification information of the specific moving body match, the matching is made. Since the recording of the surrounding image information obtained by capturing the image of the other moving body from which the moving body identification information has been extracted is started, the recording of the surrounding image information can be reliably started without any user operation or the like.

Next, specific examples corresponding to the above-described embodiments will be described with reference to FIGS. 2 to 4. The embodiment described below is an information providing system that provides information on a vehicle that performs dangerous driving from a server device connected via a network such as the Internet to an in-vehicle device mounted on each vehicle. This is an example when the present application is applied to the above.

Further, FIG. 2 is a block diagram showing an outline configuration of the information providing system of the embodiment, FIG. 3 is a block diagram showing an outline configuration of an in-vehicle device or the like constituting the information providing system, and FIG. 4 is a block diagram showing the outline configuration of the information providing system of the embodiment. It is a flowchart which shows the information provision process. At this time, in FIGS. 2 and 3, for each of the constituent members of the embodiment corresponding to each constituent member in the information processing apparatus T of the embodiment shown in FIG. 1, the same member number as each constituent member in the information processing apparatus T. Is used.

As shown in FIG. 2, the information providing system S of the embodiment is, for example, an in-vehicle device T1, an in-vehicle device T2, ... (N is a natural number) and the information providing server SV are connected to each other so that information or data can be exchanged. The vehicle-mounted device T1, the vehicle-mounted device T2, ..., The vehicle-mounted device Tn are specifically realized as, for example, a drive recorder. In the following description, when common matters are explained for the in-vehicle device T1, the in-vehicle device T2, ..., And the in-vehicle device Tn (n is a natural number), these are collectively referred to as "in-vehicle device T". Further, the vehicle on which the in-vehicle device T, which is the subject of the explanation, is mounted is hereinafter referred to as "own vehicle". At this time, the in-vehicle device T corresponds to an example of the information processing device T of the embodiment.

In the above configuration, the information providing server SV has vehicle identification information for identifying a vehicle that has been considered to have been dangerously driven in the past (specifically, the vehicle registration number of the vehicle (the vehicle number written on the so-called license plate). )), The risk score of the example, and the danger flag of the example are associated with each other and recorded non-volatilely as a dangerous driving history. At this time, the risk level score is a score that quantitatively indicates the risk level of the vehicle with respect to dangerous driving. Further, the danger flag is a flag indicating whether or not the vehicle is a vehicle that habitually performs dangerous driving based on the risk score. In the following description, a vehicle that habitually performs dangerous driving is referred to as a "dangerous driving habitual vehicle".

Then, the information providing server SV responds to the inquiry request of the embodiment transmitted from each in-vehicle device T via the network NW, and responds indicating whether or not the other vehicle subject to the inquiry request is a dangerous driving habitual vehicle. Is transmitted to the in-vehicle device T that has transmitted the inquiry request via the network NW. As a result, the in-vehicle device T that has transmitted the inquiry request recognizes whether or not the other vehicle (any of the other vehicles other than the own vehicle) that is the target of the inquiry request is a dangerous driving habitual vehicle. Then, the in-vehicle device T captures image information of the dangerous driving habitual vehicle even when the other vehicle for which the inquiry request is made is a dangerous driving habitual vehicle, for example, even if there is no instruction operation by the driver of the own vehicle or the like. , Record (save) to the SD (Super Density or Secure Digital) card of the example. In the following description, the recording on the SD card of the embodiment is simply referred to as "storing on the SD card".

On the other hand, each in-vehicle device T has evaluation information (evaluation that there was no dangerous driving) indicating the degree of dangerous driving with respect to dangerous driving by a vehicle other than its own vehicle (whether or not it is a dangerous driving habitual vehicle). The dangerous driving vehicle information of the embodiment in which the information is included) and the vehicle identification information of the other vehicle that has performed the dangerous driving is transmitted to the information providing server SV via the network NW. Then, the information providing server SV that has received the dangerous driving vehicle information has the risk score and the danger flag for the vehicle based on the evaluation information and the vehicle identification information included in the received dangerous driving vehicle information. To update. At this time, if the degree of dangerous driving indicated by the above evaluation information is high, the risk score is updated to increase, and if there is no dangerous driving, the risk score is updated to decrease.

Further, in each in-vehicle device T, the image information of the vehicle in which the dangerous driving is performed, which is saved in the SD card due to the occurrence of the dangerous driving, is deleted from the SD card according to the occurrence situation of the dangerous driving.

Next, the configurations and operations of the in-vehicle device T and the information providing server SV constituting the information providing system S of the embodiment will be described more specifically.

First, as shown in FIG. 3A, the vehicle-mounted device T of the embodiment includes an interface 10, a processing unit 11 including a CPU, a RAM (RandomAccessMemory), a ROM (ReadOnlyMemory), and a reader / writer. 12, a memory 13, an operation unit 14 including an operation button or a touch panel, a camera 15 including a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and a GNSS (Global Navigation Satellite System) reception. It is composed of a sensor unit 16 including a machine or an acceleration sensor, and a display 17 including a liquid crystal display or the like. Further, the processing unit 11 is composed of a recording / deletion control unit 11a of the embodiment, an extraction unit 11b of the embodiment, and a determination unit 11c of the embodiment. At this time, the recording / deletion control unit 11a, the extraction unit 11b, and the determination unit 11c may be realized by a hardware logic circuit including the CPU or the like of the processing unit 11, and may provide information of an embodiment described later. It may be realized by software by reading and executing the program corresponding to the processing by the CPU. Further, the extraction unit 11b corresponds to an example of the identification information extraction means 11b of the embodiment and an example of the "feature extraction means" of the present application, respectively, and the recording / deletion control unit 11a corresponds to an example of the recording control means 11a of the embodiment and the present application. Each corresponds to an example of "deletion means" and an example of "deletion control means", and the determination unit 11c corresponds to an example of "determination means" of the present application.

In the above configuration, the interface 10 controls the transfer of data to and from the information providing server SV via the network NW under the control of the processing unit 11. The camera 15 has, for example, the front and rear of the own vehicle as its imaging range, and under the control of the processing unit 11, outputs image information as a result of imaging the imaging range to the processing unit 11. The imaging range of the camera 15 may be, for example, the entire circumference of the own vehicle. The memory 13 temporarily records the image information under the control of the processing unit 11. The sensor unit 16 outputs, for example, position data indicating the position of the own vehicle to the control unit 11 based on the reception result of the navigation radio wave by the GNSS receiver. The operation unit 14 generates an operation signal according to an operation by, for example, the driver of the own vehicle, and outputs the operation signal to the processing unit 11. At this time, the operation unit 14 includes a storage instruction unit used when the driver or the like instructs the SD card CD to store the image information. On the other hand, the recording / deletion control unit 11a of the processing unit 11 controls the storage, reading, and deletion of data on the SD card CD via the reader / writer 12. The extraction unit 11b of the processing unit 11 conventionally obtains the vehicle identification information of another vehicle shown in the image corresponding to the image information output from the camera 15 and the feature amount indicating the characteristics of the other vehicle. Each is extracted by the same method as above. At this time, the feature amount includes, for example, the outer shape and color feature amount of the other vehicle. The determination unit 11c of the processing unit 11 determines whether or not another vehicle is driving dangerously based on the image information and the feature amount of the corresponding image. In addition to these, the processing unit 11 executes other processing desired as the in-vehicle device T by using the operation signal from the operation unit 14 and the position data from the sensor unit 16.

On the other hand, as shown in FIG. 3B, the information providing server SV of the embodiment includes an interface 1, a processing unit 2 including a CPU, RAM, ROM and the like, a display 3 including a liquid crystal display and the like, a keyboard and a mouse. It is composed of an operation unit 4 composed of the above and a recording unit 5 composed of an HDD (Hard Disc Drive) or an SSD (Solid State Drive) or the like. Further, the processing unit 2 is composed of an updating unit 2a of the embodiment and a determination unit 2b of the embodiment. At this time, the update unit 2a and the determination unit 2b may be realized by a hardware logic circuit including the CPU of the processing unit 2, or a program corresponding to the information providing process of the embodiment described later may be provided by the CPU. It may be realized by software by reading and executing.

In the above configuration, the recording unit 5 receives the response of the embodiment in which the vehicle identification information for identifying the vehicle that has been considered to have performed the dangerous driving in the past, the risk score, and the danger flag are associated with each other. The data 50 is non-volatilely recorded as a database of dangerous driving history. On the other hand, the interface 1 controls the transfer of data to and from each in-vehicle device T via the network NW under the control of the processing unit 2. The operation unit 4 generates an operation signal according to an operation by, for example, an administrator of the information providing server SV, and outputs the operation signal to the processing unit 2. On the other hand, the updating unit 2a of the processing unit 2 is based on the evaluation information and the vehicle identification information included in the dangerous driving vehicle information received from each in-vehicle device T, and the above-mentioned risk level for the vehicle of the vehicle identification information. Update the score. The mode of updating the risk score by the updating unit 2a will be described in detail later with reference to FIG. Next, the determination unit 2b of the processing unit 2 compares each risk score with a preset risk threshold value for each corresponding vehicle identification information, so that the vehicle with the vehicle identification information is habitually driven in danger. Determine if it is a vehicle. Then, the determination unit 2b updates the danger flag based on the determination result. Specifically, when the risk score at that time is equal to or higher than the risk threshold value, the determination unit 2b determines that the vehicle in the vehicle identification information is a dangerous driving habitual vehicle, and is associated with the vehicle identification information. Set the danger flag to "On". On the other hand, when the risk score at that time is less than the above risk threshold, the determination unit 2b determines that the vehicle of the vehicle identification information is not a dangerous driving habitual vehicle and is associated with the vehicle identification information. Set the danger flag to "off". In addition to these, the processing unit 2 executes other processing desired as the information providing server SV based on the operation signal or the like from the operation unit 4.

Next, the information providing processes of the examples, which are executed mainly by the processing unit 11 of the in-vehicle device T having the above-described configuration and the processing unit 2 of the information providing server SV, are summarized with reference to FIGS. 3 and 4. explain.

As the corresponding flowcharts are shown in FIG. 4, the information providing process of the embodiment includes the dangerous driving vehicle image recording process of the embodiment executed mainly by the processing unit 11 of the vehicle-mounted device T (see the upper left of FIG. 4). Dangerous driving vehicle information transmission processing of the embodiment (see the lower left of FIG. 4), dangerous driving vehicle inquiry processing of the embodiment executed mainly by the processing unit 2 of the information providing server SV (see the upper right of FIG. 4), and danger of the embodiment. The operation information reception process (see the lower right of FIG. 4) is included.

Then, the dangerous driving vehicle image recording process of the embodiment shown in the upper left of FIG. 4 is started at preset timings, for example, after the timing when the power of the in-vehicle device T is turned on. As shown in the upper left of FIG. 4, when the dangerous driving vehicle image recording process of the embodiment is started, the processing unit 11 of the in-vehicle device T controls the camera 15 to take an image of the surroundings of the own vehicle, and as the image pickup result. The image information of the above is acquired and recorded in the memory 13 in association with the time information indicating the time when the image was taken (step S1). The image corresponding to this image information shows, for example, other vehicles, pedestrians, etc. existing around the own vehicle. Next, the extraction unit 11b of the processing unit 11 extracts the vehicle identification information of the other vehicle from the image (step S2). After that, the processing unit 11 includes the vehicle identification information extracted by the extraction unit 11b and the device ID for identifying the vehicle-mounted device T from the other vehicle-mounted device T, and the vehicle having the vehicle identification information is in danger of driving. The inquiry request of the above embodiment for inquiring whether or not the vehicle is a vehicle is transmitted to the information providing server SV via the interface 10 and the network NW (step S3).

Next, the dangerous driving vehicle inquiry process of the embodiment shown in the upper right of FIG. 4 is parallel to the dangerous driving information reception process of the embodiment shown in the lower right of FIG. 4 at the timing when the service of the information providing server SV is started, for example. Is started on. As shown in the upper right of FIG. 4, when the dangerous driving information reception process of the embodiment is started, the processing unit 2 of the information providing server SV monitors the transmission of the inquiry request from any of the in-vehicle devices T (step). S20, step S20: NO. See step S3 above.). In the monitoring of step S20, when the inquiry request is transmitted from any of the in-vehicle devices T (step S20: YES), the processing unit 2 is then included in the received inquiry request in the response data 50. It is determined whether or not the danger flag associated with the vehicle identification information is “on” (step S21). In the determination in step S21, if the danger flag associated with the vehicle identification information is not "on" (step S21: NO), the processing unit 2 sends the inquiry request received in step S20 to the in-vehicle terminal T. In response to this, a response indicating that the vehicle with the vehicle identification information included in the inquiry request is not a dangerous driving habitual vehicle is returned via the interface 1 and the network NW (step S23). After that, the processing unit 2 shifts to another processing as the information providing server SV. On the other hand, in the determination of step S21, when the danger flag associated with the vehicle identification information is "on" (step S21: YES), the processing unit 2 has transmitted the inquiry request received in step S20. A response indicating that the vehicle with the vehicle identification information included in the inquiry request is a dangerous driving habitual vehicle is returned to the terminal T via the interface 1 and the network NW (step S22). The reply of the response in step S22 or step S23 is performed based on the device ID included in the inquiry request. After that, the processing unit 2 shifts to another processing as the information providing server SV.

On the other hand, the processing unit 11 of the vehicle-mounted device T that transmitted the inquiry request in step S3 receives the response transmitted from the information providing server SV in step S22 or step S23 (step S4). Next, the processing unit 11 determines whether or not the vehicle of the vehicle identification information included in the inquiry request transmitted in step S3 is a dangerous driving habitual vehicle based on the received response (step S5). In the determination of step S5, if the vehicle of the vehicle identification information is not a dangerous driving habitual vehicle (step S5: NO. See step S23 above), the processing unit 11 returns to step S1 as it is and performs the above-mentioned processing. repeat. On the other hand, in the determination of step S5, when the vehicle of the vehicle identification information is a dangerous driving habitual vehicle (step S5: YES. See step S22 above), the recording / deletion unit 11a then determines the vehicle identification information. The image information of the image of the vehicle (dangerous driving habitual vehicle) is read from the memory 13 and saved in the SD card CD via the reader / writer 12 (step S6). As a result, the storage of the image information showing the dangerous driving habitual vehicle on the SD card CD is started.

Next, the processing unit 11 and the extraction unit 11b extract the feature amount of the dangerous driving habitual vehicle, and based on the extracted feature amount, the dangerous driving habitual vehicle in the continuously captured image information. The image is tracked and the storage of the image information including the image is continued (step S6). The tracking in step S6 is performed based on either one or both of the outer shape and the color of the dangerous driving habitual vehicle as the feature amount. The tracking method itself is the same as the conventional image feature extraction method and tracking method.

Next, when the recording / deletion control unit 11a of the processing unit 11 becomes unable to perform the above tracking because the dangerous driving habitual vehicle in which the image information is stored in step S6 is separated from the own vehicle, the recording / deletion control unit 11a cannot perform the tracking. Alternatively, when the time during which the tracking is disabled continues for a predetermined time for a reason other than the distance, the storage of the image information of the SD card CD performed in step S6 is stopped ( Step S7). After that, the recording / deletion control unit 11a determines whether or not to delete the image information whose storage has been stopped from the SD card CD (step S8). Specifically, as the determination in step S8, the recording / deletion control unit 11a specifically, for example, regarding the dangerous driving habitual vehicle corresponding to the image information whose storage was stopped in step S7, the dangerous driving vehicle information of the embodiment shown in the lower left of FIG. Danger that associates the evaluation information that the dangerous driving habitual vehicle has performed dangerous driving (that is, that there was dangerous driving) by the transmission process (details will be described later) with the vehicle identification information of the dangerous driving habitual vehicle. When the driving vehicle information is transmitted during the storage of the image information of the dangerous driving habitual vehicle in step S6, or when the storage instruction unit of the operation unit 14 is operated for the vehicle (step S8: left behind). , Do not delete the image information (prohibit deletion). On the other hand, regarding the vehicle corresponding to the image information whose storage has been stopped in step S7, for example, the dangerous driving vehicle information including the evaluation information indicating that the dangerous driving has been performed while the image information of the dangerous driving habitual vehicle in step S6 is being stored. Is not transmitted and the save instruction unit is not operated (step S8: deletion), the recording / deletion control unit 11a deletes the image information from the SD card CD (step S9). Then, the processing unit 11 provides evaluation information indicating that the dangerous driving habitual vehicle did not actually drive dangerously (that is, "no dangerous driving") and vehicle identification information of the dangerous driving habitual vehicle. The associated dangerous driving vehicle information is transmitted to the information providing server SV via the interface 10 and the network NW (step S10). After that, the processing unit 11 shifts to another processing as the in-vehicle device T.

On the other hand, the dangerous driving vehicle information transmission process of the embodiment shown in the lower left of FIG. 4 is performed in parallel with the dangerous driving vehicle image recording process of the embodiment shown in the upper left of FIG. After that, it is started at a preset timing. As shown in the lower left of FIG. 4, when the dangerous driving vehicle information transmission process of the embodiment is started, the processing unit 11 of the in-vehicle device T controls the camera 15 to move around the own vehicle in the same manner as in step S1. An image is taken, the image information as the image pickup result is acquired, and the image information is recorded in the memory 13 in association with the time information indicating the time when the image was taken (step S15). Next, the extraction unit 11b of the processing unit 11 extracts the vehicle identification information of the other vehicle from the image in the same manner as in step S2 (step S16). Next, the processing unit 11 and the determination unit 11c determine whether or not dangerous driving in another vehicle from which the vehicle identification information has been extracted in step S16 is detected (step S17). In the determination of step S17, the determination unit 11c determines whether or not, for example, sudden width adjustment, tilting from the rear, sudden braking in the front, obstruction of the course, etc. have been performed based on the image of the other vehicle. Then, the presence or absence of the above dangerous driving is detected. In the determination of step S17, when dangerous driving is detected in the other vehicle (step S17: YES), the processing unit 11 indicates that the other vehicle has performed dangerous driving (that is, that there has been dangerous driving). The dangerous driving vehicle information associated with the evaluation information of the above and the vehicle identification information extracted in step S16 for the other vehicle is transmitted to the information providing server SV via the interface 10 and the network NW (step S18). .. At this time, as the evaluation information indicating that the dangerous driving has been performed, for example, based on a preset standard, there are three stages of "malicious dangerous driving", "moderate dangerous driving", or "minor dangerous driving". The evaluation information may be included in the dangerous driving vehicle information according to the detection content in step S7. In the detection of step S17, in addition to the automatic determination by the determination unit 11c, the driver or passenger of the own vehicle operates a predetermined button or the like of the operation unit 14 to select the evaluation information and perform dangerous driving. It may be configured to be included in the vehicle information. After that, the processing unit 11 shifts to another processing as the in-vehicle device T.

Next, the dangerous driving vehicle information reception process of the embodiment shown in the lower right of FIG. 4 is parallel to the dangerous driving vehicle inquiry process of the embodiment shown in the upper right of FIG. 4 at the timing when the service of the information providing server SV is started, for example. Is started. As shown in the lower right of FIG. 4, when the dangerous driving vehicle information reception process of the embodiment is started, the processing unit 2 of the information providing server SV transmits the dangerous driving vehicle information from any of the in-vehicle devices T. Monitor (step S30, step S30: NO; see step S12 or step S18 above). In the monitoring of step S30, when the dangerous driving vehicle information is transmitted from any of the in-vehicle devices T (step S30: YES), the processing unit 2 then requests the vehicle associated with the received dangerous driving vehicle information. It is confirmed whether or not the response data 50 including the identification information (that is, the response data 50 of the vehicle corresponding to the received dangerous driving vehicle information) has already been recorded in the recording unit 5 (step S31). In the determination in step S31, if the response data 50 including the vehicle identification information associated with the received dangerous driving vehicle information has not yet been recorded (step S31: NO), the processing unit 2 newly sets the vehicle identification information. The response data 50 including the above is newly recorded in the recording unit 5 (step S32), and the process proceeds to step S33, which will be described later. When the response data 50 is newly recorded in step S32, the risk score included in the response data 50 is set to "0" and the risk flag is set to "off".

On the other hand, in the determination in step S31, when the response data 50 including the vehicle identification information associated with the received dangerous driving vehicle information has already been recorded (step S31: YES), the update unit 2a of the processing unit 2 may perform the update unit 2a. Based on the evaluation information and the vehicle identification information included in the dangerous driving vehicle information received in step S30, the risk score for the vehicle in the vehicle identification information is updated (step S33). Here, specifically, as step S33, when the update unit 2a is in the "malicious dangerous driving" stage, for example, when the evaluation information included in the dangerous driving vehicle information received in step S30 is in the "malicious dangerous driving" stage (the above step S18). See), add the risk score, for example, 1,000 points. If the evaluation information is in the "moderate dangerous driving" stage (see step S18 above), the update unit 2a adds, for example, 750 points to the risk score. Further, when the evaluation information is in the "minor dangerous driving" stage (see step S18 above), the update unit 2a adds, for example, 500 points to the risk score. Finally, when the evaluation information is in the “no dangerous driving” stage (see step S12 above), the update unit 2a subtracts 1 point from the risk score.

Next, the determination unit 2b of the processing unit 2 determines whether or not the risk score updated according to the stage of the evaluation information in the step S33 is equal to or higher than the risk threshold (step S34). Here, as the risk threshold corresponding to the points used as the update points in step S33, (500 points, which is the amount added when the evaluation information is in the "minor dangerous driving" stage, is added once. For example, 600 points may be set in advance (so that the vehicle is not identified as a dangerous driving habit vehicle by itself). Then, when the risk score updated according to the stage of the evaluation information is equal to or higher than the risk threshold (step S34: YES), the determination unit 2b identifies the vehicle associated with the risk score at that time. It is determined that the information vehicle is a dangerous driving habitual vehicle, and the danger flag associated with the vehicle identification information is set to "on" (step S35). The update of the danger flag in step S35 includes the case where it is continuously turned "on". On the other hand, when the risk score updated according to the stage of the evaluation information is less than the risk threshold (step S34: NO), the determination unit 2b identifies the vehicle associated with the risk score at that time. It is determined that the information vehicle is not a dangerous driving habitual vehicle or is no longer a dangerous driving habitual vehicle, and the danger flag associated with the vehicle identification information is set to "off" (step S36). After that, the processing unit 2 shifts to another processing as the information providing server SV.

As described above, according to the information providing process of the embodiment, the evaluation information for evaluating the risk level of the other vehicle and the vehicle identification information of the other vehicle are acquired from the in-vehicle device T and associated with each vehicle identification information. The obtained risk score is updated according to the evaluation information (see step S33 in FIG. 4). At this time, if the evaluation information indicates that the other vehicle has driven dangerously, the risk score is increased, and if the evaluation information indicates that the other vehicle has not driven dangerously, the risk score is increased. Therefore, the risk score can be appropriately updated according to the occurrence state of dangerous driving in other vehicles.

Here, according to the point allocation of the risk level in the evaluation information as in the embodiment, for example, even if the risk score is added by 750 points even if there is a moderate dangerous driving once, the risk threshold is set. If it is 600 points and there is no dangerous driving (the risk score is reduced by 1), and then it is transmitted as the dangerous driving vehicle information from a total of 150 in-vehicle devices T, it is regarded as a dangerous driving habitual vehicle. Will no longer be identified. As a result, it is possible to prevent a vehicle that is not actually a dangerous driving habitual vehicle from being permanently identified as a dangerous driving habitual vehicle even if the vehicle accidentally performs dangerous driving. It is preferable that the point allocation as described above is reviewed according to the degree of diffusion of the information providing system S of the present application. This is because it is considered that the more the information providing system becomes widespread, the more the in-vehicle device T that transmits the dangerous driving vehicle information indicating that there is no dangerous driving increases.

In addition, the degree of danger when the evaluation information indicates that another vehicle has driven dangerously (that is, in any of the above-mentioned "malicious dangerous driving", "dangerous driving", or "minor dangerous driving"). It is dangerous because the increase in the score is larger than the decrease in the risk score when the evaluation information indicates that the other vehicle did not drive dangerously (that is, in the case of "no dangerous driving" above). The risk score can be appropriately updated with more evaluation information depending on whether the driving is performed or not.

Further, a vehicle whose associated risk score exceeds a predetermined risk threshold is determined to be a dangerous driving habitual vehicle (step S35 in FIG. 4), and in response to an inquiry request from the vehicle-mounted device T, the vehicle-mounted device T. Since it is transmitted to T (see step S22 in FIG. 4), the vehicle-mounted device T can easily recognize the dangerous driving habitual vehicle.

Furthermore, when the vehicle identification information extracted from the image information obtained by the camera 15 and the vehicle identification information of the dangerous driving habitual vehicle match, another vehicle from which the matching vehicle identification information is extracted is imaged. Since the saving of the image information on the SD card CD is started (see step S6 in FIG. 4), the saving of the image information can be surely started without any operation such as an operation by the driver of the own vehicle. As a result, it is possible to start recording the image around the own vehicle before the dangerous driving habitual vehicle actually performs dangerous driving, and it is later verified whether or not there is an event that triggered the dangerous driving habitual vehicle to perform dangerous driving. It is also possible.

In addition, the appearance features of the dangerous driving habitual vehicle reflected in the image information to be saved are extracted, and the tracking of the dangerous driving habitual vehicle and the saving of the image information are continued based on the extracted features (Fig.). (Refer to step S6), it is possible to reliably continue to save the image information obtained by capturing the image of another vehicle having the vehicle identification information that matches the vehicle identification information of the dangerous driving habitual vehicle.

Further, as the appearance feature used for the tracking in step S6, the outer shape feature or the color feature of the other vehicle is extracted, so that the necessary image information can be stored more reliably.

At this time, even if the in-vehicle device T is provided with, for example, a LiDAR (Light Detection and Ringing) sensor that optically detects the height of the vehicle as a feature of the outer shape as a means for extracting the feature of the outer shape. good. In this case, since the outer shape feature is optically detected, the outer shape feature can be extracted more accurately. At this time, the LiDAR (Light Detection and Ringing) sensor or the like corresponds to an example of the "optical feature detection means" of the present application.

Furthermore, when the storage of the image information obtained by capturing the image of the other vehicle is stopped when the above-mentioned appearance features cannot be extracted (see step S10 in FIG. 4), when the storage is no longer necessary. By stopping, for example, the recording area of the SD card CD for recording image information can be effectively utilized.

Further, when it is determined that there is dangerous driving in the other vehicle, or when there is an operation of an instruction to save the image information (see step S11 in FIG. 4), the SD card CD of the saved image information is used. Since the deletion of the image is prohibited, the necessary image information can be reliably saved.

Further, in the determination in step S11 of FIG. 4, if it is not determined that there is dangerous driving and the operation of the save instruction is not performed (see step S11: deletion in FIG. 4), the image information is deleted from the SD card CD. Therefore, for example, the recording area of the SD card CD for storing image information can be effectively used.

In the above-described embodiment, all the responses are transmitted to the in-vehicle device T that has transmitted the inquiry request (see step S22 or step S23 in FIG. 4), but in addition to this, for example, from the viewpoint of privacy protection. In response to an inquiry request from the vehicle-mounted device T, a response may be transmitted only to the vehicle-mounted device T that satisfies the preset conditions. In this case, from the viewpoint of privacy protection and the like, it is possible to limit the destination of the response regarding the dangerous driving habitual vehicle.

Further, in the above-described embodiment, the risk score is updated by using all the evaluation information transmitted in the past, but in addition to this, between the current date and time and the preset past time point. The risk score may be updated using only the sent evaluation information. In this case, it is possible to prevent the risk score from being updated based on extremely old evaluation information.

Further, the evaluation information from the in-vehicle device T may include time information, and based on the time information, the risk score may be updated by dividing it into preset days of the week or time zones. In this case, based on the risk score corresponding to the day of the week or the time zone in which the referral request from the in-vehicle device T is received, the result of determining whether the vehicle to be inquired is a dangerous driving habitual vehicle is determined by the in-vehicle device. It can be transmitted to T. This makes it possible to identify vehicles that tend to drive dangerously on a particular day or time.

Furthermore, the evaluation information from the in-vehicle device T includes type information indicating the type of the road on which the own vehicle was traveling at the time when the evaluation information was transmitted, and based on the type information, the road type during driving. It may be configured to update the risk score separately for each. In this case, when the in-vehicle device T receives a referral request including the road type in which the own vehicle is currently traveling, the vehicle to be inquired is in dangerous driving based on the risk score corresponding to the road type. The result of determining whether or not the vehicle is a habitual vehicle can be transmitted to the in-vehicle device T. This makes it possible to identify a vehicle that tends to drive dangerously on a specific road such as an expressway.

Further, in the above-described embodiment, when the vehicle characteristics of the vehicle identification information that matches the vehicle identification information of the dangerous driving habitual vehicle cannot be extracted, the storage of the image information on the SD card CD is stopped. Alternatively, after the time when the feature cannot be extracted, the image information from which the matching vehicle identification information has been extracted may be stored for a preset time. In this case, the reason why the above features could not be extracted is that, for example, the dangerous driving habitual vehicle was hidden behind the pillars of the own vehicle and other vehicles and became invisible, and then the features were extracted again. Even if it becomes possible, the necessary image information can be continuously stored.

Further, the programs corresponding to the respective flowcharts shown in FIG. 4 are recorded on a recording medium such as an optical disk or a hard disk, or acquired via a network such as the Internet, and these are read out to a general-purpose microcomputer or the like. It is also possible to make the microcomputer or the like function as the processing unit 2 or the processing unit 11 of the embodiment.

11a Recording control means (recording / deleting control unit)
11b Identification information extraction means (extraction unit)
T information processing device (vehicle-mounted device)
T1, T2, Tn In-vehicle device S Information provision system

Claims

An identification information extraction means for extracting moving object identification information of another moving object moving around the moving object from the surrounding image information corresponding to the surrounding image obtained by capturing the surroundings of the moving object.
When the moving body identification information of the specific moving body, which is a moving body specified based on the past dangerous driving history, and the extracted moving body identification information match, the matching moving body identification information is extracted. A recording control means for starting recording of the surrounding image information obtained by imaging the other moving body, and
An information processing device characterized by being equipped with.
In the mobile device according to claim 1,
A feature extraction means for extracting the appearance features of the other moving body from the surrounding image information obtained by imaging the other moving body from which the matching moving body identification information is extracted is further provided.
The information processing means that the recording control means continues to record the surrounding image information based on the extracted features after starting the recording of the surrounding image information obtained by imaging the other moving body. Device.
In the information processing apparatus according to claim 2,
The feature extraction means is an information processing apparatus characterized in that, as the appearance feature, the outer shape feature or the color feature of the other moving body from which the matching moving body identification information is extracted is extracted.
In the information processing apparatus according to claim 3,
The feature extraction means is an information processing apparatus including an optical feature detection means for optically detecting the features of the outer shape.
In the information processing apparatus according to any one of claims 2 to 4.
When the appearance feature cannot be extracted, the recording control means controls recording stop of the surrounding image information obtained by imaging the other moving body from which the matching moving body identification information is extracted. An information processing device that features it.
In the information processing apparatus according to any one of claims 2 to 5.
The recording control means captures the surrounding image information of the other moving body from which the matching moving body identification information has been extracted since the time when the matching moving body identification information cannot be extracted by the extracting means. An information processing device characterized in that the recording of is continued for a preset recording time.
The information processing apparatus according to any one of claims 1 to 6.
An operating means operated when instructing the recording of the surrounding image information,
A determination means for determining the presence or absence of dangerous movement of the matching moving body identification information in the other moving body, and
A deletion means for deleting the recorded surrounding image information, and
When it is determined that there is a dangerous movement, or when there is an operation in the operation means, the deletion control means that controls the deletion means so as to prohibit the deletion of the recorded surrounding image information, and the deletion control means.
An information processing device characterized by further comprising.
In the information processing apparatus according to claim 7,
The information processing means that the deletion control means controls the deletion means so as to delete the recorded surrounding image information when the dangerous movement is not determined and the operation is not performed. Device.
An information processing method executed in an information processing apparatus including an extraction means and a recording control means.
An identification information extraction step of extracting the moving body identification information of another moving body moving around the moving body from the surrounding image information corresponding to the surrounding image obtained by capturing the surroundings of the moving body by the extraction means.
When the moving body identification information of the specific moving body, which is the moving body specified based on the past dangerous driving history, and the extracted moving body identification information match, the matching movement is performed by the recording control means. A recording control step of starting recording of the surrounding image information obtained by imaging the other moving body from which the body identification information has been extracted, and a recording control step.
An information processing method characterized by including.
The computer included in the information processing device,
Identification information extraction means for extracting moving object identification information of another moving object moving around the moving object from the surrounding image information corresponding to the surrounding image obtained by capturing the surroundings of the moving object, and
When the moving body identification information of the specific moving body, which is a moving body specified based on the past dangerous driving history, and the extracted moving body identification information match, the matching moving body identification information is extracted. A recording control means for starting recording of the surrounding image information obtained by imaging the other moving body.
An information processing program characterized by functioning as.