JP7453005B2 - Image information processing device, image information processing method, and image information processing program - Google Patents

Description

The present application belongs to the technical field of image information processing devices, image information processing methods, and image information processing programs. More specifically, it belongs to the technical field of an image information processing device and an image information processing method that perform information processing on surrounding images captured around a moving body, and a program for image information processing executed in the image information processing device. .

In recent years, nuisance or dangerous driving such as so-called tailgating driving has often been brought up as a topic of discussion. In the following description, the above-mentioned dangerous driving or nuisance driving will be collectively referred to as "dangerous driving." If you encounter a situation where dangerous driving by another vehicle affects the driving of your own vehicle, record an image showing the situation of the other vehicle using, for example, a so-called drive recorder. It is desirable to keep it. As a prior art document that discloses a conventional technique related to recording such images, etc., the following Patent Document 1 can be cited, for example.

In the conventional technology described in Patent Document 1, the own vehicle is equipped with a camera to take images of the surroundings, and when another vehicle is driving dangerously around the own vehicle, an image of the situation is captured. The location, date and time, and the vehicle registration number of the other vehicle are saved as a single piece of data, and this is sent to an external server.

Japanese Patent Application Publication No. 2002-342883

However, in the conventional technology disclosed in Patent Document 1, when the own vehicle encounters the above-mentioned dangerous scene, the driver himself/herself operates a button installed in the vehicle to start capturing an image using the camera. It is said that In such a configuration, unless the driver operates the button, the imaging will not be performed (in other words, the corresponding data will not be saved).

On the other hand, in the above-mentioned dangerous situations, there are many cases where the above-mentioned dangerous driving has started before the driver operates the above-mentioned button, or there are other vehicles showing signs of dangerous driving. . Therefore, when a recorded image or the like is later used as evidence of the above-mentioned dangerous driving, an image etc. that shows the dangerous driving situation before the driver's operation of the above-mentioned button may become important. Therefore, it is desirable to record images before the operation.

Therefore, the present application was made in view of the above-mentioned request, and one example of the problem is the storage of images taken of other vehicles driving dangerously. An object of the present invention is to provide an image information processing device and an image information processing method that can perform image information processing, and a program for image information processing that is executed in the image information processing device.

In order to solve the above problem, the invention according to claim 1 includes an extraction means for extracting mobile body identification information of other mobile bodies moving around the mobile body from surrounding image information obtained by imaging the surroundings of the mobile body. , an association information recording means for recording association information that associates the extracted mobile body identification information with timing information indicating the timing at which the mobile body identification information was extracted; an acquisition means for acquiring specific moving body identification information, which is the moving body identification information for the moving body specified by a passenger of the moving body, based on the designation ; and an acquisition means that matches the acquired specific moving body identification information. a search means for searching the association information with which the mobile body identification information is associated; and the surrounding image information from which the mobile body identification information associated with the searched association information is extracted, storage means for storing the surrounding image information corresponding to the timing indicated by the timing information associated with the associated association information.

In order to solve the above problem, the invention according to claim 8 is implemented in an image information processing apparatus comprising an extraction means, an association information recording means, an acquisition means, a search means, and a storage means. The image information processing method includes an extraction step of extracting moving body identification information of another moving body moving around the moving body from surrounding image information obtained by capturing an image of the surroundings of the moving body, and the extracted movement. an association information recording step of recording, by the association information recording means, association information in which body identification information and timing information indicating the timing at which the moving body identification information is extracted; an acquisition step of acquiring specific moving body identification information, which is the moving body identification information about the moving body specified by a passenger of the moving body, by the acquisition means based on the designation ; and the acquired specific moving body identification. a search step of searching, by the search means, the association information with which the mobile body identification information that matches the information is associated; and the surroundings from which the mobile body identification information associated with the searched association information is extracted. The method includes a storing step of storing, by the storing means, surrounding image information that is image information and corresponds to the timing indicated by the timing information associated with the retrieved association information.

In order to solve the above problem, the invention as set forth in claim 9 allows a computer included in an image information processing device to use surrounding image information obtained by capturing images of the surroundings of a moving object, to obtain information about other moving objects moving around the moving object. an extraction means for extracting mobile body identification information; an association information recording means for recording association information in which the extracted mobile body identification information is associated with timing information indicating the timing at which the mobile body identification information is extracted ; Acquisition means for acquiring specific mobile body identification information, which is the mobile body identification information of a mobile body designated by a passenger of the mobile body among other mobile bodies, based on the designation ; a search means for searching the association information with which the mobile body identification information that matches the mobile body identification information is associated; and the surroundings from which the mobile body identification information associated with the searched association information is extracted. It functions as a storage means for storing surrounding image information that is image information and corresponds to the timing indicated by the timing information associated with the retrieved association information.

FIG. 1 is a block diagram showing a schematic configuration of an image information processing device according to an embodiment. 1 is a block diagram showing a schematic configuration of an in-vehicle device according to an embodiment. FIG. 3 is a flowchart illustrating a dangerous driving vehicle image recording/storage process according to the embodiment. FIG. 2 is a conceptual diagram illustrating a dangerous driving vehicle image recording/storage process according to an embodiment.

Next, a mode for implementing the present application will be described using FIG. 1. Note that FIG. 1 is a block diagram showing a schematic configuration of an image information processing apparatus according to an embodiment.

As shown in FIG. 1, the image information processing apparatus T according to the embodiment includes an extraction means 11b, an association information recording means 11, an acquisition means 14, a search means 11c, and a storage means 11a. ing.

In this configuration, the extracting means 11b extracts mobile body identification information of other mobile bodies moving around the mobile body from surrounding image information captured around the mobile body. Then, the association information recording means 11 records association information that associates the mobile body identification information extracted by the extraction means 11b with timing information indicating the timing at which the mobile body identification information was extracted.

On the other hand, the acquisition means 14 acquires specific mobile body identification information that is mobile body identification information of a specific mobile body. Then, the search means 11c searches for association information in which mobile body identification information that matches the specific mobile body identification information acquired by the acquisition means 14 is associated.

As a result, the storage means 11a stores surrounding image information from which mobile object identification information associated with the association information searched by the search means 11c is extracted, and timing information associated with the searched association information. The surrounding image information corresponding to the timing indicated by is saved.

As described above, according to the configuration of the image information processing device T of the embodiment, the moving object identification information extracted from the surrounding image information obtained by capturing the surroundings of the moving object and the timing at which the moving object identification information was extracted In addition to recording timing information indicating the , and association information that associates the , specific moving object identification information is acquired, and surrounding image information from which moving object identification information that matches the acquired specific moving object identification information is extracted is recorded. It is stored in correspondence with the timing indicated by the timing information associated with the mobile body identification information that matches the specific mobile body identification information. Therefore, regardless of the acquisition timing of the specific moving object identification information, surrounding image information in which a moving object identified by the moving object identification information that matches the specific moving object identification information is captured, the matching moving object identification information It can be saved in accordance with the extracted timing.

Next, a specific example corresponding to the above-described embodiment will be described using FIGS. 2 to 4. The embodiment described below applies to dangerous driving vehicle image recording/storage processing that records and stores image information corresponding to an image of a vehicle engaging in dangerous driving in an on-vehicle device installed in a vehicle. This is an example of application.

Further, FIG. 2 is a block diagram showing the general configuration of the in-vehicle device of the embodiment, FIG. 3 is a flowchart showing the dangerous driving vehicle image recording/storage process of the embodiment, and FIG. 4 is the dangerous driving vehicle image recording/storage process of the embodiment. FIG. 3 is a conceptual diagram showing storage processing. At this time, in FIG. 2, for each component of the embodiment corresponding to each component of the image information processing device T of the embodiment shown in FIG. I am using it.

As shown in FIG. 2, the in-vehicle device T of the embodiment, which is specifically implemented as, for example, a drive recorder, includes a processing unit 11 including a CPU, a RAM (Random Access Memory), a ROM (Read Only Memory), etc. A reader/writer 12, a memory 13, a display 17 including a liquid crystal display, an operation section 14 including operation buttons and a touch panel provided on the surface of the display 17, and a CCD (Charge Coupled Device) or a CMOS (Complementary Device). The camera 15 includes a metal oxide semiconductor (Metal Oxide Semiconductor) image sensor or the like, and a sensor section 16 includes a GNSS (Global Navigation Satellite System) receiver or an acceleration sensor. Further, the processing section 11 includes a recording/save control section 11a of the embodiment, an extraction section 11b of the embodiment, and a search section 11c of the embodiment. At this time, the recording/storage control section 11a, the extraction section 11b, and the search section 11c may be realized by a hardware logic circuit including the CPU of the processing section 11, or the dangerous driving It may be realized in software by the CPU reading and executing a program corresponding to vehicle image recording/storage processing. Note that in the following description, the vehicle in which the on-vehicle device T that is the subject of the description is mounted will be referred to as the "host vehicle." Further, the in-vehicle device T corresponds to an example of the image information processing device T of the embodiment, the extraction unit 11b corresponds to an example of the extraction means 11b of the embodiment, and the recording/storage control unit 11a corresponds to an example of the storage means 11a of the embodiment. This corresponds to an example and an example of the association information recording means 11, respectively. Furthermore, the search section 11c corresponds to an example of the search means 11c of the embodiment, the operation section 14 corresponds to an example of the acquisition means 14 of the embodiment and an example of the "reception means" of the present application, and the display 17 corresponds to an example of the "reception means" of the present application. This corresponds to an example of "display means".

In the above configuration, the camera 15 has an imaging range that covers, for example, the front and rear of the own vehicle, and sends image information as a result of imaging the imaging range to the processing unit 11 under the control of the processing unit 11. Output. Note that the imaging range of the camera 15 may be, for example, the entire circumference of the host vehicle. The memory 13 temporarily records the image information under the control of the recording/storage control section 11a of the processing section 11. The sensor unit 16 outputs, for example, position data indicating the position of the host vehicle to the processing unit 11 based on the reception result of navigation radio waves by the GNSS receiver. The operation unit 14 generates an operation signal according to an operation of the own vehicle, for example, by a driver, and outputs it to the processing unit 11. At this time, the operation unit 14 includes, for example, a button-type save instruction unit used when the driver etc. instructs the image information to be saved to the SD card CD, and a button-type save instruction unit used when the driver etc. It is operated when specifying vehicle identification information that identifies another vehicle shown in the above image information (specifically, the vehicle registration number of the other vehicle (so-called vehicle number written on the license plate)). and a vehicle specification section. Here, the storage instruction unit and the vehicle designation unit may be configured, for example, when the own vehicle encounters another vehicle that is driving dangerously (or shows signs of driving dangerously). This is operated when instructing to save the above-mentioned image information showing the vehicle to the SD card CD. Then, the storage instruction section is pressed, for example, in accordance with the storage instruction, and part or all of the vehicle identification information of the other vehicle is input in the vehicle specification section. In the following description, other vehicles that engage in (or exhibit signs of) the above dangerous driving will be simply referred to as "dangerous driving vehicles."

On the other hand, the recording/storage control unit 11a controls the storage and reading of data to and from the SD card CD via the reader/writer 12. In addition to this, the recording/storage control unit 11a controls recording of the image information into the memory 13. The extraction unit 11b of the processing unit 11 extracts the vehicle identification information for identifying another vehicle appearing in the image corresponding to the image information output from the camera 15, and the feature amount indicating the characteristics of the other vehicle. , are extracted using the same method as before. At this time, the feature amounts include, for example, the feature amounts of the external shape and color of the other vehicle. As a result, the recording/storage control unit 11a generates tag information of the embodiment including the vehicle identification information extracted by the extraction unit 11b and time information indicating the time when the vehicle identification information was extracted from the image information. , records the tag information in the memory 13. At this time, the recording destination of the tag information may be an SD card CD. The generation and recording of tag information in the embodiment by the recording/storage control unit 11a is performed whenever new vehicle identification information is extracted from an image corresponding to the image information output from the camera 15. This is executed using identification information and time information corresponding thereto. Then, separate tag information is generated for each newly extracted vehicle identification information and recorded in the memory 13 or the SD card CD.

Next, the search unit 11c of the processing unit 11 searches for a tag containing vehicle identification information that matches the vehicle identification information acquired via the operation unit 14, which includes a storage instruction unit and a vehicle designation unit operated by the driver or the like. Information is searched in each of the recorded tag information. As a result, the recording/storage control section 11a selects, among the image information recorded in the memory 13, image information recorded after the time indicated by the time information included in the tag information searched by the search section 11c. , save to SD card CD. In addition to these, the processing section 11 executes other processing desired by the in-vehicle device T using the operation signal from the operation section 14, the position data from the sensor section 16, and the like.

Next, the dangerous driving vehicle image recording/storage process of the embodiment, which is executed mainly by the processing unit 11 of the in-vehicle device T having the above-described configuration, will be summarized with reference to FIGS. 2 to 4.

As the corresponding flowchart is shown in FIG. 3, the dangerous driving vehicle image recording/saving process of the embodiment includes, for example, interrupt processing at each preset interrupt timing after the timing when the power of the on-vehicle device T is turned on. is started as. As shown in FIG. 3, when the dangerous driving vehicle image recording/storage process of the embodiment is started, the processing unit 11 of the in-vehicle device T controls the camera 15 to take an image of the surroundings of the host vehicle. The resulting image information is acquired (step S1). Then, the recording/storage control unit 11a of the processing unit 11 records the acquired image information in the memory 13 (step S1). This image information is recorded in the memory 13, for example, cyclically at regular intervals. Further, the image corresponding to this image information includes, for example, other vehicles, pedestrians, etc. existing around the host vehicle. Next, the extraction unit 11b of the processing unit 11 extracts the vehicle identification information of the other vehicle from the image by, for example, image analysis processing similar to the conventional one (step S2). Thereafter, the recording/storage control unit 11a generates the tag information including the vehicle identification information extracted by the extraction unit 11b and the time information indicating the extraction time, and records it in the memory 13 (step S3). .

After the steps S1 to S3 are executed, the processing unit 11 saves the storage instruction section and the vehicle designation section by the driver of the own vehicle due to reasons such as the encounter of the own vehicle with a dangerously driven vehicle. It is monitored whether the instruction to save the used image information has been executed (step S4). In the monitoring at step S4, if the save instruction operation is not executed (step S4: NO), the recording/save control unit 11a returns to step S1 and repeats the processing up to step S3.

On the other hand, in the monitoring at step S4, if the driver or the like instructs the storage to be stored in the SD card CD (step S4: YES), then the search unit 11c of the processing unit 11 searches the vehicle specifying unit according to the storage instruction operation. The tag information recorded above is searched for tag information including vehicle identification information that matches the vehicle identification information acquired through (step S5). Thereby, the recording/storage control unit 11a reads the image information recorded in the memory 13 after the time indicated by the time information included in the tag information searched in step S5, and reads the image information recorded in the memory 13 via the reader/writer 12. Save it to the SD card CD (step S6). As a result, image information showing the situation of the dangerous vehicle is stored in the SD card CD. At this time, if the above save instruction operation is performed after the time when the vehicle identification information included in the tag information searched in step S5 is extracted, the image information saved in the SD card CD will include: This includes image information recorded before the storage operation instruction and after the vehicle identification information extraction time.

Next, the processing unit 11 and the extraction unit 11b extract the feature amount of the dangerous driving vehicle, and based on the extracted feature amount, the image of the other vehicle in the continuously captured image information is extracted. Tracking is continued and storage of image information including the tracking is continued (step S6). The tracking in step S6 is performed based on either or both of the external shape and color of the other vehicle as the feature amount. The tracking method itself is the same as the conventional image feature extraction method and tracking method.

Thereafter, in step S6, the recording/storage control unit 11a determines whether the above-mentioned tracking becomes impossible because the other vehicle whose image information is stored has moved away from the host vehicle, or if the other vehicle whose image information has been stored has moved away If the time during which tracking is disabled continues for a predetermined period of time for any other reason, the storage of the image information to the SD card CD in step S6 is stopped (step S7). After that, the processing unit 11 moves on to other processing as the in-vehicle device T.

Note that there may be cases where, for example, the vehicle identification information is not extracted from the image information for some reason, and the tag information that should include the vehicle identification information that has not been extracted is not generated. In such a case, if the above-mentioned save instruction operation is performed for a dangerous driving vehicle for which the relevant tag information has not been generated, the recording/save control unit 11a determines that the corresponding tag information is not retrieved in the above-mentioned step S5. Based on this, it is preferable to control so that, for example, all or part of the image information recorded in the memory 13 at that time is stored in the SD card CD.

Next, the dangerous driving vehicle image recording/storage process of the embodiment corresponding to the flowchart shown in FIG. 3 will be described in more detail with reference to FIG. 4. When steps S1 to S3 in the flowchart shown in FIG. (See step S1 in FIG. 3). Then, each time vehicle identification information is newly extracted from the image information (see step S2 in FIG. 3), the tag information TG1, tag information TG2, tag information TG3, etc. illustrated in FIG. and corresponding time information, and are recorded in the memory 13 or the SD card CD (see step S3 in FIG. 3). In the following description, when tag information TG1, tag information TG2, tag information TG3, etc. are handled in common, they are simply referred to as "tag information TG." Assume that the vehicle identification information recognized by the driver or the like as a dangerously driven vehicle is, for example, the vehicle identification information included in the tag information TG2. In this case, when a save instruction operation including designation of the vehicle identification information included in the tag information TG2 is executed on the operation unit 14 at, for example, time t4 (see step S4: YES in FIG. 3), as shown in FIG. In this case, image information d1 from time t2 to time t4 included in tag information TG2 and image information d2 after time t4 are each stored in the nonvolatile area SA of the SD card CD. Note that the image information d1 and the image information d2 stored in the nonvolatile area SA may be deleted from the memory 13, or may be left as they are and then automatically erased by overwriting the image information. Further, as for the start time of the image information d1 stored in the SD card CD, any arbitrary time between the time t2 and the time t4 may be defined, for example, in relation to the time t2 or the time t4. You can.

As explained above, according to the dangerous driving vehicle image recording/storage process of the embodiment, the vehicle identification information extracted from the image information of the surroundings of the own vehicle and the time when the vehicle identification information was extracted are stored. At the same time as recording the tag information TG associated with the time information shown in FIG. Image information from which vehicle identification information that matches the vehicle identification information of the driving vehicle is extracted is saved in correspondence with the time indicated by the time information associated with the vehicle identification information that matches the vehicle identification information of the dangerously driven vehicle. (See steps S5 and S6 in FIG. 3). Therefore, the image information in which the vehicle identified by the vehicle identification information that matches the vehicle identification information of the dangerously driven vehicle is captured at the monitoring timing in step S4 (that is, at the timing of the save instruction operation using the operating unit 14). Regardless, the matching vehicle identification information can be stored in correspondence with the time when it was extracted.

At this time, the time information recorded and included in the tag information TG may be timing information such as a so-called time code based on a preset time starting point. Even in this case, image information of a vehicle identified by vehicle identification information that matches the vehicle identification information of the dangerously driven vehicle can be saved in correspondence with the timing at which the matching vehicle identification information is extracted. .

Furthermore, since the instruction to save to the SD card CD is an instruction using the save instruction section and vehicle specification section included in the operation section 14, it matches the vehicle identification information of the dangerous driving vehicle intended by the driver, etc. Image information of a vehicle identified by vehicle identification information can be stored in correspondence with the time or timing at which the vehicle identification information is extracted.

Furthermore, if the tag information TG associated with the vehicle identification information that matches the vehicle identification information of the dangerous driving vehicle that was the target of the storage instruction operation is not retrieved, the image information currently recorded in the memory 13 According to the configuration in which everything is stored in the SD card CD, even if the tag information TG is not retrieved, image information of a vehicle identified by vehicle identification information that matches the vehicle identification information of the dangerously driven vehicle can be saved. Can be done.

Furthermore, when the vehicle identification information is information on a vehicle number, image information of a vehicle identified by a vehicle number that matches the vehicle number of the dangerously driven vehicle is captured by the time when the vehicle number was extracted or It can be saved according to the timing.

Further, since the storage destination of the image information corresponding to the storage instruction operation is the nonvolatile area SA of the SD card CD, the image information desired to be stored can be stored reliably and in a portable manner.

In the dangerous driving vehicle image recording/storage process of the above-described embodiment, the storage on the SD card CD is performed by a storage operation instruction by the driver or the like using the storage instruction section and the vehicle specification section of the operation section 14. However, in addition to this, when the image information being recorded in the memory 13 (see step S1 in FIG. 3) is displayed on the display 17, the driver's touch operation on the touch panel for the image of the dangerously driving vehicle may cause the dangerously driving to occur. A vehicle may be designated (see step S4 in FIG. 3: YES), and the vehicle identification information of the designated dangerous driving vehicle may be extracted and used for searching the tag information TG (step S5 in FIG. 3). Even in this case, the image information of the vehicle identified by the vehicle identification information that matches the vehicle identification information of the dangerously driven vehicle specified by the above touch operation is displayed in correspondence with the time or timing at which the vehicle identification information was extracted. You can save it.

In addition, in the dangerous driving vehicle image recording/storage process of the embodiment described above, the vehicle identification information included in each tag information TG is compared with the vehicle identification information acquired by the storage instruction operation by the driver etc. , identified image information that showed a dangerously driven vehicle. However, in addition to this, the vehicle identification information extracted from the image information already recorded in the memory 13 and the vehicle identification information acquired by the above-mentioned save instruction operation are directly compared to identify image information in which a dangerously driven vehicle is reflected. You may.

Furthermore, in the dangerous driving vehicle image recording/storage process of the embodiment described above, image information is stored in the SD card CD based on a storage operation instruction from the driver, etc. (see steps S4 to S6 in FIG. 3). ). However, in addition to this, the vehicle identification information is acquired as dangerous driving vehicle identification information from an external server device that has accumulated vehicle identification information of vehicles that have engaged in dangerous driving in the past, and the acquired dangerous driving vehicle identification information is When tag information TG including matching vehicle identification information is recorded, image information after the time (or timing) indicated by the time information (or timing information) included in the tag information TG is stored on the SD card CD. It may also be configured to save to. In this case, the same effects as the dangerous driving vehicle image recording/storage process of the embodiment can be obtained regardless of the timing of acquiring the vehicle identification information from the server device.

Furthermore, in order to obtain the vehicle identification information of a dangerously driven vehicle that should be included in the image information to be saved to the SD card CD, instead of the save instruction operation in the embodiment, the voice of the driver etc. It may also be possible to input the uttered voice).

In addition, in the dangerous driving vehicle image recording/storage process of the embodiment described above, the storage destination of the image information output from the camera 15 is the SD card CD. When connected to a network, the storage destination may be a server device (a so-called "cloud" server device) connected to the network. In this case, the image information stored based on a storage instruction operation or the like in another vehicle-mounted device can be utilized in the own vehicle (vehicle-mounted device T of the embodiment). In other words, for example, on a highway, a dangerous driving vehicle may appear that performs dangerous driving such as tailgating on multiple vehicles one after another. In addition, it is also possible to transmit information regarding dangerous driving of the own vehicle to other vehicles.

Furthermore, a program corresponding to the flowchart shown in FIG. 3 may be recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and read out into a general-purpose microcomputer or the like. By executing this, it is also possible to cause the microcomputer or the like to function as the processing unit 11 of the embodiment.

11 Association information recording means (processing unit)
11a Storage means (recording/storage control unit)
11b Extraction means (extraction part)
11c Search means (search section)
14 Acquisition means (operation unit)
T Image information processing device (in-vehicle device)
CD SD card TG1, TG2, TG3 Tag information

Claims (9)

Extracting means for extracting mobile body identification information of other mobile bodies moving around the mobile body from surrounding image information captured around the mobile body;
association information recording means for recording association information that associates the extracted mobile body identification information with timing information indicating the timing at which the mobile body identification information was extracted;
acquisition means for acquiring specific mobile body identification information that is the mobile body identification information for a mobile body designated by a passenger of the mobile body among the other mobile bodies, based on the designation ;
a search means for searching the association information with which the mobile body identification information that matches the acquired specific mobile body identification information is associated;
The surrounding image information from which the mobile object identification information associated with the retrieved association information is extracted, and corresponds to the timing indicated by the timing information associated with the retrieved association information. a storage means for storing the surrounding image information;
An image information processing device comprising: The image information processing device according to claim 1,
The image information processing apparatus is characterized in that the acquisition means is a reception means that receives input of the specific mobile object identification information by the passenger . The image information processing device according to claim 1,
The acquisition means is
Display means for displaying the captured surrounding image information;
reception means for accepting the designation of the specific mobile object identification information included in the surrounding image information and displayed on the display means;
An image information processing device comprising: The image information processing device according to any one of claims 1 to 3,
If the association information with which the mobile body identification information that matches the acquired specific mobile body identification information is associated is not retrieved, the storage means stores all of the surrounding image information. Image information processing device. The image information processing device according to any one of claims 1 to 4,
The timing is a time when the mobile object identification information is extracted from the surrounding image information,
An image information processing device characterized in that the timing information is time information indicating the time. The image information processing device according to any one of claims 1 to 5,
The mobile object is a vehicle,
An image information processing device characterized in that the mobile object identification information is vehicle number information indicating a vehicle number of the vehicle. The image information processing device according to any one of claims 1 to 6,
An image information processing device characterized in that a storage destination of the surrounding image information by the storage means is a storage area in a nonvolatile card-type recording medium. An image information processing method executed in an image information processing device comprising an extraction means, an association information recording means, an acquisition means, a search means, and a storage means, the method comprising:
an extraction step of extracting mobile body identification information of another mobile body moving around the mobile body from surrounding image information obtained by capturing an image of the surroundings of the mobile body, by the extraction means;
an association information recording step of recording, by the association information recording means, association information in which the extracted mobile body identification information and timing information indicating the timing at which the mobile body identification information was extracted;
an acquisition step of acquiring specific mobile body identification information, which is the mobile body identification information about a mobile body designated by a passenger of the mobile body among the other mobile bodies , by the acquisition means based on the designation ; ,
a search step of searching, by the search means, the association information with which the mobile body identification information that matches the acquired specific mobile body identification information is associated;
The surrounding image information from which the mobile object identification information associated with the retrieved association information is extracted, and corresponds to the timing indicated by the timing information associated with the retrieved association information. a storage step of storing the surrounding image information by the storage means;
An image information processing method comprising: The computer included in the image information processing device,
Extracting means for extracting mobile body identification information of other mobile bodies moving around the mobile body from surrounding image information captured around the mobile body;
association information recording means for recording association information that associates the extracted mobile body identification information with timing information indicating the timing at which the mobile body identification information was extracted;
acquisition means for acquiring specific mobile body identification information, which is the mobile body identification information of a mobile body designated by a passenger of the mobile body among the other mobile bodies, based on the designation ;
a search means for searching the association information with which the mobile body identification information that matches the acquired specific mobile body identification information is associated; and
The surrounding image information from which the mobile object identification information associated with the retrieved association information is extracted, and corresponds to the timing indicated by the timing information associated with the retrieved association information. storage means for storing the surrounding image information;
An image information processing program characterized by functioning as an image information processing program.

Images