JP2020080462A - Image management device, road information management system, vehicle, program and image management method - Google Patents

Abstract

To solve such a problem that, if all image data acquired during travelling are stored in a server, resources of the server and a communication network are wastefully consumed.SOLUTION: An image management device includes: a storage determination section for determining an image to be stored from among a plurality of images captured by an imaging section that images an external state of a moving body; and a condition determination section for determining a condition to determine the image to be stored. The storage determination section determines the image to be stored according to a condition determined by the condition determination section. Based on the speed of the moving body, the condition determination section determines, as a condition for determining the image to be stored, at least one of the following conditions: (i) a condition regarding a time interval until a next image to be stored is determined after one image has been determined as an image to be stored; and (ii) a condition regarding a distance travelled by the moving body until the next image to be stored is determined after one image has been determined as an image to be stored.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an image management device, a road surface information management system, a vehicle, a program, and an image management method.

There is known a technique in which an in-vehicle terminal transmits road information (for example, pavement of a road surface) regarding a road on which a vehicle is traveling to a server (for example, refer to Patent Document 1).
[Prior Art Document]
[Patent Document]
[Patent Document 1] Japanese Unexamined Patent Publication No. 2015-184183

  If all the image data acquired during traveling is stored in the server, the resources of the server and the communication network are wastefully consumed.

  In a first aspect of the present invention, an image management device is provided. The above-described image management device includes, for example, a save determination unit that determines an image to be saved from among a plurality of images captured by an image capturing unit that captures an external state of the moving body. The image management apparatus described above includes, for example, a condition determination unit that determines a condition for determining an image to be stored. In the above image management device, the imaging unit is mounted on, for example, a moving body. In the above image management device, the save determination unit determines an image to be saved, for example, according to the condition determined by the condition determination unit. In the above image management device, the condition determination unit includes, for example, a speed information acquisition unit that acquires speed information indicating the speed of the moving body. In the above image management apparatus, the condition determination unit may, for example, (i) determine one image as a storage target and then determine the next storage target image as a condition for determining an image to be stored. Condition regarding time interval until determination, and (ii) Condition regarding distance traveled by the moving body after one image is determined as a storage target and before the next image to be stored is determined. And an interval condition determining unit that determines at least one of them based on the speed of the moving body.

  In the above image management device, the image management device may include a distance information acquisition unit that acquires distance information indicating a distance between the moving body and an object existing in the moving direction of the moving body. In the above image management device, the condition determination unit determines that the condition that the image is not an image captured when the distance indicated by the distance information is smaller than a predetermined value is a condition for determining the image to be saved. You may have the distance condition determination part which determines.

  In the above image management device, the moving body may be a vehicle. In the above image management device, the object existing in the moving direction of the moving body may be another vehicle existing in front of the moving body. In the above image management device, a unique vehicle identification number may be assigned to each of the plurality of vehicles. In the above-mentioned image management device, the condition determination unit stores the condition that the image is not a storage target when the vehicle identification number given to another vehicle included in the image captured by the image capturing unit is recognized. The image condition determination unit may be provided as a condition for determining the image to be determined.

  In a second aspect of the present invention, an image management device is provided. The above-described image management device includes, for example, a save determination unit that determines an image to be saved from among a plurality of images captured by an image capturing unit that captures an external state of the moving body. The above-described image management device includes, for example, a distance information acquisition unit that acquires distance information indicating the distance between the moving body and an object existing in the moving direction of the moving body. In the image management device described above, the imaging unit is mounted on, for example, a moving body. In the above image management device, the save determination unit determines that the image captured by the image capturing unit when the distance indicated by the distance information is smaller than a predetermined value is not to be stored.

  In the above image management device, the moving body may be a vehicle. In the above image management device, the object existing in the moving direction of the moving body may be another vehicle existing in front of the moving body. In the above image management device, a unique vehicle identification number may be assigned to each of the plurality of vehicles. In the above image management device, the distance information may be information indicating that the vehicle identification number given to another vehicle included in the image captured by the imaging unit is recognized. In the above image management device, the storage determination unit may determine that the distance indicated by the distance information is smaller than a predetermined value when the vehicle identification number assigned to another vehicle is recognized.

  In the first aspect and the second aspect described above, in the image management device, when the vehicle identification number given to another vehicle included in the image captured by the image capturing unit is recognized, the recognized vehicle identification is performed. An identification number storage may be provided that determines to store the number. The image management device may include an identification number transmission unit that transmits information including the vehicle identification number determined to be stored to the vehicle information collection device that collects the vehicle identification number. The image management apparatus may include an image transmission unit that transmits information including image data of an image to be stored to an image information collection apparatus that collects an image.

  In a third aspect of the present invention, a vehicle is provided. The vehicle described above includes, for example, the image management device according to the first aspect or the second aspect.

  In a fourth aspect of the present invention, a road surface information management system is provided. The road surface information management system includes, for example, the image management device according to the first aspect or the second aspect. The road surface information management system described above includes, for example, an image information collection device that collects image data of images to be stored from a plurality of image management devices. In the above road surface information management system, for example, the image to be stored includes an image of a road. In the road surface information management system described above, for example, the image information collection device analyzes the image to be saved and generates road surface information regarding the road surface state of the road.

  In a fifth aspect of the present invention, a program is provided. A non-transitory computer-readable medium storing the above program may be provided. The above program may be a program for causing a computer to function as the image management device according to the first aspect or the second aspect. The above program may be a program for causing a computer to execute the information processing method in the image management device according to the first aspect or the second aspect.

  In a sixth aspect of the present invention, an image management method is provided. The above-described image management method includes, for example, a storage determination step of determining an image to be stored among a plurality of images captured by an image capturing unit that is mounted on a mobile body and that captures an external state of the mobile body. You may have. The above-described image management method may include, for example, a condition determining step in which a computer determines a condition for determining an image to be saved. The condition determination step includes, for example, a speed information acquisition step in which the computer acquires speed information indicating the speed of the moving body. In the condition determining step, for example, as a condition for the computer to determine an image to be saved, (i) until one image is determined to be saved and then the next image to be saved is determined. At least one of the condition regarding the time interval of (ii) and (ii) the condition regarding the distance that the moving body moves after one image is determined as a storage target and before the next image to be stored is determined. , And an interval condition determining step of determining based on the speed of the moving body. The storage determining step includes, for example, a step in which the computer determines an image to be stored according to the condition determined in the condition determining step.

  In a seventh aspect of the present invention, an image management method is provided. The above-described image management method includes, for example, a save determination step of determining an image to be saved among a plurality of images captured by an imaging unit that is mounted on a mobile body and that captures an external state of the mobile body. Have. The image management method described above includes, for example, a distance information acquisition step in which the computer acquires distance information indicating a distance between the moving body and an object existing in the moving direction of the moving body. In the image management method described above, the storage determination step is, for example, a step in which the computer determines that the image captured by the image capturing unit when the distance indicated by the distance information is smaller than a predetermined value is not to be stored. including.

  Note that the above summary of the invention does not enumerate all necessary features of the present invention. Further, a sub-combination of these feature groups can also be an invention.

1 schematically shows an example of the system configuration of the management system 100. 1 schematically shows an example of the internal configuration of the management server 110. 1 schematically shows an example of an internal configuration of a vehicle 120. 1 schematically shows an example of the internal configuration of the image management unit 124. An example of the internal configuration of the storage condition determination unit 420 is schematically shown. An example of information processing in the image management unit 124 is schematically shown. An example of information processing in the interval condition determining unit 524 is schematically shown. An example of information processing in the interval condition determining unit 524 is schematically shown. An example of an image captured by the vehicle exterior image capturing unit 122 of the vehicle 120 is schematically shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Moreover, not all combinations of the features described in the embodiments are essential to the solving means of the invention. In the drawings, the same or similar parts may be denoted by the same reference numerals, and redundant description may be omitted.

[Outline of Management System 100]
FIG. 1 schematically shows an example of the system configuration of the management system 100. In this embodiment, the management system 100 includes a management server 110 and a vehicle 120. The management system 100 may include a communication terminal 140 used by a user of the management system 100. In the present embodiment, the vehicle 120 includes a vehicle exterior imaging unit 122, an image management unit 124, and a license plate 126.

  The management system 100 may be an example of a road surface information management system. The management server 110 may be an example of the image information collecting device and the vehicle information collecting device. The vehicle 120 may be an example of an image management device and a vehicle. The vehicle 120 may be an example of a moving body. The vehicle exterior imaging unit 122 may be an example of the imaging unit. The image management unit 124 may be an example of an image management device.

  In the present embodiment, the management server 110 and the vehicle 120 can send and receive information to and from each other via the communication network 10. The management server 110 and the communication terminal 140 may send and receive information via the communication network 10. The vehicle 120 and the communication terminal 140 may send and receive information via the communication network 10.

  In the present embodiment, the communication network 10 may be a wired communication transmission path, a wireless communication transmission path, or a combination of a wireless communication transmission path and a wired communication transmission path. .. The communication network 10 may include a wireless packet communication network, the Internet, a P2P network, a dedicated line, a VPN, a power line communication line, or the like. The communication network 10 may include (i) a mobile communication network such as a mobile phone network, (ii) a wireless MAN (for example, WiMAX (registered trademark)), a wireless LAN (for example, WiFi (registered trademark)). )), Bluetooth (registered trademark), Zigbee (registered trademark), NFC (Near Field Communication), and the like may be included.

  In this embodiment, the management server 110 collects images. More specifically, the management server 110 collects information (may be referred to as image information) regarding an image captured by the vehicle exterior imaging unit 122 mounted on one or more vehicles 120. The image information may include image data of the above image, may include information indicating at least one of a position and time at which the above image was captured, and may include any information recognized by analyzing the above image. May be included.

  When the collected image includes an image of a road, the management server 110 may analyze the collected image and generate road surface information regarding a road surface state of the road. The management server 110, for example, detects at least one of the presence or absence of deterioration of the road surface and the freezing of the road surface, and the presence or absence or the extent of wetness or flooding of the road surface based on the road surface information.

  In the present embodiment, the management server 110 collects various information (may be referred to as vehicle information) regarding one or more vehicles 120. The vehicle information may include a vehicle identification number given to the vehicle 120 and information indicating at least one of a position and a time at which the vehicle identification number was imaged.

  In the present embodiment, the vehicle identification number is identification information for identifying each of the plurality of vehicles. A unique vehicle identification number is assigned to each of the plurality of vehicles. The vehicle identification number may be identification information including letters, numbers, symbols, and combinations thereof. An example of the vehicle identification number is a vehicle registration number. In the present embodiment, the vehicle identification number of each vehicle is written on the license plate 126 arranged on the vehicle.

  The management server 110 may generate information indicating the movement history of the vehicle 120 identified by a specific vehicle identification number, for example, in response to a request from the communication terminal 140. The management server 110 may transmit information indicating the movement history to the communication terminal 140 as a response to the above request. The management server 110 can use the movement history to detect the position or movement history of a stolen vehicle, an uninspected vehicle, or the like.

  In the present embodiment, the vehicle 120 captures an image outside the vehicle while traveling. The vehicle 120 transmits, to the management server 110, image data of an image that matches a specific condition among the captured images. On the other hand, the vehicle 120 does not transmit image data of an image that does not meet the above conditions to the management server 110. The vehicle 120 may discard the image data of the image that does not meet the above conditions at an appropriate timing.

  The management server 110 can detect, for example, (i) unevenness of the road surface, (ii) deterioration of the road surface, (iii) lane markings or road markings arranged on the road surface, using the transmitted image. . The management server 110 uses the transmitted image to evaluate, for example, (i) road surface irregularities, (ii) road surface deterioration, and (iii) lane markings or road marking states arranged on the road surface. You can

  Examples of the vehicle 120 include an automobile and a motorcycle. Motorcycles include (i) motorcycles, (ii) three-wheeled motorcycles, (iii) Segway (registered trademark), kickboards with a power unit (registered trademark), skateboards with a power unit, such as a standing ride having a power unit. A motorcycle and the like are exemplified.

  In the present embodiment, the vehicle exterior imaging unit 122 is mounted on the vehicle 120. The vehicle exterior imaging unit 122 captures an image of the outside of the vehicle 120. The vehicle 120 outputs the image data of the captured image to the image management unit 124.

  In the present embodiment, the image management unit 124 manages the image data of the image captured by the vehicle exterior imaging unit 122. In one embodiment, the image management unit 124 stores an image captured by the vehicle exterior image capturing unit 122 as an image to be stored (may be referred to as a storage target) and a target to be discarded (referred to as discard symmetry). There is a case where it is). On the other hand, the image management unit 124 discards the image data of the image having the discard symmetry without transmitting the image data to the management server 110.

  In another embodiment, the image management unit 124 analyzes at least a part of the image captured by the vehicle exterior image capturing unit 122 to determine whether the vehicle identification number is recognized. When the vehicle identification number is recognized in the image, the image management unit 124 stores, for example, vehicle information including the vehicle identification number and information indicating at least one of the position and time at which the image is captured in the management server. Send to 110. Details of the image management unit 124 will be described later.

  In the present embodiment, the communication terminal 140 only needs to be able to send and receive information to and from at least one of the management server 110 and the vehicle 120, and the details thereof are not particularly limited. Examples of the communication terminal 140 include a personal computer and a mobile terminal. Examples of the mobile terminal include a mobile phone, a smartphone, a PDA, a tablet, a notebook computer or a laptop computer, and a wearable computer.

  The communication terminal 140 may support one or a plurality of communication methods. Examples of the communication system include a mobile communication system, a wireless MAN system, a wireless LAN system, a wireless PAN system and the like. Examples of mobile communication systems include GSM (registered trademark) system, 3G system, LTE system, 4G system, and 5G system. WiMAX (registered trademark) is exemplified as the wireless MAN system. WiFi (registered trademark) is exemplified as the wireless LAN system. Examples of the wireless PAN system include Bluetooth (registered trademark), Zigbee (registered trademark), NFC (Near Field Communication), and the like.

[Specific Configuration of Each Part of Management System 100]
Each unit of the management system 100 may be realized by hardware, software, or hardware and software. At least a part of each unit of the management system 100 may be realized by a single server, or may be realized by a plurality of servers. At least a part of each unit of the management system 100 may be realized on a virtual machine or a cloud system. At least a part of each unit of the management system 100 may be realized by a personal computer or a mobile terminal. Examples of the mobile terminal include a mobile phone, a smart phone, a PDA, a tablet, a notebook computer or a laptop computer, and a wearable computer. Each unit of the management system 100 may store information using a distributed ledger technology such as a block chain or a distributed network.

  When at least a part of the constituent elements of the management system 100 is realized by software, the constituent elements realized by the software define the operation related to the constituent elements in an information processing device having a general configuration. It may be realized by starting a program. The information processing apparatus includes, for example, (i) a data processing apparatus having a processor such as CPU and GPU, ROM, RAM, communication interface, etc., and (ii) keyboard, touch panel, camera, microphone, various sensors, GPS receiver. And an input device such as (iii) a display device, a speaker, a vibration device, and the like, and (iv) a storage device (including an external storage device) such as a memory and a HDD.

  In the information processing device, the data processing device or the storage device may store a program. The above program may be stored in a non-transitory computer-readable recording medium. The above program causes the information processing apparatus to execute the operation defined by the program by being executed by the processor.

  The program may be stored in a computer-readable medium such as a CD-ROM, a DVD-ROM, a memory or a hard disk, or may be stored in a storage device connected to the network. The program may be installed in a computer forming at least a part of the management system 100 from a computer-readable medium or a storage device connected to a network. By executing the program, the computer may function as at least a part of each unit of the management system 100.

  The program that causes the computer to function as at least a part of each unit of the management system 100 may include a module that defines the operation of each unit of the management system 100. These programs or modules work on a data processing device, an input device, an output device, a storage device, or the like to cause a computer to function as each unit of the management system 100 or cause the computer to execute an information processing method in each unit of the management system 100. Or

  The information processing described in the program functions as a specific means in which the software related to the program and various hardware resources of the management system 100 cooperate with each other when the program is read by the computer. Then, the above specific means realizes the calculation or processing of information according to the purpose of use of the computer in the present embodiment, whereby the management system 100 according to the purpose of use is constructed.

  The above program may be a program for causing a computer to function as the management system 100 or the image management unit 124. The above program may be a program for causing a computer to execute the information processing method in the management system 100 or the image management unit 124.

  In one embodiment, the above information processing method may be an image management method. The image management method described above includes, for example, a save determination step of determining an image to be saved from among a plurality of images captured by an imaging unit that is mounted on the mobile body and captures an image of the outside of the mobile body. The image management method described above includes, for example, a condition determining step of determining a condition for determining an image to be stored.

  In the above image management method, the condition determining step may include a speed information acquiring step of acquiring speed information indicating the speed of the moving body. In the image management method described above, in the condition determining step, as a condition for determining an image to be saved, (i) one image is determined as the saving target, and then the next image to be saved is determined. At least the condition regarding the time interval until the moving object and (ii) the condition regarding the distance that the moving body moves after the one image is determined as the saving target and before the next image to be saved is determined. An interval condition determining step of determining one of them based on the velocity of the moving body may be included. In the image management method described above, the saving determination step may include a step of determining an image to be saved according to the condition determined by the condition determination unit.

  In another embodiment, the above information processing method may be an image management method. The image management method described above includes, for example, a save determination step of determining an image to be saved from among a plurality of images captured by an imaging unit that is mounted on the mobile body and captures an image of the outside of the mobile body. The image management method described above includes a distance information acquisition step of acquiring distance information indicating a distance between the moving body and an object existing in the moving direction of the moving body. In the image management method described above, the storage determination step may include a step of determining that the image captured by the image capturing unit is not to be stored when the distance indicated by the distance information is smaller than a predetermined value.

[Outline of each part of the management server 110]
FIG. 2 schematically shows an example of the internal configuration of the management server 110. In the present embodiment, the management server 110 includes a road surface management server 220 and a vehicle management server 240. In the present embodiment, the road surface management server 220 includes a road surface information management unit 222 and a road surface information storage unit 224. In the present embodiment, the vehicle management server 240 has a vehicle information management unit 242 and a vehicle information storage unit 244.

  The road surface management server 220 may be an example of an image information collecting device. The vehicle management server 240 may be an example of a vehicle information collection device.

  In this embodiment, the road surface management server 220 manages image information. The road surface information management unit 222 receives image information including image data of images to be saved from the image management unit 124 of one or more vehicles 120. The road surface information management unit 222 manages the above image information. For example, the road surface information management unit 222 gives an appropriate index to the above image information and stores it in the road surface information storage unit 224. This facilitates storage, retrieval, analysis, etc. of image information.

  For example, when the image to be saved includes the image of the road, the road surface information management unit 222 analyzes the image to be saved and generates road surface information related to the road surface state of the road. The condition of the road surface is (i) whether or not there is unevenness on the road surface, (ii) whether or not there is reflection on the road surface, or (iii) whether or not there are lane markings or road markings placed on the road surface or that condition. Are exemplified. Examples of the irregularities on the road surface include undulations on the road surface, depressions on the road surface, and cracks on the road surface.

  The road surface information management unit 222 may detect at least one of deterioration of the road surface, freezing of the road surface, and wetting or flooding of the road surface based on the road surface information. At least one extent of road surface degradation, road surface freezing, and road surface wetting or flooding may be evaluated. The road surface information management unit 222 may store, in the road surface information storage unit 224, an appropriate index for the road surface information, the detection result, or the evaluation result, for example.

  For example, the road surface information management unit 222 evaluates the state of deterioration of the road surface based on the state of the unevenness of the road surface. The road surface information management unit 222 may evaluate the state of deterioration of the road surface based on the state of unevenness of the road surface and the state of lane markings or road markings arranged on the road surface. As a result of the above evaluation, when it is determined that the state of deterioration of the road surface is worse than the predetermined state, the road surface information management unit 222 may detect the deterioration of the road surface.

  For example, the road surface information management unit 222 detects at least one of freezing of the road surface and wetting or flooding of the road surface based on the reflection state of the road surface. The road surface information management unit 222 may determine at least one degree of freezing of the road surface and wetting or flooding of the road surface based on the reflection state of the road surface.

  Accordingly, the road surface information management unit 222 can specify the position of, for example, an uneven portion of the road surface, a deteriorated portion of the road surface, a marking line, or a road marking. The road surface information management unit 222 needs to be careful about the passage of vehicles, places where the passage of vehicles should be prohibited, places where restoration work is required, places where road surface repair is required, and lane markings or road marking repairs are necessary. It is possible to specify the position such as a different place. Further, the road surface information management unit 222 can determine the priority of repairing the road surface, lane markings or road markings, the priority of restoration work, and the like.

  In this embodiment, the vehicle management server 240 manages vehicle information. The vehicle information management unit 242 receives, from the image management unit 124 of one or more vehicles 120, vehicle information including a vehicle identification number recognized in an image captured by each vehicle. The vehicle information management unit 242 manages the above vehicle information. For example, the vehicle information management unit 242 assigns an appropriate index to the above vehicle information and stores it in the vehicle information storage unit 244. This facilitates storage, retrieval, analysis, etc. of vehicle information.

  For example, the vehicle information management unit 242 generates a movement history of the vehicle 120 identified by the vehicle identification number included in the search request in response to the search request from the communication terminal 140. The vehicle information management unit 242 may transmit the information indicating the movement history to the communication terminal 140 as a response to the request.

  More specifically, first, the vehicle information management unit 242 acquires the vehicle identification number of the vehicle 120 to be searched from the communication terminal 140. Next, the vehicle information management unit 242 refers to the database in which the movement history of the plurality of vehicles 120 is stored, and extracts the information indicating the movement history of the vehicle 120 to be searched. After that, the vehicle information management unit 242 transmits, to the communication terminal 140, information indicating the closest position of the vehicle 120 to be searched or information indicating the movement history of the vehicle. Examples of the vehicle 120 to be searched include a stolen vehicle, an uninspected vehicle, and a vehicle of an acquaintance.

  In the present embodiment, the road surface management server 220 and the vehicle management server 240 may be physically or logically different servers. The vehicle management server 240 does not include image data, or the number or capacity of image data stored therein is smaller than that of the road surface management server 220. Therefore, the data processing load on the vehicle management server 240 is smaller than the data processing load on the road surface management server 220. As a result, the vehicle management server 240 promptly performs a process of searching the movement history of the specific vehicle 120, detecting the theft of the vehicle 120, and searching the position or movement history of a stolen vehicle or a vehicle without a vehicle. Can be executed.

[Overview of each part of vehicle 120]
FIG. 3 schematically shows an example of the internal configuration of the vehicle 120. In the present embodiment, the vehicle 120 includes an exterior imaging unit 122, an image management unit 124, a GPS signal receiving unit 322, a traveling state detection unit 324, a driving unit 330, a communication unit 340, and a control unit 350. Prepare In the present embodiment, the control unit 350 has an input/output control unit 352, a vehicle control unit 354, and a communication control unit 356.

  In this embodiment, the GPS signal receiving unit 322 receives GPS signals. The GPS signal receiving unit 322 may generate position information indicating the position of the vehicle 120 based on the received GPS signal.

  In the present embodiment, the traveling state detection unit 324 detects the traveling state of the vehicle 120 based on the output of any internal world sensor or any external world sensor arranged on the vehicle 120. The traveling state of the vehicle 120 includes speed, acceleration, inclination, vibration, noise, operating status of the drive unit 330, abnormal status, current position, movement route, outside air temperature, outside air humidity, outside air pressure, and internal space. Temperature, humidity in the interior space, pressure in the interior space, relative position with surrounding objects, relative speed with surrounding objects, presence or absence of congestion, continuous operation time, presence or absence of rapid acceleration or frequency, presence of rapid deceleration Alternatively, the frequency is exemplified. The traveling state of the vehicle 120 may be an example of the moving state of the moving body.

  In the present embodiment, the drive unit 330 drives the vehicle 120. The drive unit 330 may drive the vehicle 120 according to a command from the control unit 350. The drive unit 330 may generate power using an internal combustion engine or may generate power using an electric motor. The drive unit 330 may include at least one of an automatic safety device and an automatic driving device. The drive unit 330 may include not only the equipment directly required to drive the vehicle 120 but also various auxiliary equipment. Examples of incidental equipment include security equipment, seat adjustment equipment, lock management equipment, window opening/closing equipment, lighting equipment, air conditioning equipment, navigation equipment, audio equipment, and video equipment.

  In the present embodiment, the communication unit 340 transmits/receives information between the vehicle 120 and the management server 110 via the communication network 10. The communication unit 340 may support one or a plurality of communication methods.

  In the present embodiment, the control unit 350 controls each unit of the vehicle 120. For example, the control unit 350 inputs at least one of image data of an image captured by the vehicle exterior image capturing unit 122, position information generated by the GPS signal receiving unit 322, and information indicating a traveling state detected by the traveling state detection unit 324. Accept. The control unit 350 also transfers the input image data to the image management unit 124.

  In the present embodiment, the input/output control unit 352 controls the input/output of information in the vehicle 120. In the present embodiment, the input/output control unit 352 controls the vehicle exterior imaging unit 122, the image management unit 124, the GPS signal reception unit 322, and the traveling state detection unit 324. The input/output control unit 352 may control at least one of other types of input devices and output devices (not shown).

  In the present embodiment, the vehicle control unit 354 controls the operation of the vehicle 120. The vehicle control unit 354 may control the operation of the drive unit 330. For example, the vehicle control unit 354 acquires the information output by the traveling state detection unit 324. The vehicle control unit 354 controls the operation of the drive unit 330 based on the information output by the traveling state detection unit 324.

  In the present embodiment, the communication control unit 356 controls communication between the vehicle 120 and external devices. The communication control unit 356 may control the operation of the communication unit 340. The communication control unit 356 may be a communication interface. The communication control unit 356 may support one or a plurality of communication methods. The communication control unit 356 may detect or monitor the communication state between the management server 110 and the vehicle 120. The communication control unit 356 may generate communication information indicating a communication state based on the result of the above detection or monitoring.

  Examples of the communication information include information regarding availability of communication, radio wave condition, communication quality, type of communication method, and type of communication carrier. Examples of the radio wave status include a radio wave reception level, radio wave intensity, RSCP (Received Signal Code Power), and CID (Cell ID). Examples of communication quality include communication speed, data communication throughput, and data communication latency.

[Outline of each part of the image management unit 124]
Details of the image management unit 124 will be described with reference to FIGS. 4 and 5. FIG. 4 schematically shows an example of the internal configuration of the image management unit 124. FIG. 5 schematically shows an example of the internal configuration of the storage condition determination unit 420.

  As shown in FIG. 4, in the present embodiment, the image management unit 124 includes a storage condition determination unit 420, a storage time determination unit 432, an inter-vehicle distance determination unit 434, an image extraction unit 440, and an image analysis unit 450. An accompanying information acquisition unit 460, a vehicle information transmission unit 472, and an image information transmission unit 474 are provided. As shown in FIG. 5, in this embodiment, the storage condition determination unit 420 includes a speed information acquisition unit 522, an interval condition determination unit 524, a distance condition determination unit 526, and an image condition determination unit 528.

  The storage condition determination unit 420 may be an example of a condition determination unit, a speed information acquisition unit, an interval condition determination unit, a distance condition determination unit, and an image condition determination unit. The storage time determination unit 432 may be an example of a storage determination unit. The inter-vehicle distance determination unit 434 may be an example of a storage determination unit and a distance information acquisition unit. The image analysis unit 450 may be an example of a storage determination unit and an identification number storage unit. The vehicle information transmitter 472 may be an example of an identification number transmitter. The image information transmission unit 474 may be an example of the image transmission unit.

  In the present embodiment, the storage condition determination unit 420 determines the conditions for determining the image to be stored or the candidate image thereof. The storage condition determination unit 420 determines, for example, a temporal or geographical condition of an image to be stored or an image thereof. The temporal or geographical condition may be a condition relating to a shooting time or a shooting position of the image.

  The storage condition determination unit 420 determines a condition for determining whether or not the image needs to be stored, for example, based on the inter-vehicle distance between the vehicle 120 and another vehicle existing in the vicinity of the vehicle 120. As a condition for determining whether or not the image needs to be stored, (i) an image is analyzed and a vehicle 120 (which is different from the vehicle 120 in which the vehicle exterior imaging unit 122 capturing the image is mounted) If the vehicle identification number of “(subject vehicle)” is recognized, the condition that the image is not to be saved, (ii) the image is analyzed, and the number of the subject vehicle is included in the image. When the plate 126 is recognized, the image is not to be saved, (iii) the image is analyzed, and the size of the image of the subject vehicle or a part of the subject vehicle in the image is predetermined. An example is a condition that the image is not to be saved when the above condition is satisfied.

  As a part of the above-mentioned subject vehicle, parts or patterns whose size is determined by legal regulations, standards or commercial practices are exemplified. Examples of the above parts include a license plate and a vehicle inspection mark. Examples of the pattern include a vehicle identification number on a license plate and letters or symbols on a vehicle inspection mark. The predetermined conditions include (i) the ratio of the size of the image of the subject vehicle or a part of the image of the subject vehicle with respect to the size of the entire image captured by the vehicle exterior imaging unit 122 is greater than a predetermined value. And (ii) the size of the image of the subject vehicle or part of the subject vehicle is larger than a predetermined size.

  The storage condition determination unit 420 outputs information indicating the determined condition to at least one of the storage time determination unit 432, the inter-vehicle distance determination unit 434, and the image analysis unit 450. For example, the storage condition determination unit 420 outputs the condition determined by the interval condition determination unit 524 shown in FIG. 5 to the storage time determination unit 432. The storage condition determination unit 420 may output the condition determined by the distance condition determination unit 526 shown in FIG. 5 to the inter-vehicle distance determination unit 434. The storage condition determination unit 420 may output the conditions determined by the image condition determination unit 528 shown in FIG. 5 to the image analysis unit 450. Details of the storage condition determination unit 420 will be described later.

[(A) An example of an element that determines a storage target based on temporal or geographical conditions]
In the present embodiment, the storage time determination unit 432 determines an image that is a candidate for storage, out of the plurality of images captured by the vehicle exterior imaging unit 122. For example, the storage time determination unit 432 determines an image that is a candidate for storage by determining the time when the process for at least temporarily storing the image is executed on the vehicle 120 side. The storage time determination unit 432 may determine an image that is a candidate for storage based on the image capturing time of the image. The storage time determination unit 432 may determine an image that is a candidate for storage based on the image capturing position of the image.

  The storage time determination unit 432 determines an image that is a candidate for storage, for example, according to the condition determined by the storage condition determination unit 420. The storage time determination unit 432 may determine an image that is a candidate for storage, according to the conditions determined by the interval condition determination unit 524 of the storage condition determination unit 420. The storage time determination unit 432 may output information for identifying an image determined as a candidate for storage to the image extraction unit 440. The information for specifying the image determined as the candidate for saving is information indicating the image capturing time of the image as the candidate for saving, a signal indicating that the execution time of the image saving process has come, an image saving process Examples of instructions for executing

[(A-1) Example of procedure for determining storage target based on temporal condition]
In one embodiment, the storage time determination unit 432 first acquires, from the storage condition determination unit 420, information indicating a temporal condition of an image to be stored or a candidate thereof. Next, the storage time determination unit 432 determines whether or not the above temporal condition is satisfied. For example, the storage time determination unit 432 determines whether or not the image capturing time satisfies the above temporal condition. For example, when it is determined that the image capturing time satisfies the above temporal condition (that is, when the temporal condition is satisfied), the save time determination unit 432 sets the above image as a save candidate. Decide that. As a result, the storage time determination unit 432 can determine images that are candidates for storage.

  More specifically, first, the storage time determination unit 432 acquires, from the interval condition determination unit 524 of the storage condition determination unit 420, information indicating a condition regarding a time interval at which an image is stored. The above-mentioned time interval is determined based on, for example, the setting regarding the imaging interval of the images that are candidates for storage and the traveling speed of the vehicle 120.

  For example, when the above setting requires that images captured at intervals of 25 m be stored at least temporarily, the condition regarding the time interval is that the traveling speed is 90 km/h or less and 1 second per second. It shows that the image is stored at an interval of one sheet, and when the traveling speed is more than 90 km/h and 180 km/h, the image is stored at an interval of two sheets per second, and the traveling speed is more than 180 km/h and 270 km/h. When h is h, it indicates that images are saved at intervals of 3 sheets per second, and when the traveling speed is more than 270 km/h and 360 km/h, it indicates that images are saved at intervals of 4 sheets per second. Details of the above-mentioned condition regarding the time interval will be described later.

  Next, the storage time determination unit 432 acquires information indicating the current time or information indicating the elapsed time from the image capturing time of the image that was determined to be a candidate to be stored immediately before. The storage time determination unit 432 determines whether or not the current time or the elapsed time satisfies the above-mentioned condition regarding the time interval, and based on the determination result, determines a candidate image to be stored. To do.

  For example, the storage time determination unit 432 determines that an image captured at a time that satisfies the above-described condition regarding the time interval is a candidate for storage. The storage time determination unit 432 outputs, for example, information indicating the image capturing time of the image that is the candidate for the storage target to the image extraction unit 440. When the elapsed time satisfies the condition regarding the time interval, the storage time determination unit 432 performs the signal indicating that the execution time of the image storage processing has come, or the image storage processing is executed. A command for doing so may be output to the image extraction unit 440. As a result, the image captured at an appropriate timing is temporarily stored at least on the vehicle 120 side.

[(A-2) Example of procedure for determining storage target based on geographical condition]
In another embodiment, the storage time determination unit 432 first acquires, from the storage condition determination unit 420, information indicating the geographical condition of an image that is a candidate for storage. Next, the storage time determination unit 432 determines whether or not the above geographical condition is satisfied. For example, the storage time determination unit 432 determines whether the image pickup position of the image satisfies the above geographical condition. For example, when it is determined that the image pickup position of the image satisfies the above geographical condition (that is, when the geographical condition is satisfied), the save time determination unit 432 sets the above image as a save candidate. Decide that. As a result, the storage time determination unit 432 can determine images that are candidates for storage.

  More specifically, first, the storage time determination unit 432 acquires from the interval condition determination unit 524 of the storage condition determination unit 420 information indicating the condition regarding the geographical interval at which the image is stored. The above-mentioned geographical interval is determined, for example, based on the setting related to the imaging interval of images that are candidates for storage. For example, with the above setting, it is required to store images captured at 25 m intervals at least temporarily. The above-mentioned geographical interval may be determined based on the setting regarding the position coordinates of the position or area where the image should be stored. Details of the conditions regarding the above-mentioned geographical interval will be described later.

  Next, the storage time determination unit 432 acquires information indicating the current position of the vehicle 120 or information indicating the movement distance from the image capturing position of the image that has been determined to be a candidate to be stored immediately before. The storage time determination unit 432 determines whether or not the current position or movement distance satisfies the conditions regarding the geographical interval, and based on the determination result, determines a candidate image to be stored. To do.

  For example, the storage time determination unit 432 determines that an image captured at a position where the current position or the moving distance satisfies the condition regarding the geographical interval is a candidate for storage. Note that the storage time determination unit 432 determines whether the current time or the elapsed time from the immediately preceding imaging time satisfies the above-described condition regarding the time interval, and thus the above-mentioned current position or It may be determined whether or not the travel distance satisfies the above-mentioned condition regarding the geographical interval.

  The storage time determination unit 432 extracts the image, for example, by using the information indicating the time when the vehicle 120 has passed the position satisfying the condition regarding the above-mentioned geographical interval as the information indicating the image capturing time of the image that is the candidate for the storage. Output to the section 440. When the elapsed time satisfies the condition regarding the geographical interval, the save time determination unit 432 performs the signal indicating that the execution time of the image save process has come, or the save process of the image is executed. A command for doing so may be output to the image extraction unit 440. As a result, the image captured at an appropriate timing is at least temporarily stored on the vehicle 120 side.

[(B) Example of Elements for Determining Storage Target Based on Distance Between Other Vehicles]
In the present embodiment, the inter-vehicle distance determination unit 434 determines an image to be stored or a candidate thereof among the plurality of images captured by the vehicle exterior image capturing unit 122. The inter-vehicle distance determining unit 434 determines an image to be stored or a candidate thereof according to the condition determined by the storage condition determining unit 420, for example. The inter-vehicle distance determining unit 434 may output information for specifying an image to be stored or a candidate thereof to the image extracting unit 440.

  For example, the inter-vehicle distance determining unit 434 acquires distance information indicating the distance between the vehicle 120 and an object existing in the moving direction of the vehicle 120. The object existing in the moving direction of the vehicle 120 may be another vehicle existing in front of the vehicle 120. The object existing in the moving direction of the vehicle 120 may be a vehicle traveling in the same lane as the vehicle 120. The object existing in the moving direction of the vehicle 120 may be a vehicle traveling in a traveling lane in the same direction as the traveling lane of the vehicle 120 and different from the traveling lane of the vehicle 120. The object existing in the moving direction of the vehicle 120 may be an oncoming vehicle. For example, the inter-vehicle distance determining unit 434 uses the distance sensor arranged in the vehicle 120 to acquire information indicating the inter-vehicle distance to the vehicle in front. The inter-vehicle distance determination unit 434 determines whether or not the distance indicated by the distance information satisfies the condition determined by the distance condition determination unit 526, and based on the determination result, the image to be saved or its candidate is selected. You may decide.

  For example, the distance condition determination unit 526 determines, as the condition for determining the image to be saved, the condition that defines the relationship between the image to be saved and the distance indicated by the distance information. In this case, the inter-vehicle distance determining unit 434 determines, as a storage target, an image captured during a period in which the distance indicated by the distance information satisfies the condition determined by the distance condition determining unit 526. The inter-vehicle distance determining unit 434 may determine that an image captured during a period in which the distance indicated by the distance information does not satisfy the condition determined by the distance condition determining unit 526 is not to be stored. The condition defining the relationship between the image to be saved and the distance indicated by the distance information may be a condition that the distance indicated by the distance information is larger than a predetermined value.

  In addition, in another embodiment, the distance condition determination unit 526 may determine the condition that defines the relationship between the image that is not the storage target and the distance indicated by the distance information. In this case, the inter-vehicle distance determination unit 434 may determine an image captured during a period in which the distance indicated by the distance information does not satisfy the condition determined by the distance condition determination unit 526, as a storage target.

  In the present embodiment, the image extraction unit 440 acquires information for specifying an image to be stored or a candidate thereof from at least one of the storage time determination unit 432 and the inter-vehicle distance determination unit 434. The image extraction unit 440 extracts the image data of the image to be saved or its candidate from the image data of the plurality of images captured by the vehicle exterior imaging unit 122. The image extraction unit 440 may output the extracted image data to the image analysis unit 450.

  In one embodiment, the extracted image data is output to the image analysis unit 450. In another embodiment, the extracted image data is temporarily stored in the image extraction unit 440, for example. The length of the period in which the image data is stored in the image extracting unit 440 may be one month or less, two weeks or less, one week or less, or three days or less. It may be 2 days or less, 1 day or less, 12 hours or less, or 6 hours or less.

[(C) An example of an element that determines a storage target based on an image analysis result]
In the present embodiment, the image analysis unit 450 determines an image to be stored among the plurality of images captured by the vehicle exterior imaging unit 122. The image analysis unit 450 determines an image to be stored, for example, according to the conditions determined by the storage condition determination unit 420. The image analysis unit 450 may determine the image to be stored according to the conditions determined by the image condition determination unit 528.

  The image analysis unit 450 may extract the image data of the image to be saved from the image data of the plurality of images captured by the vehicle exterior imaging unit 122 based on the above determination result. The image analysis unit 450 may output the extracted image data to the image information transmission unit 474.

  In the present embodiment, the image analysis unit 450 analyzes (i) each of the image data of the plurality of images captured by the vehicle exterior imaging unit 122 or (ii) each of the image data extracted by the image extraction unit 440. , It is determined whether or not the image represented by each image data contains one or more vehicle identification numbers. The one or more vehicle identification numbers included in the image may be vehicle identification numbers assigned to the subject vehicle. The subject vehicle may be another vehicle that exists in front of the vehicle 120. The subject vehicle may be a vehicle traveling in the same lane as the vehicle 120. The subject vehicle may be a vehicle that travels in a traveling lane that is in the same direction as the traveling lane of the vehicle 120 and that is different from the traveling lane of the vehicle 120.

  In one embodiment, when the vehicle identification number is recognized, the image analysis unit 450 determines that the vehicle identification number is included in the image. In another embodiment, (i) the size of the image of the character or symbol constituting the vehicle identification number, or (ii) the ratio of the size of the image of the character or symbol to the size of the entire image is: When it is larger than the predetermined value, the image analysis unit 450 determines that the image includes the vehicle identification number.

  When it is determined that the vehicle identification number is included in the image, the image analysis unit 450 may determine not to save the image. In this case (particularly when one or more vehicle identification numbers in the image are recognized), the image analysis unit 450 may determine to store the one or more vehicle identification numbers in the management server 110. .. Further, the image analysis unit 450 may output information indicating the recognized vehicle identification number to the vehicle information transmission unit 472.

  On the other hand, when it is determined that the vehicle identification number is not included in the image, the image analysis unit 450 may decide to save the image in the management server 110. Further, the image analysis unit 450 may output the image data of the image to the vehicle information transmission unit 472.

  The image analysis unit 450 analyzes (i) each of the image data of the plurality of images captured by the vehicle exterior image capturing unit 122 or (ii) each of the image data extracted by the image extraction unit 440, and uses the respective image data. In the image shown, it may be determined whether or not a specific type of component arranged in the subject vehicle is determined. Examples of the above parts include a license plate and a vehicle inspection mark. For example, (i) the size of the image of the component in the image, or (ii) the ratio of the size of the image of the component to the size of the entire image is larger than a predetermined value. The image analysis unit 450 determines that the part is identified in the image.

  When it is determined that the above-described parts are identified in the image, the image analysis unit 450 may determine not to save the image. In this case, the image analysis unit 450 may recognize one or more vehicle identification numbers included in the image. In addition, the image analysis unit 450 may determine to store the recognized vehicle identification number in the management server 110. The image analysis unit 450 may output information indicating the recognized vehicle identification number to the vehicle information transmission unit 472.

  On the other hand, when it is determined that the image does not include the image of the component, the image analysis unit 450 may decide to save the image. Further, the image analysis unit 450 may output the image data of the image to the vehicle information transmission unit 472.

  In the present embodiment, the incidental information acquisition unit 460 acquires the incidental information indicating at least one of the position and time at which the image was captured. The incidental information acquisition unit 460 acquires, for example, the information indicating the position where the image is captured from the GPS signal reception unit 322. The incidental information acquisition unit 460 acquires, for example, the information indicating the time when the image was captured from the vehicle exterior imaging unit 122.

  The incidental information acquisition unit 460 corresponds the information indicating at least one of the position and time at which the image including the vehicle identification number output by the image analysis unit 450 to the vehicle information transmission unit 472 was captured, to the identification information of the image data. It may be attached and output to the vehicle information transmission unit 472. The incidental information acquisition unit 460 associates information indicating at least one of the position and time at which the image of the image data output by the image analysis unit 450 to the image information transmission unit 474 is associated with the identification information of the image data, It may be output to the image information transmission unit 474.

  In the present embodiment, the vehicle information transmission unit 472 acquires information indicating the vehicle identification number from the image analysis unit 450. The vehicle information transmission unit 472 acquires the incidental information corresponding to the vehicle identification number from the incidental information acquisition unit 460. The accompanying information includes information indicating the position and time when the image was captured. The vehicle information transmission unit 472 generates vehicle information including information indicating a vehicle identification number and accompanying information. The vehicle information transmission unit 472 may transmit the generated vehicle information to the vehicle management server 240.

  In the present embodiment, the image information transmission unit 474 acquires image data from the image analysis unit 450. The image information transmitting unit 474 acquires the incidental information corresponding to the image data from the incidental information acquiring unit 460. The incidental information includes information indicating the position and time when the image was captured. The image information transmission unit 474 generates image information including image data and accompanying information. The image information transmitting unit 474 may transmit the generated image information to the road surface management server 220.

  The image information transmission unit 474 may generate image information including image data, accompanying data, and vibration data obtained by the acceleration sensor installed in the vehicle 120. Accordingly, the road surface information management unit 222 can estimate the road surface state using the vibration data.

  As described above, FIG. 5 schematically shows an example of the internal configuration of the storage condition determination unit 420. Details of the storage condition determination unit 420 according to the embodiment will be described with reference to FIG. 5.

  In the present embodiment, the speed information acquisition unit 522 acquires speed information indicating the speed of the vehicle 120, for example. The speed information acquisition unit 522 may acquire speed information indicating the speed of the vehicle 120 from the traveling state detection unit 324. The speed information acquisition unit 522 outputs speed information indicating the speed of the vehicle 120 to the interval condition determination unit 524, for example.

  In the present embodiment, the interval condition determining unit 524 determines a condition regarding the timing at which the image is stored, for example, a condition regarding a temporal or geographical interval. As a condition for determining an image to be stored or a candidate thereof, the interval condition determination unit 524 (i) after one image is determined to be the storage target or its candidate, then becomes the storage target or its candidate next. Conditions regarding the time interval until the image is determined, and (ii) after one image is determined as a storage target or its candidate and before the next storage target or its candidate image is determined. At least one of the conditions regarding the distance traveled by the moving body may be determined based on the speed of the vehicle 120.

  The temporal or geographical interval defines the timing at which the image to be saved or its candidate is extracted or cut out from the image data continuously output from the vehicle exterior imaging unit 122. The temporal or geographical distance may be determined based on the speed of vehicle 120. It may continuously change according to the speed of the vehicle 120, or may change stepwise according to the speed of the vehicle 120. In one embodiment, the time intervals are determined such that the faster the vehicle 120, the shorter the interval. In another embodiment, the geographical distance is determined to be constant regardless of the speed of the vehicle 120.

  The temporal or geographical interval is (i) the speed of the vehicle 120, (ii) the specification or performance of the exterior imaging unit 122, (iii) the specification or performance of the exterior imaging unit 122 of the vehicle 120 traveling in the vicinity, (iv) ) Determined based on at least one of traffic volume at the position or area where the image is captured, (v) weather conditions at the position or area where the image is captured, and (vi) time zone during which the image is captured. Good. The temporal or geographical intervals may change continuously or in steps.

  For example, the better the resolution of the vehicle exterior imaging unit 122 of the vehicle, the longer the temporal or geographical interval. For example, the better the resolution of the vehicle exterior imaging unit 122 of another vehicle traveling near the vehicle, the longer the temporal or geographical interval regarding the vehicle. For example, the poorer the resolution of the vehicle exterior imaging unit 122 of another vehicle traveling near the vehicle, the shorter the temporal or geographical interval regarding the vehicle. For example, bad weather conditions and poor visibility result in shorter temporal or geographical intervals. For example, a time zone with poor visibility has a short temporal or geographical interval. For example, the larger the number of other vehicles traveling near the own vehicle, the longer the temporal or geographical interval.

  The interval condition determining unit 524 determines the specifications or performances of the exterior imaging unit 122, the specifications or performances of the exterior imaging unit 122 of the vehicle 120 traveling in the vicinity, the position or area where an image is captured, the traffic volume of the area, and the position where the image is captured. Alternatively, information about at least one of the weather condition of the area and the time zone in which the image is captured is acquired from, for example, the management server 110. The interval condition determination unit 524 may acquire information indicating a temporal or geographical interval from the management server 110.

[Example of procedure for determining geographical interval]
The geographical interval for determining the images to be stored is determined according to the following procedure, for example. According to one embodiment, first, assuming that the vehicle exterior imaging unit 122 is installed at an appropriate position and orientation, the resolution of the vehicle exterior imaging unit 122 and the characters of the vehicle identification number on a typical license plate 126 or Based on the size of the symbol, a distance (may be referred to as an effective range) at which the vehicle exterior imaging unit 122 can capture an image with which the vehicle identification number can be determined is determined. A value of a typical effective range of a commercially available vehicle-mounted camera may be used as the effective range of the vehicle exterior imaging unit 122.

  Next, the degree of overlap of the images in the first and second images stored in succession is determined. Then, the above-mentioned geographical interval is determined based on the effective range of the vehicle exterior imaging unit 122 and the degree of overlap of the above-mentioned images.

  For the purpose of simplifying the explanation, it is assumed that the effective range of the vehicle exterior imaging unit 122 is 50 m and the traveling speed of the vehicle 120 is constant. Here, for example, in the first image and the second image that are continuously stored, it is determined that the images overlap by 25 m. In this case, half of the images overlap. That is, the lower half image of the first image and the upper half image of the second image match. In this case, the geographical distance is 25 m. Similarly, when the images are overlapped by 40 m, the lower 4/5 of the first image and the upper 4/5 of the second image match. In this case, the geographical distance is 10 m.

  According to another embodiment, the geographical distance is determined based on a setting regarding position coordinates of a position or area where an image is to be stored. For example, the above settings include position coordinates of multiple positions where the image should be stored. The above geographical distance is calculated as the distance between two position coordinates. The above-mentioned geographical interval is calculated as a distance between two position coordinates adjacent to each other on the travel route of the vehicle 120. The travel route of the vehicle 120 is designated by the user of the vehicle 120, for example.

  In the present embodiment, the effective range of the vehicle exterior imaging unit 122 is determined based on the distance that allows the size of the character or symbol of the vehicle identification number on the typical license plate 126 to be determined. However, the method of determining the effective range of the vehicle exterior imaging unit 122 is not limited to this embodiment. The effective range of the vehicle exterior imaging unit 122 may be determined based on the size of an arbitrary determination target.

  In another embodiment, the effective range of the vehicle exterior imaging unit 122 is determined based on the resolution of the vehicle exterior imaging unit 122 and the size of the unevenness of the road surface to be detected. For example, when unevenness having at least one side length of 5 cm or more is to be detected, the effective range of the vehicle exterior imaging unit 122 uses the vehicle exterior imaging unit 122 to determine an object having a side length of 5 cm. Is determined as the distance that can be.

[Example of procedure for determining time interval]
The time interval for determining the image to be stored is determined according to the following procedure, for example. First, according to the procedure described above, a geographical interval for determining an image to be stored or a candidate image thereof is determined. Next, the current traveling speed of vehicle 120 is measured. Next, the above-mentioned time interval is determined based on the above-mentioned geographical interval and the traveling speed of the vehicle 120. The above-mentioned time interval may be determined in consideration of the frame rate of the vehicle exterior imaging unit 122. A typical frame rate value of a commercially available vehicle-mounted camera may be used as the frame rate of the vehicle exterior imaging unit 122.

  For the purpose of simplifying the explanation, it is assumed that the geographical interval is 25 m and the frame rate of the vehicle exterior imaging unit 122 is 30 [f/sec or fps]. In this case, as a condition regarding the time interval, for example, when the traveling speed of the vehicle 120 is 90 km/h or less, it is determined to save the image at an interval of one sheet per second. That is, it is decided to save the image every 30 frames.

  Similarly, when the traveling speed of the vehicle 120 is more than 90 km/h and 180 km/h, it is decided to save the image at an interval of two sheets per second. That is, it is decided to save the image every 15 frames. When the traveling speed of the vehicle 120 is more than 180 km/h and 270 km/h, it is decided to save the image at an interval of 3 sheets per second. That is, it is decided to save the image every 10 frames.

  On the other hand, when the traveling speed is more than 270 km/h and 360 km/h, it is decided to save the image at an interval of four sheets per second. In this case, it may be decided to save the image every eight frames, or it may be decided to save the image every seven frames.

  In the present embodiment, the distance condition determination unit 526 determines, for example, the image to be stored under the condition that the distance indicated by the distance information is not an image captured in a period smaller than a predetermined value. Determined as a condition. The distance condition determining unit 526 may determine a condition that the distance indicated by the distance information is an image captured in a period larger than a predetermined value, as a condition for determining an image to be saved. ..

  The predetermined value is (i) the speed of the vehicle 120, (ii) the specification or performance of the exterior imaging unit 122 that captures an image, (iii) the specification of the exterior imaging unit 122 of the vehicle 120 traveling in the vicinity, or Based on at least one of performance, (iv) weather conditions of the position or area where the image is captured, (v) time zone when the image is captured, and (vi) traffic volume of the position or area where the image is captured. May be decided. The above-mentioned predetermined value may change continuously or may change stepwise.

  When the inter-vehicle distance to the vehicle 120 ahead is small, most of the image is occupied by the image of the vehicle 120 ahead, and the amount of information about the road is small. Therefore, the value transmitted to the road surface information management unit 222 is low. On the other hand, when the inter-vehicle distance to the vehicle 120 ahead is small, the vehicle identification number can be read with high accuracy. By determining the distance condition as described above, the data capacity and the communication capacity can be efficiently used.

  In the present embodiment, for example, the image condition determination unit 528 sets the condition that the image is not the storage target when the vehicle identification number of the subject vehicle is recognized in the image captured by the vehicle exterior image capturing unit 122 as the storage target. Is determined as a condition for determining the image. For example, when the vehicle identification number of the vehicle in front is recognized in the image captured by the vehicle exterior imaging unit 122 of the specific vehicle 120, the inter-vehicle distance between the specific vehicle 120 and the vehicle in front is relatively small. Probability is high. Therefore, the value transmitted to the road surface information management unit 222 is low. Therefore, by determining the distance condition as described above, the data capacity and the communication capacity can be efficiently used.

  Note that in the present embodiment, the storage condition determination unit 420, the storage time determination unit 432, and the inter-vehicle distance determination unit 434 are provided in the vehicle 120 as an example, and the storage condition determination unit 420, the storage time determination unit 432, and The details of the inter-vehicle distance determination unit 434 have been described. However, the storage condition determination unit 420, the storage time determination unit 432, and the inter-vehicle distance determination unit 434 are not limited to this embodiment. In another embodiment, at least a part of the function of the storage condition determination unit 420 may be arranged in the management server 110. For example, at least one of the interval condition determining unit 524 and the distance condition determining unit 526 may be arranged in the management server 110. In another embodiment, at least a part of the function of the storage time determination unit 432 may be arranged in the management server 110. In another embodiment, at least a part of the function of the inter-vehicle distance determining unit 434 may be arranged in the management server 110.

  In the present embodiment, the inter-vehicle distance determining unit 434 acquires information indicating the distance to the vehicle ahead from the sensor arranged in the vehicle 120, and the inter-vehicle distance determining unit 434 determines based on the distance indicated by the distance information. Then, the details of the image management unit 124 have been described by taking the case of determining the image to be stored as an example. Further, in the present embodiment, the details of the image management unit 124 have been described by taking the case where the image analysis unit 450 analyzes the image and determines the image to be saved. However, the image management unit 124 is not limited to this embodiment.

  In another embodiment, the distance information may be information indicating that the vehicle identification number assigned to another vehicle is recognized in the image captured by the vehicle exterior imaging unit 122. In this case, for example, the image analysis unit 450 analyzes (i) the image, and (ii) provides information indicating whether or not the vehicle identification number assigned to another vehicle is recognized in the image to the inter-vehicle distance. It outputs to the determination unit 434. The inter-vehicle distance determining unit 434 may determine that the distance indicated by the distance information is smaller than a predetermined value when the vehicle identification number given to another vehicle is recognized.

  The distance information may be information indicating that the license plate 126 arranged in another vehicle is recognized in the image captured by the vehicle exterior imaging unit 122. In this case, for example, the image analysis unit 450 analyzes (i) the image, and (ii) provides information indicating whether or not the license plate 126 arranged on another vehicle is recognized in the image with the inter-vehicle distance. It outputs to the determination unit 434. The inter-vehicle distance determining unit 434 may determine that the distance indicated by the distance information is smaller than a predetermined value when the license plate 126 arranged on another vehicle is recognized.

  The distance information may be information indicating that the size of the image of the subject vehicle or a part of the subject vehicle in the image captured by the vehicle exterior imaging unit 122 satisfies a predetermined condition. In this case, for example, the image analysis unit 450 analyzes (i) the image, and (ii) the size of the image of the subject vehicle or a part of the subject vehicle in the image satisfies a predetermined condition. Information indicating whether or not it is output to the inter-vehicle distance determining unit 434. The inter-vehicle distance determining unit 434 may determine that the distance indicated by the distance information is smaller than a predetermined value when the size of the image satisfies the predetermined condition. The predetermined conditions include (i) a condition that the ratio of the size of the image of the subject vehicle or a part of the image of the subject vehicle to the size of the entire image is larger than a predetermined value, (ii) The size of the image of the subject vehicle or a part of the subject vehicle is larger than a predetermined size, for example.

  Details of information processing in the image management unit 124 will be described with reference to FIGS. 6, 7, 8, and 9. Specifically, an example of a series of information processing in the image management unit 124 will be described with reference to FIG. An example of processing in which the interval condition determination unit 524 determines the imaging interval (may be referred to as imaging frequency) of images that are candidates for storage will be described with reference to FIGS. 7 and 8. An example of processing in which the image analysis unit 450 distinguishes an image saved in the management server 110 from an image that is not saved in the management server 110 and is discarded will be described with reference to FIG. 9.

  FIG. 6 schematically shows an example of information processing in the image management unit 124. In one embodiment, the information processing shown in FIG. 6 is repeated in a predetermined cycle. The above cycle may vary depending on the traveling speed of the vehicle 120. In another embodiment, the information processing shown in FIG. 6 is executed, for example, every time a frame image forming a moving image is captured.

  According to the present embodiment, first, in S622 (step may be omitted as S), the speed information acquisition unit 522 acquires information indicating the traveling speed of the vehicle 120. Next, in S624, the interval condition determination unit 524 determines a temporal or geographical interval regarding image storage according to the traveling speed of the vehicle 120.

  In one embodiment, when the vehicle exterior imaging unit 122 captures a still image, the interval condition determining unit 524 determines the interval or frequency at which the vehicle exterior imaging unit 122 captures a still image. In another embodiment, when the vehicle exterior image capturing unit 122 captures a moving image, the interval condition determining unit 524 outputs the image extracting unit 440 to the image analyzing unit 450 from a plurality of frame images captured per unit time. Determine the interval or frequency of extracting frame images to be played.

  More specifically, the interval condition determining unit 524 uses, for example, the following procedure to capture a still image or extract a frame image (sometimes referred to as image sampling) in terms of time or geographical intervals. To decide. The time interval at which the image is sampled may be the elapsed time between two consecutive sampling times. The geographical interval at which the images are sampled may be the distance between two consecutive sampling locations. The time interval at which the image is sampled may be an example of the condition regarding the sampling time of the image. The geographical interval at which the image is sampled may be an example of the condition regarding the sampling position of the image.

  First, the interval condition determining unit 524 acquires a target value regarding the distance between two consecutive sampling positions. The interval condition determining unit 524 may acquire the information indicating the target value from an appropriate storage device (not shown) arranged in the vehicle 120 or the management server 110. The interval condition determination unit 524 may determine the above target value based on the specifications or performance of the vehicle exterior imaging unit 122 mounted on the vehicle 120. The interval condition determining unit 524 may analyze the image captured by the vehicle exterior image capturing unit 122 to determine the target value.

  The target value of the distance between two consecutive sampling positions is, for example, (i) the value of the effective range of the vehicle exterior imaging unit 122 mounted on the vehicle 120, or the typical effective range of a commercially available vehicle-mounted camera. And (ii) a target value for the degree of image overlap in two consecutively sampled images. The target value relating to the degree of overlapping of images may specify that at least a part of the subjects of the two images overlap, or that the subjects of the two images do not overlap.

  The interval condition determination unit 524 may acquire information indicating the effective range of the vehicle exterior imaging unit 122 from an appropriate storage device (not shown) arranged in the vehicle 120 or the management server 110. The interval condition determining unit 524 may analyze the image captured by the vehicle exterior imaging unit 122 to estimate the effective range of the vehicle exterior imaging unit 122. The interval condition determining unit 524 may acquire information indicating a target value regarding the degree of image overlap from an appropriate storage device (not shown) arranged in the vehicle 120 or the management server 110.

  For the purpose of facilitating the understanding of the information processing in the interval condition determining unit 524, the interval condition determining unit 524 uses the specific example shown in FIG. An example of a procedure for determining a target value regarding the distance between two consecutive sampling positions is described so that a part of the area corresponding to the effective range of the unit 122 overlaps. In the specific example shown in FIG. 7, the position L72 and the position L74 indicate two consecutive sampling positions. Note that time T72 indicates the time when vehicle 120 has passed position L72. Time T74 indicates the time when vehicle 120 passed position L74.

  In the specific example shown in FIG. 7, the image captured when vehicle 120 passes position L72 includes the image of region 720 on the road surface. The area 720 may be an area corresponding to the effective range of the vehicle exterior imaging unit 122 arranged at the position L72. Similarly, the image captured when the vehicle 120 passes the position L74 includes the image of the region 740 on the road surface. The area 740 may be an area corresponding to the effective range of the vehicle exterior imaging unit 122 arranged at the position L74.

  In the specific example shown in FIG. 7, the effective range of the vehicle exterior imaging unit 122 is 50 m. In addition, the interval condition determining unit 524 sets the distance between two consecutive sampling positions so that 50% of the area corresponding to the effective range of the vehicle exterior imaging unit 122 overlaps in two images that are continuously sampled. Determine the target value for.

The interval condition determining unit 524, for example, (i) the effective range ER[m] of the vehicle exterior imaging unit 122 and (ii) two consecutively sampled images that correspond to the effective range of the vehicle exterior imaging unit 122. The target value L _T regarding the distance between two consecutive sampling positions is calculated based on the following mathematical expression (1) by using the overlapping ratio DR [%].
[Formula 1]
_{L T [m] = ER [} m] × (100-DR [%]) / 100

According to Expression 1, in the specific example shown in FIG. 7, the target value L _T regarding the distance between two consecutive sampling positions is 25 m. In this case, the distance between the position L72 and the position L74 is 25 m, and one image is sampled every time the vehicle 120 travels 25 m. Further, of the road surface area 720 captured when the vehicle 120 passes the position L72, an area 722 occupying 50% of the front side in the traveling direction of the vehicle 120 and an image captured when the vehicle 120 passes the position L74. The region 744 of the road surface 740 that occupies 50% on the rear side in the traveling direction of the vehicle 120 may be substantially the same region. Accordingly, for example, even on a road with a relatively small traffic volume, the image of the road surface of the road can be uniformly sampled by using the single vehicle 120.

  Next, the interval condition determining unit 524 determines the target value regarding the elapsed time between two consecutive sampling times. For example, the interval condition determining unit 524 acquires information indicating the traveling speed of the vehicle 120 from the sensor arranged in the vehicle 120. The interval condition determining unit 524 also determines a target value regarding the elapsed time between two consecutive sampling times, based on the target value regarding the distance between two consecutive sampling positions and the traveling speed of the vehicle 120. To do.

The interval condition determining unit 524 uses, for example, (i) the target value L _T [m] regarding the distance between two consecutive sampling positions and (ii) the traveling speed v [m/s] of the vehicle 120. , A target value T _T regarding the elapsed time between two consecutive sampling times is determined based on the following equation (2).
[Formula 2]
T _T [s]=L _T [m]÷v [m/s]

The interval condition determining unit 524 may determine the target value T _T regarding the elapsed time between two consecutive sampling times so that the target value F _T [sheets/s] of the sampling frequency is an integer. The target value F _T of the sampling frequency may be the reciprocal of the target value T _T regarding the elapsed time between two consecutive sampling times.

For example, as shown in FIG. 8, when the traveling speed 822 of the vehicle 120 fluctuates, (i) the vehicle 120 has a distance (50 m in the specific example of FIG. 7) corresponding to the effective range of the vehicle exterior imaging unit 122. Travel time 824 and (ii) Travel time 826 for the vehicle 120 to travel a target value L _T (25 m in the example of FIG. 7) for the distance between two consecutive sampling positions. Also fluctuates.

In one embodiment, the interval condition determining unit 524 determines the required time 826 as the target value T _T regarding the elapsed time between two consecutive sampling times. For example, in the specific example shown in FIG. 7, when the traveling speed of the vehicle 120 is 60 km/h, the interval condition determining unit 524 sets the target value T _T regarding the elapsed time between two consecutive sampling times to 1 Determined to be 5 seconds. When the traveling speed of the vehicle 120 is 90 km/h, the interval condition determining unit 524 determines the target value T _T regarding the elapsed time between two consecutive sampling times to be 1 second.

In another embodiment, the interval condition determining unit 524 first calculates the calculated value of the sampling frequency 828 [sheets/s] at the traveling speed as the reciprocal of the required time 826 corresponding to the traveling speed of the vehicle 120. Next, the interval condition determination unit 524 determines the target value F _T [sheets/s] of the sampling frequency 828 by moving the calculated value of the sampling frequency 828 [sheets/s] to the right of the decimal point. Next, the interval condition determining unit 524 determines the reciprocal of the target value F _T [sheets/s] of the sampling frequency 828 as the target value T _T regarding the elapsed time between two consecutive sampling times.

For example, in the specific example shown in FIG. 7, when the traveling speed [km/h] of the vehicle 120 is more than 0 and 90 or less, the target value F _T [sheets/s] of the sampling frequency is 1. At this time, the interval condition determining unit 524 determines the target value T _T regarding the elapsed time between two consecutive sampling times as 1 second. When the traveling speed [km/h] of the vehicle 120 is more than 90 and 180 or less, the target value F _T [sheets/s] of the sampling frequency is 2. At this time, the interval condition determining unit 524 determines the target value T _T regarding the elapsed time between two consecutive sampling times to be 0.5 seconds.

  Next, in S626, the storage time determination unit 432 determines whether or not the current time or current position is the time or position for saving the image. When it is determined that the current time or current position is not the time or position at which the image is sampled (NO in S626), the storage time determination unit 432 determines in S628 the image captured at the current time or current position. It is determined that the sampling is unnecessary, and the process ends.

  On the other hand, when it is determined that the current time or the current position is the time or the position to save the image (YES in S626), the image extracting unit 440 identifies the image as the candidate for the saving and saves the image. The image data is output to the image analysis unit 450. Then, the process proceeds to S660. Further, the processing of S622 and S624 may be repeated to determine the next sampling time or sampling position. The time when the information processing shown in FIG. 6 is executed next may be determined based on the next sampling time or the next sampling time.

  According to this embodiment, the processes of S642 to S648 are executed in parallel with the processes of S622 to S628. In S642, the following distance determination unit 434 measures the following distance to the vehicle 120 ahead. In S646, it is determined whether or not the inter-vehicle distance is equal to or less than a predetermined threshold value.

  When the above-mentioned inter-vehicle distance is equal to or less than the predetermined threshold value (YES in S646), in S648, the inter-vehicle distance determining unit 434 determines that the image captured at the current time does not need to be stored, To finish. On the other hand, when the inter-vehicle distance is not less than or equal to the predetermined threshold value (NO in S646), the image extraction unit 440 identifies the image to be saved and outputs the image data of the image to the image analysis unit 450. .. Then, the process proceeds to S660.

  In another embodiment, if the inter-vehicle distance is not equal to or less than the predetermined threshold value (NO in S646), the process of S626 may be performed. In still another embodiment, if the inter-vehicle distance is not equal to or less than the predetermined threshold value (NO in S646), the process of S682 may be performed.

  Next, in S660, the image analysis unit 450 determines whether or not the vehicle identification number arranged on the license plate 126 of the one or more vehicles 120 is recognized in the image extracted by the image extraction unit 440. When the vehicle identification number in the image is recognized (YES in S660), in S672, the image analysis unit 450 determines that the image is not a storage target in the road surface management server 220. Further, in S674, the image analysis unit 450 determines to store the vehicle identification number and outputs the vehicle identification number to the vehicle information transmission unit 472. After that, the vehicle information transmission unit 472 transmits the vehicle information including the vehicle identification number to the vehicle management server 240, and ends the process.

  On the other hand, when the vehicle identification number in the image is not recognized (NO in S660), in S682, the image analysis unit 450 determines that the image is to be stored in the road surface management server 220, and the image of the image is displayed. The data is output to the image information transmission unit 474. After that, the image information transmitting unit 474 transmits the image information including the above-mentioned image data to the road surface management server 220, and the processing is ended.

  FIG. 9 schematically illustrates an example of an image captured by the vehicle exterior imaging unit 122 of the vehicle 120. In step S660 of the information processing method described with reference to FIG. 6, using the specific example shown in FIG. 9, the image analysis unit 450 analyzes the image and determines whether the image is to be saved. The details of the process for determining?

  In the present embodiment, the vehicle exterior imaging unit 122 of the vehicle 120 captures a plurality of frame images per second, and one frame image is sampled per second. Note that, in FIG. 9, triangular marks indicate timings at which frame images are sampled. An image 902 shows an image sampled at time T92, and an image 904 shows an image sampled at time T94. In the image 902 and the image 904, a dotted line 910 indicates an area within the effective range of the vehicle exterior imaging unit 122. A line 930 indicates a lane marking of the road.

  In the image 902, the preceding vehicle 920 traveling on the same lane as the vehicle 120 is traveling outside the effective range of the vehicle exterior imaging unit 122. Therefore, the image analysis unit 450 cannot recognize the vehicle identification number arranged on the license plate 926 of the preceding vehicle 920. Therefore, the image analysis unit 450 determines that the image 902 is to be stored in the road surface management server 220. The image analysis unit 450 also outputs the image data of the image 902 to the image information transmission unit 474.

  On the other hand, in the image 904, the preceding vehicle 920 traveling on the same travel lane as the vehicle 120 is traveling within the effective range of the vehicle exterior imaging unit 122. Therefore, if the weather conditions are not bad, the image analysis unit 450 can recognize the vehicle identification number arranged on the license plate 926 of the preceding vehicle 920.

  As shown in FIG. 9, according to the present embodiment, the image analysis unit 450 can recognize the vehicle identification number arranged on the license plate 926 of the preceding vehicle 920. Therefore, the image analysis unit 450 determines that the image 904 is not the storage target in the road surface management server 220. On the other hand, the image analysis unit 450 determines that the vehicle identification number of the preceding vehicle 920 is the storage target of the vehicle management server 240. Therefore, the image analysis unit 450 discards the image data of the image 904 and outputs information indicating the vehicle identification number of the preceding vehicle 920 reflected in the image 904 to the vehicle information transmission unit 472.

  According to this embodiment, an image having a large road surface area such as the image 902 is transmitted to the management server 110, while an image having a small road surface area such as the image 904 is not transmitted to the management server 110. As a result, the resources of the communication network 10 and the management server 110 can be efficiently used. Even if the image of the road surface is small like the image 904, if the vehicle identification number of the preceding vehicle 920 is recognized in the image, information indicating the vehicle identification number is transmitted to the management server 110. To be done. As a result, the image captured by the vehicle 120 can be effectively used.

  Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is apparent to those skilled in the art that various changes or improvements can be added to the above-described embodiment. Further, the matters described in the specific embodiment can be applied to other embodiments within a technically consistent range. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, the specification, and the drawings is "preceding" and "prior to prior". It should be noted that the output of the previous process can be realized in any order unless it is used in the subsequent process. The operation flow in the claims, the specification, and the drawings is described by using “first,” “next,” and the like for convenience, but it is essential that the operations are performed in this order. Not a thing.

  10 communication network, 100 management system, 110 management server, 120 vehicle, 122 exterior imaging unit, 124 image management unit, 126 license plate, 140 communication terminal, 220 road surface management server, 222 road surface information management unit, 224 road surface information storage unit, 240 vehicle management server, 242 vehicle information management section, 244 vehicle information storage section, 322 GPS signal receiving section, 324 running state detection section, 330 driving section, 340 communication section, 350 control section, 352 input/output control section, 354 vehicle control Unit, 356 communication control unit, 420 storage condition determination unit, 432 storage time determination unit, 434 inter-vehicle distance determination unit, 440 image extraction unit, 450 image analysis unit, 460 accompanying information acquisition unit, 472 vehicle information transmission unit, 474 image information Transmission unit, 522 speed information acquisition unit, 524 interval condition determination unit, 526 distance condition determination unit, 528 image condition determination unit, 720 region, 722 region, 740 region, 744 region, 822 traveling speed, 824 required time, 826 required time , 828 Sampling frequency, 902 image, 904 image, 910 dotted line, 920 preceding vehicle, 926 license plate

Claims (13)

A storage determination unit that is mounted on a mobile body and that determines an image to be stored among a plurality of images captured by an image capturing unit that captures an external state of the mobile body,
A condition determining unit that determines a condition for determining the image to be stored,
Equipped with
The condition determination unit,
A speed information acquisition unit for acquiring speed information indicating the speed of the moving body,
As conditions for determining the image to be stored, (i) a condition regarding a time interval from when one image is determined as the storage target until the next image to be stored is determined, and ( ii) Based on the speed of the moving body, at least one of the conditions regarding the distance traveled by the moving body after one image is determined as a storage target and before the next image to be stored is determined. And the interval condition determination unit that determines
Have
The storage determination unit determines the image to be stored according to the condition determined by the condition determination unit,
Image management device. The image management device,
A distance information acquisition unit that acquires distance information indicating a distance between the moving body and an object existing in the moving direction of the moving body,
Further equipped with,
The condition determination unit,
A distance condition determination unit that determines a condition that the image is not an image captured when the distance indicated by the distance information is smaller than a predetermined value, as a condition for determining the image to be stored,
Further having,
The image management device according to claim 1. The moving body is a vehicle,
The object existing in the moving direction of the moving body is another vehicle existing in front of the moving body,
A unique vehicle identification number is assigned to each of the multiple vehicles,
The condition determination unit further includes
When the vehicle identification number given to the other vehicle included in the image captured by the image capturing unit is recognized, the condition that the image is not the storage target is used to determine the image to be stored. An image condition determination unit that determines the condition,
Has,
The image management device according to claim 2. A storage determination unit that is mounted on a mobile body and that determines an image to be stored among a plurality of images captured by an image capturing unit that captures an external appearance of the mobile body,
A distance information acquisition unit that acquires distance information indicating a distance between the moving body and an object existing in the moving direction of the moving body,
Equipped with
The storage determination unit determines that the image captured by the image capturing unit when the distance indicated by the distance information is smaller than a predetermined value is not the storage target,
Image management device. The moving body is a vehicle,
The object existing in the moving direction of the moving body is another vehicle existing in front of the moving body,
A unique vehicle identification number is assigned to each of the multiple vehicles,
The distance information is information indicating that the vehicle identification number given to the other vehicle included in the image captured by the image capturing unit is recognized,
When the vehicle identification number assigned to the other vehicle is recognized, the storage determination unit determines that the distance indicated by the distance information is smaller than the predetermined value,
The image management device according to claim 4. When the vehicle identification number given to the other vehicle included in the image captured by the imaging unit is recognized, an identification number storage unit that determines to store the recognized vehicle identification number,
Further comprising,
The image management device according to claim 3 or 5. An identification number transmitting unit that transmits information including the vehicle identification number determined to be stored, to a vehicle information collection device that collects the vehicle identification number,
Further comprising,
The image management device according to claim 6. An image transmitting unit that transmits information including image data of the image to be stored to an image information collecting device that collects images,
Further comprising,
The image management device according to any one of claims 1 to 7. An image management apparatus according to any one of claims 1 to 8 is provided,
vehicle. An image management apparatus according to any one of claims 1 to 8,
An image information collection device that collects image data of the images to be stored from a plurality of the image management devices,
Equipped with
The image to be saved includes a road image,
The image information collecting device analyzes the image to be stored and generates road surface information relating to a road surface state of the road,
Road information management system.   A program for causing a computer to function as the image management device according to any one of claims 1 to 8. A computer, mounted on a mobile body, a storage determination step of determining an image to be stored among a plurality of images captured by an image capturing unit that captures an external state of the mobile body;
A condition determining step in which the computer determines a condition for determining the image to be stored,
Have
The condition determining step includes
A speed information acquisition step in which the computer acquires speed information indicating the speed of the moving body;
As a condition for the computer to determine the image to be stored, (i) a condition regarding a time interval from when one image is determined to be stored and until the next image to be stored is determined. And (ii) at least one of the conditions regarding the distance traveled by the moving body after one image is determined as the saving target and before the next image to be saved is determined as the moving body. Interval condition determination step of determining based on the speed of,
Including,
The storage determination step includes a step in which the computer determines the image to be stored according to the condition determined in the condition determination step.
Image management method. A computer, mounted on a mobile body, a storage determination step of determining an image to be stored among a plurality of images captured by an image capturing unit that captures an external state of the mobile body;
A distance information acquisition step in which the computer acquires distance information indicating a distance between the moving body and an object existing in a moving direction of the moving body;
Have
The storage determination step includes a step in which the computer determines that the image captured by the imaging unit when the distance indicated by the distance information is smaller than a predetermined value is not the storage target.
Image management method.