WO2019207796A1 - Drive recorder information providing system, drive recorder information providing method, program, and drive recorder - Google Patents

Drive recorder information providing system, drive recorder information providing method, program, and drive recorder Download PDF

Info

Publication number
WO2019207796A1
WO2019207796A1 PCT/JP2018/017316 JP2018017316W WO2019207796A1 WO 2019207796 A1 WO2019207796 A1 WO 2019207796A1 JP 2018017316 W JP2018017316 W JP 2018017316W WO 2019207796 A1 WO2019207796 A1 WO 2019207796A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
drive recorder
image
feature information
captured
Prior art date
Application number
PCT/JP2018/017316
Other languages
French (fr)
Japanese (ja)
Inventor
田中 正道
篤 古城
Original Assignee
株式会社ウフル
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社ウフル filed Critical 株式会社ウフル
Priority to JP2018538658A priority Critical patent/JP6448872B1/en
Priority to PCT/JP2018/017316 priority patent/WO2019207796A1/en
Publication of WO2019207796A1 publication Critical patent/WO2019207796A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00Registering or indicating the working of vehicles
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles

Definitions

  • the present invention relates to a technology for acquiring information detected by a vehicle using IoT (Internet of Things).
  • IoT Internet of Things
  • Japanese Patent Application Laid-Open No. H10-228561 discloses a technique for analyzing image obtained by a drive recorder, calculating feature information, and extracting and recording an image having a specific feature.
  • information detected by a vehicle includes information with high rarity and high utility value, such as information that can be acquired only at a specific location and at a specific timing. For example, a video that accidentally captures a traffic accident may be useful in investigating the cause of the accident.
  • Patent Document 1 only the image inside the drive recorder is recorded, and the recorded image cannot be used effectively.
  • the object of the present invention is to effectively utilize information of images taken by a plurality of vehicles using IoT.
  • the present invention provides a first control means for controlling an image sensor module of the drive recorder so as to analyze the image captured by the drive recorder and extract feature information, and the captured image Second control means for controlling the image sensor module of the drive recorder so as to detect whether or not a predetermined event has occurred, and image feature information when the predetermined event is detected.
  • Acquiring means for acquiring from a plurality of the drive recorders via a communication network together with information indicating the taken position and time, and providing means for providing information generated based on the acquired characteristic information to an external server A drive recorder information providing system is provided.
  • the apparatus further comprises interference means for interfering with a host controller of the drive recorder so as to provide the feature information to the acquisition means via the communication network when the predetermined event is detected.
  • the predetermined event includes at least one of a traffic accident, weather, and road congestion.
  • provision of information to the external server is executed when the acquired feature information reaches a predetermined amount for one event.
  • the information processing apparatus further includes a payment unit that pays a reward to a manager of the vehicle provided with the drive recorder that captures an image that is a source of information provided to the external server.
  • the payment means determines the content of the reward based on the scarcity of the feature information.
  • the payment means determines the content of the reward based on the amount of consideration for providing information to the external server. In a preferred aspect, the payment means provides the manager of the vehicle provided with the drive recorder based on the number of times the feature information is acquired from the drive recorder that captured the image that is the source of the information provided to the external server. In contrast, the reward is paid.
  • the present invention provides a step of controlling an image sensor module of the drive recorder so as to analyze the image captured by the drive recorder and extract feature information, and based on the captured image Controlling the image sensor module of the drive recorder so as to detect whether a predetermined event has occurred, extracting feature information of an image captured by a drive recorder installed in a vehicle, and On the basis of the step of detecting that the predetermined event has occurred, and the feature information of the image when the predetermined event is detected, together with the information indicating the position and time at which the image was captured, via the communication network Acquiring from a plurality of the drive recorders, and information generated based on the acquired feature information, Providing drive recorder information providing method and a program comprising the steps of providing separate component server.
  • the present invention provides an image sensor module, first control means for controlling the image sensor module so as to extract feature information by analyzing an image captured by the image sensor module, and the imaging Second feature means for controlling the image sensor module so as to detect whether or not a predetermined event has occurred on the basis of the image, and feature information of the image when the predetermined event is detected.
  • a drive recorder comprising a communication means for providing information via a communication network to a server that provides information based on the information to an external server together with information indicating the position and time at which the image was taken.
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of an edge device 110 included in a drive recorder information providing system 100.
  • FIG. 2 is a diagram illustrating an example of a functional configuration of an edge device 110.
  • FIG. It is a figure which shows an example of the hardware constitutions of the drive recorder information server included in the drive recorder information provision system. It is a figure which shows an example of a function structure of the drive recorder information server. It is a figure which shows operation
  • FIG. 1 is a diagram showing a configuration example of a drive recorder information providing system 100 according to an embodiment of the present invention.
  • the drive recorder information providing system 100 includes a drive recorder information server 130, a plurality of edge devices 110, and a plurality of IoT devices 140.
  • the edge device 110 and the IoT device 140 are each mounted on one vehicle.
  • a vehicle on which the edge device 110 and the IoT device 140 are mounted is represented by a dashed-dotted rectangle.
  • the number of each apparatus shown in FIG. 1 is an illustration, and is not limited to this.
  • the IoT device 140 is connected to the edge device 110 via the communication network 160.
  • the IoT device 140 is a drive recorder, for example.
  • the IoT device 140 includes an imaging mechanism including a lens and an image sensor module, a storage for recording image data representing a captured image, and recording to the imaging mechanism and the storage ( And a host controller for controlling the deletion of recorded images).
  • the image sensor module includes an image sensor, a microcomputer, and the like. As will be described later, the first control means and the second control means of the edge device control the image sensor module.
  • the interference control means of the edge device receives interference from the host controller.
  • the IoT device 140 is installed in the vehicle interior of the vehicle so that the imaging direction of the camera coincides with the front direction of the vehicle, and records image data of an image captured by the camera while the vehicle is traveling in the storage.
  • An image captured by the IoT device 140 may be a still image or a moving image.
  • the IoT device 140 provides image data representing an image captured by the camera to the edge device 110 via the communication network 160.
  • the communication network 160 may include, for example, a LAN (Local Area Network) or a wireless LAN laid in the vehicle.
  • the edge device 110 is a relay device (for example, a gateway) that is connected to the communication network 160 and wirelessly connected to the communication network 150.
  • the edge device 110 mediates data communication between a device connected to the communication network 150 and a device connected to the communication network 160.
  • the communication network 150 may be configured including the Internet, for example.
  • the communication network 150 is connected to an external server 120 for acquiring information related to traffic accidents and disclosing it to a large number of drivers.
  • Specific examples of the external server 120 include a traffic information server that is operated and managed by a road administrator such as a prefecture, the Ministry of Land, Infrastructure, Transport and Tourism, or a commissioned organization thereof.
  • the communication network 150 includes feature information (in other words, information that characterizes the event) that represents the characteristics of the image captured by the IoT device 140 when a specific event such as a traffic accident occurs is detected.
  • a drive recorder information server 130 that acquires position information indicating the generation position and time information indicating the generation time from the edge device 110 is connected.
  • the drive recorder information server 130 is based on the information acquired from the edge device 110, and accident summary information indicating the outline of the traffic accident that has occurred (information indicating the degree of the traffic accident that has occurred, the location and time of occurrence) ) And provided to the external server 120.
  • accident summary information indicating the outline of the traffic accident that has occurred (information indicating the degree of the traffic accident that has occurred, the location and time of occurrence)
  • the external server 120 As a result, a large number of drivers using the external server 120 can share information on traffic accidents.
  • it demonstrates centering on the edge device 110 and the drive recorder information server 130 which show the characteristic of this embodiment notably.
  • the edge device 110 includes a processor 111, a memory 112, a storage 113, and a communication device 114, as shown in FIG. These devices are connected via a bus 115.
  • the processor 111 executes various processes by reading the program into the memory 112 and executing it.
  • the processor 111 may be configured by a CPU (Central Processing Unit).
  • the memory 112 stores a program executed by the processor 111.
  • the memory 112 may be constituted by a ROM (Read Only Memory) or a RAM (Random Access Memory).
  • the storage 113 stores various data and programs.
  • the storage 113 may be configured by a hard disk drive or a flash memory.
  • the communication device 114 performs data communication via the communication network 150 or the communication network 160.
  • FIG. 3 is a diagram illustrating an example of a functional configuration of the edge device 110.
  • the edge device 110 includes an extraction unit 211, a detection unit 212, a transmission unit 213, and a communication unit 214.
  • the communication unit 214 is the communication device 114 in FIG. 2
  • the imaging unit 215 is the IoT device 140 connected to the edge device 110 via the communication network 160.
  • the extraction unit 211, the detection unit 212, and the transmission unit 213 in FIG. 3 are operated or communicated by the processor 111 in cooperation with the program stored in the memory 112 or the storage 113 and the processor 111 that executes the program. It is a software module realized by controlling the means 214 (communication device 114).
  • the extraction unit 211 extracts feature information of the image from the image captured by the imaging unit 215.
  • the extraction unit 211 is a first control unit that controls the image sensor module of the drive recorder so as to analyze the image captured by the drive recorder and extract the feature information.
  • Specific examples of the feature information extracted by the extraction unit 211 include various information about the image such as color information, edge information, fractal dimension indicating the complexity of the image, spectrum information obtained by DFT (Discrete Fourier Transform), and the like.
  • DFT Discrete Fourier Transform
  • existing algorithms may be used as appropriate.
  • the detection unit 212 detects a predetermined event based on the image captured by the imaging unit 215.
  • the detection unit 212 is a second control unit that controls the image sensor module so as to detect that the person has taken a predetermined action based on the image.
  • the predetermined event refers to a collision accident (that is, a traffic accident) between a vehicle on which the edge device 110 is mounted and an object such as another vehicle, a wall, or a power pole, or a person or an animal.
  • the following method can be considered as a specific method for detecting the occurrence of a traffic accident.
  • the detection unit 212 compares the feature information extracted by the extraction unit 211 with each of the plurality of determination criterion information, and determines that a traffic accident has occurred when the same or similar determination criterion information exists. You can do that. For the same or similar determination of feature information and determination criterion information, depending on the distance between points when the former and the latter are mapped as points in the same coordinate space (for example, multidimensional Euclidean space). A mode of determination is conceivable.
  • the occurrence of a predetermined event is detected based on the feature information extracted by the extraction unit 211, but the occurrence of the predetermined event is detected by performing pattern recognition on the image captured by the imaging unit 215. You may do it. In short, any mode may be used as long as a predetermined event is detected based on an image captured by the imaging unit 215.
  • an acceleration sensor or an impact sensor is connected to the edge device 110 via the communication network 160, and a measurement result of each sensor (that is, a change in acceleration of the vehicle on which the edge device 110 is mounted or an impact applied to the vehicle). The occurrence of a traffic accident may be detected in consideration of the above.
  • the transmission unit 213 receives the feature information extracted by the extraction unit 211 for the image in which the predetermined event is detected, triggered by the detection unit 212 detecting a predetermined event (a traffic accident in this embodiment). Position information indicating the position at which the image was captured and time information indicating the time at which the image was captured are transmitted to the drive recorder information server 130 via the communication unit 214. In other words, the transmission unit 213 provides the feature information, the position information, and the time information to the acquisition unit of the drive recorder information server 130 via the communication network in response to the detection of the predetermined event. Interference means for interfering with the host controller of the drive recorder.
  • a set of feature information, position information, and time information is referred to as “drive recorder information”.
  • the position information may be acquired using GPS, a beacon of a wireless access point in the communication network 150, and the time information may be acquired using GPS or a real-time clock.
  • the communication address of the drive recorder information server 130 that is the transmission destination of the drive recorder information may be written in advance in the storage 113 or embedded in the program.
  • FIG. 4 is a diagram illustrating a configuration example of the drive recorder information server 130.
  • the drive recorder information server 130 includes a processor 131, a memory 132, a storage 133, and a communication device 134. These devices are connected via a bus 135. Since the processor 131, the memory 132, the storage 133, the communication device 134, and the bus 135 are the same as the processor 111, the memory 112, the storage 113, the communication device 114, and the bus 115 described above, description thereof is omitted.
  • FIG. 5 is a diagram illustrating an example of a functional configuration of the drive recorder information server 130.
  • the drive recorder information server 130 includes an acquisition unit 231, a provision unit 232, a payment unit 233, and a communication unit 234.
  • the communication means 234 is the communication device 134 in FIG.
  • the acquisition unit 231, the payment unit 233, and the provision unit 232 in FIG. 5 perform the calculation or communication by the processor 131 in cooperation with the program stored in the memory 132 or the storage 133 and the processor 131 that executes the program.
  • a software module realized by controlling the means 234 (communication device 134).
  • the acquisition unit 231 acquires drive recorder information from the edge device 110 via the communication network 150.
  • the acquisition unit 231 acquires drive recorder information by receiving drive recorder information transmitted via the communication network 150.
  • the drive recorder information is transmitted from the edge device 110 to the drive recorder information server 130 via the communication network 150 when the traffic accident is detected by the detection unit 212, but from the drive recorder information server 130
  • the drive recorder information may be acquired by polling.
  • the acquisition unit 231 is a unit that periodically performs the polling.
  • the providing unit 232 generates accident summary information from the drive recorder information acquired by the acquiring unit 231 and transmits it to the external server 120. More specifically, the providing unit 232 determines the degree of a traffic accident based on the feature information included in the drive recorder information acquired by the acquiring unit 231 (a serious accident that requires subsequent vehicle closure, or the occurrence of an accident). Moderate accidents that require traffic regulation such as deceleration when passing the vicinity of the location, minor accidents that require attention to the surroundings when passing the neighborhood of the accident location, although traffic regulation is not necessary) judge.
  • the providing unit 232 transmits the information indicating the degree of the traffic accident and the position information and time information included in the drive recorder information to the external server 120 as accident summary information.
  • the accident summary information provided from the drive recorder information server 130 is shared as it is with many drivers, and the situation worsens. Can be prevented.
  • determination standard information indicating the range of feature information (or typical feature information) for each degree of traffic accident is stored in the storage 133 in advance.
  • a method of determining the degree of a traffic accident by comparing the feature information included in the drive recorder information acquired by the acquisition unit 231 and the determination criterion information is conceivable.
  • the payment unit 233 calculates a remuneration to be paid to the manager of the vehicle provided with the image capturing apparatus that has captured the image that is the source of information provided to the external server 120, and pays the remuneration.
  • transfer destination information for example, a bank account number
  • the payment unit 233 transfers the reward to the transfer destination indicated by the transfer destination information corresponding to the communication address of the transmission source of the drive recorder information acquired by the acquisition unit 231.
  • a notification that the reward has been transferred may be transmitted to the information provider.
  • the remuneration to be paid to the sender of the drive recorder information may be calculated according to a calculation formula for consideration for providing information in a contract for information provision.
  • this calculation formula include a calculation formula that increases the consideration as the rarity of feature information (for example, the severity of an accident) increases, and a calculation formula that increases the consideration as the number of times the drive recorder information is provided. It is done.
  • an incentive for providing the drive recorder information can be given to the manager of the vehicle, and the manager's interest in providing the information can be increased.
  • the aspect performed whenever it provides information may be sufficient, for example, the aspect which pays the reward which generate
  • FIG. 6 is a sequence diagram showing operations of the edge device 110 and the drive recorder information server 130 included in the drive recorder information providing system 100.
  • Step SA100 in FIG. 6 is a process executed by the extraction unit 211 of the edge device 110.
  • the extraction unit 211 analyzes the image data provided from the imaging unit 215 and extracts feature information.
  • Step SA110 subsequent to step SA100 is processing executed by the detection unit 212 of the edge device 110.
  • the detection unit 212 detects a predetermined event (traffic accident) based on the feature information provided from the extraction unit 211.
  • Step SA120 following step SA110 is a process executed by the transmission means 213 of the edge device 110.
  • the transmission unit 213 transmits drive recorder information including the feature information extracted by the extraction unit 211 for the image in which the predetermined event is detected by the detection unit 212 to the drive recorder information server 130.
  • the drive recorder information transmitted from the edge device 110 in this way is transmitted to the drive recorder information server 130 via the communication network 150.
  • Step SB100 in FIG. 6 is a process executed by the acquisition unit 231 of the drive recorder information server 130.
  • the acquisition unit 231 acquires drive recorder information transmitted from the edge device 110.
  • Step SB110 subsequent to step SB100 is a process executed by the providing unit 232 of the drive recorder information server 130.
  • the providing unit 232 transmits the accident summary information generated based on the drive recorder information acquired in step SB100 to the external server 120.
  • the accident summary information transmitted from the drive recorder information server 130 in this way is transmitted to the external server 120 via the communication network 150.
  • the external server 120 publishes accident summary information received via the communication network 150 (for example, posted on a predetermined web page or broadcasted on a radio or the like).
  • Step SB120 following step SB110 is a process executed by the payment means 233 of the drive recorder information server 130.
  • the payment means 233 calculates a remuneration to be paid to the manager of the vehicle provided with the image capturing apparatus that captured the image that is the source of the information provided to the external server 120, and pays the remuneration.
  • an incentive for providing the drive recorder information can be given to the manager of the vehicle, and the manager's interest in providing the information can be increased.
  • the process of step SB120 is executed after the process of step SB110. However, the process of step SB120 may be executed first, and then the process of step SB110 may be executed.
  • the drive recorder information providing system 100 of the present embodiment it is possible to acquire information on traffic accidents from a plurality of vehicles using IoT and provide it to an external system. At the same time, it becomes possible to increase the interest, motivation and motivation of the vehicle manager for providing information. With the increasing interest in providing information, the introduction of the drive recorder according to the present invention is widespread, and as a result, it is expected that the quantity and quality of information acquired will be improved. A virtuous cycle in which the spread of the drive recorder according to the present invention is further accelerated can be expected by improving the amount and quality of the acquired information.
  • the image data captured by the IoT device 140 is not transmitted from the edge device 110 to the drive recorder information server 130 as it is.
  • the image data captured by the IoT device 140 is transmitted to the drive recorder information server 130, and the image data is analyzed by the drive recorder information server 130.
  • the amount of data transmitted from the edge device 110 to the drive recorder information server 130 via the network 150 can be reduced.
  • data transmission from the edge device 110 to the drive recorder information server 130 is performed only when a predetermined event is detected, communication is performed in comparison with a mode in which data transmission from the edge device 110 to the drive recorder information server 130 is always performed.
  • the amount of data transmitted from the edge device 110 to the drive recorder information server 130 via the network 150 can be further reduced.
  • the processing load of the drive recorder information server 130 can be reduced and the response of the drive recorder information server 130 can be reduced as compared with the mode in which the image data is analyzed by the drive recorder information server 130.
  • the drive recorder information server 130 is less likely to be down due to overload.
  • the present embodiment it is obtained from a plurality of vehicles using IoT while speeding up the response of the drive recorder information server 130, reducing downtime of the drive recorder information server 130, and preventing an increase in cost.
  • Information can be processed as necessary and provided to an external system for sharing with a large number of drivers, and the vehicle manager's interest in providing information can be increased.
  • the extraction unit 211, the detection unit 212, and the transmission unit 213 in the edge device 110 are software modules, but may be electronic circuits such as an ASIC.
  • the acquisition unit 231, the providing unit 232, and the payment unit 233 in the drive recorder information server 130 may be an electronic circuit such as an ASIC.
  • the payment means 233 is not essential and may be omitted. This is because even if the payment means 233 is omitted, it is possible to acquire feature information of traffic accidents from a plurality of vehicles using IoT, provide it to an external system, and share it with many drivers.
  • information related to a traffic accident is provided to an external system.
  • information related to the degree of weather fluctuation such as rainfall or snowfall or the degree of congestion on a road may be provided to an external system.
  • any mode may be used as long as it provides the external system with information including at least one of information related to traffic accidents, weather fluctuations, and road congestion, and the occurrence position and occurrence time of the event.
  • the feature information acquired for one event reaches a predetermined amount (represents the same or similar event
  • Information may be transmitted from the drive recorder information server 130 to the external server 120 when the number of received drive recorder information having the same or similar occurrence position and occurrence time reaches a predetermined amount). This is to ensure the reliability of information shared by a large number of drivers via an external server.
  • different destinations are set in the drive recorder information server 130 for information related to traffic accidents or road congestion and weather fluctuation information, and the corresponding information is transmitted to preset destinations. Also good.
  • an external server operated by a road administrator or an external server operated by a transportation company is set as the information transmission destination, and information related to weather fluctuations is operated by the Japan Meteorological Agency.
  • An external server to be managed may be set as an information transmission destination.
  • the IoT device 140 connected to the edge device 110 via the communication network 160 plays the role of the imaging unit 215.
  • the drive recorder information providing system 100 of the above embodiment can be configured by combining the existing drive recorder and the edge device 110 in this way.
  • a drive recorder including a communication unit 214, an imaging unit 215, an extraction unit 211, a detection unit 212, and a transmission unit 213 is provided as an imaging device.
  • a drive recorder information providing system may be configured by connecting an imaging device to the communication network 150.
  • a program that causes the processor 111 of the edge device 110 to function as the extraction unit 211, the detection unit 212, and the transmission unit 213 is preinstalled in the edge device 110, and the processor 131 of the drive recorder information server 130 is acquired by the acquisition unit 231.
  • a program that functions as the payment unit 233 and the providing unit 232 is installed in the drive recorder information server 130 in advance.
  • the image sensor module of the drive recorder is controlled so as to analyze the image captured by the drive recorder and extract the feature information.
  • Step controlling the image sensor module of the drive recorder so as to detect whether a predetermined event has occurred based on the captured image, and image feature information when the predetermined event is detected Together with information indicating the position and time at which the image was taken from a plurality of imaging devices via a communication network, and information generated based on the acquired feature information to an external server It is only necessary that the providing step is executed.
  • the program for executing the above steps can be distributed by downloading via a telecommunication network such as the Internet.

Abstract

This drive recorder information providing method comprises: a step (SA100) for extracting feature information of images captured by IoT devices (140) installed in a vehicle; a step (SA110) for detecting the occurrence of a prescribed event on the basis of the images; a step (SB100) for acquiring the feature information of the images when the prescribed event has been detected, together with information indicating the location and the time when the images were captured, from a plurality of the IoT devices (140); and a step (SB110) for providing information generated on the basis of the acquired feature information to an external server.

Description

ドライブレコーダ情報提供システム、ドライブレコーダ情報提供方法、プログラム、およびドライブレコーダDrive recorder information providing system, drive recorder information providing method, program, and drive recorder
 本発明は、車両にて検出される情報をIoT(Internet of Things)を利用して取得する技術に関する。 The present invention relates to a technology for acquiring information detected by a vehicle using IoT (Internet of Things).
 近年では、カメラにより撮像した画像を記録するドライブレコーダを車両に搭載しておき、他の車両等との衝突等の交通事故が発生した場合に事故発生前後の車両の状況を事後的に検証できるようにする技術が提案されている。例えば、特許文献1には、ドライブレコーダにより取得される画像を解析して特徴情報を算出し、特定の特徴を有する画像を抽出して録画する技術が開示されている。 In recent years, a drive recorder that records images captured by a camera can be installed in a vehicle, and when a traffic accident such as a collision with another vehicle occurs, the situation of the vehicle before and after the accident can be verified afterwards. Techniques for doing so have been proposed. For example, Japanese Patent Application Laid-Open No. H10-228561 discloses a technique for analyzing image obtained by a drive recorder, calculating feature information, and extracting and recording an image having a specific feature.
特開2011-14988号公報JP 2011-14988 A
 一般に、車両にて検出された情報のなかには、特定の場所でかつ特定のタイミングにおいてしか取得できないものなど、希少性が高いものや利用価値の高いものが含まれている。例えば、交通事故を偶然捉えた映像は事故原因の究明に役立つ可能性がある。また、撮影地点を移動することできるというドライブレコーダの特性が発揮された、特定の地域や時間帯における渋滞状況や天候の変化等についての情報は、その近隣を走行している走行している他の車両の運転者にとって価値がある。
 しかし、特許文献1の技術では、ドライブレコーダ内部での画像を記録するに留まり、記録した画像を有効に活用することができなかった。
In general, information detected by a vehicle includes information with high rarity and high utility value, such as information that can be acquired only at a specific location and at a specific timing. For example, a video that accidentally captures a traffic accident may be useful in investigating the cause of the accident. In addition, information on traffic conditions and weather changes in a specific area or time zone, where the characteristics of a drive recorder that can move the shooting location are demonstrated Worthy for the driver of the vehicle.
However, with the technique of Patent Document 1, only the image inside the drive recorder is recorded, and the recorded image cannot be used effectively.
 本発明は、IoTを利用して、複数の車両にて撮影された画像の情報を有効に活用することを目的とする。 The object of the present invention is to effectively utilize information of images taken by a plurality of vehicles using IoT.
 本発明は、一の態様において、ドライブレコーダにて撮像された画像を解析させて特徴情報を抽出させるように、当該ドライブレコーダのイメージセンサモジュールを制御する第1制御手段と、該撮像された画像に基づいて所定の事象が発生したかを検出させるように、前記ドライブレコーダのイメージセンサモジュール制御する第2制御手段と、前記所定の事象が検知された際の画像の特徴情報を、当該画像が撮影された位置および時刻を示す情報とともに、通信網を介して、複数の前記ドライブレコーダから取得する取得手段と、該取得した特徴情報に基づいて生成される情報を、外部サーバに提供する提供手段とを備えるドライブレコーダ情報提供システムを提供する。
 好ましい態様において、前記所定の事象を検出したことを契機として、前記特徴情報を前記通信網を介して前記取得手段に提供するように、前記ドライブレコーダのホストコントローラに干渉する干渉手段を更に有する。
 好ましい態様において、前記所定の事象とは、交通事故、天候、および道路の混雑状況に関するものの少なくともいずれかを含む。
 好ましい態様において、一の事象に対して該取得された特徴情報が所定量に達した場合に、前記外部サーバへの情報の提供が実行される。
 好ましい態様において、前記外部サーバへ提供された情報の元となる画像を撮像したドライブレコーダが設けられた車両の管理者に対し、報酬を支払う支払手段をさらに備える。
 好ましい態様において、前記支払手段は、前記特徴情報の希少性に基づいて前記報酬の内容を決定する。
 好ましい態様において、前記支払手段は、前記外部サーバに対する情報提供の対価の額に基づいて、前記報酬の内容を決定する。
 好ましい態様において、前記支払手段は、前記外部サーバへ提供された情報の元となる画像を撮像したドライブレコーダから特徴情報を取得した回数に基づいて、当該ドライブレコーダが設けられた車両の管理者に対して、前記報酬を支払う。
 本発明は、他の観点において、ドライブレコーダにて撮像された画像を解析させて特徴情報を抽出させるように、当該ドライブレコーダのイメージセンサモジュールを制御するステップと、該撮像された画像に基づいて所定の事象が発生したかを検出させるように、前記ドライブレコーダのイメージセンサモジュール制御するステップと、車両に設置されたドライブレコーダにて撮像された画像の特徴情報を抽出するステップと、前記画像に基づいて、所定の事象が発生したことを検知するステップと、前記所定の事象が検知された際の画像の特徴情報を、当該画像が撮影された位置および時刻を示す情報とともに、通信網を介して、複数の前記ドライブレコーダから取得するステップと、該取得した特徴情報に基づいて生成される情報を、外部サーバに提供するステップとを備えるドライブレコーダ情報提供方法およびプログラムを提供する。
 本発明は、他の観点において、イメージセンサモジュールと、前記イメージセンサモジュールによって撮像された画像を解析させて特徴情報を抽出させるように、当該イメージセンサモジュールを制御する第1制御手段と、該撮像された画像に基づいて所定の事象が発生したかを検出させるように、前記イメージセンサモジュール制御する第2制御手段と、前記所定の事象が検知された際の画像の特徴情報を、当該特徴情報に基づく情報を外部サーバに提供するサーバへ、当該画像が撮影された位置および時刻を示す情報とともに、通信網を介して提供する通信手段とを備えるドライブレコーダを提供する。
In one aspect, the present invention provides a first control means for controlling an image sensor module of the drive recorder so as to analyze the image captured by the drive recorder and extract feature information, and the captured image Second control means for controlling the image sensor module of the drive recorder so as to detect whether or not a predetermined event has occurred, and image feature information when the predetermined event is detected. Acquiring means for acquiring from a plurality of the drive recorders via a communication network together with information indicating the taken position and time, and providing means for providing information generated based on the acquired characteristic information to an external server A drive recorder information providing system is provided.
In a preferred aspect, the apparatus further comprises interference means for interfering with a host controller of the drive recorder so as to provide the feature information to the acquisition means via the communication network when the predetermined event is detected.
In a preferred embodiment, the predetermined event includes at least one of a traffic accident, weather, and road congestion.
In a preferred aspect, provision of information to the external server is executed when the acquired feature information reaches a predetermined amount for one event.
In a preferred aspect, the information processing apparatus further includes a payment unit that pays a reward to a manager of the vehicle provided with the drive recorder that captures an image that is a source of information provided to the external server.
In a preferred aspect, the payment means determines the content of the reward based on the scarcity of the feature information.
In a preferred aspect, the payment means determines the content of the reward based on the amount of consideration for providing information to the external server.
In a preferred aspect, the payment means provides the manager of the vehicle provided with the drive recorder based on the number of times the feature information is acquired from the drive recorder that captured the image that is the source of the information provided to the external server. In contrast, the reward is paid.
In another aspect, the present invention provides a step of controlling an image sensor module of the drive recorder so as to analyze the image captured by the drive recorder and extract feature information, and based on the captured image Controlling the image sensor module of the drive recorder so as to detect whether a predetermined event has occurred, extracting feature information of an image captured by a drive recorder installed in a vehicle, and On the basis of the step of detecting that the predetermined event has occurred, and the feature information of the image when the predetermined event is detected, together with the information indicating the position and time at which the image was captured, via the communication network Acquiring from a plurality of the drive recorders, and information generated based on the acquired feature information, Providing drive recorder information providing method and a program comprising the steps of providing separate component server.
In another aspect, the present invention provides an image sensor module, first control means for controlling the image sensor module so as to extract feature information by analyzing an image captured by the image sensor module, and the imaging Second feature means for controlling the image sensor module so as to detect whether or not a predetermined event has occurred on the basis of the image, and feature information of the image when the predetermined event is detected. A drive recorder comprising a communication means for providing information via a communication network to a server that provides information based on the information to an external server together with information indicating the position and time at which the image was taken.
 本発明によれば、IoTを利用して、複数の車両にて撮影された画像の情報を有効に活用することが可能になる。 According to the present invention, it is possible to effectively use information of images taken by a plurality of vehicles using IoT.
本発明の一実施形態によるドライブレコーダ情報提供システム100の構成例を示す図である。It is a figure which shows the structural example of the drive recorder information provision system 100 by one Embodiment of this invention. ドライブレコーダ情報提供システム100に含まれるエッジデバイス110のハードウェア構成の一例を示す図である。2 is a diagram illustrating an example of a hardware configuration of an edge device 110 included in a drive recorder information providing system 100. FIG. エッジデバイス110の機能構成の一例を示す図である。2 is a diagram illustrating an example of a functional configuration of an edge device 110. FIG. ドライブレコーダ情報提供システム100に含まれるドライブレコーダ情報サーバ130のハードウェア構成の一例を示す図である。It is a figure which shows an example of the hardware constitutions of the drive recorder information server included in the drive recorder information provision system. ドライブレコーダ情報サーバ130の機能構成の一例を示す図である。It is a figure which shows an example of a function structure of the drive recorder information server. ドライブレコーダ情報提供システム100に含まれる各装置の動作を示す図である。It is a figure which shows operation | movement of each apparatus contained in the drive recorder information provision system.
 以下、図面を参照しつつ本発明の実施形態を説明する。
<1.構成>
 図1は、本発明の一実施形態によるドライブレコーダ情報提供システム100の構成例を示す図である。ドライブレコーダ情報提供システム100は、ドライブレコーダ情報サーバ130と、複数のエッジデバイス110と、複数のIoTデバイス140と、を備える。図1に示す各装置のうち、エッジデバイス110とIoTデバイス140とは、それぞれ一組ずつ1台の車両に搭載される。図1では、エッジデバイス110とIoTデバイス140とが搭載される車両が一点鎖線の矩形で表されている。なお、図1に示す各装置の数は例示であり、これに限定されない。
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
<1. Configuration>
FIG. 1 is a diagram showing a configuration example of a drive recorder information providing system 100 according to an embodiment of the present invention. The drive recorder information providing system 100 includes a drive recorder information server 130, a plurality of edge devices 110, and a plurality of IoT devices 140. Among the apparatuses shown in FIG. 1, the edge device 110 and the IoT device 140 are each mounted on one vehicle. In FIG. 1, a vehicle on which the edge device 110 and the IoT device 140 are mounted is represented by a dashed-dotted rectangle. In addition, the number of each apparatus shown in FIG. 1 is an illustration, and is not limited to this.
 IoTデバイス140は、通信網160を介してエッジデバイス110に接続されている。IoTデバイス140は、例えばドライブレコーダである。図1では詳細な図示を省略したが、IoTデバイス140は、レンズやイメージセンサモジュールなどを含む撮像機構と、撮像された画像を表す画像データを記録するストレージと、撮像機構およびストレージへの記録(および記録された画像の削除)を制御するホストコントローラと、を含む。イメージセンサモジュールは、イメージセンサ、マイクロコンピュータなどを備えている。後述するように、エッジデバイスの第1制御手段および第2制御手段は、イメージセンサモジュールを制御する。そして、エッジデバイスの干渉制御手段は、ホストコントローラの干渉を受ける。 The IoT device 140 is connected to the edge device 110 via the communication network 160. The IoT device 140 is a drive recorder, for example. Although not shown in detail in FIG. 1, the IoT device 140 includes an imaging mechanism including a lens and an image sensor module, a storage for recording image data representing a captured image, and recording to the imaging mechanism and the storage ( And a host controller for controlling the deletion of recorded images). The image sensor module includes an image sensor, a microcomputer, and the like. As will be described later, the first control means and the second control means of the edge device control the image sensor module. The interference control means of the edge device receives interference from the host controller.
 IoTデバイス140は、カメラの撮像方向が車両の前方向と一致するように車両の車室内に設置されており、当該車両の走行中にカメラによって撮像された画像の画像データをストレージに記録する。IoTデバイス140により撮像される画像は静止画像であっても良いし、動画像であっても良い。また、IoTデバイス140は、カメラにより撮像された画像を表す画像データを、通信網160を介してエッジデバイス110に提供する。通信網160は、例えば上記車両内に敷設されたLAN(Local Area Network)または無線LANを含んで構成されても良い。 The IoT device 140 is installed in the vehicle interior of the vehicle so that the imaging direction of the camera coincides with the front direction of the vehicle, and records image data of an image captured by the camera while the vehicle is traveling in the storage. An image captured by the IoT device 140 may be a still image or a moving image. Further, the IoT device 140 provides image data representing an image captured by the camera to the edge device 110 via the communication network 160. The communication network 160 may include, for example, a LAN (Local Area Network) or a wireless LAN laid in the vehicle.
 エッジデバイス110は、通信網160に接続されているとともに、通信網150に無線接続される中継装置(例えば、ゲートウェイ)である。エッジデバイス110は、通信網150に接続されている装置と通信網160に接続されている装置との間のデータ通信を仲介する。通信網150は、例えばインターネットを含んで構成されていても良い。通信網150には、交通事故に関する情報を取得して多数の運転者に公開するための外部サーバ120が接続されている。外部サーバ120の具体例としては、都道府県や国土交通省或いはそれらの委託機関などの道路管理者によって運用管理される交通情報サーバが挙げられる。 The edge device 110 is a relay device (for example, a gateway) that is connected to the communication network 160 and wirelessly connected to the communication network 150. The edge device 110 mediates data communication between a device connected to the communication network 150 and a device connected to the communication network 160. The communication network 150 may be configured including the Internet, for example. The communication network 150 is connected to an external server 120 for acquiring information related to traffic accidents and disclosing it to a large number of drivers. Specific examples of the external server 120 include a traffic information server that is operated and managed by a road administrator such as a prefecture, the Ministry of Land, Infrastructure, Transport and Tourism, or a commissioned organization thereof.
 通信網150には、交通事故発生時などの特定のイベント(事象)が検知された場合にIoTデバイス140により撮像された画像の特徴を表す特徴情報(換言すると、その事象を特徴付ける情報)、その発生位置を示す位置情報およびその発生時刻を示す時刻情報をエッジデバイス110から取得するドライブレコーダ情報サーバ130が接続されている。本実施形態では、ドライブレコーダ情報サーバ130は、エッジデバイス110から取得した情報に基づいて、発生した交通事故の概要を示す事故概要情報(発生した交通事故の程度、発生位置および発生時刻を示す情報)を生成して外部サーバ120に提供する。これにより、外部サーバ120を利用する多数の運転者は、交通事故に関する情報を共有することが可能になる。以下では、本実施形態の特徴を顕著に示すエッジデバイス110およびドライブレコーダ情報サーバ130を中心に説明する。 The communication network 150 includes feature information (in other words, information that characterizes the event) that represents the characteristics of the image captured by the IoT device 140 when a specific event such as a traffic accident occurs is detected. A drive recorder information server 130 that acquires position information indicating the generation position and time information indicating the generation time from the edge device 110 is connected. In the present embodiment, the drive recorder information server 130 is based on the information acquired from the edge device 110, and accident summary information indicating the outline of the traffic accident that has occurred (information indicating the degree of the traffic accident that has occurred, the location and time of occurrence) ) And provided to the external server 120. As a result, a large number of drivers using the external server 120 can share information on traffic accidents. Below, it demonstrates centering on the edge device 110 and the drive recorder information server 130 which show the characteristic of this embodiment notably.
 エッジデバイス110は、図2に示すように、プロセッサ111と、メモリ112と、ストレージ113と、通信装置114と、を備える。これらの装置は、バス115を介して接続されている。プロセッサ111は、プログラムをメモリ112に読み出して実行することにより、各種の処理を実行する。例えばプロセッサ111は、CPU(Central Processing Unit)により構成されても良い。メモリ112は、プロセッサ111により実行されるプログラムを記憶する。例えばメモリ112は、ROM(Read Only Memory)またはRAM(Random Access Memory)により構成されても良い。ストレージ113は、各種のデータおよびプログラムを記憶する。例えばストレージ113は、ハードディスクドライブまたはフラッシュメモリにより構成されても良い。通信装置114は、通信網150または通信網160を介してデータ通信を行う。 The edge device 110 includes a processor 111, a memory 112, a storage 113, and a communication device 114, as shown in FIG. These devices are connected via a bus 115. The processor 111 executes various processes by reading the program into the memory 112 and executing it. For example, the processor 111 may be configured by a CPU (Central Processing Unit). The memory 112 stores a program executed by the processor 111. For example, the memory 112 may be constituted by a ROM (Read Only Memory) or a RAM (Random Access Memory). The storage 113 stores various data and programs. For example, the storage 113 may be configured by a hard disk drive or a flash memory. The communication device 114 performs data communication via the communication network 150 or the communication network 160.
 図3は、エッジデバイス110の機能構成の一例を示す図である。エッジデバイス110は、抽出手段211と、検知手段212と、送信手段213と、通信手段214と、を備える。通信手段214は、図2における通信装置114であり、撮像手段215は、通信網160を介してエッジデバイス110に接続されるIoTデバイス140である。図3における抽出手段211、検知手段212、および送信手段213は、メモリ112またはストレージ113に記憶されたプログラムと、このプログラムを実行するプロセッサ111との協働により、プロセッサ111が演算を行いまたは通信手段214(通信装置114)を制御することにより実現されるソフトウェアモジュールである。 FIG. 3 is a diagram illustrating an example of a functional configuration of the edge device 110. The edge device 110 includes an extraction unit 211, a detection unit 212, a transmission unit 213, and a communication unit 214. The communication unit 214 is the communication device 114 in FIG. 2, and the imaging unit 215 is the IoT device 140 connected to the edge device 110 via the communication network 160. The extraction unit 211, the detection unit 212, and the transmission unit 213 in FIG. 3 are operated or communicated by the processor 111 in cooperation with the program stored in the memory 112 or the storage 113 and the processor 111 that executes the program. It is a software module realized by controlling the means 214 (communication device 114).
 抽出手段211は、撮像手段215にて撮像された画像から当該画像の特徴情報を抽出する。換言すると、抽出手段211は、ドライブレコーダにて撮像された画像を解析させて特徴情報を抽出させるように、当該ドライブレコーダのイメージセンサモジュールを制御する第1制御手段である。抽出手段211により抽出される特徴情報の具体例としては、色情報、エッジ情報、画像の複雑さを示すフラクタル次元、DFT(Discrete Fourier Transform)等により得られるスペクトル情報等、画像に関する種々の情報が挙げられ、これら特徴情報の抽出アルゴリズムについては既存のアルゴリズムを適宜用いるようにすれば良い。 The extraction unit 211 extracts feature information of the image from the image captured by the imaging unit 215. In other words, the extraction unit 211 is a first control unit that controls the image sensor module of the drive recorder so as to analyze the image captured by the drive recorder and extract the feature information. Specific examples of the feature information extracted by the extraction unit 211 include various information about the image such as color information, edge information, fractal dimension indicating the complexity of the image, spectrum information obtained by DFT (Discrete Fourier Transform), and the like. As the feature information extraction algorithm, existing algorithms may be used as appropriate.
 検知手段212は、撮像手段215にて撮像された画像に基づいて、所定の事象を検知する。換言すると、検知手段212は、前記画像に基づいて前記人物が所定の行動をとったことを検知させるように、前記イメージセンサモジュールを制御する第2制御手段である。なお、所定の事象とは、エッジデバイス110の搭載された車両と、他の車両や壁、電柱などの事物或いは人や動物等との衝突事故(すなわち、交通事故)のことを言う。ここで、交通事故の発生を検知する具体的な手法としては以下の手法が考えられる。まず、複数種の交通事故の各々について、事故発生時にドライブレコーダにより記録された画像から抽出される特徴情報を判定基準情報としてストレージ113に予め記憶させておく。そして、検知手段212には、抽出手段211により抽出された特徴情報と上記複数の判定基準情報の各々とを比較させ、同一または類似の判定基準情報が存在した場合に交通事故が発生した判定させるようにすれば良い。なお、特徴情報と判定基準情報の同一または類似の判定については、前者と後者との各々を同一の座標空間(例えば、多次元ユークリッド空間)に点として写像した場合の点間の距離に応じて判定する態様が考えられる。 The detection unit 212 detects a predetermined event based on the image captured by the imaging unit 215. In other words, the detection unit 212 is a second control unit that controls the image sensor module so as to detect that the person has taken a predetermined action based on the image. The predetermined event refers to a collision accident (that is, a traffic accident) between a vehicle on which the edge device 110 is mounted and an object such as another vehicle, a wall, or a power pole, or a person or an animal. Here, the following method can be considered as a specific method for detecting the occurrence of a traffic accident. First, for each of a plurality of types of traffic accidents, feature information extracted from an image recorded by a drive recorder at the time of the accident is stored in advance in the storage 113 as determination criterion information. Then, the detection unit 212 compares the feature information extracted by the extraction unit 211 with each of the plurality of determination criterion information, and determines that a traffic accident has occurred when the same or similar determination criterion information exists. You can do that. For the same or similar determination of feature information and determination criterion information, depending on the distance between points when the former and the latter are mapped as points in the same coordinate space (for example, multidimensional Euclidean space). A mode of determination is conceivable.
 本実施形態では、抽出手段211により抽出される特徴情報に基づいて所定の事象の発生を検知するが、撮像手段215にて撮像された画像にパターン認識を施すことで所定の事象の発生を検知しても良い。要は、撮像手段215にて撮像された画像に基づいて、所定の事象を検知する態様であれば良い。また、通信網160を介して加速度センサ或いは衝撃センサをエッジデバイス110に接続しておき、各センサの計測結果(すなわち、エッジデバイス110を搭載した車両の加速度の変化または当該車両に加わった衝撃)を加味して交通事故の発生を検知しても良い。 In the present embodiment, the occurrence of a predetermined event is detected based on the feature information extracted by the extraction unit 211, but the occurrence of the predetermined event is detected by performing pattern recognition on the image captured by the imaging unit 215. You may do it. In short, any mode may be used as long as a predetermined event is detected based on an image captured by the imaging unit 215. In addition, an acceleration sensor or an impact sensor is connected to the edge device 110 via the communication network 160, and a measurement result of each sensor (that is, a change in acceleration of the vehicle on which the edge device 110 is mounted or an impact applied to the vehicle). The occurrence of a traffic accident may be detected in consideration of the above.
 送信手段213は、検知手段212により所定の事象(本実施形態では、交通事故)が検知されたことを契機として、当該所定の事象が検知された画像について抽出手段211により抽出された特徴情報、当該画像が撮影された位置を示す位置情報および当該画像が撮像された時刻を示す時刻情報を、通信手段214を介してドライブレコーダ情報サーバ130へ送信する。換言すると、送信手段213は、所定の事象を検出したことを契機として、特徴情報と位置情報と時刻情報とを、前記通信網を介してドライブレコーダ情報サーバ130の取得手段へ提供するように、前記ドライブレコーダのホストコントローラに干渉する干渉手段である。 The transmission unit 213 receives the feature information extracted by the extraction unit 211 for the image in which the predetermined event is detected, triggered by the detection unit 212 detecting a predetermined event (a traffic accident in this embodiment). Position information indicating the position at which the image was captured and time information indicating the time at which the image was captured are transmitted to the drive recorder information server 130 via the communication unit 214. In other words, the transmission unit 213 provides the feature information, the position information, and the time information to the acquisition unit of the drive recorder information server 130 via the communication network in response to the detection of the predetermined event. Interference means for interfering with the host controller of the drive recorder.
 以下では、特徴情報、位置情報および時刻情報の組を「ドライブレコーダ情報」と称する。なお、上記位置情報については、GPS、通信網150における無線アクセスポイントのビーコン等を利用して取得すれば良く、時刻情報についてGPS或いはリアルタイムクロック等を利用して取得すれば良い。また、ドライブレコーダ情報の送信先となるドライブレコーダ情報サーバ130の通信アドレスについては、ストレージ113に予め書き込んでおいても良いし、上記プログラムに埋め込んでおいても良い。 Hereinafter, a set of feature information, position information, and time information is referred to as “drive recorder information”. The position information may be acquired using GPS, a beacon of a wireless access point in the communication network 150, and the time information may be acquired using GPS or a real-time clock. Further, the communication address of the drive recorder information server 130 that is the transmission destination of the drive recorder information may be written in advance in the storage 113 or embedded in the program.
 図4は、ドライブレコーダ情報サーバ130の構成例を示す図である。ドライブレコーダ情報サーバ130は、プロセッサ131と、メモリ132と、ストレージ133と、通信装置134と、を備える。これらの装置は、バス135を介して接続されている。プロセッサ131、メモリ132、ストレージ133、通信装置134、およびバス135は、上述したプロセッサ111、メモリ112、ストレージ113、通信装置114、およびバス115と同様であるため、その説明を省略する。 FIG. 4 is a diagram illustrating a configuration example of the drive recorder information server 130. The drive recorder information server 130 includes a processor 131, a memory 132, a storage 133, and a communication device 134. These devices are connected via a bus 135. Since the processor 131, the memory 132, the storage 133, the communication device 134, and the bus 135 are the same as the processor 111, the memory 112, the storage 113, the communication device 114, and the bus 115 described above, description thereof is omitted.
 図5は、ドライブレコーダ情報サーバ130の機能構成の一例を示す図である。ドライブレコーダ情報サーバ130は、取得手段231と、提供手段232と、支払手段233と、通信手段234と、を備える。通信手段234は、図4における通信装置134である。図5における取得手段231、支払手段233、および提供手段232は、メモリ132またはストレージ133に記憶されたプログラムと、このプログラムを実行するプロセッサ131との協働により、プロセッサ131が演算を行いまたは通信手段234(通信装置134)を制御することにより実現されるソフトウェアモジュールである。 FIG. 5 is a diagram illustrating an example of a functional configuration of the drive recorder information server 130. The drive recorder information server 130 includes an acquisition unit 231, a provision unit 232, a payment unit 233, and a communication unit 234. The communication means 234 is the communication device 134 in FIG. The acquisition unit 231, the payment unit 233, and the provision unit 232 in FIG. 5 perform the calculation or communication by the processor 131 in cooperation with the program stored in the memory 132 or the storage 133 and the processor 131 that executes the program. A software module realized by controlling the means 234 (communication device 134).
 取得手段231は、通信網150を介してエッジデバイス110からドライブレコーダ情報を取得する。本実施形態では、取得手段231は、通信網150を介して送信されてくるドライブレコーダ情報を受信することにより、ドライブレコーダ情報を取得する。本実施形態では、検知手段212により交通事故が検知されたことを契機としてドライブレコーダ情報が通信網150を介してエッジデバイス110からドライブレコーダ情報サーバ130へ送信されるが、ドライブレコーダ情報サーバ130からのポーリングにより、ドライブレコーダ情報を取得しても良い。この場合の取得手段231は、上記ポーリングを定期的に行う手段である。 The acquisition unit 231 acquires drive recorder information from the edge device 110 via the communication network 150. In the present embodiment, the acquisition unit 231 acquires drive recorder information by receiving drive recorder information transmitted via the communication network 150. In the present embodiment, the drive recorder information is transmitted from the edge device 110 to the drive recorder information server 130 via the communication network 150 when the traffic accident is detected by the detection unit 212, but from the drive recorder information server 130 The drive recorder information may be acquired by polling. In this case, the acquisition unit 231 is a unit that periodically performs the polling.
 提供手段232は、取得手段231により取得されたドライブレコーダ情報から事故概要情報を生成して外部サーバ120へ送信する。より詳細に説明すると、提供手段232は、取得手段231により取得されたドライブレコーダ情報に含まれている特徴情報に基づいて交通事故の程度(以後の車両の通行止めを要する重篤な事故、事故発生位置の近隣を通過する際に減速等の交通規制を要する中程度の事故、交通規制は必要ではないものの事故発生位置の近隣を通過する際に周囲に注意を払うことを要する軽度の事故)を判定する。 The providing unit 232 generates accident summary information from the drive recorder information acquired by the acquiring unit 231 and transmits it to the external server 120. More specifically, the providing unit 232 determines the degree of a traffic accident based on the feature information included in the drive recorder information acquired by the acquiring unit 231 (a serious accident that requires subsequent vehicle closure, or the occurrence of an accident). Moderate accidents that require traffic regulation such as deceleration when passing the vicinity of the location, minor accidents that require attention to the surroundings when passing the neighborhood of the accident location, although traffic regulation is not necessary) judge.
 そして、提供手段232は、交通事故の程度を表す情報とドライブレコーダ情報に含まれている位置情報および時刻情報とを事故概要情報として外部サーバ120へ送信する。このような態様によれば、外部サーバ120側で交通事故の程度を判断する必要はなく、ドライブレコーダ情報サーバ130から提供された事故概要情報をそのまま多数の運転者に共有させ、事態の悪化を防ぐことができる。なお、特徴情報に基づいて交通事故の程度を判定する具体的な方法としては、交通事故の程度毎に特徴情報の範囲(或いは典型的な特徴情報)を示す判定基準情報を予めストレージ133に記憶させておき、取得手段231により取得されたドライブレコーダ情報に含まれる特徴情報とそれら判定基準情報との比較により交通事故の程度を判定する方法が考えられる。 Then, the providing unit 232 transmits the information indicating the degree of the traffic accident and the position information and time information included in the drive recorder information to the external server 120 as accident summary information. According to such an aspect, it is not necessary to determine the extent of the traffic accident on the external server 120 side, the accident summary information provided from the drive recorder information server 130 is shared as it is with many drivers, and the situation worsens. Can be prevented. In addition, as a specific method for determining the degree of traffic accident based on the feature information, determination standard information indicating the range of feature information (or typical feature information) for each degree of traffic accident is stored in the storage 133 in advance. In addition, a method of determining the degree of a traffic accident by comparing the feature information included in the drive recorder information acquired by the acquisition unit 231 and the determination criterion information is conceivable.
 支払手段233は、外部サーバ120へ提供される情報の元となる画像を撮像した撮像装置が設けられた車両の管理者に対して支払う報酬を算定し、その報酬を支払う。本実施形態では、ストレージ133には、ドライブレコーダ情報提供システム100の運用管理者との間で情報提供に関する契約を結んだ車両の管理者の振込先情報(例えば、銀行口座番号等)が当該車両に搭載されたエッジデバイス110の通信アドレスと対応付けて予め記憶されている。そして、支払手段233は、取得手段231により取得したドライブレコーダ情報の送信元の通信アドレスに対応する振込先情報の示す振込先に報酬を振込む。なお、報酬の振込みに加えて報酬を振り込んだ旨の通知を情報の提供元へ送信するようにしても良い。 The payment unit 233 calculates a remuneration to be paid to the manager of the vehicle provided with the image capturing apparatus that has captured the image that is the source of information provided to the external server 120, and pays the remuneration. In the present embodiment, in the storage 133, transfer destination information (for example, a bank account number) of a vehicle manager who has signed an information provision contract with the operation manager of the drive recorder information providing system 100 is stored in the vehicle. Is stored in advance in association with the communication address of the edge device 110 mounted on the device. Then, the payment unit 233 transfers the reward to the transfer destination indicated by the transfer destination information corresponding to the communication address of the transmission source of the drive recorder information acquired by the acquisition unit 231. In addition to the transfer of the reward, a notification that the reward has been transferred may be transmitted to the information provider.
 ドライブレコーダ情報の送信元に支払う報酬については、情報提供に関する契約において情報提供の対価の算定式を定めておき、その算定式にしたがって算出するようにすれば良い。この算定式の具体例としては、特徴情報の希少性(例えば事故の重篤度)が高いほど対価を高くする算定式や、ドライブレコーダ情報の提供回数が多いほど対価を高くする算定式が考えられる。これらの態様によれば、ドライブレコーダ情報の提供に対するインセンティブを車両の管理者に与え、情報提供に対する当該管理者の関心を高めることができる。なお、報酬の支払いについては情報提供の都度行う態様であっても良く、例えば一月毎などの一定期間毎にその一定期間の間に発生した報酬をまとめて支払う態様であっても良い。 The remuneration to be paid to the sender of the drive recorder information may be calculated according to a calculation formula for consideration for providing information in a contract for information provision. Specific examples of this calculation formula include a calculation formula that increases the consideration as the rarity of feature information (for example, the severity of an accident) increases, and a calculation formula that increases the consideration as the number of times the drive recorder information is provided. It is done. According to these aspects, an incentive for providing the drive recorder information can be given to the manager of the vehicle, and the manager's interest in providing the information can be increased. In addition, about the payment of a reward, the aspect performed whenever it provides information may be sufficient, for example, the aspect which pays the reward which generate | occur | produced during the fixed period for every fixed period, such as every month, may be sufficient.
<2.動作>
 次いで、図6を参照しつつドライブレコーダ情報提供システム100に含まれる各装置の動作を説明する。図6は、ドライブレコーダ情報提供システム100に含まれるエッジデバイス110およびドライブレコーダ情報サーバ130の動作を示すシーケンス図である。
<2. Operation>
Next, the operation of each device included in the drive recorder information providing system 100 will be described with reference to FIG. FIG. 6 is a sequence diagram showing operations of the edge device 110 and the drive recorder information server 130 included in the drive recorder information providing system 100.
 図6におけるステップSA100は、エッジデバイス110の抽出手段211により実行される処理である。このステップSA100では、抽出手段211は、撮像手段215から与えられる画像データを解析し特徴情報を抽出する。ステップSA100に後続するステップSA110は、エッジデバイス110の検知手段212により実行される処理である。このステップSA110では、検知手段212は、抽出手段211から与えられる特徴情報に基づいて、所定の事象(交通事故)を検知する。 Step SA100 in FIG. 6 is a process executed by the extraction unit 211 of the edge device 110. In step SA100, the extraction unit 211 analyzes the image data provided from the imaging unit 215 and extracts feature information. Step SA110 subsequent to step SA100 is processing executed by the detection unit 212 of the edge device 110. In step SA110, the detection unit 212 detects a predetermined event (traffic accident) based on the feature information provided from the extraction unit 211.
 ステップSA110に後続するステップSA120は、エッジデバイス110の送信手段213により実行される処理である。このステップSA120では、送信手段213は、検知手段212により所定の事象が検知された画像について抽出手段211により抽出された特徴情報を含むドライブレコーダ情報を、ドライブレコーダ情報サーバ130へ送信する。このようにしてエッジデバイス110から送信されたドライブレコーダ情報は、通信網150を介してドライブレコーダ情報サーバ130に伝送される。 Step SA120 following step SA110 is a process executed by the transmission means 213 of the edge device 110. In step SA120, the transmission unit 213 transmits drive recorder information including the feature information extracted by the extraction unit 211 for the image in which the predetermined event is detected by the detection unit 212 to the drive recorder information server 130. The drive recorder information transmitted from the edge device 110 in this way is transmitted to the drive recorder information server 130 via the communication network 150.
 図6に示すように、ドライブレコーダ情報サーバ130では、通信網150を介してドライブレコーダ情報を受信したことを契機としてステップSB100以降の処理が実行される。図6におけるステップSB100は、ドライブレコーダ情報サーバ130の取得手段231により実行される処理である。このステップSB100では、取得手段231はエッジデバイス110から送信されてくるドライブレコーダ情報を取得する。 As shown in FIG. 6, in the drive recorder information server 130, the process after step SB100 is executed when the drive recorder information is received via the communication network 150. Step SB100 in FIG. 6 is a process executed by the acquisition unit 231 of the drive recorder information server 130. In step SB100, the acquisition unit 231 acquires drive recorder information transmitted from the edge device 110.
 ステップSB100に後続するステップSB110は、ドライブレコーダ情報サーバ130の提供手段232により実行される処理である。このステップSB110では、提供手段232は、ステップSB100にて取得したドライブレコーダ情報に基づいて生成した事故概要情報を外部サーバ120へ送信する。このようにしてドライブレコーダ情報サーバ130から送信された事故概要情報は、通信網150を介して外部サーバ120に伝送される。外部サーバ120は、通信網150を介して受信した事故概要情報を公開(例えば、所定のwebページに掲載、或いはラジオ等で放送)する。これより、多数の運転者が上記事故概要情報を共有し、当該事故概要情報の示す事故の発生直後にその発生位置の近隣を通過する際には、他の道路へ迂回する、交通規制にしたがって車両を減速させて通過する、注意を払いつつ通過するなど発生した交通事故の程度に応じた対処を行うことができ、事態の悪化(当該交通事故に起因する渋滞の発生や二次的な交通事故の発生など)を防ぐことができる。 Step SB110 subsequent to step SB100 is a process executed by the providing unit 232 of the drive recorder information server 130. In step SB110, the providing unit 232 transmits the accident summary information generated based on the drive recorder information acquired in step SB100 to the external server 120. The accident summary information transmitted from the drive recorder information server 130 in this way is transmitted to the external server 120 via the communication network 150. The external server 120 publishes accident summary information received via the communication network 150 (for example, posted on a predetermined web page or broadcasted on a radio or the like). As a result, many drivers share the above accident summary information, and when passing through the vicinity of the location immediately after the occurrence of the accident indicated by the accident summary information, detour to other roads according to traffic regulations. It is possible to take measures according to the degree of traffic accident that occurred, such as passing the vehicle decelerating or paying attention, and worsening the situation (occurrence of traffic congestion due to the traffic accident or secondary traffic Accidents).
 ステップSB110に後続するステップSB120は、ドライブレコーダ情報サーバ130の支払手段233により実行される処理である。このステップSB120では、支払手段233は、外部サーバ120へ提供される情報の元となる画像を撮像した撮像装置が設けられた車両の管理者に対して支払う報酬を算定し、その報酬を支払う。これにより、ドライブレコーダ情報の提供に対するインセンティブを車両の管理者に与え、情報提供に対する当該管理者の関心を高めることができる。なお、本実施形態では、ステップSB110の処理の後にステップSB120の処理を実行したが、ステップSB120の処理を先に実行し、その後、ステップSB110の処理を実行しても良い。 Step SB120 following step SB110 is a process executed by the payment means 233 of the drive recorder information server 130. In this step SB120, the payment means 233 calculates a remuneration to be paid to the manager of the vehicle provided with the image capturing apparatus that captured the image that is the source of the information provided to the external server 120, and pays the remuneration. Thereby, an incentive for providing the drive recorder information can be given to the manager of the vehicle, and the manager's interest in providing the information can be increased. In this embodiment, the process of step SB120 is executed after the process of step SB110. However, the process of step SB120 may be executed first, and then the process of step SB110 may be executed.
 以上説明したように、本実施形態のドライブレコーダ情報提供システム100によれば、交通事故に関する情報を、IoTを利用して複数の車両から取得して外部のシステムに提供することが可能になる。同時に、情報提供に対する車両の管理者の関心、意欲、動機づけを高めることが可能になる。情報提供に関する関心が高まることで、本発明に係るドライブレコーダの導入が普及し、その結果、取得される情報の量や質が向上すること期待される。取得される情報の量や質が向上することにより、本発明に係るドライブレコーダの普及がさらに加速するという好循環が期待できる。 As described above, according to the drive recorder information providing system 100 of the present embodiment, it is possible to acquire information on traffic accidents from a plurality of vehicles using IoT and provide it to an external system. At the same time, it becomes possible to increase the interest, motivation and motivation of the vehicle manager for providing information. With the increasing interest in providing information, the introduction of the drive recorder according to the present invention is widespread, and as a result, it is expected that the quantity and quality of information acquired will be improved. A virtuous cycle in which the spread of the drive recorder according to the present invention is further accelerated can be expected by improving the amount and quality of the acquired information.
 加えて、上記実施形態のドライブレコーダ情報提供システム100では、IoTデバイス140により撮像された画像データがそのままエッジデバイス110からドライブレコーダ情報サーバ130に送信されることはない。このため、本実施形態によれば、IoTデバイス140により撮像された画像データをドライブレコーダ情報サーバ130に送信し、当該画像データの解析をドライブレコーダ情報サーバ130にて行う態様に比較して、通信網150を介してエッジデバイス110からドライブレコーダ情報サーバ130に送信されるデータ量を少なくすることができる。また、エッジデバイス110からドライブレコーダ情報サーバ130へのデータ送信は、所定の事象の検知時のみ行われるので、エッジデバイス110からドライブレコーダ情報サーバ130へのデータ送信を常時行う態様に比較して通信網150を介してエッジデバイス110からドライブレコーダ情報サーバ130に送信されるデータ量をさらに削減することができる。 In addition, in the drive recorder information providing system 100 of the above embodiment, the image data captured by the IoT device 140 is not transmitted from the edge device 110 to the drive recorder information server 130 as it is. For this reason, according to the present embodiment, the image data captured by the IoT device 140 is transmitted to the drive recorder information server 130, and the image data is analyzed by the drive recorder information server 130. The amount of data transmitted from the edge device 110 to the drive recorder information server 130 via the network 150 can be reduced. Further, since data transmission from the edge device 110 to the drive recorder information server 130 is performed only when a predetermined event is detected, communication is performed in comparison with a mode in which data transmission from the edge device 110 to the drive recorder information server 130 is always performed. The amount of data transmitted from the edge device 110 to the drive recorder information server 130 via the network 150 can be further reduced.
 さらに、本実施形態によれば、画像データの解析をドライブレコーダ情報サーバ130にて行う態様に比較して、ドライブレコーダ情報サーバ130の処理負荷を軽減することができ、ドライブレコーダ情報サーバ130のレスポンスの高速化が可能になるとともに、過負荷に起因するドライブレコーダ情報サーバ130のダウンが発生し難くなる。また、本実施形態によれば、画像データの解析をドライブレコーダ情報サーバ130にて行う態様に比較して、処理能力の低い安価なコンピュータ装置を用いてドライブレコーダ情報サーバ130を構成することが可能になる。 Furthermore, according to the present embodiment, the processing load of the drive recorder information server 130 can be reduced and the response of the drive recorder information server 130 can be reduced as compared with the mode in which the image data is analyzed by the drive recorder information server 130. The drive recorder information server 130 is less likely to be down due to overload. Further, according to the present embodiment, it is possible to configure the drive recorder information server 130 by using an inexpensive computer device having a low processing capacity as compared with the mode in which the image data is analyzed by the drive recorder information server 130. become.
 つまり、本実施形態によれば、ドライブレコーダ情報サーバ130のレスポンスの高速化、ドライブレコーダ情報サーバ130のダウンタイムの軽減、およびコスト増大防止を図りつつ、IoTを利用して複数の車両から取得した情報を、必要に応じて加工して、外部のシステムに提供し多数の運転者に共有させることが可能になるとともに、情報提供に対する車両の管理者の関心を高めることが可能になる。 That is, according to the present embodiment, it is obtained from a plurality of vehicles using IoT while speeding up the response of the drive recorder information server 130, reducing downtime of the drive recorder information server 130, and preventing an increase in cost. Information can be processed as necessary and provided to an external system for sharing with a large number of drivers, and the vehicle manager's interest in providing information can be increased.
<3.変形>
 以上本発明の実施形態について説明したが、この実施形態に以下の変形を加えても勿論良い。
 上記実施形態では、エッジデバイス110における抽出手段211、検知手段212、および送信手段213はソフトウェアモジュールであったが、ASICなどの電子回路であっても良い。ドライブレコーダ情報サーバ130における取得手段231、提供手段232および支払手段233についても同様にASICなどの電子回路であっても良い。また、支払手段233は必須ではなく省略しても良い。支払手段233を省略しても、交通事故の特徴情報をIoTを利用して複数の車両から取得して外部のシステムに提供し多数の運転者に共有させることは可能だからである。
<3. Deformation>
Although the embodiment of the present invention has been described above, it goes without saying that the following modifications may be added to this embodiment.
In the above embodiment, the extraction unit 211, the detection unit 212, and the transmission unit 213 in the edge device 110 are software modules, but may be electronic circuits such as an ASIC. Similarly, the acquisition unit 231, the providing unit 232, and the payment unit 233 in the drive recorder information server 130 may be an electronic circuit such as an ASIC. Further, the payment means 233 is not essential and may be omitted. This is because even if the payment means 233 is omitted, it is possible to acquire feature information of traffic accidents from a plurality of vehicles using IoT, provide it to an external system, and share it with many drivers.
 上記実施形態では、交通事故に関する情報を外部システムに提供する場合について説明したが、降雨や降雪などの天候変動の程度、または道路の混雑状況の程度に関する情報を外部システムに提供しても良い。要は、交通事故、天候変動、および道路の混雑状況当に関する情報の少なくともいずれかとその事象の発生位置および発生時刻とを含む情報を外部システムに提供する態様であれば良い。なお、天候変動または道路の混雑状況に関する情報を外部システムに提供する態様においては、一の事象に対して取得された特徴情報が所定量に達した場合(同一のまたは類似の事象を表し、かつ発生位置および発生時刻が同一または類似であるドライブレコーダ情報の受信数が所定量に達した場合)に、ドライブレコーダ情報サーバ130から外部サーバ120への情報の送信を行うようにしても良い。外部サーバを介して多数の運転者に共有される情報の信頼性を担保するためである。 In the above embodiment, the case where information related to a traffic accident is provided to an external system has been described. However, information related to the degree of weather fluctuation such as rainfall or snowfall or the degree of congestion on a road may be provided to an external system. In short, any mode may be used as long as it provides the external system with information including at least one of information related to traffic accidents, weather fluctuations, and road congestion, and the occurrence position and occurrence time of the event. In the aspect of providing information related to weather fluctuations or road congestion to an external system, when the feature information acquired for one event reaches a predetermined amount (represents the same or similar event, and Information may be transmitted from the drive recorder information server 130 to the external server 120 when the number of received drive recorder information having the same or similar occurrence position and occurrence time reaches a predetermined amount). This is to ensure the reliability of information shared by a large number of drivers via an external server.
 また、交通事故或いは道路の混雑状況に関する情報と、天候変動に関する情報とで異なる送信先をドライブレコーダ情報サーバ130に設定しておき、予め設定された送信先へ該当する情報を送信させるようにしても良い。例えば、交通事故或いは道路の混雑状況に関する情報については道路管理者の運用する外部サーバ或いは運輸事業者の運用する外部サーバを情報の送信先として設定しておき、天候変動に関する情報については気象庁の運用管理する外部サーバを情報の送信先として設定しておくことが考えられる。 Also, different destinations are set in the drive recorder information server 130 for information related to traffic accidents or road congestion and weather fluctuation information, and the corresponding information is transmitted to preset destinations. Also good. For example, for information related to traffic accidents or road congestion, an external server operated by a road administrator or an external server operated by a transportation company is set as the information transmission destination, and information related to weather fluctuations is operated by the Japan Meteorological Agency. An external server to be managed may be set as an information transmission destination.
 上記実施形態では、通信網160を介してエッジデバイス110に接続されるIoTデバイス140に撮像手段215の役割を担わせた。このようにすることで、既存のドラブレコーダとエッジデバイス110との組み合わせにより上記実施形態のドライブレコーダ情報提供システム100を構成することが可能になるからである。しかし、エッジデバイス110およびIoTデバイス140に代えて、通信手段214と、撮像手段215と、抽出手段211と、検知手段212と、送信手段213と、を備えるドライブレコーダを撮像装置として提供し、当該撮像装置を通信網150に接続してドライブレコーダ情報提供システムを構成しても良い。 In the above embodiment, the IoT device 140 connected to the edge device 110 via the communication network 160 plays the role of the imaging unit 215. This is because the drive recorder information providing system 100 of the above embodiment can be configured by combining the existing drive recorder and the edge device 110 in this way. However, instead of the edge device 110 and the IoT device 140, a drive recorder including a communication unit 214, an imaging unit 215, an extraction unit 211, a detection unit 212, and a transmission unit 213 is provided as an imaging device. A drive recorder information providing system may be configured by connecting an imaging device to the communication network 150.
 上記実施形態では、エッジデバイス110のプロセッサ111を抽出手段211、検知手段212および送信手段213として機能させるプログラムがエッジデバイス110に予めインストールされており、ドライブレコーダ情報サーバ130のプロセッサ131を取得手段231、支払手段233および提供手段232として機能させるプログラムがドライブレコーダ情報サーバ130に予めインストールされていた。
 本発明においては、1以上のコンピュータによって実現されるドライブレコーダ情報提供システムにおいて、ドライブレコーダにて撮像された画像を解析させて特徴情報を抽出させるように、当該ドライブレコーダのイメージセンサモジュールを制御するステップと、該撮像された画像に基づいて所定の事象が発生したかを検出させるように、前記ドライブレコーダのイメージセンサモジュール制御するステップと、前記所定の事象が検知された際の画像の特徴情報を、当該画像が撮影された位置および時刻を示す情報とともに、通信網を介して、複数の前記撮像装置から取得するステップと、該取得した特徴情報に基づいて生成される情報を、外部サーバに提供するステップとが実行されていればよい。
 上記各ステップを実行するためのプログラムは、インターネットなどの電気通信網経由のダウンロードにより配布することができる。
In the above embodiment, a program that causes the processor 111 of the edge device 110 to function as the extraction unit 211, the detection unit 212, and the transmission unit 213 is preinstalled in the edge device 110, and the processor 131 of the drive recorder information server 130 is acquired by the acquisition unit 231. A program that functions as the payment unit 233 and the providing unit 232 is installed in the drive recorder information server 130 in advance.
In the present invention, in the drive recorder information providing system realized by one or more computers, the image sensor module of the drive recorder is controlled so as to analyze the image captured by the drive recorder and extract the feature information. Step, controlling the image sensor module of the drive recorder so as to detect whether a predetermined event has occurred based on the captured image, and image feature information when the predetermined event is detected Together with information indicating the position and time at which the image was taken from a plurality of imaging devices via a communication network, and information generated based on the acquired feature information to an external server It is only necessary that the providing step is executed.
The program for executing the above steps can be distributed by downloading via a telecommunication network such as the Internet.
 100…ドライブレコーダ情報提供システム、110…エッジデバイス、120…外部サーバ、130…ドライブレコーダ情報サーバ、140…IoTデバイス、150,160…通信網、111,131…プロセッサ、112,132…メモリ、113,133…ストレージ、114,134…通信装置、211…抽出手段、212…検知手段、213…送信手段、214…通信手段、215…撮像手段、231…取得手段、232…提供手段、233…支払手段。 DESCRIPTION OF SYMBOLS 100 ... Drive recorder information provision system, 110 ... Edge device, 120 ... External server, 130 ... Drive recorder information server, 140 ... IoT device, 150, 160 ... Communication network, 111, 131 ... Processor, 112, 132 ... Memory, 113 , 133 ... storage, 114, 134 ... communication device, 211 ... extraction means, 212 ... detection means, 213 ... transmission means, 214 ... communication means, 215 ... imaging means, 231 ... acquisition means, 232 ... provision means, 233 ... payment means.

Claims (11)

  1.  ドライブレコーダにて撮像された画像を解析させて特徴情報を抽出させるように、当該ドライブレコーダのイメージセンサモジュールを制御する第1制御手段と、
     該撮像された画像に基づいて所定の事象が発生したかを検出させるように、前記ドライブレコーダのイメージセンサモジュール制御する第2制御手段と、
     前記所定の事象が検知された際の画像の特徴情報を、当該画像が撮影された位置および時刻を示す情報とともに、通信網を介して、複数の前記ドライブレコーダから取得する取得手段と、
     該取得した特徴情報に基づいて生成される情報を、外部サーバに提供する提供手段と
     を備えるドライブレコーダ情報提供システム。
    First control means for controlling the image sensor module of the drive recorder so as to analyze the image captured by the drive recorder and extract the feature information;
    Second control means for controlling the image sensor module of the drive recorder so as to detect whether a predetermined event has occurred based on the captured image;
    Acquisition means for acquiring feature information of an image when the predetermined event is detected, together with information indicating a position and time at which the image was captured, from a plurality of the drive recorders via a communication network;
    A drive recorder information providing system comprising: providing means for providing information generated based on the acquired feature information to an external server.
  2.  前記所定の事象を検出したことを契機として、前記特徴情報を前記通信網を介して前記取得手段に提供するように、前記ドライブレコーダのホストコントローラに干渉する干渉手段を更に有する、
     請求項1に記載のドライブレコーダ情報提供システム。
    In response to the detection of the predetermined event, it further includes an interference unit that interferes with a host controller of the drive recorder so as to provide the feature information to the acquisition unit via the communication network.
    The drive recorder information providing system according to claim 1.
  3.  前記所定の事象とは、交通事故、天候、および道路の混雑状況に関するものの少なくともいずれかを含む、
     請求項1または2のいずれか一つに記載のドライブレコーダ情報提供システム。
    The predetermined event includes at least one of traffic accidents, weather, and road congestion.
    The drive recorder information provision system according to any one of claims 1 and 2.
  4.  一の事象に対して該取得された特徴情報が所定量に達した場合に、前記外部サーバへの情報の提供が実行される、
     請求項1ないし3のいずれか一つに記載のドライブレコーダ情報提供システム。
    Provision of information to the external server is executed when the acquired feature information for a single event reaches a predetermined amount;
    The drive recorder information provision system according to any one of claims 1 to 3.
  5.  前記外部サーバへ提供された情報の元となる画像を撮像したドライブレコーダが設けられた車両の管理者に対し、報酬を支払う支払手段をさらに備える、
     請求項1ないし4のいずれか一つに記載のドライブレコーダ情報提供システム。
    A payment means for paying a reward to a manager of a vehicle provided with a drive recorder that captures an image that is a source of information provided to the external server;
    The drive recorder information provision system according to any one of claims 1 to 4.
  6.  前記支払手段は、前記特徴情報の希少性に基づいて前記報酬の内容を決定する、
     請求項5に記載のドライブレコーダ情報提供システム。
    The payment means determines the content of the reward based on the rarity of the feature information.
    The drive recorder information providing system according to claim 5.
  7.  前記支払手段は、前記外部サーバに対する情報提供の対価の額に基づいて、前記報酬の内容を決定する、
     請求項5または6に記載のドライブレコーダ情報提供システム。
    The payment means determines the content of the reward based on the amount of consideration for providing information to the external server.
    The drive recorder information provision system according to claim 5 or 6.
  8.  前記支払手段は、前記外部サーバへ提供された情報の元となる画像を撮像したドライブレコーダから特徴情報を取得した回数に基づいて、当該ドライブレコーダが設けられた車両の管理者に対して、前記報酬を支払う、
     請求項5~7のいずれか一つに記載のドライブレコーダ情報提供システム。
    The payment means is based on the number of times characteristic information is acquired from a drive recorder that has captured an image that is a source of information provided to the external server, to the manager of the vehicle provided with the drive recorder, Pay the reward,
    The drive recorder information providing system according to any one of claims 5 to 7.
  9.  ドライブレコーダにて撮像された画像を解析させて特徴情報を抽出させるように、当該ドライブレコーダのイメージセンサモジュールを制御するステップと、
     該撮像された画像に基づいて所定の事象が発生したかを検出させるように、前記ドライブレコーダのイメージセンサモジュール制御するステップと、
     車両に設置されたドライブレコーダにて撮像された画像の特徴情報を抽出するステップと、
     前記画像に基づいて、所定の事象が発生したことを検知するステップと、
     前記所定の事象が検知された際の画像の特徴情報を、当該画像が撮影された位置および時刻を示す情報とともに、通信網を介して、複数の前記ドライブレコーダから取得するステップと、
     該取得した特徴情報に基づいて生成される情報を、外部サーバに提供するステップと
     を備えるドライブレコーダ情報提供方法。
    Controlling the image sensor module of the drive recorder to analyze the image captured by the drive recorder and extract the feature information;
    Controlling the image sensor module of the drive recorder so as to detect whether a predetermined event has occurred based on the captured image;
    Extracting feature information of an image captured by a drive recorder installed in the vehicle;
    Detecting the occurrence of a predetermined event based on the image;
    Obtaining the feature information of the image when the predetermined event is detected, together with information indicating the position and time at which the image was taken, from the plurality of drive recorders via a communication network;
    Providing the information generated based on the acquired feature information to an external server.
  10.  1以上のコンピュータに、
     ドライブレコーダにて撮像された画像を解析させて特徴情報を抽出させるように、当該ドライブレコーダのイメージセンサモジュールを制御するステップと、
     該撮像された画像に基づいて所定の事象が発生したかを検出させるように、前記ドライブレコーダのイメージセンサモジュール制御するステップと、
     前記所定の事象が検知された際の画像の特徴情報を、当該画像が撮影された位置および時刻を示す情報とともに、通信網を介して、複数の前記ドライブレコーダから取得するステップと、
     該取得した特徴情報に基づいて生成される情報を、外部サーバに提供するステップと
     を実行させるためのプログラム。
    On one or more computers,
    Controlling the image sensor module of the drive recorder to analyze the image captured by the drive recorder and extract the feature information;
    Controlling the image sensor module of the drive recorder so as to detect whether a predetermined event has occurred based on the captured image;
    Obtaining the feature information of the image when the predetermined event is detected, together with information indicating the position and time at which the image was taken, from the plurality of drive recorders via a communication network;
    A step of providing information generated based on the acquired feature information to an external server.
  11.  イメージセンサモジュールと、
     前記イメージセンサモジュールによって撮像された画像を解析させて特徴情報を抽出させるように、当該イメージセンサモジュールを制御する第1制御手段と、
     該撮像された画像に基づいて所定の事象が発生したかを検出させるように、前記イメージセンサモジュールを制御する第2制御手段と、
     前記所定の事象が検知された際の画像の特徴情報を、当該特徴情報に基づく情報を外部サーバに提供するサーバへ、当該画像が撮影された位置および時刻を示す情報とともに、通信網を介して、提供する通信手段と
     を備えるドライブレコーダ。
    An image sensor module;
    First control means for controlling the image sensor module to analyze the image captured by the image sensor module and extract the feature information;
    Second control means for controlling the image sensor module so as to detect whether a predetermined event has occurred based on the captured image;
    The feature information of the image when the predetermined event is detected is sent to a server that provides information based on the feature information to an external server, along with information indicating the position and time at which the image was taken, via a communication network. A drive recorder comprising: a communication means to provide.
PCT/JP2018/017316 2018-04-27 2018-04-27 Drive recorder information providing system, drive recorder information providing method, program, and drive recorder WO2019207796A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2018538658A JP6448872B1 (en) 2018-04-27 2018-04-27 Drive recorder information providing system, drive recorder information providing method, program, and drive recorder
PCT/JP2018/017316 WO2019207796A1 (en) 2018-04-27 2018-04-27 Drive recorder information providing system, drive recorder information providing method, program, and drive recorder

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/017316 WO2019207796A1 (en) 2018-04-27 2018-04-27 Drive recorder information providing system, drive recorder information providing method, program, and drive recorder

Publications (1)

Publication Number Publication Date
WO2019207796A1 true WO2019207796A1 (en) 2019-10-31

Family

ID=64960323

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/017316 WO2019207796A1 (en) 2018-04-27 2018-04-27 Drive recorder information providing system, drive recorder information providing method, program, and drive recorder

Country Status (2)

Country Link
JP (1) JP6448872B1 (en)
WO (1) WO2019207796A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021106474A1 (en) * 2019-11-29 2021-06-03 矢崎総業株式会社 Congestion prediction system and server device

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113454970B (en) * 2019-03-21 2023-10-10 杭州飞步科技有限公司 Extensible data fusion architecture and related products
JP7023909B2 (en) * 2019-09-19 2022-02-22 Kddi株式会社 Information processing equipment, information processing systems, information processing methods, and programs
JP7480642B2 (en) 2020-08-31 2024-05-10 株式会社Jvcケンウッド Information providing device and information providing program
JP2022045519A (en) * 2020-09-09 2022-03-22 トヨタ自動車株式会社 Information management system, and on-vehicle device, mobile terminal, and image management server used therein
JP2023177401A (en) * 2022-06-02 2023-12-14 株式会社 ミックウェア Information processing device, mobile terminal, information processing method, and program

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011123814A (en) * 2009-12-14 2011-06-23 Clarion Co Ltd Processor for traffic accident information
JP2011123720A (en) * 2009-12-11 2011-06-23 Rohm Co Ltd Driving recorder
JP2013175032A (en) * 2012-02-24 2013-09-05 Yazaki Energy System Corp Drive recorder
JP2015118669A (en) * 2013-12-20 2015-06-25 矢崎エナジーシステム株式会社 Travel information management system
JP2015230579A (en) * 2014-06-05 2015-12-21 トヨタ自動車株式会社 Accident image acquisition system
JP2016224677A (en) * 2015-05-29 2016-12-28 富士通テン株式会社 Drive recorder, data recording system, data recording method, and program
JP2018028855A (en) * 2016-08-19 2018-02-22 矢崎エナジーシステム株式会社 On-vehicle device and operation management system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011123720A (en) * 2009-12-11 2011-06-23 Rohm Co Ltd Driving recorder
JP2011123814A (en) * 2009-12-14 2011-06-23 Clarion Co Ltd Processor for traffic accident information
JP2013175032A (en) * 2012-02-24 2013-09-05 Yazaki Energy System Corp Drive recorder
JP2015118669A (en) * 2013-12-20 2015-06-25 矢崎エナジーシステム株式会社 Travel information management system
JP2015230579A (en) * 2014-06-05 2015-12-21 トヨタ自動車株式会社 Accident image acquisition system
JP2016224677A (en) * 2015-05-29 2016-12-28 富士通テン株式会社 Drive recorder, data recording system, data recording method, and program
JP2018028855A (en) * 2016-08-19 2018-02-22 矢崎エナジーシステム株式会社 On-vehicle device and operation management system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021106474A1 (en) * 2019-11-29 2021-06-03 矢崎総業株式会社 Congestion prediction system and server device
JP2021086523A (en) * 2019-11-29 2021-06-03 矢崎総業株式会社 Traffic congestion prediction system and server device

Also Published As

Publication number Publication date
JP6448872B1 (en) 2019-01-09
JPWO2019207796A1 (en) 2020-05-07

Similar Documents

Publication Publication Date Title
JP6448872B1 (en) Drive recorder information providing system, drive recorder information providing method, program, and drive recorder
JP6639624B2 (en) Drive recorder information providing system, drive recorder information providing method, and program
KR101752118B1 (en) Method, apparatus and device for predicting bus running
US9153077B2 (en) Systems and methods for collecting vehicle evidence
US9336450B2 (en) Methods and systems for selecting target vehicles for occupancy detection
US9171363B2 (en) Computer-readable recording medium and road surface survey device
CN108320553B (en) Road condition prediction method based on road driving event
CN110648539B (en) In-vehicle device and control method
CN112203216B (en) Positioning information acquisition method, driving assistance method and vehicle end sensor detection method
US11738747B2 (en) Server device and vehicle
US20160217333A1 (en) Information processing apparatus and information processing system
US20180224296A1 (en) Image processing system and image processing method
CN114359848A (en) Target detection method and device, vehicle-end sensing equipment and storage medium
JP2010132056A (en) Sensing device, sensing method, and vehicle control device
CN112926575A (en) Traffic accident recognition method, device, electronic device and medium
CN108665701A (en) A kind of traffic congestion recognition methods, device, terminal and storage medium
CN110969864A (en) Vehicle speed detection method, vehicle driving event detection method and electronic equipment
US20220207997A1 (en) Traffic Flow Estimation Apparatus, Traffic Flow Estimation Method, Traffic Flow Estimation Program, And Storage Medium Storing Traffic Flow Estimation Program
KR20190024511A (en) Method for sharing road situation and computer program recorded on record-medium for executing method therefor
CN112712608A (en) System and method for collecting performance data by vehicle
CN116935631A (en) Abnormal traffic situation detection method, device and system based on radar fusion
JP7187784B2 (en) Vehicle information processing system, management device, vehicle information processing method, and vehicle information processing program
JP2020126356A (en) Information processing device, information processing method, and program
CN112766746A (en) Traffic accident recognition method and device, electronic equipment and storage medium
JP6226371B2 (en) DSRC communication abnormality monitoring apparatus and DSRC communication abnormality monitoring program

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2018538658

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18916085

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18916085

Country of ref document: EP

Kind code of ref document: A1