KR20210013814A - Platform and implementing a method for p2p transaction/sharing service of black box images among drivers based on block chain technology - Google Patents

Abstract

Disclosed are a platform for a P2P transaction/sharing service of black box images between drivers based on blockchain technology and an implementation method thereof, which easily search for images to exchange black box images for an accident. According to one embodiment of the present invention, the image exchange method comprises: a step of requesting image information associated with an event from an electronic device of a witness vehicle searched based on vehicle information including time data and location data or a license plate number; a step of entering into a transaction contract for providing the requested image information with the electronic device of the witness vehicle; and a step of acquiring image information shared based on a blockchain in accordance with the entered transaction contract from the electronic device of the witness vehicle.

Description

Blockchain technology-based platform for P2P transaction/sharing service of black box video between drivers and its implementation method {PLATFORM AND IMPLEMENTING A METHOD FOR P2P TRANSACTION/SHARING SERVICE OF BLACK BOX IMAGES AMONG DRIVERS BASED ON BLOCK CHAIN TECHNOLOGY}

The description below relates to a platform for a P2P transaction/sharing service of black box video between drivers based on blockchain technology and a method of implementing the same.

Since the black box does not shoot the installed vehicle, it is difficult to secure the entire image of the accident site in case of a traffic accident. Black box video of the vehicle witnessed is required, but the contact information of the witness is not known, and it is difficult to find who is it, and it is inconvenient to exchange black box accident images. When dealing online with an unspecified person, there is a possibility that damage may occur due to various fraudulent transactions through various fraudulent methods and means.

Since it is not possible to know when and where a specific vehicle was photographed, it is possible to check whether or not a specific vehicle was photographed only when the driver manually replays the entire recorded video file and looks for it. In addition, the reliability and security of P2P transactions of black box accident images between unspecified individuals on the network must be secured. Accordingly, there is a need for a P2P transaction/sharing service platform that can trust images taken of a specific vehicle at a specific time and at a specific place, and enables safe and transparent transactions.

The Korean patent (Registration No. 10-1424740, "Black box device for sharing recorded images between buddy vehicles and its sharing method") is the video information recorded from the black box of the buddy vehicle when there is a buddy relationship with an adjacent vehicle when a traffic accident occurs. Disclosing the technology to be provided. However, this technique requires periodic broadcasting communication to find a buddy vehicle. Accordingly, if the vehicle is not a buddy vehicle, recording is not performed, and there is a problem in that video information cannot be shared even if it is not in the field or becomes a buddy after an accident.

In addition, the Korean Patent Registration (Registration No. 10-1701698, "How to Share Black Box Information of Vehicles at the Accident Location") communicates with the black box terminal of a nearby vehicle or an interlocked smartphone to obtain the vehicle number of the surrounding vehicle. Or, it relates to a technology for exchanging the owner's phone number in real time. In the event of an accident, an image is requested using the vehicle number or phone number of the surrounding vehicle collected based on the time input by the user. However, it is impossible to confirm whether the requestor's vehicle was photographed in the video.

In addition, the Korean Patent Publication (Publication No. 10-2016-0146343, "A black box image sharing method based on location information and a terminal using the same") allows users to share the time and location of the black box image, A method of requesting an image and transmitting an image when there is a black box image captured at a time and a corresponding location is proposed. However, even if users share the time and location of the black box video recording, it is not easy to identify the black box of the vehicle that witnessed the accident vehicle at the accident site in the event of a traffic accident, and whether the accident vehicle was photographed even if it is at the same time and location. It is difficult to determine the data, and it is difficult to check the received images individually after requesting all the black box images taken at the same time and location.

In addition, Korean Patent Publication (Publication No. 10-2016-0144214, "A method of sharing traffic accident information and a mobile terminal using the same") proposes a method of sharing road traffic information including traffic accident information in real time between drivers through an SNS application. Are doing. However, in the above invention, a traffic accident occurs by simply uploading the location of a specific point and a black box image to SNS in order to share real-time traffic information, the location of a road construction point or a traffic accident point, or the road traffic status while driving. It is difficult to identify the vehicle that witnessed the accident vehicle, making it impossible to obtain a black box image of the vehicle that was witnessed.

It is possible to provide a method and system for mutually exchanging black box accident images by easily searching for images taken of a specific vehicle at a specific date/time and at a specific location.

Based on blockchain technology, it is possible to provide a transparent and reliable Internet P2P transaction and sharing method and system for black box images between drivers.

The image exchange method includes: requesting image information related to an event from an electronic device of a vehicle of sight that is searched based on vehicle information including time data, location data, or vehicle number; Signing a transaction contract for providing the requested image information with an electronic device of the sighting vehicle; And acquiring the shared image information based on the block chain according to the signed transaction contract from the electronic device of the sighting vehicle.

The image exchange method includes recording image information photographed by an electronic device of an accident vehicle and a sighting vehicle, receiving location data of the electronic device, analyzing vehicle information of neighboring vehicles per unit time, and analyzing neighboring vehicles per unit time. It may further include storing the vehicle information, the received location data, and the image information.

The image exchange method recognizes a dynamic object or a static object based on the image information YOLO v3 or an image recognition algorithm, and detects a vehicle being driven or a vehicle at a stop, and the vehicle number, vehicle license plate, vehicle type, and vehicle brand , The step of identifying vehicle information including the model name of the vehicle may be further included.

In the requesting of the image information, as the electronic device or a sensor of a vehicle present in the electronic device recognizes that an accident has occurred, the accidental image information is automatically generated based on time data or location data of the accident. Searching for or by inputting vehicle information including time data, location data, or vehicle number of the accident from the driver of the accident vehicle to manually search for the image information in which the accident has occurred.

The requesting of the image information may include searching for an electronic device of the sighting vehicle based on vehicle information including the time data, location data, or vehicle number, and the time data and location data in the electronic device of the found sighting vehicle. Alternatively, a block is generated for vehicle information, location information, and image information of the adjacent vehicle per unit time searched according to vehicle information including the vehicle number, and the number of adjacent vehicles per unit time excluding the image file according to a preset criterion from the generated block. It may include the step of creating a block chain using vehicle information and location information.

The signing of the transaction contract includes automatically entering into a transaction contract between the electronic device requesting the image information and the electronic device providing the image information according to a transaction condition set using a blockchain-based smart contract. I can.

The signing of the transaction contract may include viewing and confirming image information corresponding to the searched block chain based on vehicle information including the time data, location data, or vehicle number, and then the requested by the electronic device of the witnessing vehicle. It may include determining approval or rejection for provision of the image information, and signing a transaction contract for the requested image information as approval for the provision of the requested image information is made.

In the sharing of the requested image information, as the requested image information is encrypted from the electronic device of the sighting vehicle and transmitted to the electronic device, the electronic device downloads the encrypted image information, and then decrypts the image information. It may include the step of reproducing.

The step of sharing the requested image information includes sharing the requested image information based on access control including search, inquiry, transaction, download, and deletion of a file set in the requested image information and a limited range of use period. It may include the step of.

The electronic device for image exchange includes: a request unit for requesting image information related to an event from the electronic device of the sighted vehicle searched based on vehicle information including time data, location data, or vehicle number; A contracting unit for signing a transaction contract for providing the requested image information with an electronic device of the witnessed vehicle; And an acquisition unit for acquiring shared image information based on a block chain in accordance with the signed transaction contract in the electronic device of the sighting vehicle.

The electronic device records image information photographed by the electronic device of the accident vehicle and the sighting vehicle, receives the location data of the electronic device, analyzes vehicle information of the adjacent vehicle per unit time, and analyzes the vehicle information of the adjacent vehicle per unit time. A storage unit for storing vehicle information, the received location data, and the image information, wherein the storage unit recognizes a dynamic object or a static object based on YOLO v3 or an image recognition algorithm for the image information, and a vehicle running Alternatively, vehicle information including a vehicle number, a vehicle license plate, a vehicle type, a vehicle brand, and a vehicle model name may be identified through detection of a vehicle at a stop.

The requesting unit may automatically search for image information on the occurrence of an accident based on time data or location data of the occurrence of the accident as the electronic device or a sensor of a vehicle present in the electronic device recognizes that an accident has occurred, or The accidental image information may be manually searched for by inputting vehicle information including time data, location data, or vehicle number of the accident from the driver of the accident vehicle.

The request unit searches for an electronic device of the sighting vehicle based on vehicle information including the time data, location data, or vehicle number, and includes the time data, location data, or vehicle number in the electronic device of the found sighting vehicle. A block is generated for vehicle information, location information, and image information of adjacent vehicles per unit time searched according to the vehicle information, and vehicle information and location information of adjacent vehicles per unit time excluding video files from the generated block according to a preset criterion. Blockchain can be created using.

The contractor may automatically enter into a transaction contract between the electronic device requesting the image information and the electronic device providing the image information according to a transaction condition set using a blockchain-based smart contract.

The fastening unit reads and confirms image information corresponding to the searched block chain based on vehicle information including the time data, location data, or vehicle number, and then provides the requested image information from the electronic device of the witnessing vehicle. It is possible to decide whether to approve or reject the request, and enter into a transaction contract for the requested image information as approval for the provision of the requested image information is made.

By linking vehicle information, time information, and location information through black box image information analysis, it is possible to search for a file of an image photographing a specific vehicle at a specific location at a specific time.

When an impact above a certain level is detected, it is recognized as a traffic accident, and based on the time and location when the impact is detected, the vehicle that has taken the accident vehicle can be automatically searched, or the vehicle driver of the accident vehicle can manually search the vehicle that the vehicle has been witnessed. have.

It is possible to secure an overall image of the accident site by requesting to search for a vehicle that has actually captured the accident vehicle and provide a black box image.

Black box accident images captured by various devices can be exchanged between drivers.

It can be used in various fields such as accurate identification of the cause of the accident and real-time road situation identification, tracking and arrest of criminals by using images of witnessing accident vehicles or crime scenes, images taken from CCTV blind spots, and images showing actual road traffic conditions. have.

With the application of blockchain technology, safe and reliable real-time video information transaction and sharing is possible.

1 is a diagram illustrating a configuration of an IoT platform system for exchanging images according to an exemplary embodiment.
2 is a block diagram illustrating a configuration that may be included in a control unit of an electronic device according to an exemplary embodiment.
3 is a flowchart illustrating a method of acquiring an image in an electronic device according to an exemplary embodiment.
4 is a diagram for explaining the structure of an IoT platform system according to an embodiment.
5 is a flowchart illustrating a method of linking information in an electronic device according to an exemplary embodiment.
6 is a flowchart illustrating a method of sharing an accident image in an electronic device according to an exemplary embodiment.
7 is an example of a search result searched by an electronic device according to an exemplary embodiment.
8 is a diagram for explaining a P2P transaction and sharing operation of an image in an IoT system according to an embodiment.
9 to 12 are examples for explaining analyzing vehicle information in an IoT system according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

Black box device of vehicle, black box for bicycle, smartphone, tablet PC, wearable device, drone, etc., capable of performing action cam or black box function, video information being shot through mobile terminal (electronic device) or captured black box image By analyzing the information, vehicle information (e.g., vehicle registration number, model name, vehicle type, color, etc.) is extracted, the identified vehicle information, the time taken and the location taken are linked and recorded, and the vehicle information, the time taken, and The captured location is transmitted to the server and stored in the server, and when an impact of a certain level or higher is detected through interlocking with the shock sensor of the black box device or the shock sensor of the vehicle, it is recognized as a traffic accident, and the time when the shock is detected. Based on the location, the vehicle driver of the accident vehicle automatically searches for a vehicle that has photographed the accident vehicle, or the vehicle driver manually searches for the vehicle that the vehicle accident has photographed separately from the shock detection and requests the provision of a black box accident image. A method and system for mutually transacting and sharing black box accident images captured by various devices between drivers, which can provide a black box accident image captured while driving or while parked and stopped, will be described.

In an embodiment, an accident is recognized through a black box, a vehicle identification number such as a vehicle type, model name, and color is identified, and a black box accident image is exchanged between drivers through a specific time, specific, location, and specific vehicle search/inquiry. , Using blockchain technology, we will explain how to transparently and securely trade accident videos, and perform direct P2P transactions of video information between users. In addition, video transaction between heterogeneous devices is possible, and an IOT platform system for video information transaction will be described.

1 is a diagram illustrating a configuration of an IoT platform system for exchanging images according to an exemplary embodiment.

The IoT platform system will be described with reference to FIG. 4 to describe the structure of the IoT platform system. For example, the IoT platform system may be operated in an electronic device (eg, a black box) through an application, for example. The IoT platform system analyzes image information using camera sensors of electronic devices and records the current location data and past travel routes using GPS location sensors, not only exchanges real-time traffic condition image information of roads, but also traffic law violation vehicles. It can also be used for reporting and cracking down on, fleeing or tracking the location of specific vehicles used for crime. In addition, it is not only dependent on the image information of the accident site when a traffic accident occurs by interlocking with the device's own sensor such as a shock sensor or various sensors of the vehicle such as speedometer, engine thermometer, tire pressure gauge, By analyzing vehicle status information, it is possible to determine the exact cause of the accident. Furthermore, through the acquisition of evidence related to accidents, the evidence can be used as submission data related to accidents. In the following embodiments, a traffic accident will be described as an example among events (eg, violation of traffic laws, traffic accidents, etc.) generated by a vehicle.

The electronic device 100 performs a black box function, analyzes image information to identify vehicle information, and receives GPS location information to collect the identified vehicle information and location data. In this case, the electronic device may include, for example, a black box for a conventional vehicle, a black box for a bicycle, an action cam, a smartphone, a tablet PC, a drone, and a wearable device.

The electronic device 100 is a device capable of performing a black box function, and includes a camera 110, an impulse measurement unit 111, a GPS receiver 112, an image analysis unit 113, a control unit 114, and an encryption/decryption unit. 115, a display 116, a storage unit 117, and a communication unit 118 may be included.

The camera 110 may be installed at the front, rear or side of the vehicle to take an image and start recording the captured image. In this case, the camera 110 may capture an area existing in a preset angle range.

The impact amount measuring unit 111 may detect the amount of impact applied to the vehicle from the outside of the vehicle. The impact amount measuring unit 111 may measure the amount of impact based on at least one sensor for measuring the amount of impact. Alternatively, the impact amount measuring unit 111 may detect the amount of impact applied to the vehicle using the vehicle impact sensor. For example, the impact measurement beam 111 may detect the amount of impact applied from the outside through interlocking with the impact sensor of the electronic device itself or the impact sensor of the vehicle.

The GPS receiver 112 may identify current location data of the vehicle. For example, current data of the vehicle may be identified based on data transmitted and received from GPS. The GPS receiver 112 may receive current location data of the vehicle as coordinate information.

The image analysis unit 113 may analyze an image photographed per hour to analyze information about vehicles and surrounding vehicles adjacent to the vehicle. For example, the image analysis unit 113 may extract at least one or more surrounding vehicle information (identification information) (eg, vehicle registration number) recognized in the image. In this case, when a traffic accident occurs in a vehicle, the above-mentioned surrounding vehicle may be a sighting vehicle.

The control unit 114 may link time data for capturing the image, location data for capturing the image, and information on the vehicle identified per time. Referring to FIG. 2, it is a block diagram illustrating a configuration that may be included in the controller 114 of an electronic device. The control unit 114 may include a request unit 210, a fastening unit 220, and an acquisition unit 230.

The request unit 210 may request image information related to the event from the electronic device of the vehicle of the sighting searched based on vehicle information including time data, location data, or vehicle number. In general, information may be retrieved from an electronic device in which an accident has occurred, but is not limited thereto. The request unit 210 may search for image information based on vehicle information (eg, manufacturer, vehicle name, vehicle type, classification, model name, color, etc.) including a specific time, a specific location, and a vehicle number of the user. The request unit 210 may automatically perform a search when an accident is recognized using a sensor of an electronic device or a shock sensor of a vehicle. Alternatively, in addition to detecting the accident, the request unit 210 may manually perform a search by directly inputting the time and location of the accident. The request unit 210 may view a moving route of an accident vehicle or a sighting vehicle photographed based on a corresponding time and a corresponding location on a map through an electronic device. The request unit 210 may request to check and provide necessary image information using a thumbnail or a screenshot extracted through an electronic device.

The connection unit 220 may enter into a transaction contract for providing the requested image information with the electronic device of the vehicle to be witnessed. The contractor 220 may automatically enter into a transaction contract between an electronic device that has requested image information and an electronic device that provides image information according to a transaction condition set using a blockchain-based smart contract. Accordingly, it is possible to reduce the required time due to a request/approval procedure between the electronic device requesting the image information and the electronic device that provides the image information, and simplify the image information transaction procedure. Alternatively, the fastening unit 230 confirms viewing of the requested image information as a request for providing image information obtained by photographing vehicle information including a specific vehicle number at a specific time and at a specific location in the electronic device of the witnessing vehicle is confirmed. , Approval or rejection for providing image information to an electronic device (an electronic device that has requested image information) of the accident vehicle may be determined. As it is approved to provide the image information from the electronic device of the vehicle of the sighting, the conclusion unit 220 may proceed with a transaction contract for trading image information with the electronic device of the accident vehicle. As the conclusion of the transaction contract for the mutual image information, the connection unit 220 may encrypt and transmit/receive the corresponding image information from the electronic device of the witnessing vehicle to the electronic device of the accident vehicle. After downloading the image information from the electronic device of the accident vehicle, it may be decoded and reproduced.

The acquisition unit 230 may acquire shared image information based on a block chain according to a transaction contract concluded in the electronic device of the vehicle to be witnessed. As the image information requested from the electronic device of the sighting vehicle is encrypted and transmitted to the electronic device, the acquisition unit 230 may download the encrypted image information from the electronic device, decode it, and reproduce the image information.

The encryption unit 115 may encrypt location data where an image is captured and vehicle information. In addition, the encryption unit 115 may encrypt an image captured from time data and location data recognized as a traffic accident. For example, the encryption/decryption unit 115 may encrypt and transmit the image information from the electronic device of the sighting vehicle as the image information is requested from the electronic device to the electronic device of the sighting vehicle. The electronic device may decrypt the image information as it receives the encrypted image information from the electronic device of the sighting vehicle.

The display unit 116 may display the captured image through the screen of the electronic device.

The storage unit 117 may store the captured image in a database. In this case, the storage unit 117 may map the location data and time data in which the image is captured and store it together with the image. In this case, a part of an image in which a traffic accident occurred among the images to be photographed may be separately stored. The storage unit 117 may analyze information (eg, vehicle number, vehicle type, color, etc.) of adjacent vehicles per unit time through electronic devices of each of the sighted vehicle or accident vehicle. The storage unit 117 may record vehicle information and location information per unit time through electronic devices of each of the sighted vehicle or the accident vehicle, and store image information. For example, the storage unit 117 may record the shooting date and date and time, such as "20181108 13:30:32", of time information per unit time. The storage unit 117 may record the changed location information per unit time, including latitude and path, such as "41.40338, 2.17403". The storage unit 117 may identify the number of the vehicle being photographed by the front/rear/side cameras and record it as “21 o 9018”. The storage unit 117 recognizes a dynamic object or a static object from the image information, and stores vehicle information including a vehicle number, a license plate, a vehicle type, a vehicle brand, and a vehicle model name through detection of a running vehicle or a stopped vehicle. Can be identified.

Referring to FIG. 9, the electronic device may recognize objects such as vehicles, pedestrians, bicycles, and obstacles. The electronic device recognizes dynamic or static objects based on YOLO v3 or image recognition algorithms from image information, and detects a vehicle being driven or a vehicle at a stop to detect the vehicle number, vehicle license plate, vehicle type, vehicle brand, and vehicle model name. Vehicle information including a can be identified. For example, pedestrians (eg, children, the elderly), animals (eg, dogs, cats, etc.), various obstacles, and other threats and protection targets on the road can be identified. In addition, after recognizing the vehicle, it is possible to accurately identify the vehicle by collecting various vehicle information including detailed information about the vehicle (eg, vehicle license plate, vehicle type, brand, vehicle model name, etc.).

Referring to FIG. 10, the electronic device may recognize a vehicle license plate. The electronic device can identify license plates for various languages such as Korean, English, Chinese, and Japanese based on license plate recognition software or its own license plate recognition algorithm. In addition, the electronic device can identify license plates for each country using the same language (eg, the United States, United Kingdom, Canada, Australia, etc.). In addition, the license plate can be identified based on the license plate standard including the size, color, text color, format, symbol, and abbreviation of the license plate. In addition, the electronic device may use an infrared camera to read the license plate during night driving.

Referring to FIG. 11, the electronic device may recognize vehicle type/brand/model/color. Electronic devices can apply YOLO 9000/YOLO v3 and build their own car image database. The electronic device may classify vehicle information by a design of the rear of the vehicle or a rear light for the vehicle manufacturer, vehicle name, vehicle model, and model name. Electronic devices can build a database of car brand logos and rear design photos of vehicles for vehicle recognition (five types of passengers, vans, cargo, special, and two-wheeled vehicles according to Article 3 of the Vehicle Management Act). Electronic devices can identify vehicle types, brands, models, colors, etc. by applying YOLO 9000/YOLO V3 to pattern recognition for vehicle logos and vehicle rear designs.

In addition, vehicle-related data can be collected and analyzed. Electronic devices can link DB/web sites of automobile-related institutions, companies, and associations, or collect and analyze vehicle-related data using the vehicle's own sensor. For example, through the vehicle registration agency, the date of manufacture, vehicle registration number, type and year (model code and year of the manufacturer's internal model), vehicle identification number (car's resident registration number), motor type (engine code name), owner information, last registration date, etc. This can be collected and analyzed. The inspection history, maintenance history, automobile tax arrears, compulsory insurance subscription information, and the number of foreclosure/mortgage cases can be collected and analyzed through the automobile civil petition public portal. Through the insurance company, the name of the insurance company, product name, contract status, collateral content, subscription amount, insurance premium, accident history, etc. can be collected and analyzed. Driving history (eg, moving position, moving time, moving distance, etc.) and driving data (running speed, speed change, brake, engine RPM, stopping time, acceleration, etc.) may be collected and analyzed through the vehicle sensor.

Referring to FIG. 12, a method of collecting and analyzing road traffic safety information and driving environment information will be described. The electronic device can provide various services through the collection and analysis of real-time road traffic information. Traffic sign information may be collected through image information analysis. Emergency information can be shared between drivers, such as a major collision accident and emergency road construction, and a notification service for emergency information can be provided. Image information and vehicle sensor information are collected and analyzed so that real-time weather information (eg, heavy snow, fog, etc.) for each road section can be shared, and a notification service for weather information can be provided.

The communication unit 118 may transmit vehicle information and location data to the server. The communication unit 118 may include not only a communication method using a communication network (eg, mobile communication network, wired Internet, wireless Internet, broadcasting network) that the network may include, but also short-range wireless communication between devices. For example, when the distance between the electronic device and the server is less than a preset distance based on the distance between the electronic device and the server, the communication unit 118 may perform short-range wireless communication.

The central management service server 200 may control so as to mutually exchange black box accident images between drivers by collecting linkage records between vehicle information and location information from electronic devices. The central management service server 200 is for controlling and managing data transmitted and received from at least one electronic device, and the communication unit 120, the location information analysis unit 121, the map display unit 122, the identity authentication unit 123 , An encryption/decryption unit 124, a server control unit 125, and a storage unit (DB) 126.

The communication unit 120 may communicate with at least one electronic device. The communication unit 120 may include short-range wireless communication as well as a communication method using a communication network (eg, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network may include.

The location information analysis unit 121 may provide a view of a moving route of a vehicle based on specific time data and specific location data on the map data. For example, the location information analysis unit 121 may map a moving path of a vehicle to map data based on time data and location data, and may provide map data obtained by mapping the moving path of the vehicle.

The map display unit 122 may provide map data for searching for vehicle information including specific time data, specific location data, and vehicle number.

The identity authentication unit 123 may perform authentication necessary for checking and requesting the provision of necessary image information. In this case, the identity authentication unit 123 may perform an authentication process through a separate identity authentication server 300 in order to perform authentication of an electronic device that has requested to check and provide image information. As authentication is completed in the identity authentication server 300, it is possible to control to check the image information. For example, user identification information may be registered in advance through an application of an electronic device. In this case, at least one or more devices related to user identification information may be registered. In this way, as the authentication of the electronic device is completed, image information can be checked.

The encryption/decryption unit 124 may control encrypted transmission/reception of image information between electronic devices.

The server controller 125 may control the exchange of image information between electronic devices.

The storage unit 126 may store vehicle information (identification information) (eg, vehicle color, vehicle model name, vehicle type, vehicle registration number, etc.) and location data received from the electronic device.

The IoT platform system according to an embodiment allows the user to directly play back video information recorded in an analog method in an existing black box to manually find an accident time and an image shot at the accident location, and an impact detection sensor on the black box device. When the vehicle is equipped with or interlocked with the vehicle's impact detection sensor, images before and after the impact detection time are automatically stored separately when an impact of a certain level or higher is detected, so that the user can easily search for an accident image. In addition, by applying IoT, it is possible to notify the user of the vehicle impact in real time, and to query the vehicle's current location and past driving history information using various sensor information linked to the black box.

3 is a flowchart illustrating a method of acquiring an image in an electronic device according to an exemplary embodiment.

In an embodiment, the electronic device may be an electronic device present in a vehicle in which an event (eg, an accident) has occurred, and the electronic device of the witnessing vehicle is an electronic device present in a vehicle witnessing the event (eg, an accident). I can. In addition, image information may be requested from an electronic device of an accident vehicle (victim or perpetrator), and image information may be provided from an electronic device of the witnessed vehicle.

In operation S310, the electronic device may request image information related to the event from the electronic device of the sighted vehicle searched based on vehicle information including time data, location data, or vehicle number of the event. The electronic device automatically searches for video information on the occurrence of the accident based on the time data or location data of the accident, as the electronic device or the vehicle sensor existing in the electronic device recognizes that an accident has occurred, or the accident vehicle driver The accidental video information may be manually searched by inputting vehicle information including time data, location data, or vehicle number of the accident. The electronic device searches for an electronic device of the sighting vehicle based on vehicle information including time data, location data, or vehicle number, and the electronic device of the found sighting vehicle detects time data, location data, or vehicle information including the vehicle number. Block chain is generated for vehicle information, location information, and image information of adjacent vehicles per unit time searched according to the result, and by using vehicle information and location information of adjacent vehicles per unit time excluding video files according to a preset standard from the generated block Can be created.

In step S320, the electronic device may enter into a transaction contract for providing the requested image information with the electronic device of the witnessing vehicle. The electronic device can automatically enter into a transaction contract between the electronic device requesting the image information and the electronic device providing the image information according to the transaction conditions set by using a blockchain-based smart contract. In order to conclude an automatic transaction between the electronic device of the accident vehicle (the requester of the image information) and the electronic device (the image information provider) of the vehicle being witnessed, certain transaction conditions may be set in advance. Accordingly, it is necessary to consent to the information subject, such as collecting, viewing, and providing information necessary for the transaction of image information. Alternatively, after the video information corresponding to the block chain searched based on vehicle information including time data, location data, or vehicle number from the electronic device of the witnessed vehicle is viewed and confirmed, approval or rejection for provision of the requested video information Can be determined. As approval for the provision of the requested image information from the electronic device of the sighting vehicle is made, a transaction contract for the requested image information may be concluded between the electronic device of the accident vehicle and the electronic device of the sighting vehicle.

In step S330, the electronic device may acquire the shared image information based on the block chain according to a transaction contract concluded with the electronic device of the witnessing vehicle. At this time, P2P transactions based on blockchain technology can be performed. For example, "I didn't receive the video, ask for a refund," even though the requested video was sent, or "Can't send the video because I didn't get the money, pay back money" even though the money was correctly paid. ", etc. may occur. Therefore, it is necessary to secure the safety and reliability of the P2P-based video information transaction between decentralized users, which is the basic concept of the blockchain. In addition, although the transaction was transparent, there may be a possibility of forgery/falsification or leakage of personal or video information (or receiving a fake file), and the video information was normal, but there is a possibility that an unrequester or a hacker pays incorrectly. Therefore, it is necessary to ensure the transparency and reliability of transactions between users, and maintain the security, confidentiality, and integrity of video information.

As the image information is encrypted from the electronic device of the sighting vehicle and transmitted to the electronic device, the electronic device may download the encrypted image information from the electronic device and then decrypt the image information to reproduce the image information. For example, when a black box accident image is traded between the electronic device of the accident vehicle and the electronic device of the witnessing vehicle, it may be determined as a cryptocurrency. When browsing related data such as criminal vehicle search, accident history inquiry, and driving data, payment can also be made in cryptocurrency.

5 is a flowchart illustrating a method of linking information in an electronic device according to an exemplary embodiment.

In step S501, the electronic device may start recording an image while the vehicle is driving and may receive GPS location data.

In step S502, the electronic device may analyze vehicle information based on the image being captured per hour or the image already captured. The electronic device may search for a vehicle witnessed by using vehicle information based on location data and time data. The electronic device may analyze vehicle information to identify a vehicle present in the image.

In step S503, the electronic device may map the identified vehicle information with location data for each time unit and store it together with the image. For example, the electronic device may map and store an image including the identified vehicle information with location data where the image is captured every minute.

In step S504, the electronic device may encrypt the identified vehicle information and location data and transmit it to the server. The server may store encrypted data transmitted from the electronic device. At this time. Since the server collects only vehicle information and location data and does not collect images, there is no risk of network overload or server overload caused by storage or transmission of large files. In addition, it is possible to remove the inconvenience of having to check the image with a viewer program by physically separating the memory card of the electronic device.

6 is a flowchart illustrating a method of sharing an accident image in an electronic device according to an exemplary embodiment.

In step S601, the electronic device may recognize a traffic accident as an impact higher than a certain level is detected. For example, the electronic device may detect the amount of impact using an impact sensor mounted on a vehicle. In this case, the electronic device may determine whether or not it is a traffic accident by comparing a preset impulse amount standard with a detected impulse amount.

In step S602, the electronic device may automatically search for a vehicle to be witnessed using vehicle information based on time data and location data recognized as a traffic accident. For example, the electronic device may analyze information on a sighted vehicle present in the image based on image information captured from time data and location data recognized as a traffic accident. In addition, the electronic device is within a specific time range before and after based on the time data recognized as a traffic accident (for example, within a total of 10 minutes including 5 minutes before and 5 minutes after the time data recognized as a traffic accident) It is possible to analyze the information of the vehicle witnessed in the presence. Through this, the electronic device may search for information on the vehicle being witnessed. At this time, time data or location data recognized as a traffic accident may be input to the electronic device, thereby automatically searching for a vehicle to be witnessed. Alternatively, in step S603, the electronic device may manually search for the sighted vehicle using specific time data, location data, and vehicle information. For example, a user may directly search for a sighted vehicle by inputting time data, location data, and vehicle information through an electronic device or an electronic device different from the electronic device.

In step S604, the electronic device may view the moving route of the vehicle based on time data and location data in the map data. In this case, the location data may mean the point where the accident occurred, and may include a predetermined radius based on the point where the accident occurred. For example, the server may extract the electronic device of the sighting vehicle corresponding to the time data, the location data and the sighting vehicle information retrieved from the electronic device, and the location data and time data corresponding to the extracted electronic device of the sighting vehicle You can ask the vehicle's electronics to provide it. Referring to FIG. 7(A), on the basis of time data, location data, and vehicle information on the map data 700, the number of times the vehicle (accident vehicle) was photographed by sighting vehicles and the location of the vehicle Display to provide search results to electronic devices.

In step S605, the electronic device may check necessary image information and may request to provide image information. For example, as the image information desired by the user is searched, the electronic device providing the image information may be requested to provide the image information. Referring to FIG. 7(B), by viewing the moving route of the witnessing vehicle and checking the time data and location data of image information required for each point of the moving route displayed on the map data, the electronic device of the witnessing vehicle provides the image information. Can be requested. For example, in FIG. 7(A), a tag in which each number is displayed may mean the number of times the accident vehicle is photographed. As the user selects a tag with a high number of times the accident vehicle is photographed, the map data of FIG. 7B may be displayed. At this time, the location data (point) and time data of the accident vehicle may be displayed as tags on the map data. In addition, time data and location data of the accident vehicle may be displayed as a message 710.

In step S606, the electronic device may determine whether provision of image information is approved. For example, the electronic device of the vehicle to be witnessed may receive a notification of a request to provide image information from a user of the vehicle of an accident. The electronic device of the witnessing vehicle may approve or reject the provision of the image information by checking the image information captured from the time data and the location data requested by the user of the accident vehicle.

In step S607, the electronic device may receive the encrypted image information of the sighted vehicle. At this time, as video provision is approved from the electronic device of the vehicle being witnessed, the image encrypted with the electronic device of the accident vehicle, for example, a black box existing in the vehicle or another electronic device (for example, a smart phone) associated with the user Can be transmitted.

In step S608, the electronic device may download the image information, decode the image information, and reproduce the downloaded image. In this case, the image downloaded to the electronic device may be reproduced, and the image may be downloaded and played back from another electronic device registered with the same user identification information as the electronic device. For example, an image may be played back through a black box, and an image may be transmitted to a user terminal (eg, a smart phone) for receiving an image related to a traffic accident from outside in addition to the black box.

8 is a diagram for explaining a P2P transaction and sharing operation of an image in an IoT system according to an embodiment.

Vehicle information including time data, location data, and vehicle number from an electronic device of an accident vehicle or a vehicle witnessed may be encrypted and transmitted to the server. The user may search for image information using vehicle information including time data, location data, and vehicle number through an electronic device. In this case, an image file including vehicle information and location data per unit time may be searched. In other words, the electronic device of the sighting vehicle having the image information may be searched, and the image information may be searched through the electronic device of the found sighting vehicle.

When the searched image information exists, a block for the searched image information may be generated. In detail, a block may be generated for vehicle information, location data, and image information of adjacent vehicles per unit time searched according to vehicle information including time data, location data, or vehicle number of an accident in the electronic device of the witnessed vehicle. . From the generated block, a block chain can be created using vehicle information and location data of adjacent vehicles per unit time excluding video files according to a preset criterion. For example, a blockchain can be created by time or by location.

After viewing and confirming the video information corresponding to the block chain on the electronic device of the vehicle being witnessed, a transaction contract for video information between users can be concluded. For example, smart contracts can be made. At this time, based on Hyperledger Fabric V3.0, it is possible to provide a non-face-to-face transaction between unspecified users through content (video file)-centered transactions rather than user-centered. It is an open source and can be implemented in the form of a module for each function, so it is easy to develop and maintain, and it can support various frameworks and tools, and is suitable for business platforms.

The electronic device of the vehicle to be witnessed may encrypt image information requested from the electronic device of the accident vehicle and transmit it to the electronic device of the accident vehicle. For example, it can be used as a payment method when transacting a black box accident image between a driver of an accident vehicle and a driver of a witness vehicle through cryptocurrency (for example, LifeLedger's own coin). At this time, the cryptocurrency is a private blockchain, so it can maintain its independence, uniqueness, and specificity by creating its own coin, and it is not necessary to intervene by third party institutions such as banks and card companies, such as by using its own coin instead of an account transfer or credit card. In addition, it can be used as a payment method when transacting video information in connection with existing virtual currency (Bitcoin, Ethereum, etc.) or points/mileage.

After downloading the encrypted image information from the electronic device of the accident vehicle, the image information may be reproduced by decrypting. Here, it is possible to exchange image information by constructing its own InterPlanetary File System (IPFS) utilizing the advantages of the Peer to Peer concept and the Point to Point concept. When uploading accident images, sensitive areas such as license plates and human faces can be mosaic-processed and then distributed and stored in the network. For example, a transaction may be requested by checking a file of image information, an authentication key for decoding a mosaic may be requested after the transaction is concluded, and a mosaic existing in an encrypted image file may be decrypted with the received authentication key. In addition, it is possible to manage access control such as search, inquiry, transaction, download, and deletion of images for each image file, and limit the use period of images. Accordingly, when exchanging image files, it is possible to prevent forgery and alteration of the file and prevent leakage of personal information such as vehicle information, which is excellent in terms of information protection.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. Can be embodyed. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (15)

In the video exchange method,
Requesting image information related to an event from an electronic device of a vehicle of the sighting searched based on vehicle information including time data, location data, or vehicle number;
Signing a transaction contract for providing the requested image information with an electronic device of the sighting vehicle; And
Acquiring shared image information based on a block chain according to the concluded transaction contract in the electronic device of the witnessing vehicle
Video exchange method comprising a. The method of claim 1,
Record image information photographed by electronic devices of accident vehicles and sighting vehicles, receive location data of the electronic device, analyze vehicle information of neighboring vehicles per unit time, and receive vehicle information of neighboring vehicles per unit time analyzed. Storing the location data and the image information
Video exchange method further comprising a. The method of claim 2,
The image information is based on YOLO v3 or an image recognition algorithm to recognize a dynamic object or a static object, and the vehicle number, vehicle license plate, vehicle type, vehicle brand, and vehicle model name are included through detection of a vehicle running or a vehicle at a stop. Identifying vehicle information
Video exchange method further comprising a. The method of claim 1,
The step of requesting the image information,
By recognizing that an accident has occurred using the electronic device or a vehicle sensor present in the electronic device, the image information of the accident is automatically searched based on the time data or location data of the accident, or from the driver of the accident vehicle. Manually retrieving the image information of the accident by inputting vehicle information including time data, location data, or vehicle number of the accident
Video exchange method comprising a. The method of claim 4,
The step of requesting the image information,
The electronic device of the sighting vehicle is searched based on vehicle information including the time data, location data, or vehicle number, and the electronic device of the searched sighting vehicle provides vehicle information including the time data, location data, or vehicle number. Blocks are generated for vehicle information, location information, and image information of neighboring vehicles per unit time searched accordingly, and a block using vehicle information and location information of neighboring vehicles per unit time excluding image files according to a preset criterion from the generated block Steps to create a chain
Video exchange method comprising a. The method of claim 1,
The step of signing the transaction contract,
Automatically entering into a transaction contract between an electronic device requesting the image information and an electronic device providing the image information according to a transaction condition set by using a blockchain-based smart contract
Video exchange method comprising a. The method of claim 1,
The step of signing the transaction contract,
After viewing and checking image information corresponding to the searched block chain based on vehicle information including the time data, location data, or vehicle number, approval or rejection for provision of the requested image information from the electronic device of the witnessing vehicle Determining, and signing a transaction contract for the requested video information as approval for provision of the requested video information is made
Video exchange method comprising a. The method of claim 1,
The step of sharing the requested image information,
As the requested image information is encrypted from the electronic device of the sighting vehicle and transmitted to the electronic device, downloading the encrypted image information from the electronic device, and decoding the image information to reproduce the image information
Video exchange method comprising a. The method of claim 8,
The step of sharing the requested image information,
Sharing the requested video information on the basis of a limited range of access control and usage period including search, inquiry, transaction, download, and deletion of the file set in the requested video information
Video exchange method comprising a. In the electronic device for image exchange,
A request unit for requesting image information related to an event from an electronic device of a vehicle of sight, which is searched based on vehicle information including time data, location data, or vehicle number;
A contracting unit for signing a transaction contract for providing the requested image information with an electronic device of the witnessed vehicle; And
Acquiring unit for obtaining shared image information based on a blockchain in accordance with the signed transaction contract in the electronic device of the witnessing vehicle
Electronic device comprising a. The method of claim 10,
Record image information photographed by electronic devices of accident vehicles and sighting vehicles, receive location data of the electronic device, analyze vehicle information of neighboring vehicles per unit time, and receive vehicle information of neighboring vehicles per unit time analyzed. A storage unit for storing the location data and the image information
Including more,
The storage unit,
The image information is based on YOLO v3 or an image recognition algorithm to recognize a dynamic object or a static object, and the vehicle number, vehicle license plate, vehicle type, vehicle brand, and vehicle model name are included through detection of a vehicle running or a vehicle at a stop. To identify vehicle information
Electronic device, characterized in that. The method of claim 10,
The request unit,
By recognizing that an accident has occurred using the electronic device or a vehicle sensor present in the electronic device, the image information of the accident is automatically searched based on the time data or location data of the accident, or from the driver of the accident vehicle. By entering vehicle information including time data of the accident, location data, or vehicle number to manually search for the video information of the accident
Electronic device, characterized in that. The method of claim 12,
The request unit,
The electronic device of the sighting vehicle is searched based on vehicle information including the time data, location data, or vehicle number, and the electronic device of the searched sighting vehicle provides vehicle information including the time data, location data, or vehicle number. Blocks are generated for vehicle information, location information, and image information of neighboring vehicles per unit time searched accordingly, and a block using vehicle information and location information of neighboring vehicles per unit time excluding image files according to a preset criterion from the generated block Generating chain
Electronic device, characterized in that. The method of claim 10,
The fastening part,
Automatically signing a transaction contract between the electronic device requesting the image information and the electronic device providing the image information according to the transaction conditions set using a blockchain-based smart contract
Electronic device, characterized in that. The method of claim 10,
The fastening part,
After viewing and checking image information corresponding to the searched block chain based on vehicle information including the time data, location data, or vehicle number, approval or rejection for provision of the requested image information from the electronic device of the witnessing vehicle And, as approval for the provision of the requested video information is made, a transaction contract for the requested video information is signed.
Electronic device, characterized in that.

Images