KR20160127526A - Method for collecting video information at position where event occurred, server and system - Google Patents

Abstract

A method for collecting image information at an event occurrence point includes: a step of receiving a time when an event occurs and location information; a step of searching for a plurality of image collecting devices based on the time and the location information; a step of requesting image information to the plurality of image collecting devices; and a step of filtering image information useful for analyzing the event among a plurality of image information collected from the plurality of image collecting devices.

Description

TECHNICAL FIELD [0001] The present invention relates to a method, a server and a system for collecting image information at an event occurrence point,

The present invention relates to a method, a server and a system for collecting image information of an event occurrence point.

The video images taken by CCTV (Closed Circuit Television) devices are used not only as dispute resolution for accidents and as evidence of crime scene but also to identify the surrounding areas such as floods and landslides, .

In the past, when an accident occurred, the image of the CCTV device installed near the accident site is used to ascertain the circumstances of the incident. However, since the CCTV device captures only within a specified range, there is a limit to the transmission of the surrounding situation at the time of an accident.

Meanwhile, due to the activation of the Internet Of Things (IoT) industry, the CCTV devices are connected to the network, so that the video data of the CCTV devices can be confirmed by a smart device (for example, a smart phone) by wireless communication.

In Korean Patent No. 1442669, a database of patterns for each criminal behavior is constructed, a moving object is detected from data photographed by the monitoring terminal, and driving of the monitoring terminal is controlled to detect movement direction, behavior It is judged whether or not the movement direction and the behavior pattern of the object being tracked coincide with each crime behavior pattern. If they match, it is recognized as a criminal act, the shooting data is stored and the crime occurrence data is generated, And the occurrence data is notified to a person in charge of crime processing.

It is desired to search a plurality of image collecting apparatuses and collect image information from a plurality of searched image collecting apparatuses based on the time and position information at which the event occurred. Also, it is desirable to filter out image information useful for analysis of the event among a plurality of collected image information. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to an aspect of the present invention, there is provided a method for collecting image information of an event occurrence point according to the first aspect of the present invention includes receiving an event occurrence time and location information, The method comprising the steps of: searching a plurality of image collecting devices; requesting the plurality of image collecting devices for image information; and extracting image information useful for analyzing the event from the plurality of image information collected from the plurality of image collecting devices And filtering.

 According to a second aspect of the present invention, an image information collection server for collecting image information of an event occurrence point includes an input unit for receiving time and position information at which an event occurs, A video information requesting unit for requesting video information from the plurality of video collecting apparatuses, an image information collecting unit for collecting a plurality of video information from the plurality of video collecting apparatuses, And a filtering unit for filtering image information useful for analyzing the event.

According to a third aspect of the present invention, a system for collecting image information of an event occurrence point receives a time and position information at which an event occurs, searches for a plurality of image collection apparatuses based on the time and position information, An image information collection server for requesting image information from the plurality of image collection devices and filtering image information useful for analyzing the event among a plurality of image information collected from the plurality of image collection devices; And an image collection device for providing the image information.

The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.

According to any one of the above-described objects of the present invention, the image information collection server can search a plurality of image collection devices based on the time and position information at which the event occurred. In addition, the image information collection server can collect image information from a plurality of searched image collection devices. In addition, the image information collection server can filter image information useful for analysis of the event among a plurality of collected image information. In addition, since the image information collection server provides image information corresponding to the generation time and location information of the event, the image search time and cost can be reduced.

1 is a configuration diagram of an image information collection system according to an embodiment of the present invention.
2 is a detailed configuration diagram of the image information collection server shown in FIG. 1 according to an embodiment of the present invention.
3 is a diagram for explaining a method of calculating location information of an event occurrence point according to an embodiment of the present invention.
4 is a flowchart illustrating an example of a method of collecting image information of an event occurrence point according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

1 is a configuration diagram of an image information collection system according to an embodiment of the present invention.

Referring to FIG. 1, the image information collecting system may include a gateway apparatus 100, a plurality of image collecting apparatuses 110, and an image information collecting server 120. However, since the image information collection system of FIG. 1 is only an embodiment of the present invention, the present invention is not limited to FIG. 1 and may be configured differently from FIG. 1 according to various embodiments of the present invention .

The gateway device 100 collects sensor data (e.g., measured values such as sound, vibration, temperature, etc.) from a plurality of sensor devices (not shown) Accident, fire, earthquake, etc.). Here, the sensor device (not shown) may be a device mounted on an object (image capturing device 110, a car, a smart phone, etc.), or may be a device installed for the purpose of automatically detecting nearby events. This sensor device (not shown) can measure the value of the sensor data and transmit it to the gate wedge device 100. Further, the sensor device (not shown) can further transmit the position of the sensor device (not shown) and the time information to the gate wedge device 100 in real time.

The gateway device 100 senses the occurrence of an event from a plurality of sensor data exceeding a specific threshold value and transmits the position information of the event occurrence point through the position information of a plurality of sensor devices (not shown) Can be calculated. Further, the gateway device 100 can measure the location information of the event occurrence point using the triangulation method.

Then, the gateway device 100 can transmit the location information of the event occurrence point and the event occurrence time information to the image information collection server 120. [

The image information collection server 120 receives the time and position information at which the event occurred from the gateway device 100 and can search the plurality of image collection devices 110 based on the time and position information.

In addition, the image information collection server 120 may request image information from the plurality of searched image collection devices 110, and may collect a plurality of image information from the plurality of image collection devices 110. Here, the collected image information can be utilized for an accident analysis in an individual who requests the image, an investigation agency, or an insurance company.

Then, the image information collection server 120 may filter the image information useful for analyzing events among the plurality of collected image information, and provide filtered image information to an individual, an investigation agency, or an insurance company who requests the image.

When the gateway device 100 is able to communicate with the surrounding image capturing device, the gateway device 100 transmits the image information to the image capturing device 120 And may request the collection of image information.

The plurality of image capturing apparatuses 110 may transmit their position information to the image information collecting server 120 in real time.

The image collection apparatus 110 may provide image information to the image information collection server 120 when the image information collection server 120 receives the request for image information.

The image collecting apparatus 110 is an apparatus for photographing the surrounding situation in real time and storing the photographed image information, and may include, for example, a vehicle black box, a CCTV apparatus, and the like.

In addition, the image capturing apparatus 110 may include a mobile terminal capable of wireless communication, and may be a portable terminal capable of connecting to a remote server through a network. However, the image collecting apparatus 110 is not limited to the form shown in FIG. 1 or the preceding examples.

Generally, the components of the image information collection system of FIG. 1 are connected through a network 130. The network 130 refers to a connection structure capable of exchanging information between nodes such as terminals and servers. Examples of such a network include a 3rd Generation Partnership Project (3GPP), a Long Term Evolution (LTE) , World Interoperability for Microwave Access (WIMAX), Wi-Fi, 3G, 4G, and the like.

The present invention relates to a black box (portable image capture device) of a vehicle that has been running around an accident point, a CCTV device of a nearby store or a building (a fixed image capture device ), It can help to grasp the surrounding situation at the time of an accident.

In addition, the present invention can be applied to a plurality of image capturing apparatuses 110 having a black box for vehicles and other image capturing functions in the vicinity, even when the image quality of a blind spot such as a parking lot and a CCTV apparatus is poor, And the like.

In addition, since the present invention collects image information at the time of occurrence of an accident from a plurality of image collecting apparatuses 110 connected to the network 130 without manually examining the time of occurrence of an accident and surrounding information, It can help to identify the authenticity of the accident.

In addition, since the present invention filters and provides an image including actual accident information among a plurality of collected image information, it is possible to reduce the search time and cost of the image information.

In addition, according to the present invention, when the IoT sensor device is supplied to the road network, the image data of the event can be acquired and analyzed in real time through analyzing sensor data provided from the IoT sensor device.

In addition, the present invention can increase the coverage of the photographing area when the image capturing device equipped with the sensor device is used, and can reduce power consumption by keeping the image capturing device in a sleep state at the time of idling .

Hereinafter, the operation of each component of the image information collection system of FIG. 1 will be described in more detail.

FIG. 2 is a detailed configuration diagram of the image information collection server 120 shown in FIG. 1 according to an embodiment of the present invention.

2, the image information collection server 120 includes an input unit 200, a search unit 210, an image information request unit 220, an image information collection unit 230, a filtering unit 240, (250) and a DB (260). However, the image information collection server 120 shown in FIG. 2 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

The input unit 200 can receive the time and position information at which an event (e.g., a traffic accident, a crime, a fire, a collapse, etc.) occurred. For example, when the traffic accident occurs, the input unit 200 can receive location information of a traffic accident from a nearby witness or a victim's user terminal, an insurance company, a police, or the like.

The input unit 200 can receive the time and location information of the event detected by the sensor device (such as a sensor device mounted on the IoT (Internet Of Thing) device) from the gateway device 100. Here, the IoT device may include all objects connected to the network (e.g., an electronic device, a smart car, a smart phone, a black box, a CCTV device, and the like). Here, the sensor device can automatically detect the occurrence of an accident through, for example, analyzing OBD (On Board Diagnostic) information of the vehicle. Also, the sensor device can detect the accident of the vehicle through the gyro sensor information analysis of the vehicle black box. In addition, the sensor device can detect sounds, vibrations, temperatures, etc. exceeding a certain threshold value. Here, the gateway device 100 can measure positional information of a point where an event occurs, based on information (position information of the sensor device, etc.) received from a plurality of sensor devices located in a certain area.

In another example of the present invention, the input unit 200 may receive position information of the sensor device and event detection time information from a plurality of sensor devices that sensed an event.

The input unit 200 can receive the direction information of the location where the event occurred. For example, the input unit 200 may receive direction information of an accident point from a gyro sensor device installed in a traffic accident vehicle.

The search unit 210 can search a plurality of image collecting apparatuses 110 based on the time and position information at which the event occurred.

Specifically, the searching unit 210 can search the image collecting apparatus 110 located at a predetermined distance from the location information of the event at the time when the event occurs. For example, the search unit 210 can search for a vehicle black box, a CCTV device, and the like in the vicinity of an accident area at a time when a traffic accident occurs. At this time, since the image information collection server 120 collects and manages the positions of the plurality of image collection apparatuses 110 in real time, the search unit 210 searches the image collection apparatuses 110 located in the vicinity of the events can do.

In addition, the search unit 210 broadcasts a search query to a plurality of image collecting apparatuses in an area in order to search for an image collecting apparatus available in the adjacent area, and transmits the search query to the image collecting apparatus (D2D) 110). Alternatively, the search unit 210 may track the location information of the image collecting apparatus 110 using a Global Positioning System (GPS) / Location Based Service (LBS) technique.

The image information requesting unit 220 may request image information (images captured by the image capturing apparatus 110) to the plurality of image capturing apparatuses 110 retrieved by the retrieving unit 210. [ In addition, the image information requesting unit 220 can request a plurality of image collecting apparatuses 110 for a predetermined amount of time before and after the time when the event occurs.

The image information collecting unit 230 may collect a plurality of pieces of image information from the plurality of image collecting apparatuses 110.

The filtering unit 240 may filter image information useful for analyzing events among a plurality of collected image information.

Specifically, the filtering unit 240 may filter the image information useful for analyzing the event based on the direction information of the event occurrence position. For example, the filtering unit 240 may include a plurality of image collecting apparatuses 110, each of which stores image information of a traffic accident scene, It is possible to filter only the image information of the image.

Also, the filtering unit 240 may filter image information within a predetermined viewing angle (for example, 110 to 130 degrees) from the direction information of the event occurrence position among the collected image information.

The filtering unit 240 can filter the effective image information among the collected image information through the image analysis technique using the image condition search formula. Here, the image condition search formula may include distribution information of a specific color, shaking information of the image, information on whether a specific object or person is included, and the like.

The rewarder 250 may provide a predetermined reward (for example, a gift certificate, a reserve, etc.) to the image collecting device 110 providing the filtered image information.

The DB 260 stores data input and output between the respective components in the image information collection server 120 and inputs the input and output data between the image information collection server 120 and the components outside the image information collection server 120 And the output data. For example, the DB 260 can store event occurrence time and location information received from the gateway device 100. [ In addition, the DB 260 can update and store the position information of the sensor device received from the plurality of sensor devices in real time. One example of such a DB 260 includes a hard disk drive, a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, and a memory card existing in the image information collection server 120 or the like.

Those skilled in the art will appreciate that the input unit 200, the search unit 210, the image information request unit 220, the image information collecting unit 230, the filtering unit 240, the reward providing unit 250, May be implemented separately, or one or more of them may be implemented in unison.

3 is a diagram for explaining a method of calculating location information of an event occurrence point according to an embodiment of the present invention.

3, the sensor devices installed in the first to third image collecting devices 111 to 113 are not limited to their own state information but also sensor data such as surrounding sounds, vibration, temperature, And transmits the collected information to the gateway apparatus 100. Further, the sensor device can further transmit the location information of the sensor device and the collection time information of the sensor data to the gateway device 100. [

The gateway device 100 can detect that the event 300 has occurred when the collected plurality of sensor data exceeds a certain threshold value.

The gateway device 100 can calculate the distance from the sensor device to the occurrence position of the event 300 using the sensor data. For example, the gateway device 100 may convert the measured sound intensity (sensor data) into distance.

)를 계산할 수 있다. 또한, 게이트웨이 장치(100)는 제 2 영상 수집 장치(112)의 위치 좌표가 (x2, y2, z2)인 경우, 제 2 센서 데이터(제 2 영상 수집 장치(112)의 센서 장치로부터 수신한 센서 데이터)를 이용하여, 해당 센서 장치에서 이벤트(300)의 발생 위치까지의 상대적인 거리(

)를 계산할 수 있다. 또한, 게이트웨이 장치(100)는 제 3 영상 수집 장치(113)의 위치 좌표가 (x3, y3, z3)인 경우, 제 3 센서 데이터(제 3 영상 수집 장치(113)의 센서 장치로부터 수신한 센서 데이터)를 이용하여, 해당 센서 장치에서 이벤트(300)의 발생 위치까지의 상대적인 거리(

)를 계산할 수 있다. For example, when the position coordinate of the first image capturing apparatus 111 is (x1, y1, z1), the gateway apparatus 100 receives the first sensor data (received from the sensor apparatus of the first image capturing apparatus 111 The relative distance from the sensor device to the occurrence position of the event 300 (i.e.,

) Can be calculated. When the position coordinate of the second image capturing apparatus 112 is (x2, y2, z2), the gateway apparatus 100 transmits the second sensor data (the sensor received from the sensor apparatus of the second image capturing apparatus 112) Data), the relative distance from the sensor device to the occurrence position of the event 300

) Can be calculated. When the position coordinates of the third image capturing apparatus 113 are (x3, y3, z3), the gateway apparatus 100 transmits the third sensor data (the sensor received from the sensor apparatus of the third image capturing apparatus 113) Data), the relative distance from the sensor device to the occurrence position of the event 300

) Can be calculated.

The gateway device 100 may preliminarily configure a table capable of converting the sensor data into a distance in order to measure the accuracy of the distance measurement.

The gateway device 100 may calculate the location information of the event 300 through the triangulation method based on the sensor data and the location of the sensor device in order to accurately calculate the location information of the event 300. [

The gateway device 100 may transmit the calculated location information of the event 300 to the image information collection server 120.

Meanwhile, the functions performed by the gateway device 100 described above may be performed by the image information collection server 120 as well.

4 is a flowchart illustrating an example of a method of collecting image information of an event occurrence point according to an embodiment of the present invention.

The method for collecting image information according to the embodiment shown in FIG. 4 is the same as the method for collecting image information in the gateway device 100, the image collecting device 110, and the image information collecting server 120 according to the embodiment shown in FIGS. Lt; / RTI > Therefore, the contents described with respect to the gateway apparatus 100, the image collection apparatus 110, and the image information collection server 120 of FIGS. 1 to 3 according to the embodiment shown in FIG. 4, And can also be applied to an image information collection method.

Referring to FIG. 4, in step S401, the image information collection server 120 may receive the time and location information at which the event occurred. Here, the location information may be location information of an event detected through the sensor device. Also, the location information may be information measured through a triangulation method.

In step S403, the image information collection server 120 can search a plurality of image collection devices based on the time and position information.

In step S405, the image information collection server 120 can request image information from the plurality of image collection devices found in step S403.

In step S407, the image information collection server 120 can filter image information useful for analyzing events among a plurality of image information collected from a plurality of image collection devices.

Although not shown in FIG. 4, the image information collecting method further includes a step (S403) of searching (step S403) for an image collecting device located within a predetermined distance from the location information of the event at the time of the event can do.

Although not shown in FIG. 4, the image information collecting method may further include a step (not shown) of receiving direction information in which the event occurred before the step S403.

Although not shown in FIG. 4, the image information collecting method may further include a step (not shown) of filtering the image information based on the direction information in which the event occurred in step S407.

Although not shown in FIG. 4, the image information collection method may further include a step (not shown) of filtering image information within a predetermined viewing angle from the direction information in which the event occurred in step S407.

Although not shown in FIG. 4, the image information collection method may further include a step (not shown) of filtering image information through an image analysis technique using an image condition search formula in step S407. Here, the image condition search formula may include distribution information of a specific color, shaking information of a video, information on whether a specific object or a person is included.

Although not shown in FIG. 4, the image information collecting method may further include a step (not shown) of providing a predetermined reward to the image collecting apparatus providing the filtered image information after step S407.

In the above description, steps S401 to S407 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

An embodiment of the present invention may also be embodied in the form of a program stored on a medium executed by a computer or a recording medium including instructions executable by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium can include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

100: gateway device
110: Image collecting device
120: Image information collection server

Claims (21)

A method for collecting image information at an event occurrence point,
Receiving time and position information at which an event occurred;
Searching a plurality of image collecting apparatuses based on the time and position information;
Requesting the plurality of image collecting apparatuses for image information; And
Filtering image information useful for analyzing the event among a plurality of image information collected from the plurality of image collecting apparatuses
And an image information acquiring step of acquiring image information.
The method according to claim 1,
The step of searching the plurality of image collecting devices
And searching for an image collection device located within a predetermined distance from the position information at the time when the event occurs.
The method according to claim 1,
Further comprising receiving direction information on the event,
The step of filtering the image information
And the image information is filtered based on the direction information.
The method of claim 3,
The step of filtering the image information
And filtering the image information within a predetermined viewing angle from the direction information.
The method according to claim 1,
The step of filtering the image information
Wherein the image information is filtered through an image analysis technique using an image condition search formula.
6. The method of claim 5,
Wherein the image condition search formula includes distribution information of a specific color, shake information of a video, information on whether a specific object or a person is included.
The method according to claim 1,
Wherein the location information is location information of an event detected through the sensor device.
8. The method of claim 7,
Wherein the location information is information measured through a triangulation method.
The method according to claim 1,
Providing a predetermined reward to the image collection device providing the filtered image information
Further comprising the steps of:
An image information collection server for collecting image information of an event occurrence point,
An input unit for receiving time and location information at which an event occurred;
A retrieving unit for retrieving a plurality of image capturing apparatuses based on the time and position information;
An image information request unit for requesting the plurality of image collecting apparatuses for image information;
An image information collecting unit for collecting a plurality of pieces of image information from the plurality of image collecting apparatuses;
A filtering unit for filtering image information useful for analyzing the event among the collected plurality of image information,
And an image information collecting server.
11. The method of claim 10,
The search unit
And searches for an image collection device located within a predetermined distance from the position information at the time when the event occurs.
11. The method of claim 10,
The input unit receives direction information of the event,
Wherein the filtering unit filters the image information based on the direction information.
13. The method of claim 12,
Wherein the filtering unit filters image information within a predetermined viewing angle from the direction information.
11. The method of claim 10,
Wherein the filtering unit filters the image information through an image analysis technique using an image condition search formula.
15. The method of claim 14,
Wherein the image condition search expression includes distribution information of a specific color, shaking information of a video, information on whether a specific object or a person is included.
11. The method of claim 10,
And providing a predetermined reward to the image collecting device providing the filtered image information,
Further comprising: an image information collection server for receiving the image information from the image information collection server;
A system for collecting image information at an event occurrence point,
A time and location information of an event is received, a plurality of image collection devices are searched based on the time and position information, video information is requested to the plurality of image collection devices, An image information collection server for filtering image information useful for analyzing the event among a plurality of image information items
And an image collecting device for providing the image information to the image information collecting server
And a system for collecting image information.
18. The method of claim 17,
A sensor device for detecting the event and transmitting the detected time and location information to the gateway device,
Further comprising a gateway device for calculating location information of the event from the sensed location information using the triangulation method and transmitting the calculated location information to the image information collection server,
Wherein the detected location information is location information of the sensor device.
18. The method of claim 17,
Wherein the image information collection server provides a predetermined reward to the image collection device providing the filtered image information.
18. The method of claim 17,
Wherein the image information collection server filters the image information through an image analysis technique using an image condition search formula.
21. The method of claim 20,
Wherein the image condition search formula includes distribution information of a specific color, shake information of a video, information on whether a specific object or a person is included.

Images