KR101539557B1 - System and method for managing data related to event/accident - Google Patents

Abstract

The present invention provides a system and a method for managing event/accident data, which are used to secure the safety of related individuals when a specific situation related to an event/accident happens. According to the present invention, the system for managing event/accident data comprises: an image photographing unit setting an observation sector of each location, photographing an image of the observation sector, and transmitting the photographed image; an information collection device collecting short distance wireless communication information by scanning a plurality of smart devices in an area larger than or equal to the observation sector; and a control device, which recognizes at least one object on the image photographed by the image photographing unit, receives short distance wireless communication information from the information collecting device, is connected to a management device controlling the short wireless communication information to receive subscriber information corresponding to the short distance wireless communication information, and matches the recognized object, the short distance wireless communication information, and the subscriber information to be stored in a storage module.

Description

TECHNICAL FIELD [0001] The present invention relates to a system and method for managing event / accident data,

The present invention relates to an event / accident data management system and method, and more particularly, to a system and method for managing incidents / accident data, To an event / incident data management system and method capable of securing the event / accident data management system.

As modern society develops rapidly and becomes urbanized, various kinds of violent crimes against women and the elderly are increasing.

In order to prevent the increase of crime in advance and to increase the arrest rate in case of crime, a surveillance system installed 24 hours a day by cameras installed in the places where the crime is likely to occur in the government, local governments or police stations is installed and applied .

Generally, such a surveillance system stores an image taken by a camera using a storage medium.

However, the conventional surveillance system necessarily stores a low-quality image in order to store a large amount of data on a storage medium. For this reason, since the image quality of the image stored in the storage medium is deteriorated, it is difficult to secure the person's identity in the surveillance area.

Moreover, since the conventional surveillance system can cover only the photographing range of the camera, there is a disadvantage that it becomes useless when a crime occurs in an area beyond the photographing range of the camera such as a blind spot.

Korean Patent Laid-Open No. 10-2010-0106049 "Security System" (2010.10.01. Disclosed)

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems of the conventional art and it is an object of the present invention to provide an image processing apparatus and method that can store and manage an object recognized from an image taken by an image shooting unit, And to provide an event / accident data management system and method capable of securing the persons in the vicinity in the event / accident occurrence area irrespective of the event / accident occurrence area.

It is another object of the present invention to provide a wireless communication device that can collect short range wireless communication information about an area wider than a photographing range photographed by an image photographing section and secure personal information about people up to a blind spot And to provide an event / incident data management system and method.

It is a further object of the present invention to provide a method and system for matching short-range wireless communication information and subscriber information to an object recognized in a photographed image by using reception sensitivities of a plurality of smart devices collected through scanning, And to provide an event / accident data management system and method that can secure an accurate position for each object.

According to an aspect of the present invention, there is provided an image processing apparatus including an image capturing unit for capturing an image of the observation sector and transmitting the image, An information collecting device for collecting short-range wireless communication information through scanning for a plurality of smart devices in an area equal to or larger than the observation sector; And at least one object in the image photographed by the image capturing unit, wherein the at least one object is received from the information collecting device, receives the near field wireless communication information, and interworks with the management device for managing the near field wireless communication information, And a controller that receives the corresponding subscriber information and stores the recognized object, the near-field wireless communication information, and the subscriber information in a storage module.

According to the present invention, the information collecting apparatus is installed in the image photographing unit, the alarm sensor unit connected to the control unit, the voice unit or the emergency bell, and the illumination unit, and collects the short-range wireless communication information.

According to another aspect of the present invention, the short-range wireless communication information is a Wi-Fi ID or a Bluetooth ID for each of the plurality of smart devices, or a reception sensitivity of a signal transmitted from each of the plurality of smart devices .

According to another aspect of the present invention, there is provided a smart device, comprising: a plurality of smart devices, each smart device having a plurality of smart devices, Then, the local wireless communication information and the subscriber information are matched to the object recognized in the photographed image based on the estimated position or distance and stored in the storage module.

In addition, according to the present invention, the control apparatus matches the short-range wireless communication information received from the information collecting apparatus, the subscriber information, and the recognized object based on a situation occurrence, a state occurrence prediction, .

The above objects of the present invention can also be achieved by a control apparatus, comprising: receiving an image from at least one image capturing unit in which an observing sector per position is set; Collecting short range wireless communication information through a scanning of a plurality of smart devices in an area that is equal to or larger than the observation sector; Receiving a captured image by the image capturing unit and the collected short range wireless communication information; Recognizing at least one object in the photographed image; Receiving subscriber information corresponding to the short-range wireless communication information from the management apparatus in association with the management apparatus for managing the provided short-range wireless communication information; And storing the recognized object, the near-field wireless communication information, and the subscriber information in a storage module.

According to another aspect of the present invention, the short-range wireless communication information is a Wi-Fi ID or a Bluetooth ID for each of the plurality of smart devices, or a reception sensitivity of a signal transmitted from each of the plurality of smart devices .

According to another aspect of the present invention, the step of storing in the storage module may include estimating a position or a distance between the information collecting device and each of the plurality of smart devices through receiving sensitivity of signals to the plurality of smart devices, And stores the short range wireless communication information and the subscriber information in an object recognized in the photographed image based on the estimated position or distance, and stores the short range wireless communication information and the subscriber information in a storage module.

According to the event / accident data management system and method of the present invention, by storing and managing the object recognized from the image photographed by the image photographing unit, the near field wireless communication information, and the subscriber information, There is an advantage that the persons of the surrounding people can be secured.

According to the event / accident data management system and method of the present invention, by collecting near-field wireless communication information on an area wider than the imaging range imaged by the imaging unit, There is an advantage to be able to secure personal information about the people around.

According to the event / incident data management system and method of the present invention, it is possible to match the short-range wireless communication information and the subscriber information to the object recognized in the image using the reception sensitivity for a plurality of smart devices collected through scanning, / Accurate positioning of each object in the image is possible when an accident occurs.

1 is a detailed block diagram illustrating an incident / accident data management system according to an embodiment of the present invention;
2 is a view for explaining observation sectors applied to the embodiment of the present invention,
3 is a flowchart sequentially showing operations of an event / incident data management system using an image captured by an image capturing unit and local wireless communication information collected by an information collecting apparatus according to an embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings.

1 is a detailed block diagram illustrating an incident / accident data management system according to an embodiment of the present invention.

1, an incident / accident data management system according to an embodiment of the present invention includes a plurality of image capturing units 100, an illuminating unit 110, a plurality of sound units 120, An information collecting device 140, a control device 150, a mobile communication network management device 170 and a communication network 180. [

In the incident / accident data management system according to the embodiment of the present invention, a plurality of image capturing units 100, an illuminating unit 110, a plurality of sound units 120, a plurality of warning sensors 130, The device 140 and the mobile communication network management device 170 may be connected to the control device 150 through the communication network 180 to transmit and receive data.

The plurality of image capturing units 100 may capture a plurality of observation sectors set for each location to acquire images corresponding to the observation sectors, and provide the acquired images to the control apparatus 150. [ The image capturing unit 100 provides the image captured through the communication network 180 to the control device 150.

A plurality of regions of interest (ROIs) and a behavior direction of the observation object are additionally set in the corresponding surveillance sector of the image acquired by the image sensing unit 100 for setting the observation sector, and the perspective of the observation sector is set (ROI) and observation sector (or imaginary real world coordinate of the observation sector) of the ROIs are set for each of the ROIs, ROIs, ROIs, ROIs, ROIs, ROIs, ROIs, ROIs, Maps the coordinates of the illumination unit 110 including a plurality of LED lamp panels, the plurality of sound units 120, the plurality of warning sensors 130, and the image capturing unit 100 for image processing, The coordinate values of the image capturing unit 100 mapped to the observation sector and the positions of the illumination unit 110, the plurality of sound units 120 and the plurality of warning sensor units 130 are stored in a memory

The illumination unit 110 is composed of a plurality of LED lamp panels that emit light to a plurality of observation sectors. All or part of the LED lamps are driven under the control of the control device 150 to selectively or partially .

The plurality of audio units 120 may be operated by the control unit 150 to output an automatic voice or send a warning sound.

In addition, the plurality of audio units 120 can provide a broadcast outside the specific situation, for example, bidirectional communication with a witness or a caller, notification of a disaster situation, etc., under the control of the control device 150 through the communication network 180 . Specifically, the plurality of voice units 120 can transmit a guidance broadcast requested by an operator of the control apparatus 150, for example, a two-way voice call with a witness or a caller, an announcement for notifying a disaster situation, and the like.

The plurality of warning sensor units 130 may inform a region where the occurrence of a situation is predicted as the occurrence of a situation due to an event / accident is predicted. In the embodiment of the present invention, the warning sensor unit 130 may be, for example, a warning light or an emergency bell, but the present invention is not limited thereto.

The information collecting device 140 may collect the short range wireless communication information through real-time scanning of the smart devices in the predetermined area and provide the collected short range wireless communication information to the control device 150. Here, the predetermined area may be larger than an area photographed by the image capturing unit 100 or an area sensed by the warning sensor unit 130. [

In addition, the information collecting apparatus 140 may collect the short range wireless communication information through the predetermined range of scanning based on a situation occurrence or a request of the control apparatus 150, and then provide the short range wireless communication information to the control apparatus 150. Here, the occurrence of a situation can be detected through operation of an emergency bell installed in an arbitrary area, motion detection, and the like.

The short-range wireless communication information may include, for example, a MAC address of a short-range communication module such as a Wi-Fi module or a Bluetooth module of a smart device, and a signal reception sensitivity of a smart device such as RSSI. .

The information collecting apparatus 140 may be installed in the image capturing unit 100, the illuminating unit 110, the plurality of sound units 120 or the plurality of warning sensors 130, It is possible to collect the short-range wireless communication information through scanning for a wide area or the like. That is, the information of a blind spot that is not recognized by the image capturing unit can be collected through scanning.

As described above, the information collecting apparatus 140 collects the short range wireless communication information through scanning in a region wider than the observation sector, and provides the short distance wireless communication information to the control apparatus 150, so that the area other than the observation sector (for example, Even when it occurs, it can secure the person of the neighboring people.

The control device 150 can detect and recognize the object in the image corresponding to the observation sector through intelligent image analysis in the observation sector for each position, for example, metadata analysis. Here, the object may be a person, an automobile, an animal, a fixed object, or the like.

In addition, the control device 150 can generate and assign a unique number to each object to prevent object duplication recognition through metadata analysis, and can generate and manage object pattern recognition and object recognition result values by location . Here, the object recognition result value is exemplified by the speed of the object, the size of the object, and the moving direction.

The control device 150 can activate the data storage and retrieval function through automatic recognition function, schedule or situation detection for at least one observation sector. Specifically, the control device 150 recognizes the object through an automatic recognition function, a schedule or a situation detection, receives near-field wireless communication information provided from the information collection device 140, Can be stored.

For example, when a situation such as a crime is detected or predicted, the control device 150 accesses the mobile communication network management device 170 through the communication network 180, The subscriber information corresponding to the information is provided, and the subscriber information, the short-range wireless communication information, and the recognized object are matched and stored or the short-range wireless communication information and the subscriber information are matched and stored. Herein, the subscriber information may include a name, a telephone number, a sex, an age, etc. corresponding to the short-range wireless communication information.

On the other hand, when an offense occurs, the control device 150 can store information within a predetermined time based on the occurrence time of the situation. Specifically, the control apparatus 150 requests the image capturing unit 100, the information collecting apparatus 140, and the mobile communication network managing apparatus 170 for information corresponding to a predetermined time before or after the occurrence time of the situation, A short range wireless communication information, and subscriber information.

The control device 150 as described above includes an input module 152, an intelligent image recognition module 154, a situation sensing module 156, a control module 158, a situation prediction module 160, a storage module 162, And a communication interface module 164.

The input module 152 receives various types of data necessary for preventing an event / accident, for example, an image photographed by the image capturing section 100, a sensing signal input through the warning sensor section 130, (For example, a motion detection signal), and the short range wireless communication information collected by the information collection device 140. The input data may be provided to each component in the control device 150.

The intelligent image recognition module 154 can perform object recognition through an image analysis in an observation sector for each position provided through the input module 152. [

In addition, the intelligent image recognition module 154 may analyze the image received through the input module 152, and may detect the motion of the object and provide the sensed image to the situation prediction module 160.

The situation detection module 156 detects the occurrence of a situation in response to a sensing signal input through the warning sensor unit 130 or a signal related to a situation occurrence and provides a corresponding signal to the control module 158 can do.

The control module 158 can manage the objects recognized by the intelligent image recognition module 154 by assigning unique numbers to the recognized objects to prevent duplicate recognition among the objects.

The control module 158 collects the short-range wireless communication information and accesses the mobile communication network management device 170 connected to the communication network 180 through the communication interface module 164 to obtain subscriber information corresponding to the short- Can be provided.

The control module 158 calculates the distance or position between the information collecting device 140 and the smart device that has transmitted the short range wireless communication information using the reception sensitivity of the short range wireless communication information, The wireless communication information, the unique number of the recognized object, the data matched with the subscriber information, or the data matched with the local wireless communication information and the subscriber information, and store the data in the storage module 162. At this time, the module for matching the subscriber information can be separated.

The situation prediction module 160 predicts the occurrence of the situation using the motion of the object provided from the intelligent image recognition module 154 and informs the control module 158 of the occurrence of the situation as predicted. Specifically, the situation prediction module 160 can predict the occurrence of a situation when a specific object or a predetermined motion is included in the motion of the object provided from the intelligent image recognition module 154, and notify the control module 158 of the occurrence of the situation.

The control module 158 receives the local wireless communication information collected by the information collecting device 140 and transmits the local wireless communication information to the mobile communication network management device 170 connected to the communication network 180 through the communication interface module 164 To receive subscriber information corresponding to the short-range wireless communication information.

The storage module 162 may store the data generated by the control module 158 and the image received from the image capturing unit 100. Here, the data generated by the control module 158 may include the unique number of the object, short range wireless information, subscriber information, and the like.

Specifically, under the control of the control module 158, an image for a few minutes before / after the occurrence of the inconsistency of the learned behavior pattern between the objects (for example, a situation occurrence prediction time) The data generated by the control module 158 is stored and the object pattern located in the observation areas Z1 to Zn as shown in FIG. And the data generated by the control module 158 are stored. In addition, various environment settings including at least one of time region and motion detection of the object are stored by the user.

A storage device capable of backing up incident / accident data can be used in a wired / wireless network, a mobile phone, a smart phone, a PC, etc., without installing a separate operating PC or a physical storage device on the spot, It can utilize removable disks (USB, SD, etc.) other than the storage device of PC.

The communication interface module 164 accesses the mobile communication network management device 170 through the communication network 180 under the control of the control module 158 to request subscriber information, receives the subscriber information in response to the request, To the control module 158 via the control module 152.

A process in which the control apparatus 150 having the above configuration operates to collect event / accident data will be described with reference to FIG.

3 is a flowchart illustrating an operation of an event / accident data management system using an image photographed by the image photographing unit 100 and short-range wireless communication information collected by the information collecting apparatus 140 according to an embodiment of the present invention. It is a flow chart.

The method shown in Fig. 3 can be performed, for example, by the control apparatus 150 of Fig. 1 described above. In the flowchart shown, the method is described as being divided into a plurality of steps, but at least some of the steps may be performed in reverse order, or one or more steps not shown may be added.

3, the control module 158 sets observation sectors for each position in one or more image capturing units 100 and assigns virtual real world coordinates to the observation sectors (S202) .

Then, the control module 158 controls the image capturing unit 100 so that the image capturing unit 100 can perform automatic movement capturing (S204).

The intelligent image recognition module 154 receives an image of an observation sector for each position from the image capturing unit 100 (S206), detects objects by position through analysis of the received image (S208) And provides the analyzed state to the situation prediction module 160. Here,

Next, the control module 158 generates and assigns a unique number to the objects recognized in the observation sector (S210).

Then, the control module 158 receives near-field wireless communication information collected by the information collecting apparatus 140 in an area corresponding to the observation sector or an area wider than the observation sector, in step S212.

In addition, the control module 158 estimates the distance or position between the information collecting apparatus 140 and the smart device transmitting the short-range wireless communication information using the reception sensitivity among the short-range wireless communication information (S214) And stores the short range wireless communication information in the storage module 162 (S216).

The control module 158 repeatedly performs the above steps S206 to S216 so that the control module 158 matches the object with the unique number and the short-range wireless communication information to the storage module 152, The module 156 determines whether a situation occurrence is detected (S218).

If it is determined in step S218 that the occurrence of a situation is detected, the control module 158 transmits the received short range wireless communication information received from the at least one information collecting device 140 installed in the area where the situation occurred to the communication interface module 164 To the mobile communication network management device 170 to request subscriber information (S220).

Then, the control module 158 receives the subscriber information for the short-range wireless communication information from the mobile communication network management device 170 in response to the request (S222), adds the unique number assigned to the recognized object in the area where the situation occurred, The short distance wireless communication information and the subscriber information, and stores the generated data in the storage module 162 (S224). Here, as described above, the module for matching the subscriber information can be separately separated.

Since the data stored in the storage module 162 through the steps described above includes the local wireless communication information and the subscriber information of the area outside the observation sector photographed by the image capturing unit 100, It may be possible to secure the personalities of people around Korea.

Meanwhile, in the embodiment of the present invention, only the process of operating according to the occurrence of a situation has been described, but the process of steps S220 to S224 may be performed according to the prediction of the occurrence of a situation or a predetermined schedule.

100: image capturing unit 110:
120: audio part 130: warning sensor part
140: Information collecting device 150: Control device
152: input module 154: intelligent image recognition module
156: situation detection module 158: control module
160: situation prediction module 162: storage module
164: Communication interface module 170: Mobile communication network management device
180: Network

Claims (8)

An image capturing unit for capturing an image of the observation sector and transmitting the captured image;
An information collecting device for collecting short range wireless communication information including reception sensitivity of signals transmitted from each of the plurality of smart devices through scanning for a plurality of smart devices in an area larger than or equal to the observation sector; And
Wherein the information processing apparatus recognizes at least one object in the image photographed by the image photographing section, receives the short-range wireless communication information from the information collecting device, and interworks with the short- And a control unit that receives the subscriber information transmitted from the mobile communication terminal and stores the recognized object, the near field communication information, and the subscriber information in a storage module,
The above-
Estimating a position or a distance between the information collecting device and each of the plurality of smart devices through reception sensitivity of a signal for each of the plurality of smart devices collected through the scanning, And the short-range wireless communication information and the subscriber information are matched with the object recognized in the photographed image and stored in the storage module.
The method according to claim 1,
The information collecting apparatus includes:
Wherein the short-range wireless communication information is installed in the image capturing unit, the warning sensor unit connected to the control unit, the voice unit or the illumination unit, and collects the short-range wireless communication information.
delete delete The method according to claim 1,
The above-
And stores the short range wireless communication information received from the information collecting device, the subscriber information, and the recognized object in the storage module based on a situation occurrence, a condition occurrence prediction, or a predetermined schedule. Management system.
Wherein the control apparatus receives the image from at least one image capturing unit in which the observing sector per position is set;
Collecting short range wireless communication information including a reception sensitivity of a signal transmitted from each of the plurality of smart devices through scanning for a plurality of smart devices in an area larger than or equal to the observation sector;
Receiving a captured image by the image capturing unit and the collected short range wireless communication information;
Recognizing at least one object in the photographed image;
Receiving subscriber information corresponding to the short-range wireless communication information from the management apparatus in association with the management apparatus for managing the provided short-range wireless communication information; And
And storing the recognized object, the short-range wireless communication information, and the subscriber information in a storage module,
Wherein the storing in the storage module comprises:
Estimating a position or a distance between the information collecting device and each of the plurality of smart devices through reception sensitivity of a signal for each of the plurality of smart devices; And
And stores the short range wireless communication information and the subscriber information in an object recognized in the photographed image based on the estimated position or distance, and stores the short range wireless communication information and the subscriber information in a storage module. The method comprising the steps of:
delete delete

Images