KR101442669B1 - Method and apparatus for criminal acts distinction using intelligent object sensing - Google Patents

Abstract

The disclosed content relates to a criminal act distinction method through intelligent object sensing and a device thereof. A server computer stores patterns regarding a movement direction and behavior patterns of an object which are concomitant with a criminal act such as kidnap, assault, and a hit-and-run case in a database. The server computer improves an image of photographing data transmitted from a plurality of monitoring terminals and senses a moving object to trace the movement direction and behavior patterns of the object. The server computer determines whether the movement direction and behavior pattern of the object correspond to patterns regarding the criminal act formed with the database or not. If the movement direction and behavior pattern of the object correspond to patterns regarding the criminal act formed with the database, the server computer determines that a criminal act is generated and stores the photographing data to produce criminal generating data including contents regarding time, place, and the criminal act at the same time. The server computer transmits the criminal generating data to a communication terminal carried by a related person who processes the criminal act. Therefore, the present invention rapidly gasps all kinds of crimes such as kidnap, abduction, a hit-and-run case, and assault and secures a necessary image immediately when the criminal act is generated and induces rapid movements and treatment to a crime generation area through a related person alarm.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and an apparatus for discriminating a criminal act through intelligent object detection,

The present invention relates to a method and an apparatus for discriminating a criminal behavior through intelligent object detection that detects a criminal act by using a PTZ (Pan-Tilt-Zoom) camera or a CCTV (closed-circuit television)

Recently, the crime rate is increasing with the increase of the population, and the installation of CCTV, which is a closed circuit for crime prevention, is increasing. In addition, local governments are promoting the introduction of a control system for the purpose of crime prevention.

However, most security CCTVs currently installed are composed of low-quality analog CCTVs with a capacity of 270,000 to 410,000 pixels. For example, as can be seen from recent cases of crime, there are cases in which there is no witness to identify and arrest suspects by relying on CCTV. However, there are cases where suspects are not identified or arrested due to image quality degradation will be.

In order to solve this problem, a control system capable of photographing a high resolution image using a 1.3 to 2,000,000-pixel PTZ camera capable of zooming control while a camera lens is rotated right and left (pan) or up and down (tilt) .

However, the control system using the conventional CCTV or PTZ camera as described above requires a large number of cameras and has to be monitored with a large number of personnel.

Korean Registered Patent No. 10-1003208 Nov. 21, 2010 Korean Registered Patent No. 10-0972016 Aug. 22, 2010 Korean Registered Patent No. 10-1081861 Nov. 9, 2011 Korean Registered Patent No. 10-1005568 January 10,

The present invention provides a method and apparatus for discriminating a criminal behavior through intelligent object detection, which enables discrimination of various criminal actions based on images taken by a PTZ camera, a CCTV, or the like.

The present invention relates to an intelligent object detection method that detects an object in an image captured by a PTZ camera or a CCTV, identifies whether a criminal action occurs from the detected object, and immediately processes the image of the occurrence of the criminal activity and notifies The present invention provides a method and apparatus for discriminating a criminal act through a criminal case.

The method for determining a criminal behavior through intelligent object detection according to an exemplary embodiment of the present invention includes: (1) a server computer is configured to detect patterns of motions and behaviors of an object accompanying each criminal act including abduction, assault, (2) the server computer detects an image-enhanced object of the image pickup data transmitted from a plurality of monitoring terminals connected to the communication, and (3) Controlling the operation of the monitoring terminal when the object is detected through the step (2), and tracking the movement direction and the behavior pattern of the detected object; and (4) (5) the server computer determines whether or not there is a match between the motion direction, the behavior pattern and the patterns related to the criminal behavior established in the database in the step (1) If the motion direction of the result object and the behavior pattern match the patterns related to the criminal behavior established in the database, it is determined that a criminal act has occurred, and an event log is generated, and the captured data is stored and at the same time, (6) The server computer transmits the crime occurrence data generated in the step (5) to a communication terminal possessed by the person in charge of performing the criminal activity process And transmitting it by voice.

According to another aspect of the present invention, there is provided an apparatus for discriminating a criminal through intelligent object detection, comprising: a network communication network for connecting data communication with an unspecified number of communication lines; A plurality of surveillance terminals for transmitting data currently being photographed to a server computer through a network communication network and patterns of motion patterns and behaviors of objects accompanying each criminal act including abduction, assault, and hit-and- It is constructed as a database, and improves image of shot data transmitted from a plurality of monitoring terminals through a network communication network, detects an object having motion, and controls the operation of the monitoring terminal to track the direction and behavior of the detected object , Motion direction of the object being tracked, behavior style and database construction If the motion direction and the behavior pattern of the object coincide with the patterns related to the criminal behavior constructed in the database, the event log is generated to store the shot data Includes a server computer for generating crime occurrence data including time, place and contents of crime, and transmitting crime occurrence data by text or voice to a communication terminal possessed by a person involved in performing a crime process .

As described above, according to the method and apparatus for detecting a criminal behavior through intelligent object detection of the present invention, it is possible to detect an object in an image captured through a PTZ camera, a CCTV, and the like, It is possible to quickly identify the occurrence of various crimes such as kidnapping, kidnapping, hit-and-run, and assault by storing and notifying relevant persons. It is also possible to instantly acquire necessary images when a criminal act occurs, It is possible to induce prompt dispatch and treatment.

Brief Description of the Drawings Fig. 1 is a schematic view showing a configuration of an apparatus for discriminating a crime through intelligent object detection according to an embodiment of the present invention; Fig.
FIG. 2 is a detailed view of the configuration of the server computer of FIG. 1,
FIG. 3 is a flowchart illustrating an operation procedure of a method for discriminating a crime through intelligent object detection according to an exemplary embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a method and an apparatus for determining a criminal behavior through intelligent object detection according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a diagram schematically illustrating a configuration of a criminal behavior determination device using intelligent object detection according to an embodiment of the present invention. Referring to FIG.

As shown in the figure, the apparatus includes a network communication network 100, a plurality of monitoring terminals 200, a server computer 300, and the like.

The network communication network 100 is a variety of communication networks including a wired and wireless Internet, and connects communication lines between a plurality of monitoring terminals 200 and a server computer 300 so that data communication can be performed with each other.

The plurality of surveillance terminals 200 capture the current position under the control of the server computer 300 and transmit data currently being photographed to the server computer 300 through the network communication network 100.

At this time, the monitoring terminal 200 includes a PTZ camera, a CCTV, and the like, and may include all cameras used for monitoring.

The server computer 300 constructs databases of patterns of movement direction and behavior pattern of an object accompanying each criminal act including abduction, assault, hit-and-run, and the like through a network communication network 100. A plurality of monitoring terminals 200 And detects an image-enhanced object and an object having motion. When the object is detected, the motion direction and behavior pattern of the object are tracked by controlling the operation of the monitoring terminal 200, and the patterns related to the motion direction, the behavior pattern and the criminal behavior constructed in the database are compared And judges whether or not they coincide with each other. If the motion direction of the object and the behavior pattern match with the patterns related to the criminal activity constructed in the database, the event log is generated to store the shooting data, and at the same time, the crime occurrence data including the time, And transmits the crime occurrence data to the communication terminal possessed by the related person who performs the criminal activity process, which is registered in advance, by text or voice.

At this time, when constructing the pattern of the movement direction and the behavior pattern of the object accompanied by each criminal act, the server computer 300 generates a pattern for the behavior of each of the deliberate crime and accidental crime, the pattern of the abduction, abduction, (Eg, hat, mask, etc.) related to the appearance of the suspects for each crime, patterns of patterns of behavior of the suspects for each crime, (Eg, one or more of the moving objects collapses or does not move in the shape of some of the objects after contact) during a specific motion (eg, within 1 to 2 seconds) Build the pattern into a database.

When the object being tracked exceeds the shooting range of the surveillance terminal 200 currently being photographed, the server computer 300 may monitor the movement direction and behavior of the object, Based on the size (e.g., horizontal, vertical, diagonal, etc.) of the object on the image data photographed by the monitoring terminal, color (for example, the top, bottom, hat, It is possible to control the other monitoring terminal that has detected the matching object to continuously perform the shooting.

2 is a diagram showing the configuration of the server computer 300 of FIG. 1 in more detail.

As shown in the figure, the server computer includes a database 310, a data communication unit 320, an image improving unit 330, an object detecting unit 340, a criminal action determining unit 350, an image storing unit 360, A notification unit 370, a control unit 380, and the like.

The database 310 stores patterns of motions and behaviors of the objects involved in each crime including abduction, assault, and hit-and-run.

The data communication unit 320 processes a plurality of monitoring terminals 200 communicatively connected through the network communication network 100 and transmission of control commands for receiving imaging data and driving the monitoring terminal 200.

The image improving unit 330 corrects the illuminance, sharpness, and distortion of the photographed data transmitted from the monitoring terminal 200 through the data communication unit 320 and outputs the corrected image to the object sensing unit 340.

The object sensing unit 340 senses a moving object from the photographed data whose image has been improved through the image improving unit 330 by using an image processing algorithm preset based on the control of the controller 380. [

When a motion object is detected through the object detection unit 340, the criminal action determination unit 350 detects the motion object using the image processing algorithm preset based on the control of the control unit 380, The motion direction of the sensed object, and the behavior pattern of the object being tracked are compared with each other, and the motion direction and the behavior pattern of the object being tracked are compared with the patterns related to the crime behavior stored in the database 310 to determine whether or not they coincide with each other.

The image processing algorithms that have been set up in this time include crime behavior pattern analysis and database implementation, motion pattern recognition and image library comparison algorithm, human and vehicle motion capture through feature extraction and recognition, tracking through motion recognition and camera interlocking And auto-focus implementation, and dynamic image processing through digital image enhancement and restoration techniques.

The image storage unit 360 stores shooting data of an object determined as a criminal activity in the criminal activity determination unit 350 based on the control of the control unit 380. [

Based on the control of the control unit 380, the criminal activity notification unit 370 generates the crime occurrence data including the time, place, and content of the criminal activity determined by the criminal activity determination unit 350, Or to the communication terminal possessed by the person involved in the criminal behavior processing by voice.

The control unit 380 controls the moving direction of the object, the patterns of the behavior pattern, the image enhancement of the photographing data transmitted from the monitoring terminal 200, the detection of the moving object, It is necessary to analyze the direction of movement, track the behavior, compare and analyze patterns related to crime, record crime data, record crime data, generate crime data including time, place, Overall control.

Next, an embodiment of a method for discriminating a crime through intelligent object detection according to the present invention will be described in detail with reference to FIG.

FIG. 3 is a flowchart illustrating an operation procedure of a method for discriminating a crime through intelligent object detection according to an exemplary embodiment of the present invention.

First, the server computer 300 stores the patterns of the movement direction and behavior pattern of the object accompanying each criminal act including the kidnapping, assault, and hit-and-run, in the database, and stores the patterns related to the criminal activity continuously (S100) .

At this time, the pattern of the movement direction and the behavior pattern of the object accompanying each criminal act in the step S100 are the pattern of the behavior of the planned crime and the accidental crime, and the patterns of the behavior of the crime such as kidnapping, abduction, hit and run, Patterns of the behavior of suspects per crime, patterns of features related to the appearance of the suspects per crime, patterns of behavior related to long periods of waiting in a specific area, and specific movements of sudden movements during a short period of time.

In step S100, the server computer 300 converts patterns related to various types of criminal activity into databases. The server computer 300 analyzes image data transmitted from the plurality of monitoring terminals 200 communicatively connected through the network communication network 100, The object is detected (S200).

In operation S300, when the object is detected in the shooting data, the server computer 300 controls the operation of the monitoring terminal 200 to track the movement direction and behavior of the detected object in operation S300. At this time, when tracking the movement direction and behavior pattern of the object, if the object being tracked exceeds the shooting range of the surveillance terminal currently being photographed, the server computer 300 displays the video captured by the first surveillance terminal among the adjacent surveillance terminals (For example, the top, bottom, hat, shoes, etc. of the object being tracked), behavior pattern information based on the size of the object (e.g., horizontal, vertical, diagonal, etc.) It is possible to control to continuously perform shooting with one monitoring terminal.

Thereafter, the server computer 300 compares the movement direction and the behavior pattern of the object being tracked with the patterns related to the criminal behavior constructed in the database in step S100 through step S300 (S400) .

If it is determined in step S400 that the motion direction and the behavior pattern of the object coincide with the patterns related to the criminal behavior established in the database, the server computer 300 determines that a criminal activity has occurred, generates an event log, And generates crime occurrence data including time, place, and crime activity (S500). At this time, when the server computer 300 judges whether or not the pattern related to the object currently being tracked and the pattern associated with the previously registered criminal behavior is coincident, the server computer 300 judges that the pattern is a criminal act if the pattern matches the predetermined number, The number of patterns judged to be acts can be arbitrarily set according to the general pattern of each criminal act.

Finally, the server computer 300 transmits the crime occurrence data generated in step S500 to a communication terminal carried by a related person (for example, a police station, a fire department or the like) performing a criminal action process , So that the relevant person can process it (S600).

As described above, according to the present invention, it is possible to promptly detect the occurrence of a crime in various situations such as kidnapping, kidnapping, hit-and-run, assault, etc., And it is possible to perform quick dispatch and processing to the crime occurrence area.

It will be apparent to those skilled in the art that various modifications may be made to the invention without departing from the spirit and scope of the invention as defined in the following claims And changes may be made without departing from the spirit and scope of the invention.

100: Network communication network 200: Monitoring terminal
300: server computer 310: database
320: Data communication unit 330: Image enhancement unit
340: object detection unit 350:
360: video storage unit 370: criminal activity notification unit
380:

Claims (9)

(1) The server computer stores the patterns of the movement direction and behavior pattern of the object accompanying each criminal act including the kidnapping, assault, and hit-and-run in the database,
(2) The server computer may further include a step of image enhancement of the image pickup data transmitted from a plurality of monitoring terminals connected to communication,
(3) The server computer controls the operation of the monitoring terminal when the object is detected through the step (2), thereby tracking the movement direction and the behavior pattern of the detected object,
(4) The server computer compares the movement direction and behavior pattern of the object being tracked with the patterns related to the crime behavior constructed in the database in the step (1) through the step (3) step,
(5) The server computer determines that a crime has occurred and generates an event log if the motion direction and the behavior pattern of the object coincide with the patterns related to the crime behavior established in the database as a result of the determination in step (4) , Generating photographed crime occurrence data including time, place and contents of crime while storing photographed data, and
(6) The server computer transmits the crime occurrence data generated in the step (5) to the communication terminal possessed by the person who performs the crime behavior process,
The method comprising the steps of: The method according to claim 1,
The pattern of movement direction and behavior pattern of the object accompanied with each criminal act in the step (1)
Patterns of behavior of both deliberate and accidental crimes and patterns of behavior of suspects by each crime including kidnapping, kidnapping, hit and run, assault, vandalism and theft, and pattern And a method for discriminating a crime through intelligent object detection, which is a pattern for a behavior related to a specific motion for a long time in a specific area or a sudden movement for a short time. The method according to claim 1,
When tracking the movement direction and behavior of the object through the step (3)
If the object being tracked exceeds the shooting range of the surveillance terminal currently being photographed, the server computer may match the size, color, and behavior pattern information of the object on the image data taken by the first surveillance terminal of the adjacent surveillance terminal A method for discriminating a crime through intelligent object detection that controls shooting continuously with another monitoring terminal that senses an object. A computer-readable recording medium having recorded thereon a computer program capable of causing a computer to execute the method according to any one of claims 1 to 3. A network communication network in which an unspecified number of communication lines are connected to each other so as to perform data communication with each other,
A plurality of monitoring terminals for capturing a current position under the control of the server computer and transmitting data currently being photographed to the server computer through the network communication network,
And a controller configured to construct patterns of motion direction and behavior pattern of an object accompanying each criminal act including abduction, assault, and hit-and-run, in a database, and to perform image enhancement and motion of photographed data transmitted from the plurality of monitoring terminals through the network communication network Detects a moving object, detects the object having the moving object, controls the motion of the monitoring terminal, tracks the motion direction and behavior pattern of the detected object, compares patterns related to the motion direction and behavior pattern of the object being tracked, If the motion direction and the behavior pattern of the object coincide with the patterns related to the criminal activity constructed in the database, the event log is generated to store the shooting data, and at the same time, Crime occurrence data including contents, and the crime occurrence date A server computer for transmitting a character or voice to a communication terminal possessed by a person in charge of carrying out a criminal action process registered in advance
And detecting an object based on the detected object. 6. The method of claim 5,
The server computer,
A database that stores patterns of motions and behaviors of objects accompanying each criminal act including abduction, assault, and hit-and-run,
A plurality of monitoring terminals communicatively connected through the network communication network, a data communication unit for processing reception of imaging data and transmission of control commands,
An image enhancement unit for correcting the illuminance, sharpness, and distortion of the photographed data transmitted from the monitoring terminal through the data communication unit and outputting the corrected image,
An object sensing unit for sensing a moving object from the photographed data whose image is improved through the image improving unit,
If a motion object is detected through the object detection unit, the motion direction and behavior pattern of the detected object are tracked. The motion direction and behavior pattern of the object being tracked are compared with the patterns related to the crime behavior stored in the database A criminal action judgment unit for judging whether or not there is a match,
An image storage unit for storing shooting data of an object judged to be a criminal act by the criminal activity judging unit,
The crime occurrence data including the time, place, and content of the criminal activity judged by the criminal activity judging section is generated and transmitted to the communication terminal having the person concerned who carries out the criminal act by a character or voice Criminal Action Notification Department, and
Storing the patterns of the motion direction and behavior pattern of the object accompanying each criminal act, improving the image of the shot data transmitted from the monitoring terminal, detecting the motion object, and tracking the motion direction and behavior pattern of the detected object , A control section for controlling generation of crime occurrence data including contents of time, place and contents of crime, and notification of relevant persons, comparison analysis of patterns related to crime behavior, discrimination of crime behavior, storage of shooting data on crime behavior,
And detecting an object based on the detected object. 6. The method of claim 5,
The monitoring terminal comprises:
A PTZ (Pan-Tilt-Zoom) camera, and a CCTV (closed-circuit television). 6. The method of claim 5,
The server computer,
When constructing a pattern of movement direction and behavior pattern of object accompanied by each criminal act as database,
Patterns of behavior of both deliberate and accidental crimes and patterns of behavior of suspects by each crime including kidnapping, kidnapping, hit and run, assault, vandalism and theft, and pattern And an intelligent object detection device for constructing a pattern for a behavior related to a specific motion for a long time in a specific area or a sudden motion for a short time in a database. 6. The method of claim 5,
The server computer,
When the object being tracked exceeds the shooting range of the monitoring terminal currently being photographed, the size and color of the object on the image data photographed by the first monitoring terminal of the adjacent monitoring terminal And an intelligent object detection unit for continuously capturing an image of the object based on the behavior pattern information to another monitoring terminal that senses a matching object.

Images