CN106295565A - Monitor event identifications based on big data and in real time method of crime prediction - Google Patents

Monitor event identifications based on big data and in real time method of crime prediction Download PDF

Info

Publication number
CN106295565A
CN106295565A CN201610652780.7A CN201610652780A CN106295565A CN 106295565 A CN106295565 A CN 106295565A CN 201610652780 A CN201610652780 A CN 201610652780A CN 106295565 A CN106295565 A CN 106295565A
Authority
CN
China
Prior art keywords
crime
prediction
real
monitor
machine learning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610652780.7A
Other languages
Chinese (zh)
Inventor
江大白
胡增
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhongyong Environmental Protection Technology Co Ltd
Original Assignee
Zhongyong Environmental Protection Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhongyong Environmental Protection Technology Co Ltd filed Critical Zhongyong Environmental Protection Technology Co Ltd
Priority to CN201610652780.7A priority Critical patent/CN106295565A/en
Publication of CN106295565A publication Critical patent/CN106295565A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • G06Q50/265Personal security, identity or safety

Abstract

Monitor event identifications based on big data and in real time method of crime prediction.Comprise the following steps that step one, monitor data collection;Step 2, defines high-level semantic;Step 3, finds middle level attribute;Step 4, machine learning based on sequence of attributes;Step 5, behavioral pattern is predicted;Step 6, sets up crime probability model;Step 7, real-time prediction of criminality.The present invention utilizes machine learning method based on sequence of attributes not have the complete monitor video material of mark to process to magnanimity, and combine the experience of handling a case of Public Security Organs, obtain the behavioral pattern prediction that offender commits a crime, criminal tendency factor data storehouse is utilized to obtain crime probability model through machine learning, the two combines just can be with the generation of real-time estimate crime, provide different grades of alarm, the real video monitoring realizing intelligence, municipal public safety management is significant.

Description

Monitor event identifications based on big data and in real time method of crime prediction
Technical field:
The present invention relates to video monitoring and public safety technical field, particularly relate to a kind of monitor event based on big data Identify and real-time method of crime prediction.
Background technology:
Intelligent video analysis is mainly by obtaining the substantial amounts of sample material as machine learning, thus obtains analyzing mould Type, sample size is the most, the most accurate, and the analysis model obtained is the most accurate, to this end, people spend substantial amounts of manpower and time Collect sample, set up Sample Storehouse, such as National Institute of Standards and Technology (NIST) The LabelMeVideo [3] of the ImageNet [2] and MIT of TRECVID video frequency searching contest database [1], Stanford, The crucial problem in one, intellectual analysis field is that sample size causes the accuracy analyzing model inadequate not, and sample size is inadequate Generally refer to data deficiency mark, i.e. what these data are actually, and in event recognition field, traditional way is from video The various low-level image feature of middle extraction, such as based on light stream feature, HOG feature and spatio-temporal interest point (STIP) feature, is then directly used for setting up various model, such as Hidden Markov Models, Dynamic Bayesian Networks, Conditional Random Fields and Random Forest, the method for this " settling at one go " is for certain A little specific events design a model, and also can obtain good effect, but it lacks extensibility, when the event kind needing identification When class increases, it may be necessary to redesign corresponding model;It addition, directly utilize low-level image feature to be highly prone to the shadow of video performance Ringing, due to the motion change of target, the change at visual angle and the impact factor such as blocking, the event of same type may have difference Performance, cause event recognition failure.
Research in prediction of criminality field at present is concentrated mainly on: 1. the analysis of aetiology of crime, has from Psychological Angle Analyzing, also have the crime correlate analysis utilizing data mining technology, which the result of these researchs can teach that Factor has important impact to crime, but it can not be directly used in real-time prediction of criminality, because these are analyzed It is all to analyze qualitatively, the quantitative relationship between not crime factor and crime generation;2. criminal trend in large scale scope Prediction, is to be predicted rather than the number of crime case in a period of time of a certain area for single people on the whole The probability of crime is predicted.
Summary of the invention:
In order to solve the problem existing for background technology, the present invention provide a kind of monitor event identification based on big data and Method of crime prediction, comprises the following steps that in real time
Step one, monitors data collection;
Step 2, defines high-level semantic;
Step 3, finds middle level attribute;
Step 4, machine learning based on sequence of attributes;
Step 5, behavioral pattern is predicted;
Step 6, sets up crime probability model;
Step 7, real-time prediction of criminality.
The inventive method proposes machine learning method based on sequence of attributes and completes monitor video high-level semantic Understanding, the method has extensibility, and the change to video performance is insensitive.The mark utilizing network Shanghai amount monitors Video, we obtain its classification, and automatically extract out middle level attribute from contextual information, the most just obtain enough confession machines The sample of device study.Machine learning method based on sequence of attributes is utilized not have the complete monitor video material of mark to magnanimity Process, and combine the experience of handling a case of Public Security Organs, obtain the behavioral pattern prediction that offender commits a crime, utilize criminal tendency Factor data storehouse obtains crime probability model through machine learning, and the two combination just can be given with the generation of real-time estimate crime Different grades of alarm, the real video monitoring realizing intelligence, municipal public safety management is significant.
Accompanying drawing illustrates:
Fig. 1 is the schematic diagram that present invention discover that middle level attribute;
Fig. 2 is present invention machine learning based on sequence of attributes schematic diagram.
Detailed description of the invention:
For the defect of event recognition field traditional method, we have proposed based on sequence of attributes (Attribute Sequence) machine learning method identifies monitor event, its objective is to be reached to high level by the study of middle level attribute Semantic mapping, attribute is the more weak semantic description in a kind of middle level between low-level image feature and high-level semantic, from bottom Features training obtain, additionally, attribute is not by the constraint of semantic category (Semantic category), same attribute may Being present in multiple classification, the combination of many attribute can express certain emerging semantic category, so a lot of high-level semantics Identify and just can be realized by the study of middle level attribute.
Monitoring data collection:
At big data age, the generation of data can be uploaded more than 500,000,000 figures with geometric growth, every day, the whole world Sheet, the video just having 20 hours durations per minute shared, and more crucially these multi-medium datas shared are general the most Through being marked, i.e. they have clear and definite title, and some also carries descriptive word, specific to monitor video, its Title typically reflects certain security incident, and these monitor videos have been completed the extraction of scene (Scene), eliminate Unrelated and invalid content, utilizes the monitor video that these have marked, sets up some typical security incidents automatically Sample Storehouse, the Sample Storehouse so set up is magnanimity, and is sustainable growth.
Definition high-level semantic:
The monitor event identified as required, defines the set of a set of keyword, such as, plunders, thrustes into, and these are crucial Word is exactly high-level semantic.Therefore, on the one hand, on network, search for title contain the video of these keywords, and title or The contextual information of video should occur " monitoring " printed words, under being downloaded the most in the lump by the contextual information relevant to this video Come, for video is described the audio-frequency information of character, utilizes voice to turn text technology after extracting and be converted into word, On the other hand, the monitor video that public security department is the most archived, archive information has the explanation to video content, it is also possible to make Use for assistance data.
Discovery middle level attribute:
The monitor event identified for needs, re-defines a set of ratio more complete middle level property set, in complete Manual definition Layer property set has careless omission unavoidably, and incomplete middle level property set can affect the effectiveness of machine learning, it is therefore desirable to a kind of The method automatically extracting middle level attribute, the most just obtains enough samples for machine learning.We utilize with video together The contextual information downloaded, and the descriptive information having been converted in the video of word, use natural language processing technique, carry Take out descriptive words therein (generally noun and verb), the descriptive word that same category of monitor video is extracted Language carries out cluster analysis, finds out the word that the frequency of occurrences is higher, and carries out extensive to word, the knapsack of such as Mr. Zhang, Wang Nv The wallet of scholar is all " people X and object X ", as it is shown in figure 1, so obtained middle level attribute has static state, such as people 1,2,3 ..., Vehicle 1,2,3 ..., people X and object X etc., also have dynamic, such as, run, fall down to the ground, the middle level of all categories monitor video is belonged to Property collection merge and just obtained a set of ratio more complete middle level property set, for new monitor event, as long as adding corresponding Middle level attribute, has extendible learning capacity.
Machine learning based on sequence of attributes:
As in figure 2 it is shown, middle level attribute can remove the coupling between monitor video and its high-level semantic classification, attribute is not subject to The constraint of semantic category, same attribute is likely to be present in multiple classification, therefore each attribute can be carried out across classification Practise, train corresponding grader, after the training completing grader, to training data application class device, obtain corresponding attribute, The temporal information of record attribute simultaneously, i.e. it at which frame (or which frame) is extracted, so between each attribute Just having had temporal precedence relationship, constituted sequence of attributes, only federation properties and temporal information just can accurately identify monitoring Event, such as: consideration " robbery " event, 3 attributes therein: people 1 and object 1, people 2 and object 1, people 2 run, certain on the time Be the former front, the posterior order of the latter, so, just obtained sequence of attributes by the training of Massive Sample and arrived high-level semantic Map, when carrying out the test of unknown sample, based on middle level attributive classification device, obtain the sequence of attributes of input monitoring video, and root According to the mapping relations of sequence of attributes to high-level semantic, obtain the high-level semantic of test monitoring video.
In order to realize real-time prediction of criminality, we combine behavioral pattern prediction and crime probability model.
Behavioral pattern is predicted:
Identify that monitor event can only produce alarm when event occurs, for some premeditated criminal behavior, tend to Discovery clues and traces in monitor video before crime occurs, the and (network that these monitor videos usually do not have on network On general scene time only event occurs of monitor video), and the most do not mark, utilize machine based on sequence of attributes Device learns, and magnanimity can not had the complete monitor video material of mark to process by we, identifies the criminal behavior needing prediction, After positioning this criminal behavior and subject of crime, with subject of crime as target, in the monitor video before criminal behavior occurs, search The appearance of rope subject of crime, obtains time, place, the information such as hover/stay, trail, and aggregated analysis also combines Public Security Organs The experience of handling a case obtain corresponding behavioral pattern, with this, criminal behavior is predicted.
Set up crime probability model:
But, rely solely on the generation of behavioral pattern prediction crime, higher rate of false alarm can be caused, it practice, crime divides The educational level of son, family background, economic situation, inter personal contact, situation of serving a sentence etc. often have bigger difference with ordinary people, As the factor of prediction crime, and according to this citizen can be set up a set of criminal tendency factor data storehouse.
Utilizing the data base of the most a set of magnanimity scale, Macro or mass analysis also combines the experience of handling a case of Public Security Organs and obtains accordingly Behavioral pattern, can set up crime probability model:
G=w1α1+w2α2+w3α3+… (1)
The input of this model is criminal tendency factor-alphai, it is output as crime advanced warning grade G, wiFor weight.In order to obtain aiNeed Will be by criminal tendency factor quantification, such as to educational level, can be by primary school/junior middle school, special secondary school/senior middle school, junior college/university, research Life is quantified as 1, and 0.75,0.5,0.25, maximum is 1, is sequentially reduced backwardWherein N is the possible value of the criminal tendency factor Number (being exactly 4 for educational level), should follow a principle, the i.e. the biggest quantized value of the probability of crime quantifying when The biggest, in order to obtain weight wi, need to train first with the criminal tendency factor of existing offender and non-offender One SVM classifier
θ1α12α23α3+…b (2)
aiFor the criminal tendency factor after quantifying, θiFor coefficient, b is constant.Make a=[a1, a2, a3...], θ=[θ1, θ2, θ3...], C=[1 ,-1] represents crime and non-crime respectively, then the training process of this SVM classifier is
min||θ||2
s.t.C(θTA+b) >=1 (to all samples) (3)
Solve this optimization problem, obtain parameter θ and the b of grader.The meaning of θ is each criminal tendency factor pair crime Whether contribution, θiShow that the most greatly this criminal tendency factor is the most important, therefore wiCan be calculated as below
w i = θ i Σ i θ i - - - ( 4 )
So wiJust can reflect the importance of the corresponding criminal tendency factor, and meet ∑iwi=1.
Prediction of criminality in real time:
Bonding behavior model prediction and crime probability model can be carried out real-time prediction of criminality.Monitoring camera pair Main body in picture carries out real-time behavior prediction, starts face recognition module when meeting specific behavioral pattern, confirms it Transfer the respective record in criminal tendency factor data storehouse after identity and input crime probability model, obtaining crime early warning etc. Level, further, after being quantified by crime advanced warning grade G (M quantized interval), can provide the crime generation alarm of M grade, example Such as M=4, just there is the alarm of 4 grades (normal, should be noted that, dangerous, abnormally dangerous), coordinate color to represent, monitor in public security Display whole city dangerous hot spots scattergram real-time on the giant-screen at center, quickly, reasonably distributing police strength to public security department provides The foundation of science.

Claims (1)

1. monitor event identifications based on big data and in real time method of crime prediction, it is characterised in that comprise the following steps that
Step one, monitors data collection;
Step 2, defines high-level semantic;
Step 3, finds middle level attribute;
Step 4, machine learning based on sequence of attributes;
Step 5, behavioral pattern is predicted;
Step 6, sets up crime probability model;
Step 7, real-time prediction of criminality.
CN201610652780.7A 2016-08-10 2016-08-10 Monitor event identifications based on big data and in real time method of crime prediction Pending CN106295565A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610652780.7A CN106295565A (en) 2016-08-10 2016-08-10 Monitor event identifications based on big data and in real time method of crime prediction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610652780.7A CN106295565A (en) 2016-08-10 2016-08-10 Monitor event identifications based on big data and in real time method of crime prediction

Publications (1)

Publication Number Publication Date
CN106295565A true CN106295565A (en) 2017-01-04

Family

ID=57667964

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610652780.7A Pending CN106295565A (en) 2016-08-10 2016-08-10 Monitor event identifications based on big data and in real time method of crime prediction

Country Status (1)

Country Link
CN (1) CN106295565A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106934971A (en) * 2017-03-30 2017-07-07 安徽森度科技有限公司 A kind of power network abnormal intrusion method for early warning
CN107563929A (en) * 2017-07-27 2018-01-09 杭州中奥科技有限公司 A kind of various dimensions siren based on personage's specificity analysis
CN107563122A (en) * 2017-09-20 2018-01-09 长沙学院 The method of crime prediction of Recognition with Recurrent Neural Network is locally connected based on interleaving time sequence
CN109559045A (en) * 2018-11-30 2019-04-02 四川九洲电器集团有限责任公司 A kind of method and system of personnel's intelligence control
CN109785207A (en) * 2017-11-15 2019-05-21 娄奥林 A kind of ways and means of crime prevention prediction discovery
CN109784525A (en) * 2018-11-13 2019-05-21 北京码牛科技有限公司 Method for early warning and device based on day vacant lot integration data
CN109858489A (en) * 2019-01-15 2019-06-07 青岛海信网络科技股份有限公司 A kind of alert method for early warning and equipment
CN110009022A (en) * 2019-03-26 2019-07-12 第四范式(北京)技术有限公司 Prediction technique, device and the calculating equipment of drug addict's information
CN110059079A (en) * 2019-04-28 2019-07-26 北京深醒科技有限公司 A kind of personnel based on big data modeling analysis break laws and commit crime prediction technique and system
CN111291962A (en) * 2019-12-19 2020-06-16 韩兆鹤 Method for preventing and attacking AI crime and AI data infringement
US10733457B1 (en) 2019-03-11 2020-08-04 Wipro Limited Method and system for predicting in real-time one or more potential threats in video surveillance
CN111612677A (en) * 2020-05-27 2020-09-01 北京明略软件系统有限公司 Event security detection method, event security detection device, electronic device, and storage medium
CN112653870A (en) * 2020-08-07 2021-04-13 柳州市云奇伟业信息技术有限公司 Abnormal behavior early warning system based on big data

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102262624A (en) * 2011-08-08 2011-11-30 中国科学院自动化研究所 System and method for realizing cross-language communication based on multi-mode assistance
CN103455705A (en) * 2013-05-24 2013-12-18 中国科学院自动化研究所 Analysis and prediction system for cooperative correlative tracking and global situation of network social events
CN105138570A (en) * 2015-07-26 2015-12-09 吉林大学 Calculation method of crime degree of speech data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102262624A (en) * 2011-08-08 2011-11-30 中国科学院自动化研究所 System and method for realizing cross-language communication based on multi-mode assistance
CN103455705A (en) * 2013-05-24 2013-12-18 中国科学院自动化研究所 Analysis and prediction system for cooperative correlative tracking and global situation of network social events
CN105138570A (en) * 2015-07-26 2015-12-09 吉林大学 Calculation method of crime degree of speech data

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106934971A (en) * 2017-03-30 2017-07-07 安徽森度科技有限公司 A kind of power network abnormal intrusion method for early warning
CN107563929A (en) * 2017-07-27 2018-01-09 杭州中奥科技有限公司 A kind of various dimensions siren based on personage's specificity analysis
CN107563122B (en) * 2017-09-20 2020-05-19 长沙学院 Crime prediction method based on interleaving time sequence local connection cyclic neural network
CN107563122A (en) * 2017-09-20 2018-01-09 长沙学院 The method of crime prediction of Recognition with Recurrent Neural Network is locally connected based on interleaving time sequence
CN109785207A (en) * 2017-11-15 2019-05-21 娄奥林 A kind of ways and means of crime prevention prediction discovery
CN109784525A (en) * 2018-11-13 2019-05-21 北京码牛科技有限公司 Method for early warning and device based on day vacant lot integration data
CN109559045A (en) * 2018-11-30 2019-04-02 四川九洲电器集团有限责任公司 A kind of method and system of personnel's intelligence control
CN109858489A (en) * 2019-01-15 2019-06-07 青岛海信网络科技股份有限公司 A kind of alert method for early warning and equipment
US10733457B1 (en) 2019-03-11 2020-08-04 Wipro Limited Method and system for predicting in real-time one or more potential threats in video surveillance
CN110009022A (en) * 2019-03-26 2019-07-12 第四范式(北京)技术有限公司 Prediction technique, device and the calculating equipment of drug addict's information
CN110059079A (en) * 2019-04-28 2019-07-26 北京深醒科技有限公司 A kind of personnel based on big data modeling analysis break laws and commit crime prediction technique and system
CN111291962A (en) * 2019-12-19 2020-06-16 韩兆鹤 Method for preventing and attacking AI crime and AI data infringement
CN111612677A (en) * 2020-05-27 2020-09-01 北京明略软件系统有限公司 Event security detection method, event security detection device, electronic device, and storage medium
CN112653870A (en) * 2020-08-07 2021-04-13 柳州市云奇伟业信息技术有限公司 Abnormal behavior early warning system based on big data
CN112653870B (en) * 2020-08-07 2022-08-19 柳州市云奇伟业信息技术有限公司 Abnormal behavior early warning system based on big data

Similar Documents

Publication Publication Date Title
CN106295565A (en) Monitor event identifications based on big data and in real time method of crime prediction
Li et al. Zero-shot event detection via event-adaptive concept relevance mining
CN105787472B (en) A kind of anomaly detection method based on the study of space-time laplacian eigenmaps
CN107704637B (en) knowledge graph construction method for emergency
US8818929B2 (en) Method and system for merging data or information
CN108182262A (en) Intelligent Answer System construction method and system based on deep learning and knowledge mapping
CN109344285A (en) A kind of video map construction and method for digging, equipment towards monitoring
CN114283469B (en) Improved YOLOv4-tiny target detection method and system
CN102902960B (en) Leave-behind object detection method based on Gaussian modelling and target contour
CN109376613A (en) Video brainpower watch and control system based on big data and depth learning technology
CN104142995A (en) Social event recognition method based on visual attributes
CN109543631A (en) A kind of fire image detection alarm method based on machine learning
CN107003992A (en) Perception associative memory for neural language performance identifying system
CN110909542B (en) Intelligent semantic serial-parallel analysis method and system
CN104820711A (en) Video retrieval method for figure target in complex scene
Hanifah et al. Twitter information extraction for smart city
CN105005852A (en) Image analysis based intelligent monitoring system for dormitory environment
CN106204103A (en) The method of similar users found by a kind of moving advertising platform
CN111046213A (en) Knowledge base construction method based on image recognition
CN111191498A (en) Behavior recognition method and related product
CN106022311A (en) City monitoring video identification-based emergency event discovery method and system
CN115083229B (en) Intelligent recognition and warning system of flight training equipment based on AI visual recognition
Presa-Reyes et al. Deep learning with weak supervision for disaster scene description in low-altitude imagery
Greenwell et al. Implicit land use mapping using social media imagery
Agudelo et al. Computational Model to Support the Detection of Profiles of Missing Person in Colombia.

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
CB02 Change of applicant information

Address after: Chief District East Road Hefei 230001 Anhui province No. 959 caizhizhongxin Building 1 1- 1301

Applicant after: CHINA APPLIED TECHNOLOGY CO., LTD.

Address before: Chief District East Road Hefei 230001 Anhui province No. 959 caizhizhongxin Building 1 1- 1301

Applicant before: ZHONGYONG ENVIRONMENTAL PROTECTION TECHNOLOGY CO., LTD.

COR Change of bibliographic data
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170104