CN101655860B - Video aided analytical method for criminal investigation and case detection and system - Google Patents

Video aided analytical method for criminal investigation and case detection and system Download PDF

Info

Publication number
CN101655860B
CN101655860B CN 200910092740 CN200910092740A CN101655860B CN 101655860 B CN101655860 B CN 101655860B CN 200910092740 CN200910092740 CN 200910092740 CN 200910092740 A CN200910092740 A CN 200910092740A CN 101655860 B CN101655860 B CN 101655860B
Authority
CN
China
Prior art keywords
video
case
personnel
analysis
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 200910092740
Other languages
Chinese (zh)
Other versions
CN101655860A (en
Inventor
陈朝武
李晓峰
赵炫
陈�峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vimicro Corp
First Research Institute of Ministry of Public Security
Original Assignee
Vimicro Corp
First Research Institute of Ministry of Public Security
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp, First Research Institute of Ministry of Public Security filed Critical Vimicro Corp
Priority to CN 200910092740 priority Critical patent/CN101655860B/en
Publication of CN101655860A publication Critical patent/CN101655860A/en
Application granted granted Critical
Publication of CN101655860B publication Critical patent/CN101655860B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a video aided analytical method for criminal investigation and case detection and a system; the system comprises a case file management device, a video library management device, a video decoding and playing device, a blur video processing device, a video analysis and target feature extraction device, a video indexing device and a string case combination analysis device; the method comprises the following steps: case files are built; the related video in the case is imported in a computer system, and the videos related with the case are associated with the case by a relational database; the videos related with the case is analyzed intelligently, feature information of an interested target is extracted from the video and is stored; a user inputs indexing conditions on a system interface, so as to comprehensively and intelligently index the videos and search the video clips. The system has the functions of intelligent indexing to the videos, quality improvement and string case-combination analysis, realizes unified management of the case videos and the comprehensive analysis platform, improves the video inspection speed, and enhances the effect and accuracy of fighting against crimes.

Description

A kind of video aided analytical method for criminal investigation and case detection and system
Technical field
The present invention relates to a kind of video aided analytical method for criminal investigation and case detection and system, belong to the video analysis technical field.
Background technology
The popularizing in work and life along with video acquisition and analytic system, make people to the collection of video and utilize video to bring great help for people's work and life, particularly application is comparatively extensive in the criminal investigation and case detection field, for solving a case of public security officer made significant contribution.Along with more and more technicalization of suspect's crime means, more and more intelligent, new problem has been proposed also criminal investigation and case detection.At present, development has fast been obtained in Chinese video monitoring market under the powerful stimulation and pulling of factors such as anti-terrorism, " safe city " project and various places, the accelerated growth of every profession and trade security protection project demands.The video data that supervisory system produces is also being brought into play more and more important effect gradually in public business, but simultaneously because the characteristics of video data, video data is not given full play of the support of the public business of criminal investigation and case detection, mainly contain following reason: the one, the utilization of video also is in traditional file search and artificial content search stage, inefficiency, omit key message easily, lack of wisdom video content analysis and retrieval product; The 2nd, the unified management and the analysis-by-synthesis platform of shortage case and video; The 3rd, DE Camera Shake in the video process, night, reason such as low-light (level), misty rain weather caused video pictures smudgy, was difficult to see clearly target; The 4th, its video format difference of the video-unit of the production of different manufacturers is difficult to implement unified management and utilization on the public business platform.
Number of patent application " 200810115569.7 " name be called " a kind of video analysis and storage means, system; and a kind of video retrieval method, system ", a kind of technical scheme of having saved the storage space of video image and having improved video frequency searching efficient has been proposed, analysis wherein and storage means, system, video image is analyzed, and storage contains the motion fragment of moving target; Video retrieval method wherein, system, video image is analyzed, storage contains the motion fragment of moving target, and relevant therewith moving target information and motion frag info, search terms according to these information and user's input, the motion fragment of preserving is retrieved, and this invention also can be widely used in especially video monitoring system of processing system for video.This patent has had innovation in the fragment and the search method of storing moving target, but remaining, the deficiency that exists handles the video image inefficiency, key message is omitted easily, simultaneously to the shooting process shake, night low-light (level) and the ambiguous problem of video pictures that causes of reason such as misty rain weather still be not resolved.
Another number of patent application is that " 200610140834.8 ", name are called " a kind of video content analysis system ", is one and analyzes the system that extracts video content information automatically.System framework comprises: input interface, task scheduling modules, video flowing acquisition module, video content analysis module (nucleus module, structure is shown in Figure of abstract), video analysis be auditing module, output interface and user interface as a result.System flow is: system receives the video analysis order of automatic network or this machine, by task scheduling modules decision task executions order, the video that decoding will be analyzed through the video flowing acquisition module, video content analysis module is analyzed shot information, camera lens key frame information, scene information, scene key frame information, key frame images information and the people's face information of extracting from video afterwards, analysis result is examined according to demand, with the storage of XML document form, upload in the video information data base at last by output interface.This system equally also exists reasons such as DE Camera Shake in the video process, night low-light (level), misty rain weather and causes video pictures smudgy, be difficult to see clearly target, and its video format difference of the video-unit of the production of different manufacturers, be difficult on the public business platform to implement the defective of unified management and utilization.
Summary of the invention
The objective of the invention is provides a kind of video aided analytical method for criminal investigation and case detection and system in order to overcome the deficiencies in the prior art.
A kind of video aided analytical method for criminal investigation and case detection comprises the steps:
Step 1: after criminal case took place, the personnel that solve a case set up case file for this case, and concrete steps are as follows:
1.1: the personnel that solve a case are in case archive management device input case information such as crime time, crime place etc.;
1.2: the personnel that solve a case press submit button in the case archive management device, the case file management devices deposits case information in database;
Step 2: the personnel of solving a case collect the case video and are that the monitoring video file imports the video library management devices with the video of collecting, and concrete steps are as follows:
2.1: the personnel that solve a case select current case to be processed in described case file management devices, and are delivered to the video library management devices by described case file management devices;
2.2: the personnel that solve a case import described video library management devices by the video that the personnel that will solve a case of the video gatherer in the video library management devices collect, video library management devices as described in when importing video information being entered in the lump as shooting time, DVR model etc.;
2.3: the video library management devices is which charge sheet each video belongs in database with the corresponding relation of the case of selection in the video that imports in the step 2.2 and the step 2.1;
Step 3: the personnel of solving a case use video analysis and target's feature-extraction device that described video is carried out assistant analysis, and concrete steps are as follows:
3.1: the personnel that solve a case select to carry out the video of video assistant analysis at video analysis and target's feature-extraction device, and, to video analysis and target's feature-extraction device analysis request is proposed then for the video of selecting is provided with function such as motion detection, the humanoid identification etc. that need analysis;
3.2: video analysis and target's feature-extraction device are worked in coordination with by a plurality of analytic unit devices in the network and are analyzed, thereby improve analysis efficiency, and its analytical procedure is as follows:
3.2.1: the analytic unit device starts the back to dispatching center's device registration, and the original state of registration post analysis cell arrangement is idle;
3.2.2: video and function that dispatching center's device need carry out assistant analysis with the personnel selection of solving a case in the step 3.1 convert the assignment instructions of describing with xml to, and each task comprises all functions that a video need be analyzed;
3.2.3: the analytic unit unit state of registering among the device query steps 3.2.1 of dispatching center, task is distributed to idle analytic unit device successively, task of the each distribution of each analytic unit device;
3.2.4: after the analytic unit device acquisition task, propose the decoding request to video decode and playing device, after video decode and playing device are received request, video is decoded, its decoding step is as follows:
3.2.4.1: when video decode and playing device start automatically from database update up-to-date decode component and decoding relation table, the corresponding relation of wherein decode relation table recording of video DVR model and decode component;
3.2.4.2: video decode and playing device by step 22 typing, are searched the homographic solution Code Element according to the corresponding video DVR model of task in the step 3.1;
3.2.4.3: video decode and playing device are built into complete decoding link automatically with the decode component that finds among the step 3.2.4.2 and decode;
3.2.4.4: video decode and playing device each the frame picture that produces of will decoding sends to the analytic unit device;
3.2.5: the analytic unit device is to obtaining each frame picture from video decode and playing device, and analyzes all functions respectively, like this, as long as play a video, can analyze all functions;
3.2.6: the result that the analytic unit device is analyzed step 3.2.5 comprises that the moving target that from video extraction is suspicious and the characteristic information of static target are saved in the database;
3.2.7: after the analytic unit device is finished a task, the message of finishing to dispatching center's device transmission task; If dispatching center's device has not analyzing of task, then distribute a new task to give this analytic unit device immediately, otherwise the state that upgrades this analytic unit device is for idle;
3.2.8: repeating step 3.2.3 to 3.2.7, finish up to all tasks.
Step 4: the analytical equipment of combining related cases calculates similarity to the characteristic information of the suspicious object extracted according to step 3 in the different video, extracts the target that similarity surpasses setting threshold, is shown to the personnel of solving a case by the analytical equipment of combining related cases, and the analysis clue of combining related cases is provided;
Step 5: the personnel that solve a case at video frequency searching device input comprehensive intelligent search condition such as crime time or/and location information or/and Target Photo or/and feature description or/and event type;
Step 6: the comprehensive intelligent search condition that the video frequency searching device personnel that will solve a case import converts data base query language to, compare with the characteristic information of the suspicious object of step 3 extraction in the database, find out the target that similarity surpasses setting threshold, be shown to the personnel of solving a case by the video frequency searching device;
Step 7: the personnel that solve a case choose video in step 6 output result at the video frequency searching device, carry out decodes and plays by video decode and playing device, video decode and playing device can mark the time period that target occurs in progress bar, mark position and track that target occurs on screen;
Step 8: the personnel selection of solving a case strengthens the blurred picture processing of picture quality to the video of decodes and plays by fuzzy video process apparatus, fuzzy video process apparatus is extended processing functions dynamically, as removing shake, video enhancing, motion blur recovery, removing field effect, SUPERRESOLUTION PROCESSING FOR ACOUSTIC.
A kind of criminal investigation and case detection video assistant analysis system comprises as lower device:
(1) case file management devices is used for the case information stores providing the data manipulations such as increasing, delete, look into, change to case to database or file;
(2) video library management devices is used for video is imported to video server, in database or file, provides the data manipulation functions such as increasing, delete, look into, change to video with the Video Add-On information stores;
(3) video decode and playing device are used for the video from different DVR is carried out unified decoding and broadcast, and can carry out grabgraf and be kept at this locality video;
(4) fuzzy video process apparatus is used for fuzzy video is handled, and improves video quality;
(5) video analysis and target's feature-extraction device are used for extracting interested target from video, as moving target, static suspicious item, people, car, people's face, car plate;
(6) video frequency searching device is used to retrieve the video that meets the personnel's input of solving a case;
(7) analytical equipment of combining related cases is used for finding out automatically the same target that different video, different case occur;
Wherein: the case file management devices is connected with the video library management devices, described video library management devices is connected with the target's feature-extraction device with video analysis, described video analysis is connected with the analytical equipment of combining related cases with the target's feature-extraction device, described string and case analytical equipment are connected with the video frequency searching device, and, described video frequency searching device is connected with playing device with video decode, described video decode is connected with fuzzy video process apparatus with playing device, and described video analysis also is connected with playing device with video decode with the target's feature-extraction device.
Described video library management devices comprises the video gatherer, the described video gatherer support personnel that solve a case import video from media such as portable hard drive, CDs, also provide from network information such as time according to the personnel setting of solving a case, place to import video automatically from the DVR of networking.
Described video gatherer comprises automatic video frequency time resolution device, and described automatic video frequency time resolution device is to resolving the shooting time of video with the video of time name according to video name, and carries out time calibration according to the time deviator of the personnel setting of solving a case.
Described video analysis and target's feature-extraction device comprise dispatching center's device and a plurality of analytic unit device, device will solve a case personnel's request in described dispatching center converts the xml instruction to, and with its reasonable distribution to the analytic unit device, the analytic unit device is analyzed video, and the result is write database.
The present invention is with respect to beneficial effect that prior art has:
1, method of the present invention have the video content intelligent retrieval, the utility functions such as comprehensive video retrieval, video quality improvement, the analysis of combining related cases of time ground thing based on the personage, the unified management and the analysis-by-synthesis platform of case video have been realized, video investigation speed be will improve, the dynamics and the degree of accuracy of fighting crime strengthened;
2, the present invention is by the plug-in type framework, realized a dynamically public security application platform of expanded mode paste video processing function and intelligent video analysis search function, can be according to the demand flexible configuration of specifically solving a case.
3, the present invention makes the target of being paid close attention to be not limited to moving object detection by the combination of various analysis modules, thereby has effectively reduced the retrieval error that target moves slowly or illumination variation, noise etc. cause.
Description of drawings
Fig. 1 is a kind of video aided analytical method for criminal investigation and case detection process flow diagram of the present invention;
Fig. 2 is a kind of criminal investigation and case detection video of the present invention assistant analysis system module structural representation;
Embodiment
Understand technical scheme of the present invention for one of ordinary skill in the art can be known, now reach enforcement in conjunction with the accompanying drawings technical scheme of the present invention is done further explanation at large:
A kind of criminal investigation and case detection video assistant analysis system comprises as lower device:
(1) the case file management devices 10, and being used for the case information stores providing the data manipulations such as increasing, delete, look into, change to case to database or file;
(2) the video library management devices 20, are used for video is imported to video server, in database or file, provide the data manipulation functions such as increasing, delete, look into, change to video with the Video Add-On information stores;
(3) video decode and playing device 60 are used for the video from different DVR is carried out unified decoding and broadcast, and can carry out grabgraf and be kept at this locality video;
(4) fuzzy video process apparatus 70 is used for fuzzy video is handled, and improves video quality;
(5) video analysis and target's feature-extraction device 30 are used for extracting interested target from video, as moving target, static suspicious item, people, car, people's face, car plate;
(6) the video frequency searching device 50, are used to retrieve the video that meets the personnel's input of solving a case;
(7) string and case analytical equipment 40 are used for finding out automatically the same target that different video, different case occur;
Wherein: case file management devices 10 is connected with video library management devices 20, described video library management devices 20 is connected with target's feature-extraction device 30 with video analysis, described video analysis is connected with the analytical equipment 40 of combining related cases with target's feature-extraction device 30, described string, and case analytical equipment 40 is connected with video frequency searching device 50, and, described video frequency searching device 50 is connected with playing device 60 with video decode, described video decode is connected with fuzzy video process apparatus 70 with playing device 60, and described video analysis also is connected with playing device 60 with video decode with target's feature-extraction device 30.
The video library management devices comprises video gatherer 201, the video gatherer 201 support personnel that solve a case import video from media such as portable hard drive, CDs, also provide from network information such as time according to the personnel setting of solving a case, place to import video automatically from the DVR of networking.
Video gatherer 201 comprises automatic video frequency time resolution device 2011, and 2011 pairs in automatic video frequency time resolution device is resolved the shooting time of video with the video of time name according to video name, and carries out time calibration according to the time deviator of the personnel setting of solving a case.
Video analysis and target's feature-extraction device 30 comprise dispatching center's device 31 and a plurality of analytic unit device 32, to solve a case personnel's request of dispatching center's device 31 converts the xml instruction to, and with its reasonable distribution to analytic unit device 32,32 pairs of videos of analytic unit device are analyzed, and the result is write database.
A kind of video aided analytical method for criminal investigation and case detection comprises the steps:
Step 1: after criminal case took place, the personnel that solve a case set up case file for this case, and concrete steps are as follows:
1.1: the personnel that solve a case are in case archive management device 10 input case information such as crime time, crime places etc.;
1.2: the personnel that solve a case press submit button in case archive management device 10, case file management devices 10 deposits case information in database;
Step 2: the personnel of solving a case collect the case video and are that the monitoring video file imports video library management devices 20 with the video of collecting, and concrete steps are as follows:
2.1: the personnel that solve a case select current case to be processed in described case file management devices 10, and are delivered to video library management devices 20 by described case file management devices 10;
2.2: the personnel that solve a case import described video library management devices 20 by the video that the personnel that will solve a case of the video gatherer 201 in the video library management devices 20 collect, video library management devices 20 as described in when importing video information being entered in the lump as shooting time, DVR model etc.;
2.3: video library management devices 20 is which charge sheet each video belongs in database with the corresponding relation of the case of selection in the video that imports in the step 2.2 and the step 2.1;
Step 3: the personnel of solving a case use video analysis and 30 pairs of described videos of target's feature-extraction device to carry out assistant analysis, and concrete steps are as follows:
3.1: the personnel that solve a case select to carry out the video of video assistant analysis at video analysis and target's feature-extraction device 30, and, to video analysis and target's feature-extraction device 30 analysis request are proposed then for the video of selecting is provided with function such as motion detection, the humanoid identification etc. that need analysis;
3.2: video analysis and target's feature-extraction device 30 are by 32 collaborative analyses of a plurality of analytic unit devices in the network, thus the raising analysis efficiency, its analytical procedure is as follows:
3.2.1: analytic unit device 32 starts the back to 31 registrations of dispatching center's device, and the original state of registration post analysis cell arrangement 32 is idle;
3.2.2; Video and function that dispatching center's device 31 need carry out assistant analysis with the personnel selection of solving a case in the step 3.1 convert the assignment instructions of describing with xml to, and each task comprises all functions that a video need be analyzed;
3.2.3: analytic unit device 32 states of registering among dispatching center's device 31 query steps 3.2.1, task is distributed to idle analytic unit device 32 successively, task of each analytic unit device 32 each distribution;
3.2.4: after the analytic unit device 32 acquisition tasks, propose the decoding request to video decode and playing device 60, after video decode and playing device 60 are received request, video is decoded, its decoding step is as follows:
3.2.4.1: when video decode and playing device 60 starts automatically from database update up-to-date decode component and decoding relation table, the corresponding relation of wherein decode relation table recording of video DVR model and decode component;
3.2.4.2: video decode and playing device 60 by step 22 typing, are searched the homographic solution Code Element according to the corresponding video DVR model of task in the step 3.1;
3.2.4.3: video decode and playing device 60 are built into complete decoding link automatically with the decode component that finds among the step 3.2.4.2 and decode;
3.2.4.4: video decode and playing device 60 each the frame picture that produces of will decoding sends to analytic unit device 32;
3.2.5: 32 pairs in analytic unit device obtains each frame picture from video decode and playing device 60, and analyzes all functions respectively, like this, as long as play a video, can analyze all functions;
3.2.6: the result that analytic unit device 32 is analyzed step 3.2.5 comprises that the moving target that from video extraction is suspicious and the characteristic information of static target are saved in the database;
3.2.7: after analytic unit device 32 is finished a task, the message of finishing to dispatching center's device 31 transmission tasks; If dispatching center's device 32 has not analyzing of task, then distribute a new task to give this analytic unit device 32 immediately, otherwise the state that upgrades this analytic unit device 32 is for idle;
3.2.8: repeating step 3.2.3 to 3.2.7, finish up to all tasks.
Step 4: the characteristic information of the suspicious object of extracting according to step 3 in string and 40 pairs of different videos of case analytical equipment calculates similarity, extract the target that similarity surpasses setting threshold, be shown to the personnel of solving a case by string and case analytical equipment 40, the analysis clue of combining related cases is provided;
Step 5: the personnel that solve a case at video frequency searching device 50 input comprehensive intelligent search conditions such as crime time or/and location information or/and Target Photo or/and feature description or/and event type;
Step 6: the comprehensive intelligent search condition that video frequency searching device 50 personnel that will solve a case import converts data base query language to, compare with the characteristic information of the suspicious object of step 3 extraction in the database, find out the target that similarity surpasses setting threshold, be shown to the personnel of solving a case by video frequency searching device 50;
Step 7: the personnel that solve a case choose video in step 6 output result at video frequency searching device 50, carry out decodes and plays by video decode and playing device 60, video decode and playing device 60 can mark the time period that target occurs in progress bar, mark position and track that target occurs on screen;
Step 8: the personnel selection of solving a case strengthens the blurred picture processing of picture quality by the video of fuzzy 70 pairs of decodes and plays of video process apparatus, fuzzy video process apparatus 70 is extended processing functions dynamically, as removing shake, video enhancing, motion blur recovery, removing field effect, SUPERRESOLUTION PROCESSING FOR ACOUSTIC.
Embodiment
With bank raid case together is example:
Step 1: after robbery took place, the personnel that solve a case at first set up case file for this robbery in case archive management device 10, and the step of setting up case file is as follows:
1.1: the personnel that solve a case import case information such as crime time, crime place etc. in case archive management device 10;
1.2: the personnel that solve a case press submit button in case archive management device 10, case file management devices 10 deposits case information in database;
Step 2: the personnel of solving a case collect the case video of this robbery and are that the monitoring video file imports video library management devices 20 with the case video of collecting, and concrete steps are as follows:
2.1: the personnel that solve a case select current case to be processed in case archive management device 10, and are delivered to the video library management devices by case file management devices 10;
2.2: the video of the bank raid case that the personnel that solve a case will the personnel of solving a case collect by the video gatherer 201 in the video library management devices 20 imports video library management devices 20, when importing video information such as shooting time, DVR model etc. is entered into video library management devices 20 in the lump;
2.3: video library management devices 20 is which charge sheet each video belongs in database with the corresponding relation of the current case to be processed of selection in the bank raid case video that imports in the step 2.2 and the step 2.1;
Step 3: the personnel of solving a case use video analysis and 30 pairs of bank raid cases of target's feature-extraction device video to carry out assistant analysis, and concrete steps are as follows:
3.1: the personnel that solve a case select to carry out the video of video assistant analysis at video analysis and target's feature-extraction device 30, and, to video analysis and target's feature-extraction device 30 analysis request are proposed then for the video of selecting is provided with function such as motion detection, the humanoid identification etc. that need analysis;
3.2: video analysis and target's feature-extraction device 30 are by 32 collaborative analyses of a plurality of analytic unit devices in the network, and to improve analysis efficiency, its analytical procedure is as follows:
3.2.1: analytic unit device 32 starts the back to 31 registrations of dispatching center's device, and the original state of registration post analysis cell arrangement 32 is idle;
3.2.2: video and function that dispatching center's device 31 need carry out assistant analysis with the personnel selection of solving a case in the step 3.1 convert the assignment instructions of describing with xml to, and each task comprises all functions that a video need be analyzed;
3.2.3: analytic unit device 32 states of registering among dispatching center's device 31 query steps 3.2.1, task is distributed to idle analytic unit device 32 successively, task of each analytic unit device 32 each distribution;
3.2.4: after the analytic unit device 32 acquisition tasks, propose the decoding request to video decode and playing device 60, after video decode and playing device 60 are received request, the video of bank raid case is decoded, its decoding step is as follows:
3.2.4.1: when video decode and playing device 60 starts automatically from database update up-to-date decode component and decoding relation table, the corresponding relation of wherein decode relation table recording of video DVR model and decode component;
3.2.4.2: video decode and playing device 60 by step 22 typing, are searched the homographic solution Code Element according to the corresponding video DVR model of task in the step 3.1;
3.2.4.3: video decode and playing device 60 are built into complete decoding link automatically with the decode component that finds among the step 3.2.4.2 and decode;
3.2.4.4: video decode and playing device 60 each the frame picture that produces of will decoding sends to analytic unit device 32;
3.2.5: 32 pairs in analytic unit device obtains each frame picture from video decode and playing device 60, and analyzes all functions respectively, like this, as long as play the video of this bank raid case, can analyze all functions;
3.2.6: the result that analytic unit device 32 is analyzed step 3.2.5 comprises that the moving target that from bank raid case video extraction is suspicious and the characteristic information of static target are saved in the database;
3.2.7: after analytic unit device 32 is finished a task, the message of finishing to dispatching center's device 31 transmission tasks; If dispatching center's device 31 has not analyzing of task, then distribute a new task to give this analytic unit device 32 immediately, otherwise the state that upgrades this analytic unit device 32 is for idle;
3.2.8: repeating step 3.2.3 to 3.2.7, finish up to all tasks.
Step 4: the characteristic information of the suspicious object of extracting according to step 3 in string and 40 pairs of different videos of case analytical equipment calculates similarity, extract the target that similarity surpasses setting threshold, be shown to the personnel of solving a case by string and case analytical equipment 40, the analysis clue of combining related cases is provided;
Step 5: the personnel that solve a case at video frequency searching device 50 input comprehensive intelligent search conditions such as crime time or/and location information or/and Target Photo or/and feature description or/and event type;
Step 6: the comprehensive intelligent search condition that video frequency searching device 50 personnel that will solve a case import converts data base query language to, compare with the characteristic information of the suspicious object of step 3 extraction in the database, find out the target that similarity surpasses setting threshold, be shown to the personnel of solving a case by video frequency searching device 50;
Step 7: the personnel that solve a case choose video in step 6 output result at video frequency searching device 50, carry out decodes and plays by video decode and playing device 60, video decode and playing device 60 can mark the time period that target occurs in progress bar, mark position and track that target occurs on screen;
Step 8: the personnel selection of solving a case strengthens the blurred picture processing of picture quality by the video of fuzzy 70 pairs of decodes and plays of video process apparatus, fuzzy video process apparatus 60 is extended processing functions dynamically, as removing shake, video enhancing, motion blur recovery, removing field effect, SUPERRESOLUTION PROCESSING FOR ACOUSTIC.
Method of the present invention has the video content intelligent retrieval, the utility functions such as comprehensive video retrieval, video quality improvement, the analysis of combining related cases of ground thing during based on the personage, the unified management and the analysis-by-synthesis platform of case video have been realized, video investigation speed be will improve, the dynamics and the degree of accuracy of fighting crime strengthened; By the plug-in type framework, realized one dynamically expanded mode stick with paste the public security application platform of video processing function and intelligent video analysis search function, can be according to the demand flexible configuration of specifically solving a case; By the combination of various analysis modules, make the target of being paid close attention to be not limited to moving object detection, thereby effectively reduced the retrieval error that target moves slowly or illumination variation, noise etc. cause.

Claims (5)

1. a video aided analytical method for criminal investigation and case detection is characterized in that, comprises the steps:
Step 1: after criminal case took place, the personnel that solve a case set up case file for this case, and concrete steps are as follows:
1.1: the personnel that solve a case are in case archive management device input case information;
1.2: the personnel that solve a case press submit button in the case archive management device, the case file management devices deposits case information in database;
Step 2: the personnel of solving a case collect the case video and the video of collecting are imported the video library management devices, and concrete steps are as follows:
2.1: the personnel that solve a case select current case to be processed in described case file management devices, and are delivered to the video library management devices by described case file management devices;
2.2: the personnel that solve a case import described video library management devices by the video that the personnel that will solve a case of the video gatherer in the video library management devices collect, and when importing video information are entered into described video library management devices in the lump;
2.3: the video library management devices records the corresponding relation of the case of selection in the video that imports in the step 2.2 and the step 2.1 in the database;
Step 3: the personnel of solving a case use video analysis and target's feature-extraction device that described video is carried out assistant analysis, and concrete steps are as follows:
3.1: the personnel that solve a case select to carry out the video of video assistant analysis at video analysis and target's feature-extraction device, and for the video of selecting is provided with the function that needs analysis, propose analysis request to video analysis and target's feature-extraction device then;
3.2: video analysis and target's feature-extraction device are worked in coordination with by a plurality of analytic unit devices in the network and are analyzed, and its analytical procedure is as follows:
3.2.1: the analytic unit device starts the back to dispatching center's device registration, and the original state of registration post analysis cell arrangement is idle;
3.2.2: video and function that dispatching center's device need carry out assistant analysis with the personnel selection of solving a case in the step 3.1 convert the assignment instructions of describing with xml to, and each task comprises all functions that a video need be analyzed;
3.2.3: the analytic unit unit state of registering among the device query steps 3.2.1 of dispatching center, task is distributed to idle analytic unit device successively, task of the each distribution of each analytic unit device;
3.2.4: after the analytic unit device acquisition task, propose the decoding request to video decode and playing device, after video decode and playing device are received request, video is decoded, its decoding step is as follows:
3.2.4.1: when video decode and playing device start automatically from database update up-to-date decode component and decoding relation table, the corresponding relation of wherein decode relation table recording of video DVR model and decode component;
3.2.4.2: the video DVR model that video decode is corresponding according to task in the step 3.1 with playing device, search the homographic solution Code Element;
3.2.4.3: video decode and playing device are built into complete decoding link automatically with the decode component that finds among the step 3.2.4.2 and decode;
3.2.4.4: video decode and playing device each the frame picture that produces of will decoding sends to the analytic unit device;
3.2.5: the analytic unit device obtains each frame picture from video decode and playing device, and analyzes all functions respectively;
3.2.6: the result that the analytic unit device is analyzed step 3.2.5 comprises that the moving target that from video extraction is suspicious and the characteristic information of static target are saved in the database;
3.2.7: after the analytic unit device is finished a task, the message of finishing to dispatching center's device transmission task; If dispatching center's device has not analyzing of task, then distribute a new task to give this analytic unit device immediately, otherwise the state that upgrades this analytic unit device is for idle;
3.2.8: repeating step 3.2.3 to 3.2.7, finish up to all tasks;
Step 4: the analytical equipment of combining related cases calculates similarity to the characteristic information of the suspicious object extracted according to step 3 in the different video, extracts the target that similarity surpasses certain threshold value, is shown to the personnel of solving a case by the analytical equipment of combining related cases, and the analysis clue of combining related cases is provided;
Step 5: the personnel that solve a case are in video frequency searching device input comprehensive intelligent search condition, described comprehensive intelligent search condition comprise crime time or/and location information or/and Target Photo or/and feature description or/and event type;
Step 6: the comprehensive intelligent search condition that the video frequency searching device personnel that will solve a case import converts data base query language to, compare with the characteristic information of the suspicious object of step 3 extraction in the database, find out the target that similarity surpasses certain threshold value, be shown to the personnel of solving a case by the video frequency searching device;
Step 7: the personnel that solve a case choose video in step 6 output result at the video frequency searching device, carry out decodes and plays by video decode and playing device.Video decode and playing device can mark the time period that target occurs in progress bar, mark position and track that target occurs on screen;
Step 8: the personnel selection of solving a case strengthens the blurred picture processing of picture quality to the video of decodes and plays by fuzzy video process apparatus, described fuzzy video process apparatus is extended processing functions dynamically, and described processing capacity comprises removes shake, video enhancing, motion blur recovery, removal field effect, SUPERRESOLUTION PROCESSING FOR ACOUSTIC.
2. a criminal investigation and case detection video assistant analysis system is characterized in that, comprises as lower device:
(1) case file management devices is used for the case information stores to database or file, provides case increased, deletes, looks into, changes data manipulation;
(2) video library management devices is used for video is imported to video server, and the Video Add-On information stores in database or file, is provided video increased, deletes, looks into, changes data manipulation function;
(3) video decode and playing device are used for the video from different DVR is carried out unified decoding and broadcast, and can carry out grabgraf and be kept at this locality video;
(4) fuzzy video process apparatus is used for fuzzy video is handled, and improves video quality;
(5) video analysis and target's feature-extraction device are used for extracting interested target from video, and described interested target comprises moving target, static suspicious item, people, car, people's face, car plate;
(6) video frequency searching device is used to retrieve the video that meets the personnel's input of solving a case;
(7) analytical equipment of combining related cases is used for finding out automatically the same target that different video, different case occur;
Wherein: the case file management devices is connected with the video library management devices, described video library management devices is connected with the target's feature-extraction device with video analysis, described video analysis is connected with the analytical equipment of combining related cases with the target's feature-extraction device, the described analytical equipment of combining related cases is connected with the video frequency searching device, and, described video frequency searching device is connected with playing device with video decode, described video decode is connected with fuzzy video process apparatus with playing device, and described video analysis also is connected with playing device with video decode with the target's feature-extraction device.
3. a kind of criminal investigation and case detection video assistant analysis as claimed in claim 2 system, it is characterized in that, described video library management devices comprises the video gatherer, the described video gatherer support personnel that solve a case import video from portable hard drive, CD media, provide also that time, the location information according to the personnel setting of solving a case imports video automatically from the DVR of networking from network.
4. a kind of criminal investigation and case detection video assistant analysis as claimed in claim 3 system, it is characterized in that, described video gatherer comprises automatic video frequency time resolution device, described automatic video frequency time resolution device is to resolving the shooting time of video with the video of time name according to video name, and carries out time calibration according to the time deviator of the personnel setting of solving a case.
5. a kind of criminal investigation and case detection video assistant analysis as claimed in claim 2 system, it is characterized in that, described video analysis and target's feature-extraction device comprise dispatching center's device and analytic unit device, device will solve a case personnel's request in described dispatching center converts the xml instruction to, and with its reasonable distribution to the analytic unit device, the analytic unit device is analyzed video, and the result is write database.
CN 200910092740 2009-09-16 2009-09-16 Video aided analytical method for criminal investigation and case detection and system Active CN101655860B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200910092740 CN101655860B (en) 2009-09-16 2009-09-16 Video aided analytical method for criminal investigation and case detection and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200910092740 CN101655860B (en) 2009-09-16 2009-09-16 Video aided analytical method for criminal investigation and case detection and system

Publications (2)

Publication Number Publication Date
CN101655860A CN101655860A (en) 2010-02-24
CN101655860B true CN101655860B (en) 2011-06-15

Family

ID=41710153

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910092740 Active CN101655860B (en) 2009-09-16 2009-09-16 Video aided analytical method for criminal investigation and case detection and system

Country Status (1)

Country Link
CN (1) CN101655860B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109685459A (en) * 2018-12-17 2019-04-26 台州三石量子科技有限公司 Case Computer Aided Analysis System

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101840422A (en) * 2010-04-09 2010-09-22 江苏东大金智建筑智能化系统工程有限公司 Intelligent video retrieval system and method based on target characteristic and alarm behavior
CN103049459A (en) * 2011-10-17 2013-04-17 天津市亚安科技股份有限公司 Feature recognition based quick video retrieval method
CN102387347A (en) * 2011-10-19 2012-03-21 何进波 Video storing and instant replay system based on IP (identification of position)-SAN (storage area networking) direct storage technology
CN102404556B (en) * 2011-11-30 2014-11-12 公安部第一研究所 Universal play system and method for surveillance tape files
CN102819578B (en) * 2012-07-24 2015-01-21 武汉大千信息技术有限公司 Suspected target analyzing system and method by video investigation
CN103841367A (en) * 2012-11-21 2014-06-04 深圳市赛格导航科技股份有限公司 Monitoring system
CN103150375A (en) * 2013-03-11 2013-06-12 浙江捷尚视觉科技有限公司 Quick video retrieval system and quick video retrieval method for video detection
CN103237201B (en) * 2013-04-28 2016-01-06 江苏物联网研究发展中心 A kind of case video analysis method based on socialization mark
CN104346355B (en) * 2013-07-26 2019-03-08 南京中兴力维软件有限公司 The intelligent search method and its system of serial public security case
CN104615600B (en) * 2013-11-04 2019-06-28 深圳力维智联技术有限公司 Similitude case compares implementation method and its device
CN103903210B (en) * 2014-03-31 2018-02-27 安徽新华博信息技术股份有限公司 A kind of analysis method of case feature string simultaneously
CN104008128A (en) * 2014-04-24 2014-08-27 深圳辉锐天眼科技有限公司 Automatic case information generating and displaying method
CN105096228B (en) * 2015-07-09 2019-05-24 东方网力科技股份有限公司 Video image information treating method and apparatus
CN107277301B (en) * 2016-04-06 2019-11-29 杭州海康威视数字技术股份有限公司 The image analysis method and its system of monitor video
CN106126680A (en) * 2016-06-29 2016-11-16 北京互信互通信息技术有限公司 A kind of video image reconnaissance method and system
CN106021621B (en) * 2016-07-16 2019-11-01 大箴(杭州)科技有限公司 A kind of satellite based on big data processing is solved a case system
CN106503641B (en) * 2016-10-18 2019-06-07 上海众恒信息产业股份有限公司 Computer-aided decision support System and analysis method
CN108052581A (en) * 2017-12-08 2018-05-18 四川金英科技有限责任公司 A kind of case video studies and judges device
EP3796189A4 (en) 2018-05-18 2022-03-02 Cambricon Technologies Corporation Limited Video retrieval method, and method and apparatus for generating video retrieval mapping relationship
CN112597341A (en) * 2018-05-25 2021-04-02 中科寒武纪科技股份有限公司 Video retrieval method and video retrieval mapping relation generation method and device
CN110738083B (en) * 2018-07-20 2022-06-14 浙江宇视科技有限公司 Video processing-based string and parallel case analysis method and device
CN109118411B (en) * 2018-08-15 2022-02-22 浙江省绍兴市人民检察院 Criminal execution inspection system and method based on intelligent auxiliary platform and mobile terminal
CN109800718A (en) * 2019-01-22 2019-05-24 成都神州数码索贝科技有限公司 A kind of video portrait comparison method
CN110213651A (en) * 2019-05-28 2019-09-06 暨南大学 A kind of intelligent merit Computer Aided Analysis System and method based on security protection video
CN110177255B (en) * 2019-05-30 2021-06-11 北京易华录信息技术股份有限公司 Case scheduling-based video information publishing method and system
CN110717425A (en) * 2019-09-26 2020-01-21 深圳市商汤科技有限公司 Case association method and device, electronic equipment and storage medium
CN111598753A (en) * 2020-01-15 2020-08-28 北京明略软件系统有限公司 Suspect recommendation method and device, electronic equipment and storage medium
CN112004128A (en) * 2020-09-02 2020-11-27 中国银行股份有限公司 Method, client and server for calling video file
CN112783575B (en) * 2021-02-03 2022-09-30 杭州海宴科技有限公司 Plug-in type elastic cloud video image analysis system and method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109685459A (en) * 2018-12-17 2019-04-26 台州三石量子科技有限公司 Case Computer Aided Analysis System

Also Published As

Publication number Publication date
CN101655860A (en) 2010-02-24

Similar Documents

Publication Publication Date Title
CN101655860B (en) Video aided analytical method for criminal investigation and case detection and system
CN101021903B (en) Video caption content analysis system
CN102314916B (en) Video processing method and system
CN101778260A (en) Method and system for monitoring and managing videos on basis of structured description
CN109033440A (en) A kind of video investigation multidimensional trajectory analysis method
CN107169106B (en) Video retrieval method, device, storage medium and processor
CN102819578A (en) Suspected target analyzing system and method by video investigation
CN110290346B (en) Bidding video acquisition method based on intelligent video analysis
CN103020275A (en) Video analysis method based on video abstraction and video retrieval
CN111107319B (en) Target tracking method, device and system based on regional camera
CN110334231A (en) A kind of information processing method and device, storage medium
CN106126680A (en) A kind of video image reconnaissance method and system
CN109815878B (en) Foothold analysis method and device based on face recognition
CN106557760A (en) Monitoring system is filtered in a kind of image frame retrieval based on video identification technology
CN113239792A (en) Big data analysis processing system and method
CN111523527A (en) Special transport vehicle monitoring method and device, medium and electronic equipment
CN104484651B (en) Portrait dynamic contrast method and system
CN114078277A (en) One-person-one-file face clustering method and device, computer equipment and storage medium
CN111897993A (en) Efficient target person track generation method based on pedestrian re-recognition
CN102932421A (en) Cloud back-up method and device
CN112418063A (en) Face recognition method and device, electronic equipment and storage medium
CN114863364B (en) Security detection method and system based on intelligent video monitoring
CN115618080A (en) Data management implementation method based on data management platform and data management platform
CN101510211A (en) Multimedia data processing system and method
Zhu et al. Person re-identification in the real scene based on the deep learning

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant