CN111353369B - Application method and system of urban road side parking high-level video in auxiliary criminal investigation - Google Patents

Application method and system of urban road side parking high-level video in auxiliary criminal investigation Download PDF

Info

Publication number
CN111353369B
CN111353369B CN201910984244.0A CN201910984244A CN111353369B CN 111353369 B CN111353369 B CN 111353369B CN 201910984244 A CN201910984244 A CN 201910984244A CN 111353369 B CN111353369 B CN 111353369B
Authority
CN
China
Prior art keywords
vehicle
information
driver
berth
level video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910984244.0A
Other languages
Chinese (zh)
Other versions
CN111353369A (en
Inventor
闫军
杨怀恒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Smart Intercommunication Technology Co ltd
Original Assignee
Smart Intercommunication Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Smart Intercommunication Technology Co ltd filed Critical Smart Intercommunication Technology Co ltd
Priority to CN201910984244.0A priority Critical patent/CN111353369B/en
Publication of CN111353369A publication Critical patent/CN111353369A/en
Application granted granted Critical
Publication of CN111353369B publication Critical patent/CN111353369B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/26—Government or public services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/625—License plates
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08—Detecting or categorising vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Library & Information Science (AREA)
  • Tourism & Hospitality (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Educational Administration (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Development Economics (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses an application system and a method of an urban road side parking high-level video system in auxiliary criminal investigation, which specifically comprise the steps of acquiring action information of a vehicle entering/exiting a road side berth, acquiring a high-level video image of the berth according to the action information, receiving the high-level video image, acquiring a characteristic picture of a vehicle entering/exiting the berth and a characteristic picture of a vehicle driver in a vehicle getting-off/getting-on process, identifying the characteristic picture of the vehicle entering/exiting the berth and the characteristic picture of the vehicle driver in the vehicle getting-off/getting-on process, and confirming personnel-vehicle related event information; and processing the information of the personnel-vehicle related events in real time, and integrating the personnel-vehicle linkage database according to the real-time processing result. By adopting the application system and the method for assisting criminal investigation of the road side parking high-level video, provided by the invention, all license plate information, vehicle characteristic information and driver information of the road side parking can be stored in a standardized and efficient manner, so that the application system and the method are used for assisting investigation work.

Description

Application method and system of urban road side parking high-level video in auxiliary criminal investigation
Technical Field
The invention relates to the field of urban road side parking management and computer-aided criminal investigation application, in particular to an application method of urban road side parking high-level videos in aided criminal investigation.
Background
The roadside parking management is parking management by using sites on both sides of a road passing on the ground. With the rapid development of urban economy and the continuous improvement of the living standard of people, the maintenance quantity of urban motor vehicles is rapidly increased, and the importance of the management problem of static traffic in cities is increasingly highlighted. Road side parking management system based on high-order video is adopted by more and more urban management departments because of the advantages of high parking identification accuracy, difficult damage after installation, comprehensive and clear video capture, no need of human operation on site, rapid and convenient charging standard and the like. At present, after the system is on line, practice proves that the system has outstanding effects in the aspects of charging standard, relieving congestion, solving berth tension and the like.
In fact, in some areas, the investigation work always has a plurality of factors which affect the long-lasting security of China, such as too single auxiliary means, low criminal investigation work efficiency and the like. In view of this, it is necessary to develop new criminal investigation auxiliary tools, especially, the technical schemes with less investment, fast realization and good effect, and by means of all other technical equipment and technical methods in social life which are beneficial to investigation work, efforts are made to improve the criminal investigation work efficiency and the investigation success rate, and the fine pursuits of the peace and happiness industry of the masses of people in China are continuously satisfied.
Disclosure of Invention
Aiming at the fact that the existing criminal investigation auxiliary means are too few, the intelligent device is used for the existing intelligent devices such as the roadside parking high-level video and the like, so that the intelligent device can be an important auxiliary means for criminal investigation without inputting too much funds and manpower, and has important significance for the works such as evidence collection, investigation, searching and the like.
In order to achieve the above purpose, the invention provides an application method of urban road side parking high-level video in auxiliary criminal investigation, which comprises the following steps:
acquiring action information of a vehicle entering/exiting a road side berth, acquiring a high-order video image of the berth according to the action information,
receiving the high-level video image, acquiring a characteristic picture of a vehicle entering/exiting a berth, and a characteristic picture of a vehicle driver in the process of getting off/on the vehicle,
associating the characteristic information of the vehicles entering/exiting the berth and the characteristic information of the driver in the process of getting off/on the vehicle, and confirming the information of the person-vehicle association event;
processing the information of the related events of the people and the vehicles in real time, integrating the linkage database of the people and the vehicles according to the real-time processing result,
and searching the integrated man-vehicle linkage database information according to the instruction, and outputting a search result.
As a further improvement of the present invention, the step of acquiring the feature information of the in-vehicle further includes acquiring the time and place information of the in-vehicle according to the in-vehicle feature information.
As a further improvement of the invention, the step of acquiring the time and place of the vehicle in place further comprises the steps of acquiring the characteristic information of a driver driving the vehicle in the process of getting off the vehicle within a set time threshold, and associating the characteristic information of the vehicle and the time and place information of the vehicle in place with the characteristic information of the driver.
As a further improvement of the invention, the method comprises the steps of acquiring the action information of the berth at the side of the entrance of the vehicle, and acquiring the high-order video image of the berth according to the action information;
detecting whether the vehicle is driven into the berth by pressing the line, and if the vehicle is driven into the berth, acquiring the action information of the berth at the side of the vehicle driving into the road.
As a further improvement of the invention, the action information of the berth at the side of the entrance of the vehicle is obtained, and the high-order video image of the berth is collected according to the action information, which comprises;
collecting special display pictures in the process of driving the vehicle into the berth every several seconds, identifying the special display pictures in the process of driving the vehicle into the berth, and confirming the entrance time of the vehicle;
and after confirming the berth of the vehicle, continuously acquiring a plurality of frames of image information, and acquiring a high-order video image of the vehicle in the berth.
As a further improvement of the invention, the method comprises the steps of acquiring the action information of the berth on the exit side of the vehicle, and acquiring the high-order video image of the berth according to the action information;
Continuously collecting state information of a suspected driver passing through the vehicle, when the collected suspected driver contacts with the vehicle and the vehicle is in line with the vehicle to leave the berth within a set time threshold,
and confirming that the suspected driver is the driver driving the vehicle, determining time and place information of the vehicle driving out of the berth, and associating the time and place information of the vehicle driving out of the berth with the driver.
As a further improvement of the invention, the information of the man-vehicle related events is processed in real time, the man-vehicle linkage database is integrated according to the real-time processing result, and the invention further comprises,
obtaining video information of multiple entrance/exit of the same vehicle to a berth, obtaining a picture of the entrance/exit of the vehicle to the berth and a picture containing biological characteristic information of the driver in the process of getting off/on the vehicle,
training a plurality of pictures of the same vehicle for entering/exiting from the berth and pictures containing biological characteristic information of the driver in the process of getting off/on the vehicle to obtain a corresponding vehicle information model and a driver biological characteristic model;
and establishing a man-vehicle linkage database according to the vehicle information model and the driver biological characteristic model.
As a further improvement of the present invention,
the step of acquiring the corresponding vehicle information model and the driver biometric model is,
Marking a plurality of in/out berth pictures and pictures containing biological characteristic information of the driver in the process of getting off/on, and adding license plate numbers, vehicle brand information, faces of the driver and gait characteristic marks of the driver;
depth training a plurality of pictures with marks,
establishing a vehicle information model according to the vehicle brand information;
and establishing a driver biological characteristic model according to the facial characteristics and the gait characteristics of the driver.
As a further improvement of the present invention, if there are a plurality of vehicle information models and/or a plurality of driver biometric models for the same license plate number, the license plate number is used as the primary key, and the plurality of vehicle information models and/or the plurality of driver biometric models are added to the man-vehicle linkage database, respectively.
As a further improvement of the invention, a plurality of pictures containing the pictures of the entrance/exit berth and the biological characteristic information of the driver in the process of getting off the vehicle are trained by a deep learning method based on a convolutional neural network, so that a corresponding vehicle information model and a driver biological characteristic model are obtained.
As a further improvement of the present invention, after the man-vehicle linkage database is established according to the vehicle information model and the driver biological feature model, the method further comprises: and according to the license plate number, associating the corresponding vehicle information model with the license plate number and the corresponding driver biological characteristic model, and establishing a vehicle record.
As a further improvement of the invention, a vehicle record is established according to the license plate number, the corresponding vehicle information model and the corresponding driver biological feature model:
if one license plate number corresponds to a plurality of vehicle brand information, vehicle type information and corresponding driver facial features and gait feature information, a plurality of vehicle information models and biological feature models are associated by taking the license plate number as a main key respectively, and a plurality of vehicle records are formed.
As a further improvement of the present invention, the high-order video image is received and processed in real time, and the integration of the man-vehicle linkage database according to the real-time processing result includes,
the high-level video information of the vehicles driving in/out of the berth is obtained in real time,
marking the in/out berth image, obtaining the corresponding license plate number of the vehicle and the biological characteristic information of the driver,
and respectively comparing the license plate number, the biological characteristic information of the driver and the data in the man-vehicle linkage database to obtain a comparison result.
As a further improvement of the invention, if only the license plate number of the vehicle which enters/exits the berth exists in the man-vehicle linkage database,
the driver biological characteristic information corresponding to the vehicle is fed into the driver biological characteristic model corresponding to the vehicle which enters/exits the berth in the human-vehicle linkage database.
As a further improvement of the invention, if no license plate number of the vehicle which enters/exits the berth and no biological characteristic information of the driver in the process of getting off the vehicle exist in the man-vehicle linkage database, a record containing the vehicle information model and the driver biological characteristic model in the vehicle record is newly added in the man-vehicle linkage database by taking the license plate number as a main key.
As a further improvement of the invention, the integrated man-vehicle linkage database information is searched according to the instruction, the specific steps of outputting the search result comprise,
a search instruction is input based on the search information,
and confirming whether the search information is matched with one or more items in the man-vehicle linkage database information one by one according to the search instruction, and outputting a search result.
As a further improvement of the present invention,
confirming whether the search information is matched with one or more items in the man-vehicle linkage database information one by one according to the search instruction, and outputting the search result comprises the following steps:
and inputting face information and/or gait information, searching whether the information exists in the human-vehicle linkage database, and outputting license plate numbers and vehicle information corresponding to the face information and/or the gait information if the information exists.
As a further improvement of the present invention, determining whether the search information matches one or more items of the man-vehicle linkage database information one by one according to the search instruction, and outputting the search result further includes:
And inputting license plate numbers and/or vehicle information, searching whether the information exists in the man-vehicle linkage database, and outputting face information corresponding to the license plate numbers and the vehicle information if the information exists.
An application system of a road side parking high-level video in auxiliary criminal investigation comprises image acquisition equipment, a processor and a retrieval terminal, wherein the image acquisition equipment, the processor and the retrieval terminal are in communication connection;
the image acquisition equipment is used for acquiring the action information of the vehicle entering/exiting the berth at the road side and acquiring the high-order video image of the berth according to the action information,
the processor is used for receiving the high-order video image, acquiring the characteristic pictures of the vehicles entering/exiting the berth and the characteristic pictures of the vehicle driver in the process of getting off/getting on,
the processor is further configured to correlate the characteristic information of the in/out berth vehicle with the characteristic information of the driver's off/on course, confirm the person-vehicle correlated event information,
the processor is also used for processing the information of the related events of the vehicles and integrating the vehicle and people linkage database according to the real-time processing result,
the retrieval terminal is used for retrieving the integrated man-vehicle linkage database information according to the instruction and outputting a retrieval result.
As a further improvement of the invention, the processor is also used for acquiring the time and place information of the vehicle entering according to the feature information of the vehicle entering.
As a further improvement of the invention, the processor is also used for acquiring the characteristic information of the driver in the process of getting off the vehicle in the set time threshold and correlating the characteristic information of the vehicle, the time and place information of the vehicle into the position with the characteristic information of the driver.
The invention further comprises front-end equipment, wherein the front-end equipment is also used for detecting whether a vehicle enters the berth or not, and if the vehicle enters the berth, the front-end equipment is used for acquiring action information of the vehicle driving into/out of the road side berth.
As a further improvement of the present invention, the image acquisition apparatus includes an acquisition module and a vehicle identification module;
the acquisition module is used for acquiring special display pictures in the vehicle entering process every several seconds;
the vehicle identification module is used for identifying special display pictures in the process of driving the vehicle into the berth and confirming the time of driving the vehicle into the berth;
the acquisition module is also used for continuously acquiring a plurality of frames of image information after confirming the berth of the vehicle and acquiring a high-order video image of the vehicle in the berth.
As a further improvement of the invention, the acquisition module is also used for continuously acquiring the state information of the suspected driver of the passing vehicle,
The processor as a further improvement of the invention comprises an identification module, a correlation module, a labeling module, a training module and an integration module;
when the collected suspected driver contacts with the vehicle and the vehicle is pressed out of the berth within a set time threshold, the suspected driver is confirmed to be the driver driving the vehicle,
the vehicle identification module is used for determining time and place information of the vehicle driving out of the berth and identifying vehicle information;
the association module is used for associating the time location information of the vehicle driving out of/driving in to the berth with the biological characteristic information of the driver in the process of getting on/off the vehicle to obtain the information of the person-vehicle association event;
the marking module is used for marking a plurality of pictures of entering/exiting berths and pictures containing biological characteristic information of the driver in the process of entering/exiting, and increasing license plate numbers, vehicle brand information, faces of the driver and gait characteristic marks of the driver;
the training module is used for deeply training a plurality of pictures with marks;
the integration module is used for building a vehicle information model according to the brand information of the vehicle and building a driver biological characteristic model according to the facial characteristics and the gait characteristics of the driver.
As a further improvement of the invention, if the same license plate number has a plurality of vehicle information models and/or a plurality of driver biological feature models, the integration module is further used for respectively adding the plurality of vehicle information models and/or the plurality of driver biological feature models to the man-vehicle linkage database by taking the license plate number as a main key.
As a further improvement of the invention, the training module is further used for training a plurality of pictures containing the in-and-out berth pictures and the biological characteristic information of the driver in the process of getting off the vehicle by using a deep learning method based on a convolutional neural network to acquire a corresponding vehicle information model and a driver biological characteristic model.
As a further improvement of the present invention, the integration module is further configured to associate vehicle brand information, vehicle type information, and corresponding driver facial feature and gait feature information corresponding to the license plate number according to the license plate number, and establish a vehicle record.
As a further improvement of the present invention, if one license plate number corresponds to a plurality of pieces of vehicle brand information, vehicle type information, and corresponding pieces of facial features and gait feature information of the driver, the integration module is further configured to associate a plurality of pieces of vehicle information models and biometric feature models with the license plate number as a primary key, respectively, to form a plurality of pieces of vehicle records.
As a further improvement of the invention, the processor also comprises a comparison module, wherein the comparison module is used for respectively comparing the license plate number acquired in real time, the biological characteristic information of the driver and the data in the man-car linkage database to acquire a comparison result.
As a further improvement of the invention, if only the license plate number of the vehicle which enters/exits the berth is in the man-vehicle linkage database, the integration module is also used for supplementing the biological characteristic information of the driver corresponding to the vehicle into the biological characteristic model of the driver corresponding to the vehicle which enters/exits the berth in the man-vehicle linkage database.
As a further improvement of the invention, if no license plate number of the vehicle which enters/exits the berth and no biological characteristic information of the driver in the process of getting off the vehicle exist in the man-vehicle linkage database, the integration module is further used for adding a record containing the vehicle information model and the driver biological characteristic model in the vehicle record in the man-vehicle linkage database by taking the license plate number as a main key.
As a further improvement of the present invention, the search terminal includes an input module and a search module; the input module is used for inputting a search instruction according to the search information;
and the retrieval module is used for confirming whether the retrieval information is matched with one or more items in the man-vehicle linkage database information one by one according to the retrieval instruction, and outputting a retrieval result.
As a further improvement of the invention, the search terminal further comprises an output module;
when the face information and/or the gait information are input, the information in the man-vehicle linkage database is searched, and the output module is also used for outputting license plate numbers and vehicle information corresponding to the face information and/or the gait information.
As a further improvement of the invention, when the license plate number and/or the vehicle information is input, the information is searched to be stored in the man-vehicle linkage database, and the output module is further used for outputting the face information corresponding to the license plate number and the vehicle information.
As a further improvement of the invention, the system further comprises a man-vehicle linkage database for storing a plurality of vehicle records.
By adopting the application system and the method for assisting criminal investigation of the road side parking high-level video, provided by the invention, the man-vehicle linkage database created based on the urban road side parking management system high-level video and training can store all license plate information, vehicle characteristic information and driver information of the entering/exiting road side parking in a standardized and efficient manner, so that the application system and the method are used for assisting investigation work. When the system is used, certain input conditions can be accurately and efficiently searched according to the data in the database, so that identity information and characteristic information of suspicious personnel and suspicious vehicles can be quickly searched, and great help is provided for improving case handling efficiency.
Drawings
FIG. 1 is a schematic flow chart of an application method of a road side parking high-level video in assisting criminal investigation;
FIG. 2 is a schematic flow chart of a method for applying a road side parking high-level video to assisting criminal investigation;
FIG. 3 is a schematic diagram of an application system for assisting criminal investigation of a roadside parking high-level video according to the present invention;
FIG. 4 is a schematic diagram of a road side parking high-level video in the method of assisting criminal investigation application in establishing a man-vehicle linkage database;
fig. 5 is an application scenario diagram of an application method of a road side parking high-level video in assisting criminal investigation.
Detailed Description
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Aiming at the problem of few conventional criminal investigation auxiliary means, in order to enrich the criminal investigation auxiliary technology, the invention improves and utilizes the conventional intelligent equipment such as the roadside parking high-level video and the like, and can be an important auxiliary means for criminal investigation without inputting too much funds and manpower, and the criminal investigation auxiliary means are used for evidence obtaining, investigation, searching and the like.
S1, acquiring action information of a vehicle entering/exiting a berth on a road side, and acquiring a high-level video image of the berth according to the action information, wherein the specific berth action generally comprises the moment that the vehicle enters the berth when pressing lines or the moment that the vehicle has a trend of entering the berth, and the possible entrance of the vehicle can be judged at the moment; the event which is about to happen at the berth can be recorded through the high-order video system according to the action information.
The method comprises the steps of acquiring action information of a vehicle driving into a road side berth, and acquiring a high-level video image of the berth according to the action information of the vehicle driving into the berth;
detecting whether the vehicle is driven into the berth by pressing the line, and if the vehicle is driven into the berth, acquiring the action information of the berth at the side of the vehicle driving into the road. The specific detection mode is as follows: the method can be determined by geomagnetic sensing equipment and infrared sensing equipment or collecting high-level videos which are about to enter a parking space, when a vehicle is about to enter the parking space, the geomagnetic sensing equipment or the infrared sensing equipment arranged at the entrance of a parking lot or buried underground of the entrance of the parking lot senses that the vehicle passes, signals can be transmitted to the high-level video equipment, the high-level video can be collected by the high-level equipment, and when the vehicle is about to enter the parking space, the vehicle runs at a low speed, so that clear vehicle videos can be conveniently obtained;
specifically, when the vehicle runs to the monitoring area (generally refers to an area near a parking lot entrance or a parking space), a section of video of the running process of the vehicle can be acquired at intervals, including the video when the vehicle approaches the parking space, and generally, when no vehicle enters a road side parking lot, at least one frame of image needs to be acquired every 5 seconds, so that the total amount of garbage data is kept; when the condition that the vehicle exits from the parking place is monitored, starting a time period before the vehicle exits from the parking place according to the driving occurrence time, and collecting until the vehicle exits from the parking place; when the condition that a vehicle is driven into a parking berth is automatically monitored, collecting the vehicle until a certain time period is reached from the time of driving into the parking berth; when the vehicle is monitored to be in, the acquisition frequency is increased to at least 6 frames/second, so that the pictures of the vehicle driving in/out of the berth and the pictures containing the characteristics of the face, gait and the like of the driver of the vehicle are captured, and later evidence collection is facilitated.
S2, receiving the high-level video image, and acquiring a characteristic picture of a vehicle which enters/exits from a berth and a characteristic picture of a driver of the vehicle in the process of getting off/on;
the vehicle is always in the middle of traveling before entering the berth, when the vehicle is driven into the berth and stopped, the characteristic information of the vehicle is acquired, not limited to the vehicle type information, license plate number, vehicle color and the like, and when the vehicle is stopped within a certain time threshold (generally 0-4 min), a driver can get off the vehicle, and at the moment, the acquired video at least comprises the vehicle characteristic information (not limited to the vehicle type information, license plate number, vehicle color and the like), the biological characteristic information of the driver and the characteristic information (including a driver getting off action picture) related to the vehicle driven by the driver;
before the vehicle leaves the berth, continuously collecting state information of a suspected driver who passes through the vehicle, when the collected suspected driver contacts the vehicle and the suspected driver has a boarding action, and within a set time threshold, confirming that the suspected driver is a driver driving the vehicle, determining time and place information of the vehicle which leaves the berth, wherein the collected information comprises biological characteristic information of the driver, characteristic information of the vehicle and characteristic information (including a boarding action picture of the driver) related to the vehicle driven by the driver.
S3, identifying the characteristic information of the vehicles entering/exiting the berth and the characteristic information of the driver in the process of getting off/on the vehicle, and confirming the information of the related events of the people and the vehicles; the person-vehicle related event information is the collected characteristic information of the vehicle, the biological characteristic information of the driver driving the vehicle and the event information summarized by the characteristic information related to the person-vehicle during the process of getting on and off the vehicle by the driver, so that the person and the vehicle are highly accurately related, and the summarized event information can be generally formed by taking the license plate number of the vehicle as a main key so as to ensure the accuracy of the person-vehicle related event.
S4, processing the information of the related events of the vehicles in real time, and integrating the vehicle-to-person linkage database according to the real-time processing result;
specifically, before processing the high-order video image collected in real time, a person-vehicle linkage database needs to be established, as shown in fig. 3, a schematic diagram of the person-vehicle database is established,
the specific establishment of the man-vehicle linkage database can be generally established by collecting video images before and after a vehicle enters and exits the berth for a plurality of times; obtaining a man-vehicle linkage database according to the obtained information;
however, in order to ensure the reliability of the data, the video information of the same vehicle entering/exiting the berth for a plurality of times can be collected in a region-by-region manner,
Obtaining video information of multiple entrance/exit of the same vehicle to a berth, obtaining a picture of the entrance/exit of the vehicle to the berth and a picture containing biological characteristic information of the driver in the process of getting off/on the vehicle,
training a plurality of pictures of the same vehicle for entering/exiting from the berth and pictures containing biological characteristic information of the driver in the process of getting off/on the vehicle to obtain a corresponding vehicle information model and a driver biological characteristic model;
and establishing a man-vehicle linkage database according to the vehicle information model and the driver biological characteristic model.
Specifically, the steps of acquiring the corresponding vehicle information model and the driver biometric model are as follows:
marking a plurality of in/out berth pictures and pictures containing biological characteristic information of the driver in the process of getting off/on, and adding license plate numbers, vehicle brand information, faces of the driver and gait characteristic marks of the driver; obtaining a plurality of pictures with various marks, and performing deep training on the plurality of pictures with the marks;
building a vehicle information model according to the vehicle brand information, the vehicle color, the license plate number and the like obtained through training, wherein the specific vehicle information model is not limited to the license plate number model, the vehicle brand model and the like;
a driver biological characteristic model is established according to the facial characteristics and the gait characteristics of the driver, and the biological characteristic model is not limited to the facial characteristic model and the gait characteristic model, and is mainly used as key characteristics of the driver for later evidence collection.
In particular, during implementation, the facial features of the driver and the gait features of the driver are very important features in the human-vehicle related event, and the human-vehicle related event can be confirmed after the vehicle information is required to be highly related to the facial features and the gait features of the driver, but when the facial features of the driver cannot be clearly acquired due to special weather reasons or poor night light, the gait features of the driver are very important features for perfecting the human-vehicle related event.
In the step, the deep learning method based on the convolutional neural network trains a plurality of pictures containing the pictures of the entrance/exit berth of the same vehicle and the biological characteristic information of the driver in the process of getting off the vehicle, and a corresponding vehicle information model and a driver biological characteristic model are obtained.
After the man-vehicle linkage database is established, the information of the man-vehicle linkage database needs to be updated irregularly, as the further improvement of the information of the man-vehicle linkage database, the information of the man-vehicle linkage database needs to be combed and updated according to license plate numbers,
the method comprises the following specific steps: and according to the license plate number, associating a vehicle brand model, a vehicle type information model corresponding to the license plate and a corresponding driver facial feature model and gait feature model, and establishing a vehicle record.
And if one license plate number corresponds to a plurality of vehicle brand information models, vehicle type information models, and corresponding driver facial feature models and gait feature models, respectively taking the license plate number as a main key, and associating the plurality of vehicle information models and the biological feature models to form a plurality of vehicle records.
When a plurality of vehicle brand models exist in one license plate number, the information needs to be marked, and a fake-licensed vehicle owner can be hit;
when a license plate number has a plurality of biological feature models, each biological feature can be marked respectively, for example, a driver 1, a driver 2 and the like are marked respectively, when a vehicle is stolen, a suspected person can be locked, for example, when the vehicle is found to be lost, the last driver can be locked, the target of the suspected person is determined, and the case can be conveniently tracked.
Further, in order to ensure that the linkage database of the passenger and the vehicle is up to date, the database needs to be perfected at random, and the information of the database needs to be updated as long as the vehicle is parked; specifically, receiving the high-order video image and performing real-time processing, and integrating the man-vehicle linkage database according to the real-time processing result specifically further comprises:
acquiring the image information of the entrance/exit of the vehicle to the berth in real time,
Marking the in/out berth image, obtaining the corresponding license plate number of the vehicle and the biological characteristic information of the driver,
and respectively comparing the license plate number, the biological characteristic information of the driver and the data in the man-vehicle linkage database to obtain a comparison result.
Confirming whether the man-vehicle linkage database needs to be updated according to the comparison result,
if only the license plate number of the vehicle which enters/exits the berth exists in the man-vehicle linkage database,
and acquiring a plurality of pictures containing the biological characteristic information of the driver corresponding to the vehicle, training to obtain a biological characteristic model of the driver, and supplementing the biological characteristic model into a human-vehicle linkage database.
If no license plate number of the vehicle entering/exiting the berth exists in the man-vehicle linkage database and the biological characteristic information of the driver in the process of getting off the vehicle,
and acquiring a plurality of high-level video pictures of the vehicle entering/exiting the berth, training to obtain a vehicle information model and a driver biological characteristic model, and adding a record containing the vehicle information model and the driver biological characteristic model in the vehicle record into the man-vehicle linkage database by taking the license plate number as a main key.
If all the data obtained in real time are stored in the man-vehicle linkage database, the record can be ignored and not updated.
Above-mentioned driver biological feature includes driver gait feature and driver facial feature, and vehicle information model includes motorcycle type information, license plate number and vehicle brand etc. in order to guarantee that the information of people car linkage database is the degree of accuracy is the highest, needs to pass through the update many times, ensures the high fit of car owner and vehicle information, and convenient auxiliary criminal investigation.
In another embodiment, if two vehicle information models are confirmed in criminal investigation, it is also possible that the vehicle owner changes the vehicle, if the vehicle owner confirms that the vehicle is changed, the original record under the license plate number in the man-vehicle linkage database is deleted, and the record of the vehicle after the change is newly added.
S5, retrieving the integrated man-vehicle linkage database information according to the instruction, and outputting a retrieval result;
the specific steps include that,
a search instruction is input based on the search information,
and confirming whether the search information is matched with one or more items in the man-vehicle linkage database information one by one according to the search instruction, and outputting a search result.
When police are in a investigation case, when facial features of a suspected person are acquired, vehicle information corresponding to the facial features can be matched according to the facial features, if a vehicle exists, the vehicle information is called, a place where the vehicle frequently moves is confirmed, and the track of the suspected person is confirmed according to the moving track of the vehicle; assisting police to transact a case.
When the facial features of the suspected person are not clearly acquired or are blocked, the clear facial features cannot be acquired, vehicle information corresponding to the facial features can be matched through gait features, if a vehicle exists, the vehicle information is called, the place where the vehicle frequently moves is confirmed, and the track of the suspected person is confirmed according to the moving track of the vehicle; meanwhile, fuzzy matching can be carried out on the fuzzy facial features and the facial feature models recorded by the license plate numbers, so that the identity of the suspected person can be further confirmed.
If the driver has a plurality of vehicles confirmed by facial features or gait features, vehicle information can be fetched one by one, and the tracks of the plurality of vehicles can be confirmed respectively to assist police in solving a case.
In a vehicle missing case, when only license plate information of a suspected person is obtained, the license plate can be matched to record corresponding information of a driver, if a plurality of drivers are recorded in the license plate, the vehicle owner can be eliminated through facial feature matching, other drivers driving the vehicle and corresponding driving tracks are further confirmed, and the vehicle owner is helped to find the vehicle.
In another criminal investigation case, a suspected person can abandon the vehicle to escape after crime, so that police can only acquire vehicle information, when assisting criminal investigation, information records are acquired by inputting license plates, vehicle type information is matched according to the license plates, if only one vehicle is in a vehicle information model matched with the license plates and the facial features of the driver are only one, the suspected person is the owner of the vehicle, the driver driving the vehicle is searched, the moving track of the vehicle and the driver is called, and the case is directly detected.
If the suspected person is not the owner of the vehicle, and the license plate number is matched with the vehicle information model in the human-vehicle linkage database, if different vehicle models are recorded by the same license plate number, one of the vehicle models is identified as a fake license plate vehicle, the corresponding driver is matched according to the different vehicle information models, and the case is detected.
If the man-vehicle linkage database is used for assisting criminal investigation, any morphological characteristics of the vehicle, including license plate numbers, vehicle type information, vehicle brands and the like; and the biological characteristics of the driver, including facial characteristics, gait characteristics and the like, can be used as key characteristics for assisting criminal investigation, and a criminal investigation clue chain can be completed by associating any two or more of the characteristics, so that a favorable guarantee is provided for criminal investigation.
As shown in fig. 4, the invention also discloses a system for executing the method, which comprises a front-end device 8, an image acquisition device 4, a processor 5, a retrieval terminal 7 and a man-vehicle linkage database 6;
the image acquisition device 8 acquires motion information of a vehicle entering/exiting a berth at a road side, acquires a high-level video image of the berth according to the motion information, and preferentially selects an array camera, wherein the array camera generally comprises a plurality of cameras with different focal lengths which are arranged in parallel, and the cameras respectively shoot images of a far end and a near end, so that not only can the images of the vehicle entering/exiting the berth be acquired, but also biological characteristics and gait characteristic images of a driver associated with the vehicle can be acquired, and the imaging device can be used as strong evidence in criminal investigation;
The image acquisition device 8 may also be a gun-ball linkage device, which is a linkage device comprising a gun-shaped camera and a spherical camera, which can accurately acquire images of vehicles entering and exiting from a berth, but is slightly deficient in acquisition of biological characteristics of a driver, but can remedy the deficiency through multiple algorithmic processes, the image acquisition device is mainly used for acquiring videos and images in various formats, the image acquisition device acquires images and then transmits the images to a processor through a wired or wireless network, the processor receives the high-level video images, acquires characteristic images of vehicles entering/exiting from the berth and characteristic images of the vehicles during the vehicle driver entering/exiting from the berth, and associates the characteristic information of the vehicles entering/exiting from the berth and the characteristic information of the vehicles during the driver entering/exiting from the berth, confirms the human-vehicle related event information,
and is also used for processing the information of the related events of the people and the vehicles, integrating the linkage database of the people and the vehicles according to the real-time processing result,
the specific processing process comprises marking of data, deep learning and the like, and the specific marking of license plate information, vehicle brand and model, driver face, driver gait and the like. The deep learning training is to train the video image samples of the vehicles and the drivers by a deep learning method based on a convolutional neural network to obtain a vehicle brand model, a face feature model of the drivers and a gait feature model.
The search terminal is used for searching the integrated man-vehicle linkage database information according to the instruction, outputting a search result, and is generally arranged at the criminal investigation search terminal and is in communication connection with the man-vehicle linkage database and used for retrieving the man-vehicle information in the man-vehicle linkage database according to the search instruction.
The system further comprises front-end equipment, the front-end equipment is further used for detecting whether a vehicle enters the berth or not, if the vehicle enters the berth, the action information of the vehicle entering/exiting the berth on the road side is obtained, the specific front-end equipment can be a single gun-type camera, a single ball-type camera, a plurality of ball-type cameras, a plurality of gun-type cameras or a parallel array camera (comprising a plurality of cameras, the cameras are arranged in a device shell), and the system is mainly used for judging whether the vehicle enters the berth or not, and can also assist in judgment through equipment such as a geomagnetic sensor, an infrared sensor and the like.
Specifically, the acquisition device comprises an acquisition module; the acquisition module is used for acquiring special display pictures in the vehicle entering process every several seconds; the acquisition module is also used for acquiring a biological characteristic information picture of the driver in the getting-off/getting-on process corresponding to the vehicle.
In the invention, the information such as the biological characteristic model of the driver, the vehicle information model and the like is used as the key information searched in criminal investigation cases.
In the invention, the processor comprises an identification module, a correlation module, a labeling module, a training module and an integration module;
when the collected suspected driver contacts with the vehicle and the vehicle is pressed out of the berth within a set time threshold, the suspected driver is confirmed to be the driver driving the vehicle,
the vehicle identification module is used for determining time and place information of the vehicle driving out of the berth and identifying vehicle information;
the association module is used for associating the time location information of the vehicle exiting from the berth with the biological characteristic information of the driver in the boarding process to obtain the information of the person-vehicle association event;
the marking module is used for marking a plurality of pictures of entering/exiting berths and pictures containing biological characteristic information of a driver in the process of getting off, and increasing license plate numbers, vehicle brand information, faces of the driver and gait characteristic marks of the driver;
the training module is used for training a plurality of sample pictures with marks;
the integration module is used for building a vehicle information model according to the brand information of the vehicle and building a driver biological characteristic model according to the facial characteristics and the gait characteristics of the driver.
If the same license plate number has a plurality of vehicle information models and/or a plurality of driver biological feature models, the integration module is further used for respectively adding the plurality of vehicle information models and/or the plurality of driver biological feature models to the man-vehicle linkage database by taking the license plate number as a main key.
The training module is also used for training a plurality of pictures containing the in-berth pictures and the biological characteristic information of the driver in the process of getting off the vehicle by using a deep learning method based on a convolutional neural network to acquire a corresponding vehicle information model and a driver biological characteristic model.
The integration module is also used for associating vehicle brand information and vehicle type information corresponding to the license plate number with corresponding driver facial features and gait feature information according to the license plate number, and establishing a vehicle record.
If one license plate number corresponds to a plurality of pieces of vehicle brand information, vehicle type information and corresponding pieces of facial features and gait feature information of a driver, the integration module is further used for associating a plurality of vehicle information models and biological feature models by using the license plate number as a main key respectively to form a plurality of vehicle records.
Further, the processor also comprises a comparison module, wherein the comparison module is used for respectively comparing the license plate number, the biological characteristic information of the driver and the data in the man-car linkage database which are acquired in real time to acquire a comparison result.
If the linkage database of the man and the vehicle only has the license plate number of the vehicle which enters/exits the berth, the integration module is also used for supplementing the biological characteristic information of the driver corresponding to the vehicle into the biological characteristic model of the driver corresponding to the vehicle which enters/exits the berth in the linkage database of the man and the vehicle.
If no license plate number of the vehicle which enters/exits the berth and no biological characteristic information of the driver in the process of getting off the vehicle exist in the man-vehicle linkage database, the integration module is further used for adding a record containing the vehicle information model and the driver biological characteristic model in the vehicle record in the man-vehicle linkage database by taking the license plate number as a main key.
The retrieval terminal comprises an input module and a retrieval module; the input module is used for inputting a search instruction according to the search information;
and the retrieval module is used for confirming whether the retrieval information is matched with one or more items in the man-vehicle linkage database information one by one according to the retrieval instruction, and outputting a retrieval result.
The retrieval terminal also comprises an output module;
when the face information and/or the gait information are input, the information in the man-vehicle linkage database is searched, and the output module is also used for outputting license plate numbers and vehicle information corresponding to the face information and/or the gait information.
When the license plate number and/or the vehicle information is input, the information existing in the man-vehicle linkage database is searched, and the output module is further used for outputting face information corresponding to the license plate number and the vehicle information.
The high-order video in the invention refers to: the method is characterized in that videos acquired by image acquisition equipment hung on a high position of a monitoring rod are adopted in the existing road side road occupation parking or closed parking lot parking.
It should be noted that, as those skilled in the art can appreciate, deep learning is one of machine learning, and machine learning is a necessary path for implementing artificial intelligence. The deep learning concept is derived from the research of an artificial neural network, and a multi-layer sensor with a plurality of hidden layers is a deep learning structure. Deep learning forms more abstract high-level representation attribute categories or features by combining low-level features to discover distributed feature representations of data. In the scheme, specific steps of labeling and training the samples by the deep learning method are not repeated.
The embodiment of the invention provides an application method of urban road side parking high-level video in auxiliary criminal investigation, which is only a preferred embodiment of the invention.
It should be understood that the specific order or hierarchy of steps in the processes disclosed are examples of exemplary approaches. Based on design preferences, it is understood that the specific order or hierarchy of steps in the processes may be rearranged without departing from the scope of the present disclosure. The accompanying method claims present elements of the various steps in a sample order, and are not meant to be limited to the specific order or hierarchy presented.
In the foregoing detailed description, various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments of the subject matter require more features than are expressly recited in each claim. Rather, as the following claims reflect, application lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate preferred embodiment of this application.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. As will be apparent to those skilled in the art; various modifications to these embodiments will be readily apparent, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description includes examples of one or more embodiments. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the aforementioned embodiments, but one of ordinary skill in the art may recognize that many further combinations and permutations of various embodiments are possible. Accordingly, the embodiments described herein are intended to embrace all such alterations, modifications and variations that fall within the scope of the appended claims. Furthermore, as used in the specification or claims, the term "comprising" is intended to be inclusive in a manner similar to the term "comprising," as interpreted when employed as a transitional word in a claim. Furthermore, any use of the term "or" in the specification of the claims is intended to mean "non-exclusive or".
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.

Claims (37)

1. An application method of urban road side parking high-level video in auxiliary criminal investigation is characterized by comprising the following steps:
acquiring action information of a vehicle entering/exiting a road side berth, acquiring a high-order video image of the berth according to the action information,
receiving the high-level video image, acquiring a characteristic picture of a vehicle entering/exiting a berth, and a characteristic picture of a vehicle driver in the process of getting off/on the vehicle,
identifying a characteristic picture of a vehicle which enters/exits from a berth, and identifying information of a person-vehicle related event by the characteristic picture of the vehicle driver in the process of getting off/getting on;
processing the information of the related events of the people and the vehicles in real time, integrating the linkage database of the people and the vehicles according to the real-time processing result,
and searching the integrated man-vehicle linkage database information according to the instruction, and outputting a search result.
2. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 1, wherein,
acquiring action information of a berth at the side of a vehicle entrance road, and acquiring a high-order video image of the berth according to the action information;
detecting whether the vehicle is driven into the berth by pressing the line, and if the vehicle is driven into the berth, acquiring the action information of the berth at the side of the vehicle driving into the road.
3. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 2, wherein,
the method further comprises the step of acquiring time and place information of the vehicle entering the berth according to the characteristic image of the vehicle entering the berth after acquiring the characteristic image of the vehicle entering the berth.
4. The application method of the urban roadside parking high-level video in auxiliary criminal investigation according to claim 3, which is characterized in that,
the method further comprises the steps of acquiring the characteristic information of a driver driving the vehicle in the process of getting off the vehicle within a set time threshold after acquiring the time and place of the vehicle, and associating the characteristic information of the vehicle, the time and place information of the vehicle in place with the characteristic information of the driver.
5. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 4, wherein,
acquiring action information of a berth at the exit side of a vehicle, and acquiring a high-order video image of the berth according to the action information;
continuously collecting state information of a suspected driver passing through the vehicle, when the collected suspected driver contacts with the vehicle and the vehicle is in line with the vehicle to leave the berth within a set time threshold,
and confirming that the suspected driver is the driver driving the vehicle, determining time and place information of the vehicle driving out of the berth, and associating the time and place information of the vehicle driving out of the berth with the characteristic information of the driver.
6. The application method of the urban roadside parking high-level video in auxiliary criminal investigation according to claim 5, which is characterized in that,
the method comprises the steps of acquiring action information of a vehicle entering/exiting a road side berth, and establishing a man-vehicle linkage database after acquiring a high-order video image of the berth according to the action information.
7. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 6, wherein,
the step of establishing the man-vehicle linkage database is as follows: obtaining high-level video information of the same vehicle entering/exiting the berth for a plurality of times, obtaining a picture of the vehicle entering/exiting the berth and a picture containing biological characteristic information of a driver in the process of getting off/on the vehicle,
training a plurality of pictures of the same vehicle for entering/exiting from the berth and pictures containing biological characteristic information of the driver in the process of getting off/on the vehicle to obtain a corresponding vehicle information model and a driver biological characteristic model;
and establishing a man-vehicle linkage database according to the vehicle information model and the driver biological characteristic model.
8. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 7, wherein,
the step of acquiring the corresponding vehicle information model and the driver biometric model is,
Marking a plurality of in/out berth pictures and pictures containing biological characteristic information of the driver in the process of getting off/on, and adding license plate numbers, vehicle brand information, faces of the driver and gait characteristic marks of the driver;
depth training a plurality of pictures with marks,
establishing a vehicle information model according to the vehicle brand information;
and establishing a driver biological characteristic model according to the facial characteristics and the gait characteristics of the driver.
9. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 8, wherein,
if the same license plate number has a plurality of vehicle information models and/or a plurality of driver biological feature models, the license plate number is used as a main key, and the vehicle information models and/or the driver biological feature models are respectively added into the man-vehicle linkage database.
10. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 8, wherein,
the method comprises the steps of training a plurality of pictures containing pictures of the entrance/exit berth of the same vehicle and biological characteristic information of a driver in the process of getting off the vehicle through a deep learning method based on a convolutional neural network, and acquiring a corresponding vehicle information model and a corresponding driver biological characteristic model.
11. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 10, wherein the application method is characterized in that:
after the man-vehicle linkage database is established according to the vehicle information model and the driver biological characteristic model, the method further comprises the following steps: and according to the license plate number, associating the corresponding vehicle information model with the license plate number and the corresponding driver biological characteristic model, and establishing a vehicle record.
12. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 11, wherein,
if one license plate number corresponds to a plurality of vehicle brand information, vehicle type information and corresponding driver facial features and gait feature information, a plurality of vehicle information models and biological feature models are associated by taking the license plate number as a main key respectively, and a plurality of vehicle records are formed.
13. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 12, wherein,
the step of processing the information of the related events of the people and the vehicles in real time and integrating the linkage database of the people and the vehicles according to the real-time processing result is as follows;
the high-level video information of the vehicles driving in/out of the berth is obtained in real time,
marking the in/out berth image, obtaining the corresponding license plate number of the vehicle and the biological characteristic information of the driver,
And respectively comparing the license plate number, the biological characteristic information of the driver and the data in the man-vehicle linkage database to obtain a comparison result.
14. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 13, wherein,
if only the license plate number of the vehicle which enters/exits the berth exists in the man-vehicle linkage database,
the driver biological characteristic information corresponding to the vehicle is fed into the driver biological characteristic model corresponding to the vehicle which enters/exits the berth in the human-vehicle linkage database.
15. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 14, wherein,
if no license plate number of the vehicle which enters/exits the berth and no biological characteristic information of the driver in the process of getting off/on the vehicle exist in the man-vehicle linkage database, the license plate number is used as a main key, and a record containing a vehicle information model and a driver biological characteristic model in the vehicle record is newly added in the man-vehicle linkage database.
16. The application method of the urban roadside parking high-level video in auxiliary criminal investigation according to any one of claims 1 to 15, characterized in that,
the specific steps of outputting the search result comprise the steps of searching the integrated man-vehicle linkage database information according to the instruction,
A search instruction is input based on the search information,
and confirming whether the search information is matched with one or more items in the man-vehicle linkage database information one by one according to the search instruction, and outputting a search result.
17. The application method of the urban roadside parking high-level video in auxiliary criminal investigation as claimed in claim 16, wherein,
confirming whether the search information is matched with one or more items in the man-vehicle linkage database information one by one according to the search instruction, and outputting the search result comprises the following steps:
and inputting face information and/or gait information, searching whether the information exists in the human-vehicle linkage database, and outputting license plate numbers and vehicle information corresponding to the face information and/or the gait information if the information exists.
18. The application method of the urban roadside parking high-level video in auxiliary criminal investigation according to claim 17,
confirming whether the search information is matched with one or more items in the man-vehicle linkage database information one by one according to the search instruction, and outputting the search result further comprises:
and inputting license plate numbers and/or vehicle information, searching whether the information exists in the man-vehicle linkage database, and outputting face information corresponding to the license plate numbers and the vehicle information if the information exists.
19. The application system of the road side parking high-level video in the auxiliary criminal investigation is characterized by comprising image acquisition equipment, a processor and a retrieval terminal, wherein the image acquisition equipment, the processor and the retrieval terminal are in communication connection;
the image acquisition equipment is used for acquiring the action information of the vehicle entering/exiting the berth at the road side and acquiring the high-order video image of the berth according to the action information,
the processor is used for receiving the high-order video image, acquiring the characteristic pictures of the vehicles entering/exiting the berth and the characteristic pictures of the vehicle driver in the process of getting off/getting on,
the processor is also used for identifying the characteristic pictures of the vehicles entering/exiting the berth and the characteristic pictures of the vehicle driver in the process of getting off/getting on, confirming the information of the related events of people and vehicles,
the processor is also used for processing the information of the man-vehicle related events in real time and integrating the man-vehicle linkage database according to the real-time processing result;
the retrieval terminal is used for retrieving the integrated man-vehicle linkage database information according to the instruction and outputting a retrieval result.
20. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 19, wherein,
The front-end equipment is also used for detecting whether the vehicle enters the berth or not, and if the vehicle enters the berth, the front-end equipment acquires the action information of the vehicle driving into/out of the roadside berth.
21. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 20, wherein the processor is further used for acquiring time and place information of the vehicle entering the vehicle according to the entering vehicle characteristic information.
22. The application system of the roadside parking high-level video in assisting criminal investigation according to claim 21, wherein the processor is further used for acquiring characteristic information of a driver driving the vehicle in a driving process within a set time threshold and associating the characteristic information of the vehicle, the time and place information of the vehicle in place with the characteristic information of the driver.
23. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 22, wherein,
the image acquisition equipment is also used for acquiring special display pictures of the entering vehicles every several seconds; and after confirming the berth of the vehicle, continuously acquiring a plurality of frames of image information, and acquiring a high-order video image of the vehicle in the berth.
24. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 23, wherein,
The acquisition device is also used for continuously acquiring the state information of the suspected driver of the passing vehicle.
25. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 24, wherein,
the processor comprises an identification module, a correlation module, a labeling module, a training module and an integration module;
when the collected suspected driver contacts with the vehicle and the vehicle is pressed out of the berth within a set time threshold, the suspected driver is confirmed to be the driver driving the vehicle,
the identification module is used for determining time and place information of the vehicle when the vehicle exits from the berth and identifying vehicle information;
the association module is used for associating the time location information of the vehicle driving out of/driving in to the berth with the biological characteristic information of the driver in the process of getting on/off the vehicle to obtain the information of the person-vehicle association event;
the marking module is used for marking a plurality of pictures of entering/exiting berths and pictures containing biological characteristic information of the driver in the process of entering/exiting, and increasing license plate numbers, vehicle brand information, faces of the driver and gait characteristic marks of the driver;
the training module is used for deeply training a plurality of pictures with marks;
the integration module is used for building a vehicle information model according to the brand information of the vehicle and building a driver biological characteristic model according to the facial characteristics and the gait characteristics of the driver.
26. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 25, wherein,
if the same license plate number has a plurality of vehicle information models and/or a plurality of driver biological feature models, the integration module is further used for respectively adding the plurality of vehicle information models and/or the plurality of driver biological feature models to the man-vehicle linkage database by taking the license plate number as a main key.
27. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 26, wherein,
the training module is also used for training a plurality of pictures containing the in-berth pictures and the biological characteristic information of the driver in the process of getting off the vehicle by using a deep learning method based on a convolutional neural network to acquire a corresponding vehicle information model and a driver biological characteristic model.
28. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 27, wherein,
the integration module is also used for associating vehicle brand information and vehicle type information corresponding to the license plate number with corresponding driver facial features and gait feature information according to the license plate number, and establishing a vehicle record.
29. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 28, wherein,
if one license plate number corresponds to a plurality of pieces of vehicle brand information, vehicle type information and corresponding pieces of facial features and gait feature information of a driver, the integration module is further used for associating a plurality of vehicle information models and biological feature models by using the license plate number as a main key respectively to form a plurality of vehicle records.
30. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 29, wherein,
the processor also comprises a comparison module, wherein the comparison module is used for respectively comparing the license plate number and the biological characteristic information of the driver obtained in real time with the data in the man-car linkage database to obtain a comparison result.
31. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 29, wherein,
if the linkage database of the man and the vehicle only has the license plate number of the vehicle which enters/exits the berth, the integration module is also used for supplementing the biological characteristic information of the driver corresponding to the vehicle into the biological characteristic model of the driver corresponding to the vehicle which enters/exits the berth in the linkage database of the man and the vehicle.
32. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 31, wherein,
if no license plate number of the vehicle which enters/exits the berth and no biological characteristic information of the driver in the process of getting off the vehicle exist in the man-vehicle linkage database, the integration module is further used for adding a record containing the vehicle information model and the driver biological characteristic model in the vehicle record in the man-vehicle linkage database by taking the license plate number as a main key.
33. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 19, wherein,
the retrieval terminal comprises an input module and a retrieval module; the input module is used for inputting a search instruction according to the search information;
and the retrieval module is used for confirming whether the retrieval information is matched with one or more items in the man-vehicle linkage database information one by one according to the retrieval instruction, and outputting a retrieval result.
34. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 33, wherein,
the retrieval terminal also comprises an output module;
when the face information and/or the gait information are input, the information in the man-vehicle linkage database is searched, and the output module is also used for outputting license plate numbers and vehicle information corresponding to the face information and/or the gait information.
35. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in claim 34, wherein,
when the license plate number and/or the vehicle information is input, the information existing in the man-vehicle linkage database is searched, and the output module is further used for outputting face information corresponding to the license plate number and the vehicle information.
36. The application system of the roadside parking high-level video in assisting criminal investigation as claimed in any one of claims 19 to 35, wherein the acquisition equipment comprises an array camera or a gun-ball linkage camera.
37. The application system of the roadside parking high level video in assisting criminal investigation as claimed in any one of claims 19 to 35, wherein the system further comprises a people-to-vehicles linkage database for storing a plurality of vehicle records.
CN201910984244.0A 2019-10-16 2019-10-16 Application method and system of urban road side parking high-level video in auxiliary criminal investigation Active CN111353369B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910984244.0A CN111353369B (en) 2019-10-16 2019-10-16 Application method and system of urban road side parking high-level video in auxiliary criminal investigation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910984244.0A CN111353369B (en) 2019-10-16 2019-10-16 Application method and system of urban road side parking high-level video in auxiliary criminal investigation

Publications (2)

Publication Number Publication Date
CN111353369A CN111353369A (en) 2020-06-30
CN111353369B true CN111353369B (en) 2023-11-10

Family

ID=71196949

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910984244.0A Active CN111353369B (en) 2019-10-16 2019-10-16 Application method and system of urban road side parking high-level video in auxiliary criminal investigation

Country Status (1)

Country Link
CN (1) CN111353369B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111862425B (en) * 2020-07-07 2022-05-13 深圳市凯达尔科技实业有限公司 Parking lot management system and method based on 3D visual dynamic monitoring
CN112766206B (en) * 2021-01-28 2024-05-28 深圳市捷顺科技实业股份有限公司 High-order video vehicle detection method and device, electronic equipment and storage medium
CN113205689B (en) * 2021-04-09 2022-09-20 超级视线科技有限公司 Multi-dimension-based roadside parking admission event judgment method and system
CN113205690B (en) * 2021-04-09 2022-09-20 超级视线科技有限公司 Roadside parking departure event judgment method and system based on multiple dimensions
CN113449624B (en) * 2021-06-22 2024-05-14 超级视线科技有限公司 Method and device for determining vehicle behavior based on pedestrian re-identification
CN114141053A (en) * 2021-12-07 2022-03-04 无锡加视诚智能科技有限公司 High-position gun and ball linkage device and using method
CN115147911A (en) * 2022-08-22 2022-10-04 山东海博科技信息系统股份有限公司 Smart city file information integration method, system and terminal

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102426786A (en) * 2011-11-15 2012-04-25 无锡港湾网络科技有限公司 Intelligent video analyzing system and method for automatically identifying fake plate vehicle
CN107133563A (en) * 2017-03-17 2017-09-05 深圳市能信安科技股份有限公司 A kind of video analytic system and method based on police field
CN107256394A (en) * 2017-06-09 2017-10-17 北京深瞐科技有限公司 Driver information and information of vehicles checking method, device and system
CN107633687A (en) * 2017-09-08 2018-01-26 绵阳西真科技有限公司 A kind of vehicle identification method and system for parking lot
CN107945521A (en) * 2017-11-20 2018-04-20 青岛比特信息技术有限公司 A kind of rifle ball linkage trackside is parked detecting system and method
CN108154708A (en) * 2018-01-19 2018-06-12 北京悦畅科技有限公司 Parking lot management method, server, video camera and terminal device
CN108288307A (en) * 2018-01-19 2018-07-17 北京悦畅科技有限公司 A kind of parking lot management method, server, video camera and terminal device
CN108427718A (en) * 2018-02-07 2018-08-21 江苏大学 A kind of vehicle traveling information temporal index and big data analysis method
CN108470381A (en) * 2018-03-08 2018-08-31 沈志强 Roadside Parking management method
CN108765976A (en) * 2018-06-21 2018-11-06 智慧互通科技有限公司 The parallel parking information of trackside manages system and method
CN108805008A (en) * 2018-04-19 2018-11-13 江苏理工学院 A kind of community's vehicle security system based on deep learning
CN109147068A (en) * 2018-09-12 2019-01-04 西安艾润物联网技术服务有限责任公司 Unlicensed vehicles management method, device and computer readable storage medium
CN109446921A (en) * 2018-10-08 2019-03-08 武汉爱迪科技股份有限公司 A kind of police service comprehensive monitoring method based on parking lot monitoring
CN109712255A (en) * 2019-02-27 2019-05-03 北京猎户智芯科技有限公司 A kind of Car park payment evidence-obtaining system and method based on dynamic picture synthesis
CN109815848A (en) * 2018-12-29 2019-05-28 深圳市天彦通信股份有限公司 Parking lot safety pre-warning system and method

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102426786A (en) * 2011-11-15 2012-04-25 无锡港湾网络科技有限公司 Intelligent video analyzing system and method for automatically identifying fake plate vehicle
CN107133563A (en) * 2017-03-17 2017-09-05 深圳市能信安科技股份有限公司 A kind of video analytic system and method based on police field
CN107256394A (en) * 2017-06-09 2017-10-17 北京深瞐科技有限公司 Driver information and information of vehicles checking method, device and system
CN107633687A (en) * 2017-09-08 2018-01-26 绵阳西真科技有限公司 A kind of vehicle identification method and system for parking lot
CN107945521A (en) * 2017-11-20 2018-04-20 青岛比特信息技术有限公司 A kind of rifle ball linkage trackside is parked detecting system and method
CN108288307A (en) * 2018-01-19 2018-07-17 北京悦畅科技有限公司 A kind of parking lot management method, server, video camera and terminal device
CN108154708A (en) * 2018-01-19 2018-06-12 北京悦畅科技有限公司 Parking lot management method, server, video camera and terminal device
CN108427718A (en) * 2018-02-07 2018-08-21 江苏大学 A kind of vehicle traveling information temporal index and big data analysis method
CN108470381A (en) * 2018-03-08 2018-08-31 沈志强 Roadside Parking management method
CN108805008A (en) * 2018-04-19 2018-11-13 江苏理工学院 A kind of community's vehicle security system based on deep learning
CN108765976A (en) * 2018-06-21 2018-11-06 智慧互通科技有限公司 The parallel parking information of trackside manages system and method
CN109147068A (en) * 2018-09-12 2019-01-04 西安艾润物联网技术服务有限责任公司 Unlicensed vehicles management method, device and computer readable storage medium
CN109446921A (en) * 2018-10-08 2019-03-08 武汉爱迪科技股份有限公司 A kind of police service comprehensive monitoring method based on parking lot monitoring
CN109815848A (en) * 2018-12-29 2019-05-28 深圳市天彦通信股份有限公司 Parking lot safety pre-warning system and method
CN109712255A (en) * 2019-02-27 2019-05-03 北京猎户智芯科技有限公司 A kind of Car park payment evidence-obtaining system and method based on dynamic picture synthesis

Also Published As

Publication number Publication date
CN111353369A (en) 2020-06-30

Similar Documents

Publication Publication Date Title
CN111353369B (en) Application method and system of urban road side parking high-level video in auxiliary criminal investigation
CN110008298B (en) Parking multidimensional information perception application system and method
CN105702048B (en) Highway front truck illegal road occupation identifying system based on automobile data recorder and method
US7786897B2 (en) High occupancy vehicle (HOV) lane enforcement
CN103824037B (en) Vehicle anti-tracking alarm device
CN108986472B (en) Method and device for monitoring vehicle turning round
CN105185123A (en) Fake plate vehicle recognition system and method
CN107067730B (en) Network appointment vehicle-man-vehicle inconsistency monitoring method based on bayonet equipment
CN104766479A (en) Automobile identity recognition method and device based on ultrahigh frequency radio frequency and video image dual-recognition matching
JP2006260483A (en) Face collation system and method
KR102181355B1 (en) Vehicle search system based artificial intelligence
CN105046966A (en) System and method for automatically detecting illegal parking behaviors in drop-off areas
CN111445703A (en) Intelligent parking lot system and method based on image recognition
CN107123270A (en) A kind of intelligent managing and control system in building site for slag-soil truck
CN105118305A (en) Vehicle management platform of outdoor parking lot exit
KR100970278B1 (en) An integrated system for parking guide and security
WO2016107302A1 (en) Method and system for inspecting moving vehicles
CN104346928A (en) Red light running vehicle monitoring and photo taking system
WO2014007762A1 (en) A method and system for automated monitoring of traffic
JP2007206785A (en) Vehicle tracking system, and image processing unit, central unit and onboard unit for use in the same, and vehicle tracking method
CN107180535A (en) The joyride behavior automatic identification equipment and method of a kind of automatic sound detection based on deep learning
JP2002344952A (en) License plate recognition device and method
CN110837753A (en) Collective and separate model for human-vehicle object identification and control and use method thereof
CN111950499A (en) Method for detecting vehicle-mounted personnel statistical information
CN112532928A (en) Bus-mounted system based on 5G and face recognition and use method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 075000 ten building, phase 1, airport economic and Technological Development Zone, Zhangjiakou, Hebei

Applicant after: Smart intercommunication Technology Co.,Ltd.

Address before: 075000 ten building, phase 1, airport economic and Technological Development Zone, Zhangjiakou, Hebei

Applicant before: INTELLIGENT INTER CONNECTION TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant