CN106682644A

CN106682644A - Double dynamic vehicle monitoring management system and method based on mobile vedio shooting device

Info

Publication number: CN106682644A
Application number: CN201710018129.9A
Authority: CN
Inventors: 史方; 隆刚; 王标
Original assignee: Tong Wei Technology (shenzhen) Co Ltd
Current assignee: Changxin Intelligent Control Network Technology Co ltd
Priority date: 2017-01-11
Filing date: 2017-01-11
Publication date: 2017-05-17
Anticipated expiration: 2037-01-11
Also published as: CN106682644B

Abstract

The embodiment of the invention discloses a double dynamic vehicle monitoring management system and method based on mobile vedio shooting devices. The system includes the mobile vedio shooting devices, an uploading management server, a storage management server, a central memory and a regional memory; the mobile vedio shooting devices are used for monitoring vehicle image information of a target vehicle; the uploading management server is in communication connection with the mobile vedio shooting devices and is used for controlling all the mobile vedio shooting devices to upload vehicle information respectively in the order from the high device priority to the low device priority when the number of the mobile vedio shooting devices which are used for uploading the vehicle information in the same monitoring region in the same time period is larger than or equal to the maximum uploading channel number in the monitoring region; the storage management server is in communication connection with the mobile vedio shooting devices respectively and is used for transmitting the vehicle information to the regional memory or the cross-regional central memory in the order from the high device priority to the low device priority respectively. According to the system and the method, network congestion can be reduced, and the access speed and quality of the vehicle information are improved.

Description

Dual-dynamic vehicle monitoring management system and method based on mobile camera equipment

Technical Field

The invention relates to the technical field of vehicle monitoring, in particular to a dual-dynamic vehicle monitoring management system and method based on mobile camera equipment.

Background

In order to guarantee traffic safety and prevent illegal crimes, image monitoring is generally required for vehicles in each road section or cell. In a general scene, a large number of fixed monitoring points are often arranged on each road section or cell to capture video images of each passing target vehicle. However, since most target vehicles are mobile, the coverage rate of the fixed monitoring points is insufficient, and the fixed monitoring points are not highly targeted, and it is difficult for the fixed monitoring points to perform all-around monitoring on the moving vehicles.

In order to make up for the above-mentioned deficiency of the fixed monitoring point, the prior art usually adopts the mobile camera equipment to dynamically take the image information of the vehicle, for example, the vehicle is monitored by video at multiple angles and for a long time through the "mobile electronic eye", which is a camera equipment installed on the mobile device such as the vehicle, etc., the image information of the target vehicle can be monitored at multiple angles and for a long time through the displacement of the mobile device and the rotation of the camera equipment; and with the progress of society, mobile image pickup apparatuses represented by "mobile electronic eyes" are widely distributed in a large number in each monitored area, thereby enabling all-around monitoring of a moving target vehicle. In summary, through the mobile camera devices widely distributed in each monitoring area, a large amount of acquired vehicle image information can be uploaded to the unified data storage device, so that monitoring personnel can call the vehicle image information from the data storage device, and effective monitoring of the vehicle is realized.

However, since the mobile camera devices are more and widely distributed, a large number of vehicle images can be uploaded in the same time period, which is likely to cause network congestion; and the vehicle image information is uploaded to the same data memory, and when a plurality of people access the memory, the problems of low access speed and poor access quality are easily caused.

Disclosure of Invention

The embodiment of the invention provides a double-dynamic vehicle monitoring management scheme based on a mobile camera device, which aims to solve the problems that the mobile camera device in the prior art uploads a large amount of vehicle image information, network congestion is easily caused, and the network server is easy to have slow access speed and poor access quality because the vehicle image information is stored in the same data memory.

In order to solve the technical problem, the embodiment of the invention discloses the following technical scheme:

according to a first aspect of the present invention, there is provided a dual dynamic vehicle monitoring management system based on a mobile camera device, comprising:

the system comprises a plurality of mobile camera devices, an uploading management server, a storage management server, a central memory and an area memory; wherein,

the mobile camera devices are used for monitoring vehicle image information of a target vehicle, wherein each mobile camera device in the mobile camera devices has a device priority;

the uploading management server is in communication connection with the mobile camera devices respectively and is used for determining a monitoring area where the mobile camera devices are located, and controlling each mobile camera device uploaded at the same time period to upload respective vehicle information to the storage management server respectively according to the sequence of device priority from high to low if the number of the mobile camera devices uploaded at the same time period in the same monitoring area is greater than or equal to the maximum uploading channel number of the monitoring area, wherein the vehicle information comprises the vehicle image information, the position information of the mobile camera devices and uploading time;

the storage management server is in communication connection with the mobile camera devices respectively and is used for forwarding the vehicle information uploaded by each mobile camera device to an area memory corresponding to the monitoring area or a cross-area central memory according to the priority level of the device, wherein the device priority level corresponding to the vehicle information in the central memory is higher than the device priority level corresponding to the vehicle information in the area memory.

Preferably, the vehicle image information includes a unique distinguishing feature corresponding to the target vehicle; the dual-dynamic vehicle monitoring and management system further comprises a retrieval server in communication connection with the central storage and the area storage, and the retrieval server specifically comprises:

the vehicle information calling device is in communication connection with the central memory and the area memory and is used for calling vehicle information of a suspected vehicle from the central memory or the area memory according to the unique distinguishing characteristics;

the current position determiner is electrically connected with the vehicle information transfer device and is used for determining the current position of the suspect vehicle according to the position information and the uploading time of the mobile camera equipment contained in the vehicle information;

the mobile camera equipment calling device is electrically connected with the current position determiner and is in communication connection with the mobile camera equipment, and is used for calling the mobile camera equipment in the preset distance of the current position to track and monitor the suspect vehicle in real time;

and/or the presence of a gas in the gas,

the image information calling device is electrically connected with the vehicle information calling device and used for calling the vehicle image information of the suspected vehicle from the central memory or the regional memory according to the uploading time of the mobile camera equipment contained in the vehicle information;

the image information display is electrically connected with the image information caller and is used for displaying the vehicle image information according to the sequence of the uploading time;

and/or the presence of a gas in the gas,

the moving track generator is electrically connected with the vehicle information transfer device and used for generating a moving track of the suspect vehicle according to the position information and the uploading time of the mobile camera equipment contained in the vehicle information;

and the moving track display is electrically connected with the moving track generator and is used for displaying the moving track of the suspected vehicle.

Preferably, the dual dynamic vehicle monitoring management system further comprises a multi-feature information extraction server electrically connected with the central memory and the area memory, respectively; the multi-feature information extraction server specifically includes:

a vehicle region detector communicatively connected to the central memory and the region memory, for detecting an image feature of a target vehicle in the vehicle image information using a machine learning algorithm, extracting a vehicle image region of the target vehicle from the vehicle image information based on the image feature;

the interested region detector is electrically connected with the vehicle region detector and used for detecting image information in the vehicle image region by using a sliding window in a sliding manner, selecting an interested region feature classifier to determine a vehicle structure corresponding to the image information and dividing the interested image region of the vehicle structure from the vehicle image region, wherein the interested region feature classifier is obtained by training from a preset training image set through a machine learning algorithm;

a region-of-interest analyzer electrically connected to the region-of-interest detector for analyzing feature information of the vehicle structure from the image region of interest using the region-of-interest feature classifier;

and the first storage controller is electrically connected with the region-of-interest analyzer and is used for storing the vehicle structure, the characteristic information of the vehicle structure and the corresponding relation between the characteristic information and the target vehicle into the central storage or the region storage.

Preferably, the vehicle information retriever in the search server is further configured to retrieve vehicle information of a suspected vehicle from the central storage or the area storage according to the vehicle structure and the feature information of the vehicle structure.

Preferably, the upload management server specifically includes:

the monitoring area determiner is used for determining a monitoring area where the mobile camera shooting equipment is located according to the position information of the mobile camera shooting equipment;

the channel number determiner is electrically connected with the monitoring area determiner and is used for determining the maximum uploading channel number of the monitoring area;

the first equipment quantity judger is electrically connected with the channel quantity determiner and is used for judging whether the quantity of the mobile camera equipment uploaded in the monitoring area at the same time period is greater than or equal to the maximum uploading channel quantity;

the first uploading controller is electrically connected with the first equipment quantity judger and is used for controlling each mobile camera equipment uploaded at the same time period and uploading respective vehicle information to the storage management server from high to low according to the equipment priority;

the second equipment quantity judger is used for judging whether the quantity of the mobile camera equipment with the same equipment priority is larger than or equal to the maximum uploading channel quantity or not;

and the second uploading controller is electrically connected with the second equipment quantity judger and used for controlling each mobile camera equipment with the same equipment priority and uploading respective vehicle information according to the sequence of the application uploading time from first to last.

Preferably, the upload management server specifically includes:

the suspected vehicle judger is used for judging whether the target vehicle is a suspected vehicle or not according to the unique distinguishing characteristics corresponding to the target vehicle and contained in the vehicle image information;

and the priority regulator is electrically connected with the suspect vehicle judger and used for heightening the equipment priority of the mobile camera equipment which monitors the suspect vehicle if the target vehicle is the suspect vehicle.

Preferably, the storage management server specifically includes:

the vehicle information receiver is used for receiving the vehicle information uploaded by each mobile camera device;

the priority judging device is electrically connected with the vehicle information receiver and used for respectively judging whether the equipment priority of each mobile camera equipment is higher than or equal to the preset division priority;

the second storage controller is electrically connected with the priority judging device and is used for storing the vehicle information into the central storage if the equipment priority of the mobile camera equipment is higher than or equal to the preset dividing priority;

and the second storage controller is further used for storing the vehicle information to an area memory of a monitoring area where the mobile camera device is located if the device priority of the mobile camera device is lower than the preset division priority.

According to a second aspect of the present invention, there is further provided a dual-dynamic vehicle monitoring and management method based on a mobile camera device, the method being used in the dual-dynamic vehicle monitoring and management system according to any one of the above technical solutions, the dual-dynamic vehicle monitoring and management method including:

controlling a plurality of mobile camera devices to monitor vehicle image information of a target vehicle, wherein each mobile camera device in the plurality of mobile camera devices has a device priority;

determining a monitoring area where the mobile camera devices are located, and controlling each mobile camera device uploaded at the same time interval to upload respective vehicle information respectively according to the sequence of the priority of the device from high to low when the number of the mobile camera devices uploaded at the same time interval in the same monitoring area is larger than or equal to the maximum uploading channel number of the monitoring area, wherein the vehicle information comprises vehicle image information, position information of the mobile camera devices and uploading time;

and respectively forwarding the vehicle information uploaded by each mobile camera device to an area memory corresponding to the monitoring area or a cross-area central memory according to the priority level of the device, wherein the device priority level corresponding to the vehicle information in the central memory is higher than the device priority level corresponding to the vehicle information in the area memory.

Preferably, the dual dynamic vehicle image information includes a unique distinguishing feature corresponding to the target vehicle; the dual dynamic vehicle monitoring management method further comprises:

calling vehicle information of a suspected vehicle from the central memory or the area memory according to the unique distinguishing features;

determining the current position of the suspect vehicle according to the position information and the uploading time of the mobile camera equipment contained in the vehicle information, and calling the mobile camera equipment within a preset distance of the current position to track and monitor the suspect vehicle in real time;

and/or the presence of a gas in the gas,

according to the uploading time of the mobile camera equipment contained in the vehicle information, vehicle image information of the suspect vehicle is called from the central memory or the regional memory, and the vehicle image information is displayed according to the sequence of the uploading time;

and/or the presence of a gas in the gas,

and generating and displaying the movement track of the suspect vehicle according to the position information and the uploading time of the mobile camera equipment contained in the vehicle information.

Preferably, the dual dynamic vehicle monitoring management method further includes:

detecting image characteristics about a target vehicle in the vehicle image information by using a machine learning algorithm, and extracting a vehicle image area of the target vehicle from the vehicle image information according to the image characteristics;

detecting image information in the vehicle image area by using sliding of a sliding window, selecting an interested area feature classifier to determine a vehicle structure corresponding to the image information, and segmenting an interested image area of the vehicle structure from the vehicle image area, wherein the interested area feature classifier is obtained by training in a preset training image set through a machine learning algorithm;

analyzing feature information of the vehicle structure from the interested image region by using an interested region feature classifier;

and storing the vehicle structure, the characteristic information of the vehicle structure and the corresponding relation between the characteristic information and the target vehicle into the central memory or the area memory.

Preferably, the determining a monitoring area where the mobile camera is located, and when the number of the mobile camera uploaded in the same monitoring area at the same time period is greater than or equal to the maximum number of the uploading channels of the monitoring area, controlling each mobile camera uploaded in the same time period to upload respective vehicle information according to the order of the priority of the equipment from high to low includes:

determining a monitoring area where the mobile camera device is located according to the position information of the mobile camera device;

determining the maximum uploading channel number of the monitoring area;

judging whether the number of the mobile camera devices uploaded in the same time period in the monitoring area is greater than or equal to the maximum uploading channel number;

if yes, controlling each mobile camera device uploaded at the same time period, and uploading respective vehicle information to the storage management server from high to low according to the priority sequence of the devices;

judging whether the number of the mobile camera devices with the same device priority is greater than or equal to the maximum uploading channel number or not;

if yes, controlling each mobile camera device with the same device priority and uploading respective vehicle information according to the order of application uploading time from first to last.

judging whether the target vehicle is a suspected vehicle or not according to the unique distinguishing characteristics corresponding to the target vehicle, which are included in the vehicle image information;

and if the target vehicle is a suspected vehicle, increasing the equipment priority of the mobile camera equipment which monitors the suspected vehicle.

Preferably, the step of forwarding the vehicle information uploaded by each mobile camera device to an area memory corresponding to the monitored area or a cross-area central memory according to the device priority level includes:

receiving vehicle information uploaded by each mobile camera device;

respectively judging whether the equipment priority of each mobile camera equipment is higher than or equal to a preset division priority;

if the equipment priority of the mobile camera equipment is higher than or equal to the preset division priority, the vehicle information is stored in the central memory;

and if the equipment priority of the mobile camera equipment is lower than the preset division priority, storing the vehicle information into an area memory of a monitoring area where the mobile camera equipment is located.

According to the technical scheme, the double-dynamic vehicle monitoring management scheme based on the mobile camera equipment divides the monitoring range into one or more monitoring areas, and controls each mobile camera equipment to respectively upload vehicle information according to the priority of the equipment from high to low when the uploading management server determines that the number of the mobile camera equipment uploaded in the same monitoring area at the same time period is greater than or equal to the maximum uploading channel number of the monitoring area, so that the phenomenon of network congestion caused by the fact that a large number of equipment in the system which are not divided into areas are simultaneously uploaded to the same memory is avoided; and the storage management server respectively stores the vehicle information to a central memory or a regional memory of a monitored region according to the priority level of the equipment, so that a large amount of monitored information is stored in a regional mode, the bandwidth of a core network can be saved, and the problems of low network access speed and poor access quality caused by the fact that a plurality of people access the same memory are solved. Meanwhile, the mobile camera equipment with lower equipment priority uploads the vehicle information to the regional memory of the monitored region nearby, and the uploading speed is high; the mobile camera device with higher device priority stores the vehicle information to the cross-regional central memory, so that the query speed of the cross-regional vehicle information can be improved.

Drawings

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.

FIG. 1 is a schematic diagram of a dual dynamic vehicle monitoring and management system according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of a search server according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of a multi-feature information extraction server according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a first upload management server provided in the embodiment shown in fig. 1;

fig. 5 is a schematic structural diagram of a second upload management server provided in the embodiment shown in fig. 1;

FIG. 6 is a schematic structural diagram of a storage management server according to the embodiment shown in FIG. 1;

FIG. 7 is a schematic flow chart illustrating a first dual dynamic vehicle monitoring and management method according to an embodiment of the present invention;

FIG. 8 is a schematic flow chart illustrating a second dual dynamic vehicle monitoring and management method according to an embodiment of the present invention;

FIG. 9 is a schematic flow chart illustrating a vehicle information uploading method according to the embodiment shown in FIG. 7;

fig. 10 is a schematic flowchart of a vehicle information storage method according to the embodiment shown in fig. 7.

Detailed Description

In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1, fig. 1 is a schematic diagram of an architecture of a dual dynamic vehicle monitoring and management system according to an embodiment of the present invention, the dual dynamic vehicle monitoring and management system according to an embodiment of the present invention is based on a mobile camera device, and a managed area range can be divided into one or more monitoring areas, as shown in fig. 1, the dual dynamic vehicle monitoring and management system according to an embodiment of the present invention includes:

a plurality of mobile image capturing apparatuses 100, an upload management server 200, a storage management server 300, a center memory 400, and an area memory 500; wherein,

the plurality of mobile camera apparatuses 100 are used to monitor vehicle image information of a target vehicle.

Each of the plurality of mobile photographing apparatuses 100 can move and rotate by an angle, thereby enabling to monitor vehicle image information of a target vehicle from a plurality of angles and in a wide range; and since the mobile camera apparatus 100 can move to track the target vehicle, the mobile camera apparatus 100 can move to a different monitoring area to monitor the vehicle image information of the target vehicle across areas; since the mobile camera device 100 can span the area, the mobile camera device 100 needs to upload the position information of the mobile camera device while acquiring the vehicle image information of the target vehicle, so as to conveniently determine the position of the mobile camera device 100 and the position of the target vehicle. In the application environment of the embodiment of the present invention, the mobile camera device 100 and the target vehicle to be monitored are both in a dynamic moving process, and therefore, the process is a "dual-dynamic" process.

Among them, the mobile image capturing apparatus 100 mainly includes an image capturing apparatus such as "mobile electronic eye" mounted on a vehicle, such as: the device comprises a gun type camera or a special camera and the like, which are arranged on police patrol vehicles, urban management law enforcement vehicle industry management departments, service vehicles, public vehicles such as buses or private cars and the like. In a typical application scenario, the "mobile electronic eye" moves along with the vehicle, and the "mobile electronic eye" captures image information of the target vehicle during the movement of the vehicle, wherein the image information includes information such as video. For example:

the method comprises the steps that video information is collected in real time by moving a camera device on a patrol border or an event site, and specifically, the video information on the patrol road border or the event processing site is monitored in real time through a special camera arranged in a car or on the roof of the car; or

Recording images in a patrol process or an accident handling process, specifically, performing local storage and local browsing on video records in a patrol process of a service vehicle or an accident/transaction handling process at an event place through a special camera arranged in the vehicle or on the roof of the vehicle, and uploading the video records to a background memory through a 4G wireless channel; or,

moving fixed-point snapshot: specifically, the vehicle moves to a preset place or a temporary event place, and the target vehicle is subjected to image capture through a gun type camera on the roof according to the use requirement and uploaded to a background memory.

In addition, since the types of the mobile camera apparatuses 100 are different, including a gun camera or a dedicated camera installed in a social vehicle such as a police patrol vehicle, an emergency treatment vehicle, a city management enforcement vehicle, an industrial management department service vehicle, a bus or a private car, the importance levels of the mobile camera apparatuses are different, and accordingly, each of the mobile camera apparatuses 100 has a device priority. In addition, the device priority can be divided into an upload priority and a storage priority. In the uploading process, the uploading priority is used for managing the uploading of the vehicle information; in the storing process, the storage of the vehicle information is managed by the storage priority. Wherein the values of the upload priority and the storage priority may be the same.

In addition, the mobile camera device 100 in each embodiment of the present invention is integrated with a low code stream vehicle feature recognition virtual server LVS to implement the following functions: analyzing and identifying unique distinguishing characteristics of the target vehicle according to the monitored vehicle image information; and performing code stream compression on the vehicle image information, for example, performing H.264SVC video code stream compression on the vehicle image information in a video form, and uploading the compressed information to the vehicle image information through a wireless network transmission technology. In addition, a positioning module (such as a GPS or beidou positioning module) is integrated in the LVS to position the mobile camera device 100 itself and the monitored target vehicle.

Since the capacity of the base station in each monitoring area is limited, the number of corresponding uploading channels is limited in the same time period, and the number of the mobile camera devices 100 that need to upload vehicle information in one monitoring area may be too large in the same time period, which may easily cause network congestion if the number of uploading channels exceeds the limit.

In order to avoid the foregoing situation, the upload management server 200 is in communication connection with the plurality of mobile camera devices 100, and is configured to determine a monitoring area where the mobile camera device 100 is located, and control each mobile camera device 100 uploaded at the same time period to upload respective vehicle information according to the order of device priority from high to low, if the number of the mobile camera devices 100 uploaded at the same time period in the same monitoring area is greater than or equal to the maximum upload channel number of the monitoring area, where the vehicle information includes vehicle image information, position information of the mobile camera device, and upload time information. Specifically, the mobile image capturing apparatus 100 uploads the apparatus priority in the vehicle information in order of the apparatus priority from high to low as the upload priority described above.

Since the mobile camera devices 100 have device priorities, which reflect the importance of the mobile camera devices 100, when the number of the mobile camera devices 100 uploading vehicle information in the same monitoring area at the same time interval is greater than or equal to the maximum uploading channel number of the monitoring area, by controlling the mobile camera devices 100 to upload information in sequence from high to low according to the device priorities, the number of the mobile camera devices 100 needing to be uploaded in the same time interval can be reduced, and network congestion caused by uploading a large number of mobile camera devices 100 in the same area at the same time is avoided. Among them, the upload management server 200 is capable of monitoring position information of the mobile image pickup apparatus 100, by which a monitoring area in which the mobile image pickup apparatus 100 is located is determined.

In addition, if the number of the mobile image capturing apparatuses 100 uploaded at the same time period is smaller than the maximum upload number of the monitoring area, the upload management server 200 does not process the upload of each mobile image capturing apparatus 100.

In the background art, the vehicle image information is uploaded to the same data storage, which easily causes the problems of low network access speed and poor access quality.

In order to solve the above problem, in the dual-dynamic vehicle monitoring and management system provided in this embodiment, the storage management server 300 is in communication connection with the plurality of mobile camera devices 100, and is configured to forward the vehicle information uploaded by each mobile camera device 100 to the area memory 500 corresponding to the monitored area or the cross-area central memory 400 according to the device priority level, where the device priority level corresponding to the vehicle information in the central memory 400 is higher than the device priority level corresponding to the vehicle information in the area memory 500. The vehicle information comprises vehicle image information, position information of the mobile camera equipment and uploading time.

The storage management server 300 stores the vehicle information sent by each mobile camera device 100 to the central storage 400 or the regional storage 500 in the monitoring region according to the device priority level, so that a large amount of monitoring information is stored in regions, the load of the central storage 400 can be reduced, the bandwidth of a core network is saved, and the problems of low network access speed and poor access quality caused by the fact that multiple people access the same data storage are solved. Specifically, the storage management server 300 uses the storage priority among the device priorities when forwarding the vehicle information according to the device priorities.

To sum up, the dual-dynamic vehicle monitoring and management system based on the mobile camera devices provided in the embodiment of the present invention divides the monitoring range of the system into one or more monitoring areas, and controls each mobile camera device 100 to upload vehicle information in the order from high to low according to the device priority when it is determined that the number of the mobile camera devices 100 uploaded at the same time period in the same monitoring area is greater than or equal to the maximum number of upload channels of the monitoring area through the upload management server 200, so as to avoid a network congestion phenomenon caused by uploading a large number of devices in non-divided areas to the same data storage at the same time in the system; and the storage management server 300 stores the vehicle information into the central storage 400 or the regional storage 500 of the monitoring region according to the priority level of the device, so as to store a large amount of monitoring information in regions, thereby reducing the burden of the central storage 400, saving the bandwidth of the core network, and avoiding the problems of low network access speed and poor access quality caused by that a plurality of people access the same data storage. Meanwhile, the mobile camera device 100 with lower device priority uploads the vehicle information to the area memory 500 of the monitored area nearby, and the uploading speed is high; the mobile imaging apparatus 100 having a higher apparatus priority stores the vehicle information in the center memory 400 across the area, and the retrieval speed of the vehicle information across the area can be increased.

In addition, the vehicle image information includes a unique distinguishing feature corresponding to the target vehicle, and the unique distinguishing feature is a feature that the target vehicle is distinguished from other vehicles, such as a license plate and the like. The dual-dynamic vehicle monitoring management system provided by the embodiment of the invention can store the vehicle information into the central memory 400 or the area memories 500 corresponding to the monitoring areas, and then can build indexes for the vehicle information in the memories according to the unique distinguishing characteristics, so that the retrieval of related users is facilitated. For example: and according to the license plate characteristics, establishing indexes of the vehicle information according to different monitoring areas, different uploading time periods and different vehicle type sources, and storing the vehicle information according to the index contents.

To enable indexing of the vehicle information in the central memory 400 and the area memory 500, the embodiment shown in fig. 1 provides a dual dynamic vehicle monitoring management system further comprising a retrieval server 600 communicatively coupled to the central memory 400 and the area memory 500. As shown in fig. 2, the search server 600 specifically includes:

the vehicle information retriever 601 is used for retrieving vehicle information of a suspected vehicle from the central memory or the regional memory according to the unique distinguishing characteristics;

since the unique distinguishing feature is a distinguishing feature that the target vehicle is distinguished from other vehicles, when the suspected vehicle is viewed, the vehicle information of the suspected vehicle can be retrieved from the memory by the unique distinguishing feature.

The mobile camera equipment can rotate and is different in distribution position, so that the mobile camera equipment can be controlled to monitor the vehicle image information of the suspected vehicle in a multi-angle, multi-dimensional and directional fixed-point mode through the unique distinguishing characteristics, and further the vehicle information in the central storage and the regional storage can be searched according to the specified time and the specified position during searching.

And a current position determiner 602 electrically connected to the vehicle information retriever 601, configured to determine a current position of the suspected vehicle according to the position information of the mobile image capturing apparatus and the uploading time included in the vehicle information.

In practical applications, a suspected vehicle monitored by the mobile camera device is usually within an early warning distance of the mobile camera device. Moreover, the mobile camera equipment can track and shoot images of the suspected vehicle, or a large number of distributed mobile camera equipment are used for calling the cameras of the mobile camera equipment to shoot images of the suspected vehicle, so that the suspected vehicle can be continuously monitored; therefore, according to the position information and the uploading time of the mobile camera included in the vehicle information, the current position of the suspect vehicle can be determined by using the uploading time as the last position information of the mobile camera.

The mobile camera equipment caller 603 is electrically connected with the current position determiner 602 and is used for calling mobile camera equipment in a preset distance of the current position to track and monitor the suspect vehicle in real time;

after the current position of the suspect vehicle is determined, the mobile camera device closest to the suspect vehicle can be determined through the position information of each mobile camera device, the suspect vehicle can be continuously monitored by continuously calling the mobile camera device to track and monitor the suspect vehicle in real time, the danger caused by the suspect vehicle needing to be tracked is reduced, and the suspect vehicle can be blocked according to the position of the suspect vehicle continuously monitored.

The monitoring of the suspected vehicle mainly comprises three aspects of pre-control, in-process tracking and post-analysis.

As can be seen from the system shown in fig. 1, taking the prior control as an example, the prior control is an active warning: when some suspected vehicles need to be arranged and controlled, the license plate numbers of the suspected vehicles are set by the system background, and then the license plate numbers are sent to the mobile camera devices 100. When the mobile camera device 100 identifies the license plate of the suspected vehicle, the vehicle information including the relevant video, the position information and the uploading time is uploaded to the central storage 400 or the area storage 500 through the storage management server 300; then the position information of the vehicle in the memory is called, the current position of the suspected vehicle can be located immediately, then other mobile camera devices in the early warning distance nearby the suspected vehicle are found through the position information of all the mobile camera devices in the system, and the other mobile camera devices are called to monitor the suspected vehicle together.

Or receiving the confirmation information of the license plate of the suspected vehicle in other modes, and calling other mobile camera equipment within a preset distance nearby according to the current position to detect the suspected vehicle when the current position of the suspected vehicle is determined. Specifically, the upload management server 200 may initiate a shooting request (preferably, n ≧ 2) to n mobile camera apparatuses within a predetermined distance D (in meters: m) near the current position of the suspect vehicle, and wait for confirmation of the mobile camera apparatuses. If no appropriate mobile camera equipment is arranged near the suspected vehicle, the current position of the suspected vehicle can be notified to the mobile camera equipment with higher equipment priority, and the mobile camera equipment is called to track and monitor the suspected vehicle. The confirmation mode of the mobile camera device is as follows: and (5) confirming that m (m is less than or equal to n) terminal shooting.

In the process of monitoring the suspected vehicle, if the image uploading of m1(m1 is less than or equal to m) mobile camera devices is interrupted, the mobile camera devices are relocated, and the request is sent to the mobile camera devices within the preset distance nearby again until the confirmation of the m1 mobile camera devices is received.

And/or the presence of a gas in the gas,

an image information retriever 604 electrically connected to the vehicle information retriever 601, configured to retrieve vehicle image information of the suspected vehicle from the central memory or the area memory according to the upload time of the mobile image capturing apparatus included in the vehicle information;

the image information display 605 is electrically connected with the image information caller 604 and is used for displaying the vehicle image information according to the sequence of the uploading time;

the suspected vehicle can be continuously and uninterruptedly monitored and live broadcast by continuously calling the vehicle image information of the suspected vehicle and displaying the vehicle image information according to the uploading time sequence, for example, displaying the video of the suspected vehicle.

And/or the presence of a gas in the gas,

a movement trajectory generator 606 electrically connected to the vehicle information retriever 601, configured to generate a movement trajectory of the suspect vehicle according to the position information and the uploading time of the mobile camera included in the vehicle information;

and a moving track display 607 electrically connected to the moving track generator 606 for displaying the moving track of the suspected vehicle.

The position information and the uploading time of the mobile camera equipment are searched in the central storage and the area storage, and the position change condition of the suspect vehicle can be determined according to the sequence of the uploading time, so that the moving track of the suspect vehicle is generated according to the position change condition, and the suspect vehicle is arranged, controlled and intercepted according to the moving track. Wherein, the moving track of the suspected vehicle can be presented in a GIS map.

In addition, the reliability of the target vehicle identified only by the unique distinguishing features is insufficient, which easily causes a problem that erroneous determination or missing determination is easily generated when the search server 600 searches for a suspected vehicle from the center memory 400 or the area memory 500 or performs confirmation and tracking on the suspected vehicle.

In order to solve the above problem, as shown in fig. 3, the dual dynamic vehicle monitoring management system provided in the embodiment shown in fig. 1 or fig. 2 further includes a multi-feature information extraction server 700 electrically connected to the central memory 400 and the area memory 500, respectively; the multi-feature information extraction server 700 specifically includes:

a vehicle region detector 701, communicatively connected to the central memory 400 and the region memory 500, for detecting an image feature of a target vehicle in the vehicle image information using a machine learning algorithm, and extracting a vehicle image region of the target vehicle from the vehicle image information according to the image feature.

The vehicle image information comprises a target vehicle to be detected and may also contain a large amount of irrelevant content, and valuable characteristic information of the target vehicle can be screened out by detecting image characteristics of the target vehicle in the vehicle image information by using a machine learning algorithm and then extracting a vehicle image area of the target vehicle from the vehicle image information according to the image characteristics. Wherein the vehicle image area is an image formed by the shape contour of the target vehicle. In addition, in the above-mentioned detection of image features related to the target vehicle by using a machine learning algorithm, the feature information of interest may be analyzed by a feature classifier of interest trained by the machine learning algorithm, for example, the image features may be self-detected and searched by a deep neural network, where the image features include histogram of oriented gradients HOG, local binary pattern LBP, and/or Haar for edge feature, linear feature, center feature, and diagonal feature detection, and the like.

And the region-of-interest detector 702 is electrically connected to the vehicle region detector 701, and is configured to detect image information in the vehicle image region by using a sliding window to slide, select a region-of-interest feature classifier to determine a vehicle structure corresponding to the image information, and segment an image region of interest of the vehicle structure from the vehicle image region, where the region-of-interest feature classifier is obtained by training from a preset training image set through a machine learning algorithm. The vehicle structure comprises structures such as a vehicle type, a license plate, a vehicle body color, a sun shield, a pendant and a decoration of a target vehicle.

Specifically, when the sliding window slides to a certain part of the vehicle image area, various types of interested area feature classifiers are sequentially used for matching with pixels in the sliding window, when the annual inspection target classifier determines that the features of the annual inspection target are matched with the part of pixels, the annual inspection target is output, the annual inspection target classifier calculates the position and the size of the interested image area corresponding to the annual inspection target, and after the position and the size are determined, the interested image area corresponding to the annual inspection target is segmented from the vehicle image area; and if the annual survey mark classifier is not matched with the part, matching the pixels in the part area by using the car mark classifier, outputting the car mark if the characteristic of the car mark is determined to be matched with the pixels in the part area, calculating the position and the size of the interested image area corresponding to the car mark, and segmenting the interested image area corresponding to the car mark from the vehicle image area.

And a region-of-interest analyzer 703 electrically connected to the region-of-interest detector 702 for analyzing feature information of the vehicle structure from the image region of interest using the region-of-interest feature classifier.

Specifically, the annual survey mark classifier is capable of identifying the numerical information of the annual survey mark, such as 2017, according to a predetermined algorithm defined by the annual survey mark classifier itself.

A first storage controller 704 electrically connected to the region of interest analyzer 703, for storing the vehicle structure, the characteristic information of the vehicle structure, and the correspondence relationship of the characteristic information and the target vehicle to the central storage 400 or the region storage 500.

By configuring the multi-feature information extraction server 700 in communication connection with the central memory 400 and the area memory 500, a multi-feature information recognition and extraction function can be implemented for an original picture of a vehicle captured by the mobile camera device 100, so that a target vehicle can be determined more accurately, and the suspected vehicle can be quickly and accurately found by the retrieval server 600 according to a plurality of types of vehicle structures of the target vehicle and feature information of the vehicle structures. The feature information of the plurality of vehicle structures extracted by the multi-feature information extraction server 700 belongs to secondary feature information extraction with respect to the unique distinguishing features, and extraction of multi-feature structured and unstructured information of the target vehicle can be realized. In summary, by extracting the feature information of the vehicle structures of multiple types of the target vehicle, the target vehicle can be accurately determined, and the suspected vehicle and the suspected person in the vehicle can be accurately positioned. After obtaining the feature information of the plurality of types of vehicle structures of the target vehicle, the feature information is stored in the central storage 400 or the area storage 500, so that the vehicle information retriever 601 in the search server 600 shown in fig. 2 can retrieve the vehicle information of the suspected vehicle from the central storage 400 or the area storage 500 according to the feature information, and further perform operations such as positioning, tracking, monitoring, live broadcasting and the like on the suspected vehicle.

In order to further avoid the situation of wireless channel blocking caused by information uploading, as a preferred embodiment, as shown in fig. 4, in the embodiment shown in fig. 1 or in a new embodiment formed by adding the retrieval server shown in fig. 2 to fig. 1, the upload management server 200 specifically includes:

a monitoring area determiner 201, configured to determine a monitoring area where the mobile image capturing apparatus is located according to the position information of the mobile image capturing apparatus;

the vehicle information uploaded by the mobile camera equipment comprises the position information of the mobile camera equipment, the monitoring area where the mobile camera equipment is located can be determined according to the position information, and the maximum uploading channel number of the area and the number of the mobile camera equipment needing to upload information in the area can be further determined according to the monitoring area.

A channel number determiner 202 electrically connected to the monitoring area determiner 201, for determining a maximum uploading channel number of the monitoring area; the maximum uploading channel number is the maximum channel number which is allowed to be uploaded at the same time section in the monitoring area;

a first device number judger 203 electrically connected to the channel number determiner 202, configured to judge whether the number of mobile image capturing devices uploaded at the same time period in the monitoring area is greater than or equal to the maximum uploading channel number;

different monitoring areas have corresponding regional memory or are directly responsible for by central memory, and corresponding, different monitoring areas have respective biggest upload passageway quantity and set up, through judging whether the mobile camera equipment quantity of uploading in the monitoring area in the same time interval is greater than or equal to the biggest upload passageway quantity, can be according to the mobile camera equipment's of this biggest upload passageway quantity regulation and control in the same time interval quantity.

A first upload controller 204 electrically connected to the first device number judger 203, configured to control each mobile image capturing device uploaded at the same time interval, and upload respective vehicle information to the storage management server in order from high to low according to the device priority;

by controlling each mobile camera device 100 to upload respective vehicle information in sequence from high to low in device priority, the uploading process can be planned in order, and network congestion of a wireless channel is avoided. Since there may be a plurality of mobile camera devices 100 with the same device priority, when uploading vehicle information, one or more mobile camera devices with high priority may be guaranteed first, and information uploading behavior of other mobile camera devices 100 is temporarily suspended, so as to guarantee that the number of mobile camera devices 100 uploaded at the same time does not exceed the limit of the maximum number of uploading channels. For example: the maximum uploading channel number of a certain monitoring area is N, the number of all mobile camera devices needing to be uploaded at the same time is M (wherein M is larger than or equal to N), and of the M mobile camera devices, the number of high-priority mobile camera devices is M1, the number of medium-priority mobile camera devices is M2, and the number of low-priority mobile camera devices is M3; and if the sum of the numbers of the high-priority mobile camera devices and the medium-priority mobile camera devices is M1+ M2< N, uploading the vehicle information of the high-priority mobile camera devices and the medium-priority mobile camera devices to a storage management server, and suspending uploading the vehicle information of the low-priority mobile camera devices. The time period may be determined according to the capacity of the base station.

Because the number of the mobile camera devices with the same device priority in the same monitoring area may be too large, even if the mobile camera devices with the device priority are only controlled to upload simultaneously, the maximum number of upload channels in the monitoring area is exceeded, and network congestion is caused. To solve the problem, as shown in fig. 4, the upload management server 200 of the dual dynamic vehicle monitoring management system according to the embodiment of the present invention further includes, in addition to the respective structures shown in fig. 3:

a second device number determinator 205 configured to determine whether the number of mobile image capturing devices of the same device priority is greater than or equal to the maximum number of upload channels;

and a second upload controller 206 electrically connected to the second device number determiner 205, for controlling the mobile image capturing devices with the same device priority and uploading the vehicle information in the order from the first to the last in the application upload time.

By controlling each mobile camera device with the same device priority to upload respective vehicle information according to the application uploading time sequence, the information uploading efficiency can be improved, and network congestion of a wireless channel is avoided. For example, if the vehicle information of the high-priority and medium-priority mobile camera apparatuses cannot be uploaded, that is, the number M1+ M2 of the two priority mobile camera apparatuses is greater than or equal to N, at this time, by determining whether the number M1 of the high-priority mobile camera apparatus is greater than or equal to the maximum uploading channel number N of the monitored area, when M1 is less than the maximum uploading channel number N, M4 mobile camera apparatuses (where M4< M2) are selected from the medium-priority mobile camera apparatuses M2 according to the order of application uploading time, so that the sum of the number of the high-priority mobile camera apparatuses and the number of the selected medium-priority mobile camera apparatuses is less than the maximum uploading channel number, for example, M1+ M4 is equal to N-1; therefore, network blockage of a wireless channel is avoided, and uploading efficiency is improved.

In addition, a mobile camera device with a low device priority may also acquire vehicle image information of a suspected vehicle, however, since the device priority of such a mobile camera device is low, when uploading vehicle information including vehicle image information and position information, a problem of an excessively long uploading waiting time may occur, thereby delaying monitoring of the suspected vehicle.

In order to solve the above problem, the upload management server 200 in the dual dynamic vehicle monitoring management system shown in fig. 1 can adjust the device priority of the mobile image pickup device 100, thereby reducing the upload wait time. Preferably, as shown in fig. 5, the upload management server 200 in fig. 1 further includes:

a suspect vehicle judger 207 for judging whether the target vehicle is a suspect vehicle according to the unique distinguishing feature corresponding to the target vehicle contained in the vehicle image information;

and the priority adjustor 208 is electrically connected with the suspected vehicle judger 207 and is used for increasing the equipment priority of the mobile camera equipment which monitors the suspected vehicle if the target vehicle is the suspected vehicle.

When the target vehicle is determined to be the suspected vehicle, the priority of the equipment of the mobile camera equipment is increased, if the priority of the equipment is adjusted to the highest level, the vehicle information of the mobile camera equipment can be uploaded to the central storage preferentially when the mobile camera equipment monitors the suspected vehicle, so that the uploading waiting time is reduced, and the suspected vehicle is monitored continuously. In addition, the mobile camera device can also realize the function of increasing the priority of the device when the suspect vehicle is monitored, so that field personnel can conveniently monitor the suspect vehicle in time.

On the contrary, when the mobile camera device with the lower priority no longer monitors the suspected vehicle, for example, the suspected vehicle is lost due to the movement change of the scene, the default priority of the mobile camera device can be automatically recovered.

In addition, the priority adjuster 208 may not only increase the device priority of the mobile camera device monitoring the suspect vehicle, but also may predict a moving path of the suspect vehicle according to a moving track of the suspect vehicle, and temporarily increase the device priority of the mobile camera device distributed on the predicted moving path in a future predetermined time period, so as to monitor the suspect vehicle.

In addition, the mobile camera devices have different device priorities, and the importance of the vehicle information acquired by the corresponding mobile camera devices is different. As a preferred embodiment, as shown in fig. 6, in order to facilitate subsequent retrieval and recall of vehicle information with different importance levels, in a new embodiment formed by adding a retrieval server to the dual-dynamic vehicle monitoring and management system shown in fig. 1 or the system shown in fig. 1, the storage management server 300 specifically includes:

a vehicle information receiver 301, configured to receive vehicle information uploaded by each mobile image capturing apparatus;

a priority determiner 302 electrically connected to the vehicle information receiver 301 for determining whether the device priority of each mobile image pickup device is higher than or equal to a preset division priority, respectively;

the vehicle information uploaded by the mobile camera equipment with the equipment priority higher than or equal to the preset priority is higher in importance degree; and the priority of the equipment is lower than the vehicle information uploaded by the preset prioritized mobile camera equipment, so that the importance degree is lower.

And a second storage controller 303 electrically connected to the priority determiner 302, for storing the vehicle information into the central storage if the device priority of the mobile camera device is higher than or equal to a preset prioritization level.

The central memory 400 has a large storage capacity and spans different areas, and can store vehicle information uploaded by mobile camera devices in different monitoring areas and directly send the vehicle information to a retrieval server during subsequent retrieval and calling. Therefore, the vehicle information uploaded by the mobile camera equipment with the equipment priority higher than or equal to the preset priority is stored in the central memory, and the retrieval and the calling of the vehicle information can be facilitated.

The second storage controller 303 is further configured to store the vehicle information in an area memory of a monitoring area where the mobile camera device is located if the device priority of the mobile camera device is lower than a preset prioritization priority.

The area memory 500 manages the storage of the vehicle information of the present monitoring area in a divided manner, so when there are a plurality of monitoring areas, the area memory is distributed; because the vehicle information amount uploaded by each mobile camera device in different monitoring areas is relatively dispersed, the total vehicle information amount uploaded by a plurality of monitoring areas is relatively large, and the importance degree of the vehicle information uploaded by each mobile camera device in each monitoring area is often different, the vehicle information sent by the mobile camera device with lower equipment priority in the monitoring area is stored by the area memory, the burden of the central memory 400 can be reduced while a large amount of vehicle information is stored, and because the vehicle information of a large amount of mobile camera devices with lower equipment priority is distributed, the vehicle information can be forwarded to each area memory nearby, only part of the vehicle information with higher equipment priority is directly forwarded to the central memory, the bandwidth of a core network can be saved, and the gridding management of data is facilitated. Meanwhile, the vehicle information uploaded by the mobile camera equipment with higher equipment priority, namely the vehicle information with higher importance degree is sent to the central memory, so that the vehicle information with higher importance degree can be conveniently subjected to unified centralized management, unified storage and calling.

As shown in fig. 1, 2 and 6, the central memory 400 may be directly connected to the search server 600 in a communication manner, and each of the area memories 500 may be respectively connected to the central memory 400 in a communication manner, so that when the search server 600 needs to search for vehicle information of a certain vehicle, the vehicle information uploaded by the mobile camera with high device priority may be directly called from the central memory 400, or the vehicle information uploaded by the mobile camera with low device priority may be called from the area memory 500 through the central memory 400, by using a unique distinguishing feature.

Based on the same inventive concept, the embodiment of the present invention further provides a dual dynamic vehicle monitoring management method based on a mobile camera device, and as the system corresponding to the method is the dual dynamic vehicle monitoring management system based on the mobile camera device in the embodiment of the present invention, and the principle of the method for solving the problem is similar to that of the system, the implementation of the method can refer to the implementation of the system, and repeated details are not repeated.

Referring to fig. 7, fig. 7 is a schematic flow chart of a dual-dynamic vehicle monitoring and management method based on a mobile camera device according to an embodiment of the present invention, where the dual-dynamic vehicle monitoring and management method provided in this embodiment is used in the dual-dynamic vehicle monitoring and management system according to any one of the foregoing embodiments, as shown in fig. 7, the dual-dynamic vehicle monitoring and management method provided in the embodiment of the present invention includes:

s110: controlling a plurality of mobile camera devices to monitor vehicle image information of a target vehicle, wherein each mobile camera device in the plurality of mobile camera devices has a device priority;

s120: determining a monitoring area where the mobile camera is located, and controlling each piece of mobile camera uploaded at the same time period to upload respective vehicle information respectively according to the sequence of the priority of the equipment from high to low when the number of the mobile camera uploaded at the same time period in the same monitoring area is larger than or equal to the maximum uploading channel number of the monitoring area, wherein the vehicle information comprises vehicle image information, position information of the mobile camera and uploading time;

s130: and respectively forwarding the vehicle information uploaded by each mobile camera device to an area memory corresponding to the monitoring area or a cross-area central memory according to the priority level of the device, wherein the device priority level corresponding to the vehicle information in the central memory is higher than the device priority level corresponding to the vehicle information in the area memory.

According to the dual-dynamic vehicle monitoring management method based on the mobile camera devices, the range to be monitored is divided into one or more monitoring areas, when the number of the mobile camera devices uploaded in the same monitoring area at the same time period is determined to be larger than or equal to the maximum uploading channel number of the monitoring area through the uploading management server, the mobile camera devices are controlled to respectively upload vehicle information according to the priority of the devices from high to low, and therefore the phenomenon of network congestion caused by the fact that a large number of devices which are not divided into areas in a system are simultaneously uploaded to the same memory is avoided; and the storage management server respectively stores the vehicle information to a central memory or a regional memory of a monitored region according to the priority level of the equipment, so that a large amount of monitored information is stored in a regional mode, the bandwidth of a core network can be saved, and the problems of low network access speed and poor access quality caused by the fact that a plurality of people access the same memory are solved. Meanwhile, the mobile camera equipment with lower equipment priority uploads the vehicle information to the regional memory of the monitored region nearby, and the uploading speed is high; the mobile camera device with higher device priority stores the vehicle information to the cross-regional central memory, so that the query speed of the cross-regional vehicle information can be improved.

In order to achieve indexing of the vehicle information in the central memory and the area memory, as a preferred embodiment, the vehicle image information includes a unique distinctive feature corresponding to the target vehicle; as shown in fig. 8, the dual dynamic vehicle monitoring management method shown in fig. 7 further includes:

s140: calling vehicle information of the suspected vehicle from the central memory or the regional memory according to the unique distinguishing characteristics;

s150: determining the current position of the suspect vehicle according to the position information and uploading time of the mobile camera equipment contained in the vehicle information, and calling the mobile camera equipment within a preset distance of the current position of the suspect vehicle to track and monitor the suspect vehicle in real time;

And/or the presence of a gas in the gas,

s160: according to the uploading time of the mobile camera equipment contained in the vehicle information, vehicle image information of a suspected vehicle is called from a central memory or a regional memory, and the vehicle image information is displayed according to the sequence of the uploading time;

the suspected vehicle can be continuously and uninterruptedly monitored and live broadcast by continuously calling the vehicle image information of the suspected vehicle and displaying the vehicle image information according to the sequence of the uploading time, for example, displaying the video of the suspected vehicle.

And/or the presence of a gas in the gas,

s170: and generating and displaying the movement track of the suspected vehicle according to the position information and the uploading time of the mobile camera equipment contained in the vehicle information.

In order to determine the structural features of the target vehicle more accurately and further improve the success rate of retrieving the suspected vehicle, as a preferred embodiment, the dual-dynamic vehicle monitoring and management method provided in the embodiment shown in fig. 7 or 8 further includes the following steps:

detecting image characteristics about a target vehicle in the vehicle image information by using a machine learning algorithm, and extracting a vehicle image area of the target vehicle from the vehicle image information according to the image characteristics; detecting image information in the vehicle image area by using sliding of a sliding window, selecting an interested area feature classifier to determine a vehicle structure corresponding to the image information, and segmenting an interested image area of the vehicle structure from the vehicle image area, wherein the interested area feature classifier is obtained by training in a preset training image set through a machine learning algorithm; analyzing feature information of the vehicle structure from the interested image region by using an interested region feature classifier; and storing the vehicle structure, the characteristic information of the vehicle structure and the corresponding relation between the characteristic information and the target vehicle into the central memory or the area memory.

By extracting the vehicle structure of the target vehicle and the feature information of the vehicle structure from the central memory 400 and the area memory 500, the multi-feature information identification and extraction function of the motor vehicle can be realized for the original motor vehicle picture captured by the mobile camera device, so that the target vehicle can be determined more accurately, and the suspected vehicle can be found out quickly and accurately by the retrieval server 600 according to the vehicle structures of multiple types of the target vehicle and the feature information of the vehicle structure. The feature information of the plurality of vehicle structures extracted by the multi-feature information extraction server 700 belongs to secondary feature information extraction with respect to the unique distinguishing features, and extraction of multi-feature structured and unstructured information of the target vehicle can be realized. In summary, by extracting the feature information of the vehicle structures of multiple types of the target vehicle, the target vehicle can be accurately determined, and the suspected vehicle and the suspected person in the vehicle can be accurately positioned. After the feature information of the vehicle structures of the multiple types of the target vehicle is obtained, the feature information is stored in the central memory or the regional memory, so that the retrieval server 600 shown in fig. 2 can conveniently retrieve the vehicle information of the suspected vehicle from the central memory or the regional memory according to the feature information, and further perform operations such as positioning, tracking, monitoring and live broadcasting on the suspected vehicle.

In order to further avoid the situation of wireless channel blocking caused by information uploading, as a preferred embodiment, as shown in fig. 9, in the embodiment shown in fig. 7, step S120: the method comprises the steps of determining a monitoring area where the mobile camera devices are located, and controlling each mobile camera device uploaded at the same time period to upload respective vehicle information according to the sequence of the priority of the device from high to low when the number of the mobile camera devices uploaded at the same time period in the same monitoring area is larger than or equal to the maximum uploading channel number of the monitoring area, and specifically comprises the following steps:

s121: determining a monitoring area where the mobile camera device is located according to the position information of the mobile camera device;

s122: determining the maximum uploading channel number of the monitoring area;

s123: judging whether the number of the mobile camera devices uploaded in the same time period in the monitoring area is larger than or equal to the maximum uploading channel number or not;

s124: if so, controlling each mobile camera device uploaded at the same time period, and uploading respective vehicle information to a storage management server from high to low according to the priority sequence of the devices; if not, the uploading of the vehicle information of the mobile camera equipment is not controlled;

by controlling each mobile camera device to upload respective vehicle information in sequence from high to low in priority of the device, the uploading process can be planned in order, and network blockage of a wireless channel is avoided.

S125: judging whether the number of the mobile camera devices with the same device priority is larger than or equal to the maximum uploading channel number or not;

s126: if yes, controlling each mobile camera device with the same device priority and uploading respective vehicle information according to the order of application uploading time from first to last.

By controlling each mobile camera device with the same device priority to upload respective vehicle information according to the application uploading time sequence, the information uploading efficiency can be improved, and network congestion of a wireless channel is avoided.

In addition, a mobile camera device with a low device priority may also acquire vehicle image information of a suspected vehicle, however, since the device priority of such a mobile camera device is low, when uploading vehicle information including vehicle image information and position information, a problem of an excessively long uploading waiting time may occur, thereby delaying monitoring of the suspected vehicle. In order to solve the above problem, as a preferred embodiment, the dual dynamic vehicle monitoring management method shown in fig. 6 further includes: judging whether the target vehicle is a suspected vehicle or not according to the unique distinguishing characteristics corresponding to the target vehicle, which are included in the vehicle image information; and if the target vehicle is a suspected vehicle, increasing the equipment priority of the mobile camera equipment which monitors the suspected vehicle.

When the target vehicle is determined to be the suspected vehicle, the priority of the equipment of the mobile camera equipment is increased, if the priority of the equipment is adjusted to the highest level, the vehicle information of the mobile camera equipment can be uploaded to the central storage preferentially when the mobile camera equipment monitors the suspected vehicle, so that the uploading waiting time is reduced, and the suspected vehicle is monitored continuously.

In addition, the mobile camera devices have different device priorities, and the importance of the vehicle information acquired by the corresponding mobile camera devices is different. In order to facilitate subsequent retrieval and recall of vehicle information with different importance levels, as a preferred embodiment, as shown in fig. 10, the embodiment shown in fig. 6 provides step S130 in the dual dynamic vehicle monitoring and management system: according to the priority level of the equipment, respectively forwarding the vehicle information uploaded by each mobile camera to an area memory corresponding to the monitored area or a cross-area central memory, specifically comprising the following steps:

s131: receiving vehicle information uploaded by each mobile camera device;

s132: respectively judging whether the equipment priority of each mobile camera equipment is higher than or equal to a preset division priority;

s133: if the equipment priority of the mobile camera equipment is higher than or equal to the preset division priority, storing the vehicle information into a central memory;

s134: and if the equipment priority of the mobile camera equipment is lower than the preset division priority, storing the vehicle information into an area memory of a monitoring area where the mobile camera equipment is located.

The area memory is used for storing the vehicle information sent by the mobile camera equipment with lower equipment priority in the monitoring area, so that the burden of the central memory can be reduced while a large amount of vehicle information is guaranteed to be stored, and because a large amount of mobile camera equipment with lower equipment priority is generally distributed, the vehicle information can be forwarded to each area memory nearby, only part of the vehicle information with higher equipment priority is directly forwarded to the central memory, so that the bandwidth of a core network can be saved, and the gridding management of data is facilitated.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments.

The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing is directed to embodiments of the present invention, and it is understood that various modifications and improvements can be made by those skilled in the art without departing from the spirit of the invention.

Claims

1. A dual dynamic vehicle monitoring management system based on mobile camera device, comprising:

2. The dual-dynamic vehicle monitoring management system of claim 1, wherein the vehicle image information includes a unique distinguishing feature corresponding to the target vehicle; the dual-dynamic vehicle monitoring and management system further comprises a retrieval server in communication connection with the central storage and the area storage, and the retrieval server specifically comprises:

and/or the presence of a gas in the gas,

3. The dual dynamic vehicle monitoring management system of claim 1 or 2, further comprising a multi-feature information extraction server electrically connected to the central memory and area memory, respectively; the multi-feature information extraction server specifically includes:

4. The dual dynamic vehicle monitoring management system according to claim 1 or 2, wherein the upload management server specifically comprises:

the second uploading controller is electrically connected with the second equipment quantity judger and is used for controlling each mobile camera equipment with the same equipment priority and uploading respective vehicle information according to the sequence of the application uploading time from first to last;

the upload management server specifically further includes: the suspected vehicle judger is used for judging whether the target vehicle is a suspected vehicle or not according to the unique distinguishing characteristics corresponding to the target vehicle and contained in the vehicle image information; and the priority regulator is electrically connected with the suspect vehicle judger and used for heightening the equipment priority of the mobile camera equipment which monitors the suspect vehicle if the target vehicle is the suspect vehicle.

5. The dual dynamic vehicle monitoring and management system of claim 1, wherein the storage management server, in particular, comprises:

6. A dual-dynamic vehicle monitoring management method based on a mobile camera device, which is used in the dual-dynamic vehicle monitoring management system of any one of claims 1 to 5, the dual-dynamic vehicle monitoring management method comprising:

7. The dual dynamic vehicle monitoring management method of claim 6 wherein the vehicle image information includes a unique distinguishing feature corresponding to the target vehicle; the method further comprises the following steps:

and/or the presence of a gas in the gas,

8. The dual dynamic vehicle monitoring management method according to claim 6 or 7, further comprising:

9. The dual-dynamic vehicle monitoring and management method according to claim 6 or 7, wherein the step of determining the monitoring area where the mobile camera devices are located, and when the number of the mobile camera devices uploaded in the same monitoring area at the same time period is greater than or equal to the maximum number of the uploading channels of the monitoring area, controlling each mobile camera device uploaded in the same time period to upload respective vehicle information according to the order of the priority of the device from high to low includes:

determining the maximum uploading channel number of the monitoring area;

10. The dual-dynamic vehicle monitoring and management method according to claim 6, wherein the step of forwarding the vehicle information uploaded by each mobile camera device to an area memory corresponding to the monitored area or a center memory across areas according to the device priority level includes:

receiving vehicle information uploaded by each mobile camera device;