CN105913656A - Distributed statistics based method and system for frequently passing vehicles - Google Patents
Distributed statistics based method and system for frequently passing vehicles Download PDFInfo
- Publication number
- CN105913656A CN105913656A CN201610274065.4A CN201610274065A CN105913656A CN 105913656 A CN105913656 A CN 105913656A CN 201610274065 A CN201610274065 A CN 201610274065A CN 105913656 A CN105913656 A CN 105913656A
- Authority
- CN
- China
- Prior art keywords
- car
- data
- bayonet socket
- crossing
- frequent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0125—Traffic data processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0137—Measuring and analyzing of parameters relative to traffic conditions for specific applications
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Train Traffic Observation, Control, And Security (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a distributed statistics based method for frequently passing vehicles. The method comprises the following steps: generating a request for statistics on frequently passing vehicles according to a preset statistical condition for frequently passing vehicles; sending the request for statistics on frequently passing vehicles to all nodes of a hadoop; receiving data of frequently passing vehicles through passing gates, found by the nodes in response to the request and in compliance to requirements of preset gate information, vehicle information and vehicle passing time, and storing the data according to the gate information and vehicle identification; searching all stored data of passing vehicles through the gates, having them combined and finding out the how many times each vehicle passes through the gates and recording the times; search how many times one vehicle passes the gates; according to a preset threshold value on the passing times, deleting the data of passing vehicles that are not in compliance with the threshold value; and obtaining and storing the gate information, vehicle information, gate passing time and the passing times of frequently passing vehicles. The method and the system raise statistical efficiency on frequently passing vehicle.
Description
Technical field
The present invention relates to the technical field of car data statistics, in particular it relates to one is based on distributed system
Count the frequent method and system crossing car.
Background technology
In recent years, along with improvement and the progress of technology of people's living standard, automobile also becomes people's day
Often the vehicles of common of trip, is very easy to life and the work of people.But, on the other hand,
Automobile is providing easily simultaneously for people's live and work, also provides machine for many law-breakers
Meeting, utilizes automobile to emerge in an endless stream as the event of guilty tool now, such as hit-and-run, drive to run away,
Drive tracking etc..If the travel information that can find these crime vehicles is often tracked down illegal to people's police
Case provides great convenience condition.Along with Internet technology and the development of the information processing technology, various letters
Breath intelligent analysis and be treated as popular research contents in the industry.Transit equipment plus various places now
Substantial increase, the construction of Traffic Information Engineering, also form the information acquiring technology of vehicle of maturation.
In prior art, car data crossed by the vehicle being collected in each bayonet socket by the vehicle data acquisition equipment of bayonet socket,
And it is stored in relational database or dispersion does not has in related text data.If it is desired to obtain the car excessively of vehicle
Number of times has two ways: manually carry out adding up and adding up from relation data.
But, collecting device collect by the characteristic information of bayonet vehicle imperfect time, such as see not
Clear vehicle brand, license plate shading etc., imperfect feature here is not necessarily and is caused by anthropic factor, also
It is likely due to the reasons such as collecting device shooting direction, angle, light cause, or record keeping personnel at that time
Only remember the situations such as a part for Chu's car plate, the color of vehicle, brand.Crossing, car data amount of storage is such
In the case of big, want to find out a most full automobile of feature general as looking for a needle in a haystack.From these mistakes
Car data will first reduce the seeking scope of car data by screening, also can at double, become the minimizing of Radix Achyranthis Bidentatae
Follow-up workload, saves the cost of lookup.In the prior art, frequent car of crossing is calculating vehicle warp
Crossing the number of times of somewhere (bayonet socket), the number of times being crossed car by vehicle screens out/captures vehicle number according to pre-conditioned
According to, thus reduce seeking scope, and filter out reach that some crosses train number number cross car data set,
I.e. it is referred to as frequent car excessively.
The bayonet socket data of prior art are to there is relational database or dispersion does not has related text data to work as
In, in the hugest data volume, it is the most unpractical that artificial statistics searches frequent car data excessively；
And relevant database is the form storage data according to intersection bivariate table, can be because storage data volume increase
Add carrying cost, also quick search can not navigate to mesh because of the huge data of storage in traversal bivariate table
Mark car data, also cannot realize frequently crossing the real-time query of car data.Simple inquiry also needs
The waiting time of several minutes, the speed adding up frequent car data excessively is the most slack-off, can not meet far away reality
Real-time query and the purpose of statistics.
Therefore it provides a kind of efficiently easily implement on big data platform, cross what car was added up to frequent
Method is this area problem demanding prompt solution.
Summary of the invention
In view of this, the invention provides a kind of based on the frequent method and system crossing car of distributed statistics,
Solve in car data excessively, add up the frequent height of car cost excessively, the problem of inefficiency.
In order to solve above-mentioned technical problem, the present invention proposes a kind of based on the frequent side crossing car of distributed statistics
Method, including:
According to presetting frequently, car statistical condition generation statistics is frequent crossed car request；
Send the frequent car of crossing of described statistics to each node of distributed memory system to ask；
Receiving each node asks determine to meet card message set in advance according to described frequent car of crossing
Breath, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data, and described card is made a slip of the tongue car data by card
The form of message breath and vehicles identifications preserves；Wherein, described vehicles identifications includes: the number-plate number and
Cross train number number；
The described card that traversal preserves is made a slip of the tongue car data, and merge each bayonet socket crosses car data, adds up each card
In mouth data, every chassis crosses train number number and preserves；
Travel through the train number number excessively of every chassis in each bayonet socket, cross car frequency threshold value according to set in advance,
Deleted train number number do not meet threshold requirement cross car data, statistics obtained frequently cross car bayonet socket information,
Information of vehicles, excessively car time and excessively train number number also preserve.
Further, wherein, the method farther includes:
Giving up each node asks determine not meet card message set in advance according to described frequent car of crossing
Breath, information of vehicles and cross the card of car time and make a slip of the tongue car data.
Further, wherein, the car data excessively of described each bayonet socket of merging, add up in each bayonet socket data
Crossing train number number and preserving of every chassis, farther includes:
The car data of crossing of the identical bayonet socket traversed is merged in same set；
In each bayonet socket set, all train number numbers excessively of the same number-plate number are added and obtain this license plate number
Code corresponding vehicle crossing train number number and preserving at corresponding bayonet socket.
Further, wherein, each node of described reception asks the symbol determined according to described frequent car excessively
Close bayonet socket information set in advance, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data, and by institute
State card car data of making a slip of the tongue to preserve by the form of bayonet socket information and vehicles identifications, farther include:
Distributed service framework is utilized to meet set in advance from each node acquisition of distributed memory system
Bayonet socket information, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data.
Further, wherein, described card is made a slip of the tongue car data, farther includes: bayonet socket numbering, license plate number
Code, body color, vehicle model, vehicle running state and mistake car time.
It addition, the present invention also provides for a kind of system based on the frequent car excessively of distributed statistics, including: process
Module, sending module, receiver module, filing merge module and statistical module；Wherein,
Described processing module, for according to presetting frequently, car statistical condition generation statistics is frequent crosses car
Request；
Described sending module, please for sending the frequent car of crossing of statistics to each node of distributed memory system
Ask；
Described receiver module, asks determine to meet for receiving each node according to described frequent car of crossing
Bayonet socket information set in advance, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data, and by described
Block car data of making a slip of the tongue to preserve by the form of bayonet socket information and vehicles identifications；Wherein, described vehicles identifications
Including: the number-plate number and excessively train number number；
Described filing merges module, and the described card for traveling through preservation is made a slip of the tongue car data, merges each bayonet socket
Cross car data, add up the mistake train number number of every chassis in each bayonet socket data and preserve；
Described statistical module, for traveling through the train number number excessively of every chassis in each bayonet socket, according to setting in advance
Fixed crosses car frequency threshold value, deleted train number number and does not meets the car data of crossing of threshold requirement, and statistics obtains frequency
Numerous bayonet socket information of car excessively, information of vehicles, excessively car time and mistake train number number also preserve.
Further, wherein, described receiver module, it is further used for:
Giving up each node asks determine not meet card message set in advance according to described frequent car of crossing
Breath, information of vehicles and cross the card of car time and make a slip of the tongue car data.
Further, wherein, described filing merges module, is further used for:
The car data of crossing of the identical bayonet socket traversed is merged in same set；
In each bayonet socket set, all train number numbers excessively of the same number-plate number are added and obtain this license plate number
Code corresponding vehicle crossing train number number and preserving at corresponding bayonet socket.
Further, wherein, described receiver module, it is further used for:
Distributed service framework is utilized to meet set in advance from each node acquisition of distributed memory system
Bayonet socket information, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data.
Further, wherein, described card is made a slip of the tongue car data, farther includes: bayonet socket numbering, license plate number
Code, body color, vehicle model, vehicle running state, excessively train number number and mistake car time.
Compared with prior art, the method and system based on the frequent car excessively of distributed statistics of the present invention, real
Show following beneficial effect:
(1) of the present invention based on the frequent method and system crossing car of distributed statistics, based on big data
The frequent of platform crosses car statistical method, receives and is distributed on the node of big data platform distributed storage
Formula operation result, carries out integration, statistics the most again, can be set up in a distributed manner by big data platform
On cheap business PC, and determine the size of distributed type assemblies according to practical situations such as the sizes of data volume,
The data of magnanimity can be stored, saved the frequent resource used crossing car of statistics, and can utilize point
Car data excessively is inquired about, is added up by cloth cluster concurrently, improves the frequent statistics effect crossing car of statistics
Rate.
(2) of the present invention based on the frequent method and system crossing car of distributed statistics, according to setting in advance
Fixed requirement filters out ineligible data in rough estimates, eliminates numerous and diverse car data of crossing and processes
Process, thus reduce the data volume when carrying out integrating statistics, thus shorten the frequent car excessively of statistics
Operation time and calculating speed.
(3) of the present invention based on the frequent method and system crossing car of distributed statistics, in data statistics
Initial stage first filters out the car data excessively required that conforms to a predetermined condition, then adds up every chassis mistake of each bayonet socket
After train number number, the frequent car frequency threshold value of crossing crossing car predetermined is utilized to select and add up the information frequently crossing car,
In inquiry, statistic processes, the information of each vehicle is all without there being omission, it is ensured that adds up frequent and crosses car
Accuracy.
Certainly, the arbitrary product implementing the present invention must be not necessarily required to reach all the above skill simultaneously
Art effect.
Accompanying drawing explanation
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes of the present invention
Point, the schematic description and description of the present invention is used for explaining the present invention, is not intended that the present invention's
Improper restriction.In the accompanying drawings:
Figure 1A is an alternative embodiment based on the frequent method crossing car of distributed statistics of the present invention
Schematic flow sheet；
Figure 1B is the operating principle schematic diagram based on the frequent method crossing car of distributed statistics of the present invention；
Fig. 2 is the embodiment based on the frequent method crossing car of distributed statistics described in the embodiment of the present invention 2
Schematic flow sheet；
Fig. 3 is the tool based on the frequent method crossing car of distributed statistics described in the embodiment of the present invention 3
The schematic flow sheet of body embodiment；
Fig. 4 is the structure of a present invention alternative embodiment based on the frequent system crossing car of distributed statistics
Schematic diagram.
Detailed description of the invention
As employed some vocabulary in the middle of description and claim to censure specific components.This area skill
Art personnel are it is to be appreciated that hardware manufacturer may call same assembly with different nouns.This explanation
In the way of book and claim not difference by title is used as distinguishing assembly, but with assembly in function
On difference be used as distinguish criterion." bag as mentioned by the middle of description in the whole text and claim
Contain " it is an open language, therefore " comprise but be not limited to " should be construed to." substantially " refer to receivable
In range of error, those skilled in the art can solve described technical problem, base in the range of certain error
Originally described technique effect is reached.Description subsequent descriptions is to implement the better embodiment of the present invention, right institute
State description be the rule so that the present invention to be described for the purpose of, be not limited to the scope of the present invention.This
The protection domain of invention is when being as the criterion depending on the defined person of claims.
Embodiment 1
As shown in FIG. 1A and 1B, Figure 1A is the side based on the frequent car excessively of distributed statistics of the present invention
The schematic flow sheet of one alternative embodiment of method；Figure 1B is the frequent based on distributed statistics of the present invention
Cross the operating principle schematic diagram of the method for car.The present invention, based on distributed memory system, passes through distributed pipes
What reason controlled that first filtering out conforms to a predetermined condition and requires crosses car data, then carries out the filing of car data, whole
Close and clean count the most frequent cross car information, accelerated frequently cross car statistics efficiency.This reality
Execute and comprise the following steps based on the frequent method crossing car of distributed statistics described in example:
Step 101, basis preset frequently the frequent car of crossing of car statistical condition generation statistics and asked, and
Send the frequent car of crossing of statistics to each node of distributed memory system to ask.
Distributed memory system (Hadoop), has the feature of high fault tolerance, on cheap hardware top
Administration's memory node, the information after the data process of each node that is managed collectively by Distributed Services agreement is passed
Pass, again because the high-throughput that it provides can be used to access application data, make full use of distributed
The parallel computation power of cluster is capable of high-speed computation and storage.Need are added up according to actual frequent car of crossing
Seek survival into the frequent car of crossing of statistics to ask, be issued to each distributed node by distributed management protocol.
Step 102, receive each node according to described frequent cross that car request determines meet and preset
Bayonet socket information, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data, and car that described card is made a slip of the tongue
Data are preserved by the form of bayonet socket information and vehicles identifications；Wherein, described vehicles identifications includes: car
Trade mark code and excessively train number number.
Each node reception of distributed memory system adds up frequent after crossing car request, crosses car from what it stored
Data base obtains the car data excessively of eligible requirement, wherein, the car excessively of its storage of each node traverses
Data, and compare with bayonet socket information set in advance, information of vehicles and car time requirement excessively, it is judged that
Go out satisfactory car data excessively, so just can set required condition according to actual needs and require information,
Can carry out filtering out preliminary satisfactory frequent car data excessively by each node, reduce follow-up conjunction
And, statistical work amount, and ensure that frequently cross car cross car data do not have omission.
The described card that step 103, traversal preserve is made a slip of the tongue car data, and merge each bayonet socket crosses car data,
Add up the train number number excessively of every chassis in each bayonet socket data and preserve.
In this step, what in first traversal step 102, Preliminary screening went out crosses car data, finds out each bayonet socket
Cross car data bring together, then by the every chassis in each bayonet socket data acquisition system cross train number number system
It is calculated as total train number number excessively.So, the train number excessively of every chassis in each bayonet socket can be counted exactly
Count and cross car information, storing according to the form of bayonet socket set, facilitating follow-up further screening.
Step 104, travel through every chassis in each bayonet socket cross train number number, cross car according to set in advance
Frequency threshold value, deleted train number number and did not met the car data of crossing of threshold requirement, and statistics obtains frequently crossing car
Bayonet socket information, information of vehicles, excessively car time and mistake train number number also preserve.
Wherein, Figure 1B is showing based on the frequent operating principle of method crossing car of distributed statistics of the present invention
It is intended to.It can be seen that through step 105,106,107 and 108 to respectively from the schematic diagram of Figure 1B
After the mistake car data of individual node pools together after adding up；By step 109 by the mistake of each bayonet socket
After car data filing merges；Step 110 is used to clean the car data excessively after filing merges again；Eventually through
Step 111 obtains final frequent car statistical result excessively.
The merging of train number number crossed by every chassis through Preliminary screening and each bayonet socket, finds out taxonomically
Every chassis crosses train number number data each bayonet socket, every chassis with it at the train number number excessively of each bayonet socket
Information is well-determined.According to required data cleansing rule, each after traversal filing merges blocks
In mouthful set every chassis cross car number information, i.e. can get the frequent statistical data crossing car.Such as,
Frequently cross car pre-set requirement added up train number number less than/more than m, will cross train number number more than/less than m
Vehicle cross train number number information deletion, finally required frequent cross car information of vehicles and it is at card
The train number number data excessively of mouth.
In the present embodiment, cross car data storage system based on distributed, receive and be distributed at big data platform
After on the node of formula storage, basis presets and requires the car data excessively after carrying out distributed screening, then carry out
Integration, statistics, and wash out the frequent car data excessively meeting frequently car predetermined threshold excessively, not only may be used
To utilize the parallel computation mode of distributed system, additionally it is possible to use first primary dcreening operation to remerge the mode of cleaning,
Promote the frequent statistical efficiency crossing car of statistics.
Embodiment 2
As in figure 2 it is shown, be the method based on the frequent car excessively of distributed statistics of the embodiment of the present invention 2.?
In the present embodiment, it is provided with and carries out data merging and cleaning based in the frequent method crossing car of distributed statistics
Concrete grammar.The present embodiment comprises the following steps based on the frequent method crossing car of distributed statistics:
Step 201, basis preset frequently the frequent car of crossing of car statistical condition generation statistics and asked, and
Send the frequent car of crossing of statistics to each node of distributed memory system to ask.
Step 202, utilize distributed service framework receive each node according to described frequent cross car request sentence
Break meets bayonet socket information set in advance, information of vehicles and crosses the card of car time requirement and make a slip of the tongue car data,
And car data of being made a slip of the tongue by described card is preserved by the form of bayonet socket information and vehicles identifications；Wherein, described
Vehicles identifications includes: the number-plate number and excessively train number number.
Preferably, described card is made a slip of the tongue car data, farther includes: bayonet socket numbering, the number-plate number, vehicle body
Color, vehicle model, vehicle running state and mistake car time.
Step 203, give up each node according to described frequent cross that car request determines do not meet and set in advance
Fixed bayonet socket information, information of vehicles and cross the card of car time and make a slip of the tongue car data.
The described card that step 204, traversal preserve is made a slip of the tongue car data, obtains every chassis mistake of each bayonet socket
Car data.
Step 205, by the identical bayonet socket traversed cross car data be merged in same set.
Step 206, in each bayonet socket set, by the same number-plate number all cross train number numbers be added
To this number-plate number correspondence vehicle crossing train number number and preserving at corresponding bayonet socket.
Step 207, travel through every chassis in each bayonet socket cross train number number, cross car according to set in advance
Frequency threshold value, deleted train number number and did not met the car data of crossing of threshold requirement, and statistics obtains frequently crossing car
Bayonet socket information, information of vehicles, excessively car time and mistake train number number also preserve.
The method based on the frequent car excessively of distributed statistics of the present embodiment, according to requirement set in advance just
Step statistics filters out ineligible data, eliminates numerous and diverse car data processing procedure excessively, thus drops
The low data volume when carrying out integrating statistics, thus shorten the frequent operation time crossing car of statistics and
Calculate speed, decrease the frequent cost crossing car of statistics simultaneously.
Embodiment 3
As it is shown on figure 3, for based on the frequent method crossing car of distributed statistics described in the embodiment of the present invention 3
One optional specific embodiment.The step of the present embodiment is as follows:
Step 301, arrange bayonet socket information set in advance, information of vehicles and cross car time requirement be: mistake
The car time, during 2016-03-01 to 2016-03-03, believes through the numbered vehicle of 1,2,3 of bayonet socket
Breath is: the car data of crossing of popular brand carries out filtering, adding up.
Step 302, the distributed node crossing car storage system obtains meet in step 301 and set in advance
The car data excessively of fixed condition.
Each node judging, whether each car data excessively meets above three condition successively, chooses and meet
What above-mentioned condition required crosses car data, runs into not meet and any one in above three condition all gives up to fall,
And continue next traversal crossing car data and judgement.
Step 303, in each bayonet socket data chosen, judge whether that vehicle license plate number is consistent
Cross car data, and each the train number number of crossing crossing car data finding out same vehicle license plate number merges guarantor
Deposit.Travel through all vehicles in each bayonet socket data crosses car number information, each bayonet socket final after merging
Cross in car data set and cross train number number according to what vehicle license plate number retained each vehicle at this bayonet socket.
Wherein, concrete steps include:
(1) car data of crossing of previous node data after Preliminary screening and node below is carried out time
Go through and compare.If a certain bayonet socket information below in node does not exists in crossing in car data of previous node,
Then the car data value of crossing of this bayonet socket information and this bayonet socket is added in previous node.
(2) if some bayonet socket information crossed in car data of previous node is also deposited in node below
, then travel through it and cross car data.If it is crossed identical " number-plate number n " in car data, then will
Crossing in the corresponding mistake car data crossing train number numerical value and node below of corresponding bayonet socket in car data of previous node
The corresponding train number numerical value of crossing of corresponding bayonet socket is added, and save as corresponding vehicle crosses train number number；
(3) if some number-plate number in car data of crossing in previous node is not deposited in node below
, then the corresponding train number numerical value of crossing of corresponding bayonet socket in car data of crossing of described previous node is saved as this car
Cross train number number at corresponding bayonet socket.
(4) data so using previous node and other node below merge, until all nodes
Merging completes, and the car data excessively finally given is in each bayonet socket the car data excessively of every chassis.
Step 304, to preset train number number threshold requirement be the train number number of crossing not less than 4 times, then time
In each bayonet socket obtained after going through merging, the car data excessively of every chassis, rejected train number number and was less than 4 times
Cross car data.Concrete steps include:
(1) the train number number excessively that in each bayonet socket, first bayonet socket of the car data excessively of every chassis is corresponding is obtained
Value.This is crossed train number numerical value resolve, if a certain vehicle cross train number number less than 4, then by its from
In each bayonet socket, crossing in car data of every chassis removes, otherwise not operation.
After train number numerical value traversal crossed by each chassis that (2) first bayonet sockets are corresponding, if crossing train number number
Value also has corresponding data, does not processes；Otherwise reject each chassis mistake of this bayonet socket and its correspondence
Train number numerical value.
(3) car data excessively of every chassis in each bayonet socket, the car number excessively to each bayonet socket preserved are traveled through
Process according to according to step (1) and (2), this frequent statistical data crossing car of final acquisition.
According to the method based on the frequent car excessively of distributed statistics described in the present embodiment, at the data statistics initial stage
First filtering out the car data of crossing of the requirement that conforms to a predetermined condition, then train number crossed by the every chassis adding up each bayonet socket
After number, utilize the frequent car frequency threshold value of crossing crossing car predetermined to select and add up the information frequently crossing car, looking into
In inquiry, statistic processes, the information of each vehicle is all without there being omission, it is ensured that add up the frequent standard crossing car
Really property.
Embodiment 4
As shown in Figure 4, for based on the frequent system crossing car of distributed statistics disclosed in the present embodiment
The structural representation of individual alternative embodiment.Based on distributed full-text search system described in the present embodiment
The system of bayonet vehicle search includes: processing module 401, sending module 402, receiver module 403, return
Shelves merging module 404 and statistical module 405, wherein,
Described processing module 401, merges module with described sending module 402, receiver module 403 and filing
404 phase Rhizoma Nelumbinis connect, for according to presetting frequently, car statistical condition generation statistics is frequent crosses car request；
Described sending module 402, connects with described processing module 401 phase Rhizoma Nelumbinis, for distributed storage system
Each node of system sends the frequent car of crossing of statistics and asks.
Described receiver module 403, connects with described processing module 401 phase Rhizoma Nelumbinis, is used for receiving each node root
According to described frequent cross car request determine meet bayonet socket information set in advance, information of vehicles and cross car time
Between the card that requires make a slip of the tongue car data, and car data of being made a slip of the tongue by described card is by bayonet socket information and the lattice of vehicles identifications
Formula preserves；Wherein, described vehicles identifications includes: the number-plate number and excessively train number number.
Described filing merges module 404, connects with described processing module 401 phase Rhizoma Nelumbinis, for traveling through preservation
Described card is made a slip of the tongue car data, and merge each bayonet socket crosses car data, adds up every chassis in each bayonet socket data
Cross train number number preserving.
Described statistical module 405, merges module 404 phase Rhizoma Nelumbinis with described filing and connects, and is used for traveling through each card
In Kou, the train number number excessively of every chassis, crosses car frequency threshold value according to set in advance, deleted train number number not
Meeting the car data of crossing of threshold requirement, statistics obtains frequently crossing the bayonet socket information of car, information of vehicles, crossing car
Time and excessively train number number also preserve.
Above-mentioned receiver module 403, is further used for giving up each node and asks according to described frequent car of crossing
Determine does not meets bayonet socket information set in advance, information of vehicles and crosses the card of car time and make a slip of the tongue car data.
Described receiver module 403, is additionally operable to further:
Distributed service framework (zookeeper) is utilized to obtain symbol from each node of distributed memory system
Close bayonet socket information set in advance, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data.
Distributed service framework (zookeeper) is a distributed application program coordination service increased income,
Being the significant components of Hadoop, it is the software providing Consistency service for Distributed Application, carries
The function of confession includes: configuring maintenance, domain name service, distributed synchronization, group service etc..
Described filing merges module 404, is further used for:
The car data of crossing of the identical bayonet socket traversed is merged in same set；
In each bayonet socket set, all train number numbers excessively of the same number-plate number are added and obtain this license plate number
Code corresponding vehicle crossing train number number and preserving at corresponding bayonet socket.
Wherein, described card car data of making a slip of the tongue farther includes: bayonet socket numbering, the number-plate number, body color,
Vehicle model, vehicle running state, excessively train number number and mistake car time.
Cross car and system based on distributed statistics is frequent described in the present embodiment, use distributed storage system
The administrative mechanism of system, filters out ineligible data according to requirement set in advance in rough estimates,
Eliminate numerous and diverse car data processing procedure excessively, thus reduce the data volume when carrying out integrating statistics,
Thus shorten the frequent operation time crossing car of statistics and calculate speed.
By each embodiment above, the method based on distributed statistics frequent mistake car of the present invention and
System exists and provides the benefit that:
(1) of the present invention based on the frequent method and system crossing car of distributed statistics, based on big data
The frequent of platform crosses car statistical method, receives and is distributed on the node of big data platform distributed storage
Formula operation result, carries out integration, statistics the most again, can be set up in a distributed manner by big data platform
On cheap business PC, and determine the size of distributed type assemblies according to practical situations such as the sizes of data volume,
The data of magnanimity can be stored, saved the frequent resource used crossing car of statistics, and can utilize point
Car data excessively is inquired about, is added up by cloth cluster concurrently, improves the frequent statistics effect crossing car of statistics
Rate.
(2) of the present invention based on the frequent method and system crossing car of distributed statistics, according to setting in advance
Fixed requirement filters out ineligible data in rough estimates, eliminates numerous and diverse car data of crossing and processes
Process, thus reduce the data volume when carrying out integrating statistics, thus shorten the frequent car excessively of statistics
Operation time and calculating speed.
(3) of the present invention based on the frequent method and system crossing car of distributed statistics, in data statistics
Initial stage first filters out the car data excessively required that conforms to a predetermined condition, then adds up every chassis mistake of each bayonet socket
After train number number, the frequent car frequency threshold value of crossing crossing car predetermined is utilized to select and add up the information frequently crossing car,
In inquiry, statistic processes, the information of each vehicle is all without there being omission, it is ensured that adds up frequent and crosses car
Accuracy.
Those skilled in the art it should be appreciated that embodiments of the invention can be provided as method, device or
Computer program.Therefore, the present invention can use complete hardware embodiment, complete software implementation,
Or combine the form of embodiment in terms of software and hardware.And, the present invention can use one or more
The computer-usable storage medium wherein including computer usable program code (includes but not limited to disk
Memorizer, CD-ROM, optical memory etc.) form of the upper computer program implemented.
Described above illustrate and describes some alternative embodiments of the present invention, but as previously mentioned, it should reason
Solve the present invention and be not limited to form disclosed herein, be not to be taken as the eliminating to other embodiments,
And can be used for various other combination, amendment and environment, and can in invention contemplated scope described herein,
It is modified by above-mentioned teaching or the technology of association area or knowledge.And those skilled in the art are carried out changes
Move and change is without departing from the spirit and scope of the present invention, the most all should be in the protection of claims of the present invention
In the range of.
Claims (10)
1. a method based on the frequent car excessively of distributed statistics, it is characterised in that including:
According to presetting frequently, car statistical condition generation statistics is frequent crossed car request；
Send the frequent car of crossing of described statistics to each node of distributed memory system to ask；
Receiving each node asks determine to meet card message set in advance according to described frequent car of crossing
Breath, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data, and described card is made a slip of the tongue car data by card
The form of message breath and vehicles identifications preserves；Wherein, described vehicles identifications includes: the number-plate number and
Cross train number number；
The described card that traversal preserves is made a slip of the tongue car data, and merge each bayonet socket crosses car data, adds up each card
In mouth data, every chassis crosses train number number and preserves；
Travel through the train number number excessively of every chassis in each bayonet socket, cross car frequency threshold value according to set in advance,
Deleted train number number do not meet threshold requirement cross car data, statistics obtained frequently cross car bayonet socket information,
Information of vehicles, excessively car time and excessively train number number also preserve.
It is the most according to claim 1 based on the frequent method crossing car of distributed statistics, it is characterised in that
Farther include:
Giving up each node asks determine not meet card message set in advance according to described frequent car of crossing
Breath, information of vehicles and cross the card of car time and make a slip of the tongue car data.
It is the most according to claim 1 based on the frequent method crossing car of distributed statistics, it is characterised in that
The car data excessively of described each bayonet socket of merging, adds up the mistake train number number of every chassis in each bayonet socket data also
Preserve, farther include:
The car data of crossing of the identical bayonet socket traversed is merged in same set；
In each bayonet socket set, all train number numbers excessively of the same number-plate number are added and obtain this license plate number
Code corresponding vehicle crossing train number number and preserving at corresponding bayonet socket.
It is the most according to claim 1 based on the frequent method crossing car of distributed statistics, it is characterised in that
Each node of described reception asks determine to meet card message set in advance according to described frequent car of crossing
Breath, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data, and described card is made a slip of the tongue car data by card
The form of message breath and vehicles identifications preserves, and farther includes:
Distributed service framework is utilized to meet set in advance from each node acquisition of distributed memory system
Bayonet socket information, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data.
5. according to the method based on the frequent car excessively of distributed statistics according to any one of claim 1-4,
It is characterized in that, described card is made a slip of the tongue car data, farther includes: bayonet socket numbering, the number-plate number, vehicle body
Color, vehicle model, vehicle running state and mistake car time.
6. a system based on the frequent car excessively of distributed statistics, it is characterised in that including: processing module,
Sending module, receiver module, filing merge module and statistical module；Wherein,
Described processing module, for according to presetting frequently, car statistical condition generation statistics is frequent crosses car
Request；
Described sending module, please for sending the frequent car of crossing of statistics to each node of distributed memory system
Ask；
Described receiver module, asks determine to meet for receiving each node according to described frequent car of crossing
Bayonet socket information set in advance, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data, and by described
Block car data of making a slip of the tongue to preserve by the form of bayonet socket information and vehicles identifications；Wherein, described vehicles identifications
Including: the number-plate number and excessively train number number；
Described filing merges module, and the described card for traveling through preservation is made a slip of the tongue car data, merges each bayonet socket
Cross car data, add up the mistake train number number of every chassis in each bayonet socket data and preserve；
Described statistical module, for traveling through the train number number excessively of every chassis in each bayonet socket, according to setting in advance
Fixed crosses car frequency threshold value, deleted train number number and does not meets the car data of crossing of threshold requirement, and statistics obtains frequency
Numerous bayonet socket information of car excessively, information of vehicles, excessively car time and mistake train number number also preserve.
It is the most according to claim 6 based on the frequent system crossing car of distributed statistics, it is characterised in that
Described receiver module, is further used for:
Giving up each node asks determine not meet card message set in advance according to described frequent car of crossing
Breath, information of vehicles and cross the card of car time and make a slip of the tongue car data.
It is the most according to claim 6 based on the frequent system crossing car of distributed statistics, it is characterised in that
Described filing merges module, is further used for:
The car data of crossing of the identical bayonet socket traversed is merged in same set；
In each bayonet socket set, all train number numbers excessively of the same number-plate number are added and obtain this license plate number
Code corresponding vehicle crossing train number number and preserving at corresponding bayonet socket.
It is the most according to claim 6 based on the frequent system crossing car of distributed statistics, it is characterised in that
Described receiver module, is further used for:
Distributed service framework is utilized to meet set in advance from each node acquisition of distributed memory system
Bayonet socket information, information of vehicles and cross the card of car time requirement and make a slip of the tongue car data.
10. according to the system based on the frequent car excessively of distributed statistics according to any one of claim 6-9,
It is characterized in that, described card is made a slip of the tongue car data, farther includes: bayonet socket numbering, the number-plate number, vehicle body
Color, vehicle model, vehicle running state, excessively train number number and mistake car time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610274065.4A CN105913656B (en) | 2016-04-28 | 2016-04-28 | Based on the frequent method and system for crossing vehicle of distributed statistics |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610274065.4A CN105913656B (en) | 2016-04-28 | 2016-04-28 | Based on the frequent method and system for crossing vehicle of distributed statistics |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105913656A true CN105913656A (en) | 2016-08-31 |
| CN105913656B CN105913656B (en) | 2019-04-09 |
Family
ID=56753031
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610274065.4A Active CN105913656B (en) | 2016-04-28 | 2016-04-28 | Based on the frequent method and system for crossing vehicle of distributed statistics |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105913656B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107798142A (en) * | 2017-11-24 | 2018-03-13 | 泰华智慧产业集团股份有限公司 | The method and device of concealment vehicle is analyzed based on big data |
| CN107862867A (en) * | 2017-11-08 | 2018-03-30 | 泰华智慧产业集团股份有限公司 | Based on big data for the first time enter the method and system of city vehicle analysis |
| CN107993444A (en) * | 2017-11-22 | 2018-05-04 | 紫光捷通科技股份有限公司 | The suspicion car identification of car big data analysis is crossed based on bayonet |
| CN108022428A (en) * | 2016-11-02 | 2018-05-11 | 杭州海康威视系统技术有限公司 | A kind of vehicle identification method and device |
| CN110021161A (en) * | 2018-01-09 | 2019-07-16 | 株式会社日立制作所 | A kind of prediction technique and system of traffic direction |
| CN110136452A (en) * | 2018-02-08 | 2019-08-16 | 杭州海康威视数字技术股份有限公司 | A kind of car statistics method and device |
| CN110749335A (en) * | 2019-10-24 | 2020-02-04 | 成都路行通信息技术有限公司 | Method and system for calculating average mileage from owner to unit in target area |
| CN111199644A (en) * | 2020-01-06 | 2020-05-26 | 山东合天智汇信息技术有限公司 | Method and system for automatically fitting people and vehicles |
| CN111368617A (en) * | 2019-07-31 | 2020-07-03 | 杭州海康威视系统技术有限公司 | Vehicle access data processing method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104199903A (en) * | 2014-08-27 | 2014-12-10 | 上海熙菱信息技术有限公司 | Vehicle data query system and method based on path correlation |
| CN104616494A (en) * | 2014-12-23 | 2015-05-13 | 浙江宇视科技有限公司 | Method and device for recording and determining target object based on base station and block port |
| CN104750800A (en) * | 2014-11-13 | 2015-07-01 | 安徽四创电子股份有限公司 | Motor vehicle clustering method based on travel time characteristic |
| CN105447617A (en) * | 2015-11-06 | 2016-03-30 | 上海熙菱信息技术有限公司 | Vehicle track data analysis-based early-warning integrating method and system |
| CN105513368A (en) * | 2015-11-26 | 2016-04-20 | 银江股份有限公司 | Uncertain information-based method for screening vehicles with false license plates |
-
2016
- 2016-04-28 CN CN201610274065.4A patent/CN105913656B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104199903A (en) * | 2014-08-27 | 2014-12-10 | 上海熙菱信息技术有限公司 | Vehicle data query system and method based on path correlation |
| CN104750800A (en) * | 2014-11-13 | 2015-07-01 | 安徽四创电子股份有限公司 | Motor vehicle clustering method based on travel time characteristic |
| CN104616494A (en) * | 2014-12-23 | 2015-05-13 | 浙江宇视科技有限公司 | Method and device for recording and determining target object based on base station and block port |
| CN105447617A (en) * | 2015-11-06 | 2016-03-30 | 上海熙菱信息技术有限公司 | Vehicle track data analysis-based early-warning integrating method and system |
| CN105513368A (en) * | 2015-11-26 | 2016-04-20 | 银江股份有限公司 | Uncertain information-based method for screening vehicles with false license plates |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108022428A (en) * | 2016-11-02 | 2018-05-11 | 杭州海康威视系统技术有限公司 | A kind of vehicle identification method and device |
| CN108022428B (en) * | 2016-11-02 | 2021-05-25 | 杭州海康威视系统技术有限公司 | Vehicle identification method and device |
| CN107862867B (en) * | 2017-11-08 | 2019-08-27 | 泰华智慧产业集团股份有限公司 | The method and system for entering city vehicle analysis for the first time are carried out based on big data |
| CN107862867A (en) * | 2017-11-08 | 2018-03-30 | 泰华智慧产业集团股份有限公司 | Based on big data for the first time enter the method and system of city vehicle analysis |
| CN107993444A (en) * | 2017-11-22 | 2018-05-04 | 紫光捷通科技股份有限公司 | The suspicion car identification of car big data analysis is crossed based on bayonet |
| CN107798142A (en) * | 2017-11-24 | 2018-03-13 | 泰华智慧产业集团股份有限公司 | The method and device of concealment vehicle is analyzed based on big data |
| CN110021161A (en) * | 2018-01-09 | 2019-07-16 | 株式会社日立制作所 | A kind of prediction technique and system of traffic direction |
| CN110136452A (en) * | 2018-02-08 | 2019-08-16 | 杭州海康威视数字技术股份有限公司 | A kind of car statistics method and device |
| CN111368617A (en) * | 2019-07-31 | 2020-07-03 | 杭州海康威视系统技术有限公司 | Vehicle access data processing method and device |
| CN111368617B (en) * | 2019-07-31 | 2023-11-24 | 杭州海康威视系统技术有限公司 | Vehicle access data processing method and device |
| CN110749335A (en) * | 2019-10-24 | 2020-02-04 | 成都路行通信息技术有限公司 | Method and system for calculating average mileage from owner to unit in target area |
| CN110749335B (en) * | 2019-10-24 | 2021-05-04 | 成都路行通信息技术有限公司 | Method and system for calculating average mileage from owner to unit in target area |
| CN111199644A (en) * | 2020-01-06 | 2020-05-26 | 山东合天智汇信息技术有限公司 | Method and system for automatically fitting people and vehicles |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105913656B (en) | 2019-04-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105913656A (en) | Distributed statistics based method and system for frequently passing vehicles | |
| CN107147639B (en) | A kind of actual time safety method for early warning based on Complex event processing | |
| CN107247718B (en) | Map data updating method and device, navigation system and server | |
| CN104348667B (en) | Fault Locating Method based on warning information | |
| CN106528865A (en) | Quick and accurate cleaning method of traffic big data | |
| CN107798079A (en) | Section joining method and system based on track of vehicle data | |
| CN104952248B (en) | A kind of vehicle convergence Forecasting Methodology based on Euclidean space | |
| CN106251637A (en) | A kind of intelligent parking lot licence plate recognition method | |
| CN110263022B (en) | Hotel data matching method and device | |
| CN106205120B (en) | A kind of method and device for extracting road cross traffic limitation | |
| CN105788264A (en) | Hbase-based barrier data area collision analysis method and Hbase-based barrier data area collision analysis system | |
| CN104462222A (en) | Distributed storage method and system for checkpoint vehicle pass data | |
| CN105741553A (en) | Method for identifying parking road segment in vehicle track based on dynamic threshold | |
| CN107610471A (en) | Vehicle fake-license detection method and system | |
| CN105426375A (en) | Relationship network calculation method and apparatus | |
| KR100898465B1 (en) | Data storage and inquiry method for time series analysis of weblog and system for executing the method | |
| CN104199903A (en) | Vehicle data query system and method based on path correlation | |
| CN104021205A (en) | Method and device for establishing microblog index | |
| CN108615359B (en) | Vehicle foothold analysis method and device | |
| CN107679075A (en) | Method for monitoring network and equipment | |
| CN107862867B (en) | The method and system for entering city vehicle analysis for the first time are carried out based on big data | |
| CN106156170A (en) | The analysis of public opinion method and device | |
| CN104731908A (en) | ETL-based data cleaning method | |
| CN109064342A (en) | Client identity recognition methods and device | |
| CN106097708A (en) | One determines method and device with car |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |