CN105897706A - Universal analysis processing method of traffic data - Google Patents
Universal analysis processing method of traffic data Download PDFInfo
- Publication number
- CN105897706A CN105897706A CN201610198252.9A CN201610198252A CN105897706A CN 105897706 A CN105897706 A CN 105897706A CN 201610198252 A CN201610198252 A CN 201610198252A CN 105897706 A CN105897706 A CN 105897706A
- Authority
- CN
- China
- Prior art keywords
- data
- resolved
- configuration information
- dynamic link
- protocol
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/26—Special purpose or proprietary protocols or architectures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/03—Protocol definition or specification
Abstract
The invention discloses a universal analysis processing method of traffic data. The method comprises the steps of: 1, generating a dynamic link library; 11, according to the uniqueness of traffic industry data, adopting a pre-defined XML Schema format to expand and define data elements of data to be analyzed; 12, defining a protocol, wherein the protocol defines an information service ID, an affiliation unit and service message content; 13, generating configuration information according to the defined protocol, wherein the configuration information defines the element information and types of the data to be analyzed and defines the corresponding relations with each element in the XML Schema; 14, analyzing the configuration information, which is defined by the protocol, of the data to be analyzed, and analyzing the data to be analyzed into the dynamic link library of a standard protocol according to the configuration information; and 2, in the traffic data processing process, firstly obtaining the data to be analyzed, carrying out pre-processing on the data to be analyzed according to the dynamic link library, and executing corresponding operation instructions after the pre-processing.
Description
Technical field
The present invention relates to technical field of data processing, be specifically related to a kind of general distribution method that traffic data is carried out dissection process.
Background technology
The IT application of the transportation industry is through development for many years, establish many business application systems, these systems are that solid foundation has been established in industrial application of information technology construction, but owing to each transportation industry department is when setting up informatization platform, be substantially and go out to send construction with self-demand, the most each informatization platform have do things in his own way, incompatible problem, lack the overall situation unified planning, make the information between each department not smooth, it is impossible to accomplish that information is shared in time.Along with deeply and developing widely of Internet technology, people are the most increasing to the demand of data exchange and sharing, are badly in need of developing the data process machine system of a kind of versatility, solve the problem that existing information platform is incompatible.
Summary of the invention
Therefore, for above-mentioned problem, the present invention proposes the general analyzing and processing method of a kind of traffic data, existing complicated and diversified transportation industry data can be carried out efficient, safe, data parsing flexibly and process, to solve the deficiency of prior art.
In order to solve above-mentioned technical problem, the technical solution adopted in the present invention is, the general analyzing and processing method of a kind of traffic data, including following process:
Step 1: generate dynamic link library: according to configuration information, data parsing to be resolved is become the dynamic link library of standard agreement, specifically include following process:
Step 11: according to the uniqueness of transportation industry data, uses predefined XML Schema(extensible markup language) data element of data to be resolved is extended and defines by form；Predefined XML Schema form describes the Property Name of data to be resolved (traffic data key element), protocol type and weave connection relation；
Step 12: definition agreement, this protocol conventions information service ID, ownership unit and service message content；
Step 13: the protocol generation configuration information that will define；Configuration information defines element information and the type of data to be resolved (source transportation industry data), and has arranged and corresponding relation between each element in XML Schema；
Step 14: the configuration information of the data to be resolved of analysis protocol definition, becomes the dynamic link library of standard agreement according to configuration information by data parsing to be resolved；Dynamic link library includes the element information of data to be resolved (all transportation industry data), (or being generated by developer) is automatically generated according to Code Template according to specification by configuration information, dynamic link library be as assembly presented in, loaded by the application program using this technical method and use, for the characteristic support of the field of traffic support to multiple dynamic link libraries.
Step 2: when processing traffic data, first obtain data to be resolved, according to dynamic link library, data to be resolved are carried out pretreatment, perform corresponding operational order after pretreatment again.
Dynamic link library realization on each programming language is different, and C++ is upper mainly to be realized in the way of dll file, and on Java, then dynamic load and modularization mode with Jar packet mode realizes.Such as OSGI provides the modular a series of specifications of mobilism towards the dynamic modeling system of Java.
Need to load dynamic link library system initialization when, the mode of follow-up employing periodic monitor is updated loading.System, processing all kinds of transportation industry data when, can select corresponding processing mode to carry out data parsing process according to data category.
It addition, perform corresponding operational order in above-mentioned steps 2, operational order therein includes storing the operation such as data, distribution data.The process being wherein stored in data (including log-on data and amendment data) is as follows: generates interface interchange parameter array by the requirement of each interface parameter list, then parameter array generates URL parameter string, the URL parameter string of generation is sent to platform interface；After platform interface receives URL parameter string, it is resolved, and be stored in platform respective attributes；
The process of distribution data is as follows: request data generates URL request string, the URL request string of generation is sent to platform interface；After platform interface receives URL request string, it is resolved, and perform this request data generation reply data, and data transmission will be replied to user side；The subscription information of rest interface log-on data distribution, subscription information is to store with the form of key-value in systems, subscription information contains the authority information of user side and each information service, authority information can get the subscribing relationship of data field, thus the subscription of data field rank can be realized.Such as positioning data of vehicles information, data source reports and contains (information of vehicles, longitude and latitude, warning message, speed mileage etc.), certain information service is not concerned with the warning message of vehicle, then need to safeguard this authority in subscribing relationship, after data distribution, this information service can only get information of vehicles and longitude and latitude, thus save the network bandwidth and improve data safety.
The present invention uses such scheme, initially sets up platform, and platform is to be realized by the dynamic link library that can identify configuration information, then data to be resolved are carried out pretreatment, obtain the configuration information that platform can identify automatically, then, loaded by this dynamic link library and resolved.
Further, in order to improve transmitting efficiency and ensure the confidentiality of data, in described step 2, the URL parameter string generated also being carried out base64 process, do so more conducively GET mode carries out the transmission of data.Base64 is one of coded system being commonly used in transmission 8Bit syllabified code, specifically see RFC2045～RFC2049, has the detail specification of MIME above.Base64 coding can be used for transmitting longer identification information under HTTP environment, such as, in Java Persistence system Hibernate, just have employed Base64 and one longer unique identifier (UUID of generally 128-bit) is encoded to a character string, as the parameter in HTTP list and HTTP GET URL.In other application programs, the most usually needing binary data coding is to be suitable for being placed on URL(to include hiding form fields) in form.Now, using Base64 coding to have unreadable property, i.e. coded data with the naked eye will not be immediately seen by people.
Further, in order to prevent sending repeatedly the situation of same request at synchronization owing to network problem or other reasons cause, described URL request string includes request data, timestamp and queue number.Wherein, queue number (is designated as call_id), and the serial number that is call_id for the queue of request is the queue number asked each time, the api interface opened to all of platform initiates request when, all sends a call_id parameter.Timestamp is the system time that current request sends, and is accurate to millisecond value.Each time the call_id parameter of calling interface all can not equally, after once call should be bigger than front.Typically taking millisecond number the most permissible, if to call continuously, best do-it-yourself controls, and the most often calls once, and call_id is increased by 0.001.Platform uses call_id and timestamp to prevent owing to network problem or other reasons cause and sends repeatedly the situation of same request at synchronization.
This dissemination system can use configuration file and the mode of rest interface registration, it is not necessary to amendment program code can realize parsing and the distribution of data.Use the mode of dynamic link library, different analysis modes, preferable usability, versatility can be used for different data forms.When in the face of complicated and diversified transportation industry data, there are efficient, safe, data parsing flexibly and process performance.
Detailed description of the invention
In conjunction with detailed description of the invention, the present invention is further described.
The present invention provides the dissemination system that a kind of general-purpose data parsing processes, this system mainly comprises following subsystem: the configuration information of analysis protocol definition, the subscription information becoming the dynamic link library of standard agreement, rest interface log-on data to distribute data parsing according to configuration information, can realize the subscription of data field rank.
Concrete, the technical solution adopted in the present invention is, the general analyzing and processing method of a kind of traffic data, including following process:
Step 1: generate dynamic link library: according to configuration information, data parsing to be resolved is become the dynamic link library of standard agreement, specifically include following process:
Step 11: according to the uniqueness of transportation industry data, uses predefined XML Schema form that the data element of data to be resolved is extended and is defined；Predefined XML Schema form describes the Property Name of data to be resolved (traffic data key element), protocol type and weave connection relation；Wherein, XML Schema(extensible markup language) it is a kind of language describing XML document, describe the Property Name of traffic element, protocol type, weave connection relation etc.；
Step 12: definition agreement, the main several information service ID of protocol conventions, ownership unit, service message content etc., and the mode of expansible element information is provided；
Step 13: the protocol generation configuration information that will define；Configuration information defines element information and the type of data to be resolved (source transportation industry data), and has arranged and corresponding relation between each element in XML Schema；Configuration information need to provide information service ID corresponding to these data and ownership unit, and other extension information then can be according to the self-defined interpolation of data characteristic；
Step 14: according to configuration information, data parsing to be resolved is become the dynamic link library of standard agreement；Dynamic link library includes all elements information of data to be resolved, automatically generated according to specification by configuration information or generated according to Code Template by developer, dynamic link library be as assembly presented in, loaded by the application program using this technical method and use, for the characteristic support of the field of traffic support to multiple dynamic link libraries；
Dynamic link library has multi-form according to the difference of each programming language, such as realize in the way of dll file on C++, and on Java, then dynamic load and modularization mode with Jar packet mode realizes.The dynamic link library of standard agreement, refers to provide the modular a series of specifications of mobilism according to existing standard protocol realization, such as OSGI towards the dynamic modeling system of Java；
Step 2: when processing traffic data, first obtain data to be resolved, according to dynamic link library, data to be resolved are carried out pretreatment, perform corresponding operational order after pretreatment again.When being stored in data (including log-on data and amendment data): generate interface interchange parameter array by the requirement of each interface parameter list, then parameter array is generated URL parameter string, the URL parameter string of generation is sent to platform interface；After platform interface receives URL parameter string, it is resolved, and be stored in platform respective attributes；
During distribution data: request data is generated URL request string, the URL request string of generation is sent to platform interface；After platform interface receives URL request string, it is resolved, and perform this request data generation reply data, and data transmission will be replied to user side；The subscription information of rest interface log-on data distribution, can realize the subscription of data field rank.
In order to improve transmitting efficiency and ensure the confidentiality of data, in said process, the URL parameter string generated also being carried out base64 process, do so more conducively GET mode carries out the transmission of data.Base64 is one of coded system being commonly used in transmission 8Bit syllabified code, specifically see RFC2045～RFC2049, has the detail specification of MIME above.Base64 coding can be used for transmitting longer identification information under HTTP environment, such as, in Java Persistence system Hibernate, just have employed Base64 and one longer unique identifier (UUID of generally 128-bit) is encoded to a character string, as the parameter in HTTP list and HTTP GET URL.In other application programs, the most usually needing binary data coding is to be suitable for being placed on URL(to include hiding form fields) in form.Now, using Base64 coding to have unreadable property, i.e. coded data with the naked eye will not be immediately seen by people.
In order to prevent sending repeatedly the situation of same request at synchronization owing to network problem or other reasons cause, described URL request string includes request data, timestamp and queue number.Wherein, queue number (is designated as call_id), and the serial number that is call_id for the queue of request is the queue number asked each time, the api interface opened to all of platform initiates request when, all sends a call_id parameter.Timestamp is the system time that current request sends, and is accurate to millisecond value.Each time the call_id parameter of calling interface all can not equally, after once call should be bigger than front.Typically taking millisecond number the most permissible, if to call continuously, best do-it-yourself controls, and the most often calls once, and call_id is increased by 0.001.Platform uses call_id and timestamp to prevent owing to network problem or other reasons cause and sends repeatedly the situation of same request at synchronization.
This dissemination system can use configuration file and the mode of rest interface registration, it is not necessary to amendment program code can realize parsing and the distribution of data.Use the mode of dynamic link library, different analysis modes, preferable usability, versatility can be used for different data forms.When in the face of complicated and diversified transportation industry data, there are efficient, safe, data parsing flexibly and process performance.
Although specifically showing in conjunction with preferred embodiment and describing the present invention; but those skilled in the art should be understood that; in the spirit and scope of the present invention limited without departing from appended claims; the present invention can be made a variety of changes in the form and details, be protection scope of the present invention.
Claims (4)
1. a general analyzing and processing method for traffic data, including following process:
Step 1: generate dynamic link library: according to configuration information, data parsing to be resolved is become the dynamic link library of standard agreement, specifically include following process:
Step 11: according to the uniqueness of transportation industry data, uses predefined XML Schema form that the data element of data to be resolved is extended and is defined；Predefined XML Schema form describes the Property Name of data to be resolved, protocol type and weave connection relation；
Step 12: definition agreement, this protocol conventions information service ID, ownership unit and service message content；
Step 13: the protocol generation configuration information that will define；Configuration information defines element information and the type of data to be resolved, and has arranged and corresponding relation between each element in XML Schema；
Step 14: the configuration information of the data to be resolved of analysis protocol definition, becomes the dynamic link library of standard agreement according to configuration information by data parsing to be resolved；
Step 2: when processing traffic data, first obtain data to be resolved, according to dynamic link library, data to be resolved are carried out pretreatment, perform corresponding operational order after pretreatment again.
The general analyzing and processing method of a kind of traffic data the most according to claim 1, it is characterised in that: in described step 2, perform corresponding operational order and specifically include following process:
When being stored in data: generate interface interchange parameter array by the requirement of each interface parameter list, then parameter array is generated URL parameter string, the URL parameter string of generation is sent to platform interface；After platform interface receives URL parameter string, it is resolved, and be stored in platform respective attributes；
During distribution data: request data is generated URL request string, the URL request string of generation is sent to platform interface；After platform interface receives URL request string, it is resolved, and perform this request data generation reply data, and data transmission will be replied to user side.
The general analyzing and processing method of a kind of traffic data the most according to claim 2, it is characterised in that: in described step 2, when generating URL parameter string, the URL parameter string generated also is carried out base64 process.
The general analyzing and processing method of a kind of traffic data the most according to claim 2, it is characterised in that: described URL request string includes request data, timestamp and queue number.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610198252.9A CN105897706B (en) | 2016-04-01 | 2016-04-01 | A kind of general analyzing and processing method of traffic data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610198252.9A CN105897706B (en) | 2016-04-01 | 2016-04-01 | A kind of general analyzing and processing method of traffic data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105897706A true CN105897706A (en) | 2016-08-24 |
| CN105897706B CN105897706B (en) | 2019-01-18 |
Family
ID=57012039
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610198252.9A Active CN105897706B (en) | 2016-04-01 | 2016-04-01 | A kind of general analyzing and processing method of traffic data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105897706B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106448157A (en) * | 2016-09-05 | 2017-02-22 | 天津中兴智联科技有限公司 | Traffic data platform adapter realizing method and system |
| CN110808982A (en) * | 2019-11-05 | 2020-02-18 | 积成电子股份有限公司 | Communication protocol establishing method and system based on registration mechanism |
| CN111221532A (en) * | 2019-12-23 | 2020-06-02 | 北京轩宇信息技术有限公司 | Method and device for generating dynamic link library |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050091231A1 (en) * | 2003-10-24 | 2005-04-28 | Shankar Pal | System and method for storing and retrieving XML data encapsulated as an object in a database store |
| CN1622095A (en) * | 2004-12-27 | 2005-06-01 | 中国科学院软件研究所 | Method of storing extensible markup language file and inserting relational database sheet |
| CN104320396A (en) * | 2014-10-28 | 2015-01-28 | 用友优普信息技术有限公司 | Data interaction device and method |
| CN105335310A (en) * | 2014-06-05 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Interface defining method, and data transmission method and apparatus |
-
2016
- 2016-04-01 CN CN201610198252.9A patent/CN105897706B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050091231A1 (en) * | 2003-10-24 | 2005-04-28 | Shankar Pal | System and method for storing and retrieving XML data encapsulated as an object in a database store |
| CN1622095A (en) * | 2004-12-27 | 2005-06-01 | 中国科学院软件研究所 | Method of storing extensible markup language file and inserting relational database sheet |
| CN105335310A (en) * | 2014-06-05 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Interface defining method, and data transmission method and apparatus |
| CN104320396A (en) * | 2014-10-28 | 2015-01-28 | 用友优普信息技术有限公司 | Data interaction device and method |
Non-Patent Citations (2)
| Title |
|---|
| 王霜: "基于Schema文档的XML文档验证系统的设计", 《沈阳师范大学学报(自然科学版)》 * |
| 胡德敏等: "基于CORBA、XML的交通综合信息平台的研究与设计", 《计算机工程与设计》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106448157A (en) * | 2016-09-05 | 2017-02-22 | 天津中兴智联科技有限公司 | Traffic data platform adapter realizing method and system |
| CN110808982A (en) * | 2019-11-05 | 2020-02-18 | 积成电子股份有限公司 | Communication protocol establishing method and system based on registration mechanism |
| CN110808982B (en) * | 2019-11-05 | 2022-02-01 | 积成电子股份有限公司 | Communication protocol establishing method and system based on registration mechanism |
| CN111221532A (en) * | 2019-12-23 | 2020-06-02 | 北京轩宇信息技术有限公司 | Method and device for generating dynamic link library |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105897706B (en) | 2019-01-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108280367A (en) | Management method, device, computing device and the storage medium of data manipulation permission | |
| US20190089749A1 (en) | Method for providing wireless application privilege management | |
| WO2009055492A1 (en) | Model-based composite application platform | |
| US20170149915A1 (en) | System and method of feed data transmission | |
| WO2009055490A2 (en) | Model-based composite application platform | |
| US10171630B2 (en) | Executing remote commands | |
| CN110535928B (en) | Event pushing method for JAVA intelligent contract of block chain | |
| EP2926238A1 (en) | Running agents to execute automation tasks in cloud systems | |
| CN107925857A (en) | For the customization resource type of machine-to-machine communication | |
| CN105897706A (en) | Universal analysis processing method of traffic data | |
| CN115516840A (en) | Information processing method, device, system, medium, chip and program | |
| US10924527B2 (en) | Dynamic workflow-based composite web service system and method | |
| US9160767B2 (en) | System and method for device management security of trap management object | |
| CN113691635A (en) | Method and device for calling micro service, electronic equipment and readable storage medium | |
| FI120286B (en) | A method and device arrangement for managing a server-client environment | |
| CN111953716B (en) | Message communication method, system, computer device and storage medium | |
| CN113556359B (en) | Communication protocol conversion method, device, system and gateway device | |
| Hackmann et al. | Extending BPEL for interoperable pervasive computing | |
| EP1574980A1 (en) | Context objects for accessing message content | |
| CN109618187B (en) | Video data acquisition method and device | |
| De et al. | Towards Translation of Semantics of Automotive Interface Description Models from Franca to AUTOSAR Frameworks: An Approach using Semantic Synergies | |
| CN113992736B (en) | Interconnection method of structured data based on cloud computing service platform and server | |
| CN101521592B (en) | Method and device for establishing the SNMP agent of printer | |
| CN113918245A (en) | Data calling method, device, equipment and computer readable storage medium | |
| WO2017000256A1 (en) | Positioning method and corresponding apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |