CN107995062B - RPC-based traffic management integrated platform remote service real-time processing method and system - Google Patents

RPC-based traffic management integrated platform remote service real-time processing method and system Download PDF

Info

Publication number
CN107995062B
CN107995062B CN201711271128.1A CN201711271128A CN107995062B CN 107995062 B CN107995062 B CN 107995062B CN 201711271128 A CN201711271128 A CN 201711271128A CN 107995062 B CN107995062 B CN 107995062B
Authority
CN
China
Prior art keywords
service
formal
nodes
remote
calling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711271128.1A
Other languages
Chinese (zh)
Other versions
CN107995062A (en
Inventor
邵志骅
孙嘉冬
崔林山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Traffic Management Research Institute of Ministry of Public Security
Original Assignee
Traffic Management Research Institute of Ministry of Public Security
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Traffic Management Research Institute of Ministry of Public Security filed Critical Traffic Management Research Institute of Ministry of Public Security
Priority to CN201711271128.1A priority Critical patent/CN107995062B/en
Publication of CN107995062A publication Critical patent/CN107995062A/en
Application granted granted Critical
Publication of CN107995062B publication Critical patent/CN107995062B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • H04L67/1023Server selection for load balancing based on a hash applied to IP addresses or costs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • G06Q50/40
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0805Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/10Network architectures or network communication protocols for network security for controlling access to devices or network resources
    • H04L63/101Access control lists [ACL]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/51Discovery or management thereof, e.g. service location protocol [SLP] or web services

Abstract

The invention provides a RPC-based real-time processing method and a system for the foreign service of a traffic management integrated platform, which can realize the real-time acquisition of foreign data and the real-time interaction of foreign service handling information when a large number of traffic management integrated platform service nodes handle foreign services in China, perfect the foreign service handling process, realize the real-time service interaction, resolve the IP lists of all server nodes from a supervision system record server list, select a service node to be checked, perform availability detection on the selected service node to be checked, remove invalid nodes, form a formal service node list through the formal service node list of the availability detection, sequentially and circularly call the formal service nodes in the formal service nodes according to a service routing mechanism when a call request for handling the foreign service is sent by a service initiator working library, and the available formal service nodes respond to the call request, and performing service processing and returning service execution information.

Description

RPC-based traffic management integrated platform remote service real-time processing method and system
Technical Field
The invention relates to the technical field of remote service processing of a public security traffic management information system, in particular to a remote service real-time processing method and system of a traffic management comprehensive platform based on RPC.
Background
At present, all service information systems for national traffic management are established and applied in a large scale, such as: the number of application data nodes of the national public security traffic management integrated application platform is up to 340, and the number of teams using the service system is up to 470. In addition, the amount of newly added illegal record data in the whole country is hundreds of millions, millions if less data are accumulated by each data node, and tens of millions if more data are accumulated. Besides huge data volume, the service functions are quite abundant, the number of service function modules in each service system is thousands, and the services can be divided into local services and remote services according to regions. Because the comprehensive platform is deployed at provincial and urban levels, when the remote service is handled, three-level data exchange of department, provincial and urban levels is needed, the time consumption is too long, the remote service cannot be handled in time, and the problems that the driver scores inaccurately, the service handling data cannot be updated in time and the like often occur.
Disclosure of Invention
The invention provides a RPC-based real-time processing method and a RPC-based real-time processing system for remote service of a traffic management integrated platform, which can realize real-time acquisition of remote data and real-time interaction of remote service handling information when a large number of traffic management integrated platform service nodes in the country handle remote services, improve remote service handling processes and realize real-time service interaction.
The technical scheme is as follows: a RPC-based traffic control integrated platform remote service real-time processing method is characterized by comprising the following steps:
screening formal service nodes: decomposing IP lists of all server nodes from a supervision system record server list, combing non-public security network IP, non-latest version and currently inactive nodes, selecting service nodes to be checked, carrying out availability detection on the selected service nodes to be checked, and removing invalid nodes;
remote service invocation: and forming a formal service node list by the formal service node list which passes the availability detection, when a remote calling request for transacting the allopatric service is sent by the initiator working library, sequentially and circularly calling the formal service nodes in the formal service node list by the server working library, responding to the calling request by the available formal service nodes, processing the service, and returning service execution information.
Further, the process of handling the remote call request of the remote service comprises the following steps:
a. the initiator working library initiates a remote calling request for transacting the remote service;
b. carrying out HMACSHA256 encryption through a security management framework to generate a check code;
c. applying for a formal service node address to a target service side working library of the remote call request, sequentially and circularly calling formal service nodes in a formal service node list by the service side working library, if the application is successful, initiating connection to the available formal service nodes, and otherwise, sending the application again;
d. and the available formal service node verifies the white list of the initiator working library, verifies whether the initiator working library is in the local white list or not, and responds to the request if the initiator working library is in the local white list.
e. Checking the check code by the formal service node through a security management framework, and responding to the calling request if the check is correct;
f. the formal service node performs service processing;
g. the formal service node generates a log;
h. the formal service node returns service execution information like the initiator working library;
i. the initiator working library records a corresponding log after receiving the service execution information and returns a result of the remote call request;
J. and finishing the calling.
A traffic management comprehensive platform remote service real-time processing system based on RPC is characterized in that:
comprises a department platform and a working library which are in communication connection, wherein the department platform is used for screening formal service nodes, the working library is used for calling remote services,
the department level platform comprises:
the service discovery module resolves all server IP lists from a supervision system record server list, combs nodes which are not public security network IP, not latest versions and not active at present, and selects a service node to be checked;
the service monitoring module is used for carrying out availability detection on the service node to be checked selected by the service discovery module and removing invalid nodes;
the work library includes:
the service list downloading module takes the service nodes to be checked detected by the service monitoring module as formal service nodes and forms a formal service node list for downloading;
the calling module is used for initiating a remote calling request for transacting the remote service according to the service requirement;
the service routing module carries out sequential cyclic calling on formal service nodes according to the remote calling request of the calling module and sends the addresses of the available formal service nodes to the calling module;
and the service module receives the remote calling request and feeds back a response.
Further, the system also comprises a security management framework, which is used for performing HMACSHA256 encryption and encryption verification;
furthermore, the system also comprises a HESSIAN remote invocation framework which is used for sending a service request to the service module of the available formal service node.
Further, the working library further comprises a state checking module, wherein the state checking module comprises a special state monitoring page used for monitoring whether the current server node normally operates or not, and the special state monitoring page comprises JDBC connection and working library white list data.
Further, the service routing module automatically marks a formal server node with a problem as unavailable for access to the formal server node.
Further, the invalid node comprises a server node which cannot be accessed across provinces due to a firewall.
The RPC-based traffic control comprehensive platform allopatric service real-time processing method divides service nodes of nationwide provinces and cities into grids, the grids become units for processing allopatric requests, formal service nodes are found by screening server nodes in a supervision system record server list and monitoring availability, invalid nodes are removed from a source, connection to the invalid nodes is avoided when allopatric services are handled, and the efficiency of allopatric service handling is improved; the formal service nodes in the target service party working library of the remote call request are sequentially and circularly called through the service route, the call pressure is averagely analyzed to each target server as much as possible, the pressure caused by accessing the same service node every time is ensured not to be caused, the efficiency of the whole system is improved, the operation load of a single server is reduced, the formal server nodes correspondingly call the request, service processing is carried out and service execution information is returned, the real-time acquisition of remote data and the real-time interaction of remote service handling information are realized, the remote service handling process is perfected, and the real-time service interaction is realized. The user experience can be improved.
Drawings
FIG. 1 is a system diagram of a RPC-based traffic control comprehensive platform remote service real-time processing system of the present invention;
fig. 2 is a flow chart of a call request for transacting a remote service in the RPC-based traffic control integrated platform remote service real-time processing method of the present invention.
Detailed Description
Referring to fig. 1 and 2, the invention relates to a RPC-based traffic control comprehensive platform allopatric service real-time processing method, which comprises the following steps:
screening formal service nodes: decomposing IP lists of all server nodes from a supervision system record server list, combing non-public security network IP, non-latest version and currently inactive nodes, selecting service nodes to be checked, carrying out availability detection on the selected service nodes to be checked, and removing invalid nodes;
remote service invocation: and forming a formal service node list by the formal service node list which passes the availability detection, when a remote calling request for transacting the allopatric service is sent by the initiator working library, sequentially and circularly calling the formal service nodes in the formal service node list by the server working library, responding to the calling request by the available formal service nodes, processing the service, and returning service execution information.
The process of transacting the remote call request of the remote service comprises the following steps:
a. the initiator working library initiates a remote calling request for transacting the remote service;
b. carrying out HMACSHA256 encryption through a security management framework to generate a check code;
c. applying for a formal service node address to a target service side working library of the remote call request, sequentially and circularly calling formal service nodes in a formal service node list by the service side working library, if the application is successful, initiating connection to the available formal service nodes, and otherwise, sending the application again;
d. and the available formal service node verifies the white list of the initiator working library, verifies whether the initiator working library is in the local white list or not, and responds to the request if the initiator working library is in the local white list.
e. Checking the check code by the formal service node through a security management framework, and responding to the calling request if the check is correct;
f. the formal service node performs service processing;
g. the formal service node generates a log;
h. the formal service node returns service execution information like the initiator working library;
i. the initiator working library records a corresponding log after receiving the service execution information and returns a result of the remote call request;
J. and finishing the calling.
A RPC-based traffic control comprehensive platform remote service real-time processing system comprises a department platform and a working library which are in communication connection, wherein the department platform is used for formal service node screening, the working library is used for remote service calling,
the department level platform comprises:
the service discovery module 1 is used for solving all server IP lists from a supervision system record server list, carding nodes which are not public security network IP, not latest version and currently inactive, and selecting service nodes to be checked;
a service monitoring module 2, configured to perform availability detection on the service node to be checked selected by the service discovery module 1, and remove invalid nodes, where the invalid nodes include server nodes that cannot be accessed across provinces due to firewalls
The work library includes:
the service list downloading module 3 takes the service nodes to be checked detected by the service monitoring module 2 as formal service nodes and forms a formal service node list for downloading;
the calling module 4 is used for initiating a remote calling request for transacting the remote service according to the service requirement;
the service routing module 5 is used for sequentially and circularly calling the formal service nodes according to the remote calling request of the calling module, sending the addresses of the available formal service nodes to the calling module 4, and automatically marking the formal server nodes as unavailable by the service routing module 5 for visiting the formal server nodes with problems;
the service module 6 receives the remote calling request and feeds back a response;
the state checking module 7, wherein the state checking module 7 comprises a special state monitoring page for monitoring whether the current server node normally operates, including the connection to JDBC and white list data of a working library;
in addition, the RPC-based traffic control comprehensive platform remote service real-time processing system further comprises:
the security management framework 8 is used for performing HMACSHA256 encryption and encryption verification;
the HESSIAN remote invocation framework 9 is used for sending service requests to the service modules 6 of the available formal service nodes.
The RPC-based traffic control comprehensive platform allopatric service real-time processing method divides service nodes of nationwide provinces and cities into grids, the grids become units for processing allopatric requests, formal service nodes are found by screening server nodes in a supervision system record server list and monitoring availability, invalid nodes are removed from a source, connection to the invalid nodes is avoided when allopatric services are handled, and the efficiency of allopatric service handling is improved; the formal service nodes in the target service party working library of the remote call request are sequentially and circularly called through the service route, the call pressure is averagely analyzed to each target server as much as possible, the pressure caused by accessing the same service node every time is ensured not to be caused, the efficiency of the whole system is improved, the operation load of a single server is reduced, the formal server nodes correspondingly call the request, service processing is carried out and service execution information is returned, the real-time acquisition of remote data and the real-time interaction of remote service handling information are realized, the remote service handling process is perfected, and the real-time service interaction is realized. The user experience can be improved.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (5)

1. A RPC-based traffic control integrated platform remote service real-time processing method is characterized by comprising the following steps:
screening formal service nodes: decomposing IP lists of all server nodes from a supervision system record server list, combing non-public security network IP, non-latest version and currently inactive nodes, selecting service nodes to be checked, carrying out availability detection on the selected service nodes to be checked, and removing invalid nodes;
remote service invocation: forming a formal service node list from the formal service node list passing availability detection, when an initiator working library sends a call request for transacting foreign services, sequentially and circularly calling the formal service nodes in the formal service node list by the service working library, responding the call request by the available formal service nodes, performing service processing, and returning service execution information;
the process of handling the call request of the remote service comprises the following steps:
a. the initiator working library initiates a remote calling request for transacting the remote service;
b. carrying out HMACSHA256 encryption through a security management framework to generate a check code;
c. applying for a formal service node address to a target service side working library of the remote call request, sequentially and circularly calling formal service nodes in a formal service node list by the service side working library, if the application is successful, initiating connection to the available formal service nodes, and otherwise, sending the application again;
d. the available formal service node verifies the white list of the initiator working library, verifies whether the initiator working library is in the local white list or not, and responds to the request if the initiator working library is in the local white list;
e. checking the check code by the formal service node through a security management framework, and responding to the calling request if the check is correct;
f. the formal service node performs service processing;
g. the formal service node generates a log;
h. the formal service node returns service execution information to the initiator working library;
i. the initiator working library records a corresponding log after receiving the service execution information and returns a result of the remote call request;
J. and finishing the calling.
2. A traffic management comprehensive platform remote service real-time processing system based on RPC is characterized in that:
comprises a department platform and a working library which are in communication connection, wherein the department platform is used for screening formal service nodes, the working library is used for calling remote services,
the department level platform comprises:
the service discovery module resolves all server IP lists from a supervision system record server list, combs nodes which are not public security network IP, not latest versions and not active at present, and selects a service node to be checked;
the service monitoring module is used for carrying out availability detection on the service node to be checked selected by the service discovery module and removing invalid nodes;
the work library includes:
the service list downloading module takes the service nodes to be checked detected by the service monitoring module as formal service nodes and forms a formal service node list for downloading;
the calling module is used for initiating a remote calling request for transacting the remote service according to the service requirement;
the service routing module carries out sequential cyclic calling on formal service nodes according to the remote calling request of the calling module and sends the addresses of the available formal service nodes to the calling module;
the service module receives the remote calling request and feeds back a response;
the system also comprises a HESSIAN remote calling framework which is used for sending a service request to a service module of an available formal service node;
the system also comprises a working library white list, wherein the working library white list is stored in the formal service node, and a legal initiator working library is stored in the white list;
the working library further comprises a state checking module, wherein the state checking module comprises a special state monitoring page used for monitoring whether the current server node normally operates or not, and the special state monitoring page comprises JDBC connection and working library white list data.
3. The RPC-based traffic control comprehensive platform allopatric service real-time processing system according to claim 2, wherein: and the system also comprises a security management framework which is used for carrying out HMACSHA256 encryption and encryption verification.
4. The RPC-based traffic control comprehensive platform allopatric service real-time processing system according to claim 2, wherein: and the service routing module automatically marks the formal server node as unavailable for visiting the formal server node with the problem.
5. The RPC-based traffic control comprehensive platform allopatric service real-time processing system according to claim 2, wherein: the invalid nodes include server nodes that are not accessible across provinces due to firewalls.
CN201711271128.1A 2017-12-05 2017-12-05 RPC-based traffic management integrated platform remote service real-time processing method and system Active CN107995062B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711271128.1A CN107995062B (en) 2017-12-05 2017-12-05 RPC-based traffic management integrated platform remote service real-time processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711271128.1A CN107995062B (en) 2017-12-05 2017-12-05 RPC-based traffic management integrated platform remote service real-time processing method and system

Publications (2)

Publication Number Publication Date
CN107995062A CN107995062A (en) 2018-05-04
CN107995062B true CN107995062B (en) 2021-03-23

Family

ID=62036073

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711271128.1A Active CN107995062B (en) 2017-12-05 2017-12-05 RPC-based traffic management integrated platform remote service real-time processing method and system

Country Status (1)

Country Link
CN (1) CN107995062B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110798411A (en) * 2018-08-03 2020-02-14 阿里巴巴集团控股有限公司 Service calling method, traffic scheduling method and device
CN111191080B (en) * 2019-08-22 2021-04-30 腾讯科技(深圳)有限公司 Data processing method and device
CN111464558B (en) * 2020-04-20 2022-03-01 公安部交通管理科学研究所 Data acquisition and transmission method for traffic safety comprehensive service management platform

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101076142A (en) * 2007-06-29 2007-11-21 南京骏环信息科技有限公司 System and method for paying traffic violation fine by SMS
CN101604312A (en) * 2007-12-07 2009-12-16 宗刚 The method and system of the searching, managing and communicating of information
CN101610190A (en) * 2009-07-22 2009-12-23 刘文祥 Data network and system
CN102231172A (en) * 2011-06-10 2011-11-02 王坦 Remote medical information acquisition system
CN105187375A (en) * 2015-06-16 2015-12-23 公安部交通管理科学研究所 Hadoop ecological assembly scheduling service realization method and system based on agent service
CN105553993A (en) * 2015-12-18 2016-05-04 广州华多网络科技有限公司 Remote service dispatching method and device and server
CN107111594A (en) * 2014-09-24 2017-08-29 V5系统公司 Dynamic data management

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150019620A1 (en) * 2013-07-09 2015-01-15 Kaminario Technologies Ltd. High availability for communications based on remote procedure calls

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101076142A (en) * 2007-06-29 2007-11-21 南京骏环信息科技有限公司 System and method for paying traffic violation fine by SMS
CN101604312A (en) * 2007-12-07 2009-12-16 宗刚 The method and system of the searching, managing and communicating of information
CN101610190A (en) * 2009-07-22 2009-12-23 刘文祥 Data network and system
CN102231172A (en) * 2011-06-10 2011-11-02 王坦 Remote medical information acquisition system
CN107111594A (en) * 2014-09-24 2017-08-29 V5系统公司 Dynamic data management
CN105187375A (en) * 2015-06-16 2015-12-23 公安部交通管理科学研究所 Hadoop ecological assembly scheduling service realization method and system based on agent service
CN105553993A (en) * 2015-12-18 2016-05-04 广州华多网络科技有限公司 Remote service dispatching method and device and server

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
远程过程调用与分布式应用设计实现;宋传杰;《微计算机应用》;19960531;第17卷(第3期);摘要 *

Also Published As

Publication number Publication date
CN107995062A (en) 2018-05-04

Similar Documents

Publication Publication Date Title
US10904277B1 (en) Threat intelligence system measuring network threat levels
KR102577139B1 (en) Smart contract-based data processing methods, devices, and storage media
EP3389219B1 (en) Access request conversion method and device
CN107995062B (en) RPC-based traffic management integrated platform remote service real-time processing method and system
CN107819891B (en) Data processing method, data processing device, computer equipment and storage medium
CN103685575A (en) Website security monitoring method based on cloud architecture
CN110719194B (en) Network data analysis method and device
CN107092686B (en) File management method and device based on cloud storage platform
CN108197486A (en) Big data desensitization method, system, computer-readable medium and equipment
CN112231168A (en) Micro server control method, device, equipment and storage medium
CN105512283A (en) Data quality management and control method and device
CN110602227B (en) Intelligent contract management method and related device
CN110597541B (en) Interface updating processing method, device, equipment and storage medium based on block chain
CN112241439A (en) Attack organization discovery method, device, medium and equipment
US8224933B2 (en) Method and apparatus for case-based service composition
CN106067879B (en) The detection method and device of information
CN114549068A (en) Short link generation method, equipment, device and computer readable storage medium
CN103139243A (en) File synchronization method based on star distributed system
CN105530137A (en) Traffic data analysis method and traffic data analysis system
US11805146B2 (en) System and method for detection promotion
CN110764838B (en) Service model loading method and system, electronic equipment and storage medium
CN110636072A (en) Target domain name scheduling method, device, equipment and storage medium
CN109213883B (en) Disaster model group service chain arranging method and device, terminal and storage medium
CN106936643B (en) Equipment linkage method and terminal equipment
CN111260475A (en) Data processing method, block chain node point equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant