CN105656995A - Data sharing method and system based on distributed processing - Google Patents

Data sharing method and system based on distributed processing Download PDF

Info

Publication number
CN105656995A
CN105656995A CN201510992355.8A CN201510992355A CN105656995A CN 105656995 A CN105656995 A CN 105656995A CN 201510992355 A CN201510992355 A CN 201510992355A CN 105656995 A CN105656995 A CN 105656995A
Authority
CN
China
Prior art keywords
data
subsystem
distributed
pipeline
target distribution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510992355.8A
Other languages
Chinese (zh)
Inventor
李道申
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE ICT Technologies Co Ltd
Original Assignee
ZTE ICT Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE ICT Technologies Co Ltd filed Critical ZTE ICT Technologies Co Ltd
Priority to CN201510992355.8A priority Critical patent/CN105656995A/en
Publication of CN105656995A publication Critical patent/CN105656995A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/06Network architectures or network communication protocols for network security for supporting key management in a packet data network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1073Registration or de-registration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/563Data redirection of data network streams

Abstract

The invention discloses a data sharing method and system based on distributed processing. The data sharing method based on distributed processing comprises following steps: receiving a data sharing request to a target distributed subsystem from a distributed subsystem, wherein the data sharing request comprises the addresses of the distributed subsystem and the target distributed subsystem; building a data forwarding pipeline for the distributed subsystem and the target distributed subsystem according to the data sharing request; and carrying out data forwarding sharing to the distributed subsystem and the target distributed subsystem according to a preset sending mode. Through the technique scheme provided by the invention, a customization management system can uniformly customize the information sending mode and the data forwarding pipeline between the two distributed subsystems; the customization management system can automatically obtain and send to-be-shared entity data; the inter-multi-system shared data are uniformly managed; the data sharing flexibility and security are improved; and the intersystem data sharing management and control uniformity is increased.

Description

Based on data sharing method and the system of distributed processing
Technical field
The present invention relates to field of terminal technology, specifically, it relates to a kind of data sharing method based on distributed processing and a kind of data-sharing systems based on distributed processing.
Background technology
Along with the development of computer network, the interconnected property between a lot of system, between computer increases, and distributed processing on a large scale becomes more and more attractive. In most cases, between distributed each subsystem intercommunication cooperation need shared portion basic data, such as user profile, resource information etc. But, existing distributed framework is when carrying out data sharing without unified management, and handiness, real-time that the seamless access of subsystem and data among systems are shared are difficult to ensure, are unfavorable for safety and the expansion of distributed system.
It is thus desirable to a kind of new technical scheme, it is possible to promote security and the handiness of the data sharing between distributed each subsystem.
Summary of the invention
The present invention is just based on the problems referred to above, it is proposed that a kind of new technical scheme, it is possible to promote security and the handiness of the data sharing between distributed each subsystem.
In view of this, an aspect of of the present present invention proposes a kind of data sharing method based on distributed processing, comprise: receive the data sharing request to target distribution subsystem from distributed subsystem, wherein, described data sharing request has described distributed subsystem and the address of described target distribution subsystem; According to described data sharing request, set up data for described distributed subsystem and described target distribution subsystem and forward pipeline; According to predetermined transmission pattern be described distributed subsystem and described target distribution subsystem carry out data forward share.
In this technical scheme, multiple distributed subsystem can be accessed customized management system, the information that customized management system can unify to customize between any two distributed subsystem sends pattern and data forward pipeline, data described here forward the transport pipe that pipeline is the solid data to be shared between distributed subsystem, customized management system can obtain and send solid data to be shared automatically, achieve the unity to multisystem data sharing to manage, improve handiness and the security of data sharing, increase the unity of data sharing management and control between subsystem.
In technique scheme, preferably, described according to described data sharing request, set up data for described distributed subsystem and described target distribution subsystem to forward before pipeline, also comprise: receive from the registration information of described distributed subsystem and/or described target distribution subsystem; According to described registration information, it is determined whether allow for described distributed subsystem/or described target distribution subsystem is set up described data and forwarded pipeline; Wherein, described registration information: the system coding of described distributed subsystem and/or described target distribution subsystem, title, developer and version information.
In this technical scheme, distributed subsystem needs to register in customized management system, whether effective according to the registration information of the checking Information Authentication distributed subsystem preset for customized management system, or can also by manually verifying that whether the registration information of distributed subsystem is effective in customized management system side, thus improving the security of data sharing, the distributed subsystem of authority obtains by not having to avoid shared data.
In technique scheme, it may be preferred that also comprise: according to the memory command received, the described data set up are forwarded pipelined storage to pipe database; And according to the state setting command received, identify or Pending The Entry Into Force mark for the described data forwarding install pipeline in described pipe database has come into force, be set to significant condition or disarmed state for the state that described data are forwarded pipeline.
In this technical scheme, can the data set up for sharing the both sides of data be forwarded in the pipe database of pipelined storage in customized management system, thus be convenient in pipe database data are forwarded pipeline carry out editing operation, such that it is able to effectively control the real-time status that data forward pipeline. Specifically, it is possible to stamp, for data forward pipeline, come into force mark or Pending The Entry Into Force mark, thus make data forwarding pipeline be in the significant condition that can transmit data or stop the disarmed state of transmission data.
In technique scheme, it may be preferred that also comprise: according to the delete command received, delete the described data set up and forward pipeline.
In this technical scheme, data are forwarded pipeline by pipe database and carries out editing operation, also comprise and delete these data forwarding pipeline, in actual applications, data sharing between two distributed subsystem is disposable sometimes, after completing data sharing for two distributed subsystem, in order to ensure the independent security of these two distributed subsystem, the data set up can be deleted and forward pipeline, avoid virus or malice software etc. to utilize data to forward pipeline and invade distributed subsystem.
In technique scheme, preferably, described be that described distributed subsystem and described target distribution subsystem carry out before data forward and share according to predetermined transmission pattern, also comprise: according to the mode setting command received, described predetermined transmission pattern is set, wherein, described predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
In this technical scheme, it is possible to according to the actual needs of user, or forward the actual state of pipeline according to data, for needing the data of transmission to arrange predetermined transmission pattern.
In technique scheme, preferably, described be that described distributed subsystem and described target distribution subsystem carry out before data forward and share according to predetermined transmission pattern, also comprise: according to the key setting command received, for described distributed subsystem and described target distribution subsystem set up docking key; It is the encrypt data that described distributed subsystem is shared with described target distribution subsystem by described docking key.
In this technical scheme, in order to guarantee the security of data forwarded in shared process, the both sides' distributed subsystem foundation docking key shared can be forwarded for carrying out data, to be needed the data encryption shared by docking double secret key, like this, the security of data in transmitting procedure just obtains effective guarantee.
In technique scheme, it may be preferred that described predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
In this technical scheme, transmission types refers to which kind of data layout to send data packet with, comprise: character string, xml (extensible markup language), JSON (JavaScriptObjectNotation, for a kind of lightweight data exchange form) string, file stream etc., send content and comprise transmission data list title, entity name, and entity attributes name, attribute type, transmission frequency refers to that described forwarding thread performs forwarding task according to regular hour frequency timing, and the mode that sends is when referring to described forwarding thread execution, which kind of transmission technology is used to carry out forwarding data, comprise: JMS (JavaMessageService, Java Message Service), http (Internet agreement), socket (socket) etc., in addition, sending the parameter that safe type refers to send in described data forwarding unit module data is with which kind of encryption algorithm be encrypted, comprise: expressly, DES (DataEncryptionStandred, data encryption standards), RSA (PKI encryption algorithm) etc. by technique scheme, for data forward the predetermined transmission pattern shared and provide variation, such that it is able to adapt to the actual demand of user further.
The another aspect of the present invention proposes a kind of data-sharing systems based on distributed processing, comprise: sharing request receives unit, receive the data sharing request to target distribution subsystem from distributed subsystem, wherein, described data sharing request has described distributed subsystem and the address of described target distribution subsystem; Pipeline customization units, according to described data sharing request, sets up data for described distributed subsystem and described target distribution subsystem and forwards pipeline; Data sharing unit, according to predetermined transmission pattern be described distributed subsystem and described target distribution subsystem carry out data forward share.
In this technical scheme, multiple distributed subsystem can be accessed customized management system, the information that customized management system can unify to customize between any two distributed subsystem sends pattern and data forward pipeline, data described here forward the transport pipe that pipeline is the solid data to be shared between distributed subsystem, customized management system can obtain and send solid data to be shared automatically, achieve the unity to multisystem data sharing to manage, improve handiness and the security of data sharing, increase the unity of data sharing management and control between subsystem.
In technique scheme, preferably, also comprise: registration information receiving unit, described according to described data sharing request, set up data for described distributed subsystem and described target distribution subsystem to forward before pipeline, receive from the registration information of described distributed subsystem and/or described target distribution subsystem; Determining unit, according to described registration information, determine whether to allow for described distributed subsystem/or described target distribution subsystem is set up described data and forwarded pipeline, wherein, described registration information: the system coding of described distributed subsystem and/or described target distribution subsystem, title, developer and version information.
In this technical scheme, distributed subsystem needs to register in customized management system, whether effective according to the registration information of the checking Information Authentication distributed subsystem preset for customized management system, or can also by manually verifying that whether the registration information of distributed subsystem is effective in customized management system side, thus improving the security of data sharing, the distributed subsystem of authority obtains by not having to avoid shared data.
In technique scheme, it may be preferred that also comprise: storage unit, according to the memory command received, the described data set up are forwarded pipelined storage to pipe database; And pipeline conditions setting unit, according to the state setting command received, identifying or Pending The Entry Into Force mark for the described data forwarding install pipeline in described pipe database has come into force, significant condition or the described Pending The Entry Into Force of the mark correspondence that come into force described in being set to for the state that described data forward pipeline identify corresponding disarmed state.
In this technical scheme, can the data set up for sharing the both sides of data be forwarded in the pipe database of pipelined storage in customized management system, thus be convenient in pipe database data are forwarded pipeline carry out editing operation, such that it is able to effectively control the real-time status that data forward pipeline. Specifically, it is possible to stamp, for data forward pipeline, come into force mark or Pending The Entry Into Force mark, thus make data forwarding pipeline be in the significant condition that can transmit data or stop the disarmed state of transmission data.
In technique scheme, it may be preferred that also comprise: unit deleted by pipeline, according to the delete command received, delete the described data set up and forward pipeline.
In this technical scheme, data are forwarded pipeline by pipe database and carries out editing operation, also comprise and delete these data forwarding pipeline, in actual applications, data sharing between two distributed subsystem is disposable sometimes, after completing data sharing for two distributed subsystem, in order to ensure the independent security of these two distributed subsystem, the data set up can be deleted and forward pipeline, avoid virus or malice software etc. to utilize data to forward pipeline and invade distributed subsystem.
In technique scheme, preferably, also comprise: send mode setting unit, described be that described distributed subsystem and described target distribution subsystem carry out before data forward and share according to predetermined transmission pattern, according to the mode setting command received, arranging described predetermined transmission pattern, wherein, described predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
In this technical scheme, it is possible to according to the actual needs of user, or forward the actual state of pipeline according to data, for needing the data of transmission to arrange predetermined transmission pattern.
In technique scheme, preferably, also comprise: key setting unit, described be that described distributed subsystem and described target distribution subsystem carry out before data forward and share according to predetermined transmission pattern, according to the key setting command received, for described distributed subsystem and described target distribution subsystem set up docking key; Data encryption unit is the encrypt data that described distributed subsystem is shared with described target distribution subsystem by described docking key.
In this technical scheme, in order to guarantee the security of data forwarded in shared process, the both sides' distributed subsystem foundation docking key shared can be forwarded for carrying out data, to be needed the data encryption shared by docking double secret key, like this, the security of data in transmitting procedure just obtains effective guarantee.
In technique scheme, it may be preferred that described predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
In this technical scheme, transmission types refers to which kind of data layout to send data packet with, comprise: character string, xml (extensible markup language), JSON (JavaScriptObjectNotation, for a kind of lightweight data exchange form) string, file stream etc., send content and comprise transmission data list title, entity name, and entity attributes name, attribute type, transmission frequency refers to that described forwarding thread performs forwarding task according to regular hour frequency timing, and the mode that sends is when referring to described forwarding thread execution, which kind of transmission technology is used to carry out forwarding data, comprise: JMS (JavaMessageService, Java Message Service), http (Internet agreement), socket (socket) etc., in addition, sending the parameter that safe type refers to send in described data forwarding unit module data is with which kind of encryption algorithm be encrypted, comprise: expressly, DES (DataEncryptionStandred, data encryption standards), RSA (PKI encryption algorithm) etc.By technique scheme, for data forward the predetermined transmission pattern shared and provide variation, such that it is able to adapt to the actual demand of user further.
By above technical scheme, the information that customized management system can unify to customize between any two distributed subsystem sends pattern and data forward pipeline, customized management system can obtain and send solid data to be shared automatically, achieve the unity to multisystem data sharing to manage, improve handiness and the security of data sharing, increase the unity of data sharing management and control between subsystem.
Accompanying drawing explanation
Fig. 1 shows the schema of the data sharing method based on distributed processing according to one embodiment of present invention;
Fig. 2 shows the block diagram of the data-sharing systems based on distributed processing according to one embodiment of present invention;
Fig. 3 shows the block diagram of real-time pipeline custom-built system according to one embodiment of present invention.
Embodiment
In order to more clearly understand above-mentioned purpose, the feature and advantage of the present invention, below in conjunction with the drawings and specific embodiments, the present invention is further described in detail. It should be noted that, when not conflicting, the feature in the embodiment of the application and embodiment can combine mutually.
Set forth a lot of detail in the following description so that fully understanding the present invention; but; the present invention can also adopt other to be different from other modes described here to implement, and therefore, protection scope of the present invention is by the restriction of following public specific embodiment.
Fig. 1 shows the schema of the data sharing method based on distributed processing according to one embodiment of present invention.
As shown in Figure 1, the data sharing method based on distributed processing according to one embodiment of present invention, comprising:
Step 102, receives the data sharing request to target distribution subsystem from distributed subsystem, wherein, has distributed subsystem and the address of target distribution subsystem in data sharing request.
Step 104, according to data sharing request, sets up data for distributed subsystem and target distribution subsystem and forwards pipeline.
Step 106, according to predetermined transmission pattern be distributed subsystem and target distribution subsystem carry out data forward share.
In this technical scheme, multiple distributed subsystem can be accessed customized management system, the information that customized management system can unify to customize between any two distributed subsystem sends pattern and data forward pipeline, here data forward the transport pipe that pipeline is the solid data to be shared between distributed subsystem, customized management system can obtain and send solid data to be shared automatically, achieve the unity to multisystem data sharing to manage, improve handiness and the security of data sharing, increase the unity of data sharing management and control between subsystem.
In technique scheme, it may be preferred that before step 104, also comprise: receive from the registration information of distributed subsystem and/or target distribution subsystem; According to registration information, it is determined whether allow for distributed subsystem/or target distribution subsystem is set up data and forwarded pipeline; Wherein, information is registered: the system coding of distributed subsystem and/or target distribution subsystem, title, developer and version information.
In this technical scheme, distributed subsystem needs to register in customized management system, whether effective according to the registration information of the checking Information Authentication distributed subsystem preset for customized management system, or can also by manually verifying that whether the registration information of distributed subsystem is effective in customized management system side, thus improving the security of data sharing, the distributed subsystem of authority obtains by not having to avoid shared data.
In technique scheme, it may be preferred that also comprise: according to the memory command received, the data set up are forwarded pipelined storage to pipe database; And according to the state setting command received, identify or Pending The Entry Into Force mark for the data forwarding install pipeline in pipe database has come into force, be set to significant condition or disarmed state for the state that data are forwarded pipeline.
In this technical scheme, can the data set up for sharing the both sides of data be forwarded in the pipe database of pipelined storage in customized management system, thus be convenient in pipe database data are forwarded pipeline carry out editing operation, such that it is able to effectively control the real-time status that data forward pipeline. Specifically, it is possible to stamp, for data forward pipeline, come into force mark or Pending The Entry Into Force mark, thus make data forwarding pipeline be in the significant condition that can transmit data or stop the disarmed state of transmission data.
In technique scheme, it may be preferred that also comprise: according to the delete command received, delete the data set up and forward pipeline.
In this technical scheme, data are forwarded pipeline by pipe database and carries out editing operation, also comprise and delete these data forwarding pipeline, in actual applications, data sharing between two distributed subsystem is disposable sometimes, after completing data sharing for two distributed subsystem, in order to ensure the independent security of these two distributed subsystem, the data set up can be deleted and forward pipeline, avoid virus or malice software etc. to utilize data to forward pipeline and invade distributed subsystem.
In technique scheme, it may be preferred that before step 106, also comprise: according to the mode setting command received, arranging predetermined transmission pattern, wherein, predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
In this technical scheme, it is possible to according to the actual needs of user, or forward the actual state of pipeline according to data, for needing the data of transmission to arrange predetermined transmission pattern.
In technique scheme, it may be preferred that described predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
In this technical scheme, transmission types refers to which kind of data layout to send data packet with, comprise: character string, xml (extensible markup language), JSON (JavaScriptObjectNotation, for a kind of lightweight data exchange form) string, file stream etc., send content and comprise transmission data list title, entity name, and entity attributes name, attribute type, transmission frequency refers to that described forwarding thread performs forwarding task according to regular hour frequency timing, and the mode that sends is when referring to described forwarding thread execution, which kind of transmission technology is used to carry out forwarding data, comprise: JMS (JavaMessageService, Java Message Service), http (Internet agreement), socket (socket) etc., in addition, sending the parameter that safe type refers to send in described data forwarding unit module data is with which kind of encryption algorithm be encrypted, comprise: expressly, DES (DataEncryptionStandred, data encryption standards), RSA (PKI encryption algorithm) etc. by technique scheme, for data forward the predetermined transmission pattern shared and provide variation, such that it is able to adapt to the actual demand of user further.
In technique scheme, it may be preferred that before step 106, also comprise: according to the key setting command received, for distributed subsystem and target distribution subsystem set up docking key;By docking key be the encrypt data that distributed subsystem is shared with target distribution subsystem.
In this technical scheme, in order to guarantee the security of data forwarded in shared process, the both sides' distributed subsystem foundation docking key shared can be forwarded for carrying out data, to be needed the data encryption shared by docking double secret key, like this, the security of data in transmitting procedure just obtains effective guarantee.
Fig. 2 shows the block diagram of the data-sharing systems based on distributed processing according to one embodiment of present invention.
As shown in Figure 2, the data-sharing systems 200 based on distributed processing according to one embodiment of present invention, comprise: sharing request receives unit 202, receive the data sharing request to target distribution subsystem from distributed subsystem, wherein, data sharing request has distributed subsystem and the address of target distribution subsystem; Pipeline customization units 204, according to data sharing request, sets up data for distributed subsystem and target distribution subsystem and forwards pipeline; Data sharing unit 206, according to predetermined transmission pattern be distributed subsystem and target distribution subsystem carry out data forward share.
In this technical scheme, multiple distributed subsystem can be accessed customized management system, the information that customized management system can unify to customize between any two distributed subsystem sends pattern and data forward pipeline, here data forward the transport pipe that pipeline is the solid data to be shared between distributed subsystem, customized management system can obtain and send solid data to be shared automatically, achieve the unity to multisystem data sharing to manage, improve handiness and the security of data sharing, increase the unity of data sharing management and control between subsystem.
In technique scheme, preferably, also comprise: registration information receiving unit 208, according to data sharing request, set up data for distributed subsystem and target distribution subsystem to forward before pipeline, receive from the registration information of distributed subsystem and/or target distribution subsystem; Determining unit 210, according to registration information, determine whether to allow for distributed subsystem/or target distribution subsystem is set up data and forwarded pipeline, wherein, registration information: the system coding of distributed subsystem and/or target distribution subsystem, title, developer and version information.
In this technical scheme, distributed subsystem needs to register in customized management system, whether effective according to the registration information of the checking Information Authentication distributed subsystem preset for customized management system, or can also by manually verifying that whether the registration information of distributed subsystem is effective in customized management system side, thus improving the security of data sharing, the distributed subsystem of authority obtains by not having to avoid shared data.
In technique scheme, it may be preferred that also comprise: storage unit 212, according to the memory command received, the data set up are forwarded pipelined storage to pipe database; And pipeline conditions setting unit 214, according to the state setting command received, come into force disarmed state corresponding to mark or Pending The Entry Into Force mark, the significant condition that being set to for the state that data forward pipeline to come into force mark is corresponding or Pending The Entry Into Force mark for the data in pipe database forward install pipeline.
In this technical scheme, can the data set up for sharing the both sides of data be forwarded in the pipe database of pipelined storage in customized management system, thus be convenient in pipe database data are forwarded pipeline carry out editing operation, such that it is able to effectively control the real-time status that data forward pipeline. Specifically, it is possible to stamp, for data forward pipeline, come into force mark or Pending The Entry Into Force mark, thus make data forwarding pipeline be in the significant condition that can transmit data or stop the disarmed state of transmission data.
In technique scheme, it may be preferred that also comprise: unit 216 deleted by pipeline, according to the delete command received, delete the data set up and forward pipeline.
In this technical scheme, data are forwarded pipeline by pipe database and carries out editing operation, also comprise and delete these data forwarding pipeline, in actual applications, data sharing between two distributed subsystem is disposable sometimes, after completing data sharing for two distributed subsystem, in order to ensure the independent security of these two distributed subsystem, the data set up can be deleted and forward pipeline, avoid virus or malice software etc. to utilize data to forward pipeline and invade distributed subsystem.
In technique scheme, preferably, also comprise: send mode setting unit 218, according to predetermined transmission pattern be distributed subsystem and target distribution subsystem carry out data forward share before, according to the mode setting command received, arranging predetermined transmission pattern, wherein, predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
In this technical scheme, it is possible to according to the actual needs of user, or forward the actual state of pipeline according to data, for needing the data of transmission to arrange predetermined transmission pattern.
In technique scheme, preferably, also comprise: key setting unit 220, according to predetermined transmission pattern be distributed subsystem and target distribution subsystem carry out data forward share before, according to the key setting command received, for distributed subsystem and target distribution subsystem set up docking key; Data encryption unit 222 is the encrypt data that distributed subsystem is shared with target distribution subsystem by docking key.
In this technical scheme, in order to guarantee the security of data forwarded in shared process, the both sides' distributed subsystem foundation docking key shared can be forwarded for carrying out data, to be needed the data encryption shared by docking double secret key, like this, the security of data in transmitting procedure just obtains effective guarantee.
In technique scheme, it may be preferred that described predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
In this technical scheme, transmission types refers to which kind of data layout to send data packet with, comprise: character string, xml (extensible markup language), JSON (JavaScriptObjectNotation, for a kind of lightweight data exchange form) string, file stream etc., send content and comprise transmission data list title, entity name, and entity attributes name, attribute type, transmission frequency refers to that described forwarding thread performs forwarding task according to regular hour frequency timing, and the mode that sends is when referring to described forwarding thread execution, which kind of transmission technology is used to carry out forwarding data, comprise: JMS (JavaMessageService, Java Message Service), http (Internet agreement), socket (socket) etc., in addition, sending the parameter that safe type refers to send in described data forwarding unit module data is with which kind of encryption algorithm be encrypted, comprise: expressly, DES (DataEncryptionStandred, data encryption standards), RSA (PKI encryption algorithm) etc. by technique scheme, for data forward the predetermined transmission pattern shared and provide variation, such that it is able to adapt to the actual demand of user further.
Fig. 3 shows the block diagram of real-time pipeline custom-built system according to one embodiment of present invention.
As shown in Figure 3, real-time pipeline custom-built system 300 is by the mode customizing pipeline, generate real-time pipeline, automatically forward, realize the data sharing of data to be shared between multiple system, comprising: system access unit 302, pipeline customization units 304, in real time pipeline generate unit 306, data forwarding unit 308.
Wherein, system access unit 302 for being registered to real-time pipeline custom-built system by FTP client FTP, pipeline customization units 304 is for forwarding pipeline for FTP client FTP customization data, real-time pipeline generates unit 306 and comes into force in real time for control data forwarding pipeline, and data forwarding unit 308 forwards for the real-time pipeline generated according to real-time pipeline generation unit 306 shares data.
For system access unit 302, specifically, FTP client FTP comprises the original system 400 of client terminal and client objectives system 500, the original system 400 of client terminal is at the real information of system access unit 302 register account number, client objectives system 500, and it is saved in real-time pipeline customization units 304, so that information can be examined by the system administrative account of pipeline custom-built system 300 in real time. Wherein, the original system of client terminal 400 is for preserving the system of data to be shared, and client objectives system 500 is the system that the original system of pre-acquiring shares data.
The original system of multiple client terminal and client objectives system registrable true identity information are to real-time pipeline custom-built system, so that in real time the system administrative account of pipeline custom-built system 300 is after carrying out identity examination & verification to original system and target system, by or refuse the information of the original system of multiple client terminal and client objectives system registry.
For pipeline customization units 304, specifically, system administrative account can be the original system customization client objectives system of client terminal and transmission pattern.
For client terminal original system 400 customization customer end target system, specifically comprise: determine that data forward Data Source side and the address of pipeline, and determine that data forward data receiver and the address of pipeline.
Transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode, send safe type.
For real-time pipeline generate unit 306, specifically, system administrative account can control data forward pipeline for coming into force, invalid, delete. Wherein, the pipeline warehouse-in that pipeline customization units 304 can be customized, it is set to the mark that comes into force, and put into the forwarding pond of retransmission unit, or the pipeline warehouse-in that pipeline customization units 304 customized, it is set to Pending The Entry Into Force mark, and removes corresponding pipeline in the forwarding pond in retransmission unit, the corresponding duct size information of the pipeline delete database that pipeline customization units 304 can also be customized, and remove corresponding pipeline in the forwarding pond in retransmission unit. Wherein, the pipeline forwarding thread that pond refers to comprise some amount is forwarded. In addition, can be multiple FTP client FTP unification multiple data of customization and forward pipeline, and control forwards the validity of pipeline in real time, thus whether control data forwarding pipeline is unobstructed.
For data forwarding unit 308, it specifically comprises: data acquisition module, data conversion module, data-pushing module.
Wherein, the feature of data acquisition module is: forward the pipeline thread in pond according to transmission frequency, transmission types, transmission content sender formula, send the original system 400 of safe type requesting client, with the data to be shared obtained in the original system of client terminal 400.
The feature of data conversion module is: by the shared data of the original system of client terminal 400 of acquisition, sends parameter according to transmission types and transmission content package.
The feature of data-pushing module is: according to transmission frequency, transmission mode, sends safe type and is sent to client objectives system 500. Client objectives system 500 receives the transmission parameter that data forwarding unit 308 sends, and is converted into the data characteristics of client objectives system 500 simultaneously.
The register account number of FTP client FTP and the real information of FTP client FTP can be represented, it is saved in real-time pipeline custom-built system 300, register account number comprises: the information such as FTP client FTP coding, system title, system development business, system version, can also generate docking key for FTP client FTP simultaneously.
The original system of multiple client terminal and client objectives system registrable true identity information are to real-time pipeline custom-built system 300, so that the original system of client terminal and client objectives system can be carried out identity examination & verification by system administration account, and pass through or refuse the information of the original system of client terminal and client objectives system registry.
Docking key is used for the data encryption in data forwarding unit 308.
Pipeline customization units 304 can customize the transmission types of transmission pattern, send content, transmission frequency, transmission mode, send safe type, wherein, transmission types refers to which kind of data layout to send data packet with, comprise: character string, xml, JSON goes here and there, file stream etc., send content and comprise transmission data list title, entity name, and entity attributes name, attribute type, transmission frequency refers to that forwarding thread performs forwarding task according to regular hour frequency timing, and the mode that sends refer to forward thread execution time, which kind of transmission technology is used to carry out forwarding data, comprise: JMS, http, socket etc., in addition, sending the parameter that safe type refers to send in data forwarding unit module data is with which kind of encryption algorithm be encrypted, comprise: expressly, DES, RSA etc.
More than it is described with reference to the accompanying drawings the technical scheme of the present invention, by the technical scheme of the present invention, the information that customized management system can unify to customize between any two distributed subsystem sends pattern and data forward pipeline, customized management system can obtain and send solid data to be shared automatically, achieve the unity to multisystem data sharing to manage, improve handiness and the security of data sharing, increase the unity of data sharing management and control between subsystem.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations. Within the spirit and principles in the present invention all, any amendment of doing, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (14)

1. the data sharing method based on distributed processing, it is characterised in that, comprising:
Receive the data sharing request to target distribution subsystem from distributed subsystem, wherein, described data sharing request has described distributed subsystem and the address of described target distribution subsystem;
According to described data sharing request, set up data for described distributed subsystem and described target distribution subsystem and forward pipeline;
According to predetermined transmission pattern be described distributed subsystem and described target distribution subsystem carry out data forward share.
2. the data sharing method based on distributed processing according to claim 1, it is characterised in that, described according to described data sharing request, set up data for described distributed subsystem and described target distribution subsystem and forward before pipeline, also comprise:
Receive from the registration information of described distributed subsystem and/or described target distribution subsystem;
According to described registration information, it is determined whether allow for described distributed subsystem/or described target distribution subsystem is set up described data and forwarded pipeline;
Wherein, described registration information: the system coding of described distributed subsystem and/or described target distribution subsystem, title, developer and version information.
3. the data sharing method based on distributed processing according to claim 1 and 2, it is characterised in that, also comprise:
According to the memory command received, the described data set up are forwarded pipelined storage to pipe database; And
According to the state setting command received, identify or Pending The Entry Into Force mark for the described data forwarding install pipeline in described pipe database has come into force, it is set to significant condition or disarmed state for the state that described data are forwarded pipeline.
4. the data sharing method based on distributed processing according to claim 1 and 2, it is characterised in that, also comprise:
According to the delete command received, delete the described data set up and forward pipeline.
5. the data sharing method based on distributed processing according to claim 1, it is characterised in that, described be that described distributed subsystem and described target distribution subsystem carry out also comprising before data forward and share according to predetermined transmission pattern:
According to the mode setting command received, described predetermined transmission pattern is set.
6. the data sharing method based on distributed processing according to claim 1, it is characterised in that, described be that described distributed subsystem and described target distribution subsystem carry out also comprising before data forward and share according to predetermined transmission pattern:
According to the key setting command received, for described distributed subsystem and described target distribution subsystem set up docking key;
It is the encrypt data that described distributed subsystem is shared with described target distribution subsystem by described docking key.
7. the data sharing method based on distributed processing according to claim 5, it is characterised in that, described predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
8. the data-sharing systems based on distributed processing, it is characterised in that, comprising:
Sharing request receives unit, receives the data sharing request to target distribution subsystem from distributed subsystem, wherein, has described distributed subsystem and the address of described target distribution subsystem in described data sharing request;
Pipeline customization units, according to described data sharing request, sets up data for described distributed subsystem and described target distribution subsystem and forwards pipeline;
Data sharing unit, according to predetermined transmission pattern be described distributed subsystem and described target distribution subsystem carry out data forward share.
9. the data-sharing systems based on distributed processing according to claim 8, it is characterised in that, also comprise:
Registration information receiving unit, described according to described data sharing request, set up data for described distributed subsystem and described target distribution subsystem to forward before pipeline, receive from the registration information of described distributed subsystem and/or described target distribution subsystem;
Determining unit, according to described registration information, determine whether to allow for described distributed subsystem/or described target distribution subsystem is set up described data and forwarded pipeline, wherein, described registration information: the system coding of described distributed subsystem and/or described target distribution subsystem, title, developer and version information.
10. the data-sharing systems based on distributed processing according to claim 8 or claim 9, it is characterised in that, also comprise:
The described data set up, according to the memory command received, are forwarded pipelined storage to pipe database by storage unit; And
Pipeline conditions setting unit, according to the state setting command received, identifying or Pending The Entry Into Force mark for the described data forwarding install pipeline in described pipe database has come into force, significant condition or the described Pending The Entry Into Force of the mark correspondence that come into force described in being set to for the state that described data forward pipeline identify corresponding disarmed state.
11. data-sharing systems based on distributed processing according to claim 8 or claim 9, it is characterised in that, also comprise:
Unit deleted by pipeline, according to the delete command received, deletes the described data set up and forwards pipeline.
12. data-sharing systems based on distributed processing according to claim 8, it is characterised in that, also comprise:
Send mode setting unit, described be that described distributed subsystem and described target distribution subsystem carry out according to the mode setting command received, arranging described predetermined transmission pattern before data forward and share according to predetermined transmission pattern.
13. data-sharing systems based on distributed processing according to claim 8, it is characterised in that, also comprise:
Key setting unit, described be that described distributed subsystem and described target distribution subsystem carry out before data forward and share according to predetermined transmission pattern, according to the key setting command received, for described distributed subsystem and described target distribution subsystem set up docking key;
Data encryption unit is the encrypt data that described distributed subsystem is shared with described target distribution subsystem by described docking key.
14. data-sharing systems based on distributed processing according to claim 12, it is characterised in that, described predetermined transmission pattern comprises: transmission types, send content, transmission frequency, transmission mode and send safe type.
CN201510992355.8A 2015-12-25 2015-12-25 Data sharing method and system based on distributed processing Pending CN105656995A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510992355.8A CN105656995A (en) 2015-12-25 2015-12-25 Data sharing method and system based on distributed processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510992355.8A CN105656995A (en) 2015-12-25 2015-12-25 Data sharing method and system based on distributed processing

Publications (1)

Publication Number Publication Date
CN105656995A true CN105656995A (en) 2016-06-08

Family

ID=56476834

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510992355.8A Pending CN105656995A (en) 2015-12-25 2015-12-25 Data sharing method and system based on distributed processing

Country Status (1)

Country Link
CN (1) CN105656995A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109753824A (en) * 2018-12-14 2019-05-14 航天信息股份有限公司 A kind of distributed electronic signature method and system
CN110149313A (en) * 2019-04-12 2019-08-20 平安普惠企业管理有限公司 Data sharing method, electronic device and computer readable storage medium
WO2020164526A1 (en) * 2019-02-15 2020-08-20 腾讯科技(深圳)有限公司 Control method for nodes in distributed system and related device
CN112087453A (en) * 2020-09-09 2020-12-15 云和恩墨(北京)信息技术有限公司 Storage data sharing method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101820449A (en) * 2010-04-20 2010-09-01 江苏电力调度通信中心 Cross-safety zone application service isolation platform
US20100251350A1 (en) * 2009-03-27 2010-09-30 Samsung Electronics Co., Ltd. Distributed control method and apparatus using url
CN102082834A (en) * 2011-03-04 2011-06-01 中国联合网络通信集团有限公司 P2P (Peer-To-Peer) resource sharing method, system and proxy server based on IMS (IP Multimedia Subsystem)
CN103077134A (en) * 2012-12-27 2013-05-01 飞天诚信科技股份有限公司 Method and device for achieving multi-pipe data transmission in embedded system
CN104320164A (en) * 2014-10-14 2015-01-28 宇龙计算机通信科技(深圳)有限公司 Data transmission method and device
CN104506404A (en) * 2014-12-17 2015-04-08 杭州华三通信技术有限公司 Method and device for establishing virtual local area network forwarding channel

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100251350A1 (en) * 2009-03-27 2010-09-30 Samsung Electronics Co., Ltd. Distributed control method and apparatus using url
CN101820449A (en) * 2010-04-20 2010-09-01 江苏电力调度通信中心 Cross-safety zone application service isolation platform
CN102082834A (en) * 2011-03-04 2011-06-01 中国联合网络通信集团有限公司 P2P (Peer-To-Peer) resource sharing method, system and proxy server based on IMS (IP Multimedia Subsystem)
CN103077134A (en) * 2012-12-27 2013-05-01 飞天诚信科技股份有限公司 Method and device for achieving multi-pipe data transmission in embedded system
CN104320164A (en) * 2014-10-14 2015-01-28 宇龙计算机通信科技(深圳)有限公司 Data transmission method and device
CN104506404A (en) * 2014-12-17 2015-04-08 杭州华三通信技术有限公司 Method and device for establishing virtual local area network forwarding channel

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109753824A (en) * 2018-12-14 2019-05-14 航天信息股份有限公司 A kind of distributed electronic signature method and system
WO2020164526A1 (en) * 2019-02-15 2020-08-20 腾讯科技(深圳)有限公司 Control method for nodes in distributed system and related device
US11343233B2 (en) 2019-02-15 2022-05-24 Tencent Technology (Shenzhen) Company Limited Node control method and related apparatus in distributed system
CN110149313A (en) * 2019-04-12 2019-08-20 平安普惠企业管理有限公司 Data sharing method, electronic device and computer readable storage medium
CN110149313B (en) * 2019-04-12 2023-10-13 上海申磊信息科技有限公司 Data sharing method, electronic device and computer readable storage medium
CN112087453A (en) * 2020-09-09 2020-12-15 云和恩墨(北京)信息技术有限公司 Storage data sharing method and device
CN112087453B (en) * 2020-09-09 2021-07-16 云和恩墨(北京)信息技术有限公司 Storage data sharing method and device

Similar Documents

Publication Publication Date Title
CN113691597B (en) Block chain contract deployment method, device, equipment and storage medium
US8341715B2 (en) System and method for shared resource owner based access control
CN101573936B (en) Digital rights management using trusted processing techniques
US8656037B2 (en) Web service simple object access protocol request response processing
CN101043478B (en) Service gateway and method for realizing message safe process
CN102378170A (en) Method, device and system of authentication and service calling
JP6326173B1 (en) Data transmission / reception system and data transmission / reception method
CN111108735A (en) Asset update service
US20210067507A1 (en) Information processing apparatus and processing method for the same
CN105656995A (en) Data sharing method and system based on distributed processing
CN111314491A (en) Cross-tenant data interaction method and device, server cluster and medium
CN112152778B (en) Node management method and device and electronic equipment
CN112804354B (en) Method and device for data transmission across chains, computer equipment and storage medium
JP2007226470A (en) Authority management server, authority management method, and authority management program
CN108769743B (en) Video playing control method, system, node and computer storage medium
CN111800426A (en) Method, device, equipment and medium for accessing native code interface in application program
CA2654740C (en) System and method for shared resource owner based access control
CN113872940B (en) Access control method, device and equipment based on NC-Link
Dulal et al. Building a secure mhealth data sharing infrastructure over ndn
CN102299927A (en) Content security supervision system and method
CN112689003A (en) Service request forwarding method, device, equipment and storage medium
CN114978698B (en) Network access method, target terminal, credential management network element and verification network element
CN110324290B (en) Network equipment authentication method, network element equipment, medium and computer equipment
Anantharaman et al. Scalable identity and key management for publish-subscribe protocols in the Internet-of-Things
CN111970253A (en) PEP configuration method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160608

RJ01 Rejection of invention patent application after publication