CN113746900B - Intranet data transmission method, electronic device and computer readable storage medium - Google Patents
Intranet data transmission method, electronic device and computer readable storage medium Download PDFInfo
- Publication number
- CN113746900B CN113746900B CN202110882634.4A CN202110882634A CN113746900B CN 113746900 B CN113746900 B CN 113746900B CN 202110882634 A CN202110882634 A CN 202110882634A CN 113746900 B CN113746900 B CN 113746900B
- Authority
- CN
- China
- Prior art keywords
- data
- transmission
- transmission data
- internal
- external network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 387
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000012545 processing Methods 0.000 claims abstract description 61
- 238000012795 verification Methods 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000013524 data verification Methods 0.000 claims description 2
- 238000012544 monitoring process Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000002955 isolation Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/12—Applying verification of the received information
- H04L63/123—Applying verification of the received information received data contents, e.g. message integrity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computer And Data Communications (AREA)
Abstract
The application discloses an intranet and extranet data transmission method, electronic equipment and a computer readable storage medium, and relates to the technical field of data transmission. The method comprises the steps of obtaining a service request for data transmission, obtaining initial transmission data to be transmitted according to the service request, processing the initial transmission data to obtain target transmission data, calling an inner network transmission channel and an outer network transmission channel of an inner network and outer network switching platform according to the target transmission data, transmitting the target transmission data to a receiving end platform through the inner network and outer network transmission channel, and processing the target transmission data by the receiving end platform to obtain the initial transmission data, so that the condition of overlarge service pressure and service overload can be avoided when the inner network and outer network switching platform transmits the inner network and outer network data, and the stability of data transmission between the inner network and the outer network can be improved.
Description
Technical Field
The present disclosure relates to the field of data transmission technologies, and in particular, to an intranet and extranet data transmission method, an electronic device, and a computer readable storage medium.
Background
With the high-speed development of the internet, the internet security problem is increasingly serious, and in order to ensure data security, at present, when data sharing transmission is carried out, a network is generally divided into two network environments with different security levels, namely an internal network and an external network, and the internal network and the external network are exchanged in an information ferrying mode by adopting an internal network and external network exchange platform, namely an isolation gatekeeper. However, the data exchange mode is basically that the internal and external network exchange platform is responsible for processing and transmitting all the requested data, which causes the problem of overlarge service pressure at the internal and external network exchange platform, causes overload of the internal and external network exchange platform and even causes failure of the internal and external network exchange platform, so that data transmission between the internal network and the external network can not be performed any more.
Disclosure of Invention
The present application aims to solve at least one of the technical problems existing in the prior art. Therefore, the application provides an internal and external network data transmission method, electronic equipment and a computer readable storage medium, which can avoid the conditions of overlarge service pressure and service overload when an internal and external network exchange platform performs internal and external network data transmission and improve the stability of internal and external network data transmission.
The application also provides an internal and external network data transmission method.
The application also provides electronic equipment with the internal and external network data transmission method.
The application also provides a computer readable storage medium with the internal and external network data transmission method.
An intranet and extranet data transmission method according to an embodiment of a first aspect of the present application includes: acquiring a service request for data transmission; acquiring initial transmission data to be transmitted according to the service request; processing the initial transmission data to obtain target transmission data; calling an internal and external network transmission channel of an internal and external network exchange platform according to the target transmission data; and transmitting the target transmission data to a receiving end platform through the internal and external network transmission channel, and processing the target transmission data by the receiving end platform to obtain the initial transmission data.
The method for transmitting the data of the internal and external networks has at least the following beneficial effects: the method comprises the steps of obtaining a service request for data transmission, obtaining initial transmission data to be transmitted according to the service request, processing the initial transmission data to obtain target transmission data, calling an inner network transmission channel and an outer network transmission channel of an inner network and outer network switching platform according to the target transmission data, transmitting the target transmission data to a receiving end platform through the inner network and outer network transmission channel, and processing the target transmission data by the receiving end platform to obtain the initial transmission data, so that the condition of overlarge service pressure and service overload can be avoided when the inner network and outer network switching platform transmits the inner network and outer network data, and the stability of data transmission between the inner network and the outer network can be improved.
According to some embodiments of the present application, the processing the initial transmission data to obtain target transmission data includes: acquiring priority parameters of the service request; and configuring a time delay parameter for the initial transmission data according to the priority parameter to obtain the target transmission data.
According to some embodiments of the present application, the internal and external network transmission channels include a structured transmission channel; correspondingly, the calling the internal and external network transmission channels of the internal and external network switching platform according to the target transmission data comprises the following steps: and calling the structured transmission channel of the internal and external network switching platform according to the delay parameter of the target transmission data and the structured data type of the target transmission data.
According to some embodiments of the present application, the internal and external network transmission channels include a structured transmission channel; correspondingly, the calling the internal and external network transmission channels of the internal and external network switching platform according to the target transmission data comprises the following steps: and invoking an unstructured transmission channel of the internal and external network switching platform according to the time delay parameter of the target transmission data and the unstructured data type of the target transmission data.
According to some embodiments of the present application, the processing the initial transmission data to obtain target transmission data includes: and performing slicing processing on the initial transmission data to obtain a plurality of sliced transmission data.
According to some embodiments of the present application, the invoking the intranet transmission channel of the intranet switching platform according to the target transmission data includes:
and calling the structured transmission channel of the internal and external network switching platform according to the plurality of the fragmented transmission data.
According to some embodiments of the present application, the target transmission data includes a data check code; and acquiring a verification result of the target transmission data returned by the receiving end platform, wherein the verification result is obtained by the receiving end platform through verifying the target transmission data according to the data verification code.
According to some embodiments of the application, further comprising: recording current transmission state information of target transmission data, and acquiring acquisition state information of the target transmission data returned by a receiving end platform; and re-transmitting the target transmission data to a receiving end platform through the internal and external network transmission channel according to the transmission state information and the acquired state information.
An electronic device according to an embodiment of a second aspect of the present application, comprising: at least one processor, and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions that are executed by the at least one processor to cause the at least one processor to implement the intranet and extranet data transmission method of the first aspect when the instructions are executed.
The electronic equipment has at least the following beneficial effects: by executing the method for transmitting the data of the internal and external networks in the embodiment of the first aspect, the condition of overlarge service pressure and service overload can be avoided when the internal and external network exchange platform transmits the data of the internal and external networks, and the stability of the data transmission of the internal and external networks can be improved.
A computer-readable storage medium according to an embodiment of the third aspect of the present application stores computer-executable instructions for causing a computer to perform the intranet data transmission method according to the first aspect.
A computer-readable storage medium according to the present application has at least the following advantageous effects: by executing the method for transmitting the data of the internal and external networks in the embodiment of the first aspect, the condition of overlarge service pressure and service overload can be avoided when the internal and external network exchange platform transmits the data of the internal and external networks, and the stability of the data transmission of the internal and external networks can be improved.
Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
Drawings
Fig. 1 is a schematic diagram of a specific module of an intranet and extranet data transmission architecture in an embodiment of the present application;
FIG. 2 is a schematic flow chart of a method for intranet and extranet data in an embodiment of the present application;
FIG. 3 is a diagram illustrating a first specific application example of the intranet and extranet data method according to an embodiment of the present application;
FIG. 4 is a diagram illustrating a second specific application example of the intranet and extranet data method according to an embodiment of the present application;
FIG. 5 is a diagram illustrating a third specific application example of the intranet and extranet data method according to an embodiment of the present application;
fig. 6 is a diagram of a fourth specific application example of the intranet and extranet data method in the embodiment of the application.
Reference numerals:
the system comprises an external network platform 100, an external network synchronization module 110, an external network file synchronization module 111, an external network data synchronization module 112, an external network service module 120, an internal network platform 200, an internal network synchronization module 210, an internal network file synchronization module 211, an internal network data synchronization module 212 and an internal network service module 220; an intranet switching platform 300, and an intranet transmission path 310.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
It should be noted that the logical order of illustration is depicted in a flowchart, but in some cases the steps shown or described may be performed in a different order in the flowchart. If "a number" is referred to, it means more than one, if "a plurality" is referred to, it means more than two, and if "a number" is referred to, it is understood that the number is included. The use of any and all examples, or exemplary language (e.g., "such as") provided herein, is intended merely to better illuminate embodiments of the application and does not pose a limitation on the scope of the application unless otherwise claimed. Greater than, less than, greater than, etc. are understood to exclude this number, and above, below, within, etc. are understood to include this number. The description of the first and second is for the purpose of distinguishing between technical features only and should not be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated or implicitly indicating the precedence of the technical features indicated.
It is noted that, unless otherwise indicated, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Furthermore, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The term "and/or" as used herein includes any combination of one or more of the associated listed items.
With the high-speed development of the internet, the internet security problem is increasingly serious, and in order to ensure data security, at present, when data sharing transmission is carried out, a network is generally divided into two network environments with different security levels, namely an internal network and an external network, and the internal network and the external network are exchanged in an information ferrying mode by adopting an internal network and external network exchange platform, namely an isolation gatekeeper. However, the data exchange mode is basically that the internal and external network exchange platform is responsible for processing and transmitting all the requested data, which causes the problem of overlarge service pressure at the internal and external network exchange platform, causes overload of the internal and external network exchange platform and even causes failure of the internal and external network exchange platform, so that data transmission between the internal network and the external network can not be performed any more.
Based on this, the embodiment of the application provides an internal and external network data transmission method, electronic equipment and a computer readable storage medium, which can avoid the condition of overlarge service pressure and service overload when an internal and external network exchange platform performs internal and external network data transmission, and improve the stability of internal and external network data transmission.
It should be noted that, the method for transmitting the intranet and extranet data in the embodiment of the present application is performed by using an intranet and extranet data transmission architecture as shown in fig. 1, and includes an extranet platform 100, an intranet platform 200, and an extranet switching platform 300. The external network platform 100 comprises an external network synchronization module 110 and an external network service module 120, wherein the external network synchronization module 110 is used for synchronizing data transmitted by the internal network platform 200 and performing corresponding synchronization processing; or after the data to be transmitted to the intranet platform 200 is processed, the data is transmitted to the intranet platform 200; the external network synchronization module 110 further includes an external network data synchronization module 112111 and an external network data synchronization module, and transmits the data to the internal network platform 200 or receives the data from the internal network platform 200 according to different data types, and the data is processed by different synchronization modules, for example, unstructured data is processed by the external network data synchronization module 112111, and structured data is processed by the external network data synchronization module; the external network service module 120 is configured to perform service on the received transmission data of the structured data type of the internal network platform 200 or initiate a service to generate a corresponding service request to the internal network synchronization module 210.
The intranet platform 200 comprises an intranet synchronization module 210 and an intranet service module 220, wherein the intranet synchronization module 210 is used for synchronizing data transmitted by the extranet platform 100 and performing corresponding synchronization processing; or after processing the data to be transmitted to the external network platform 100, the data is sent to the external network platform 100; the intranet synchronization module 210 further includes an intranet file synchronization module 211 and an intranet data synchronization module 212, and data types of data transmitted to the external network platform 100 or received from the external network platform 100 are processed by different synchronization modules according to the requirement, for example, unstructured type data is processed by the intranet file synchronization module 211, structured type data is different, and the data is processed by the intranet data synchronization module 212; the intranet service module 220 is configured to perform service processing on the received transmission data of the structured data type of the external network, or initiate a service to generate a corresponding service request to the intranet synchronization module 210.
The intranet and extranet switching platform 300 is used as an isolated network between the intranet platform 200 and the extranet platform 100, and performs data transmission between the intranet and the extranet by setting the intranet and extranet transmission channels 310. The internal and external network transmission channels 310 are divided into a structured transmission channel and an unstructured transmission channel, the structured transmission channel is mainly responsible for transmitting structured data between the internal network and the external network, and the unstructured transmission channel is mainly responsible for transmitting unstructured data between the internal network and the external network.
Structured data, which is data that can be represented by data or a unified structure, such as numerals, letters, symbols, and the like, are described with respect to structured data and unstructured data. Structured data, also called row data, is data logically expressed and implemented by a two-dimensional table structure, strictly following data format and length specifications, and mainly stored and managed through a relational database; unstructured data is data that is irregular or incomplete in data structure, has no predefined data model, and is inconvenient to represent by a two-dimensional logical table of a database, including data such as image and audio/video information.
In a first aspect, an embodiment of the present application provides a method for transmitting data in an intranet and extranet.
It should be noted that, in the embodiment of the present application, the method for performing data transmission between the intranet and the extranet is a sending end platform, where the sending end platform refers to a platform for transmitting data to a receiving end platform, and when the intranet platform 200 needs to transmit data to the extranet platform 100, the intranet platform 200 is a sending end platform, and the extranet platform 100 is a receiving end platform; when the external network platform 100 needs to transmit data to the internal network platform 200, the external network platform 100 is a transmitting end platform, and the internal network platform 200 is a receiving end platform. Thus, it may be determined that intranet platform 200 and extranet platform 100 may perform the same or similar data processing steps when receiving the transmitted data and may perform the same or similar data processing steps when sending the transmitted data.
It should be noted that, in order to facilitate understanding of the solution described in the present application, the embodiment of the present application uses the sending end platform as the external network platform 100, and the receiving end platform as the internal network platform 200 as an example.
In some embodiments, referring to fig. 2, a flow chart of a method for transmitting data between an intranet and an extranet in an embodiment of the present application is shown. The method specifically comprises the following steps:
s100, acquiring a service request for data transmission;
s200, acquiring initial transmission data to be transmitted according to a service request;
s300, processing the initial transmission data to obtain target transmission data;
s400, calling an internal and external network transmission channel of an internal and external network exchange platform according to target transmission data;
s500, transmitting the target transmission data to a receiving end platform through an intranet transmission channel and an extranet transmission channel, and processing the target transmission data by the receiving end platform to obtain initial transmission data.
In step S100, the receiving end platform obtains a real-time service request of the user, where the service request is used to indicate that the user needs to transmit data to the receiving end platform, specifically, by calling an API interface provided by the external network synchronization module 110, the external network synchronization module 110 obtains the service request generated in the external network service module 120 through the API interface, and different service requests correspond to different transmission data.
In step S200, initial transmission data to be transmitted is obtained according to the received service request, and in practical application, the data types of the initial transmission data obtained according to different service request locks are different, including initial transmission data of structured type and initial transmission data of unstructured type. According to different data types, the mode of acquiring the corresponding initial transmission data is different, for example, when the data to be transmitted is unstructured type initial transmission data, the corresponding initial transmission data such as files and the like need to be called from a file system, and the file system is a database system established based on SFTP (Secret File Transfer Protocol, secure file transfer protocol), and relevant file data and the like are stored in the file system; if the initial transmission data of the structured type is required to be transmitted, the corresponding initial transmission data such as data of tables, characters and the like are phishing from the database.
In step S300, the acquired initial transmission data is processed to obtain target transmission data. The processing of the initial transmission data refers to processing according to the actual situation of the service request, for example, configuring a delay parameter for the initial transmission data, that is, delaying the transmission of the initial transmission data to the receiving end platform, so as to achieve non-real-time data synchronization; the method can also carry out slicing processing based on the data size and the data type of the initial transmission data to obtain smaller data, thereby realizing the data synchronization of batch transmission and the like. The specific data processing mode can be processed according to the priority required by the service request and the data type and data size of the initial transmission data.
In step S400, the internal and external network transmission channels 310 of the internal and external network switching platform 300 are called according to the target transmission data, and specifically, the corresponding internal and external network transmission channels 310 are called according to the data type of the target transmission data, that is, different data types correspond to different types of internal and external network transmission channels 310. For example, when the data type of the target transmission data is an unstructured type, an unstructured transmission channel of the intranet and extranet switching platform 300 is called; when the data type of the target transmission data is the structured type, the structured transmission channel of the intranet and extranet switching platform 300 is invoked. In practical application, the call to the corresponding internal and external network transmission channel 310 is realized by calling the API interface corresponding to the transmission channel in the internal and external network switching platform 300.
In step S500, after the call is made to the intranet/extranet transmission channel 310, the target transmission data is transmitted to the receiving end platform through the intranet/extranet transmission channel 310, and the receiving end platform processes the target transmission data to obtain initial transmission data. The processing of the target transmission data by the receiving end platform refers to a data processing mode of reversing the processing of the initial transmission data by the sending end, for example, when the sending end platform performs data transmission by configuring a time delay parameter for the initial transmission data, the receiving end platform receives the target transmission data transmitted by the sending end platform after a certain time, and at the moment, the target transmission data is not configured with the time delay parameter, namely, the data received by the receiving end platform is the initial transmission data of the sending end; if the target transmission data sent by the sending end platform is the data obtained after the initial transmission data is subjected to the slicing treatment, the receiving end platform needs to carry out restoration treatment based on the sliced transmission data after receiving the target transmission data and combine the target transmission data into original complete initial transmission data, so that data transmission exchange between the internal network and the external network is completed.
In some embodiments, the step S300 mentioned in the embodiments of the present application specifically further includes: and acquiring the priority parameter of the service request, and configuring a time delay parameter for the initial transmission data according to the priority parameter to obtain the target transmission data. Specifically, the priority of the service corresponding to the service request and/or the queue condition of the current external network synchronization module in which data transmission is being performed are called from a preset database, and a specific delay parameter, namely the time required to delay transmission, is calculated. In practical application, different service requests identify different service services, the service services have different priorities, corresponding priorities are determined according to the importance of the service services, and in addition, a data transmission task which is in progress or already in progress may exist in an external network synchronization module, a specific time delay parameter is obtained through the processing progress of the data transmission task and the priority calculation of the service requests, so that the time delay parameter is configured to initial transmission data, target transmission data is obtained, namely, the target transmission data is the initial transmission data configured with the time delay parameter, non-real-time internal and external network data synchronization can be realized through configuration of the time delay parameter, and the internal and external network switching platform 300 is ensured not to process a large amount of transmission data in the same time, so that overload condition is avoided.
In some embodiments, when the target transmission data is initial transmission data configured with a delay parameter and the target transmission data type is a structured data type, the structured transmission channel of the internal and external network switching platform 300 is invoked for data transmission after a certain waiting time according to the delay parameter of the target transmission data. The waiting time is obtained according to a time delay parameter, for example, the waiting time determined by the time delay parameter is ten seconds, and then the target transmission data needs to enter the waiting queue to wait for ten seconds before entering a data transmission link, that is, invoking a structured transmission channel of the internal and external network switching platform 300 to perform data transmission.
In a possible implementation example, for the initial transmission DATA to be transmitted of the structured DATA type, referring to fig. 3, when the external network service module 120 in the external network platform 100 needs to perform the service, the external network service module 120 calls the API interface of the external network synchronization module 110 through the service request, sends the service request to the external network synchronization module 110, and the external network synchronization module 110 calls the corresponding initial transmission DATA in the preparation stage, and the server calculates the TIME delay parameter TIME configured for the initial transmission DATA from the priority parameters such as the service priority and the service parameter, and calls the structured transmission channel of the internal and external network switching platform 300 after waiting for a certain TIME in the consumption stage, and transmits the TIME delay parameter TIME to the internal network platform 200, thereby obtaining the DATA synchronization condition between the whole internal and external networks. After receiving the initial transmission DATA, the intranet synchronization module 210 of the intranet platform 200 sends the initial transmission DATA to the intranet service module 220 for service processing, and after the service processing, returns a response to the external network synchronization module 110 of the external network platform 100, and the timing monitor can monitor the synchronization state of the current DATA transmission in real time by calling a query interface in the external network synchronization module 110 and record the synchronization state, thereby monitoring the DATA synchronization condition between the whole internal network and the whole external network, and completing the internal network and external network DATA transmission flow of the transmission DATA of the whole structured DATA type.
In some embodiments, when the target transmission data is initial transmission data configured with a delay parameter and the target transmission data type is unstructured data type, according to the delay parameter of the target transmission data, after a certain waiting time, the unstructured transmission channel of the intranet/extranet switching platform 300 is called for data transmission. The waiting time is obtained according to a time delay parameter, for example, the waiting time determined by the time delay parameter is ten seconds, and then the target transmission data needs to enter the waiting queue to wait for ten seconds before entering a data transmission link, that is, invoking an unstructured transmission channel of the internal and external network switching platform 300 to perform data transmission.
In a possible implementation application example, an initial transmission DATA to be transmitted of an unstructured DATA type is exemplarily illustrated, referring to fig. 4, when an external network service module 120 in an external network platform 100 needs to perform service, the external network service module 120 calls an API interface of an external network synchronization module 110 through a service request, the service request is sent to the external network synchronization module 110, the external network synchronization module 110 can call a corresponding initial transmission DATA File in a preparation stage, and a server obtains a TIME delay parameter TIME configured for the initial transmission DATA from a priority parameter such as a service priority and a parameter transmission priority of the service request, configures a corresponding DATA check code MD5 for the initial transmission DATA File in a consumption stage, and waits for a certain TIME of TIME to call an unstructured transmission channel of an internal network exchange platform 300, and transmits the unstructured transmission DATA to an internal network platform 200, the internal network synchronization module 210 of the internal network platform 200 receives the target transmission DATA including the initial transmission DATA File and the DATA check code MD5, checks whether the initial transmission DATA File is completely stored in the external network platform 100 according to a DATA check code MD5, and if the complete DATA is accurately stored in the external network 100, and the complete transmission result is accurately stored in the external network is accurately checked and the initial transmission DATA is completely stored in the DATA transmission platform; and after receiving the notice of the storage result, the external network synchronization module 110 can monitor the current transmission state of the transmission data through the query interface to obtain the synchronization condition of the current internal and external network data, thereby completing the internal and external network data transmission flow of the transmission data of the whole unstructured data type.
In some embodiments, step S400 mentioned in the embodiments of the present application specifically further includes: the external network synchronization module 110 in the external network platform 100 performs a slicing process on the initial transmission data to obtain a plurality of sliced transmission data, where the plurality of sliced transmission data is the target transmission data mentioned in the embodiment of the present application. In practical application, the acquired initial data is subjected to slicing processing through a file slicing module in the external network synchronization module to obtain a plurality of sliced transmission data, wherein each sliced transmission data comprises sliced parameters including but not limited to: the method comprises the steps of a slice group ID, an original file MD5, a slice ID, a slice MD5, a slice serial number and a slice number; the burst ID is identification information of a burst in which the burst transmission data is located, the original file MD5 is used for checking the integrity of the data after the burst transmission data is reorganized, the burst MD5 is used for performing data reorganization checking, the burst sequence number is used for recording the sequence of each burst transmission data in the whole burst, and the burst number is used for recording the number of the burst transmission data in the whole burst. After receiving the plurality of fragmented transmission data transmitted by the sender platform, the receiver platform can reconstruct and verify the plurality of transmission data according to the above-mentioned fragmentation parameters, including fragment verification and verification of the reconstructed original file, and by verifying the integrity and correctness of the data transmitted by the intranet and extranet switching platform 300, the problem that the transmission data cannot be correctly transmitted due to errors in the transmission process is avoided.
In some embodiments, when the sending end platform performs slicing processing on the initial transmission data to obtain a plurality of corresponding sliced transmission data, the structured transmission channels of the internal and external network switching platform 300 are called according to the plurality of sliced transmission data to perform data transmission, specifically, the data type of the initial transmission data before being subjected to slicing processing is an unstructured data type, when the data type of the plurality of sliced transmission data is obtained after being subjected to slicing processing, the data type of the sliced transmission data is divided into structured data types, and at the moment, the internal and external network transmission channels 310 to be called are the structured transmission channels and are responsible for transmitting the sliced transmission data with the structured data type. By performing the slicing process on the unstructured type of the initial transmission data, the internal and external network switching platform 300 can sequentially transmit the data with smaller data volume in batches, so that the load pressure of the data transmission of the internal and external network switching platform 300 is reduced, and the overload condition is avoided.
In some embodiments, the sending end platform configures corresponding delay parameters for the plurality of fragmented transmission data, and invokes the structured transmission channel of the internal and external network switching platform 300 to perform data transmission of the fragmented transmission data after waiting for a certain time, so as to realize non-real-time data synchronization between the internal and external networks.
In a possible implementation example, for performing data transmission after slicing processing on initial transmission data to be transmitted, referring to fig. 5, when an external network service module 120 in an external network platform 100 needs to perform service, the external network service module 120 calls an API interface of an external network synchronization module 110 through a service request, sends the service request to the external network synchronization module 110, the external network synchronization module 110 invokes a corresponding initial transmission data File from an SFTP database, records a log of the obtained initial transmission data File in a log database, and performs slicing processing on the initial transmission data File by a File slicing module of the external network synchronization module 110 to obtain a plurality of corresponding sliced transmission data, for example, a plurality of sliced transmission data such as a slice 1, a slice 2, a slice n, and the like, where each sliced transmission data carries a corresponding slice parameter, for example, including: the method comprises the following steps of a slice group ID, an original file MD5, a slice ID, a slice MD5, a slice serial number, a slice number and the like; the data transmission is carried out by calling the structured transmission channels of the internal and external network exchange platform 300 according to the plurality of sliced transmission data, after the intranet synchronization module 210 of the intranet platform 200 receives the plurality of sliced transmission data, the steps of slicing verification, slicing recombination, original File verification and the like are carried out on the sliced transmission data successively, so that a correct original File, namely an original transmission data File, is obtained and stored in a corresponding SFTP database, a response of successfully storing the File is returned to the external network synchronization module 110, the received response is stored in a corresponding log database in a log form by the external network synchronization module 110, and the internal and external network data transmission flow after the slicing processing of the whole original transmission data is completed.
In some embodiments, the target transmission data of the unstructured data type further includes a data check code, where the data check code is used for performing integrity check on the target transmission data after the receiving end platform receives the target transmission data, checking whether a problem of data errors occurs, obtaining a check result, and completing data transmission between the internal network and the external network if the check result is that the target transmission data does not have a problem, and specifically, the data check code may be an MD5 check code. When the receiving end receives the target transmission data, the receiving end checks the target transmission data through the MD5 check code, a corresponding check result is obtained after the check, the check result is returned to the sending end platform, the sending end platform determines the transmission condition of the current target transmission data through the check result, and if the check result shows that the check is successful, the receiving end platform is proved to successfully receive the complete target transmission data; if the verification result shows that the verification fails, the receiving end platform is proved to not successfully receive and store the complete target transmission data, and the target transmission data needs to be retransmitted to the receiving end platform.
In some embodiments, the external network synchronization module 110 of the transmitting end mentioned in the embodiments of the present application may acquire and record the transmission status information of the target transmission data, and may acquire the transmission status information of the receiving end platform according to the received target transmission data, determine the transmission condition of the current target transmission data by combining the transmission status information, the acquisition status information and the processing status information, and determine whether to resend the target transmission data to the receiving end platform according to the specific transmission condition of the current target transmission data, or resend the target transmission data to the internal network service module 220 of the receiving end platform part by the receiving end platform for service processing. In practical application, the target transmission data in the embodiment of the present application is described with respect to the target transmission data of the structured data type, and the data synchronization processing is performed by the external network data synchronization module and the internal network data synchronization module 212 in the external network synchronization module 110, so as to implement corresponding processing on the abnormal state of data synchronization between the internal network and the external network, and avoid the problem of abnormal data synchronization.
In a possible implementation example, as shown in fig. 6, the external network service module 120 invokes an interface of the external network synchronization module 110 to perform a service request, monitors transmission status information of the external network synchronization module 110 of the sending end platform in a certain period of time through the timing monitor a, and records the monitored transmission status information into a database so as to perform an invoking record; the transmission state information of the intranet synchronous module 210 of the receiving end platform is monitored in a certain time period through the timing monitor B, the monitored acquired state information of the intranet synchronous module 210 is recorded in a database so as to be convenient for calling and recording, and the record is returned to the transmitting end platform; the transmission state information of the intranet service module 220 of the receiving end platform is monitored in a certain time period through the timing monitor C, and the monitored processing state information of the intranet service module 220 is recorded in a database so as to be convenient for calling and recording.
For the transmission state information, the acquired state information and the processing state information, as shown in table 1 below, when the transmission state information monitored by the timing monitor a is sending, the acquired state information monitored by the timing monitor B is empty, and when the processing state information monitored by the timing monitor C is empty, it represents that the target transmission data is sent but not reached, which indicates that the external network synchronization module 110 of the current external network platform 100 is in error, and at this time, the external network synchronization module 110 of the external network platform 100 resends the target transmission data to the internal network platform 200; when the transmission state information monitored by the timing monitor a is sensing, the acquired state information monitored by the timing monitor B is arived, and the processing state information monitored by the timing monitor C is empty, the external network synchronization module 110 representing that the target transmission data has arrived but is not notified to the external network platform 100 by a return notification is called back to the external network synchronization module 110, which indicates that the internal network synchronization module 210 of the current internal network platform 200 is in error, and the internal network platform 200 resends the target transmission data to the data synchronization module of the internal network platform 200; when the transmission state information monitored by the timing monitor a is aried, the acquired state information monitored by the timing monitor B is aried, and the processing state information monitored by the timing monitor C is empty, the transmission state information represents that the target transmission data is sent but not processed, which indicates that the intranet service module 220 of the current intranet platform 200 is in error, and at the moment, the intranet synchronization module 210 of the intranet platform 200 resends the target transmission data to the intranet service module 220; when the transmission state information monitored by the timing monitor a is aried and the acquired state information monitored by the timing monitor B is aried and the processing state information monitored by the timing monitor C is execute, the processing state information represents that the target transmission data is processed but is not returned to be notified to the external network platform 100, which indicates that the internal network service module 220 of the current internal network platform 200 is in error, at this time, the data synchronization module of the external network platform 100 resends the target transmission data to the data synchronization module of the internal network platform 200, and then the data synchronization module 210 of the internal network platform 200 sends the target transmission data to the internal network service module 220; when the transmission status information monitored by the timing monitor a is fail and the acquired status information monitored by the timing monitor B is fail, the processing status information monitored by the timing monitor C represents failure of processing the target transmission data, which indicates that the intranet service module 220 of the current intranet platform 200 is in error, and the extranet synchronization module 110 of the extranet platform 100 resends the target transmission data to the intranet synchronization module 210 of the intranet platform 200, and then the intranet synchronization module 210 of the intranet platform 200 sends the target transmission data to the intranet service module 220 for service processing.
| Timing monitor A | Timing monitor B | Timing monitor C |
| sending | Empty space | Empty space |
| sending | arrived | Empty space |
| arrived | arrived | Empty space |
| arrived | arrived | execute |
| fail | fail | fail |
TABLE 1
In this embodiment of the present application, by acquiring a service request for data transmission, acquiring initial transmission data to be transmitted according to the service request, processing the initial transmission data to obtain target transmission data, calling the internal and external network transmission channels 310 of the internal and external network switching platform 300 according to the target transmission data, transmitting the target transmission data to the receiving end platform through the internal and external network transmission channels 310, and processing the target transmission data by the receiving end platform to obtain the initial transmission data, the internal and external network switching platform 300 can avoid the conditions of overlarge service pressure and service overload when performing internal and external network data transmission, and improve the stability of internal and external network data transmission.
In a second aspect, embodiments of the present application further provide an electronic device, including: at least one processor, and a memory communicatively coupled to the at least one processor;
the processor is configured to execute the method for transmitting data between the internal and external networks in the embodiment of the first aspect by calling a computer program stored in the memory.
The memory is used as a non-transitory computer readable storage medium for storing a non-transitory software program and a non-transitory computer executable program, such as the intranet and extranet data transmission method in the embodiment of the first aspect of the application. The processor executes the non-transitory software program and instructions stored in the memory, thereby implementing the method for transmitting intranet and extranet data in the embodiment of the first aspect.
The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store and execute the intranet and extranet data transmission method in the embodiment of the first aspect. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory optionally includes memory remotely located relative to the processor, the remote memory being connectable to the terminal through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The non-transitory software programs and instructions required to implement the method for data transmission in the first aspect embodiment are stored in the memory, and when executed by the one or more processors, the method for data transmission in the first aspect embodiment is performed.
In a third aspect, embodiments of the present application further provide a computer-readable storage medium storing computer-executable instructions for: executing the internal and external network data transmission method in the embodiment of the first aspect;
In some embodiments, the computer-readable storage medium stores computer-executable instructions that are executed by one or more control processors, for example, by one processor in an electronic device of the second aspect embodiment, and may cause the one or more processors to perform the method for intranet and extranet data transmission in the first aspect embodiment.
The above described embodiments of the apparatus are only illustrative, wherein the units described as separate components may or may not be physically separate, i.e. may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
In the description of the present specification, descriptions with reference to the terms "some embodiments," "examples," "specific examples," or "some examples," etc., mean that a particular feature or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples.
Claims (8)
1. The method for transmitting the data of the intranet and the extranet is characterized by comprising the following steps of:
acquiring a service request for data transmission;
acquiring initial transmission data to be transmitted according to the service request;
processing the initial transmission data to obtain target transmission data; the processing the initial transmission data to obtain target transmission data includes: acquiring priority parameters of the service request; wherein, corresponding priority parameters are determined according to the importance of business service; configuring delay parameters for the initial transmission data according to the priority parameters to obtain the target transmission data; the specific time delay parameter is obtained through the calculation of the processing progress of the data transmission task and the priority of the service request;
Calling an internal and external network transmission channel of an internal and external network exchange platform according to the target transmission data;
transmitting the target transmission data to a receiving end platform through the internal and external network transmission channel, and processing the target transmission data by the receiving end platform to obtain the initial transmission data;
when the internal and external networks transmit data, current transmission state information of the target transmission data is acquired, and acquisition state information and processing state information of the target transmission data returned by the receiving end platform are acquired; monitoring a data transmission state according to the transmission state information, the acquired state information and the processing state information, and transmitting the target transmission data to a receiving end platform through the internal and external network transmission channel again if the data transmission is problematic; and retransmitting the target transmission data through the receiving end platform if the data is transmitted to the receiving end platform with a problem.
2. The method of claim 1, wherein the internal and external network transmission channels comprise structured transmission channels;
correspondingly, the calling the internal and external network transmission channels of the internal and external network switching platform according to the target transmission data comprises the following steps:
And calling the structured transmission channel of the internal and external network switching platform according to the delay parameter of the target transmission data and the structured data type of the target transmission data.
3. The method for transmitting data between an internal network and an external network according to claim 1, wherein the internal network transmission channel comprises an unstructured transmission channel;
correspondingly, the calling the internal and external network transmission channels of the internal and external network switching platform according to the target transmission data comprises the following steps:
and invoking an unstructured transmission channel of the internal and external network switching platform according to the time delay parameter of the target transmission data and the unstructured data type of the target transmission data.
4. The method for transmitting data between an internal network and an external network according to claim 1, wherein said processing said initial transmission data to obtain target transmission data comprises:
and performing slicing processing on the initial transmission data to obtain a plurality of sliced transmission data.
5. The method for transmitting data between an internal network and an external network according to claim 4, wherein said calling an internal network transmission channel of an internal network switching platform according to said target transmission data comprises:
and calling the structured transmission channel of the internal and external network switching platform according to the plurality of the fragmented transmission data.
6. The method for transmitting data over an intranet and extranet according to claim 5, wherein the target transmission data includes a data check code;
and acquiring a verification result of the target transmission data returned by the receiving end platform, wherein the verification result is obtained by the receiving end platform through verifying the target transmission data according to the data verification code.
7. An electronic device, comprising:
at least one processor, and,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions that are executed by the at least one processor to cause the at least one processor to implement the intranet and extranet data transmission method of any one of claims 1-6 when the instructions are executed.
8. A computer-readable storage medium storing computer-executable instructions for causing a computer to perform the intranet and extranet data transmission method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110882634.4A CN113746900B (en) | 2021-08-02 | 2021-08-02 | Intranet data transmission method, electronic device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110882634.4A CN113746900B (en) | 2021-08-02 | 2021-08-02 | Intranet data transmission method, electronic device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113746900A CN113746900A (en) | 2021-12-03 |
| CN113746900B true CN113746900B (en) | 2024-02-23 |
Family
ID=78729772
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110882634.4A Active CN113746900B (en) | 2021-08-02 | 2021-08-02 | Intranet data transmission method, electronic device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113746900B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114389866B (en) * | 2021-12-29 | 2022-08-26 | 北京连山科技股份有限公司 | System and method for realizing high-speed isolation network gate data ferrying |
| CN114900473B (en) * | 2022-04-24 | 2024-08-16 | 深圳位置网科技有限公司 | Transmission method for transmitting emergency data to safety platform and transmission platform thereof |
| CN115348090A (en) * | 2022-08-16 | 2022-11-15 | 中国联合网络通信集团有限公司 | Intranet and extranet interaction method and device for enterprise and electronic equipment |
| CN116527731B (en) * | 2023-02-01 | 2023-09-26 | 武汉华瑞测智能技术有限公司 | Power plant internal and external network communication method, equipment and medium based on network isolation device |
| CN116471103B (en) * | 2023-05-04 | 2023-09-22 | 深圳市显科科技有限公司 | Internal and external network data security exchange method, device and equipment based on boundary network |
| CN116260657B (en) * | 2023-05-09 | 2023-07-21 | 南京汇荣信息技术有限公司 | Information encryption method and system suitable for network security system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101001201A (en) * | 2006-01-13 | 2007-07-18 | 华为技术有限公司 | Method for setting count request delay |
| CN106209801A (en) * | 2016-06-28 | 2016-12-07 | 广东电网有限责任公司信息中心 | Mobile solution platform and inner-external network data safety switching plane integrated system |
| CN112105080A (en) * | 2020-11-18 | 2020-12-18 | 之江实验室 | Time-sensitive network data transmission system and transmission method |
-
2021
- 2021-08-02 CN CN202110882634.4A patent/CN113746900B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101001201A (en) * | 2006-01-13 | 2007-07-18 | 华为技术有限公司 | Method for setting count request delay |
| CN106209801A (en) * | 2016-06-28 | 2016-12-07 | 广东电网有限责任公司信息中心 | Mobile solution platform and inner-external network data safety switching plane integrated system |
| CN112105080A (en) * | 2020-11-18 | 2020-12-18 | 之江实验室 | Time-sensitive network data transmission system and transmission method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113746900A (en) | 2021-12-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113746900B (en) | Intranet data transmission method, electronic device and computer readable storage medium | |
| US11063709B2 (en) | Segment retransmission method and apparatus | |
| CN111629368B (en) | Communication method of earphone and charging box, earphone and readable storage medium | |
| CN110120980A (en) | Reliable file transmission method, computer equipment and the storage medium of unstable link | |
| CN107645531A (en) | Method of data synchronization and system | |
| EP3537740B1 (en) | Hash based device configuration management | |
| CN117714324A (en) | RDMA request overtime monitoring method and device | |
| CN109428684B (en) | Data transmission method, RLC entity and PDCP entity | |
| CN107359972B (en) | A kind of data receiver method and device | |
| CN116599953B (en) | File uploading method, device, system, equipment and readable storage medium | |
| CN112839106A (en) | Communication method and apparatus, electronic device, and medium | |
| CN117424910A (en) | Automatic synchronization method, system, equipment and medium for incremental data | |
| CN117040692A (en) | Method and device for transmitting service data, electronic equipment and storage medium | |
| EP1662704B1 (en) | Monitoring system, apparatus to be monitored, monitoring apparatus and monitoring method | |
| CN111190754A (en) | Block chain event notification method and block chain system | |
| CN115988110A (en) | Inter-chip communication method and storage medium | |
| WO2016165289A1 (en) | Inter-board data processing method and device | |
| CN113645103A (en) | Method and device for detecting communication link abnormity between video monitoring platform and front-end equipment | |
| CN108988994A (en) | The repeating method and device of message | |
| CN111131001A (en) | Message sending method, device, storage medium and server | |
| CN113891499A (en) | Method and device for solving inconsistency of user plane states of core network and base station | |
| CN111478755B (en) | Asynchronous data communication method, medium, equipment and asynchronous data communication system | |
| CN110784518A (en) | Static resource acquisition method and device | |
| CN111552907A (en) | Message processing method, device, equipment and storage medium | |
| CN115484004B (en) | Error message retry method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: 510000 501, 502, 601 and 602, building D, wisdom Plaza, Qiaoxiang Road, Gaofa community, Shahe street, Nanshan District, Shenzhen, Guangdong Applicant after: China Southern Power Grid Digital Platform Technology (Guangdong) Co.,Ltd. Address before: 510000 501, 502, 601 and 602, building D, wisdom Plaza, Qiaoxiang Road, Gaofa community, Shahe street, Nanshan District, Shenzhen, Guangdong Applicant before: China Southern Power Grid Shenzhen Digital Power Grid Research Institute Co.,Ltd. Country or region before: China |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |