CN114124916A - Data transmission method and device, electronic equipment and storage medium - Google Patents

Data transmission method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN114124916A
CN114124916A CN202111258128.4A CN202111258128A CN114124916A CN 114124916 A CN114124916 A CN 114124916A CN 202111258128 A CN202111258128 A CN 202111258128A CN 114124916 A CN114124916 A CN 114124916A
Authority
CN
China
Prior art keywords
data
transmission
target
communication network
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111258128.4A
Other languages
Chinese (zh)
Inventor
张池
陈明智
于高
王闯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apollo Intelligent Connectivity Beijing Technology Co Ltd
Original Assignee
Apollo Intelligent Connectivity Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apollo Intelligent Connectivity Beijing Technology Co Ltd filed Critical Apollo Intelligent Connectivity Beijing Technology Co Ltd
Priority to CN202111258128.4A priority Critical patent/CN114124916A/en
Publication of CN114124916A publication Critical patent/CN114124916A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/10—Network architectures or network communication protocols for network security for controlling access to devices or network resources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H04L67/146—Markers for unambiguous identification of a particular session, e.g. session cookie or URL-encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04—Protocols for data compression, e.g. ROHC
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22—Parsing or analysis of headers

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The present disclosure provides a data transmission method, an apparatus, an electronic device and a storage medium, which relate to the technical field of computers, in particular to the technical field of artificial intelligence such as intelligent transportation and big data, and include: the method comprises the steps of receiving a data transmission request sent by a first application program in a first communication network, analyzing the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data, processing the initial transmission data according to the data description information to obtain target transmission data, and transmitting the target transmission data to a second data transmission device, wherein the second data transmission device corresponds to a second communication network, and the first communication network and the second communication network are different.

Description

Data transmission method and device, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to the field of artificial intelligence technologies such as intelligent transportation and big data, and in particular, to a data transmission method and apparatus, an electronic device, and a storage medium.
Background
Artificial intelligence is the subject of research that makes computers simulate some human mental processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), both at the hardware level and at the software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data, and the like; the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, machine learning/deep learning, a big data technology, a knowledge map technology and the like.
In the related art, when data is transmitted across networks, the convenience of data transmission is poor, and the security of data transmission is low.
Disclosure of Invention
The disclosure provides a data transmission method, a data transmission device, an electronic device, a storage medium and a computer program product.
According to a first aspect of the present disclosure, there is provided a data transmission method applied to a first data transmission apparatus, where the first data transmission apparatus corresponds to a first communication network, including: receiving a data transmission request sent by a first application program in the first communication network; analyzing the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data; processing the initial transmission data according to the data description information to obtain target transmission data; and transmitting the target transmission data to a second data transmission device, wherein the second data transmission device corresponds to a second communication network, and the first communication network is different from the second communication network.
According to a second aspect of the present disclosure, there is provided a data transmission method applied to a second data transmission apparatus, where the second data transmission apparatus corresponds to a second communication network, including: receiving target transmission data transmitted by a first data transmission device; transmitting the target transmission data to a second application program of the second communication network; the first data transmission device corresponds to a first communication network, the first communication network is different from the second communication network, the target transmission data is obtained by analyzing the first data transmission device according to a data transmission request sent by a first application program, initial transmission data and data description information are obtained, and the initial transmission data is processed by adopting the data description information, and the first application program is an application program in the first communication network.
According to a third aspect of the present disclosure, there is provided a data transmission apparatus, the apparatus corresponding to a first communication network, comprising: a first receiving module, configured to receive a data transmission request sent by a first application program in the first communication network; the analysis module is used for analyzing the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data; the processing module is used for processing the initial transmission data according to the data description information to obtain target transmission data; the first transmission module is configured to transmit the target transmission data to a second data transmission device, where the second data transmission device corresponds to a second communication network, and the first communication network and the second communication network are different.
According to a fourth aspect of the present disclosure, there is provided a data transmission apparatus, the apparatus corresponding to a second communication network, including: the second receiving module is used for receiving the target transmission data transmitted by the first data transmission device; a second transmission module, configured to transmit the target transmission data to a second application program of the second communication network; the first data transmission device corresponds to a first communication network, the first communication network is different from the second communication network, the target transmission data is obtained by analyzing the first data transmission device according to a data transmission request sent by a first application program, initial transmission data and data description information are obtained, and the initial transmission data is processed by adopting the data description information, and the first application program is an application program in the first communication network.
According to a fifth aspect of the present disclosure, there is provided an electronic device comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data transfer method according to the first aspect of the disclosure or to perform the data transfer method according to the second aspect of the disclosure.
According to a sixth aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the data transmission method according to the first aspect of the present disclosure or perform the data transmission method according to the second aspect of the present disclosure.
According to a seventh aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the steps of the data transmission method according to the first aspect of the present disclosure, or performs the steps of the data transmission method according to the second aspect of the present disclosure.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 is a schematic diagram according to a first embodiment of the present disclosure;
FIG. 2 is a schematic diagram according to a second embodiment of the present disclosure;
FIG. 3 is a schematic diagram according to a third embodiment of the present disclosure;
FIG. 4 is a schematic diagram according to a fourth embodiment of the present disclosure;
FIG. 5 is a schematic diagram of a data transmission device according to an embodiment of the present disclosure;
FIG. 6 is a schematic diagram according to a fifth embodiment of the present disclosure;
FIG. 7 is a schematic diagram according to a sixth embodiment of the present disclosure;
FIG. 8 is a schematic diagram according to a seventh embodiment of the present disclosure;
FIG. 9 is a schematic diagram according to an eighth embodiment of the present disclosure;
fig. 10 shows a schematic block diagram of an example electronic device used to implement the data transmission method of an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a schematic diagram according to a first embodiment of the present disclosure.
It should be noted that the main execution body of the data transmission method of this embodiment is a data transmission device, the device may be implemented by software and/or hardware, the device may be configured in an electronic device, and the electronic device may include, but is not limited to, a terminal, a server, and the like.
The embodiment of the disclosure relates to the technical field of computers, in particular to the technical field of intelligent transportation and big data.
Wherein, Artificial Intelligence (Artificial Intelligence), english is abbreviated as AI. The method is a new technical science for researching and developing theories, methods, technologies and application systems for simulating, extending and expanding human intelligence.
The big data refers to a process of analyzing and processing large-scale data in an artificial intelligence mode, and the big data can be summarized into 5V, and has a large data Volume (Volume), a high speed (Velocity), a plurality of types (Variety), a Value (Value), and a reality (Veracity).
The intelligent transportation is a transportation-oriented system based on modern electronic information technology. The system is a real-time, accurate and efficient comprehensive transportation management system which can play a role in a large range and all around and is established by effectively integrating and applying an advanced information technology, a data communication transmission technology, an electronic sensing technology, a control technology, a computer technology and the like to the whole ground transportation management system.
As shown in fig. 1, the data transmission method includes:
s101: a data transmission request sent by a first application in a first communication network is received.
The data transmission method described in the embodiment of the present disclosure may be applied to a first data transmission device, that is, data may be transmitted from the first data transmission device to a second data transmission device, and may also be transmitted from the second data transmission device to the first data transmission device, where the data transmission device may specifically be, for example, a data channel (data-tunnel) system, and is not limited thereto.
The communication network corresponding to the first data transmission device may be referred to as a first communication network, and the communication network may be a wide area network or a local area network, which is not limited thereto.
The application in the first communication network may be referred to as a first application.
The request sent by the first application program for triggering data transmission may be referred to as a data transmission request.
In this disclosure, the first data transmission device may provide a corresponding HyperText Transfer Protocol (HTTP) interface, and correspondingly, receive a data transmission request sent by a first application program in the first communication network, where the first application program invokes the HTTP interface of the first data transmission device in advance, report the data transmission request to the first data transmission device, and the first data transmission device receives the data transmission request sent by the first application program in the first communication network, or the first data transmission device may monitor and obtain the data transmission request sent by the first application program in the first communication network in any other possible manner, which is not limited to this.
S102: and analyzing the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data.
The data to be transmitted currently may be referred to as initial transmission data.
The initial transmission data may have some related description information, which may be referred to as data description information, and the data description information may specifically be, for example, a data name, a data storage address, a data size, and the like, which is not limited thereto.
After receiving a data transmission request sent by a first application program in a first communication network, the embodiment of the disclosure may analyze the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data.
For example, after receiving the data transmission request of the first application, the first data transmission device may parse the data transmission request to obtain the data content, the data size, and the data name, and then may use the data content as the initial transmission data and use the data size and the data name together as the data description information, which is not limited thereto.
S103: and processing the initial transmission data according to the data description information to obtain target transmission data.
After the initial transmission data is obtained by analyzing the data transmission request, the initial transmission data can be processed according to the data description information to obtain processed data, and the data can be called as target transmission data.
In some embodiments, the initial transmission data is processed according to the data description information, or the initial transmission data is correspondingly labeled according to the data description information, for example, a data storage address corresponding to the initial transmission data may be obtained by parsing the data transmission request and used as the data description information, and then the initial transmission data may be labeled according to the data storage address and the labeled data is used as the target transmission data, which is not limited to this.
In other embodiments, the initial transmission data is processed according to the data description information, or the initial transmission data is compressed according to the data description information, for example, a data size corresponding to the initial transmission data may be obtained by parsing the data transmission request and used as the data description information, and then the initial transmission data may be compressed according to the data size and the compressed data is used as the target transmission data, which is not limited to this.
S104: and transmitting the target transmission data to a second data transmission device, wherein the second data transmission device corresponds to a second communication network, and the first communication network is different from the second communication network.
After the initial transmission data is processed according to the data description information to obtain the target transmission data, the target transmission data can be transmitted to the second data transmission device.
That is to say, the data transmission method described in the embodiment of the present disclosure may be applied to transmit data between a first data transmission device and a second data transmission device, where the second data transmission device corresponds to a second communication network, the first communication network is different from the second communication network, and the second communication network may also be a wide area network or a local area network, which is not limited to this.
In the embodiment of the present disclosure, a first program in a first communication network may send a data transmission request, and then a first data transmission device may transmit data to a second data transmission device in a second communication network based on the data transmission request, so that cross-network transmission of data may be achieved.
In some embodiments, the target data may be transmitted to the second data transmission device by the first data transmission device and the second data transmission device providing corresponding data transmission interfaces, and then the first data transmission device may transmit the target data to the second data transmission device via the data transmission interfaces.
In other embodiments, the first data transmission device may also upload the target transmission data to a corresponding data transmission module in advance (the data transmission module may be a module that is configured between the first data transmission device and the second data transmission device in advance, and the module may be used to exchange data between the first data transmission device and the second data transmission device), and then the data transmission module transmits the target transmission data to the second data transmission device, which is not limited to this.
In this embodiment, a data transmission request sent by a first application program in a first communication network is received, initial transmission data and data description information corresponding to the initial transmission data are obtained through analysis in the data transmission request, the initial transmission data are processed according to the data description information, target transmission data are obtained, and the target transmission data are transmitted to a second data transmission device corresponding to a second communication network, wherein the first communication network and the second communication network are different, so that convenience of data transmission between different communication networks can be effectively improved, safety of data transmission can be effectively guaranteed, applicability of a data transmission method can be effectively improved, and a data transmission effect can be improved.
Fig. 2 is a schematic diagram according to a second embodiment of the present disclosure.
As shown in fig. 2, the data transmission method includes:
s201: a data transmission request sent by a first application in a first communication network is received.
S202: and analyzing the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data.
For the description of S201-S202, reference may be made to the above embodiments, which are not described herein again.
S203: and performing authentication and certification on the initial transmission data according to the data certification information.
The information for authenticating and authenticating the data may be referred to as data authentication information, and the data authentication information may specifically be, for example: data name, data key, etc., without limitation.
In the embodiment of the present disclosure, corresponding configuration information, such as a data name and a data key, may be configured in advance for the first data transmission device, and accordingly, authentication and authentication may be performed on the initial transmission data, and it may be determined whether the data authentication information matches the configuration information configured in advance in the first data transmission device, so as to ensure security of data transmission between the cross-network transmissions.
S204: and processing the initial transmission data according to the data description information to obtain the data to be transmitted.
After the data description information corresponding to the initial transmission data is obtained through analysis in the data transmission request, the initial transmission data can be processed according to the data description information, and the processed data is used as data to be transmitted.
Optionally, in some embodiments, the initial transmission data is processed according to the data description information, the initial transmission data may be processed according to the data description information when the result of the authentication and authentication of the initial transmission data satisfies the authentication condition, so as to obtain the data to be transmitted, because it is determined whether the result of the authentication and authentication of the initial transmission data satisfies the authentication condition before the initial transmission data is processed, when the authentication condition is satisfied, it indicates that the initial transmission data satisfies the requirement of the authentication security, the processing of the initial transmission data based on the data description information may be triggered to obtain the target transmission data, and if the initial transmission data does not satisfy the requirement of the authentication security, the description and encapsulation of the initial transmission data is not triggered, so that the resource consumption occupied by the data description and encapsulation can be reduced, and the data describing and encapsulating can be guaranteed to satisfy the requirement of the authentication security, the safety performance of data in the whole data transmission process is effectively improved.
For example, if the data authentication information matches the pre-configured configuration information in the first data transmission device, it may be characterized that the result of the authentication and authentication on the initial transmission data satisfies the authentication condition, at this time, the initial transmission data may be processed according to the data description information to obtain the target transmission data, if the data authentication information does not match the pre-configured configuration information in the first data transmission device, it may be characterized that the result of the authentication and authentication on the initial transmission data does not satisfy the authentication condition, the description and encapsulation processing on the initial transmission data is not performed, and the continuous monitoring of the next frame data may be triggered, which is not limited.
Optionally, in some embodiments, the processing of the initial transmission data according to the data description information to obtain the data to be transmitted may be performed by performing format conversion on the initial transmission data by using a file transmission protocol to obtain the data to be transmitted, generating data marking information by using a data identifier and a data name, and marking the data to be processed by using the data marking information to obtain the data to be transmitted, since the format conversion is performed on the initial transmission data by using the file transmission protocol, the data to be processed based on the file transmission protocol can be efficiently transmitted in the execution process of the subsequent data transmission method, and in addition, the data to be processed is marked by using the data marking information, so that the data to be transmitted can be efficiently traced and marked by using the subsequent reference data marking information, and the traceability of the data in the whole data transmission process can be ensured, the applicability of data transmission can be effectively assisted to be improved.
Wherein the data description information includes: the data identifier (data-id) and the data name are used to uniquely identify an identifier of the initial transmission data, which may be referred to as a data identifier, and the data name may represent information, such as semantic information and a data type, included in the initial transmission data, which is not limited in this respect.
In the embodiment of the present disclosure, when sending the data transmission request, the first application in the first communication network may apply for a data-id and a data key (which may be used to perform encryption processing on data) corresponding to the data type from the first data transmission device according to the data type corresponding to the data transmission request, that is, for different types of transmission data, the first application may apply for different data-ids from the first data transmission device, where the data-ids may be referred to as data identifiers.
In the embodiment of the present disclosure, the first data transmission device may support a File Transfer Protocol (FTP), that is, the first data transmission device may transmit data based on the FTP, and of course, the first data transmission device may also adopt any other possible Transfer Protocol to transmit data, which is not limited thereto.
In the embodiment of the present disclosure, after the initial transmission data is obtained by parsing the data transmission request, format conversion may be performed on the initial transmission data by using a file transfer protocol FTP, that is, a format of the initial transmission data may be converted into data capable of supporting an FTP format, where the data may be referred to as to-be-processed data.
After the data identifier and the data name are obtained by analyzing the data transmission request, the corresponding marking information can be generated by using the data identifier and the data name, and the marking information can be called as data marking information which can be used for marking the data to be processed.
That is to say, in the embodiment of the present disclosure, format conversion is performed on initial transmission data by using a file transmission protocol to obtain data to be processed, and after data tag information is generated by using a data identifier and a data name, the data to be processed may be tagged by using the data tag information, and the tagged data is used as the data to be transmitted.
S205: and encrypting the data to be transmitted to obtain target transmission data.
After the initial transmission data is processed according to the data description information to obtain the data to be transmitted, the data to be transmitted can be encrypted, and the encrypted data is used as target transmission data.
The encryption processing is a processing mode of converting a plaintext into a ciphertext through an encryption algorithm and a secret key in the field of computer security, and data to be transmitted are encrypted, so that the occurrence of data leakage events in the data transmission process can be effectively avoided, the security of the data in the whole data transmission process is effectively guaranteed, and the security level of the data is effectively improved.
In the embodiment of the present disclosure, a data identifier may correspond to a data key, that is, data of the same data identifier may be encrypted according to the data key, and then, in the data transmission process, a data key corresponding to the data identifier may be determined according to the data identifier.
In this embodiment, after the data to be processed is obtained, the data to be processed may be stored in a corresponding file with a data name as a file name, the file is encrypted by using the data key corresponding to the data identifier obtained by applying to the first data transmission device, and the encrypted data is used as the target transmission data.
S206: the target transfer data is transferred to a first server in a first communication network, wherein the first server supports a file transfer protocol.
In the first communication network, the server supporting the data transmission based on the file transfer protocol FTP may be referred to as a first server, that is, the first server supports the file transfer protocol FTP.
That is to say, after the target transmission data is obtained, the first data transmission device may upload the target transmission data to the first server supporting the file transfer protocol FTP in an uplink synchronization manner, and then the first server may push the target transmission data to the second data transmission device.
S207: and controlling the first server to synchronize the target transmission data to a second server, wherein the second server is a server supporting a file transfer protocol in a second communication network, so as to trigger the second server to push the target transmission data to a second data transmission device.
The communication network corresponding to the second data transmission device may be referred to as a second communication network, and the communication network may be a wide area network or a local area network, which is not limited thereto.
In the second communication network, the server supporting the data transmission based on the file transfer protocol FTP may be referred to as a second server, that is, the second server may also be a server configured to support the file transfer protocol FTP, so that the data is efficiently and conveniently transmitted by the server supporting the file transfer protocol FTP in the cross-network.
In the embodiment of the present disclosure, the first server is controlled to synchronize the target transmission data to the second server, where the first server directly synchronizes the target transmission data to the second server based on the file transfer protocol FTP, or a security vendor supporting the file transfer protocol FTP is configured between the first communication network and the second communication network, and then the target transmission data transmitted by the first server may be received based on a gateway of the security vendor, and then the target transmission data is synchronized to the second server in the second communication network, which is not limited thereto.
In some embodiments, when the target transmission data is synchronized to the second server based on the security vendor, in order to effectively reduce the data synchronization pressure of the security vendor, the first data transmission device may compress the target transmission data in advance to reduce the size of the data, so as to effectively reduce the data synchronization pressure of the security vendor, and effectively improve the data transmission efficiency.
In the embodiment of the disclosure, when the first server target transmission data is synchronized to the second server based on the security vendor, when the security vendor supports the sub-directory synchronization of the server, a directory with a data identifier as a name may be created in the server to distinguish data of different data identifiers in the server directory, and when the security vendor does not support the sub-directory synchronization of the server, a prefix of the data identifier may be added before a file name to distinguish data of different data identifiers in the server directory.
In some embodiments, when the target transmission data is synchronized to the second server timeout event, that is, the target transmission data is frequently transmitted in the form of a small data size file, the first data transmission device may perform a buffering function, for example, the first data transmission device may pack a plurality of small files with a certain time or a certain total file size into a total file, and then transmit the total file to the second server.
In the embodiment of the disclosure, the target transmission data is transmitted to the first server in the first communication network, and then the target transmission data is synchronized to the second server by the first server, so that direct access to the external network can be avoided, thereby effectively avoiding attack of the external network and effectively ensuring data security.
The data transmission method described in the embodiment of the present disclosure may further support monitoring and alarming for data traffic and data transmission delay, for example, for data transmission delay, the start time of data transmission and the delay time of each stage of data transmission may be filled in a file name, and when data is transmitted to the second communication network, the second data transmission device may obtain information related to data transmission delay by parsing the file name, obtain a file size, store the file size and the information related to data transmission delay in an analysis Engine (ES), count data of the ES, display delay and traffic in a monitoring page, and further set traffic early warning, and may alarm when traffic is abnormal, and may also set data transmission delay early warning, and may alarm when data transmission delay is abnormal.
In the embodiment, the data transmission request sent by the first application program in the first communication network is received, the initial transmission data and the data description information corresponding to the initial transmission data are obtained by analyzing the data transmission request, the authentication and the certification are carried out on the initial transmission data according to the data certification information, the initial transmission data are processed according to the data description information, the data to be transmitted are obtained, the data to be transmitted are encrypted, the occurrence of data leakage events in the data transmission process can be effectively avoided, the safety of the data in the whole data transmission process is effectively guaranteed, the safety and confidentiality level of the data is effectively improved, the target transmission data are transmitted to the first server in the first communication network, the target transmission data are synchronized to the second server by the first server, and the direct access to an external network can be avoided, therefore, the attack of an external network can be effectively avoided, the data safety is effectively guaranteed, in addition, the data are transmitted through the server, the uniformity and the convenience of data management in data transmission can be effectively improved, the dynamic management effect of the data in the data transmission process is improved, and the online deployment implementation and the application of the data transmission method are facilitated.
Fig. 3 is a schematic diagram according to a third embodiment of the present disclosure.
It should be noted that the main execution body of the data transmission method of this embodiment is a data transmission device, the device may be implemented by software and/or hardware, the device may be configured in an electronic device, and the electronic device may include, but is not limited to, a terminal, a server, and the like.
As shown in fig. 3, the data transmission method includes:
s301: and receiving target transmission data transmitted by the first data transmission device.
The same meanings and descriptions of terms in this embodiment as those in the above embodiments may be specifically referred to the above embodiments, and are not repeated herein.
The data transmission method described in the embodiments of the present disclosure may be applied to a second data transmission apparatus, where the second data transmission apparatus corresponds to a second communication network, that is, the second data apparatus may receive target transmission data transmitted by a first data transmission apparatus.
The first data transmission device corresponds to a first communication network, the first communication network is different from a second communication network, and the target transmission data is obtained by analyzing the first data transmission device according to a data transmission request sent by a first application program to obtain initial transmission data and data description information and processing the initial transmission data by adopting the data description information.
Optionally, in some embodiments, the receiving of the target data transmitted by the first data transmission device may be receiving target transmission data synchronously transmitted by the first data transmission device, or may also be receiving target transmission data pushed by the second server, so that cross-network transmission of data may be achieved more conveniently, and thus, a second application in the second communication network may be facilitated to call the target transmission data.
In the second communication network, the server supporting the data transmission based on the file transfer protocol FTP may be referred to as a second server, where the second server supports the file transfer protocol FTP.
That is to say, in the embodiment of the present disclosure, the second data transmission device may receive the target transmission data transmitted by the first data transmission device, where the target transmission data may be the target transmission data transmitted by the second data transmission device and transmitted to the second server by the first server in the first communication network based on the file transfer protocol FTP, or may also be the target transmission data transmitted to the second server by the security vendor supporting the file transfer protocol FTP and configured between the first communication network and the second communication network.
S302: the target transfer data is transmitted to a second application of a second communication network.
After receiving the target transmission data transmitted by the first data transmission device, the embodiment of the disclosure may transmit the target transmission data to the second application program of the second communication network, so that the second application program in the second communication network calls the target transmission data.
In some embodiments, the transmitting the target transmission data to the second application program of the second communication network may be that the second application program provides a corresponding data interface, and then the target transmission data transmitted by the second data transmission device is received based on the data interface, or the second application program subscribes corresponding data to the second data transmission device in advance, and then the second application program may obtain the target transmission data transmitted by the second data transmission device based on a subscription mechanism, which is not limited to this.
In this embodiment, by receiving the target transmission data transmitted by the first data transmission device and transmitting the target transmission data to the second application program of the second communication network, the second application program in the second communication network can safely and conveniently receive the data in the first communication network, so that the performance and application requirements of cross-network data transmission can be effectively met.
Fig. 4 is a schematic diagram according to a fourth embodiment of the present disclosure.
As shown in fig. 4, the data transmission method includes:
s401: and receiving target transmission data transmitted by the first data transmission device.
For the description of S401, reference may be made to the foregoing embodiments, which are not described herein again.
S402: and determining data mark information corresponding to the target transmission data, wherein the data mark information is generated by adopting a data identifier and a data name.
The disclosed embodiments may determine data tag information corresponding to target transmission data after receiving the target data transmitted by the first data transmission device.
S403: data decryption information corresponding to the data tag information is determined.
The information for decrypting the target transmission data may be referred to as data decryption information, and the data decryption information may be, for example, a first application program in a first communication network, and when a data transmission request is sent, according to a data type corresponding to the data transmission request, a data key corresponding to a data identifier is applied to a first data transmission device, that is, a corresponding data identifier may be obtained through parsing according to data tag information, and then, according to the data identifier, a data key corresponding to the data identifier is determined, and the data key is used as data decryption information.
S404: and decrypting the target transmission data according to the data decryption information to obtain the data to be transmitted.
After the data decryption information corresponding to the data marking information is determined, the target transmission data can be decrypted according to the data decryption information, so that the data to be transmitted can be obtained.
That is, the target transmission data may be decrypted according to the data key to obtain the data to be transmitted.
S405: and transmitting the data to be transmitted to a second application program of a second communication network.
The target transmission data can be transmitted to the second application program in the second communication network after being decrypted according to the data decryption information to obtain the data to be transmitted, and the target transmission data is decrypted according to the data decryption information, so that the second data transmission device can obtain the data to be transmitted based on the decryption key, the data can be prevented from being stolen while the data acquisition requirement of the second data transmission device is guaranteed, and the safety of data transmission can be effectively guaranteed.
Optionally, in some embodiments, the transmitting the data to be transmitted to the second application program of the second communication network may be processing the data to be transmitted according to the data tag information to obtain initial metadata, where the initial metadata has a data access address, the data access address is a storage address of a temporary file in the second server, the data to be transmitted has been written in the temporary file, and performing protocol conversion on the initial metadata by using a data transmission protocol of a target message system to obtain target metadata, and then pushing the target metadata to the target message system, where the data to be transmitted is transmitted to the second application program of the second communication network via the target message system, and the initial metadata is obtained by processing the data to be transmitted according to the data tag information, so that the data access address based on the metadata can be used in the execution process of the subsequent data transmission method, the acquisition and calling of the corresponding data are accurately realized, and the target metadata are obtained by performing protocol conversion on the initial metadata according to the data transmission protocol of the target message system, so that the data transmission process of the target message system can be smoothly executed.
After the target transmission data is decrypted according to the data decryption information to obtain the data to be transmitted, the data to be transmitted may be processed according to the tag information to obtain processed data, where the data may be referred to as metadata, and the metadata may have a corresponding access address, and the access address may be referred to as a data access address.
The target Message system may be used to transmit data to be transmitted to the second application program of the second communication network, and may be, for example, a Message Queue (MQ) or, for example, a Kafka platform, which is not limited thereto.
Among them, Kafka is an open-source streaming data processing platform, i.e., Kafka is a high-throughput distributed publish-subscribe messaging system that can pass data from one application to another through a publish-subscribe model.
In the target message system, a protocol for transmitting data may be referred to as a data transmission protocol, that is, the target message system may transmit data to be transmitted based on the data transmission protocol.
In the embodiment of the disclosure, after the target transmission data is decrypted to obtain the data to be transmitted, the data to be transmitted may be uploaded to a temporary file in the second server, where the file may be referred to as a temporary file, and a storage address of the temporary file is generated, where the address may be referred to as a temporary address.
After the data to be transmitted is processed according to the data tag information to obtain the initial metadata, protocol conversion can be performed on the initial metadata according to the data transmission protocol of the target message system, that is, the initial metadata is converted into data supporting the data transmission protocol according to the data transmission protocol, and the converted data is used as the target metadata.
In the embodiment of the present disclosure, after the target metadata is obtained, the target metadata may be pushed to a target message system, and then the target message system transmits the target metadata to a second application program based on a data transmission protocol, where the second application program may search a data access address corresponding to the target metadata, and download corresponding data to be transmitted based on the data access address.
Optionally, in other embodiments, the data to be transmitted is transmitted to the second application program of the second communication network, or when the second application program subscribes to the target metadata in the target message system, the data access address of the initial metadata corresponding to the target metadata is determined, and the data to be transmitted in the temporary file indicated by the data access address is transmitted to the second application program.
That is to say, after the target metadata is obtained, the target metadata may be pushed to a topic (topic) in the target message system, the topic may be composed of a specific prefix and a data identifier, and the second application program in the second communication network may obtain the corresponding target metadata by subscribing to the topic in the target message system, may then search for a data access address of the initial metadata corresponding to the target metadata, and download the corresponding data to be transmitted based on the data access address.
In the embodiment, the target transmission data transmitted by the first data transmission device is received, the data mark information corresponding to the target transmission data is determined, the data mark information is generated by adopting the data identifier and the data name, the data decryption information corresponding to the data mark information is determined, the target transmission data is decrypted according to the data decryption information to obtain the data to be transmitted, and the data to be transmitted is transmitted to the second application program of the second communication network.
In this embodiment, as shown in fig. 5, fig. 5 is a schematic structural diagram of a data transmission apparatus according to an embodiment of the present disclosure, which includes a first communication network and a second communication network, where a first application in the first communication network may call an HTTP interface of the first data transmission apparatus to transmit a data transmission request to the first data transmission apparatus, and after receiving the data transmission request, the first data transmission apparatus may parse the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data, may process the initial transmission data according to the data description information to obtain target transmission data, and push the target transmission data to a second server in the second communication network through the first server in the first communication network, or may also be based on a security vendor configured between the first communication network and the second communication network, the target transmission data is pushed to a second server in a second communication network, a second data transmission device in the second communication network can transmit the target transmission data to a target message system after receiving the target transmission data, and a second application program can acquire the target transmission data transmitted by the first communication network by subscribing the target message system.
Fig. 6 is a schematic diagram according to a fifth embodiment of the present disclosure.
As shown in fig. 6, the data transmission device 60 corresponding to a first communication network, includes:
a first receiving module 601, configured to receive a data transmission request sent by a first application in a first communication network;
the analysis module 602 is configured to analyze the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data;
a processing module 603, configured to process the initial transmission data according to the data description information to obtain target transmission data;
the first transmitting module 604 is configured to transmit the target transmission data to a second data transmission device, where the second data transmission device corresponds to a second communication network, and the first communication network is different from the second communication network.
In some embodiments of the present disclosure, as shown in fig. 7, fig. 7 is a schematic diagram according to a sixth embodiment of the present disclosure, the data transmission device 70 includes: a first receiving module 701, an analyzing module 702, a processing module 703, and a first transmitting module 704, where the processing module 703 includes:
a processing submodule 7031, configured to process the initial transmission data according to the data description information, so as to obtain data to be transmitted;
and the encryption sub-module 7032 is configured to encrypt the data to be transmitted to obtain target transmission data.
In some embodiments of the present disclosure, the data description information includes: the data authentication information, the data transmission device 70, further includes:
the authentication module 705 is configured to perform authentication and authentication on the initial transmission data according to the data authentication information after the initial transmission data and the data description information corresponding to the initial transmission data are obtained by parsing the data transmission request;
wherein, the processing sub-module 7031 is specifically configured to:
and when the result of the authentication and the certification of the initial transmission data meets the certification condition, processing the initial transmission data according to the data description information.
In some embodiments of the present disclosure, the data description information includes: data identification and data name, wherein the processing sub-module 7031 is specifically configured to:
adopting a file transfer protocol to perform format conversion on the initial transmission data to obtain data to be processed;
generating data marking information by adopting the data identification and the data name;
and marking the data to be processed by adopting the data marking information to obtain the data to be transmitted.
In some embodiments of the present disclosure, the first transmission module 704 is specifically configured to:
transmitting the target transmission data to a first server in a first communication network, wherein the first server supports a file transfer protocol;
and controlling the first server to synchronize the target transmission data to a second server, wherein the second server is a server supporting a file transfer protocol in a second communication network, so as to trigger the second server to push the target transmission data to a second data transmission device.
It is understood that the data transmission device 70 in fig. 7 of this embodiment and the data transmission device 60 in the foregoing embodiment, the receiving module 701 and the receiving module 601 in the foregoing embodiment, the parsing module 702 and the parsing module 602 in the foregoing embodiment, the processing module 703 and the processing module 603 in the foregoing embodiment, and the first transmission module 704 and the first transmission module 604 in the foregoing embodiment may have the same functions and structures.
It should be noted that the explanation of the data transmission method is also applicable to the data transmission apparatus of the present embodiment, and is not repeated herein.
In this embodiment, a data transmission request sent by a first application program in a first communication network is received, initial transmission data and data description information corresponding to the initial transmission data are obtained through analysis in the data transmission request, the initial transmission data are processed according to the data description information, target transmission data are obtained, and the target transmission data are transmitted to a second data transmission device corresponding to a second communication network, wherein the first communication network and the second communication network are different, so that convenience of data transmission between different communication networks can be effectively improved, safety of data transmission can be effectively guaranteed, applicability of a data transmission method can be effectively improved, and a data transmission effect can be improved.
Fig. 8 is a schematic diagram according to a seventh embodiment of the present disclosure.
As shown in fig. 8, the data transmission device 80 corresponding to the second communication network, includes:
a second receiving module 801, configured to receive target transmission data transmitted by the first data transmission apparatus;
a second transmission module 802, configured to transmit the target transmission data to a second application program of a second communication network;
the first data transmission device corresponds to a first communication network, the first communication network is different from a second communication network, the target transmission data is obtained by analyzing the initial transmission data and data description information according to a data transmission request sent by a first application program by the first data transmission device, and processing the initial transmission data by adopting the data description information, and the first application program is an application program in the first communication network.
In some embodiments of the present disclosure, as shown in fig. 9, fig. 9 is a schematic diagram according to an eighth embodiment of the present disclosure, and the data transmission device 90 includes: a receiving module 901 and a second transmitting module 902, wherein the receiving module 901 is specifically configured to:
receiving target transmission data synchronously transmitted by a first data transmission device; or
Receiving target transmission data pushed by a second server;
the second server is a server supporting a file transfer protocol in the second communication network, the target transmission data in the second server is obtained synchronously according to the target transmission data in the first server, and the first server is a server supporting the file transfer protocol in the first communication network.
In some embodiments of the present disclosure, the data description information includes: data identification and data name, wherein the second transmission module 902 includes:
the first determining submodule 9021 is configured to determine data tag information corresponding to target transmission data, where the data tag information is generated by using a data identifier and a data name;
a second determining submodule 9022, configured to determine data decryption information corresponding to the data marking information;
the decryption submodule 9023 is configured to decrypt the target transmission data according to the data decryption information to obtain data to be transmitted;
the transmission sub-module 9024 is configured to transmit the data to be transmitted to a second application program of the second communication network.
In some embodiments of the present disclosure, the transmission sub-module 9024 is specifically configured to:
processing data to be transmitted according to the data marking information to obtain initial metadata, wherein the initial metadata is provided with a data access address, the data access address is a storage address of a temporary file in the second server, and the data to be transmitted is written in the temporary file;
performing protocol conversion on the initial metadata by adopting a data transmission protocol of a target message system to obtain target metadata;
and pushing the target metadata to a target message system, wherein the data to be transmitted is transmitted to a second application program of a second communication network through the target message system.
In some embodiments of the present disclosure, the transmission sub-module 9024 is further configured to:
when a second application program subscribes target metadata in a target message system, determining a data access address of initial metadata corresponding to the target metadata;
and transmitting the data to be transmitted in the temporary file indicated by the data access address to a second application program.
It is understood that the data transmission device 90 in fig. 9 of this embodiment and the data transmission device 80 in the above embodiment, the second receiving module 901 and the second receiving module 801 in the above embodiment, and the second transmitting module 902 and the second transmitting module 802 in the above embodiment may have the same functions and structures.
It should be noted that the explanation of the data transmission method is also applicable to the data transmission device of the present embodiment, and is not repeated herein.
In this embodiment, by receiving the target transmission data transmitted by the first data transmission device and transmitting the target transmission data to the second application program of the second communication network, the second application program in the second communication network can safely and conveniently receive the data in the first communication network, so that the performance and application requirements of cross-network data transmission can be effectively met.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
Fig. 10 shows a schematic block diagram of an example electronic device used to implement the data transmission method of an embodiment of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 10, the apparatus 1000 includes a computing unit 1001 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)1002 or a computer program loaded from a storage unit 1008 into a Random Access Memory (RAM) 1003. In the RAM 1003, various programs and data necessary for the operation of the device 1000 can also be stored. The calculation unit 1001, the ROM 1002, and the RAM 1003 are connected to each other by a bus 1004. An input/output (I/O) interface 1005 is also connected to bus 1004.
A number of components in device 1000 are connected to I/O interface 1005, including: an input unit 1006 such as a keyboard, a mouse, and the like; an output unit 1007 such as various types of displays, speakers, and the like; a storage unit 1008 such as a magnetic disk, an optical disk, or the like; and a communication unit 1009 such as a network card, a modem, a wireless communication transceiver, or the like. The communication unit 1009 allows the device 1000 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
Computing unit 1001 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 1001 executes the respective methods and processes described above, such as the data transmission method. For example, in some embodiments, the data transfer method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 1008. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 1000 via ROM 1002 and/or communications unit 1009. When the computer program is loaded into RAM 1003 and executed by the computing unit 1001, one or more steps of the data transfer method described above may be performed. Alternatively, in other embodiments, the computing unit 1001 may be configured to perform the data transfer method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), the internet, and blockchain networks.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server can be a cloud Server, also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service ("Virtual Private Server", or simply "VPS"). The server may also be a server of a distributed system, or a server incorporating a blockchain.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims (23)

1. A data transmission method is applied to a first data transmission device, wherein the first data transmission device corresponds to a first communication network, and the method comprises the following steps:
receiving a data transmission request sent by a first application program in the first communication network;
analyzing the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data;
processing the initial transmission data according to the data description information to obtain target transmission data;
and transmitting the target transmission data to a second data transmission device, wherein the second data transmission device corresponds to a second communication network, and the first communication network is different from the second communication network.
2. The method of claim 1, wherein the processing the initial transmission data according to the data description information to obtain target transmission data comprises:
processing the initial transmission data according to the data description information to obtain data to be transmitted;
and encrypting the data to be transmitted to obtain the target transmission data.
3. The method of claim 2, the data description information comprising: after the initial transmission data and the data description information corresponding to the initial transmission data are obtained by analyzing the data transmission request, the data authentication information further includes:
according to the data authentication information, performing authentication on the initial transmission data;
wherein the processing the initial transmission data according to the data description information comprises:
and if the result of the authentication and the certification of the initial transmission data meets the certification condition, processing the initial transmission data according to the data description information.
4. The method of claim 2, the data description information comprising: a data identification and a data name,
wherein, the processing the initial transmission data according to the data description information to obtain the data to be transmitted includes:
adopting a file transfer protocol to perform format conversion on the initial transmission data to obtain data to be processed;
generating data marking information by adopting the data identification and the data name;
and marking the data to be processed by adopting the data marking information to obtain the data to be transmitted.
5. The method of claim 1, wherein the transmitting the target transmission data to a second data transmission device comprises:
transmitting the target transfer data to a first server in the first communication network, wherein the first server supports a file transfer protocol;
controlling the first server to synchronize the target transmission data to a second server, wherein the second server is a server in the second communication network that supports the file transfer protocol, so as to trigger the second server to push the target transmission data to the second data transmission device.
6. A data transmission method is applied to a second data transmission device, wherein the second data transmission device corresponds to a second communication network, and the method comprises the following steps:
receiving target transmission data transmitted by a first data transmission device;
transmitting the target transmission data to a second application program of the second communication network;
the first data transmission device corresponds to a first communication network, the first communication network is different from the second communication network, the target transmission data is obtained by analyzing the first data transmission device according to a data transmission request sent by a first application program, initial transmission data and data description information are obtained, and the initial transmission data is processed by adopting the data description information, and the first application program is an application program in the first communication network.
7. The method of claim 6, wherein the receiving target transmission data transmitted by the first data transmission device comprises:
receiving the target transmission data synchronously transmitted by the first data transmission device; or,
receiving the target transmission data pushed by a second server;
the second server is a server supporting a file transfer protocol in the second communication network, the target transfer data in the second server is obtained by synchronizing the target transfer data in the first server, and the first server is a server supporting the file transfer protocol in the first communication network.
8. The method of claim 6, the data description information comprising: a data identifier and a data name, wherein the transmitting the target transfer data to a second application of the second communication network comprises:
determining data mark information corresponding to the target transmission data, wherein the data mark information is generated by adopting the data identification and the data name;
determining data decryption information corresponding to the data marking information;
decrypting the target transmission data according to the data decryption information to obtain data to be transmitted;
and transmitting the data to be transmitted to a second application program of the second communication network.
9. The method of claim 8, wherein the transmitting the data to be transmitted to a second application of the second communication network comprises:
processing the data to be transmitted according to the data marking information to obtain initial metadata, wherein the initial metadata is provided with a data access address, the data access address is a storage address of a temporary file in the second server, and the data to be transmitted is written in the temporary file;
performing protocol conversion on the initial metadata by adopting a data transmission protocol of a target message system to obtain target metadata;
pushing the target metadata to the target message system, wherein the data to be transmitted is transmitted to a second application of the second communication network via the target message system.
10. The method of claim 9, further comprising:
if the second application program subscribes to the target metadata in the target message system, determining a data access address of initial metadata corresponding to the target metadata;
and transmitting the data to be transmitted in the temporary file indicated by the data access address to the second application program.
11. A data transmission apparatus, the apparatus corresponding to a first communication network, the apparatus comprising:
a first receiving module, configured to receive a data transmission request sent by a first application program in the first communication network;
the analysis module is used for analyzing the data transmission request to obtain initial transmission data and data description information corresponding to the initial transmission data;
the processing module is used for processing the initial transmission data according to the data description information to obtain target transmission data;
the first transmission module is configured to transmit the target transmission data to a second data transmission device, where the second data transmission device corresponds to a second communication network, and the first communication network and the second communication network are different.
12. The apparatus of claim 11, wherein the processing module comprises:
the processing submodule is used for processing the initial transmission data according to the data description information to obtain data to be transmitted;
and the encryption submodule is used for encrypting the data to be transmitted to obtain the target transmission data.
13. The apparatus of claim 12, the data description information comprising: data authentication information, the apparatus further comprising:
the authentication module is used for carrying out authentication and authentication on the initial transmission data according to the data authentication information after the initial transmission data and the data description information corresponding to the initial transmission data are obtained by analyzing the data transmission request;
wherein the processing submodule is specifically configured to:
and when the result of the authentication and the certification of the initial transmission data meets the certification condition, processing the initial transmission data according to the data description information.
14. The apparatus of claim 12, the data description information comprising: a data identification and a data name,
wherein the processing submodule is specifically configured to:
adopting a file transfer protocol to perform format conversion on the initial transmission data to obtain data to be processed;
generating data marking information by adopting the data identification and the data name;
and marking the data to be processed by adopting the data marking information to obtain the data to be transmitted.
15. The apparatus of claim 11, wherein the first transmission module is specifically configured to:
transmitting the target transfer data to a first server in the first communication network, wherein the first server supports a file transfer protocol;
controlling the first server to synchronize the target transmission data to a second server, wherein the second server is a server in the second communication network that supports the file transfer protocol, so as to trigger the second server to push the target transmission data to the second data transmission device.
16. A data transmission apparatus, the apparatus corresponding to a second communication network, the apparatus comprising:
the second receiving module is used for receiving the target transmission data transmitted by the first data transmission device;
a second transmission module, configured to transmit the target transmission data to a second application program of the second communication network;
the first data transmission device corresponds to a first communication network, the first communication network is different from the second communication network, the target transmission data is obtained by analyzing the first data transmission device according to a data transmission request sent by a first application program, initial transmission data and data description information are obtained, and the initial transmission data is processed by adopting the data description information, and the first application program is an application program in the first communication network.
17. The apparatus of claim 16, wherein the second receiving means is specifically configured to:
receiving the target transmission data synchronously transmitted by the first data transmission device; or
Receiving the target transmission data pushed by a second server;
the second server is a server supporting a file transfer protocol in the second communication network, the target transfer data in the second server is obtained by synchronizing the target transfer data in the first server, and the first server is a server supporting the file transfer protocol in the first communication network.
18. The apparatus of claim 16, the data description information comprising: data identification and data name, wherein the second transmission module comprises:
the first determining submodule is used for determining data mark information corresponding to the target transmission data, wherein the data mark information is generated by adopting the data identification and the data name;
the second determining submodule is used for determining data decryption information corresponding to the data marking information;
the decryption submodule is used for decrypting the target transmission data according to the data decryption information to obtain data to be transmitted;
and the transmission submodule is used for transmitting the data to be transmitted to a second application program of the second communication network.
19. The apparatus of claim 18, wherein the transmission submodule is specifically configured to:
processing the data to be transmitted according to the data marking information to obtain initial metadata, wherein the initial metadata is provided with a data access address, the data access address is a storage address of a temporary file in the second server, and the data to be transmitted is written in the temporary file;
performing protocol conversion on the initial metadata by adopting a data transmission protocol of a target message system to obtain target metadata;
pushing the target metadata to the target message system, wherein the data to be transmitted is transmitted to a second application of the second communication network via the target message system.
20. The apparatus of claim 19, wherein the transmission sub-module is further configured to:
when the second application program subscribes to the target metadata in the target message system, determining a data access address of initial metadata corresponding to the target metadata;
and transmitting the data to be transmitted in the temporary file indicated by the data access address to the second application program.
21. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5 or to perform the method of any one of claims 6-10.
22. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-5 or to perform the method of any one of claims 6-10.
23. A computer program product comprising a computer program which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5 or carries out the steps of the method according to any one of claims 6 to 10.
CN202111258128.4A 2021-10-27 2021-10-27 Data transmission method and device, electronic equipment and storage medium Pending CN114124916A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111258128.4A CN114124916A (en) 2021-10-27 2021-10-27 Data transmission method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111258128.4A CN114124916A (en) 2021-10-27 2021-10-27 Data transmission method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114124916A true CN114124916A (en) 2022-03-01

Family

ID=80377283

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111258128.4A Pending CN114124916A (en) 2021-10-27 2021-10-27 Data transmission method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114124916A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114745186A (en) * 2022-04-19 2022-07-12 同方赛威讯信息技术有限公司 Method for realizing data exchange between two different networks isolated from each other
CN115729688A (en) * 2022-11-23 2023-03-03 北京百度网讯科技有限公司 Multithreading scheduling method and device of processor, electronic equipment and storage medium
CN116915760A (en) * 2023-09-12 2023-10-20 哈尔滨工程大学三亚南海创新发展基地 Full-network data communication packaging method and system based on http

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106973073A (en) * 2016-01-13 2017-07-21 杭州海康威视系统技术有限公司 The transmission method and equipment of multi-medium data
CN110213318A (en) * 2018-09-21 2019-09-06 腾讯科技（深圳）有限公司 A kind of method of Data Transmission Controlling, equipment and storage medium
CN112100134A (en) * 2020-08-25 2020-12-18 深圳市星砺达科技有限公司 Method and device for exporting large file, storage medium and computer equipment
US20200404044A1 (en) * 2019-06-18 2020-12-24 Software Ag Diversified file transfer
CN113194129A (en) * 2021-04-22 2021-07-30 山东浪潮通软信息科技有限公司 Data ferrying method, equipment and medium
CN113542274A (en) * 2021-07-15 2021-10-22 南京中孚信息技术有限公司 Cross-domain data transmission method, device, server and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106973073A (en) * 2016-01-13 2017-07-21 杭州海康威视系统技术有限公司 The transmission method and equipment of multi-medium data
CN110213318A (en) * 2018-09-21 2019-09-06 腾讯科技（深圳）有限公司 A kind of method of Data Transmission Controlling, equipment and storage medium
US20200404044A1 (en) * 2019-06-18 2020-12-24 Software Ag Diversified file transfer
CN112100134A (en) * 2020-08-25 2020-12-18 深圳市星砺达科技有限公司 Method and device for exporting large file, storage medium and computer equipment
CN113194129A (en) * 2021-04-22 2021-07-30 山东浪潮通软信息科技有限公司 Data ferrying method, equipment and medium
CN113542274A (en) * 2021-07-15 2021-10-22 南京中孚信息技术有限公司 Cross-domain data transmission method, device, server and storage medium

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114745186A (en) * 2022-04-19 2022-07-12 同方赛威讯信息技术有限公司 Method for realizing data exchange between two different networks isolated from each other
CN115729688A (en) * 2022-11-23 2023-03-03 北京百度网讯科技有限公司 Multithreading scheduling method and device of processor, electronic equipment and storage medium
CN115729688B (en) * 2022-11-23 2023-09-12 北京百度网讯科技有限公司 Multithreading scheduling method and device for processor, electronic equipment and storage medium
CN116915760A (en) * 2023-09-12 2023-10-20 哈尔滨工程大学三亚南海创新发展基地 Full-network data communication packaging method and system based on http
CN116915760B (en) * 2023-09-12 2023-12-26 哈尔滨工程大学三亚南海创新发展基地 Full-network data communication packaging method and system based on http

Similar Documents

Publication Publication Date Title
CN114124916A (en) Data transmission method and device, electronic equipment and storage medium
CN106209948B (en) A kind of data push method and device
CN106685990A (en) Safety detecting method and safety detecting device based on industrial Internet operation system
CN112769897A (en) Synchronization method and device for edge calculation message, electronic equipment and storage medium
CN111614683B (en) Data processing method, device and system and network card
CN111930709B (en) Data storage method, apparatus, electronic device, and computer readable medium
WO2019022723A1 (en) Transport of control data in proxy-based network communications
CN112631800A (en) Kafka-oriented data transmission method and system, computer equipment and storage medium
EP3331213A1 (en) Access to data on a remote device
WO2017192549A1 (en) System and method for secure and efficient communication within an organization
CN104219298A (en) Cluster system and data backup method thereof
CN113595927A (en) Method and device for processing mirror flow in bypass mode
CN106941418B (en) SSL VPN configuration information synchronization method and device
CN113242244B (en) Data transmission method, device and system
CN113038192B (en) Video processing method and device, electronic equipment and storage medium
CN110719233B (en) Method and device for transmitting information
CN109819026B (en) Method and device for transmitting information
EP3110211B1 (en) Data transceiving method, modem and terminal device
WO2015195808A1 (en) Communicating information between devices using ultra high frequency audio
CN115333851A (en) Automatic driving data transmission method and device and electronic equipment
CN113079055B (en) AGV operation data dynamic acquisition method and device
CN115134793A (en) Data processing method, device, equipment and storage medium
CN103780605A (en) Fast encryption and decryption method and gateway
CN104935623B (en) Application management method and update release server
CN105281976A (en) Method and apparatus for monitoring transmission of proxy service data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20220301

WD01 Invention patent application deemed withdrawn after publication