CN113347281A - Data transmission method and device, electronic equipment and storage medium - Google Patents
Data transmission method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113347281A CN113347281A CN202010135799.0A CN202010135799A CN113347281A CN 113347281 A CN113347281 A CN 113347281A CN 202010135799 A CN202010135799 A CN 202010135799A CN 113347281 A CN113347281 A CN 113347281A
- Authority
- CN
- China
- Prior art keywords
- target
- data
- interface machine
- destination address
- data transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/45—Network directories; Name-to-address mapping
- H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
- H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/02—Network architectures or network communication protocols for network security for separating internal from external traffic, e.g. firewalls
- H04L63/0227—Filtering policies
- H04L63/0245—Filtering by information in the payload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
Abstract
The present disclosure discloses a data transmission method, an apparatus, an electronic device and a storage medium, wherein the method comprises: acquiring a data transmission instruction, wherein the data transmission instruction comprises a source address and a destination address of target data; responding to a data transmission instruction, and determining an adaptive target interface machine according to a destination address; generating configuration information according to a source address and a destination address of the target data; and sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data. According to the data transmission method provided by the embodiment of the disclosure, the adaptive target interface machine can be determined according to the destination address of the target data, the configuration information is generated according to the source address and the destination address of the target data, and is sent to the target interface machine, so that the target interface machine can transmit the target data, the target interface machine can be dynamically selected according to the source address and the destination address of the target data, the target interface machine suitable for the current network state is used for transmitting the target data, and the transmission efficiency of the target data is improved.
Description
Technical Field
The present disclosure relates to data processing technologies, and in particular, to a data transmission method and apparatus, an electronic device, and a storage medium.
Background
With the development of network technologies, companies have deployed multiple network environments around the globe. There is now a need to transfer data to different network environments.
Data transmission is currently performed using statically configured transmission channels. However, since each transmission data can only be transmitted through the data sources at both ends of the static configuration, multiple network switching between two network segments may be required. Meanwhile, an interface machine used in network switching is fixed, and when a statically configured transmission path is inappropriate, a data transmission path cannot be changed in time, so that the data transmission efficiency is low.
Disclosure of Invention
The present disclosure provides a data transmission method, an apparatus, an electronic device, and a storage medium, so as to improve data transmission efficiency.
In a first aspect, an embodiment of the present disclosure provides a data transmission method, including:
acquiring a data transmission instruction, wherein the data transmission instruction comprises a source address and a destination address of target data;
responding to a data transmission instruction, and determining an adaptive target interface machine according to a destination address;
generating configuration information according to a source address and a destination address of the target data;
and sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data.
In a second aspect, an embodiment of the present disclosure further provides a data transmission apparatus, including:
the instruction acquisition module is used for acquiring a data transmission instruction, and the data transmission instruction comprises a source address and a destination address of target data;
the target interface machine determining module is used for responding to the data transmission instruction and determining an adaptive target interface machine according to the destination address;
the matching information generation module is used for generating configuration information according to a source address and a destination address of the target data;
and the matching information sending module is used for sending the configuration information to the target interface machine and controlling the target interface machine to transmit the target data.
In a third aspect, an embodiment of the present disclosure further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the data transmission method according to the first aspect is implemented.
In a fourth aspect, the disclosed embodiments also provide a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the data transmission method as shown in the first aspect.
According to the data transmission method, the data transmission device, the electronic equipment and the storage medium, when cross-network data transmission is carried out, a data transmission instruction is obtained, and in response to the data transmission instruction, an adaptive target interface machine is determined according to a destination address carried in the data transmission instruction; generating configuration information according to a source address and a destination address of the target data; and sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data. Compared with the prior art that static configuration is used for transmitting data, the data transmission method provided by the embodiment of the disclosure has low transmission efficiency, can determine an adaptive target interface machine according to a destination address of target data, generates configuration information according to a source address and the destination address of the target data, and sends the configuration information to the target interface machine, so that the target interface machine transmits the target data, dynamically selects the target interface machine according to the source address and the destination address of the target data, transmits the target data by using the target interface machine applicable to the current network state, and improves the transmission efficiency of the target data.
Drawings
Fig. 1 is a schematic flow chart diagram of a data transmission method in an embodiment of the present disclosure;
fig. 2 is a schematic flow chart diagram of another data transmission method in an embodiment of the present disclosure;
FIG. 3 is a schematic flow chart diagram of another data transmission method in an embodiment of the present disclosure;
FIG. 4 is a schematic flow chart diagram of another data transmission method in an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a data transmission device in an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of an electronic device in an embodiment of the present disclosure.
Detailed Description
The present disclosure is described in further detail below with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the disclosure and are not limiting of the disclosure. It should be further noted that, for the convenience of description, only some of the structures relevant to the present disclosure are shown in the drawings, not all of them.
Fig. 1 is a flowchart of a data transmission method provided in an embodiment of the present disclosure, where the method is applied to a server, where the server includes a data transmission function, and the method includes:
step 110, a data transmission instruction is obtained, where the data transmission instruction includes a source address and a destination address of the target data.
A user or computer program may access the server. The server may provide a user or computer program with a database listing located in different network environments. The access server may select a source database in which the target data is stored and a target database in which the target data is to be stored, and further determine a source address and a destination address of the target data. Alternatively, the source address may be the network address of the source database, and the destination database may be the network address of the destination database. The source address and the destination address may be connected to a database or a database tool. The database type may be MySQL, Remote Dictionary service (redis), mongo database, or hive.
MySQL is an open source relational database management system (RDBMS) that uses the most common database management language, Structured Query Language (SQL), for database management. The redis is an open source log-type and Key-Value database which is written by using ANSI C language, supports network, can be based on memory and can also be persistent, and provides API of multiple languages. MongoDB is a distributed file storage based database. Written in the C + + language. It is intended to provide an extensible high performance data storage solution for WEB applications. hive is a data warehouse tool based on Hadoop, which is used for data extraction, transformation and loading, and is a mechanism capable of storing, querying and analyzing large-scale data stored in Hadoop. The hive data warehouse tool can map the structured data file into a database table, provide SQL query function and convert SQL sentences into MapReduce tasks for execution.
When the user or the computer program selects two ends of the target data transmission, namely the source database and the target database, the server generates a data transmission instruction. The data transmission instruction carries a source address and a destination address of the target data, so that the data transmission instruction can carry the target data to be transmitted, the source address in which the target data is stored, and the destination address of the received target data.
And step 120, responding to the data transmission instruction, and determining an adaptive target interface machine according to the destination address.
When the data transmission instruction is generated, the server responds to the data transmission instruction. And searching a target interface machine matched with the destination address from a plurality of pre-registered interface machines according to the network environment of the destination address. The target interface machine and the destination address belong to the same network environment.
In one implementation, a target network environment is determined based on a destination address; and determining a target interface machine according to the target network environment.
When registering the interface machine, recording the network environment of the interface machine. The network context may be determined based on the domain name or IP address of the database to which the source or destination address is connected. The network environment may include a chinese network environment, a united states network environment, a british network environment, an indian network environment, or the like. One or more interface machines may be configured for each network environment. And searching the interface machine configured under the network environment according to the network environment where the destination address is located. And if one interface machine is configured in the network environment, determining the interface machine as a target interface machine. Optionally, the interface machine located in the same network environment as the target address is determined as the target interface machine. The target interface machine is determined according to the target network environment, so that the target data can be transmitted only through the network where the source address is located and the network where the destination address is located in the transmission process, multiple cross-network transmission of the target data by using the statically configured interface machine is avoided, and the data transmission efficiency is improved.
If a plurality of interface machines are configured in the network environment, optionally, determining a plurality of interface machines to be selected according to the destination address; and determining a target interface machine according to interface machine parameters of a plurality of interface machines to be selected, wherein the interface machine parameters comprise interface machine network bandwidth or interface machine load information.
If there are a plurality of interface machines adapted to the target address, the target interface machine needs to be determined from the plurality of adapted interface machines. At this time, the target interface machine can be determined according to the interface machine parameters of the plurality of interface machines. For example, the interface machine with higher network bandwidth of the interface machine is determined as the target interface machine, or the interface machine with lower load of the interface machine is determined as the target interface machine. The interface machine with higher network bandwidth and lower load can be determined as the target interface machine. And the most appropriate interface machine is determined as a target interface machine from the plurality of interface machines by using the interface machine parameters, so that the resource utilization rate is improved.
Step 130, generating configuration information according to the source address and the destination address of the target data.
The configuration information is used for being sent to the target interface machine, so that the target interface machine can accurately transmit target data. A combination of source and destination addresses may be used as configuration information.
Further, the configuration information further includes a pre-processing parameter or a post-processing parameter, the pre-processing parameter is used for controlling the target interface machine to pre-process the target data, and the post-processing parameter is used for controlling the target interface machine to write the target data into the database according to the transmission requirement for data processing.
The configuration information enables the target interface machine to obtain a source address and a destination address of the target data, and can also configure pre-processing parameters and post-processing parameters. Optionally, the database where the source address is located compresses the target data, and the interface machine reads the compressed target data. Optionally, the database where the source address is located compresses the data to obtain the target data. The target data in the compressed format is read by the interface machine.
The preprocessing includes data cleaning of the target data. The post-processing can be configured according to the use requirement of the target database, such as aggregation calculation or sorting.
The interface machine can be configured more in a diversified manner by adding the pre-processing parameter and the post-processing parameter in the configuration information, so that the interface machine has more functions, and the usability of the interface machine is improved.
And step 140, sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data.
The server sends the configuration information to the target interface machine through the network. And the target interface machine accesses the source address according to the received configuration information to obtain target data and transmits the target data to the destination address. The interface machine can complete the processing of the database data by installing the connected database plug-in. The database includes, but is not limited to, MySQL, redis, mongo database, or hive.
And if the configuration information comprises the pre-processing parameter or the post-processing parameter, performing corresponding processing on the target data according to the pre-processing parameter or the post-processing parameter.
The data transmission method provided by the embodiment of the disclosure acquires a data transmission instruction when performing cross-network data transmission, responds to the data transmission instruction, and determines an adaptive target interface machine according to a destination address carried in the data transmission instruction; generating configuration information according to a source address and a destination address of the target data; and sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data. Compared with the prior art that static configuration is used for transmitting data, the data transmission method provided by the embodiment of the disclosure has low transmission efficiency, can determine an adaptive target interface machine according to a destination address of target data, generates configuration information according to a source address and the destination address of the target data, and sends the configuration information to the target interface machine, so that the target interface machine transmits the target data, dynamically selects the target interface machine according to the source address and the destination address of the target data, transmits the target data by using the target interface machine applicable to the current network state, and improves the transmission efficiency of the target data.
Fig. 2 is a flowchart of a data transmission method provided in an embodiment of the present disclosure, which is used to further describe the above embodiment, and includes:
step 210, a data transmission instruction is obtained, where the data transmission instruction includes a source address and a destination address of the target data.
Step 220, responding to the data transmission instruction, and determining the adaptive target interface machine according to the destination address.
Step 230, obtaining transmission parameters of the target data, where the transmission parameters include: data filtering parameters, interface machine performance parameters, or transmission data block size.
The data filtering parameter is used to represent a filtering rule. And then when the interface machine reads the target data or transmits the target data, the noise in the target data is filtered according to the data filtering parameters. Illustratively, the target data is a data table. The data filtering parameter can be used for filtering row data or column data in the data table. The filtering process includes filtering out invalid data such as symbols. The interface machine filters data impurities in the transmission process, and the processing efficiency of target data is improved.
The interface machine performance parameter is used for representing the hardware allocation of the interface machine when the interface machine transmits the target data. For example, the performance parameters of the interface engine include the processor utilization rate, the process number, the memory occupation ratio, and the like of the interface engine. The hardware of the interface machine can be controlled more accurately and effectively, and after the interface machine is subjected to resource allocation, a plurality of transmission tasks can be processed more efficiently and parallelly, so that the resource utilization rate is improved.
The transmission data block size is used to indicate the block size of the target data transmitted in each transmission window, and the block data may be transmitted to the destination address after the target data is blocked according to the transmission data block size. The problems of bandwidth occupation and data loss caused by overlarge data volume transmitted at one time are avoided, and the reliability of data transmission is improved.
Step 240, generating configuration information according to the transmission parameters, the source address and the destination address of the target data.
And step 250, sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data.
According to the data transmission method provided by the embodiment of the disclosure, the configuration information can be generated according to the transmission parameters of the target data, so that the transmission process of the interface machine can be configured, and the usability is improved.
Fig. 3 is a flowchart of a data transmission method provided in an embodiment of the present disclosure, and it is found in the process of implementing the foregoing embodiment that if transmission is interrupted due to a network drop or the like when target data is transmitted, a target interface machine needs to reconnect a source address and a destination address, and breakpoint transmission cannot be completed. In order to solve the problem, an embodiment of the present disclosure provides a data transmission method, as a further description of the above embodiment, including:
step 310, a data transmission instruction is obtained, wherein the data transmission instruction comprises a source address and a destination address of target data.
And step 320, responding to the data transmission instruction, and determining an adaptive target interface machine according to the destination address.
Step 330, generating configuration information according to the source address and the destination address of the target data.
And step 340, sending the configuration information to the target interface machine.
And step 350, controlling the target interface machine to record the target data transmission progress when transmitting data.
The data transmitted by the target interface machine is target data. When the target data is transmitted, the sent proportion of the target data or the number of sent packets and the like are recorded, so that the transmission condition of the target data can be accurately recorded by the target data transmission progress.
And step 360, if the terminal is transmitted, the transmission of the target data is recovered according to the transmission progress.
According to the data transmission method provided by the embodiment of the disclosure, transmission can be resumed by means of the recorded transmission progress after transmission interruption by recording the transmission progress, so that breakpoint continuous transmission is completed, and the transmission reliability is improved.
Fig. 4 is a flowchart of a data transmission method provided in an embodiment of the present disclosure, which is used to further describe the above embodiment, and includes:
step 410, receiving registration information of a plurality of interface machines.
The registration information of the interface machine includes the network environment where the interface machine is located, a database to which the interface machine can be connected, the hardware configuration of the interface machine, and the like.
Step 420, obtaining a data transmission instruction, where the data transmission instruction includes a source address and a destination address of the target data.
And 430, responding to the data transmission instruction, and determining a target interface machine matched with the target address according to the registration information of the plurality of interface machines.
Step 440, generating configuration information according to the source address and the destination address of the target data.
And 450, sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data.
The data transmission method provided by the embodiment of the disclosure can receive the registration information of the plurality of interface machines in advance, so that the server can acquire the transmission capabilities of the plurality of interface machines, and the target interface machine can be determined more accurately based on the registration information. Through the registration mode, the interface machine can be quickly accessed to the server, so that quick registration is realized, the data transmission function is executed, and the resource utilization rate is improved.
In one implementation of the disclosed embodiment, a system configuration module may be configured to perform the server functions shown in the above embodiments. Illustratively, a user or external system configures a data source and a data destination in a system configuration module, which may be any two data resources of any network environment. The data source may be data accessed through MySQL, redis, mongo database, or hive.
And triggering a data transmission instruction after the user or the external system selects the target data to be transmitted. The system configuration module receives the data transmission instruction. And selecting a target interface machine suitable for transmission according to index calculation such as network information of a data source and a data destination, network bandwidth of the interface machine, load condition of the interface machine and the like. And dynamically generating a piece of configuration information to be transmitted to the target interface machine.
Besides the two-end data sources, the configuration information can define the transmission parameters of the target data, such as a custom filter, a performance parameter of an interface machine, the block size of the transmission data and the like. The configuration information includes address information of the data sources at both ends (the address information may be a data storage address of the target data, and the address may be a port address of the connected database).
After the system configuration module sends the configuration information to the target interface machine, the target interface machine operates in the spark operating environment, starts downloading the data (namely the target data) which is compressed in advance by depending on the spark operating environment to be connected with the data source, saves the transmission progress in the data transmission process, and resumes transmission according to the transmission progress when the transmission is interrupted abnormally. And executing different insertion commands according to the type of the data resource area pointed by the destination address, and writing the data into different types of data resources. The data resources are data resources in a database.
Fig. 5 is a schematic structural diagram of a data transmission device according to an embodiment of the present disclosure, where the data transmission device is applied to a server, and the data transmission device includes: an instruction acquisition module 510, a target interface machine determination module 520, a matching information generation module 530, and a matching information transmission module 540.
An instruction obtaining module 510, configured to obtain a data transmission instruction, where the data transmission instruction includes a source address and a destination address of target data;
a target interface machine determining module 520, configured to determine, in response to the data transmission instruction, an adapted target interface machine according to the destination address;
a matching information generating module 530, configured to generate configuration information according to a source address and a destination address of the target data;
and the matching information sending module 540 is configured to send the configuration information to the target interface machine, and control the target interface machine to transmit the target data.
Further, the target interface machine determining module 520 is configured to:
determining a target network environment according to the destination address;
and determining a target interface machine according to the target network environment.
Further, the target interface machine determining module 520 is configured to:
determining a plurality of interface machines to be selected according to the destination address;
and determining a target interface machine according to interface machine parameters of a plurality of interface machines to be selected, wherein the interface machine parameters comprise interface machine network bandwidth or interface machine load information.
Further, the matching information generating module 530 is configured to:
acquiring transmission parameters of target data, wherein the transmission parameters comprise: data filtering parameters, interface machine performance parameters or transmission data block size;
and generating configuration information according to the transmission parameters, the source address and the destination address of the target data.
Further, the matching information sending module 540 is configured to:
controlling a target interface machine to record the transmission progress of target data when transmitting data;
and if the terminal is transmitted, recovering the transmission of the target data according to the transmission progress.
Further, the configuration information further includes a pre-processing parameter or a post-processing parameter, the pre-processing parameter is used for controlling the target interface machine to pre-process the target data, and the post-processing parameter is used for controlling the target interface machine to write the target data into the database according to the transmission requirement for data processing.
The system further comprises an interface machine registration module used for receiving registration information of a plurality of interface machines;
accordingly, the target interface machine determination module 520 is configured to:
and determining a target interface machine matched with the target address according to the registration information of the plurality of interface machines.
In the data transmission device provided by the embodiment of the present disclosure, when performing cross-network data transmission, the instruction obtaining module 510 obtains a data transmission instruction, and the target interface machine determining module 520 determines an adapted target interface machine according to a destination address carried in the data transmission instruction in response to the data transmission instruction; the matching information generating module 530 generates configuration information according to the source address and the destination address of the target data; the matching information sending module 540 sends the configuration information to the target interface machine, and controls the target interface machine to transmit the target data. Compared with the prior art that static configuration is used for transmitting data, the data transmission method provided by the embodiment of the disclosure has low transmission efficiency, can determine an adaptive target interface machine according to a destination address of target data, generates configuration information according to a source address and the destination address of the target data, and sends the configuration information to the target interface machine, so that the target interface machine transmits the target data, dynamically selects the target interface machine according to the source address and the destination address of the target data, transmits the target data by using the target interface machine applicable to the current network state, and improves the transmission efficiency of the target data.
The device can execute the methods provided by all the embodiments of the disclosure, and has corresponding functional modules and beneficial effects for executing the methods. For technical details that are not described in detail in this embodiment, reference may be made to the methods provided in all the foregoing embodiments of the disclosure. It should be noted that, in the embodiment of the apparatus, the included units and modules are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the present disclosure.
Fig. 6 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure, as shown in fig. 6, the computer device includes a processor 60, a memory 61, an input device 62, and an output device 63; the number of processors 60 in the computer device may be one or more, and one processor 60 is taken as an example in fig. 6; the processor 60, the memory 61, the input device 62 and the output device 63 in the computer apparatus may be connected by a bus or other means, and the connection by the bus is exemplified in fig. 6.
The memory 61 is a computer-readable storage medium that can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the data transmission method in the embodiments of the present disclosure. The processor 60 executes various functional applications of the computer device and data processing by executing software programs, instructions, and modules stored in the memory 61, that is, implements the above-described data transmission method. The method comprises the following steps:
acquiring a data transmission instruction, wherein the data transmission instruction comprises a source address and a destination address of target data;
responding to a data transmission instruction, and determining an adaptive target interface machine according to a destination address;
generating configuration information according to a source address and a destination address of the target data;
and sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data.
Further, determining an adapted target interface machine according to the destination address includes:
determining a target network environment according to the destination address;
and determining a target interface machine according to the target network environment.
Further, determining an adapted target interface machine according to the destination address includes:
determining a plurality of interface machines to be selected according to the destination address;
and determining a target interface machine according to interface machine parameters of a plurality of interface machines to be selected, wherein the interface machine parameters comprise interface machine network bandwidth or interface machine load information.
Further, generating configuration information according to the source address and the destination address of the target data includes:
acquiring transmission parameters of target data, wherein the transmission parameters comprise: data filtering parameters, interface machine performance parameters or transmission data block size;
and generating configuration information according to the transmission parameters, the source address and the destination address of the target data.
Further, controlling the target interface machine to transmit the target data includes:
controlling a target interface machine to record the transmission progress of target data when transmitting data;
and if the terminal is transmitted, recovering the transmission of the target data according to the transmission progress.
Further, the configuration information further includes a pre-processing parameter or a post-processing parameter, the pre-processing parameter is used for controlling the target interface machine to pre-process the target data, and the post-processing parameter is used for controlling the target interface machine to write the target data into the database according to the transmission requirement for data processing.
Further, before acquiring the data transmission instruction, the method further includes:
receiving registration information of a plurality of interface machines;
correspondingly, the target interface machine which is adapted according to the destination address is determined, and the method comprises the following steps:
and determining a target interface machine matched with the target address according to the registration information of the plurality of interface machines.
The memory 61 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 61 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 61 may further include memory located remotely from the processor 60, which may be connected to a computer device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 62 may be used to receive input numeric or character information and to generate key signal inputs relating to user settings and function controls of the computer apparatus. The output device 63 may include a display device such as a display screen.
Embodiments of the present disclosure also provide a computer-readable storage medium storing a computer program for performing a data transmission method when executed by a computer processor. The method comprises the following steps:
acquiring a data transmission instruction, wherein the data transmission instruction comprises a source address and a destination address of target data;
responding to a data transmission instruction, and determining an adaptive target interface machine according to a destination address;
generating configuration information according to a source address and a destination address of the target data;
and sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data.
Further, determining an adapted target interface machine according to the destination address includes:
determining a target network environment according to the destination address;
and determining a target interface machine according to the target network environment.
Further, determining an adapted target interface machine according to the destination address includes:
determining a plurality of interface machines to be selected according to the destination address;
and determining a target interface machine according to interface machine parameters of a plurality of interface machines to be selected, wherein the interface machine parameters comprise interface machine network bandwidth or interface machine load information.
Further, generating configuration information according to the source address and the destination address of the target data includes:
acquiring transmission parameters of target data, wherein the transmission parameters comprise: data filtering parameters, interface machine performance parameters or transmission data block size;
and generating configuration information according to the transmission parameters, the source address and the destination address of the target data.
Further, controlling the target interface machine to transmit the target data includes:
controlling a target interface machine to record the transmission progress of target data when transmitting data;
and if the terminal is transmitted, recovering the transmission of the target data according to the transmission progress.
Further, the configuration information further includes a pre-processing parameter or a post-processing parameter, the pre-processing parameter is used for controlling the target interface machine to pre-process the target data, and the post-processing parameter is used for controlling the target interface machine to write the target data into the database according to the transmission requirement for data processing.
Further, before acquiring the data transmission instruction, the method further includes:
receiving registration information of a plurality of interface machines;
correspondingly, the target interface machine which is adapted according to the destination address is determined, and the method comprises the following steps:
and determining a target interface machine matched with the target address according to the registration information of the plurality of interface machines.
Of course, the computer readable storage medium storing the computer program provided in the embodiments of the present disclosure is not limited to the above method operations, and may also perform related operations in the data transmission method provided in any embodiment of the present disclosure.
From the above description of the embodiments, it is obvious for a person skilled in the art that the present disclosure can be implemented by software and necessary general hardware, and certainly can be implemented by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present disclosure may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods of the embodiments of the present disclosure.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present disclosure and the technical principles employed. Those skilled in the art will appreciate that the present disclosure is not limited to the specific embodiments illustrated herein and that various obvious changes, adaptations, and substitutions are possible, without departing from the scope of the present disclosure. Therefore, although the present disclosure has been described in greater detail with reference to the above embodiments, the present disclosure is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present disclosure, the scope of which is determined by the scope of the appended claims.
Claims (10)
1. A method of data transmission, comprising:
acquiring a data transmission instruction, wherein the data transmission instruction comprises a source address and a destination address of target data;
responding to a data transmission instruction, and determining an adaptive target interface machine according to the destination address;
generating configuration information according to the source address and the destination address of the target data;
and sending the configuration information to the target interface machine, and controlling the target interface machine to transmit the target data.
2. The method of claim 1, wherein determining the adapted target interface machine according to the destination address comprises:
determining a target network environment according to the destination address;
and determining a target interface machine according to the target network environment.
3. The method of claim 1, wherein determining the adapted target interface machine according to the destination address comprises:
determining a plurality of interface machines to be selected according to the destination address;
and determining a target interface machine according to interface machine parameters of the plurality of interface machines to be selected, wherein the interface machine parameters comprise interface machine network bandwidth or interface machine load information.
4. The method of claim 1, wherein generating configuration information according to a source address and a destination address of the target data comprises:
acquiring transmission parameters of the target data, wherein the transmission parameters comprise: data filtering parameters, interface machine performance parameters or transmission data block size;
and generating configuration information according to the transmission parameters, the source address and the destination address of the target data.
5. The method of claim 1, wherein said controlling said target interface machine to transmit said target data comprises:
controlling the target interface machine to record the transmission progress of the target data when transmitting data;
and if the terminal is transmitted, recovering the transmission of the target data according to the transmission progress.
6. The method according to claim 1, wherein the configuration information further includes a pre-processing parameter or a post-processing parameter, the pre-processing parameter is used to control the target interface machine to pre-process the target data, and the post-processing parameter is used to control the target interface machine to write the target data into a database according to a transmission requirement.
7. The method of claim 1, prior to obtaining the data transfer instruction, further comprising:
receiving registration information of a plurality of interface machines;
correspondingly, the determining the adapted target interface machine according to the destination address includes:
and determining the target interface machine matched with the target address according to the registration information of the plurality of interface machines.
8. A data transmission apparatus, comprising:
the instruction acquisition module is used for acquiring a data transmission instruction, and the data transmission instruction comprises a source address and a destination address of target data;
the target interface machine determining module is used for responding to a data transmission instruction and determining an adaptive target interface machine according to the destination address;
the matching information generation module is used for generating configuration information according to a source address and a destination address of the target data;
and the matching information sending module is used for sending the configuration information to the target interface machine and controlling the target interface machine to transmit the target data.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the data transmission method according to any of claims 1-7 when executing the program.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the data transmission method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010135799.0A CN113347281A (en) | 2020-03-02 | 2020-03-02 | Data transmission method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010135799.0A CN113347281A (en) | 2020-03-02 | 2020-03-02 | Data transmission method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113347281A true CN113347281A (en) | 2021-09-03 |
Family
ID=77467173
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010135799.0A Pending CN113347281A (en) | 2020-03-02 | 2020-03-02 | Data transmission method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113347281A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1816024A (en) * | 2005-02-01 | 2006-08-09 | 中兴通讯股份有限公司 | Method for insuring telecommunication service quality in soft-exchanging network |
| CN101175034A (en) * | 2006-10-31 | 2008-05-07 | 日立通讯技术株式会社 | Packet forwarding apparatus having gateway load distribution function |
| CN101632273A (en) * | 2006-12-20 | 2010-01-20 | 杰恩邦德公司 | Methods, systems, and computer program products for source-aware IP routing at a media gateway |
| CN102971992A (en) * | 2010-06-29 | 2013-03-13 | 华为技术有限公司 | Layer two over multiple sites |
| CN103491088A (en) * | 2013-09-22 | 2014-01-01 | 成都卫士通信息产业股份有限公司 | Method for processing IPSec VPN gateway data |
| CN106789667A (en) * | 2016-11-21 | 2017-05-31 | 华为技术有限公司 | A kind of data forwarding method, relevant device and system |
| CN109245984A (en) * | 2018-07-13 | 2019-01-18 | 华为技术有限公司 | A kind of message transmitting method, a kind of information processing method and its relevant device |
| CN110474884A (en) * | 2019-07-24 | 2019-11-19 | 北京百度网讯科技有限公司 | Ether mill network system and communication means, equipment and computer readable storage medium |
-
2020
- 2020-03-02 CN CN202010135799.0A patent/CN113347281A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1816024A (en) * | 2005-02-01 | 2006-08-09 | 中兴通讯股份有限公司 | Method for insuring telecommunication service quality in soft-exchanging network |
| CN101175034A (en) * | 2006-10-31 | 2008-05-07 | 日立通讯技术株式会社 | Packet forwarding apparatus having gateway load distribution function |
| CN101632273A (en) * | 2006-12-20 | 2010-01-20 | 杰恩邦德公司 | Methods, systems, and computer program products for source-aware IP routing at a media gateway |
| CN102971992A (en) * | 2010-06-29 | 2013-03-13 | 华为技术有限公司 | Layer two over multiple sites |
| CN103491088A (en) * | 2013-09-22 | 2014-01-01 | 成都卫士通信息产业股份有限公司 | Method for processing IPSec VPN gateway data |
| CN106789667A (en) * | 2016-11-21 | 2017-05-31 | 华为技术有限公司 | A kind of data forwarding method, relevant device and system |
| CN109245984A (en) * | 2018-07-13 | 2019-01-18 | 华为技术有限公司 | A kind of message transmitting method, a kind of information processing method and its relevant device |
| CN110474884A (en) * | 2019-07-24 | 2019-11-19 | 北京百度网讯科技有限公司 | Ether mill network system and communication means, equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108365967B (en) | Method, system, terminal and computer readable storage medium for dynamically configuring communication parameters | |
| CN107391770B (en) | Method, device and equipment for processing data and storage medium | |
| CN109829287A (en) | Api interface permission access method, equipment, storage medium and device | |
| WO2014000485A1 (en) | Content filtration method and device | |
| CN108600053B (en) | Wireless network data packet capturing method based on zero copy technology | |
| US10552068B2 (en) | Access method and device for random access memories, control chip and storage medium | |
| US11695623B2 (en) | Method and apparatus for binding network card in multi-network card server, and electronic device and storage medium | |
| CN109600385B (en) | Access control method and device | |
| CN109088957B (en) | NAT rule management method, device and equipment | |
| CN110391989B (en) | Method and device for data transmission | |
| US9641595B2 (en) | System management apparatus, system management method, and storage medium | |
| CN111193633A (en) | Method and device for detecting abnormal network connection | |
| CN115023699A (en) | Malicious process detection method and device, electronic device and storage medium | |
| CN111585963A (en) | Data acquisition method, system and storage medium | |
| CN113992600A (en) | Multi-rate mode data transmission control method and device based on cache queue | |
| CN115145806A (en) | Data acquisition method and device and computer readable storage medium | |
| CN110737678B (en) | Data searching method, device, equipment and storage medium | |
| CN113347281A (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN107357853B (en) | Method and device for operating REDIS console and computer system | |
| CN112883088A (en) | Data processing method, device, equipment and storage medium | |
| CN114338529B (en) | Five-tuple rule matching method and device | |
| CN112291212B (en) | Static rule management method and device, electronic equipment and storage medium | |
| CN114039969A (en) | Data transmission method and device | |
| CN113849686A (en) | Video data acquisition method and device, electronic equipment and storage medium | |
| US11604877B1 (en) | Nested courses of action to support incident response in an information technology environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |