WO2016091085A1

WO2016091085A1 - Data transmission method, device, and server

Info

Publication number: WO2016091085A1
Application number: PCT/CN2015/095803
Authority: WO
Inventors: 杨涛; 侯金轩
Original assignee: 北京奇虎科技有限公司; 奇智软件（北京）有限公司
Priority date: 2014-12-08
Filing date: 2015-11-27
Publication date: 2016-06-16
Also published as: CN104468399B; CN104468399A

Abstract

The present invention mainly relates to the technical field of Internet. Disclosed are a data transmission method, device, and server, which mainly aim to prevent data loss in a data transmission process. The method comprises: receiving, at a geographical position at which a first server is located, data that is from the first server and is to be sent to a second server, the second server and the first server being located at different geographical positions; storing the data in a preset queue; acquiring the data from the queue, and sending the data to the second server; determining whether the data is successfully sent to the second server; and when the data fails to be sent, reacquiring the data from the queue and sending the data. According to the technical solution of the present invention, the occurrence of data loss can be effectively prevented.

Description

Data transmission method, device and server

Technical field

The present invention relates to the field of Internet technologies, and in particular, to a data transmission method, apparatus, and server.

Background technique

How to ensure the accuracy of the transmitted data is an important issue for the transmission of large amounts of data over the Internet.

A more common example is that the game manufacturer's server is set up in the Beijing computer room to run the game program; the data analyst's server is set up in the Shanghai computer room for analyzing the game data; therefore, the game data of the Beijing computer room server needs to be sent. Go to the Shanghai computer room server for data analysis. If there is a failure in the public network between Beijing and Shanghai, it will inevitably result in a large amount of data transmission loss. The quality of the public network in Beijing and Shanghai is not controlled by game makers or data analysts. This poses a problem of data loss.

Summary of the invention

In view of the above problems, the present invention has been made in order to provide a data transmission method, apparatus and server that overcomes the above problems or at least partially solves or alleviates the above problems.

According to an aspect of the present invention, a data transmission method is provided, comprising: receiving, at a geographic location where a first server is located, data to be sent from the first server to a second server, the second server And the first server is located in a different geographical location; storing the data in a preset queue; acquiring the data from the queue, and sending the data to the second server; determining the data Whether it is successfully sent to the second server; when the data transmission fails, the data is re-acquired from the queue and transmitted.

According to still another aspect of the present invention, a data transmission apparatus is provided, comprising: a data receiving module, configured to receive, at a geographic location where the first server is located, from the first server to be sent to a second server Data, the second server and the first server are located in different geographic locations; a queue storage module is configured to store the data in a preset queue; and a data sending module is configured to obtain the Data, and the data is sent to the second server; the determining module is configured to determine whether the data is successfully sent to the second server; when the data transmission fails, the data sending module re-sends The data is obtained and sent in the queue.

According to another aspect of the present invention, a server is provided, comprising: the aforementioned data transmission device.

According to still another aspect of the present invention, a computer program is provided, comprising computer readable code that, when executed on a computing device, causes the computing device to perform data transmission according to any of the above method.

According to still another aspect of the present invention, a computer readable medium storing a computer program as described above is provided.

The beneficial effects of the invention are:

According to the technical solution of the present invention, the data of the first server is received in the geographical location where the first server is located, and the data transmission may not pass through the public network because the geographical location is the same, so that the received data can be completely accurate; When the second server sends the data, the data is cached through the queue. Therefore, even if the data is not successfully sent to the second server, the data can be re-transmitted from the queue, and the transmission is successful, and the technical solution of the present invention can be effectively Prevent data loss.

The above description is only an overview of the technical solutions of the present invention, and the above-described and other objects, features and advantages of the present invention can be more clearly understood. Specific embodiments of the invention are set forth below.

DRAWINGS

Various other advantages and benefits will become apparent to those skilled in the art from a The drawings are only for the purpose of illustrating the preferred embodiments and are not to be construed as limiting. Throughout the drawings, the same reference numerals are used to refer to the same parts. In the drawing:

FIG. 1 is a flow chart schematically showing a data transmission method according to an embodiment of the present invention; FIG.

FIG. 2 is a flow chart schematically showing a data transmission method according to an embodiment of the present invention; FIG.

FIG. 3 is a flow chart schematically showing a data transmission method according to an embodiment of the present invention; FIG.

4 is a flow chart schematically showing a data transmission method according to an embodiment of the present invention;

FIG. 5 is a flow chart schematically showing a data transmission method according to an embodiment of the present invention; FIG.

Figure 6 is a block diagram schematically showing a data transmission device in accordance with one embodiment of the present invention;

Figure 7 is a block diagram schematically showing a data transmission device in accordance with one embodiment of the present invention;

Figure 8 is a block diagram schematically showing a data transmission device in accordance with one embodiment of the present invention;

Figure 9 is a schematic block diagram of a server in accordance with one embodiment of the present invention;

Figure 10 is a block diagram schematically showing a computing device for performing a data transmission method according to the present invention; and

Fig. 11 schematically shows a storage unit for holding or carrying program code implementing the data transmission method according to the present invention.

detailed description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the embodiments of the present invention have been shown in the drawings, the embodiments Rather, these embodiments are provided so that this disclosure will be more fully understood and the scope of the disclosure will be fully disclosed.

As shown in FIG. 1, an embodiment of the present invention provides a data transmission method, which at least includes:

Step 110: Receive data to be sent to the second server from the first server at a geographic location where the first server is located, where the second server and the first server are located in different geographic locations. In this embodiment, the size of the geographical location is not limited, for example, whether it is the same geographical location; whether it is the same equipment room. Data transmission in the same equipment room can be carried out without going through the public network. Even if data is transmitted in real time, data loss is difficult.

In step 120, the data is stored in a preset queue.

In step 130, data is obtained from the queue and sent to the second server. In this embodiment, according to the foregoing, the first server and the second server may be located in different computer rooms, so that data transmission between the two needs to be performed through the public network.

Step 140: Determine whether the data is successfully sent to the second server.

Step 150: When the data transmission fails, the data is re-acquired from the queue and sent. According to the technical solution of the present embodiment, even if the data is not successfully transmitted to the second server, the data can be re-transmitted from the queue until the transmission is successful. It can be seen that the technical solution of the present invention can effectively prevent the occurrence of data loss.

According to FIG. 1, one or several game manufacturer log center machines can be applied in the machine room where the game manufacturer's server (first server) is located, and the software syslog-ng is configured on the manufacturer server and the log center machine at the same time, and the vendor server is used as the server. The syslog-ng client, the log center machine is used as the syslog-ng server, through syslog-ng to collect the player's key behavior (recharge, consumption of ingots, etc.) as log data. The log repeater and the log transmitter are implemented by the program on the log center machine, wherein the log repeater is used to store the log data in the queue, and the log transmitter is used to send the log data to the data analyst of another computer room through the public network. Server (second server). If the public network transmission fails, the corresponding log records will still be cached in the queue, and then the log transmitter will perform data transmission until the data transmission is successful.

An embodiment of the present invention provides a data transmission method, which at least includes:

Step 110: Receive data to be sent to the second server from the first server at a geographic location where the first server is located, where the second server and the first server are located in different geographic locations.

In step 120, the data is stored in a preset queue.

Step 140: Determine whether the data is successfully sent to the second server.

Step 150: When the data transmission fails, the data is re-acquired from the queue and sent.

In step 160, data is deleted from the queue when the data is successfully transmitted. According to the technical solution of the embodiment, the data in the queue is cleared in time, so that there is space in the queue to store new data.

According to FIG. 1, combined with the foregoing, it can be seen that after the log data is successfully sent to the server (second server) of the data analyst, the log center machine (first server) is cleared from the queue by the log repeater. The data.

As shown in FIG. 2, an embodiment of the present invention provides a data transmission method, which at least includes:

Step 210: Receive data to be sent to the second server from the first server at a geographic location where the first server is located, where the second server and the first server are located in different geographic locations.

In step 220, the data is stored in a preset queue.

In step 230, data is retrieved from the queue and sent to the second server. In this embodiment, according to the foregoing, the first server and the second server may be located in different computer rooms, so that data transmission between the two needs to be performed through the public network.

Step 240: Determine whether a message sent by the second server for notifying that the data transmission is successful is received within a preset time period after the data is sent. In this embodiment, the content of the message is not limited, as long as it is preset to indicate that the content has been successfully sent.

Step 250: If no message is received within a preset time period after the data is sent, it is determined that the data transmission fails, and data is re-acquired from the queue and sent.

Step 260: If a message is received within a preset time period after the data is sent, it is determined that the data is successfully sent, and the data is deleted from the queue. According to the technical solution of the embodiment, whether the data is successfully transmitted can be accurately determined based on whether the message is received within a predetermined time period.

According to FIG. 2, the player behavior log transmission between the game maker server (first server) and the data analyzer server (second server) is also taken as an example. After the log data is sent from the game manufacturer server, if it is in 1 minute (preset During the time period), no information received by the data analyzer server containing specific characters was received. It means that the transmission is not successful, you need to get the data from the queue and resend it.

As shown in FIG. 3, an embodiment of the present invention provides a data transmission method, which at least includes:

Step 310: Receive data to be sent to the second server from the first server at a geographic location where the first server is located, where the second server and the first server are located in different geographic locations.

Step 311: Identify a computing task of the data to be used according to the attribute of the data.

Step 320: Select a queue for storing data from the plurality of queues according to the calculation task of the data to be used, and store the data in the selected queue. The number of queues is multiple, and multiple queues are used to store data to be sent to the second server for various computing tasks. In the present embodiment, the type of the computing task is not limited, and it can be automatically recognized by the owner of the second server.

At step 330, data is retrieved from the queue and sent to the second server. In this embodiment, according to the foregoing, the first server and the second server may be located in different computer rooms, so that data transmission between the two needs to be performed through the public network.

In step 340, it is determined whether the data is successfully sent to the second server.

In step 350, when the data transmission fails, the data is re-acquired from the queue and sent.

In step 360, data is deleted from the queue when the data is successfully transmitted. According to the technical solution of the embodiment, multiple queues correspond to multiple computing tasks, and the data of the queue can be used for the calculation of the corresponding computing task in time when the data of the queue is sent to the second server.

According to FIG. 3, taking the player behavior log transmission between the game maker server (first server) and the data analyst server (second server) as an example, it is assumed that there is a queue 1 corresponding to the player consumption amount calculation task, corresponding to the player going online. Queue 2 of the time analysis task, if the data obtained from the game manufacturer server is the online time of a player, it is stored in the queue 2, and if the data obtained from the game manufacturer server is the amount of the game item purchased by a player, the storage is performed. Go to queue 1.

Step 311: Identify a computing task of the data to be used according to the attribute of the data. In this embodiment, the attribute of the data is not limited, and it may be one or more types of data, a field, and a data amount.

At step 330, data is retrieved from the queue and sent to the second server. In this embodiment, According to the foregoing, the first server and the second server may be located in different equipment rooms, so that data transmission between the two needs to be performed through the public network.

In step 360, data is deleted from the queue when the data is successfully transmitted. According to the technical solution of the embodiment, different computing tasks usually require data of different attributes, so the corresponding computing tasks are identified according to the attributes of the data, so that the data is stored in the corresponding queue.

According to FIG. 3, taking the player behavior log transmission between the game maker server (first server) and the data analyzer server (second server) as an example, if the data acquired from the game maker server is a time type (attribute), Determining that the data is the user's online time, the data can be stored in a queue corresponding to the player's online time analysis task; if the data obtained from the game manufacturer server includes "RMB" (field), the data can be determined to be a user to purchase the item. The amount of consumption, which can be stored in a queue corresponding to the user consumption amount calculation task.

As shown in FIG. 4, an embodiment of the present invention provides a data transmission method, which at least includes:

Step 401: The first server receives data from a cluster that includes multiple third servers in the same geographical location as the first server. In this embodiment, the number of the third server clusters is not limited, and the number of the third server clusters may be arbitrarily increased or decreased, but the second server always obtains data from the first server, so the second server and the first server are The data transfer configuration does not need to be changed.

Step 410: Receive data to be sent to the second server from the first server at a geographic location where the first server is located, where the second server and the first server are located in different geographic locations.

In step 420, the data is stored in a preset queue.

In step 430, data is retrieved from the queue and sent to the second server. In this embodiment, according to the foregoing, the first server and the second server may be located in different computer rooms, so that data transmission between the two needs to be performed through the public network.

Step 440: Determine whether the data is successfully sent to the second server.

In step 450, when the data transmission fails, the data is re-acquired from the queue and sent.

Step 460: Delete data from the queue when the data is successfully transmitted.

According to FIG. 4, the game manufacturer configures a plurality of servers to run the game program (the third server), and all the servers running the game programs are connected to the same server (the first server) and transmit data, and the data of the server is pressed. The preset configuration information is transmitted to the server (second server) that performs data analysis. Regardless of the increase or decrease in the number of third servers, since the second server is only connected to the first server, there is no need to change the configuration information, which is advantageous for adjusting the number of servers at any time.

As shown in FIG. 5, an embodiment of the present invention provides a data transmission method, which at least includes:

Step 510: Receive data sent by the first server in real time and record it in a preset log file.

In step 520, data is extracted from the log file and stored in a preset queue.

In step 530, data is retrieved from the queue and sent to the second server. In this embodiment, according to the foregoing, the first server and the second server may be located in different computer rooms, so that data transmission between the two needs to be performed through the public network.

Step 540: Determine whether the data is successfully sent to the second server.

Step 550: When the data transmission fails, the data is re-acquired from the queue and sent.

In step 560, the data is deleted from the queue when the data is successfully transmitted. According to the technical solution of the embodiment, the method of recording the log file is advantageous for receiving and saving data in real time, and delaying the extraction of the data from the log file and storing it in the queue, thereby ensuring that the data can be received in time without affecting the data. send.

As shown in FIG. 6, an embodiment of the present invention provides a data transmission apparatus, which at least includes:

The data receiving module 610 receives data from the first server to be sent to the second server in a geographical location where the first server is located, and the second server and the first server are located in different geographical locations. In this embodiment, the size of the geographic location is not limited. For example, whether the same geographical location is: whether it is the same equipment room, data transmission in the same equipment room may not pass through the public network, even if data is transmitted in real time. It is difficult to have data loss.

The queue storage module 620 stores the data in a preset queue.

The data sending module 630 acquires data from the queue and transmits the data to the second server. In this embodiment, according to the foregoing, the first server and the second server may be located in different computer rooms, so that data transmission between the two needs to be performed through the public network.

The determining module 640 determines whether the data is successfully sent to the second server.

When the data transmission fails, the data sending module 630 re-acquires the data from the queue and transmits it. According to the technical solution of the present embodiment, even if the data is not successfully transmitted to the second server, the data can be re-transmitted from the queue until the transmission is successful. It can be seen that the technical solution of the present invention can effectively prevent the occurrence of data loss.

According to FIG. 6, one or several game manufacturer log center machines can be applied in the machine room where the game manufacturer's server (first server) is located, and the software syslog-ng is configured on the vendor server and the log center machine at the same time, and the vendor server is used as the server. The syslog-ng client, the log center machine is used as the syslog-ng server, through syslog-ng to collect the player's key behavior (recharge, consumption of ingots, etc.) as log data. The log repeater and the log transmitter are implemented by the program on the log center machine, wherein the log repeater is used to store the log data in the queue, and the log transmitter is used to send the log data to the other computer room through the public network. According to the analyst's server (second server). If the public network transmission fails, the corresponding log records will still be cached in the queue, and then the log transmitter will perform data transmission until the data transmission is successful.

As shown in FIG. 7, an embodiment of the present invention provides a data transmission apparatus, which at least includes:

The data receiving module 710 receives data to be sent from the first server to the second server in a geographical location where the first server is located, and the second server and the first server are located in different geographical locations.

The queue storage module 720 stores the data in a preset queue.

The data sending module 730 acquires data from the queue and transmits the data to the second server. In this embodiment, according to the foregoing, the first server and the second server may be located in different computer rooms, so that data transmission between the two needs to be performed through the public network.

The determining module 740 determines whether the data is successfully sent to the second server.

When the data transmission fails, the data transmission module 730 re-acquires the data from the queue and transmits it.

The data deletion module 750 deletes data from the queue when the data is successfully transmitted. According to the technical solution of the embodiment, the data in the queue is cleared in time, so that there is space in the queue to store new data.

According to FIG. 7, combined with the foregoing, it can be seen that after the log data is successfully sent to the server (second server) of the data analyst, it is cleared from the queue by the log repeater in the log center machine (first server). The data.

In an embodiment of the present invention, a data transmission apparatus is provided, which at least includes:

The queue storage module 720 stores the data in a preset queue.

The determining module 740 determines whether a message sent by the second server for notifying that the data transmission is successful is received within a preset time period after the data is sent. In this embodiment, the content of the message is not limited, as long as it is preset to indicate that the content has been successfully sent.

If the message is not received within the preset time period after the data is transmitted, the determining module 740 determines that the data transmission has failed, and the data sending module 730 re-acquires the data from the queue and transmits the data.

If the message is received within a preset time period after the data is transmitted, the determining module 740 determines that the data transmission is successful, and the data deletion module 750 deletes the data from the queue. According to the technical solution of the embodiment, whether the data is successfully transmitted can be accurately determined based on whether the message is received within a predetermined time period.

According to Figure 7, the same is the game maker server (first server) and the data analyst server (second For example, the player behavior log transmission between the servers), after the log data is sent from the game manufacturer server, if the information containing the specific character returned by the data analyzer server is not received within 1 minute (preset time period), it means that there is no transmission. To be successful, you need to get the data from the queue and resend it.

The queue storage module 720 selects a queue for storing data from the plurality of queues according to the calculation task of the data to be used, and stores the data in the selected queue. The number of queues is multiple, and multiple queues are used to store data to be sent to the second server for various computing tasks. In the present embodiment, the type of the computing task is not limited, and it can be automatically recognized by the owner of the second server.

When the data transmission is successful, the data deletion module 740 deletes the data from the queue. According to the technical solution of the embodiment, multiple queues correspond to multiple computing tasks, and the data of the queue can be used for the calculation of the corresponding computing task in time when the data of the queue is sent to the second server.

According to FIG. 7, taking the player behavior log transmission between the game maker server (first server) and the data analyst server (second server) as an example, it is assumed that there is a queue 1 corresponding to the player consumption amount calculation task, corresponding to the player going online. Queue 2 of the time analysis task, if the data obtained from the game manufacturer server is the online time of a player, it is stored in the queue 2, and if the data obtained from the game manufacturer server is the amount of the game item purchased by a player, the storage is performed. Go to queue 1.

As shown in FIG. 8, an embodiment of the present invention provides a data transmission apparatus, which at least includes:

The data receiving module 810 receives data to be sent from the first server to the second server in a geographical location where the first server is located, and the second server and the first server are located in different geographical locations.

The computing task identification module 820 identifies a computing task of the data to be used based on the attributes of the data. In this embodiment, the attribute of the data is not limited, and it may be one or more types of data, a field, and a data amount.

The queue storage module 830 selects a queue for storing data from the plurality of queues according to the calculation task of the data to be used, and stores the data in the selected queue. The number of queues is multiple, and multiple queues are used to store data to be sent to the second server for various computing tasks. In this embodiment, the class for the computing task The type is not restricted and can be automatically recognized by the owner of the second server.

The data sending module 840 acquires data from the queue and transmits the data to the second server. In this embodiment, according to the foregoing, the first server and the second server may be located in different computer rooms, so that data transmission between the two needs to be performed through the public network.

The determining module 850 determines whether the data is successfully sent to the second server.

When the data transmission fails, the data transmission module 840 retrieves the data from the queue and transmits it.

The data deletion module 860 deletes data from the queue when the data is successfully transmitted. According to the technical solution of the embodiment, different computing tasks usually require data of different attributes, so the corresponding computing tasks are identified according to the attributes of the data, so that the data is stored in the corresponding queue.

According to FIG. 8, taking the player behavior log transmission between the game maker server (first server) and the data analyzer server (second server) as an example, if the data acquired from the game maker server is a time type (attribute), Determining that the data is the user's online time, the data can be stored in a queue corresponding to the player's online time analysis task; if the data obtained from the game manufacturer server includes "RMB" (field), the data can be determined to be a user to purchase the item. The amount of consumption, which can be stored in a queue corresponding to the user consumption amount calculation task.

The first server receives data from a cluster containing a plurality of third servers located in the same geographic location as the first server. In this embodiment, the number of the third server clusters is not limited, and the number of the third server clusters may be arbitrarily increased or decreased, but the second server always obtains data from the first server, so the second server and the first server are The data transfer configuration does not need to be changed.

The queue storage module 720 stores the data in a preset queue.

The data deletion module 750 deletes data from the queue when the data is successfully transmitted.

According to FIG. 7, the game manufacturer configures a plurality of servers to run the game program (the third server), and all the servers running the game programs are connected to the same server (the first server) and transmit data, and the data of the server is pressed. The preset configuration information is transmitted to the server for data analysis (second server) on. Regardless of the increase or decrease in the number of third servers, since the second server is only connected to the first server, there is no need to change the configuration information, which is advantageous for adjusting the number of servers at any time.

The data receiving module 710 receives the data sent by the first server in real time and records it in a preset log file.

The queue storage module 720 extracts data from the log file and stores it in a preset queue.

The data deletion module 750 deletes data from the queue when the data is successfully transmitted. According to the technical solution of the embodiment, the method of recording the log file is advantageous for receiving and saving data in real time, and delaying the extraction of the data from the log file and storing it in the queue, thereby ensuring that the data can be received in time without affecting the data. send.

As shown in FIG. 9, an embodiment of the present invention provides a server, which includes at least the data transmission device in any of the embodiments corresponding to FIG. 6 to FIG.

According to the foregoing embodiment, the server of the embodiment receives the data of the first server in the geographic location where the first server is located. Because the geographical location is the same, the data transmission may not pass through the public network, so the received data can be completely accurate. When the data is sent to the second server, since the data is cached through the queue, even if the data is not successfully transmitted to the second server, the data can be retrieved from the queue and sent again until the transmission is successful, and the technology of the present invention is known. The solution can effectively prevent data loss.

The algorithms and displays provided herein are not inherently related to any particular computer, virtual system, or other device. Various general purpose systems can also be used with the teaching based on the teachings herein. The structure required to construct such a system is apparent from the above description. Moreover, the invention is not directed to any particular programming language. It is to be understood that the invention may be embodied in a variety of programming language, and the description of the specific language has been described above in order to disclose the preferred embodiments of the invention.

In the description provided herein, numerous specific details are set forth. However, it is understood that the embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of the description.

Similarly, in order to simplify the disclosure and to facilitate understanding of one or more of the various inventive aspects, in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together An embodiment, a diagram, or a description thereof. However, the method disclosed is not to be interpreted as reflecting the intention that the claimed invention requires more features than those recited in the claims. Rather, as the following claims reflect, inventive aspects reside in less than all features of the single embodiments disclosed herein. Therefore, the claims following the specific embodiments are hereby explicitly incorporated into the embodiments, and each of the claims as a separate embodiment of the invention.

Those skilled in the art will appreciate that the modules in the devices of the embodiments can be adaptively changed and placed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and further they may be divided into a plurality of sub-modules or sub-units or sub-components. In addition to such features and/or at least some of the processes or units being mutually exclusive, any combination of the features disclosed in the specification, including the accompanying claims, the abstract and the drawings, and any methods so disclosed, or All processes or units of the device are combined. Each feature disclosed in this specification (including the accompanying claims, the abstract and the drawings) may be replaced by alternative features that provide the same, equivalent or similar purpose.

In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features that are included in other embodiments and not in other features, combinations of features of different embodiments are intended to be within the scope of the present invention. Different embodiments are formed and formed. For example, in the following claims, any one of the claimed embodiments can be used in any combination.

The various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the functionality of some or all of the components of a data transmission device in accordance with embodiments of the present invention. The invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein. Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

For example, Figure 10 illustrates a computing device in which the data transfer method in accordance with the present invention can be implemented. The computing device conventionally includes a processor 1010 and a computer program product or computer readable medium in the form of a memory 1020. The memory 1020 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. The memory 1020 has a memory space 1030 for executing program code 1031 of any of the above method steps. For example, storage space 1030 for program code may include various program code 1031 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products to the one or more computer programs. In the product. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG. The storage unit may have storage segments, storage spaces, and the like that are similarly arranged to memory 1020 in the computing device of FIG. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit includes computer readable code 1031', ie, code that can be read by, for example, a processor such as 1010, which when executed by a computing device causes the computing device to perform each of the methods described above step.

"an embodiment," or "an embodiment," or "an embodiment," In addition, it is noted that the phrase "in one embodiment" is not necessarily referring to the same embodiment.

It is to be noted that the above-described embodiments are illustrative of the invention and are not intended to be limiting, and that the invention may be devised without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as a limitation. The word "comprising" does not exclude the presence of the elements or steps that are not recited in the claims. The word "a" or "an" The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means can be embodied by the same hardware item. The use of the words first, second, and third does not indicate any order. These words can be interpreted as names.

In addition, it should be noted that the language used in the specification has been selected for the purpose of readability and teaching, and is not intended to be construed or limited. Therefore, many modifications and changes will be apparent to those skilled in the art without departing from the scope of the invention. The disclosure of the present invention is intended to be illustrative, and not restrictive, and the scope of the invention is defined by the appended claims.

Claims

A data transmission method includes:

Receiving, in a geographic location where the first server is located, data to be sent from the first server to the second server, where the second server and the first server are located in different geographic locations;

Store the data in a preset queue;

Obtaining the data from the queue and transmitting the data to the second server;

Determining whether the data is successfully sent to the second server;

When the data transmission fails, the data is retrieved from the queue and transmitted.
The method of claim 1 further comprising:

The data is deleted from the queue when the data transmission is successful.
The method of claim 1, wherein determining whether the data is successfully sent to the second server comprises:

Determining whether a message sent by the second server for notifying that the data is successfully sent is received within a preset time period after the data is sent;

If the message is not received within a preset time period after the data is sent, it is determined that the data transmission fails;

If the message is received within the preset time period after the data is sent, it is determined that the data is successfully transmitted.
The method according to claim 1, wherein the number of the queues is plural, and the plurality of queues are used for storing data to be sent to the second server for performing various computing tasks;

The data is stored in a preset queue, including:

A queue for storing the data is selected from a plurality of the queues according to a computing task to be used for the data, and the data is stored in the selected queue.
The method according to claim 4, wherein before the queue for storing the data is selected from the plurality of the queues according to the computing task of the data to be used, the method further comprises:

A computing task to be used for the data is identified based on the attributes of the data.
The method of claim 5, wherein the attributes of the data comprise one or more of a type, a field, and a quantity of data of the data.
The method of claim 1, wherein before receiving the data to be sent to the second server from the first server, the second server and the first server are located in different geographic locations, and further comprising:

The first server receives the data from a cluster comprising a plurality of third servers located in the same geographic location as the first server.
The method according to any one of claims 1 to 7, wherein receiving the data sent by the first server comprises:

Receiving data sent by the first server in real time and recording it in a preset log file;

The data is stored in a preset queue, including:

Extracting the data from the log file and storing it in a preset queue.
A data transmission device includes:

a data receiving module, configured to receive data from the first server to be sent to the second server in a geographic location where the first server is located, where the second server and the first server are located in different geographic locations;

a queue storage module, configured to store the data in a preset queue;

a data sending module, adapted to acquire the data from the queue, and send the data to the second server;

a determining module, configured to determine whether the data is successfully sent to the second server;

When the data transmission fails, the data sending module re-acquires the data from the queue and transmits the data.
The apparatus according to claim 9, further comprising:

And a data deletion module, configured to delete the data from the queue when the data is successfully sent.
The apparatus according to claim 9, wherein

The determining module is further configured to: determine whether a message sent by the second server to notify that the data is successfully sent is received within a preset time period after the data is sent;

If the message is not received within a preset time period after the data is sent, the determining module determines that the data transmission fails;

If the message is received within the preset time period after the data is sent, the determining module determines that the data transmission is successful.
The apparatus according to claim 9, wherein the number of the queues is plural, and the plurality of queues are used for storing data to be sent to the second server for performing various computing tasks;

The queue storage module selects a queue for storing the data from a plurality of the queues according to a calculation task of the data to be used, and stores the data in the selected queue.
The apparatus according to claim 9, further comprising:

a calculation task identification module adapted to identify a calculation to use the data according to an attribute of the data Business.
The apparatus of claim 13, wherein the attributes of the data comprise one or more of a type, a field, and an amount of data of the data.
The apparatus of claim 9, wherein the first server receives the data from a cluster comprising a plurality of third servers located in the same geographic location as the first server.
The apparatus according to any one of claims 9 to 15, further comprising:

a log file recording module, configured to receive data sent by the first server in real time, and record the data in a preset log file;

The queue storage module extracts the data from the log file and stores the data in a preset queue.
A server comprising:

A data transmission device according to any one of claims 9 to 16.
A computer program comprising computer readable code, when said computer readable code is run on a computing device, causing said computing device to perform a data transfer method according to any of claims 1-8.
A computer readable medium storing the computer program of claim 18.