CN108572870B - Data acquisition method, device, electronic equipment, storage medium and system - Google Patents

Abstract

Embodiments of the present invention provide a data acquisition method, device, electronic device, storage medium and system, wherein the method includes: receiving N pass acquisition requests sent by N service servers, and judging whether N is greater than a preset number of passes issued M, when N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain the identification information of the M request sender service servers carried in the M pass obtaining requests; add each pass to M pieces of pass response information; respectively send M pieces of pass response information to the service server corresponding to the identification information of the M request sender service servers, so that each service server obtains the corresponding information according to the pass response information Data to be obtained. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by the service control server, thereby reducing the pressure on the service control server.

Description

A data acquisition method, device, electronic device, storage medium and system

technical field

The present invention relates to the field of communication technologies, and in particular, to a data acquisition method, device, electronic device, storage medium and system.

Background technique

With the rapid development of Internet technology, cloud computing has been widely used as an Internet-based computing method. Among them, the core idea of cloud computing is to manage and schedule a large number of computing resources connected by the network in a unified manner to form a unified resource pool to provide on-demand services to users. Cloud computing is the product of the integration of traditional computer and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage, virtualization, and load balancing.

Through cloud computing, computing can be distributed in a distributed system, and the distributed system can include a service control server and a service server. The service control server is used for unified management and scheduling of computing resources, and the service server is used for executing specific services according to the scheduling instruction of the service control server. In general, the number of service control servers is relatively small, while the number of service servers is relatively large. The service server needs to acquire the required data from the service control server from time to time. When more business servers need to obtain data from the business control server at the same time, and the number of business servers that obtain data is large, it will increase the pressure on the business control server, cause the business control server to run slowly, and eventually cause the business control server to fail in the setting If the data required by the business server is returned within a certain period of time, it may even cause a DDOS (Distributed Denial of Service, Distributed Denial of Service) situation, which will even cause the business control server to be overwhelmed and paralyzed.

In order to avoid the above problems, the following solutions are generally adopted:

Option 1: Avoid all business servers from acquiring data at the same time, and manually control the order in which the business servers acquire data. For example, 1000 service servers are controlled to obtain data in batches, so that the pressure on the service control server is always within the tolerable range of the service control server. However, solution 1 requires operation and maintenance managers to manually control all business servers to obtain data in batches, resulting in low efficiency of business servers to obtain data.

Solution 2: Increase the number of service control servers, so that the service control server can return the data required by the service server to all service servers within a preset time. However, under normal circumstances, the service control server does not need to return the data required by the service server within a preset time at every time point. In order to cope with the situation when more service servers acquire data at the same time, adding service control server nodes will increase the cost, which is not the best solution.

Solution 3: Set different data acquisition times for each service server, so that each service server acquires data from the service control server according to different data acquisition times. Solution 3 seems to prevent all business servers from acquiring the required data from the business control server at the same time. However, when the business servers are frequently added, it is necessary to frequently reset the data acquisition time, which is cumbersome.

It can be seen that the three solutions in the prior art are not the preferred technical solutions to solve the above problems.

SUMMARY OF THE INVENTION

The purpose of the embodiments of the present invention is to provide a data acquisition method, device, electronic device, storage medium and system, so as to automatically limit the number of service servers that acquire data from the service control server at the same time, thereby reducing the pressure on the service control server. The specific technical solutions are as follows:

In a first aspect, an embodiment of the present invention provides a data acquisition method, which is applied to a passport management server, and the method includes:

Receive N pass acquisition requests sent by N business servers, wherein each business server sends a pass acquisition request, each pass acquisition request carries the identification information of the business server of the request sender, and each pass acquisition request belongs to When the request sender business server has data to be obtained, it is sent to the pass management server, and N is an integer greater than or equal to 1;

Determine whether N is greater than the preset number of passes issued M; wherein, M is an integer greater than or equal to 1;

When N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain the identification information of the M request sender service servers carried in the M pass obtaining requests;

adding the pre-stored M passes to the M pass response information respectively;

The M pieces of pass response information are respectively sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information.

Optionally, before receiving N passport acquisition requests sent by N service servers, a data acquisition method according to an embodiment of the present invention further includes:

Receive pass generation instructions;

According to the pass generation instruction, according to the preset number M of passes, generate M passes, and store the M passes.

Optionally, after receiving the pass generation instruction, the data acquisition method according to the embodiment of the present invention further includes:

Determine whether a distributed lock is carried in the pass generation instruction;

Correspondingly, according to the pass generation instruction, according to the preset number M of passes, generate M passes, and store the M passes, including:

When the distributed lock is carried in the pass generation instruction, M passes are generated according to the preset number M of passes, and the M passes are stored.

Optionally, the step of storing the M passes includes:

Add M passes to the preset pass set;

After the M passes are added to the preset pass set, a data acquisition method according to an embodiment of the present invention further includes:

Set the flag state of the preset pass set to the set state;

Correspondingly, each pass obtaining request is sent to the pass management server when each service server has data to be obtained and it is confirmed that the flag state of the preset pass set is set.

In a second aspect, an embodiment of the present invention also provides a data acquisition method, which is applied to a service server, and the method includes:

When there is data to be acquired, send a pass obtaining request to the pass management server, so that the pass management server constructs the pass response information including the pass and sends it to the business server according to the pass obtaining request;

When receiving the pass response information sent by the pass management server, obtain the pass in the pass response information;

Add the passport to the data acquisition request, and send the data acquisition request to the business control server.

Optionally, before sending the pass obtaining request to the pass management server, a data obtaining method according to the embodiment of the present invention further includes:

Obtain the flag status of the pass collection that stores the pass in the pass management server;

Correspondingly, send a pass obtaining request to the pass management server, including:

When the flag state of the pass collection is set, send a pass acquisition request to the pass management server.

Optionally, after storing the marked state of the pass set of the pass in the obtaining pass management server, a data obtaining method according to the embodiment of the present invention further includes:

When the marked state of the pass set is the reset state, send a distributed lock acquisition request to the pass management server;

After receiving the distributed lock response information carrying the distributed lock sent by the pass management server, the distributed lock is added to the pass generation instruction;

Send the pass generation instruction carrying the distributed lock to the pass management server.

Optionally, after sending the pass obtaining request to the pass management server, the data obtaining method according to the embodiment of the present invention further includes:

When the pass response information corresponding to the pass acquisition request is not received, enter sleep according to the first preset sleep time;

After the first preset sleep time expires, the pass acquisition request is repeatedly sent to the pass management server.

Optionally, after the data acquisition request is sent to the service control server, the data acquisition method according to the embodiment of the present invention further includes:

After receiving the data corresponding to the data acquisition request sent by the service control server, send the pass to the pass management server.

In a third aspect, an embodiment of the present invention further provides a data acquisition device, which is applied to a passport management server, and the device includes:

The first receiving module is configured to receive N pass acquisition requests sent by N service servers, wherein each service server sends a pass acquisition request, and each pass acquisition request carries the identification information of the service server of the request sender, Each pass obtaining request is sent to the pass management server when the business server of the request sender to which it belongs has data to be obtained, and N is an integer greater than or equal to 1;

The first judgment module is used for judging whether N is greater than the preset number of passes issued M; wherein, M is an integer greater than or equal to 1;

A selection module, configured to select M passport acquisition requests from the N passport acquisition requests when N is greater than M, and acquire the identification information of the M request sender service servers carried in the M passport acquisition requests;

The adding module is used to add the pre-stored M passes to the M pass response information respectively;

The response module is used for respectively sending M pieces of pass response information to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information.

Optionally, a data acquisition device according to an embodiment of the present invention further includes:

The second receiving module is used for receiving the pass generation instruction;

The storage module is used for generating M passes according to the pass generation instruction and according to the preset number M of passes, and storing the M passes.

Optionally, a data acquisition device according to an embodiment of the present invention further includes:

The second judgment module is used for judging whether a distributed lock is carried in the pass generation instruction;

Correspondingly, the storage module is specifically used for:

When the distributed lock is carried in the pass generation instruction, M passes are generated according to the preset number M of passes, and the M passes are stored.

Optional, storage module, specifically for:

Add M passes to the preset pass set;

Correspondingly, a data acquisition device according to an embodiment of the present invention further includes:

The mark state setting module is used to set the mark state of the preset pass set to the set state;

Correspondingly, each pass obtaining request is sent to the pass management server when each service server has data to be obtained and it is confirmed that the flag state of the preset pass set is set.

In a fourth aspect, an embodiment of the present invention further provides a data acquisition device, which is applied to a service server, and the device includes:

The first sending module is configured to send a pass obtaining request to the pass management server when there is data to be obtained, so that the pass management server constructs the pass response information including the pass and sends it to the service server according to the pass obtaining request;

a first receiving module, configured to acquire the pass in the pass response information when receiving the pass response information sent by the pass management server;

The second sending module is used to add the passport to the data acquisition request, and send the data acquisition request to the service control server.

Optionally, a data acquisition device according to an embodiment of the present invention further includes:

The mark state obtaining module is used to obtain the mark state of the pass set storing the pass in the pass management server;

Correspondingly, the first sending module is specifically used for:

When the flag state of the pass collection is set, send a pass acquisition request to the pass management server.

Optionally, a data acquisition device according to an embodiment of the present invention further includes:

a third sending module, configured to send a distributed lock acquisition request to the pass management server when the marked state of the pass set is the reset state;

The second receiving module is configured to add the distributed lock to the pass generation instruction after receiving the distributed lock response information carrying the distributed lock sent by the pass management server;

The fourth sending module is used for sending the pass generation instruction carrying the distributed lock to the pass management server.

Optionally, a data acquisition device according to an embodiment of the present invention further includes:

The sleep setting module is configured to enter sleep according to the first preset sleep time when the pass response information corresponding to the pass acquisition request is not received; after the end of the first preset sleep time, trigger the first sending module.

Optionally, a data acquisition device according to an embodiment of the present invention further includes:

The fifth sending module is configured to send the pass to the pass management server after receiving the data corresponding to the data acquisition request sent by the service control server.

In a fifth aspect, an embodiment of the present invention further provides a pass management server, including a processor and a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions that can be executed by the processor, and the processor is Executing the instruction prompts: implementing the steps of the data acquisition method provided by the first aspect.

In a sixth aspect, an embodiment of the present invention further provides a service server, including a processor and a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions that can be executed by the processor, and the processor is executable by the machine The instructions cause: the steps of implementing a data acquisition method provided by the second aspect.

In a seventh aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the data acquisition method provided in the first aspect is implemented. step.

In an eighth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the data acquisition method provided in the second aspect is implemented. step.

In a ninth aspect, an embodiment of the present invention further provides a computer program product including instructions, which, when running on a computer, cause the computer to execute the steps of the data acquisition method provided in the first aspect.

In a tenth aspect, an embodiment of the present invention further provides a computer program product including instructions, which, when running on a computer, cause the computer to execute the steps of the data acquisition method provided in the second aspect above.

In an eleventh aspect, an embodiment of the present invention further provides a computer program, which, when running on a computer, causes the computer to execute the steps of the data acquisition method provided in the first aspect.

In a twelfth aspect, an embodiment of the present invention further provides a computer program that, when running on a computer, causes the computer to execute the steps of the data acquisition method provided in the second aspect.

In a thirteenth aspect, an embodiment of the present invention further provides a data acquisition system, the system comprising: a pass management server, a service server, and a service control server;

a business server, configured to send a pass obtaining request to a pass management server when there is data to be obtained, wherein the business server includes N, and N is an integer greater than or equal to 1;

The pass management server is used to receive N pass acquisition requests sent by N service servers, determine whether N is greater than the preset pass issuance quantity M, and when N is greater than M, select M pass acquisition requests from the N pass acquisition requests, and obtain the identification information of the M service servers carried in the M pass acquisition requests, add the pre-stored M passes to the M pass response information respectively, and send the M pass response information respectively to the M requests to which they belong. The service server corresponding to the identification information of the sender's service server, wherein each pass obtaining request carries the identification information of the corresponding request sender's service server, and M is an integer greater than or equal to 1;

The business server is further configured to obtain the pass in the pass response information when receiving the pass response information sent by the pass management server, add the pass in the pass response information to the data acquisition request, and send the data acquisition request to the business control server ;

The service control server is configured to receive the data acquisition request sent by the service server, and send the data to be acquired corresponding to the data acquisition request to the service server.

In a data acquisition method, device, electronic device, storage medium, and system provided by an embodiment of the present invention, after receiving N pass acquisition requests sent by N service servers, it is determined whether N is greater than a preset number M of passes issued, and in When N is greater than M, select M pass obtaining requests from the N pass obtaining requests, then obtain the identification information of the M service servers carried in the M pass obtaining requests, and then add the pre-stored M passes to the M passes respectively. In the pass response information, M pieces of pass response information are finally sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server. Of course, it is not necessary for any product or method of the present invention to achieve all of the above-mentioned advantages at the same time.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

1 is a schematic diagram of a system in which a data acquisition method according to an embodiment of the present invention is applied to a distributed system;

2 is a flowchart of a first implementation manner in which a data acquisition method according to an embodiment of the present invention is applied to a passport management server;

FIG. 3 is a flowchart of a first implementation manner in which a data acquisition method according to an embodiment of the present invention is applied to a service server;

4 is a schematic structural diagram of a data acquisition device applied to a passport management server according to an embodiment of the present invention;

5 is a schematic structural diagram of a data acquisition apparatus applied to a service server according to an embodiment of the present invention;

6 is a schematic structural diagram of a pass management server according to an embodiment of the present invention;

7 is a schematic structural diagram of a service server according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a data acquisition system according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

In order to solve the problems existing in the prior art, the embodiments of the present invention provide a data acquisition method, device, electronic device, storage medium and system, so as to automatically limit the number of service servers that simultaneously acquire the data required by themselves from the service control server , thereby reducing the pressure on the service control server.

First, a data acquisition method according to an embodiment of the present invention can be applied to a distributed system. As shown in FIG. 1 , it is a schematic diagram of a system in which a data acquisition method according to an embodiment of the present invention is applied to a distributed system. It includes: the pass management server 101, the service control server 102, the first service server 103, the second service server 104 and the third service server 105, wherein the line segment 106 may represent the communication line between the service server and the pass management server 101, and the line segment 107 may The communication line between the service server and the service control server 102 is shown.

In this system, the first service server 103 , the second service server 104 and the third service server 105 may first obtain the passport from the passport management server 101 before sending the data acquisition request to the service control server 102 . After obtaining the pass from the pass management server 101 , the data acquisition request is sent to the service control server 102 . When the pass is not obtained from the pass management server 101 , the data acquisition request is not sent to the service control server 102 . Thereby, the number of service servers that simultaneously obtain the data required by themselves from the service control server is automatically limited, and the pressure on the service control server is reduced. For example, after acquiring the pass from the pass management server 101 , the first service server 103 may send a data acquisition request to the service control server 102 . The second service server 104 does not obtain a pass from the pass management server 101 , and does not send a data acquisition request to the service control server 102 .

Next, a data acquisition method according to an embodiment of the present invention is introduced. As shown in FIG. 2 , a flowchart of a first implementation manner in which a data acquisition method according to an embodiment of the present invention is applied to a passport management server, the method may include :

S201: Receive N passport acquisition requests sent by N service servers.

Among them, each service server sends a pass acquisition request, each pass acquisition request carries the identification information of the request sender business server to which it belongs, and each pass pass acquisition request belongs to the request sender business server when there is data to be acquired, it is sent to Sent by the passport management server, N is an integer greater than or equal to 1, and the identification information may be the IP address, MAC address, etc. of the service server.

Specifically, before the service server obtains the data to be obtained from the service control server, it may first send a pass obtaining request to the pass management server to obtain the pass. Therefore, in this step, a pass management server applying a data acquisition method according to an embodiment of the present invention may receive N pass acquisition requests sent by N service servers.

In some examples, the above-mentioned service server may be a virtual server implemented by a virtual technology on a physical server, and each virtual server may have independent identification information.

In some examples, the above-mentioned service servers may also be physical servers, and each physical server may have different identification information.

In some examples, the service server may also be loaded with a virtual switch or a virtual router.

In still other examples, a part of the above N service servers may be virtual servers and the other part may be physical servers.

For example, the first service server 103, the second service server 104, and the third service server 105 shown in FIG. 1 may all be virtual servers or all physical servers; they may also be any two of the three service servers. The server is a virtual server, or any one of the three service servers is a virtual server.

Specifically, the pass management server applying the data acquisition method according to the embodiment of the present invention may count the number of pass acquisition requests after receiving N pass acquisition requests sent by N service servers.

S202, judging whether N is greater than the preset number M of passes issued.

Wherein, M is an integer greater than or equal to 1, and the preset number of passes issued may be set according to experience, or may be set according to the performance of the service control server.

Specifically, after receiving N pass acquisition requests through the above steps, it is possible to determine the size relationship between N and the preset number of passes issued M, that is, to determine whether N is greater than the preset number of passes issued M, or less than or equal to the preset number of passes Issue quantity M.

In some examples, by presetting the number of passes issued in the pass management server to which the data acquisition method according to the embodiment of the present invention is applied, the number of service servers that obtain passes from the pass management server can be limited, thereby reducing the simultaneous sending of data acquisition requests The number of business servers is reduced, and the pressure on business control servers is reduced.

In other examples, the preset number of passes issued in this step may be preset by the service control server. Specifically, the service control server may send a setting instruction carrying the number M of passes issued to the pass management server in advance. After receiving the setting instruction, the pass management server may obtain the number M of passes issued from the setting instruction, and record the pass Issue quantity M.

S203, when N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain identification information of M request sender service servers carried in the M pass obtaining requests.

Specifically, after judging whether N is greater than M through the above steps, a data acquisition method according to an embodiment of the present invention provides a feasible implementation manner: when N is greater than M, first select M from N pass acquisition requests Pass acquisition request.

In some examples, when M pass acquisition requests are selected from N pass acquisition requests, the M pass acquisition requests may be randomly selected.

In some examples, after receiving N pass acquisition requests sent by N service servers through step S201, an identification number may also be generated for each pass acquisition request. Therefore, in this step, from the N pass acquisition requests When selecting M pass acquisition requests from among the ID numbers, the M pass acquisition requests may be selected in descending order of the identification number, or in descending order.

In still other examples, after selecting the M pass obtaining requests, the identification information of the M service servers carried in the M pass obtaining requests may be obtained. Through this step, the pass management server applying the data acquisition method of the embodiment of the present invention can only obtain the identification information of M service servers, thereby reducing the number of identification information obtained by the pass management server, thereby reducing the workload of the pass management server.

S204, adding the pre-stored M passes to the M pieces of pass response information respectively.

The pre-stored M passes may be pre-generated and stored by a pass management server applying a data acquisition method according to an embodiment of the present invention.

In some examples, the M passes in this step may be pre-generated and stored by a pass management server applying a data acquisition method according to an embodiment of the present invention. By generating and storing in advance, the time overhead for the service server to obtain the pass can be reduced, so that the service server can send a data obtaining request to the service control server in time to obtain the data to be obtained.

In some examples, after selecting M pass acquisition requests through the above steps, the generation of pass response information may be triggered. In this step, the pre-stored M passes may be added to the M pass response information respectively to M pieces of pass response information carrying M passes are generated, wherein one pass response message carries one pass.

Through this step, each pass response information can only carry one pass, and after obtaining the pass response information through the subsequent steps, the service server can only send a data acquisition request through the one pass. Prevent the business server from sending multiple data acquisition requests after acquiring the pass response information once. Thus, the pressure on the service control server can be reduced.

S205: Send M pieces of pass response information to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information.

After obtaining the identification information of M service servers through the above steps, and obtaining M pieces of pass response information, in order to enable the service server to obtain the data to be obtained from the service control server through the pass. In this step, M pieces of pass response information may be respectively sent to the service servers corresponding to the identification information of the M request sender service servers to which they belong. Each service server can obtain a passport response message.

In some examples, M pieces of pass response information may be sequentially sent to the service servers corresponding to the identification information of the M request sender service servers to which they belong. It can reduce the instantaneous bandwidth usage of the pass management server.

In some examples, M pieces of pass response information may be respectively sent to the service servers corresponding to the identification information of the M request-sender service servers to which they belong. The time for sending the pass response information can be reduced, so that the service server can obtain the communication pass response information in time, and then can obtain the data to be obtained according to the pass response information.

With a data acquisition method provided by an embodiment of the present invention, after receiving N pass acquisition requests sent by N service servers, it is determined whether N is greater than the preset number M of passes issued, and when N is greater than M, the number of passes from the N passes is determined. In the acquisition request, select M passport acquisition requests, then acquire the identification information of the M service servers carried in the M passport acquisition requests, and then add the pre-stored M passports to the M passport response information respectively, and finally send M respectively. The pieces of pass response information are sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server.

In a possible implementation manner of the embodiment of the present invention, the service server may apply a data acquisition method of the embodiment of the present invention in the startup phase, firstly send a pass acquisition request, and then apply the data acquisition method of the embodiment of the present invention The pass management server of the method, after receiving the pass acquisition request, the pass management server can send the pass response information to the business server through the first implementation of a data acquisition method according to the embodiment of the present invention, and the business server is receiving the pass. After the corresponding information of the pass is obtained, the pass is obtained from the corresponding information of the pass, and then the data to be obtained is obtained from the service control server according to the pass.

Specifically, the pass can be a distributed lock. When the pass is a distributed lock, the distributed lock may be pre-stored in a pass management server to which the data acquisition method of the embodiment of the present invention is applied.

It should be understood that, as a distributed lock for a pass, a plurality of distributed locks can be generated by the above-mentioned pass management server through a plurality of distributed lock generating applications, and stored locally on the pass management server.

In some examples, the pass may also be a token. When the pass is a token, the embodiment of the present invention also provides a possible implementation manner, before receiving N pass acquisition requests sent by N service servers, It is also possible to receive a pass generation instruction, and then generate M passes according to the pass generation instruction, and store them.

Specifically, in S201, before receiving N passport acquisition requests sent by N service servers, a data acquisition method according to an embodiment of the present invention may further include:

S2010, receive a pass generation instruction.

In some examples, the pass generation instruction may be sent by the service control server, eg, in FIG. 1 , the pass generation instruction may be sent by the service control server 102 . Specifically, the service control server can store the identification information of the pass management server. After the service control server generates the pass generation instruction, the identification information of the pass management server can be added to the pass generation instruction and sent to the pass management server.

In some examples, the pass generation instruction may also be sent by the service server. Specifically, before sending the pass obtaining request, the business server may first send the pass generating instruction, so that the pass management server generates the pass according to the pass generating instruction, and then sends the pass obtaining request. In this way, it can be ensured that N service servers send N After the pass obtaining request, a part of the service servers in the N service servers can obtain the pass returned by the pass management server.

S2011 , according to the pass generation instruction, and according to the preset number M of passes, generate M passes, and store the M passes.

In some examples, a pass management server applying a data acquisition method according to an embodiment of the present invention may trigger a corresponding application to generate a pass after receiving the pass generation instruction.

Specifically, M passes may be generated according to the preset number M of passes, and the M passes may be stored in the pass management server.

In some examples, the M passes may be stored in a database of the pass management server.

In this step, by generating M passes, the number of service servers that obtain the passes can be limited, thereby limiting the number of sending data acquisition requests to the service control server, thereby reducing the pressure on the service control server.

In some examples, the above-mentioned implementation manner can be applied to the case where there is only one service control server. When there are multiple service control servers, there may be multiple service control servers sending multiple pass generation instructions to the pass management server, thereby causing the pass management server to generate passes according to the multiple pass generation instructions, affecting the efficiency of the pass management server.

In a possible implementation manner of the embodiment of the present invention, the pass management server receives multiple pass generation instructions sent by multiple service control servers, in order to prevent the pass management server from receiving multiple pass generation instructions according to the Multiple pass generation instructions repeatedly generate a pass, and the embodiment of the present invention also provides a possible implementation manner. After receiving the pass generation instruction, a data acquisition method according to the embodiment of the present invention may further include:

Determine whether a distributed lock is carried in the pass generation instruction.

In some examples, a pass management server applying a data acquisition method according to an embodiment of the present invention may receive multiple pass generation instructions, and when the pass management server receives multiple pass generation instructions, it can determine the multiple Whether a distributed lock is carried in the pass generation instruction, it can be determined, according to which pass generation instruction among the plurality of pass generation instructions, the pass is generated.

In some examples, a pass management server applying a data acquisition method according to an embodiment of the present invention may, after receiving only one pass generation instruction, determine whether the pass generation instruction carries a distributed lock, and determine whether the pass The generate instruction generates a pass.

By judging whether a distributed lock is carried in the pass generation instruction, the above-mentioned pass management server can only generate the pass according to the pass generation instruction carrying the distributed lock, which can avoid the repetition of the generation instructions according to multiple passes that do not carry the distributed lock. Generate passports to avoid wasting resources of the passport management server.

Correspondingly, after judging whether a distributed lock is carried in the pass generation instruction, in the above steps, according to the pass generation instruction, according to the preset number of passes M, generate M passes, and store the M passes, which may include:

When the distributed lock is carried in the pass generation instruction, M passes are generated according to the preset number M of passes, and the M passes are stored.

Specifically, after judging whether a distributed lock is carried in the pass generation instruction, the pass management server applying the data acquisition method according to the embodiment of the present invention can issue the pass according to the preset after determining that the distributed lock is carried in the pass generation instruction M number of passes is generated, and the M passes are stored in the database of the pass management server.

In a possible application scenario of the embodiment of the present invention, the pass generation instruction may be sent by the service server, and when the pass generation instruction is sent by the service server, it may also be determined whether the pass generation instruction sent by the service server carries the distribution lock.

In some examples, there is only one pass generation instruction that carries a distributed lock.

Through the above steps, it can be ensured that the pass management server generates a pass only according to one pass generation instruction, so as to avoid the pass management server from receiving multiple pass generation instructions sent by multiple service control servers, and improve the efficiency of the pass management server.

In another possible implementation manner of the embodiment of the present invention, when storing M passes, the M passes may be added to a preset pass set for storage.

Wherein, the preset pass set may be preset in the pass management server.

By adding the M passes to the preset pass set for storage, it is convenient for the pass management server to manage the M passes.

In some examples, after the M passes are added to the preset pass set, a data acquisition method according to an embodiment of the present invention also provides a possible implementation method, and the method may include:

Sets the flag state of the preset pass collection to the set state.

In some examples, when the preset pass set is preset, a flag state may be set for the preset pass set. For example, when no pass is stored in the preset pass set, the flag state is a reset state, and in this When a pass is stored in the preset pass set, the flag state is the set state.

In some examples, the set state and reset state may be represented by "1" and "0" in binary numbers, respectively, eg, the set state is represented by a "1" and the reset state is represented by a "0".

In some examples, each pass acquisition request is sent to the pass management server when each service server has data to be acquired and it is confirmed that the flag state of the preset pass set is set.

By setting the mark state of the preset pass set to the set state, the service server can first check the mark state of the preset pass set before sending the pass acquisition request, so as to determine whether the pass is stored in the preset pass set. The problem that all business servers cannot obtain the passport after sending the request for obtaining the passport.

An embodiment of the present invention also provides a data acquisition method, which is applied to a service server. As shown in FIG. 3 , it is a flowchart of the first implementation manner of applying the data acquisition method of the embodiment of the present invention to a service server. Methods can include:

S301, when there is data to be acquired, send a pass obtaining request to the pass management server, so that the pass management server constructs the pass response information including the pass and sends it to the service server according to the pass obtaining request.

In some examples, in order to limit the number of service servers that simultaneously send data acquisition requests to the service control server, before the service server acquires data to be acquired from the service control server, it may first send a pass acquisition request to the pass management server.

Specifically, the business server may store the identification information of the pass management server, and before acquiring the data to be acquired from the business control server, a pass acquisition request carrying the identification information of the pass management server may be generated, and then the pass acquisition request is sent. Request to pass management server.

In some examples, the pass acquisition request may also carry the identification information of the service server, so that the pass management server, when sending the pass response information corresponding to the pass acquisition request, can correctly send it to the service server corresponding to the identification information. business server.

S302, when the passport response information sent by the passport management server is received, obtain the passport in the passport response information.

In some examples, the number of service servers that send the pass acquisition request may be multiple. In order to limit the number of service servers that simultaneously send the data acquisition request to the service control server, the number of the pass response information carrying the pass sent by the pass management server , which may be less than the number of business servers that send the pass obtaining request. Therefore, among the multiple business servers that send the pass obtaining request, some business servers may receive the pass response information, and some business servers may not receive the pass response information. .

When the service server receives the pass response information sent by the pass management server, it can obtain the carried pass from the pass response information. In the subsequent steps, a data acquisition request is sent to the service control server through the pass to acquire the data to be acquired.

S303, add the passport to the data acquisition request, and send the data acquisition request to the service control server.

In some examples, when a service server applying a data acquisition method according to an embodiment of the present invention receives the pass response information sent by the pass management server and obtains the pass, it can call a corresponding application to generate a data acquisition request.

Specifically, when the data acquisition request is generated, the pass can be added to the data acquisition request, and then the data acquisition request can be sent to the service control server.

In some examples, the service server may also store identification information of the service control server, and when generating the data acquisition request, the identification information of the service control server may also be added to the data acquisition request and sent to the service control server .

With the data acquisition method according to the embodiment of the present invention, before sending the data acquisition request, the service server can first send the pass acquisition request, and after the service server receives the pass corresponding information sent by the pass management server and corresponding to the pass acquisition request, it can send the request from the service server. The passport is obtained from the passport response information, and then according to the passport, a data acquisition request is sent to the service control server to acquire the data to be acquired. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server.

When the pass in the pass management server is stored in the preset pass set, and the flag state of the preset pass set is set as the set state, corresponding to the pass management server applying the data acquisition method according to the embodiment of the present invention, the application The service server of the data acquisition method according to the embodiment of the present invention may also acquire the flag state of the passport set storing the passport in the passport management server before sending the passport acquisition request to the passport management server.

In some examples, the service server may send a tag status acquisition request to the pass management server, and after receiving the tag status acquisition request, the pass management server may acquire the tag status of the local pass set, and then generate a tag status response information, and send the mark status response to the service server, therefore, the business server can receive the mark status response information sent by the above-mentioned pass management server, and can judge the pass set stored in the above-mentioned pass management server according to the mark status response information. The flag state is either a set state or a reset state.

Correspondingly, a service server applying a data acquisition method according to an embodiment of the present invention can send a pass acquisition request to a pass management server when the flag state of the pass set is set.

In some examples, when the above-mentioned service server obtains the marked state of the pass set storing the pass in the pass management server, and the marked state of the pass set is the reset state, the embodiment of the present invention also provides a possible implementation method. , the method can include:

Step A, when the marked state of the pass set is the reset state, send a distributed lock acquisition request to the pass management server.

In some examples, when the above-mentioned business server, in the pass acquisition management server, stores the mark state of the pass set of the pass, and determines that the mark state is the reset state, it can call the corresponding application program to generate a distributed lock acquisition request, The distributed lock acquisition request is then sent to the pass management server. Wherein, the distributed lock may be pre-stored in the pass management server, and there may be only one distributed lock.

In some examples, when the distributed lock acquisition request is generated, the identification information of the pass management server may also be added to the distributed lock acquisition request.

Step B, after receiving the distributed lock response information carrying the distributed lock sent by the pass management server, adding the distributed lock to the pass generation instruction.

In some examples, there may be multiple above-mentioned business servers that send distributed lock acquisition requests. For example, the first service server 103, the second service server 104, and the third service server 105 shown in FIG. 1 can all send a distributed lock acquisition request to the above-mentioned pass management server. When the above-mentioned pass management server, after receiving distributed lock acquisition requests sent by multiple business servers, can randomly select a distributed lock acquisition request sent by a business server, and generate a distributed lock response corresponding to the distributed lock acquisition request information, and send the distributed lock response information to the service server corresponding to the distributed lock acquisition request.

Step C, sending the pass generation instruction carrying the distributed lock to the pass management server.

In some examples, after receiving the distributed lock response information sent by the above-mentioned pass management server, the business server that sends the distributed lock acquisition request can acquire the distributed lock in the distributed lock response information, and trigger the generation of the pass. instruction.

Specifically, when the pass generation instruction is generated, the distributed lock and the identification information of the service server may be added to the pass generation instruction and sent to the pass management server.

It should be understood that, in the pass management server applying the data acquisition method of the embodiment of the present invention, two distributed locks can be managed, and the first distributed lock is used for receiving the first distributed lock. When acquiring the request, return a distributed lock response message carrying the first type of distributed lock, so that the business server can send a pass carrying the first type of distributed lock after acquiring the first type of distributed lock Generate an instruction to the above-mentioned pass management server. The above-mentioned pass management server can also manage a second distributed lock, and the second kind of distributed lock can be generated by the above-mentioned pass management server after receiving the pass generation instruction through a plurality of distributed lock generation applications. , and stored locally on the Pass Management Server.

Through a data acquisition method according to the embodiment of the present invention, when a passport is stored in the passport collection of the above-mentioned passport management server, the service server sends a passport acquisition request, thereby reducing the number of times the service server sends a passport acquisition request and avoiding the management of passports. Server bandwidth is unnecessarily wasted.

In some examples, when the service server does not receive the pass response information, the embodiment of the present invention also provides a possible implementation manner. In S301, when there is data to be acquired, after sending a pass acquisition request to the pass management server, A data acquisition method according to an embodiment of the present invention may further include:

S304, when no pass response information corresponding to the pass acquisition request is received, enter sleep according to the first preset sleep time.

In some examples, a first preset sleep time may be preset for each service server, and when the service server does not receive the pass response information corresponding to the pass acquisition request sent by the pass management server, the embodiment of the present invention is applied. The service server of the data acquisition method can enter the sleep state according to the first preset sleep time.

S305, after the first preset sleep time expires, repeatedly send the pass obtaining request to the pass management server.

In some examples, after the above-mentioned service server that has not received the pass response information enters the dormant state, the time when the service server enters the dormant state may be timed, and when the timing ends, the above-mentioned service server that has not received the pass response information , you can send the pass obtaining request to the pass management server again.

Through this step, the service server that has not received the pass response information can be made to enter a dormant state in time, thereby reducing energy consumption.

In a possible implementation manner of the embodiment of the present invention, after the data acquisition request is sent to the service control server, the data acquisition method of the embodiment of the present invention may further include:

After receiving the data corresponding to the data acquisition request sent by the service control server, send the pass to the pass management server.

In some examples, after the service server that obtains the pass response information, after receiving the data corresponding to the data obtaining request sent by the service control server, it can send the pass in the obtained pass response information to the pass management server.

In some examples, after the above-mentioned pass management server generates M passes, the total number of the M passes remains unchanged. After the pass management server adds the pre-stored M passes to the M pieces of pass response information, and sends the M pieces of pass response information to the service servers corresponding to the identification information of the M request sender service servers, the The number of passes in the pass management server is zero. At this time, the above-mentioned pass management server does not regenerate the pass, and can wait for the above-mentioned M service servers that have obtained M passes to return the corresponding passes to the pass management server, thereby It can be guaranteed that the total number of passes in the pass management server remains M.

Through this step, the business server of the pass response information can be made to return the obtained pass in time, and the business server that has not obtained the pass response information can also be made to obtain the pass response in time after sending the pass request information again. information, and send a data acquisition request according to the pass in the pass response information to obtain the data to be acquired.

Further, through this step, after the pass is generated, under the condition that the number of service servers and the number of service control servers do not change, it is not necessary to perform the step of generating the pass again, thereby reducing the number of times of generating the pass.

In some examples, when the service server that has obtained the pass response information sends a data acquisition request to the service control server, but fails to acquire the data to be acquired corresponding to the data acquisition request, an abnormal event log can be generated, and the above-mentioned abnormal event log can be generated. The event that the data to be acquired corresponding to the data acquisition request is not acquired is recorded.

Further, the abnormal event record log may also record the time when the data acquisition request is sent to the service control server, the identification information of the service control server, and the like.

An embodiment of the present invention further provides a data acquisition device, which is applied to a passport management server. As shown in FIG. 4 , it is a schematic structural diagram of a data acquisition device according to an embodiment of the present invention applied to a passport management server. The device may include:

The first receiving module 401 is configured to receive N pass acquisition requests sent by N service servers, wherein each service server sends a pass acquisition request, and each pass acquisition request carries the identification information of the service server of the request sender. , each pass acquisition request is sent to the pass management server when the business server of the request sender to which it belongs has data to be acquired, and N is an integer greater than or equal to 1;

The first judging module 402 is used for judging whether N is greater than the preset pass issuance quantity M; wherein, M is an integer greater than or equal to 1;

The selection module 403 is configured to select M passport acquisition requests from the N passport acquisition requests when N is greater than M, and acquire the identification information of the M request sender service servers carried in the M passport acquisition requests;

The adding module 404 is configured to add the pre-stored M passes to the M pass response information respectively;

The response module 405 is configured to send M pieces of pass response information to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information.

With a data acquisition device provided by an embodiment of the present invention, after receiving N pass acquisition requests sent by N service servers, it is determined whether N is greater than the preset number M of passes issued, and when N is greater than M, the number of passes from the N passes is determined. In the acquisition request, select M passport acquisition requests, then acquire the identification information of the M service servers carried in the M passport acquisition requests, and then add the pre-stored M passports to the M passport response information respectively, and finally send M respectively. The pieces of pass response information are sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server.

Specifically, a data acquisition device according to an embodiment of the present invention may further include:

The second receiving module is used for receiving the pass generation instruction;

The storage module is used for generating M passes according to the pass generation instruction and according to the preset number M of passes, and storing the M passes.

Specifically, a data acquisition device according to an embodiment of the present invention may further include:

The second judgment module is used for judging whether a distributed lock is carried in the pass generation instruction;

Correspondingly, the storage module is specifically used for:

When the distributed lock is carried in the pass generation instruction, M passes are generated according to the preset number M of passes, and the M passes are stored.

Specifically, the storage module is specifically used for:

Add M passes to the preset pass set;

Correspondingly, a data acquisition apparatus according to an embodiment of the present invention may further include:

The mark state setting module is used to set the mark state of the preset pass set to the set state;

Correspondingly, each pass obtaining request is sent to the pass management server when each service server has data to be obtained and it is confirmed that the flag state of the preset pass set is set.

An embodiment of the present invention further provides a data acquisition apparatus, which is applied to a service server. As shown in FIG. 5 , it is a schematic structural diagram of a data acquisition apparatus according to an embodiment of the present invention applied to a service server. The apparatus may include:

The first sending module 501 is configured to send a pass obtaining request to the pass management server when there is data to be obtained, so that the pass management server constructs the pass response information including the pass and sends it to the service server according to the pass obtaining request;

The first receiving module 502 is configured to acquire the passport in the passport response information when receiving the passport response information sent by the passport management server;

The second sending module 503 is configured to add the passport to the data acquisition request, and send the data acquisition request to the service control server.

With a data acquisition device according to an embodiment of the present invention, before sending a data acquisition request, a pass acquisition request can be sent first, and after the service server receives the pass corresponding information sent by the pass management server and corresponding to the pass acquisition request, the pass is obtained from the pass. The passport is obtained from the response information, and then according to the passport, a data acquisition request is sent to the service control server to acquire the data to be acquired. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server.

Specifically, a data acquisition device according to an embodiment of the present invention may further include:

The mark state obtaining module is used to obtain the mark state of the pass set storing the pass in the pass management server;

Correspondingly, the first sending module 501 is specifically used for:

When the flag state of the pass collection is set, send a pass acquisition request to the pass management server.

Specifically, a data acquisition device according to an embodiment of the present invention may further include:

a third sending module, configured to send a distributed lock acquisition request to the pass management server when the marked state of the pass set is the reset state;

The second receiving module is configured to add the distributed lock to the pass generation instruction after receiving the distributed lock response information carrying the distributed lock sent by the pass management server;

The fourth sending module is used for sending the pass generation instruction carrying the distributed lock to the pass management server.

Specifically, a data acquisition device according to an embodiment of the present invention may further include:

The sleep setting module is configured to enter sleep according to the first preset sleep time when the pass response information corresponding to the pass acquisition request is not received; after the end of the first preset sleep time, the first sending module 501 is triggered.

Specifically, a data acquisition device according to an embodiment of the present invention may further include:

The fifth sending module is configured to send the pass to the pass management server after receiving the data corresponding to the data acquisition request sent by the service control server.

An embodiment of the present invention also provides a pass management server. As shown in FIG. 6 , it is a schematic structural diagram of a data acquisition method according to an embodiment of the present invention applied to a pass management server. The pass management server may include a processor 601 and a machine A readable storage medium 602 that stores machine-executable instructions that can be executed by a processor 601 that is caused by the machine-executable instructions to perform the following steps:

Receive N passport acquisition requests sent by N service servers;

Determine whether N is greater than the preset number M of passes issued;

When N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain the identification information of the M service servers carried in the M pass obtaining requests;

adding the pre-stored M passes to the M pass response information respectively;

The M pieces of pass response information are respectively sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information.

Through the pass management server provided by the embodiment of the present invention, after receiving N pass acquisition requests sent by N service servers, it is judged whether N is greater than the preset number M of passes issued, and when N is greater than M, the number of passes from the N passes is determined. In the acquisition request, select M passport acquisition requests, then acquire the identification information of the M service servers carried in the M passport acquisition requests, and then add the pre-stored M passports to the M passport response information respectively, and finally send M respectively. The pieces of pass response information are sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server.

An embodiment of the present invention also provides a service server. As shown in FIG. 7 , it is a schematic structural diagram of a data acquisition method according to an embodiment of the present invention applied to a service server. The service server may include a processor 701 and a machine-readable storage. Medium 702, the machine-readable storage medium 702 stores machine-executable instructions executable by the processor 701, the processor 701 being caused by the machine-executable instructions to perform the following steps:

When there is data to be acquired, send a pass obtaining request to the pass management server, so that the pass management server constructs the pass response information including the pass and sends it to the business server according to the pass obtaining request;

When receiving the pass response information sent by the pass management server, obtain the pass in the pass response information;

Add the passport to the data acquisition request, and send the data acquisition request to the business control server.

With a service server according to an embodiment of the present invention, before sending a data acquisition request, a pass acquisition request may be sent first, and after the service server receives the pass corresponding information sent by the pass management server and corresponding to the pass acquisition request, it responds from the pass The passport is obtained from the information, and then according to the passport, a data acquisition request is sent to the service control server to acquire the data to be acquired. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server.

The machine-readable storage medium may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

The above-mentioned processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; may also be a digital signal processor (Digital Signal Processing, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

An embodiment of the present invention also provides a computer-readable storage medium, which is applied to a passport management server, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the following steps are implemented:

Receive N passport acquisition requests sent by N service servers;

Determine whether N is greater than the preset number M of passes issued;

When N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain the identification information of the M service servers carried in the M pass obtaining requests;

adding the pre-stored M passes to the M pass response information respectively;

The M pieces of pass response information are respectively sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information.

Through a computer-readable storage medium provided by an embodiment of the present invention, after receiving N pass acquisition requests sent by N service servers, it is judged whether N is greater than the preset number M of passes issued, and when N is greater than M, from N Select M pass obtaining requests from the pass obtaining requests, then obtain the identification information of the M service servers carried in the M pass obtaining requests, and then add the pre-stored M passes to the M pass response information respectively, and finally respectively Send M pieces of pass response information to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server.

The embodiment of the present invention also provides a computer-readable storage medium, which is applied to a service server, and a computer program is stored in the computer-readable storage medium. When the computer program is executed by the processor, the following method steps are implemented:

When there is data to be acquired, send a pass obtaining request to the pass management server, so that the pass management server constructs the pass response information including the pass and sends it to the business server according to the pass obtaining request;

When receiving the pass response information sent by the pass management server, obtain the pass in the pass response information;

Add the passport to the data acquisition request, and send the data acquisition request to the business control server.

With a computer-readable storage medium according to an embodiment of the present invention, before sending a data acquisition request, a pass acquisition request may be sent first, and after the service server receives the pass corresponding information sent by the pass management server and corresponding to the pass acquisition request, the request is sent from the service server. The passport is obtained from the passport response information, and then according to the passport, a data acquisition request is sent to the service control server to acquire the data to be acquired. Therefore, it is possible to automatically limit the number of service servers that simultaneously obtain data required by themselves from the service control server, thereby reducing the pressure on the service control server.

The embodiment of the present invention also provides a computer program product containing instructions, which is applied to a pass management server, and when it runs on a computer, causes the computer to execute the following steps:

Receive N passport acquisition requests sent by N service servers;

Determine whether N is greater than the preset number M of passes issued;

When N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain the identification information of the M service servers carried in the M pass obtaining requests;

adding the pre-stored M passes to the M pass response information respectively;

The M pieces of pass response information are respectively sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information.

The embodiment of the present invention also provides a computer program product containing instructions, which is applied to a service server, and when it runs on a computer, causes the computer to perform the following steps:

When there is data to be acquired, send a pass obtaining request to the pass management server, so that the pass management server constructs the pass response information including the pass and sends it to the business server according to the pass obtaining request;

When receiving the pass response information sent by the pass management server, obtain the pass in the pass response information;

Add the passport to the data acquisition request, and send the data acquisition request to the business control server.

The embodiment of the present invention also provides a computer program, which is applied to the pass management server, and when it runs on the computer, causes the computer to execute the following steps:

Receive N passport acquisition requests sent by N service servers;

Determine whether N is greater than the preset number M of passes issued;

When N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain the identification information of the M service servers carried in the M pass obtaining requests;

adding the pre-stored M passes to the M pass response information respectively;

The M pieces of pass response information are respectively sent to the service servers corresponding to the identification information of the M request sender service servers, so that each service server obtains the data to be obtained according to the pass response information.

The embodiment of the present invention also provides a computer program, which is applied to the service server, and when it runs on the computer, causes the computer to perform the following steps:

When there is data to be acquired, send a pass obtaining request to the pass management server, so that the pass management server constructs the pass response information including the pass and sends it to the business server according to the pass obtaining request;

When receiving the pass response information sent by the pass management server, obtain the pass in the pass response information;

Add the passport to the data acquisition request, and send the data acquisition request to the business control server.

An embodiment of the present invention also provides a data acquisition system. As shown in FIG. 8, it is a schematic structural diagram of a data acquisition system according to an embodiment of the present invention. The system may include: a pass management server 801, a service server 802, and a service control server 803;

A service server 802, configured to send a pass obtaining request to a pass management server when there is data to be obtained, wherein the service servers include N, and N is an integer greater than or equal to 1;

The pass management server 801 is configured to receive N pass acquisition requests sent by N service servers, determine whether N is greater than the preset number of passes M, and when N is greater than M, select M pass acquisition requests from the N pass acquisition requests , and obtain the identification information of the M service servers carried in the M pass acquisition requests, add the pre-stored M passes to the M pass response information respectively, and send the M pass response information respectively to the corresponding M The service server corresponding to the identification information of the service server of the request sender, wherein each pass acquisition request carries the identification information of the service server of the request sender to which it belongs, and M is an integer greater than or equal to 1;

The service server 802 is further configured to obtain the passport in the passport response information when receiving the passport response information sent by the passport management server, add the passport in the passport response information to the data acquisition request, and send the data acquisition request to the service control server;

The service control server 803 is configured to receive the data acquisition request sent by the service server, and send the data to be acquired corresponding to the data acquisition request to the service server.

Through a data acquisition system according to an embodiment of the present invention, the pass management server can select M passes, and generate M pass response messages when the number N of pass acquisition requests sent by N service servers is greater than the preset pass issuance number M, It is returned to the M service servers, so that M service servers in the N service servers can obtain the passport from the received passport response information, and send a data acquisition request through the passport, and obtain the data to be acquired from the service control server, It is possible to automatically limit the number of service servers that acquire the data required by themselves from the service control server at the same time, thereby reducing the pressure on the service control server.

It should be noted that, in this document, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any relationship between these entities or operations. any such actual relationship or sequence exists. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

Each embodiment in this specification is described in a related manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, as for the system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for related parts, please refer to the partial descriptions of the method embodiments.

The above are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims (23)

1. a data acquisition method, is characterized in that, is applied to the passport management server, and described method comprises: Receive N pass acquisition requests sent by N service servers, wherein each service server sends a pass acquisition request, and each pass acquisition request carries the identification information of the service server of the request sender, and each pass The acquisition request is sent to the pass management server when there is data to be acquired in the service server of the request sender, the N is an integer greater than or equal to 1, and the service server is on a physical server, through the virtual technology The implemented virtual server, the physical server is provided with a plurality of the business servers; Determine whether N is greater than the preset number of passes issued M; wherein, the M is an integer greater than or equal to 1; When N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain the identification information of the M request sender service servers carried in the M pass obtaining requests; adding the pre-stored M passes to the M pass response information respectively; Send the M pass response information to the service servers corresponding to the identification information of the M request sender service servers, so that when each service server receives the pass response information sent by the pass management server, Acquire the pass in the pass response information, add the acquired pass to the data acquisition request, and send the data acquisition request to the service control server to acquire the data to be acquired. 2. The method according to claim 1, characterized in that, before receiving N passport acquisition requests sent by N service servers, the method further comprises: Receive pass generation instructions; According to the pass generation instruction, M passes are generated according to the preset number M of passes, and the M passes are stored. 3. The method according to claim 2, characterized in that, after receiving the pass generation instruction, the method further comprises: Determine whether the pass generation instruction carries a distributed lock; Correspondingly, according to the pass generation instruction, according to the preset number M of passes, generate M passes, and store the M passes, including: When the distributed lock is carried in the pass generation instruction, M passes are generated according to the preset number M of passes, and the M passes are stored. 4. The method according to claim 2 or 3, wherein the step of storing the M passes comprises: adding the M passes to a preset set of passes; After the adding the M passes to the preset pass set, the method further includes: setting the marked state of the preset pass set as a set state; Correspondingly, each pass obtaining request is sent to the pass management server when each service server has data to be obtained and the flag state of the preset pass set is confirmed to be set. 5. A data acquisition method, characterized in that, applied to a service server, the method comprising: When there is data to be acquired, send a pass obtaining request to the pass management server, so that the pass management server, when receiving N pass obtaining requests sent by N service servers, judges whether N is greater than the preset number of passes M is issued, And when N is greater than M, select M pass obtaining requests from the N pass obtaining requests, and obtain the identification information of the M request sender service servers carried in the M pass obtaining requests; The stored M passports are respectively added to the M passport response messages; the M passport response messages are respectively sent to the service servers corresponding to the identification information of the M request sender service servers to which they belong, wherein the service The server is a virtual server implemented by virtual technology on a physical server, and a plurality of the service servers are set on the physical server; When receiving the pass response information sent by the pass management server, obtain the pass in the pass response information; The pass is added to the data acquisition request, and the data acquisition request is sent to the service control server. 6. The method according to claim 5, wherein before the sending the pass obtaining request to the pass management server, the method further comprises: Acquire the mark state of the pass set of the pass that is stored in the pass management server; Correspondingly, the sending the pass obtaining request to the pass management server includes: When the flag state of the pass set is the set state, a pass acquisition request is sent to the pass management server. 7. The method according to claim 6, characterized in that, after storing the marked state of the pass set of the pass in the acquiring the pass management server, the method further comprises: When the marked state of the pass set is the reset state, sending a distributed lock acquisition request to the pass management server; After receiving the distributed lock response information carrying the distributed lock sent by the pass management server, adding the distributed lock to the pass generation instruction; Send a pass generation instruction carrying the distributed lock to the pass management server. 8. The method according to claim 5, wherein after sending the pass obtaining request to the pass management server, the method further comprises: When the pass response information corresponding to the pass acquisition request is not received, enter sleep according to the first preset sleep time; After the first preset sleep time expires, the pass acquisition request is repeatedly sent to the pass management server. 9. The method according to claim 5, wherein after the sending the data acquisition request to the service control server, the method further comprises: After receiving the data corresponding to the data acquisition request sent by the service control server, the pass is sent to the pass management server. 10. A data acquisition device, characterized in that, applied to a passport management server, the device comprising: The first receiving module is configured to receive N pass acquisition requests sent by N service servers, wherein each service server sends a pass acquisition request, and each pass acquisition request carries the identity of the service server of the request sender Information, each of the pass acquisition requests is sent to the pass management server when the business server of the request sender to which it belongs has data to be obtained, the N is an integer greater than or equal to 1, and the business server is in a On the physical server, a virtual server realized by virtual technology, and the physical server is provided with a plurality of the business servers; The first judgment module is used for judging whether N is greater than the preset pass issuance quantity M; wherein, the M is an integer greater than or equal to 1; A selection module, configured to select M pass obtaining requests from the N pass obtaining requests when N is greater than M, and obtain the identifiers of the M request sender service servers carried in the M pass obtaining requests information; The adding module is used to add the pre-stored M passes to the M pass response information respectively; The response module is used to respectively send the M pieces of pass response information to the service servers corresponding to the identification information of the M request sender service servers to which they belong, so that each service server receives the information sent by the pass management server. When the pass response information is obtained, the pass in the pass response information is obtained, the obtained pass is added to the data acquisition request, and the data acquisition request is sent to the service control server to acquire the data to be acquired. 11. The apparatus of claim 10, wherein the apparatus further comprises: The second receiving module is used for receiving the pass generation instruction; The storage module is configured to generate M passes according to the pass generation instruction and according to the preset number M of passes, and store the M passes. 12. The apparatus of claim 11, wherein the apparatus further comprises: a second judging module, configured to judge whether the pass generation instruction carries a distributed lock; Correspondingly, the storage module is specifically used for: When the distributed lock is carried in the pass generation instruction, M passes are generated according to the preset number M of passes, and the M passes are stored. 13. The device according to claim 11 or 12, wherein the storage module is specifically used for: adding the M passes to a preset set of passes; Correspondingly, the device further includes: a mark state setting module, configured to set the mark state of the preset pass set to a set state; Correspondingly, each pass obtaining request is sent to the pass management server when each service server has data to be obtained and the flag state of the preset pass set is confirmed to be set. 14. A data acquisition device, characterized in that, applied to a service server, the device comprising: The first sending module is configured to send a pass obtaining request to the pass management server when there is data to be obtained, so that the pass management server, when receiving N pass obtaining requests sent by N service servers, judges whether N is greater than or equal to Preset the number M of passport issuances, and when N is greater than M, select M passport acquisition requests from the N passport acquisition requests, and acquire the M request sender services carried in the M passport acquisition requests The identification information of the server; adding the pre-stored M passes to the M pass response information respectively; respectively sending the M pass response information to the service corresponding to the identification information of the M request sender service servers to which they belong A server, wherein the service server is a virtual server implemented by a virtual technology on a physical server, and a plurality of the service servers are set on the physical server; a first receiving module, configured to acquire the pass in the pass response information when receiving the pass response information sent by the pass management server; The second sending module is configured to add the pass to the data acquisition request, and send the data acquisition request to the service control server. 15. The apparatus of claim 14, wherein the apparatus further comprises: a mark state obtaining module, configured to obtain the mark state of the pass set storing the pass in the pass management server; Correspondingly, the first sending module is specifically used for: When the flag state of the pass set is the set state, a pass acquisition request is sent to the pass management server. 16. The apparatus of claim 15, wherein the apparatus further comprises: a third sending module, configured to send a distributed lock acquisition request to the pass management server when the marked state of the pass set is a reset state; The second receiving module is configured to add the distributed lock to the pass generation instruction after receiving the distributed lock response information carrying the distributed lock sent by the pass management server; The fourth sending module is configured to send the pass generation instruction carrying the distributed lock to the pass management server. 17. The apparatus of claim 14, wherein the apparatus further comprises: a sleep setting module, configured to enter sleep according to a first preset sleep time when the pass response information corresponding to the pass acquisition request is not received; after the end of the first preset sleep time, trigger the first sending module . 18. The apparatus of claim 14, wherein the apparatus further comprises: The fifth sending module is configured to send the pass to the pass management server after receiving the data corresponding to the data acquisition request sent by the service control server. 19. A pass management server, characterized by comprising a processor and a machine-readable storage medium, wherein the machine-readable storage medium stores machine-executable instructions executable by the processor, and the processor is executed by the processor. The machine-executable instructions cause: implementing the method steps of any one of claims 1-4. 20. A service server, comprising a processor and a machine-readable storage medium, wherein the machine-readable storage medium stores machine-executable instructions that can be executed by the processor, and the processor is executed by the processor. Machine-executable instructions cause to implement the method steps of any of claims 5-9. 21. A computer-readable storage medium, characterized in that it is applied to a passport management server, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, any one of claims 1 to 4 can be realized. The method steps of a. 22. A computer-readable storage medium, characterized in that, when applied to a service server, a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, any one of claims 5 to 9 is implemented. The method steps described in item. 23. A data acquisition system, characterized in that the system comprises: a passport management server, a service server and a service control server; the business server, configured to send a pass obtaining request to the pass management server when there is data to be obtained, wherein the business server includes N, and N is an integer greater than or equal to 1; The pass management server is configured to receive N pass acquisition requests sent by N service servers, determine whether the N is greater than the preset number M of passes issued, and when the N is greater than the M, select the N passes from the N passes. In the acquisition request, select M pass acquisition requests, and acquire the identification information of M service servers carried in the M pass acquisition requests, add the pre-stored M passes to the M pass response information, respectively, send the The M pieces of pass response information are sent to the service servers corresponding to the identification information of the M request-sender service servers to which they belong, wherein each of the pass-acquisition requests carries the identification information of the request-sender service server to which they belong, and the M is an integer greater than or equal to 1; The service server is further configured to, when receiving the pass response information sent by the pass management server, acquire the pass in the pass response information, and add the pass in the pass response information to the data acquisition request , and send the data acquisition request to the service control server; The service control server is configured to receive the data acquisition request sent by the service server, and send the data to be acquired corresponding to the data acquisition request to the service server.

Images