WO2021155656A1

WO2021155656A1 - Data processing method and apparatus, and access system, electronic device and storage medium

Info

Publication number: WO2021155656A1
Application number: PCT/CN2020/105871
Authority: WO
Inventors: 赵历; 李斯睿; 钱凯桦
Original assignee: 北京百度网讯科技有限公司
Priority date: 2020-02-06
Filing date: 2020-07-30
Publication date: 2021-08-12
Also published as: CN111343235A

Abstract

Disclosed are a data processing method and apparatus, and an access system, an electronic device and a storage medium, which relate to the field of information flow. The data processing method comprises: receiving a first message, which is sent by an object and is used for accessing target content; according to the target content, selecting, from multiple server groups, a first server in a first server group used for feeding back the target content, wherein each server group comprises multiple servers; and feeding back, to the object, the target content fed back by the first server. Multiple servers form a server group so as to construct multiple server groups, such that a certain server group is selected from the multiple server groups, and a certain server which is used for feeding back target content is selected from the server group. Since the pressure resistance capacity of a server group is higher than that of a single server, and the service jitter of the server group is smaller than the service jitter of the single server, the technical effect of improving the efficiency and reliability of accessing target content is achieved.

Description

Data processing method and device, access system, electronic equipment and storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 202010081833.0, and the application name is "data processing methods and devices, access systems, electronic equipment and storage media" on February 6, 2020, and its entire contents Incorporated in this application by reference.

Technical field

The embodiments of the present application relate to the field of data processing technology, in particular to the field of information flow technology, and in particular to a data processing method and device, an access system, an electronic device, and a storage medium.

Background technique

With the development of computer technology and Internet technology, the amount of network visits has gradually increased.

In the prior art, the message used to access certain content is distributed (for example, distributed by hash calculation) to a corresponding independent server, and the server fulfills the requirement of accessing certain content.

However, in the process of implementing the present application, the inventor found at least the following problem: the independent server has limited stress resistance, resulting in excessive service jitter.

Summary of the invention

According to one aspect of the embodiments of the present application, the embodiments of the present application provide a data processing method, and the method includes:

Receiving the first message sent by the object for accessing the target content;

Selecting a first server in a first server group for feeding back the target content from a plurality of server groups according to the target content, wherein each of the server groups includes a plurality of servers;

The target content fed back by the first server is fed back to the object.

In the embodiment of the present application, since the server group includes multiple services, the stress resistance of the server group is stronger than that of a single server, and the service jitter of the server group is smaller than the service jitter of a single server. Therefore, through the solution of the embodiment of the present application, the technical effect of reducing service jitter and improving feedback capability can be improved.

In some embodiments, the method further includes:

In response to the second message that is fed back by the first server for indicating the failure of the acquisition, or the first server has no feedback within a preset period of time, select a user from the first server group other than the first server. To a second server that feeds back the target content.

In the embodiment of the present application, since each server group includes multiple servers, when a certain server in a certain server group is abnormal (that is, including feedback of the second message and no feedback), the server group can be Other servers continue to process to avoid increasing the load on other server groups to ensure the normal operation of the access system, thereby improving the efficiency and reliability of the data processing device feedback, and improving the work efficiency and performance of the access system Effect.

In some embodiments, the method further includes:

In response to all the servers in the first server group failing to feed back the target content, a server group for feeding back the target content is selected from server groups other than the first server group server.

In the embodiment of the present application, the data processing device selects a server group for feeding back target content from other server groups, and selects a server for feeding back the target content from the server group, so as to ensure that the target content is fed back to the object Timeliness and effectiveness, thereby increasing the number of visits.

In some embodiments, the method further includes:

In response to none of the servers in the first server group feeding back the target content, a server for feeding back the target content is selected from a preset backup server group, and the backup group includes at least one server.

In the embodiment of the present application, when all the servers in a certain server group do not feed back the target content, the server used to feed back the target content is selected from the backup server group, which can avoid increasing the load of other server groups. Improve the effectiveness and reliability of the operation of other server groups, and by ensuring that the target content is fed back by the backup server group to the object, the reliability of the feedback can be improved, thereby increasing the amount of access.

In some embodiments, the method further includes:

According to a preset mapping relationship between servers and groups, multiple servers are divided into corresponding groups to generate multiple server groups.

In some embodiments, the method further includes:

Collecting the amount of access to the target content, and collecting the load of each server in each of the server groups;

Adjust the number of servers in at least part of the server group and/or adjust the number of the server group according to the amount of visits and the collected load.

In the embodiment of the present application, by adjusting the number of servers in at least part of the server group and/or adjusting the number of server groups according to the amount of visits and the collected load, the layout of the access system can be adjusted in time, In order to meet the demand of visits, the technical effect of improving the reliability of visits and the timeliness of feedback is realized.

In some embodiments, the selecting the first server in the first server group for feeding back the target content from a plurality of server groups according to the target content includes:

Determining a distribution ratio corresponding to the first server group;

The first server is selected according to the distribution ratio.

In the embodiment of the present application, by selecting the first server according to the determined split ratio, it is possible to select the corresponding server based on the load of each server, reduce the jitter of the access system, and improve the technical effect of the stability of the access system .

In some embodiments, the determining the distribution ratio corresponding to the first server group includes:

Obtaining the initial weight of each server in the first server group;

Calculating the load of each server in the first server group;

Allocate the calculated load weights corresponding to the loads of each server;

The diversion ratio is determined according to the initial weight and the load weight.

In the embodiment of the present application, the shunt ratio is determined according to the initial weight and the load weight, that is, the shunt ratio is determined through multiple dimensions, which can ensure the technical effect of the reliability and accuracy of the shunt ratio.

According to one aspect of the embodiments of the present application, the embodiments of the present application provide a data processing device, the device including:

The receiving module is used to receive the first message sent by the object for accessing the target content;

The selection module is configured to select the first server in the first server group for feeding back the target content from a plurality of server groups according to the target content, wherein each of the server groups includes a plurality of server;

The feedback module is configured to feed back the target content fed back by the first server to the object.

In some embodiments, the selection module is further configured to respond to the second message used to indicate the failure of the acquisition fed back by the first server, or the first server has no feedback within a preset period of time, so as to remove the second message from the first server. A second server used for feeding back the target content is selected from the first server group other than a server.

In some embodiments, the selection module is further configured to, in response to that none of the servers in the first server group feed back the target content, from a server group other than the first server group Select a server in the server group for feeding back the target content.

In some embodiments, the selection module is further configured to, in response to that none of the servers in the first server group feed back the target content, select from a preset backup server group for feeding back the A server of the target content, and the backup group includes at least one server.

In some embodiments, the device further includes:

The generating module is used to divide multiple servers into corresponding groups according to a preset mapping relationship between servers and groups to generate multiple server groups.

In some embodiments, the device further includes:

A collection module, configured to collect the amount of access to the target content, and collect the load of each server in each of the server groups;

The adjustment module is configured to adjust the number of servers in at least part of the server group and/or adjust the number of the server group according to the amount of visits and the collected load.

In some embodiments, the selection module is configured to determine a distribution ratio corresponding to the first server group, and select the first server according to the distribution ratio.

In some embodiments, the selection module is configured to obtain the initial weight of each server in the first server group, calculate the load of each server in the first server group, and distribute the calculated server The load weight corresponding to each load of the load, and the shunt ratio is determined according to the initial weight and the load weight.

According to one aspect of the embodiments of the present application, the embodiments of the present application provide an electronic device, including:

At least one processor; and

A memory communicatively connected with the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the method described in any of the above embodiments.

According to one aspect of the embodiments of the present application, the embodiments of the present application provide a non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the method described in any of the above embodiments .

According to one aspect of the embodiments of the present application, the embodiments of the present application provide an access system, the system includes the data processing device as described in any of the above embodiments, and further includes: a plurality of server groups, each of the servers Each group includes multiple servers.

The embodiments of the present application provide a data processing method and device, an access system, an electronic device, and a storage medium, including: receiving a first message sent by an object for accessing target content, and selecting from multiple server groups according to the target content The first server in the first server group for feeding back target content, where each server group includes multiple servers, and the target content fed back by the first server is fed back to the object, and a server is formed by multiple servers Group, so as to construct multiple server groups to select a server group from multiple server groups, and select a server from the server group for feedback of the target content, due to the resistance of the server group The pressure capability is stronger than that of a single server, and the service jitter of a server group is smaller than that of a single server, thus achieving the technical effect of improving the efficiency and reliability of accessing target content.

It should be understood that the content described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be easily understood through the following description.

Description of the drawings

The drawings are used to better understand the solution, and do not constitute a limitation to the application. in:

FIG. 1 is a schematic diagram of an application scenario of a data processing method according to an embodiment of the application;

2 is a schematic flowchart of a data processing method according to an embodiment of the application;

3 is a schematic diagram of two different ways of sending a first message when the object is a user in an embodiment of the application;

FIG. 4 is a schematic diagram of comparison between the solution of the embodiment of the application and the solution of the prior art;

FIG. 5 is a schematic flowchart of a data processing method according to another embodiment of the application;

FIG. 6 is a schematic flowchart of a data processing method according to another embodiment of this application;

FIG. 7 is a schematic flowchart of a data processing method according to another embodiment of the application;

FIG. 8 is a schematic flowchart of a data processing method according to another embodiment of the application;

FIG. 9 is a schematic flowchart of a data processing method according to another embodiment of the application;

10 is a schematic flowchart of a method for selecting a first server in a first server group for feeding back target content from a plurality of server groups according to target content according to an embodiment of the present application;

FIG. 11 is a schematic flowchart of a method for selecting a first server according to a distribution ratio according to an embodiment of the application;

FIG. 12 is a schematic diagram of a data processing device according to an embodiment of the application;

FIG. 13 is a schematic diagram of a data processing device according to another embodiment of the application;

FIG. 14 is a block diagram of an electronic device according to an embodiment of the application.

Detailed ways

The exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be regarded as merely exemplary. Therefore, those of ordinary skill in the art should realize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Likewise, for clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

The data processing method provided in the embodiment of the present application may be applicable to the application scenario shown in FIG. 1.

In the application scenario shown in FIG. 1, the user 100 can access various contents through the terminal 200, such as accessing web pages, microblogs, forums, and videos.

Among them, the terminal 200 may include a mobile phone as shown in FIG. 1, and may also include a computer, a notebook, an iPad, a smart speaker, a smart bracelet, a vehicle-mounted terminal, and the like.

The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

According to one aspect of the embodiments of the present application, the embodiments of the present application provide a data processing method.

Please refer to FIG. 2, which is a schematic flowchart of a data processing method according to an embodiment of the application.

As shown in Figure 2, the method includes:

S101: Receive a first message sent by an object for accessing target content.

Among them, the execution subject of the embodiment of the present application may be a data processing device, which may be a processor CPU; it may also be a server, and the server may include a local server and a cloud server; it may also be a terminal, and the terminal includes but is not limited to Computer, iPad and vehicle-mounted terminal; it can also be a chip, the chip can be an embedded chip, and it can be embedded in other devices (such as terminals and servers, etc.).

Among them, the target content is used to characterize the relevant information that the user wants to read, including news information and web page URLs.

In some embodiments, the object may be a user, for example, the object may be a user 100 in an application scenario as shown in FIG. 1. And when the object is a user, the object can send the first message in at least two ways. The first method is to manually input or click on the display interface of the data processing device to send the first message to the data processing device; One way is to send the first message to the data processing device by voice.

Please refer to FIG. 3. FIG. 3 is a schematic diagram of two different ways of sending the first message when the object is a user in an embodiment of the application.

Among them, 3-1 in FIG. 3 is that the user manually enters the target content desired to be accessed on the display interface of the data processing device by manual means, and initiates the first message to the data processing device when clicking "start search".

3-2 in Figure 3 means that the user speaks the target content that he wants to access through voice, and when he speaks the concluding sentence "start search", he will report to the data processing device (the data processing device in 3-2 in Figure 3 is specifically The smart speaker) initiates the first message.

It is worth noting that FIG. 3 is only used to exemplarily illustrate that when the object is a user, the user can initiate a first message to the data processing device from at least two aspects, and cannot be understood as a limitation on the display interface and the concluding remarks.

For example, in some embodiments, the user can also wake up the data processing device through a "wake-up word". After the data processing device responds to the "wake-up word", the user can start to initiate a voice for accessing the target content, and the data processing device When the end time of the user's voice reaches the preset duration, it is determined that the user's voice is over, and the search is started.

Taking the data processing device as a smart speaker as an example, the explanation is as follows:

The user initiates the voice of "Xiaodu Xiaodu" (that is, the wake-up word), the smart speaker responds with "I am here", the user initiates the voice of "Visit Baidu Forum" (that is, the voice used to access the target content), and the smart speaker is in If no other voice initiated by the user is received for 3 seconds, it is determined that the voice is over, and the relevant content of the Baidu forum is searched and displayed.

Of course, in other embodiments, the object may also be a user terminal, a computer, a smart speaker, a vehicle-mounted terminal, and so on.

Take the vehicle-mounted terminal as an example for an exemplary explanation as follows:

When the distance between the user and the vehicle is less than the preset distance threshold, the user can use the user terminal (such as a mobile phone) to turn on the vehicle terminal (which can be realized through Bluetooth connection), and initiate a query command to the vehicle terminal. The query command carries the user's desire To access the target content (such as querying the driving route from the current location to a certain place), the vehicle-mounted terminal initiates the first message for obtaining the target content to the cloud server according to the query instruction, that is, querying the driving route from the current location to a certain place, and in the vehicle The driving route is displayed on the display interface of the terminal, so as to avoid the problem of wasting time for the user to determine the route after getting in the car.

S102: Select a first server in the first server group for feeding back the target content from a plurality of server groups according to the target content, where each server group includes a plurality of servers.

Among them, the data processing device can be integrated with each server group, that is, the data processing device and each server group form a system (hereinafter referred to as the access system), and the data processing device and each server group are part of the access system. Component; the data processing device and each server group can also be independent individuals.

This step may specifically include: selecting a first server group for feeding back the target content from a plurality of server groups according to the target content, and then selecting a first server for feeding back the target content from the first server group.

Wherein, selecting the first server group for feeding back the target content from a plurality of server groups according to the target content can be implemented by calculating a hash value. For example, the ID of the target content is determined, the ID is calculated according to a hash algorithm to obtain a hash value, and the first server group for feeding back the target content is determined based on the calculated hash value. The method for determining the first server group based on the hash value is the same as the method for determining the independent server based on the hash value. For details, please refer to the prior art, which will not be repeated here.

Please refer to FIG. 4, which is a schematic diagram of comparison between the solution of the embodiment of this application and the solution of the prior art.

It can be seen from 4-1 in FIG. 4 that the inventive concept of the prior art is that the servers are independent of each other, and the data processing device selects an independent server for feeding back target content from a plurality of independent servers.

The inventive concept of the embodiment of the present application is: a server group is formed by multiple servers, a certain server group is selected from the multiple server groups, and a certain server group for feeding back target content is selected from the server group. server.

It is worth noting that because the server group includes multiple services, the stress resistance of the server group is stronger than that of a single server, and the service jitter of the server group is smaller than that of a single server. Therefore, through the solution of the embodiment of the present application, the technical effect of reducing service jitter and improving feedback capability can be improved.

Among them, service jitter is used to characterize the phenomenon of jitter generated by the first message of the execution object.

S103: Feed back the target content fed back by the first server to the object.

Based on the above analysis, it can be seen that an embodiment of the present application provides a data processing method, which includes: receiving a first message sent by an object for accessing target content, and selecting from multiple server groups for feedback of the target according to the target content The first server in the first server group of the content, where each server group includes multiple servers, and the target content fed back by the first server is fed back to the object, and a server group is formed by multiple servers, thereby Build multiple server groups in order to select a server group from multiple server groups, and select a server from the server group for feedback of target content, because the server group is more resistant to stress than A single server, and the service jitter of the server group is made smaller than the service jitter of a single server, thus achieving the technical effect of improving the efficiency and reliability of accessing target content.

It can be seen from FIG. 5 that, in some embodiments, after S102, the method further includes:

S104: In response to the second message that is fed back by the first server to indicate the failure of the acquisition, or the first server has no feedback within a preset time period, select from a group of first servers other than the first server for feedback of target content The second server in order to feed back the target content fed back by the second server to the object.

Among them, on the one hand, this step may specifically include: if the data processing device receives the second message fed back by the first server, and the second message is used to characterize the failure of the acquisition, the data processing device reselects the user from the first server group. For the second server that feeds back the target content.

Wherein, the second message used to characterize the acquisition and identification may include at least two situations, one is that there is no target content and therefore access fails, and the other is that the target content cannot be accessed due to various factors such as the network, and therefore the acquisition fails.

On the other hand, this step may specifically include: the data processing device can be configured for a period of time (that is, the preset period of time) based on requirements, historical records, and test tests in advance by staff or other equipment, if the data processing device is in the preset If the feedback from the first server is not received within the time period, the data processing device reselects the second server for feeding back the target content from the first server group.

For example: the access target content is to access the listing information of Baidu's new generation of smart speakers. The first server group includes four servers, and the four servers are server A, server B, server C, and server D. The first server is the server A.

In some embodiments, if server A feeds back the second message to the data processing apparatus due to a network failure, the data processing apparatus selects one server from server B, server C, and server D for feeding back the target content.

In other embodiments, if server A is unable to access Baidu official website within the preset time period due to its own load or heavy visits to the Baidu official website, which results in server A failing to provide feedback to the data processing device within the preset time period, Then the data processing device selects a server from server B, server C, and server D to feed back the target content

It is worth noting that in the prior art, each server is an independent individual. When a certain server does not feed back to the data processing device within a preset period of time, or when the server feeds back a second message to the data processing device, the data The processing device can only redistribute the first message to other independent servers, and the stress resistance of each server is certain. Therefore, it is easy to cause the phenomenon of overwhelming other servers, leading to the collapse of the access system.

In the embodiment of the present application, since each server group includes multiple servers, when a certain server in a certain server group is abnormal (that is, including feedback of the second message and no feedback), the server group can be The other servers in the server continue to process to avoid increasing the load on other server groups to ensure the normal operation of the access system, thereby improving the efficiency and reliability of the data processing device feedback, and improving the work efficiency and performance of the access system Technical effect.

It can be seen from FIG. 6 that, in some embodiments, after S104, the method further includes:

S105: In response to that none of the servers in the first server group feed back the target content, select a server in the server group for feeding back the target content from a server group other than the first server group, so that the selected The target content fed back by the server is fed back to the target.

Among them, all servers in the first server group fail to feed back the target content, including the following situations: one is the second message that all servers in the first server group feed back to the data processing device; the other is data processing The device does not receive feedback from any server in the first server group within a preset time period; one is that some servers in the first server group feed back the second message to the data processing device, and the data processing device is in advance It is assumed that no feedback from other servers in the first server group is received within the time period.

It can be seen in conjunction with FIG. 7 that, in some embodiments, after S104, the method further includes:

S106: In response to that none of the servers in the first server group feed back the target content, select a server for feeding back the target content from a preset backup server group. The backup server group includes at least one server so that the selected The target content returned by the server is fed back to the object.

Similarly, none of the servers in the first server group feedback the target content, including three situations. For details, please refer to the above example, which will not be repeated here.

In the embodiment of the present application, a backup server group may be preset, and the backup server group may include one server or multiple servers. When all servers in a server group do not feed back the target content, select the server used to feed back the target content from the backup server group, which can avoid increasing the load of other server groups and improve the operation of other server groups. Effectiveness and reliability, and by ensuring that the target content is fed back to the target by the backup server group, the reliability of the feedback can be improved, thereby increasing the amount of visits.

It can be seen in conjunction with FIG. 8 that, in some embodiments, before S101, the method further includes:

S01: According to a preset mapping relationship between servers and groups, multiple servers are divided into corresponding groups to generate multiple server groups.

It can be seen in conjunction with FIG. 9 that, in some embodiments, the method further includes:

S107: Collect the amount of access to the target content, and collect the load of each server in each server group.

It should be noted that there is no inevitable sequence relationship between S107 and the above steps. For example, S107 can be executed after S102, or before S101, and can be executed in parallel with any step, and FIG. 8 is only for exemplary purposes. Describes a certain order of execution between the steps, but cannot be understood as a limitation on the order of execution of the steps.

Among them, the collection of visits to the target content can be achieved by estimating the visits.

In some embodiments, the estimation method may specifically include: determining the number of visits of similar content with high similarity to the target content from the historical visit records, and predicting the visit of the target content based on the determined number of visits quantity.

In other embodiments, the estimation method may also specifically include: publishing information related to the target content, collecting access information (including visits and comments, etc.) of the related information, and predicting the target content based on the access information Of visits.

Of course, it can also be achieved by other estimation methods, which will not be repeated here.

S108: Adjust the number of servers in at least part of the server group and/or adjust the number of server groups according to the amount of visits and the collected load.

Wherein, this step may specifically include: adjusting the number of servers in at least part of the server group according to the amount of visits and the collected load; adjusting the number of server groups according to the amount of visits and the collected load; While adjusting the number of servers in at least part of the server group according to the amount of visits and the collected load, the number of server groups is adjusted according to the amount of visits and the collected load.

Specifically, adjusting the number of servers in at least part of the server group may include adjusting the number of servers in one server group, and may also include adjusting the number of servers in multiple server groups.

It should be noted that adjusting the number of servers in at least part of the server group may include increasing the number of servers in at least part of the server group, such as adding one or more servers to a certain server group; This includes reducing the number of servers in at least part of the server group, such as reducing one or more servers in a certain server group.

Specifically, adjusting the number of server groups may include increasing the number of server groups, such as creating a new server group; or reducing the number of server groups, such as deleting at least one server group.

It should be noted that creating a new server group can be to add a new server and construct a new server group from the added new server; it can also be to select some servers from the created server group and build a new server group. Server group; it is also possible to create a new server group for the newly added server and some servers selected from the created server group.

With reference to FIG. 10, it can be seen that, in some embodiments, S102 includes:

S21: Determine the distribution ratio corresponding to the first server group.

S22: Select the first server according to the distribution ratio.

With reference to FIG. 11, it can be seen that, in some embodiments, S21 includes:

S211: Acquire as the initial weight of each server in the first server group.

Wherein, the initial weight value may be a weight value pre-configured for each server in the first server group.

In some embodiments, the initial weight can be a dynamically adjusted weight, and the initial default value of the initial weight can be set to 0, that is, the initial weight of any server in the initial state is 0, and the initial state can be understood as no The state when the data processing method of the embodiment of the present application is executed can also be understood as the state when a certain server is added to reduce the jitter of the access system, thereby improving the stability of the access system.

The dynamic adjustment of the initial weight can be realized based on the load of each server, and the dynamic adjustment of the initial weight can be a positive adjustment, which can be understood as when the load of a server increases, the corresponding initial weight The value increases accordingly.

Among them, in some embodiments, the initial weight may be set to a value in the interval [-100, 0].

S212: Calculate the load of each server in the first server group.

Among them, calculating the load of each server in the first server group can be implemented in the following manner:

Collect parameter information such as CPU utilization, memory utilization, disk usage information, number of access connections, and number of processes of each server in the first server group, and calculate each parameter information according to the parameter information of each server in the first server group. The load of the corresponding server.

Taking the calculation of the load of server A as an example, the description is as follows:

Collect the parameter information of server A's CPU utilization, memory utilization, disk usage information, number of access connections, and number of processes, and calculate the load of server A according to the collected parameters. The specific formula for calculating the load of server A can be found here There is a formula for calculating the load in the technology, so I won't repeat it here.

S213: Allocate the calculated load weights corresponding to the loads of each server.

This step can be implemented using the following methods:

Method 1: The mapping table can be set up in advance based on requirements, experience and test data. The mapping table is used to characterize the correspondence between the load and the load weight. That is, when the load of a certain server is known, the server can be found in the mapping table. The corresponding load weight of the load.

Method 2: Set a load threshold based on demand, experience, and test data, and compare the load of each server with the load threshold, and assign load weights to each server according to the difference vector between the two obtained from the comparison. If The difference vector is negative, that is, if the load of a server is less than the load threshold, the load weight assigned to the server is larger; if the difference vector is positive, that is, if the load of a server is greater than the load threshold, then it is assigned to the server The load weight is smaller. And, if the difference vector is positive, the larger the value corresponding to the difference vector, the smaller the corresponding load weight. For example, if the load of server A and the load of server B are both greater than the load threshold, and the load of server A is greater than the load of server B, then the load weight of server A is less than the load weight of server B. Moreover, if the difference vector is negative, the larger the value corresponding to the difference vector, the larger the corresponding load weight. For example, if the load of server A and the load of server B are both less than the load threshold, and the load of server A is less than the load of server B, then the load weight of server A is greater than the load weight of server B.

Among them, in some embodiments, the load weight may be set to a value in the interval [0,100].

S214: Determine the shunt ratio according to the initial weight and the load weight.

Among them, the sum of the initial weight and the load weight can be determined as the shunt ratio.

According to another aspect of the embodiments of the present application, the embodiments of the present application also provide a data processing device.

Please refer to FIG. 12, which is a schematic diagram of a data processing device according to an embodiment of the application.

As shown in Figure 12, the device includes:

The receiving module 11 is configured to receive the first message sent by the object for accessing the target content;

The selection module 12 is configured to select a first server in a first server group for feeding back the target content from a plurality of server groups according to the target content, wherein each of the server groups includes multiple server groups. Servers;

The feedback module 13 is configured to feed back the target content fed back by the first server to the object.

In some embodiments, the selection module 12 is further configured to, in response to all servers in the first server group failing to feed back the target content, from a server group other than the first server group Select a server in the server group for feeding back the target content.

In some embodiments, the selection module 12 is further configured to, in response to all the servers in the first server group failing to feed back the target content, select from a preset backup server group for feedback. For the server of the target content, the backup group includes at least one server.

With reference to FIG. 13, it can be seen that, in some embodiments, the device further includes:

The generating module 14 is configured to divide multiple servers into corresponding groups according to a preset mapping relationship between servers and groups, and generate multiple server groups.

The collection module 15 is configured to collect the amount of access to the target content, and collect the load of each server in each of the server groups;

The adjustment module 16 is configured to adjust the number of servers in at least part of the server group and/or adjust the number of the server groups according to the amount of visits and the collected load.

In some embodiments, the selection module 12 is configured to determine a distribution ratio corresponding to the first server group, and select the first server according to the distribution ratio.

In some embodiments, the selection module 12 is configured to obtain the initial weight of each server in the first server group, calculate the load of each server in the first server group, and distribute the calculated values of each server. The load weight value corresponding to the load of the server is determined according to the initial weight value and the load weight.

According to the embodiments of the present application, the present application also provides an electronic device and a readable storage medium.

As shown in FIG. 14, it is a block diagram of an electronic device according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples, and are not intended to limit the implementation of the embodiments of the present application described and/or required herein.

As shown in FIG. 14, the electronic device includes: one or more processors 101, a memory 102, and interfaces for connecting various components, including a high-speed interface and a low-speed interface. The various components are connected to each other by using different buses, and can be installed on a common motherboard or installed in other ways as required. The processor may process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input/output device (such as a display device coupled to an interface). In other embodiments, if necessary, multiple processors and/or multiple buses can be used with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides part of the necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). In FIG. 14, a processor 101 is taken as an example.

The memory 102 is a non-transitory computer-readable storage medium provided by an embodiment of the application. Wherein, the memory stores instructions executable by at least one processor, so that the at least one processor executes the data processing method provided in the embodiment of the present application. The non-transitory computer-readable storage medium of the embodiment of the present application stores computer instructions, and the computer instruction is used to make a computer execute the data processing method provided by the embodiment of the present application.

As a non-transitory computer-readable storage medium, the memory 102 can be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the data processing method in the embodiment of the present application. The processor 101 executes various functional applications and data processing of the server by running non-transient software programs, instructions, and modules stored in the memory 102, that is, realizing the data processing method in the foregoing method embodiment.

The memory 102 may include a program storage area and a data storage area. The program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the electronic device, and the like. In addition, the memory 102 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some embodiments, the memory 102 may optionally include a memory remotely provided with respect to the processor 101, and these remote memories may be connected to an electronic device through a network. Examples of the foregoing network include, but are not limited to, the Internet, corporate intranet, local area network, Block-chain-based Service Network (BSN), mobile communication network, and combinations thereof.

The electronic device may further include: an input device 103 and an output device 104. The processor 101, the memory 102, the input device 103, and the output device 104 may be connected by a bus or in other ways. In FIG. 14, the connection by a bus is taken as an example.

The input device 103 can receive input digital or character information, and generate key signal input related to the user settings and function control of the electronic device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more Input devices such as mouse buttons, trackballs, joysticks, etc. The output device 104 may include a display device, an auxiliary lighting device (for example, LED), a tactile feedback device (for example, a vibration motor), and the like. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device may be a touch screen.

Various implementations of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: being implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, the programmable processor It can be a dedicated or general-purpose programmable processor that can receive data and instructions from the storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device. An output device.

These computing programs (also referred to as programs, software, software applications, or codes) include machine instructions for programmable processors, and can be implemented using high-level procedures and/or object-oriented programming languages, and/or assembly/machine language Calculation program. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, device, and/or device used to provide machine instructions and/or data to a programmable processor ( For example, magnetic disks, optical disks, memory, programmable logic devices (PLD)), including machine-readable media that receive machine instructions as machine-readable signals. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

In order to provide interaction with the user, the systems and techniques described here can be implemented on a computer that has: a display device for displaying information to the user (for example, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) ); and a keyboard and a pointing device (for example, a mouse or a trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (for example, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including Acoustic input, voice input, or tactile input) to receive input from the user.

The systems and technologies described herein can be implemented in a computing system that includes back-end components (for example, as a data server), or a computing system that includes middleware components (for example, an application server), or a computing system that includes front-end components (for example, A user computer with a graphical user interface or a web browser, through which the user can interact with the implementation of the system and technology described herein), or includes such back-end components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be connected to each other through any form or medium of digital data communication (for example, a communication network). Examples of communication networks include: Local Area Network (LAN), Block-chain-based Service Network (BSN), Wide Area Network (WAN), and the Internet.

It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present application can be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution of the present application can be achieved, there is no limitation herein.

The foregoing specific implementations do not constitute a limitation on the protection scope of the present application. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent replacement and improvement made within the spirit and principle of this application shall be included in the protection scope of this application.

Claims

A data processing method, characterized in that the method includes:

Receiving the first message sent by the object for accessing the target content;

Selecting a first server in a first server group for feeding back the target content from a plurality of server groups according to the target content, wherein each of the server groups includes a plurality of servers;

The target content fed back by the first server is fed back to the object.
The method according to claim 1, wherein the method further comprises:

In response to the second message that is fed back by the first server for indicating the failure of the acquisition, or the first server has no feedback within a preset period of time, select a user from the first server group other than the first server. To a second server that feeds back the target content.
The method according to claim 2, wherein the method further comprises:

In response to all the servers in the first server group failing to feed back the target content, a server group for feeding back the target content is selected from server groups other than the first server group server.
The method according to claim 2, wherein the method further comprises:

In response to none of the servers in the first server group feeding back the target content, a server for feeding back the target content is selected from a preset backup server group, and the backup group includes at least one server.
The method according to any one of claims 1 to 4, wherein the method further comprises:

According to a preset mapping relationship between servers and groups, multiple servers are divided into corresponding groups to generate multiple server groups.
The method according to any one of claims 1 to 4, wherein the method further comprises:

Collecting the amount of access to the target content, and collecting the load of each server in each of the server groups;

Adjust the number of servers in at least part of the server group and/or adjust the number of the server group according to the amount of visits and the collected load.
The method according to any one of claims 1 to 4, wherein the first server group in the first server group for feeding back the target content is selected from a plurality of server groups according to the target content One server includes:

Determining a distribution ratio corresponding to the first server group;

The first server is selected according to the distribution ratio.
The method according to any one of claims 1 to 4, wherein the determining the distribution ratio corresponding to the first server group comprises:

Obtaining the initial weight of each server in the first server group;

Calculating the load of each server in the first server group;

Allocate the calculated load weights corresponding to the loads of each server;

The diversion ratio is determined according to the initial weight and the load weight.
A data processing device, characterized in that the device comprises:

The receiving module is used to receive the first message sent by the object for accessing the target content;

The selection module is configured to select the first server in the first server group for feeding back the target content from a plurality of server groups according to the target content, wherein each of the server groups includes a plurality of server;

The feedback module is configured to feed back the target content fed back by the first server to the object.
The device according to claim 9, wherein the selection module is further configured to respond to a second message that is fed back by the first server and used to characterize the failure of the acquisition, or the first server does not have any information within a preset period of time. Feedback: selecting a second server for feeding back the target content from the first server group except the first server.
10. The device according to claim 10, wherein the selection module is further configured to, in response to all servers in the first server group failing to feed back the target content, remove from the first server group A server in the server group used for feeding back the target content is selected from the server group outside the group.
The device according to claim 10, wherein the selection module is further configured to, in response to all servers in the first server group failing to feed back the target content, from a preset backup server group The server used for feeding back the target content is selected from the group, and the backup group includes at least one server.
The device according to any one of claims 9 to 12, wherein the device further comprises:

The generating module is used to divide multiple servers into corresponding groups according to a preset mapping relationship between servers and groups to generate multiple server groups.
The device according to any one of claims 9 to 12, wherein the device further comprises:

A collection module, configured to collect the amount of access to the target content, and collect the load of each server in each of the server groups;

The adjustment module is configured to adjust the number of servers in at least part of the server group and/or adjust the number of the server group according to the amount of visits and the collected load.
The device according to any one of claims 9 to 12, wherein the selection module is configured to determine a distribution ratio corresponding to the first server group, and select the first server according to the distribution ratio .
The device according to any one of claims 9 to 12, wherein the selection module is configured to obtain the initial weight of each server in the first server group, and calculate the first server group For the load of each server in the group, the calculated load weights corresponding to the loads of each server are allocated, and the diversion ratio is determined according to the initial weight and the load weight.
An electronic device, characterized in that it comprises:

At least one processor; and

A memory communicatively connected with the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute any one of claims 1-8 Methods.
A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to make the computer execute the method according to any one of claims 1-8.
An access system, characterized in that the system comprises the data processing device according to any one of claims 9 to 16, and further comprises: a plurality of server groups, and each of the server groups includes Servers.