CN114095567B - Data access request processing method and device, computer equipment and medium - Google Patents
Data access request processing method and device, computer equipment and medium Download PDFInfo
- Publication number
- CN114095567B CN114095567B CN202111188949.5A CN202111188949A CN114095567B CN 114095567 B CN114095567 B CN 114095567B CN 202111188949 A CN202111188949 A CN 202111188949A CN 114095567 B CN114095567 B CN 114095567B
- Authority
- CN
- China
- Prior art keywords
- node
- nodes
- access request
- data access
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 230000036541 health Effects 0.000 claims abstract description 43
- 238000000034 method Methods 0.000 claims abstract description 24
- 238000012216 screening Methods 0.000 claims abstract description 20
- 230000004044 response Effects 0.000 claims abstract description 18
- 238000003860 storage Methods 0.000 claims abstract description 14
- 238000012545 processing Methods 0.000 claims description 35
- 238000004364 calculation method Methods 0.000 claims description 15
- 238000011156 evaluation Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 8
- 238000007405 data analysis Methods 0.000 claims description 6
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 4
- 238000007689 inspection Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/12—Avoiding congestion; Recovering from congestion
- H04L47/125—Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer And Data Communications (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a processing method, a device, computer equipment and a storage medium of a data access request, wherein the method comprises the following steps: when a data access request sent by a client is received, an IP address of the client is obtained, a real physical address of the client is determined based on the IP address, a node corresponding to the real physical address distance is obtained from cluster server nodes according to preset screening conditions and used as a candidate node, health examination is conducted on each candidate node, an examination result is a healthy node which is used as an effective node, a target node is selected from the effective nodes based on a dynamic balance mode, and response is conducted on the data access request based on the target node. The access requests from different sources are rapidly distributed according to the geographic positions, and the response speed of the access requests is improved.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a method, an apparatus, a computer device, and a medium for processing a data access request.
Background
With the rapid development of computer technology, more and more transactions are processed through a network, access to the internet to acquire information becomes a common thing in daily life, and data access is performed through the network, mainly through a client accessing a designated domain name or an IP address, and further corresponding data resources are acquired from a storage server corresponding to the designated domain name or the IP address to acquire corresponding information. Accordingly, with the rapid increase of access data, there is an increasing demand for server performance and the like for network data access, and the existing method is to add some servers for concurrent use to relieve the stress of the servers, but the existing method is usually to directly perform random distribution, and how to reasonably perform distribution of data access requests so that the data access requests can be responded to at the fastest speed, that is, how to improve the processing efficiency of the data access requests is a problem to be solved.
Disclosure of Invention
The embodiment of the invention provides a method, a device, computer equipment and a storage medium for processing a data access request, so as to improve the processing efficiency of the data access request.
In order to solve the above technical problem, an embodiment of the present application provides a method for processing a data access request, including:
when a data access request sent by a client is received, acquiring an IP address of the client, and determining a real physical address of the client based on the IP address;
according to preset screening conditions, nodes corresponding to the real physical address distance are obtained from cluster server nodes and serve as candidate nodes;
performing health examination on each candidate node, and taking the nodes with healthy examination results as effective nodes;
and selecting a target node from the effective nodes based on a dynamic balancing mode, and responding to the data access request based on the target node.
Optionally, the obtaining, according to a preset screening condition, a node corresponding to the real physical address distance from the cluster server node, as a candidate node includes:
determining a geographic area corresponding to the real physical address as a target geographic area;
reading nodes in the cluster server nodes, the areas of which correspond to the target geographic areas, as initial nodes;
acquiring an actual physical address of each initial node, and calculating a distance interval between the actual physical address of each initial node and the target geographic area;
taking the intermediate value of each distance interval as the reference distance between the actual physical address and the target geographic area, and sequencing the reference distances from small to large to obtain a distance sequence;
selecting a preset number of reference distances from front to back in the distance sequence to serve as target reference distances;
and taking the node corresponding to the target reference distance as the candidate node.
Optionally, the performing health check on each candidate node, and taking the check result as a healthy node, as an effective node, includes:
acquiring node parameter information of each candidate node according to each candidate node, wherein the node parameter information comprises at least one of node throughput, data packet quantity, request number response speed, delay and Round Trip Time (RTT);
based on the node parameter information and preset weights, carrying out health calculation on each candidate node to obtain a health score corresponding to each candidate node;
and confirming the candidate nodes with the health scores exceeding a preset score threshold as healthy nodes with healthy results, and taking the nodes with the healthy examination results as the effective nodes.
Optionally, the selecting the target node from the valid nodes based on the dynamic balancing manner includes:
acquiring a historical stability score of each effective node;
for each effective node, comprehensively evaluating the effective node based on the historical stability level and the health score to obtain an evaluation score;
and taking the effective node with the maximum evaluation value as the target node.
Optionally, before the step of obtaining the historical stability score of each of the active nodes, the processing method of the data access request further includes: after each data access request is processed, performing stability scoring on a target node executing the data access request to obtain a basic stability score;
and carrying out data analysis on the basic stability scores of each time of the target node executing the data access request, obtaining the historical stability scores of the target node executing the data access request, and storing the historical stability scores.
In order to solve the above technical problem, an embodiment of the present application further provides a processing device for a data access request, including:
the system comprises a physical address acquisition module, a data processing module and a data processing module, wherein the physical address acquisition module is used for acquiring an IP address of a client when receiving a data access request sent by the client, and determining a real physical address of the client based on the IP address;
the candidate node determining module is used for acquiring a node corresponding to the real physical address distance from the cluster server nodes according to a preset screening condition, and taking the node as a candidate node;
the effective node screening module is used for carrying out health examination on each candidate node and taking the nodes with healthy examination results as effective nodes;
and the access request response module is used for selecting a target node from the effective nodes based on a dynamic balance mode and responding to the data access request based on the target node.
Optionally, the candidate node determining module includes:
the geographic area determining unit is used for determining a geographic area corresponding to the real physical address as a target geographic area;
an initial node obtaining unit, configured to read, as an initial node, a node in a cluster server node, where the node corresponds to the target geographic area;
the distance calculation unit is used for acquiring the actual physical address of each initial node and calculating a distance interval between the actual physical address of each initial node and the target geographic area;
the distance sorting unit is used for taking the intermediate value of each distance interval as the reference distance between the actual physical address and the target geographic area, and sorting the reference distances from small to large to obtain a distance sequence;
the target reference distance selecting unit is used for selecting a preset number of reference distances from front to back in the distance sequence to serve as target reference distances;
and the candidate node determining unit is used for taking the node corresponding to the target reference distance as the candidate node.
Optionally, the active node screening module includes:
a node parameter information obtaining unit, configured to obtain, for each candidate node, node parameter information of the candidate node, where the node parameter information includes at least one of node throughput, number of data packets, request number response speed, delay, and round trip time RTT;
the health score calculation unit is used for carrying out health calculation on each candidate node based on the node parameter information and the preset weight to obtain a health score corresponding to each candidate node;
and the effective node determining unit is used for confirming the candidate nodes with the health scores exceeding a preset score threshold as healthy nodes with the health results, and taking the nodes with the checked results as healthy nodes as the effective nodes.
Optionally, the access request response module includes:
a history score obtaining unit, configured to obtain a history stability score of each of the valid nodes;
the scoring value calculation unit is used for comprehensively evaluating the effective nodes based on the historical stability level and the health score for each effective node to obtain an evaluation score;
and the target node determining unit is used for taking the effective node with the maximum evaluation value as the target node.
Optionally, the processing device of the data access request further includes:
the first scoring module is used for scoring the stability of the target node executing the data access request after the data access request is processed each time, so as to obtain a basic stability score;
and the second scoring module performs data analysis on the basic stability score of each time of the target node executing the data access request, obtains the historical stability score of the target node executing the data access request, and stores the historical stability score.
In order to solve the above technical problem, an embodiment of the present application further provides a computer device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements the steps of the method for processing a data access request when executing the computer program.
In order to solve the above technical problem, embodiments of the present application further provide a computer readable storage medium storing a computer program, where the computer program implements the steps of the method for processing a data access request when executed by a processor.
According to the processing method, the device, the computer equipment and the storage medium for the data access request, when the data access request sent by the client is received, the IP address of the client is obtained, the real physical address of the client is determined based on the IP address, the node corresponding to the real physical address distance is obtained from the cluster server node according to the preset screening condition, the node is used as a candidate node, health check is conducted on each candidate node, the checked result is a healthy node, the node is used as an effective node, a target node is selected from the effective node based on a dynamic balance mode, and the response is conducted on the data access request based on the target node. The access requests from different sources are rapidly distributed according to the geographic positions, and the response speed of the access requests is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic illustration of an application environment of the present application;
FIG. 2 is a flow chart of one embodiment of a method of processing a data access request of the present application;
FIG. 3 is a schematic diagram of one embodiment of a processing device for data access requests according to the present application;
FIG. 4 is a schematic structural diagram of one embodiment of a computer device according to the present application.
Detailed Description
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used in the description of the applications herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "comprising" and "having" and any variations thereof in the description and claims of the present application and in the description of the figures above are intended to cover non-exclusive inclusions. The terms first, second and the like in the description and in the claims or in the above-described figures, are used for distinguishing between different objects and not necessarily for describing a sequential or chronological order.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, as shown in fig. 1, a system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used as a medium to provide communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The user may interact with the server 105 via the network 104 using the terminal devices 101, 102, 103 to receive or send messages or the like.
The terminal devices 101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablet computers, electronic book readers, MP3 players (Moving Picture Eperts Group Audio Layer III, dynamic video expert compression standard audio plane 3), MP4 (Moving Picture Eperts Group Audio Layer IV, dynamic video expert compression standard audio plane 4) players, laptop and desktop computers, and the like.
The server 105 may be a server providing various services, such as a background server providing support for pages displayed on the terminal devices 101, 102, 103.
It should be noted that, the processing method of the data access request provided in the embodiment of the present application is executed by a server, and accordingly, the processing device of the data access request is set in the server.
It should be understood that the number of terminal devices, networks and servers in fig. 1 is merely illustrative. Any number of terminal devices, networks and servers may be provided according to implementation requirements, and the terminal devices 101, 102 and 103 in the embodiments of the present application may specifically correspond to application systems in actual production.
Referring to fig. 2, fig. 2 shows a method for processing a data access request according to an embodiment of the present invention, which is described in detail below:
s201: when a data access request sent by a client is received, the IP address of the client is obtained, and the real physical address of the client is determined based on the IP address.
S202: and acquiring nodes corresponding to the real physical address distance from the cluster server nodes according to preset screening conditions, and taking the nodes as candidate nodes.
Specifically, according to a preset screening condition, obtaining a node corresponding to a real physical address distance from the cluster server node, wherein the node serving as a candidate node comprises:
determining a geographic area corresponding to the real physical address as a target geographic area;
reading nodes corresponding to the target geographic area in the cluster server nodes as initial nodes;
acquiring an actual physical address of each initial node, and calculating a distance interval between the actual physical address of each initial node and a target geographic area;
taking the intermediate value of each distance interval as the reference distance between the actual physical address and the target geographic area, and sequencing the reference distances from small to large to obtain a distance sequence;
selecting a preset number of reference distances from front to back in a distance sequence to serve as target reference distances;
and taking the node corresponding to the target reference distance as a candidate node.
It should be noted that, there are multiple nodes (node servers) in the cluster, and due to factors such as some management policies and performance of the nodes, dynamic online and offline can be performed, so in order to ensure the effectiveness of the distribution and processing of the subsequent data access request, the state of the nodes needs to be judged first, and the nodes whose node state is down or inactive are removed from the candidate nodes, so that the interference to subsequent screening is avoided.
The node states include active, down and inactive.
S203: and carrying out health examination on each candidate node, and taking the nodes with healthy examination results as effective nodes.
Specifically, performing health check on each candidate node, and taking the node with the check result being healthy as an effective node includes:
for each candidate node, acquiring node parameter information of the candidate node, wherein the node parameter information comprises at least one of node throughput, data packet number, request number response speed, delay and Round Trip Time (RTT);
based on node parameter information and preset weights, carrying out health calculation on each candidate node to obtain a health score corresponding to each candidate node;
and confirming the candidate nodes with the health scores exceeding the preset score threshold as healthy nodes with the health results, and taking the nodes with the checking results as healthy nodes as effective nodes.
Specifically, different node servers have different data processing capacities due to different configurations and different current running states, so that the current running states of the node servers are needed to be used for calculating the resource states of the node servers which can be used for data processing, and preset weights are set in order to avoid server faults or anomalies in the data processing process caused by overload running of the node servers.
The preset score threshold may be set according to practical application requirements, and is not limited herein.
S204: and selecting a target node from the effective nodes based on a dynamic balancing mode, and responding to the data access request based on the target node.
Further, based on the dynamic balancing mode, selecting the target node from the effective nodes includes:
acquiring historical stability scores of each effective node;
for each effective node, comprehensively evaluating the effective node based on the historical stability level and the health score to obtain an evaluation score;
and taking the effective node with the maximum evaluation value as the target node.
Further, before the historical stability score of each valid node is obtained, the processing method of the data access request further comprises: after each data access request is processed, performing stability scoring on a target node executing the data access request to obtain a basic stability score;
and carrying out data analysis on the basic stability scores of each time of the target node executing the data access request, obtaining the historical stability scores of the target node executing the data access request, and storing the historical stability scores.
In this embodiment, when a data access request sent by a client is received, an IP address of the client is obtained, a real physical address of the client is determined based on the IP address, a node corresponding to a distance between the real physical address is obtained from a cluster server node according to a preset screening condition, the node is used as a candidate node, health inspection is performed on each candidate node, an inspection result is used as a healthy node, a target node is selected from the effective nodes based on a dynamic balancing mode, and a response is performed on the data access request based on the target node. The access requests from different sources are rapidly distributed according to the geographic positions, and the response speed of the access requests is improved.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present invention.
Fig. 3 shows a schematic block diagram of a processing apparatus for a data access request in one-to-one correspondence with the processing method for a data access request of the above-described embodiment. As shown in fig. 3, the processing device for a data access request includes a physical address acquisition module 31, a candidate node determination module 32, an effective node screening module 33, and an access request response module 34. The functional modules are described in detail as follows:
the physical address obtaining module 31 is configured to obtain an IP address of the client when receiving a data access request sent by the client, and determine a real physical address of the client based on the IP address;
the candidate node determining module 32 is configured to obtain, from the cluster server nodes, a node corresponding to the real physical address distance as a candidate node according to a preset screening condition;
an effective node screening module 33, configured to perform health inspection on each candidate node, and take a node whose inspection result is healthy as an effective node;
the access request response module 34 is configured to select a target node from the valid nodes based on a dynamic balancing manner, and respond to the data access request based on the target node.
Optionally, the candidate node determination module 32 includes:
the geographic area determining unit is used for determining a geographic area corresponding to the real physical address as a target geographic area;
the initial node acquisition unit is used for reading nodes corresponding to the target geographic area in the cluster server nodes and taking the nodes as initial nodes;
the distance calculation unit is used for acquiring the actual physical address of each initial node and calculating a distance interval between the actual physical address of each initial node and the target geographic area;
the distance sorting unit is used for taking the intermediate value of each distance interval as the reference distance between the actual physical address and the target geographic area, and sorting the reference distances from small to large to obtain a distance sequence;
the target reference distance selecting unit is used for selecting a preset number of reference distances from front to back in the distance sequence to serve as target reference distances;
and the candidate node determining unit is used for taking the node corresponding to the target reference distance as a candidate node.
Optionally, the active node screening module 33 includes:
the node parameter information acquisition unit is used for acquiring node parameter information of the candidate nodes aiming at each candidate node, wherein the node parameter information comprises at least one of node throughput, data packet quantity, request number response speed, delay and Round Trip Time (RTT);
the health score calculation unit is used for carrying out health calculation on each candidate node based on the node parameter information and the preset weight to obtain a health score corresponding to each candidate node;
and the effective node determining unit is used for confirming the candidate nodes with the health scores exceeding the preset score threshold as healthy nodes with the health results, and taking the nodes with the checked results as healthy nodes as effective nodes.
Optionally, the access request response module 34 includes:
a history score obtaining unit, configured to obtain a history stability score of each effective node;
the scoring value calculation unit is used for comprehensively evaluating the effective nodes based on the historical stability peace and the health score for each effective node to obtain an evaluation value;
and the target node determining unit is used for taking the effective node with the maximum evaluation value as the target node.
Optionally, the processing device of the data access request further includes:
the first scoring module is used for scoring the stability of the target node executing the data access request after the data access request is processed each time, so as to obtain a basic stability score;
and the second scoring module performs data analysis on the basic stability score of each time of the target node executing the data access request, obtains the historical stability score of the target node executing the data access request, and stores the historical stability score.
For specific limitations on the processing means of the data access request, reference may be made to the above limitation on the processing method of the data access request, and no further description is given here. The respective modules in the processing device for the data access request may be implemented in whole or in part by software, hardware, and a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In order to solve the technical problems, the embodiment of the application also provides computer equipment. Referring specifically to fig. 4, fig. 4 is a basic structural block diagram of a computer device according to the present embodiment.
The computer device 4 comprises a memory 41, a processor 42, a network interface 43 communicatively connected to each other via a system bus. It is noted that only a computer device 4 having a component connection memory 41, a processor 42, a network interface 43 is shown in the figures, but it is understood that not all of the illustrated components are required to be implemented and that more or fewer components may be implemented instead. It will be appreciated by those skilled in the art that the computer device herein is a device capable of automatically performing numerical calculations and/or information processing in accordance with predetermined or stored instructions, the hardware of which includes, but is not limited to, microprocessors, application specific integrated circuits (Application Specific Integrated Circuit, ASICs), programmable gate arrays (fields-Programmable Gate Array, FPGAs), digital processors (Digital Signal Processor, DSPs), embedded devices, etc.
The computer equipment can be a desktop computer, a notebook computer, a palm computer, a cloud server and other computing equipment. The computer equipment can perform man-machine interaction with a user through a keyboard, a mouse, a remote controller, a touch pad or voice control equipment and the like.
The memory 41 includes at least one type of readable storage medium including flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or D interface display memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the storage 41 may be an internal storage unit of the computer device 4, such as a hard disk or a memory of the computer device 4. In other embodiments, the memory 41 may also be an external storage device of the computer device 4, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like, which are provided on the computer device 4. Of course, the memory 41 may also comprise both an internal memory unit of the computer device 4 and an external memory device. In this embodiment, the memory 41 is typically used for storing an operating system and various application software installed on the computer device 4, such as program codes for controlling electronic files, etc. Further, the memory 41 may be used to temporarily store various types of data that have been output or are to be output.
The processor 42 may be a central processing unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments. The processor 42 is typically used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is configured to execute the program code stored in the memory 41 or process data, such as program code for executing data access.
The network interface 43 may comprise a wireless network interface or a wired network interface, which network interface 43 is typically used for establishing a communication connection between the computer device 4 and other electronic devices.
The present application also provides another embodiment, namely, a computer-readable storage medium storing a data access program executable by at least one processor to cause the at least one processor to perform the steps of the method for processing a data access request as described above.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.
It is apparent that the embodiments described above are only some embodiments of the present application, but not all embodiments, the preferred embodiments of the present application are given in the drawings, but not limiting the patent scope of the present application. This application may be embodied in many different forms, but rather, embodiments are provided in order to provide a more thorough understanding of the present disclosure. Although the present application has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments described in the foregoing, or equivalents may be substituted for elements thereof. All equivalent structures made by the specification and the drawings of the application are directly or indirectly applied to other related technical fields, and are also within the protection scope of the application.
Claims (4)
1. The processing method of the data access request is applied to a cluster server and is characterized by comprising the following steps:
when a data access request sent by a client is received, acquiring an IP address of the client, and determining a real physical address of the client based on the IP address;
according to preset screening conditions, nodes corresponding to the real physical address distance are obtained from cluster server nodes and serve as candidate nodes;
performing health examination on each candidate node, and taking the nodes with healthy examination results as effective nodes;
selecting a target node from the effective nodes based on a dynamic balancing mode, and responding to the data access request based on the target node;
the step of obtaining the node corresponding to the real physical address distance from the cluster server node according to the preset screening condition, wherein the step of obtaining the node as a candidate node comprises the following steps:
determining a geographic area corresponding to the real physical address as a target geographic area;
reading nodes in the cluster server nodes, the areas of which correspond to the target geographic areas, as initial nodes;
acquiring an actual physical address of each initial node, and calculating a distance interval between the actual physical address of each initial node and the target geographic area;
taking the intermediate value of each distance interval as the reference distance between the actual physical address and the target geographic area, and sequencing the reference distances from small to large to obtain a distance sequence;
selecting a preset number of reference distances from front to back in the distance sequence to serve as target reference distances;
taking the node corresponding to the target reference distance as the candidate node;
and performing health check on each candidate node, and taking the node with the check result being healthy as an effective node, wherein the method comprises the following steps:
acquiring node parameter information of each candidate node according to each candidate node, wherein the node parameter information comprises at least one of node throughput, data packet quantity, request number response speed, delay and Round Trip Time (RTT);
based on the node parameter information and preset weights, carrying out health calculation on each candidate node to obtain a health score corresponding to each candidate node;
confirming the candidate nodes with the health scores exceeding a preset score threshold as healthy nodes with healthy results, and taking the nodes with the healthy examination results as the effective nodes;
the dynamic equalization-based mode for selecting the target node from the effective nodes comprises the following steps:
acquiring a historical stability score of each effective node;
for each effective node, comprehensively evaluating the effective node based on the historical stability scores and the health scores to obtain evaluation scores;
taking the effective node with the maximum evaluation value as the target node;
the processing method of the data access request further comprises the following steps before the historical stability score of each effective node is obtained:
after each data access request is processed, performing stability scoring on a target node executing the data access request to obtain a basic stability score;
and carrying out data analysis on the basic stability scores of each time of the target node executing the data access request, obtaining the historical stability scores of the target node executing the data access request, and storing the historical stability scores.
2. A processing apparatus for a data access request, the processing apparatus for a data access request comprising:
the system comprises a physical address acquisition module, a data processing module and a data processing module, wherein the physical address acquisition module is used for acquiring an IP address of a client when receiving a data access request sent by the client, and determining a real physical address of the client based on the IP address;
the candidate node determining module is used for acquiring a node corresponding to the real physical address distance from the cluster server nodes according to a preset screening condition, and taking the node as a candidate node;
the effective node screening module is used for carrying out health examination on each candidate node and taking the nodes with healthy examination results as effective nodes;
the access request response module is used for selecting a target node from the effective nodes based on a dynamic balance mode and responding to the data access request based on the target node, wherein a historical stability score of each effective node is obtained; for each effective node, comprehensively evaluating the effective node based on the historical stability scores and the health scores to obtain evaluation scores; taking the effective node with the maximum evaluation value as the target node; the processing method of the data access request further comprises the following steps before the historical stability score of each effective node is obtained: after each data access request is processed, performing stability scoring on a target node executing the data access request to obtain a basic stability score; performing data analysis on each basic stability score of a target node executing the data access request to obtain a historical stability score of the target node executing the data access request, and storing the historical stability score;
the candidate node determination module includes:
the geographic area determining unit is used for determining a geographic area corresponding to the real physical address as a target geographic area;
an initial node obtaining unit, configured to read, as an initial node, a node in a cluster server node, where the node corresponds to the target geographic area;
the distance calculation unit is used for acquiring the actual physical address of each initial node and calculating a distance interval between the actual physical address of each initial node and the target geographic area;
the distance sorting unit is used for taking the intermediate value of each distance interval as the reference distance between the actual physical address and the target geographic area, and sorting the reference distances from small to large to obtain a distance sequence;
the target reference distance selecting unit is used for selecting a preset number of reference distances from front to back in the distance sequence to serve as target reference distances;
a candidate node determining unit, configured to use a node corresponding to the target reference distance as the candidate node;
the effective node screening module comprises:
a node parameter information obtaining unit, configured to obtain, for each candidate node, node parameter information of the candidate node, where the node parameter information includes at least one of node throughput, number of data packets, request number response speed, delay, and round trip time RTT;
the health score calculation unit is used for carrying out health calculation on each candidate node based on the node parameter information and the preset weight to obtain a health score corresponding to each candidate node;
and the effective node determining unit is used for confirming the candidate nodes with the health scores exceeding a preset score threshold as healthy nodes with the health results, and taking the nodes with the checked results as healthy nodes as the effective nodes.
3. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the method of processing a data access request according to claim 1 when executing the computer program.
4. A computer-readable storage medium storing a computer program, characterized in that the computer program, when executed by a processor, implements the method of processing a data access request according to claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111188949.5A CN114095567B (en) | 2021-10-12 | 2021-10-12 | Data access request processing method and device, computer equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111188949.5A CN114095567B (en) | 2021-10-12 | 2021-10-12 | Data access request processing method and device, computer equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114095567A CN114095567A (en) | 2022-02-25 |
| CN114095567B true CN114095567B (en) | 2023-12-29 |
Family
ID=80296900
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111188949.5A Active CN114095567B (en) | 2021-10-12 | 2021-10-12 | Data access request processing method and device, computer equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114095567B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114745565B (en) * | 2022-04-14 | 2023-10-20 | 上海哔哩哔哩科技有限公司 | Scheduling method and device for edge nodes |
| CN114884944B (en) * | 2022-04-28 | 2024-04-30 | 广东电网有限责任公司 | Data processing method, device, equipment and storage medium |
| CN115277566B (en) * | 2022-05-20 | 2024-03-22 | 鸬鹚科技(深圳)有限公司 | Load balancing method and device for data access, computer equipment and medium |
| CN116708035B (en) * | 2023-08-07 | 2023-10-03 | 钛合联(深圳)科技有限公司 | Network data security encryption method and system |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000315200A (en) * | 1998-09-24 | 2000-11-14 | Alteon Web Systems Inc | Decentralized load balanced internet server |
| US8539080B1 (en) * | 2012-12-18 | 2013-09-17 | Microsoft Corporation | Application intelligent request management based on server health and client information |
| WO2017166803A1 (en) * | 2016-03-30 | 2017-10-05 | 华为技术有限公司 | Resource scheduling method and device |
| CN110727499A (en) * | 2019-09-18 | 2020-01-24 | 平安科技（深圳）有限公司 | Resource data acquisition method and device, computer equipment and storage medium |
| CN110856103A (en) * | 2019-11-18 | 2020-02-28 | 腾讯科技（深圳）有限公司 | Scheduling method, communication method and related equipment |
| CN111064821A (en) * | 2019-12-23 | 2020-04-24 | 北京达佳互联信息技术有限公司 | Method and device for determining IP address of edge node |
| CN111857990A (en) * | 2020-06-23 | 2020-10-30 | 苏州浪潮智能科技有限公司 | Method and system for enhancing YARN long type service scheduling |
| WO2021120969A1 (en) * | 2020-02-21 | 2021-06-24 | 聚好看科技股份有限公司 | Domain name resolution method, domain name resolution server, and terminal device |
| CN113181658A (en) * | 2021-05-20 | 2021-07-30 | 腾讯科技（深圳）有限公司 | Edge computing node scheduling method, device, equipment and medium |
| CN113259428A (en) * | 2021-05-11 | 2021-08-13 | 鸬鹚科技(深圳)有限公司 | Data access request processing method and device, computer equipment and medium |
| CN113282565A (en) * | 2020-02-19 | 2021-08-20 | 广州虎牙科技有限公司 | Data access method, device, scheduling equipment and storage medium |
| CN113315825A (en) * | 2021-05-24 | 2021-08-27 | 康键信息技术（深圳）有限公司 | Distributed request processing method, device, equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9398467B2 (en) * | 2014-09-05 | 2016-07-19 | Verizon Patent And Licensing Inc. | System and method for providing extension of network coverage |
| CN108064439B (en) * | 2017-10-17 | 2021-04-06 | 达闼机器人有限公司 | Network path optimization method, system, control server and network access terminal |
| US11064417B2 (en) * | 2018-05-10 | 2021-07-13 | Telefonaktiebolaget Lm Ericsson (Publ) | QoS and hop-aware adaptation layer for multi-hop integrated access backhaul system |
-
2021
- 2021-10-12 CN CN202111188949.5A patent/CN114095567B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000315200A (en) * | 1998-09-24 | 2000-11-14 | Alteon Web Systems Inc | Decentralized load balanced internet server |
| US8539080B1 (en) * | 2012-12-18 | 2013-09-17 | Microsoft Corporation | Application intelligent request management based on server health and client information |
| WO2017166803A1 (en) * | 2016-03-30 | 2017-10-05 | 华为技术有限公司 | Resource scheduling method and device |
| CN110727499A (en) * | 2019-09-18 | 2020-01-24 | 平安科技（深圳）有限公司 | Resource data acquisition method and device, computer equipment and storage medium |
| CN110856103A (en) * | 2019-11-18 | 2020-02-28 | 腾讯科技（深圳）有限公司 | Scheduling method, communication method and related equipment |
| CN111064821A (en) * | 2019-12-23 | 2020-04-24 | 北京达佳互联信息技术有限公司 | Method and device for determining IP address of edge node |
| CN113282565A (en) * | 2020-02-19 | 2021-08-20 | 广州虎牙科技有限公司 | Data access method, device, scheduling equipment and storage medium |
| WO2021120969A1 (en) * | 2020-02-21 | 2021-06-24 | 聚好看科技股份有限公司 | Domain name resolution method, domain name resolution server, and terminal device |
| CN111857990A (en) * | 2020-06-23 | 2020-10-30 | 苏州浪潮智能科技有限公司 | Method and system for enhancing YARN long type service scheduling |
| CN113259428A (en) * | 2021-05-11 | 2021-08-13 | 鸬鹚科技(深圳)有限公司 | Data access request processing method and device, computer equipment and medium |
| CN113181658A (en) * | 2021-05-20 | 2021-07-30 | 腾讯科技（深圳）有限公司 | Edge computing node scheduling method, device, equipment and medium |
| CN113315825A (en) * | 2021-05-24 | 2021-08-27 | 康键信息技术（深圳）有限公司 | Distributed request processing method, device, equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| an energy-aware and predictive fuzzy logic-based routing scheme in flying ad hoc networks (FANETS);Sang-Woong Lee, etal.;《IEEE ACCESS》;第9卷;全文 * |
| 社会机会网络中基于节点相似性的信任转发算法;袁江涛;张振宇;杨文忠;;计算机应用与软件(09);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114095567A (en) | 2022-02-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114095567B (en) | Data access request processing method and device, computer equipment and medium | |
| CN109729131B (en) | Application request processing method and device and router | |
| CN107239701B (en) | Method and device for identifying malicious website | |
| CN115277566B (en) | Load balancing method and device for data access, computer equipment and medium | |
| CN113259428A (en) | Data access request processing method and device, computer equipment and medium | |
| CN113890879B (en) | Load balancing method and device for data access, computer equipment and medium | |
| CN109582844A (en) | A kind of method, apparatus and system identifying crawler | |
| CN115858311A (en) | Operation and maintenance monitoring method and device, electronic equipment and readable storage medium | |
| CN104573486A (en) | Vulnerability detection method and device | |
| CN113191114A (en) | Method and apparatus for authenticating a system | |
| CN116545905A (en) | Service health detection method and device, electronic equipment and storage medium | |
| CN114124883B (en) | Data access method and device based on cloud storage address, computer equipment and medium | |
| CN113590447B (en) | Buried point processing method and device | |
| CN115470399A (en) | ID (identity) communication method, device, equipment and storage medium based on big data | |
| CN110891097B (en) | Cross-device user identification method and device | |
| CN113239396A (en) | Data access system, method, device, computer equipment and medium | |
| CN113590352A (en) | Data calling method, device, equipment and readable storage medium | |
| CN108551484B (en) | User information synchronization method, device, computer device and storage medium | |
| CN113242302A (en) | Data access request processing method and device, computer equipment and medium | |
| CN111600769A (en) | Site detection method and device and storage medium | |
| CN110719260B (en) | Intelligent network security analysis method and device and computer readable storage medium | |
| CN111475289B (en) | Load balancing method and device | |
| CN113239296B (en) | Method, device, equipment and medium for displaying small program | |
| CN116010744A (en) | Page data processing method and device, electronic equipment and readable storage medium | |
| CN115269353A (en) | Energy consumption pressure measurement method and device of server, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |