CN113259428A - Data access request processing method and device, computer equipment and medium - Google Patents
Data access request processing method and device, computer equipment and medium Download PDFInfo
- Publication number
- CN113259428A CN113259428A CN202110510256.7A CN202110510256A CN113259428A CN 113259428 A CN113259428 A CN 113259428A CN 202110510256 A CN202110510256 A CN 202110510256A CN 113259428 A CN113259428 A CN 113259428A
- Authority
- CN
- China
- Prior art keywords
- node
- data access
- access request
- effective
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Abstract
The invention discloses a method and a device for processing a data access request, computer equipment and a storage medium, wherein the method comprises the following steps: when a data access request sent by a client is received, each node in a cluster is actively detected in a cluster communication mode to obtain a node state, the node state is an activated node and is used as an effective node, then health check is carried out on the effective node aiming at each effective node to obtain a check result, meanwhile, an actual physical address of the client is obtained, the actual physical address of each effective node is read, the physical distance between the client and each effective node is determined based on the actual physical address of the client and the actual physical address of the effective node, a target node is determined based on the check result and each physical distance of each effective node, and the data access request is distributed to the target node for data processing.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a method and an apparatus for processing a data access request, a computer device, and a medium.
Background
With the rapid development of computer technology, more and more transactions are processed through a network to access the internet to obtain information, which is a common thing in daily life, and data access is performed through the network, mainly through a client accessing an appointed domain name or an IP address, and then corresponding data resources are obtained from a storage server corresponding to the appointed domain name or IP address to obtain corresponding information. Therefore, with the rapid increase of access data, the requirements for the performance of a server performing network data access and the like are higher and higher, and the existing method is to add some servers for concurrent use to relieve the pressure of the servers, but the existing method usually directly performs random distribution, and how to reasonably perform distribution of data access requests so that the data access requests can be responded to the fastest, that is, how to improve the response speed of the data access requests becomes a problem to be solved urgently.
Disclosure of Invention
The embodiment of the invention provides a method and a device for processing a data access request, computer equipment and a storage medium, which are used for improving the response speed of the data access request.
In order to solve the foregoing technical problem, an embodiment of the present application provides a method for processing a data access request, including:
when a data access request sent by a client is received, performing activity detection on each node in a cluster communication mode to obtain a node state;
taking the node with the node state as an activated node as an effective node;
for each effective node, carrying out health check on the effective node to obtain a check result;
acquiring an actual physical address of the client, reading the actual physical address of each effective node, and determining a physical distance between the client and each effective node based on the actual physical address of the client and the actual physical address of the effective node;
determining a target node based on the inspection result of each effective node and each physical distance;
and distributing the data access request to the target node for data processing.
Optionally, the performing activity detection on each node in the cluster by means of cluster communication to obtain a node state includes:
sending a heartbeat packet detection instruction to each node based on cluster communication;
and determining the node state corresponding to each node according to the feedback result of each node aiming at the heartbeat packet detection instruction.
Optionally, the obtaining the actual physical address of the client includes:
acquiring a client IP address carried in a data access request;
determining an actual physical address of the client based on the IP address.
Optionally, the health check category includes node throughput, number of packets, request number response speed, delay time, and round trip time RTT.
Optionally, the determining a target node based on the inspection result of each valid node and each physical distance includes:
for each physical distance, carrying out normalization processing on the physical distance, and taking an obtained result as the distance weight of the effective node corresponding to the physical distance;
obtaining a health score of each effective node based on the inspection result of the effective node;
aiming at each effective node, calculating a matching score of the effective node in a preset mode according to the distance weight and the health score;
and obtaining the effective node with the maximum matching score as the target node.
In order to solve the foregoing technical problem, an embodiment of the present application further provides a data access request processing apparatus, including:
the state detection module is used for performing activity detection on each node in the cluster in a cluster communication mode when receiving a data access request sent by a client to obtain a node state;
a node obtaining module, configured to use the node with the activated node state as an active node;
the health check module is used for carrying out health check on the effective nodes aiming at each effective node to obtain a check result;
the distance determining module is used for acquiring the actual physical address of the client, reading the actual physical address of each effective node, and determining the physical distance between the client and each effective node based on the actual physical address of the client and the actual physical address of the effective node;
a target node determination module, configured to determine a target node based on the inspection result of each valid node and each physical distance;
and the data distribution module is used for distributing the data access request to the target node for data processing.
Optionally, the state detection module includes:
the heartbeat detection unit is used for sending a heartbeat packet detection instruction to each node based on cluster communication;
and the state determining unit is used for determining the node state corresponding to each node according to the feedback result of each node aiming at the heartbeat packet detection instruction.
Optionally, the distance determining module comprises:
the IP address acquisition unit is used for acquiring the IP address of the client carried in the data access request;
and the physical address determining unit is used for determining the actual physical address of the client based on the IP address.
Optionally, the target node determining module includes:
a distance weight calculation unit, configured to perform normalization processing on the physical distance for each physical distance, and use an obtained result as a distance weight of an effective node corresponding to the physical distance;
the health scoring unit is used for obtaining the health score of each effective node based on the inspection result of each effective node;
the matching scoring unit is used for calculating the matching scoring of the effective nodes in a preset mode according to the distance weight and the health scoring aiming at each effective node;
and the target node determining unit is used for acquiring the effective node with the maximum matching score as the target node.
In order to solve the above technical problem, an embodiment of the present application further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method for processing the data access request when executing the computer program.
In order to solve the above technical problem, an embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the steps of the above data access request processing method.
In the method, the device, the computer equipment and the storage medium for processing the data access request provided by the embodiment of the invention, when the data access request sent by the client is received, the activity of each node in the cluster is detected in a cluster communication mode to obtain the node state, the node state is an activated node as an effective node, then health check is carried out on the effective node aiming at each effective node to obtain a check result, meanwhile, the actual physical address of the client is obtained, the actual physical address of each effective node is read, the physical distance between the client and each effective node is determined based on the actual physical address of the client and the actual physical address of the effective node, the target node is determined based on the check result and each physical distance of each effective node, the data access request is distributed to the target node for data processing, the node server optimal to the data access request is quickly determined through multiple dimensions, and the response efficiency of the data access request is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
FIG. 1 is a schematic diagram of an application environment of the present application;
FIG. 2 is a flow diagram of one embodiment of a method of processing a data access request of the present application;
FIG. 3 is a block diagram illustrating one embodiment of a device for processing a data access request according to the present application;
FIG. 4 is a schematic block diagram of one embodiment of a computer device according to the present application.
Detailed Description
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "including" and "having," and any variations thereof, in the description and claims of this application and the description of the above figures are intended to cover non-exclusive inclusions. The terms "first," "second," and the like in the description and claims of this application or in the above-described drawings are used for distinguishing between different objects and not for describing a particular order.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a schematic diagram of an application environment for processing a data access request according to this embodiment, in fig. 1(a), a global load balancing device is deployed outside a data center and supports a single machine or redundancy, and in fig. 1(b), the global load balancing device is deployed inside each data center (supports a single machine or redundancy in each center) to form a cluster and provide DNS service to outside uniformly.
All global load balancing will automatically synchronize configuration and performance data. When the servers of any data center are in balance downtime, the whole DNS server is not influenced.
Referring to fig. 2, fig. 2 shows a method for processing a data access request according to an embodiment of the present invention, which is detailed as follows:
s201: when a data access request sent by a client is received, each node in the cluster is actively detected in a cluster communication mode to obtain a node state.
Specifically, when a data access request sent by a client is received, activity detection is carried out on each node in the cluster so as to determine the node state.
It should be noted that there are multiple nodes (node servers) in the cluster, and due to some control policies and performance factors of the nodes themselves, the nodes may be dynamically brought online and offline, so that to ensure the effectiveness of subsequent data access request distribution and processing, the state of the nodes needs to be determined first.
The node states include activated, down and not activated.
S202: and taking the node with the node state as an active node.
S203: and aiming at each effective node, carrying out health check on the effective node to obtain a check result.
Wherein the health check is used to determine the service availability of the node server (ECS instance). The health check mechanism improves the whole availability of the front-end service, avoids the influence of the rear-end ECS abnormity on the overall service, and carries out the existing main modes of health check, including seven-layer check, four-layer check, load balance and the like.
Optionally, the categories of health check include node throughput, number of packets, request number response speed, delay and round trip time RTT.
S204: and acquiring the actual physical address of the client, reading the actual physical address of each effective node, and determining the physical distance between the client and each effective node based on the actual physical address of the client and the actual physical address of the effective node.
It should be understood that the nodes in the cluster are distributed, that is, different nodes may have the same physical address or different physical addresses (usually different physical addresses according to actual situations, for example, a node is saved, B is saved by one node), and the closer the physical address corresponding to the client IP address of the data access request is to the physical address of the node, the shorter the time consumed for information propagation (data transmission and reception) will be.
S205: and determining a target node based on the inspection result of each effective node and each physical distance.
Specifically, the matching degree of each effective node and the data access request is calculated according to the checking result and the physical distance of each effective node, and then the target node is determined according to the matching degree of each effective node. For a specific implementation process, reference may be made to the description of the subsequent embodiments, and in order to avoid repetition, details are not described here.
S206: and distributing the data access request to the target node for data processing.
In the embodiment, when a data access request sent by a client is received, each node in a cluster is actively detected in a cluster communication mode to obtain a node state, the node state is an activated node and is used as an effective node, then health check is performed on the effective node aiming at each effective node to obtain a check result, meanwhile, an actual physical address of the client is obtained and read, the actual physical address of each effective node is read, the physical distance between the client and each effective node is determined based on the actual physical address of the client and the actual physical address of the effective node, a target node is determined based on the check result and each physical distance of each effective node, the data access request is distributed to the target node for data processing, and the node server optimal to the data access request is quickly determined through multiple dimensions, the response efficiency of the data access request is improved.
In a specific optional implementation manner, in step S201, performing activity detection on each node in the cluster in a cluster communication manner, and obtaining a node state includes:
sending a heartbeat packet detection instruction to each node based on cluster communication;
and determining the node state corresponding to each node according to the feedback result of each node aiming at the heartbeat packet detection instruction.
Specifically, whether the link state of the network connection port of the node corresponding to the heartbeat packet is normal is judged by sending a heartbeat packet detection instruction to each node, and when the link state is normal, the node interactively responds with the server according to the heartbeat packet detection instruction.
It should be understood that an anomaly can be timely discovered through heartbeat monitoring, for example, if no feedback of the node server to the heartbeat packet is received within a period of time, it is determined that the link state of the node is abnormal, at this time, the node is removed from the list of the valid nodes, the subsequent data access request is prevented from being distributed to the node, and meanwhile, the abnormal condition is timely displayed on an interactive interface of the server, so that a maintainer can timely analyze and process the related anomaly problem appearing on the corresponding cluster node.
The heartbeat packet is a self-defined command word which is used for regularly informing the self state of the opposite side between the target host and the server, is sent according to a certain time interval, is similar to a heartbeat, and is called as a heartbeat packet. The heartbeat package is used for monitoring the availability of the SOCKET and ensuring the stability of interaction between the server and the target host.
In the embodiment, the state of the node is judged in a heartbeat detection mode, so that the follow-up selection from the effective nodes is ensured, the invalid nodes are prevented from participating in the follow-up selection operation, unnecessary operation is brought, and the efficiency of selecting the follow-up target node is improved.
In a specific optional implementation manner, in step S204, the obtaining the actual physical address of the client includes:
acquiring a client IP address carried in a data access request;
based on the IP address, the actual physical address of the client is determined.
It should be noted that, in some cases, the client may use an IP proxy, where the IP address in this embodiment is an IP address used by the client to send a data access request, that is, the IP address may be a real IP address of the client or an agent IP address, and if the agent IP address is used by the client, the obtained actual physical address is an actual physical address of the agent IP address, and the actual physical address and an actual physical address of the valid node are subsequently calculated, and the obtained physical distance also meets the requirement of node matching.
In this embodiment, by acquiring the IP address of the client, the actual physical address corresponding to the client network is further acquired, which is beneficial to subsequently matching the nodes according to the physical address.
In a specific optional embodiment, in step S205, determining the target node based on the inspection result of each valid node and each physical distance includes:
for each physical distance, carrying out normalization processing on the physical distance, and taking the obtained result as the distance weight of the effective node corresponding to the physical distance;
obtaining the health score of each effective node based on the inspection result of each effective node;
calculating the matching score of each effective node in a preset mode according to the distance weight and the health score;
and obtaining the effective node with the maximum matching score as a target node.
Normalization (normalization) is a dimensionless processing means, and makes the absolute value of the physical system value become a certain relative value relation. The effective method for simplifying calculation and reducing the magnitude can be specifically to unify a plurality of numerical values with large variation ranges into one interval. In this embodiment, the physical distance is normalized, and the obtained result is used as the distance weight of the effective node, so that the distance is used as one dimension to evaluate the matching degree between the data access request and the effective node.
The preset manner may be a formula set according to actual requirements, and the like, and is not limited in detail here.
In the embodiment, the numerical value after the normalization of the physical distance is used as the distance weight, and each effective node is calculated by combining the health score, so that the method has higher pertinence to each different data access request, has higher matching degree, improves the accuracy of obtaining the target node, and is favorable for improving the speed of data access response.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Fig. 3 shows a schematic block diagram of a data access request processing device in one-to-one correspondence with the processing methods of the data access requests of the above-described embodiments. As shown in fig. 3, the data access request processing device includes a status detection module 31, a node acquisition module 32, a health check module 33, a distance determination module 34, a target node determination module 35, and a data distribution module 36. The functional modules are explained in detail as follows:
the state detection module 31 is configured to perform activity detection on each node in the cluster in a cluster communication manner when receiving a data access request sent by a client, so as to obtain a node state;
a node obtaining module 32, configured to use a node with an activated node state as an active node;
the health check module 33 is configured to perform health check on the valid nodes for each valid node to obtain a check result;
a distance determining module 34, configured to obtain an actual physical address of the client, read an actual physical address of each valid node, and determine a physical distance between the client and each valid node based on the actual physical address of the client and the actual physical address of the valid node;
a target node determining module 35, configured to determine a target node based on the inspection result of each valid node and each physical distance;
and the data distribution module 36 is configured to distribute the data access request to the target node for data processing.
Optionally, the state detection module 31 includes:
the heartbeat detection unit is used for sending a heartbeat packet detection instruction to each node based on cluster communication;
and the state determining unit is used for determining the node state corresponding to each node according to the feedback result of each node aiming at the heartbeat packet detection instruction.
Optionally, the distance determining module 34 comprises:
the IP address acquisition unit is used for acquiring the IP address of the client carried in the data access request;
and the physical address determining unit is used for determining the actual physical address of the client based on the IP address.
Optionally, the target node determining module 35 includes:
the distance weight calculation unit is used for carrying out normalization processing on the physical distances according to each physical distance and taking the obtained result as the distance weight of the effective node corresponding to the physical distance;
the health scoring unit is used for obtaining the health score of each effective node based on the inspection result of each effective node;
the matching scoring unit is used for calculating the matching scoring of the effective nodes in a preset mode according to the distance weight and the health scoring aiming at each effective node;
and the target node determining unit is used for acquiring the effective node with the maximum matching score as the target node.
The specific definition of the processing device for the data access request may refer to the above definition of the processing method for the data access request, and is not described herein again. The respective modules in the data access request processing apparatus described above may be implemented wholly or partially by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In order to solve the technical problem, an embodiment of the present application further provides a computer device. Referring to fig. 4, fig. 4 is a block diagram of a basic structure of a computer device according to the present embodiment.
The computer device 4 comprises a memory 41, a processor 42, a network interface 43 communicatively connected to each other via a system bus. It is noted that only the computer device 4 having the components connection memory 41, processor 42, network interface 43 is shown, but it is understood that not all of the shown components are required to be implemented, and that more or fewer components may be implemented instead. As will be understood by those skilled in the art, the computer device is a device capable of automatically performing numerical calculation and/or information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded device, and the like.
The computer device can be a desktop computer, a notebook, a palm computer, a cloud server and other computing devices. The computer equipment can carry out man-machine interaction with a user through a keyboard, a mouse, a remote controller, a touch panel or voice control equipment and the like.
The memory 41 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or D interface display memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the memory 41 may be an internal storage unit of the computer device 4, such as a hard disk or a memory of the computer device 4. In other embodiments, the memory 41 may also be an external storage device of the computer device 4, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the computer device 4. Of course, the memory 41 may also include both internal and external storage devices of the computer device 4. In this embodiment, the memory 41 is generally used for storing an operating system installed in the computer device 4 and various types of application software, such as program codes for controlling electronic files. Further, the memory 41 may also be used to temporarily store various types of data that have been output or are to be output.
The processor 42 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip in some embodiments. The processor 42 is typically used to control the overall operation of the computer device 4. In this embodiment, the processor 42 is configured to execute the program code stored in the memory 41 or process data, for example, execute the program code for data access.
The network interface 43 may comprise a wireless network interface or a wired network interface, and the network interface 43 is generally used for establishing communication connection between the computer device 4 and other electronic devices.
The present application provides yet another embodiment, which provides a computer-readable storage medium storing a data access program, the data access program being executable by at least one processor to cause the at least one processor to perform the steps of the method of processing a data access request as described above.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
It is to be understood that the above-described embodiments are merely illustrative of some, but not restrictive, of the broad invention, and that the appended drawings illustrate preferred embodiments of the invention and do not limit the scope of the invention. This application is capable of embodiments in many different forms and is provided for the purpose of enabling a thorough understanding of the disclosure of the application. Although the present application has been described in detail with reference to the foregoing embodiments, it will be apparent to one skilled in the art that the present application may be practiced without modification or with equivalents of some of the features described in the foregoing embodiments. All equivalent structures made by using the contents of the specification and the drawings of the present application are directly or indirectly applied to other related technical fields and are within the protection scope of the present application.
Claims (10)
1. A method for processing a data access request is characterized by comprising the following steps:
when a data access request sent by a client is received, performing activity detection on each node in a cluster communication mode to obtain a node state;
taking the node with the node state as an activated node as an effective node;
for each effective node, carrying out health check on the effective node to obtain a check result;
acquiring an actual physical address of the client, reading the actual physical address of each effective node, and determining a physical distance between the client and each effective node based on the actual physical address of the client and the actual physical address of the effective node;
determining a target node based on the inspection result of each effective node and each physical distance;
and distributing the data access request to the target node for data processing.
2. The method for processing a data access request according to claim 1, wherein the performing activity detection on each node in the cluster by means of cluster communication to obtain the node status comprises:
sending a heartbeat packet detection instruction to each node based on cluster communication;
and determining the node state corresponding to each node according to the feedback result of each node aiming at the heartbeat packet detection instruction.
3. The method of processing a data access request according to claim 1, wherein said obtaining an actual physical address of the client comprises:
acquiring a client IP address carried in a data access request;
determining an actual physical address of the client based on the IP address.
4. The method of processing a data access request of claim 1, wherein the categories of health check include node throughput, number of packets, request number response speed, latency, and round trip delay RTT.
5. The method of processing a data access request according to any of claims 1 to 4, wherein said determining a target node based on the result of the check of each of said valid nodes and each of said physical distances comprises:
for each physical distance, carrying out normalization processing on the physical distance, and taking an obtained result as the distance weight of the effective node corresponding to the physical distance;
obtaining a health score of each effective node based on the inspection result of the effective node;
aiming at each effective node, calculating a matching score of the effective node in a preset mode according to the distance weight and the health score;
and obtaining the effective node with the maximum matching score as the target node.
6. A data access request processing apparatus, the data access request processing apparatus comprising:
the state detection module is used for performing activity detection on each node in the cluster in a cluster communication mode when receiving a data access request sent by a client to obtain a node state;
a node obtaining module, configured to use the node with the activated node state as an active node;
the health check module is used for carrying out health check on the effective nodes aiming at each effective node to obtain a check result;
the distance determining module is used for acquiring the actual physical address of the client, reading the actual physical address of each effective node, and determining the physical distance between the client and each effective node based on the actual physical address of the client and the actual physical address of the effective node;
a target node determination module, configured to determine a target node based on the inspection result of each valid node and each physical distance;
and the data distribution module is used for distributing the data access request to the target node for data processing.
7. The apparatus for processing a data access request according to claim 6, wherein the state detection module comprises:
the heartbeat detection unit is used for sending a heartbeat packet detection instruction to each node based on cluster communication;
and the state determining unit is used for determining the node state corresponding to each node according to the feedback result of each node aiming at the heartbeat packet detection instruction.
8. The apparatus for processing a data access request according to claim 6, wherein the distance determination module comprises:
the IP address acquisition unit is used for acquiring the IP address of the client carried in the data access request;
and the physical address determining unit is used for determining the actual physical address of the client based on the IP address.
9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the method of processing a data access request according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out a method of processing a data access request according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110510256.7A CN113259428A (en) | 2021-05-11 | 2021-05-11 | Data access request processing method and device, computer equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110510256.7A CN113259428A (en) | 2021-05-11 | 2021-05-11 | Data access request processing method and device, computer equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113259428A true CN113259428A (en) | 2021-08-13 |
Family
ID=77222615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110510256.7A Pending CN113259428A (en) | 2021-05-11 | 2021-05-11 | Data access request processing method and device, computer equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259428A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113778346A (en) * | 2021-11-12 | 2021-12-10 | 深圳市名竹科技有限公司 | Data reading method, device, equipment and storage medium |
| CN113885794A (en) * | 2021-09-10 | 2022-01-04 | 鸬鹚科技(深圳)有限公司 | Data access method and device based on multi-cloud storage, computer equipment and medium |
| CN113890879A (en) * | 2021-09-10 | 2022-01-04 | 鸬鹚科技(深圳)有限公司 | Load balancing method and device for data access, computer equipment and medium |
| CN114095567A (en) * | 2021-10-12 | 2022-02-25 | 鸬鹚科技(深圳)有限公司 | Data access request processing method and device, computer equipment and medium |
| CN114221964A (en) * | 2021-12-13 | 2022-03-22 | 中国平安财产保险股份有限公司 | Access request processing method and device, computer equipment and storage medium |
| CN115277566A (en) * | 2022-05-20 | 2022-11-01 | 鸬鹚科技(深圳)有限公司 | Load balancing method and device for data access, computer equipment and medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101552740A (en) * | 2009-05-14 | 2009-10-07 | 腾讯科技（北京）有限公司 | Instant communication system, clients, server and method for judging on-line state |
| CN102404378A (en) * | 2010-09-07 | 2012-04-04 | 成都索贝数码科技股份有限公司 | Streaming media distribution and transmission network system |
| CN105471760A (en) * | 2014-09-12 | 2016-04-06 | 华为技术有限公司 | Routing method, load balancing device and data communication system |
| CN105933429A (en) * | 2016-05-30 | 2016-09-07 | 新奥特（北京）视频技术有限公司 | Server load control method and device |
| US20160381101A1 (en) * | 2015-06-26 | 2016-12-29 | Onwards Media Group Pte Ltd | Method and apparatus for streaming media |
| CN107682397A (en) * | 2017-08-28 | 2018-02-09 | 平安科技（深圳）有限公司 | Customer resources acquisition methods, device, terminal device and storage medium |
| CN108737270A (en) * | 2018-05-07 | 2018-11-02 | 北京京东尚科信息技术有限公司 | A kind of method for managing resource and device of server cluster |
| CN109104377A (en) * | 2018-09-21 | 2018-12-28 | 深圳前海微众银行股份有限公司 | Long connection load-balancing method, equipment, system and computer readable storage medium |
| CN109788012A (en) * | 2017-11-14 | 2019-05-21 | 阿里巴巴集团控股有限公司 | A kind of health examination method and device, health examination control method and controller |
| CN109815204A (en) * | 2018-12-10 | 2019-05-28 | 清华大学 | A kind of metadata request distribution method and equipment based on congestion aware |
| CN110113399A (en) * | 2019-04-24 | 2019-08-09 | 华为技术有限公司 | Load balancing management method and relevant apparatus |
| CN112217859A (en) * | 2020-08-28 | 2021-01-12 | 厦门快商通科技股份有限公司 | Load balancing method, system, mobile terminal and storage medium |
| CN112565327A (en) * | 2019-09-26 | 2021-03-26 | 广州虎牙科技有限公司 | Access flow forwarding method, cluster management method and related device |
-
2021
- 2021-05-11 CN CN202110510256.7A patent/CN113259428A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101552740A (en) * | 2009-05-14 | 2009-10-07 | 腾讯科技（北京）有限公司 | Instant communication system, clients, server and method for judging on-line state |
| CN102404378A (en) * | 2010-09-07 | 2012-04-04 | 成都索贝数码科技股份有限公司 | Streaming media distribution and transmission network system |
| CN105471760A (en) * | 2014-09-12 | 2016-04-06 | 华为技术有限公司 | Routing method, load balancing device and data communication system |
| US20160381101A1 (en) * | 2015-06-26 | 2016-12-29 | Onwards Media Group Pte Ltd | Method and apparatus for streaming media |
| CN105933429A (en) * | 2016-05-30 | 2016-09-07 | 新奥特（北京）视频技术有限公司 | Server load control method and device |
| CN107682397A (en) * | 2017-08-28 | 2018-02-09 | 平安科技（深圳）有限公司 | Customer resources acquisition methods, device, terminal device and storage medium |
| CN109788012A (en) * | 2017-11-14 | 2019-05-21 | 阿里巴巴集团控股有限公司 | A kind of health examination method and device, health examination control method and controller |
| CN108737270A (en) * | 2018-05-07 | 2018-11-02 | 北京京东尚科信息技术有限公司 | A kind of method for managing resource and device of server cluster |
| CN109104377A (en) * | 2018-09-21 | 2018-12-28 | 深圳前海微众银行股份有限公司 | Long connection load-balancing method, equipment, system and computer readable storage medium |
| CN109815204A (en) * | 2018-12-10 | 2019-05-28 | 清华大学 | A kind of metadata request distribution method and equipment based on congestion aware |
| CN110113399A (en) * | 2019-04-24 | 2019-08-09 | 华为技术有限公司 | Load balancing management method and relevant apparatus |
| CN112565327A (en) * | 2019-09-26 | 2021-03-26 | 广州虎牙科技有限公司 | Access flow forwarding method, cluster management method and related device |
| CN112217859A (en) * | 2020-08-28 | 2021-01-12 | 厦门快商通科技股份有限公司 | Load balancing method, system, mobile terminal and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 鄢锋;桂卫华;胡志坤;冯怀成;: "一种网络节点通信控制的心跳模型", 信息与控制, no. 05 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113885794A (en) * | 2021-09-10 | 2022-01-04 | 鸬鹚科技(深圳)有限公司 | Data access method and device based on multi-cloud storage, computer equipment and medium |
| CN113890879A (en) * | 2021-09-10 | 2022-01-04 | 鸬鹚科技(深圳)有限公司 | Load balancing method and device for data access, computer equipment and medium |
| CN113890879B (en) * | 2021-09-10 | 2023-12-29 | 鸬鹚科技(深圳)有限公司 | Load balancing method and device for data access, computer equipment and medium |
| CN113885794B (en) * | 2021-09-10 | 2024-01-26 | 鸬鹚科技(深圳)有限公司 | Data access method and device based on multi-cloud storage, computer equipment and medium |
| CN114095567A (en) * | 2021-10-12 | 2022-02-25 | 鸬鹚科技(深圳)有限公司 | Data access request processing method and device, computer equipment and medium |
| CN114095567B (en) * | 2021-10-12 | 2023-12-29 | 鸬鹚科技(深圳)有限公司 | Data access request processing method and device, computer equipment and medium |
| CN113778346A (en) * | 2021-11-12 | 2021-12-10 | 深圳市名竹科技有限公司 | Data reading method, device, equipment and storage medium |
| CN113778346B (en) * | 2021-11-12 | 2022-02-11 | 深圳市名竹科技有限公司 | Data reading method, device, equipment and storage medium |
| CN114221964A (en) * | 2021-12-13 | 2022-03-22 | 中国平安财产保险股份有限公司 | Access request processing method and device, computer equipment and storage medium |
| CN114221964B (en) * | 2021-12-13 | 2023-10-03 | 中国平安财产保险股份有限公司 | Access request processing method, device, computer equipment and storage medium |
| CN115277566A (en) * | 2022-05-20 | 2022-11-01 | 鸬鹚科技(深圳)有限公司 | Load balancing method and device for data access, computer equipment and medium |
| CN115277566B (en) * | 2022-05-20 | 2024-03-22 | 鸬鹚科技(深圳)有限公司 | Load balancing method and device for data access, computer equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113259428A (en) | Data access request processing method and device, computer equipment and medium | |
| CN108268328B (en) | Data processing device and computer | |
| CN109885452B (en) | Performance monitoring method and device and terminal equipment | |
| US9384114B2 (en) | Group server performance correction via actions to server subset | |
| CN114095567B (en) | Data access request processing method and device, computer equipment and medium | |
| CN108924274B (en) | Domain name system DNS processing method and device, storage medium and electronic equipment | |
| CN107682172B (en) | Control center device, service system processing method and medium | |
| CN110784515B (en) | Data storage method based on distributed cluster and related equipment thereof | |
| CN109510878B (en) | Long connection session keeping method and device | |
| CN111752770A (en) | Service request processing method, system, computer device and storage medium | |
| CN114172829B (en) | Server health monitoring method and system and computing equipment | |
| CN115277566B (en) | Load balancing method and device for data access, computer equipment and medium | |
| CN113259479B (en) | Data processing method and equipment | |
| CN113890879B (en) | Load balancing method and device for data access, computer equipment and medium | |
| CN111416836A (en) | Nginx-based server maintenance method and device, computer equipment and storage medium | |
| CN113885794B (en) | Data access method and device based on multi-cloud storage, computer equipment and medium | |
| CN116743619B (en) | Network service testing method, device, equipment and storage medium | |
| CN111737084A (en) | Information monitoring method and device, intelligent equipment, computer equipment and medium | |
| CN113242302A (en) | Data access request processing method and device, computer equipment and medium | |
| CN113239396A (en) | Data access system, method, device, computer equipment and medium | |
| CN115454896A (en) | SMBUS-based SSD MCTP control message verification method and device, computer equipment and storage medium | |
| CN115604144A (en) | Test method and device, electronic equipment and storage medium | |
| CN112214437B (en) | Storage device, communication method and device and computer readable storage medium | |
| CN114281774A (en) | Log identification method and device, electronic equipment and storage medium | |
| CN113242299A (en) | Disaster recovery system, method, computer device and medium for multiple data centers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |