CN112532764A - Data acquisition method and device - Google Patents
Data acquisition method and device Download PDFInfo
- Publication number
- CN112532764A CN112532764A CN202011388930.0A CN202011388930A CN112532764A CN 112532764 A CN112532764 A CN 112532764A CN 202011388930 A CN202011388930 A CN 202011388930A CN 112532764 A CN112532764 A CN 112532764A
- Authority
- CN
- China
- Prior art keywords
- domain name
- data
- server
- client
- name information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 238000013500 data storage Methods 0.000 claims abstract description 57
- 238000013507 mapping Methods 0.000 claims description 18
- 102100032305 Bcl-2 homologous antagonist/killer Human genes 0.000 description 29
- 101000798320 Homo sapiens Bcl-2 homologous antagonist/killer Proteins 0.000 description 29
- 238000010586 diagram Methods 0.000 description 11
- 230000005540 biological transmission Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/45—Network directories; Name-to-address mapping
- H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
- H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/63—Routing a service request depending on the request content or context
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present specification provides a data acquisition method and apparatus, wherein the data acquisition method includes: receiving a data acquisition request aiming at target data sent by a client, wherein the data acquisition request carries domain name information of the target data and address information of the client; selecting a first resolution server for the client based on the address information, and resolving the domain name information based on the first resolution server; under the condition of failed analysis, selecting a second analysis server for the client, and analyzing the domain name information based on the second analysis server; and determining a data storage position of the target data based on the analysis result, and acquiring the target data from the data storage position.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a data acquisition method. The present specification also relates to a data acquisition apparatus, a computing device, and a computer-readable storage medium.
Background
With the rapid development of internet applications, server service-based applications are becoming more and more widespread, and requirements for accelerating data transmission and shortening delay time are becoming higher and higher, based on which a Content Delivery Network (CDN) is a one-layer intelligent virtual Network on the existing internet basis formed by placing node servers at various places in the Network, and can redirect an access request of a user to a service node closest to the user in real time according to comprehensive information such as Network traffic, connection of each node, load conditions, a distance to the user, and response time, so as to accelerate data transmission, but data acquisition failure caused by Network congestion or node damage cannot be avoided.
Disclosure of Invention
In view of this, the embodiments of the present specification provide a data acquisition method. The present specification also relates to a data acquisition apparatus, a computing device, and a computer-readable storage medium, so as to solve the problem that data cannot be acquired in the prior art.
According to a first aspect of embodiments of the present specification, there is provided a data acquisition method including:
receiving a data acquisition request aiming at target data sent by a client, wherein the data acquisition request carries domain name information of the target data and address information of the client;
selecting a first resolution server for the client based on the address information, and resolving the domain name information based on the first resolution server;
under the condition of failed analysis, selecting a second analysis server for the client, and analyzing the domain name information based on the second analysis server;
and determining a data storage position of the target data based on the analysis result, and acquiring the target data from the data storage position.
According to a second aspect of embodiments herein, there is provided a data acquisition apparatus including:
the data acquisition module is configured to receive a data acquisition request aiming at target data sent by a client, wherein the data acquisition request carries domain name information of the target data and address information of the client;
a first resolution module configured to select a first resolution server for the client based on the address information and to resolve the domain name information based on the first resolution server;
the second resolution module is configured to select a second resolution server for the client under the condition of failed resolution, and to resolve the domain name information based on the second resolution server;
an obtaining module configured to determine a data storage location of the target data based on the parsing result, and obtain the target data from the data storage location.
According to a third aspect of embodiments herein, there is provided a computing device comprising:
a memory and a processor;
the memory is configured to store computer-executable instructions and the processor is configured to execute the computer-executable instructions, wherein the processor implements the steps of the data acquisition method when executing the computer-executable instructions.
According to a fourth aspect of embodiments herein, there is provided a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of any of the data acquisition methods.
The data acquisition method includes receiving a data acquisition request for target data sent by a client, where the data acquisition request carries domain name information of the target data and address information of the client; selecting a first resolution server for the client based on the address information, and resolving the domain name information based on the first resolution server; under the condition of failed analysis, selecting a second analysis server for the client, and analyzing the domain name information based on the second analysis server; and determining a data storage position of the target data based on the analysis result, and acquiring the target data from the data storage position.
According to the data acquisition method, the resolution server is selected by determining the address information of the client, so that the domain name information is resolved, another resolution server is selected for the client under the condition that the resolution fails, the data storage position of the target data is further determined, the target data can be acquired through the other resolution server under the condition that one resolution server fails, the target data can be acquired at high speed under the condition that the node is damaged, and the experience of a user is improved.
Drawings
Fig. 1 is an exemplary diagram of a specific application scenario of a data acquisition method provided in an embodiment of the present specification;
FIG. 2 is a flow chart of a data acquisition method provided in an embodiment of the present specification;
FIG. 3 is a flow chart of a data acquisition method provided in another embodiment of the present description;
fig. 4 is an exemplary diagram of a data acquisition method provided in an embodiment of the present specification, which acquires data by using a CDN server;
fig. 5 is another exemplary diagram illustrating a data obtaining method using a CDN server to obtain data according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a data acquisition apparatus according to an embodiment of the present disclosure;
fig. 7 is a block diagram of a computing device according to an embodiment of the present disclosure.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, as those skilled in the art will be able to make and use the present disclosure without departing from the spirit and scope of the present disclosure.
The terminology used in the description of the one or more embodiments is for the purpose of describing the particular embodiments only and is not intended to be limiting of the description of the one or more embodiments. As used in one or more embodiments of the present specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first can also be referred to as a second and, similarly, a second can also be referred to as a first without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
First, the noun terms to which one or more embodiments of the present specification relate are explained.
CDN (English full name: Content Delivery Network, Chinese full name: Content Delivery Network): one technique for speeding up the speed of a user's link is to implement the principles of node caching, link acceleration, etc.
DNS (English full Name: Domain Name System, Chinese full Name: Domain Name System): a distributed database on the Internet as a mutual mapping between domain names and IP addresses enables users to more conveniently access the Internet without remembering the IP address number string which can be read directly by the machine.
Domain name: is the name of a computer or group of computers on the internet that is made up of a string of names separated by dots that identify the electronic location (sometimes also referred to as the geographic location) of the computer at the time of data transmission.
A source station: and the server stores the whole data of the website.
In practical application, in order to accelerate data access, a data acquisition request sent by a client is used for realizing node caching and data acquisition link acceleration through a CDN, but when the client is provided with one CDN, if the CDN is damaged by a node or has a network disaster tolerance, the client cannot access data, and user experience is sharply reduced.
The data acquisition method provided by the embodiment of the specification is used for solving the problem that data cannot be accessed due to the fact that a CDN is configured at a client side, and can improve the probability of acquiring the data while accelerating the data access. The data acquisition method provided by the embodiment of the present description may be applied to any device, such as a mobile phone, a tablet computer, a desktop, and the like, which configures a CDN to implement accelerated data access.
In the present specification, a data acquisition method is provided, and the present specification relates to a data acquisition apparatus, a computing device, and a computer-readable storage medium, which are described in detail one by one in the following embodiments.
Referring to fig. 1, fig. 1 is a diagram illustrating an example of a specific application scenario of a data acquisition method according to an embodiment of the present specification.
In fig. 1, a user a inputs domain name information a that the user a wants to acquire through a domain name input box of a display interface of a client a, and sends a data acquisition request to a server, where the data acquisition request carries the domain name information a and address information of the client a, a first resolution server configured at the client a parses the domain name information a, and in the case that feedback information of "error occurrence" is displayed in the display interface of the client a, the server can automatically select a second resolution server configured at the client a to parse the domain name information a, determine a data storage location a1 corresponding to the domain name information a based on the parsing result of the domain name information a, and acquire data corresponding to the domain name information a from the data storage location a1, and after acquiring corresponding data, the server returns the data to the client a, where the data content is to be displayed in the display interface of the client a, and meanwhile, feedback information of 'obtaining success' can be displayed in a display interface of the client A.
According to the data acquisition method provided by the embodiment of the specification, the domain name information and the address information carried in the data acquisition request sent by the client are used, and the second resolution server capable of resolving the domain name information is selected for the client under the condition that the first resolution server fails to acquire the domain name information, so that the domain name information is resolved in time, the data storage position of the data is determined to acquire the data, the data acquisition can be accelerated, and the experience of a user can be improved.
Referring to fig. 2, fig. 2 is a flowchart illustrating a data acquisition method according to an embodiment of the present disclosure, which specifically includes the following steps.
Step 202: receiving a data acquisition request aiming at target data sent by a client, wherein the data acquisition request carries domain name information of the target data and address information of the client.
The data acquisition request can be understood as a request sent by a user through a client for acquiring data, the domain name information can be understood as information for acquiring target data by a keyword input by the user through the client, and the address information can be understood as address information of an IP (Internet protocol) address, an MAC (media access control) address and the like of the client which can represent the area where the client is located.
Specifically, a server is used for receiving a data acquisition request aiming at target data sent by a client, and an analysis server is used for analyzing domain name information in the data acquisition request for the client.
In specific implementation, a server receives a data acquisition request triggered by domain name information input by a user through an input box of a client, wherein the data acquisition request carries domain name information of target data which the user wants to acquire and address information of the client for inputting the domain name information by the user.
Step 204: and selecting a first resolution server for the client based on the address information, and resolving the domain name information based on the first resolution server.
The resolution server may be understood as a server capable of resolving domain name information to obtain a storage location for storing target data, and in this embodiment, the resolution server is taken as a CDN resolution server as an example, and the data acquisition method provided in this embodiment is further described.
In specific implementation, the server selects a first resolution server for the client according to address information in the received data acquisition request, where the first resolution server may be a local CDN server configured for the client, and the CDN server resolves domain name information in the data acquisition request.
For example, a user a sends a request for obtaining a video a to a server through a client a, the request carries domain name information a and address information b, and a CDN1-1 is selected for the client a based on the address information b to resolve the domain name information a.
Step 206: and under the condition of failed analysis, selecting a second analysis server for the client, and analyzing the domain name information based on the second analysis server.
The second resolution server may be understood as a server belonging to a same service object as the first resolution server and belonging to a different service node, where it should be noted that the service object may be understood as a CDN server, and the service node may be understood as a domain name (also may be understood as a region or a region).
After the server selects the first resolution server for the client, the situation that the resolution of the first resolution server fails and domain name information cannot be successfully resolved may occur, wherein the resolution failure reason may be a network reason, a node damage and the like, which is not limited by the specification so as to obtain an actual storage position of the target data, and then a second resolution server may be selected for the client again; specifically, the selecting a second resolution server for the client and resolving the domain name information based on the second resolution server includes:
selecting a second analysis server of a different service node belonging to the same service object as the first analysis server for the client;
and the second resolution server based on the different service nodes resolves the domain name information according to a preset resolution algorithm.
The second analysis server may be understood as a server belonging to a same service object as the first analysis server and having a different service node, where it is to be noted that the first analysis server is CDN1-1, the second analysis server is CDN1-2, and CDN1-1 and CDN1-2 may be understood as CDNs 1 (the CDN leaves the same manufacturer as the first analysis server, and the analysis policy and the storage manner or the content probability of the node are the same) from the same manufacturer, which are placed in different region nodes, for example, CDN1-1 is configured in beijing, and CDN1-2 is configured in shanghai.
In specific implementation, when the first resolution server selected by the server fails to resolve, the second resolution server is selected for the client to resolve the domain name information, and the domain name information is resolved by using a preset resolution algorithm of the second resolution server, where the preset resolution algorithm may adopt recursive resolution, repeated resolution, and the like, but is not limited thereto, and this specification does not limit this.
Along the above example, when the CDN1-1 fails to analyze the domain name information a, the CDN1-2 is selected for the client a to analyze the domain name information a, that is, when the CDN1 configured in beijing fails to analyze, the domain name information a is analyzed by the CDN1 configured in shanghai.
In the embodiment of the specification, the domain name information is analyzed by selecting the analysis server of the same service object in another region for the client, so that the cross analysis of different regions of the domain name information is realized, and the data content corresponding to the domain name information is ensured to be rapidly acquired for the client.
Step 208: and determining a data storage position of the target data based on the analysis result, and acquiring the target data from the data storage position.
The data storage location may be understood as a server storing an actual IP address of data content corresponding to the domain name information.
The method comprises the steps that under the condition that a server obtains an actual storage position of data content corresponding to domain name information, the server determines the data storage position in a mapping table of an analysis server by utilizing an analysis result of the analysis server on the domain name information, and further requests an actual IP address to obtain corresponding data content; specifically, the determining the data storage location of the target data based on the analysis result includes:
and determining a data storage position corresponding to the domain name information in an analysis mapping table of the second analysis server based on the analyzed transcoding address of the domain name information, wherein the analysis mapping table comprises a mapping relation between the transcoding address of the domain name information and the data storage position.
The resolution mapping table can be understood as a mapping table of a distributed database in which a domain name and an IP address are mapped to each other by a DNS system used in the CDN server; the transcoding address can be understood as a transcoding address obtained by binary conversion of domain name information by the CDN server.
In practical application, the content of the resolution mapping table can be continuously written and expanded by acquiring data, so that the data storage position corresponding to the domain name information can be found in the resolution mapping table in the follow-up process.
In the embodiment of the specification, the data storage position corresponding to the domain name information is obtained in the resolution mapping table, so that data can be quickly obtained from the data storage position in the follow-up process, and the experience of a user for obtaining the data in time is improved.
After the server acquires the target data from the data storage position, the server stores the data to the storage node of the analysis server by using the analysis server, so that the data can be directly acquired from the storage node of the analysis server subsequently, and the data acquisition efficiency is greatly improved; specifically, after the target data is acquired from the data storage location, the method includes:
and storing the target data to storage nodes of the first analysis server and the second analysis server, and returning the target data to the client.
The storage node may be understood as a storage node of the analysis server, and may also be understood as a source station of the CDN, and is used to store data content obtained from the data storage location.
In specific implementation, the obtained target data is stored in a storage node of an analysis server, wherein the storage node is a storage node common to a first analysis server and a second analysis server, it should be noted that different service nodes based on the same service object are based on one source station server, data content is stored, in practical application, the target data is stored in the storage node, and the target data is returned to a client to display the target data for a user.
To sum up, in the data acquisition method provided in the embodiments of the present specification, an analysis server is selected by determining address information of a client, so as to implement analysis of domain name information, and in the case of an analysis failure, another analysis server that is only different from the analysis server in terms of geographical area is selected for the client, so as to further determine a data storage location of target data, so that the target data can be acquired by another analysis server in the same way in the case of a failure of one analysis server, which not only can ensure that the acquisition of the target data can be accelerated in the case of a node damage, but also improves user experience.
In the data obtaining method provided in another embodiment of the present specification, the first parsing server and the second parsing server belong to CDN servers shipped from different manufacturers, and the first parsing server and the second parsing server are both configured in the same service node, for example, one client in beijing, and two CDN servers shipped from different manufacturers, namely CDN1 and CDN2, are configured on the client.
Specifically, when a server receives a data acquisition request for target data sent by a client, the data acquisition request carries domain name information of the target data and address information of the client, the server selects a first resolution server for the client according to the address information of the client, and the target data can be determined under the condition that the domain name information is successfully resolved by the first resolution server; specifically, after the domain name information is resolved based on the first resolution server, the method further includes:
and under the condition of successful resolution, determining the target data in a storage node of the first resolution server based on the resolution result of the first resolution server on the domain name information, and returning the target data to the client.
In specific implementation, when the first resolution server successfully resolves the domain name information, the target data is determined in the storage node of the first resolution server based on a resolution result of the first resolution server on the domain name information, and in practical application, the storage node of the first resolution server may store the data that needs to be obtained before the client, that is, the target data may be determined in the storage node based on the resolution result, and the target data is returned to the client.
For example, the client B sends a data obtaining request in the client B, where the data obtaining request carries domain name information a1 and address information B1, and when the CDN1 is selected to resolve the domain name information based on the address information B1, target data may be determined in a storage node of the CDN1, and the target data is returned to the client B.
In the embodiment of the specification, the storage node of the resolution server can directly acquire the target data corresponding to the domain name information and return the target data to the client, and when the user acquires the previously acquired data through the client, the domain name information does not need to be resolved, so that the target data is acquired more quickly.
Under the condition that the target data is not stored in the storage node of the first resolution server, the first resolution server resolves the domain name information to obtain a data storage position and further obtain the target data; specifically, after the domain name information is resolved based on the first resolution server, the method further includes:
under the condition that the resolution is successful, determining a data storage position of the target data based on the resolution result of the first resolution server on the domain name information, and acquiring the target data from the data storage position;
and storing the target data in a storage node of the first analysis server, and returning the target data to the client.
In specific implementation, under the condition that the first resolution server resolves the domain name information, after the domain name information is resolved successfully, the server determines a data storage position of the target data by using a resolution result of the first resolution server on the domain name information, acquires the target data from the data storage position, stores the target data in a storage node of the first resolution server, and returns the target data to the client.
It should be noted that the specific resolution manner of the first resolution server is the same as that of the domain name information resolution process in the previous embodiment, and in this embodiment, the description thereof is not repeated.
In the above example, after the server uses the CDN1 to analyze the domain name information, the server determines a data storage location of the target data according to an analysis result, acquires the target data from the data storage location, stores the target data in a storage node of the CDN1, and returns the target data corresponding to the domain name information a1 to the client B.
In the embodiment of the present specification, the domain name information is resolved by the resolution server to obtain the data storage location corresponding to the domain name information, so that data access of the client to the domain name information can be accelerated.
In addition, in the case that the resolution of the first resolution server fails, a second resolution server is selected for the client, and the domain name information is resolved based on the second resolution server. The second analysis server and the first analysis server belong to CDN servers of different manufacturers and are configured on the same client, for example, a CDN server of a client with a location in guangzhou is configured, and the CDN servers of different manufacturers are denoted as CDN1 and CDN2, respectively.
Further, in a case that domain name resolution of the CDN1 server fails, selecting a second resolution server for the client, and resolving the domain name information based on the second resolution server includes:
selecting a second resolution server of the same service node of a service object different from the first resolution server for the client;
and analyzing the domain name information according to a preset analysis algorithm based on the second analysis server.
In specific implementation, the server selects a second resolution server of the same service node of a different service object from the first resolution server for the client, and resolves the domain name information according to a preset resolution algorithm, and in the above example, when the domain name resolution of the client B in guangzhou using the CDN1 server fails, the user B selects the CDN2 server for the client to resolve the domain name information, and after determining the resolved data storage location, the target data can be obtained.
It should be noted that, a CDN1 server and a CDN2 server belong to different manufacturers, so that an analysis policy for analyzing domain name information may be different, a data storage location determined in an analysis mapping table in the CDN1 server may not be obtained in the analysis mapping table in the CDN2 server, and target data may be obtained successfully or may fail.
In summary, the data acquisition method is configured in the same client through different parsing servers of different manufacturers, so that when one parsing server in the client is damaged, accelerated acquisition of data can be also achieved through another parsing server, and the access speed of user data is guaranteed.
The data acquisition method provided in the present specification will be further described below with reference to fig. 3, taking an application of the data acquisition method to acquiring video data as an example. Fig. 3 shows a processing flow chart of a data acquisition method applied to acquire video data according to an embodiment of the present specification, and specifically includes the following steps:
step 302: and receiving a video acquisition request sent by a user at a video website through a client.
Step 304: and the CDN1-1 is selected for the client to analyze the video domain name information in the video acquisition request.
Step 306: whether the resolution of the CDN1-1 for the video domain name information is successful is determined.
Step 308: if yes, the CDN1-1 determines a storage location where the target video data is stored, using the result of parsing the video domain name information, and continues to perform step 314.
Step 310: if not, the CDN1-2 is selected for the client to analyze the video domain name information in the video acquisition request.
Step 312: and determining a storage position for storing the target video data by using the analysis result of the video domain name information of the CDN 1-2.
Step 314: and video data are obtained based on the storage position, stored to a storage node of the CDN1, and returned to the client.
In summary, according to the data acquisition method, through domain name information and address information carried in a data acquisition request sent by a client, when a first resolution server fails to acquire the domain name information, a second resolution server capable of resolving different service nodes of the same service object of the domain name information is selected for the client, so that the domain name information is resolved in time, and then a data storage location of data is determined to acquire the data, so that not only is the data acquisition accelerated, but also the user experience is improved.
Referring to fig. 4, fig. 4 is a diagram illustrating an example that a CDN server acquires data by using a data acquisition method provided in an embodiment of the present disclosure.
In fig. 4, CDN-1 domain name 1 is an analysis server configured in the local client, CDN-1 domain name 2 is an analysis server configured in another area, and CDN-1 domain name 1 and CDN-1 domain name 2 belong to the same manufacturer and leave the factory, and have a common CDN1 source for storing data content obtained after analysis, where the source is total source information and a server for storing full data. As shown in fig. 4, CDN-1 domain name 1 receives a data acquisition request sent by a user through a client, and if CDN-1 domain name 1 successfully resolves domain name information in the data acquisition request, data content may be acquired in a CDN1 source station; if the resolution of the domain name information in the data acquisition request by the CDN-1 domain name 1 fails, the server may select the CDN-1 domain name 2 to resolve the domain name information for the user, and when the data corresponding to the domain name information cannot be found in the CDN1 source station, the server may send a data request corresponding to the domain name information to the source station, for example, when the CDN-1 domain name 1 is configured in beijing, and the CDN-1 domain name 2 is configured in shanghai, and when the resolution of the CDN-1 domain name 1 configured in beijing fails, the domain name information may be resolved by the CDN-1 domain name 2 configured in shanghai, and the data may be acquired and returned to the user according to a data storage location determined by a result of the resolution.
To sum up, in the embodiment of the present specification, an analysis server that is the same as the CDN1 is configured in another different region node, so that when one of the region nodes cannot access data, an analysis server that is the same as the CDN1 in another region configured in advance can still achieve fast acquisition of data.
Referring to fig. 5, fig. 5 is a diagram illustrating another example of a data obtaining method provided by an embodiment of the present specification obtaining data by using a CDN server.
In fig. 5, the CDN1 is an analysis server configured at an tianjin local client, the CDN2 is an analysis server configured at the tianjin local client that is the same as the CDN1, that is, the client is configured with two analysis servers shipped by different manufacturers, each analysis server corresponds to different CDN1 source stations and CDN2 source stations, and the two CDN1 source stations and the CDN2 source station have a common source station to store total data of the total station. As shown in fig. 5, the CDN1 receives a data obtaining request sent by a user through a client, and if the CDN1 successfully resolves domain name information in the data obtaining request, the CDN1 may obtain data content from a source station; if the CDN1 fails to resolve the domain name information in the data acquisition request, the server may select the CDN2 to resolve the domain name information for the user, and when the CDN1 source station cannot find data corresponding to the domain name information, the server may send a data request for acquiring the domain name information to the source station, for example, the CDN1 and the CDN2 are simultaneously configured at tianjin clients, and when the CDN1 fails to resolve the domain name information, the CDN2 may be selected for the user to resolve the domain name information, and a data storage location determined according to a resolved result is used to further acquire the data and return the data to the user.
In summary, according to the data acquisition method, through domain name information and address information carried in a data acquisition request sent by a client, when a first resolution server fails to acquire the domain name information, a second resolution server which can resolve the domain name information and is different from the first resolution server is selected for the client, so that the domain name information is resolved in time, and a data storage location of data is determined to acquire the data, so that not only is the data acquisition accelerated, but also the user experience is improved.
Corresponding to the above method embodiment, the present specification further provides an embodiment of a data acquisition apparatus, and fig. 6 shows a schematic structural diagram of the data acquisition apparatus provided in an embodiment of the present specification. As shown in fig. 6, the apparatus includes:
a receiving module 602, configured to receive a data acquisition request for target data sent by a client, where the data acquisition request carries domain name information of the target data and address information of the client;
a first resolution module 604 configured to select a first resolution server for the client based on the address information and to resolve the domain name information based on the first resolution server;
a second parsing module 606 configured to select a second parsing server for the client in case of a failure in parsing, and parse the domain name information based on the second parsing server;
an obtaining module 608 configured to determine a data storage location of the target data based on the parsing result, and obtain the target data from the data storage location.
Optionally, the second parsing module 606 is further configured to:
selecting a second analysis server of a different service node belonging to the same service object as the first analysis server for the client;
and the second resolution server based on the different service nodes resolves the domain name information according to a preset resolution algorithm.
Optionally, the obtaining module 608 is further configured to:
and determining a data storage position corresponding to the domain name information in an analysis mapping table of the second analysis server based on the analyzed transcoding address of the domain name information, wherein the analysis mapping table comprises a mapping relation between the transcoding address of the domain name information and the data storage position.
Optionally, the apparatus further includes:
a storage module configured to store the target data to storage nodes of the first and second parsing servers and return the target data to the client.
Optionally, the apparatus further includes:
a determining module configured to determine the target data in a storage node of the first resolution server based on a resolution result of the first resolution server on the domain name information, and return the target data to the client if the resolution is successful.
Optionally, the apparatus further includes:
a determining module configured to determine a data storage location of the target data based on an analysis result of the first analysis server on the domain name information, and acquire the target data from the data storage location, if the analysis is successful;
and storing the target data in a storage node of the first analysis server, and returning the target data to the client.
Optionally, the second parsing module 606 is further configured to:
selecting a second resolution server of the same service node of a service object different from the first resolution server for the client;
and analyzing the domain name information according to a preset analysis algorithm based on the second analysis server.
Optionally, the apparatus further includes:
the service object is a content distribution network, and the service node is a domain name.
In summary, the data acquisition device selects an analysis server by determining the address information of the client to realize the analysis of the domain name information, and selects another analysis server for the client when the analysis fails, so as to further determine the data storage location of the target data, so that the target data can be acquired by the other analysis server when one analysis server fails, thereby ensuring that the acquisition of the target data can be accelerated when the node is damaged, and improving the use feeling of the user.
The foregoing is a schematic configuration of a data acquisition apparatus of the present embodiment. It should be noted that the technical solution of the data acquisition apparatus belongs to the same concept as the technical solution of the data acquisition method, and details that are not described in detail in the technical solution of the data acquisition apparatus can be referred to the description of the technical solution of the data acquisition method.
Fig. 7 illustrates a block diagram of a computing device 700 provided according to an embodiment of the present description. The components of the computing device 700 include, but are not limited to, memory 710 and a processor 720. Processor 720 is coupled to memory 710 via bus 730, and database 750 is used to store data.
Computing device 700 also includes access device 740, access device 740 enabling computing device 700 to communicate via one or more networks 760. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. Access device 740 may include one or more of any type of network interface, e.g., a Network Interface Card (NIC), wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present description, the above-described components of computing device 700, as well as other components not shown in FIG. 7, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device architecture shown in FIG. 7 is for purposes of example only and is not limiting as to the scope of the present description. Those skilled in the art may add or replace other components as desired.
Computing device 700 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smartphone), wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 700 may also be a mobile or stationary server.
Wherein the processor 720 is configured to execute the computer-executable instructions, and the processor is configured to execute the computer-executable instructions, wherein the processor implements the steps of the data acquisition method when executing the computer-executable instructions.
The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the data acquisition method belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the data acquisition method.
An embodiment of the present specification further provides a computer readable storage medium storing computer instructions, which when executed by a processor, implement the steps of the data acquisition method.
The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the data acquisition method, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the data acquisition method.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present disclosure is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present disclosure. Further, those skilled in the art should also appreciate that the embodiments described in this specification are preferred embodiments and that acts and modules referred to are not necessarily required for this description.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
The preferred embodiments of the present specification disclosed above are intended only to aid in the description of the specification. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the specification and its practical application, to thereby enable others skilled in the art to best understand the specification and its practical application. The specification is limited only by the claims and their full scope and equivalents.
Claims (11)
1. A method of data acquisition, comprising:
receiving a data acquisition request aiming at target data sent by a client, wherein the data acquisition request carries domain name information of the target data and address information of the client;
selecting a first resolution server for the client based on the address information, and resolving the domain name information based on the first resolution server;
under the condition of failed analysis, selecting a second analysis server for the client, and analyzing the domain name information based on the second analysis server;
and determining a data storage position of the target data based on the analysis result, and acquiring the target data from the data storage position.
2. The method according to claim 1, wherein the selecting a second resolution server for the client and resolving the domain name information based on the second resolution server includes:
selecting a second analysis server of a different service node belonging to the same service object as the first analysis server for the client;
and the second resolution server based on the different service nodes resolves the domain name information according to a preset resolution algorithm.
3. The data acquisition method according to claim 1 or 2, wherein the determining the data storage location of the target data based on the parsing result includes:
and determining a data storage position corresponding to the domain name information in an analysis mapping table of the second analysis server based on the analyzed transcoding address of the domain name information, wherein the analysis mapping table comprises a mapping relation between the transcoding address of the domain name information and the data storage position.
4. The data acquisition method according to claim 3, wherein after the acquiring the target data from the data storage location, comprising:
and storing the target data to storage nodes of the first analysis server and the second analysis server, and returning the target data to the client.
5. The data acquisition method according to claim 1 or 2, wherein after the resolving the domain name information based on the first resolution server, the method further comprises:
and under the condition of successful resolution, determining the target data in a storage node of the first resolution server based on the resolution result of the first resolution server on the domain name information, and returning the target data to the client.
6. The data acquisition method according to claim 1 or 2, wherein after the resolving the domain name information based on the first resolution server, the method further comprises:
under the condition that the resolution is successful, determining a data storage position of the target data based on the resolution result of the first resolution server on the domain name information, and acquiring the target data from the data storage position;
and storing the target data in a storage node of the first analysis server, and returning the target data to the client.
7. The method according to claim 6, wherein the selecting a second resolution server for the client and resolving the domain name information based on the second resolution server includes:
selecting a second resolution server of the same service node of a service object different from the first resolution server for the client;
and analyzing the domain name information according to a preset analysis algorithm based on the second analysis server.
8. The data acquisition method according to claim 2, wherein the service object is a content distribution network, and the service node is a domain name.
9. A data acquisition apparatus, comprising:
the data acquisition module is configured to receive a data acquisition request aiming at target data sent by a client, wherein the data acquisition request carries domain name information of the target data and address information of the client;
a first resolution module configured to select a first resolution server for the client based on the address information and to resolve the domain name information based on the first resolution server;
the second resolution module is configured to select a second resolution server for the client under the condition of failed resolution, and to resolve the domain name information based on the second resolution server;
an obtaining module configured to determine a data storage location of the target data based on the parsing result, and obtain the target data from the data storage location.
10. A computing device, comprising:
a memory and a processor;
the memory is configured to store computer-executable instructions and the processor is configured to execute the computer-executable instructions, wherein the processor when executing the computer-executable instructions implements the steps of the data acquisition method of claims 1 to 8.
11. A computer-readable storage medium storing computer instructions which, when executed by a processor, perform the steps of the data acquisition method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011388930.0A CN112532764A (en) | 2020-12-01 | 2020-12-01 | Data acquisition method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011388930.0A CN112532764A (en) | 2020-12-01 | 2020-12-01 | Data acquisition method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112532764A true CN112532764A (en) | 2021-03-19 |
Family
ID=74996107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011388930.0A Pending CN112532764A (en) | 2020-12-01 | 2020-12-01 | Data acquisition method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112532764A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113099261A (en) * | 2021-04-27 | 2021-07-09 | 上海哔哩哔哩科技有限公司 | Node processing method and device and node processing system |
| CN113239155A (en) * | 2021-06-02 | 2021-08-10 | 浙江网商银行股份有限公司 | Data processing method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104869182A (en) * | 2015-05-28 | 2015-08-26 | 广州华多网络科技有限公司 | Domain name resolution method and device |
| CN105897942A (en) * | 2015-09-17 | 2016-08-24 | 乐视云计算有限公司 | Domain name resolution system and domain name resolution method |
| CN109040343A (en) * | 2018-09-11 | 2018-12-18 | 达闼科技（北京）有限公司 | Domain name analytic method, device, computer readable storage medium and electronic equipment |
| WO2019028683A1 (en) * | 2017-08-08 | 2019-02-14 | 深圳前海达闼云端智能科技有限公司 | Method and system for acquiring and collecting client local dns server |
| CN111327697A (en) * | 2020-02-18 | 2020-06-23 | 腾讯科技（深圳）有限公司 | Data downloading method, device, equipment and storage medium |
-
2020
- 2020-12-01 CN CN202011388930.0A patent/CN112532764A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104869182A (en) * | 2015-05-28 | 2015-08-26 | 广州华多网络科技有限公司 | Domain name resolution method and device |
| CN105897942A (en) * | 2015-09-17 | 2016-08-24 | 乐视云计算有限公司 | Domain name resolution system and domain name resolution method |
| WO2019028683A1 (en) * | 2017-08-08 | 2019-02-14 | 深圳前海达闼云端智能科技有限公司 | Method and system for acquiring and collecting client local dns server |
| CN109040343A (en) * | 2018-09-11 | 2018-12-18 | 达闼科技（北京）有限公司 | Domain name analytic method, device, computer readable storage medium and electronic equipment |
| CN111327697A (en) * | 2020-02-18 | 2020-06-23 | 腾讯科技（深圳）有限公司 | Data downloading method, device, equipment and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113099261A (en) * | 2021-04-27 | 2021-07-09 | 上海哔哩哔哩科技有限公司 | Node processing method and device and node processing system |
| CN113099261B (en) * | 2021-04-27 | 2023-04-18 | 上海哔哩哔哩科技有限公司 | Node processing method and device and node processing system |
| CN113239155A (en) * | 2021-06-02 | 2021-08-10 | 浙江网商银行股份有限公司 | Data processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2633667B1 (en) | System and method for on the fly protocol conversion in obtaining policy enforcement information | |
| WO2021051880A1 (en) | Resource data acquisition method and apparatus, computer device and storage medium | |
| US10250646B2 (en) | Method and device for establishing channel | |
| CN103281409B (en) | Based on mobile Internet domain name analytic method and the dns server of Transmission Control Protocol | |
| US7600011B1 (en) | Use of a domain name server to direct web communications to an intermediation platform | |
| CN109729183B (en) | Request processing method, device, equipment and storage medium | |
| CN105144652A (en) | Address resolution in software-defined networks | |
| CN111314472A (en) | Domain name resolution method, domain name resolution server and terminal equipment | |
| US20210337611A1 (en) | Optimized serving gateway node selection for interworking networks | |
| CN112532764A (en) | Data acquisition method and device | |
| CN112217856A (en) | Address acquisition method, device, equipment and storage medium of application example | |
| CN113067909A (en) | Edge node addressing method, device, equipment and storage medium | |
| CN101741902B (en) | System and method for Internet terminal to quickly access to Internet server | |
| CN112583952B (en) | Redirection scheduling processing method, device and system, related equipment and storage medium | |
| CN102904765A (en) | Method and equipment for data reporting | |
| US11758370B2 (en) | Cross network rich communications services content | |
| CN110392069B (en) | CDN service scheduling processing method and CDN server | |
| CN110933193B (en) | Domain name resolution method and device, electronic equipment and computer readable storage medium | |
| CN113301005B (en) | Data acquisition method and device | |
| US20160197878A1 (en) | Method and system for processing a geographical internet protocol (ip) lookup request | |
| CN108810092B (en) | Network access method and device, electronic equipment and computer readable storage medium | |
| US11838960B2 (en) | Packet gateway selection based on device capabilities | |
| US9021061B2 (en) | Method and apparatus for accommodating overlapping wireless networks | |
| US20220263759A1 (en) | Addressing method, addressing system, and addressing apparatus | |
| CN108737350B (en) | Information processing method and client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210319 |