CN106210156B - Processing method, device and the server of parsing task - Google Patents
Processing method, device and the server of parsing task Download PDFInfo
- Publication number
- CN106210156B CN106210156B CN201510214167.2A CN201510214167A CN106210156B CN 106210156 B CN106210156 B CN 106210156B CN 201510214167 A CN201510214167 A CN 201510214167A CN 106210156 B CN106210156 B CN 106210156B
- Authority
- CN
- China
- Prior art keywords
- task
- parsing
- combined analysis
- queue
- domain name
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
Abstract
This application discloses processing method, device and the servers of parsing task, which comprises the original parsing task of domain name is obtained from the buffer queue of each domain name；It is that each domain name generates the combined analysis task with different priorities according to the original parsing task, includes one or more original parsing tasks in each combined analysis task；It is that the combined analysis task distributes resolving resource according to the sequence of priority from high to low.The embodiment of the present application is due to generating combined analysis task according to the original parsing task of each domain name, therefore reduce the overall quantity of parsing task to be treated, and different combined analysis tasks has different priority, therefore resolving resource can be distributed according to priority, make the important available priority processing of parsing task, so that it is guaranteed that the generation progress of domain name mapping, guarantees that user can preferentially access site resource.
Description
Technical field
This application involves network communication technology fields, more particularly to processing method, device and the server of parsing task.
Background technique
Cloud service is the increase, use and delivery mode of related service Internet-based, with the development of virtual technology,
In cloud service system, it is flat that several virtualizations can be fictionalized on the hardware platform of a Cloud Server by virtualization technology
Platform, each virtual platform can correspond to a VM (Virtual Machine, virtual machine).In the prior art, on Cloud Server
Every VM can correspond to the Main Domain of a website, multiple subdomain names may be corresponded under further each Main Domain.It is existing
In technology, different VM can send the parsing task of corresponding website to the server for generating domain name mapping, and server passes through execution
These parsing tasks, generate domain name mapping for different domain names, so that these domain names to be directed toward to the IP (Internet of corresponding website
Protocol, Internet protocol) address, to keep user accessible to these Main Domains or the corresponding website money of subdomain name
Source.
But when multiple VM send parsing task simultaneously, server is elder generation of these parsing tasks according to sending time
Sequence, mean allocation process resource cause certain important parsing tasks to be difficult to obtain priority processing, to influence domain name solution afterwards
The generation progress of analysis, causes user that can not preferentially access site resource.
Summary of the invention
The application provides processing method, device and the server of parsing task, average by parsing task of settlement server
Allocation processing resource, thus the problem of domain name mapping for influencing website generates progress.
According to the embodiment of the present application in a first aspect, providing a kind of processing method of parsing task, which comprises
The original parsing task of domain name is obtained from the buffer queue of each domain name；
According to the original parsing task be each domain name generate have different priorities combined analysis task, each group
Closing in parsing task includes one or more original parsing tasks；
It is that the combined analysis task distributes resolving resource according to the sequence of priority from high to low.
According to the second aspect of the embodiment of the present application, a kind of processing unit of parsing task is provided, described device includes:
Acquiring unit, for obtaining the original parsing task of domain name from the buffer queue of each domain name；
Generation unit, for being that each domain name generates the combination solution with different priorities according to the original parsing task
Analysis task includes one or more original parsing tasks in each combined analysis task；
Allocation unit, for being that the combined analysis task distributes resolving resource according to the sequence of priority from high to low.
According to the third aspect of the embodiment of the present application, a kind of server is provided, comprising:
Processor；For storing the memory of the processor-executable instruction；
Wherein, the processor is configured to:
The original parsing task of domain name is obtained from the buffer queue of each domain name；
According to the original parsing task be each domain name generate have different priorities combined analysis task, each group
Closing in parsing task includes one or more original parsing tasks；
It is that the combined analysis task distributes resolving resource according to the sequence of priority from high to low.
The original parsing task for caching each domain name in the embodiment of the present application by buffer queue is carried out to parsing task
When processing, the original parsing task of domain name is obtained from the buffer queue of each domain name, then generating for each domain name has not
The combined analysis task of same priority, and be that combined analysis task distributes resolving resource according to the sequence of priority from high to low.
The embodiment of the present application reduces due to generating combined analysis task according to the original parsing task of each domain name and needs to handle
Parsing task overall quantity, and different combined analysis tasks has different priority, therefore can be according to priority
Resolving resource is distributed, the important available priority processing of parsing task is made, so that it is guaranteed that the generation progress of domain name mapping, guarantees
User can preferentially access site resource.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
The application can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the application
Example, and together with specification it is used to explain the principle of the application.
Fig. 1 is a kind of application scenarios schematic diagram of the embodiment of the present application；
Fig. 2 is one embodiment flow chart for the processing method that the application parses task；
Fig. 3 A is another embodiment flow chart for the processing method that the application parses task
Fig. 3 B is the process schematic handled in Fig. 3 A parsing task；
Fig. 4 is a kind of hardware structure diagram of server where the application parses the processing unit of task；
Fig. 5 is one embodiment block diagram for the processing unit that the application parses task；
Fig. 6 is another embodiment block diagram for the processing unit that the application parses task.
Specific embodiment
It is only to be not intended to be limiting the application merely for for the purpose of describing particular embodiments in term used in this application.
It is also intended in the application and the "an" of singular used in the attached claims, " described " and "the" including majority
Form, unless the context clearly indicates other meaning.It is also understood that term "and/or" used herein refers to and wraps
It may be combined containing one or more associated any or all of project listed.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application
A little information should not necessarily be limited by these terms.These terms are only used to for same type of information being distinguished from each other out.For example, not departing from
In the case where the application range, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as
One information.Depending on context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determination ".
Referring to Fig. 1, for using a kind of application scenarios schematic diagram of the embodiment of the present application:
A kind of cloud service system is shown in Fig. 1, the embodiment of the present application can carry out parsing based on the cloud service system and appoint
The processing of business, and then domain name mapping can be generated based on processing result, it include Cloud Server, parsing times in the cloud server system
The processing server (processing server is referred to as in subsequent the embodiment of the present application) of business and the server for generating domain name mapping
(server is referred to as generated in subsequent the embodiment of the present application).Wherein, n is provided on Cloud Server, and (n is the nature greater than 1
Number) a VM, each VM can be supplied to a website, and for storing the site resource of the website, each website is by being distributed
IP address be identified.User can access to site resource by the domain name of input website registration, in access process
Domain name can be converted to the IP address of website by middle dns server, to complete the access to above-mentioned website.It follows that wanting
Realize that user, to different site resources, needs to generate the parsing times that server first carries out different domain names in advance by domain name access
Business, to generate domain name mapping for different domain names, the domain name mapping result for following generation so as to subsequent is with completing from domain name to IP
The conversion of location.
In the prior art, tasks usually are parsed according to the sequencing of sending time, averagely for these by generation server
Allocation processing resource causes certain important parsing tasks to be difficult to obtain priority processing, thus influence the generation of domain name mapping into
Degree.As shown in fig. 1, processing server can be arranged generating server front end in the embodiment of the present application, by processing server elder generation
The original parsing task that the corresponding VM of each domain name is sent is cached by buffer queue, then to the parsing task in buffer queue
It is uniformly handled, the original parsing task of domain name is obtained from the buffer queue of each domain name, be then the generation of each domain name
Combined analysis task with different priorities, and be the distribution parsing of combined analysis task according to the sequence of priority from high to low
Resource, it is subsequent combined analysis task to be parsed according to the resolving resource distributed by generation server, to generate
The domain name mapping of different domain names；It should be noted that processing server shown in Fig. 1 is arranged independently of server is generated,
In practical application, processing server and the function of generating server also be can integrate on a server, to this application reality
It applies example to be not limited, the embodiment of the present application can be applied on the server for being arbitrarily integrated with processing parsing task function.
Referring to fig. 2, one embodiment flow chart of the processing method of task is parsed for the application, the embodiment is from server
Side is described:
Step 201: the original parsing task of domain name is obtained from the buffer queue of each domain name.
During generating domain name mapping for different domain names, each domain name can correspond to multiple parsing tasks, by holding
These parsing tasks of row, to generate domain name mapping.These parsing tasks may include: the solution in (the configuration domain name domain) AddZone
Analysis task；Configure the parsing task of A (Address, address) record；Configure the parsing task of CNAME (alias) record；Configure MX
The parsing task of (Mailbox, mailbox) record；It can also include the parsing task of DelZone (deleting domain name domain), configure rubbish
The parsing task of filtrating mail, the parsing task dispatching of config directory access；Configure particular content and the configuration of above-mentioned parsing task
Mode is consistent with the prior art, and details are not described herein.
A buffer queue can be created for each domain name in advance in the embodiment of the present application, each buffer queue is for caching
The parsing task of corresponding domain name, therefore after receiving the parsing task of certain domain name, it can be first according to the received time
Sequence afterwards, the parsing task of the domain name is added in the buffer queue of the domain name.It, can when to handle parsing task
To extract the parsing task of each domain name from above-mentioned buffer queue, in order to be different from the combined analysis task being subsequently generated,
The parsing task cached in buffer queue can be known as original parsing task in the embodiment of the present application.
Step 202: being that each domain name generates the combined analysis task with different priorities according to original parsing task, often
It include one or more original parsing tasks in a combined analysis task.
The embodiment of the present application can be different to the importance degree for generating domain name mapping previously according to different parsing tasks, right
Original parsing task is classified to obtain preset task type, and task type may include importance journey in the embodiment of the present application
Higher transactional task is spent, for example, the parsing task of AddZone, the parsing task of configuration A record, configuration CNAME record
The not high routinely task of the parsing task dispatching and importance degree that parsing task, configuration MX are recorded, for example, DelZone
The parsing task dispatching that parsing task, the parsing task for configuring Spam filtering, config directory access.
After getting the original parsing task of each domain name, according to above-mentioned preset task type to the original of each domain name
Beginning parsing task is classified, and the combined analysis task with different priorities is generated according to classification results, each combination solution
Include one or more parsing tasks with same task type in analysis task.For example, the combined analysis task generated includes
First combined analysis task and the second combined analysis task, wherein the parsing task for including in the first combined analysis task is appointed
Service type is transactional task, and the task type for the parsing task for including in the second combined analysis task is routinely to appoint
Business then knows that the priority of the first combined analysis task is higher than the priority of the second combined analysis task.
Step 203: being that combined analysis task distributes resolving resource according to the sequence of priority from high to low.
The embodiment of the present application can be previously according to the classification of task type, in other words according to the preferential of combined analysis task
Grade is arranged a task queue for each priority, can be priority higher first such as the example in preceding step 202
High-priority task queue is arranged in combined analysis task, and alternatively referred to as first task queue in the present embodiment is that priority is opposite
Low priority task queue, alternatively referred to as the second task queue in the present embodiment is arranged in lower second combined analysis task.
It, can be by each combined analysis task after generating the combined analysis task with different priorities for each domain name
It is added in corresponding task queue, then the sequence according to the priority of combined analysis task in task queue from high to low,
That is the sequence of the priority of task queue from high to low distributes resolving resource for different task queues, that is, is preferably priority
Higher first task queue assignment resolving resource.
As seen from the above-described embodiment, which appoints due to generating combined analysis according to the original parsing task of each domain name
Business, therefore reduces the overall quantity of parsing task to be treated, and different combined analysis tasks have it is different preferential
Grade, therefore resolving resource can be distributed according to priority, make the important available priority processing of parsing task, so that it is guaranteed that domain
The generation progress of name parsing guarantees that user can preferentially access site resource.
Referring to Fig. 3 A, another embodiment flow chart of the processing method of task is parsed for the application, the embodiment is to solution
The treatment process of analysis task is described in detail:
Step 301: creating buffer queue in advance for each domain name.
In conjunction with Fig. 1 it is found that the embodiment of the present application can be completed on processing server, processing server and Cloud Server into
Row communication, the parsing task for being unified for the registered domain name of website corresponding to difference VM on Cloud Server is handled, wherein each
Domain name can all correspond to multiple parsing tasks.These parsing tasks may include: the parsing task of AddZone, and AddZone is for referring to
Show the lookup region of domain name mapping；The parsing task of A record is configured, A record is used for the corresponding IP address of designated domain name；Configuration
The parsing task of CNAME record, CNAME are recorded for multiple domain names to be mapped to same IP address；Configure the parsing of MX record
Task, MX record the routing for being used to indicate the corresponding mail server of domain name；It can also include DelZone (deleting domain name domain)
Parsing task configures the parsing task of Spam filtering, the parsing task dispatching of config directory access；Configure above-mentioned parsing task
Particular content and configuration mode it is consistent with the prior art, details are not described herein.
A buffer queue can be created for each domain name in advance in the embodiment of the present application, each buffer queue is for caching
The parsing task of corresponding domain name.As shown in Figure 3B, the process to be handled in the embodiment of the present application parsing task is shown
It is intended to, corresponds to this step, it is assumed that has n (n is greater than 1 natural number) a website to need to generate domain name mapping, be then each net
The domain name stood creates a buffer queue, respectively buffer queue 1 to buffer queue n.
Step 302: after receiving the original parsing task of each domain name, the original parsing task received being added to
In the corresponding buffer queue of each domain name.
It, can be according to received chronological order, by the solution of the domain name after receiving the parsing task of certain domain name
Analysis task is added in the buffer queue of the domain name.As shown in Figure 3B, by taking website 1 as an example, the parsing task of corresponding website 1 according to
The chronological order of transmission is successively added in buffer queue 1.
Step 303: when starting to process parsing task, the original of each domain name is obtained from the buffer queue of each domain name
Parsing task.
When to handle parsing task, the parsing that each domain name can be extracted from above-mentioned buffer queue is appointed
Business, in order to be different from the combined analysis task being subsequently generated, the parsing task that will be cached in buffer queue in the embodiment of the present application
Referred to as original parsing task.As shown in Figure 3B, website 1 is obtained respectively into buffer queue n from buffer queue 1 to the domain of website n
The original parsing task of name.
Step 304: classifying according to original parsing task of the preset task type to each domain name of acquisition.
The embodiment of the present application can be different to the importance degree for generating domain name mapping previously according to different parsing tasks, right
Original parsing task is classified to obtain preset task type, and task type may include importance journey in the embodiment of the present application
Higher transactional task is spent, for example, the parsing task of AddZone, the parsing task of configuration A record, configuration CNAME record
Parsing task, the not high routinely task of the parsing task dispatching and importance degree of configuration MX record, for example, DelZone
Parsing task configures the parsing task of Spam filtering, the parsing task dispatching of config directory access.
After getting the original parsing task of each domain name, according to above-mentioned preset task type to the original of each domain name
Beginning parsing task is classified, as shown in Figure 3B, by taking buffer queue 1 as an example, to the parsing task in buffer queue 1 according to above-mentioned
Task type is divided into two classes, respectively transactional task and routinely task.
Step 305: generating combined analysis task according to classification results, which appoints including the first combined analysis
The priority of business and the second combined analysis task, the first combined analysis task is higher than the preferential of the second combined analysis task
Grade, it include one or more original parsing tasks in each combined analysis task.
In this step, the combined analysis task with different priorities is generated according to the classification results in abovementioned steps 304,
Include one or more parsing tasks with same task type in each combined analysis task.Assuming that the combined analysis generated
Task includes the first combined analysis task and the second combined analysis task, wherein the parsing for including in the first combined analysis task
The task type of task is transactional task, and the task type for the parsing task for including in the second combined analysis task is normal
Rule property task then knows that the priority of the first combined analysis task is higher than the priority of the second combined analysis task.In conjunction with Fig. 3 B,
By executing this step, can generate respectively for each domain name in the n domain name of website 1 to website n has different priorities
Combined analysis task.
Step 306: each combined analysis task is added to task corresponding with the priority of each combined analysis task
Queue.
The embodiment of the present application can be previously according to the classification of task type, in other words according to the preferential of combined analysis task
A task queue is arranged for each priority in grade, can be priority higher the in conjunction with abovementioned steps 305 and Fig. 3 B
High-priority task queue is arranged in one combined analysis task, and alternatively referred to as first task queue in the present embodiment is priority phase
Low priority task queue, alternatively referred to as the second task queue in the present embodiment are arranged to lower second combined analysis task；
For the combined analysis task of each domain name of generated website 1 to website n, these combined analysis tasks can be added to
In the task queue of corresponding priority, i.e., the first combined analysis task is added to high-priority task queue, and by second
Combined analysis task is added to low priority task queue.
Step 307: according to the priority sequence from high to low of combined analysis task in task queue, for task queue point
With resolving resource.
Sequence in this step according to the priority of task queue from high to low, for different task queue distribution parsing money
Source, in conjunction with Fig. 3 B it is found that being preferably high-priority task queue assignment resolving resource.
In the example that one is distributed resolving resource, for high-priority task queue, available high-priority task
The first task quantity for the combined analysis task for including in queue is called and the consistent first parsing production line of first task quantity
Often journey carries out distributed treatment to the combined analysis task in first task queue will pass through the first parsing production thread, i.e.,
A first parsing production thread is responsible for parsing a combined analysis task, to fully ensure that the group in high-priority task queue
It closes parsing task and obtains preferential comprehensive processing, as shown in Figure 3B, it is assumed that include x combined analysis in high-priority task queue
Task then calls x parsing to produce thread for high-priority task queue；For low priority task queue, due to low preferential
The priority of grade task queue is lower, therefore the quantity of the second parsing production thread called for low priority task queue can be with
Less than the second task quantity of the combined analysis task for including in low priority task queue, in other words in order to meet to Gao You
Combined analysis task in first grade task queue carries out distributed treatment, to be preferably that solution has been called in high-priority task queue
After analysis production thread, then it is the remaining parsing production thread of combined analysis task call in low priority task queue, such as schemes
Shown in 3B, it is assumed that include m combined analysis task in low priority task queue, processing server can be low priority task
The remaining parsing production thread in addition to x parsing production thread is called in queue, and the quantity of residue parsing production thread is likely larger than
M, it is also possible to be less than m, correspondingly, being parsed in production thread from residue as in Fig. 3 B and call y for low priority task queue
A parsing produces thread, and the quantity of y is no more than m.
In another optional example, after for different task queue assignment resolving resource, processing server may be used also
To judge whether the access frequency of current parsing task is more than preset access frequency upper limit threshold, when more than the access frequency upper limit
When threshold value, illustrates that current resolving resource is difficult to meet and all combined analysis tasks are handled, height can be remained at this time
The resolving resource of priority tasks queue assignment, while it being reduced to the resolving resource of low priority task queue assignment, until visiting
Ask that frequency is no more than access frequency upper limit threshold；It is, under any circumstance, can be guaranteed preferentially using the embodiment of the present application
The higher transactional task of grade can preferentially obtain resolving resource, since transactional task is the key that generate domain name mapping, because
This can not influence the generation of domain name mapping using the embodiment of the present application, guarantee that site resource can be preferentially accessed in user.
As seen from the above-described embodiment, which appoints due to generating combined analysis according to the original parsing task of each domain name
Business, therefore reduces the overall quantity of parsing task to be treated, and different combined analysis tasks have it is different preferential
Grade, therefore resolving resource can be distributed according to priority, make the important available priority processing of parsing task, so that it is guaranteed that domain
The generation progress of name parsing guarantees that user can preferentially access site resource；Also, if transmitted parsing task causes to take
When the access frequency of business device reaches the access upper limit, different from existing all parsing tasks of shielding, the embodiment of the present application can guarantee
The resolving resource of the task queue of high priority reduces or no longer distributes resolving resource for the task queue of low priority, from
And may insure that important parsing task can be handled preferentially, the generation of domain name mapping is not influenced.
Corresponding with the embodiment of processing method of parsing task of aforementioned offer, present invention also provides parsing tasks
The embodiment of processing unit and server.
The embodiment that the application parses the processing unit of task can be using on the server.Installation practice can pass through
Software realization can also be realized by way of hardware or software and hardware combining.Taking software implementation as an example, it anticipates as a logic
Device in justice is to be read computer program instructions corresponding in nonvolatile memory by the processor of equipment where it
Into memory, operation is formed.For hardware view, as shown in figure 4, clothes where parsing the processing unit of task for the application
Be engaged in device a kind of hardware structure diagram, in addition to processor shown in Fig. 4, memory, network interface and nonvolatile memory it
Outside, the generation server in embodiment where device is generally according to device actual functional capability, can also include other hardware, in Fig. 4 not
It shows one by one again.
Referring to Fig. 5, one embodiment block diagram of the processing unit of task is parsed for the application:
The device includes: acquiring unit 510, generation unit 520 and allocation unit 530.
Wherein, acquiring unit 510, the original parsing for obtaining domain name from the buffer queue of each domain name are appointed
Business；
Generation unit 520, for being that each domain name generates the group with different priorities according to the original parsing task
Parsing task is closed, includes one or more original parsing tasks in each combined analysis task；
Allocation unit 530, for being combined analysis task distribution parsing money according to the sequence of priority from high to low
Source.
Referring to Fig. 6, another embodiment block diagram of the processing unit of task is parsed for the application:
The device includes: creating unit 610, adding unit 620, acquiring unit 630, generation unit 640 and allocation unit
650。
Wherein, creating unit 610, for creating buffer queue in advance for each domain name；
Adding unit 620, for after receiving the original parsing task of target domain name, the original parsing received to be appointed
Business is added in the buffer queue of the target domain name；
Acquiring unit 630, for obtaining the original parsing task of domain name from the buffer queue of each domain name；
Generation unit 640, for being that each domain name generates the group with different priorities according to the original parsing task
Parsing task is closed, includes one or more original parsing tasks in each combined analysis task；
Allocation unit 650, for being combined analysis task distribution parsing money according to the sequence of priority from high to low
Source.
In an optional implementation:
The generation unit 640 may include (being not shown in Fig. 6):
Classification of task subelement, for according to preset task type to the original parsing task of each domain name of acquisition into
Row classification；
Task generates subelement, and for generating combined analysis task according to classification results, the combined analysis task includes
First combined analysis task and the second combined analysis task, wherein the priority of the first combined analysis task is higher than described
The priority of second combined analysis task includes first that task type is transactional task in the first combined analysis task
Original parsing task includes the second original parsing in addition to the described first original parsing task in the second combined analysis task
Task.
Wherein, the described first original parsing task may include: to configure the parsing task of domain name domain AddZone, configuration A note
The parsing task of record, the parsing task of configuration CNAME record；
The second original parsing task may include: to delete the parsing task of domain name domain DelZone, configure spam
The parsing task of filtering, the parsing task of config directory access.
In another optional implementation:
Described device can also include (being not shown in Fig. 6):
Task queue is arranged in setting unit, the priority for being respectively each type；
Correspondingly, the allocation unit 650 may include (being not shown in Fig. 6):
Task adding subelement, it is excellent with each combined analysis task for being added to each combined analysis task
The corresponding task queue of first grade；
Resource allocation subelement, for from high to low suitable of the priority according to combined analysis task in the task queue
Sequence distributes resolving resource for the task queue.
In another optional implementation:
The task queue may include first task queue and the second task queue, wherein the first task queue
The priority of middle combined analysis task is higher than the priority of combined analysis task in second task queue；
Correspondingly, the resource allocation subelement, can be specifically used for obtaining the group for including in the first task queue
The first task quantity of parsing task is closed, is called and consistent first solution of the first task quantity for the first task queue
Analysis production thread, the first parsing production thread is for being distributed the combined analysis task in the first task queue
Formula processing, and, the second parsing production thread, the quantity of the second parsing production thread are called for second task queue
Less than the second task quantity of the combined analysis task for including in second task queue.
In another optional implementation:
Described device can also include (being not shown in Fig. 6):
Judging unit, for judging whether current accessed frequency is more than preset access frequency upper limit threshold；
Adjustment unit, for remaining described when the current accessed frequency is more than the access frequency upper limit threshold
The resolving resource of first task queue assignment, and it is reduced to the resolving resource of the second task queue distribution.
The function of each unit and the realization process of effect are specifically detailed in the above method and correspond to step in above-mentioned apparatus
Realization process, details are not described herein.
For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality
Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein described be used as separation unit
The unit of explanation may or may not be physically separated, and component shown as a unit can be or can also be with
It is not physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to actual
The purpose for needing to select some or all of the modules therein to realize application scheme.Those of ordinary skill in the art are not paying
Out in the case where creative work, it can understand and implement.
As seen from the above-described embodiment, due to generating combined analysis task according to the original parsing task of each domain name,
Reduce the overall quantity of parsing task to be treated, and different combined analysis tasks has different priority, therefore
Resolving resource can be distributed according to priority, make the important available priority processing of parsing task, so that it is guaranteed that domain name mapping
Generation progress, guarantee user can preferentially access site resource.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the application
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the application, these modifications, purposes or
Person's adaptive change follows the general principle of the application and including the undocumented common knowledge in the art of the application
Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the application are by following
Claim is pointed out.
It should be understood that the application is not limited to the precise structure that has been described above and shown in the drawings, and
And various modifications and changes may be made without departing from the scope thereof.Scope of the present application is only limited by the accompanying claims.
Claims (15)
1. a kind of processing method of parsing task, which is characterized in that the described method includes:
The original parsing task of domain name is obtained from the buffer queue of each domain name；
It is that each domain name generates the combined analysis task with different priorities, each combination solution according to the original parsing task
It include one or more original parsing tasks in analysis task；
It is that the combined analysis task distributes resolving resource according to the sequence of priority from high to low.
2. the method according to claim 1, wherein the method also includes:
Buffer queue is created in advance for each domain name；
After receiving the original parsing task of target domain name, the original parsing task received is added to the target domain name
Buffer queue in.
3. the method according to claim 1, wherein described raw for each domain name according to the original parsing task
At the combined analysis task with different priorities, comprising:
Classify according to original parsing task of the preset task type to each domain name of acquisition；
Combined analysis task is generated according to classification results, the combined analysis task includes the first combined analysis task and second group
Close parsing task, wherein the priority of the first combined analysis task is higher than the priority of the second combined analysis task,
It include the first original parsing task that task type is transactional task in the first combined analysis task, second combination
It include the second original parsing task in addition to the described first original parsing task in parsing task.
4. according to the method described in claim 3, it is characterized in that,
The first original parsing task includes: to configure the parsing task of domain name domain AddZone, the parsing task of configuration A record,
Configure the parsing task of CNAME record；
The second original parsing task includes: to delete the parsing task of domain name domain DelZone, configures the solution of Spam filtering
Analysis task, the parsing task of config directory access.
5. according to priority sequence being from high to low described group the method according to claim 1, wherein described
Parsing task is closed to distribute before resolving resource, further includes:
Task queue is arranged in the priority of respectively each type；
It is described to distribute resolving resource according to the sequence of priority from high to low for the combined analysis task, comprising:
Each combined analysis task is added to task queue corresponding with the priority of each combined analysis task；
According to the priority sequence from high to low of combined analysis task in the task queue, for task queue distribution solution
Analyse resource.
6. according to the method described in claim 5, it is characterized in that, the task queue includes first task queue and second
Business queue, wherein the priority of combined analysis task is higher than in second task queue and combines in the first task queue
The priority of parsing task；
The sequence of the priority according to combined analysis task in the task queue from high to low, for the task queue point
With resolving resource, comprising:
Obtain the first task quantity for the combined analysis task for including in the first task queue；
It is called and the consistent first parsing production thread of the first task quantity, first solution for the first task queue
Analysis production thread is used to carry out distributed treatment to the combined analysis task in the first task queue, and, it is described the
The second parsing production thread is called in two task queues, and the quantity of the second parsing production thread is less than second task queue
In include combined analysis task the second task quantity.
7. according to the method described in claim 6, it is characterized in that, described according to combined analysis task in the task queue
The sequence of priority from high to low is distributed after resolving resource for the task queue, further includes:
Judge whether current accessed frequency is more than preset access frequency upper limit threshold；
When the current accessed frequency is more than the access frequency upper limit threshold, the first task queue assignment is remained
Resolving resource, and it is reduced to the resolving resource of the second task queue distribution.
8. a kind of processing unit of parsing task, which is characterized in that described device includes:
Acquiring unit, for obtaining the original parsing task of domain name from the buffer queue of each domain name；
Generation unit, for being that each domain name generates the combined analysis times with different priorities according to the original parsing task
It is engaged in, includes one or more original parsing tasks in each combined analysis task；
Allocation unit, for being that the combined analysis task distributes resolving resource according to the sequence of priority from high to low.
9. device according to claim 8, which is characterized in that described device further include:
Creating unit, for creating buffer queue in advance for each domain name；
Adding unit, for after receiving the original parsing task of target domain name, the original parsing task received to be added
Into the buffer queue of the target domain name.
10. device according to claim 8, which is characterized in that the generation unit includes:
Classification of task subelement, for dividing according to original parsing task of the preset task type to each domain name of acquisition
Class；
Task generates subelement, and for generating combined analysis task according to classification results, the combined analysis task includes first
Combined analysis task and the second combined analysis task, wherein the priority of the first combined analysis task is higher than described second
The priority of combined analysis task, in the first combined analysis task include that task type is transactional task first are original
Parsing task includes that the second original parsing in addition to the described first original parsing task is appointed in the second combined analysis task
Business.
11. device according to claim 10, which is characterized in that
The first original parsing task includes: to configure the parsing task of domain name domain AddZone, the parsing task of configuration A record,
Configure the parsing task of CNAME record；
The second original parsing task includes: to delete the parsing task of domain name domain DelZone, configures the solution of Spam filtering
Analysis task, the parsing task of config directory access.
12. device according to claim 8, which is characterized in that described device further include:
Task queue is arranged in setting unit, the priority for being respectively each type；
The allocation unit, comprising:
Task adding subelement, for each combined analysis task to be added to the priority with each combined analysis task
Corresponding task queue；
Resource allocation subelement, for the sequence of the priority according to combined analysis task in the task queue from high to low,
Resolving resource is distributed for the task queue.
13. device according to claim 12, which is characterized in that the task queue includes first task queue and second
Task queue, wherein the priority of combined analysis task is higher than group in second task queue in the first task queue
Close the priority of parsing task；
The resource allocation subelement, specifically for obtaining the first of the combined analysis task for including in the first task queue
Task quantity is called for the first task queue and produces thread with consistent first parsing of the first task quantity, described
First parsing production thread is used to carry out distributed treatment to the combined analysis task in the first task queue, and, it is
The second parsing production thread is called in second task queue, and the quantity of the second parsing production thread is less than described second
Second task quantity of the combined analysis task for including in business queue.
14. device according to claim 13, which is characterized in that described device further include:
Judging unit, for judging whether current accessed frequency is more than preset access frequency upper limit threshold；
Adjustment unit, for remaining described first when the current accessed frequency is more than the access frequency upper limit threshold
The resolving resource of task queue distribution, and it is reduced to the resolving resource of the second task queue distribution.
15. a kind of server characterized by comprising
Processor；For storing the memory of the processor-executable instruction；
Wherein, the processor is configured to:
The original parsing task of domain name is obtained from the buffer queue of each domain name；
It is that each domain name generates the combined analysis task with different priorities, each combination solution according to the original parsing task
It include one or more original parsing tasks in analysis task；
It is that the combined analysis task distributes resolving resource according to the sequence of priority from high to low.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510214167.2A CN106210156B (en) | 2015-04-29 | 2015-04-29 | Processing method, device and the server of parsing task |
| PCT/CN2016/079867 WO2016173452A1 (en) | 2015-04-29 | 2016-04-21 | Method and apparatus for processing resolution task, and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510214167.2A CN106210156B (en) | 2015-04-29 | 2015-04-29 | Processing method, device and the server of parsing task |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106210156A CN106210156A (en) | 2016-12-07 |
| CN106210156B true CN106210156B (en) | 2019-07-23 |
Family
ID=57198146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510214167.2A Active CN106210156B (en) | 2015-04-29 | 2015-04-29 | Processing method, device and the server of parsing task |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106210156B (en) |
| WO (1) | WO2016173452A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107239342A (en) * | 2017-05-31 | 2017-10-10 | 郑州云海信息技术有限公司 | A kind of storage cluster task management method and device |
| CN111950832A (en) * | 2019-05-17 | 2020-11-17 | 拉扎斯网络科技（上海）有限公司 | Scheduling method, device, server cluster and storage medium |
| CN110647389B (en) * | 2019-09-16 | 2023-04-07 | 北京镁伽机器人科技有限公司 | Task processing method for automatic beverage machine, automatic beverage machine and storage medium |
| CN112256418B (en) * | 2020-10-26 | 2023-10-24 | 清华大学深圳国际研究生院 | Big data task scheduling method |
| CN113904994B (en) * | 2021-09-30 | 2024-03-19 | 天翼数字生活科技有限公司 | Method for uniformly reporting big data of home gateway to platform |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101501669A (en) * | 2005-11-21 | 2009-08-05 | 杰出网络公司 | Domain name resolution resource allocation |
| CN101841577A (en) * | 2010-06-07 | 2010-09-22 | 中兴通讯股份有限公司 | Method and device for implementing domain name resolution agent function |
| CN102572014A (en) * | 2012-03-07 | 2012-07-11 | 华为终端有限公司 | Message processing method and device and system thereof |
| CN102984275A (en) * | 2012-12-14 | 2013-03-20 | 北京奇虎科技有限公司 | Method and browser for web downloading |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009111799A2 (en) * | 2008-03-07 | 2009-09-11 | 3Tera, Inc. | Globally distributed utility computing cloud |
| CN103024044B (en) * | 2012-12-14 | 2016-07-06 | 北京奇虎科技有限公司 | Webpage download method and device |
| CN103701886A (en) * | 2013-12-19 | 2014-04-02 | 中国信息安全测评中心 | Hierarchic scheduling method for service and resources in cloud computation environment |
-
2015
- 2015-04-29 CN CN201510214167.2A patent/CN106210156B/en active Active
-
2016
- 2016-04-21 WO PCT/CN2016/079867 patent/WO2016173452A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101501669A (en) * | 2005-11-21 | 2009-08-05 | 杰出网络公司 | Domain name resolution resource allocation |
| CN101841577A (en) * | 2010-06-07 | 2010-09-22 | 中兴通讯股份有限公司 | Method and device for implementing domain name resolution agent function |
| CN102572014A (en) * | 2012-03-07 | 2012-07-11 | 华为终端有限公司 | Message processing method and device and system thereof |
| CN102984275A (en) * | 2012-12-14 | 2013-03-20 | 北京奇虎科技有限公司 | Method and browser for web downloading |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106210156A (en) | 2016-12-07 |
| WO2016173452A1 (en) | 2016-11-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106210156B (en) | Processing method, device and the server of parsing task | |
| US10469314B2 (en) | API gateway for network policy and configuration management with public cloud | |
| CN112512090B (en) | Communication processing method and device, computer readable medium and electronic equipment | |
| CN109510846B (en) | API calling system, method and device, electronic equipment and storage medium | |
| US10193839B2 (en) | Managing security in messaging protocol communications | |
| EP3121997B1 (en) | Service provisioning in a communication network | |
| JP2020502895A (en) | Managing messaging protocol communications | |
| WO2017045471A1 (en) | Method and apparatus for acquiring service chain information in cloud computing system | |
| JP6162337B2 (en) | Application-aware network management | |
| US20150043335A1 (en) | High performance quality-of-service packet scheduling for multiple packet processing engines | |
| Cerroni et al. | Live migration of virtual network functions in cloud-based edge networks | |
| US11799821B2 (en) | Service chains for inter-cloud traffic | |
| US20190058636A1 (en) | Network functions virtualization management and orchestration policy descriptor management method and apparatus | |
| CN103119907A (en) | Systems and methods for providing a smart group | |
| CN108353040A (en) | system and method for distributed packet scheduling | |
| EP3871091B1 (en) | Distributed database-driven resource management and locking in a cloud native mobile core network node architecture | |
| US11057308B2 (en) | User- and application-based network treatment policies | |
| US20110161911A1 (en) | Composite service refactoring | |
| CN106161668B (en) | Generate the method, apparatus and server of domain name mapping | |
| WO2020135517A1 (en) | Method and device for deploying virtual network function | |
| US10791088B1 (en) | Methods for disaggregating subscribers via DHCP address translation and devices thereof | |
| CN114827249A (en) | Method and device for extending grid agent | |
| CN112825524B (en) | Method, device and system for determining network service node | |
| US20160062888A1 (en) | Least disruptive cache assignment | |
| US20130312012A1 (en) | Updating and Consolidating Events in Computer Systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |