CN109639801A - Back end distribution and data capture method and system - Google Patents
Back end distribution and data capture method and system Download PDFInfo
- Publication number
- CN109639801A CN109639801A CN201811545054.0A CN201811545054A CN109639801A CN 109639801 A CN109639801 A CN 109639801A CN 201811545054 A CN201811545054 A CN 201811545054A CN 109639801 A CN109639801 A CN 109639801A
- Authority
- CN
- China
- Prior art keywords
- access request
- node
- data cached
- area
- user terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
- H04L9/3236—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions
Abstract
The invention discloses a kind of back end distribution methods, comprising: according to the access request of user terminal, it is corresponding data cached into the corresponding fringe node of the user terminal to obtain the access request；When be not present in the fringe node access request it is corresponding data cached when, according to presetting method, distribute the access request corresponding Area Node, and it is corresponding data cached to obtain into the Area Node access request；And when corresponding data cached there is no the access request in the Area Node, the corresponding data of the access request are obtained into source station.The invention also discloses a kind of back end distributor and storage mediums.The present invention can reduce the consumption of bandwidth, saves waste of storage space and improve transmission speed.
Description
Technical field
The present invention relates to the distribution of network communication technology field more particularly to a kind of back end and data capture methods
And system.
Background technique
It is all based in traditional CDN (Content Delivery Network, content distributing network) internal transmission
For polling mode Hui Yuan to top service device, it is most simply also relatively very effective method that this, which is undoubtedly,.But there is with
Lower three problems:
Bandwidth consumption problem, due to being to use polling mode, then will lead to request every time can all find upper layer machine at random
Resource is accessed, as there is no will lead to source station bandwidth lose to accessing on source station.
Memory space problem, the upper layer machine that polling mode then will lead to may be all cache identical file, this
Sample causes waste of storage space.
Latency issue is be easy to cause the number of top service device request source station to become more, is caused whole with the mode of poll
Transmission time lengthens.
Summary of the invention
The main purpose of the present invention is to provide a kind of distribution of back end and data capture method, device and storage to be situated between
Matter, it is intended to solve the problems, such as bandwidth consumption in the prior art, waste of storage space and transmission delay.
To achieve the above object, back end distribution method provided by the invention, comprising:
According to the access request of user terminal, it is corresponding that the access request is obtained into the corresponding fringe node of the user terminal
It is data cached；
When corresponding data cached there is no the access request in the fringe node, according to presetting method, distribution
The corresponding Area Node of the access request, and it is corresponding data cached to obtain into the Area Node access request,
And by acquired data cached storage into the fringe node；And
When corresponding data cached there is no the access request in the Area Node, the visit is obtained into source station
Ask request corresponding data, and by acquired data cached storage into the Area Node.
Optionally, the corresponding fringe node of the user terminal is to be located at identical region and/or use with the user terminal
The node of identical operator.
Optionally, the presetting method is the cryptographic Hash according to the domain name for including in the access request, distributes the visit
Ask request corresponding Area Node, so that identical access request distributes the same Area Node.
Optionally, it is corresponding to distribute the access request for the cryptographic Hash according to the domain name for including in the access request
Area Node include:
The Area Node is ranked up according to the quantity of the Area Node, and assigns its unique sequence number；
The cryptographic Hash of domain name is subjected to modulus, is determined to be assigned as current access request service by the remainder that modulus obtains
Area Node.
To achieve the above object, back end distributor provided by the invention includes memory and processor, described to deposit
The back end distribution program that can be run on the processor is stored on reservoir, the back end distribution program is described
Processor realizes following method when executing:
According to the access request of user terminal, it is corresponding that the access request is obtained into the corresponding fringe node of the user terminal
It is data cached；
When corresponding data cached there is no the access request in the fringe node, according to presetting method, distribution
The corresponding Area Node of the access request, and it is corresponding data cached to obtain into the Area Node access request,
And by acquired data cached storage into the fringe node；And
When corresponding data cached there is no the access request in the Area Node, the visit is obtained into source station
Ask request corresponding data, and by acquired data cached storage into the Area Node.
Optionally, the corresponding fringe node of the user terminal is to be located at identical region and/or use with the user terminal
The node of identical operator.
Optionally, the presetting method is the cryptographic Hash according to the domain name for including in the access request, distributes the visit
Ask request corresponding Area Node, so that identical access request distributes the same Area Node.
Optionally, it is corresponding to distribute the access request for the cryptographic Hash according to the domain name for including in the access request
Area Node include:
The Area Node is ranked up according to the quantity of the Area Node, and assigns its unique sequence number；
The cryptographic Hash of domain name is subjected to modulus, is determined to be assigned as current access request service by the remainder that modulus obtains
Area Node.
To achieve the above object, the present invention further provides a kind of data capture method, the data capture method applications
In a fringe node, comprising:
The access request for receiving user terminal, obtains the domain name carried in the access request；
The domain name in the access request is parsed, and is searched in the fringe node according to domain name with the presence or absence of described
Access request is corresponding data cached；
When corresponding data cached there are the access request in the fringe node, data cached it is sent to described
The user terminal；
When corresponding data cached there is no the access request in the fringe node, Xiang Suoshu access request is corresponding
Area Node obtain that the access request is corresponding data cached, and data cached deposited what is obtained from the Area Node
Storage is sent to the user terminal after the fringe node.
To achieve the above object, the present invention further provides a kind of fringe nodes, which is characterized in that the fringe node packet
Memory and processor are included, the program that can be run on the processor is stored on the memory, described program is described
Processor realizes following method when executing:
The access request for receiving user terminal, obtains the domain name carried in the access request；
The domain name in the access request is parsed, and is searched in the fringe node according to domain name with the presence or absence of described
Access request is corresponding data cached；
When corresponding data cached there are the access request in the fringe node, data cached it is sent to described
The user terminal；
When corresponding data cached there is no the access request in the fringe node, Xiang Suoshu access request is corresponding
Area Node obtain that the access request is corresponding data cached, and data cached deposited what is obtained from the Area Node
Storage is sent to the user terminal behind local.
To achieve the above object, further a kind of data capture method, the data capture method are applied to one to the present invention
In a Area Node, comprising:
The corresponding data cached request of acquisition access request for receiving fringe node transmission, is searched in the Area Node
With the presence or absence of described data cached；
When in the Area Node there are it is described data cached when, data cached be sent to the fringe node for described；
It is described data cached to source station acquisition when being not present described data cached in the Area Node, and will be from institute
It states after obtain in source station data cached is stored in the Area Node and is sent to the fringe node.
To achieve the above object, further a kind of Area Node, the Area Node include memory and processing to the present invention
Device is stored with the program that can be run on the processor on the memory, real when described program is executed by the processor
Existing following method:
The corresponding data cached request of acquisition access request for receiving fringe node transmission, is searched in the Area Node
With the presence or absence of described data cached；
When in the Area Node there are it is described data cached when, data cached be sent to the fringe node for described；
It is described data cached to source station acquisition when being not present described data cached in the Area Node, and will be from institute
It states after obtain in source station data cached is stored in local and is sent to the fringe node.To achieve the above object, the present invention into
One step provides a kind of computer readable storage medium, and back end distribution journey is stored on the computer readable storage medium
Sequence, the back end distribution program are executed by one or more processor, to realize back end distribution described above
Method.
To achieve the above object, the present invention further provides a kind of computer program products, including one or more calculating
Machine instruction, when loading on computers and executing the computer program instructions, realizes back end distribution side described above
Method.
Back end distribution method, device and storage medium described in the present embodiment are arrived according to the access request of user terminal
It is corresponding data cached that the access request is obtained in the corresponding fringe node of the user terminal；When not deposited in the fringe node
When the access request is corresponding data cached, according to presetting method, distribute the access request corresponding Area Node, and
It is corresponding data cached that the access request is obtained into the Area Node；And when there is no the visits in the Area Node
When asking that request is corresponding data cached, the corresponding data of the access request are obtained into source station, solve band in the prior art
The problem of width consumption, waste of storage space and transmission delay.
Detailed description of the invention
Fig. 1 is the application environment schematic diagram for the back end distribution method that one embodiment of the invention discloses；
Fig. 2 is the flow diagram for the back end distribution method that one embodiment of the invention discloses；
Fig. 3 is the detailed process schematic diagram of back end distribution method shown in Fig. 2；
Fig. 4 is the schematic diagram of internal structure for the back end distributor that one embodiment of the invention discloses.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that described herein, specific examples are only used to explain the present invention, not
For limiting the present invention.Based on the embodiments of the present invention, those of ordinary skill in the art are not before making creative work
Every other embodiment obtained is put, shall fall within the protection scope of the present invention.
The description and claims of this application and term " first ", " second ", " third ", " in above-mentioned attached drawing
The (if present)s such as four " are to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should manage
The data that solution uses in this way are interchangeable under appropriate circumstances, so that the embodiments described herein can be in addition to illustrating herein
Or the sequence other than the content of description is implemented.In addition, the description of " first ", " second " etc. is used for description purposes only, without
It can be interpreted as its relative importance of indication or suggestion or implicitly indicate the quantity of indicated technical characteristic.It defines as a result,
The feature of " first ", " second " can explicitly or implicitly include at least one of the features.
Further, term " includes " and " having " and their any deformation, it is intended that cover non-exclusive packet
Contain, for example, what the process, method, system, product or equipment for containing a series of steps or units were not necessarily limited to be clearly listed
Those step or units, but may include be not clearly listed or it is intrinsic for these process, methods, product or equipment
Other step or units.
It in addition, the technical solution between each embodiment can be combined with each other, but must be with ordinary skill
Based on personnel can be realized, this technical side will be understood that when the combination of technical solution appearance is conflicting or cannot achieve
The combination of case is not present, also not the present invention claims protection scope within.
The present invention provides a kind of back end distribution method.
Refering to fig. 1, Fig. 1 is the application environment schematic diagram of back end distribution method of the present invention.The present invention is preferably real
It applies in example, the back end distribution method is applied to be formed by user terminal 1, fringe node 2, Area Node 3 and source station 4
The network architecture in.
Wherein, the user terminal 1 can be PC (PersonalComputer, PC), be also possible to smart phone,
The subscriber terminal equipments such as tablet computer, palm PC, portable computer, smart home device, intelligent wearable device.
The fringe node 2 refer to close to user terminal 1, provide network, storage, calculating, using etc. abilities, reach faster
Web services response, the equipment of safer local data transfer.The fringe node is distributed in more areas and using not
Same operator, it is different according to region and the operator used locating for user terminal 1 for directly providing service to user terminal 1
User terminal 1 distributes different fringe nodes 2.
In present pre-ferred embodiments, the fringe node 2 receives the access request of user terminal 1, obtains the access and asks
Seek the domain name of middle carrying；Parse the domain name in the access request, and according to domain name search in the fringe node 2 whether
It is corresponding data cached that there are the access requests；When there are the corresponding caching numbers of the access request in the fringe node 2
According to when, data cached be sent to the user terminal 1 for described；It is corresponding when the access request is not present in the fringe node 2
It is data cached when, it is corresponding data cached that the corresponding Area Node 3 of Xiang Suoshu access request obtains the access request, and will
Data cached be stored in behind local obtained from the Area Node 3 is sent to the user terminal 1.
The Area Node 3 is commonly referred to as backbone node, clothes when mainly as 2 miss of content distribution and fringe node
Business node.
In present pre-ferred embodiments, it is corresponding that the Area Node 3 receives the acquisition access request that fringe node 2 transmits
Data cached request is searched in the Area Node 3 with the presence or absence of described data cached；Exist when in the Area Node 3
When described data cached, data cached the fringe node 2 is sent to for described；When there is no described in the Area Node 3
When data cached, Xiang Yuanzhan 4 obtains described data cached, and data cached is stored in local for what is obtained from the source station 4
After be sent to the fringe node 2.
The source station 4 is the data source of network data.
It is the flow diagram of one embodiment of the invention back end distribution method referring to Fig. 2, Fig. 2.The flow diagram
Described in method can be executed by device, which can be by software and or hardware realization.
In the present embodiment, the back end distribution method includes:
S00 obtains the access into the corresponding fringe node 2 of the user terminal 1 according to the access request of user terminal 1
It requests corresponding data cached.
S01, when be not present in the fringe node 2 access request it is corresponding data cached when, according to presetting method,
It distributes the access request corresponding Area Node 3, and obtains the corresponding caching of the access request into the Area Node 3
Data, and by acquired data cached storage into the fringe node.
In present pre-ferred embodiments, the presetting method is the Hash according to the domain name for including in the access request
Value, distributes the access request corresponding Area Node, so that in access request each time, it is total for identical access request
The same Area Node can be assigned to.
S02 is obtained when corresponding data cached there is no the access request in the Area Node 3 into source station 4
The corresponding data of the access request, and by acquired data cached storage into the Area Node.
As shown in fig.3, Fig. 3 is the detailed process schematic diagram of back end distribution method shown in Fig. 2, specifically:
S10 receives the access request that user terminal 1 provides.
Specifically, user's content to be accessed according to it, in the user terminals such as the PC of the user or smart phone
Domain name, i.e. URL (Uniform Resource Locator, uniform resource locator) are inputted in the browser of equipment.It should
Solution, user access content be it is very random and extensive, same user may initiate different access requests, and may also
It has multiple users while initiating identical access request, but a unique domain name can be carried in each access request.
S11, according to presetting method, selection and the user terminal edges matched node 2.
In one embodiment, the region where 1 and the operator used, different according to the user end by the present invention
User terminal 1 can distribute different fringe nodes 2.
Preferably, the matched fringe node 2 is located at identical region with the user terminal 1, such as selects the same city
Fringe node 2.If the same city does not have fringe node, fringe node 2 of the same province etc. is selected.
In addition, the matched fringe node 2 uses identical operator with the user terminal 1, connection net is such as used
Network operator, telecommunication network operators or Mobile Network Operator etc..
S12 parses the domain name in the access request, and judges to ask in the fringe node 2 with the presence or absence of the access
Ask corresponding data cached.
Present pre-ferred embodiments store the domain name in the access request with the fringe node data cached
Corresponding domain name carries out Key comparison, to judge in the fringe node with the presence or absence of the corresponding caching number of the access request
According to.
When corresponding data cached there are the access request in the fringe node, following step S17 is executed, it will
The caching is sent to user terminal 1.
When corresponding data cached there is no the access request in the fringe node, S13 is executed, the domain is calculated
The cryptographic Hash of name, and corresponding Area Node 3 is determined according to the cryptographic Hash.
There are many methods for the cryptographic Hash of calculating domain name, for example, MD2, MD4, MD5 and SHA-1 etc..Present pre-ferred embodiments
Using a unified calculation method.
It is a kind of calculation method that hash output is carried out according to keyword since cryptographic Hash calculates, so that same access request
Or similar access request may correspond to the same cryptographic Hash, therefore, make same access request or similar in the present invention
Access request can be assigned to the same Area Node, using the method for calculating domain name cryptographic Hash, and to identical domain name Hash
It is worth corresponding access request, distributes the same Area Node 3, save the memory space of Area Node 3.
In present pre-ferred embodiments, determine that corresponding Area Node includes: according to the cryptographic Hash
The Area Node is ranked up according to the quantity of the Area Node, and assigns its unique sequence number；
The cryptographic Hash of the domain name calculated is subjected to modulus, determines to be assigned as currently to visit by the remainder that modulus obtains
Ask the Area Node of request service.
For example, the present invention co-exists in 5 Area Nodes in one embodiment, then the Area Node is endowed respectively
Sequence number 0,1,2,3 and 4, when the cryptographic Hash for the domain name calculated is 150,5 modulus of quantity of Area Node is obtained more than
Number is 0, then selects number for 0 Area Node, service current access request.
S14 judges corresponding data cached with the presence or absence of the access request in the corresponding Area Node 3.
Present pre-ferred embodiments by the access request domain name and the corresponding Area Node in store it is slow
The corresponding domain name of deposit data carries out Key comparison, judges to ask in the corresponding Area Node 3 with the presence or absence of the access
Ask corresponding data cached.
If it is corresponding data cached that there are the access requests in the Area Node, execute following step S16 with
And S17, by the buffer memory into the edge section 2, and the caching is further sent to user terminal 1.
If corresponding data cached there is no the access request in the Area Node 1, following S15 is executed, is arrived
The corresponding data of the access request are obtained in source station 4, and are saved in the corresponding Area Node 3, and continue to execute institute
S16 and S17 is stated, by the buffer memory into the fringe node 2, and the caching is further sent to user terminal 1.
Present pre-ferred embodiments also provide a kind of back end distribution for executing above-mentioned back end distribution method
Device.
As shown in figure 3, back end distributor 10 of the present invention may include memory 11, processor 12 and bus
13。
Wherein, the memory 11 includes at least a type of readable storage medium storing program for executing, and the readable storage medium storing program for executing includes
Flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory etc.), magnetic storage, disk, CD etc..It deposits
Reservoir 11 can be the internal storage unit of back end distributor 10, such as back end distribution in some embodiments
The hard disk of device 10.The external storage that memory 11 is also possible to back end distributor 10 in further embodiments is set
Plug-in type hard disk that is standby, such as being equipped on back end distributor 10, intelligent memory card (Smart Media Card, SMC),
Secure digital (Secure Digital, SD) card, flash card (Flash Card) etc..Further, memory 11 can also be both
Internal storage unit including back end distributor 10 also includes External memory equipment.Memory 11 can be not only used for depositing
Storage is installed on the application software and Various types of data of back end distributor 10, such as the code of back end distribution program 01
Deng can be also used for temporarily storing the data that has exported or will export.
Processor 12 can be in some embodiments a central processing unit (Central Processing Unit,
CPU), controller, microcontroller, microprocessor or other data processing chips, the program for being stored in run memory 11
Code or processing data, such as execute back end distribution program 01 etc..
The bus 13 can be Peripheral Component Interconnect standard (peripheral component interconnect, abbreviation
PCI) bus or expanding the industrial standard structure (extended industry standard architecture, abbreviation EISA)
Bus etc..The bus can be divided into address bus, data/address bus, control bus etc..For convenient for indicating, in Fig. 3 only with one slightly
Line indicates, it is not intended that an only bus or a type of bus.
Further, back end distributor 10 can also include network interface 14, and network interface 14 is optional, can be with
Including wireline interface and/or wireless interface (such as WI-FI interface, blue tooth interface), commonly used in the device 10 and other electricity
Communication connection is established between sub- equipment.
Optionally, which can also include user interface, and user interface may include display
(Display), input unit such as keyboard (Keyboard), optional user interface can also include standard wireline interface,
Wireless interface.Optionally, in some embodiments, it is aobvious to can be light-emitting diode display, liquid crystal display, touch control type LCD for display
Show that device and OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) touch device etc..Wherein, display
Can also it is appropriate be known as display screen or display unit, for be shown in the information handled in back end distributor 10 and
For showing visual user interface.
Fig. 3 illustrates only the back end distributor 10 with component 11-14 and back end distribution program 01, this
Field technical staff it is understood that structure shown in Fig. 3 not structure paired data node distributor 10 restriction, can be with
Including perhaps combining certain components or different component layouts than illustrating less perhaps more components.
In 10 embodiment of back end distributor shown in Fig. 3, the back end stored in memory 11 distributes journey
Following steps may be implemented when calling execution by processor 12 in sequence 01:
According to the access request of user terminal 1, the access request is obtained into the corresponding fringe node 2 of the user terminal 1
It is corresponding data cached；
When corresponding data cached there is no the access request in the fringe node 2, according to presetting method, distribution
The corresponding Area Node 3 of the access request, and the corresponding caching number of the access request is obtained into the Area Node 3
According to, and by acquired data cached storage into the fringe node 2；
When corresponding data cached there is no the access request in the Area Node 3, into source station 4 described in acquisition
The corresponding data of access request, and by acquired data cached storage into the Area Node 3.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program
Product is stored in a kind of computer readable storage medium.The computer program product includes that one or more computers refer to
It enables.When loading on computers and executing the computer program instructions, entirely or partly generate according to the embodiment of the present invention
The process or function.
The computer can be general purpose computer, special purpose computer, computer network or other programmable devices.
The computer instruction may be stored in a computer readable storage medium, or from a computer readable storage medium to another
One computer readable storage medium transmission, for example, the computer instruction can be from web-site, computer, a server
Or data center is (such as infrared, wireless, micro- by wired (such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless
Wave etc.) mode transmitted to another web-site, computer, server or data center.The computer-readable storage
Medium can be any usable medium that computer can store or include the integrated service of one or more usable mediums
The data storage devices such as device, data center.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), light
Medium (for example, DVD) or semiconductor medium (such as solid state hard disk Solid State Disk (SSD)) etc.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or
The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit
It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the application
Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
It should be noted that the serial number of the above embodiments of the invention is only for description, do not represent the advantages or disadvantages of the embodiments.And
The terms "include", "comprise" herein or any other variant thereof is intended to cover non-exclusive inclusion, so that packet
Process, device, article or the method for including a series of elements not only include those elements, but also including being not explicitly listed
Other element, or further include for this process, device, article or the intrinsic element of method.Do not limiting more
In the case where, the element that is limited by sentence "including a ...", it is not excluded that including process, device, the article of the element
Or there is also other identical elements in method.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (13)
1. a kind of back end distribution method, which is characterized in that the described method includes:
According to the access request of user terminal, it is corresponding slow that the access request is obtained into the corresponding fringe node of the user terminal
Deposit data；
When be not present in the fringe node access request it is corresponding data cached when, according to presetting method, described in distribution
The corresponding Area Node of access request, and it is corresponding data cached to obtain into the Area Node access request, and will
Acquired data cached storage is into the fringe node；And
When corresponding data cached there is no the access request in the Area Node, the access is obtained into source station and is asked
Corresponding data are sought, and by acquired data cached storage into the Area Node.
2. the method as described in claim 1, which is characterized in that the corresponding fringe node of the user terminal is and the user terminal
Positioned at identical region and/or use the node of identical operator.
3. the method as described in claim 1, which is characterized in that the presetting method includes according in the access request
The cryptographic Hash of domain name distributes the access request corresponding Area Node, so that identical access request distributes the same region
Node.
4. method as claimed in claim 3, which is characterized in that the Hash according to the domain name for including in the access request
Value, distributing the corresponding Area Node of the access request includes:
The Area Node is ranked up according to the quantity of the Area Node, and assigns its unique sequence number；
The cryptographic Hash of domain name is subjected to modulus, the area for being assigned as current access request service is determined by the remainder that modulus obtains
Domain node.
5. a kind of data capture method, which is characterized in that the data capture method is applied in a fringe node, comprising:
The access request for receiving user terminal, obtains the domain name carried in the access request；
The domain name in the access request is parsed, and is searched according to domain name and whether there is the access in the fringe node
It requests corresponding data cached；
When corresponding data cached there are the access request in the fringe node, by it is described it is data cached be sent to it is described
User terminal；
When corresponding data cached there is no the access request in the fringe node, from the corresponding area of the access request
Domain node obtains that the access request is corresponding data cached, and data cached is stored in what is obtained from the Area Node
The user terminal is sent to after the fringe node.
6. a kind of data capture method, which is characterized in that the data capture method is applied in an Area Node, comprising:
The corresponding data cached request of acquisition access request for receiving fringe node transmission, search in the Area Node whether
There are described data cached；
When in the Area Node there are it is described data cached when, data cached be sent to the fringe node for described；
It is described data cached to source station acquisition when being not present described data cached in the Area Node, and will be from the source
Stand obtain it is data cached be stored in the Area Node after be sent to the fringe node.
7. a kind of back end distributor, which is characterized in that described device includes memory and processor, on the memory
It is stored with the back end distribution program that can be run on the processor, the back end distribution program is by the processor
Following method is realized when execution:
According to the access request of user terminal, it is corresponding slow that the access request is obtained into the corresponding fringe node of the user terminal
Deposit data；
When be not present in the fringe node access request it is corresponding data cached when, according to presetting method, described in distribution
The corresponding Area Node of access request, and it is corresponding data cached to obtain into the Area Node access request, and will
Acquired data cached storage is into the fringe node；And
When corresponding data cached there is no the access request in the Area Node, the access is obtained into source station and is asked
Corresponding data are sought, and by acquired data cached storage into the Area Node.
8. device as claimed in claim 7, which is characterized in that the corresponding fringe node of the user terminal is and the user terminal
Positioned at identical region and/or use the node of identical operator.
9. device as claimed in claim 7, which is characterized in that the presetting method includes according in the access request
The cryptographic Hash of domain name distributes the access request corresponding Area Node, so that identical access request distributes the same region
Node.
10. device as claimed in claim 9, which is characterized in that the Kazakhstan according to the domain name for including in the access request
Uncommon value, distributing the corresponding Area Node of the access request includes:
The Area Node is ranked up according to the quantity of the Area Node, and assigns its unique sequence number；
The cryptographic Hash of domain name is subjected to modulus, the area for being assigned as current access request service is determined by the remainder that modulus obtains
Domain node.
11. a kind of fringe node, which is characterized in that the fringe node includes memory and processor, is deposited on the memory
The program that can be run on the processor is contained, described program realizes following method when being executed by the processor:
The access request for receiving user terminal, obtains the domain name carried in the access request；
The domain name in the access request is parsed, and is searched according to domain name and whether there is the access in the fringe node
It requests corresponding data cached；
When corresponding data cached there are the access request in the fringe node, by it is described it is data cached be sent to it is described
User terminal；
When corresponding data cached there is no the access request in the fringe node, the corresponding area of Xiang Suoshu access request
Domain node obtains that the access request is corresponding data cached, and data cached is stored in what is obtained from the Area Node
The user terminal is sent to behind local.
12. a kind of Area Node, which is characterized in that the Area Node includes memory and processor, is deposited on the memory
The program that can be run on the processor is contained, described program realizes following method when being executed by the processor:
The corresponding data cached request of acquisition access request for receiving fringe node transmission, search in the Area Node whether
There are described data cached；
When in the Area Node there are it is described data cached when, data cached be sent to the fringe node for described；
It is described data cached to source station acquisition when being not present described data cached in the Area Node, and will be from the source
Stand obtain it is data cached be stored in local after be sent to the fringe node.
13. a kind of computer readable storage medium, which is characterized in that be stored with data section on the computer readable storage medium
Point distribution caller, the back end distribution caller is executed by one or more processor, to realize such as right
It is required that back end distribution method described in any one of 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811545054.0A CN109639801A (en) | 2018-12-17 | 2018-12-17 | Back end distribution and data capture method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811545054.0A CN109639801A (en) | 2018-12-17 | 2018-12-17 | Back end distribution and data capture method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109639801A true CN109639801A (en) | 2019-04-16 |
Family
ID=66074773
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811545054.0A Pending CN109639801A (en) | 2018-12-17 | 2018-12-17 | Back end distribution and data capture method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109639801A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111597259A (en) * | 2020-05-12 | 2020-08-28 | 北京爱奇艺科技有限公司 | Data storage system, method, device, electronic equipment and storage medium |
| CN112153160A (en) * | 2020-09-30 | 2020-12-29 | 北京金山云网络技术有限公司 | Access request processing method and device and electronic equipment |
| CN112513830A (en) * | 2019-07-15 | 2021-03-16 | 华为技术有限公司 | Back-source method and related device in content distribution network |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102137006A (en) * | 2010-12-31 | 2011-07-27 | 华为技术有限公司 | Data transmission method and equipment in CDN (Content Delivery Network) |
| CN102882939A (en) * | 2012-09-10 | 2013-01-16 | 北京蓝汛通信技术有限责任公司 | Load balancing method, load balancing equipment and extensive domain acceleration access system |
| CN104935648A (en) * | 2015-06-03 | 2015-09-23 | 北京快网科技有限公司 | High-cost-performance CDN system, and file pre-push and fragment buffer memory methods |
| CN105302801A (en) * | 2014-05-27 | 2016-02-03 | 腾讯科技（深圳）有限公司 | Resource caching method and apparatus |
| CN105516334A (en) * | 2015-12-25 | 2016-04-20 | 上海帝联信息科技股份有限公司 | CDN (content delivery network) file delivery system |
| CN105897850A (en) * | 2015-12-22 | 2016-08-24 | 乐视云计算有限公司 | Response processing method and system and scheduling proxy server for CDN platform |
| CN106202112A (en) * | 2015-05-06 | 2016-12-07 | 阿里巴巴集团控股有限公司 | CACHE DIRECTORY method for refreshing and device |
| CN106790324A (en) * | 2015-11-20 | 2017-05-31 | 华为技术有限公司 | Content distribution method, virtual server management method, cloud platform and system |
| CN107317879A (en) * | 2017-08-02 | 2017-11-03 | 网宿科技股份有限公司 | The distribution method and system of a kind of user's request |
| CN108234639A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of data access method and device based on content distributing network CDN |
| CN108737470A (en) * | 2017-04-19 | 2018-11-02 | 贵州白山云科技有限公司 | A kind of access request time source method and apparatus |
| CN108924579A (en) * | 2018-08-28 | 2018-11-30 | 深圳市网心科技有限公司 | Video networking system returns source network node equipment, method and storage medium |
-
2018
- 2018-12-17 CN CN201811545054.0A patent/CN109639801A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102137006A (en) * | 2010-12-31 | 2011-07-27 | 华为技术有限公司 | Data transmission method and equipment in CDN (Content Delivery Network) |
| CN102882939A (en) * | 2012-09-10 | 2013-01-16 | 北京蓝汛通信技术有限责任公司 | Load balancing method, load balancing equipment and extensive domain acceleration access system |
| CN105302801A (en) * | 2014-05-27 | 2016-02-03 | 腾讯科技（深圳）有限公司 | Resource caching method and apparatus |
| CN106202112A (en) * | 2015-05-06 | 2016-12-07 | 阿里巴巴集团控股有限公司 | CACHE DIRECTORY method for refreshing and device |
| CN104935648A (en) * | 2015-06-03 | 2015-09-23 | 北京快网科技有限公司 | High-cost-performance CDN system, and file pre-push and fragment buffer memory methods |
| CN106790324A (en) * | 2015-11-20 | 2017-05-31 | 华为技术有限公司 | Content distribution method, virtual server management method, cloud platform and system |
| CN105897850A (en) * | 2015-12-22 | 2016-08-24 | 乐视云计算有限公司 | Response processing method and system and scheduling proxy server for CDN platform |
| CN105516334A (en) * | 2015-12-25 | 2016-04-20 | 上海帝联信息科技股份有限公司 | CDN (content delivery network) file delivery system |
| CN108737470A (en) * | 2017-04-19 | 2018-11-02 | 贵州白山云科技有限公司 | A kind of access request time source method and apparatus |
| CN107317879A (en) * | 2017-08-02 | 2017-11-03 | 网宿科技股份有限公司 | The distribution method and system of a kind of user's request |
| CN108234639A (en) * | 2017-12-29 | 2018-06-29 | 北京奇虎科技有限公司 | A kind of data access method and device based on content distributing network CDN |
| CN108924579A (en) * | 2018-08-28 | 2018-11-30 | 深圳市网心科技有限公司 | Video networking system returns source network node equipment, method and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112513830A (en) * | 2019-07-15 | 2021-03-16 | 华为技术有限公司 | Back-source method and related device in content distribution network |
| CN111597259A (en) * | 2020-05-12 | 2020-08-28 | 北京爱奇艺科技有限公司 | Data storage system, method, device, electronic equipment and storage medium |
| CN112153160A (en) * | 2020-09-30 | 2020-12-29 | 北京金山云网络技术有限公司 | Access request processing method and device and electronic equipment |
| WO2022068333A1 (en) * | 2020-09-30 | 2022-04-07 | 北京金山云网络技术有限公司 | Access request processing method and apparatus, electronic device, and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9846699B2 (en) | System and methods thereof for dynamically updating the contents of a folder on a device | |
| CN110519401A (en) | Improve method, apparatus, equipment and the storage medium of network Access Success Rate | |
| CN103455582B (en) | The display packing of browser navigation page and mobile terminal | |
| CN109634915A (en) | File dispositions method, Cloud Server, system and storage medium | |
| US11310066B2 (en) | Method and apparatus for pushing information | |
| CN109639801A (en) | Back end distribution and data capture method and system | |
| CN107844324A (en) | Customer terminal webpage redirects treating method and apparatus | |
| CN109617959A (en) | A kind of data load method, device, system and storage medium | |
| CN109639823A (en) | Network node dispatching method and device, computer installation and storage medium | |
| CN106534281A (en) | Data request responding method, apparatus and system | |
| CN110442773A (en) | Distributed system interior joint caching method, system, device and computer media | |
| CN109582246A (en) | Data access method, device, system and readable storage medium storing program for executing based on mine machine | |
| CN109618174A (en) | A kind of live data transmission method, device, system and storage medium | |
| CN108989369A (en) | The method and its system of progress current limliting are requested user | |
| CN108536617A (en) | Buffer memory management method, medium, system and electronic equipment | |
| CN110278278A (en) | A kind of data transmission method, system, device and computer media | |
| CN111142799A (en) | Distributed storage method and device, network node and storage medium | |
| CN103067500B (en) | Web browsing method based on cloud terminal | |
| CN110417789A (en) | Server connection method, electronic equipment, system and medium | |
| CN109857579A (en) | A kind of data processing method and relevant apparatus | |
| CN104572981B (en) | A kind of Webpage method for caching and processing and mobile terminal device | |
| KR20010034957A (en) | Internet link service system and method using telephone number | |
| CN107045452B (en) | Virtual machine scheduling method and device | |
| CN102833295B (en) | Data manipulation method and device in distributed cache system | |
| CN110300182A (en) | Network node dispatching method and device, computer installation and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190416 |