CN109634915A - File dispositions method, Cloud Server, system and storage medium - Google Patents
File dispositions method, Cloud Server, system and storage medium Download PDFInfo
- Publication number
- CN109634915A CN109634915A CN201811436571.4A CN201811436571A CN109634915A CN 109634915 A CN109634915 A CN 109634915A CN 201811436571 A CN201811436571 A CN 201811436571A CN 109634915 A CN109634915 A CN 109634915A
- Authority
- CN
- China
- Prior art keywords
- file
- node equipment
- memory node
- resource
- resource utilization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a kind of file dispositions methods, comprising: receives the resource file information that memory node equipment reports, the resource file information includes the resource utilization of the memory node equipment and the file request information that the memory node equipment receives；Judge the resource utilization whether within the scope of preset resource reasonable employment；If the resource utilization is more than the maximum value of the resource reasonable employment range, the target storage node equipment that can currently dispose is determined；According to the file request information, file destination is determined；The file destination is deployed in the target storage node equipment, wherein after file destination described in the target storage node deployed with devices, the resource utilization of the target storage node equipment is within the scope of the resource reasonable employment.The invention also discloses a kind of Cloud Server, system and storage mediums.The present invention can preferably mitigate the service pressure of memory node equipment.
Description
Technical field
The present invention relates to fields of communication technology more particularly to a kind of file dispositions method, Cloud Server, system and storage to be situated between
Matter.
Background technique
Currently, the scheduling scheme of the file deployment based on memory node equipment is: obtaining from data platform or other platforms
The frequency of user's demand file, according to the number of requests and file size of temperature file in the unit time, carrying out decision this document is needed
Then deployment task is issued to memory node equipment by Cloud Server by the deployment number wanted, to increase the deployment of temperature file
Quantity onto memory node equipment makes the service of memory node equipment be in a reasonable loading range.
However, above-mentioned scheduling scheme is entirely to be unfolded to implement using the file of request as dimension, such as with the unit time
The quantity of documents and file size of interior request.This decision making algorithm is more by servicing energy to memory node device history
The experience of power, which calculates, to be got, it is contemplated that the performance of memory node equipment different editions difference, external storage equipment on line
Also different, so, there may be different in different memory node equipment for identical demand file and request frequency
Loading condition calculates and is adjusted only by the frequency and attribute of demand file the deployment number of this document, can not be formed
One unified efficient scheduling strategy.
In addition, the memory node equipment of incremental deploying, may be also at high load condition due to the access of alternative document.
As it can be seen that there is no the service pressures for mitigating memory node equipment well for above-mentioned scheduling scheme.
Summary of the invention
The main purpose of the present invention is to provide a kind of file dispositions method, Cloud Server, system and storage mediums, it is intended to
Solve the technical issues of how preferably mitigating the service pressure of memory node equipment.
To achieve the above object, the present invention provides a kind of file dispositions method, is applied in Cloud Server, the method packet
It includes:
The resource file information that memory node equipment reports is received, the resource file information includes that the memory node is set
The file request information that standby resource utilization and the memory node equipment receive；
Judge the resource utilization whether within the scope of preset resource reasonable employment；
If the resource utilization is more than the maximum value of the resource reasonable employment range, the target that can currently dispose is determined
Memory node equipment；
According to the file request information, file destination is determined；
The file destination is deployed in the target storage node equipment, wherein the target storage node equipment
After disposing the file destination, the resource utilization of the target storage node equipment is within the scope of the resource reasonable employment.
Optionally, the target storage node equipment that the determination can currently be disposed includes:
Remove the memory node equipment that resource utilization is more than the maximum value from all memory node equipment, determines surplus
Balance stores up node device；
The memory space and resource utilization of the remaining memory node equipment are weighted, weighted score is obtained；
According to the sequence of weighted score from high to low, the remaining memory node equipment is ranked up；
The memory node equipment of first preset quantity in the top is determined as the target storage node that can currently dispose
Equipment.
Optionally, the target storage node equipment that the determination can currently be disposed includes:
Remove the maximum that the resource utilization is more than the resource reasonable employment range from all memory node equipment
The memory node equipment of value determines residue memory node equipment；
Obtain the resource utilization of the remaining memory node equipment；
The remaining memory node equipment that resource utilization is lower than default resource utilization threshold value is determined as currently disposing
Target storage node equipment.
Optionally, described according to the file request information, determine that file destination includes:
From in the file request information obtain preset time in requested listed files；
Count the request number of times of each file in the listed files；
According to the sequence of request number of times from high to low, the All Files in the listed files are ranked up；
The file of second preset quantity in the top is determined as current request more frequently file destination.
Optionally, the method also includes:
If the resource utilization is lower than the minimum value of the resource reasonable employment range, the memory node equipment is deleted
The cold file of middle storage, wherein the request frequency of the cold file is lower than predeterminated frequency threshold value.
Optionally, before the resource file information that the reception memory node equipment reports, the method also includes:
Receive the file request that client is sent；
The file request is responded, Xiang Suoshu client returns to the memory node where the corresponding file of the file request
Equipment.
To achieve the above object, the present invention further provides a kind of Cloud Server, the Cloud Server include memory and
Processor is stored with the file deployment program that can be run on the processor, the file deployment program on the memory
The file dispositions method is realized when being executed by the processor.
Optionally, the Cloud Server is the node of component content distribution network or block chain network.
To achieve the above object, the present invention further provides a kind of file deployment systems, comprising:
Receiving unit, the resource file information reported for receiving memory node equipment, the resource file information include
The file request information that the resource utilization of the memory node equipment and the memory node equipment receive；
Judging unit, for judging the resource utilization whether within the scope of preset resource reasonable employment；
First determination unit, if the maximum value for the resource utilization more than the resource reasonable employment range, really
The target storage node equipment that can be disposed before settled；
Second determination unit, for determining file destination according to the file request information；
Deployment unit, for the file destination to be deployed to the target storage node equipment, wherein the target
After file destination described in memory node deployed with devices, the resource utilization of the target storage node equipment is reasonable in the resource
In use scope.
To achieve the above object, the present invention further provides a kind of computer readable storage mediums, described computer-readable
File deployment program is stored on storage medium, the file deployment program can be executed by one or more processor, with reality
The existing file dispositions method.
To achieve the above object, the present invention further provides a kind of computer program products, including computer instruction, when it
When running on computers, computer is allowed to execute the file dispositions method.
The present invention realized the utility model has the advantages that
In the present invention, the resource file information that memory node equipment reports can receive, the resource file information includes
The file request information that the resource utilization of the memory node equipment and the memory node equipment receive；Further,
It may determine that the resource utilization whether within the scope of preset resource reasonable employment；If the resource utilization is more than described
The maximum value of resource reasonable employment range determines the target storage node equipment that can currently dispose；Believed according to the file request
Breath, determines file destination；Finally, the file destination can be deployed in the target storage node equipment, wherein described
After file destination described in target storage node deployed with devices, the resource utilization of the target storage node equipment is in the resource
Within the scope of reasonable employment.As it can be seen that, mainly using memory node equipment as dimension, passing through memory node equipment itself in the present invention
Real time load situation (such as resource utilization), dynamic adjustment deployment number, will request more frequently file is deployed to and currently may be used
In the target storage node equipment of deployment, so as to preferably mitigate the service pressure of memory node equipment.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of file dispositions method disclosed in one embodiment of the invention；
Fig. 2 is the flow diagram of another kind file dispositions method disclosed in one embodiment of the invention；
Fig. 3 is a kind of schematic diagram of internal structure of Cloud Server disclosed in one embodiment of the invention；
Fig. 4 is a kind of the functional block diagram of file deployment system disclosed in one embodiment of the invention.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that described herein, specific examples are only used to explain the present invention, not
For limiting the present invention.Based on the embodiments of the present invention, those of ordinary skill in the art are not before making creative work
Every other embodiment obtained is put, shall fall within the protection scope of the present invention.
The description and claims of this application and the term " first " in above-mentioned attached drawing, " second " are for distinguishing class
As object, without being used to describe a particular order or precedence order.It should be understood that the data used in this way are in appropriate situation
Under can be interchanged, so that the embodiments described herein can be real with the sequence other than the content for illustrating or describing herein
It applies.In addition, term " includes " and " having " and their any deformation, it is intended that cover it is non-exclusive include, for example, packet
The process, method, system, product or equipment for having contained a series of steps or units those of be not necessarily limited to be clearly listed step or
Unit, but may include other steps being not clearly listed or intrinsic for these process, methods, product or equipment or
Unit.
It should be noted that the description for being related to " first ", " second " etc. in the present invention is used for description purposes only, and cannot
It is interpreted as its relative importance of indication or suggestion or implicitly indicates the quantity of indicated technical characteristic.Define as a result, " the
One ", the feature of " second " can explicitly or implicitly include at least one of the features.In addition, the skill between each embodiment
Art scheme can be combined with each other, but must be based on can be realized by those of ordinary skill in the art, when technical solution
Will be understood that the combination of this technical solution is not present in conjunction with there is conflicting or cannot achieve when, also not the present invention claims
Protection scope within.
The present invention provides a kind of file dispositions method, can pass through memory node equipment using memory node equipment as dimension
The real time load situation (such as resource utilization) of itself, dynamic adjustment deployment number, will request more frequently file is deployed to and works as
In the preceding target storage node equipment disposed, so as to preferably mitigate the service pressure of memory node equipment.
Wherein, the Cloud Server, which can refer to, to provide the computer of service to equipment (such as client) other in network
System.If personal computer can externally provide File Transfer Protocol (File Transfer Protocol, abbreviation FTP)
Service, can also be Cloud Server.From narrow scope, Cloud Server refers exclusively to certain high-performance computers, can pass through network,
Externally provide service, for common PC, stability, safety, performance etc. require it is higher, because
This is different in the hardware such as CPU, chipset, memory, disk system, network and common PC.The Cloud Server
For providing service (such as data transport service) to client.The Cloud Server can include but is not limited to PC
(Personal Computer, PC), smart phone, tablet computer, palm PC, portable computer, Intelligent routing
Device, network storage equipment etc..
Wherein, memory node equipment, that is, small mine machine (mining machine) sets for the minicomputer in home network
It is standby, objective cloud is such as played, is made money precious.It will be installed the plug-in unit of deployment file and demand file on small mine machine, wherein the plug-in unit of deployment file
It can be used for storing data, the plug-in unit of demand file can be used for externally providing the service of request of data, and then provides and calculate, deposits
Storage and bandwidth resources.
Wherein, client is that one kind can be automatic to carry out numerical value calculating and/or letter according to the instruction for being previously set or storing
The equipment of processing is ceased, hardware includes but is not limited to microprocessor, specific integrated circuit (Application Specific
Integrated Circuit, ASIC), programmable gate array (Field-Programmable Gate Array, FPGA), number
Word processing device (Digital Signal Processor, DSP), embedded device etc..The client includes but is not limited to appoint
What one kind can be produced with user by the electronics that the modes such as keyboard, mouse, remote controler, touch tablet or voice-operated device carry out human-computer interaction
Product, for example, personal computer, tablet computer, smart phone, personal digital assistant (Personal Digital Assistant,
PDA), Interactive Internet TV (Internet Protocol Television, IPTV), intellectual wearable device etc..
Referring to Fig.1, Fig. 1 is a kind of flow diagram of file dispositions method disclosed in one embodiment of the invention.Such as Fig. 1 institute
Show, this method comprises:
S101, Cloud Server receive the resource file information that memory node equipment reports.
Wherein, the resource file information includes that the resource utilization of the memory node equipment and the memory node are set
The standby file request information received.
The resource utilization consumed CPU (Central Processing when can be run for memory node equipment
Unit, central processing unit) resource.
The file request information can include but is not limited to the listed files of requested document and asking for each file
Seek number.
In the embodiment of the present invention, when memory node equipment receives the file request of client transmission, memory node is set
It is standby that built-in small plug-in unit can be used to monitor and obtain the resource service condition of the memory node equipment, for example resource uses
The case where rate, at the same time it can also obtain file column from the file request that (such as nearest 1min) is received in nearest a period of time
Table and the request number of times of each file etc..
Further, memory node equipment can be by resource utilization and the storage including the memory node equipment
The resource file information for the file request information that node device receives is sent to Cloud Server.
S102, Cloud Server judges the resource utilization whether within the scope of preset resource reasonable employment, if it is not, holding
Row step S103, if so, terminating this process.
Wherein, a resource reasonable employment range, such as [30,80] can be rule of thumb arranged in Cloud Server in advance,
Within the scope of the resource reasonable employment, memory node equipment is in load balancing state.
After receiving the resource utilization that memory node equipment reports, it can be determined that whether the resource utilization is pre-
If resource reasonable employment within the scope of, if the resource utilization is not belonging to preset resource reasonable employment range, show to work as
The load of preceding memory node equipment is simultaneously unbalanced, may exceed load capacity, it is also possible to more than resource space, cannot rationally it utilize,
In order to allow the load balancing of memory node equipment, Cloud Server needs to be implemented the operation of next step, if the resource utilization
Belong to preset resource reasonable employment range, show the load balancing of currently stored node device, Cloud Server does not need to execute
Any operation.
S103, if the resource utilization is more than the maximum value of the resource reasonable employment range, Cloud Server determination is worked as
The preceding target storage node equipment disposed.
In the embodiment of the present invention, Cloud Server judges that the resource utilization is not belonging to preset resource reasonable employment model
It encloses, specifically, Cloud Server judges that the resource utilization is more than the maximum value of the resource reasonable employment range, shows current
The load of memory node equipment is simultaneously unbalanced, exceeds load capacity, in order to allow the load balancing of memory node equipment, mitigates storage
The service pressure of node device, Cloud Server need to increase other memory node equipment, that is, inquire the target that can currently dispose
Memory node equipment.
Specifically, the target storage node equipment that the determination can currently be disposed includes:
Remove the memory node equipment that resource utilization is more than the maximum value from all memory node equipment, determines surplus
Balance stores up node device；
The memory space and resource utilization of the remaining memory node equipment are weighted, weighted score is obtained；
According to the sequence of weighted score from high to low, the remaining memory node equipment is ranked up；
The memory node equipment of first preset quantity in the top is determined as the target storage node that can currently dispose
Equipment.
In the optional embodiment, it is more than described for needing first to remove from all memory node equipment resource utilization
The memory node equipment of maximum value determines residue memory node equipment, in this way, remaining memory node equipment is all light load
Memory node equipment, resource utilization is lower, can have extra resource for using.
It is possible to further to the remaining memory node equipment memory space and resource utilization be weighted,
Obtain weighted score；Such as: the weighted percentage that memory space is arranged is 80%, and the weighted percentage of resource utilization is
20%, the size of memory space is A, resource utilization B, then for each remaining memory node equipment, by memory space and
Resource utilization is weighted, and acquisition weighted score is 80%A+20%B.It later, can be according to weighted score from high to low
Sequentially, the remaining memory node equipment is ranked up；Weighted score is higher, shows depositing for the remaining memory node equipment
Storage space is bigger, and resource utilization is lower, and weighted score is lower, shows that the memory space of the remaining memory node equipment is got over
Small, resource utilization is higher.Cloud Server is true by the memory node equipment of the first preset quantity (such as 10) in the top
It is set to the target storage node equipment that can currently dispose.In this way, the target storage node equipment determined is all that memory space is larger,
And the lower memory node equipment of resource utilization, can there are extra memory space and resource come for using.
Specifically, the target storage node equipment that the determination can currently be disposed includes:
Remove the maximum that the resource utilization is more than the resource reasonable employment range from all memory node equipment
The memory node equipment of value determines residue memory node equipment；
Obtain the resource utilization of the remaining memory node equipment；
The remaining memory node equipment that resource utilization is lower than default resource utilization threshold value is determined as currently disposing
Target storage node equipment.
In the optional embodiment, it is more than described for needing first to remove from all memory node equipment resource utilization
The memory node equipment of maximum value determines residue memory node equipment, in this way, remaining memory node equipment is all light load
Memory node equipment, resource utilization is lower, can have extra resource for using.
Wherein it is possible to preset default resource utilization threshold value, such as 50%, determine remaining memory node equipment it
Afterwards, the resource utilization of the remaining memory node equipment can be obtained；Further, from the remaining memory node equipment
In, the remaining memory node equipment that resource utilization is lower than default resource utilization threshold value is determined as the target that can currently dispose
Memory node equipment.In this way, the target storage node equipment determined is the lower memory node equipment of resource utilization, it can
There is extra resource for using.
Specifically, the target storage node equipment that the determination can currently be disposed includes:
Remove the maximum that the resource utilization is more than the resource reasonable employment range from all memory node equipment
The memory node equipment of value determines residue memory node equipment；
Randomly choose the memory node equipment of the first preset quantity from the remaining memory node equipment, and by selection
Memory node equipment is determined as the target storage node equipment that can currently dispose.
In the optional embodiment, it is more than described for needing first to remove from all memory node equipment resource utilization
The memory node equipment of maximum value determines residue memory node equipment, in this way, remaining memory node equipment is all light load
Memory node equipment, resource utilization is lower, can have extra resource for using.
It is set it is possible to further randomly choose the memory node of the first preset quantity from the remaining memory node equipment
It is standby, and the memory node equipment of selection is determined as to the target storage node equipment that can currently dispose.This random selection mode,
The computing resource of Cloud Server can be saved.
S104, Cloud Server determine file destination according to the file request information.
Specifically, it is described according to the file request information, determine that file destination includes:
From in the file request information obtain preset time in requested listed files；
Count the request number of times of each file in the listed files；
According to the sequence of request number of times from high to low, the All Files in the listed files are ranked up.
The file of second preset quantity in the top is determined as current request more frequently file destination.
It wherein, include the request number of times of the requested listed files of client and each file in file request information,
According to these information, Cloud Server can count the request number of times of each file in the listed files；According to request number of times from
High to Low sequence is ranked up the All Files in the listed files, and by the second preset quantity in the top
File is determined as current request more frequently file destination.
Wherein it is possible to preset the second preset quantity, such as 3.
The file destination is deployed in the target storage node equipment by S105, Cloud Server.
Wherein, after file destination described in the target storage node deployed with devices, the money of the target storage node equipment
Source utilization rate is within the scope of the resource reasonable employment.
Wherein, Cloud Server can preset the quantity of target storage node equipment, such as 10, by the target text
After part is deployed in the target storage node equipment, if the resource utilization category that the target storage node equipment reports
In the resource reasonable employment range, Cloud Server is no longer scheduled deployment, whereas if the target storage node equipment
The resource utilization reported exceeds the maximum value of the resource reasonable employment range, and Cloud Server also needs to further increase target
The quantity of memory node equipment, until the resource utilization of all target storage node equipment belongs to the resource reasonable employment model
It encloses.
In the method flow described in Fig. 1, the resource file information that memory node equipment reports, the money can receive
Source file information includes the resource utilization of the memory node equipment and the file request that the memory node equipment receives
Information；It is possible to further judge the resource utilization whether within the scope of preset resource reasonable employment；If the resource
Utilization rate is more than the maximum value of the resource reasonable employment range, determines the target storage node equipment that can currently dispose；According to
The file request information, determines file destination；It is set finally, the target storage node can be deployed to the file destination
It is standby upper, wherein after file destination described in the target storage node deployed with devices, the resource of the target storage node equipment makes
With rate within the scope of the resource reasonable employment.As it can be seen that in the present invention, mainly using memory node equipment as dimension, by depositing
The real time load situation (such as resource utilization) of node device itself is stored up, dynamic adjustment deployment number is more frequently literary by request
Part is deployed in the target storage node equipment that can currently dispose, so as to preferably mitigate the service pressure of memory node equipment
Power.
It is the flow diagram of another kind file dispositions method disclosed in one embodiment of the invention referring to Fig. 2, Fig. 2.Such as Fig. 2
It is shown, this method comprises:
S201, Cloud Server receive the file request that client is sent.
In the embodiment of the present invention, when the user belonging to the client needs demand file, client elder generation Xiang Yun can be passed through
Server sends file request, and this document request is for the storage location where demand file.
S202, Cloud Server respond the file request, and Xiang Suoshu client returns to the corresponding file of the file request
The memory node equipment at place.
Wherein, each file can be issued to memory node equipment in advance by Cloud Server, be stored by memory node equipment
It is used for client.
S203, Cloud Server receive the resource file information that memory node equipment reports.
Wherein, the resource file information includes that the resource utilization of the memory node equipment and the memory node are set
The standby file request information received.
The resource utilization is usually to read the CPU (Central of memory node equipment consumed by file
Processing Unit, central processing unit).
The file request information can include but is not limited to the listed files of requested document and asking for each file
Seek number.
In the embodiment of the present invention, when memory node equipment receives the file request of client transmission, memory node is set
It is standby that built-in small plug-in unit can be used to monitor and obtain the resource service condition of the memory node equipment, for example resource uses
The case where rate, at the same time it can also obtain file column from the file request that (such as nearest 1min) is received in nearest a period of time
Table and the request number of times of each file etc..
Further, memory node equipment can be by resource utilization and the storage including the memory node equipment
The resource file information for the file request information that node device receives is sent to Cloud Server.
S204, Cloud Server judges the resource utilization whether within the scope of preset resource reasonable employment, if described
Resource utilization is more than the maximum value of the resource reasonable employment range, executes step S205~S207；If the resource uses
Rate is lower than the minimum value of the resource reasonable employment range, executes step S208.
Wherein, a resource reasonable employment range, such as [30,80] can be rule of thumb arranged in Cloud Server in advance,
Within the scope of the resource reasonable employment, memory node equipment is in load balancing state.
After receiving the resource utilization that memory node equipment reports, it can be determined that whether the resource utilization is pre-
If resource reasonable employment within the scope of, if the resource utilization is not belonging to preset resource reasonable employment range, specifically,
If the resource utilization is more than the maximum value of the resource reasonable employment range, show the load of currently stored node device
And it is unbalanced, exceed load capacity, if the resource utilization is lower than the minimum value of the resource reasonable employment range, shows
The resource of memory node equipment has vacant, cannot rationally utilize, in order to allow the load balancing of memory node equipment, Cloud Server
The operation of next step is needed to be implemented, if the resource utilization belongs to preset resource reasonable employment range, shows currently to deposit
The load balancing of node device is stored up, Cloud Server does not need to execute any operation.
S205, Cloud Server determine the target storage node equipment that can currently dispose.
Specifically, the target storage node equipment that the determination can currently be disposed includes:
Remove the memory node equipment that resource utilization is more than the maximum value from all memory node equipment, determines surplus
Balance stores up node device；
The memory space and resource utilization of the remaining memory node equipment are weighted, weighted score is obtained；
According to the sequence of weighted score from high to low, the remaining memory node equipment is ranked up；
The memory node equipment of first preset quantity in the top is determined as the target storage node that can currently dispose
Equipment.
Specifically, the target storage node equipment that the determination can currently be disposed includes:
Remove the maximum that the resource utilization is more than the resource reasonable employment range from all memory node equipment
The memory node equipment of value determines residue memory node equipment；
Obtain the resource utilization of the remaining memory node equipment；
The remaining memory node equipment that resource utilization is lower than default resource utilization threshold value is determined as currently disposing
Target storage node equipment.
Specifically, the target storage node equipment that the determination can currently be disposed includes:
Remove the maximum that the resource utilization is more than the resource reasonable employment range from all memory node equipment
The memory node equipment of value determines residue memory node equipment；
Randomly choose the memory node equipment of the first preset quantity from the remaining memory node equipment, and by selection
Memory node equipment is determined as the target storage node equipment that can currently dispose；
S206, Cloud Server determine file destination according to the file request information.
Specifically, it is described according to the file request information, determine that file destination includes:
From in the file request information obtain preset time in requested listed files；
Count the request number of times of each file in the listed files；
According to the sequence of request number of times from high to low, the All Files in the listed files are ranked up；
The file of second preset quantity in the top is determined as current request more frequently file destination.
S207, the file destination is deployed in the target storage node equipment by Cloud Server, and terminates this process.
Wherein, after file destination described in the target storage node deployed with devices, the money of the target storage node equipment
Source utilization rate is within the scope of the resource reasonable employment.
S208, Cloud Server delete the cold file stored in the memory node equipment.
Wherein it is possible to set predeterminated frequency threshold value, whether the predeterminated frequency threshold value is frequent for measuring file request
Minimum limit value.The each file that can be stored in preset period of time (such as one week) Lai Tongji memory node equipment is asked
Frequency is sought, shows the file request not frequently if the request frequency of the file is lower than predeterminated frequency threshold value for each file
Numerous, i.e., the user of the described file request is fewer, then can determine that the file is cold file, in other words, the cold file
It is lower than the file of predeterminated frequency threshold value for request frequency.
When Cloud Server judges that the resource utilization is lower than the minimum value of the resource reasonable employment range, show to deposit
The resource of storage node device has vacant, and resource cannot be utilized rationally, in order to save memory space, can delete the storage and save
The cold file stored in point device.
In the method flow described in Fig. 2, the file request of client transmission can receive, and respond the file and ask
It asks, Xiang Suoshu client returns to the memory node equipment where the corresponding file of the file request.Further, it is deposited in reception
After the resource file information that storage node device reports, it can be determined that whether the resource utilization is in preset resource reasonable employment
In range；If the resource utilization is more than the maximum value of the resource reasonable employment range, can determine can currently be disposed
Target storage node equipment；According to the file request information, file destination is determined, and the file destination is deployed to described
In target storage node equipment, if the resource utilization is lower than the minimum value of the resource reasonable employment range, it can delete
The cold file stored in the memory node equipment.As it can be seen that the embodiment of the present invention, mainly using memory node equipment as dimension,
Pass through the real time load situation (such as resource utilization) of memory node equipment itself, dynamic adjustment deployment number, by request relatively frequency
Numerous file is deployed in the target storage node equipment that can currently dispose, and less cold file will be requested to delete, thus
The service pressure that memory node equipment can not only preferably be mitigated, can also save the memory space of memory node equipment.
Referring to Fig. 3, Fig. 3 is a kind of schematic diagram of internal structure of Cloud Server disclosed in one embodiment of the invention, such as Fig. 3 institute
Show, the Cloud Server 1 may include memory 11, processor 12 and bus 13.
In the present embodiment, the Cloud Server 1, which can refer to, to provide clothes to equipment (such as client) other in network
The computer system of business.If personal computer can externally provide File Transfer Protocol (File Transfer
Protocol, abbreviation FTP) service, Cloud Server can also be.From narrow scope, Cloud Server refers exclusively to certain high-performance
Computer can externally provide service by network, for common PC, stability, safety, performance
Etc. require higher, therefore have in the hardware such as CPU, chipset, memory, disk system, network and common PC
Institute is different.The server is used to provide service (such as data transport service) to client.The Cloud Server may include
But be not limited to PC (Personal Computer, PC), smart phone, tablet computer, palm PC, portable computer,
Intelligent router, network storage equipment etc..
The Cloud Server 1 can be the node of component content distribution network or block chain network.
The Cloud Server 1 may include memory 11, processor 12 and bus 13.
Wherein, memory 11 include at least a type of readable storage medium storing program for executing, the readable storage medium storing program for executing include flash memory,
Hard disk, multimedia card, card-type memory (for example, SD or DX memory etc.), magnetic storage, disk, CD etc..Memory 11
It can be the internal storage unit of Cloud Server 1, such as the hard disk of the Cloud Server 1 in some embodiments.Memory 11 exists
It is hard to be also possible to the plug-in type being equipped on the External memory equipment of Cloud Server 1, such as Cloud Server 1 in other embodiments
Disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card
(Flash Card) etc..Further, memory 11 can also both including Cloud Server 1 internal storage unit and also including outside
Store equipment.Memory 11 can be not only used for the application software and Various types of data that storage is installed on Cloud Server 1, such as file
The code etc. of deployment program can be also used for temporarily storing the data that has exported or will export.
Processor 12 can be in some embodiments a central processing unit (Central Processing Unit,
CPU), controller, microcontroller, microprocessor or other data processing chips, the program for being stored in run memory 11
Code or processing data, such as execute file deployment program etc..
The bus 13 can be Peripheral Component Interconnect standard (peripheral component interconnect, abbreviation
PCI) bus or expanding the industrial standard structure (extended industry standard architecture, abbreviation EISA)
Bus etc..The bus can be divided into address bus, data/address bus, control bus etc..For convenient for indicating, in Fig. 3 only with one slightly
Line indicates, it is not intended that an only bus or a type of bus.Further, server can also connect including network
Mouthful, network interface optionally may include wireline interface and/or wireless interface (such as WI-FI interface, blue tooth interface), usually use
It is communicated to connect in being established between the Cloud Server 1 and other servers.
Optionally, the Cloud Server 1 can also include user interface, user interface may include display (Display),
Input unit such as keyboard (Keyboard), optional user interface can also include standard wireline interface and wireless interface.It can
Selection of land, in some embodiments, display can be light-emitting diode display, liquid crystal display, touch-control liquid crystal display and OLED
(Organic Light-Emitting Diode, Organic Light Emitting Diode) touches device etc..Wherein, display can also be appropriate
Referred to as display screen or display unit, for being shown in the information handled in Cloud Server 1 and for showing visual user
Interface.
Fig. 3 is illustrated only with component 11 to 13 and the Cloud Server of file deployment program 1, and those skilled in the art can
With understanding, the structure shown in Fig. 3 does not constitute the restriction to Cloud Server 1, may include less or more than illustrating
Component, perhaps combine certain components or different component layouts.
In conjunction with Fig. 1 or Fig. 2, the memory 11 in the Cloud Server 1 stores multiple instruction to realize a kind of file
The multiple instruction can be performed to realize in dispositions method, the processor 12:
The resource file information that memory node equipment reports is received, the resource file information includes that the memory node is set
The file request information that standby resource utilization and the memory node equipment receive；
Judge the resource utilization whether within the scope of preset resource reasonable employment；
If the resource utilization is more than the maximum value of the resource reasonable employment range, the target that can currently dispose is determined
Memory node equipment；
According to the file request information, file destination is determined；
The file destination is deployed in the target storage node equipment, wherein the target storage node equipment
After disposing the file destination, the resource utilization of the target storage node equipment is within the scope of the resource reasonable employment.
In a kind of optional embodiment, the target storage node equipment that the determination can currently be disposed includes:
Remove the memory node equipment that resource utilization is more than the maximum value from all memory node equipment, determines surplus
Balance stores up node device；
The memory space and resource utilization of the remaining memory node equipment are weighted, weighted score is obtained；
According to the sequence of weighted score from high to low, the remaining memory node equipment is ranked up；
The memory node equipment of first preset quantity in the top is determined as the target storage node that can currently dispose
Equipment.
In a kind of optional embodiment, the target storage node equipment that the determination can currently be disposed includes:
Remove the maximum that the resource utilization is more than the resource reasonable employment range from all memory node equipment
The memory node equipment of value determines residue memory node equipment；
Obtain the resource utilization of the remaining memory node equipment；
The remaining memory node equipment that resource utilization is lower than default resource utilization threshold value is determined as currently disposing
Target storage node equipment.
It is described according to the file request information in a kind of optional embodiment, determine that file destination includes:
From in the file request information obtain preset time in requested listed files；
Count the request number of times of each file in the listed files；
According to the sequence of request number of times from high to low, the All Files in the listed files are ranked up；
The file of second preset quantity in the top is determined as current request more frequently file destination.
In a kind of optional embodiment, the processor 12 can be performed the multiple instruction that the memory 11 stores with
It realizes:
If the resource utilization is lower than the minimum value of the resource reasonable employment range, the memory node equipment is deleted
The cold file of middle storage, wherein the request frequency of the cold file is lower than predeterminated frequency threshold value.
In a kind of optional embodiment, before the resource file information that the reception memory node equipment reports, institute
Stating processor 12 can be performed the multiple instruction of the storage of memory 11 to realize:
Receive the file request that client is sent；
The file request is responded, Xiang Suoshu client returns to the memory node where the corresponding file of the file request
Equipment.
Specifically, the processor 12 can refer in Fig. 1 or Fig. 2 corresponding embodiment the concrete methods of realizing of above-metioned instruction
The description of correlation step, this will not be repeated here.
In the Cloud Server described in Fig. 3, the resource file information that memory node equipment reports, the money can receive
Source file information includes the resource utilization of the memory node equipment and the file request that the memory node equipment receives
Information；It is possible to further judge the resource utilization whether within the scope of preset resource reasonable employment；If the resource
Utilization rate is more than the maximum value of the resource reasonable employment range, determines the target storage node equipment that can currently dispose；According to
The file request information, determines file destination；It is set finally, the target storage node can be deployed to the file destination
It is standby upper, wherein after file destination described in the target storage node deployed with devices, the resource of the target storage node equipment makes
With rate within the scope of the resource reasonable employment.As it can be seen that in the present invention, mainly using memory node equipment as dimension, by depositing
The real time load situation (such as resource utilization) of node device itself is stored up, dynamic adjustment deployment number is more frequently literary by request
Part is deployed in the target storage node equipment that can currently dispose, so as to preferably mitigate the service pressure of memory node equipment
Power.
It is a kind of the functional block diagram of file deployment system disclosed in one embodiment of the invention referring to Fig. 4, Fig. 4.Its
In, the file deployment system of Fig. 4 description is for some or all of executing in file dispositions method described in Fig. 1 or Fig. 2 step
Suddenly, the specific associated description referring to Figure 1 or in Fig. 2, details are not described herein.The so-called unit of the present invention refers to that one kind can be by
Processor is performed and can complete the series of computation machine program segment of fixed function, and storage is in memory.In this reality
It applies in example, the function about each unit will be described in detail in subsequent embodiment.
Fig. 4 description file deployment system include:
Receiving unit 401, the resource file information reported for receiving memory node equipment, the resource file packet
The file request information that the resource utilization and the memory node equipment for including the memory node equipment receive；
Judging unit 402, for judging the resource utilization whether within the scope of preset resource reasonable employment；
First determination unit 403, if the maximum value for the resource utilization more than the resource reasonable employment range,
Determine the target storage node equipment that can currently dispose；
Specifically, first determination unit 403 determines that the target storage node equipment that can currently dispose includes:
Remove the memory node equipment that resource utilization is more than the maximum value from all memory node equipment, determines surplus
Balance stores up node device；
The memory space and resource utilization of the remaining memory node equipment are weighted, weighted score is obtained；
According to the sequence of weighted score from high to low, the remaining memory node equipment is ranked up；
The memory node equipment of first preset quantity in the top is determined as the target storage node that can currently dispose
Equipment.
Specifically, first determination unit 403 determines that the target storage node equipment that can currently dispose includes:
Remove the maximum that the resource utilization is more than the resource reasonable employment range from all memory node equipment
The memory node equipment of value determines residue memory node equipment；
Obtain the resource utilization of the remaining memory node equipment；
The remaining memory node equipment that resource utilization is lower than default resource utilization threshold value is determined as currently disposing
Target storage node equipment.
Second determination unit 404, for determining file destination according to the file request information；
Specifically, the second determination unit 404 according to the file request information, determines that file destination includes:
From in the file request information obtain preset time in requested listed files；
Count the request number of times of each file in the listed files；
According to the sequence of request number of times from high to low, the All Files in the listed files are ranked up；
The file of second preset quantity in the top is determined as current request more frequently file destination.
Deployment unit 405, for the file destination to be deployed to the target storage node equipment, wherein described
After file destination described in target storage node deployed with devices, the resource utilization of the target storage node equipment is in the resource
Within the scope of reasonable employment.
Optionally, file deployment system described in Fig. 4 can also include:
Unit is deleted, if being lower than the minimum value of the resource reasonable employment range for the resource utilization, deletes institute
State the cold file stored in memory node equipment, wherein the request frequency of the cold file is lower than predeterminated frequency threshold value.
The receiving unit 401 is also used to receive the file request of client transmission；
Transmission unit, for responding the file request, Xiang Suoshu client returns to the corresponding file of the file request
The memory node equipment at place.
In the file deployment system described in Fig. 4, the resource file information that memory node equipment reports, institute can receive
State the resource utilization that resource file information includes the memory node equipment and the file that the memory node equipment receives
Solicited message；It is possible to further judge the resource utilization whether within the scope of preset resource reasonable employment；If described
Resource utilization is more than the maximum value of the resource reasonable employment range, determines the target storage node equipment that can currently dispose；
According to the file request information, file destination is determined；Finally, the file destination can be deployed to the target storage section
On point device, wherein after file destination described in the target storage node deployed with devices, the money of the target storage node equipment
Source utilization rate is within the scope of the resource reasonable employment.As it can be seen that, mainly using memory node equipment as dimension, leading in the present invention
The real time load situation (such as resource utilization) of memory node equipment itself is crossed, dynamic adjustment deployment number will request more frequent
File be deployed in the target storage node equipment that can currently dispose, so as to preferably mitigate the clothes of memory node equipment
Business pressure.
The above-mentioned integrated unit realized in the form of software function module, can store in a computer-readable storage
In medium.Wherein, which can store computer program, which is being executed by processor
When, it can be achieved that the step of above-mentioned each embodiment of the method.Wherein, the computer program includes computer program code, described
Computer program code can be source code form, object identification code form, executable file or certain intermediate forms etc..The meter
Calculation machine readable storage medium storing program for executing may include: can carry the computer program code any entity or device, recording medium,
USB flash disk, mobile hard disk, magnetic disk, CD, computer storage, read-only memory (ROM, Read-Only Memory), arbitrary access
Memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It needs
Bright, the content that the computer readable storage medium includes can be according to making laws in jurisdiction and patent practice is wanted
It asks and carries out increase and decrease appropriate, such as in certain jurisdictions, do not include according to legislation and patent practice, computer-readable medium
Electric carrier signal and telecommunication signal.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.
The computer program product includes one or more computer instructions.Load and execute on computers the meter
When calculation machine program instruction, entirely or partly generate according to process or function described in the embodiment of the present invention.The computer can
To be general purpose computer, special purpose computer, computer network or other programmable devices.The computer instruction can be deposited
Storage in a computer-readable storage medium, or from a computer readable storage medium to another computer readable storage medium
Transmission, for example, the computer instruction can pass through wired (example from a web-site, computer, server or data center
Such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (such as infrared, wireless, microwave) mode to another website
Website, computer, server or data center are transmitted.The computer readable storage medium can be computer and can deposit
Any usable medium of storage either includes that the data storages such as one or more usable mediums integrated server, data center are set
It is standby.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or partly lead
Body medium (such as solid state hard disk Solid State Disk (SSD)) etc.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or
The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit
It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the application
Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
It should be noted that the serial number of the above embodiments of the invention is only for description, do not represent the advantages or disadvantages of the embodiments.And
The terms "include", "comprise" herein or any other variant thereof is intended to cover non-exclusive inclusion, so that packet
Process, device, article or the method for including a series of elements not only include those elements, but also including being not explicitly listed
Other element, or further include for this process, device, article or the intrinsic element of method.Do not limiting more
In the case where, the element that is limited by sentence "including a ...", it is not excluded that including process, device, the article of the element
Or there is also other identical elements in method.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of file dispositions method, which is characterized in that be applied in Cloud Server, which comprises
The resource file information that memory node equipment reports is received, the resource file information includes the memory node equipment
The file request information that resource utilization and the memory node equipment receive；
Judge the resource utilization whether within the scope of preset resource reasonable employment；
If the resource utilization is more than the maximum value of the resource reasonable employment range, the target storage that can currently dispose is determined
Node device；
According to the file request information, file destination is determined；
The file destination is deployed in the target storage node equipment, wherein the target storage node deployed with devices
After the file destination, the resource utilization of the target storage node equipment is within the scope of the resource reasonable employment.
2. the method as described in claim 1, which is characterized in that the target storage node equipment packet that the determination can currently be disposed
It includes:
Remove the memory node equipment that resource utilization is more than the maximum value from all memory node equipment, determines that residue is deposited
Store up node device；
The memory space and resource utilization of the remaining memory node equipment are weighted, weighted score is obtained；
According to the sequence of weighted score from high to low, the remaining memory node equipment is ranked up；
The memory node equipment of first preset quantity in the top is determined as to the target storage node equipment that can currently dispose.
3. the method as described in claim 1, which is characterized in that the target storage node equipment packet that the determination can currently be disposed
It includes:
Remove the maximum value that the resource utilization is more than the resource reasonable employment range from all memory node equipment
Memory node equipment determines residue memory node equipment；
Obtain the resource utilization of the remaining memory node equipment；
The remaining memory node equipment that resource utilization is lower than default resource utilization threshold value is determined as the mesh that can currently dispose
Mark memory node equipment.
4. the method as described in claim 1, which is characterized in that it is described according to the file request information, determine file destination
Include:
From in the file request information obtain preset time in requested listed files；
Count the request number of times of each file in the listed files；
According to the sequence of request number of times from high to low, the All Files in the listed files are ranked up；
The file of second preset quantity in the top is determined as the file destination.
5. method according to any one of claims 1 to 4, which is characterized in that the method also includes:
If the resource utilization is lower than the minimum value of the resource reasonable employment range, deletes and deposited in the memory node equipment
The cold file of storage, wherein the request frequency of the cold file is lower than predeterminated frequency threshold value.
6. method according to any one of claims 1 to 4, which is characterized in that described to receive what memory node equipment reported
Before resource file information, the method also includes:
Receive the file request that client is sent；
The file request is responded, the memory node where Xiang Suoshu client returns to the corresponding file of the file request is set
It is standby.
7. a kind of Cloud Server, which is characterized in that the Cloud Server includes memory and processor, is stored on the memory
There is the file deployment program that can be executed by the processor, realizes when the file deployment program is executed by the processor as weighed
Benefit require any one of 1 to 6 described in file dispositions method.
8. Cloud Server according to claim 7, which is characterized in that the Cloud Server be component content distribution network or
The node of person's block chain network.
9. a kind of file deployment system, which is characterized in that the system comprises:
Receiving unit, the resource file information reported for receiving memory node equipment, the resource file information include described
The file request information that the resource utilization of memory node equipment and the memory node equipment receive；
Judging unit, for judging the resource utilization whether within the scope of preset resource reasonable employment；
First determination unit, if the maximum value for the resource utilization more than the resource reasonable employment range, determination is worked as
The preceding target storage node equipment disposed；
Second determination unit, for determining file destination according to the file request information；
Deployment unit, for the file destination to be deployed to the target storage node equipment, wherein the target storage
After node device disposes the file destination, the resource utilization of the target storage node equipment is in the resource reasonable employment
In range.
10. a kind of computer readable storage medium, which is characterized in that be stored with Documents Department on the computer readable storage medium
Program is affixed one's name to, the file deployment program can be executed by one or more processor, to realize as any in claim 1 to 6
File dispositions method described in.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811436571.4A CN109634915A (en) | 2018-11-28 | 2018-11-28 | File dispositions method, Cloud Server, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811436571.4A CN109634915A (en) | 2018-11-28 | 2018-11-28 | File dispositions method, Cloud Server, system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109634915A true CN109634915A (en) | 2019-04-16 |
Family
ID=66070101
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811436571.4A Pending CN109634915A (en) | 2018-11-28 | 2018-11-28 | File dispositions method, Cloud Server, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109634915A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110347648A (en) * | 2019-07-18 | 2019-10-18 | 深圳市网心科技有限公司 | File dispositions method and device, computer installation and storage medium |
| CN110365783A (en) * | 2019-07-18 | 2019-10-22 | 深圳市网心科技有限公司 | File dispositions method and device, network node and storage medium |
| CN110708370A (en) * | 2019-09-27 | 2020-01-17 | 中移物联网有限公司 | Data processing method and terminal |
| CN110704382A (en) * | 2019-09-25 | 2020-01-17 | 深圳市网心科技有限公司 | File deployment method, device, server and storage medium |
| CN110839069A (en) * | 2019-11-04 | 2020-02-25 | 深圳市网心科技有限公司 | Node data deployment method, node data deployment system and medium |
| CN111770180A (en) * | 2020-06-29 | 2020-10-13 | 百度在线网络技术（北京）有限公司 | Deployment method, device, equipment and storage medium |
| CN114338694A (en) * | 2022-03-04 | 2022-04-12 | 广州鹏捷科技股份有限公司 | One-stop cloud data center server scheduling method and system |
| CN115167783A (en) * | 2022-08-03 | 2022-10-11 | 贵州同创科技有限公司 | Electric power material data multi-element storage method and system based on big data |
| CN115242598A (en) * | 2022-07-15 | 2022-10-25 | 天翼云科技有限公司 | Cloud operating system deployment method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8255385B1 (en) * | 2011-03-22 | 2012-08-28 | Microsoft Corporation | Adaptive crawl rates based on publication frequency |
| CN103530189A (en) * | 2013-09-29 | 2014-01-22 | 中国科学院信息工程研究所 | Automatic scaling and migrating method and device oriented to stream data |
| CN104978236A (en) * | 2015-07-07 | 2015-10-14 | 四川大学 | HDFS load source and sink node selection method based on multiple measurement indexes |
| CN106227598A (en) * | 2016-07-20 | 2016-12-14 | 浪潮电子信息产业股份有限公司 | A kind of recovery method of cache resources |
| CN107766159A (en) * | 2017-11-13 | 2018-03-06 | 郑州云海信息技术有限公司 | A kind of metadata management method, device and computer-readable recording medium |
| CN107861999A (en) * | 2017-10-20 | 2018-03-30 | 北京集奥聚合科技有限公司 | The processing method and system of cold data in a kind of hdfs |
| CN107943594A (en) * | 2016-10-13 | 2018-04-20 | 北京京东尚科信息技术有限公司 | Data capture method and device |
| CN108536539A (en) * | 2018-04-26 | 2018-09-14 | 东北大学 | A kind of method for scheduling task in industrial allocation formula data collecting system |
-
2018
- 2018-11-28 CN CN201811436571.4A patent/CN109634915A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8255385B1 (en) * | 2011-03-22 | 2012-08-28 | Microsoft Corporation | Adaptive crawl rates based on publication frequency |
| CN103530189A (en) * | 2013-09-29 | 2014-01-22 | 中国科学院信息工程研究所 | Automatic scaling and migrating method and device oriented to stream data |
| CN104978236A (en) * | 2015-07-07 | 2015-10-14 | 四川大学 | HDFS load source and sink node selection method based on multiple measurement indexes |
| CN106227598A (en) * | 2016-07-20 | 2016-12-14 | 浪潮电子信息产业股份有限公司 | A kind of recovery method of cache resources |
| CN107943594A (en) * | 2016-10-13 | 2018-04-20 | 北京京东尚科信息技术有限公司 | Data capture method and device |
| CN107861999A (en) * | 2017-10-20 | 2018-03-30 | 北京集奥聚合科技有限公司 | The processing method and system of cold data in a kind of hdfs |
| CN107766159A (en) * | 2017-11-13 | 2018-03-06 | 郑州云海信息技术有限公司 | A kind of metadata management method, device and computer-readable recording medium |
| CN108536539A (en) * | 2018-04-26 | 2018-09-14 | 东北大学 | A kind of method for scheduling task in industrial allocation formula data collecting system |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110347648A (en) * | 2019-07-18 | 2019-10-18 | 深圳市网心科技有限公司 | File dispositions method and device, computer installation and storage medium |
| CN110365783A (en) * | 2019-07-18 | 2019-10-22 | 深圳市网心科技有限公司 | File dispositions method and device, network node and storage medium |
| CN110347648B (en) * | 2019-07-18 | 2022-04-01 | 深圳市网心科技有限公司 | File deployment method and device, computer device and storage medium |
| CN110704382A (en) * | 2019-09-25 | 2020-01-17 | 深圳市网心科技有限公司 | File deployment method, device, server and storage medium |
| CN110708370A (en) * | 2019-09-27 | 2020-01-17 | 中移物联网有限公司 | Data processing method and terminal |
| CN110708370B (en) * | 2019-09-27 | 2022-06-10 | 中移物联网有限公司 | Data processing method and terminal |
| CN110839069B (en) * | 2019-11-04 | 2021-09-24 | 深圳市网心科技有限公司 | Node data deployment method, node data deployment system and medium |
| CN110839069A (en) * | 2019-11-04 | 2020-02-25 | 深圳市网心科技有限公司 | Node data deployment method, node data deployment system and medium |
| CN111770180A (en) * | 2020-06-29 | 2020-10-13 | 百度在线网络技术（北京）有限公司 | Deployment method, device, equipment and storage medium |
| CN114338694A (en) * | 2022-03-04 | 2022-04-12 | 广州鹏捷科技股份有限公司 | One-stop cloud data center server scheduling method and system |
| CN114338694B (en) * | 2022-03-04 | 2022-05-31 | 广州鹏捷科技股份有限公司 | One-stop cloud data center server scheduling method and system |
| CN115242598A (en) * | 2022-07-15 | 2022-10-25 | 天翼云科技有限公司 | Cloud operating system deployment method and device |
| CN115167783A (en) * | 2022-08-03 | 2022-10-11 | 贵州同创科技有限公司 | Electric power material data multi-element storage method and system based on big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109634915A (en) | File dispositions method, Cloud Server, system and storage medium | |
| CN109933420A (en) | Node tasks dispatching method, electronic equipment and system | |
| CN109857551B (en) | Service resource scheduling method and device based on cloud computing and electronic equipment | |
| US10484468B2 (en) | Method and device for downloading file | |
| MX2013013951A (en) | Application notifications. | |
| CN106534281A (en) | Data request responding method, apparatus and system | |
| US11080068B2 (en) | Adaptive user-interface assembling and rendering | |
| CN110493357A (en) | A kind of calculation resource disposition method, system, device and computer storage medium | |
| CN109152061A (en) | Channel agility method, apparatus, server and storage medium | |
| CN107357857A (en) | A kind of method and service node device for updating cache information | |
| CN110225104A (en) | Data capture method, device and terminal device | |
| CN109413207A (en) | A kind of file uploading method, system, device and computer readable storage medium | |
| CN107944000A (en) | Flight freight rate update method, device, electronic equipment, storage medium | |
| CN108038112A (en) | Document handling method, mobile terminal and computer-readable recording medium | |
| CN109818810A (en) | A kind of access server connection optimization method, access server and communication system | |
| CN110442773A (en) | Distributed system interior joint caching method, system, device and computer media | |
| US11190581B1 (en) | Job allocation support system and method | |
| CN109309735A (en) | Connection processing method, server, system and storage medium | |
| CN106411920A (en) | Data sharing method and device | |
| CN110290399A (en) | A kind of data distributing method, system, device and computer readable storage medium | |
| CN111338745B (en) | Deployment method and device of virtual machine and intelligent device | |
| CN115345464A (en) | Service order dispatching method and device, computer equipment and storage medium | |
| CN111142799A (en) | Distributed storage method and device, network node and storage medium | |
| CN109639801A (en) | Back end distribution and data capture method and system | |
| CN114924751A (en) | Method and device for distributing service access request flow |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190416 |