CN112083890A - Data processing method for automatically adjusting cache, data processing system, data visualization equipment and computer readable storage medium - Google Patents

Data processing method for automatically adjusting cache, data processing system, data visualization equipment and computer readable storage medium Download PDF

Info

Publication number
CN112083890A
CN112083890A CN202010976178.5A CN202010976178A CN112083890A CN 112083890 A CN112083890 A CN 112083890A CN 202010976178 A CN202010976178 A CN 202010976178A CN 112083890 A CN112083890 A CN 112083890A
Authority
CN
China
Prior art keywords
cache
data
data processing
data stream
parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010976178.5A
Other languages
Chinese (zh)
Inventor
庄佳颖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shangde Shenzhen Data Technology Co ltd
Thunder Zhuhai Data Technology Co ltd
Original Assignee
Shangde Shenzhen Data Technology Co ltd
Thunder Zhuhai Data Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shangde Shenzhen Data Technology Co ltd, Thunder Zhuhai Data Technology Co ltd filed Critical Shangde Shenzhen Data Technology Co ltd
Priority to CN202010976178.5A priority Critical patent/CN112083890A/en
Publication of CN112083890A publication Critical patent/CN112083890A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0656Data buffering arrangements

Abstract

The invention discloses a data processing method, a data processing system, data visualization equipment and a computer readable storage medium for automatically adjusting cache, wherein the method comprises the following steps: initializing a data processing program according to the cache parameters; receiving a data stream, and performing data statistics on the data stream; and carrying out caching processing on the received data stream according to the caching parameters, and dynamically adjusting the caching capacity and the caching quantity of data processing so as to achieve the best efficiency for different data volumes. The problem that the traditional data processing method has fixed cache capacity and cache quantity, and cannot dynamically adjust parameters on line according to different data volumes in practical application, so that the data processing efficiency can be changed due to different data volumes, and the optimal efficiency cannot be maintained is solved.

Description

Data processing method for automatically adjusting cache, data processing system, data visualization equipment and computer readable storage medium
Technical Field
The present invention relates to the field of data caching technologies, and in particular, to a data processing method, a data processing system, a data visualization device, and a computer-readable storage medium for automatically adjusting a cache.
Background
In a storage system, in order to reasonably pool cache resources, a technique of cache partitioning is used to achieve this goal. In current storage systems, the system creates a cache partition for each storage pool.
In the prior art, the occupied cache capacity and the occupied cache number of each cache partition created by the system are fixed, so all the storage pools are evenly allocated with cache resources, and the work is automatically completed. When the number of the storage pools changes, each cache partition is automatically adjusted to the same proportion, so that when different data volumes are processed, the overall data processing efficiency has different efficiency changes due to the change of the data volumes. .
In practical applications, a critical application may be run on a certain storage pool, and when a cache space required by a certain critical application is large, if the cache space of the critical application is not enough according to a cache partition average allocation manner, the critical application may not run. The system is reset after the parameters are adjusted, and the parameters cannot be dynamically adjusted on line according to different data volumes in practical application, so that the data processing performance is changed due to different data volumes, and the optimal performance cannot be maintained.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a data processing method and a data processing system for automatically adjusting cache, which aim to solve the problems in the prior art, and the specific scheme is as follows:
in a first aspect, the present invention provides a data processing method for automatically adjusting a cache, where the method includes:
initializing a data processing program according to the cache parameters;
receiving a data stream, and performing data statistics on the data stream;
and carrying out caching processing on the received data stream according to the caching parameters.
Preferably, the method further comprises: and updating a counter for data statistics, and adjusting the cache parameters according to the latest statistical data in the counter.
Preferably, the caching parameters include: the cache capacity, the cache number, a cache capacity parameter list and a cache number parameter list.
Preferably, the initializing the data processing program according to the cache parameter includes:
acquiring the maximum value of the cache capacity parameter list and the maximum value of the cache quantity parameter list;
and setting a cache space according to the maximum cache capacity and the maximum cache quantity, and initializing a receiving buffer area.
Preferably, before the initializing the data processing program according to the cache parameter, the method further includes: and receiving data of a transmitting end and forming the data stream.
Preferably, after the buffering the received data stream according to the buffering parameter, the method further includes: and extracting the data after the cache processing, and sending the data to a data center for processing.
Preferably, the data statistics of the data stream are performed, and the method comprises the following steps: and performing data statistics on the data stream by adopting a sliding window algorithm.
In a second aspect, the present invention provides a data processing system for automatically adjusting a cache, the system comprising:
the initialization module is used for initializing a data processing program according to the cache parameters;
the receiving and counting module is used for receiving the data stream and carrying out data counting on the data stream;
and the cache processing module is used for carrying out cache processing on the received data stream according to the cache parameters.
In a third aspect, the present invention provides a data processing apparatus for automatically adjusting a cache, where the apparatus includes:
the communication bus is used for realizing the connection communication between the processor and the memory;
a memory for storing a computer program;
a processor for executing the computer program to implement the steps of:
initializing a data processing program according to the cache parameters;
receiving a data stream, and performing data statistics on the data stream;
and carrying out caching processing on the received data stream according to the caching parameters.
In a fourth aspect, the invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the method according to the first aspect.
The invention has the beneficial effects that: the data processing method and the system for automatically adjusting the cache initialize a data processing program according to the cache parameters; receiving a data stream, and performing data statistics on the data stream; and carrying out cache processing on the received data stream according to the cache parameters, and dynamically adjusting the cache capacity and the cache number of data processing so as to achieve the best efficiency for different data volumes. The problem that the traditional data processing method has fixed cache capacity and cache quantity, and cannot dynamically adjust parameters on line according to different data volumes in practical application, so that the data processing efficiency can be changed due to different data volumes, and the optimal efficiency cannot be maintained is solved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, it is obvious that the drawings in the following description are only some embodiments of the present invention, the embodiments in the drawings do not constitute any limitation to the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating a data processing method for automatically adjusting a cache according to an embodiment of the present invention.
FIG. 2 is a block diagram of a data processing system with an automatic cache adjustment function according to an embodiment of the present invention.
FIG. 3 is a block diagram of a data processing apparatus for automatically adjusting a cache according to an embodiment of the present invention.
Detailed Description
The technical solution of the present invention will be further described in detail with reference to the accompanying drawings and embodiments, which are preferred embodiments of the present invention. It is to be understood that the described embodiments are merely a subset of the embodiments of the invention, and not all embodiments; it should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The main idea of the technical scheme of the embodiment of the invention is as follows: initializing a data processing program according to the cache parameters; receiving a data stream, and performing data statistics on the data stream; and carrying out caching processing on the received data stream according to the caching parameters.
In order to better understand the technical solutions, the technical solutions will be described in detail below with reference to the drawings and specific embodiments.
Example one
An embodiment of the present invention provides a data processing method for automatically adjusting a cache, as shown in fig. 1, the data processing method for automatically adjusting a cache may specifically include the following steps:
and S101, initializing a data processing program according to the cache parameters.
In this embodiment, the caching parameters include: the cache capacity, the cache number, a cache capacity parameter list and a cache number parameter list.
Specifically, the maximum value of the cache capacity parameter list and the maximum value of the cache number parameter list are obtained;
further, a cache space is set according to the maximum cache capacity and the maximum cache quantity, and a receiving buffer area is initialized.
S102, receiving a data stream, and performing data statistics on the data stream.
Specifically, a sliding window algorithm is adopted to perform data statistics on the data stream.
S103, caching the received data stream according to the caching parameters.
For example, the server sends the data stream of the streaming media file to a receiving buffer, the receiving buffer receives and stores the data stream to any storage space in the receiving buffer, the storage structure of the receiving buffer can be a chained queue or an array type, the receiving buffer can also decode the data packet of the receiving buffer through a decoder to obtain a decoded data packet, and then stores the decoded data packet into a playing buffer, and the storage structure of the receiving buffer is a sequential queue.
And S104, updating a counter for data statistics, and adjusting the cache parameters according to the latest statistical data in the counter.
In an optional embodiment, before the initializing the data processing program according to the buffer parameters, the data of the sending end is received, and the data stream is formed.
In another optional embodiment, after the received data stream is cached according to the caching parameter, the cached data is extracted and sent to a data center for processing.
Example two
An embodiment of the present invention provides a data processing system for automatically adjusting a cache, as shown in fig. 2, the cache adjustment processing system may specifically include the following modules:
and the initialization module is used for initializing the data processing program according to the cache parameters.
In this embodiment, the caching parameters include: the cache capacity, the cache number, a cache capacity parameter list and a cache number parameter list.
Specifically, the maximum value of the cache capacity parameter list and the maximum value of the cache number parameter list are obtained, then a cache space is set according to the maximum value of the cache capacity and the maximum value of the cache number, and a receiving buffer area is initialized.
And the receiving and counting module is used for receiving the data stream and carrying out data counting on the data stream.
Specifically, a sliding window algorithm is adopted to perform data statistics on the data stream.
And the cache processing module is used for carrying out cache processing on the received data stream according to the cache parameters.
For example, the server sends the data stream of the streaming media file to a receiving buffer, the receiving buffer receives and stores the data stream to any storage space in the receiving buffer, the storage structure of the receiving buffer can be a chained queue or an array type, the receiving buffer can also decode the data packet of the receiving buffer through a decoder to obtain a decoded data packet, and then stores the decoded data packet into a playing buffer, and the storage structure of the receiving buffer is a sequential queue.
EXAMPLE III
An embodiment of the present invention provides a data processing device for automatically adjusting a cache, and as shown in fig. 3, the visualization device may specifically include the following modules:
the communication bus is used for realizing the connection communication between the processor and the memory;
a memory for storing a computer program; the memory may comprise high-speed RAM memory and may also comprise non-volatile memory, such as at least one disk memory. The memory may optionally comprise at least one memory device.
A processor for executing the computer program to implement the steps of:
first, a data handler is initialized according to cache parameters.
In this embodiment, the caching parameters include: the cache capacity, the cache number, a cache capacity parameter list and a cache number parameter list.
Specifically, the maximum value of the cache capacity parameter list and the maximum value of the cache number parameter list are obtained;
further, a cache space is set according to the maximum cache capacity and the maximum cache quantity, and a receiving buffer area is initialized.
Secondly, receiving a data stream, and performing data statistics on the data stream. Specifically, a sliding window algorithm is adopted to perform data statistics on the data stream.
And then, carrying out caching processing on the received data stream according to the caching parameters.
For example, the server sends the data stream of the streaming media file to a receiving buffer, the receiving buffer receives and stores the data stream to any storage space in the receiving buffer, the storage structure of the receiving buffer can be a chained queue or an array type, the receiving buffer can also decode the data packet of the receiving buffer through a decoder to obtain a decoded data packet, and then stores the decoded data packet into a playing buffer, and the storage structure of the receiving buffer is a sequential queue.
And finally, updating a counter for data statistics, and adjusting the cache parameters according to the latest statistical data in the counter.
In an optional embodiment, before the initializing the data processing program according to the buffer parameters, the data of the sending end is received, and the data stream is formed.
In another optional embodiment, after the received data stream is cached according to the caching parameter, the cached data is extracted and sent to a data center for processing.
Example four
An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the cache adjustment processing method.
In summary, the data processing method and system for automatically adjusting the cache according to the embodiments of the present invention initialize the data processing program according to the cache parameter; receiving a data stream, and performing data statistics on the data stream; and carrying out cache processing on the received data stream according to the cache parameters, and dynamically adjusting the cache capacity and the cache number of data processing so as to achieve the best efficiency for different data volumes. The problem that the traditional data processing method has fixed cache capacity and cache quantity, and cannot dynamically adjust parameters on line according to different data volumes in practical application, so that the data processing efficiency can be changed due to different data volumes, and the optimal efficiency cannot be maintained is solved.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are exemplary embodiments and that the acts and modules illustrated are not necessarily required to practice the invention.
The above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the present application are generated in whole or in part when the computer program instructions are loaded or executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more collections of available media. The available media may be magnetic media (e.g., floppy disks, hard disks, tapes), optical media (e.g., DVDs), or semiconductor media. The semiconductor medium may be a solid state disk.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A data processing method for automatically adjusting cache is characterized by comprising the following steps:
initializing a data processing program according to the cache parameters;
receiving a data stream, and performing data statistics on the data stream;
and carrying out caching processing on the received data stream according to the caching parameters.
2. The data processing method for automatically adjusting cache according to claim 1, further comprising: and updating a counter for data statistics, and adjusting the cache parameters according to the latest statistical data in the counter.
3. The data processing method for automatically adjusting the cache according to claim 1 or 2, wherein the cache parameters comprise: the cache capacity, the cache number, a cache capacity parameter list and a cache number parameter list.
4. The data processing method for automatically adjusting cache according to claim 3, wherein the data processing program is initialized according to the cache parameters, the method comprising:
acquiring the maximum value of the cache capacity parameter list and the maximum value of the cache quantity parameter list;
and setting a cache space according to the maximum cache capacity and the maximum cache quantity, and initializing a receiving buffer area.
5. The data processing method for automatically adjusting cache according to claim 4, wherein before the initializing the data processing program according to the cache parameter, the method further comprises: and receiving data of a transmitting end and forming the data stream.
6. The data processing method for automatically adjusting buffering according to claim 5, wherein after the buffering the received data stream according to the buffering parameter, the method further comprises: and extracting the data after the cache processing, and sending the data to a data center for processing.
7. The data processing method for automatically adjusting the buffer memory according to claim 1, wherein the data statistics of the data stream includes: and performing data statistics on the data stream by adopting a sliding window algorithm.
8. A data processing system that automatically adjusts a cache, the system comprising:
the initialization module is used for initializing a data processing program according to the cache parameters;
the receiving and counting module is used for receiving the data stream and carrying out data counting on the data stream;
and the cache processing module is used for carrying out cache processing on the received data stream according to the cache parameters.
9. A data warehouse-based data visualization apparatus, the apparatus comprising:
the communication bus is used for realizing the connection communication between the processor and the memory;
a memory for storing a computer program;
a processor for executing the computer program to implement the steps of:
initializing a data processing program according to the cache parameters;
receiving a data stream, and performing data statistics on the data stream;
and carrying out caching processing on the received data stream according to the caching parameters.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a data processing method of automatically adjusting a cache according to any one of claims 1 to 7.
CN202010976178.5A 2020-09-16 2020-09-16 Data processing method for automatically adjusting cache, data processing system, data visualization equipment and computer readable storage medium Pending CN112083890A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010976178.5A CN112083890A (en) 2020-09-16 2020-09-16 Data processing method for automatically adjusting cache, data processing system, data visualization equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010976178.5A CN112083890A (en) 2020-09-16 2020-09-16 Data processing method for automatically adjusting cache, data processing system, data visualization equipment and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN112083890A true CN112083890A (en) 2020-12-15

Family

ID=73736482

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010976178.5A Pending CN112083890A (en) 2020-09-16 2020-09-16 Data processing method for automatically adjusting cache, data processing system, data visualization equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN112083890A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114333103B (en) * 2021-12-24 2024-04-19 中国铁道科学研究院集团有限公司 Locomotive-mounted data train-ground dumping system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130232228A1 (en) * 2012-03-01 2013-09-05 General Instrument Corporation Managing adaptive streaming of data via a communication connection
CN105718384A (en) * 2014-12-05 2016-06-29 中兴通讯股份有限公司 Cache configuration method and device
US20170063959A1 (en) * 2015-08-27 2017-03-02 Cavium, Inc. Method and Apparatus for Providing a Low Latency Transmission System Using Adjustable Buffers
CN111026677A (en) * 2019-10-31 2020-04-17 苏州浪潮智能科技有限公司 Cache allocation method, system, terminal and storage medium based on EMA algorithm

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130232228A1 (en) * 2012-03-01 2013-09-05 General Instrument Corporation Managing adaptive streaming of data via a communication connection
CN105718384A (en) * 2014-12-05 2016-06-29 中兴通讯股份有限公司 Cache configuration method and device
US20170063959A1 (en) * 2015-08-27 2017-03-02 Cavium, Inc. Method and Apparatus for Providing a Low Latency Transmission System Using Adjustable Buffers
CN111026677A (en) * 2019-10-31 2020-04-17 苏州浪潮智能科技有限公司 Cache allocation method, system, terminal and storage medium based on EMA algorithm

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114333103B (en) * 2021-12-24 2024-04-19 中国铁道科学研究院集团有限公司 Locomotive-mounted data train-ground dumping system and method

Similar Documents

Publication Publication Date Title
US10656838B2 (en) Automatic stream detection and assignment algorithm
EP3073364B1 (en) Caching and tiering for cloud storage
TW201447746A (en) Automatic tuning of virtual data center resource utilization policies
US20150199281A1 (en) Apparatus and method for meeting performance metrics for users in file systems
CN108733344A (en) Data read-write method, device and circle queue
CN111224806A (en) Resource allocation method and server
EP4020153A1 (en) Cache space management method and device
US11936616B2 (en) Assigning variable length address identifiers to packets in a processing system
CN111291770B (en) Parameter configuration method and device
CN104866339A (en) Distributed persistent management method, system and device of FOTA data
CN108924203B (en) Data copy self-adaptive distribution method, distributed computing system and related equipment
CN108632624B (en) Image data processing method and device, terminal equipment and readable storage medium
WO2013101120A1 (en) Online learning based algorithms to increase retention and reuse of gpu-generated dynamic surfaces in outer-level caches
EP3944091B1 (en) Cache allocation method and device, storage medium, and electronic device
US9135064B2 (en) Fine grained adaptive throttling of background processes
US20130238871A1 (en) Data processing method and apparatus, pci-e bus system, and server
CN112083890A (en) Data processing method for automatically adjusting cache, data processing system, data visualization equipment and computer readable storage medium
CN110222019B (en) Method and device for adjusting space occupied by file system
CN111651126B (en) Memory writing operation method, system, electronic device and medium
US10387330B1 (en) Less recently and frequently used (LRAFU) cache replacement policy
CN113268329B (en) Request scheduling method, device and storage medium
JPWO2020217465A1 (en) Network controller
CN112882835B (en) Machine node parallel processing method and device, computer equipment and storage medium
JP6848278B2 (en) Storage management device, performance adjustment method and performance adjustment program
CN107408071A (en) A kind of memory pool access method, device and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination