CN109246234B - Image file downloading method and device, electronic equipment and storage medium - Google Patents

Image file downloading method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN109246234B
CN109246234B CN201811162297.6A CN201811162297A CN109246234B CN 109246234 B CN109246234 B CN 109246234B CN 201811162297 A CN201811162297 A CN 201811162297A CN 109246234 B CN109246234 B CN 109246234B
Authority
CN
China
Prior art keywords
image file
image
mirror image
tasks
cache region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811162297.6A
Other languages
Chinese (zh)
Other versions
CN109246234A (en
Inventor
葛淼龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Kingsoft Cloud Network Technology Co Ltd
Beijing Kingsoft Cloud Technology Co Ltd
Original Assignee
Beijing Kingsoft Cloud Network Technology Co Ltd
Beijing Kingsoft Cloud Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Kingsoft Cloud Network Technology Co Ltd, Beijing Kingsoft Cloud Technology Co Ltd filed Critical Beijing Kingsoft Cloud Network Technology Co Ltd
Priority to CN201811162297.6A priority Critical patent/CN109246234B/en
Publication of CN109246234A publication Critical patent/CN109246234A/en
Application granted granted Critical
Publication of CN109246234B publication Critical patent/CN109246234B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching

Abstract

The embodiment of the invention provides a method and a device for downloading an image file, electronic equipment and a storage medium, wherein the method comprises the following steps: receiving a mirror image file downloading request; determining whether a mirror image cache region of the mirror image server caches a mirror image file corresponding to the mirror image file downloading request; if the image file corresponding to the image file downloading request is cached in the image cache region of the image server, acquiring the processing quantity of the first image file tasks currently processed in parallel in the image cache region; determining whether the processing number of the first image file tasks reaches a preset number threshold; and when the processing quantity of the first image file tasks does not reach the preset quantity threshold value, reading the image file corresponding to the image file downloading request from the image cache region. The embodiment of the invention improves the overall processing efficiency of the mirror image server.

Description

Image file downloading method and device, electronic equipment and storage medium
Technical Field
The invention relates to the technical field of cloud computing, in particular to a method and a device for downloading an image file, electronic equipment and a storage medium.
Background
The image file is similar to the compressed package, and a specific series of files are made into a single file according to a certain format, so that the single file is convenient for a user to download and use, such as an operating system, games and the like. The most important feature of the image file is that it can be recognized by specific software and directly recorded on the optical disc. The image file in the general sense can be extended and more information can be contained in the image file. Such as system files, boot files, partition table information, etc.
In the prior art, when a service server needs to acquire an image file, the service server sends an image downloading request to the image server, and after receiving the image downloading request, the image server acquires the image file from a mirror database and returns the image file requested to be downloaded to the service server.
At present, one mirror image server needs to process mirror image downloading requests from a plurality of service servers, and different service servers may request the same mirror image file, so that, in order to improve processing efficiency, the mirror image server may cache the acquired mirror image file in a mirror image database, so that after receiving the mirror image downloading request, the mirror image file requested to be downloaded by the service server can be quickly found from the cache and returned. The cached image file may be an image file that has been returned to a certain service server, or may be a part of image file that has been cached in advance, where the image file may be a whole image file of a mirror database of the image server, or a part of image file that is commonly used, for example, an image file with a large number of requests for downloading. Specifically, the caching middleware can be installed on the image server to implement the processing of the image download request and the caching of the image file.
In practical application, the image server may process a plurality of image download requests in parallel, which may involve performing a read operation of an image file in the cache middleware, or may also perform a cache operation of a plurality of image files in parallel, which may involve performing a write operation of an image file in the cache middleware. However, if there are more image downloading requests for parallel processing or there are more image files cached in parallel, that is, for the caching middleware, there are more parallel read-write operations for the image files, which may cause the read-write pressure of the caching middleware to increase, and the overall performance of the image server to decrease, and on the contrary, the overall processing efficiency of the image server is low.
Disclosure of Invention
The embodiment of the invention aims to provide a method and a device for downloading an image file, electronic equipment and a storage medium, so as to improve the overall processing efficiency of an image server. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention discloses a method for downloading an image file, which is applied to an image server, and the method includes:
receiving a mirror image file downloading request;
determining whether a mirror image cache region of the mirror image server caches a mirror image file corresponding to the mirror image file downloading request;
if the image file corresponding to the image file downloading request is cached in the image cache region of the image server, acquiring the processing quantity of the first image file tasks currently processed in parallel in the image cache region;
determining whether the processing number of the first image file tasks reaches a preset number threshold;
and when the processing quantity of the first image file tasks does not reach the preset quantity threshold value, reading the image file corresponding to the image file downloading request from the image cache region.
Optionally, the method further comprises:
and when the processing quantity of the first image file tasks reaches the preset quantity threshold value, reading the image file corresponding to the image file downloading request from a preset image database.
Optionally, after determining whether the image file corresponding to the image file downloading request is cached in the image cache area of the image server, the method further includes:
if the image caching area of the image server does not cache the image file corresponding to the image file downloading request, reading the image file corresponding to the image file downloading request from a preset image database;
acquiring the processing quantity of the second image file tasks currently processed in parallel in the image cache region;
determining whether the processing number of the second image file tasks reaches a preset number threshold;
and when the processing quantity of the second image file tasks does not reach the preset quantity threshold value, writing the image file corresponding to the image file downloading request read from the preset image database into the image cache area.
Optionally, the first image file task includes:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file to the mirror image cache region;
the processing quantity of the first image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
Optionally, the second image file task includes:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file to the mirror image cache region;
the processing quantity of the second image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
Optionally, the first image file task includes:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, and a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the acquiring the processing number of the first image file tasks currently processed in parallel in the image cache region comprises:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks of the image cache region as the processing quantity of the first image file tasks. Optionally, the second image file task includes:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, and a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the acquiring the processing number of the second image file tasks currently processed in parallel in the image cache region comprises:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks of the image cache region as the processing quantity of the second image file tasks.
In a second aspect, an embodiment of the present invention further discloses an image file downloading device, which is applied to an image server, and the device includes:
the receiving module is used for receiving a mirror image file downloading request;
the determining module is used for determining whether a mirror image cache region of the mirror image server caches a mirror image file corresponding to the mirror image file downloading request;
the task quantity obtaining module is used for obtaining the processing quantity of the first image file tasks currently processed in parallel in the image cache area if the image cache area of the image server caches the image file corresponding to the image file downloading request;
the threshold value judging module is used for determining whether the processing number of the first image file tasks reaches a preset number threshold value;
and the first processing module is used for reading the image file corresponding to the image file downloading request from the image cache area when the processing quantity of the first image file tasks does not reach the preset quantity threshold value.
Optionally, the apparatus further comprises:
and the second processing module is used for reading the image file corresponding to the image file downloading request from a preset image database when the processing quantity of the first image file tasks reaches the preset quantity threshold value.
Optionally, the apparatus further comprises:
the third processing module is used for reading the image file corresponding to the image file downloading request from a preset image database if the image file corresponding to the image file downloading request is not cached in the image caching area of the image server;
the second task quantity obtaining module is used for obtaining the processing quantity of second image file tasks currently processed in parallel in the image cache region;
the second threshold value judging module is used for determining whether the processing number of the second image file tasks reaches a preset number threshold value;
and the fourth processing module is used for writing the image file corresponding to the image file downloading request read from the preset image database into the image cache area when the processing quantity of the second image file tasks does not reach the preset quantity threshold value.
Optionally, the first image file task includes: a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file to the mirror image cache region;
the processing quantity of the first image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
Optionally, the second image file task includes: a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file to the mirror image cache region;
the processing quantity of the second image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
Optionally, the first image file task includes:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, and a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the task quantity obtaining module comprises:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks of the image cache region as the processing quantity of the first image file tasks.
Optionally, the second image file task includes:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, and a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the second task quantity obtaining module includes:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks of the image cache region as the processing quantity of the second image file tasks.
In a third aspect, an embodiment of the present invention further discloses an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the method steps of any one of the image file downloading methods when executing the program stored in the memory.
In a fourth aspect, an embodiment of the present invention further discloses a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method step of any one of the image file downloading methods is implemented.
In the method, the device, the electronic device and the storage medium for downloading the image file, provided by the embodiment of the invention, after the image file downloading request is received by the image server, whether the image file corresponding to the image file downloading request is cached or not is firstly searched in the image cache region of the image server, if the image file corresponding to the image file downloading request is cached in the image cache region, the processing quantity of the first image file tasks currently processed in parallel in the image cache region is obtained, a preset quantity threshold value is set for the image cache region, whether the processing quantity of the first image file tasks currently reaches the preset quantity threshold value or not is determined, and when the processing quantity of the first image file tasks does not reach the preset quantity threshold value, the image file corresponding to the image file downloading request is read from the image cache region. In the embodiment of the invention, the mirror image cache region is provided with the mirror image file task threshold, so that the mirror image file is read and written under the condition that the task amount of the mirror image file task in the mirror image cache region is below the threshold, the condition of high reading and writing pressure of the cache region is effectively avoided, and the overall processing efficiency of the mirror image server is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a diagram of an image file processing system architecture according to an embodiment of the present invention;
FIG. 2 is a flowchart of a method for downloading an image file according to an embodiment of the present invention;
FIG. 3 is a flowchart of a method for downloading an image file according to an embodiment of the present invention;
FIG. 4 is a flowchart of a method for downloading an image file according to an embodiment of the present invention;
FIG. 5 is a flowchart of a method for downloading an image file according to an embodiment of the present invention;
FIG. 6 is a schematic structural diagram of an image file downloading device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the prior art, when a service server or a user end device needs to acquire an image file, an image downloading request is sent to an image server, and after receiving the image downloading request, the image server returns the image file requested to be downloaded to the service server. In practical application, the image server may read an image file from a preset image database and send the image file to the service server or the user side device, and may set a cache middleware, i.e., a cache area, in the image server, the image server may cache the image file read from the image database in the cache area, and when receiving a same image file download request, directly read the image file from the cache area. However, the mirror image server may process a plurality of mirror image download requests in parallel, and may also cache a plurality of mirror image files in parallel, so that there are many read-write operations on the cache area in parallel in the same time period, which may cause an increase in read-write pressure of the cache middleware, and a decrease in overall performance of the mirror image server, and on the contrary, may cause a lower overall processing efficiency of the mirror image server.
In order to solve the technical problem, in the embodiment of the present invention, the number threshold of the mirror image file tasks is set in the cache region of the mirror image server, so that the number of the mirror image file tasks concurrently processed in the cache region of the mirror image server does not exceed the preset number threshold, thereby ensuring that the mirror image file is read and written in the cache region under the condition that the task amount of the mirror image file tasks in the cache region is below the threshold, effectively avoiding the condition of high read and write pressure in the cache region, and further improving the overall processing efficiency of the mirror image server.
The architecture of the image file downloading method of the embodiment of the invention can be seen in fig. 1. Fig. 1 is a diagram of an image processing system architecture according to an embodiment of the present invention, where the system architecture of an image file includes a plurality of business servers 101, an image server 102, an image caching area 1021 (e.g., caching middleware, a caching database) disposed in the image server 102, and an image database 103. After receiving the image file downloading request sent by the service server 101, the image server 102 may directly obtain the image file corresponding to the image file downloading request in the image cache area 1021, and when the image cache area 1021 does not have the image file corresponding to the image file downloading request, the image server 102 obtains the image file corresponding to the image file downloading request in the preset image database 103. The image cache area 1021 may cache an image file that is frequently used in the image database 103 or an image file generated by the service server 101 itself. In the embodiment of the present invention, a preset number threshold is set for a cache area 1021 of a mirror image server according to the system architecture, so as to generate a method for downloading a mirror image file according to the embodiment of the present invention, specifically as follows:
in a first aspect, an embodiment of the present invention discloses a method for downloading an image file, as shown in fig. 2. Fig. 2 is a flowchart of a method for downloading an image file, which is applied to an image server and includes:
s201, receiving an image file downloading request.
The image server of the embodiment of the present invention may be a dedicated "simple box" or NAS (network attached storage) device for storing the image file. In this step, the image server receives an image file downloading request from the service server or the user side device.
S202, determining whether a mirror image file corresponding to the mirror image file downloading request is cached in a mirror image caching area of a mirror image server;
in this step, after the image server receives the image file downloading request, it first searches whether there is an image file corresponding to the image file downloading request in the image cache region. For example, by parsing a data packet of the image file download request, an image file name or an image file identifier included in the data packet is obtained, and whether an image file consistent with the image file name or the image file identifier exists is searched in an image cache region.
S203, if the mirror image file corresponding to the mirror image file downloading request is cached in the mirror image cache region of the mirror image server, the processing quantity of the first mirror image file tasks currently processed in parallel in the mirror image cache region is obtained.
In the step, the processing number of the first image file tasks processed in parallel in the cache area of the image server at the current time can be acquired through a mathematical statistics mode. Or, detecting the processing quantity of the first image file tasks processed in parallel in the cache region of the image server through a detection program.
Specifically, the processing number of the image file reading tasks for reading the image file in the cache region of the image server at the current time can be counted in a mathematical statistics mode; and counting the processing quantity of the image file writing tasks cached to the cache region at the current time. Or, detecting the processing quantity of the image file reading tasks for reading the image files from the cache region of the image server at the current time through a detection program; and detecting the processing quantity of the image file writing tasks cached to the cache region at the current time. The image file reading task comprises the following steps: and according to a request sent by the service server or the user terminal equipment, reading the image file corresponding to the request from the cache area, and downloading the image file to the corresponding service server. Writing a mirror image file into a task; the task of writing the mirror image file is as follows: and writing the commonly used image files in the image database of the image server into a cache area of the image server, or storing the image files newly built by the service server or the user side equipment in the cache server.
Optionally, the first image file task in S203 includes:
the image file reading task is used for reading the image file from the image cache region, and the image file writing task is used for caching the image file in the image cache region;
in S203, acquiring the processing number of the first image file tasks currently processed in parallel in the image cache area includes:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks in the image cache region as the processing quantity of the first image file tasks.
S204, determining whether the processing number of the first image file tasks reaches a preset number threshold.
In the implementation of the present invention, a preset number threshold may be set for the cache area of the mirror server. That is, the corresponding task processing data when the parallel processing task performance of the cache region of the mirror image server is optimal is obtained by analyzing the historical data, and the number is determined as the preset number threshold of the cache region of the mirror image server in the embodiment of the present invention.
In this step, a threshold judgment program for the number of tasks of the mirror image file processed in parallel in the cache area of the mirror image server may be set, that is, the judgment program may judge the relationship between the number of tasks of the mirror image file processed in parallel in the cache area at the current time and the threshold of the preset number in real time, and determine whether the processing number at the current time reaches the threshold of the preset number.
Optionally, the first image file task in S203 includes:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file in the mirror image cache region;
in S204, the processing number of the first image file tasks is the processing number of the image file reading tasks currently processed in parallel in the image cache region, or the processing number of the image file reading tasks currently processed in parallel in the image cache region.
S205, when the processing quantity of the first image file tasks does not reach the preset quantity threshold value, the image file corresponding to the image file downloading request is read from the image cache area.
In this step, when the processing number of the first image file tasks does not reach the preset number threshold, the image file corresponding to the image file downloading request is read from the image cache region, and the read image file is sent to the corresponding service server or the user side device.
Optionally, the method further comprises:
and when the processing quantity of the first image file tasks reaches a preset quantity threshold value, reading the image file corresponding to the image file downloading request from a preset image database.
In the method for downloading the image file, after the image file downloading request is received by the image server, whether the image file corresponding to the image file downloading request is cached or not is firstly searched in an image cache region of the image server, if the image cache region caches the image file corresponding to the image file downloading request, the processing quantity of the first image file tasks currently processed in parallel in the image cache region is obtained, a preset quantity threshold value is set for the image cache region, whether the processing quantity of the current first image file tasks reaches the preset quantity threshold value or not is determined, and when the processing quantity of the first image file tasks does not reach the preset quantity threshold value, the image file corresponding to the image file downloading request is read from the image cache region. In the embodiment of the invention, the mirror image cache region is provided with the mirror image file task threshold, so that the mirror image file is read and written below the mirror image file task threshold of the mirror image cache region threshold, the condition of high reading and writing pressure of the cache region is effectively avoided, and the overall processing efficiency of the mirror image server is improved.
Optionally, in an embodiment of the image file downloading method of the present invention, after determining whether the image file corresponding to the image file downloading request is cached in the image cache area of the image server in S202, there may be a method flowchart as shown in fig. 3, where the method further includes:
s301, if the mirror image file corresponding to the mirror image file downloading request is not cached in the mirror image caching area of the mirror image server, reading the mirror image file corresponding to the mirror image file downloading request from a preset mirror image database.
The mirror database of the embodiment of the invention is a permanent database of the mirror server, and all mirror image files are stored in the database. And when the image file corresponding to the image file downloading request is not cached in the image caching area of the image server, reading the image file corresponding to the image file downloading request from the image database.
S302, acquiring the processing quantity of the second image file tasks currently processed in parallel in the image cache region.
Optionally, the second image file task in S302 includes:
the image file reading task is used for reading the image file from the image cache region, and the image file writing task is used for caching the image file in the image cache region;
in the above S302, the obtaining of the processing number of the second image file tasks currently processed in parallel in the image cache area includes:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks in the image cache region as the processing quantity of the second image file tasks.
S303, determining whether the processing number of the second image file tasks reaches a preset number threshold value.
S304, when the processing quantity of the second image file tasks does not reach the preset quantity threshold value, writing the image file corresponding to the image file downloading request read from the preset image database into the image cache area.
In the embodiment of the invention, if the mirror image server does not have the mirror image file corresponding to the mirror image file downloading request, the mirror image file is obtained from the mirror image database set by the mirror image server, the parallel processing file task quantity of the mirror image cache region at the current time is judged, and if the parallel processing file task quantity does not reach the preset quantity threshold value, the mirror image file can be written into the mirror image cache region, so that the mirror image file in the mirror image database is cached into the mirror image cache region for subsequent use.
In an embodiment of the image file downloading method of the present invention, there may also be a flowchart of the image file downloading method of fig. 4, including:
s401, acquiring the processing quantity of the current parallel processing image file tasks aiming at the cache area of the image server, wherein the image file tasks are related to the image file processing.
S402, determining whether the processing quantity reaches a preset quantity threshold value.
In the implementation of the invention, a quantity threshold value of the task processing quantity can be set for the cache area of the mirror server. In this step, a threshold judgment program for the number of tasks of the image file processed in parallel in the cache area of the image server may be set, the size relationship between the number of tasks of the image file processed in parallel in the cache area at the current time and the threshold of the preset number is judged, and whether the processing number at the current time reaches the threshold of the preset number is determined.
And S403, when the processing quantity does not reach the preset quantity threshold value, starting parallel processing of the image file tasks to be processed aiming at the image file tasks to be processed.
When the processing quantity at the current time is judged not to reach the preset quantity threshold value, the image file tasks to be processed corresponding to the residual quantity of which the parallel processing task quantity does not exceed the preset quantity threshold value can be started, and then the image file tasks to be processed are processed respectively. For example, starting each image file reading task for reading the image file from the cache region corresponding to the remaining number of the preset number threshold, or starting each image file writing task for caching the image file into the cache region corresponding to the remaining number of the preset number threshold; or starting each image file reading task for reading the image files from the cache region corresponding to the residual quantity of the preset quantity threshold value, and caching the image files to the image file writing task of the cache region.
S404, when the processing quantity reaches the preset quantity threshold value, the parallel processing of the image file tasks to be processed is stopped to be started aiming at the image file tasks to be processed.
And stopping starting the parallel processing of the image file tasks to be processed when the current time processing quantity is judged to reach the preset quantity threshold value. And starting the image file tasks to be processed corresponding to the residual quantity which does not exceed the preset quantity threshold value after the cache region of the image server processes part of the image file tasks to be processed.
According to the embodiment of the invention, the number of the tasks of the mirror image file which are processed in parallel in the cache region is ensured by setting the preset number threshold value for the processing number of the mirror image server, so that the overall performance of the mirror image server is optimized, and the aim of improving the overall processing efficiency of the mirror image server is fulfilled finally.
In an embodiment of the image file downloading method of the present invention, reference may be made to a flowchart of the image file downloading method shown in fig. 5. The image file tasks comprise: the image file tasks comprise:
the image file reading task is used for reading the image file from the cache region, and the image file writing task is used for caching the image file in the cache region;
the method for acquiring the processing number of the current parallel processing image file tasks aiming at the cache area of the image server comprises the following steps:
s501, acquiring the number of read processes of the current parallel-processed image file read tasks and the number of write processes of the image file write tasks aiming at the cache area of the image server.
In the implementation of the invention, the processing quantity of the image file reading tasks for reading the image file from the cache region of the image server at the current time can be counted in a mathematical statistics mode; and counting the processing quantity of the image file writing tasks cached to the cache region at the current time to obtain the sum of the processing quantity. Or, detecting the processing quantity of the image file reading tasks for reading the image files from the cache region of the image server at the current time through a detection program; and detecting the processing quantity of the image file writing tasks cached to the cache region at the current time to obtain the sum of the processing quantity. Or directly counting the total processing number of the mirror image file tasks which are processed in parallel in the cache region of the mirror image server at the current time.
Determining whether the processing quantity reaches a preset quantity threshold value, including:
s502, it is determined whether the read processing number reaches a preset read number threshold and the write processing number reaches a preset write number threshold.
For example, setting a preset reading number threshold value to 50, and judging whether the processing number of the image file reading tasks for reading the image files from the cache area of the image server at the current time reaches 50; and setting a preset writing quantity threshold value to be 30, and judging whether the processing quantity of the image file reading tasks for reading the image files from the cache area of the image server at the current time reaches 30.
When the processing quantity does not reach the preset quantity threshold value, starting parallel processing of the image file tasks to be processed aiming at the image file tasks to be processed, wherein the parallel processing comprises the following steps:
and S503, when the reading processing quantity does not reach the preset reading quantity threshold value, starting parallel processing of the image file reading task to be processed aiming at the image file reading task to be processed.
When the reading processing quantity is judged not to reach the preset reading quantity threshold value, the residual to-be-processed image file reading tasks of the preset reading quantity threshold value are started, and the to-be-processed image file reading tasks are processed in parallel.
For example, a preset reading number threshold is set to be 50, and the processing number of the image file reading tasks for reading the image file from the cache area of the image server at the current time is 30, so that at most 20 image file reading tasks to be processed can be processed in parallel at present.
S504, when the writing processing quantity does not reach the writing preset quantity threshold value, aiming at the to-be-processed image file writing task, parallel processing of the to-be-processed image file writing task is started.
For example, the preset number of writing thresholds is set to be 30, and the processing number of the image file writing tasks for writing the image files from the cache area of the image server at the current time is 25, so that at most 5 image file writing tasks to be processed can be processed in parallel at present.
When the processing quantity reaches a preset quantity threshold value, stopping starting the parallel processing of the image file tasks to be processed aiming at the image file tasks to be processed, and comprising the following steps:
and S505, when the reading processing quantity reaches a preset reading quantity threshold value, stopping starting the parallel processing of the to-be-processed image file reading task aiming at the to-be-processed image file reading task.
When the reading processing quantity is judged to reach the preset reading quantity threshold value, the reading image file cannot be read at present, and then all the tasks of reading the image file to be processed are stopped to be started. And after the processing of part of the tasks of the image file reading task which is being processed is finished, processing the image file reading tasks in a corresponding quantity.
S506, when the writing processing quantity reaches the preset writing quantity threshold value, the parallel processing of the writing image file task to be processed is stopped to be started aiming at the writing image file task to be processed.
When the writing processing number is judged to reach the preset writing number threshold value, the mirror image file tasks cannot be written at present, and then all the mirror image file tasks to be processed are stopped to be started. And after the partial tasks of the processed tasks of writing the image files are processed, processing the corresponding number of tasks of writing the image files.
In the embodiment of the invention, the concurrent processing conditions of the tasks of reading the image files and the tasks of writing the image files are respectively judged by setting the preset reading quantity threshold value for the reading processing quantity and the preset writing quantity threshold value for the writing processing quantity, so that the task quantity of reading the image files and the task quantity of writing the image files are respectively controlled, and the integral efficiency of reading and writing of the image server is improved.
Optionally, in an embodiment of the image file downloading method of the present invention, before acquiring the number of processing tasks of the image file currently processed in parallel for the cache area of the image server, the method further includes:
monitoring whether a quantity acquisition period arrives, and triggering and executing the step of acquiring the processing quantity of the current parallel processed image file tasks aiming at the cache area of the image server when the quantity acquisition period arrives; and/or
And step two, monitoring whether the to-be-processed image file task is generated or not, and triggering and executing the step of acquiring the processing quantity of the current parallel processed image file tasks aiming at the cache area of the image server when the to-be-processed image file task is monitored to be generated.
In the embodiment of the invention, whether the current time reaches the preset number acquisition period is monitored in real time by the monitoring program for setting the number acquisition period, so that the processing number of the mirror image file task for starting the parallel processing of the cache region is ensured to be acquired regularly. In addition, whether the to-be-processed image file task is generated or not is set, so that whether the to-be-processed image file task needs to be executed or not at the current time is monitored in real time.
Optionally, in an embodiment of the image file downloading method of the present invention, the image file reading task is: after receiving a mirror image file downloading request sent by a service server, reading a task of the mirror image file from a cache region aiming at the mirror image file downloading request;
the writing task of the mirror image file is as follows: after acquiring a mirror image file from a mirror database of a mirror image server for the first time, writing the first acquired mirror image file into a cache region; or after receiving the image file sent by the service server, writing the received image file into the cache area.
In the implementation of the invention, after receiving the image file downloading request sent by the service server, the cache area does not have the image file corresponding to the image file downloading request, and then the cache area can send the request to the image database of the image server. And searching the mirror image file corresponding to the request in the mirror image database of the mirror image server through the request, so that the mirror image file is sent to the corresponding service server through the mirror image database of the mirror image server.
And judging whether the processing quantity of the mirror image file tasks processed in parallel in the current cache area reaches a threshold value, and if not, storing the mirror image file in the cache area of the mirror image server.
In addition, when the mirror image file requested by the service server does not exist in the mirror image database of the mirror image server, the service server can automatically create the mirror image file and further send a request to the cache area of the mirror image server, after the cache area obtains the request, whether the processing quantity of the mirror image file tasks processed in parallel by the current cache area reaches a threshold value or not is judged, and if not, the mirror image file is stored in the cache area of the mirror image server.
By the embodiment of the invention, the task of writing the image file acquired from the mirror database into the cache area can be realized, or the received image file of the service server can be written into the cache area.
In a second aspect, an embodiment of the present invention further discloses an image file downloading device, as shown in fig. 6. Fig. 6 is a schematic structural diagram of an image file downloading device according to an embodiment of the present invention, which is applied to an image server, and the device includes:
a receiving module 601, configured to receive a request for downloading an image file;
a determining module 602, configured to determine whether a mirror image file corresponding to the mirror image file downloading request is cached in a mirror image cache area of the mirror image server;
a task quantity obtaining module 603, configured to obtain a processing quantity of a first image file task currently processed in parallel in an image cache region of the image server if an image file corresponding to the image file downloading request is cached in the image cache region of the image server;
a threshold judgment module 604, configured to determine whether the processing number of the first image file tasks reaches a preset number threshold;
the first processing module 605 is configured to, when the processing quantity of the first image file task does not reach the preset quantity threshold, read the image file corresponding to the image file downloading request from the image cache region.
In the image file downloading device provided in the embodiment of the present invention, after receiving an image file downloading request through an image server, first, whether an image file corresponding to the image file downloading request is cached in an image cache region of the image server is searched, if an image file corresponding to the image file downloading request is cached in the image cache region, a processing number of first image file tasks currently processed in parallel in the image cache region is obtained, a preset number threshold is set for the image cache region, it is determined whether the processing number of the current first image file tasks reaches the preset number threshold, and when the processing number of the first image file tasks does not reach the preset number threshold, an image file corresponding to the image file downloading request is read from the image cache region. In the embodiment of the invention, the mirror image cache region is provided with the mirror image file task threshold, so that the mirror image file is read and written below the mirror image file task threshold of the mirror image cache region threshold, the condition of high reading and writing pressure of the cache region is effectively avoided, and the overall processing efficiency of the mirror image server is improved.
Optionally, in an embodiment of the image file downloading apparatus of the present invention, the apparatus further includes: and the second processing module is used for reading the image file corresponding to the image file downloading request from a preset image database when the processing quantity of the first image file tasks reaches a preset quantity threshold value.
Optionally, the apparatus further comprises:
the third processing module is used for reading the image file corresponding to the image file downloading request from a preset image database if the image file corresponding to the image file downloading request is not cached in the image caching area of the image server;
the second task quantity obtaining module is used for obtaining the processing quantity of second image file tasks currently processed in parallel in the image cache region;
the second threshold value judging module is used for determining whether the processing number of the second image file tasks reaches a preset number threshold value;
and the fourth processing module is used for writing the image file corresponding to the image file downloading request read from the preset image database into the image cache area when the processing quantity of the second image file tasks does not reach the preset quantity threshold value.
Optionally, the first image file task includes: a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the processing quantity of the first image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
Optionally, the second image file task includes: a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the processing quantity of the second image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
Optionally, the first image file task includes:
the image file reading task is used for reading the image file from the image cache region, and the image file writing task is used for caching the image file in the image cache region;
the task quantity obtaining module comprises:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks in the image cache region as the processing quantity of the first image file tasks.
Optionally, the second image file task includes:
the image file reading task is used for reading the image file from the image cache region, and the image file writing task is used for caching the image file in the image cache region;
the second task quantity obtaining module includes:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks in the image cache region as the processing quantity of the second image file tasks. In a third aspect, an embodiment of the present invention further discloses an electronic device, as shown in fig. 7. Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, which includes a processor 701, a communication interface 702, a memory 703 and a communication bus 704, where the processor 701, the communication interface 702 and the memory 703 complete communication with each other through the communication bus 704;
a memory 703 for storing a computer program;
the processor 701 is configured to implement the following method steps when executing the program stored in the memory 703:
receiving a mirror image file downloading request;
determining whether a mirror image file corresponding to the mirror image file downloading request is cached in a mirror image caching area of a mirror image server;
if the mirror image cache region of the mirror image server caches the mirror image file corresponding to the mirror image file downloading request, acquiring the processing quantity of the first mirror image file tasks currently processed in parallel in the mirror image cache region;
determining whether the processing number of the first image file tasks reaches a preset number threshold;
and when the processing quantity of the first image file tasks does not reach the preset quantity threshold value, reading the image file corresponding to the image file downloading request from the image cache area.
The communication bus 704 mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus 704 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface 702 is used for communication between the above-described electronic apparatus and other apparatuses.
The Memory 703 may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory 703 may also be at least one storage device located remotely from the processor 601.
The Processor 701 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In the electronic device provided by the embodiment of the invention, after receiving a downloading request of an image file through an image server, whether the image file corresponding to the downloading request of the image file is cached is firstly searched in an image cache region of the image server, if the image cache region caches the image file corresponding to the downloading request of the image file, the processing number of first image file tasks currently processed in parallel in the image cache region is obtained, a preset number threshold value is set for the image cache region, whether the processing number of the current first image file tasks reaches the preset number threshold value is determined, and when the processing number of the first image file tasks does not reach the preset number threshold value, the image file corresponding to the downloading request of the image file is read from the image cache region. In the embodiment of the invention, the mirror image cache region is provided with the mirror image file task threshold, so that the mirror image file is read and written below the mirror image file task threshold of the mirror image cache region threshold, the condition of high reading and writing pressure of the cache region is effectively avoided, and the overall processing efficiency of the mirror image server is improved.
In a fourth aspect, an embodiment of the present invention further discloses a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the following method steps are implemented:
in the storage medium provided in the embodiment of the present invention, after receiving a mirror image file download request through a mirror image server, first, whether a mirror image file corresponding to the mirror image file download request is cached in a mirror image cache region of the mirror image server is searched, if the mirror image cache region caches the mirror image file corresponding to the mirror image file download request, a processing number of first mirror image file tasks currently processed in parallel in the mirror image cache region is obtained, a preset number threshold is set for the mirror image cache region, it is determined whether the processing number of the current first mirror image file tasks reaches the preset number threshold, and when the processing number of the first mirror image file tasks does not reach the preset number threshold, a mirror image file corresponding to the mirror image file download request is read from the mirror image cache region. In the embodiment of the invention, the mirror image cache region is provided with the mirror image file task threshold, so that the mirror image file is read and written below the mirror image file task threshold of the mirror image cache region threshold, the condition of high reading and writing pressure of the cache region is effectively avoided, and the overall processing efficiency of the mirror image server is improved.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (16)

1. An image file downloading method is applied to an image server, and comprises the following steps:
receiving a mirror image file downloading request;
determining whether a mirror image cache region of the mirror image server caches a mirror image file corresponding to the mirror image file downloading request;
if the mirror image cache region of the mirror image server caches the mirror image file corresponding to the mirror image file downloading request, and when the number acquisition cycle is monitored to reach and/or the number of the mirror image file tasks to be processed is monitored to be generated, the processing number of the first mirror image file tasks currently processed in parallel in the mirror image cache region is acquired;
determining whether the processing number of the first image file tasks reaches a preset number threshold, where the preset number threshold is: analyzing the historical data to obtain the task processing quantity which is optimal in task performance and corresponds to the mirror image cache region of the mirror image server in parallel processing;
and when the processing quantity of the first image file tasks does not reach the preset quantity threshold value, reading the image file corresponding to the image file downloading request from the image cache region.
2. The method of claim 1, further comprising:
and when the processing quantity of the first image file tasks reaches the preset quantity threshold value, reading the image file corresponding to the image file downloading request from a preset image database.
3. The method according to claim 1 or 2, wherein after determining whether the image file corresponding to the image file downloading request is cached in the image cache area of the image server, the method further comprises:
if the image caching area of the image server does not cache the image file corresponding to the image file downloading request, reading the image file corresponding to the image file downloading request from a preset image database;
acquiring the processing quantity of the second image file tasks currently processed in parallel in the image cache region;
determining whether the processing number of the second image file tasks reaches a preset number threshold;
and when the processing quantity of the second image file tasks does not reach the preset quantity threshold value, writing the image file corresponding to the image file downloading request read from the preset image database into the image cache area.
4. The method of any of claims 1-2, wherein the first image task comprises:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file to the mirror image cache region;
the processing quantity of the first image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
5. The method of claim 3, wherein the second image task comprises:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file to the mirror image cache region;
the processing quantity of the second image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
6. The method of any of claims 1-2, wherein the first image task comprises:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, and a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the acquiring the processing number of the first image file tasks currently processed in parallel in the image cache region comprises:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks of the image cache region as the processing quantity of the first image file tasks.
7. The method of claim 3, wherein the second image task comprises:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, and a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the acquiring the processing number of the second image file tasks currently processed in parallel in the image cache region comprises:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks of the image cache region as the processing quantity of the second image file tasks.
8. An image file downloading device, applied to an image server, the device comprising:
the receiving module is used for receiving a mirror image file downloading request;
the determining module is used for determining whether a mirror image cache region of the mirror image server caches a mirror image file corresponding to the mirror image file downloading request;
the task quantity obtaining module is used for obtaining the processing quantity of the first image file task currently processed in parallel in the image cache region if the image file corresponding to the image file downloading request is cached in the image cache region of the image server and the quantity obtaining period is monitored to reach and/or the image file task to be processed is monitored to be generated;
a threshold judgment module, configured to determine whether the processing number of the first image file tasks reaches a preset number threshold, where the preset number threshold is: analyzing the historical data to obtain the task processing quantity which is optimal in task performance and corresponds to the mirror image cache region of the mirror image server in parallel processing;
and the first processing module is used for reading the image file corresponding to the image file downloading request from the image cache area when the processing quantity of the first image file tasks does not reach the preset quantity threshold value.
9. The apparatus of claim 8, further comprising:
and the second processing module is used for reading the image file corresponding to the image file downloading request from a preset image database when the processing quantity of the first image file tasks reaches the preset quantity threshold value.
10. The apparatus of claim 8 or 9, further comprising:
the third processing module is used for reading the image file corresponding to the image file downloading request from a preset image database if the image file corresponding to the image file downloading request is not cached in the image caching area of the image server;
the second task quantity obtaining module is used for obtaining the processing quantity of second image file tasks currently processed in parallel in the image cache region;
the second threshold value judging module is used for determining whether the processing number of the second image file tasks reaches a preset number threshold value;
and the fourth processing module is used for writing the image file corresponding to the image file downloading request read from the preset image database into the image cache area when the processing quantity of the second image file tasks does not reach the preset quantity threshold value.
11. The apparatus according to any one of claims 8 to 9,
the first image file task comprises the following steps: a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file to the mirror image cache region;
the processing quantity of the first image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
12. The apparatus of claim 10,
the second image file task comprises: a mirror image file reading task for reading a mirror image file from the mirror image cache region, or a mirror image file writing task for caching the mirror image file to the mirror image cache region;
the processing quantity of the second image file tasks is correspondingly the processing quantity of the image file reading tasks currently processed in parallel in the image cache region, or the processing quantity of the image file reading tasks currently processed in parallel in the image cache region.
13. The apparatus according to any one of claims 8 to 9,
the first image file task comprises the following steps:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, and a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the task quantity obtaining module comprises:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks of the image cache region as the processing quantity of the first image file tasks.
14. The apparatus of claim 10,
the second image file task comprises:
a mirror image file reading task for reading a mirror image file from the mirror image cache region, and a mirror image file writing task for caching the mirror image file in the mirror image cache region;
the second task quantity obtaining module includes:
and acquiring the sum of the processing quantity of the current parallel processing image file reading tasks and the processing quantity of the image file writing tasks of the image cache region as the processing quantity of the second image file tasks.
15. An electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus;
the memory is used for storing a computer program;
the processor, when executing the program stored in the memory, implementing the method steps of any of claims 1-7.
16. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 7.
CN201811162297.6A 2018-09-30 2018-09-30 Image file downloading method and device, electronic equipment and storage medium Active CN109246234B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811162297.6A CN109246234B (en) 2018-09-30 2018-09-30 Image file downloading method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811162297.6A CN109246234B (en) 2018-09-30 2018-09-30 Image file downloading method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109246234A CN109246234A (en) 2019-01-18
CN109246234B true CN109246234B (en) 2021-09-24

Family

ID=65055620

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811162297.6A Active CN109246234B (en) 2018-09-30 2018-09-30 Image file downloading method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109246234B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112130869B (en) * 2020-09-11 2022-11-29 苏州浪潮智能科技有限公司 AI platform mirror image processing method and device
CN113434254B (en) * 2021-06-30 2023-03-07 深圳平安智汇企业信息管理有限公司 Client deployment method, client deployment apparatus, computer device, and storage medium
CN114785770A (en) * 2022-04-01 2022-07-22 京东科技信息技术有限公司 Mirror layer file sending method and device, electronic equipment and computer readable medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106453461A (en) * 2015-08-12 2017-02-22 中兴通讯股份有限公司 Resource caching method and resource caching device
CN107135249A (en) * 2017-04-06 2017-09-05 腾讯科技(深圳)有限公司 Data download method and device
CN107623709A (en) * 2016-07-15 2018-01-23 北京金山云网络技术有限公司 A kind of document down loading method and device

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201238331A (en) * 2011-03-01 2012-09-16 Hon Hai Prec Ind Co Ltd System and method for supplying streaming media to media player
CN104780190A (en) * 2014-01-13 2015-07-15 北京兆维电子(集团)有限责任公司 Data read-write control method and data read-write control device
JP2018156606A (en) * 2017-03-21 2018-10-04 東芝メモリ株式会社 Communication control device, communication control method, and computer program
CN107743138A (en) * 2017-07-24 2018-02-27 上海壹账通金融科技有限公司 Push server distribution method, device, computer equipment and storage medium
CN107623722A (en) * 2017-08-21 2018-01-23 云宏信息科技股份有限公司 A kind of remote data caching method, electronic equipment and storage medium
CN108200211B (en) * 2018-02-12 2020-10-09 华为技术有限公司 Method, node and query server for downloading mirror image files in cluster
CN108391289B (en) * 2018-05-31 2021-05-18 京信通信系统(中国)有限公司 Congestion control method and base station

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106453461A (en) * 2015-08-12 2017-02-22 中兴通讯股份有限公司 Resource caching method and resource caching device
CN107623709A (en) * 2016-07-15 2018-01-23 北京金山云网络技术有限公司 A kind of document down loading method and device
CN107135249A (en) * 2017-04-06 2017-09-05 腾讯科技(深圳)有限公司 Data download method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"A Learning-Based Approach to Caching in Heterogenous Small Cell Networks ";B. N. Bharath, K. G. Nagananda, and H. Vincent Poor;《IEEE Transactions on Communications 》;20160301;全文 *
"Hadoop集群下海量小文件优化处理";张呈;《中国优秀硕士学位论文全文数据库 信息科技辑》;20150430;全文 *

Also Published As

Publication number Publication date
CN109246234A (en) 2019-01-18

Similar Documents

Publication Publication Date Title
CN109150930B (en) Configuration information loading method and device and service processing method and device
CN109246234B (en) Image file downloading method and device, electronic equipment and storage medium
WO2018072408A1 (en) Memory analysis method, device, system and computing device
CN110162270B (en) Data storage method, storage node and medium based on distributed storage system
CN109450969B (en) Method and device for acquiring data from third-party data source server and server
CN111046310A (en) Page processing method, device, server and computer readable storage medium
CN110910249B (en) Data processing method and device, node equipment and storage medium
CN113067875A (en) Access method, device and equipment based on dynamic flow control of micro-service gateway
CN111147310A (en) Log tracking processing method, device, server and medium
CN110069217B (en) Data storage method and device
CN111124315A (en) Data processing method and device, electronic equipment and storage medium
CN112653736A (en) Parallel source returning method and device and electronic equipment
CN109101259B (en) Updating method and device of OSDMap cache container and terminal
CN115576872B (en) Access detection method and device for multi-level cache
CN113626483B (en) Front-end caching method, system, equipment and storage medium for filling forms
CN112214178B (en) Storage system, data reading method and data writing method
CN108846141B (en) Offline cache loading method and device
CN113672248A (en) Patch acquisition method, device, server and storage medium
CN113849125A (en) Method, device and system for reading disk of CDN server
CN113485855A (en) Memory sharing method and device, electronic equipment and readable storage medium
CN112559294A (en) Method and device for determining resource consumption of application page
CN107783911B (en) Data filtering method and terminal equipment
CN110784479B (en) Data verification method and device, electronic equipment and storage medium
CN117453643B (en) File caching method, device, terminal and medium based on distributed file system
CN113849133B (en) Processing method and device of privacy data, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant