CN110221914B - File processing method and device - Google Patents
File processing method and device Download PDFInfo
- Publication number
- CN110221914B CN110221914B CN201910420841.0A CN201910420841A CN110221914B CN 110221914 B CN110221914 B CN 110221914B CN 201910420841 A CN201910420841 A CN 201910420841A CN 110221914 B CN110221914 B CN 110221914B
- Authority
- CN
- China
- Prior art keywords
- file
- processing
- splitting
- determining
- thread
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title description 7
- 238000012545 processing Methods 0.000 claims abstract description 370
- 238000000034 method Methods 0.000 claims abstract description 35
- 238000004590 computer program Methods 0.000 claims description 13
- 238000013468 resource allocation Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 6
- 230000005611 electricity Effects 0.000 description 4
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the application discloses a method and a device for processing files, which are suitable for resource allocation, wherein the method comprises the following steps: receiving a file processing request, and determining the receiving time and the file type of the file processing request; acquiring the file size and the file disc returning time, and determining the file processing priority and the file processing speed of the file according to the file type; if the file processing priority belongs to the preset file processing priority range, determining a first file splitting number of the file according to the file size, the file processing speed and the file disc returning time; acquiring thread resource occupancy rate corresponding to the receiving time, and correcting the first file splitting number according to the thread resource occupancy rate to obtain a second file splitting number; thread resources are obtained according to the second file splitting quantity, and a plurality of subfiles obtained by file splitting are processed in parallel based on the obtained thread resources. By adopting the embodiment of the application, the effective utilization of the system resources can be realized, the utilization rate of the system resources can be improved, and the applicability is high.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for processing a file.
Background
Currently, with the development of information technology and network technology, various industries have appeared comprehensive business systems for implementing business transaction through a network, such as a government integrated business information system, an electronic government system, a digital medical interactive system, a banking core system, and the like. Because of the characteristics of complex service types and large service quantity of the comprehensive service system, the comprehensive service system often faces the problem of system load balancing, and the problem of system load balancing is directly related to the stability and service quality of the system. The existing comprehensive service system cannot sense the busyness of system resources and cannot adjust the processing strategy according to service scenes, so that how to reasonably utilize the system resources becomes a current urgent problem to be solved.
Disclosure of Invention
The embodiment of the application provides a method and a device for processing files. The consumption of the system resources can be ensured to be controlled within a certain range, the effective utilization of the system resources is realized, the utilization rate of the system resources is improved, and the applicability is high.
In a first aspect, an embodiment of the present application provides a method for processing a file, where the method includes:
Receiving a file processing request, determining the receiving time of the file processing request, and determining the file type of the file requested to be processed by the file processing request;
acquiring the file size and the file disc returning time of the file, and determining the file processing priority and the file processing speed of the file according to the file type;
If the file processing priority belongs to a preset file processing priority range, determining a first file splitting number of the file according to the file size, the file processing speed and the file disc returning time;
Acquiring the thread resource occupancy rate corresponding to the receiving time, and correcting the first file splitting number according to the thread resource occupancy rate to obtain a second file splitting number;
thread resources are obtained according to the second file splitting number, and concurrent processing is carried out on a plurality of subfiles obtained by splitting the files based on the obtained thread resources, wherein the number of the thread resources is equal to the second file splitting number.
In the embodiment of the application, when the file processing priority belongs to the preset file processing priority range, the first file splitting quantity of the file is determined according to the acquired file size, the file processing speed and the file disc returning time, the reference value of concurrent execution of the subfiles can be determined, the first file splitting quantity is corrected based on the acquired thread resource occupancy rate corresponding to the receiving time to obtain the second file splitting quantity, and finally the concurrent processing of the subfiles by the second file splitting quantity can ensure that the consumption of system resources is controlled within a certain range, thereby realizing effective utilization of the system resources and improving the utilization rate of the system resources.
With reference to the first aspect, in a possible implementation manner, before the receiving the file processing request, the method further includes:
Acquiring at least two file types;
setting file processing priorities corresponding to various file types in the at least two file types, wherein the file processing priorities corresponding to the various file types are used for determining processing sequences of the various file types.
In the embodiment of the application, the processing sequence of various file types can be determined by setting the file processing priority corresponding to various file types in the at least two acquired file types, thereby realizing personalized processing of various file types and having strong applicability.
With reference to the first aspect, in one possible implementation manner, the file processing request includes a file identifier; the determining the file type of the file requested to be processed by the file processing request includes:
extracting a file identifier in the file processing request;
And determining the file marked by the file mark and determining the file type of the file.
In the embodiment of the application, the file marked by the file mark is determined by extracting the file mark in the file processing request, so that the file type of the file is determined, the corresponding relation between the file mark and the file type is simple and clear, the error is not easy to occur, the operation process is simple, and the applicability is strong.
With reference to the first aspect, in one possible implementation manner, the correcting the first file splitting number according to the thread resource occupancy to obtain a second file splitting number includes:
If the thread resource occupancy rate is not greater than a first preset threshold value, increasing the first file splitting number by N to obtain a second file splitting number, wherein N is a positive integer;
if the thread resource occupancy rate is greater than the first preset threshold value and not greater than a second preset threshold value, determining the first file splitting number as a second file splitting number, wherein the first preset threshold value is smaller than the second preset threshold value;
and if the thread resource occupancy rate is greater than the second preset threshold value, reducing the first file splitting number by N to obtain a second file splitting number.
In the embodiment of the application, the first file splitting quantity is corrected to obtain the second file splitting quantity after the thread resource occupancy rate is compared with the first preset threshold value and the second preset threshold value, so that the obtained second file splitting quantity meets the actual requirements, the system resource utilization rate is effectively improved, and the flexibility is high.
With reference to the first aspect, in one possible implementation manner, the obtaining thread resources according to the second file splitting number, and performing concurrent processing on multiple subfiles obtained by splitting the file based on the obtained thread resources includes:
Splitting the file into M subfiles according to the second file splitting number, wherein M is equal to the second file splitting number;
and acquiring M thread resources, and concurrently processing the M subfiles based on the acquired M thread resources, wherein one thread resource is used for processing one subfile.
In the embodiment of the application, the files are split into the subfiles based on the second file splitting quantity and the line resources are allocated, so that the number of subfiles is equal to the number of the thread resources allocated, the processing time of the files can be shortened, the effective utilization of the system resources can be realized, the resource consumption can be controlled within a certain range, and the utilization rate of the system resources is improved.
In a second aspect, an embodiment of the present application provides an apparatus for processing a file, including:
The request acquisition module is used for receiving the file processing request and determining the receiving time of the file processing request and the file type of the file requested to be processed by the file processing request;
the data acquisition module is used for acquiring the file size and the file disc returning time of the file and determining the file processing priority and the file processing speed of the file according to the file type;
The first splitting module is used for determining a first file splitting number of the file according to the file size, the file processing speed and the file disc returning time if the file processing priority belongs to a preset file processing priority range;
The second splitting module is used for acquiring the thread resource occupancy rate corresponding to the receiving time, and correcting the first file splitting number according to the thread resource occupancy rate to obtain a second file splitting number;
the file processing module is used for acquiring thread resources according to the second file splitting number, and carrying out concurrent processing on a plurality of subfiles obtained by splitting the files based on the acquired thread resources, wherein the number of the thread resources is equal to the second file splitting number.
With reference to the second aspect, in one possible implementation manner, the file processing apparatus further includes:
The priority setting module is used for acquiring at least two file types;
setting file processing priorities corresponding to various file types in the at least two file types, wherein the file processing priorities corresponding to the various file types are used for determining processing sequences of the various file types.
With reference to the second aspect, in a possible implementation manner, the file processing request includes a file identifier; the request acquisition module is used for:
extracting a file identifier in the file processing request;
And determining the file marked by the file mark and determining the file type of the file.
With reference to the second aspect, in one possible implementation manner, the second splitting module is configured to:
If the thread resource occupancy rate is not greater than a first preset threshold value, increasing the first file splitting number by N to obtain a second file splitting number, wherein N is a positive integer;
if the thread resource occupancy rate is greater than the first preset threshold value and not greater than a second preset threshold value, determining the first file splitting number as a second file splitting number, wherein the first preset threshold value is smaller than the second preset threshold value;
and if the thread resource occupancy rate is greater than the second preset threshold value, reducing the first file splitting number by N to obtain a second file splitting number.
With reference to the second aspect, in one possible implementation manner, the file processing module is configured to:
Splitting the file into M subfiles according to the second file splitting number, wherein M is equal to the second file splitting number;
and acquiring M thread resources, and concurrently processing the M subfiles based on the acquired M thread resources, wherein one thread resource is used for processing one subfile.
In a third aspect, an embodiment of the present application provides a terminal device, where the terminal device includes a processor and a memory, and the processor and the memory are connected to each other. The memory is configured to store a computer program supporting the terminal device to perform the method provided by the first aspect and/or any of the possible implementation manners of the first aspect, the computer program comprising program instructions, the processor being configured to invoke the program instructions to perform the method provided by the first aspect and/or any of the possible implementation manners of the first aspect.
In a fourth aspect, embodiments of the present application provide a computer readable storage medium storing a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method provided by the first aspect and/or any of the possible implementations of the first aspect.
The embodiment of the application has the following beneficial effects:
When the file processing priority belongs to the preset file processing priority range, determining a first file splitting number of the file according to the acquired file size, the file processing speed and the file disc returning time, determining a reference value for concurrent execution of the subfiles, correcting the first file splitting number based on the thread resource occupancy rate corresponding to the acquired receiving time to obtain a second file splitting number, and finally carrying out concurrent processing of the subfiles by the second file splitting number to ensure that the consumption of system resources is controlled within a certain range, realize effective utilization of the system resources and improve the utilization rate of the system resources.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a file processing method according to an embodiment of the present application;
Fig. 2 is an application scenario schematic diagram of a file processing method provided in an embodiment of the present application;
FIG. 3 is a schematic diagram of a document processing apparatus according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The file processing method provided by the embodiment of the application can be widely applied to various comprehensive business handling systems. The integrated service handling system may determine a reception time of the file processing request, a file type of the file requested to be processed, a file processing priority, and a file processing speed based on the received file processing request of the file to be processed (for convenience of description, abbreviated as a file) transmitted from the peripheral system. When the file processing priority belongs to the preset file processing priority range, the first file splitting number of the file can be determined according to the acquired file size, the file processing speed and the file disc returning time, and then the first file splitting number is corrected by combining the thread resource occupancy rate corresponding to the receiving time to obtain the second file splitting number. And finally, obtaining thread resources according to the second file splitting quantity, and carrying out concurrent processing on a plurality of subfiles obtained by file splitting based on the obtained thread resources. By implementing the embodiment of the application, the consumption of the system resources can be ensured to be controlled within a certain range, the effective utilization of the system resources is realized, the utilization rate of the system resources is improved, and the applicability is high.
The method and the related device according to the embodiments of the present application will be described in detail below with reference to fig. 1 to 4, respectively. The method provided by the embodiment of the application can comprise data processing stages for receiving a file processing request, determining receiving time and file type, acquiring file size and file disc-returning time, determining file processing priority and file processing speed, determining first file splitting quantity, determining second file splitting quantity based on thread resource occupancy rate, acquiring thread resources and concurrently processing split subfiles and the like. The implementation of the above-mentioned individual data processing phases can be seen from the following fig. 1 to 2.
Referring to fig. 1, fig. 1 is a flow chart of a file processing method according to an embodiment of the present application. The method provided by the embodiment of the application can comprise the following steps 101 to 105:
101. a file processing request is received, and a receiving time of the file processing request and a file type of a file requested to be processed by the file processing request are determined.
In some possible embodiments, the arrival time may be determined as the receipt time of the file processing request by receiving the file processing request and querying the arrival time of the file processing request when the system receives the file processing request. Alternatively, the receiving time of the file processing request may also be time parameter information carried in the file processing request, and the time parameter information may be determined as the receiving time of the file processing request by extracting the time parameter information carried in the file processing request.
In some possible embodiments, the file processing request may further include a file identifier, and after receiving the file processing request, the file type to which the file belongs may be determined by analyzing and extracting the file identifier of the file processing request, where the file is marked by the file identifier. Optionally, after the file identifier of the file processing request is obtained through analysis, the file type of the file requested to be processed by the file processing request can be determined by extracting and querying key characters in the file identifier.
For example, referring to fig. 2, fig. 2 is an application scenario schematic diagram of a file processing method according to an embodiment of the present application. It is assumed that the bank core system may receive file processing requests from four peripheral systems, namely, a system a, B system C, and D system, where the a system is responsible for sending file processing requests for collecting water and electricity fee type files, the B system is responsible for sending file processing requests for credit card payment type files, the C system is responsible for sending file processing requests for sending pay type files, and the D system is responsible for sending file processing requests for intermediate service type files. At time 2019.2.15 15:03:00, the bank core system receives the file processing request "B1 file processing request" sent by the B system, and can determine that the receiving time of the file processing request is "2019.2.15 15:03:00" by querying the arrival time "2019.2.15 15:03:00" of the "B1 file processing request". Assuming that the "B1 file processing request" includes the file identifier "B10", the file identifier "B10" marks the credit card payment file of the first company, and therefore, by parsing and extracting the file identifier "B10" of the "B1 file processing request", the "credit card payment file of the first company" marked by "B10" can be matched from the file repository, so that it is determined that the file type to which the "credit card payment file of the first company" belongs is the "credit card payment type file". Or after determining that the file identifier is "B10", the file type corresponding to "B10" may be determined to be "credit card repayment type file" by querying the file type to which the file identifier "B10" belongs.
102. And acquiring the file size and the file disc returning time of the file, and determining the file processing priority and the file processing speed of the file according to the file type.
In some possible embodiments, the file rollback time is a preset file expected processing time. In other words, the file disc-returning time is preset according to the actual service requirement, and the file marked by the file mark can be extracted from the file cache library according to the file mark by analyzing and extracting the file mark in the file processing request, so that the file size of the file and the file disc-returning time preset for the file can be obtained, wherein the file size can be measured by the data volume contained in the file. For example, assuming that 10000 strokes of data are contained in the file a, the file size of the file a may be represented as 10000 strokes.
In some possible embodiments, one file type corresponds to one file processing priority and one file processing speed. The file processing priorities at least comprise a first processing priority and a second processing priority, and each file processing priority corresponding to each file type is used for determining the processing sequence of the file corresponding to each file type, so that the importance degree of the file can be reflected. For example, a file with high timeliness requirement may be set as a first processing priority, such as a quick payment file, a real-time transfer file, etc., and a file with low timeliness requirement may be set as a second priority, such as a water and electricity fee collection file, a wage file, etc., which may be specifically determined according to an actual application scenario, and is not limited herein. According to the file type of the file to be processed, the file processing priority and the file processing speed corresponding to the file to be processed can be determined.
In some possible embodiments, the file processing speed corresponding to a file type may be determined by obtaining the historical processing total amount and the historical processing time of the file type in each period. For example, assuming that the transaction period of banking is 24 hours, the total amount of processing of the credit card payment type file on a certain day is 18000 and the processing time is 60 minutes, the processing speed of the credit card payment type file is 5/second by acquiring the total amount of processing of the credit card payment type file 18000 and the processing time of 60 minutes, and therefore, 5/second can be determined as the file processing speed of the credit card payment type file. For another example, assuming that the transaction period of banking is 24 hours, the total amount of processing of the credit card repayment type file on one day is 14400, the processing time is 60 minutes, by acquiring and calculating the total amount of processing of the credit card repayment type file 14400 and the processing time of 60 minutes, the processing speed of the credit card repayment type file is 4 pens/second, meanwhile, the total amount of processing of the credit card repayment type file on the other day is 23760 pens, the processing time of the credit card repayment type file is 66 minutes, and the processing speed of the credit card repayment type file is 6 pens/second. Then, the arithmetic average of the processing speeds obtained in the two times can be determined as the file processing speed of the credit card repayment type file, that is, the file processing speed of the credit card repayment type file is 5 pens/second.
103. If the file processing priority belongs to the preset file processing priority range, determining the first file splitting number of the file according to the file size, the file processing speed and the file disc returning time.
In some possible embodiments, when the amount of data contained in a file is too large, it often takes longer to process such a file, and if an abnormality occurs in the processing of a piece of data during the processing of the file, the processing efficiency of the entire file may be affected. Therefore, if a file containing a large amount of data is split into a plurality of small files for processing, on one hand, the integrity of the data can be ensured, meanwhile, the processing time of the file can be shortened, and the processing efficiency of the file can be improved. Then, after a file processing request of a file is obtained, if the file processing priority of the file requested to be processed by the file processing request belongs to a preset file processing priority range, the first file splitting number of the file can be determined according to the determined file size, file processing speed and file disc returning time. Optionally, if the file processing priority of the file requested to be processed by the file processing request does not belong to the preset file processing priority range, rejecting the file processing request.
For example, assuming that the cycle of the bank core system is 24 hours, the preset file processing priority range of the first period (02:00:00 to 11:59:59) includes the first to third processing priorities and the processing order of the files of the first processing priority is prioritized over the processing order of the files of the second processing priority, which is prioritized over the processing order of the files of the third processing priority; the preset file processing priority range of the second time period (12:00:00-22:59:59) comprises a third processing priority and a fourth processing priority, and the processing sequence of the file with the third processing priority is higher than that of the file with the fourth processing priority; since the third period (23:00:00-01:59:59) belongs to the clearing settlement time, no type of file is processed. Assume that the file processing request transmitted by the B system is received by the bank core system as a "B1 file processing request" at a certain point of time within the first period of time. By analyzing the received 'B1 file processing request', the file identifier 'B10' in the 'B1 file processing request' can be extracted, and the 'A company credit card repayment file' marked by 'B10' can be matched from a file cache according to the file identifier 'B10', so that the file type of the 'A company credit card repayment file' is determined to be a 'credit card repayment file', the file processing priority of the credit card repayment file is the first processing priority, and the file processing speed of the credit card repayment file is 5 times/second. The file contains 10000 data, namely the file size is 10000, and the file disc returning time is 10 minutes. The first processing priority belongs to a preset file processing priority range in the first time period, so that the first file splitting number of the file can be determined according to the file size of 10000 pens, the file processing speed of 5 pens/second and the file playback time of 10 minutes, namely, the processing time of 10000 pens of data can be determined to be 2000 seconds according to the file size of 10000 pens and the file processing speed of 5 pens/second, and the first file splitting number can be calculated to be 3.3 by combining the file playback time of 600 seconds (10 minutes), and the first file splitting number can be obtained by rounding up 3.3 to be 4 because the file splitting number is a positive integer, namely, 4 small files are required to be split and simultaneously processed to meet the demands.
By way of further example, assume that at some point in time (e.g., 2019.2.15 10:03:00) within a first time period, the bank core system simultaneously receives "A2 file processing request", "B1 file processing request", and "D1 file processing request" sent by the a system, B system, and D system, respectively, wherein the preset file processing priority range for the first time period (02:00:00-11:59:59) includes a first processing priority, a second priority, and a third processing priority, and the processing order of the files decreases sequentially from left to right. By respectively analyzing the received "A2 file processing request", "B1 file processing request" and "D1 file processing request", the file identifiers in each file processing request are respectively "A20", "B10" and "D10", and further it can be determined that the file types to which the files marked by "A20", "B10" and "D10" belong are respectively "water and electricity fee collection type files", "credit card repayment type files" and "intermediate service type files", wherein the file processing priority of "water and electricity fee collection type files" is the second processing priority, the file processing priority of "credit card repayment type files" is the first processing priority, the file processing priority of "intermediate service type files" is the fourth processing priority, and the fourth processing priority does not belong to the preset file processing priority range of the first time period, so that the "D1 file processing request is rejected. The first processing priority and the second processing priority belong to a preset file processing priority range of the first time period, so that the processing of the files requested to be processed by the "A2 file processing request" and the "B1 file processing request" is allowed, but the processing sequence of the first processing priority is higher than that of the second processing priority, so that the "B1 file processing request" is preferentially responded, and the implementation process of the first file splitting number of the credit card repayment file of the first company is specifically referred to and will not be repeated herein.
104. And acquiring the thread resource occupancy rate corresponding to the receiving time, and correcting the first file splitting number according to the thread resource occupancy rate to obtain the second file splitting number.
In some possible embodiments, the first number of file splits may be determined based on the file size, the file processing speed, and the file rollback time, it being understood that the first number of file splits is a baseline value. In order to effectively utilize the thread resources and improve the utilization rate of the thread resources, the thread resource occupancy rate corresponding to the receiving time can be obtained, and the first file splitting number can be corrected to obtain the second file splitting number by judging the use condition of the thread resources. For example, if the occupancy rate of the thread resources is not greater than 40% of the first preset threshold value, indicating that the system is currently in an idle state, determining that the first file splitting number is the second file splitting number after increasing the N splitting numbers, and accelerating processing of the files according to the obtained second file splitting number; if the occupancy rate of the thread resources is greater than the second preset threshold value of 60%, indicating that the current system is busy, determining the first file splitting number minus the N splitting numbers as a second file splitting number, and decelerating the files according to the second file splitting number to ensure that the resource consumption of the system can be controlled within a certain range; if the thread resource occupancy rate is greater than 40% of the first preset threshold value and not greater than 60% of the second preset threshold value, the first file splitting number may be determined to be the second file splitting number. It will be appreciated that the thread resource occupancy varies over time, and that the thread resource occupancy varies from one time to another, and thus the thread resource occupancy may be collected by means of timed polling or real-time acquisition. For example, statistics and registration can be set for the occupancy rate of the thread resources every 10s, and then when the file processing request is received, the occupancy rate of the thread resources corresponding to the receiving time of the file processing request can be directly read.
For example, according to the file size 18000 pen, the file processing speed 5 pen/second and the file playback time 20 minutes, the first file splitting number of the file is calculated to be 3, that is, the file needs to be split into 3 small files to be processed simultaneously so as to meet the requirement. Assuming that the first preset threshold is 40%, the second preset threshold is 60%, according to the obtained occupancy rate of the current thread resource of 30%, it is known that the occupancy rate of the thread resource of 30% is smaller than the first preset threshold of 40%, so that 50% of processing can be allowed to be accelerated, that is, the processing of 6 small files is actually allowed to be split into 3000 strokes, the processing time of each small file is estimated to be 600 seconds, and the actual processing time of the file is 10 minutes.
105. Thread resources are obtained according to the second file splitting quantity, and a plurality of subfiles obtained by file splitting are processed in parallel based on the obtained thread resources.
In some possible implementations, the thread resource is the smallest unit that the operating system can schedule for operations, and is included in the process as the actual unit of operation in the process. Instead of frequently creating destroy thread resources, a thread pool is a form of multithreading that utilizes existing thread resources to continue servicing new tasks (according to certain execution policies), thereby providing throughput of service, reducing idle time of central processing units (CPUs, central Processing Unit). In the embodiment of the application, assuming that the second file splitting number is M, according to the determined second file splitting number M, the file to be processed can be split into M subfiles, M thread resources are obtained from a thread pool for concurrently processing the M subfiles, if the thread resources are insufficient, the processing of files with the file processing priority lower than that of the file processing priority can be suspended, the thread resources are yielded for the processing of the file, and one of the thread resources is used for processing one subfile. Optionally, according to the second file splitting number M, the file to be processed may be split into M subfiles, and M thread resources are created for concurrently processing the M subfiles, where M is a positive integer, and one of the thread resources is used for processing one subfile. And after the file processing is completed, releasing the occupied thread resources to complete the recovery of the thread resources.
In the embodiment of the application, the arrival time of the file processing request can be determined as the receiving time of the file processing request by receiving the file processing request and querying the arrival time of the file processing request when the system receives the file processing request. By analyzing the file identification in the file processing request, the file type of the file marked by the file identification can be determined, the file size and the file disc-returning time of the file can be obtained, and the file processing priority and the file processing speed of the file can be determined according to the file type. When the file processing priority belongs to a preset file processing priority range, the first file splitting number of the file can be determined according to the file size, the file processing speed and the file disc returning time, then the first file splitting number can be corrected to obtain the second file splitting number by comparing the thread resource occupancy corresponding to the acquired receiving time with a first preset threshold value and a second preset threshold value, finally the file is split based on the second file splitting number to obtain a plurality of subfiles, and the thread resources with corresponding numbers are allocated for completing concurrent processing on the plurality of subfiles. By implementing the embodiment of the application, the processing time of the file can be shortened, the consumption of the system resource is ensured to be controlled within a certain range, the effective utilization of the system resource is realized, the utilization rate of the system resource is improved, and the applicability is high.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a document processing device according to an embodiment of the present application. The device for processing the file provided by the embodiment of the application comprises the following components:
A request acquisition module 31, configured to receive a file processing request, and determine a receiving time of the file processing request and a file type of a file requested to be processed by the file processing request;
A data acquisition module 32, configured to acquire a file size and a file playback time of the file, and determine a file processing priority and a file processing speed of the file according to the file type;
A first splitting module 33, configured to determine a first file splitting number of the file according to the file size, the file processing speed, and the file playback time if the file processing priority belongs to a preset file processing priority range;
the second splitting module 34 is configured to obtain a thread resource occupancy rate corresponding to the receiving time, and correct the first file splitting number according to the thread resource occupancy rate to obtain a second file splitting number;
the file processing module 35 is configured to obtain thread resources according to the second file splitting number, and perform concurrent processing on a plurality of subfiles obtained by splitting the file based on the obtained thread resources, where the number of thread resources is equal to the second file splitting number.
In some possible embodiments, the above-mentioned file processing apparatus further includes:
The priority setting module is used for acquiring at least two file types;
setting file processing priorities corresponding to various file types in the at least two file types, wherein the file processing priorities corresponding to the various file types are used for determining processing sequences of the various file types.
In some possible embodiments, the file processing request includes a file identifier, and the request obtaining module 31 is configured to:
extracting a file identifier in the file processing request;
And determining the file marked by the file mark and determining the file type of the file.
In some possible embodiments, the second splitting module 34 is configured to:
If the thread resource occupancy rate is not greater than a first preset threshold value, increasing the first file splitting number by N to obtain a second file splitting number, wherein N is a positive integer;
if the thread resource occupancy rate is greater than the first preset threshold value and not greater than a second preset threshold value, determining the first file splitting number as a second file splitting number, wherein the first preset threshold value is smaller than the second preset threshold value;
and if the thread resource occupancy rate is greater than the second preset threshold value, reducing the first file splitting number by N to obtain a second file splitting number.
In some possible embodiments, the file processing module 35 is configured to:
Splitting the file into M subfiles according to the second file splitting number, wherein M is equal to the second file splitting number;
and acquiring M thread resources, and concurrently processing the M subfiles based on the acquired M thread resources, wherein one thread resource is used for processing one subfile.
In a specific implementation, the device for processing a file may execute an implementation manner provided by each step in fig. 1 to 2 through each function module built in the device. For example, the request obtaining module 31 may be configured to execute the above-mentioned steps to receive the file processing request, determine the receiving time of the file processing request, determine the file type, and other implementation manners, and specifically refer to the implementation manners provided by the above-mentioned steps, which are not described herein again. The data obtaining module 32 may be configured to perform the implementation manners described in the related steps of obtaining the file size and the file playback time, determining the file processing priority and the file processing speed in the above steps, and specifically refer to the implementation manners provided in the above steps, which are not described herein again. The first splitting module 33 may be configured to execute the implementation manners of determining the first number of file splitting according to the file size, the file processing speed, and the file playback time in the above steps, and the implementation manners provided in the above steps may be referred to specifically, and will not be described herein. The second splitting module 34 may be configured to perform the above-mentioned steps to obtain the thread resource occupancy rate, correct the first file splitting number to obtain the second file splitting number, and the like, and the detailed description of the implementation manner provided by the above-mentioned steps will be omitted herein. The above-mentioned file processing module 35 may be used to execute the implementation manners of splitting the file, obtaining the thread resource and concurrently processing the split sub-file in the above-mentioned steps, and the detailed description will not be repeated herein, specifically referring to the implementation manners provided in the above-mentioned steps. The priority setting module may be configured to execute the implementation manners of obtaining the file type and setting the file processing priority in the above steps, and specifically refer to the implementation manners provided in the above steps, which are not described herein again.
In the embodiment of the application, the device for processing the file can be based on the received file processing request, and inquire the arrival time of the file processing request when the system receives the file processing request, and the arrival time can be determined as the receiving time of the file processing request. By analyzing the file identification in the file processing request, the file type of the file marked by the file identification can be determined, the file size and the file disc-returning time of the file can be obtained, and the file processing priority and the file processing speed of the file can be determined according to the file type. When the file processing priority belongs to a preset file processing priority range, the first file splitting number of the file can be determined according to the file size, the file processing speed and the file disc returning time, then the first file splitting number can be corrected to obtain the second file splitting number by comparing the thread resource occupancy corresponding to the acquired receiving time with a first preset threshold value and a second preset threshold value, finally the file is split based on the second file splitting number to obtain a plurality of subfiles, and the thread resources with corresponding numbers are allocated for completing concurrent processing on the plurality of subfiles. By implementing the embodiment of the application, the processing time of the file can be shortened, the consumption of the system resource is ensured to be controlled within a certain range, the effective utilization of the system resource is realized, the utilization rate of the system resource is improved, the flexibility is high, and the application range is wide.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 4, the terminal device in this embodiment may include: one or more processors 401 and a memory 402. The processor 401 and the memory 402 are connected via a bus 403. The memory 402 is used for storing a computer program comprising program instructions, and the processor 401 is used for executing the program instructions stored in the memory 402 for performing the following operations:
Receiving a file processing request, and determining the receiving time of the file processing request and the file type of the file requested to be processed by the file processing request;
acquiring the file size and the file disc returning time of the file, and determining the file processing priority and the file processing speed of the file according to the file type;
If the file processing priority belongs to a preset file processing priority range, determining a first file splitting number of the file according to the file size, the file processing speed and the file disc returning time;
Acquiring the thread resource occupancy rate corresponding to the receiving time, and correcting the first file splitting number according to the thread resource occupancy rate to obtain a second file splitting number;
thread resources are obtained according to the second file splitting number, and concurrent processing is carried out on a plurality of subfiles obtained by splitting the files based on the obtained thread resources, wherein the number of the thread resources is equal to the second file splitting number.
In some possible embodiments, the processor 401 is configured to:
Acquiring at least two file types;
setting file processing priorities corresponding to various file types in the at least two file types, wherein the file processing priorities corresponding to the various file types are used for determining processing sequences of the various file types.
In some possible embodiments, the file processing request includes a file identifier; the processor 401 is configured to:
extracting a file identifier in the file processing request;
And determining the file marked by the file mark and determining the file type of the file.
In some possible embodiments, the processor 401 is configured to:
If the thread resource occupancy rate is not greater than a first preset threshold value, increasing the first file splitting number by N to obtain a second file splitting number, wherein N is a positive integer;
if the thread resource occupancy rate is greater than the first preset threshold value and not greater than a second preset threshold value, determining the first file splitting number as a second file splitting number, wherein the first preset threshold value is smaller than the second preset threshold value;
and if the thread resource occupancy rate is greater than the second preset threshold value, reducing the first file splitting number by N to obtain a second file splitting number.
In some possible embodiments, the processor 401 is configured to:
Splitting the file into M subfiles according to the second file splitting number, wherein M is equal to the second file splitting number;
and acquiring M thread resources, and concurrently processing the M subfiles based on the acquired M thread resources, wherein one thread resource is used for processing one subfile.
It should be appreciated that in some possible embodiments, the processor 401 may be a central processing unit (central processing unit, CPU), which may also be other general purpose processors, digital signal processors (DIGITAL SIGNAL processors, DSPs), application Specific Integrated Circuits (ASICs), off-the-shelf programmable gate arrays (field programmable GATE ARRAY, FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The memory 402 may include read only memory and random access memory and provides instructions and data to the processor 401. A portion of memory 402 may also include non-volatile random access memory. For example, the memory 402 may also store information of device type.
In a specific implementation, the terminal device may execute, through each functional module built in the terminal device, an implementation manner provided by each step in fig. 1, and specifically, the implementation manner provided by each step may be referred to, which is not described herein again.
In the embodiment of the application, the terminal equipment can be based on the received file processing request, and inquire the arrival time of the file processing request when the system receives the file processing request, and the arrival time can be determined as the receiving time of the file processing request. By analyzing the file identification in the file processing request, the file type of the file marked by the file identification can be determined, the file size and the file disc-returning time of the file can be obtained, and the file processing priority and the file processing speed of the file can be determined according to the file type. When the file processing priority belongs to a preset file processing priority range, the first file splitting number of the file can be determined according to the file size, the file processing speed and the file disc returning time, then the first file splitting number can be corrected to obtain the second file splitting number by comparing the thread resource occupancy corresponding to the acquired receiving time with a first preset threshold value and a second preset threshold value, finally the file is split based on the second file splitting number to obtain a plurality of subfiles, and the thread resources with corresponding numbers are allocated for completing concurrent processing on the plurality of subfiles. By implementing the embodiment of the application, the processing time of the file can be shortened, the consumption of the system resource is ensured to be controlled within a certain range, the effective utilization of the system resource is realized, the utilization rate of the system resource is improved, the flexibility is high, and the application range is wide.
The embodiment of the present application further provides a computer readable storage medium, where a computer program is stored, where the computer program includes program instructions, and when the program instructions are executed by a processor, the method for implementing the file processing provided in each step in fig. 1 may refer to the implementation manner provided in each step, which is not described herein again.
The computer readable storage medium may be the apparatus for file processing provided in any one of the foregoing embodiments or an internal storage unit of the terminal device, for example, a hard disk or a memory of an electronic device. The computer readable storage medium may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (SMART MEDIA CARD, SMC), a Secure Digital (SD) card, a flash memory card (FLASH CARD), or the like, which are provided on the electronic device. Further, the computer-readable storage medium may also include both an internal storage unit and an external storage device of the electronic device. The computer-readable storage medium is used to store the computer program and other programs and data required by the electronic device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.
The terms "first," "second," "third," "fourth" and the like in the claims and in the description and drawings of the present application are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments. The term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations. Those of ordinary skill in the art will appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied in electronic hardware, in computer software, or in a combination of the two, and that the elements and steps of the examples have been generally described in terms of function in the foregoing description to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The method and related apparatus provided in the embodiments of the present application are described with reference to the flowchart and/or schematic structural diagrams of the method provided in the embodiments of the present application, and each flow and/or block of the flowchart and/or schematic structural diagrams of the method may be implemented by computer program instructions, and combinations of flows and/or blocks in the flowchart and/or block diagrams. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or structural diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or structures.
Claims (9)
1. A method of processing a document, the method comprising:
Receiving a file processing request, determining the receiving time of the file processing request, and determining the file type of a file requested to be processed by the file processing request;
acquiring the file size and the file disc returning time of the file, and determining the file processing priority and the file processing speed of the file according to the file types, wherein one file type corresponds to one file processing priority and one file processing speed, and the file processing speed corresponding to each file type is determined based on the historical processing total amount and the historical processing time of the file type in each period;
if the file processing priority belongs to a preset file processing priority range corresponding to a preset time period, determining a first file splitting number of the file according to the file size, the file processing speed and the file disc returning time;
Acquiring the thread resource occupancy rate corresponding to the receiving time, and correcting the first file splitting number according to the thread resource occupancy rate to obtain a second file splitting number;
Thread resources are obtained according to the second file splitting number, and concurrent processing is carried out on a plurality of subfiles obtained by splitting the files based on the obtained thread resources, wherein the number of the thread resources is equal to the second file splitting number;
the correcting the first file splitting number according to the thread resource occupancy rate to obtain a second file splitting number includes:
If the thread resource occupancy rate is not greater than a first preset threshold value, increasing the first file splitting number by N to obtain a second file splitting number, wherein N is a positive integer;
If the thread resource occupancy rate is greater than the first preset threshold value and not greater than a second preset threshold value, determining the first file splitting number as a second file splitting number, wherein the first preset threshold value is smaller than the second preset threshold value;
And if the thread resource occupancy rate is greater than the second preset threshold value, reducing the first file splitting number by N to obtain a second file splitting number.
2. The method of claim 1, wherein prior to receiving the file processing request, the method further comprises:
Acquiring at least two file types;
Setting file processing priorities corresponding to various file types in the at least two file types, wherein the file processing priorities corresponding to the various file types are used for determining processing sequences of the various file types.
3. A method according to claim 1 or 2, wherein the file handling request includes a file identification; the determining the file type of the file requested to be processed by the file processing request comprises:
extracting a file identifier in the file processing request;
and determining the file marked by the file mark and determining the file type to which the file belongs.
4. The method according to claim 1 or 2, wherein the obtaining the thread resource according to the second file splitting number, and performing concurrent processing on the multiple subfiles obtained by splitting the file based on the obtained thread resource, includes:
Splitting the file into M subfiles according to the second file splitting number, wherein M is equal to the second file splitting number;
and acquiring M thread resources, and concurrently processing the M subfiles based on the acquired M thread resources, wherein one thread resource is used for processing one subfile.
5. A document processing apparatus, the apparatus comprising:
The request acquisition module is used for receiving a file processing request and determining the receiving time of the file processing request and the file type of a file requested to be processed by the file processing request;
The data acquisition module is used for acquiring the file size and the file disc returning time of the file, and determining the file processing priority and the file processing speed of the file according to the file types, wherein one file type corresponds to one file processing priority and one file processing speed, and the file processing speed corresponding to each file type is determined based on the historical processing total amount and the historical processing time of the file type in each period;
The first splitting module is used for determining a first file splitting number of the file according to the file size, the file processing speed and the file disc returning time if the file processing priority belongs to a preset file processing priority range corresponding to a preset time period;
The second splitting module is used for acquiring the thread resource occupancy rate corresponding to the receiving time, and correcting the first file splitting number according to the thread resource occupancy rate to obtain a second file splitting number;
the file processing module is used for acquiring thread resources according to the second file splitting quantity, and carrying out concurrent processing on a plurality of subfiles obtained by splitting the files based on the acquired thread resources, wherein the quantity of the thread resources is equal to the second file splitting quantity;
wherein the second splitting module is used for:
If the thread resource occupancy rate is not greater than a first preset threshold value, increasing the first file splitting number by N to obtain a second file splitting number, wherein N is a positive integer;
If the thread resource occupancy rate is greater than the first preset threshold value and not greater than a second preset threshold value, determining the first file splitting number as a second file splitting number, wherein the first preset threshold value is smaller than the second preset threshold value;
And if the thread resource occupancy rate is greater than the second preset threshold value, reducing the first file splitting number by N to obtain a second file splitting number.
6. The apparatus of claim 5, wherein the apparatus further comprises:
The priority setting module is used for acquiring at least two file types;
Setting file processing priorities corresponding to various file types in the at least two file types, wherein the file processing priorities corresponding to the various file types are used for determining processing sequences of the various file types.
7. The apparatus according to claim 5 or 6, wherein the file handling request includes a file identification; the request acquisition module is used for:
extracting a file identifier in the file processing request;
and determining the file marked by the file mark and determining the file type to which the file belongs.
8. A terminal device comprising a processor and a memory, said processor and memory being interconnected;
the memory is for storing a computer program comprising program instructions, the processor being configured to invoke the program instructions to perform the method of any of claims 1-4.
9. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910420841.0A CN110221914B (en) | 2019-05-20 | 2019-05-20 | File processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910420841.0A CN110221914B (en) | 2019-05-20 | 2019-05-20 | File processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110221914A CN110221914A (en) | 2019-09-10 |
| CN110221914B true CN110221914B (en) | 2024-05-17 |
Family
ID=67821553
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910420841.0A Active CN110221914B (en) | 2019-05-20 | 2019-05-20 | File processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110221914B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110955515A (en) * | 2019-10-21 | 2020-04-03 | 量子云未来（北京）信息科技有限公司 | File processing method and device, electronic equipment and storage medium |
| CN111078537B (en) * | 2019-11-29 | 2023-09-22 | 珠海金山数字网络科技有限公司 | Evaluation method for Unity game bundle package resource division |
| CN112699181B (en) * | 2020-12-30 | 2021-07-16 | 深圳格隆汇信息科技有限公司 | Big data based information processing system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102207891A (en) * | 2011-06-10 | 2011-10-05 | 浙江大学 | Method for achieving dynamic partitioning and load balancing of data-partitioning distributed environment |
| CN107844520A (en) * | 2017-10-09 | 2018-03-27 | 平安科技（深圳）有限公司 | Electronic installation, vehicle data introduction method and storage medium |
| CN107959700A (en) * | 2016-10-18 | 2018-04-24 | 中国电信股份有限公司 | The method and cloud storage gateway that adaptive document is downloaded |
| CN108304554A (en) * | 2018-02-02 | 2018-07-20 | 平安证券股份有限公司 | File declustering method, apparatus, computer equipment and storage medium |
| CN109408468A (en) * | 2018-08-24 | 2019-03-01 | 阿里巴巴集团控股有限公司 | Document handling method and device calculate equipment and storage medium |
-
2019
- 2019-05-20 CN CN201910420841.0A patent/CN110221914B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102207891A (en) * | 2011-06-10 | 2011-10-05 | 浙江大学 | Method for achieving dynamic partitioning and load balancing of data-partitioning distributed environment |
| CN107959700A (en) * | 2016-10-18 | 2018-04-24 | 中国电信股份有限公司 | The method and cloud storage gateway that adaptive document is downloaded |
| CN107844520A (en) * | 2017-10-09 | 2018-03-27 | 平安科技（深圳）有限公司 | Electronic installation, vehicle data introduction method and storage medium |
| CN108304554A (en) * | 2018-02-02 | 2018-07-20 | 平安证券股份有限公司 | File declustering method, apparatus, computer equipment and storage medium |
| CN109408468A (en) * | 2018-08-24 | 2019-03-01 | 阿里巴巴集团控股有限公司 | Document handling method and device calculate equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110221914A (en) | 2019-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109783229B (en) | Thread resource allocation method and device | |
| CN110018893B (en) | Task scheduling method based on data processing and related equipment | |
| CN108595157B (en) | Block chain data processing method, device, equipment and storage medium | |
| CN107360206B (en) | Block chain consensus method, equipment and system | |
| CN110221914B (en) | File processing method and device | |
| CN106713396B (en) | Server scheduling method and system | |
| CN107729137B (en) | Server, block chain signature verification decryption method and storage medium | |
| CN104753711B (en) | Method and device for adjusting resource allocation of network equipment | |
| CN106815254A (en) | A kind of data processing method and device | |
| CN110659905B (en) | Transaction verification method, device, terminal equipment and storage medium | |
| CN111813573B (en) | Communication method of management platform and robot software and related equipment thereof | |
| CN108574645B (en) | Queue scheduling method and device | |
| CN111597040A (en) | Resource allocation method, device, storage medium and electronic equipment | |
| CN110704226B (en) | Data verification method, device and storage medium | |
| CN110222016B (en) | File processing method and device | |
| CN111625507A (en) | File processing method and device | |
| CN113626173B (en) | Scheduling method, scheduling device and storage medium | |
| CN111625358B (en) | Resource allocation method and device, electronic equipment and storage medium | |
| CN107194712B (en) | Method and device for recording change information of shared account and method and system for supplementing account of internal account | |
| CN109086132A (en) | A kind of recognition of face task balance call method, device and terminal device | |
| CN111176847B (en) | Method and device for optimizing performance of big data cluster on physical core ultra-multithreading server | |
| CN116841720A (en) | Resource allocation method, apparatus, computer device, storage medium and program product | |
| CN106845926A (en) | A kind of Third-party payment supervisory systems distributed data method for stream processing and system | |
| CN104426900B (en) | multimedia data acquisition method and system | |
| CN115242814B (en) | Cloud space memory space allocation method, device and medium based on idle memory space |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |