CN110287159A - A kind of document handling method and device - Google Patents
A kind of document handling method and device Download PDFInfo
- Publication number
- CN110287159A CN110287159A CN201910476837.6A CN201910476837A CN110287159A CN 110287159 A CN110287159 A CN 110287159A CN 201910476837 A CN201910476837 A CN 201910476837A CN 110287159 A CN110287159 A CN 110287159A
- Authority
- CN
- China
- Prior art keywords
- file
- processed
- processor resource
- newly
- increased
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Abstract
The application discloses a kind of document handling method and device, which comprises whether have newly-increased file, if there is newly-increased file, judge whether available free processor resource if monitoring in FTP catalogue；If available free processor resource, the corresponding file of the processor resource then is moved into using the newly-increased file as file to be processed, and the processing status of the filename of the file to be processed, the number of the processor resource and the file to be processed is stored in database；It creates a subtask and the file to be processed is handled using the processor resource, and processing result is pushed into Kafka server.
Description
Technical field
This application involves a kind of document handling method and devices.
Background technique
Nodejs is single thread server technology, and synchronization can only handle a file, and treatment effeciency is lower.If with
It is huge that family end concurrently uploads data volume, does not come then will result in server process data processing, and processing task blocking causes
The problems such as server disk piles with, server failure.
And in some scenes, in the information interactive process of certain third party systems, often carried out with document form
Data interaction.So need server that there is very strong concurrent file process ability, but since Nodejs is single thread,
Therefore do not have parallel processing capability.
Summary of the invention
In order to solve the above technical problems, the embodiment of the present application provides a kind of document handling method and device.
Document handling method provided by the embodiments of the present application, comprising:
Whether have newly-increased file, if there is newly-increased file, judge whether available free processor money if monitoring in FTP catalogue
Source；
If available free processor resource, the processor resource is moved into using the newly-increased file as file to be processed
Corresponding file, and by the filename of the file to be processed, the number of the processor resource and the text to be processed
In the processing status deposit database of part；
It creates a subtask and the file to be processed is handled using the processor resource, and by processing result
Push to Kafka server.
In one embodiment, whether there is newly-increased file in the monitoring FTP catalogue, if there is newly-increased file, judgement is
No available free processor resource, comprising:
Watch module timing training in rotation FTP catalogue, to check whether there is newly-increased file in FTP catalogue, if there is newly-increased file,
Then the filename of the newly-increased file is passed to scheduler module by the Watch module；
The scheduler module receive after the filename of the newly-increased file whether available free processor resource.
In one embodiment, described corresponding using the newly-increased file as the file to be processed immigration processor resource
File, comprising:
Scheduler module judges whether there is the corresponding file of the processor resource；If it does not exist, then the place is created
The corresponding file of device resource is managed, and the file to be processed is stored in this document folder；It if it exists, then directly will be described to be processed
File is stored in this document folder；
Wherein, the folder name of the corresponding file of the processor resource includes the number of the processor resource.
In one embodiment, one subtask of the creation using the processor resource to the file to be processed into
Row processing, comprising:
Scheduler module starts subtask by Fork, and by the filename and the processor resource of the file to be processed
Number be passed in the subtask；
According to the filename of the file to be processed and the number of the processor resource after the subtask starting, obtain
File path to be treated, and the processing status of file to be processed described in the database is updated then to open in processing
Beginning parses the file to be processed.
In one embodiment, the method also includes:
After the subtask is successfully processed, the processing status for updating file to be processed described in the database is
Terminate, and processed file is moved into processed file.
Document handling apparatus provided by the embodiments of the present application, comprising:
Whether Watch module has newly-increased file for monitoring in FTP catalogue；
Scheduler module, if judging whether available free processor resource for there is newly-increased file；If available free processing
Device resource then moves into the corresponding file of the processor resource for the newly-increased file as file to be processed, and will be described
The processing status of the filename of file to be processed, the number of the processor resource and the file to be processed is stored in database
In；It creates a subtask and the file to be processed is handled using the processor resource, and processing result is pushed
To Kafka server.
In one embodiment, the Watch module is used for timing training in rotation FTP catalogue, with check in FTP catalogue whether
There is newly-increased file, if there is newly-increased file, the filename of the newly-increased file is passed into scheduler module；
The scheduler module, after the filename for receiving the newly-increased file whether available free processor resource.
In one embodiment, the scheduler module, for judging whether there is the corresponding file of the processor resource
Folder；If it does not exist, then the corresponding file of the processor resource is created, and the file to be processed is stored in this document folder；
If it exists, then the file to be processed is directly stored in this document folder；Wherein, the text of the corresponding file of the processor resource
Part presss from both sides the number that name includes the processor resource.
In one embodiment, the scheduler module, for by Fork starting subtask, and by the file to be processed
Filename and the number of the processor resource be passed in the subtask；According to described to be processed after the subtask starting
The number of the filename of file and the processor resource obtains file path to be treated, and updates in the database
The processing status of the file to be processed is then to start to parse the file to be processed in processing.
In one embodiment, the scheduler module after being successfully processed for the subtask, updates the data
The processing status of file to be processed described in library is to have terminated, and processed file is moved into processed file.
The technical solution of the embodiment of the present application improves the processing capacity of Nodejs and server hardware is made full use of to provide
Source by the Cluster function library of Nodejs, and increases Scheduler module and provides parallel processing capability for nodejs, thus
Server resource is made full use of, treatment effeciency is improved.On the other hand, avoid due to server handling ability deficiency cause to
Handle file accumulation, Insufficient disk space, thus the problems such as service disruption.
Detailed description of the invention
Fig. 1 is the flow diagram of document handling method provided by the embodiments of the present application；
Fig. 2 is the file process architecture diagram provided by the embodiments of the present application based on Nodejs；
Fig. 3 is the structure composition schematic diagram of document handling apparatus provided by the embodiments of the present application.
Specific embodiment
The technical solution of the embodiment of the present application for ease of understanding below says the relevant technologies of the embodiment of the present application
It is bright.
In the related art, data acquisition supplier by File Transfer Protocol (File Transfer Protocol,
FTP acquisition data) are pushed to data exchange server in the form of zip file；Nodejs is used in data exchange server
Program is parsed and is decrypted to the zip file for being uploaded to data exchange server, and the data result after processing parsing is pushed away
It is sent to Kafka.
There are the following problems for above-mentioned the relevant technologies: 1, Nodejs is single-threading program, although it is non-fastly compared with Java to execute speed
Chang Duo, and development efficiency is high, but due to lacking parallel processing capability, promotion data-handling capacity means are limited, a denier
It explodes suddenly according to amount, server will be caused to exhaust disk, server delay machine because of processing capacity deficiency.2, due to its single thread
Feature is unable to fully result in waste of resources using server multi-core CPU resource.3, the simple scheme for using cluster cluster,
Since all task parallelisms execute, it will lead to resource and seize, the case where task queue handles same file simultaneously generation causes
Mistake.4, if carrying out shunting processing using lock mechanism, meeting blocked task is locked, performance is caused to decline.It is above-mentioned to solve
Problem proposes the following technical scheme of the embodiment of the present application.
The characteristics of in order to more fully hereinafter understand the embodiment of the present application and technology contents, with reference to the accompanying drawing to this Shen
Please the realization of embodiment be described in detail, appended attached drawing purposes of discussion only for reference is not used to limit the embodiment of the present application.
Fig. 1 is the flow diagram of document handling method provided by the embodiments of the present application, as shown in Figure 1, at the file
Reason method the following steps are included:
Step 101: whether have newly-increased file, if there is newly-increased file, judge whether available free place if monitoring in FTP catalogue
Manage device resource.
In the embodiment of the present application, the format of the file can be JSON file.
In the embodiment of the present application, whether there is newly-increased file in the monitoring FTP catalogue, if there is newly-increased file, judgement is
No available free processor resource, can be accomplished by the following way:
1) Watch module timing training in rotation FTP catalogue, to check whether there is newly-increased file in FTP catalogue, if there is newly-increased text
Part, then the filename of the newly-increased file is passed to scheduler module by the Watch module；
2) scheduler module receive after the filename of the newly-increased file whether available free processor resource.
Here, processor resource includes but is not limited to cpu resource.
Here, the function of the scheduler module is realized by Nodejs, and such as scheduler module is Nodejs
Master。
Step 102: if available free processor resource, moving into the place for the newly-increased file as file to be processed
Manage the corresponding file of device resource, and by the filename of the file to be processed, the number of the processor resource and described
In the processing status deposit database of file to be processed.
It is described corresponding using the newly-increased file as the file to be processed immigration processor resource in the embodiment of the present application
File, can be accomplished by the following way:
Scheduler module judges whether there is the corresponding file of the processor resource；If it does not exist, then the place is created
The corresponding file of device resource is managed, and the file to be processed is stored in this document folder；It if it exists, then directly will be described to be processed
File is stored in this document folder；
Wherein, the folder name of the corresponding file of the processor resource includes the number of the processor resource.
Step 103: one subtask of creation is handled the file to be processed using the processor resource, and will
Processing result pushes to Kafka server.
In the embodiment of the present application, one subtask of the creation using the processor resource to the file to be processed into
Row processing, can be accomplished by the following way:
1) scheduler module starts subtask by Fork, and the filename of the file to be processed and the processor are provided
The number in source is passed in the subtask；
2) it is obtained after the subtask starting according to the filename of the file to be processed and the number of the processor resource
File path to be treated is taken, and updates the processing status of file to be processed described in the database in processing, then
Start to parse the file to be processed.
In the embodiment of the present application, after the subtask is successfully processed, text to be processed described in the database is updated
The processing status of part is to have terminated, and processed file is moved into processed file.
For it is more detailed understand the embodiment of the present application technical solution, below in conjunction with specific example to the embodiment of the present application
Technical solution is elaborated.
Fig. 2 is the file process architecture diagram provided by the embodiments of the present application based on Nodejs, as shown in Fig. 2, data exchange
Server includes FTP catalogue, and client can will acquire FTP catalogue of the data-pushing to data exchange server by FTP.?
A scheduler module, i.e. Nodejs Master module (hereinafter referred to as Master module) are created in data exchange server,
Master module goes to monitor whether FTP catalogue has newly-increased file by Watch module (module of a timing training in rotation file),
If there is increasing file newly, then judging whether available free cpu resource, newly-increased file is moved into CPU if available free cpu resource
The file of reference numeral, while by filename to be processed, CPU number, processing status is stored in database (Redis), and is created
It builds a subprocess to handle this document, be pushed into Kafka server (or Kafka cluster) after processing.Pass through this
Scheme effectively avoids the use of lock it is possible to prevente effectively from the case where multitask request same data file, is promoted parallel
Processing capacity.
Referring to Fig. 2, the detailed process of framework shown in Fig. 2 is as follows:
1) by PM2 instrument start-up Master module (i.e. scheduler module), due to each server only one
Master module, so, once Master module abnormal end, entire service will stop servicing, and server will be because of number
Excessive according to file, disk expends light, service disruption.Since PM2 has monitoring Nodejs program and can be restarted automatically at the first time
The characteristics of Nodejs program, to realize the High Availabitity of Master module.
2) Master module has checked whether to need by Watch module timing training in rotation (being set as 100ms at present) FTP catalogue
File to be processed, if so, filename is then passed to Master module.
3) after Master module receives filename to be treated, Master module judges whether CPU has vacant resource,
If it is not, into suspend mode 100MS, and monitor subtask and exit event, the return step 2 after dormancy time) it carries out
Processing.If there is CPU idling-resource, then the processing of step 4) is carried out.
4) filename to be processed, CPU number are stored in Redis by Master module, and are pending by the task flagging.
5) Master module judges whether there is the file using CPU number as folder name, if there is no then creating,
And this document is stored in this file, and if so, file to be processed is stored in this document folder.
6) Master module starts subtask (utilizing the Cluster module creation subprocess of Nodejs) by Fork, and
By filename, CPU number is passed in subtask, while will be in the corresponding cpu number of the pid of subtask deposit redis.
7) filename and CPU number are obtained after the starting of subtask.It needs to handle by CPU number and filename acquisition
File path, and update in Redis file process task status in processing, then to start to carry out document analysis.
8) after document analysis success, the result after parsing is pushed into Kafka server, if document analysis fails,
Subtask is exited, it is 999 that code is exited in subtask.
9) group Mission Success after treatment, the processing status for updating this document in Redis are to have terminated, and exit,
Exiting code is 0.
10) Master module is available to the subtask end of run by exiting event, and reads file in Redis
The processing file is then moved into processed file if it is having terminated by processing status, if not having terminated, illustrates that son is appointed
Business abnormal end.Need to restart the subtask.Again file is handled.
11) if subtask is exited, and exiting code is 0, then re-executes the 2) step.
The technical solution of the embodiment of the present application proposes a kind of task scheduling approach, optimizes Nodejs program in multi-core CPU
Parallel efficiency calculation avoids between parallel task in such a way that single task role scheduling unit (i.e. Master module) distributes task
Conflict, improve the concurrent processing efficiency of Nodejs.
The above scheme of the embodiment of the present application can be realized by following code, it should be noted that following code belongs to
Pseudocode, under the premise of without departing from the embodiment of the present application technical solution objective, the function that any type of code is realized is all
Belong to the protection scope of the embodiment of the present application:
Fig. 3 is the structure composition schematic diagram of document handling apparatus provided by the embodiments of the present application, as shown in figure 3, the text
Part processing unit includes:
Whether Watch module 301 has newly-increased file for monitoring in FTP catalogue；
Scheduler module 302, if judging whether available free processor resource for there is newly-increased file；If available free
Processor resource then moves into the corresponding file of the processor resource for the newly-increased file as file to be processed, and will
The processing status of the filename of the file to be processed, the number of the processor resource and the file to be processed is stored in number
According in library；It creates a subtask and the file to be processed is handled using the processor resource, and by processing result
Push to Kafka server.
In one embodiment, the Watch module 301 is used for timing training in rotation FTP catalogue, is to check in FTP catalogue
It is no to have newly-increased file, if there is newly-increased file, the filename of the newly-increased file is passed into scheduler module 302；
The scheduler module 302, after the filename for receiving the newly-increased file whether available free processor resource.
In one embodiment, the scheduler module 302, for judging whether there is the corresponding text of the processor resource
Part folder；If it does not exist, then the corresponding file of the processor resource is created, and the file to be processed is stored in this document
Folder；If it exists, then the file to be processed is directly stored in this document folder；Wherein, the corresponding file of the processor resource
Folder name include the processor resource number.
In one embodiment, the scheduler module 302, for starting subtask by Fork, and will be described to be processed
The number of the filename of file and the processor resource is passed in the subtask；After the starting of the subtask according to it is described to
The filename of file and the number of the processor resource are handled, obtains file path to be treated, and update the data
The processing status of file to be processed described in library is then to start to parse the file to be processed in processing.
In one embodiment, the scheduler module 302, after being successfully processed for the subtask, described in update
The processing status of file to be processed described in database is to have terminated, and processed file is moved into processed file.
It will be appreciated by those skilled in the art that the realization function of each module in document handling apparatus shown in Fig. 3 can join
According to aforementioned document processing method associated description and understand.The function of each module in document handling apparatus shown in Fig. 3 can lead to
It crosses the program run on processor and realizes, can also be realized by specific logic circuit.
It, in the absence of conflict, can be in any combination between technical solution documented by the embodiment of the present application.
In several embodiments provided herein, it should be understood that disclosed method and smart machine, Ke Yitong
Other modes are crossed to realize.Apparatus embodiments described above are merely indicative, for example, the division of the unit, only
Only a kind of logical function partition, there may be another division manner in actual implementation, such as: multiple units or components can be tied
It closes, or is desirably integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed each group
Can be through some interfaces at the mutual coupling in part or direct-coupling or communication connection, equipment or unit it is indirect
Coupling or communication connection, can be electrical, mechanical or other forms.
Above-mentioned unit as illustrated by the separation member, which can be or may not be, to be physically separated, aobvious as unit
The component shown can be or may not be physical unit, it can and it is in one place, it may be distributed over multiple network lists
In member；Some or all of units can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, can be fully integrated into a second processing unit in each functional unit in each embodiment of the application,
It is also possible to each unit individually as a unit, can also be integrated in one unit with two or more units；
Above-mentioned integrated unit both can take the form of hardware realization, can also add the form of SFU software functional unit real using hardware
It is existing.
The above, the only specific embodiment of the application, but the protection scope of the application is not limited thereto, it is any
Those familiar with the art within the technical scope of the present application, can easily think of the change or the replacement, and should all contain
Lid is within the scope of protection of this application.
Claims (10)
1. a kind of document handling method, which is characterized in that the described method includes:
Whether have newly-increased file, if there is newly-increased file, judge whether available free processor resource if monitoring in FTP catalogue；
If available free processor resource, it is corresponding that the processor resource is moved into using the newly-increased file as file to be processed
File, and by the filename of the file to be processed, the number of the processor resource and the file to be processed
Processing status is stored in database；
It creates a subtask and the file to be processed is handled using the processor resource, and processing result is pushed
To Kafka server.
2. the method according to claim 1, wherein whether having newly-increased file in the monitoring FTP catalogue, if having
Newly-increased file, then judge whether available free processor resource, comprising:
Watch module timing training in rotation FTP catalogue, to check whether there is newly-increased file in FTP catalogue, if having newly-increased file, institute
It states Watch module and the filename of the newly-increased file is passed into scheduler module；
The scheduler module receive after the filename of the newly-increased file whether available free processor resource.
3. method according to claim 1 or 2, which is characterized in that described using the newly-increased file as file to be processed
Move into the corresponding file of the processor resource, comprising:
Scheduler module judges whether there is the corresponding file of the processor resource；If it does not exist, then the processor is created
The corresponding file of resource, and the file to be processed is stored in this document folder；If it exists, then directly by the file to be processed
It is stored in this document folder；
Wherein, the folder name of the corresponding file of the processor resource includes the number of the processor resource.
4. method according to claim 1 or 2, which is characterized in that described one subtask of creation utilizes the processor
Resource handles the file to be processed, comprising:
Scheduler module starts subtask by Fork, and by the volume of the filename of the file to be processed and the processor resource
It number is passed in the subtask；
According to the filename of the file to be processed and the number of the processor resource after the subtask starting, obtains and need
The file path of processing, and the processing status of file to be processed described in the database is updated in processing, then to start pair
The file to be processed is parsed.
5. according to the method described in claim 4, it is characterized in that, the method also includes:
After the subtask is successfully processed, the processing status for updating file to be processed described in the database is to have tied
Beam, and processed file is moved into processed file.
6. a kind of document handling apparatus, which is characterized in that described device includes:
Whether Watch module has newly-increased file for monitoring in FTP catalogue；
Scheduler module, if judging whether available free processor resource for there is newly-increased file；If available free processor provides
Source then moves into the corresponding file of the processor resource for the newly-increased file as file to be processed, and by described wait locate
It manages in the processing status deposit database of the filename of file, the number of the processor resource and the file to be processed；
It creates a subtask and the file to be processed is handled using the processor resource, and processing result is pushed to
Kafka server.
7. device according to claim 6, wherein
The Watch module is used for timing training in rotation FTP catalogue, to check whether there is newly-increased file in FTP catalogue, if having newly-increased
The filename of the newly-increased file is then passed to scheduler module by file；
The scheduler module, after the filename for receiving the newly-increased file whether available free processor resource.
8. device according to claim 6 or 7, wherein the scheduler module, for judging whether there is the processor
The corresponding file of resource；If it does not exist, then the corresponding file of the processor resource is created, and by the file to be processed
It is stored in this document folder；If it exists, then the file to be processed is directly stored in this document folder；Wherein, the processor resource pair
The folder name for the file answered includes the number of the processor resource.
9. device according to claim 6 or 7, wherein the scheduler module, for starting subtask by Fork, and
The number of the filename of the file to be processed and the processor resource is passed in the subtask；The subtask starting
Afterwards according to the number of the filename of the file to be processed and the processor resource, file path to be treated is obtained, and
The processing status of file to be processed described in the database is updated in processing, then to start to carry out the file to be processed
Parsing.
10. device according to claim 9, wherein the scheduler module is successfully processed end for the subtask
Afterwards, the processing status for updating file to be processed described in the database is to have terminated, and the immigration of processed file has been located
Manage file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910476837.6A CN110287159B (en) | 2019-06-03 | 2019-06-03 | File processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910476837.6A CN110287159B (en) | 2019-06-03 | 2019-06-03 | File processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110287159A true CN110287159A (en) | 2019-09-27 |
| CN110287159B CN110287159B (en) | 2021-11-12 |
Family
ID=68003291
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910476837.6A Active CN110287159B (en) | 2019-06-03 | 2019-06-03 | File processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110287159B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113422840A (en) * | 2021-07-13 | 2021-09-21 | 全景智联(武汉)科技有限公司 | Picture processing system and method based on file transfer protocol |
| CN113760832A (en) * | 2020-06-03 | 2021-12-07 | 富泰华工业（深圳）有限公司 | File processing method, computer device and readable storage medium |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100011383A1 (en) * | 2008-07-12 | 2010-01-14 | Sahul Hameed Abdul Kader Jailani | Method for file handling in network switch stacking |
| CN101630271A (en) * | 2009-06-26 | 2010-01-20 | 湖南大学 | Middleware supporting system for simulating and calculating earthquake in grid environment |
| US20100145718A1 (en) * | 2000-03-30 | 2010-06-10 | Convergys Customer Management Group Inc. | System and Method for Establishing Electronic Business Systems for Supporting Communications Services Commerce |
| CN102111438A (en) * | 2010-12-24 | 2011-06-29 | 华为技术有限公司 | Method and device for parameter adjustment and distributed computation platform system |
| CN102457567A (en) * | 2010-11-08 | 2012-05-16 | 中标软件有限公司 | Mirror image backup/recovery method and tool of web management mode |
| CN103780675A (en) * | 2013-12-11 | 2014-05-07 | 北京荣之联科技股份有限公司 | Cloud disc file synchronization method and apparatus |
| CN103810048A (en) * | 2014-03-11 | 2014-05-21 | 国家电网公司 | Automatic adjusting method and device for thread number aiming to realizing optimization of resource utilization |
| CN103810293A (en) * | 2014-02-28 | 2014-05-21 | 广州云宏信息科技有限公司 | Text classification method and device based on Hadoop |
| CN104133822A (en) * | 2013-07-15 | 2014-11-05 | 腾讯科技（深圳）有限公司 | Method and device for scanning files in memory |
| CN105138565A (en) * | 2015-07-23 | 2015-12-09 | 浪潮(北京)电子信息产业有限公司 | File processing method and system |
| CN105243340A (en) * | 2015-11-18 | 2016-01-13 | 浪潮(北京)电子信息产业有限公司 | Method and system for preventing mis-deleting of data in HBase |
| CN106101265A (en) * | 2016-07-26 | 2016-11-09 | 浪潮软件股份有限公司 | A kind of method carrying out file synchronization between Dropbox and desktop end |
| CN107807950A (en) * | 2017-09-18 | 2018-03-16 | 南京华盾电力信息安全测评有限公司 | A kind of online friendly picture cutting method read of internet site group magazine file |
| CN108156238A (en) * | 2017-12-23 | 2018-06-12 | 贵阳朗玛信息技术股份有限公司 | The method and device that a kind of data automation uploads |
| CN109286641A (en) * | 2017-07-19 | 2019-01-29 | 腾讯科技（深圳）有限公司 | A kind of document transmission method and its device |
-
2019
- 2019-06-03 CN CN201910476837.6A patent/CN110287159B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100145718A1 (en) * | 2000-03-30 | 2010-06-10 | Convergys Customer Management Group Inc. | System and Method for Establishing Electronic Business Systems for Supporting Communications Services Commerce |
| US20100011383A1 (en) * | 2008-07-12 | 2010-01-14 | Sahul Hameed Abdul Kader Jailani | Method for file handling in network switch stacking |
| CN101630271A (en) * | 2009-06-26 | 2010-01-20 | 湖南大学 | Middleware supporting system for simulating and calculating earthquake in grid environment |
| CN102457567A (en) * | 2010-11-08 | 2012-05-16 | 中标软件有限公司 | Mirror image backup/recovery method and tool of web management mode |
| CN102111438A (en) * | 2010-12-24 | 2011-06-29 | 华为技术有限公司 | Method and device for parameter adjustment and distributed computation platform system |
| CN104133822A (en) * | 2013-07-15 | 2014-11-05 | 腾讯科技（深圳）有限公司 | Method and device for scanning files in memory |
| CN103780675A (en) * | 2013-12-11 | 2014-05-07 | 北京荣之联科技股份有限公司 | Cloud disc file synchronization method and apparatus |
| CN103810293A (en) * | 2014-02-28 | 2014-05-21 | 广州云宏信息科技有限公司 | Text classification method and device based on Hadoop |
| CN103810048A (en) * | 2014-03-11 | 2014-05-21 | 国家电网公司 | Automatic adjusting method and device for thread number aiming to realizing optimization of resource utilization |
| CN105138565A (en) * | 2015-07-23 | 2015-12-09 | 浪潮(北京)电子信息产业有限公司 | File processing method and system |
| CN105243340A (en) * | 2015-11-18 | 2016-01-13 | 浪潮(北京)电子信息产业有限公司 | Method and system for preventing mis-deleting of data in HBase |
| CN106101265A (en) * | 2016-07-26 | 2016-11-09 | 浪潮软件股份有限公司 | A kind of method carrying out file synchronization between Dropbox and desktop end |
| CN109286641A (en) * | 2017-07-19 | 2019-01-29 | 腾讯科技（深圳）有限公司 | A kind of document transmission method and its device |
| CN107807950A (en) * | 2017-09-18 | 2018-03-16 | 南京华盾电力信息安全测评有限公司 | A kind of online friendly picture cutting method read of internet site group magazine file |
| CN108156238A (en) * | 2017-12-23 | 2018-06-12 | 贵阳朗玛信息技术股份有限公司 | The method and device that a kind of data automation uploads |
Non-Patent Citations (1)
| Title |
|---|
| 张春华: "银行项目管理系统的开发与设计", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113760832A (en) * | 2020-06-03 | 2021-12-07 | 富泰华工业（深圳）有限公司 | File processing method, computer device and readable storage medium |
| CN113422840A (en) * | 2021-07-13 | 2021-09-21 | 全景智联(武汉)科技有限公司 | Picture processing system and method based on file transfer protocol |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110287159B (en) | 2021-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3837604B1 (en) | In situ triggered function as a service within a service mesh | |
| US7934220B2 (en) | Method and system for optimizing file table usage | |
| US8238350B2 (en) | Message batching with checkpoints systems and methods | |
| CN112882813B (en) | Task scheduling method, device and system and electronic equipment | |
| CN110825535B (en) | Job scheduling method and system | |
| CN109445944A (en) | A kind of network data acquisition processing system and its method based on DPDK | |
| CN113504985B (en) | Task processing method and network equipment | |
| US8266504B2 (en) | Dynamic monitoring of ability to reassemble streaming data across multiple channels based on history | |
| CN103092682A (en) | Asynchronous network application program processing method | |
| CN110471777B (en) | Method and system for realizing multi-user sharing and using Spark cluster in Python-Web environment | |
| US8606908B2 (en) | Wake-up server | |
| CN110287159A (en) | A kind of document handling method and device | |
| Wang et al. | FLOWPROPHET: Generic and accurate traffic prediction for data-parallel cluster computing | |
| WO2004042571A2 (en) | A communication method with reduced response time in a distributed data processing system | |
| Sun et al. | Republic: Data multicast meets hybrid rack-level interconnections in data center | |
| CN110365786B (en) | Job processing system, asynchronous job scheduling method, and computer device | |
| CN113515361B (en) | Lightweight heterogeneous computing cluster system facing service | |
| CN112925648B (en) | Business strategy issuing method and device | |
| US20100122255A1 (en) | Establishing future start times for jobs to be executed in a multi-cluster environment | |
| CN106909368B (en) | Service-side service layer logic architecture for realizing rapid service development | |
| CN115437766A (en) | Task processing method and device | |
| CN109766131A (en) | The system and method for the intelligent automatic upgrading of software is realized based on multithreading | |
| CN112748855B (en) | Method and device for processing high concurrency data request | |
| CN105808585B (en) | Method and device for processing streaming data | |
| CN110955461B (en) | Processing method, device, system, server and storage medium for computing task |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |