CN109766316A - File acquisition method, device, computer equipment and storage medium - Google Patents
File acquisition method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109766316A CN109766316A CN201811553802.XA CN201811553802A CN109766316A CN 109766316 A CN109766316 A CN 109766316A CN 201811553802 A CN201811553802 A CN 201811553802A CN 109766316 A CN109766316 A CN 109766316A
- Authority
- CN
- China
- Prior art keywords
- file
- task
- information
- file acquisition
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000012795 verification Methods 0.000 claims abstract description 36
- 238000004590 computer program Methods 0.000 claims description 28
- 230000005540 biological transmission Effects 0.000 claims description 9
- 238000007726 management method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 206010033799 Paralysis Diseases 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application involves O&M field, in particular to a kind of file acquisition method, device, computer equipment and storage medium.The described method includes: obtaining current time, when current time reaches file acquisition task corresponding executions time in task pool, file acquisition task is obtained from task pool, identifies the corresponding target user of file acquisition task；Corresponding storage address and verification information are obtained according to target user；File read request is generated according to file acquisition task；File read request is sent to the corresponding terminal of storage address, when the corresponding terminal of storage address is verified verification information, obtains file corresponding with read requests from the corresponding terminal of storage address, and file acquisition task is removed from task pool.Using this method can be different channel automatic identification file acquisition modes, improve the efficiency of file acquisition.
Description
Technical field
This application involves field of computer technology, more particularly to a kind of file acquisition method, device, computer equipment and
Storage medium.
Background technique
With the development of modern science and technology, people face data file daily now in current big data era, thus
Very necessary is increasingly become with management method to the processing of data, many times, it would be desirable to which processing is dispersed in not homologous ray
Different-format data；So needing first to obtain the file that user provides from different system and database.
In traditional file acquisition methods, it is typically employed in when needing to obtain a file, transfers the time according to demand by list
A terminal executes file acquisition operation；But the file if necessary to obtain is dispersed in different databases, and storage medium
When more diversified, require a great deal of time obtaining these files, the efficiency of file acquisition is lower.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide a kind of file acquisition that can be improved file acquisition efficiency
Method, apparatus, computer equipment and storage medium.
A kind of file acquisition method, which comprises
Current time is obtained, when the current time reaches file acquisition task corresponding execution time in task pool,
The file acquisition task is obtained from the task pool, identifies the corresponding target user of the file acquisition task；
Corresponding storage address and verification information are obtained according to the target user；
File read request is generated according to the file acquisition task；
The file read request is sent to the corresponding terminal of the storage address, when the corresponding terminal of the storage address
When being verified to the verification information, text corresponding with the read requests is obtained from the corresponding terminal of the storage address
Part, and the file acquisition task is removed from the task pool.
It is described corresponding with the read requests from the corresponding terminal acquisition of the storage address in one of the embodiments,
File after, further includes:
Receive the information acquisition request that service terminal is sent, carry in the information acquisition request target user's mark and
Information category；
The file destination for obtaining the target user is identified according to the target user；
Information corresponding with the information acquisition request is read from the file destination, and by the information according to
Information category filing；
The information after filing is back to the service terminal.
It is described corresponding with the read requests from the corresponding terminal acquisition of the storage address in one of the embodiments,
File after, further includes:
File corresponding with the read requests is stored to predeterminated position；
Then after the generation file read request according to the file acquisition task, further includes:
It checks in the predeterminated position with the presence or absence of file corresponding with the read requests, and if it exists, continuation is described will
The file acquisition task is removed from the task pool.
In one of the embodiments, before the acquisition current time, further includes:
The file acquisition task is received, the file acquisition task, which carries, executes the time；
The file acquisition task is stored in the task pool according to the time is executed.
In one of the embodiments, after the file read request to storage address transmission, further includes:
It is the text in the task pool when receiving acquisition failed message corresponding with the file read request
Part obtains task and resets the execution time.
In one of the embodiments, the method also includes:
When the same execution time, the quantity for file acquisition task was more than preset value, then the preset value number is only carried out
The file acquisition task of amount；
Reset the file acquisition task corresponding execution time for exceeding the default value part.
A kind of file acquisition device, described device include:
Task timing module, for obtaining current time, when the current time reaches file acquisition task in task pool
When the corresponding execution time, the file acquisition task is obtained from the task pool, identifies that the file acquisition task is corresponding
Target user；
Address acquisition module, for obtaining corresponding storage address and verification information according to the target user；
Generation module is requested, for generating file read request according to the file acquisition task；
File acquisition module, for sending the file read request to the corresponding terminal of the storage address, when described
When the corresponding terminal of storage address is verified the verification information, from the corresponding terminal of the storage address obtain with it is described
The corresponding file of read requests, and the file acquisition task is removed from the task pool.
Described device in one of the embodiments, further include:
Information acquisition request receiving module, for receiving the information acquisition request of service terminal transmission, the acquisition of information
Target user's mark and information category are carried in request；
File destination obtains module, for identifying the file destination for obtaining the target user according to the target user；
Information profiling module, for reading information corresponding with the information acquisition request from the file destination, and
The information is filed according to the information category；
Information return module, for the information after filing to be back to the service terminal.
A kind of computer equipment, including memory and processor, the memory are stored with computer program, the processing
The step of device realizes any of the above-described the method when executing the computer program.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
The step of method described in any of the above embodiments is realized when row.
Above-mentioned file acquisition method, device, computer equipment and storage medium, when the subordinate terminal of server is needed from it
When obtaining file in the storage address such as his terminal or website, file acquisition task is sent to server, server is by appointing
Pond be engaged according to the file acquisition task for executing all terminals of time management and sending of each file acquisition task, when having in task pool
When reaching the file acquisition task for executing the time, server obtains this task, identifies corresponding target user, and obtains target use
The corresponding storage address in family and verification information send the file read request for obtaining file to storage address, and are believed according to verifying
Breath obtains the file acquisition permission of this storage address, when permission is verified, can obtain corresponding file from storage address,
Then this task in task pool is removed, completes this file acquisition task.Above-mentioned file acquisition method passes through task pool management
The file acquisition task of multiple terminals is managed collectively the file acquisition task of terminal, and storage is used for target on the server
The storage address and corresponding verification information of file are stored in family, allow server according to the difference of target user, obtain storage ground
Location and verification information are different channel automatic identification file acquisition modes, improve the efficiency of file acquisition.
Detailed description of the invention
Fig. 1 is the application scenario diagram of file acquisition method in one embodiment；
Fig. 2 is the flow diagram of file acquisition method in one embodiment；
Fig. 3 is the flow diagram of information acquiring step in one embodiment；
Fig. 4 is the structural block diagram of file acquisition device in one embodiment；
Fig. 5 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
File acquisition method provided by the present application can be applied in application environment as shown in Figure 1.Wherein, terminal 102
It is communicated by network with server 104.When the subordinate terminal 102 of server 104 is needed from other terminals or website etc.
When obtaining file in storage address, file acquisition task is sent to server 104, server 104 is by task pool according to every
The file acquisition task for executing all terminals of time management and sending of a file acquisition task, when there is arrival to execute in task pool
Between file acquisition task when, server obtains this task, identifies corresponding target user, and obtain that target user is corresponding to deposit
Address and verification information are stored up, the file read request for obtaining file is sent to storage address, and this is obtained according to verification information and is deposited
The file acquisition permission for storing up address can obtain corresponding file from storage address, then by task when permission is verified
This task in pond removes, and completes this file acquisition task.Wherein, terminal 102 can be, but not limited to be various personal computers,
Laptop, smart phone, tablet computer and portable wearable device, server 104 can with independent server or
Person is the server cluster of multiple server compositions to realize.
In one embodiment, as shown in Fig. 2, providing a kind of file acquisition method, it is applied in Fig. 1 in this way
It is illustrated for server, comprising the following steps:
S202 obtains current time, when current time reaches file acquisition task corresponding execution time in task pool,
File acquisition task, the corresponding target user of identification file acquisition task are obtained from task pool.
Wherein, current time is the time shown on server at this time, is for judging that starting executes the text in task pool
Part obtains the foundation of task, can be current natural time.
File acquisition task is that the subordinate terminal of server obtains appointing for file to other terminals or network address, database
Business usually has one to start the execution time obtained；Such as provide that 6 points of every morning reads from the database of a subordinate bank
Primary the previous day received loan data.
Target user is the corresponding user of the file to be obtained in file acquisition task, can be cooperation Business Name,
Department name or the server name etc. for being also possible to our company can represent the code name that uniqueness obtains address.
Specifically, task pool is the database for managing the file acquisition task that all subordinate terminals are sent；In terminal
When having pending file acquisition task, the execution time of this task and file acquisition task are sent jointly to service by terminal
All file acquisition tasks received are all placed in task pool by device, server, when server detects that current time arrives
Up to file acquisition task a certain in task pool it is corresponding execute the time when, server obtains this file acquisition from task pool
Task starts to execute, and each file acquisition task should all have corresponding user, allows server to inquire the user and stores text
The address of part, and continue following the step of obtaining file from the address.
S204 obtains corresponding storage address and verification information according to target user.
Wherein, storage address is the address of target user's storage file, can be the IP address of database, MAC Address or
Person's network address etc.；Verification information is that target user is supplied to server for accessing the information of storage address, can be user name
With the verification modes such as password.
Specifically, server is according to identifying the pending corresponding target user of file acquisition task in step S202
Afterwards, from the corresponding storage address of storage target user and the corresponding storage address of this target user of the position acquisition of verification information and
Verification information.Optionally, technical staff can be by the corresponding storage address of each target user and the corresponding storage of verification information, clothes
Being engaged in device can be by target user as the corresponding storage address of search index acquisition and verification information.
S206 generates file read request according to file acquisition task.
Specifically, file read request is that the slave storage address acquisition that server is generated according to file acquisition task is corresponding
The request of file；Server generates file read request according to file acquisition task, this file read request does not need setting and holds
The row time, server is i.e. executable after generating, and should include the information for the file that need to be obtained.
Optionally, since the medium of each target user's storage file is different, server identifies that file acquisition task is corresponding
File be that after being provided by which target user, the medium type of the storage of target user and server commitment, root can be obtained
Corresponding Code Template is obtained according to medium type, and by corresponding storage address and verification information filling Code Template, is generated
Corresponding file read request is obtained from storage address.For example, target user can be using medium sftp (refer generally to bank or
The server of other financial institutions) fund side A, then server can be by host ip (Internet Protocol network interconnection
Agreement), port (storage address), username and password (verification information) insert Code Template, generate the generation of file read request
Code, executes this code by server；Target user is also possible to the fund side B using iobs (a kind of storage mode), server
It needs to configure the filling Code Template such as ak, sk (verification information), bucket (being equivalent to storage address) and generates file read request.
Above-mentioned steps can allow for server different according to the medium type of target user, selection is matched by Templated code configuration
It sets template, obtain storage address and verification information, be different channel automatic identification file acquisition modes, improve file acquisition
Efficiency.
S208 sends file read request to the corresponding terminal of storage address, when the corresponding terminal of storage address is to verifying
When Information Authentication passes through, the file that the corresponding terminal of storage address is returned according to file read request is received, and by file acquisition
Task is removed from task pool.
Wherein, the terminal of the corresponding terminal of storage address, that is, target user's storage file address, can be network data
Library or cooperation etc..
Specifically, the file read request of generation is sent to the corresponding terminal of storage address, corresponding terminal by server
The file read request for obtaining file is sent, and obtains the file acquisition permission of this storage address according to verification information, works as permission
When being verified, corresponding file can be obtained from storage address, then this task in task pool is removed, completes this file
Acquisition task.
Above-mentioned file acquisition method, when the subordinate terminal of server is needed from the storage address such as other terminals or website
When obtaining file, file acquisition task is sent to server, server is by task pool according to each file acquisition task
The file acquisition task that all terminals of time management are sent is executed, reaches the file acquisition task for executing the time when having in task pool
When, server obtains this task, identifies corresponding target user, and obtain the corresponding storage address of target user and verifying letter
Breath sends the file read request for obtaining file to the corresponding terminal of storage address, and obtains this storage ground according to verification information
The file acquisition permission of location can obtain corresponding file from storage address when permission is verified, then will be in task pool
This task remove, complete this file acquisition task.Above-mentioned file acquisition method manages the file of multiple terminals by task pool
Acquisition task is managed collectively the file acquisition task of terminal, and storage depositing for target user's storage file on the server
Address and corresponding verification information are stored up, allows server according to the difference of target user, obtains storage address and verification information, be
Different channel automatic identification file acquisition modes, improve the efficiency of file acquisition.
In one embodiment, step S208 in above-mentioned file acquisition method receive the corresponding terminal of storage address according to
After the file that file read request returns, it can also include information acquiring step, specifically include:
S302 receives the information acquisition request that service terminal is sent, and target user's mark is carried in information acquisition request
And information category.
Wherein, service terminal is the terminal for needing to obtain corresponding business information from server, can be, but not limited to be various
Personal computer, laptop, smart phone, tablet computer and portable wearable device.Information acquisition request is business
The request of terminal to server request extraction corresponding informance from the file that server obtains, service terminal can by mail or
The modes such as person's message are sent to server.
Target user's mark is the target of the information to be obtained for identification in the information acquisition request of service terminal transmission
The mark of user can be also possible to associated code name of other uniqueness etc. using the title with above-mentioned target user.
Information category is the foundation for the information of target user to be classified, and service terminal can be according to classification needs
A template is set up, and puts it into and sends jointly to server in information acquisition request.
Specifically, server completes the file acquisition task that multiple terminals are sent according to executing the time, and by file acquisition
Task is stored in server local, when server receives the information acquisition request of service terminal transmission, i.e., obtains according to information
Request is taken to return to corresponding information, target user's mark that the information that should be needed comprising service terminal in this information acquisition request belongs to
Know and the information for will acquire corresponds to the information category classified.
S304 identifies the file destination for obtaining target user according to target user.
Specifically, server identifies the position acquisition file destination from storage target user's file, mesh according to target user
Mark file is the file where the corresponding information of information acquisition request.
S306 reads information corresponding with information acquisition request from file destination, and information is returned according to information category
Shelves.
Specifically, after server obtains file destination, corresponding letter is obtained from file destination according to information acquisition request
Breath, the corresponding storage of the information that then will acquire according to information category.The loan limit of such as loan, date of refunding, rate letter
Breath, is filed according to unified template, forms the file or table of classification.
Information after filing is back to service terminal by S308.
Specifically, the information after filing is fed back to terminal in the business for sending information acquisition request by server, completes this
Secondary acquisition of information.
In above-described embodiment, service terminal is allowed to obtain correspondence from the file that server stores by information acquisition request
Information.
In one embodiment step S208 in above-mentioned file acquisition method receive the corresponding terminal of storage address according to
It can also include: by file corresponding with read requests storage to predeterminated position after the file that file read request returns；Then
After generating file read request according to file acquisition task, further includes: checking whether there is and read requests in predeterminated position
Corresponding file, and if it exists, continue to remove file acquisition task from task pool.
Wherein, predeterminated position is obtained according to file acquisition task from other terminals or database for storage server
File position, can be server specified a file or disk.
Specifically, server needs first to check predeterminated position before obtaining corresponding file according to file acquisition task
Corresponding file whether is had existed, if it is present not executing such file acquisition task, is executed this file acquisition task
It is removed from task pool.
In above-described embodiment, since a file acquisition request may be performed more than once, avoided by this step
The file of acquisition is repeatedly obtained, and the wasting of resources is reduced.
In one embodiment, it before the step S202 in above-mentioned file acquisition method obtains current time, can also wrap
It includes: receiving file acquisition task, file acquisition task, which carries, executes the time；File acquisition task is stored according to the time is executed
In task pool.
Specifically, it if when the file acquisition task of subordinate terminal execution in need, does not all execute first, is sent to server
Concentrative implementation；When server receives the file acquisition task of terminal transmission, that is, it is stored in task pool, according to its corresponding execution
Time executes.
In above-described embodiment, the file acquisition task that server receiving terminal is sent, and pass through task pool management.
In one embodiment, the step S208 in above-mentioned file acquisition method sends file read request to storage address
Later, further includes: be that the file acquisition in task pool is appointed when receiving acquisition failed message corresponding with file read request
Business, which is reset, executes the time.
Wherein, obtaining failed message is the file read request that the corresponding terminal of storage address receives server transmission
Afterwards, if the corresponding terminal of storage address is to verification information authentication failed, or not when local search is to corresponding file, to service
The message that device returns.
Specifically, when server receives the acquisition failed message that the corresponding terminal of storage address is sent, that is, this is proved
Secondary file acquisition task execution failure, reason may be the also not upper transmitting file of target user or route error etc., server
A new execution time can be reset for file acquisition task corresponding in task pool, the new execution time is waited to reach
Afterwards, then the corresponding terminal in storage address is gone to obtain a file.
In above-described embodiment, re-executed for the file acquisition task setting of the execution failure new execution time.
In one embodiment, above-mentioned file acquisition method can also include: when the same execution time is for file acquisition
When the quantity of task is more than preset value, then the file acquisition task of preset value quantity is only carried out；It resets and exceeds preset value portion
The file acquisition task corresponding execution time divided.
Wherein, preset value is the threshold value of the quantity of the file acquisition task executed for limiting server in the same time；
It can be the numerical value that technical staff sets according to the bus bearing capacity or server operating rate of server, such as one
It is secondary to execute 50 file acquisition tasks.
Specifically, when the amount for the file acquisition task that same a batch needs to be implemented is excessive, the fortune of server may be will affect
Row, it is therefore desirable to control the file acquisition task amount that each batch is performed simultaneously, the part exceeded can wait next batch to hold again
Row；When server detects that same execution time corresponding file acquisition task is beyond preset value quantity in task pool, then in advance
If the file acquisition task being worth in quantity still executes time execution according to this, the file acquisition task beyond default value part is then weighed
New distribution executes the time.
It is that the quantity setting one of the file acquisition task executed in server in the same time is default in above-described embodiment
Value avoids the problem that server causes system Caton even to paralyse because task execution quantity is excessive.
It should be understood that although each step in the flow chart of Fig. 2 to Fig. 3 is successively shown according to the instruction of arrow,
But these steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly state otherwise herein, these
There is no stringent sequences to limit for the execution of step, these steps can execute in other order.Moreover, Fig. 2 is into Fig. 3
At least part step may include that perhaps these sub-steps of multiple stages or stage are not necessarily same to multiple sub-steps
One moment executed completion, but can execute at different times, and the execution in these sub-steps or stage sequence is also not necessarily
Be successively carry out, but can at least part of the sub-step or stage of other steps or other steps in turn or
Alternately execute.
In one embodiment, as shown in figure 4, providing a kind of file acquisition device, comprising: task timing module 100,
Address acquisition module 200, request generation module 300 and file acquisition module 400, in which:
Task timing module 100, for obtaining current time, when current time reaches file acquisition task pair in task pool
When the execution time answered, file acquisition task, the corresponding target user of identification file acquisition task are obtained from task pool.
Address acquisition module 200, for obtaining corresponding storage address and verification information according to target user.
Generation module 300 is requested, for generating file read request according to file acquisition task.
File acquisition module 400, for sending file read request to the corresponding terminal of storage address, when storage address pair
When the terminal answered is verified verification information, file corresponding with read requests is obtained from the corresponding terminal of storage address, and
File acquisition task is removed from task pool.
In one embodiment, above-mentioned file acquisition device can also include:
Information acquisition request receiving module, for receiving the information acquisition request of service terminal transmission, information acquisition request
In carry target user mark and information category.
File destination obtains module, for identifying the file destination for obtaining target user according to target user.
Information profiling module, for reading corresponding with information acquisition request information from file destination, and by information root
File according to information category.
Information return module, for the information after filing to be back to service terminal.
In one embodiment, can also include: in above-mentioned file acquisition device
Memory module, for storing file corresponding with read requests to predeterminated position.
Iterative testing module, for checking in predeterminated position with the presence or absence of file corresponding with read requests, and if it exists,
Continue to remove file acquisition task from task pool.
In one embodiment, above-mentioned file acquisition device can also include:
Task receiving module, for receiving file acquisition task, file acquisition task, which carries, executes the time.
Enter pond module, for file acquisition task to be stored in task pool according to the time is executed.
In one embodiment, above-mentioned file acquisition device can also include:
Time update module, for when receiving acquisition failed message corresponding with file read request, being task pool
In file acquisition task reset execute the time.
In one embodiment, above-mentioned file acquisition device can also include:
Threshold setting module, for when it is same execution the time for file acquisition task quantity be more than preset value when, then
Only carry out the file acquisition task of preset value quantity.
Excess minutes setting module, when for resetting the corresponding execution of file acquisition task for exceeding default value part
Between.
Specific about file acquisition device limits the restriction that may refer to above for file acquisition method, herein not
It repeats again.Modules in above-mentioned file acquisition device can be realized fully or partially through software, hardware and combinations thereof.On
Stating each module can be embedded in the form of hardware or independently of in the processor in computer equipment, can also store in a software form
In memory in computer equipment, the corresponding operation of the above modules is executed in order to which processor calls.
In one embodiment, a kind of computer equipment is provided, which can be server, internal junction
Composition can be as shown in Figure 5.The computer equipment include by system bus connect processor, memory, network interface and
Database.Wherein, the processor of the computer equipment is for providing calculating and control ability.The memory packet of the computer equipment
Include non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system, computer program and data
Library.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating
The database of machine equipment obtains data for storage file.The network interface of the computer equipment is used to pass through with external terminal
Network connection communication.To realize a kind of file acquisition method when the computer program is executed by processor.
It will be understood by those skilled in the art that structure shown in Fig. 5, only part relevant to application scheme is tied
The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment
It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer equipment, including memory and processor are provided, which is stored with
Computer program, the processor perform the steps of acquisition current time when executing computer program, appoint when current time reaches
Be engaged in file acquisition task corresponding executions time in pond when, file acquisition task, identification file acquisition times are obtained from task pool
Be engaged in corresponding target user；Corresponding storage address and verification information are obtained according to target user；It is raw according to file acquisition task
At file read request；File read request is sent to the corresponding terminal of storage address, when the corresponding terminal of storage address is to testing
When card Information Authentication passes through, file corresponding with read requests is obtained from the corresponding terminal of storage address, and file acquisition is appointed
Business is removed from task pool.
In one embodiment, when processor executes computer program the corresponding terminal of the slave storage address realized obtain with
After the corresponding file of read requests, further includes: receive the information acquisition request that service terminal is sent, taken in information acquisition request
With target user's mark and information category；The file destination for obtaining target user is identified according to target user；From file destination
It is middle to read information corresponding with information acquisition request, and information is filed according to information category；Information after filing is back to
Service terminal.
In one embodiment, when processor executes computer program the corresponding terminal of the slave storage address realized obtain with
After the corresponding file of read requests, further includes: store file corresponding with read requests to predeterminated position；Processor executes
Realized when computer program according to file acquisition task generate file read request after, further includes: check predeterminated position in
With the presence or absence of file corresponding with read requests, and if it exists, continue to remove file acquisition task from task pool.
In one embodiment, before the acquisition current time realized when processor execution computer program, further includes: connect
File acquisition task is received, file acquisition task, which carries, executes the time；File acquisition task is stored in task according to the time is executed
Chi Zhong.
In one embodiment, that realizes when processor execution computer program sends file read request to storage address
Later, further includes: be that the file acquisition in task pool is appointed when receiving acquisition failed message corresponding with file read request
Business, which is reset, executes the time.
In one embodiment, it can also perform the steps of when processor executes computer program when same execution
Between for file acquisition task quantity be more than preset value when, then only carry out the file acquisition task of preset value quantity；Again it sets
The fixed file acquisition task corresponding execution time beyond default value part.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of acquisition current time when being executed by processor, when current time reaches file acquisition in task pool
When task corresponding execution time, file acquisition task is obtained from task pool, the corresponding target of identification file acquisition task is used
Family；Corresponding storage address and verification information are obtained according to target user；File read request is generated according to file acquisition task；
File read request is sent to the corresponding terminal of storage address, when the corresponding terminal of storage address is verified verification information
When, file corresponding with read requests is obtained from the corresponding terminal of storage address, and file acquisition task is removed from task pool.
In one embodiment, the corresponding terminal of the slave storage address realized when computer program is executed by processor obtains
After file corresponding with read requests, further includes: the information acquisition request that service terminal is sent is received, in information acquisition request
Carry target user's mark and information category；The file destination for obtaining target user is identified according to target user；From target text
Information corresponding with information acquisition request is read in part, and information is filed according to information category；Information after filing is returned
To service terminal.
In one embodiment, the corresponding terminal of the slave storage address realized when computer program is executed by processor obtains
After file corresponding with read requests, further includes: store file corresponding with read requests to predeterminated position；Computer journey
After that realizes when sequence is executed by processor generates file read request according to file acquisition task, further includes: check default position
It whether there is file corresponding with read requests in setting, and if it exists, continue to remove file acquisition task from task pool.
In one embodiment, before the acquisition current time realized when computer program is executed by processor, further includes:
File acquisition task is received, file acquisition task, which carries, executes the time；File acquisition task is appointed according to time deposit is executed
It is engaged in pond.
In one embodiment, that realizes when computer program is executed by processor asks to storage address transmission file reading
After asking, further includes: be the file acquisition in task pool when receiving acquisition failed message corresponding with file read request
Task, which is reset, executes the time.
In one embodiment, it can also perform the steps of when computer program is executed by processor when same execution
When time is more than preset value for the quantity of file acquisition task, then the file acquisition task of preset value quantity is only carried out；Again
File acquisition task corresponding execution time of the setting beyond default value part.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
Above embodiments only express the several embodiments of the application, and the description thereof is more specific and detailed, but can not
Therefore it is construed as limiting the scope of the patent.It should be pointed out that for those of ordinary skill in the art,
Under the premise of not departing from the application design, various modifications and improvements can be made, these belong to the protection scope of the application.
Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (10)
1. a kind of file acquisition method, which comprises
Current time is obtained, when the current time reaches file acquisition task corresponding execution time in task pool, from institute
It states and obtains the file acquisition task in task pool, identify the corresponding target user of the file acquisition task；
Corresponding storage address and verification information are obtained according to the target user；
File read request is generated according to the file acquisition task；
The file read request is sent to the corresponding terminal of the storage address, when the corresponding terminal of the storage address is to institute
When stating verification information and being verified, file corresponding with the read requests is obtained from the corresponding terminal of the storage address, and
The file acquisition task is removed from the task pool.
2. the method according to claim 1, wherein described from the corresponding terminal acquisition of the storage address and institute
After stating the corresponding file of read requests, further includes:
The information acquisition request that service terminal is sent is received, target user's mark and information are carried in the information acquisition request
Classification；
The file destination for obtaining the target user is identified according to the target user；
Information corresponding with the information acquisition request is read from the file destination, and by the information according to the information
Classification filing；
The information after filing is back to the service terminal.
3. the method according to claim 1, wherein described from the corresponding terminal acquisition of the storage address and institute
After stating the corresponding file of read requests, further includes:
File corresponding with the read requests is stored to predeterminated position；
Then after the generation file read request according to the file acquisition task, further includes:
It checks in the predeterminated position with the presence or absence of file corresponding with the read requests, and if it exists, continuation is described will be described
File acquisition task is removed from the task pool.
4. the method according to claim 1, wherein before the acquisition current time, further includes:
The file acquisition task is received, the file acquisition task, which carries, executes the time；
The file acquisition task is stored in the task pool according to the time is executed.
5. the method according to claim 1, which is characterized in that described to send institute to the storage address
After stating file read request, further includes:
When receiving acquisition failed message corresponding with the file read request, obtained for the file in the task pool
It takes task to reset and executes the time.
6. the method according to claim 1, which is characterized in that the method also includes:
When the same execution time, the quantity for file acquisition task was more than preset value, then the preset value quantity is only carried out
File acquisition task；
Reset the file acquisition task corresponding execution time for exceeding the default value part.
7. a kind of file acquisition device, which is characterized in that described device includes:
Task timing module is corresponded to for obtaining current time when the current time reaches file acquisition task in task pool
The execution time when, the file acquisition task is obtained from the task pool, identifies the corresponding mesh of the file acquisition task
Mark user；
Address acquisition module, for obtaining corresponding storage address and verification information according to the target user；
Generation module is requested, for generating file read request according to the file acquisition task；
File acquisition module, for sending the file read request to the corresponding terminal of the storage address, when the storage
When the corresponding terminal in address is verified the verification information, obtained and the reading from the corresponding terminal of the storage address
Corresponding file is requested, and the file acquisition task is removed from the task pool.
8. device according to claim 7, which is characterized in that described device further include:
Information acquisition request receiving module, for receiving the information acquisition request of service terminal transmission, the information acquisition request
In carry target user mark and information category；
File destination obtains module, for identifying the file destination for obtaining the target user according to the target user；
Information profiling module, for reading corresponding with information acquisition request information from the file destination, and by institute
Information is stated to be filed according to the information category；
Information return module, for the information after filing to be back to the service terminal.
9. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists
In the step of processor realizes any one of claims 1 to 6 the method when executing the computer program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 6 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811553802.XA CN109766316A (en) | 2018-12-18 | 2018-12-18 | File acquisition method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811553802.XA CN109766316A (en) | 2018-12-18 | 2018-12-18 | File acquisition method, device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109766316A true CN109766316A (en) | 2019-05-17 |
Family
ID=66451536
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811553802.XA Pending CN109766316A (en) | 2018-12-18 | 2018-12-18 | File acquisition method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109766316A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110515712A (en) * | 2019-08-09 | 2019-11-29 | 精硕科技（北京）股份有限公司 | Task management method and computer storage medium |
| CN113254389A (en) * | 2021-06-07 | 2021-08-13 | 深圳华云信息系统有限公司 | Data processing method and device based on FPGA, electronic equipment and storage medium |
| CN114662074A (en) * | 2022-05-24 | 2022-06-24 | 国网浙江省电力有限公司 | Data processing method and central station for paperless electronic file |
| CN115186854A (en) * | 2022-09-07 | 2022-10-14 | 艾斯特国际安全技术（深圳）有限公司 | Certificate acquisition control method, device and system and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CH354282A (en) * | 1955-01-27 | 1961-05-15 | Emi Ltd | Data processing facility |
| CN101119283A (en) * | 2006-07-31 | 2008-02-06 | 北京华旗资讯数码科技有限公司 | System and method for obtaining network information using electronic device |
| CN104408068A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Report form data processing method and related equipment |
| CN106254467A (en) * | 2016-08-05 | 2016-12-21 | 北京小米移动软件有限公司 | Sharing files method and device |
| CN107612842A (en) * | 2017-09-07 | 2018-01-19 | 携程商旅信息服务（上海）有限公司 | Collecting method, system, equipment and storage medium based on token management |
| CN107818407A (en) * | 2017-10-20 | 2018-03-20 | 平安科技（深圳）有限公司 | Method for allocating tasks, device, storage medium and computer equipment |
| CN108733811A (en) * | 2018-05-21 | 2018-11-02 | 努比亚技术有限公司 | A kind of file access method, terminal and computer readable storage medium |
| CN108810894A (en) * | 2018-05-31 | 2018-11-13 | 康键信息技术（深圳）有限公司 | Authorization terminal method, apparatus, computer equipment and storage medium |
| CN108833497A (en) * | 2018-05-25 | 2018-11-16 | 徐工集团工程机械有限公司 | Distributed post method and system, user terminal, server and distribution apparatus |
| US20210086089A1 (en) * | 2019-09-25 | 2021-03-25 | Nvidia Corporation | Player analysis using one or more neural networks |
-
2018
- 2018-12-18 CN CN201811553802.XA patent/CN109766316A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CH354282A (en) * | 1955-01-27 | 1961-05-15 | Emi Ltd | Data processing facility |
| CN101119283A (en) * | 2006-07-31 | 2008-02-06 | 北京华旗资讯数码科技有限公司 | System and method for obtaining network information using electronic device |
| CN104408068A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Report form data processing method and related equipment |
| CN106254467A (en) * | 2016-08-05 | 2016-12-21 | 北京小米移动软件有限公司 | Sharing files method and device |
| CN107612842A (en) * | 2017-09-07 | 2018-01-19 | 携程商旅信息服务（上海）有限公司 | Collecting method, system, equipment and storage medium based on token management |
| CN107818407A (en) * | 2017-10-20 | 2018-03-20 | 平安科技（深圳）有限公司 | Method for allocating tasks, device, storage medium and computer equipment |
| CN108733811A (en) * | 2018-05-21 | 2018-11-02 | 努比亚技术有限公司 | A kind of file access method, terminal and computer readable storage medium |
| CN108833497A (en) * | 2018-05-25 | 2018-11-16 | 徐工集团工程机械有限公司 | Distributed post method and system, user terminal, server and distribution apparatus |
| CN108810894A (en) * | 2018-05-31 | 2018-11-13 | 康键信息技术（深圳）有限公司 | Authorization terminal method, apparatus, computer equipment and storage medium |
| US20210086089A1 (en) * | 2019-09-25 | 2021-03-25 | Nvidia Corporation | Player analysis using one or more neural networks |
Non-Patent Citations (2)
| Title |
|---|
| WU, H (WU, HAO) [1] ; ZHAO, JS (ZHAO, JINSONG) [1] , [2]: "Deep convolutional neural network model based chemical process fault diagnosis", COMPUTERS & CHEMICAL ENGINEERING, vol. 115, pages 185 - 197, XP085406050, DOI: 10.1016/j.compchemeng.2018.04.009 * |
| 王丽娟;蔡晓东;王迪;赵勤鲁;: "基于集中式管理的缓存优化方案", 电视技术, no. 05, pages 101 - 104 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110515712A (en) * | 2019-08-09 | 2019-11-29 | 精硕科技（北京）股份有限公司 | Task management method and computer storage medium |
| CN113254389A (en) * | 2021-06-07 | 2021-08-13 | 深圳华云信息系统有限公司 | Data processing method and device based on FPGA, electronic equipment and storage medium |
| CN113254389B (en) * | 2021-06-07 | 2021-10-29 | 深圳华云信息系统有限公司 | Data processing method and device based on FPGA, electronic equipment and storage medium |
| CN114662074A (en) * | 2022-05-24 | 2022-06-24 | 国网浙江省电力有限公司 | Data processing method and central station for paperless electronic file |
| CN114662074B (en) * | 2022-05-24 | 2022-08-16 | 国网浙江省电力有限公司 | Data processing method and central station for paperless electronic file |
| CN115186854A (en) * | 2022-09-07 | 2022-10-14 | 艾斯特国际安全技术（深圳）有限公司 | Certificate acquisition control method, device and system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109766316A (en) | File acquisition method, device, computer equipment and storage medium | |
| CN109474578B (en) | Message checking method, device, computer equipment and storage medium | |
| CN108595157B (en) | Block chain data processing method, device, equipment and storage medium | |
| CN108573371A (en) | The data measures and procedures for the examination and approval, device, computer equipment and storage medium | |
| CN111181975B (en) | Account management method, device, equipment and storage medium | |
| JP6209626B2 (en) | Data scraping system, method and computer program | |
| KR101876674B1 (en) | Method of managing common account using block chain and system performing the same | |
| WO2020000720A1 (en) | Server, packet processing method, program, and computer-readable storage medium | |
| CN110008665B (en) | Authority control method and device for blockchain | |
| CN110532025B (en) | Data processing method, device and equipment based on micro-service architecture and storage medium | |
| CN110209681A (en) | Block chain data enter chain method, apparatus, computer equipment and storage medium | |
| CN108280761A (en) | Increase letter side's distribution method, device, computer equipment and storage medium | |
| CN108492005A (en) | Project data processing method, device, computer equipment and storage medium | |
| CN109492856A (en) | Service request processing method, device, computer equipment and storage medium | |
| CN110677453A (en) | ZooKeeper-based distributed lock service implementation method, device, equipment and storage medium | |
| CN109816364A (en) | Transaction data processing method, device, computer equipment and storage medium | |
| CN112288400A (en) | Multi-system data interaction method and device, computer equipment and storage medium | |
| CN111488626A (en) | Data processing method, device, equipment and medium based on block chain | |
| CN113326165A (en) | Data processing method and device based on block chain and computer readable storage medium | |
| CN109358874A (en) | Business rule update method, device, computer equipment and storage medium | |
| CN111260253A (en) | Information sending method and device, computer equipment and storage medium | |
| CN111813418A (en) | Distributed link tracking method, device, computer equipment and storage medium | |
| CN111260475A (en) | Data processing method, block chain node point equipment and storage medium | |
| CN111209061A (en) | Method and device for filling in user information, computer equipment and storage medium | |
| WO2020233310A1 (en) | Asynchronous compensation method and apparatus for real-time processing data, device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |