CN112115105A - Service processing method, device and equipment - Google Patents
Service processing method, device and equipment Download PDFInfo
- Publication number
- CN112115105A CN112115105A CN202011042760.0A CN202011042760A CN112115105A CN 112115105 A CN112115105 A CN 112115105A CN 202011042760 A CN202011042760 A CN 202011042760A CN 112115105 A CN112115105 A CN 112115105A
- Authority
- CN
- China
- Prior art keywords
- file
- target file
- configuration parameters
- task configuration
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title abstract description 14
- 238000012545 processing Methods 0.000 claims abstract description 57
- 238000000034 method Methods 0.000 claims abstract description 49
- 238000004590 computer program Methods 0.000 claims description 6
- 238000012986 modification Methods 0.000 claims description 6
- 230000004048 modification Effects 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 3
- 238000009795 derivation Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 25
- 230000006872 improvement Effects 0.000 description 8
- 230000002159 abnormal effect Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the specification provides a service processing method, a service processing device and service processing equipment. The method comprises the following steps: receiving a service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path; constructing task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set; acquiring a target file from the file storage set based on the task configuration parameters; exporting the target file through the export path. The method sets corresponding task configuration parameters according to the specific information of the exported files, ensures that the process of exporting the target files is matched with the requirements of the business, avoids exporting redundant files or redundant data, further efficiently and accurately realizes the batch export of the files and improves the efficiency of business processing.
Description
Technical Field
The embodiment of the specification relates to the technical field of computers, in particular to a service processing method, a service processing device and service processing equipment.
Background
With the development of information technology, people can more and more utilize a batch processing mode to quickly process various services for a larger service. For example, when statistical data is needed, the data or the file can be exported from the database or the file storage system by using a batch derivative mode through corresponding conditions so as to process or process the data. Under the condition of large data volume, the data processing speed is accelerated, and the execution of the service is facilitated.
At present, when data or files are exported in batches, the same script is often used for searching and importing the data or files. However, under different requirements, the export of data or files may have a certain difference, and when the omission of the troop data or files is ensured, the export of files by using the same script causes the exported data to contain certain redundant data or redundant files. Therefore, not only is extra resources consumed in the process of acquiring data or files, but also users or other devices receiving files cannot effectively utilize exported files, thereby affecting the normal execution of services. Therefore, a way to export files in batches efficiently and accurately is needed.
Disclosure of Invention
An embodiment of the present specification aims to provide a method, an apparatus, and a device for processing a service, so as to solve a problem of how to efficiently and accurately export files in batches.
To solve the foregoing technical problem, an embodiment of this specification provides a service processing method, including:
receiving a service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path;
constructing task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set;
acquiring a target file from the file storage set based on the task configuration parameters;
exporting the target file through the export path.
An embodiment of this specification further provides a service processing apparatus, including:
the service receiving module to be processed is used for receiving the service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path;
the task configuration parameter construction module is used for constructing task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set;
the target file acquisition module is used for acquiring a target file from the file storage set based on the task configuration parameters;
and the target file exporting module is used for exporting the target file through the exporting path.
The embodiment of the present specification further provides a service processing device, which includes a memory and a processor;
the memory to store computer program instructions;
the processor to execute the computer program instructions to implement the steps of: receiving a service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path; constructing task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set; acquiring a target file from the file storage set based on the task configuration parameters; exporting the target file through the export path.
As can be seen from the technical solutions provided in the embodiments of the present specification, after receiving a to-be-processed service for exporting a target file, the embodiments of the present specification construct corresponding task configuration parameters based on target file information included in the to-be-processed service, so that a manner of exporting a file from a file storage set can be defined, and in a subsequent operation process, a corresponding target file can be directly obtained through the task configuration parameters, and the target file is exported through an export path. According to the business processing method, in the process of exporting the files, the corresponding task configuration parameters are set according to the specific information of the exported files, the process of exporting the target files is matched with the business requirements, the export of redundant files or redundant data is avoided, the batch export of the files is efficiently and accurately realized, and the business processing efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the specification, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of a service processing method according to an embodiment of the present disclosure;
fig. 2 is a block diagram of a service processing apparatus according to an embodiment of the present disclosure;
fig. 3 is a block diagram of a service processing device according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present specification without any creative effort shall fall within the protection scope of the present specification.
In order to solve the above technical problem, an embodiment of the present specification provides a service processing method. The execution main body of the service processing method is service processing equipment, and the service processing equipment comprises equipment such as a server, an industrial personal computer and a PC (personal computer). As shown in fig. 1, the service processing method may include the following specific implementation steps.
S110: receiving a service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path.
And the service processing equipment starts to execute corresponding file export work by receiving the service to be processed. The service to be processed is a service requesting the service processing device to export at least one target file.
The service to be processed may be sent by a user directly through a client, or may be generated by a server, a client and other devices according to a certain program logic based on a preset instruction, and sent to the service processing device. In practical application, the generation and sending modes of the to-be-processed service are not limited, and are not described herein again.
The target file is the file exported by the service request to be processed. The target file may include data corresponding to each index, or may include other specific data. The content contained in the specific target file can be set according to the requirements of actual application. The format of the target file is also not limited, and is not described herein again.
In some embodiments, the service to be processed is a service for exporting files in batches, that is, the service processing device exports a plurality of target files in batches after receiving the service to be processed. Accordingly, the business processing device can export a plurality of target files.
The service to be processed may include target file information and an export path of the target file.
The target file information may include a task name, a task type, a corresponding task service, a task identifier, a file format description, a default field list, and the like. The task name may be a name of a task executed this time, the task type may correspond to a preset task type, the task service may be specific service content executed by the task, the task identifier may correspond to an identifier of each type of file in the file storage combination, the file format description may describe a data format in the file, for example, an integer type, a floating point type, or a type defined for specific data such as funds, and the default field list may be used to represent a field and a list stored in the data to be exported in a default condition, so as to accelerate the search progress. In practical application, the task information may also be set as other information according to requirements, and is not limited to the above example, and is not described herein again.
Since the target task information may only correspond to information of a file itself that needs to be exported and cannot be used for directly searching a corresponding file, the target file information may also be adjusted in a subsequent step to export the target file.
The export path is used to limit the target location for exporting the target file, and the export path may correspond to different devices or different storage paths on the same device. The file receiver can better utilize the target file by setting the export path.
S120: constructing task configuration parameters according to the target file information; the task configuration parameters are used to define a manner in which files corresponding to the target file information are derived from a file storage set.
After the target file information is obtained, corresponding task configuration parameters can be constructed according to the target file information. The task configuration parameters are used for defining a mode of exporting the files corresponding to the target file information from the file storage set, namely, the export of the corresponding target files can be conveniently and quickly realized according to the task configuration parameters.
In some embodiments, the task configuration parameters may include a task name, a target data table name, a start business date, a subtask identification, a file splitting threshold, a data batch submission threshold, a file common path, a backup file common path, and the like.
The task name may be a name corresponding to a task when the target file is exported, and the task name may be the same as or different from the task name in the target file information, which is not limited thereto. The target data table name may be an identifier of a data table storing data corresponding to the target file, so that the target data table name can be located in the data table to realize export of the file. The initial service date may be the setup time of the corresponding target file, so that the target file can be quickly searched based on the service date. The subtask identifier may be an identifier corresponding to each subtask when the task of the export file is divided into a plurality of subtasks to be executed, respectively. The file split threshold may be a maximum value defined for the size of a single export file in the event that the export file is too large and needs to be split. The data batch commit threshold may be a maximum batch value for a single commit of data. The file general path may be a general export path from which the file is exported, and in the case where the export path is not particularly limited, the target file may be exported based on the general export path, and the backup file general path may be a file export path applied in the case where the file general path is unavailable. In practical applications, other types of parameters may be set in the task configuration parameters according to requirements, and are not limited to the above examples, and are not described herein again.
In some embodiments, after receiving the pending task, a file storage device identifier may be obtained from the target file information. The file storage device identification may be used to identify a device on which the target file is stored. The service processing device may obtain a current device identifier of itself, and determine whether the file storage device identifier matches the current device identifier.
Correspondingly, under the condition that the file storage device identification is matched with the current device identification, task configuration parameters are constructed according to the target file information.
If the file storage device identifier is found to be not matched with the current device identifier by comparing the file storage device identifier with the current device identifier, it indicates that the file storage device cannot acquire the corresponding target file from the file storage system corresponding to the file storage device. In this case, corresponding export failure information may be fed back to indicate that the service processing device cannot export the target file successfully. Correspondingly, the export failure information may include a specific export failure reason, so that the corresponding client or server adjusts the instruction for obtaining the target file.
S130: and acquiring a target file from the file storage set based on the task configuration parameters.
After the task configuration parameters are generated, the corresponding target files can be obtained from the file storage set according to the task configuration parameters.
A file storage collection may be a collection in which various types of files are stored. The file storage set may be a storage system, a database, or the like of the service processing device, or may be a file storage set corresponding to a file storage system corresponding to a plurality of devices. The file storage set stores data or files corresponding to the target files.
Since the task configuration parameters are used to define the way of deriving the file corresponding to the target file information from the file storage set, the corresponding target file can be directly obtained from the file storage set based on the task configuration parameters.
In some embodiments, the task configuration parameters include an identification of a target file. The target file identifier is used for limiting the identifier corresponding to the exported target file, so that the corresponding target file can be matched in the file storage set directly according to the target file identifier. Specifically, a file corresponding to the target file identifier may be matched in the file storage set as a target file.
In some embodiments, during the process of exporting the target file, the execution process may be interrupted due to program failure, version upgrade, or file write error. In order to avoid a situation where the export file is restarted due to an interruption of the file export process, the transmission of the file may be restarted from the breakpoint of the export file in the described embodiment.
Specifically, in the process of exporting the file, the task processing log may be obtained. The task processing log may be recorded with history export information, and the history export information may be used to record identification information of a file that has been exported currently. When exporting the file, the service processing device may compare the task configuration parameters with the historical export information, so as to determine whether a parameter corresponding to the historical export information exists in the task configuration parameters. In the case of an abnormal interruption, the history export parameter may record a target file exported before the target file acquisition process is terminated.
Accordingly, in a subsequent process of retrieving a target file, the target file may be retrieved from the file storage set based on the historical export information. Namely, the position of the abnormal interruption is determined according to the history derived information, and the fixed point retransmission is realized from the position.
By determining the position of the abnormal interruption in the file transmission process according to the history derived information, the breakpoint retransmission can be realized from the interruption position when the abnormal interruption is derived from the file, so that the extra workload generated in the unexpected situation is reduced, and the waste of time and resources is avoided.
In order to avoid interference of files exported at different moments on the judgment process, in actual application, historical export information within a certain time range can be compared with task configuration parameters, so that the accuracy of the judgment process is improved.
In some embodiments, at least two processing submodules are included in the business processing device when exporting the corresponding target file. The processing sub-modules can respectively execute the tasks of exporting the files, thereby realizing the effect of parallel processing of the corresponding tasks.
Specifically, the task configuration parameters may be divided into task configuration sub-parameters corresponding to the processing sub-modules, and the processing sub-modules may be used to obtain the target file through the corresponding task configuration sub-parameters.
The task configuration sub-parameters may be divided according to the types of the task configuration parameters, so as to obtain the task configuration sub-parameters corresponding to different properties. Correspondingly, the task processing sub-module may also have an ability to export different types of target files, and may export the corresponding target files based on different types of task configuration sub-parameters.
The task configuration sub-parameters can also be directly divided according to the number of the task configuration parameters, so that the divided task configuration sub-parameters have no obvious difference, and then the processing sub-modules respectively utilize the corresponding task configuration sub-parameters to execute the tasks, thereby realizing the high-efficiency export of the target file.
In some embodiments, a candidate file is first obtained from the file storage set based on the task configuration parameters, and the candidate file may be a file directly corresponding to the task configuration parameters, without limitation in other respects. However, in some cases, when a file is too large, part of the system may not support large file import, or may consume too much time and resources in exporting a large file. Thus, large files may be split into small file exports.
Specifically, it may be determined whether the size of the candidate file is greater than a file size threshold. The file size threshold defines the maximum amount of data for the file. Splitting the candidate file into at least two split files based on the file size threshold if the size of the candidate file is greater than a file size threshold. In the subsequent file export process, the split file can be directly exported, so that the export of the large file is realized.
And under the condition that the size of the candidate file is not larger than the file size threshold, because the candidate file does not accord with the condition of a large file, the candidate file can be directly exported through the export path.
In some embodiments, before exporting the target file through the export path, the target file may be further subjected to a deduplication process. Because the obtained target files may have repeated files or the target files also contain obvious repeated data, when the receiver receives the target files, the processing of the redundant files may consume additional unnecessary resources, thereby affecting the processing process, therefore, before exporting the files, the target files can be subjected to deduplication processing, and the deduplicated target files are exported, thereby avoiding additional consumption of resources and time.
The specific method for removing duplicate of the target file may be set according to the requirements of the actual application, and is not described herein again.
S140: exporting the target file through the export path.
After the target file is obtained, the target file can be exported according to an export path. The specific derivation manner can be set according to the requirements of the actual application, and is not described herein again.
In some embodiments, the target file information may include a file identifier and a file modification date. And when constructing the export path, the export path may be preset into a path form associated with the file identification and the file modification date. Therefore, the business processing equipment can directly construct a corresponding export path according to the file identification and the file modification date contained in the target file information, so that the file is exported through the export path, the exported target file is easy to find, and the efficiency of file retrieval is improved.
As can be seen from the introduction in the above embodiments, after receiving a to-be-processed service for exporting a target file, the service processing method constructs a corresponding task configuration parameter based on target file information included in the to-be-processed service, so that a manner of exporting files from a file storage set can be defined, and in a subsequent operation process, a corresponding target file can be directly obtained through the task configuration parameter, and the target file is exported through an export path. According to the business processing method, in the process of exporting the files, the corresponding task configuration parameters are set according to the specific information of the exported files, the process of exporting the target files is matched with the business requirements, the export of redundant files or redundant data is avoided, the batch export of the files is efficiently and accurately realized, and the business processing efficiency is improved.
A service processing apparatus according to an embodiment of the present description is introduced based on a service processing method corresponding to fig. 1. The service processing device may be disposed in the service processing apparatus. As shown in fig. 2, the service processing apparatus includes the following modules.
A pending service receiving module 210, configured to receive a pending service; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path;
the task configuration parameter construction module 220 is configured to construct task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set;
a target file obtaining module 230, configured to obtain a target file from the file storage set based on the task configuration parameter;
and a target file export module 240, configured to export the target file through the export path.
Based on the service processing method corresponding to fig. 1, an embodiment of the present specification provides a service processing device. As shown in fig. 3, the traffic processing device may include a memory and a processor.
In this embodiment, the memory may be implemented in any suitable manner. For example, the memory may be a read-only memory, a mechanical hard disk, a solid state disk, a U disk, or the like. The memory may be used to store computer program instructions.
In this embodiment, the processor may be implemented in any suitable manner. For example, the processor may take the form of, for example, a microprocessor or processor and a computer-readable medium that stores computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, an embedded microcontroller, and so forth. The processor may execute the computer program instructions to perform the steps of: receiving a service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path; constructing task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set; acquiring a target file from the file storage set based on the task configuration parameters; exporting the target file through the export path.
In the 90 s of the 20 th century, improvements in a technology could clearly distinguish between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate application-specific integrated circuit chips. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Hardware Description Language), traffic, pl (core universal Programming Language), HDCal (jhdware Description Language), lang, Lola, HDL, laspam, hardward Description Language (vhr Description Language), vhal (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
From the above description of the embodiments, it is clear to those skilled in the art that the present specification can be implemented by software plus the necessary first hardware platform. Based on such understanding, the technical solutions of the present specification may be essentially or partially implemented in the form of software products, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and include instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments of the present specification.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The description is operational with numerous first or special purpose computing system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
This description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
While the specification has been described with examples, those skilled in the art will appreciate that there are numerous variations and permutations of the specification that do not depart from the spirit of the specification, and it is intended that the appended claims include such variations and modifications that do not depart from the spirit of the specification.
Claims (15)
1. A method for processing a service, comprising:
receiving a service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path;
constructing task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set;
acquiring a target file from the file storage set based on the task configuration parameters;
exporting the target file through the export path.
2. The method of claim 1, wherein the target file information comprises at least one of a task name, a task type, a corresponding task service, a task identification, a file format description, a list of default value fields.
3. The method of claim 1, wherein the task configuration parameters include at least one of a task name, a target data table name, a start business date, a subtask identification, a file split threshold, a file batch commit threshold, a file common path, a backup file common path.
4. The method of claim 1, wherein the task configuration parameters include a target file identification; the obtaining of the target file from the file storage set based on the task configuration parameters includes:
and matching a file corresponding to the target file identifier in the file storage set to serve as a target file.
5. The method of claim 1, wherein the target file information includes a file storage device identification; after receiving the service to be processed, the method further includes:
judging whether the file storage device identification is matched with the current device identification;
correspondingly, the constructing of the task configuration parameters according to the target file information includes:
and under the condition that the file storage device identification is matched with the current device identification, constructing task configuration parameters according to the target file information.
6. The method of claim 5, wherein after determining whether the file storage device identification matches the current device identification, further comprising:
and feeding back export failure information under the condition that the file storage device identification is not matched with the current device identification.
7. The method of claim 1, wherein the retrieving a target file from the file storage set based on the task configuration parameters comprises:
acquiring a task processing log; history export information is recorded in the task processing log;
judging whether task configuration parameters corresponding to the historical derivation information exist or not;
and if so, acquiring the target file from the file storage set based on the historical export information.
8. The method of claim 7, wherein the retrieving a target file from the file storage set based on the task configuration parameters comprises:
and after a target file is acquired from the file storage set, recording a target file identifier corresponding to the target file as historical export information to a task processing log.
9. The method of claim 1, wherein the task configuration parameters correspond to at least two processing sub-modules; the obtaining of the target file from the file storage set based on the task configuration parameters includes:
dividing the task configuration parameters into task configuration sub-parameters corresponding to the processing sub-modules;
and acquiring a target file by using the processing sub-module through the corresponding task configuration sub-parameters.
10. The method of claim 1, wherein the retrieving a target file from the file storage set based on the task configuration parameters comprises:
acquiring a candidate file from the file storage set based on the task configuration parameters;
splitting the candidate file into at least two split files based on the file size threshold if the size of the candidate file is greater than a file size threshold;
correspondingly, the exporting the target file through the export path includes:
exporting the split file through the export path.
11. The method of claim 10, wherein after retrieving candidate files from the file storage set based on the task configuration parameters, further comprising:
exporting the candidate file through the export path if the size of the candidate file is not greater than a file size threshold.
12. The method of claim 1, wherein prior to exporting the target file via the export path, further comprising:
carrying out duplicate removal processing on the target file;
correspondingly, the exporting the target file through the export path includes:
exporting the target file after the de-duplication processing through the export path.
13. The method of claim 1, wherein the target file information includes a file identification and a file modification date; the export path is a path constructed based on the file identification and the file modification date.
14. A traffic processing apparatus, comprising:
the service receiving module to be processed is used for receiving the service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path;
the task configuration parameter construction module is used for constructing task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set;
the target file acquisition module is used for acquiring a target file from the file storage set based on the task configuration parameters;
and the target file exporting module is used for exporting the target file through the exporting path.
15. A traffic processing device comprising a memory and a processor;
the memory to store computer program instructions;
the processor to execute the computer program instructions to implement the steps of: receiving a service to be processed; the service to be processed is used for requesting to export at least one target file; the service to be processed comprises target file information corresponding to the target file and a exporting path; constructing task configuration parameters according to the target file information; the task configuration parameters are used for defining a mode of deriving files corresponding to the target file information from a file storage set; acquiring a target file from the file storage set based on the task configuration parameters; exporting the target file through the export path.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011042760.0A CN112115105A (en) | 2020-09-28 | 2020-09-28 | Service processing method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011042760.0A CN112115105A (en) | 2020-09-28 | 2020-09-28 | Service processing method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112115105A true CN112115105A (en) | 2020-12-22 |
Family
ID=73797304
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011042760.0A Pending CN112115105A (en) | 2020-09-28 | 2020-09-28 | Service processing method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112115105A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113114757A (en) * | 2021-04-09 | 2021-07-13 | 中国工商银行股份有限公司 | File transmission method, device and equipment |
| CN113516558A (en) * | 2021-04-26 | 2021-10-19 | 中国工商银行股份有限公司 | Service processing method, device and equipment |
| CN114124542A (en) * | 2021-11-25 | 2022-03-01 | 合芯科技(苏州)有限公司 | Method for exporting confidential data to shared security area after approval of research and development network |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107577420A (en) * | 2017-07-26 | 2018-01-12 | 阿里巴巴集团控股有限公司 | Document handling method and device, server |
| CN110795387A (en) * | 2019-09-26 | 2020-02-14 | 广州市玄武无线科技股份有限公司 | Data import method, data export device and data processing system |
| CN110888842A (en) * | 2019-12-02 | 2020-03-17 | 中国银行股份有限公司 | File storage method, file query method, file storage device, file query device and file query equipment |
| WO2020155760A1 (en) * | 2019-01-28 | 2020-08-06 | 平安科技（深圳）有限公司 | Multi-database data processing method, apparatus, computer device, and storage medium |
-
2020
- 2020-09-28 CN CN202011042760.0A patent/CN112115105A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107577420A (en) * | 2017-07-26 | 2018-01-12 | 阿里巴巴集团控股有限公司 | Document handling method and device, server |
| WO2020155760A1 (en) * | 2019-01-28 | 2020-08-06 | 平安科技（深圳）有限公司 | Multi-database data processing method, apparatus, computer device, and storage medium |
| CN110795387A (en) * | 2019-09-26 | 2020-02-14 | 广州市玄武无线科技股份有限公司 | Data import method, data export device and data processing system |
| CN110888842A (en) * | 2019-12-02 | 2020-03-17 | 中国银行股份有限公司 | File storage method, file query method, file storage device, file query device and file query equipment |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113114757A (en) * | 2021-04-09 | 2021-07-13 | 中国工商银行股份有限公司 | File transmission method, device and equipment |
| CN113114757B (en) * | 2021-04-09 | 2022-09-30 | 中国工商银行股份有限公司 | File transmission method, device and equipment |
| CN113516558A (en) * | 2021-04-26 | 2021-10-19 | 中国工商银行股份有限公司 | Service processing method, device and equipment |
| CN114124542A (en) * | 2021-11-25 | 2022-03-01 | 合芯科技(苏州)有限公司 | Method for exporting confidential data to shared security area after approval of research and development network |
| CN114124542B (en) * | 2021-11-25 | 2024-03-15 | 合芯科技(苏州)有限公司 | Method for exporting confidential data to shared security area after approval by research and development network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112115105A (en) | Service processing method, device and equipment | |
| CN109409121B (en) | Desensitization processing method and device and server | |
| US11544137B2 (en) | Data processing platform monitoring | |
| US10452376B2 (en) | Method for identifying file and mobile terminal | |
| US8126859B2 (en) | Updating a local version of a file based on a rule | |
| US20060294049A1 (en) | Back-off mechanism for search | |
| EP2783310A1 (en) | Image searching | |
| CN108536745B (en) | Shell-based data table extraction method, terminal, equipment and storage medium | |
| CN110688096B (en) | Method and device for constructing application program containing plug-in, medium and electronic equipment | |
| CN110618999A (en) | Data query method and device, computer storage medium and electronic equipment | |
| CN111767320A (en) | Data blood relationship determination method and device | |
| WO2019161618A1 (en) | Character string parsing method, apparatus and device, and computer-readable storage medium | |
| CN110222046B (en) | List data processing method, device, server and storage medium | |
| US9785724B2 (en) | Secondary queue for index process | |
| CN110990179B (en) | Task processing method, device and equipment | |
| CN111143461A (en) | Mapping relation processing system and method and electronic equipment | |
| CN111767126A (en) | System and method for distributed batch processing | |
| CN110727565B (en) | Network equipment platform information collection method and system | |
| US9659041B2 (en) | Model for capturing audit trail data with reduced probability of loss of critical data | |
| CN113722321A (en) | Data export method and device and electronic equipment | |
| CN114461762A (en) | Archive change identification method, device, equipment and storage medium | |
| CN114064712A (en) | Data access method and device, electronic equipment and computer readable storage medium | |
| CN113342270A (en) | Volume unloading method and device and electronic equipment | |
| CN107451050B (en) | Function acquisition method and device and server | |
| CN112184027A (en) | Task progress updating method and device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |