CN114461582A

CN114461582A - File processing method, device, equipment and storage medium

Info

Publication number: CN114461582A
Application number: CN202210010156.2A
Authority: CN
Inventors: 曹建锋
Original assignee: CITIC Aibank Corp Ltd
Current assignee: CITIC Aibank Corp Ltd
Priority date: 2022-01-06
Filing date: 2022-01-06
Publication date: 2022-05-10

Abstract

The disclosure provides a file processing method, a file processing device, an electronic device and a storage medium. Transmitting a source file from a source node to a target node by obtaining a transmission request; determining a transmission path from the source node to the target node according to the transmission request; determining a file processing strategy according to the transmission path; processing the source file according to the file processing strategy to obtain a target file; sending the target file to the target node; therefore, the file processing of the file transmitted between the source node and the target node is realized, and the adaptation complexity of the file transmission process to the service systems of different nodes is reduced.

Description

File processing method, device, equipment and storage medium

Technical Field

The present disclosure relates to file processing technologies, and in particular, to a file processing method, apparatus, device, and storage medium.

Background

With the development of the current information technology, the business processing requirements between the bank and the cooperative enterprises are increasingly complex, and a large amount of file transmission business is involved.

In an actual business scene, a transmission mode of pulling or pushing files stored in a file server of a bank cannot completely match file management requirements of an opposite side when different business systems of different cooperative enterprises are aimed at, and the business systems need to be cooperatively transformed, so that the complexity of file processing is increased, the workload is large, and the cost is high.

Disclosure of Invention

The embodiment of the disclosure provides a file processing method, a file processing device, file processing equipment and a storage medium.

In a first aspect, the present disclosure provides a file processing method, including:

acquiring a transmission request for transmitting a source file from a source node to a target node;

determining a transmission path from the source node to the target node according to the transmission request;

determining a file processing strategy according to the transmission path;

processing the source file according to the file processing strategy to obtain a target file;

and sending the target file to the target node.

In some optional embodiments, the determining a transmission path from the source node to the target node according to the transmission request includes:

determining a corresponding preset transmission channel according to the source node and the target node;

and determining the transmission path according to the source node, the target node and the preset transmission channel.

In some optional embodiments, the determining a file processing policy according to the transmission path includes:

and determining the file processing strategy corresponding to the transmission path in a preset file processing strategy set.

In some optional embodiments, the file processing policy includes:

and preprocessing and/or post-processing the source file.

In some optional embodiments, the file processing policy further includes:

preprocessing steps in the preprocessing and the execution sequence of the preprocessing steps;

and performing post-processing steps in the post-processing and the execution sequence of the post-processing steps.

In some alternative embodiments, the pre-treating step comprises at least one of:

checking the file and generating a temporary file;

the post-treatment step comprises at least one of:

decompressing, decrypting, renaming the file and generating an OK file.

In some optional embodiments, the transmission request comprises:

a pull request or a push request.

In a second aspect, the present disclosure provides a document processing apparatus comprising:

a control unit configured to acquire a transmission request for transmitting a source file from a source node to a destination node;

a determining unit configured to determine a transmission path from the source node to the target node according to the transmission request, and determine a file processing policy according to the transmission path;

the processing unit is configured to process the source file according to the file processing strategy to obtain a target file;

a sending unit configured to send the target file to the target node.

In some optional embodiments, the determining unit is specifically configured to:

In some optional embodiments, the file processing policy includes:

and preprocessing and/or post-processing the source file.

In some optional embodiments, the file processing policy further includes:

checking the file and generating a temporary file;

the post-treatment step comprises at least one of:

decompressing, decrypting, renaming the file and generating an OK file.

In some optional embodiments, the transmission request comprises:

a pull request or a push request.

In a third aspect, the present disclosure provides an electronic device comprising:

one or more processors;

storage means having one or more programs stored thereon which, when executed by the one or more processors, cause the one or more processors to implement a method as claimed in any one of the embodiments of the first aspect.

In a fourth aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by one or more processors, implements the method according to any one of the embodiments of the first aspect.

According to the file processing method, the file processing device, the electronic equipment and the storage medium, a transmission request for transmitting a source file from a source node to a target node is obtained; determining a transmission path from a source node to a target node according to the transmission request; determining a file processing strategy according to the transmission path; processing the source file according to the file processing strategy to obtain a target file; sending the target file to a target node; the corresponding file processing strategy is determined through the transmission paths of the source node and the target node, and the source file is processed to obtain the target file, so that the file processing requirement of file transmission between the source node and the target node is met, the system cooperation requirement between the source node and the target node is reduced, and the adaptation complexity of the file transmission process to different node service systems is reduced.

Drawings

Other features, objects, and advantages of the disclosure will become apparent from a reading of the following detailed description of non-limiting embodiments which proceeds with reference to the accompanying drawings. The drawings are only for purposes of illustrating the particular embodiments and are not to be construed as limiting the invention. In the drawings:

FIG. 1 is an exemplary system architecture diagram in which one embodiment according to the present disclosure may be applied;

FIG. 2 is a schematic flow chart diagram illustrating one embodiment of a document processing method according to the present disclosure;

FIG. 3 is a schematic flow diagram illustrating the transfer of a file from a file source server to a target server according to the disclosed file processing method;

FIG. 4 is a schematic block diagram of one embodiment of a document processing apparatus according to the present disclosure;

fig. 5 is a schematic structural diagram of a computer system of a terminal device or server suitable for implementing embodiments of the present disclosure.

Detailed Description

The present disclosure is described in further detail below with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.

It should be noted that, in the present disclosure, the embodiments and features of the embodiments may be combined with each other without conflict. The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.

Fig. 1 illustrates an exemplary system architecture 100 to which embodiments of the document processing method or document processing apparatus of the present disclosure may be applied.

As shown in fig. 1, the system architecture 100 may include

terminal devices

101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the

terminal devices

101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the

terminal devices

101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have installed thereon various communication client applications, such as a file transfer application, a web browser application, a shopping-type application, a search-type application, an instant messaging tool, a mailbox client, social platform software, and the like.

The

terminal apparatuses

101, 102, and 103 may be hardware or software. When the

terminal devices

101, 102, 103 are hardware, they may be various electronic devices having a display screen and supporting sound collection and/or video collection, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III, motion Picture Experts compression standard Audio Layer 3), MP4 players (Moving Picture Experts Group Audio Layer IV, motion Picture Experts compression standard Audio Layer 4), laptop portable computers, desktop computers, and the like. When the

terminal devices

101, 102, 103 are software, they can be installed in the electronic devices listed above. It may be implemented as multiple pieces of software or software modules (e.g., to provide distributed services) or as a single piece of software or software module. And is not particularly limited herein.

The server 105 may be a server providing various services, such as a background server providing support for file transfer like applications displayed on the

terminal devices

101, 102, 103. The background server may analyze and perform other processing on the received data, such as a transmission request for transmitting the source file from the source node to the target node, and feed back a processing result (e.g., a file processing policy) to the terminal device.

The server 105 may be hardware or software. When the server 105 is hardware, it may be implemented as a distributed server cluster composed of a plurality of servers, or may be implemented as a single server. When the server 105 is software, it may be implemented as multiple pieces of software or software modules (e.g., to provide distributed services), or as a single piece of software or software module. And is not particularly limited herein.

It should be noted that, in some cases, the file processing method provided by the present disclosure may be executed by the server 105, by the

terminal devices

101, 102, and 103, or by both the server 105 and the

terminal devices

101, 102, and 103. Accordingly, the file processing apparatus may be provided in the server 105, or may be provided in the

terminal devices

101, 102, and 103, or may be provided in part in the server 105 and in part in the

terminal devices

101, 102, and 103. And accordingly system architecture 100 may include only server 105, or only

terminal devices

101, 102, 103, or may include

terminal devices

101, 102, 103, network 104 and server 105. The present disclosure is not limited thereto.

It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

With continued reference to FIG. 2, a flow 200 of one embodiment of a document processing method according to the present disclosure is shown. The file processing method comprises the following steps:

in step 201, a transmission request for transmitting a source file from a source node to a target node is obtained.

In the embodiment of the present disclosure, the file type of the source file is not specifically limited, and the source file may be a file stored in the source node. By way of example, the source files may include: audio files, video files, reconciliation files, etc.

The source node may be a location where the source file is stored, for example, the source node may include a server, a terminal device, or a software system having file storage and transmission functions. In some alternative embodiments, the source node may be a file origin server.

The target node may be a location where a target file obtained by processing the source file is stored, for example, the target node may include a server, a terminal device, or a software system with file storage and transmission functions. In some alternative embodiments, the target node may be a target server.

Here, the transmission request may include a pull (pull) request or a push (push) request.

In the embodiment of the present disclosure, an obtaining manner of the transmission request is not specifically limited, for example, the obtaining manner may be obtaining by monitoring, or obtaining may be triggered by an action of a pull request or a push request.

Step 202, determining a transmission path from the source node to the target node according to the transmission request.

In the embodiment, the transmission path from the source node to the target node may be preset. For example, in some embodiments, the source node may set transmission paths corresponding to a plurality of target nodes, respectively. The transmission path may characterize the correspondence of the source node and the target node.

In some optional embodiments, determining the transmission path from the source node to the target node according to the transmission request may specifically include:

and determining a corresponding preset transmission channel according to the source node and the target node, and determining a transmission path according to the source node, the target node and the preset transmission channel.

Here, the preset transmission channel may be a transmission channel that is preset according to transmission needs between the source node and the target node. The transmission channel may include, for example, a wired connection (e.g., data cable, optical fiber), a wireless transmission (e.g., bluetooth, WiFi), a wired transmission network (e.g., broadband), and/or a wireless communication network (e.g., 4G network, 5G network), etc.

Step 203, determining a file processing strategy according to the transmission path.

Here, the file processing policy may include pre-processing and/or post-processing the source file.

Correspondingly, the file processing policy may further include a pre-processing step in the pre-processing and an execution order of the pre-processing step, and a post-processing step in the post-processing and an execution order of the post-processing step.

In an embodiment of the disclosure, the pre-processing step includes at least one of:

checking the file;

a temporary file is generated.

The post-treatment step comprises at least one of:

decompressing;

decrypting;

renaming the file;

an OK file is generated.

In some optional embodiments, the method further comprises: the functionality of each of the pre-treatment step and the post-treatment step is atomized. For example, the functions of verifying files, generating temporary files, decompressing, decrypting, renaming files, and generating OK files are atomized.

Here, atomization refers to determining an operation agreed in advance as being inseparable into other sub-operations. The processing steps after the function atomization run to the end once the processing steps start to be executed, and no thread switching exists in the middle.

In some optional embodiments, determining the file processing policy according to the transmission path may include:

and determining a file processing strategy corresponding to the transmission path in a preset file processing strategy set.

In some optional embodiments, a file processing policy between the source node and the target node may be preset, and a correspondence between the file processing policy and the transmission path may be established to form a file processing policy set.

It can be understood that, between a source node and different target nodes, corresponding file processing strategies may be set according to file processing requirements between the service systems of the source node and each target node, respectively.

And step 204, processing the source file according to the file processing strategy to obtain a target file.

The target file is a file which is obtained after the source file is processed and meets the file processing requirement of the target node.

Step 205, sending the target file to the target node.

Here, the target file may be sent to the target node via a transmission path from the source node to the target node.

In the file processing method provided by the above embodiment of the present disclosure, a transmission request for transmitting a source file from a source node to a destination node is obtained; determining a transmission path from a source node to a target node according to the transmission request; determining a file processing strategy according to the transmission path; processing the source file according to the file processing strategy to obtain a target file; sending the target file to a target node; the corresponding file processing strategy is determined through the transmission paths of the source node and the target node, and the source file is processed to obtain the target file, so that the file processing requirement of file transmission between the source node and the target node is met, the system cooperation requirement between the source node and the target node is reduced, and the adaptation complexity of the file transmission process to different node service systems is reduced.

In the embodiment, after all functions in the preprocessing step and the post-processing step in the file processing strategy are atomized, the file processing strategy corresponding to different transmission paths is preset, when a downstream business system calls a service (or calls a timing task), a program is executed according to the appointed file processing strategy, and finally, a processed target file is sent to a target server.

To further illustrate the processing of the above-described document processing method, reference is now made to FIG. 3, which illustrates a flow 300 for transferring a document from a document source server to a destination server according to the above-described document processing method.

The process comprises the following steps:

step 301, link file source server.

In some alternative embodiments, the source node, i.e., the file source server, may be linked in response to a transfer request to transfer the source file from the source node to the target node after the transfer request is obtained.

Step 302, a source file to be pulled is located at a file source server.

Step 303, determine whether to preprocess the source file. If yes, go to step 304; if not, go to step 305.

Whether to pre-process the source file may be determined based on whether pre-processing is included in the file processing policy. How to determine the file processing policy is disclosed in the above embodiment of the file processing method, and is not described herein again.

Step 304, source files are preprocessed.

Specifically, the source file may be preprocessed according to the file processing policy including preprocessing steps in preprocessing and an execution order of the preprocessing steps.

Step 305, obtaining a preprocessed source file.

The preprocessed source file may be pulled for post-processing operations.

It is understood that if no preprocessing is performed, the source file that is not preprocessed can be directly used as the preprocessed source file.

Step 306, judging whether to post-process the source file. If yes, go to step 307; if not, go to step 308.

Step 307, post-processing the preprocessed source file.

Specifically, the preprocessed source file may be post-processed according to an execution sequence of the file processing policy including a post-processing step and a post-processing step in the post-processing.

And 308, obtaining a target file and transmitting the target file to a target server.

In some optional embodiments, the target file is obtained after post-processing the preprocessed source file. The target file can be transferred and stored.

It is understood that if no post-processing is performed, the preprocessed source file that is not post-processed may be directly used as the target file.

With further reference to fig. 4, as an implementation of the above-mentioned file processing method, an embodiment of the present disclosure provides a file processing apparatus 400, where the apparatus embodiment corresponds to the method embodiment shown in fig. 2, and the apparatus may be specifically applied to various electronic devices.

As shown in fig. 4, the document processing apparatus 400 of the present embodiment may include: a control unit 401, a determination unit 402, a processing unit 403 and a transmission unit 404. Wherein, the control unit 401 is configured to obtain a transmission request for transmitting a source file from a source node to a target node; a determining unit 402 configured to determine a transmission path from the source node to the target node according to the transmission request, and determine a file processing policy according to the transmission path; a processing unit 403, configured to process the source file according to the file processing policy, to obtain a target file; a sending unit 404 configured to send the target file to the target node.

In this embodiment, specific processing contents of the control unit 401, the determining unit 402, the processing unit 403, and the sending unit 404 of the file processing apparatus 400 and technical effects thereof can refer to the related descriptions of step 201 to step 205 in fig. 2 respectively, and are not described herein again.

In some optional embodiments, the determining unit 402 may be further configured to: determining a corresponding preset transmission channel according to a source node and a target node; and determining a transmission path according to the source node, the target node and a preset transmission channel.

In some optional embodiments, the determining unit 402 may be further configured to: and determining a file processing strategy corresponding to the transmission path in a preset file processing strategy set.

In some optional embodiments, the file handling policy comprises:

the source file is preprocessed and/or post-processed.

In some optional embodiments, the file processing policy further comprises:

preprocessing steps in preprocessing and the execution sequence of the preprocessing steps;

the post-processing step in the post-processing and the execution order of the post-processing step.

In some alternative embodiments, the pre-treatment step comprises at least one of:

checking the file and generating a temporary file;

the post-treatment step comprises at least one of:

decompressing, decrypting, renaming the file and generating an OK file.

In some optional embodiments, the transmission request comprises:

a pull request or a push request.

It should be noted that, for details of implementation and technical effects of each unit in the file processing apparatus provided in the embodiments of the present disclosure, reference may be made to descriptions of other embodiments in the present disclosure, and details are not described herein again.

Referring now to FIG. 5, shown is a block diagram of a computer system 500 suitable for use as a server in implementing embodiments of the present disclosure. The computer system 500 shown in fig. 5 is only an example and should not bring any limitations to the functionality or scope of use of the embodiments of the present disclosure.

As shown in fig. 5, computer system 500 may include a processing device (e.g., central processing unit, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage device 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data necessary for the operation of the computer system 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.

Generally, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, and the like; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage devices 508 including, for example, magnetic tape, hard disk, etc.; and a communication device 509. The communication means 509 may allow the computer system 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 5 illustrates a computer system 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 508, or installed from the ROM 502. The computer program, when executed by the processing device 501, performs the above-described functions defined in the methods of embodiments of the present disclosure.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to implement the file processing method as shown in the embodiment shown in fig. 2 and its optional embodiments.

Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. The name of a unit does not in some cases form a limitation on the unit itself, and for example, a processing unit may also be described as a "unit that processes a source file according to a file processing policy to obtain a target file".

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Claims

1. A method of file processing, comprising:

determining a file processing strategy according to the transmission path;

and sending the target file to the target node.

2. The method of claim 1, wherein the determining a transmission path from the source node to the target node according to the transmission request comprises:

3. The method of claim 1, wherein said determining a file handling policy from said transmission path comprises:

4. The method of claim 1, wherein the file handling policy comprises:

and preprocessing and/or post-processing the source file.

5. The method of claim 4, wherein the file handling policy further comprises:

6. The method of claim 5, wherein the pre-processing step comprises at least one of:

checking the file and generating a temporary file;

the post-treatment step comprises at least one of:

decompressing, decrypting, renaming the file and generating an OK file.

7. The method of claim 1, wherein the transmission request comprises:

a pull request or a push request.

8. A document processing apparatus comprising:

a control unit configured to acquire a transmission request for transmitting a source file from a source node to a target node;

a sending unit configured to send the target file to the target node.

9. An electronic device, comprising:

one or more processors;

storage having one or more programs stored thereon that, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-7.

10. A computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by one or more processors, implements the method of any one of claims 1-7.