WO2021027592A1

WO2021027592A1 - File processing method, apparatus, device and computer readable storage medium

Info

Publication number: WO2021027592A1
Application number: PCT/CN2020/106058
Authority: WO
Inventors: 夏勇; 李凌
Original assignee: 深圳前海微众银行股份有限公司
Priority date: 2019-08-14
Filing date: 2020-07-31
Publication date: 2021-02-18
Also published as: CN110457260A

Abstract

A file processing method, an apparatus, a device and a computer readable storage medium. The file processing method comprises: after determining that a file processing request is received, acquiring a file to be processed and the filename thereof according to the file processing request, and acquiring corresponding configuration information from a preset configuration table according to the filename (S10); converting the file to be processed according to the configuration information and a first preset rule to obtain a Java object to be processed (S20); according to a processing class name in the configuration information, calling a corresponding executor to process the Java object to be processed so as to obtain a processing result Java object (S30); and converting the processing result Java object according to the configuration information and a second preset rule to obtain a processing result file (S40).

Description

File processing method, device, equipment and computer readable storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910761804.6, and the invention title is "File processing methods, devices, equipment and computer-readable storage media" on August 14, 2019. The reference is incorporated in the application.

Technical field

This application relates to the field of financial technology (Fintech) technology, and in particular to a file processing method, device, equipment, and computer-readable storage medium.

Background technique

With the development of computer technology, more and more technologies (big data, distributed, blockchain, artificial intelligence, etc.) are applied in the financial field. The traditional financial industry is gradually transforming to Fintech. However, due to financial The industry's security and real-time requirements also place higher requirements on technology.

With the continuous development of financial business, the volume of various business transactions continues to increase, and various transaction documents continue to increase. If all transaction documents are processed manually, problems of low processing efficiency and high error rates will occur. Therefore, for some common types of files, the corresponding code will be written to realize the automatic processing of the files. When automatically processing files through the above methods, there will be the following problems: 1) The code reuse is low, and a new set of code must be developed to process the file every time a new file is processed; 2) Once some files are processed There are changes in format, such as file order and separator, the code needs to be revised; 3) If new services are added to the file, the code must be revised again and the corresponding processing logic is added. Therefore, in the prior art, in order to realize automatic file processing, a large amount of code development is required, the development workload is relatively large, and the development efficiency is low.

Technical solutions

The main purpose of this application is to provide a file processing method, device, equipment, and computer-readable storage medium, aiming to realize automatic file processing through configuration, so as to reduce the workload of developers and improve development efficiency.

In order to achieve the above objective, the present application provides a file processing method, the file processing method includes:

After determining that the file processing request is received, obtain the file to be processed and its file name according to the file processing request, and obtain corresponding configuration information from the preset configuration table according to the file name;

Performing conversion processing on the file to be processed according to the configuration information and the first preset rule to obtain a Java object to be processed;

According to the processing class name in the configuration information, call the corresponding executor to process the to-be-processed Java object to obtain the processing result Java object;

Transform the processing result Java object according to the configuration information and the second preset rule to obtain a processing result file.

In an embodiment, the configuration information includes the target conversion Java class name, line beginning identifier, separator, the mapping relationship between the first array element and the first target conversion attribute, and the configuration information is based on the configuration information and the first target conversion attribute. The step of converting the file to be processed by a preset rule to obtain a Java object to be processed includes:

Split the file to be processed into multiple pieces of data according to the line header identifier;

Split the multiple pieces of data into arrays according to the separator, traverse the split arrays, and read the first array element;

Acquire the type of the first target conversion attribute, and call the first format converter corresponding to the type of the first target conversion attribute to perform format conversion on the read first array element to obtain the first array after format conversion element;

According to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute, the first array elements after the format conversion are respectively mapped to the corresponding first target conversion attributes to obtain The pending Java object.

In an embodiment, the first array elements after the format conversion are respectively mapped to corresponding ones according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute In the first target conversion attribute, before the step of obtaining the to-be-processed Java object, it also includes:

Detecting whether the number of read first array elements is equal to the number of first target conversion attributes;

After determining that the number of read first array elements is equal to the number of the first target conversion attributes, perform the step of: converting the Java class name according to the target and the mapping between the first array elements and the first target conversion attributes Relationship, mapping the first array elements after the format conversion to the corresponding first target conversion attributes to obtain the Java object to be processed;

After determining that the number of read first array elements is not equal to the number of the first target conversion attributes, detecting whether the strict mode in the configuration information is strict or non-strict;

After determining that the strict mode in the configuration information is strict, generate corresponding exception reminding information and return it to the client corresponding to the file processing request;

After determining that the strict mode in the configuration information is not strict, perform the step of: according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute, the second format converted An array element is respectively mapped to the corresponding first target conversion attribute to obtain the Java object to be processed.

In an embodiment, the configuration information further includes a mapping relationship between a second array element and a second target conversion attribute, and the processing result Java object is converted according to the configuration information and a second preset rule Processing to obtain the processing result file includes:

Extract the attribute information corresponding to each second target conversion attribute in the processing result Java object, and call the second format converter corresponding to the type of the second target conversion attribute to perform format conversion on the attribute information to obtain Second array element;

The second array element, the line header identifier, and the separator are spliced in a preset format to obtain a processing result file.

In an embodiment, the configuration information further includes a file limit size, and before the step of converting the file to be processed according to the configuration information and the first preset rule to obtain the Java object to be processed, the method further includes :

Acquiring the file size of the file to be processed, and detecting whether the file size exceeds the file limit size;

After determining that the file size has exceeded the file limit size, split the file to be processed according to the file limit size;

The step of converting the file to be processed according to the configuration information and the first preset rule to obtain the Java object to be processed includes:

According to the configuration information and the first preset rule, the split files to be processed are sequentially converted to obtain the Java objects to be processed.

In an embodiment, the step of obtaining corresponding configuration information from a preset configuration table according to the file name includes:

Determining the file type of the file to be processed according to the file name;

According to the file type and the mapping relationship between the preset file type and the configuration name, the target configuration name is determined, and the configuration information corresponding to the target configuration name is obtained from the preset configuration table.

In an embodiment, the file processing method further includes:

When receiving a configuration table modification request, display a corresponding configuration information modification interface based on the configuration table modification request;

Receive a configuration table modification instruction triggered by a user based on the configuration information modification interface, and update the preset configuration table according to the configuration table modification instruction.

In addition, in order to achieve the above objective, the present application also provides a file processing device, the file processing device includes:

The information obtaining module is configured to obtain the file to be processed and its file name according to the file processing request after confirming that the file processing request is received, and obtain corresponding configuration information from the preset configuration table according to the file name;

The first conversion module is configured to perform conversion processing on the file to be processed according to the configuration information and the first preset rule to obtain a Java object to be processed;

The processing module is configured to call the corresponding executor to process the to-be-processed Java object according to the processing class name in the configuration information to obtain the processing result Java object;

The second conversion module is configured to perform conversion processing on the processing result Java object according to the configuration information and a second preset rule to obtain a processing result file.

In addition, in order to achieve the above object, the present application also provides a file processing device, the file processing device includes: a memory, a processor, and a file processing program stored in the memory and running on the processor, so When the file processing program is executed by the processor, the steps of the file processing method described above are implemented.

In addition, in order to achieve the above object, the present application also provides a computer-readable storage medium having a file processing program stored on the computer-readable storage medium, and the file processing program is executed by a processor to realize the file processing as described above. Method steps.

This application provides a file processing method, device, equipment, and computer-readable storage medium. When a file processing request is received, the file to be processed and its file name are first obtained according to the file processing request, and the file name is obtained from a preset configuration table The corresponding configuration information is obtained in the configuration information; then, the file to be processed is converted according to the configuration information and the first preset rule to obtain the Java object to be processed, and then the corresponding executor is called according to the processing class name in the configuration information. The processing is performed to obtain the processing result Java object; finally, the processing result Java object is converted according to the configuration information and the second preset rule to obtain the processing result file. Through the above method, this application realizes the automatic processing of files through configuration. Compared with the automatic processing of files by writing code in the prior art, this application does not require new developers to process new files or file changes. Adding or modifying a large amount of code can reduce the workload of developers and improve development efficiency.

Description of the drawings

FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the application;

FIG. 2 is a schematic flowchart of the first embodiment of the application file processing method;

FIG. 3 is a schematic diagram of functional modules of the first embodiment of the file processing apparatus of this application.

The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Implementation of this application

It should be understood that the specific embodiments described here are only used to explain the application, and are not used to limit the application.

Referring to FIG. 1, FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the application.

The document processing device in the embodiment of this application can be a smart phone or a PC (Personal Computer, personal computer), tablet computer, portable computer and other terminal equipment.

As shown in FIG. 1, the file processing device may include a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a Wi-Fi interface). The memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage. Optionally, the memory 1005 may also be a storage device independent of the foregoing processor 1001.

Those skilled in the art can understand that the structure of the file processing device shown in FIG. 1 does not constitute a limitation on the file processing device, and may include more or less components than shown in the figure, or a combination of certain components, or different components Layout.

As shown in FIG. 1, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a file processing program.

In the terminal shown in FIG. 1, the network interface 1004 is mainly used to connect to a back-end server and communicate with the back-end server; the user interface 1003 is mainly used to connect to a client and communicate with the client; and the processor 1001 can be used to Call the file processing program stored in the memory 1005 and perform the following operations:

Further, the configuration information includes the target conversion Java class name, line beginning identifier, separator, the mapping relationship between the first array element and the first target conversion attribute, and the processor 1001 can call the file processing program stored in the memory 1005 , Also do the following:

Further, the processor 1001 may call a file processing program stored in the memory 1005, and also perform the following operations:

It is determined that the number of the first array elements obtained by reading is equal to the number of the first target conversion attributes, and the execution step: according to the target conversion Java class name and the mapping relationship between the first array elements and the first target conversion attributes , Map the first array elements after the format conversion to the corresponding first target conversion attributes respectively to obtain the to-be-processed Java object;

Determining that the number of read first array elements is not equal to the number of first target conversion attributes, and detecting whether the strict mode in the configuration information is strict or non-strict;

After determining that the strict mode in the configuration information is non-strict, perform the step: according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute, the format converted The first array elements are respectively mapped to the corresponding first target conversion attributes to obtain the to-be-processed Java object.

Further, the configuration information further includes the mapping relationship between the second array element and the second target conversion attribute, and the processor 1001 may call the file processing program stored in the memory 1005, and further perform the following operations:

Further, the configuration information also includes a limited file size, and the processor 1001 may call a file processing program stored in the memory 1005, and also perform the following operations:

After receiving the configuration table modification request, display the corresponding configuration information modification interface based on the configuration table modification request;

Based on the above hardware structure, various embodiments of the file processing method of the present application are proposed.

This application provides a file processing method.

Referring to FIG. 2, FIG. 2 is a schematic flowchart of a first embodiment of a file processing method of this application.

In this embodiment, the file processing method includes:

Step S10, after determining that the file processing request is received, obtain the file to be processed and its file name according to the file processing request, and obtain corresponding configuration information from a preset configuration table according to the file name;

The file processing method in this embodiment is implemented by a file processing device, and the device is described by taking a server as an example. In this embodiment, when the server receives the file processing request, it first obtains the file to be processed and its file name according to the file processing request, and obtains corresponding configuration information from the preset configuration table according to the file name.

Wherein, the step of "obtaining corresponding configuration information from the preset configuration table according to the file name" includes:

Step a1: Determine the file type of the file to be processed according to the file name;

Step a2: Determine the target configuration name according to the file type and the mapping relationship between the preset file type and the configuration name, and obtain configuration information corresponding to the target configuration name from the preset configuration table.

After obtaining the file name of the file to be processed, the file type of the file to be processed can be determined first according to the file name, and then the target configuration name is determined according to the file type and the mapping relationship between the preset file type and the configuration name, and The configuration information corresponding to the target configuration name is obtained from the preset configuration table. Among them, the preset configuration table may include, but is not limited to, the configuration name, line header identifier, separator, target conversion Java class name, the mapping relationship between the first array element and the first target conversion attribute (that is, the The properties of the Java class and its mapping relationship with the first array element), the mapping relationship between the second array element and the second target conversion property (that is, the property of the Java class to be converted in the write file and its relationship with the second The mapping relationship between array elements), processing class name, strict mode, file limit size and transaction processing size and other fields. Correspondingly, each piece of configuration information includes the configuration information corresponding to the above-mentioned fields. It should be noted that because the configuration information corresponding to different line header identifiers is different, one target configuration name can correspond to multiple pieces of configuration information. For example, for the file type is Batch Performance Test (batch performance test) files to be processed. The preset configuration table will contain 4 different configuration information. The line headers in each configuration information are H, X, Y, and Z respectively, which are used for subsequent identification After reaching the character at the beginning of each line of the file to be processed, the configuration information corresponding to the character (that is, the line beginning identifier) is used to automatically deserialize each line of data into a Java object.

Of course, it can be understood that in a specific embodiment, the mapping relationship between the file name and the configuration name can also be directly established, so as to directly determine the target configuration name according to the mapping relationship between the file name, the file name and the configuration name, and then from The configuration information corresponding to the target configuration name is obtained from the preset configuration table.

Step S20: Perform conversion processing on the file to be processed according to the configuration information and the first preset rule to obtain a Java object to be processed;

After the file to be processed and the configuration information are acquired, the file to be processed is converted according to the configuration information and the first preset rule to obtain the Java object to be processed. It should be noted that a row of data corresponds to one Java object, and when the file to be processed includes multiple (rows) of data, there are also multiple corresponding Java objects to be processed.

Wherein, the configuration information includes the target conversion Java class name, line header identifier, separator, the mapping relationship between the first array element and the first target conversion attribute, and step S20 includes:

Step b1: Split the file to be processed into multiple pieces of data according to the line header identifier;

The specific process of object deserialization (the process of restoring the byte sequence to the object) is as follows: First, the file to be processed is split into multiple pieces of data according to the line header identification, for example, for the following files:

H|123|333

B|22|tt

F|333|tt

6 pieces of data can be obtained by splitting according to the line header identification.

Step b2, split the multiple pieces of data into an array according to the separator, and traverse the split array, and read the first array element;

Then, split multiple pieces of data into arrays according to the separator, and traverse the split array to read the first array element. For example, for the piece of data H|123|333, the first array elements can be obtained as 123 and 333 respectively.

Step b3: Obtain the type of the first target conversion attribute, and call the first format converter corresponding to the type of the first target conversion attribute to perform format conversion on the read first array element to obtain the converted format First array element;

Then, the type of the first target conversion attribute is obtained, and the first format converter corresponding to the type of the first target conversion attribute is called to perform format conversion on the read first array element to obtain the first array after the format conversion element. For example, when the first target conversion attribute includes age (age) and date (date), a string-to-integer format converter and a string-to-date format converter can be called respectively to perform format conversion.

Step b4, according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute, map the first array element after format conversion to the corresponding first target conversion attribute, respectively , Get the Java object to be processed.

Then, according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute, the first array elements after format conversion are respectively mapped to the corresponding first target conversion attributes to obtain the Java object to be processed . For example, in the above example, for the H|123|333 piece of data, such as the line header identifier starting with H, the corresponding target standard is changed to the Java class File Coop Open Confirm Detl class. After splitting into an array, read the first array elements 123 and 333. If the first target conversion attribute includes field1 and field2, after format conversion, map the first array element to the first target conversion attribute, that is 123->filed1, 333->filed2, after the conversion, you can get a File with the data set The Coop Open Confirm Detl object is the Java object to be processed.

Step S30: According to the processing class name in the configuration information, call the corresponding executor to process the to-be-processed Java object to obtain the processing result Java object;

After obtaining the Java object to be processed, according to the processing class name in the configuration information, call the corresponding executor to process the Java object to be processed to obtain the processing result Java object. Among them, the executor is used to execute business logic. For example, the obtained Java object is a Fund Transfer object, and the corresponding executor can be determined according to the processing class name as Fund Transfer Server.doTransfer, then the executor will be automatically called to process the Fund Transfer object to complete the transfer business, and then get the processing result. The processing result is also a Java object, which is recorded as the processing result Java object.

Step S40: Perform conversion processing on the processing result Java object according to the configuration information and the second preset rule to obtain a processing result file.

After the processing result Java object is obtained through processing, the processing result Java object is converted according to the configuration information and the second preset rule to obtain the processing result file. That is, the processing result Java object needs to be converted into a corresponding character string in order to write back the result file. This process involves the serialization of the object, that is, converting the object into a sequence of bytes.

Wherein, the configuration information further includes the mapping relationship between the second array element and the second target conversion attribute, and step S40 includes:

Step c1: Extract the attribute information corresponding to each second target conversion attribute in the processing result Java object, and call a second format converter corresponding to the type of the second target conversion attribute to format the attribute information Convert to get the second array element;

Specifically, the attribute information corresponding to each second target conversion attribute in the processing result Java object is extracted, and then the second format converter corresponding to the type of the second target conversion attribute is called to perform format conversion on the attribute information to obtain the first Two array elements. Among them, the second format converter is a format converter that converts an object type to a string type, such as a format converter that converts an integer type to a string, and a date type to a string format converter.

Step c2, splicing the second array element, the line header identifier, and the separator according to a preset format to obtain a processing result file.

Then, the second array element, line beginning identifier, and separator are spliced according to the preset format to obtain the processing result file. Among them, the preset format can be preset and can be similar to the format of the file to be processed. For example, if the second array element is 222 and 234, if the line header identifier in the configuration information is B and the separator is |, that is Can be spliced to get B|222|234. After each processing result Java object is converted, multiple sets of second array elements can be obtained, and then each second array element can be spliced separately, and then the processing results are generated according to the splicing results file.

The embodiment of the application provides a file processing method. When a file processing request is received, the file to be processed and its file name are first obtained according to the file processing request, and corresponding configuration information is obtained from a preset configuration table according to the file name; , Convert the file to be processed according to the configuration information and the first preset rule to obtain the Java object to be processed, and then call the corresponding executor to process the Java object to be processed according to the processing class name in the configuration information to obtain the processing result Java object ; Finally, the processing result Java object is converted according to the configuration information and the second preset rule to obtain the processing result file. In the above manner, in the embodiment of the present application, the automatic processing of files is realized through configuration. Compared with the automatic processing of files by writing codes in the prior art, the embodiments of the present application will process newly added files or file changes. , No need for developers to add or modify a large amount of code, which can reduce the workload of developers and improve development efficiency.

Further, based on the above-mentioned first embodiment, a second embodiment of the file processing method of this application is proposed.

Based on the foregoing first embodiment, before the foregoing step b4, the file processing method further includes:

Step A, detecting whether the number of read first array elements is equal to the number of first target conversion attributes;

In this embodiment, in order to ensure that the first array element read from the file to be processed can be subjected to subsequent processing, the strict mode can also be set in the configuration information, and then according to the strict mode, the number of first array elements and the first target The number of conversion attributes is used to determine whether further subsequent processing can be performed (ie, the next step S20). Among them, strict mode includes strict and non-strict. Specifically, after the first array element is read, it is detected whether the number of the read first array element is equal to the number of the first target conversion attribute.

It is determined that the number of read first array elements is equal to the number of the first target conversion attributes, and step b4 is performed: according to the target conversion Java class name and the mapping between the first array elements and the first target conversion attributes Relationship, mapping the first array elements after the format conversion to the corresponding first target conversion attributes to obtain the Java object to be processed;

After confirming that the number of first array elements read is equal to the number of first target conversion attributes, it indicates that the number of first data elements is sufficient. At this time, the Java class name and the first array element and the first target conversion attribute can be converted according to the target The mapping relationship between the first array elements after format conversion are respectively mapped to the corresponding first target conversion attributes to obtain the Java object to be processed, and then execute the subsequent processing process. For the specific execution process, refer to the first implementation above For example, I won’t repeat them here.

After determining that the number of elements in the first array obtained is not equal to the number of the first target conversion attributes, perform step B: detecting whether the strict mode in the configuration information is strict or non-strict;

After determining that the number of read first array elements is not equal to the number of first target conversion attributes, it is necessary to further check whether the strict mode in the configuration information is strict or non-strict, and combined with the strict mode to determine whether the next processing can be performed.

It is determined that the strict mode in the configuration information is strict, and step C is executed: corresponding abnormal reminder information is generated, and returned to the client corresponding to the file processing request;

It is determined that the strict mode in the configuration information is strict, and the next processing cannot be performed. At this time, the corresponding abnormal reminder information is generated and returned to the client corresponding to the file processing request.

It is determined that the strict mode in the configuration information is non-strict, and step b4 is executed: according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute, the format converted The first array elements are respectively mapped to the corresponding first target conversion attributes to obtain the to-be-processed Java object.

Confirm that the strict mode in the configuration information is non-strict, which means that even if the numbers are not equal, you can continue to the next step, which is to change the format according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute The converted first array elements are respectively mapped to the corresponding first target conversion attributes to obtain the to-be-processed Java object, and then perform subsequent processing. It should be noted that when the number of read first array elements is not equal to the number of first target conversion attributes, and the strict mode is non-strict mode, it needs to be based on the number of first array elements and the first target conversion attribute. The quantity is mapped. For example, if the number of the first target conversion attribute is 4, if the number of the first array element is 5, only the first 4 elements need to be mapped, and if the number of the first array element is 2, then only the These two elements can be mapped to the conversion attribute corresponding to your first target.

Further, based on the above-mentioned first embodiment, a third embodiment of the file processing method of this application is proposed.

Based on the foregoing first embodiment, the configuration information further includes a file limit size. Before the foregoing step S20, the file processing method further includes:

Step D: Obtain the file size of the file to be processed, and detect whether the file size exceeds the file limit size;

In this embodiment, the configuration information may also include a limited file size, where the limited file size is the number of pieces of data that can be processed at one time. After obtaining the file to be processed, the file size of the file to be processed can be obtained first, where the file size refers to the total number of data included in the file to be processed. Specifically, it can be determined according to the line header identification. Each line has a line header identifier, the number of line header identifiers is the total number of data; of course, the total number of lines of the file to be processed can also be directly identified, and the total number of lines is the total number of data. Then, it is detected whether the file size of the file to be processed exceeds the file limit size.

It is determined that the file size has exceeded the limited file size, and step E is performed: splitting the file to be processed according to the limited file size;

At this time, step S20 includes:

Determine that the file size of the file to be processed has exceeded the file limit. In order to avoid the server's processing performance being limited due to excessive server pressure, the file to be processed can be split according to the file limit size, and then based on the configuration information and the first preset The rules sequentially convert the files to be processed after splitting to obtain the Java objects to be processed. Further, the subsequent steps are executed, and the specific execution process can refer to the above-mentioned first embodiment, which will not be repeated here.

It is determined that the file size does not exceed the limited file size, and step S20 is executed: according to the configuration information and the first preset rule, the split files to be processed are sequentially converted to obtain the Java object to be processed.

Make sure that the file size of the file to be processed does not exceed the file limit. You do not need to split the file to be processed, just process it directly. Specifically, according to the configuration information and the first preset rule, the files to be processed after splitting are converted in turn After processing, the Java object to be processed is obtained, and then the subsequent steps are executed. For the specific execution process, please refer to the above-mentioned first embodiment, which will not be repeated here.

Through the above method, the size of the configuration file is limited. When processing the file, it is detected whether the file size of the file to be processed exceeds the limited size of the file. When it exceeds, the file to be processed is split and processed, which can avoid the server from being overstressed. The processing performance of the server is limited.

Further, the configuration information may also include the transaction commit size, where the transaction commit size refers to the data size limited by a single time during processing. Correspondingly, before step S30, it can also be detected whether the size of the Java object to be processed exceeds The transaction commit size further controls the data volume of the Java object to be processed in a single processing according to the transaction commit size. Through the above method, the number of single processing can also be controlled according to actual needs to avoid excessive server pressure.

Correspondingly, the above-mentioned similar method can also be used to limit the data volume of the Java object of the processing result of a single conversion, so as to further avoid the situation that the server's processing performance is limited due to excessive server pressure.

Further, based on the foregoing embodiments, a third embodiment of the file processing method of this application is proposed.

In this embodiment, the file processing method further includes:

Step F, receiving a configuration table modification request, and displaying a corresponding configuration information modification interface based on the configuration table modification request;

Step G: Receive a configuration table modification instruction triggered by the user based on the configuration information modification interface, and update the preset configuration table according to the configuration table modification instruction.

In this embodiment, when there is a new file that needs to be processed automatically, or the format of the original file is changed, or a new service is added to the original file, at this time, the staff only needs to add configuration information or modify the original configuration The information is enough, no need to develop a whole set of new code, and no need to make substantial changes to the original code. Specifically, when the staff needs to modify the configuration table, they can click on the configuration table modification option through the corresponding software or App (Application) of the user terminal (such as mobile phone, PC, etc.) to trigger the configuration table modification request. When the server receives the configuration table modification request, it displays the corresponding configuration information modification interface based on the configuration table modification request. The staff can input the modification information through the configuration information modification interface, and the configuration table modification instruction can be triggered after the input is completed. When receiving the configuration table modification instruction triggered by the user based on the configuration information modification interface, the server updates the preset configuration table according to the configuration table modification instruction. For example, for the modification of part of the configuration information, you can directly modify and adjust the relevant configuration information in the preset configuration table, such as separators, processing class names, mapping relationships, file limit sizes, etc. For new configuration information, just add a new line in the preset configuration table, add the corresponding configuration name, target conversion Java class name, line beginning identification, separator, mapping relationship, processing class name and other information, and then add related configuration It's done.

Through the above method, it is convenient for the staff to update the configuration information in the preset configuration table. At the same time, the automatic processing of the file is realized based on the configuration method, without the developer adding or modifying a large amount of code, which can reduce the developer's workload , Improve development efficiency.

The application also provides a file processing device.

Referring to FIG. 3, FIG. 3 is a schematic diagram of the functional modules of the first embodiment of the file processing apparatus of this application.

As shown in Fig. 3, the file processing device includes:

The information obtaining module 10 is configured to receive a file processing request, obtain a file to be processed and its file name according to the file processing request, and obtain corresponding configuration information from a preset configuration table according to the file name;

The first conversion module 20 is configured to perform conversion processing on the file to be processed according to the configuration information and a first preset rule to obtain a Java object to be processed;

The processing module 30 is configured to call the corresponding executor to process the to-be-processed Java object according to the processing class name in the configuration information to obtain the processing result Java object;

The second conversion module 40 is configured to perform conversion processing on the processing result Java object according to the configuration information and a second preset rule to obtain a processing result file.

Further, the configuration information includes the target conversion Java class name, line beginning identifier, separator, the mapping relationship between the first array element and the first target conversion attribute, and the first conversion module 20 includes:

A file splitting unit, configured to split the file to be processed into multiple pieces of data according to the line header identifier;

An element reading unit, configured to split the multiple pieces of data into an array according to the separator, traverse the split array, and read the first array element;

The first conversion unit is configured to obtain the type of the first target conversion attribute, and call the first format converter corresponding to the type of the first target conversion attribute, and perform format conversion on the read first array element to obtain The first array element after format conversion;

The element mapping unit is configured to map the first array elements after the format conversion to the corresponding first array elements respectively according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute In the target conversion property, the Java object to be processed is obtained.

Further, the first conversion module 20 further includes:

The first detection unit is configured to detect whether the number of the read first array elements is equal to the number of the first target conversion attributes;

The element mapping unit is further configured to: after the first detection and determination unit determines that the number of read first array elements is equal to the number of the first target conversion attribute, convert the Java class name and the first target conversion attribute according to the target A mapping relationship between array elements and first target conversion attributes, mapping the first array elements after the format conversion to the corresponding first target conversion attributes to obtain the Java object to be processed;

The second detection unit is configured so that the first detection and determination unit determines that the number of read first array elements is not equal to the number of the first target conversion attribute, and detects whether the strict mode in the configuration information is strict or non strict;

An abnormality reminder unit, configured to generate corresponding abnormality reminder information after the second detection unit determines that the strict mode in the configuration information is strict, and return to the client corresponding to the file processing request;

The element mapping unit is further configured to: after the second detection unit determines that the strict mode in the configuration information is non-strict, execute the step of: converting the Java class name and the first array element and the first target according to the target The mapping relationship between the conversion attributes is to map the first array elements after the format conversion to the corresponding first target conversion attributes to obtain the Java object to be processed.

Further, the second conversion module 40 includes:

The second conversion unit is configured to extract attribute information corresponding to each second target conversion attribute in the processing result Java object, and call a second format converter corresponding to the type of the second target conversion attribute, to The attribute information is formatted to obtain the second array element;

The splicing unit is configured to splice the second array element, the line header identifier, and the separator in a preset format to obtain a processing result file.

Further, the configuration information further includes a file limit size, and before the step of converting the file to be processed according to the configuration information and the first preset rule to obtain the Java object to be processed, the file processing device Also includes:

A size detection module, configured to obtain the file size of the file to be processed, and detect whether the file size exceeds the file limit size;

A file splitting module configured to split the file to be processed according to the limited file size after the size detection module determines that the file size has exceeded the limited file size;

The first conversion module is further configured to sequentially perform conversion processing on the split files to be processed according to the configuration information and the first preset rule to obtain the Java object to be processed.

Further, the information acquisition module 10 includes:

The type determining unit is configured to determine the file type of the file to be processed according to the file name;

The information obtaining unit is configured to determine the target configuration name according to the file type and the mapping relationship between the preset file type and the configuration name, and obtain configuration information corresponding to the target configuration name from the preset configuration table.

Further, the file processing device further includes:

The display module is configured to display the corresponding configuration information modification interface based on the configuration table modification request after receiving the configuration table modification request;

The update module is configured to receive a configuration table modification instruction triggered by a user based on the configuration information modification interface, and update the preset configuration table according to the configuration table modification instruction.

Among them, the function realization of each module in the above-mentioned file processing apparatus corresponds to each step in the above-mentioned file processing method embodiment, and the functions and realization processes thereof will not be repeated here.

The present application also provides a computer-readable storage medium having a file processing program stored on the computer-readable storage medium, and when the file processing program is executed by a processor, the file processing method as described in any of the above embodiments is implemented step.

The specific embodiments of the computer-readable storage medium of this application are basically the same as the embodiments of the above-mentioned file processing method, and will not be repeated here.

It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, It also includes other elements not explicitly listed, or elements inherent to the process, method, article, or system. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article or system that includes the element.

The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disk, optical disk), including several instructions to make a terminal device (can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.

The above are only preferred embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of this application, or directly or indirectly used in other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims

A file processing method, wherein the file processing method includes:

After determining that the file processing request is received, obtain the file to be processed and its file name according to the file processing request, and obtain corresponding configuration information from the preset configuration table according to the file name;

Performing conversion processing on the file to be processed according to the configuration information and the first preset rule to obtain a Java object to be processed;

According to the processing class name in the configuration information, call the corresponding executor to process the to-be-processed Java object to obtain the processing result Java object;

Transform the processing result Java object according to the configuration information and the second preset rule to obtain a processing result file.
The file processing method according to claim 1, wherein the configuration information includes a target conversion Java class name, a line header identifier, a separator, a mapping relationship between the first array element and the first target conversion attribute, and the The step of converting the file to be processed by the configuration information and the first preset rule to obtain the Java object to be processed includes:

Split the file to be processed into multiple pieces of data according to the line header identifier;

Split the multiple pieces of data into arrays according to the separator, traverse the split arrays, and read the first array element;

Acquire the type of the first target conversion attribute, and call the first format converter corresponding to the type of the first target conversion attribute to perform format conversion on the read first array element to obtain the first array after format conversion element;

According to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute, the first array elements after the format conversion are respectively mapped to the corresponding first target conversion attributes to obtain The pending Java object.
The file processing method according to claim 2, wherein the first format converted according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute The array elements are respectively mapped to the corresponding first target conversion attributes, and before the step of obtaining the to-be-processed Java object, it also includes:

Detecting whether the number of read first array elements is equal to the number of first target conversion attributes;

After determining that the number of read first array elements is equal to the number of the first target conversion attributes, perform the step of: converting the Java class name according to the target and the mapping between the first array elements and the first target conversion attributes Relationship, mapping the first array elements after the format conversion to the corresponding first target conversion attributes to obtain the Java object to be processed;

After determining that the number of read first array elements is not equal to the number of the first target conversion attributes, detecting whether the strict mode in the configuration information is strict or non-strict;

After determining that the strict mode in the configuration information is strict, generate corresponding exception reminding information and return it to the client corresponding to the file processing request;

After determining that the strict mode in the configuration information is not strict, perform the step of: according to the target conversion Java class name and the mapping relationship between the first array element and the first target conversion attribute, the second format converted An array element is respectively mapped to the corresponding first target conversion attribute to obtain the Java object to be processed.
The file processing method according to claim 2, wherein the configuration information further includes a mapping relationship between a second array element and a second target conversion attribute, and the configuration information and the second preset rule The processing result Java object is converted to obtain the processing result file. The steps include:

Extract the attribute information corresponding to each second target conversion attribute in the processing result Java object, and call the second format converter corresponding to the type of the second target conversion attribute to perform format conversion on the attribute information to obtain Second array element;

The second array element, the line header identifier, and the separator are spliced in a preset format to obtain a processing result file.
5. The file processing method according to claim 1, wherein the configuration information further includes a limited file size, and the file to be processed is converted according to the configuration information and a first preset rule to obtain Java to be processed Before the steps of the object, it also includes:

Acquiring the file size of the file to be processed, and detecting whether the file size exceeds the file limit size;

After determining that the file size has exceeded the file limit size, split the file to be processed according to the file limit size;

The step of converting the file to be processed according to the configuration information and the first preset rule to obtain the Java object to be processed includes:

According to the configuration information and the first preset rule, the split files to be processed are sequentially converted to obtain the Java objects to be processed.
5. The file processing method according to claim 1, wherein the step of obtaining corresponding configuration information from a preset configuration table according to the file name comprises:

Determining the file type of the file to be processed according to the file name;

According to the file type and the mapping relationship between the preset file type and the configuration name, the target configuration name is determined, and the configuration information corresponding to the target configuration name is obtained from the preset configuration table.
8. The file processing method according to any one of claims 1 to 6, wherein the file processing method further comprises:

After receiving the configuration table modification request, display the corresponding configuration information modification interface based on the configuration table modification request;

Receive a configuration table modification instruction triggered by a user based on the configuration information modification interface, and update the preset configuration table according to the configuration table modification instruction.
A file processing device, wherein the file processing device includes:

The information obtaining module is configured to obtain the file to be processed and its file name according to the file processing request after confirming that the file processing request is received, and obtain corresponding configuration information from the preset configuration table according to the file name;

The first conversion module is configured to perform conversion processing on the file to be processed according to the configuration information and the first preset rule to obtain a Java object to be processed;

The processing module is configured to call the corresponding executor to process the to-be-processed Java object according to the processing class name in the configuration information to obtain the processing result Java object;

The second conversion module is configured to perform conversion processing on the processing result Java object according to the configuration information and a second preset rule to obtain a processing result file.
A file processing device, wherein the file processing device includes: a memory, a processor, and a file processing program stored on the memory and running on the processor, and the file processing program is executed by the processor When executed, the file processing method according to any one of claims 1 to 7 is realized.
A computer-readable storage medium, wherein a file processing program is stored on the computer-readable storage medium, and when the file processing program is executed by a processor, the file processing according to any one of claims 1 to 7 is realized method.