CN112860706A - Service processing method, device, equipment and storage medium - Google Patents
Service processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN112860706A CN112860706A CN202110266735.9A CN202110266735A CN112860706A CN 112860706 A CN112860706 A CN 112860706A CN 202110266735 A CN202110266735 A CN 202110266735A CN 112860706 A CN112860706 A CN 112860706A
- Authority
- CN
- China
- Prior art keywords
- service
- data
- processed
- processing
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title description 17
- 238000012545 processing Methods 0.000 claims abstract description 325
- 238000000034 method Methods 0.000 claims abstract description 37
- 230000002159 abnormal effect Effects 0.000 claims description 17
- 238000012790 confirmation Methods 0.000 claims description 16
- 238000012216 screening Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000005856 abnormality Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000002354 daily effect Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a method, a device, equipment and a storage medium for processing services, wherein the method comprises the following steps: acquiring a target batch processing service group to be processed at the current moment, and acquiring a target service to be processed in the target batch processing service group; acquiring a service file of a target service to be processed, and analyzing the service file to acquire corresponding service data; when the business data are determined to accord with the preset data display rule, a business data table corresponding to the business data is obtained; the method comprises the steps of obtaining service processing logic corresponding to a target service to be processed, carrying out data processing on a service data table according to the service processing logic to obtain a data processing result of the target service to be processed, achieving batch processing of the service to be processed, carrying out data processing on the service data table through preset service processing logic to obtain the data processing result, reducing processing time required by batch service processing, and improving processing efficiency of the batch service.
Description
Technical Field
The embodiment of the invention relates to the technical field of networks, in particular to a service processing method, a service processing device, service processing equipment and a storage medium.
Background
With the high-speed development of the internet technology, the functions of application programs are continuously improved, and related service data are more and more complex; when the server acquires the service to be processed, real-time and efficient processing and analysis of a large amount of service data are realized, and the method has important significance for improving user experience.
In the conventional service processing method, when a batch of services to be processed is obtained, service processing logics matched with the services to be processed are generally obtained one by one, and the services to be processed corresponding to each service processing logic one by one are processed; however, this method has low data processing efficiency, takes a long time, cannot realize real-time response to the service for the service to be processed containing a large amount of service data, and has poor service carrying capacity of the server.
Disclosure of Invention
The embodiment of the invention provides a service processing method, a service processing device, service processing equipment and a storage medium, and aims to realize high-efficiency processing of batch services.
In a first aspect, an embodiment of the present invention provides a method for processing a service, including:
acquiring a target batch processing service group to be processed at the current moment, and acquiring a target service to be processed in the target batch processing service group;
acquiring a service file of the target service to be processed, and analyzing the service file to acquire corresponding service data;
judging whether the service data accord with a preset data display rule or not, and acquiring a service data table corresponding to the service data when the service data accord with the preset data display rule is determined;
and acquiring a service processing logic corresponding to the target service to be processed, and performing data processing on the service data table according to the service processing logic to acquire a data processing result of the target service to be processed.
In a second aspect, an embodiment of the present invention provides a device for processing a service, including:
the system comprises a target to-be-processed service acquisition module, a target batch processing service acquisition module and a target batch processing service processing module, wherein the target to-be-processed service acquisition module is used for acquiring a target batch processing service group to be processed at the current moment and acquiring a target to-be-processed service in the target batch processing service group;
the service data acquisition module is used for acquiring a service file of the target service to be processed and analyzing the service file to acquire corresponding service data;
the service data table acquisition module is used for judging whether the service data accord with a preset data display rule or not and acquiring a service data table corresponding to the service data when the service data accord with the preset data display rule is determined;
and the data processing result acquisition module is used for acquiring the service processing logic corresponding to the target service to be processed and carrying out data processing on the service data table according to the service processing logic so as to acquire the data processing result of the target service to be processed.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the service processing method according to any embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a service processing method according to any embodiment of the present invention.
According to the technical scheme provided by the embodiment of the invention, after the target batch processing service group to be processed at the current moment is obtained, and the target service to be processed in the target batch processing service group is obtained; acquiring a service file of a target service to be processed, and analyzing the service file to acquire corresponding service data; when the business data are determined to accord with the preset data display rule, a business data table corresponding to the business data is obtained; the method comprises the steps of obtaining service processing logic corresponding to a target service to be processed, carrying out data processing on a service data table according to the service processing logic to obtain a data processing result of the target service to be processed, achieving batch processing of the service to be processed, carrying out data processing on the service data table through preset service processing logic to obtain the data processing result, reducing processing time required by batch service processing, and improving processing efficiency of the batch service.
Drawings
Fig. 1 is a flowchart of a service processing method according to an embodiment of the present invention;
fig. 2 is a flowchart of a service processing method according to a second embodiment of the present invention;
fig. 3A is a schematic structural diagram of a service processing system according to a third embodiment of the present invention;
fig. 3B is a schematic structural diagram of a service layer provided in the third embodiment of the present invention;
fig. 3C is a schematic flowchart of a service processing method according to a third embodiment of the present invention;
fig. 4 is a block diagram of a service processing apparatus according to a fourth embodiment of the present invention;
fig. 5 is a block diagram of an electronic device according to a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a service processing method according to an embodiment of the present invention, where this embodiment is applicable to efficiently process a batch of services when a batch of services to be processed is obtained, and the method may be executed by a service processing apparatus according to a fourth embodiment of the present invention, where the apparatus may be implemented by software and/or hardware and integrated on an electronic device, and typically may be integrated in a server of a service processing platform, and the method specifically includes the following steps:
s110, obtaining a target batch processing service group to be processed at the current moment, and obtaining a target service to be processed in the target batch processing service group.
The batch processing service is a service which can automatically and efficiently process and analyze complex data without manual participation; for example, adjustment of bank reconciliation and interest rates, data synchronization across databases/systems; through batch processing of services, a large amount of service data can be automatically processed at regular time (for example, every day, every week or every month) according to working steps set by a system, and the efficiency of service processing can be greatly improved; the service data volume of the batch processing service can reach the service magnitude of tens of millions or even hundreds of millions, and in the embodiment of the invention, the magnitude of the service data of the batch processing service is not particularly limited. Particularly, in the embodiment of the present invention, the batch processing service includes a service (e.g., a web service) that needs to be processed immediately, that is, the time for acquiring the current service is the time for processing the current service; the method also comprises the service (timing scheduling service) which needs to be processed at a specific time, namely the current service is processed only when the corresponding specific time is reached regardless of the time for acquiring the current service, so that the flexible processing of different types of batch processing services is realized.
The target batch processing service group refers to a set of all batch processing services to be processed corresponding to the current time, and the number of the batch processing services in the target batch processing service group may be one or more. The execution time corresponding to all the batch processing services contained in the target batch processing service group is the current time, and when the target batch processing service group only contains one batch processing service, the current time only corresponds to one batch processing service to be processed; when the target batch processing service group comprises a plurality of batch processing services, the target batch processing service group indicates that a plurality of batch processing services need to be processed at the current moment. When the server obtains the batch processing service through the application program, the target batch processing service group is formed according to the batch processing service of which the corresponding execution time is the current time, so that the batch processing service is intensively processed, the service processing efficiency can be further improved, and the service carrying capacity of the server can be further improved.
The target service to be processed refers to the batch processing service which needs to be processed currently; when the number of the to-be-processed services contained in the target batch processing service group is small (for example, less than 10) and does not exceed the maximum processing capacity of the server, determining all the to-be-processed services at the current moment as target to-be-processed services, that is, processing all the to-be-processed services simultaneously; when the number of the to-be-processed services contained in the target batch processing service group is large (for example, more than 100), and exceeds the maximum processing capacity of the server, and the number of the to-be-processed services exceeds the maximum load capacity of the service processing system, all the to-be-processed services can be batched, and the to-be-processed services are processed according to batches, respectively, for example, the number of the to-be-processed services contained in the target batch processing service group is 300, and the maximum simultaneous service processing number of the system is 100, the to-be-processed services are divided into 3 batches to be processed sequentially, and the to-be-processed services of the current to-be-processed batch are the target to-be-processed; by determining the target to-be-processed service in the target batch processing service group, the effective processing of the target to-be-processed service can be ensured.
Optionally, in the embodiment of the present invention, the method may further include: and when the service to be processed is obtained, obtaining the execution time of the service to be processed, and adding the service to be processed into a corresponding batch processing service group according to the execution time of the service to be processed. Specifically, when each service to be processed is obtained, the execution time corresponding to each service to be processed is obtained at the same time, and if the service to be processed needs to be executed in real time, the current service to be processed is added to the batch processing service group corresponding to the current moment; and if the service to be processed is executed regularly, adding the current service to be processed into the batch processing service group corresponding to the specific moment. Particularly, in the embodiment of the present invention, if there is no corresponding batch processing service group at the execution time of a certain service to be processed, a service group may be newly created, and the service to be processed currently is added to the newly created service group; correspondingly, when all the batch processing services in a certain batch processing service group are completely executed, the current batch processing service group is deleted, and the occupation of the storage space is avoided. By matching each service to be processed with the corresponding batch processing service group, a large amount of services to be processed can be processed in a centralized manner, and the processing efficiency of the batch services to be processed is further improved.
S120, acquiring a service file of the target service to be processed, and analyzing the service file to acquire corresponding service data.
The service file refers to file data corresponding to a target service to be processed; the service file can be attached to the service to be processed, so that the service file corresponding to the service to be processed can be obtained while the service to be processed is obtained; specifically, the service file includes an existing file uploaded manually and a file generated by manual entry. Optionally, in this embodiment of the present invention, the service file includes: comma separated value files, plain text files, and spreadsheet files; the Comma-Separated Values (CSv) file is a file for storing table data in a pure text form, and has strong universality and is relatively simple; a plain text file (TXT), a text format file without any text embellishment; a spreadsheet file, which refers to a file that stores data in the form of cells organized in a row and column format; the three file formats almost cover all daily files in the field of data processing, and in the embodiment of the invention, file analysis and data processing can be carried out on various acquired business files, so that the universality of a file processing system is ensured; meanwhile, the user is supported to upload the task file in various ways, and the use experience of the user is enhanced.
Optionally, in this embodiment of the present invention, the obtaining a service file of the target service to be processed may further include: and acquiring a file screening instruction, and acquiring a service file matched with the target service to be processed in a database according to the file screening instruction. The file screening instruction refers to a file searching and searching command input by a user; the database is also called as a data management system, data is stored together according to a certain mode, a plurality of users can share and reduce the data set of redundancy as much as possible, and the users can operate operations such as adding, deleting, modifying, searching and the like on the data in the database; in the embodiment of the invention, the database comprises MySQL, FastDFS and Redis; MySQL is an open-source small database management system and has the characteristics of small volume, high speed and low total cost; the FastDFS is an open source distributed file system and has the advantage of supporting a large number of concurrent accesses; redis is a database for storing data in a key value pair form, and can realize rapid query of the data under the condition of massive concurrent access; by adopting the database to store the service files, the service files matched with the target service to be processed can be quickly found in the database after the file screening instruction is obtained. When the service to be processed does not have the service file, the matched service file can be obtained in the database through the file screening instruction, so that the flexible obtaining of the service file is realized.
The service data refers to a data part related to data processing in the service file; in particular, the service file may include other data information besides service data, that is, unnecessary data information, that is, data irrelevant to data processing, for example, the total amount of the order payment of all the users on the current day is calculated for the current service to be processed, the task file is the order of all the users on the current day, each order includes an order number, a receiving address, remark information, payment information, and the like, and the payment information in each order is only needed for calculating the total amount of the order payment on the current day, so that other data irrelevant to the current task can be screened out. After the service file corresponding to the service to be processed is obtained, the task-related data is extracted and screened from the service file, so that a data part related to subsequent data processing is obtained as the service data, unnecessary data parts contained in the service data can be avoided, and the efficiency of service processing can be further improved.
S130, judging whether the service data accord with a preset data display rule or not, and acquiring a service data table corresponding to the service data when the service data accord with the preset data display rule.
A service data table, which refers to data in a table form corresponding to service data; particularly, in the embodiment of the present invention, after it is determined that the obtained service data conforms to the preset data display rule, the service data is stored in the database, and if problems such as data processing abnormality occur subsequently and processing of corresponding service data needs to be performed again, the corresponding service data can be directly obtained in the database, so that the user is prevented from repeatedly uploading the same service file, user experience is improved, and meanwhile, service processing efficiency is improved; the data in the database are stored in a table form, so that a service data table corresponding to the service data is obtained; by acquiring the corresponding service data table according to the service data and then performing data processing on the service data table, rapid query and processing of a large amount of service data can be realized, and further the efficiency of batch service processing is improved.
Specifically, after the service data is acquired, because the acquired service file may have problems such as uploading error or entry error, the acquired service data can be judged whether to be correct according to a preset data display rule; and only when the current business data are determined to accord with the preset data display rule, acquiring a corresponding business data table which accords with the storage form of the database according to the current business data, and further processing the business data table so as to realize the processing of the current business to be processed. Optionally, after determining whether the service data conforms to the preset data display rule, the method may further include: and if the service data is determined not to accord with the preset data display rule, giving up the target service to be processed, and sending prompt information to the user. By giving up the service data which do not conform to the preset data display rule in time, the occupation of invalid service data on the storage space can be reduced, and the service processing efficiency can be improved.
Optionally, in this embodiment of the present invention, the determining whether the service data meets a preset data display rule may include: and extracting specific field information from the service data, and judging whether the specific field information comprises preset characters and/or judging whether the specific field information conforms to a preset field format. Specifically, whether the current service data meets a preset data display rule is judged, and whether the specific field information in the service data comprises a preset character can be judged; for example, the service data is a user order, the specific field information is a user order number, and whether the service data meets a preset data display rule is determined by judging whether the user order number comprises a specific letter; whether the specific field information conforms to a preset field format or not can also be judged, for example, the specific field information is a user order number, a preset order number format (for example, a combination of the order number length and specific alphanumerics) is set, and whether the service data conforms to a preset data display rule or not is determined by judging whether the user order number conforms to the preset order number format or not. Particularly, in the embodiment of the present invention, any one of the above judgment criteria may be selected to determine whether the service data meets a preset data display rule, that is, the service data meets the corresponding judgment criteria, that is, the service data is correct; the two judgment criteria can also be selected simultaneously to determine whether the service data meets the preset data display rule, that is, the service data can be determined to be correct only if the service data meets the two judgment criteria simultaneously. The business data is judged through the preset data display rule, and the accuracy of the business data can be ensured.
S140, acquiring a service processing logic corresponding to the target service to be processed, and performing data processing on the service data table according to the service processing logic to acquire a data processing result of the target service to be processed.
The service processing logic is mathematical logic used for processing the service data table, and can be a combination of a series of mathematical operations; before service processing, corresponding service processing logic can be configured in advance for different types of services to be processed. Specifically, after a target service to be processed is obtained, a service processing logic matched with the target service to be processed is obtained according to the pre-configuration information of the service processing logic and the service type of the target service to be processed; and calling a rapid calculation engine, and performing data processing on the service data table according to the acquired matched service processing logic to acquire a data processing result. Wherein, the computing engine comprises Apache Spark; apache Spark, a fast computing engine specially designed for large-scale data processing, can execute processing of hundred million levels of data in a short time, reduces the time spent on processing a target service to be processed, and further improves the efficiency of service processing.
Optionally, in the embodiment of the present invention, after obtaining the data processing result of the target service to be processed, the method may further include: generating a data display file according to the data processing result of the target service to be processed, adding a data identifier in the data display file according to the abnormal judgment result of the data processing result, and sending the data display file with the identifier to a target user; the data identification comprises a data normal identification or a data abnormal identification. The data display file refers to a display file of a data processing result; specifically, after the target to-be-processed service is processed, a corresponding data display file is generated according to the data processing result, and the data display file is sent to the user in a short message or enterprise WeChat mode, so that the user can check the data processing result in time.
In addition, in the process of processing the service data table, because the data volume processed at the same time is too large, a situation of calculation error may exist; after a data processing result of the target service to be processed is obtained, judging the abnormality of the data processing result, and adding the abnormality judging result as a data identifier into a data display file; particularly, when the data processing result is abnormal, the data abnormal identifier is added to the data display file and is sent to the target user, and meanwhile, the warning information is sent to the target user to prompt that the processing result of the current service to be processed is abnormal. The data processing result of the current service to be processed is sent to the target user in a file form, so that the target user can obtain the processing result of the service to be processed in time, and meanwhile, the abnormal condition of the data processing result is identified in the display file, so that the target user can determine whether to perform the processing of the corresponding service again according to the identification.
The determining the abnormality of the data processing result may include: and performing numerical analysis on the data processing result, and determining that the current data processing result is abnormal if the numerical value of the data processing result exceeds a preset result threshold value and/or if the format of the numerical value of the data processing result is inconsistent with the preset result format. By judging the abnormity of the data processing result through the method, the abnormity of the data processing result can be accurately judged, and the accuracy of service processing is improved.
According to the technical scheme provided by the embodiment of the invention, after the target batch processing service group to be processed at the current moment is obtained, and the target service to be processed in the target batch processing service group is obtained; acquiring a service file of a target service to be processed, and analyzing the service file to acquire corresponding service data; when the business data are determined to accord with the preset data display rule, a business data table corresponding to the business data is obtained; the method comprises the steps of obtaining service processing logic corresponding to a target service to be processed, carrying out data processing on a service data table according to the service processing logic to obtain a data processing result of the target service to be processed, achieving batch processing of the service to be processed, carrying out data processing on the service data table through preset service processing logic to obtain the data processing result, reducing processing time required by batch service processing, and improving processing efficiency of the batch service.
Example two
Fig. 2 is a flowchart of a service processing method according to a second embodiment of the present invention, which is embodied on the basis of the foregoing embodiment, and in this embodiment, after sending the data display file with the identifier added to the target user, the service to be processed is continuously processed according to instruction information of the target user, where the method specifically includes:
s201, obtaining a target batch processing service group to be processed at the current moment, obtaining a target service to be processed in the target batch processing service group, and executing S202.
S202, acquiring a service file of the target service to be processed, analyzing the service file to acquire corresponding service data, and executing S203.
S203, judging whether the service data accords with a preset data display rule.
If the business data are determined to accord with the preset data display rule, S204 is executed; if it is determined that the service data does not conform to the preset data display rule, S205 is executed.
And S204, acquiring a service data table corresponding to the service data, and executing S206.
S205, abandoning the target service to be processed, and executing S210.
S206, acquiring a service processing logic corresponding to the target service to be processed, performing data processing on the service data table according to the service processing logic to acquire a data processing result of the target service to be processed, and executing S207.
S207, generating a data display file according to the data processing result of the target service to be processed, adding a data identifier in the data display file according to the abnormal judgment result of the data processing result, sending the data display file with the identifier added to a target user, and executing S208.
And S208, judging whether the data confirmation instruction of the target user is acquired within preset time.
If the data confirmation instruction of the target user is acquired within the preset time, executing S209; and if the data confirmation instruction of the target user is not acquired within the preset time, returning to execute S206.
Specifically, if a data update instruction of a target user is obtained or a data confirmation instruction of the target user is not obtained within a preset time, a service processing logic corresponding to a target service to be processed is continuously obtained, and data processing is performed on a service data table according to the service processing logic to obtain a data processing result of the target service to be processed. And generating a data display file according to the data processing result of the target service to be processed, adding a data identifier in the generated data display file according to the abnormal judgment result of the data processing result, and sending the data display file with the identifier added to a target user until a data confirmation instruction of the target user is obtained.
The data confirmation instruction refers to instruction information for confirming that a data processing result sent by a target user meets requirements, and is used for finishing processing of the current target service to be processed. Specifically, after the data display file added with the identifier is sent to the target user, if a data confirmation instruction of the target user is obtained within a preset time, the processing of the current target service to be processed is finished; particularly, the identifier added to the data display file may be a normal identifier or an abnormal identifier; namely, whether the exception judgment result of the current data processing result is normal or abnormal, the processing of the target service to be processed is finished as long as the user sends a data confirmation instruction.
The data updating instruction refers to instruction information sent by the user to confirm that the current service needs to be processed again. Specifically, if a data update instruction of a target user is obtained, or a data confirmation instruction from the target user is not obtained within a preset time, it indicates that the current target user needs to re-process the current service; and acquiring a service data table corresponding to the current service from the database, acquiring matched service processing logic according to the target service to be processed, and performing data processing on the service data table again according to the service processing logic to acquire a new data processing result. The target to-be-processed service is processed again according to the instruction information corresponding to the target user to obtain a satisfactory data processing result of the target user, so that the user experience is further improved.
S209, confirming that the target service to be processed is processed, and executing S210.
And S210, ending.
According to the technical scheme provided by the embodiment of the invention, the target service to be processed at the current moment is processed, and the data processing result of the target service to be processed is obtained; generating a data display file added with an identifier according to a data processing result, sending the data display file to a target user, and further continuing to process a target service to be processed according to instruction information of the target user until a data confirmation instruction of the target user is obtained; the method and the device realize batch processing of the services to be processed, simultaneously perform subsequent processing and termination of the target services to be processed according to the instruction information of the user, ensure that the acquired data processing result can meet the requirements of the user, and improve the user experience.
EXAMPLE III
Fig. 3A is a schematic structural diagram of a service processing system according to a third embodiment of the present invention, where the system may execute a service processing method according to any embodiment of the present invention, and the service processing system includes: an access layer, a service layer and a base layer;
the access layer is used for accessing the background management page service and the timing scheduling service of the application program; the service layer comprises a file analysis module and a task processing module, wherein the file analysis module is used for reading the service file, writing the service file, uploading the service file and downloading the service file; specifically, as shown in fig. 3B, the file parsing module includes a file obtaining unit and a file parsing unit, where the file obtaining unit is configured to obtain a service file that is manually uploaded, a service file that is manually input and/or a service file that is generated by system screening; the file analysis unit is used for analyzing the obtained comma separated value file and the plain text file so as to obtain corresponding service data; the task processing module is used for verifying the service data, namely judging whether the service data accords with a preset data display rule, and processing the service data, namely calculating the service data acquired from the database according to the matched service processing logic; specifically, as shown in fig. 3B, the task processing module includes a task processing unit and a result processing unit; the task processing unit is used for task addition and task execution, and the executable tasks comprise a contract task, a matching task, an auditing task and a payment-for-replacement task; the result processing unit is used for writing the data processing result into the data display file and sending the data display file to a target user for result notification; and the base layer is used for storing and managing all data in the business processing system, including MySQL, FastDFS and Redis.
Specifically, fig. 3C is a schematic flow chart of a service processing method applied to the service processing system; when the service to be processed is obtained, the file obtaining unit obtains a service file, and the service file corresponding to the service to be processed is analyzed through the file analyzing unit to obtain corresponding service data; verifying whether the service data conform to a preset data format and specification or not through the task processing unit, and writing the service data into a FastDFS database by the file analyzing unit when the service data conform to the preset data format and specification, and simultaneously acquiring a service data table corresponding to the service data; analyzing, segmenting and extracting the service data table through a file analyzing unit; acquiring a service processing logic corresponding to the target service to be processed through the task processing unit, and performing data processing on the service data table according to the service processing logic to acquire a data processing result of the target service to be processed; and the result processing unit generates a data display file according to the data processing result, performs exception judgment on the data processing result, acquires a corresponding data identifier, adds the corresponding data identifier to the corresponding data display file, and sends the data display file to a target user for result notification.
According to the technical scheme provided by the embodiment of the invention, after the target batch processing service group to be processed at the current moment is obtained, and the target service to be processed in the target batch processing service group is obtained; acquiring corresponding service data, and acquiring a service data table corresponding to the service data when the service data is determined to accord with a preset data display rule; the method comprises the steps of obtaining service processing logic corresponding to a target service to be processed, performing data processing on a service data table according to the service processing logic to obtain a data processing result of the target service to be processed, achieving batch processing of the service to be processed, and performing data processing on the service data table through preset service processing logic to obtain the data processing result, so that processing time required by batch service processing is reduced, and processing efficiency of the batch service is improved; furthermore, a data display file with a data identifier is generated according to the data processing result, and the data display file is sent to the target user, so that the user can acquire the data processing result.
Example four
Fig. 4 is a block diagram of a service processing apparatus according to a fourth embodiment of the present invention, where the apparatus specifically includes: a target to-be-processed service acquisition module 410, a service data acquisition module 420, a service data table acquisition module 430 and a data processing result acquisition module 440;
a target to-be-processed service acquisition module 410, configured to acquire a target batch processing service group to be processed at a current time, and acquire a target to-be-processed service in the target batch processing service group;
a service data obtaining module 420, configured to obtain a service file of the target service to be processed, and parse the service file to obtain corresponding service data;
a service data table obtaining module 430, configured to determine whether the service data conforms to a preset data display rule, and obtain a service data table corresponding to the service data when it is determined that the service data conforms to the preset data display rule;
the data processing result obtaining module 440 is configured to obtain a service processing logic corresponding to the target service to be processed, and perform data processing on the service data table according to the service processing logic to obtain a data processing result of the target service to be processed.
According to the technical scheme provided by the embodiment of the invention, after the target batch processing service group to be processed at the current moment is obtained, and the target service to be processed in the target batch processing service group is obtained; acquiring a service file of a target service to be processed, and analyzing the service file to acquire corresponding service data; when the business data are determined to accord with the preset data display rule, a business data table corresponding to the business data is obtained; the method comprises the steps of obtaining service processing logic corresponding to a target service to be processed, carrying out data processing on a service data table according to the service processing logic to obtain a data processing result of the target service to be processed, achieving batch processing of the service to be processed, carrying out data processing on the service data table through preset service processing logic to obtain the data processing result, reducing processing time required by batch service processing, and improving processing efficiency of the batch service.
Optionally, on the basis of the foregoing technical solution, the service processing apparatus further includes:
and the execution time acquisition module is used for acquiring the execution time of the service to be processed when the service to be processed is acquired, and adding the service to be processed into a corresponding batch processing service group according to the execution time of the service to be processed.
Optionally, on the basis of the foregoing technical solution, the service processing apparatus further includes:
the file sending module is used for generating a data display file according to the data processing result of the target service to be processed, adding a data identifier in the data display file according to the abnormal judgment result of the data processing result, and sending the data display file added with the identifier to a target user; the data identification comprises a data normal identification or a data abnormal identification.
Optionally, on the basis of the foregoing technical solution, the service processing apparatus further includes:
and if the data confirmation instruction of the target user is acquired within the preset time, confirming that the target service to be processed is processed.
Optionally, on the basis of the foregoing technical solution, the data processing result obtaining module 440 is further configured to, if a data update instruction of the target user is obtained or a data confirmation instruction of the target user is not obtained within a preset time, continue to obtain a service processing logic corresponding to the target service to be processed, and perform data processing on the service data table according to the service processing logic to obtain a data processing result of the target service to be processed;
and the file sending module is further used for generating a data display file according to the data processing result of the target service to be processed, adding a data identifier in the data display file according to the abnormal judgment result of the data processing result, and sending the data display file with the identifier added to a target user until a data confirmation instruction of the target user is obtained.
Optionally, on the basis of the foregoing technical solution, the service data obtaining module 420 is specifically configured to obtain a file screening instruction, and obtain a service file matched with the target service to be processed in a database according to the file screening instruction.
Optionally, on the basis of the foregoing technical solution, the service data table obtaining module 430 is specifically configured to extract specific field information from the service data, and determine whether the specific field information includes a preset character, and/or determine whether the specific field information conforms to a preset field format.
Optionally, on the basis of the above technical solution, the service file includes: comma separated value files, plain text files, and spreadsheet files.
The device can execute the service processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method. For technical details not described in detail in this embodiment, reference may be made to the method provided in any embodiment of the present invention.
EXAMPLE five
Fig. 5 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention. FIG. 5 illustrates a block diagram of an exemplary electronic device 12 suitable for use in implementing embodiments of the present invention. The electronic device 12 shown in fig. 5 is only an example and should not bring any limitation to the function and the scope of use of the embodiment of the present invention.
As shown in FIG. 5, electronic device 12 is embodied in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a memory 28, and a bus 18 that couples various system components including the memory 28 and the processing unit 16.
The memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, and commonly referred to as a "hard drive"). Although not shown in FIG. 5, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
The processing unit 16 executes various functional applications and data processing, such as a processing method for implementing a service provided by any embodiment of the present invention, by executing a program stored in the memory 28. Namely: acquiring a target batch processing service group to be processed at the current moment, and acquiring a target service to be processed in the target batch processing service group; acquiring a service file of the target service to be processed, and analyzing the service file to acquire corresponding service data; judging whether the service data accord with a preset data display rule or not, and acquiring a service data table corresponding to the service data when the service data accord with the preset data display rule is determined; and acquiring a service processing logic corresponding to the target service to be processed, and performing data processing on the service data table according to the service processing logic to acquire a data processing result of the target service to be processed.
EXAMPLE six
The sixth embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a service processing method according to any embodiment of the present invention; the method comprises the following steps:
acquiring a target batch processing service group to be processed at the current moment, and acquiring a target service to be processed in the target batch processing service group;
acquiring a service file of the target service to be processed, and analyzing the service file to acquire corresponding service data;
judging whether the service data accord with a preset data display rule or not, and acquiring a service data table corresponding to the service data when the service data accord with the preset data display rule is determined;
and acquiring a service processing logic corresponding to the target service to be processed, and performing data processing on the service data table according to the service processing logic to acquire a data processing result of the target service to be processed.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A method for processing a service, comprising:
acquiring a target batch processing service group to be processed at the current moment, and acquiring a target service to be processed in the target batch processing service group;
acquiring a service file of the target service to be processed, and analyzing the service file to acquire corresponding service data;
judging whether the service data accord with a preset data display rule or not, and acquiring a service data table corresponding to the service data when the service data accord with the preset data display rule is determined;
and acquiring a service processing logic corresponding to the target service to be processed, and performing data processing on the service data table according to the service processing logic to acquire a data processing result of the target service to be processed.
2. The method of claim 1, further comprising:
and when the service to be processed is obtained, obtaining the execution time of the service to be processed, and adding the service to be processed into a corresponding batch processing service group according to the execution time of the service to be processed.
3. The method according to claim 1, further comprising, after obtaining the data processing result of the target service to be processed:
generating a data display file according to the data processing result of the target service to be processed, adding a data identifier in the data display file according to the abnormal judgment result of the data processing result, and sending the data display file with the identifier to a target user; the data identification comprises a data normal identification or a data abnormal identification.
4. The method of claim 3, after sending the data presentation file with the identifier added to the target user, further comprising:
if the data confirmation instruction of the target user is acquired within the preset time, confirming that the target service to be processed is processed;
if the data updating instruction of the target user is obtained or the data confirmation instruction of the target user is not obtained within the preset time, continuing to obtain a service processing logic corresponding to the target service to be processed, and performing data processing on the service data table according to the service processing logic to obtain a data processing result of the target service to be processed;
and generating a data display file according to the data processing result of the target service to be processed, adding a data identifier in the data display file according to the abnormal judgment result of the data processing result, and sending the data display file with the identifier added to a target user until a data confirmation instruction of the target user is obtained.
5. The method according to claim 1, wherein the obtaining the service file of the target service to be processed comprises:
and acquiring a file screening instruction, and acquiring a service file matched with the target service to be processed in a database according to the file screening instruction.
6. The method of claim 1, wherein the determining whether the service data complies with a preset data presentation rule comprises:
and extracting specific field information from the service data, and judging whether the specific field information comprises preset characters and/or judging whether the specific field information conforms to a preset field format.
7. The method according to any of claims 1-6, wherein the service file comprises: comma separated value files, plain text files, and spreadsheet files.
8. An apparatus for processing traffic, comprising:
the system comprises a target to-be-processed service acquisition module, a target batch processing service acquisition module and a target batch processing service processing module, wherein the target to-be-processed service acquisition module is used for acquiring a target batch processing service group to be processed at the current moment and acquiring a target to-be-processed service in the target batch processing service group;
the service data acquisition module is used for acquiring a service file of the target service to be processed and analyzing the service file to acquire corresponding service data;
the service data table acquisition module is used for judging whether the service data accord with a preset data display rule or not and acquiring a service data table corresponding to the service data when the service data accord with the preset data display rule is determined;
and the data processing result acquisition module is used for acquiring the service processing logic corresponding to the target service to be processed and carrying out data processing on the service data table according to the service processing logic so as to acquire the data processing result of the target service to be processed.
9. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a method of processing a service as claimed in any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out a method of processing a service according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110266735.9A CN112860706A (en) | 2021-03-11 | 2021-03-11 | Service processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110266735.9A CN112860706A (en) | 2021-03-11 | 2021-03-11 | Service processing method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112860706A true CN112860706A (en) | 2021-05-28 |
Family
ID=75994101
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110266735.9A Pending CN112860706A (en) | 2021-03-11 | 2021-03-11 | Service processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112860706A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112905635A (en) * | 2021-03-11 | 2021-06-04 | 深圳市分期乐网络科技有限公司 | Service processing method, device, equipment and storage medium |
| CN116431742A (en) * | 2023-06-09 | 2023-07-14 | 合肥青谷信息科技有限公司 | Method and device for processing business data with large data volume and electronic equipment |
| CN116720202A (en) * | 2023-05-19 | 2023-09-08 | 国网物资有限公司 | Service information detection method, device, electronic equipment and computer readable medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100161549A1 (en) * | 2008-12-19 | 2010-06-24 | Microsoft Corporation | Masterless distributed batch scheduling engine |
| CN110765102A (en) * | 2019-09-25 | 2020-02-07 | 苏宁云计算有限公司 | Service data processing method and device, computer equipment and storage medium |
| CN112199423A (en) * | 2020-09-01 | 2021-01-08 | 河钢数字技术股份有限公司 | ETL data quality judgment and feedback method |
-
2021
- 2021-03-11 CN CN202110266735.9A patent/CN112860706A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100161549A1 (en) * | 2008-12-19 | 2010-06-24 | Microsoft Corporation | Masterless distributed batch scheduling engine |
| CN110765102A (en) * | 2019-09-25 | 2020-02-07 | 苏宁云计算有限公司 | Service data processing method and device, computer equipment and storage medium |
| CN112199423A (en) * | 2020-09-01 | 2021-01-08 | 河钢数字技术股份有限公司 | ETL data quality judgment and feedback method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112905635A (en) * | 2021-03-11 | 2021-06-04 | 深圳市分期乐网络科技有限公司 | Service processing method, device, equipment and storage medium |
| CN116720202A (en) * | 2023-05-19 | 2023-09-08 | 国网物资有限公司 | Service information detection method, device, electronic equipment and computer readable medium |
| CN116720202B (en) * | 2023-05-19 | 2024-03-29 | 国网物资有限公司 | Service information detection method, device, electronic equipment and computer readable medium |
| CN116431742A (en) * | 2023-06-09 | 2023-07-14 | 合肥青谷信息科技有限公司 | Method and device for processing business data with large data volume and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112860706A (en) | Service processing method, device, equipment and storage medium | |
| CN112162965B (en) | Log data processing method, device, computer equipment and storage medium | |
| CN111709527A (en) | Operation and maintenance knowledge map library establishing method, device, equipment and storage medium | |
| CN110955640A (en) | Cross-system data file processing method, device, server and storage medium | |
| CN110222046B (en) | List data processing method, device, server and storage medium | |
| CN109460363B (en) | Automatic testing method and device, electronic equipment and computer readable medium | |
| CN111367982A (en) | Method and device for importing TRIRIGA basic data, computer equipment and storage medium | |
| CN116644035B (en) | File batch warehousing method, device, equipment and storage medium | |
| CN113448869A (en) | Method and device for generating test case, electronic equipment and computer readable medium | |
| CN112948396A (en) | Data storage method and device, electronic equipment and storage medium | |
| CN110515954B (en) | Data processing method, device, equipment and storage medium | |
| CN111367813A (en) | Automatic testing method and device for decision engine, server and storage medium | |
| CN112905635A (en) | Service processing method, device, equipment and storage medium | |
| CN112148705A (en) | Data migration method and device | |
| CN113111078B (en) | Resource data processing method and device, computer equipment and storage medium | |
| CN112818204B (en) | Service processing method, device, equipment and storage medium | |
| CN113139881B (en) | Method, device, equipment and storage medium for identifying main power supply of dual-power-supply user | |
| CN113778977A (en) | Data processing method and data processing device | |
| CN113722007A (en) | Configuration method, device and system of VPN branch equipment | |
| CN112925840A (en) | Data export method, system, device and storage medium | |
| CN112527467B (en) | Storage structure, query method, deletion method, device, equipment and medium of container mirror image | |
| CN118132218A (en) | Task processing method and device, electronic equipment and storage medium | |
| CN114416781A (en) | Data searching method and device, electronic equipment and storage medium | |
| CN115423329A (en) | Order evaluation processing method, system, equipment and medium | |
| CN116881247A (en) | Service identifier generation method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |