CN115658790A - Data processing system, method and device - Google Patents
Data processing system, method and device Download PDFInfo
- Publication number
- CN115658790A CN115658790A CN202211362849.4A CN202211362849A CN115658790A CN 115658790 A CN115658790 A CN 115658790A CN 202211362849 A CN202211362849 A CN 202211362849A CN 115658790 A CN115658790 A CN 115658790A
- Authority
- CN
- China
- Prior art keywords
- data information
- pieces
- data
- platform
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
A data processing system, a method and a device are applied to the field of big data and used for improving timeliness of data processing. The data processing system comprises a data platform, an auxiliary platform, a host platform and a database which are sequentially connected, wherein when data are processed, N pieces of first data information are obtained by the data platform, then the N pieces of first data information are transcoded into N pieces of second data information by the auxiliary platform, then the N pieces of second data information are verified by the host platform, and M pieces of second data information which pass the verification are written into the database. Through setting up data platform and auxiliary platform in the system, data platform can acquire data information at any time, and then combines auxiliary platform and host computer platform to accomplish transcoding and the check-up to data information, and need not rely on the host computer platform to do unified batch processing, and this helps realizing data information's real-time processing, improves data processing's timeliness.
Description
Technical Field
The present invention relates to the field of big data, and in particular, to a data processing system, method, and apparatus.
Background
With the rapid development of the financial industry, stocks are popular among investors as one of the ways to manage money. The dividend sending refers to that the share company sends dividend according to the net profit condition of the company, wherein the cash dividend can be sent in a check form.
At this stage, the dividend check registration mechanism is usually a batch daily dividend check registration service or a batch time-based dividend check registration service. The end-of-day batch processing refers to batch processing of the check registration service at 22 o 'clock in the evening to 5 o' clock in the morning. The regular batch processing means batch processing of the dividend check registration service at fixed time points set every day, for example, 9 am, 12 am, and 5 pm every day. Therefore, the registration mechanism is poor in timeliness no matter the batch processing is finished every day or is performed regularly, and the method cannot meet the increasing demand of the stock information service.
In summary, there is a need for a data processing system for improving the timeliness of data processing (e.g., dividend check).
Disclosure of Invention
The invention provides a data processing system, a method and a device, which are used for improving the timeliness of data (such as dividend checks) processing.
In a first aspect, the present invention provides a data processing system comprising: the system comprises a data platform, an auxiliary platform, a host platform and a database which are sequentially connected, wherein the data platform is used for acquiring N pieces of first data information, the auxiliary platform is used for transcoding the N pieces of first data information to acquire N pieces of second data information, the host platform is used for verifying the N pieces of second data information and writing M pieces of second data information which pass the verification into the database, and the database is used for storing the M pieces of second data information. The N pieces of second data information correspond to the N pieces of first data information one to one, where N is a positive integer, and M is a positive integer less than or equal to N.
Based on the scheme, the data platform can acquire data information at any time; the auxiliary platform transcodes the data information to the data information which can be identified by the host platform; the host platform checks the transcoded data information and writes the data information passing the check into a database; the database stores the M pieces of second data information passing the verification; therefore, the data platform and the auxiliary platform are arranged in the system, the data platform can acquire data information at any time, and then the auxiliary platform and the host platform are combined to complete transcoding and checking of the data information, and the host platform does not need to be relied on to perform uniform batch processing, so that real-time processing of the data information is facilitated, and timeliness of data processing is improved.
Optionally, the host platform is further configured to: and recording N-M pieces of second data information except the M pieces of second data information in the N pieces of second data information.
In the above scheme, the host platform may further record N-M pieces of second data information other than the M pieces of second data information, that is, N-M pieces of second data information that fails to be verified, so that the second data information that fails to be verified may be scheduled as needed, so as to facilitate the auditor to perform inspection and correction.
Illustratively, the host platform may record the N-M pieces of second data information that fail the verification to the result file.
Optionally, the auxiliary platform is further configured to: transcoding the N-M pieces of second data information to obtain N-M pieces of third data information; and transmitting the N-M pieces of third data information to the data platform.
Based on the scheme, the auxiliary platform transcodes the N-M pieces of second data information to N-M pieces of third data information which can be identified by the data platform and transmits the N-M pieces of third data information to the data platform. That is, the auxiliary platform transcodes the result file into a result file which can be identified by the data platform and transmits the identified result file to the data platform, so that the data platform can feed back the processing result of the uploaded dividend check file in real time.
Optionally, the data platform comprises a front end and a back end: the front end is used for acquiring the N pieces of first data information uploaded by the interface; the back end is used for transmitting the N pieces of first data information to the auxiliary platform.
In the above scheme, the front end of the data platform may obtain N pieces of first data information uploaded on the interface and transmit the N pieces of first data information to the back end. And the rear end receives the N pieces of first data information sent by the front end and transmits the N pieces of first data information to the auxiliary platform to realize subsequent operation.
Optionally, the front end is configured to obtain the N pieces of first data information in real time.
In the scheme, the front end can acquire N pieces of first data information uploaded by the interface in real time, so that the problem of poor timeliness of a dividend check registration mechanism in the prior art is solved.
Optionally, the front end includes a file uploading interface, a progress querying interface, a file deleting interface, and a file updating interface.
In the scheme, the file uploading interface is used for realizing the function of uploading the dividend check file, the inquiry progress interface is used for realizing the progress function of inquiring the uploaded dividend check file, the deletion file interface is used for realizing the function of deleting the uploaded dividend check file, and the update file interface is used for realizing the function of updating the uploaded dividend check file.
Optionally, the data platform is further configured to obtain fourth data information through a delete file interface on the front end; the auxiliary platform is further used for transcoding the fourth data information into fifth data information; the host platform is further used for verifying the fifth data information and sending the verified fifth data information to the database; the database is further used for deleting the fifth data information passing the verification.
In the scheme, the front end acquires fourth data information to be deleted, namely a dividend check file to be deleted, through a file deletion interface; the auxiliary platform transcodes the fourth data information into fifth data information which can be identified by the host platform; the host platform checks the fifth data information and sends the checked fifth data information to the database; and deleting the fifth data information passing the verification by the database. When wrong dividend check data is recorded in the database, deletion of the wrong dividend check data can be realized by using the scheme. That is, the scheme can realize real-time batch deletion of wrong dividend check data.
Optionally, any one of the pieces of first data information is an UTF-8 code, and any one of the pieces of second data information is an E code; and/or any one piece of the third data information is a UTF-8 code; and/or any one of the fourth data information is a UTF-8 code, and any one of the fifth data information is an E code.
Optionally, any piece of the second data information includes a ticket number, an account number, a detail amount, a date, and a summary amount; the host platform is specifically configured to: for Ren Yitiao second data information, if it is determined that an account number in the second data information matches a historical account number, it is determined that a ticket number in the second data information matches a historical ticket number, it is determined that a format of the second data information matches, it is determined that a detail amount of the second data information matches a summary amount, and it is determined that the second data information passes verification.
In the above scheme, the host platform checks the N pieces of second data information, and can divide the second data information into: the second data information passing the verification and the second data information failing the verification.
Optionally, a format of any one of the pieces of second data information includes: and sorting the ticket number, the account number, the detailed amount, the date and the summary amount in sequence.
In a second aspect, the present invention provides a data processing method, which is applied to a data processing system, where the data processing system includes a data platform, an auxiliary platform, a host platform, and a database, which are connected in sequence, and the method includes: acquiring N pieces of first data information through the data platform, wherein N is a positive integer; transcoding the N pieces of first data information through the auxiliary platform to obtain N pieces of second data information, wherein the N pieces of second data information correspond to the N pieces of first data information one by one; verifying the N pieces of second data information through the host platform, and writing the verified M pieces of second data information into the database, wherein M is a positive integer less than or equal to N; and storing the M pieces of second data information through the database.
Optionally, the method further includes: and recording N-M pieces of second data information except the M pieces of second data information in the N pieces of second data information through the host platform.
Optionally, the method further includes: and transcoding the N-M pieces of second data information through the auxiliary platform to obtain N-M pieces of third data information.
Optionally, the data platform includes a front end and a back end, and the method further includes: acquiring the N pieces of first data information uploaded by an interface through the front end; and transmitting the N pieces of first data information to the auxiliary platform through the rear end.
Optionally, the method further includes: and acquiring the N pieces of first data information in real time through the front end.
Optionally, the front end includes a file uploading interface, a progress querying interface, a file deleting interface, and a file updating interface.
Optionally, the method further includes: acquiring fourth data information through the data platform; transcoding, by the auxiliary platform, the fourth data information into fifth data information; verifying the fifth data information through the host platform, and sending the verified fifth data information to the database; and deleting the fifth data information passing the verification through the database.
Optionally, any one of the pieces of first data information is an UTF-8 code, and any one of the pieces of second data information is an E code; and/or any one piece of the third data information is a UTF-8 code; and/or any one piece of fourth data information is a UTF-8 code, and any one piece of fifth data information is an E code.
Optionally, any piece of the second data information includes a ticket number, an account number, a detail amount, a date, and a summary amount; the verifying the N pieces of second data information by the host platform includes: aiming at Ren Yitiao second data information, the host platform verifies whether an account number in the second data information is matched with a historical account number, the host platform verifies whether a ticket number in the second data information is matched with a historical ticket number, the host platform verifies whether the format of the second data information is matched, and the host platform verifies whether the detail amount and the summary amount of the second data information are matched.
Optionally, a format of any one of the second data messages includes: and sorting the ticket number, the account number, the detailed amount, the date and the summary amount in sequence.
In a third aspect, the present invention provides a data processing apparatus comprising: the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring N pieces of first data information, and N is a positive integer; the processing unit is used for transcoding the N pieces of first data information to obtain N pieces of second data information, wherein the N pieces of second data information correspond to the N pieces of first data information one by one; verifying the N pieces of second data information, and writing M pieces of second data information which are verified to pass into a database, wherein M is a positive integer less than or equal to N; and storing the M pieces of second data information.
Optionally, the processing unit is specifically configured to record, by the host platform, N-M pieces of second data information excluding the M pieces of second data information from the N pieces of second data information.
Optionally, the processing unit is specifically configured to transcode the N-M pieces of second data information by using the auxiliary platform to obtain N-M pieces of third data information.
Optionally, the data platform includes a front end and a back end, and the processing unit is specifically configured to obtain the N pieces of first data information uploaded on the interface through the front end; and transmitting the N pieces of first data information to the auxiliary platform through the rear end.
Optionally, the processing unit is specifically configured to obtain the N pieces of first data information in real time through the front end.
Optionally, the front end includes a file uploading interface, a progress querying interface, a file deleting interface, and a file updating interface.
Optionally, the processing unit is specifically configured to obtain fourth data information through the data platform; transcoding, by the auxiliary platform, the fourth data information into fifth data information; verifying the fifth data information through the host platform, and sending the verified fifth data information to the database; and deleting the fifth data information passing the verification through the database.
Optionally, any one of the pieces of first data information is an UTF-8 code, and any one of the pieces of second data information is an E code; and/or any one piece of the third data information is a UTF-8 code; and/or any one of the fourth data information is a UTF-8 code, and any one of the fifth data information is an E code.
Optionally, any piece of the second data information includes a ticket number, an account number, a detail amount, a date, and a summary amount; the processing unit is specifically configured to check, by the host platform, whether an account number in the second data information matches a historical account number, check, by the host platform, whether a ticket number in the second data information matches a historical ticket number, check, by the host platform, whether a format of the second data information matches, and check, by the host platform, whether a detail amount and a summary amount of the second data information match, for the second data information Ren Yitiao.
Optionally, a format of any one of the second data messages includes: and sorting the ticket number, the account number, the detailed amount, the date and the summary amount in sequence.
In a fourth aspect, the present invention provides a computing device comprising at least one processor and at least one memory, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the data processing method of any of the second aspects.
In a fifth aspect, the present invention also provides a computer-readable storage medium storing a program which, when run on a computer, causes the computer to implement a method of processing data according to any of the second aspects described above.
In a sixth aspect, the present invention also provides a computer program product comprising computer readable instructions which, when executed by a processor, cause the method described in any one of the possible designs of the second aspect to be carried out.
For the beneficial effects of the second aspect to the sixth aspect, please refer to the technical effects that can be achieved by the corresponding design in the first aspect, and the detailed description is omitted here.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a schematic structural diagram of a data processing system according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a data platform according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of a data processing method according to an embodiment of the present invention;
FIG. 4 is an interaction diagram of a possible front end according to an embodiment of the present invention;
FIG. 5 is an interaction diagram of a possible front end according to an embodiment of the present invention;
FIG. 6 is an interaction diagram of a possible front end according to an embodiment of the present invention;
FIG. 7 is an interaction diagram of a possible front end according to an embodiment of the present invention;
FIG. 8 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a computing device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In overseas financial transactions, cash stock information may be distributed in the form of checks. Currently, the dividend check registration mechanism is usually a batch daily dividend check registration service or a batch time-based dividend check registration service. The stock interest check registration mechanism has poor timeliness and cannot meet the increasing stock interest dispatching business. In view of this, an embodiment of the present invention provides a data processing system.
Fig. 1 is a schematic structural diagram of a data processing system according to an embodiment of the present invention. As shown in fig. 1, the data processing system includes a data platform 101, an auxiliary platform 102, a host platform 103, and a database 104, where the data platform 101, the auxiliary platform 102, the host platform 103, and the database 104 are connected in sequence, and the connection mode may be a wired connection or a wireless connection, and is not limited specifically.
When data needs to be processed, the data platform 101 obtains N pieces of first data information, and then forwards the N pieces of first data information to the auxiliary platform, the auxiliary platform 102 transcodes the N pieces of first data information into N pieces of second data information corresponding to the N pieces of first data information one to one, and then transmits the N pieces of second data information to the host platform, and then the host platform 103 verifies the N pieces of second data information, and sends M pieces of second data information that pass the verification (M is a positive integer less than or equal to N) to the database 104, and the database 104 stores the second data information.
In the above, N is a positive integer. That is, the whole data processing system can process only one piece of data information at a time, and can also process two or more pieces of data information at the same time. And, the one or the two or more pieces of data information may be sent to the data platform 101 by the service personnel at any time when needed. Therefore, the data platform 101 can acquire data information at any time, and then the auxiliary platform 102 and the host platform 103 are combined to complete transcoding and checking of the data information, and uniform batch processing of the host platform 103 is not required, so that real-time processing of the data information is facilitated, and timeliness of data processing is improved.
In one possible application scenario, the first data information may specifically be data information of a dividend check, such as a dividend check file. The dividend check file may include one or more pieces of data information of the dividend check, such as N pieces of first data information. The types of dividend check files may be text type, document type, and report type, among others. In one example, the first data information includes a ticket number, an account number, a detail amount, a date, and a summary amount. It should be noted that, for each piece of first data information, a ticket number, an account number, a detailed amount, a date, and a summary amount are included. The ticket number refers to the check number of the dividend check, and may be, for example, an 8-digit number. The account number refers to the account number of the account to which the dividend check belongs, and one account can comprise one dividend check or a plurality of dividend checks, in other words, one account number can comprise one ticket number or a plurality of ticket numbers; for example, the account number may be an 11 digit number. The detail amount refers to the amount of the stock information check, and corresponds to the ticket number one by one, in other words, one ticket number corresponds to one detail amount; illustratively, the itemized amount may be a 15 digit number. Date refers to the date of the dividend check; illustratively, the date may be a 14 digit number. The aggregate amount refers to the total amount of the account to which the dividend check belongs, and may be, for example, a 15 digit number. The summary amount corresponds to the account number one to one, in other words, one account number corresponds to one summary amount. For a dividend check, the sum of the amounts of the dividend check is equal to the sum of the detailed amounts of all dividend checks of the account to which the dividend check belongs. As can be seen from the above description, each piece of first data information includes a ticket number, an account number, a detailed amount, a date, and a total amount. That is, each piece of first data information may be understood as: each piece of first data information comprises a ticket number, an account number to which the ticket number belongs, a detailed amount corresponding to the ticket number, a date and a summary amount corresponding to the account number to which the ticket number belongs.
It should be noted that the first data information is 8-bit Universal Character Set/Unicode Transformation Format (UTF-8). The UTF-8 code is a variable length character encoding for the universal code (Unicode). It can be used to represent any character in the Unicode Standard and the first byte in the Code is still compatible with American Standard Code for Information Interchange (ASCII) so that the original software that processes the ASCII character can continue to be used without or with only minor modifications. Therefore, UTF-8 code is becoming the preferred encoding for use in e-mail, web pages, and other text storage or delivery applications.
Exemplarily, as shown in fig. 2, a schematic structural diagram of a data platform provided in an embodiment of the present invention is shown. In this example, the data platform 102 may include a front end 201 and a back end 202. Wherein:
the front end 201 is configured to obtain N pieces of first data information uploaded by the interface, and optionally, may obtain the N pieces of first data information in real time. In one possible embodiment, the front end 201 may display all or a portion of the dividend check files for selection, and the selected dividend check file is the dividend check file to be uploaded. The front end 201 obtains N pieces of first data information included in the dividend check file to be uploaded, that is, the front end 201 obtains N pieces of first data information uploaded on the interface. The front end 201 may also be used for querying, deleting, and updating the dividend check file, and the specific functions will be further explained in fig. 4, which is not described herein.
The backend 202 is configured to transmit the N pieces of first data information to the auxiliary platform. Specifically, the back end 202 receives N pieces of first data information acquired by the front end 201, and transmits the N pieces of first data information to the auxiliary platform 102.
In the above scheme, the front end 201 of the data platform displays all or part of the dividend check files for selection, and then obtains N pieces of first data information uploaded on the interface and transmits the N pieces of first data information to the back end 202. The backend 202 receives the N pieces of first data information sent by the front end and transmits the N pieces of first data information to the auxiliary platform to implement subsequent operations.
In detail, in the above description of the first data message, the first data message is the UTF-8 code, which is a preferred code for e-mail, web page and other applications for storing or transmitting text. However, the UTF-8 code information cannot be processed by the host platform. Therefore, information of the UTF-8 code needs to be transcoded into an E code that can be recognized by the host platform 103. The E-code, i.e., the E-code, is machine code at the system level that is used to monitor the execution of software processes related to physical events. Execution of the E-code is triggered by a context interrupt, which signals an external event, e.g., the arrival of information or sensor values. It is understood that the auxiliary platform 102 may transcode the information of the UTF-8 code to the E code, and may also transcode the information of the E code to the UTF-8 code, and for the auxiliary platform 102 to transcode the information of the E code to the UTF-8 code, reference may be made to the following description, and details are not described here again.
In the above scheme, the auxiliary platform 102 transcodes N pieces of first data information of the UTF-8 code to obtain N pieces of second data information of the E code, where the N pieces of second data information correspond to the N pieces of first data information one to one. The second data information includes a ticket number, an account number, a detail amount, a date, and a summary amount. Then, the auxiliary platform 102 transmits the N pieces of second data information to the host platform 103. Based on the above scheme, the auxiliary platform 102 may transcode the N pieces of first data information of the UTF-8 code into N pieces of second data information of the E code, which may be recognized by the host platform 103, and transmit the transcoded N pieces of second data information to the host platform 103.
Optionally, the verification types of the host platform 103 for the N pieces of second data information may include the following four types:
the verification type is one: it is checked whether the format of the second data information matches.
In detail, it is checked whether the format of each of the N pieces of second data information matches. In other words, it is checked whether the format of the data information of each transcoded dividend check matches. If the format of a certain piece of second data information is matched, the piece of second data information is judged to pass the verification of the verification type I, otherwise, the piece of second data information is judged not to pass the verification of the verification type I.
Specifically, as can be seen from the foregoing related description, the second data information includes a ticket number, an account number, a detailed amount, a date, and a total amount. In one possible embodiment, the format of the second data information may be: and sorting the ticket number, the account number, the detailed amount, the date and the summary amount in sequence. Based on the set format, it is verified whether the format of each of the N pieces of second data information matches the set format of the second data information. If the format of a certain piece of second data information is sorted in the order of ticket number, account number, detail amount, date and summary amount, the format of the piece of second data information is called to be matched, and the piece of second data information passes the verification of the verification type I. If the format of a certain piece of second data information is not sorted in the order of ticket number, account number, detail amount, date and summary amount, the format of the piece of second data information is not matched, and the piece of second data information does not pass the verification of the verification type I. For example, if the format of a certain piece of second data information is sorted in the order of account number, ticket number, detail amount, date, and total amount, the format of the piece of second data information is said to be unmatched, and the piece of second data information does not pass the verification of verification type one. For another example, if the format of a certain piece of second data information is sorted in the order of ticket number, detail amount, date, and total amount, the format of the piece of second data information is said to be unmatched, and the piece of second data information does not pass the verification of the verification type one.
And B, checking type II: and checking whether the ticket number in the second data information is matched with the historical ticket number.
In detail, whether the ticket number of each piece of the N pieces of second data information matches the historical ticket number is checked. In other words, it is checked whether the ticket number of the data information of each transcoded dividend check matches the historical ticket number. And if the ticket number of a certain piece of second data information is matched with the historical ticket number, the piece of second data information is judged to pass the verification of the verification type II, otherwise, the piece of second data information is judged not to pass the verification of the verification type II.
Specifically, as can be seen from the foregoing description, the ticket number refers to the check number of the dividend check. In one possible implementation, the host platform 103 may communicate with a database of the peripheral system, and obtain the ticket number of the data information of each dividend check, i.e. the historical ticket number, from the database of the peripheral system according to the account number of the data information of each dividend check. And checking whether the ticket number of the data information of each transcoded dividend check is matched with the historical ticket number, namely checking whether the ticket number of each piece of second data information in the N pieces of second data information is matched with the historical ticket number. And if the ticket number of a certain piece of second data information is matched with the historical ticket number, the piece of second data information is deemed to pass the verification of the verification type II. And if the ticket number of a certain piece of second data information is not matched with the historical ticket number, the piece of second data information is not verified through the verification of the verification type two. One case of failing to pass the verification type two is exemplarily shown as follows: if for a certain piece of second data information, when the ticket number of the piece of second data information does not exist in the account number in the database of the peripheral system, which is the same as the account number of the piece of second data information, the ticket number of the piece of second data information is not matched with the historical ticket number, so that the piece of second data information does not pass the verification of the verification type two.
The verification type is three: and checking whether the account number in the second data information is matched with the historical account number.
In detail, it is checked whether an account of each piece of the N pieces of second data information matches the historical account. In other words, it is verified whether the account number of the data information of each transcoded dividend check matches the historical account number. If the account number of a certain piece of second data information is matched with the historical account number, the piece of second data information is judged to pass the verification of the verification type III, otherwise, the piece of second data information is judged not to pass the verification of the verification type III.
Specifically, the host platform 103 may obtain an account number of the data information of each dividend check, that is, a historical account number, from a database of the peripheral system. And checking whether the account of the data information of each transcoded dividend check is matched with the historical account, namely checking whether the account of each piece of second data information in the N pieces of second data information is matched with the historical account. And if the account number of a certain piece of second data information is matched with the historical account number, the piece of second data information is considered to pass the verification of the verification type III. And if the account number of a certain piece of second data information is not matched with the historical account number, the piece of second data information is not verified by the verification type III. A case of not passing the verification type three is exemplarily shown as follows: if a certain piece of second data information does not have the account number of the piece of second data information in the database of the peripheral system, the account number of the piece of second data information is not matched with the historical account number, so that the piece of second data information does not pass the verification of the verification type three. In a possible case, a certain account may not sign a contract, so the account does not exist in the database of the peripheral system, and therefore, the second data information including the account does not match the historical account, so the second data information including the account does not pass the verification of the verification type three.
The verification type is four: and checking whether the detail amount of the second data information is matched with the summary amount.
In detail, whether the detail amount of each piece of the N pieces of second data information is matched with the summary amount is checked. In other words, it is checked whether the detailed amount of the data information of each transcoded dividend check matches the summarized amount. And if the detail amount of a certain piece of second data information is matched with the summary amount, the piece of second data information is judged to pass the verification of the verification type four, otherwise, the piece of second data information is judged not to pass the verification of the verification type four.
Specifically, as can be seen from the above description, for one dividend check, the sum of the amounts of the dividend checks is equal to the sum of the detailed amounts of all dividend checks of the account to which the dividend check belongs. Therefore, for a certain piece of second data information, the sum of the detailed amounts of all ticket numbers of the account number to which the second data information belongs is equal to the sum of the total amounts of the account numbers to which the second data information belongs. And if the sum of the detailed sum of all the ticket numbers of the account number belonging to a certain piece of second data information is equal to the sum of the account number belonging to the second data information, the detailed sum of the second data information is called to be matched with the sum, so that the piece of second data information passes the verification of the verification type four. If the sum of the detailed amounts of all the ticket numbers of the account number belonging to a certain piece of second data information is not equal to the sum of the account number belonging to the second data information, the detailed amount of the piece of second data information is not matched with the sum, so that the piece of second data information does not pass the verification of the verification type four.
For a certain piece of second data information, if the piece of second data information passes the verification of the verification types from one to four, the piece of second data information is called the second data information passing the verification; and if the piece of second data information does not pass the verification of any one verification type or a plurality of verification types from the first to the fourth verification types, the piece of second data information is called the second data information which does not pass the verification. In the embodiment of the present invention, the host platform 103 writes M pieces of second data information that pass the verification in the N pieces of second data information into the database.
Optionally, the host platform 103 is further configured to record N-M pieces of second data information, excluding M pieces of second data information, in the N pieces of second data information. In one possible embodiment, the host platform 103 records the N-M pieces of second data information that failed the verification to the result file. The host platform 103 then passes the result file to the auxiliary platform 102. It should be noted that the N-M pieces of second data information that do not pass the verification are in the E-code format, and the result file is also in the E-code format.
In this embodiment of the present invention, the database 104 is configured to store M pieces of the second data information. Specifically, the database 104 may store M pieces of second data information that have passed the verification, so as to facilitate obtaining, through the database 104, the M pieces of second data information that have passed the verification when clearing the dividend check subsequently.
Optionally, the auxiliary platform 102 is further configured to: transcoding the N-M pieces of second data information to obtain N-M pieces of third data information; and transmitting the N-M pieces of third data information to the data platform.
Specifically, the auxiliary platform 102 transcodes N-M pieces of second data information in the E code format to N-M pieces of third data information in the UTF-8 code format that is recognizable by the data platform, that is, the auxiliary platform 102 transcodes the result file in the E code format to the result file in the UTF-8 code format that is recognizable by the data platform. Then, the auxiliary platform 102 transmits the N-M pieces of third data information in the UTF-8 code format to the data platform 101, that is, the auxiliary platform 102 transcodes the result file in the UTF-8 code format to the data platform 101.
Optionally, the back end 202 of the data platform 101 is further configured to: and receiving N-M pieces of third data information. When the front end 201 inquires the result of the uploaded dividend check file, the back end 202 transmits the obtained result file to the front end 201. For specific implementation of the front end 201 and its related functions, reference may be made to the following description, which is not repeated herein.
Based on the data processing system of fig. 1 and the associated description of the data platform of fig. 2, fig. 3 provides a method flow diagram of a data processing method, the method comprising the steps of:
in step 301, the front end 201 obtains N pieces of first data information.
Specifically, the front end 201 obtains N pieces of first data information of the uploaded dividend check file, where the N pieces of first data information are UTF-8 codes.
Step 302, the front end 201 sends N pieces of first data information to the back end 202.
Specifically, the back end 202 receives N pieces of first data information sent by the front end.
In step 303, the backend 202 sends N pieces of first data information to the auxiliary platform 102.
Specifically, the auxiliary platform 102 receives N pieces of first data information sent by the backend 202.
In step 304, the auxiliary platform 102 transcodes the N pieces of first data information into N pieces of second data information.
Specifically, the auxiliary platform 102 transcodes N pieces of first data information of the UFT-8 code to N pieces of second data information of the E code.
In step 305, the auxiliary platform 102 sends N pieces of second data information to the host platform 103.
Specifically, the host platform 103 receives N pieces of second data information of the E code.
In step 306, the host platform 103 checks the N pieces of second data information.
Specifically, the host platform 103 checks the received N pieces of second data information. For details of the verification, reference is made to the related descriptions above, and the details are not repeated here. Step 307 is performed on the second data information that passed the verification, and step 308 is performed on the second data information that failed the verification.
In step 307, the host platform 103 sends the second data information passing the verification to the database 104.
Specifically, the host platform 103 writes M pieces of second data information that pass the check in the N pieces of second data information into the database 104.
In step 308, the host platform 103 records the failed verification to the result file.
Specifically, the host platform 103 records N-M pieces of second data information that fails to pass the verification in the N pieces of second data information to the result file, which is known as the E code by referring to the foregoing related description.
In step 309, the host platform 103 sends the result file to the auxiliary platform 102.
Specifically, the auxiliary platform 102 receives the result file of the host platform 103 that transmits the E code.
In step 310, the auxiliary platform 102 transcodes the result file.
Specifically, the auxiliary platform 102 transcodes the result file of the E code into the UTF-8 code.
In step 311, the auxiliary platform 102 sends the transcoded result file to the backend 202.
Specifically, the backend 202 receives the transcoded result file.
In step 312, the back end 202 returns the transcoded result file to the front end 201.
Specifically, when the front end 101 receives a request for a progress query of an uploaded dividend check file, the front end 201 requests the progress query of the dividend check file from the back end 202. If one or more pieces of second data information in the N pieces of second data information fail to be verified in step 306, the back end 202 returns the transcoded result file to the front end 201. If all the N pieces of second data information pass the verification in step 306, the back end 202 returns a processing status of "file processing completed" to the front end 201. For a detailed description of the progress of processing the dividend check file, reference is made to the following description of fig. 5, which is not repeated herein.
Fig. 4 is a schematic diagram of an interaction of a front end 201 according to an embodiment of the present invention. The front end 201 includes a file upload interface, a query progress interface, a delete file interface, and an update file interface. The file uploading interface is used for providing an interface of a file uploading function, the inquiry progress interface is used for providing an interface of the inquiry progress function, the file deleting interface is used for providing an interface of a file deleting function, and the file updating interface is used for providing an interface of a file updating function.
Specifically, for the file upload interface, by clicking the interface, the front end 201 displays the file upload interface. Fig. 5 is an interaction diagram of a possible front end 201 according to an embodiment of the present invention. As shown in fig. 5, the front end 201 displays all dividend check files that can be uploaded, and can select whether to upload the dividend check file corresponding to the button through the right-side selection button of the interface. In one possible implementation, one or more files may be selected and uploaded. The selected dividend check file can be uploaded by clicking the ok button in the lower right corner of the interface. It should be noted that, after the dividend check file is successfully uploaded, a file upload code is returned for the subsequent real-time acquisition of the processing progress of the dividend check file through the file upload code. In one possible embodiment, the processing progress of the dividend check file may include: uploading the file, transcoding the file, verifying the file, finishing the file processing and returning a result file. In detail, when the dividend check file has been successfully uploaded from the front end 201 and has not been transcoded by the auxiliary platform 102, the processing progress of the dividend check file is "file uploaded". When the dividend check file has been transcoded by the auxiliary platform 102 and has not been verified by the host platform 103, the processing progress of the dividend check file is "file transcoded". When the dividend check file is being checked by the host platform 103, the processing progress of the dividend check file is "file check in". When all of the second data information in the dividend check file is verified and recorded to the database 104, the processing progress of the dividend check file is "file processing completed". When one or more pieces of second data information in the dividend check file fail to be checked and the second data information which fails to be checked is recorded in the result file, the processing progress of the dividend check file is 'result file return'.
Specifically, for the query progress interface, by clicking the interface, the front end 201 displays the progress query interface. Fig. 6 is an interaction diagram of a possible front end 201 according to an embodiment of the present invention. As shown in fig. 6, the file uploading code of the dividend check file to be queried may be input into an input field at the center of the interface, and the file processing progress of the dividend check file may be queried by clicking a determination button at the right side of the interface. For the file processing progress, reference may be made to the related description above, and details are not repeated here.
Specifically, for updating a file interface, the front end 201 displays the file update interface by clicking the interface. In which a dividend check file to be updated may be selected.
Specifically, for a delete file interface, by clicking the interface, the front end 201 displays the file delete interface. Fig. 7 is an interaction diagram of a possible front end 201 according to an embodiment of the present invention. As shown in fig. 7, the front end 201 displays all dividend check files that can be uploaded, and can select whether to delete the dividend check file corresponding to the button through a right-side selection button of the interface.
Based on the file deletion interface of the front end 201 described in fig. 7, the data processing system provided in the embodiment of the present invention may also be used to delete an uploaded dividend check file. In a possible implementation manner, the data platform 101 is further configured to obtain fourth data information through a delete file interface on the front end 201; the auxiliary platform 102 is further configured to transcode the fourth data information into fifth data information; the host platform 103 is further configured to verify the fifth data information, and send the verified fifth data information to the database 104; the database 104 is further configured to delete the fifth data information that passes the verification.
Specifically, the data platform 101 obtains the dividend check file to be deleted through the deletion file interface on the front end 201, where the dividend check file to be deleted includes fourth data information, and the fourth data information is the UTF-8 code.
Specifically, the auxiliary platform 102 is further configured to transcode the fourth data information of the UTF-8 code into the fifth data information of the E code.
Specifically, the host platform 103 is further configured to verify fifth data information of the E code. Optionally, the verification types of the N pieces of second data information by the host platform 103 may include the four verification types described above, which are not described herein again. The host platform 103 sends the fifth data information passing the verification to the database 104.
Specifically, the database 104 is further configured to delete the fifth data information that passes the verification.
In the scheme, the front end acquires fourth data information to be deleted, namely a dividend check file to be deleted, through a file deletion interface; the auxiliary platform transcodes the fourth data information into fifth data information which can be identified by the host platform; the host platform checks the fifth data information and sends the checked fifth data information to the database; and deleting the fifth data information passing the verification by the database. When wrong dividend check data is recorded in the database, deletion of the wrong dividend check data can be realized by using the scheme. That is, the scheme can realize real-time batch deletion of wrong dividend check data.
Based on the same inventive concept, the invention also provides a data processing device, which can execute the method in the embodiment of the invention. The structure of a data processing device provided by the invention can be seen in fig. 8. The data processing apparatus 800 includes an acquisition unit 801 and a processing unit 802. Wherein, the acquisition unit 801ForAcquiring N pieces of first data information, wherein N is a positive integer; the processing unit 802 is configured to transcode the N pieces of first data information to obtain N pieces of second data information, and N pieces of first data informationData information corresponds to each other one by one; checking N pieces of second data information, and writing M pieces of second data information passing the checking into a database, wherein M is a positive integer less than or equal to N; and storing the M pieces of second data information.
The more detailed description about the obtaining unit 801 and the processing unit 802 can be directly obtained by referring to the related description in the embodiment of the method shown in fig. 3, and is not repeated here.
Based on the same technical concept, the present invention further provides a computing device, as shown in fig. 9, where the computing device 900 includes at least one processor 901 and a memory 902 connected to the at least one processor, and the specific connection medium between the processor 901 and the memory 902 is not limited in the present invention, and the processor 901 and the memory 902 are connected through a bus in fig. 9 as an example. The bus may be divided into an address bus, a data bus, a control bus, etc.
In the present invention, the memory 902 stores instructions executable by the at least one processor 901, and the at least one processor 901 can execute the steps included in the aforementioned data processing method by executing the instructions stored in the memory 902.
The processor 901 is a control center of the computing device, and may connect various parts of the computing device by using various interfaces and lines, and implement data processing by executing or executing instructions stored in the memory 902 and calling data stored in the memory 902. Alternatively, the processor 901 may include one or more processing units, and the processor 901 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, and the like, and the modem processor mainly processes an issued instruction. It will be appreciated that the modem processor described above may not be integrated into the processor 901. In some embodiments, the processor 901 and the memory 902 may be implemented on the same chip, or in some embodiments, they may be implemented separately on separate chips.
Based on the same technical concept, embodiments of the present invention also provide a computer-readable storage medium storing a computer program executable by a computing device, wherein the program, when executed on the computing device, causes the computing device to execute the steps of the data processing method.
Based on the same technical concept, embodiments of the present invention further provide a computer program product, which includes computer readable instructions, and when the computer readable instructions are executed by a processor, the data processing method is implemented.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (24)
1. The data processing system is characterized by comprising a data platform, an auxiliary platform, a host platform and a database which are connected in sequence:
the data platform is used for acquiring N pieces of first data information, wherein N is a positive integer;
the auxiliary platform is used for transcoding the N pieces of first data information to obtain N pieces of second data information, wherein the N pieces of second data information correspond to the N pieces of first data information one to one;
the host platform is used for verifying the N pieces of second data information and writing M pieces of second data information passing verification into the database, wherein M is a positive integer less than or equal to N;
the database is used for storing the M pieces of second data information.
2. The data processing system of claim 1, wherein the host platform is further configured to:
and recording N-M pieces of second data information except the M pieces of second data information in the N pieces of second data information.
3. The data processing system of claim 2, wherein the auxiliary platform is further configured to:
transcoding the N-M pieces of second data information to obtain N-M pieces of third data information;
and transmitting the N-M pieces of third data information to the data platform.
4. The data processing system of claim 1, wherein the data platform comprises a front end and a back end:
the front end is used for acquiring the N pieces of first data information uploaded by the interface;
and the back end is used for transmitting the N pieces of first data information to the auxiliary platform.
5. The data processing system of claim 4, wherein the front end is configured to obtain the N pieces of first data information in real time.
6. The data processing system of claim 4, wherein the front end comprises a file upload interface, a query progress interface, a delete file interface, and an update file interface.
7. The data processing system of claim 1, wherein:
the data platform is also used for acquiring fourth data information through a deleted file interface on the front end;
the auxiliary platform is further used for transcoding the fourth data information into fifth data information;
the host platform is further used for verifying the fifth data information and sending the verified fifth data information to the database;
the database is further used for deleting the fifth data information passing the verification.
8. The data processing system of any one of claims 1-7,
any one piece of first data information is a UTF-8 code, and any one piece of second data information is an E code;
and/or the presence of a gas in the atmosphere,
any one piece of the third data information is a UTF-8 code;
and/or the presence of a gas in the gas,
any one of the fourth data information is a UTF-8 code, and any one of the fifth data information is an E code.
9. The data processing system of claim 1, wherein any of the second data information includes a ticket number, an account number, a detail amount, a date, a summary amount;
the host platform is specifically configured to:
for Ren Yitiao second data information, if it is determined that an account number in the second data information matches a historical account number, it is determined that a ticket number in the second data information matches a historical ticket number, it is determined that a format of the second data information matches, it is determined that a detail amount of the second data information matches a summary amount, and it is determined that the second data information passes verification.
10. The data processing system of claim 8, wherein the format of any one of the second data messages comprises: and sorting the ticket number, the account number, the detailed amount, the date and the summary amount in sequence.
11. A data processing method is characterized by being applicable to a data processing system, wherein the data processing system comprises a data platform, an auxiliary platform, a host platform and a database which are sequentially connected, and the method comprises the following steps:
acquiring N pieces of first data information through the data platform, wherein N is a positive integer;
transcoding the N pieces of first data information through the auxiliary platform to obtain N pieces of second data information, wherein the N pieces of second data information correspond to the N pieces of first data information one by one;
verifying the N pieces of second data information through the host platform, and writing M pieces of second data information which are verified to pass into the database, wherein M is a positive integer less than or equal to N;
and storing the M pieces of second data information through the database.
12. The method of claim 11, further comprising:
and recording N-M pieces of second data information except the M pieces of second data information in the N pieces of second data information through the host platform.
13. The method of claim 12, further comprising:
and transcoding the N-M pieces of second data information through the auxiliary platform to obtain N-M pieces of third data information.
14. The method of claim 11, wherein the data platform comprises a front end and a back end, the method further comprising:
acquiring the N pieces of first data information uploaded by an interface through the front end;
and transmitting the N pieces of first data information to the auxiliary platform through the rear end.
15. The method of claim 14, further comprising:
and acquiring the N pieces of first data information in real time through the front end.
16. The method of claim 14, wherein the front end comprises a file upload interface, a query progress interface, a delete file interface, and an update file interface.
17. The method of claim 11, further comprising:
acquiring fourth data information through the data platform;
transcoding, by the auxiliary platform, the fourth data information into fifth data information;
verifying the fifth data information through the host platform, and sending the verified fifth data information to the database;
and deleting the fifth data information passing the verification through the database.
18. The method according to any one of claims 11-17,
any one piece of first data information is a UTF-8 code, and any one piece of second data information is an E code;
and/or the presence of a gas in the gas,
any one piece of the third data information is a UTF-8 code;
and/or the presence of a gas in the gas,
any one of the fourth data information is a UTF-8 code, and any one of the fifth data information is an E code.
19. The method of claim 11, wherein any piece of the second data information comprises a ticket number, an account number, a detail amount, a date, a summary amount;
the verifying the N pieces of second data information by the host platform includes:
for Ren Yitiao second data information, the host platform confirms whether an account number in the second data information is matched with a historical account number, confirms whether a ticket number in the second data information is matched with a historical ticket number, confirms whether a format of the second data information is matched, and confirms whether a detail amount and a summary amount of the second data information are matched.
20. The method of claim 11, wherein the format of any one of the pieces of second data information comprises: and sorting the ticket number, the account number, the detailed amount, the date and the summary amount in sequence.
21. A data processing apparatus, comprising:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring N pieces of first data information, and N is a positive integer;
the processing unit is used for transcoding the N pieces of first data information to obtain N pieces of second data information, wherein the N pieces of second data information correspond to the N pieces of first data information one by one; verifying the N pieces of second data information, and writing M pieces of second data information which are verified to pass into a database, wherein M is a positive integer less than or equal to N; and storing the M pieces of second data information.
22. A computing device comprising at least one processor and at least one memory, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the method of any of claims 11 to 20.
23. A computer-readable storage medium, characterized in that the storage medium stores a program which, when run on a computer, causes the computer to carry out the method of any one of claims 11 to 20.
24. A computer program product comprising computer readable instructions which, when executed by a processor, cause the method of any of claims 11 to 20 to be carried out.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211362849.4A CN115658790A (en) | 2022-11-02 | 2022-11-02 | Data processing system, method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211362849.4A CN115658790A (en) | 2022-11-02 | 2022-11-02 | Data processing system, method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115658790A true CN115658790A (en) | 2023-01-31 |
Family
ID=84994554
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211362849.4A Pending CN115658790A (en) | 2022-11-02 | 2022-11-02 | Data processing system, method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115658790A (en) |
-
2022
- 2022-11-02 CN CN202211362849.4A patent/CN115658790A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11188884B2 (en) | Processing network architecture with companion database | |
| US10153939B2 (en) | Real time event capture, analysis and reporting system | |
| US10158737B2 (en) | Real time event capture and analysis of transient data for an information network | |
| US7512690B2 (en) | System and method for transferring data between databases | |
| WO2022041834A1 (en) | Transaction data processing method and apparatus | |
| US10503750B2 (en) | Real time event capture and transformation of transient data for an information network | |
| US7925555B2 (en) | Master system of record | |
| CN113360043A (en) | Service processing method and device | |
| CN115658790A (en) | Data processing system, method and device | |
| CN107430746B (en) | Credit transaction management system and method thereof | |
| CN114119116A (en) | Bill processing method and device, computer equipment and storage medium | |
| JP5850546B1 (en) | Government bond principal and interest distribution system and method | |
| JP2022117121A (en) | Asset management system | |
| CN111445330A (en) | Account checking method and device | |
| CN115456747B (en) | Automatic intelligent account settling method and device for ERP system and storage medium | |
| RU215982U1 (en) | A device for the remote provision of insurance services using the recognition of an electronic passport of the Russian Federation on a plastic card | |
| CN111652747B (en) | Electronic policy processing method, device, equipment and computer readable storage medium | |
| CN113111631A (en) | Data processing method, device, equipment, storage medium and program product | |
| JP2011096060A (en) | System for managing data related to trade settlement and method for the system | |
| CN117743282A (en) | Transaction data sharing method and device | |
| CN116521750A (en) | Data processing method, device, equipment and computer readable storage medium | |
| CN117237058A (en) | Order processing method and related equipment | |
| JP2023141312A (en) | Loan management device, loan management method, and loan management program | |
| TWM620226U (en) | Batched fee/tax payment system | |
| CN111125026A (en) | Analysis processing method, device, equipment and storage medium for running file |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |