CN115375430A - Method, device and equipment for batch analysis and loading of additional data of bank - Google Patents
Method, device and equipment for batch analysis and loading of additional data of bank Download PDFInfo
- Publication number
- CN115375430A CN115375430A CN202211000841.3A CN202211000841A CN115375430A CN 115375430 A CN115375430 A CN 115375430A CN 202211000841 A CN202211000841 A CN 202211000841A CN 115375430 A CN115375430 A CN 115375430A
- Authority
- CN
- China
- Prior art keywords
- additional recording
- data
- additional
- source data
- entry
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/177—Editing, e.g. inserting or deleting of tables; using ruled lines
- G06F40/18—Editing, e.g. inserting or deleting of tables; using ruled lines of spreadsheets
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Finance (AREA)
- General Engineering & Computer Science (AREA)
- Accounting & Taxation (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Artificial Intelligence (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a method, a device and equipment for analyzing and loading additional data of a bank in batches, which can be applied to the field of big data and the field of finance, and can analyze and load the information of the additional data in batches under a big data platform so as to complete the production of a supervision report form, thereby not only reducing the additional cost and human resources, but also greatly improving the timeliness of the additional data. The method comprises the following steps: firstly, the name range of an additional recording data table is combed, the name and the type of an additional recording field are combed, then, an additional recording mapping table is created according to a preset additional recording requirement, a mapping rule is set in the mapping table, then, additional recording source data are obtained, the attribute of an additional recording target table is built, the additional recording source data are analyzed, and an analysis result of the additional recording source data is obtained; and further, the analysis result of the additional recording source data can be loaded into an additional recording target table in the database in batch, so that the batch analysis and loading of the bank additional recording data are realized.
Description
Technical Field
The application relates to the technical field of big data, in particular to a method, a device and equipment for batch analysis and loading of bank additional data.
Background
With the rapid development of social economy, each large bank serves as a financial service center, more and more customers handle various financial services through the bank, and therefore more and more additional data which need to be processed by the bank are obtained.
At present, a BDP-ODSS (overseas supervision and delivery and internal management subject application) of a bank processes overseas shared data sets for overseas branches and creates overseas supervision and delivery and internal management data service infrastructure for meeting the subject applications of overseas supervision and delivery, internal management and the like of each branch based on a BDP big data platform. The system generates a format report of the supervision and delivery requirement by automatically extracting, calculating, summarizing and analyzing data required by the supervision report, reduces the workload of manual operation, improves the working efficiency, and avoids various errors caused by manual operation errors, however, the supervision requirements of overseas branches are very different, and overseas shared data sets cannot completely meet the supervision and delivery requirements, so that overseas branches also need to manually additionally record local characteristic data through BOCS-OSS-AIES (overseas integrated support system-information additional recording) to complete the production of the supervision report. However, since the BOCS-OSS-AIES needs to support the requirement of overseas division diversification, the product design stores all the data of the additional recording table in a general layer additional recording information table, which is not consistent with the structure of the additional recording table required by the actual division, so that the additional recording data cannot be directly used after being downloaded to the BDP-ODSS through a UDP-ASVR (unified data platform — analysis layer service center).
Disclosure of Invention
The embodiment of the application mainly aims to provide a method, a device and equipment for analyzing and loading additional data of a bank in batches, which can analyze and load information of the additional data in batches under a large data platform so as to complete the production of a supervision report, thereby not only reducing the additional cost and human resources, but also greatly improving the timeliness of the additional data.
In a first aspect, an embodiment of the present application provides a method for batch parsing and loading of banking entry data, where the method includes:
the name range of the additional entry data table is sorted, and the name and the type of the additional entry field are sorted;
creating an additional recording mapping table according to a preset additional recording requirement, and setting a mapping rule in the mapping table;
acquiring additional recording source data, constructing attributes of an additional recording target table, and analyzing the additional recording source data to obtain an analysis result of the additional recording source data;
and loading the analysis result of the additional record source data into an additional record target table in the database in batch, so as to realize batch analysis and loading of the bank additional record data.
Optionally, the combing the range of the entry-padding data table name, and the combing the name and type of the entry-padding field includes:
acquiring a table name and a table ID of an additional recording data table according to a preset additional recording requirement; and acquiring the field name and attribute of the additional recording data table and the field ID of the table field according to the preset additional recording requirement.
Optionally, the obtaining of the entry-added source data and the constructing of the entry-added target table attribute include:
loading data in an analysis layer service center UDP-ASVR of a unified data platform into a temporary storage;
and acquiring a table ID according to the table name of the additional recording data table, and acquiring the field name, the position and the attribute of the additional recording target table in the mapping table according to the table ID so as to construct the attribute of the additional recording target.
Optionally, the analyzing the additional recording source data to obtain an analysis result of the additional recording source data includes:
acquiring a table ID according to the table name of the additional recording data table, and acquiring source data sets of all the additional recording tables from the temporary storage according to the table ID;
and analyzing the source data set one by one to obtain an analysis result of the additional source data.
In a second aspect, an embodiment of the present application further provides a device for batch parsing and loading of banking entry data, where the device includes:
the carding unit is used for carding the name range of the additional entry data table and carding the name and the type of the additional entry field;
the device comprises a creating unit, a mapping unit and a processing unit, wherein the creating unit is used for creating an additional recording mapping table according to a preset additional recording requirement and setting a mapping rule in the mapping table;
the analysis unit is used for acquiring the additional recording source data, constructing the attribute of the additional recording target table, and analyzing the additional recording source data to obtain an analysis result of the additional recording source data;
and the loading unit is used for loading the analysis result of the additional recording source data into the additional recording target table in the database in batch to realize batch analysis and loading of the bank additional recording data.
Optionally, the combing unit is specifically configured to:
acquiring a table name and a table ID of an additional recording data table according to a preset additional recording requirement; and acquiring the field name and attribute of the additional recording data table and the field ID of the table field according to the preset additional recording requirement.
Optionally, the parsing unit includes:
the loading subunit is used for loading the data in the UDP-ASVR into the temporary storage;
and the construction subunit is used for acquiring the table ID according to the table name of the additional recording data table, and acquiring the field name, the position and the attribute of the additional recording target table in the mapping table according to the table ID so as to construct the attribute of the additional recording target.
Optionally, the parsing unit further includes:
an obtaining subunit, configured to obtain a table ID according to a table name of an additional recording data table, and obtain source data sets of all additional recording tables from the temporary storage according to the table ID;
and the analysis subunit is used for analyzing the source data sets one by one to obtain an analysis result of the additional source data.
The embodiment of the present application further provides a batch parsing and loading device for the bank entry data, including: a processor, a memory, a system bus;
the processor and the memory are connected through the system bus;
the memory is used for storing one or more programs, and the one or more programs comprise instructions which when executed by the processor cause the processor to execute any one implementation mode of the batch parsing and loading method of the bank supplementary data.
The embodiment of the application further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are run on a terminal device, the terminal device is enabled to execute any implementation manner of the batch parsing and loading method for the bank entry data.
According to the method, the device and the equipment for analyzing and loading the additional entry data of the bank in batches, firstly, the name range of the additional entry data table is combed, the name and the type of an additional entry field are combed, then, an additional entry mapping table is created according to the preset additional entry requirement, mapping rules are set in the mapping table, then, additional entry source data are obtained, the attribute of an additional entry target table is built, the additional entry source data are analyzed, and the analysis result of the additional entry source data is obtained; and then, the analysis result of the additional recording source data can be loaded into an additional recording target table in a database in batch, so that the batch analysis and loading of the bank additional recording data are realized, the information of the additional recording data can be analyzed and loaded in batch under a big data platform, the production of a supervision report is convenient to complete, the additional recording cost and the human resource are reduced, and the timeliness of the additional recording data is greatly improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a method for batch parsing and loading of banking entry data according to an embodiment of the present application;
fig. 2 is a schematic diagram illustrating that an entry-supplementing mapping table is created according to a preset entry-supplementing requirement, and a mapping rule is set in the mapping table according to an embodiment of the present application;
fig. 3 is a schematic diagram illustrating an analysis result of the additional source data obtained by analyzing the additional source data according to the embodiment of the present application;
fig. 4 is a schematic composition diagram of a device for batch parsing and loading of bank entry data according to an embodiment of the present application.
Detailed Description
At present, a large number of additional recording source data tables on a large data platform BDP of a bank are inconsistent with the structures of the additional recording tables required by actual branches, so that a back-line analysis product cannot be directly used. Specifically, the entry of the branch line is directly entered into the rear line product by means of data bottoming, and the following problems exist in the way:
(1) The additional recording cost is high, and the rows need to submit work orders to modify the bottom laying data of the additional recording;
(2) The timeliness of the data is poor, namely, the flow of the version required to be proposed is changed when the additional information item group is modified;
(3) The additional recording management efficiency is low, and the branch can not flexibly and autonomously manage the additional recording information.
Aiming at the problems, the branch line realizes real-time management and maintenance of the additional recording data through BOCS-OSS-AIES (overseas integrated support system-information additional recording, support for the overseas branch line to flexibly customize required columns, additionally record local information and deal with frequent supervision and reporting), but the additional recording data cannot be directly used after being transmitted to a back-line product.
In order to solve the above defects, an embodiment of the present application provides a method for batch analysis and loading of bank entry data, which includes firstly combing an entry table name range, combing entry field names and types, then creating an entry table according to a preset entry requirement, setting a mapping rule in the table, then obtaining entry source data, constructing an entry target table attribute, and analyzing entry source data to obtain an analysis result of the entry source data; and then the analysis result of the additional recording source data can be loaded into an additional recording target table in a database in batch, so that the batch analysis and loading of the bank additional recording data are realized, the information of the additional recording data can be analyzed and loaded in batch under a big data platform, the production of a supervision report is conveniently completed, the additional recording cost and human resources are reduced, and the timeliness of the additional recording data is greatly improved.
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
First embodiment
Referring to fig. 1, a schematic flow chart of a method for batch parsing and loading of banking entry data provided in this embodiment is shown, where the method includes the following steps:
s101: and (5) carding the name range of the additional entry data table, and carding the name and type of the additional entry field.
In this embodiment, in order to analyze and load the information of the additional entry data in batch on the big data platform so as to complete the production of the supervision report, the present application first needs to sort the name range of the additional entry data table, and sort the name and type of the additional entry field, so as to execute the subsequent step S102.
Specifically, when parsing and loading the additional entry data in batch on the big data platform, first, according to the additional entry requirement preset by the branch line, the table name of the additional entry data table is acquired from the branch line, and the table ID of the agreed additional entry data table is acquired from overseas branch lines. Meanwhile, according to the supplement and record requirement preset by the branch line, the field name and the attribute of each supplement and record data table are obtained from the branch line, and the field ID of the appointed supplement and record data table field is obtained from the branch line.
The preset additional recording requirement can be set according to the actual situation, and the method is not limited in the application.
S102: and creating an additional recording mapping table according to a preset additional recording requirement, and setting a mapping rule in the mapping table.
In this embodiment, after the scope of the entry-padding data table name is combed through step S101, and the name and the type of the entry-padding field are combed, it is further necessary to create an entry-padding mapping table according to the entry-padding requirement preset in the branch line, and set a mapping rule in the mapping table: the entry table name and table ID mapping rule, the entry table field name and field ID mapping rule, and the field ID and field attribute mapping rule are shown in fig. 2, so as to perform the following step S103.
S103: acquiring the additional recording source data, constructing the attribute of the additional recording target table, and analyzing the additional recording source data to obtain the analysis result of the additional recording source data.
In this embodiment, after the step S102 creates the entry-supplementing mapping table according to the preset entry-supplementing requirement, and sets the mapping rule in the mapping table, the entry-supplementing source data may be further obtained, the entry-supplementing target table attribute may be constructed, and the entry-supplementing source data may be analyzed to obtain an analysis result of the entry-supplementing source data, so as to execute the subsequent step S104.
Specifically, since the BOCS-OSS-AIES needs to support the requirement of overseas division and diversification, the product design stores all data of the entry table in a general layer entry information table, and needs to acquire entry source data in order to reduce the number of database interactions, that is, data in an upstream UDP-ASVR (unified data platform — analysis layer service center) can be loaded into a temporary storage once a day.
Then, a table ID may be obtained according to the table name of the entry-padding data table, and a field name, a location, and an attribute of the entry-padding target table in the mapping table may be obtained according to the table ID, so as to construct an entry-padding target attribute. It can be understood that the building of the attribute of the entry-supplementing target table is to interact with the parameter table in the parameter template according to the name of the entry-supplementing table, and obtain the table ID, the field name, the field position and the field attribute, so that the source data can be matched to the correct position when the entry-supplementing source data is analyzed subsequently.
Then, a table ID may be obtained according to the table name of the additional recording data table, the source data sets of all the additional recording tables are obtained from the temporary storage according to the table ID, and the source data sets are analyzed one by one to obtain an analysis result of the additional recording source data, so as to execute the subsequent step S104.
It should be noted that, since each piece of source data includes a field ID and an entry-padding value, after finding a corresponding field name and a corresponding location in the mapping table according to the field ID, the entry-padding value needs to be temporarily stored in the corresponding location until all data in the entry-padding source data set under the table ID is completely parsed, as shown in fig. 3.
S104: and loading the analysis result of the additional recording source data into an additional recording target table in the database in batches, so as to realize batch analysis and loading of the bank additional recording data.
In this embodiment, after acquiring the additional recording source data through step S103, constructing the attribute of the additional recording target table, and analyzing the additional recording source data to obtain the analysis result of the additional recording source data, the analysis result of the additional recording source data may be further loaded in batch into the additional recording target table in the MPP (unified data platform) database of the branch, that is, after the analysis result of the additional recording source data is obtained, the additional recording value may be temporarily stored in a corresponding position, the loading module generates an insertion statement in batch according to the constructed attribute of the additional recording target table, and writes the target temporarily stored data in batch into the additional recording target table in the MPP database of the branch, so as to implement batch analysis and loading of the additional recording data of the bank.
Thus, by executing the steps S101 to S104, under a big data platform, branch-line characteristic supplementary recording is supported, and a complete mechanism is established, starting from supplementary recording source data, the source data is analyzed and loaded in batches into a branch-line MPP database through basic parameters, and is provided for back-line BDP-ODSS (overseas branch-line supervision reporting and internal management subject application, overseas shared data sets are processed for each branch line overseas based on the MPP database, stored in each line database, and each line user is supported to access the data of the line data set) to directly use the supplementary recording data for overseas report processing, so as to meet the requirement of overseas branch-line characteristic supervision reporting. The method has strong expandability, realizes the flexible and autonomous management of the additional recording information, reduces the cost of branch information additional recording, saves human resources and greatly improves the timeliness of the additional recording data.
In summary, according to the method for batch analysis and loading of additional entry data of a bank provided by this embodiment, first, a name range of an additional entry data table is sorted, names and types of additional entry fields are sorted, then, an additional entry mapping table is created according to a preset additional entry requirement, a mapping rule is set in the mapping table, then, additional entry source data is obtained, an attribute of an additional entry target table is constructed, and the additional entry source data is analyzed to obtain an analysis result of the additional entry source data; and then the analysis result of the additional recording source data can be loaded into an additional recording target table in a database in batch, so that the batch analysis and loading of the bank additional recording data are realized, the information of the additional recording data can be analyzed and loaded in batch under a big data platform, the production of a supervision report is conveniently completed, the additional recording cost and human resources are reduced, and the timeliness of the additional recording data is greatly improved.
Second embodiment
In this embodiment, a device for analyzing and loading the additional data in batch for the bank will be described, and please refer to the above method embodiment for related contents.
Referring to fig. 4, a schematic composition diagram of the device for batch parsing and loading of bank entry data provided in this embodiment specifically includes:
a combing unit 401, configured to comb the range of the entry table name, and comb the name and type of the entry field;
a creating unit 402, configured to create an entry-supplementing mapping table according to a preset entry-supplementing requirement, and set a mapping rule in the mapping table;
the analysis unit 403 is configured to obtain the entry-added source data, construct an attribute of the entry-added target table, and analyze the entry-added source data to obtain an analysis result of the entry-added source data;
and the loading unit 404 is configured to load the analysis result of the additional entry source data into the additional entry target table in the database in batch, so as to implement batch analysis and loading of the bank additional entry data.
In an implementation manner of this embodiment, the combing unit 401 is specifically configured to:
acquiring a table name and a table ID of an additional recording data table according to a preset additional recording requirement; and acquiring the field name and attribute of the additional recording data table and the field ID of the table field according to the preset additional recording requirement.
In an implementation manner of this embodiment, the parsing unit 403 includes:
the loading subunit is used for loading the data in the UDP-ASVR of the analysis layer service center of the unified data platform into a temporary storage;
and the construction subunit is used for acquiring the table ID according to the table name of the additional recording data table, and acquiring the field name, the position and the attribute of the additional recording target table in the mapping table according to the table ID so as to construct the attribute of the additional recording target.
In an implementation manner of this embodiment, the parsing unit 403 further includes:
the acquisition subunit is configured to acquire a table ID according to a table name of the additional recording data table, and acquire source data sets of all the additional recording tables from the temporary storage according to the table ID;
and the analysis subunit is used for analyzing the source data set one by one to obtain an analysis result of the additional source data.
In summary, according to the device for batch analysis and loading of the additional entry data of the bank provided by this embodiment, first, the name range of the additional entry data table is sorted, the name and the type of the additional entry field are sorted, then, according to a preset additional entry requirement, an additional entry mapping table is created, a mapping rule is set in the mapping table, then, additional entry source data is obtained, an attribute of an additional entry target table is created, and the additional entry source data is analyzed, so as to obtain an analysis result of the additional entry source data; and then the analysis result of the additional recording source data can be loaded into an additional recording target table in a database in batch, so that the batch analysis and loading of the bank additional recording data are realized, the information of the additional recording data can be analyzed and loaded in batch under a big data platform, the production of a supervision report is conveniently completed, the additional recording cost and human resources are reduced, and the timeliness of the additional recording data is greatly improved.
Further, an embodiment of the present application further provides a batch parsing and loading device for bank entry data, including: a processor, a memory, a system bus;
the processor and the memory are connected through the system bus;
the memory is used for storing one or more programs, and the one or more programs comprise instructions which when executed by the processor cause the processor to execute any implementation method of the batch parsing and loading method of the bank supplementary data.
Further, an embodiment of the present application further provides a computer-readable storage medium, where an instruction is stored in the computer-readable storage medium, and when the instruction runs on a terminal device, the terminal device is enabled to execute any implementation method of the batch parsing and loading method for the bank entry data.
As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that all or part of the steps in the above embodiment methods can be implemented by software plus a necessary general hardware platform. Based on such understanding, the technical solutions of the present application or portions contributing to the prior art may be embodied in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network communication device such as a media gateway, etc.) to execute the method described in the embodiments or some portions of the embodiments of the present application.
It should be noted that, in the present specification, the embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
In addition, it should be noted that the method, the device and the equipment for analyzing and loading the bank entry data in batches provided by the invention can be used in the field of big data and the field of finance. The above description is only an example, and does not limit the application fields of the method, the apparatus, and the device for batch analysis and loading of the bank entry data provided by the present invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for analyzing and loading bank additional data in batches is characterized by comprising the following steps:
the name range of the additional entry data table is sorted, and the name and the type of the additional entry field are sorted;
creating an additional recording mapping table according to a preset additional recording requirement, and setting a mapping rule in the mapping table;
acquiring additional source data, constructing the attribute of an additional target table, and analyzing the additional source data to obtain an analysis result of the additional source data;
and loading the analysis result of the additional recording source data into an additional recording target table in the database in batches, so as to realize batch analysis and loading of the bank additional recording data.
2. The method of claim 1, wherein the combing the range of entry fields and the combing the entry field names and types comprises:
acquiring a table name and a table ID of an additional recording data table according to a preset additional recording requirement; and acquiring the field name and attribute of the additional recording data table and the field ID of the table field according to the preset additional recording requirement.
3. The method of claim 2, wherein obtaining the entry-supplemented source data and constructing the entry-supplemented target table attributes comprises:
loading data in an analysis layer service center UDP-ASVR of a unified data platform into a temporary storage;
and acquiring a table ID according to the table name of the additional recording data table, and acquiring the field name, the position and the attribute of the additional recording target table in the mapping table according to the table ID so as to construct the additional recording target attribute.
4. The method according to any one of claims 2-3, wherein the parsing the supplement source data to obtain a parsing result of the supplement source data comprises:
acquiring a table ID according to the table name of the additional recording data table, and acquiring source data sets of all the additional recording tables from the temporary storage according to the table ID;
and analyzing the source data set one by one to obtain an analysis result of the additional source data.
5. A batch analysis and loading device for bank entry data is characterized in that the device comprises:
the carding unit is used for carding the name range of the additional recording data table and carding the name and the type of the additional recording field;
the system comprises a creating unit, a mapping unit and a processing unit, wherein the creating unit is used for creating an additional recording mapping table according to a preset additional recording requirement and setting a mapping rule in the mapping table;
the analysis unit is used for acquiring the additional recording source data, constructing the attribute of the additional recording target table, and analyzing the additional recording source data to obtain an analysis result of the additional recording source data;
and the loading unit is used for loading the analysis result of the additional recording source data into the additional recording target table in the database in batch to realize batch analysis and loading of the bank additional recording data.
6. Device according to claim 5, characterized in that said comb unit is particularly adapted to:
acquiring a table name and a table ID of an additional recording data table according to a preset additional recording requirement; and acquiring the field name and attribute of the additional recording data table and the field ID of the table field according to the preset additional recording requirement.
7. The apparatus of claim 6, wherein the parsing unit comprises:
the loading subunit is used for loading the data in the UDP-ASVR into the temporary storage;
and the construction subunit is used for acquiring the table ID according to the table name of the additional recording data table, and acquiring the field name, the position and the attribute of the additional recording target table in the mapping table according to the table ID so as to construct the attribute of the additional recording target.
8. The apparatus according to any of claims 6-7, wherein the parsing unit further comprises:
an obtaining subunit, configured to obtain a table ID according to a table name of an additional recording data table, and obtain source data sets of all additional recording tables from the temporary storage according to the table ID;
and the analysis subunit is used for analyzing the source data set one by one to obtain an analysis result of the additional source data.
9. The utility model provides a batch analysis and load equipment of bank's additional recording data which characterized in that includes: a processor, a memory, a system bus;
the processor and the memory are connected through the system bus;
the memory is to store one or more programs, the one or more programs comprising instructions, which when executed by the processor, cause the processor to perform the method of any of claims 1-4.
10. A computer-readable storage medium having stored therein instructions that, when executed on a terminal device, cause the terminal device to perform the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211000841.3A CN115375430A (en) | 2022-08-19 | 2022-08-19 | Method, device and equipment for batch analysis and loading of additional data of bank |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211000841.3A CN115375430A (en) | 2022-08-19 | 2022-08-19 | Method, device and equipment for batch analysis and loading of additional data of bank |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115375430A true CN115375430A (en) | 2022-11-22 |
Family
ID=84066534
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211000841.3A Pending CN115375430A (en) | 2022-08-19 | 2022-08-19 | Method, device and equipment for batch analysis and loading of additional data of bank |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115375430A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117608536A (en) * | 2023-12-20 | 2024-02-27 | 杭州明佑电子有限公司 | Gap data online template customization and supplementary recording system and method thereof |
-
2022
- 2022-08-19 CN CN202211000841.3A patent/CN115375430A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117608536A (en) * | 2023-12-20 | 2024-02-27 | 杭州明佑电子有限公司 | Gap data online template customization and supplementary recording system and method thereof |
| CN117608536B (en) * | 2023-12-20 | 2024-05-28 | 杭州明佑电子有限公司 | Gap data online template customization and supplementary recording system and method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10956422B2 (en) | Integrating event processing with map-reduce | |
| CN107506383B (en) | Audit data processing method and computer equipment | |
| CN103927314B (en) | A kind of method and apparatus of batch data processing | |
| CN111290813B (en) | Software interface field data standardization method, device, equipment and medium | |
| CN111552728B (en) | Data processing method, system, terminal and storage medium of block chain | |
| CN112651218A (en) | Automatic generation method and management method of bidding document, medium and computer | |
| CN112988123B (en) | DDD-oriented software design method and system | |
| CN108960672B (en) | Quota and time-limited wind control method and device and computer readable storage medium | |
| CN112966486A (en) | Intelligent engineering quantity list generation method and device, terminal and storage medium | |
| CN112905323A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN115375430A (en) | Method, device and equipment for batch analysis and loading of additional data of bank | |
| CN110781235A (en) | Big data based purchase data processing method and device, terminal and storage medium | |
| CN111061733A (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN113536148A (en) | Crowd delineating method, device, equipment and storage medium | |
| CN112163948A (en) | Method, system, equipment and storage medium for separately-moistening calculation | |
| CN111522729A (en) | Method, device and system for determining rule release | |
| CN115543428A (en) | Simulated data generation method and device based on strategy template | |
| CN114880387A (en) | Data integration script generation method and device, storage medium and electronic equipment | |
| CN112905720A (en) | Operation data processing method and device based on source data management model | |
| CN114707953A (en) | Main data full life cycle management method, system, engine and storage medium | |
| CN114328579A (en) | System, method, electronic device, and storage medium for automatically creating and assigning tasks | |
| CN111522840A (en) | Label configuration method, device, equipment and computer readable storage medium | |
| CN110134516B (en) | Financial data processing method, apparatus, device and computer readable storage medium | |
| US20240126759A1 (en) | Converting an api into a graph api | |
| CN113806436A (en) | Method and device for improving access efficiency based on AMDP (advanced metering disk) and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |