CN111858737A - Data import device and method, bank system building device and method, and storage medium - Google Patents
Data import device and method, bank system building device and method, and storage medium Download PDFInfo
- Publication number
- CN111858737A CN111858737A CN202010743017.1A CN202010743017A CN111858737A CN 111858737 A CN111858737 A CN 111858737A CN 202010743017 A CN202010743017 A CN 202010743017A CN 111858737 A CN111858737 A CN 111858737A
- Authority
- CN
- China
- Prior art keywords
- data
- built
- bank system
- business
- bank
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 230000008676 import Effects 0.000 title claims abstract description 28
- 238000012545 processing Methods 0.000 claims abstract description 53
- 238000004891 communication Methods 0.000 claims abstract description 42
- 230000008878 coupling Effects 0.000 claims abstract description 11
- 238000010168 coupling process Methods 0.000 claims abstract description 11
- 238000005859 coupling reaction Methods 0.000 claims abstract description 11
- 238000005192 partition Methods 0.000 claims description 30
- 238000000586 desensitisation Methods 0.000 claims description 21
- 238000004519 manufacturing process Methods 0.000 claims description 20
- 230000008569 process Effects 0.000 claims description 20
- 238000000605 extraction Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 12
- 238000010276 construction Methods 0.000 claims description 11
- 230000006870 function Effects 0.000 claims description 10
- 238000012360 testing method Methods 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 9
- 230000015654 memory Effects 0.000 claims description 8
- 230000010354 integration Effects 0.000 claims description 7
- 230000008520 organization Effects 0.000 claims description 7
- 230000006835 compression Effects 0.000 claims description 6
- 238000007906 compression Methods 0.000 claims description 6
- 230000005012 migration Effects 0.000 claims description 6
- 238000013508 migration Methods 0.000 claims description 6
- 230000006798 recombination Effects 0.000 claims description 5
- 238000005215 recombination Methods 0.000 claims description 5
- 238000004088 simulation Methods 0.000 claims description 5
- 230000003993 interaction Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 12
- 238000013075 data extraction Methods 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 4
- 238000012827 research and development Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000012217 deletion Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
- G06F21/6254—Protecting personal data, e.g. for financial or medical purposes by anonymising data, e.g. decorrelating personal data from the owner's identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/65—Updates
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/71—Version control; Configuration management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0813—Configuration setting characterised by the conditions triggering a change of settings
- H04L41/082—Configuration setting characterised by the conditions triggering a change of settings the condition being updates or upgrades of network functionality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Abstract
The embodiment of the invention relates to the field of finance, and provides a bank system building device, which comprises: the system configuration device is used for deploying hardware resources required by the bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; the data import device is used for generating business data and importing the generated business data into a database of a bank system to be built; the operation adjusting device is used for configuring operation parameters, and the operation parameters are used for processing business data of the bank system to be built; the online setting device is used for setting online communication parameters, and the online communication parameters are used for carrying out data communication among global areas by the bank system to be built; and the version upgrading configuration device is used for adjusting and setting parameters required by the upgraded bank system version. The embodiment of the invention provides a core bank system building device or method with high feasibility, low cost and short period.
Description
Technical Field
The embodiment of the invention relates to the technical field of finance, in particular to a data import device and method, a bank system building device and method and a storage medium.
Background
International commercial banks with businesses throughout the world typically employ IT architecture strategies with data and systems centrally deployed in data centers. In order to ensure that the business of all countries and regions in the world is smoothly developed, the bank often faces the requirements of all countries, and performs the work of simulating the trial operation of new local business, demonstrating the system function of the central bank or the financial management bureau, simulating the change business by matching with the local clearing organization and the like. In order to meet the demand, the global data center of the international commercial bank is forced to additionally add a set of full-function bank system to meet the demand on the basis of not influencing production operation.
After business requirements are put forward in various countries and regions, a bank system is newly built for meeting the business requirements, and the traditional process is as follows: and (3) evaluating/purchasing/deploying system hardware resources, importing business and technical data after completing storage configuration of a host of the full-function bank system, building a communication module, building a database and deploying an operating system, and providing the work of trial operation of new business, demonstration of new functions and simulation of organization among banks after the built full-function bank system is formed. However, the traditional process is adopted to build a bank system, so that the cost is high, the building period is long, and the business expansion requirement is difficult to meet in a short time.
Moreover, the traditional process is adopted to build a new system, so that the resource consumption is large, the system needs to be released as soon as possible after the system is used, repeated building and releasing brings great pressure to system resources, human resources and operation and maintenance investment of the data center, and even if 2-3 sets of systems are built every year, the upper limit of the current system, human resources and operation and maintenance of the data center is exceeded, so that more business expansion requirements are difficult to meet.
Disclosure of Invention
The embodiment of the invention provides a data importing device and method, a bank system building device and method and a storage medium, and solves the problem that the IT organization and the architecture of a global bank system in the related technology cannot meet the current situation of business expansion development.
According to one aspect of the invention, a data import method is provided, which is used for importing data when a bank system is built, and the method comprises the following steps: extracting pre-input data according to business requirements to obtain extracted data, wherein the pre-input data are business data of a bank system centralized in a production operation center; desensitizing sensitive information in the extracted data according to a desensitization rule to obtain desensitized extracted data; and processing the desensitized extracted data so as to generate business data of the bank system to be built, and importing the generated business data of the bank system to be built into a database of the bank system to be built.
In some embodiments, the data importing method further comprises: backing up the data input in advance before extracting the data; and setting data capacity required during data migration and integration, wherein the setting comprises capacity expansion, database table space compression and data recombination.
In some embodiments, processing the desensitized decimated data comprises: taking one or more policies for different situation data, wherein the different situation data comprises: repeated records, the key value contents are the same but not the key value information difference, the key value contents are different but not the key value information difference, and the table structure has no unique key value; the one or more policies include: and judging the data under different conditions, deleting the error data, deleting the repeated data and merging the repeated data according to the judgment result.
In some embodiments, processing the desensitized decimated data comprises: performing supplementary input on data required by the bank system to be built in a production environment and/or a test environment, wherein the data comprises teller information and a card number of a newly added teller; and/or resetting original data in the database, wherein the original data comprises teller information of an original teller.
According to one aspect of the invention, a data import device is provided, which is used for building a bank system and comprises: the extraction unit is used for extracting pre-input data according to business requirements to obtain extracted data, wherein the pre-input data are business data of a bank system centralized in a production operation center; a desensitization unit, configured to perform desensitization processing on the sensitive information in the extracted data according to a desensitization rule, to obtain desensitized extracted data; and the processing unit is used for processing the desensitized extracted data so as to generate business data of the bank system to be built and importing the generated business data of the bank system to be built into a database of the bank system to be built.
In some embodiments, the data importing apparatus further includes: the backup unit is used for backing up the data input in advance before the data are extracted by the extraction unit; and the setting unit is used for setting the data capacity required during data migration and integration, and the setting comprises capacity expansion, database table space compression and data recombination.
According to another aspect of the invention, a banking system construction method is provided, which includes: deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; generating business data and importing the generated business data into a database of the bank system to be built; configuring operation parameters, wherein the operation parameters are used for the bank system to be built to process business data; setting online communication parameters, wherein the online communication parameters are used for data communication between global areas of the bank system to be built; and adjusting and setting parameters required by upgrading the built bank system version.
According to an aspect of the present invention, there is provided a banking system construction apparatus including: the system configuration device is used for deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; the data import device is used for generating business data and importing the generated business data into a database of the bank system to be built; the operation adjusting device is used for configuring operation parameters, and the operation parameters are used for the bank system to be built to process business data; the online setting device is used for setting online communication parameters, and the online communication parameters are used for data communication between global areas by the bank system to be built; and the version upgrading configuration device is used for adjusting and setting parameters required by the upgraded bank system version.
In some embodiments, the system configuration means comprises: the hardware resource configuration unit is used for configuring a disk and a CPU (central processing unit) required by the deployment of the parallel coupling system; the host storage configuration unit is used for allocating host virtual space used by the parallel coupling system deployment; the communication configuration unit is used for configuring a communication module of the bank system to be built; a host database configuration unit for running multiple database subsystems simultaneously on an operating system, wherein each subsystem corresponds to multiple application databases defined by its address space.
In some embodiments, the operation adjustment device includes: the system and application parameter adjusting unit is used for adjusting system and application parameters so as to allow the bank system to be built to process the banking business data in batch; a batch operation parameter setting unit for setting operation time to allow corresponding batch data processing at each operation time; and the information interaction setting unit is used for transmitting the data processed by the bank system to be built to an open system platform according to a data transmission strategy, wherein the data transmission strategy is set by the open system platform and a data processing system, and the strategy comprises the transmission of the preset content data in the preset time corresponding to the preset content data and/or the transmission of the preset content data to the preset position of the open system platform corresponding to the preset content data.
In some embodiments, when the version upgrading configuration device upgrades the version of the system, the version upgrading is performed according to a host partition, wherein the partition is a partition of a region where the bank system extends global businesses.
According to another aspect of the present invention, there is provided a method for applying the banking system building device in the above embodiment, the method including: a bank system is built by using the bank system building device according to business requirements; and performing service commissioning, function demonstration and local card organization or clearing network simulation on the built bank system.
According to another aspect of the present invention, there is provided an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the data importing method in the above embodiments when executing the program; or the processor implements the banking system building method in the above embodiment when executing the program.
According to another aspect of the present invention, there is provided a computer-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a processor, implements the data import method in the above embodiments; or the computer program realizes the bank system building method in the above embodiment when being executed by the processor.
According to the data importing device and method and the bank system building device and method provided by the embodiment of the invention, a set of core bank system environment can be built in a short time, and less manpower and financial resources are used, so that the requirement of business expansion of the local country or overseas branch can be met.
Drawings
Other objects and advantages of the present invention will become apparent from the following description of the invention which refers to the accompanying drawings, and may assist in a comprehensive understanding of the invention.
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic structural diagram of a data import apparatus according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a data import apparatus according to another embodiment of the present invention;
FIG. 3 is a flow chart of a data import method according to an embodiment of the present invention;
fig. 4 shows a schematic structural diagram of a banking system construction device according to an embodiment of the present invention;
fig. 5 shows a schematic structural diagram of a banking system construction device according to another embodiment of the present invention;
FIG. 6 shows a flow chart of a banking system construction method according to an embodiment of the present invention;
FIG. 7 shows a schematic diagram of a method of building a device using a banking system, according to an embodiment of the invention;
FIG. 8 shows a schematic structural diagram of a computer system according to an embodiment of the invention.
It is noted that the drawings are not necessarily to scale and are merely illustrative in nature and not intended to obscure the reader.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this invention belongs.
The data importing device and the bank system building device of the embodiment of the invention provide a device and a method for supporting building of a set of core bank system environment in a short time in order to solve the problem that the IT organization and the architecture of a global bank system cannot meet the current situation of business expansion development, so that the built independent system is provided for a home country or a foreign branch to meet the business expansion requirement of the home country or the foreign branch on the basis of not influencing the production and operation of the original bank system.
Fig. 1 is a schematic structural diagram of a data import apparatus according to an embodiment of the present invention. The data importing device 20 is used for building a bank system, and comprises: the extraction unit 21 is configured to extract pre-input data according to business requirements to obtain extracted data, where the pre-input data is business data of a bank system centralized in a production operation center; a desensitization unit 22, configured to perform desensitization processing on the sensitive information in the extracted data according to a desensitization rule, so as to obtain desensitized extracted data; and the processing unit 23 is configured to process the desensitized extracted data so as to generate service data of the bank system to be built, and import the generated service data of the bank system to be built into a database of the bank system to be built.
According to the traditional bank system building process, when building is carried out each time, business data are required to be imported after system host storage configuration, database building and the like are implemented, the traditional method is time-consuming and labor-consuming, building and releasing are required to be carried out repeatedly, great pressure is caused to a data center, and due to the long building period, the instant demand of business expansion is easily influenced.
The data import device of the embodiment of the invention provides a tool for conveniently and rapidly building a bank system through modular design data management, and realizes effective management of data through each modular function, thereby improving the accuracy, the effectiveness and the like of the data.
After business requirements are provided by each country and each region, a set of core bank system needs to be newly built, and required basic business data is firstly created for a database of the bank system to be built according to the business requirements. The business data of the existing bank system centralized in the production operation center is used as input and is used as the data base of the bank system to be built, and the data comprises all types of data of the production operation of the bank system, such as account, amount, card information, protocol, business parameters, teller information (in production, test and research and development environments) and the like. Further, the extraction unit 21 performs at least partial extraction on the input data according to different business requirements, so as to create new business data for the bank system to be built. In order to ensure the safety, the effectiveness and the like of the extracted data, desensitization processing and other processing are further carried out on the extracted data, so that business data of the bank system to be built are generated and are imported into a database of the bank system to be built.
Referring to fig. 1-2, in some embodiments, the data importing apparatus 20 further includes a backup unit 24, which may be used to backup the input data before the data extraction performed by the extraction unit 21, synchronize the data to a data center (e.g., for use in a research and development test environment) through a shared tape library, perform data backup so that the extraction unit 21 performs data extraction at any time through the data backup, or prevent data loss during data extraction to facilitate data re-provision. The extracting unit 21 is configured to extract, according to a service requirement, for example, the outbound branch data that needs to be merged. The desensitization unit 22 further performs desensitization processing on the sensitive information in the extracted data according to desensitization rules, for example, data conversion and transformation processing are performed on a username, a communication number, a certificate number, a client address, an email address, a password, and the like, so as to realize reliable protection of the sensitive information, wherein the desensitization rules can be set according to actual requirements, and include data conversion rules, regular rule modification time, and the like. The processing unit 23 further performs processing on the desensitized extracted data, for example, performing multiple-dimension statistics such as statistics of table capacity, statistics of table list number, and the like on data of partitions such as the specified extracted asian-pacific region, american region, european region, and the like, wherein redundant data deletion processing is performed on table information repeatedly recorded in the partition data, or/and data merging is performed on tables having unique index key values, or/and data having conflicts in the partition data is adjusted according to a framework, for example, the processing unit 23 merges the partition data in a new framework.
In some embodiments, the processing unit 23 is further configured to process data required by the banking system in a production environment and a testing environment, for example, when the number of the original teller persons used in the testing environment cannot meet the requirement, the number of the teller persons needs to be increased, and the processing unit 23 may be configured to supplement the teller information of the newly increased teller persons into the database; or the teller information of the original teller, such as a password, is reset so as to meet the use requirements of the bank system under different environments.
In some embodiments, the data importing apparatus 20 further includes a setting unit 25, for example, in a link related to data migration and integration, when the extracted partition data needs to be merged, in order to avoid situations such as insufficient tablespace resources, the setting unit 25 may perform operations such as early capacity expansion of data capacity, and/or database table space compression, and/or data reorganization, so as to ensure that the data capacity meets requirements.
Fig. 3 is a flowchart illustrating a data importing method according to an embodiment of the present invention. The data import method can be used for data import when a bank system is built, for example.
Step S301, extracting the pre-input data according to the business requirements to obtain extracted data, wherein the pre-input data is the business data of the bank system centralized in the production operation center.
The business data of the existing bank system centralized in the production operation center is used as input and is used as the data base of the bank system to be built, and the data comprises all types of data of the production operation of the bank system, such as account, amount, card information, protocol, business parameters, teller information (in production, test and research and development environments) and the like. In some embodiments, the input data is at least partially extracted according to different business requirements, which may be implemented via the extraction unit 21 of the data importing apparatus 20 shown in fig. 1 or 2, so as to create new business data for the banking system to be built. For example, the data of each subarea such as the Asia-Pacific area, the American area, the European area and the like is subjected to specified extraction.
And step S302, desensitizing sensitive information in the extracted data according to a desensitizing rule to obtain desensitized extracted data.
In some embodiments, desensitization processing is performed on sensitive information in the extracted data according to desensitization rules, which can be implemented by the desensitization unit 22 of the data importing apparatus 20 shown in fig. 1 or 2, for example, data conversion and transformation processing is performed on a user name, a communication number, a certificate number, a client address, an email address, a password, and the like, so as to implement reliable protection of the sensitive information, and the desensitization rules can be set according to actual requirements, and include data conversion rules, regular modification time of the rules, and the like.
Step S303, processing the desensitized extracted data so as to generate business data of the bank system to be built, and importing the generated business data of the bank system to be built into a database of the bank system to be built.
In some embodiments, the processing of the desensitized extracted data includes, for example, performing various dimensional statistics such as statistics of table capacity, statistics of table list number, etc. on partition data such as specified extracted asia-pacific region, american region, european region, etc., for example, performing redundant data deletion processing on table information repeatedly recorded in the partition data via the processing unit 23 of the data importing apparatus 20 shown in fig. 1 or 2, or/and performing data merging on a table having a unique index key value, or/and performing framework adjustment on data having a conflict in the partition data, for example, the processing unit 23 merges the partition data in a new framework.
In some embodiments, processing the desensitized decimated data further comprises: processing data required by the bank system in a production environment and a test environment, for example, when the number of the original teller persons in the test environment cannot meet the requirement, the number of the teller persons needs to be increased, and the processing unit 23 can supplement the teller information of the newly increased teller persons into the database; or the teller information of the original teller, such as a password, is reset so as to meet the use requirements of the bank system under different environments.
In some embodiments, the data importing method further comprises: before the data extraction is performed, the input data is backed up, which can be implemented by the backup unit 24 unit of the data importing apparatus 20 shown in fig. 1 or 2, and is synchronized to the data center (for example, for a research and development test environment) through the shared tape library, so that the data extraction is performed by the extraction unit 21 at any time through data backup, or data loss is prevented during the data extraction process so as to facilitate the data re-provision. In the links related to data migration and integration, when extracted partition data needs to be merged, in order to avoid situations such as insufficient tablespace resources, the setting unit 25 can be used for performing work such as early capacity expansion of data capacity, and/or compression of database table space, and/or data recombination, so as to ensure that the data capacity meets requirements.
In some embodiments, when processing desensitized extracted data, one or more policies may be applied to different case data, including, for example: repeated records, the same key value content but different non-key value information, different key value content but different non-key value information, and no unique key value in the table structure. For example, for normal duplicate records belonging to a match, redundant duplicate records may be deleted via the processing unit 23 to ensure the uniqueness of each normal record in the database. For another example, when there are two records in the database: record 1: name: zhang III, identification number: x, home address: y1; record 2: name: zhang III, identification number: x, home address: y2 (only home addresses differ in the two records); the processing unit 23 determines the two records according to the above two records, deletes the error record according to the determination result, and combines the two records (which belongs to the case that the key value content is the same but the key value information is different). The data of different situations are judged via the processing unit 23, and then one or more strategies, such as deletion, combination and the like, are adopted to process the data.
According to the data importing method provided by the embodiment of the present invention, corresponding functions can be implemented by using the data importing apparatus provided by the embodiment of the present invention, and may also be implemented by other methods, which is not limited in the embodiment of the present invention.
Fig. 4 shows a schematic structural diagram of a banking system building device according to an embodiment of the present invention. As shown in fig. 4, the banking system constructing apparatus 100 includes: the system configuration device 10 is used for deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; the data import device 20 is used for generating business data and importing the generated business data into a database of a bank system to be built; the operation adjusting device 30 is used for configuring operation parameters, and the operation parameters are used for processing business data of the bank system to be built; the online setting device 40 is used for setting online communication parameters, and the online communication parameters are used for data communication between global areas of the bank system to be built; and the version upgrading configuration device 50 is used for adjusting and setting parameters required by upgrading the built bank system version.
Referring further to fig. 5, the system configuration device 10 is used for configuring a full-function banking system (i.e. a chinese industrial and commercial bank information processing system) as a core business system, which embodies the advantage of data concentration, for example, in a remittance business, a remitter can directly check the name and account number of a receiver in a unified database, and can handle the remittance immediately and check the remittance in real time if the data are consistent, without the need for confirmation, check and feedback by the receiver. The full-function bank system realizes system integration and openness and high information sharing.
In some embodiments, the system configuration apparatus 10 may include a hardware resource configuration unit 11, which may implement configuration of a disk, a CPU, and the like required for deployment of the parallel coupled system; the host storage configuration unit 12 is configured to allocate a host virtual space used for deployment of the parallel coupled system, for example, the space of the newly added system after merging may be allocated according to an original space occupied by each partition data (asia-pacific region, american region, and the like); the communication configuration unit 13 is used for the full-function bank system to carry out external communication; a host database configuration unit 14, configured to run a plurality of database subsystems simultaneously on an operating system, wherein each of the subsystems corresponds to a plurality of application databases defined by its address space.
Referring to fig. 5, in some embodiments, the data import apparatus 20 may use the apparatus of the embodiment of fig. 2, which includes a backup unit 24, an extraction unit 21, a desensitization unit 22, a processing unit 23, and a setting unit 25. The functions of the modules of the data importing apparatus 20 may be as described in the above embodiments, and descriptions for achieving the same technical effects are not repeated herein.
In other embodiments, the data importing apparatus 20 may also use a general data importing apparatus, which is not limited in this embodiment of the present invention.
Referring to fig. 5, in some embodiments, the operation adjustment device 30 includes: the system and application parameter adjusting unit 31 can implement parallel batch operation of the hosts to process banking data by adjusting system and application parameters, for example, a plurality of hosts operate in parallel to process data of each partition (asia-pacific area, american area, etc.), and the batch operation includes operation modes such as daytime batch, end-of-day batch, etc.; the batch operation parameter setting unit 32 is used as a batch operation processing tool, and can be configured independently in terms of batch operation, such as setting operation time, operation period, and the like, so that the host can automatically allocate and process batch data of each partition data at set time; the information interaction setting unit 33 is configured to transmit data processed by the bank system to be built to the open system platform according to the data transmission policy, for example, batch processing data of the core bank system host in the daytime and in the end-of-day batch may be downloaded to the open system platform by using a fixed field number (for example, including transmitting the processed partition data at different times, or transmitting the processed partition data to a designated location of the platform), so that the data automatically generates a statistical form and the like on the platform, and automation of service information management is achieved.
In some embodiments, the online configuration device 40 is configured to configure parameters related to the online communication module, so as to implement a global inter-domain data exchange routing information adjustment function. The device can set the service data originally belonging to different partitions to be cross-partition or not to be cross-partition for cross-partition service processing after the host application parameters are modified. For example, for each partition entered by merging, the parameters of the host application are modified during merging, so that each partition data has a corresponding position in the newly added system, and therefore, required data can be acquired from the corresponding position during communication.
In some embodiments, when the version-up configuration apparatus 50 performs a version-up on the system, the version-up is performed on the host partitions as a whole, where the host partitions are banking businesses corresponding to one partition (asia-pacific area, american area, etc.) for each host. For example, taking the asia-pacific region as an example, the version-up configuration device 50 sets a time when all the branches of the region are not open, so as to perform the version-up on the host system responsible for the asia-pacific region service.
Fig. 6 shows a flow diagram of a banking system building method according to an embodiment of the present invention. The bank system building method comprises the following steps: step S601, deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; step S602, generating business data and importing the generated business data into a database of the bank system to be built; step S603, configuring operation parameters, wherein the operation parameters are used for the bank system to be built to process business data; step S604, setting online communication parameters, wherein the online communication parameters are used for data communication between global areas of the bank system to be built; and step S605, adjusting and setting parameters required by upgrading the built bank system version.
According to the bank system building device and method provided by the embodiment of the invention, the advantages of convenience in operation, short period and low cost for building the core bank system are provided. For traditional bank system construction for dealing with business requirements, for example, taking the requirements received by a commercial bank all the year 2015 as an example, in order to meet the special system requirements proposed by branches outside 28 families in total, 1-2 sets of systems independent of the production environment are arranged and constructed, and the requirements of 5-8 branches are only met, and the rest 20 branches cannot obtain independent systems within 2 months to complete demonstration and simulation, so that the limitations have negative effects on the development progress and market occupation time of new business of the industrial and silver bank in the European region and the American region.
The bank system building device and the bank system building method can solve the problems and achieve the purpose of completing independent core bank system building in a short time (for example, within 1 week), so that the bank group is provided for local and global overseas branches to use, and ideas are provided for coping with the expansion requirements of the overseas branch business newly entering the country and the region.
Compared with the traditional process, the bank system building device and method provided by the embodiment of the invention can relieve the system resource and human resource pressure of the data center and improve the feasibility.
Fig. 7 shows a schematic diagram of a method for building a device using a banking system according to an embodiment of the present invention. After each region puts forward a system environment building requirement, the bank system building device provided by the embodiment of the invention can build a full-function bank system independent of a production environment in a short time, so that the system is provided for each region for use, and functions including new business commissioning, new function demonstration, local card organization or clearing network simulation and the like are facilitated.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the data importing method in the foregoing embodiments; or the computer program realizes the bank system building method in the above embodiment when being executed by the processor.
An embodiment of the present invention further provides a structural schematic diagram of a computer system, and fig. 8 schematically illustrates a block diagram of a computer system suitable for implementing the method described above according to an embodiment of the present disclosure. The computer system illustrated in FIG. 8 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the disclosure.
As shown in fig. 8, the computer system 80 according to the embodiment of the present disclosure includes a processor 800, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)801 or a program loaded from a storage section 807 into a Random Access Memory (RAM) 802. Processor 800 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 800 may also include on-board memory for caching purposes. Processor 800 may include a single processing unit or multiple processing units for performing different actions of a method flow according to embodiments of the disclosure.
In the RAM 802, various programs and data necessary for the operation of the system 80 are stored. The processor 800, ROM 801, and RAM 802 are connected to each other by a bus 803. The processor 800 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 801 and/or the RAM 802. Note that the programs may also be stored in one or more memories other than the ROM 801 and the RAM 802. The processor 800 may also perform various operations of method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to an embodiment of the present disclosure, the system 80 may also include an input/output (I/O) interface 804, the input/output (I/O) interface 804 also being connected to the bus 803. The system 80 may also include one or more of the following components connected to the I/O interface 804: an input section 805 including a keyboard, a mouse, and the like; an output section 806 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 807 including a hard disk and the like; and a communication section 808 including a network interface card such as a LAN card, a modem, or the like. The communication section 808 performs communication processing via a network such as the internet. A drive 809 is also connected to the I/O interface 804 as necessary. A removable medium 810 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 809 as necessary, so that a computer program read out therefrom is mounted into the storage section 807 as necessary.
It should also be noted that, in the case of the embodiments of the present invention, features of the embodiments and examples may be combined with each other to obtain a new embodiment without conflict.
The above description is only an embodiment of the present invention, but the scope of the present invention is not limited thereto, and the scope of the present invention is subject to the scope of the claims.
Claims (14)
1. A data import method is used for data import when a bank system is built, and comprises the following steps:
extracting pre-input data according to business requirements to obtain extracted data, wherein the pre-input data are business data of a bank system centralized in a production operation center;
desensitizing sensitive information in the extracted data according to a desensitization rule to obtain desensitized extracted data;
and processing the desensitized extracted data so as to generate business data of the bank system to be built, and importing the generated business data of the bank system to be built into a database of the bank system to be built.
2. The data import method according to claim 1, further comprising:
backing up the data input in advance before extracting the data;
and setting data capacity required during data migration and integration, wherein the setting comprises capacity expansion, database table space compression and data recombination.
3. The data import method of claim 1 or 2, wherein processing the desensitized extracted data comprises:
taking one or more policies for different situation data, wherein the different situation data comprises: repeated records, the key value contents are the same but not the key value information difference, the key value contents are different but not the key value information difference, and the table structure has no unique key value;
the one or more policies include: and judging the data under different conditions, deleting the error data, deleting the repeated data and merging the repeated data according to the judgment result.
4. The data import method of claim 3, wherein processing the desensitized decimated data comprises:
performing supplementary input on data required by the bank system to be built in a production environment and/or a test environment, wherein the data comprises teller information and a card number of a newly added teller; and/or
Resetting original data in a database, wherein the original data comprises teller information of an original teller.
5. A data import device is used for building a bank system and comprises:
the extraction unit is used for extracting pre-input data according to business requirements to obtain extracted data, wherein the pre-input data are business data of a bank system centralized in a production operation center;
a desensitization unit, configured to perform desensitization processing on the sensitive information in the extracted data according to a desensitization rule, to obtain desensitized extracted data;
and the processing unit is used for processing the desensitized extracted data so as to generate business data of the bank system to be built and importing the generated business data of the bank system to be built into a database of the bank system to be built.
6. The data import apparatus of claim 5, further comprising:
the backup unit is used for backing up the data input in advance before the data are extracted by the extraction unit;
and the setting unit is used for setting the data capacity required during data migration and integration, and the setting comprises capacity expansion, database table space compression and data recombination.
7. A banking system building method comprises the following steps:
deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system;
generating business data and importing the generated business data into a database of the bank system to be built;
configuring operation parameters, wherein the operation parameters are used for the bank system to be built to process business data;
setting online communication parameters, wherein the online communication parameters are used for data communication between global areas of the bank system to be built;
and adjusting and setting parameters required by upgrading the built bank system version.
8. A banking system set-up device comprising:
the system configuration device is used for deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system;
the data import device is used for generating business data and importing the generated business data into a database of the bank system to be built;
the operation adjusting device is used for configuring operation parameters, and the operation parameters are used for the bank system to be built to process business data;
the online setting device is used for setting online communication parameters, and the online communication parameters are used for data communication between global areas by the bank system to be built;
and the version upgrading configuration device is used for adjusting and setting parameters required by the upgraded bank system version.
9. A banking system construction apparatus according to claim 8, wherein the system configuration means comprises:
the hardware resource configuration unit is used for configuring a disk and a CPU (central processing unit) required by the deployment of the parallel coupling system;
the host storage configuration unit is used for allocating a host virtual space used by the parallel coupling system deployment;
the communication configuration unit is used for configuring a communication module of the bank system to be built;
a host database configuration unit for running multiple database subsystems simultaneously on an operating system, wherein each subsystem corresponds to multiple application databases defined by its address space.
10. A banking system construction apparatus according to claim 8 or 9, wherein the operation adjustment means includes:
the system and application parameter adjusting unit is used for adjusting system and application parameters so as to allow the bank system to be built to process the banking business data in batch;
a batch operation parameter setting unit for setting operation time to allow corresponding batch data processing at each operation time;
and the information interaction setting unit is used for transmitting the data processed by the bank system to be built to an open system platform according to a data transmission strategy, wherein the data transmission strategy is set by the open system platform and a data processing system, and the strategy comprises the transmission of the preset content data in the preset time corresponding to the preset content data and/or the transmission of the preset content data to the preset position of the open system platform corresponding to the preset content data.
11. The banking system building device according to claim 10, wherein when the version upgrading configuration device upgrades the version of the system, the version upgrading is performed according to a host partition, wherein the partition is a partition of the banking system in a region where global business is located.
12. A method of applying the banking system construction apparatus of any one of claims 8-11, the method comprising:
a bank system is built by using the bank system building device according to business requirements;
and performing service commissioning, function demonstration and local card organization or clearing network simulation on the built bank system.
13. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the data import method of any of claims 1-4 when executing the program; or
The processor, when executing the program, implements the banking system construction method of claim 7.
14. A computer-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a processor, implements the data import method of any of claims 1 to 4; or
The computer program, when executed by a processor, implements the banking system construction method of claim 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010743017.1A CN111858737B (en) | 2020-07-29 | 2020-07-29 | Data importing device and method, bank system constructing device and method, and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010743017.1A CN111858737B (en) | 2020-07-29 | 2020-07-29 | Data importing device and method, bank system constructing device and method, and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111858737A true CN111858737A (en) | 2020-10-30 |
CN111858737B CN111858737B (en) | 2024-01-09 |
Family
ID=72944949
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010743017.1A Active CN111858737B (en) | 2020-07-29 | 2020-07-29 | Data importing device and method, bank system constructing device and method, and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111858737B (en) |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10038289A1 (en) * | 1999-08-11 | 2001-02-22 | Ibm | Core banking activities integration system, involves preparing application-development environment business platforms for integration into the various processes usually required in separate core banking systems |
US6990466B1 (en) * | 2000-08-08 | 2006-01-24 | International Business Machines Corporation | Method and system for integrating core banking business processes |
CN103366243A (en) * | 2013-06-19 | 2013-10-23 | 华夏银行股份有限公司 | Banking business core system |
CN105631028A (en) * | 2015-12-30 | 2016-06-01 | 中国农业银行股份有限公司 | Method and system for implementing database clustering function |
CN107995064A (en) * | 2017-12-14 | 2018-05-04 | 云南电网有限责任公司玉溪供电局 | Test platform building method based on virtualization technology |
CN109032757A (en) * | 2018-07-12 | 2018-12-18 | 贵州电网有限责任公司 | A kind of time-optimized method of system framework automatic deployment based on cloud platform |
CN110795764A (en) * | 2019-11-01 | 2020-02-14 | 中国银行股份有限公司 | Data desensitization method and system |
CN110852800A (en) * | 2019-11-07 | 2020-02-28 | 深圳前海点金保理有限公司 | Method for integrating trade information, terminal device and storage medium |
CN111145011A (en) * | 2019-12-27 | 2020-05-12 | 中国银行股份有限公司 | Banking business system building method and device |
-
2020
- 2020-07-29 CN CN202010743017.1A patent/CN111858737B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10038289A1 (en) * | 1999-08-11 | 2001-02-22 | Ibm | Core banking activities integration system, involves preparing application-development environment business platforms for integration into the various processes usually required in separate core banking systems |
US6990466B1 (en) * | 2000-08-08 | 2006-01-24 | International Business Machines Corporation | Method and system for integrating core banking business processes |
CN103366243A (en) * | 2013-06-19 | 2013-10-23 | 华夏银行股份有限公司 | Banking business core system |
CN105631028A (en) * | 2015-12-30 | 2016-06-01 | 中国农业银行股份有限公司 | Method and system for implementing database clustering function |
CN107995064A (en) * | 2017-12-14 | 2018-05-04 | 云南电网有限责任公司玉溪供电局 | Test platform building method based on virtualization technology |
CN109032757A (en) * | 2018-07-12 | 2018-12-18 | 贵州电网有限责任公司 | A kind of time-optimized method of system framework automatic deployment based on cloud platform |
CN110795764A (en) * | 2019-11-01 | 2020-02-14 | 中国银行股份有限公司 | Data desensitization method and system |
CN110852800A (en) * | 2019-11-07 | 2020-02-28 | 深圳前海点金保理有限公司 | Method for integrating trade information, terminal device and storage medium |
CN111145011A (en) * | 2019-12-27 | 2020-05-12 | 中国银行股份有限公司 | Banking business system building method and device |
Non-Patent Citations (2)
Title |
---|
周翔: ""浅析大型机在银行核心系统中的应用"", 中国优秀硕士学位论文全文数据库(电子期刊) 信息科技辑》 * |
海洋: ""商业银行开发测试云数据隐私保护安全设计"", 《中国优秀硕士学位论文全文数据库(电子期刊) 信息科技辑》 * |
Also Published As
Publication number | Publication date |
---|---|
CN111858737B (en) | 2024-01-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2565802B1 (en) | Data masking setup | |
CN111988203B (en) | Node election method, device and storage medium | |
US10713224B2 (en) | Implementing a continuity plan generated using solution data modeling based on predicted future event simulation testing | |
CN109582433A (en) | A kind of resource regulating method, device, cloud computing system and storage medium | |
CN111651431A (en) | Database service oriented management flow standardization method | |
CN113515499A (en) | Database service method and system | |
CN109255701A (en) | A kind of net loan business data processing method | |
CN107423223A (en) | Test and management system | |
CN115373861A (en) | GPU resource scheduling method and device, electronic equipment and storage medium | |
CN114817022A (en) | Railway electronic payment platform test method, system, equipment and storage medium | |
US8639657B2 (en) | Reorganizing table-based data objects | |
CN114168682A (en) | Data auditing method, device, equipment and storage medium | |
CN107807992A (en) | Barcode scanning multiplies public transport payment system | |
CN112765014A (en) | Automatic test system for multi-user simultaneous operation and working method | |
CN111858737A (en) | Data import device and method, bank system building device and method, and storage medium | |
CN107944743A (en) | The operation and maintenance method, apparatus and system of a kind of large computer system | |
CN104317660A (en) | Bank parameter managing system | |
CN113449444B (en) | Simulation method, computer device and storage medium for domain engineering | |
CN112559603B (en) | Feature extraction method, device, equipment and computer-readable storage medium | |
CN114372293A (en) | Block chain based data approval method, device, equipment and storage medium | |
CN115033616A (en) | Data screening rule verification method and device based on multi-round sampling | |
CN114218100A (en) | Business model testing method, device, system, equipment, medium and program product | |
CN113111066A (en) | Automatic online method, device and system for database operation work order and computer equipment | |
CN110033145B (en) | Financial sharing job order separating method and device, equipment and storage medium | |
Zhang et al. | Financial System Design for High-Tech Enterprise Based on Cloud Service and Task Scheduling Algorithm |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |