CN111858737A - Data import device and method, bank system building device and method, and storage medium - Google Patents

Data import device and method, bank system building device and method, and storage medium Download PDF

Info

Publication number
CN111858737A
CN111858737A CN202010743017.1A CN202010743017A CN111858737A CN 111858737 A CN111858737 A CN 111858737A CN 202010743017 A CN202010743017 A CN 202010743017A CN 111858737 A CN111858737 A CN 111858737A
Authority
CN
China
Prior art keywords
data
built
bank system
business
bank
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010743017.1A
Other languages
Chinese (zh)
Other versions
CN111858737B (en
Inventor
奚晓斌
刁吉祥
段鹏
孟伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202010743017.1A priority Critical patent/CN111858737B/en
Publication of CN111858737A publication Critical patent/CN111858737A/en
Application granted granted Critical
Publication of CN111858737B publication Critical patent/CN111858737B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/214Database migration support
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245Protecting personal data, e.g. for financial or medical purposes
    • G06F21/6254Protecting personal data, e.g. for financial or medical purposes by anonymising data, e.g. decorrelating personal data from the owner's identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/60Software deployment
    • G06F8/65Updates
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • G06F8/71Version control; Configuration management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0803Configuration setting
    • H04L41/0813Configuration setting characterised by the conditions triggering a change of settings
    • H04L41/082Configuration setting characterised by the conditions triggering a change of settings the condition being updates or upgrades of network functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

The embodiment of the invention relates to the field of finance, and provides a bank system building device, which comprises: the system configuration device is used for deploying hardware resources required by the bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; the data import device is used for generating business data and importing the generated business data into a database of a bank system to be built; the operation adjusting device is used for configuring operation parameters, and the operation parameters are used for processing business data of the bank system to be built; the online setting device is used for setting online communication parameters, and the online communication parameters are used for carrying out data communication among global areas by the bank system to be built; and the version upgrading configuration device is used for adjusting and setting parameters required by the upgraded bank system version. The embodiment of the invention provides a core bank system building device or method with high feasibility, low cost and short period.

Description

Data import device and method, bank system building device and method, and storage medium
Technical Field
The embodiment of the invention relates to the technical field of finance, in particular to a data import device and method, a bank system building device and method and a storage medium.
Background
International commercial banks with businesses throughout the world typically employ IT architecture strategies with data and systems centrally deployed in data centers. In order to ensure that the business of all countries and regions in the world is smoothly developed, the bank often faces the requirements of all countries, and performs the work of simulating the trial operation of new local business, demonstrating the system function of the central bank or the financial management bureau, simulating the change business by matching with the local clearing organization and the like. In order to meet the demand, the global data center of the international commercial bank is forced to additionally add a set of full-function bank system to meet the demand on the basis of not influencing production operation.
After business requirements are put forward in various countries and regions, a bank system is newly built for meeting the business requirements, and the traditional process is as follows: and (3) evaluating/purchasing/deploying system hardware resources, importing business and technical data after completing storage configuration of a host of the full-function bank system, building a communication module, building a database and deploying an operating system, and providing the work of trial operation of new business, demonstration of new functions and simulation of organization among banks after the built full-function bank system is formed. However, the traditional process is adopted to build a bank system, so that the cost is high, the building period is long, and the business expansion requirement is difficult to meet in a short time.
Moreover, the traditional process is adopted to build a new system, so that the resource consumption is large, the system needs to be released as soon as possible after the system is used, repeated building and releasing brings great pressure to system resources, human resources and operation and maintenance investment of the data center, and even if 2-3 sets of systems are built every year, the upper limit of the current system, human resources and operation and maintenance of the data center is exceeded, so that more business expansion requirements are difficult to meet.
Disclosure of Invention
The embodiment of the invention provides a data importing device and method, a bank system building device and method and a storage medium, and solves the problem that the IT organization and the architecture of a global bank system in the related technology cannot meet the current situation of business expansion development.
According to one aspect of the invention, a data import method is provided, which is used for importing data when a bank system is built, and the method comprises the following steps: extracting pre-input data according to business requirements to obtain extracted data, wherein the pre-input data are business data of a bank system centralized in a production operation center; desensitizing sensitive information in the extracted data according to a desensitization rule to obtain desensitized extracted data; and processing the desensitized extracted data so as to generate business data of the bank system to be built, and importing the generated business data of the bank system to be built into a database of the bank system to be built.
In some embodiments, the data importing method further comprises: backing up the data input in advance before extracting the data; and setting data capacity required during data migration and integration, wherein the setting comprises capacity expansion, database table space compression and data recombination.
In some embodiments, processing the desensitized decimated data comprises: taking one or more policies for different situation data, wherein the different situation data comprises: repeated records, the key value contents are the same but not the key value information difference, the key value contents are different but not the key value information difference, and the table structure has no unique key value; the one or more policies include: and judging the data under different conditions, deleting the error data, deleting the repeated data and merging the repeated data according to the judgment result.
In some embodiments, processing the desensitized decimated data comprises: performing supplementary input on data required by the bank system to be built in a production environment and/or a test environment, wherein the data comprises teller information and a card number of a newly added teller; and/or resetting original data in the database, wherein the original data comprises teller information of an original teller.
According to one aspect of the invention, a data import device is provided, which is used for building a bank system and comprises: the extraction unit is used for extracting pre-input data according to business requirements to obtain extracted data, wherein the pre-input data are business data of a bank system centralized in a production operation center; a desensitization unit, configured to perform desensitization processing on the sensitive information in the extracted data according to a desensitization rule, to obtain desensitized extracted data; and the processing unit is used for processing the desensitized extracted data so as to generate business data of the bank system to be built and importing the generated business data of the bank system to be built into a database of the bank system to be built.
In some embodiments, the data importing apparatus further includes: the backup unit is used for backing up the data input in advance before the data are extracted by the extraction unit; and the setting unit is used for setting the data capacity required during data migration and integration, and the setting comprises capacity expansion, database table space compression and data recombination.
According to another aspect of the invention, a banking system construction method is provided, which includes: deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; generating business data and importing the generated business data into a database of the bank system to be built; configuring operation parameters, wherein the operation parameters are used for the bank system to be built to process business data; setting online communication parameters, wherein the online communication parameters are used for data communication between global areas of the bank system to be built; and adjusting and setting parameters required by upgrading the built bank system version.
According to an aspect of the present invention, there is provided a banking system construction apparatus including: the system configuration device is used for deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; the data import device is used for generating business data and importing the generated business data into a database of the bank system to be built; the operation adjusting device is used for configuring operation parameters, and the operation parameters are used for the bank system to be built to process business data; the online setting device is used for setting online communication parameters, and the online communication parameters are used for data communication between global areas by the bank system to be built; and the version upgrading configuration device is used for adjusting and setting parameters required by the upgraded bank system version.
In some embodiments, the system configuration means comprises: the hardware resource configuration unit is used for configuring a disk and a CPU (central processing unit) required by the deployment of the parallel coupling system; the host storage configuration unit is used for allocating host virtual space used by the parallel coupling system deployment; the communication configuration unit is used for configuring a communication module of the bank system to be built; a host database configuration unit for running multiple database subsystems simultaneously on an operating system, wherein each subsystem corresponds to multiple application databases defined by its address space.
In some embodiments, the operation adjustment device includes: the system and application parameter adjusting unit is used for adjusting system and application parameters so as to allow the bank system to be built to process the banking business data in batch; a batch operation parameter setting unit for setting operation time to allow corresponding batch data processing at each operation time; and the information interaction setting unit is used for transmitting the data processed by the bank system to be built to an open system platform according to a data transmission strategy, wherein the data transmission strategy is set by the open system platform and a data processing system, and the strategy comprises the transmission of the preset content data in the preset time corresponding to the preset content data and/or the transmission of the preset content data to the preset position of the open system platform corresponding to the preset content data.
In some embodiments, when the version upgrading configuration device upgrades the version of the system, the version upgrading is performed according to a host partition, wherein the partition is a partition of a region where the bank system extends global businesses.
According to another aspect of the present invention, there is provided a method for applying the banking system building device in the above embodiment, the method including: a bank system is built by using the bank system building device according to business requirements; and performing service commissioning, function demonstration and local card organization or clearing network simulation on the built bank system.
According to another aspect of the present invention, there is provided an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the data importing method in the above embodiments when executing the program; or the processor implements the banking system building method in the above embodiment when executing the program.
According to another aspect of the present invention, there is provided a computer-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a processor, implements the data import method in the above embodiments; or the computer program realizes the bank system building method in the above embodiment when being executed by the processor.
According to the data importing device and method and the bank system building device and method provided by the embodiment of the invention, a set of core bank system environment can be built in a short time, and less manpower and financial resources are used, so that the requirement of business expansion of the local country or overseas branch can be met.
Drawings
Other objects and advantages of the present invention will become apparent from the following description of the invention which refers to the accompanying drawings, and may assist in a comprehensive understanding of the invention.
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic structural diagram of a data import apparatus according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a data import apparatus according to another embodiment of the present invention;
FIG. 3 is a flow chart of a data import method according to an embodiment of the present invention;
fig. 4 shows a schematic structural diagram of a banking system construction device according to an embodiment of the present invention;
fig. 5 shows a schematic structural diagram of a banking system construction device according to another embodiment of the present invention;
FIG. 6 shows a flow chart of a banking system construction method according to an embodiment of the present invention;
FIG. 7 shows a schematic diagram of a method of building a device using a banking system, according to an embodiment of the invention;
FIG. 8 shows a schematic structural diagram of a computer system according to an embodiment of the invention.
It is noted that the drawings are not necessarily to scale and are merely illustrative in nature and not intended to obscure the reader.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this invention belongs.
The data importing device and the bank system building device of the embodiment of the invention provide a device and a method for supporting building of a set of core bank system environment in a short time in order to solve the problem that the IT organization and the architecture of a global bank system cannot meet the current situation of business expansion development, so that the built independent system is provided for a home country or a foreign branch to meet the business expansion requirement of the home country or the foreign branch on the basis of not influencing the production and operation of the original bank system.
Fig. 1 is a schematic structural diagram of a data import apparatus according to an embodiment of the present invention. The data importing device 20 is used for building a bank system, and comprises: the extraction unit 21 is configured to extract pre-input data according to business requirements to obtain extracted data, where the pre-input data is business data of a bank system centralized in a production operation center; a desensitization unit 22, configured to perform desensitization processing on the sensitive information in the extracted data according to a desensitization rule, so as to obtain desensitized extracted data; and the processing unit 23 is configured to process the desensitized extracted data so as to generate service data of the bank system to be built, and import the generated service data of the bank system to be built into a database of the bank system to be built.
According to the traditional bank system building process, when building is carried out each time, business data are required to be imported after system host storage configuration, database building and the like are implemented, the traditional method is time-consuming and labor-consuming, building and releasing are required to be carried out repeatedly, great pressure is caused to a data center, and due to the long building period, the instant demand of business expansion is easily influenced.
The data import device of the embodiment of the invention provides a tool for conveniently and rapidly building a bank system through modular design data management, and realizes effective management of data through each modular function, thereby improving the accuracy, the effectiveness and the like of the data.
After business requirements are provided by each country and each region, a set of core bank system needs to be newly built, and required basic business data is firstly created for a database of the bank system to be built according to the business requirements. The business data of the existing bank system centralized in the production operation center is used as input and is used as the data base of the bank system to be built, and the data comprises all types of data of the production operation of the bank system, such as account, amount, card information, protocol, business parameters, teller information (in production, test and research and development environments) and the like. Further, the extraction unit 21 performs at least partial extraction on the input data according to different business requirements, so as to create new business data for the bank system to be built. In order to ensure the safety, the effectiveness and the like of the extracted data, desensitization processing and other processing are further carried out on the extracted data, so that business data of the bank system to be built are generated and are imported into a database of the bank system to be built.
Referring to fig. 1-2, in some embodiments, the data importing apparatus 20 further includes a backup unit 24, which may be used to backup the input data before the data extraction performed by the extraction unit 21, synchronize the data to a data center (e.g., for use in a research and development test environment) through a shared tape library, perform data backup so that the extraction unit 21 performs data extraction at any time through the data backup, or prevent data loss during data extraction to facilitate data re-provision. The extracting unit 21 is configured to extract, according to a service requirement, for example, the outbound branch data that needs to be merged. The desensitization unit 22 further performs desensitization processing on the sensitive information in the extracted data according to desensitization rules, for example, data conversion and transformation processing are performed on a username, a communication number, a certificate number, a client address, an email address, a password, and the like, so as to realize reliable protection of the sensitive information, wherein the desensitization rules can be set according to actual requirements, and include data conversion rules, regular rule modification time, and the like. The processing unit 23 further performs processing on the desensitized extracted data, for example, performing multiple-dimension statistics such as statistics of table capacity, statistics of table list number, and the like on data of partitions such as the specified extracted asian-pacific region, american region, european region, and the like, wherein redundant data deletion processing is performed on table information repeatedly recorded in the partition data, or/and data merging is performed on tables having unique index key values, or/and data having conflicts in the partition data is adjusted according to a framework, for example, the processing unit 23 merges the partition data in a new framework.
In some embodiments, the processing unit 23 is further configured to process data required by the banking system in a production environment and a testing environment, for example, when the number of the original teller persons used in the testing environment cannot meet the requirement, the number of the teller persons needs to be increased, and the processing unit 23 may be configured to supplement the teller information of the newly increased teller persons into the database; or the teller information of the original teller, such as a password, is reset so as to meet the use requirements of the bank system under different environments.
In some embodiments, the data importing apparatus 20 further includes a setting unit 25, for example, in a link related to data migration and integration, when the extracted partition data needs to be merged, in order to avoid situations such as insufficient tablespace resources, the setting unit 25 may perform operations such as early capacity expansion of data capacity, and/or database table space compression, and/or data reorganization, so as to ensure that the data capacity meets requirements.
Fig. 3 is a flowchart illustrating a data importing method according to an embodiment of the present invention. The data import method can be used for data import when a bank system is built, for example.
Step S301, extracting the pre-input data according to the business requirements to obtain extracted data, wherein the pre-input data is the business data of the bank system centralized in the production operation center.
The business data of the existing bank system centralized in the production operation center is used as input and is used as the data base of the bank system to be built, and the data comprises all types of data of the production operation of the bank system, such as account, amount, card information, protocol, business parameters, teller information (in production, test and research and development environments) and the like. In some embodiments, the input data is at least partially extracted according to different business requirements, which may be implemented via the extraction unit 21 of the data importing apparatus 20 shown in fig. 1 or 2, so as to create new business data for the banking system to be built. For example, the data of each subarea such as the Asia-Pacific area, the American area, the European area and the like is subjected to specified extraction.
And step S302, desensitizing sensitive information in the extracted data according to a desensitizing rule to obtain desensitized extracted data.
In some embodiments, desensitization processing is performed on sensitive information in the extracted data according to desensitization rules, which can be implemented by the desensitization unit 22 of the data importing apparatus 20 shown in fig. 1 or 2, for example, data conversion and transformation processing is performed on a user name, a communication number, a certificate number, a client address, an email address, a password, and the like, so as to implement reliable protection of the sensitive information, and the desensitization rules can be set according to actual requirements, and include data conversion rules, regular modification time of the rules, and the like.
Step S303, processing the desensitized extracted data so as to generate business data of the bank system to be built, and importing the generated business data of the bank system to be built into a database of the bank system to be built.
In some embodiments, the processing of the desensitized extracted data includes, for example, performing various dimensional statistics such as statistics of table capacity, statistics of table list number, etc. on partition data such as specified extracted asia-pacific region, american region, european region, etc., for example, performing redundant data deletion processing on table information repeatedly recorded in the partition data via the processing unit 23 of the data importing apparatus 20 shown in fig. 1 or 2, or/and performing data merging on a table having a unique index key value, or/and performing framework adjustment on data having a conflict in the partition data, for example, the processing unit 23 merges the partition data in a new framework.
In some embodiments, processing the desensitized decimated data further comprises: processing data required by the bank system in a production environment and a test environment, for example, when the number of the original teller persons in the test environment cannot meet the requirement, the number of the teller persons needs to be increased, and the processing unit 23 can supplement the teller information of the newly increased teller persons into the database; or the teller information of the original teller, such as a password, is reset so as to meet the use requirements of the bank system under different environments.
In some embodiments, the data importing method further comprises: before the data extraction is performed, the input data is backed up, which can be implemented by the backup unit 24 unit of the data importing apparatus 20 shown in fig. 1 or 2, and is synchronized to the data center (for example, for a research and development test environment) through the shared tape library, so that the data extraction is performed by the extraction unit 21 at any time through data backup, or data loss is prevented during the data extraction process so as to facilitate the data re-provision. In the links related to data migration and integration, when extracted partition data needs to be merged, in order to avoid situations such as insufficient tablespace resources, the setting unit 25 can be used for performing work such as early capacity expansion of data capacity, and/or compression of database table space, and/or data recombination, so as to ensure that the data capacity meets requirements.
In some embodiments, when processing desensitized extracted data, one or more policies may be applied to different case data, including, for example: repeated records, the same key value content but different non-key value information, different key value content but different non-key value information, and no unique key value in the table structure. For example, for normal duplicate records belonging to a match, redundant duplicate records may be deleted via the processing unit 23 to ensure the uniqueness of each normal record in the database. For another example, when there are two records in the database: record 1: name: zhang III, identification number: x, home address: y1; record 2: name: zhang III, identification number: x, home address: y2 (only home addresses differ in the two records); the processing unit 23 determines the two records according to the above two records, deletes the error record according to the determination result, and combines the two records (which belongs to the case that the key value content is the same but the key value information is different). The data of different situations are judged via the processing unit 23, and then one or more strategies, such as deletion, combination and the like, are adopted to process the data.
According to the data importing method provided by the embodiment of the present invention, corresponding functions can be implemented by using the data importing apparatus provided by the embodiment of the present invention, and may also be implemented by other methods, which is not limited in the embodiment of the present invention.
Fig. 4 shows a schematic structural diagram of a banking system building device according to an embodiment of the present invention. As shown in fig. 4, the banking system constructing apparatus 100 includes: the system configuration device 10 is used for deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; the data import device 20 is used for generating business data and importing the generated business data into a database of a bank system to be built; the operation adjusting device 30 is used for configuring operation parameters, and the operation parameters are used for processing business data of the bank system to be built; the online setting device 40 is used for setting online communication parameters, and the online communication parameters are used for data communication between global areas of the bank system to be built; and the version upgrading configuration device 50 is used for adjusting and setting parameters required by upgrading the built bank system version.
Referring further to fig. 5, the system configuration device 10 is used for configuring a full-function banking system (i.e. a chinese industrial and commercial bank information processing system) as a core business system, which embodies the advantage of data concentration, for example, in a remittance business, a remitter can directly check the name and account number of a receiver in a unified database, and can handle the remittance immediately and check the remittance in real time if the data are consistent, without the need for confirmation, check and feedback by the receiver. The full-function bank system realizes system integration and openness and high information sharing.
In some embodiments, the system configuration apparatus 10 may include a hardware resource configuration unit 11, which may implement configuration of a disk, a CPU, and the like required for deployment of the parallel coupled system; the host storage configuration unit 12 is configured to allocate a host virtual space used for deployment of the parallel coupled system, for example, the space of the newly added system after merging may be allocated according to an original space occupied by each partition data (asia-pacific region, american region, and the like); the communication configuration unit 13 is used for the full-function bank system to carry out external communication; a host database configuration unit 14, configured to run a plurality of database subsystems simultaneously on an operating system, wherein each of the subsystems corresponds to a plurality of application databases defined by its address space.
Referring to fig. 5, in some embodiments, the data import apparatus 20 may use the apparatus of the embodiment of fig. 2, which includes a backup unit 24, an extraction unit 21, a desensitization unit 22, a processing unit 23, and a setting unit 25. The functions of the modules of the data importing apparatus 20 may be as described in the above embodiments, and descriptions for achieving the same technical effects are not repeated herein.
In other embodiments, the data importing apparatus 20 may also use a general data importing apparatus, which is not limited in this embodiment of the present invention.
Referring to fig. 5, in some embodiments, the operation adjustment device 30 includes: the system and application parameter adjusting unit 31 can implement parallel batch operation of the hosts to process banking data by adjusting system and application parameters, for example, a plurality of hosts operate in parallel to process data of each partition (asia-pacific area, american area, etc.), and the batch operation includes operation modes such as daytime batch, end-of-day batch, etc.; the batch operation parameter setting unit 32 is used as a batch operation processing tool, and can be configured independently in terms of batch operation, such as setting operation time, operation period, and the like, so that the host can automatically allocate and process batch data of each partition data at set time; the information interaction setting unit 33 is configured to transmit data processed by the bank system to be built to the open system platform according to the data transmission policy, for example, batch processing data of the core bank system host in the daytime and in the end-of-day batch may be downloaded to the open system platform by using a fixed field number (for example, including transmitting the processed partition data at different times, or transmitting the processed partition data to a designated location of the platform), so that the data automatically generates a statistical form and the like on the platform, and automation of service information management is achieved.
In some embodiments, the online configuration device 40 is configured to configure parameters related to the online communication module, so as to implement a global inter-domain data exchange routing information adjustment function. The device can set the service data originally belonging to different partitions to be cross-partition or not to be cross-partition for cross-partition service processing after the host application parameters are modified. For example, for each partition entered by merging, the parameters of the host application are modified during merging, so that each partition data has a corresponding position in the newly added system, and therefore, required data can be acquired from the corresponding position during communication.
In some embodiments, when the version-up configuration apparatus 50 performs a version-up on the system, the version-up is performed on the host partitions as a whole, where the host partitions are banking businesses corresponding to one partition (asia-pacific area, american area, etc.) for each host. For example, taking the asia-pacific region as an example, the version-up configuration device 50 sets a time when all the branches of the region are not open, so as to perform the version-up on the host system responsible for the asia-pacific region service.
Fig. 6 shows a flow diagram of a banking system building method according to an embodiment of the present invention. The bank system building method comprises the following steps: step S601, deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system; step S602, generating business data and importing the generated business data into a database of the bank system to be built; step S603, configuring operation parameters, wherein the operation parameters are used for the bank system to be built to process business data; step S604, setting online communication parameters, wherein the online communication parameters are used for data communication between global areas of the bank system to be built; and step S605, adjusting and setting parameters required by upgrading the built bank system version.
According to the bank system building device and method provided by the embodiment of the invention, the advantages of convenience in operation, short period and low cost for building the core bank system are provided. For traditional bank system construction for dealing with business requirements, for example, taking the requirements received by a commercial bank all the year 2015 as an example, in order to meet the special system requirements proposed by branches outside 28 families in total, 1-2 sets of systems independent of the production environment are arranged and constructed, and the requirements of 5-8 branches are only met, and the rest 20 branches cannot obtain independent systems within 2 months to complete demonstration and simulation, so that the limitations have negative effects on the development progress and market occupation time of new business of the industrial and silver bank in the European region and the American region.
The bank system building device and the bank system building method can solve the problems and achieve the purpose of completing independent core bank system building in a short time (for example, within 1 week), so that the bank group is provided for local and global overseas branches to use, and ideas are provided for coping with the expansion requirements of the overseas branch business newly entering the country and the region.
Compared with the traditional process, the bank system building device and method provided by the embodiment of the invention can relieve the system resource and human resource pressure of the data center and improve the feasibility.
Fig. 7 shows a schematic diagram of a method for building a device using a banking system according to an embodiment of the present invention. After each region puts forward a system environment building requirement, the bank system building device provided by the embodiment of the invention can build a full-function bank system independent of a production environment in a short time, so that the system is provided for each region for use, and functions including new business commissioning, new function demonstration, local card organization or clearing network simulation and the like are facilitated.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the data importing method in the foregoing embodiments; or the computer program realizes the bank system building method in the above embodiment when being executed by the processor.
An embodiment of the present invention further provides a structural schematic diagram of a computer system, and fig. 8 schematically illustrates a block diagram of a computer system suitable for implementing the method described above according to an embodiment of the present disclosure. The computer system illustrated in FIG. 8 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the disclosure.
As shown in fig. 8, the computer system 80 according to the embodiment of the present disclosure includes a processor 800, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)801 or a program loaded from a storage section 807 into a Random Access Memory (RAM) 802. Processor 800 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 800 may also include on-board memory for caching purposes. Processor 800 may include a single processing unit or multiple processing units for performing different actions of a method flow according to embodiments of the disclosure.
In the RAM 802, various programs and data necessary for the operation of the system 80 are stored. The processor 800, ROM 801, and RAM 802 are connected to each other by a bus 803. The processor 800 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 801 and/or the RAM 802. Note that the programs may also be stored in one or more memories other than the ROM 801 and the RAM 802. The processor 800 may also perform various operations of method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to an embodiment of the present disclosure, the system 80 may also include an input/output (I/O) interface 804, the input/output (I/O) interface 804 also being connected to the bus 803. The system 80 may also include one or more of the following components connected to the I/O interface 804: an input section 805 including a keyboard, a mouse, and the like; an output section 806 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 807 including a hard disk and the like; and a communication section 808 including a network interface card such as a LAN card, a modem, or the like. The communication section 808 performs communication processing via a network such as the internet. A drive 809 is also connected to the I/O interface 804 as necessary. A removable medium 810 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 809 as necessary, so that a computer program read out therefrom is mounted into the storage section 807 as necessary.
It should also be noted that, in the case of the embodiments of the present invention, features of the embodiments and examples may be combined with each other to obtain a new embodiment without conflict.
The above description is only an embodiment of the present invention, but the scope of the present invention is not limited thereto, and the scope of the present invention is subject to the scope of the claims.

Claims (14)

1. A data import method is used for data import when a bank system is built, and comprises the following steps:
extracting pre-input data according to business requirements to obtain extracted data, wherein the pre-input data are business data of a bank system centralized in a production operation center;
desensitizing sensitive information in the extracted data according to a desensitization rule to obtain desensitized extracted data;
and processing the desensitized extracted data so as to generate business data of the bank system to be built, and importing the generated business data of the bank system to be built into a database of the bank system to be built.
2. The data import method according to claim 1, further comprising:
backing up the data input in advance before extracting the data;
and setting data capacity required during data migration and integration, wherein the setting comprises capacity expansion, database table space compression and data recombination.
3. The data import method of claim 1 or 2, wherein processing the desensitized extracted data comprises:
taking one or more policies for different situation data, wherein the different situation data comprises: repeated records, the key value contents are the same but not the key value information difference, the key value contents are different but not the key value information difference, and the table structure has no unique key value;
the one or more policies include: and judging the data under different conditions, deleting the error data, deleting the repeated data and merging the repeated data according to the judgment result.
4. The data import method of claim 3, wherein processing the desensitized decimated data comprises:
performing supplementary input on data required by the bank system to be built in a production environment and/or a test environment, wherein the data comprises teller information and a card number of a newly added teller; and/or
Resetting original data in a database, wherein the original data comprises teller information of an original teller.
5. A data import device is used for building a bank system and comprises:
the extraction unit is used for extracting pre-input data according to business requirements to obtain extracted data, wherein the pre-input data are business data of a bank system centralized in a production operation center;
a desensitization unit, configured to perform desensitization processing on the sensitive information in the extracted data according to a desensitization rule, to obtain desensitized extracted data;
and the processing unit is used for processing the desensitized extracted data so as to generate business data of the bank system to be built and importing the generated business data of the bank system to be built into a database of the bank system to be built.
6. The data import apparatus of claim 5, further comprising:
the backup unit is used for backing up the data input in advance before the data are extracted by the extraction unit;
and the setting unit is used for setting the data capacity required during data migration and integration, and the setting comprises capacity expansion, database table space compression and data recombination.
7. A banking system building method comprises the following steps:
deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system;
generating business data and importing the generated business data into a database of the bank system to be built;
configuring operation parameters, wherein the operation parameters are used for the bank system to be built to process business data;
setting online communication parameters, wherein the online communication parameters are used for data communication between global areas of the bank system to be built;
and adjusting and setting parameters required by upgrading the built bank system version.
8. A banking system set-up device comprising:
the system configuration device is used for deploying hardware resources required by a bank system to be built according to business requirements, configuring a host for storage, building a host database, building a communication module and configuring an operating system, wherein the host adopts a parallel coupling system;
the data import device is used for generating business data and importing the generated business data into a database of the bank system to be built;
the operation adjusting device is used for configuring operation parameters, and the operation parameters are used for the bank system to be built to process business data;
the online setting device is used for setting online communication parameters, and the online communication parameters are used for data communication between global areas by the bank system to be built;
and the version upgrading configuration device is used for adjusting and setting parameters required by the upgraded bank system version.
9. A banking system construction apparatus according to claim 8, wherein the system configuration means comprises:
the hardware resource configuration unit is used for configuring a disk and a CPU (central processing unit) required by the deployment of the parallel coupling system;
the host storage configuration unit is used for allocating a host virtual space used by the parallel coupling system deployment;
the communication configuration unit is used for configuring a communication module of the bank system to be built;
a host database configuration unit for running multiple database subsystems simultaneously on an operating system, wherein each subsystem corresponds to multiple application databases defined by its address space.
10. A banking system construction apparatus according to claim 8 or 9, wherein the operation adjustment means includes:
the system and application parameter adjusting unit is used for adjusting system and application parameters so as to allow the bank system to be built to process the banking business data in batch;
a batch operation parameter setting unit for setting operation time to allow corresponding batch data processing at each operation time;
and the information interaction setting unit is used for transmitting the data processed by the bank system to be built to an open system platform according to a data transmission strategy, wherein the data transmission strategy is set by the open system platform and a data processing system, and the strategy comprises the transmission of the preset content data in the preset time corresponding to the preset content data and/or the transmission of the preset content data to the preset position of the open system platform corresponding to the preset content data.
11. The banking system building device according to claim 10, wherein when the version upgrading configuration device upgrades the version of the system, the version upgrading is performed according to a host partition, wherein the partition is a partition of the banking system in a region where global business is located.
12. A method of applying the banking system construction apparatus of any one of claims 8-11, the method comprising:
a bank system is built by using the bank system building device according to business requirements;
and performing service commissioning, function demonstration and local card organization or clearing network simulation on the built bank system.
13. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the data import method of any of claims 1-4 when executing the program; or
The processor, when executing the program, implements the banking system construction method of claim 7.
14. A computer-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a processor, implements the data import method of any of claims 1 to 4; or
The computer program, when executed by a processor, implements the banking system construction method of claim 7.
CN202010743017.1A 2020-07-29 2020-07-29 Data importing device and method, bank system constructing device and method, and storage medium Active CN111858737B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010743017.1A CN111858737B (en) 2020-07-29 2020-07-29 Data importing device and method, bank system constructing device and method, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010743017.1A CN111858737B (en) 2020-07-29 2020-07-29 Data importing device and method, bank system constructing device and method, and storage medium

Publications (2)

Publication Number Publication Date
CN111858737A true CN111858737A (en) 2020-10-30
CN111858737B CN111858737B (en) 2024-01-09

Family

ID=72944949

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010743017.1A Active CN111858737B (en) 2020-07-29 2020-07-29 Data importing device and method, bank system constructing device and method, and storage medium

Country Status (1)

Country Link
CN (1) CN111858737B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10038289A1 (en) * 1999-08-11 2001-02-22 Ibm Core banking activities integration system, involves preparing application-development environment business platforms for integration into the various processes usually required in separate core banking systems
US6990466B1 (en) * 2000-08-08 2006-01-24 International Business Machines Corporation Method and system for integrating core banking business processes
CN103366243A (en) * 2013-06-19 2013-10-23 华夏银行股份有限公司 Banking business core system
CN105631028A (en) * 2015-12-30 2016-06-01 中国农业银行股份有限公司 Method and system for implementing database clustering function
CN107995064A (en) * 2017-12-14 2018-05-04 云南电网有限责任公司玉溪供电局 Test platform building method based on virtualization technology
CN109032757A (en) * 2018-07-12 2018-12-18 贵州电网有限责任公司 A kind of time-optimized method of system framework automatic deployment based on cloud platform
CN110795764A (en) * 2019-11-01 2020-02-14 中国银行股份有限公司 Data desensitization method and system
CN110852800A (en) * 2019-11-07 2020-02-28 深圳前海点金保理有限公司 Method for integrating trade information, terminal device and storage medium
CN111145011A (en) * 2019-12-27 2020-05-12 中国银行股份有限公司 Banking business system building method and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10038289A1 (en) * 1999-08-11 2001-02-22 Ibm Core banking activities integration system, involves preparing application-development environment business platforms for integration into the various processes usually required in separate core banking systems
US6990466B1 (en) * 2000-08-08 2006-01-24 International Business Machines Corporation Method and system for integrating core banking business processes
CN103366243A (en) * 2013-06-19 2013-10-23 华夏银行股份有限公司 Banking business core system
CN105631028A (en) * 2015-12-30 2016-06-01 中国农业银行股份有限公司 Method and system for implementing database clustering function
CN107995064A (en) * 2017-12-14 2018-05-04 云南电网有限责任公司玉溪供电局 Test platform building method based on virtualization technology
CN109032757A (en) * 2018-07-12 2018-12-18 贵州电网有限责任公司 A kind of time-optimized method of system framework automatic deployment based on cloud platform
CN110795764A (en) * 2019-11-01 2020-02-14 中国银行股份有限公司 Data desensitization method and system
CN110852800A (en) * 2019-11-07 2020-02-28 深圳前海点金保理有限公司 Method for integrating trade information, terminal device and storage medium
CN111145011A (en) * 2019-12-27 2020-05-12 中国银行股份有限公司 Banking business system building method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
周翔: ""浅析大型机在银行核心系统中的应用"", 中国优秀硕士学位论文全文数据库(电子期刊) 信息科技辑》 *
海洋: ""商业银行开发测试云数据隐私保护安全设计"", 《中国优秀硕士学位论文全文数据库(电子期刊) 信息科技辑》 *

Also Published As

Publication number Publication date
CN111858737B (en) 2024-01-09

Similar Documents

Publication Publication Date Title
EP2565802B1 (en) Data masking setup
CN111988203B (en) Node election method, device and storage medium
US10713224B2 (en) Implementing a continuity plan generated using solution data modeling based on predicted future event simulation testing
CN109582433A (en) A kind of resource regulating method, device, cloud computing system and storage medium
CN111651431A (en) Database service oriented management flow standardization method
CN113515499A (en) Database service method and system
CN109255701A (en) A kind of net loan business data processing method
CN107423223A (en) Test and management system
CN115373861A (en) GPU resource scheduling method and device, electronic equipment and storage medium
CN114817022A (en) Railway electronic payment platform test method, system, equipment and storage medium
US8639657B2 (en) Reorganizing table-based data objects
CN114168682A (en) Data auditing method, device, equipment and storage medium
CN107807992A (en) Barcode scanning multiplies public transport payment system
CN112765014A (en) Automatic test system for multi-user simultaneous operation and working method
CN111858737A (en) Data import device and method, bank system building device and method, and storage medium
CN107944743A (en) The operation and maintenance method, apparatus and system of a kind of large computer system
CN104317660A (en) Bank parameter managing system
CN113449444B (en) Simulation method, computer device and storage medium for domain engineering
CN112559603B (en) Feature extraction method, device, equipment and computer-readable storage medium
CN114372293A (en) Block chain based data approval method, device, equipment and storage medium
CN115033616A (en) Data screening rule verification method and device based on multi-round sampling
CN114218100A (en) Business model testing method, device, system, equipment, medium and program product
CN113111066A (en) Automatic online method, device and system for database operation work order and computer equipment
CN110033145B (en) Financial sharing job order separating method and device, equipment and storage medium
Zhang et al. Financial System Design for High-Tech Enterprise Based on Cloud Service and Task Scheduling Algorithm

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant