CN114722109A - Data import method, system, device and storage medium - Google Patents

Data import method, system, device and storage medium Download PDF

Info

Publication number
CN114722109A
CN114722109A CN202210388409.XA CN202210388409A CN114722109A CN 114722109 A CN114722109 A CN 114722109A CN 202210388409 A CN202210388409 A CN 202210388409A CN 114722109 A CN114722109 A CN 114722109A
Authority
CN
China
Prior art keywords
data
service
data carrier
updated
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210388409.XA
Other languages
Chinese (zh)
Other versions
CN114722109B (en
Inventor
李凌
阳志明
张英彬
喻琦
宋琦
陶德威
裴煜
涂博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Telecom Corp Ltd
Original Assignee
China Telecom Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Telecom Corp Ltd filed Critical China Telecom Corp Ltd
Priority to CN202210388409.XA priority Critical patent/CN114722109B/en
Publication of CN114722109A publication Critical patent/CN114722109A/en
Application granted granted Critical
Publication of CN114722109B publication Critical patent/CN114722109B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a data import method, a system, equipment and a storage medium, wherein the data import method comprises the following steps: reading at least one service attribute value in service reference relations among different service data from a data carrier, generating a global identifier by adopting a service system algorithm corresponding to the service attribute value, generating an updated service reference relation by utilizing the service reference relations among the different service data and the global identifier, writing the global identifier and the updated service reference relation into the data carrier to obtain an updated data carrier, and importing the service data in the updated data carrier into a database. Before the database is imported, the key values at two ends of the updated service reference relation based on the global identification in the data carrier have uniqueness, so that the problem that the original service reference relation in the data carrier is not unique can be solved, the reference relation between tables in the corresponding database also has uniqueness and availability, the database constraint does not need to be cancelled, and the data quality can be kept not to be weakened.

Description

Data import method, system, device and storage medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a data importing method, system, device, and storage medium.
Background
Data import is the introduction of service data stored in data carriers into database systems, so-called "databases" being data sets which are stored together in a manner which can be shared by a plurality of users, have as little redundancy as possible and are independent of the application.
It is noted that the information disclosed in the background section above is only for enhancement of understanding of the background of the invention and therefore may comprise information that does not form the prior art that is already known to a person of ordinary skill in the art.
Disclosure of Invention
The present invention is directed to a method, a system, a device and a storage medium for importing data, which overcome the difficulties in the prior art and can improve the quality of data in a database.
An embodiment of the present invention provides a data importing method, including:
reading at least one service attribute value in service reference relations among different service class data from a data carrier;
generating a global identifier by adopting a service system algorithm corresponding to the service attribute value, and generating an updated service reference relation by utilizing a service reference relation and the global identifier among different service data;
and writing the global identification and the updated service reference relationship into a data carrier to obtain an updated data carrier, and importing the service data in the updated data carrier into a database.
In an alternative embodiment, before reading at least one service attribute value in the service reference relationship between different service class data from the data carrier, the data importing method further includes:
the data carrier is set to a namespace.
In an alternative embodiment, the business system algorithm is an algorithm used by the business system in generating business class data in response to user input at the interface.
In an alternative embodiment, reading at least one service attribute value in a service reference relationship between different service class data from a data carrier includes:
and traversing the service data in the data carrier one by one, and reading at least one service attribute value in the service reference relationship between different service class data from the data carrier.
In an optional embodiment, generating an updated service reference relationship by using the service reference relationship and the global identifier between different service class data includes:
and traversing the service data in the data carrier one by one, and adding an updated service reference relation using the global identification in the service reference relation among different service class data.
In an alternative embodiment, importing the service data in the update data carrier into a database, comprises:
and traversing and updating the service data in the data carrier item by item according to a specified sequence, and sequentially importing the service data into the database.
In an optional embodiment, generating an updated service reference relationship by using the service reference relationship and the global identifier between different service class data includes:
and generating a global reference relation of the database by using the service reference relation and the global identification among different service class data.
In an optional embodiment, generating a global service reference relationship of the database by using the service reference relationship and the global identifier between different service class data includes:
and generating the foreign key association based on the global identification by utilizing the service reference relation between the global identification and different service class data.
An embodiment of the present disclosure further provides a data importing system, which includes:
the data reading module is used for reading at least one service attribute value in the service reference relationship among different service class data from the data carrier;
the service reference relation updating module generates a global identifier by adopting a service system algorithm corresponding to the service attribute value, and generates an updated service reference relation by utilizing the service reference relation and the global identifier among different service data;
the writing module writes the global identification and the updating service reference relation into the data carrier to obtain an updating data carrier;
and the import module imports the service data in the updated data carrier into data.
An embodiment of the present invention further provides a data importing apparatus, including:
a processor;
a memory having stored therein executable instructions of the processor;
wherein the processor is configured to perform the steps of the above data import method via executing executable instructions.
Embodiments of the present invention also provide a computer-readable storage medium for storing a program, which when executed implements the steps of the data importing method described above.
The invention aims to provide a data importing method, a system, equipment and a storage medium, wherein at least one service attribute value in service reference relations among different service class data is read from a data carrier, a service system algorithm is adopted to generate a global mark corresponding to the service attribute value, an updating service reference relation is generated by utilizing the service reference relations among the different service class data and the global mark, the global mark and the updating service reference relation are written into the data carrier to obtain an updating data carrier, and the service data in the updating data carrier is imported into a database.
In the embodiment of the present disclosure, the global identifier is a database key value. In importing data into a database, the reference relationship of the business level between different business class data is mapped into the reference relationship between a plurality of tables in the database. Because the newly generated global identification is written into the data carrier before the database is imported, key values at two ends of the updated service reference relation based on the global identification in the data carrier have uniqueness, and the problem that the original service reference relation in the data carrier is not unique can be solved.
In this case, the reference relations between tables in the database corresponding to the updated reference relations in the updated data carrier are unique and can be used, and the data carrier is consistent with the data in the database. The embodiment of the disclosure does not need to cancel the constraint of the database, thereby being capable of keeping the data quality from weakening.
Drawings
Other features, objects and advantages of the present invention will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, with reference to the accompanying drawings.
FIG. 1 is a flow diagram of one of the embodiments of a data import method of the present invention;
FIG. 2 is a flowchart of a second embodiment of the data importing method according to the present invention;
FIG. 3 is a block diagram of one embodiment of a data import system of the present invention;
FIG. 4 is a block diagram of a second embodiment of the data import system of the present invention;
FIG. 5 is a schematic diagram of the operation of the data import system of the present invention.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.
The drawings are merely schematic illustrations of the invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware forwarding modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
In addition, the flow shown in the drawings is only an exemplary illustration, and not necessarily includes all the steps. For example, some steps may be divided, some steps may be combined or partially combined, and the actual execution sequence may be changed according to the actual situation. The use of "first," "second," and similar terms in the detailed description is not intended to imply any order, quantity, or importance, but rather is used to distinguish one element from another. It should be noted that features of the embodiments of the invention and of the different embodiments may be combined with each other without conflict.
In the related art, the data import of the same service class data and different service class data is related, and the service class refers to the object type described by the corresponding service data, such as user information, product information, and order type, which are not exemplified herein.
Different from the method for importing the same service class data in a disclosing manner, a service reference relationship of a service level exists between different service class data, so if a batch of service data of different service types is imported into a database, it is required to ensure that key values at two ends of the service reference relationship already exist and are unique.
In the related art, when importing data of different service classes, considering that the relationship between tables is very complex, especially when there are various foreign key relationships, it is necessary to temporarily cancel database constraint checks, such as primary key constraint check and foreign key constraint check, where the database constraint is to make constraints on the data of rows and columns of the tables to ensure the integrity and uniqueness of the data in the tables.
However, since the database constraint check is cancelled, the related art has a situation that key values at two ends of a service level service reference relation in the database are not unique, which results in data quality degradation.
The embodiment of the disclosure provides a data import scheme aiming at technical problems in the related art, and the inventive idea is that a global identifier is generated by adopting a service system algorithm corresponding to a service attribute value, an update service reference relationship is generated by utilizing a service reference relationship and a global identifier between different service data, the global identifier and the update service reference relationship are written into a data carrier to obtain an update data carrier, and service data in the update data carrier is imported into a database.
The service attribute value is located at one end of the service reference relation of different service classes, and the service reference relation in the data carrier refers to that the corresponding data record references the service attribute value. In the process of importing the database, the reference relationship of the service level between different service class data is mapped into the reference relationship between a plurality of tables in the database. Before the data base is imported, the uniqueness of the key values at two ends of the service reference relation between different service data is realized through the global identification, the reference relation between the tables in the corresponding data base is also the uniqueness and the citation, the data carrier is consistent with the data in the data base, and the problem that the original service reference relation in the data carrier is not unique can be solved.
In this case, the database constraint need not be canceled, so that the data quality can be kept from being degraded.
Fig. 1 is a flowchart of a data importing method according to an embodiment of the present disclosure, and as shown in fig. 1, the data importing method includes the following steps:
step 110: reading at least one service attribute value in service reference relations among different service class data from a data carrier;
step 120: generating a global identifier by adopting a service system algorithm corresponding to the service attribute value, and generating an updated service reference relation by utilizing the service reference relation and the global identifier among different service data;
step 130: and writing the global identification and the updated service reference relationship into a data carrier to obtain an updated data carrier, and importing the service data in the updated data carrier into a database.
In the embodiment of the present disclosure, the global identifier is a database key value. In importing data into a database, the reference relationship of the business level between different business class data is mapped into the reference relationship between a plurality of tables in the database. Because the newly generated global identification is written into the data carrier before the database is imported, key values at two ends of the updated service reference relation based on the global identification in the data carrier have uniqueness, and the problem that the original service reference relation in the data carrier is not unique can be solved.
In this case, the reference relations between tables in the database corresponding to the updated reference relations in the updated data carrier are unique and can be used, and the data carrier is consistent with the data in the database. The embodiment of the disclosure does not need to cancel the constraint of the database, thereby being capable of keeping the data quality from weakening.
In the embodiment of the disclosure, business data in the update database is imported into the database, wherein the business data comprises entity data and business reference relations between the entity data, and the reference relations between the entity data comprise update business reference relations.
In the embodiment of the present disclosure, the data carrier may be an excel file, a csv file, and the like, and is not particularly limited herein. Wherein, for the data carrier, the data carrier has the import of the update service reference relation based on the global identification in the current database import stage, and exports the data to the database.
In the embodiment of the disclosure, the data import method receives entity data and reference relationship data of a business dimension organization, which is beneficial to ensuring readability and understandability of business personnel to the data and keeping judgment of the business personnel on correctness and integrity of data business.
In an embodiment of the present disclosure, before reading at least one service attribute value in a service reference relationship between different service class data from a data carrier, the data importing method further includes:
the data carrier is set to a namespace.
Where a Namespace (Namespace), also called Namespace, or the like, represents the visible range of a service attribute value (identifier). A business attribute value can be defined in multiple namespaces, and its meaning in different namespaces is irrelevant. Thus, any business attribute values can be defined in a new namespace and do not conflict with any existing business attribute values because the existing definitions are in other namespaces.
For example, let Bill be an employee of company X with a job number of 123, and John be an employee of company Y with a job number of 123. Since two people work at different companies, which can be identified using the same job number without confusion, each company represents a separate namespace.
Thus, by arranging the data carriers themselves as a namespace, the uniqueness of a certain service attribute value (name or code) or a certain combination of several service attribute values can be ensured within the namespace. The service level reference relationship in the data carrier is a reference to the service attribute value(s).
In the disclosed embodiment, the business system algorithm is an algorithm used by the business system in generating business class data in response to user input at the interface. That is, the service data in the data carrier is generated by the service system for the content input by the user at the interface by using the service system algorithm. Therefore, the disclosed embodiments utilize a business system algorithm to generate a global identification that can be recognized by the data carrier and thus written to the data carrier.
The global Identifier is also called a Globally Unique Identifier (GUID), and is a Unique Identifier generated by an algorithm, and the main purpose of the GUID is to generate a completely Unique number. The global mark is a key value, which is written into the data carrier and the database to generate an updated service reference relationship, so that the normal reference between the service data in the data carrier and the database is realized by utilizing the uniqueness and the availability of the key value, and the data quality is improved.
In the embodiment of the present disclosure, generating an updated service reference relationship by using a service reference relationship and a global identifier between different service class data includes:
and generating a global service reference relation of the database by using the service reference relation and the global identification among different service class data, wherein the global service reference relation of the database is the updated service reference relation.
The embodiment of the present disclosure generates a global reference relationship of the database by using the service reference relationship of the "one or more service attribute values" in combination with the generated global identifier. The method realizes that the global reference relation of the database is generated on the basis of the local service reference relation of the database based on the service attribute value.
In this case, the newly added global identification and the global reference relation of the database are then written into the data carrier of the batch import/export data, and the entity and the reference relation are written into the database according to the specified sequence.
In the embodiment of the present disclosure, generating a global service reference relationship of a database by using a service reference relationship and a global identifier between different service class data includes:
and generating the foreign key association based on the global identification by utilizing the service reference relation between the global identification and different service class data.
Foreign key, a sentence summary: if the primary key of one table A is also present in another table B, then this field in B can be used as the foreign key of the A table. Foreign key association is a specific way of the business reference relationship of the database global.
In particular, the global identifier in the data carrier is mapped into the database and constitutes the primary key of one data table, while the global identifier exists in another data table in the database, and the global identifier in the latter table serves as the foreign key of the previous referenced data table, and the global identifier and the foreign key form a foreign key association.
Fig. 2 is a flowchart of a data importing method according to another embodiment of the present disclosure, and as shown in fig. 2, the data importing method may include the following steps:
step 210: traversing the service data in the data carrier one by one, reading at least one service attribute value in the service reference relationship among different service class data from the data carrier, generating a global identifier by adopting a service system algorithm corresponding to the service attribute value, and generating an updated service reference relationship by utilizing the service reference relationship among the different service class data and the global identifier;
step 220: traversing the service data in the data carrier one by one, and adding an updated service reference relation using the global identification in the service reference relation among different service class data;
step 230: and traversing and updating the service data in the data carrier item by item according to a specified sequence, and sequentially importing the service data into the database.
With this embodiment, a batch import of service data into a data carrier at a time can be achieved. Specifically, when the batch is imported, by analyzing the service reference relationship, an external key association based on the global identifier is generated, the external key association is the above updated service reference relationship, and the global identifier and the external key association are written into the data carrier.
The embodiment of the disclosure provides a batch import means on the premise of ensuring consistent constraint strength, and improves input efficiency.
Fig. 3 is a schematic block diagram of an embodiment of a data import system according to an embodiment of the present disclosure. As shown in FIG. 3, the data import system of the present invention includes, but is not limited to:
the data reading module 310 reads at least one service attribute value in the service reference relationship between different service class data from the data carrier;
the service reference relationship updating module 320 generates a global identifier by adopting a service system algorithm corresponding to the service attribute value, and generates an updated service reference relationship by using the service reference relationship and the global identifier between different service class data;
the writing module 330 writes the global identifier and the updated service reference relationship into a data carrier to obtain an updated data carrier, and introduces service data in the updated data carrier into data.
The implementation principle of the above modules is described in the data importing method, and is not described herein again.
In the embodiment of the disclosure, when data is imported into a database, reference relations of service levels among different service class data are mapped into reference relations among a plurality of tables in the database. Because the newly generated global identification is written into the data carrier before the database is imported, key values at two ends of the updated service reference relation based on the global identification in the data carrier have uniqueness, and the problem that the original service reference relation in the data carrier is not unique can be solved.
In this case, the reference relations between tables in the database corresponding to the updated reference relations in the updated data carrier are unique and can be used, and the data carrier is consistent with the data in the database. The embodiment of the disclosure does not need to cancel the constraint of the database, thereby being capable of keeping the data quality from weakening.
Optionally, the business system algorithm is an algorithm used by the business system in generating business class data in response to user input at the interface.
Optionally, the data reading module 310 is specifically configured to:
and traversing the service data in the data carrier one by one, and reading at least one service attribute value in the service reference relationship between different service class data from the data carrier.
Optionally, the service reference relationship updating module 320 is specifically configured to:
and traversing the service data in the data carrier one by one, and adding an updated service reference relation using the global identification in the service reference relation among different service class data.
Optionally, the writing module 330 is specifically configured to:
and traversing and updating the service data in the data carrier item by item according to the specified sequence, and sequentially importing the service data into the database.
Optionally, the service reference relationship updating module 320 is specifically configured to:
and generating a global reference relation of the database by using the service reference relation and the global identification among different service class data.
Optionally, the service reference relationship updating module 320 is further specifically configured to:
and generating the foreign key association based on the global identification by utilizing the service reference relation between the global identification and different service class data.
Optionally, unlike fig. 3, the data import system shown in fig. 4 further includes the following modules:
the namespace setting module 410 sets the data carrier as a namespace before reading at least one service attribute value in a service reference relationship between different service class data from the data carrier.
The embodiment of the invention also provides data import equipment which comprises a processor. A memory having stored therein executable instructions of the processor. Wherein the processor is configured to perform the steps of the data import method via execution of executable instructions.
As shown above, the data import apparatus according to the embodiment of the present disclosure can map, in importing data into a database, reference relationships of service levels between different service class data into reference relationships between multiple tables in the database. Because the newly generated global identification is written into the data carrier before the database is imported, key values at two ends of the updated service reference relation based on the global identification in the data carrier have uniqueness, and the problem that the original service reference relation in the data carrier is not unique can be solved.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Accordingly, various aspects of the present invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" platform.
Fig. 5 is a schematic structural diagram of the data import apparatus according to the present invention. An electronic device 500 according to this embodiment of the invention is described below with reference to fig. 5. The electronic device 500 shown in fig. 5 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 5, the electronic device 500 is embodied in the form of a general purpose computing device. The components of the electronic device 500 may include, but are not limited to: at least one processing unit 510, at least one memory unit 520, a bus 530 connecting different platform components (including memory unit 520 and processing unit 510), a display unit 540, etc.
Wherein the storage unit stores program code, which can be executed by the processing unit 510, to cause the processing unit 510 to perform the steps according to various exemplary embodiments of the present invention described in the above-mentioned data importing method section of the present specification. For example, processing unit 510 may perform the steps as shown in fig. 1-2.
The storage unit 520 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)521 and/or a cache memory unit 522, and may further include a read only memory unit (ROM) 523.
The storage unit 520 may also include a program/utility 524 having a set (at least one) of program modules 525, such program modules 525 including, but not limited to: a processing system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Bus 530 may be one or more of any of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 500 may also communicate with one or more external devices 570 (e.g., keyboard, pointing device, Bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 500, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 500 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 550.
Also, the electronic device 500 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 560. The network adapter 560 may communicate with other modules of the electronic device 500 via the bus 530. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms, to name a few.
The embodiment of the invention also provides a computer readable storage medium for storing the program, and the steps of the data importing method are realized when the program is executed. In some possible embodiments, the various aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to the various exemplary embodiments of the invention described in the above-mentioned data import method section of this description, when the program product is run on the terminal device.
According to the program product for realizing the method, the portable compact disc read only memory (CD-ROM) can be adopted, the program code is included, and the program product can be operated on terminal equipment, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out processes of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
In summary, the present invention is directed to a data import method, system, device and storage medium, in importing data into a database, mapping reference relationships of service levels between different service class data into reference relationships between multiple tables in the database. Because the newly generated global identification is written into the data carrier before the database is imported, key values at two ends of the updated service reference relation based on the global identification in the data carrier have uniqueness, and the problem that the original service reference relation in the data carrier is not unique can be solved.
In this case, the reference relations between tables in the database corresponding to the updated reference relations in the updated data carrier are unique and can be used, and the data carrier is consistent with the data in the database. The embodiment of the disclosure does not need to cancel the constraint of the database, thereby being capable of keeping the data quality from weakening.
The foregoing is a further detailed description of the invention in connection with specific preferred embodiments and it is not intended to limit the invention to the specific embodiments described. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.

Claims (11)

1. A data import method, comprising:
reading at least one service attribute value in service reference relations among different service class data from a data carrier;
generating a global identifier corresponding to the service attribute value by adopting a service system algorithm, and generating an updated service reference relation by utilizing the service reference relation among the different service class data and the global identifier;
and writing the global identification and the updated service reference relationship into the data carrier to obtain an updated data carrier, and importing the service data in the updated data carrier into a database.
2. The data import method according to claim 1, wherein before reading the at least one service attribute value in the service reference relationship between different service class data from the data carrier, the data import method further comprises:
the data carrier is set as a namespace.
3. The data import method of claim 1, wherein the business system algorithm is an algorithm used by the business system in generating business class data in response to user input at the interface.
4. The data import method according to claim 1, wherein reading at least one service attribute value in the service reference relationship between different service class data from the data carrier comprises:
and traversing the service data in the data carrier one by one, and reading at least one service attribute value in the service reference relationship between different service class data from the data carrier.
5. The data import method according to claim 4, wherein generating an updated service reference relationship by using the service reference relationship between the different service class data and the global identifier comprises:
and traversing the service data in the data carrier one by one, and adding an updated service reference relation using the global identification in the service reference relation among different service class data.
6. The data import method of claim 5, wherein importing the service data in the updated data carrier into a database comprises:
and traversing the service data in the updated data carrier item by item according to a specified sequence, and sequentially importing the service data into the database.
7. The data import method according to claim 1, wherein the generating an updated service reference relationship by using the service reference relationship between the different service class data and the global identifier includes:
and generating a global reference relation of the database by using the service reference relation among the different service class data and the global identification.
8. The data import method of claim 7, wherein the generating a global business reference relationship of the database by using the business reference relationship between the different business class data and the global identifier comprises:
and generating the foreign key association based on the global identification by utilizing the service reference relation between the global identification and the different service class data.
9. A data import system, comprising:
the data reading module is used for reading at least one service attribute value in the service reference relationship among different service class data from the data carrier;
the service reference relation updating module generates a global identifier corresponding to the service attribute value by adopting a service system algorithm, and generates an updated service reference relation by utilizing the service reference relation among different service class data and the global identifier;
the writing module writes the global identification and the updating service reference relation into the data carrier to obtain an updating data carrier;
and the import module imports the service data in the updated data carrier into data.
10. A data import apparatus, comprising:
a processor;
a memory having stored therein executable instructions of the processor;
wherein the processor is configured to perform the steps of the data import method of any of claims 1 to 8 via execution of the executable instructions.
11. A computer-readable storage medium storing a program, wherein the program is configured to implement the steps of the data importing method according to any one of claims 1 to 8 when executed by a processor.
CN202210388409.XA 2022-04-13 2022-04-13 Data importing method, system, equipment and storage medium Active CN114722109B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210388409.XA CN114722109B (en) 2022-04-13 2022-04-13 Data importing method, system, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210388409.XA CN114722109B (en) 2022-04-13 2022-04-13 Data importing method, system, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN114722109A true CN114722109A (en) 2022-07-08
CN114722109B CN114722109B (en) 2024-02-06

Family

ID=82244582

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210388409.XA Active CN114722109B (en) 2022-04-13 2022-04-13 Data importing method, system, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114722109B (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103605782A (en) * 2013-11-29 2014-02-26 北京国双科技有限公司 Data insertion method and device for data table
CN104317974A (en) * 2014-11-21 2015-01-28 武汉理工大学 Reconfigurable multi-source data importing method in ERP system
CN104573100A (en) * 2015-01-29 2015-04-29 无锡江南计算技术研究所 Step-by-step database synchronization method with autoincrement identifications
CN104598610A (en) * 2015-01-29 2015-05-06 无锡江南计算技术研究所 Step-by-step database data distribution uploading and synchronizing method
CN107220266A (en) * 2016-03-22 2017-09-29 阿里巴巴集团控股有限公司 It is a kind of to create Service Database, business datum storage and the method and device for determining business datum
CN107368593A (en) * 2017-07-25 2017-11-21 万帮充电设备有限公司 Data lead-in method, device and server
CN107870979A (en) * 2017-09-30 2018-04-03 平安科技（深圳）有限公司 Electronic installation, extract tables of data data method and storage medium
CN107908637A (en) * 2017-09-26 2018-04-13 北京百度网讯科技有限公司 The entity update method and system in a kind of knowledge based storehouse
WO2019096191A1 (en) * 2017-11-16 2019-05-23 四川长虹电器股份有限公司 Design method for xbrl standard-based master data management system
CN110555078A (en) * 2019-09-02 2019-12-10 上海摩库数据技术有限公司 Distributed ID generation
CN111538774A (en) * 2020-04-23 2020-08-14 上海携程商务有限公司 Data storage and display method, system, equipment and storage medium

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103605782A (en) * 2013-11-29 2014-02-26 北京国双科技有限公司 Data insertion method and device for data table
CN104317974A (en) * 2014-11-21 2015-01-28 武汉理工大学 Reconfigurable multi-source data importing method in ERP system
CN104573100A (en) * 2015-01-29 2015-04-29 无锡江南计算技术研究所 Step-by-step database synchronization method with autoincrement identifications
CN104598610A (en) * 2015-01-29 2015-05-06 无锡江南计算技术研究所 Step-by-step database data distribution uploading and synchronizing method
CN107220266A (en) * 2016-03-22 2017-09-29 阿里巴巴集团控股有限公司 It is a kind of to create Service Database, business datum storage and the method and device for determining business datum
CN107368593A (en) * 2017-07-25 2017-11-21 万帮充电设备有限公司 Data lead-in method, device and server
CN107908637A (en) * 2017-09-26 2018-04-13 北京百度网讯科技有限公司 The entity update method and system in a kind of knowledge based storehouse
CN107870979A (en) * 2017-09-30 2018-04-03 平安科技（深圳）有限公司 Electronic installation, extract tables of data data method and storage medium
WO2019096191A1 (en) * 2017-11-16 2019-05-23 四川长虹电器股份有限公司 Design method for xbrl standard-based master data management system
CN110555078A (en) * 2019-09-02 2019-12-10 上海摩库数据技术有限公司 Distributed ID generation
CN111538774A (en) * 2020-04-23 2020-08-14 上海携程商务有限公司 Data storage and display method, system, equipment and storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
BALKASH, A.; WANISS, A.M.Y.; MOUSSA, A.A.: "Designing a Computer Program to Complete Final Exams In Saudi Universities using MS Excel", INTERNATIONAL JOURNAL OF COMPUTER AND INFORMATION TECHNOLOGY, pages 99 - 107 *
WEIXIN_48223794: "将Excel中数据导入到数据库中，并且修改外键的值", pages 1 - 5, Retrieved from the Internet <URL:https://blog.csdn.net/weixin_48223794/article/details/115177999> *
陈立;彭复员;: "联机事务处理在电信经营中的应用", 计算机时代, no. 03, pages 32 - 34 *

Also Published As

Publication number Publication date
CN114722109B (en) 2024-02-06

Similar Documents

Publication Publication Date Title
US11119988B2 (en) Performing logical validation on loaded data in a database
US7711680B2 (en) Common common object
US9582555B2 (en) Data enrichment using business compendium
US7904491B2 (en) Data mapping and import system
US9996521B2 (en) Validation of formulas with external sources
US20120158742A1 (en) Managing documents using weighted prevalence data for statements
WO2019051945A1 (en) Insurance data checking method and apparatus, computer device, and storage medium
CA2852948C (en) System and method for optimizing the loading of data submissions
CN109544392B (en) Method, system, device and medium for insurance order processing
US9495638B2 (en) Scalable, rule-based processing
US20220019907A1 (en) Dynamic In-Memory Construction of a Knowledge Graph
CN112039975A (en) Method, device, equipment and storage medium for processing message field
CN103714062A (en) Method and system for importing entity-relationship model data based on dependency relationships
CN110765069A (en) Data migration method, device and system
CN114722109B (en) Data importing method, system, equipment and storage medium
CN113687827B (en) Data list generation method, device and equipment based on widget and storage medium
CN108182628B (en) Method, system, equipment and storage medium for ordering travel
JP6588988B2 (en) Business program generation support system and business program generation support method
US8874435B2 (en) Automated glossary creation
CN111447268A (en) File structure conversion method, device, equipment and storage medium
US20240086409A1 (en) Techniques for pre-assignment validation of data managed by a data processing system
CN114385671A (en) Abnormal registration account identification method, device, equipment and storage medium
CN115470222A (en) Data dictionary modification method, device, equipment and storage medium
CN113902368A (en) Information processing method, device, equipment and storage medium
CN116595963A (en) Document generation method, device, equipment and medium based on template configuration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant