CN114253480A - Data storage method and device, electronic equipment and storage medium - Google Patents

Data storage method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN114253480A
CN114253480A CN202111572362.4A CN202111572362A CN114253480A CN 114253480 A CN114253480 A CN 114253480A CN 202111572362 A CN202111572362 A CN 202111572362A CN 114253480 A CN114253480 A CN 114253480A
Authority
CN
China
Prior art keywords
data
database
storage
stored
temporary storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111572362.4A
Other languages
Chinese (zh)
Inventor
付东洋
周天月
支涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Yunji Technology Co Ltd
Original Assignee
Beijing Yunji Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Yunji Technology Co Ltd filed Critical Beijing Yunji Technology Co Ltd
Priority to CN202111572362.4A priority Critical patent/CN114253480A/en
Publication of CN114253480A publication Critical patent/CN114253480A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/062—Securing storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/211—Schema design and management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/258—Data format conversion from or to a database
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0643—Management of files

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data storage method, a data storage device, electronic equipment and a storage medium. Wherein, the method comprises the following steps: reading storage data in at least two databases according to the drive configuration file; and storing each storage data according to the temporary storage database. The embodiment of the invention can realize the unified management of different types of databases, can improve the safety of data storage, is convenient for the use of stored data, and can improve the management efficiency of the stored data.

Description

Data storage method and device, electronic equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of data storage, in particular to a data storage method and device, electronic equipment and a storage medium.
Background
With the continuous promotion of interconnection infrastructure, interconnection and intercommunication at the top layer of the internet are further perfected, informatization becomes an important development factor of current enterprises, the current internet industry fully utilizes the advantages of new generation information technology and platform service such as cloud computing, big data, artificial intelligence and the like, and rapid development is achieved.
Disclosure of Invention
The invention provides a data storage method, a data storage device, electronic equipment and a storage medium, which are used for realizing the unified management of different databases, improving the safety of data storage, facilitating the use of stored data and improving the management efficiency of the stored data.
In a first aspect, an embodiment of the present invention provides a data storage method, where the method includes:
reading storage data in at least two databases according to the drive configuration file;
and storing each storage data according to the temporary storage database.
Further, reading the stored data in at least two databases according to the drive configuration file comprises:
extracting database drivers corresponding to the databases in the driver configuration file;
and calling the database driver to read the stored data in the corresponding database.
Further, storing each storage data according to a temporary storage database includes:
processing each storage data according to the data storage format of the temporary storage database;
and storing the storage data in the temporary storage database.
Further, the temporary database includes: MySQL database.
Further, the data storage method provided by the embodiment of the present invention further includes: and configuring connection parameters of the temporary storage database according to user parameters, wherein the connection parameters at least comprise a data source address and login information.
Further, processing each storage data according to the data storage format of the temporary storage database includes:
converting each of the stored data into a comma separated value file;
extracting target content in the comma separated value file according to the field information of the data storage format;
and splicing the storage data into the data storage format according to the field information corresponding to each target content.
In a second aspect, an embodiment of the present invention further provides a data storage apparatus, where the apparatus includes:
the data reading module is used for reading the storage data in the at least two databases according to the drive configuration file;
and the data temporary storage module is used for storing the storage data according to a temporary storage database.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a method as in any one of the embodiments of the invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements the method according to any one of the embodiments of the present invention.
According to the embodiment of the invention, the stored data in different databases in the drive configuration file are read, and the stored data are stored in the temporary storage database.
Drawings
Fig. 1 is a flowchart of a data storage method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another data storage method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a data storage device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be noted that, for convenience of description, only a part of the structures related to the present invention, not all of the structures, are shown in the drawings, and furthermore, embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
Example one
Fig. 1 is a flowchart of a data storage method provided in an embodiment of the present invention, where this embodiment is applicable to a case of uniformly managing stored data of different types of databases, and the method may be executed by a data storage device, where the data storage device may be implemented in a hardware and/or software manner, and may be generally integrated in a server or a server cluster, referring to fig. 1, where the method provided in the embodiment of the present invention specifically includes the following steps:
step 110, reading the stored data in at least two databases according to the drive configuration file.
The driver configuration file may be a configuration file driven by one or more databases, and the database driver may be a software program code for connecting the databases, may be composed of a programming language, and provides a uniform access manner for the databases. A database may be a repository where data is organized, stored, and managed in a data structure, and may be stored for long periods of time within a computer.
In the embodiment of the invention, the database driver of one or more databases can be read in the pre-configured driver configuration file, and the read database driver can be connected to the corresponding database and read the stored data in the database.
And step 120, storing each storage data according to the temporary storage database.
The temporary database may be a database that performs unified management on stored data in different types of databases, and the types of the approved databases may be the same as or different from the types of the original databases storing the data. It can be understood that the type of the temporary database can be selected according to the requirements of the enterprise business, so as to increase the management efficiency of different stored data.
Specifically, the stored data read from each database may be stored in the temporary storage database, and unified management of the data in each database may be achieved by processing the stored data in the approved database.
According to the embodiment of the invention, the stored data in different databases in the drive configuration file are read, and the stored data are stored in the temporary storage database.
Example two
Fig. 2 is a flowchart of another data storage method provided in the second embodiment of the present invention, and the second embodiment of the present invention is embodied on the basis of the foregoing second embodiment of the present invention, and referring to fig. 2, the method provided in the second embodiment of the present invention specifically includes the following steps:
step 210, configuring connection parameters of the temporary storage database according to the user parameters, wherein the connection parameters at least comprise a data source address and login information.
The connection parameter may be information that a user connects to the temporary storage database, and the connection parameter may include a data source address and login information, where the data source address may be a network address used by connecting to the temporary storage database, and the login information may be authentication information only used by the user to access the temporary storage database.
In the embodiment of the invention, a user can input the data source address and the login information of the temporary storage database into the server in a mode of configuring the connection parameters, and the server can be connected to the temporary storage database through the connection parameters and the database driver corresponding to the temporary storage database, so that the configuration of the temporary storage database is realized. Wherein the user parameter may be input by a user or determined by the server from user information.
Further, on the basis of the above embodiment of the present invention, the temporary database includes: MySQL database.
Step 220, extracting the database driver corresponding to each database in the driver configuration file.
In the embodiment of the present invention, the database drivers corresponding to the databases may be sequentially extracted from the determined driver configuration file, and the different types of databases in the driver configuration file may have their respective corresponding database drivers, for example, a database driver corresponding to a MySQL database, a database driver corresponding to a SQLSERVER database, a database driver corresponding to an ORACLE database, a database driver corresponding to a HIVE database, and the like. Step 230, invoke the database driver to read the stored data in the corresponding database.
Specifically, for each database, a corresponding database driver may be respectively called to be connected to each database, and the stored data in each database is read, it can be understood that a thread may be separately created to execute each database driver, so as to implement parallel reading of the stored data in different databases.
And step 240, processing each storage data according to the data storage format of the temporary storage database.
The data storage format may be a structure for organizing and storing data in a database.
In the embodiment of the present invention, part or all of the original database storing data may be an unstructured database, and before the stored data is transferred to the temporary storage database, format processing may be performed on the read stored data, so that the data format of the converted stored data is the same as the data storage format of the temporary storage database.
And step 250, storing the stored data in a temporary storage database.
Specifically, the read stored data is stored in the temporary storage database, and unified management of data in each database can be realized by processing the stored data in the approved database.
According to the embodiment of the invention, the connection parameters of the temporary storage database are configured by using the user parameters, the database driver in the driver configuration file is extracted, the database driver is called to read the stored data stored in the database, the stored data are processed according to the data storage format of the temporary storage database, and the stored data are stored in the temporary storage database, so that the unified management of different types of databases can be realized, the safety of data storage can be improved, the use of the stored data is facilitated, and the management efficiency of the stored data can be improved.
Further, on the basis of the above embodiment of the present invention, processing each storage data according to the data storage format of the temporary storage database includes:
converting each of the stored data into a comma separated value file; extracting target content in the comma separated value file according to the field information of the data storage format; and splicing the storage data into the data storage format according to the field information corresponding to each target content.
Wherein, Comma-Separated Values (CSV) file can be pure text type storing table data, the file is a character sequence, composed of any number of records, the records are Separated by some sort of line feed character; each record is made up of fields, and separators between fields are other characters or strings, most commonly commas or tabs. The field information may be column information or row information of a fixed position in a data storage format, the data storage format may be composed of one or more field information, and different field information may be positions of different data storage formats.
In the embodiment of the present invention, the read storage data may be stored in a common separation value file, different storage data may be separated by a separator, and corresponding target content may be matched in the comma separation value file according to different field information of the data storage format, for example, the target content may have the same identification number as the field information or the semantics of the target content is similar to the field information, and for each storage data, the extracted target content may be spliced into one or more data storage formats according to the respective corresponding field information, thereby implementing format conversion of the storage data.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a data storage device according to a third embodiment of the present invention, which is capable of executing a data storage method according to any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. The device can be implemented by software and/or hardware, and specifically comprises: a data reading module 301 and a data temporary storage module 302.
And a data reading module 301, configured to read the storage data in the at least two databases according to the drive configuration file.
The data temporary storage module 302 is configured to store each of the stored data according to a temporary storage database.
According to the embodiment of the invention, the data reading module is used for reading the stored data in different databases in the drive configuration file, and the data temporary storage module is used for storing each stored data in the temporary storage database.
Further, on the basis of the above embodiment of the present invention, the data reading module 301 includes:
the drive determining unit is used for extracting the database drive corresponding to each database in the drive configuration file;
and the reading execution unit is used for calling the database driver to read the storage data in the corresponding database.
Further, on the basis of the above embodiment of the present invention, the data temporary storage module 302 includes:
the format conversion unit is used for processing each storage data according to the data storage format of the temporary storage database;
and the data storage unit is used for storing the storage data in the temporary storage database.
Further, on the basis of the above embodiment of the present invention, the temporary database includes: MySQL database.
Further, on the basis of the above embodiment of the invention, the apparatus further includes: the temporary storage configuration module is used for configuring connection parameters of the temporary storage database according to user parameters, wherein the connection parameters at least comprise a data source address and login information.
Further, on the basis of the above embodiment of the present invention, the format conversion unit is specifically configured to: converting each of the stored data into a comma separated value file; extracting target content in the comma separated value file according to the field information of the data storage format; and splicing the storage data into the data storage format according to the field information corresponding to each target content.
Example four
Fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention, and fig. 4 shows a block diagram of a computer device 312 suitable for implementing an embodiment of the present invention. The computer device 312 shown in FIG. 4 is only an example and should not bring any limitations to the functionality or scope of use of embodiments of the present invention. Device 312 is typically a computing device implementing a data storage method.
As shown in FIG. 4, computer device 312 is in the form of a general purpose computing device. The components of computer device 312 may include, but are not limited to: one or more processors 316, a storage device 328, and a bus 318 that couples the various system components including the storage device 328 and the processors 316.
Bus 318 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.
Computer device 312 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 312 and includes both volatile and nonvolatile media, removable and non-removable media.
Storage 328 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 330 and/or cache Memory 332. The computer device 312 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 334 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, and commonly referred to as a "hard drive"). Although not shown in FIG. 4, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk-Read Only Memory (CD-ROM), a Digital Video disk (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 318 by one or more data media interfaces. Storage 328 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
Program 336 having a set (at least one) of program modules 326 may be stored, for example, in storage 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which may comprise an implementation of a network environment, or some combination thereof. Program modules 326 generally carry out the functions and/or methodologies of embodiments of the invention as described herein.
The computer device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), with one or more devices that enable a user to interact with the computer device 312, and/or with any devices (e.g., network card, modem, etc.) that enable the computer device 312 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 322. Also, computer device 312 may communicate with one or more networks (e.g., a Local Area Network (LAN), Wide Area Network (WAN), etc.) and/or a public Network, such as the internet, via Network adapter 320. As shown, network adapter 320 communicates with the other modules of computer device 312 via bus 318. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the computer device 312, including but not limited to: microcode, device drivers, Redundant processing units, external disk drive Arrays, disk array (RAID) systems, tape drives, and data backup storage systems, to name a few.
Processor 316 executes various functional applications and data processing, such as implementing the data storage methods provided by the above-described embodiments of the present invention, by executing programs stored in storage 328.
EXAMPLE five
Embodiments of the present invention provide a computer-readable storage medium on which a computer program is stored, which, when executed by a processing apparatus, implements a data storage method as in embodiments of the present invention. The computer readable medium of the present invention described above may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the computer device; or may exist separately and not be incorporated into the computer device.
The computer readable medium carries one or more programs which, when executed by the computing device, cause the computing device to: reading storage data in at least two databases according to the drive configuration file; and storing each storage data according to the temporary storage database. Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (10)

1. A method of data storage, the method comprising:
reading storage data in at least two databases according to the drive configuration file;
and storing each storage data according to the temporary storage database.
2. The method of claim 1, wherein reading the stored data in at least two databases according to the drive profile comprises:
extracting database drivers corresponding to the databases in the driver configuration file;
and calling the database driver to read the stored data in the corresponding database.
3. The method of claim 1, wherein storing each of the stored data according to a scratch database comprises:
processing each storage data according to the data storage format of the temporary storage database;
and storing the storage data in the temporary storage database.
4. The method of claim 1, wherein the staging database comprises: MySQL database.
5. The method of claim 1, further comprising: and configuring connection parameters of the temporary storage database according to user parameters, wherein the connection parameters at least comprise a data source address and login information.
6. The method of claim 3, wherein said processing each of said stored data according to a data storage format of said staging database comprises:
converting each of the stored data into a comma separated value file;
extracting target content in the comma separated value file according to the field information of the data storage format;
and splicing the storage data into the data storage format according to the field information corresponding to each target content.
7. A data storage device, characterized in that the device comprises:
the data reading module is used for reading the storage data in the at least two databases according to the drive configuration file;
and the data temporary storage module is used for storing the storage data according to a temporary storage database.
8. The apparatus of claim 7, wherein the data reading module comprises:
the drive determining unit is used for extracting the database drive corresponding to each database in the drive configuration file;
and the reading execution unit is used for calling the database driver to read the storage data in the corresponding database.
9. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-6.
CN202111572362.4A 2021-12-21 2021-12-21 Data storage method and device, electronic equipment and storage medium Pending CN114253480A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111572362.4A CN114253480A (en) 2021-12-21 2021-12-21 Data storage method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111572362.4A CN114253480A (en) 2021-12-21 2021-12-21 Data storage method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114253480A true CN114253480A (en) 2022-03-29

Family

ID=80796340

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111572362.4A Pending CN114253480A (en) 2021-12-21 2021-12-21 Data storage method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114253480A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030225599A1 (en) * 2002-05-30 2003-12-04 Realty Datatrust Corporation System and method for data aggregation
CN101452450A (en) * 2007-11-30 2009-06-10 上海市电力公司 Multiple source data conversion service method and apparatus thereof
US20120144388A1 (en) * 2010-12-06 2012-06-07 International Business Machines Corporation Database Access for Native Applications in a Virtualized Environment
CN102567334A (en) * 2010-12-15 2012-07-11 上海杉达学院 Office automation system based on heterogeneous data
CN103092980A (en) * 2013-01-31 2013-05-08 中国科学院自动化研究所 Method and system of data automatic conversion and storage
CN110209719A (en) * 2019-05-20 2019-09-06 华南理工大学 A kind of multitype database based on micro services framework uniformly accesses system and method
CN110825802A (en) * 2019-11-15 2020-02-21 北京锐安科技有限公司 Multi-type database data backup method, device, equipment and storage medium
CN112711589A (en) * 2020-12-29 2021-04-27 核工业西南物理研究院 Storage control method and system for MDSplus
CN112860778A (en) * 2021-03-22 2021-05-28 平安商业保理有限公司 Database management method, device, equipment and medium for desktop application program

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030225599A1 (en) * 2002-05-30 2003-12-04 Realty Datatrust Corporation System and method for data aggregation
CN101452450A (en) * 2007-11-30 2009-06-10 上海市电力公司 Multiple source data conversion service method and apparatus thereof
US20120144388A1 (en) * 2010-12-06 2012-06-07 International Business Machines Corporation Database Access for Native Applications in a Virtualized Environment
CN102567334A (en) * 2010-12-15 2012-07-11 上海杉达学院 Office automation system based on heterogeneous data
CN103092980A (en) * 2013-01-31 2013-05-08 中国科学院自动化研究所 Method and system of data automatic conversion and storage
CN110209719A (en) * 2019-05-20 2019-09-06 华南理工大学 A kind of multitype database based on micro services framework uniformly accesses system and method
CN110825802A (en) * 2019-11-15 2020-02-21 北京锐安科技有限公司 Multi-type database data backup method, device, equipment and storage medium
CN112711589A (en) * 2020-12-29 2021-04-27 核工业西南物理研究院 Storage control method and system for MDSplus
CN112860778A (en) * 2021-03-22 2021-05-28 平安商业保理有限公司 Database management method, device, equipment and medium for desktop application program

Similar Documents

Publication Publication Date Title
US11238099B2 (en) Method and device for obtaining answer, and computer device
CN107256206B (en) Method and device for converting character stream format
CN110428319B (en) Data comparison platform, method, equipment and storage medium
US11556496B2 (en) Outputting map-reduce jobs to an archive file
US20180300167A1 (en) Method, device and computer readable storage medium for managing a virtual machine
US9588952B2 (en) Collaboratively reconstituting tables
CN111949850A (en) Multi-source data acquisition method, device, equipment and storage medium
US10620950B2 (en) Message parsing in a distributed stream processing system
US11204926B2 (en) Storing partial tuples from a streaming application in a database system
CN114265966A (en) Data processing method and device, electronic equipment and storage medium
CN109033456B (en) Condition query method and device, electronic equipment and storage medium
CN110825802A (en) Multi-type database data backup method, device, equipment and storage medium
US9965447B2 (en) Efficient handling of bi-directional data
US20150127666A1 (en) Processing a database table
CN112613964A (en) Account checking method, account checking device, account checking equipment and storage medium
US20200387507A1 (en) Optimization of database execution planning
CN113220237B (en) Distributed storage method, device, equipment and storage medium
CN114253480A (en) Data storage method and device, electronic equipment and storage medium
US20220382731A1 (en) Preserving metadata context in a hybrid cloud context
US10628416B2 (en) Enhanced database query processing
US20140059011A1 (en) Automated data curation for lists
CN114090124A (en) Data processing method, data processing device, computer equipment and storage medium
CN111367503A (en) Management method, device and equipment of multi-element storage and storage medium
CN110781234A (en) TRS database retrieval method, device, equipment and storage medium
CN113609131B (en) Data storage method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination