CN114090124A - Data processing method, data processing device, computer equipment and storage medium - Google Patents

Data processing method, data processing device, computer equipment and storage medium Download PDF

Info

Publication number
CN114090124A
CN114090124A CN202111392174.3A CN202111392174A CN114090124A CN 114090124 A CN114090124 A CN 114090124A CN 202111392174 A CN202111392174 A CN 202111392174A CN 114090124 A CN114090124 A CN 114090124A
Authority
CN
China
Prior art keywords
data
data source
information
plug
configuration information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111392174.3A
Other languages
Chinese (zh)
Inventor
王海波
张扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cognitive Computing Nanjing Information Technology Co ltd
Original Assignee
Cognitive Computing Nanjing Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cognitive Computing Nanjing Information Technology Co ltd filed Critical Cognitive Computing Nanjing Information Technology Co ltd
Priority to CN202111392174.3A priority Critical patent/CN114090124A/en
Publication of CN114090124A publication Critical patent/CN114090124A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/445—Program loading or initiating
    • G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
    • G06F9/44526—Plug-ins; Add-ons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/547—Remote procedure calls [RPC]; Web services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying

Abstract

The invention discloses a data processing method, a data processing device, computer equipment and a storage medium, wherein the method comprises the following steps: acquiring and storing configuration information of a data source, wherein the configuration information comprises data source connection information, data mode information and data table information; and acquiring the data of the data source according to the configuration information and a preset data plug-in, wherein the preset data plug-in corresponds to the data source type of the data source. According to the embodiment of the invention, the applicability of the data source is enhanced through the preset data plug-in, the problem that the data source is difficult to acquire by upper-layer application due to the inconsistent types of the data source is solved, and the data acquisition efficiency can be improved.

Description

Data processing method, data processing device, computer equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of computer application, in particular to a data processing method, a data processing device, computer equipment and a storage medium.
Background
With the popularization of the internet, data acquisition technology has been developed greatly, and various data are stored in various ways. However, the data formats of the data are often five-fold, and when the heterogeneous data are processed, uniform acquisition and processing cannot be performed frequently, and various heterogeneous data need to be analyzed, mined and displayed respectively based on various service scenarios. The data analysis and mining is based on acquiring data from various data sources, and in order to facilitate data analysis and data management, different data sources need to be managed by a uniform data interface, so that the condition that services are unavailable due to the change of the data sources by upper-layer application is avoided.
Common methods in Data access management are JAVA Database Connectivity (JDBC) and dynamic Data Objects (ADO), which can solve the problem of Data sharing between heterogeneous databases. However, JDBC can only be used for JAVA development, which is inconvenient for application in C + + development and lacks management of data sources. The ADO technology focuses on COM components, so that secondary development is inconvenient, cross-platform use cannot be realized, and the ADO technology can only be applied to Windows systems. In addition, the unified access interface can only manage and abstract the link of the database, and the upper layer application cannot realize one-time coding and adapt to all the data of the bottom layer data source, so that a universal data processing method is urgently needed at present, and the influence of different data sources on the upper layer application is reduced.
Disclosure of Invention
The invention provides a data processing method, a data processing device, computer equipment and a storage medium, which are used for realizing the efficient management of a data source, improving the data processing efficiency, enhancing the applicability of the data source and reducing the influence of the type of the data source on the implementation of upper-layer application.
In a first aspect, an embodiment of the present invention provides a data processing method, where the method includes:
acquiring and storing configuration information of a data source, wherein the configuration information comprises data source connection information, data mode information and data table information;
and acquiring the data of the data source according to the configuration information and a preset data plug-in, wherein the preset data plug-in corresponds to the data source type of the data source.
In a second aspect, an embodiment of the present invention further provides a data processing apparatus, where the apparatus includes:
the data source configuration module is used for acquiring and storing configuration information of a data source, wherein the configuration information comprises data source connection information, data mode information and data table information;
and the data reading module is used for acquiring the data of the data source according to the configuration information and a preset data plug-in, wherein the preset data plug-in corresponds to the data source type of the data source.
In a third aspect, an embodiment of the present invention further provides a computer device, where the computer device includes:
one or more processors;
a memory for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the data processing method according to any one of the embodiments of the present invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the data processing method according to any one of the embodiments of the present invention.
According to the embodiment of the invention, the preset data plug-in corresponding to the type of the data source is obtained by reading and storing the configuration information of the data source, the preset data plug-in is called according to the configuration information to read the data of the data source, so that the efficient management of the data source is realized, the applicability of the data source is enhanced based on the preset data plug-in, the problem that the data source is difficult to obtain by upper-layer application due to the inconsistent types of the data source is solved, and the data obtaining efficiency can be improved.
Drawings
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention;
fig. 2 is a flowchart of a data processing method according to a second embodiment of the present invention;
fig. 3 is an exemplary diagram of a data processing method according to a second embodiment of the present invention;
fig. 4 is a schematic structural diagram of a data processing apparatus according to a third embodiment of the present invention;
fig. 5 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be noted that, for convenience of description, only a part of the structures related to the present invention, not all of the structures, are shown in the drawings, and furthermore, embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
Example one
Fig. 1 is a flowchart of a data processing method provided in an embodiment of the present invention, where this embodiment is applicable to a case of data reading across data sources, and the method may be executed by a data processing apparatus, and the apparatus may be implemented in a hardware and/or software manner, and referring to fig. 1, the data processing method provided in the embodiment of the present invention specifically includes the following steps:
step 110, obtaining and storing configuration information of the data source, wherein the configuration information includes data source connection information, data mode information and data table information.
In the embodiment of the present invention, data corresponding to a data source may be divided into three layers, i.e., a data source connection layer, a data mode layer, and a data table layer, and correspondingly, the configuration information may include attribute information of the three layers, i.e., data source connection information, data mode information, and data table information, where the data source connection information may be a storage folder path of the data, the data mode information may be file information in a storage folder, and the data table information may be data information in a file.
Specifically, when a new data source is acquired, attribute information such as access verification information and connection information of the data source may be acquired, the acquired attribute information may be divided into data source connection information, data mode information, and data table information according to three levels of data source connection, data mode, and data table, and the data source connection information, the data mode information, and the data table information may be stored as configuration information of the data source, so as to facilitate subsequent data processing operations.
And 120, acquiring data of the data source according to the configuration information and a preset data plug-in, wherein the preset data plug-in corresponds to the data source type of the data source.
The preset data plug-ins can be plug-ins for operating data in the data source, the number of the preset data plug-ins can be one or more, different preset data plug-ins can correspond to different types of data sources, the type of the data source can be attribute information of the data source, the type of the data source can represent a data organization structure of the data source, and the type of the data source can include information such as a data storage manufacturer and a data storage structure.
In the embodiment of the present invention, the corresponding preset data plug-in may be obtained according to the data source type of the data source, where the preset data plug-in is used to process the data source of the corresponding data source type, and the preset data plug-in may be called according to the configuration information, and data acquisition in the data source is realized by executing the processing logic in the preset data plug-in.
According to the embodiment of the invention, the preset data plug-in corresponding to the type of the data source is obtained by reading and storing the configuration information of the data source, the preset data plug-in is called according to the configuration information to read the data of the data source, so that the efficient management of the data source is realized, the applicability of the data source is enhanced based on the preset data plug-in, the problem that the data source is difficult to obtain by upper-layer application due to the inconsistent types of the data source is solved, and the data obtaining efficiency can be improved.
Example two
Fig. 2 is a flowchart of a data processing method according to a second embodiment of the present invention, which is embodied on the basis of the second embodiment of the present invention, and referring to fig. 2, the method according to the second embodiment of the present invention specifically includes the following steps:
step 210, obtaining and storing configuration information of the data source, wherein the configuration information includes data source connection information, data mode information, and data table information.
And step 220, acquiring a function interface in the preset data plug-in according to the data source type of the data source.
In the embodiment of the present invention, a plurality of preset data plug-ins may be installed, and each preset data plug-in may process a data source of a different data source type, for example, a MySql plug-in may process a data source of a MySql database. Each preset data plug-in unit can have a set of corresponding functional interfaces, and the functions realized by the functional interfaces in the preset data plug-in units can be the same, but the realization logics can be different.
Specifically, the data source type of the data source may be extracted, the data source type may be located in the configuration information, a corresponding preset data plug-in is searched according to the extracted data source type, and a corresponding functional interface in the preset data plug-in is obtained.
Further, on the basis of the above embodiment of the present invention, the functional interface includes: the data updating system comprises a data adding interface, a data deleting interface, a data updating interface and a data searching interface.
In the embodiment of the present invention, the functional interfaces in each preset data plug-in may include a data adding interface, a data deleting interface, a data updating interface, and a data searching interface, where the data adding interface may be used to add data in the data source, the data deleting interface may be used to delete data in the data source, the data updating interface may be used to update data in the data source, and the data searching interface may be used to search data in the data source.
And step 230, calling a function interface according to the configuration information to read data corresponding to the configuration information in the data source.
Specifically, the function interface is called according to the configuration information, processing logic in the function interface is executed, and data in the data source is read according to the configuration information, for example, the function interface reads a file in a folder path or a data table in a certain file in the folder path according to the data source connection information.
And step 240, storing the data to the memory according to the data caching logic corresponding to the data source.
The data caching logic may be a logic for caching data, and due to different data structures, a plurality of data caching logics may be preset to process the data.
In the embodiment of the present invention, a plurality of data caching logics may be preset, each of which may operate on data of different data sources, and when caching the acquired data, a corresponding data caching processing logic may be selected according to the data source, and the data caching processing logic may exist in a function or interface form, and may store the data in a memory using the acquired data caching processing logic, so that an upper layer application may use the cached data conveniently.
According to the embodiment of the invention, the configuration information of the acquired data source is stored, the functional interface is selected from the preset data plug-in corresponding to the type of the data source, the functional interface is called by using the configuration information to realize data acquisition, the data is stored into the memory according to the cache processing logic corresponding to the data source, and the data acquisition across the data sources is realized based on the preset data plug-in, so that the problem of difficult data acquisition caused by different types of the data source is solved, and the data acquisition efficiency can be improved.
Further, on the basis of the above embodiment of the present invention, the invoking the functional interface according to the configuration information to read data corresponding to the configuration information in the data source includes:
generating a connection object according to the data source connection information; acquiring a data operation handle of a connection object at a functional interface; and reading the data in the data source according to the data operation handle.
The connection object may be an instance object generated based on the data source connection information, the instance object may operate on the data source connection information, and the data operation handle may be an identifier used to identify the connection object in the data acquisition process, and may operate on data corresponding to the connection object.
In the embodiment of the present invention, a connection object may be generated for the data source connection information, and a data operation handle of the connection object may be acquired in the functional interface, and the generated data operation handle may be used to operate data in the data source, so as to implement data acquisition.
Further, on the basis of the above embodiment of the invention, the method further includes: and acquiring plug-in expansion information, and managing the preset data plug-in according to the plug-in expansion information.
The plug-in extension information may be information for managing the plug-in, and specifically may be installation information, uninstallation information, query information, and the like of the plug-in.
Specifically, plug-in expansion information input by a user can be received, and management such as installation, uninstallation, query and the like can be performed on the preset data plug-in according to the plug-in expansion information.
Further, on the basis of the above embodiment of the invention, the method further includes: and acquiring data source management information, and managing configuration information according to the data source management information.
In the embodiment of the present invention, the data source management information may be information for managing configuration information of a data source, and may include data source addition information, data source deletion information, data source update information, data source query information, and the like, and the configuration information of each data source may be managed according to the data source management information input by a user, so that addition, deletion, update, query, and the like of the configuration information of the data source may be implemented, and further, in the management process of the configuration information of the data source, information generated by management operations such as addition, deletion, update, query, and the like may be displayed on a visual interface, so as to improve the use experience of user configuration information management.
Fig. 3 is an exemplary diagram of a data processing method according to a second embodiment of the present invention, taking a data processing framework for implementing the method as an example, referring to fig. 3, the framework may include: the system comprises a data source management module, a data source basic module, a data cache module, a data unified operation module, an extended plug-in management module and data source connection management. And the upper layer application realizes the access to the data source data by using a data unified operation module interface in the framework. The data storage structure of each data source is abstracted into a data source connection, a data mode (schema) and a three-layer structure of a data table in the data processing framework, for example, the data source can be a folder, the data source connection can be a path of the folder, the data mode can be a file in the folder, and the data table can be data in the file. Data operations and data accesses in the data processing framework may operate based on these three layers of structures.
And the data source management module is used for managing configuration information of the data source, performing operations such as addition, deletion, modification and check on the data source and the like, and is responsible for managing the data source, including data source persistence and data source information processing. The data source management module can comprise functional interfaces for creating data sources, deleting data sources and inquiring data sources.
The data source basic module comprises all data extension plug-ins, the data source basic module provides a functional interface for realizing data operation of a data source, and the data source basic module can also manage the data extension plug-ins.
The data caching module is used for caching data acquired from the bottom layer, the operating efficiency of a service system can be improved due to the existence of the cached data, the support for the lazy loading data source can be realized, a lazy loading frame can be provided, a developer only needs to pay attention to the acquisition of the data when secondary development is carried out, and the developer does not need to pay attention to the acquisition and caching of the bottom layer data.
And the data unified operation module is used for providing a unified data operation handle after the connection of the data source is completed, and is used for realizing operations such as addition, deletion, modification, check and the like on the data mode and the data table.
And the user can uniformly manage the adapted data source plug-ins according to the extension plug-in management module and provide the loading and unloading functions of the plug-ins.
The data source connection management module can manage the connection corresponding to the opened data source, all the data sources need to be acquired from the data source management module before accessing data, and then the connection is instantiated through the data source connection management module to generate a connection object. The generation of data operation handles in the data unified operation module is realized, and the data operation is convenient. The data source connection management module can generate a plurality of connections for one data source according to the needs of a user so as to adapt to different business needs. The data source connection management module can also perform unified management on the generated connection, and provide operations such as opening and closing of the connection.
EXAMPLE III
Fig. 4 is a schematic structural diagram of a data processing apparatus according to a third embodiment of the present invention, which is capable of executing a data processing method according to any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. The device can be implemented by software and/or hardware, and specifically comprises: a data source configuration module 301 and a data reading module 302.
The data source configuration module 301 is configured to obtain and store configuration information of a data source, where the configuration information includes data source connection information, data mode information, and data table information.
A data reading module 302, configured to obtain data of the data source according to the configuration information and a preset data plugin, where the preset data plugin corresponds to a data source type of the data source.
According to the embodiment of the invention, the configuration information of the data source is read and stored through the data source configuration module, the data reading module acquires the preset data plug-in corresponding to the type of the data source, the preset data plug-in is called according to the configuration information to read the data of the data source, the high-efficiency management of the data source is realized, the applicability of the data source is enhanced based on the preset data plug-in, the problem that the data source is difficult to acquire by upper-layer application due to the inconsistency of the types of the data source is solved, and the data acquisition efficiency can be improved.
Further, on the basis of the above embodiment of the present invention, the data reading module 302 includes:
and the interface acquisition unit is used for acquiring the functional interface in the preset data plug-in according to the data source type of the data source.
And the interface calling unit is used for calling the functional interface according to the configuration information so as to read the data corresponding to the configuration information in the data source.
Further, on the basis of the above embodiment of the present invention, the interface calling unit is specifically configured to:
generating a connection object according to the data source connection information; acquiring a data operation handle of the connection object at the functional interface; and reading the data in the data source according to the data operation handle.
Further, on the basis of the above embodiment of the invention, the functional interface in the apparatus includes: the data updating system comprises a data adding interface, a data deleting interface, a data updating interface and a data searching interface.
Further, on the basis of the above embodiment of the invention, the apparatus further includes:
and the plug-in management module is used for acquiring plug-in expansion information and managing the preset data plug-in according to the plug-in expansion information.
Further, on the basis of the above embodiment of the invention, the apparatus further includes:
and the data caching module is used for storing the data to the memory according to the data caching logic corresponding to the data source.
Further, on the basis of the above embodiment of the invention, the apparatus further includes:
and the data source management module is used for acquiring data source management information and managing the configuration information according to the data source management information.
Example four
Fig. 5 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention, and fig. 5 shows a block diagram of a computer device 312 suitable for implementing an embodiment of the present invention. The computer device 312 shown in FIG. 5 is only an example and should not bring any limitations to the functionality or scope of use of embodiments of the present invention. Device 312 is a typical computing device for data processing across data sources.
As shown in FIG. 5, computer device 312 is in the form of a general purpose computing device. The components of computer device 312 may include, but are not limited to: one or more processors 316, a storage device 328, and a bus 318 that couples the various system components including the storage device 328 and the processors 316.
Bus 318 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.
Computer device 312 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 312 and includes both volatile and nonvolatile media, removable and non-removable media.
Storage 328 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 330 and/or cache Memory 332. The computer device 312 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 334 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 5 and commonly referred to as a "hard drive"). Although not shown in FIG. 5, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk-Read Only Memory (CD-ROM), a Digital Video disk (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 318 by one or more data media interfaces. Storage 328 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
Program 336 having a set (at least one) of program modules 326 may be stored, for example, in storage 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which may comprise an implementation of a network environment, or some combination thereof. Program modules 326 generally carry out the functions and/or methodologies of embodiments of the present invention as described herein.
The computer device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), with one or more devices that enable a user to interact with the computer device 312, and/or with any devices (e.g., network card, modem, etc.) that enable the computer device 312 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 322. Also, computer device 312 may communicate with one or more networks (e.g., a Local Area Network (LAN), Wide Area Network (WAN), etc.) and/or a public Network, such as the internet, via Network adapter 320. As shown, network adapter 320 communicates with the other modules of computer device 312 via bus 318. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the computer device 312, including but not limited to: microcode, device drivers, Redundant processing units, external disk drive Arrays, disk array (RAID) systems, tape drives, and data backup storage systems, to name a few.
The processor 316 executes various functional applications and data processing by executing programs stored in the storage 328, for example, to implement the data processing methods provided by the above-described embodiments of the present invention.
EXAMPLE five
An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processing apparatus, implements a plug-in processing method as in the embodiment of the present invention. The computer readable medium of the present invention described above may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring and storing configuration information of a data source, wherein the configuration information comprises data source connection information, data mode information and data table information; and acquiring the data of the data source according to the configuration information and a preset data plug-in, wherein the preset data plug-in corresponds to the data source type of the data source.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
It is to be noted that the foregoing description is only exemplary of the invention and that the principles of the technology may be employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in some detail by the above embodiments, the invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the invention, and the scope of the invention is determined by the scope of the appended claims.

Claims (10)

1. A method of data processing, the method comprising:
acquiring and storing configuration information of a data source, wherein the configuration information comprises data source connection information, data mode information and data table information;
and acquiring the data of the data source according to the configuration information and a preset data plug-in, wherein the preset data plug-in corresponds to the data source type of the data source.
2. The method according to claim 1, wherein the obtaining the data of the data source according to the configuration information and a preset data plug-in comprises:
acquiring a function interface in the preset data plug-in according to the data source type of the data source;
and calling the functional interface according to the configuration information to read the data corresponding to the configuration information in the data source.
3. The method according to claim 2, wherein said invoking the functional interface according to the configuration information to read data corresponding to the configuration information in the data source comprises:
generating a connection object according to the data source connection information;
acquiring a data operation handle of the connection object at the functional interface;
and reading the data in the data source according to the data operation handle.
4. The method of claim 2, wherein the functional interface comprises: the data updating system comprises a data adding interface, a data deleting interface, a data updating interface and a data searching interface.
5. The method of claim 1, further comprising:
and acquiring plug-in expansion information, and managing the preset data plug-in according to the plug-in expansion information.
6. The method of claim 1, further comprising:
and storing the data to a memory according to the data caching logic corresponding to the data source.
7. The method of claim 1, further comprising:
and acquiring data source management information, and managing the configuration information according to the data source management information.
8. A data processing apparatus, characterized in that the apparatus comprises:
the data source configuration module is used for acquiring and storing configuration information of a data source, wherein the configuration information comprises data source connection information, data mode information and data table information;
and the data reading module is used for acquiring the data of the data source according to the configuration information and a preset data plug-in, wherein the preset data plug-in corresponds to the data source type of the data source.
9. A computer device, characterized in that the computer device comprises:
one or more processors;
a memory for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the data processing method of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data processing method of any one of claims 1 to 7.
CN202111392174.3A 2021-11-23 2021-11-23 Data processing method, data processing device, computer equipment and storage medium Pending CN114090124A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111392174.3A CN114090124A (en) 2021-11-23 2021-11-23 Data processing method, data processing device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111392174.3A CN114090124A (en) 2021-11-23 2021-11-23 Data processing method, data processing device, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114090124A true CN114090124A (en) 2022-02-25

Family

ID=80303084

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111392174.3A Pending CN114090124A (en) 2021-11-23 2021-11-23 Data processing method, data processing device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114090124A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116401218A (en) * 2023-06-08 2023-07-07 天津金城银行股份有限公司 File export method and terminal equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116401218A (en) * 2023-06-08 2023-07-07 天津金城银行股份有限公司 File export method and terminal equipment
CN116401218B (en) * 2023-06-08 2023-09-19 天津金城银行股份有限公司 File export method and terminal equipment

Similar Documents

Publication Publication Date Title
CN110019080B (en) Data access method and device
CN111522927B (en) Entity query method and device based on knowledge graph
CN110764748B (en) Code calling method, device, terminal and storage medium
CN111949693B (en) Data processing device, data processing method, storage medium and electronic equipment
CN112965761B (en) Data processing method, system, electronic equipment and storage medium
CN115757400A (en) Data table processing method and device, electronic equipment and computer readable medium
CN114090124A (en) Data processing method, data processing device, computer equipment and storage medium
CN114281803A (en) Data migration method, device, equipment, medium and program product
CN110109983B (en) Method and device for operating Redis database
CN113886485A (en) Data processing method, device, electronic equipment, system and storage medium
CN111124541A (en) Configuration file generation method, device, equipment and medium
CN115344688A (en) Business data display method and device, electronic equipment and computer readable medium
CN111367500A (en) Data processing method and device
CN114356962A (en) Data query method and device, electronic equipment and storage medium
CN114253922A (en) Resource directory management method, resource management method, device, equipment and medium
CN113468342A (en) Data model construction method, device, equipment and medium based on knowledge graph
CN113419740A (en) Program data stream analysis method and device, electronic device and readable storage medium
CN112230986A (en) Project file generation method and device, electronic equipment and computer readable medium
CN113742321A (en) Data updating method and device
CN111881216A (en) Data acquisition method and device based on shared template
CN110825802A (en) Multi-type database data backup method, device, equipment and storage medium
CN112445820A (en) Data conversion method and device
CN110674224A (en) Entity data processing method, device, equipment and computer readable storage medium
CN115563183B (en) Query method, query device and program product
CN115422131B (en) Business audit knowledge base retrieval method, device, equipment and computer readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination