CN112580307A - Multi-data source access method, device, system and readable storage medium - Google Patents
Multi-data source access method, device, system and readable storage medium Download PDFInfo
- Publication number
- CN112580307A CN112580307A CN202011466524.1A CN202011466524A CN112580307A CN 112580307 A CN112580307 A CN 112580307A CN 202011466524 A CN202011466524 A CN 202011466524A CN 112580307 A CN112580307 A CN 112580307A
- Authority
- CN
- China
- Prior art keywords
- data source
- access
- target
- information
- target data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000007613 environmental effect Effects 0.000 claims abstract description 18
- 230000008520 organization Effects 0.000 claims description 108
- 238000012795 verification Methods 0.000 claims description 56
- 238000004891 communication Methods 0.000 claims description 49
- 238000013507 mapping Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 10
- 230000008859 change Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 6
- 238000007405 data analysis Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012423 maintenance Methods 0.000 description 3
- 230000004075 alteration Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/602—Providing cryptographic facilities or services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Strategic Management (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Entrepreneurship & Innovation (AREA)
- Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Bioethics (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Storage Device Security (AREA)
Abstract
The embodiment of the invention provides a multi-data-source access method, a device, a system and a readable storage medium. The multiple data source access method comprises the following steps: acquiring setting information of a target data source; setting the environmental parameters of the target data source according to the setting information of the target data source; sending an access request to a target access system corresponding to the target data source according to the environmental parameters of the target data source, so that the target access system can access according to the access request; and receiving an access result set sent by the target access system. The method comprises the steps that according to setting information of a target data source, environment parameters of the target data source are set, so that a target access system capable of accessing data in the target data source is determined according to the environment parameters of the target data source, an access request is sent to the target access system corresponding to the target data source, the target access system can access the corresponding target data source according to the access request, and data access from different ERP systems across systems and data sources is achieved.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a multi-data-source data fetching method, a multi-data-source data fetching device, a multi-data-source data fetching system and a readable storage medium.
Background
The group report forms are used as important components of enterprise management, and are taken based on various business systems to a great extent, such as general ledgers, assets, cash flow and the like. In the related art, in the same ERP system, a plurality of products realize data acquisition. However, most of the products in the existing ERP system are accessed based on the same data source, and if the products are upgraded to a new version or upgraded to a new product, multiple systems and multiple data sources coexist. In the process of enterprise development, the data of the original data source is acquired in the new system, and the important role is played in enterprise decision and data analysis.
However, due to changes of organizations and changes of data sources accessed by business systems of various versions, cross-version and cross-data-source access is difficult, and access requests of different data sources need to be processed in the same transaction, so that the difficulty is higher.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art or the related art.
To this end, a first aspect of an embodiment of the present invention is to provide a multiple data source fetching method.
A second aspect of the embodiments of the present invention is to provide a multiple data source fetching apparatus.
A third aspect of the embodiments of the present invention is to provide a multiple data source data fetching system.
A fourth aspect of embodiments of the present invention is to provide a readable storage medium.
In view of the above, according to a first aspect of the embodiments of the present invention, a multiple data source access method is provided, including: acquiring setting information of a target data source; setting the environmental parameters of the target data source according to the setting information of the target data source; sending an access request to a target access system corresponding to the target data source according to the environmental parameters of the target data source, so that the target access system can access according to the access request; and receiving an access result set sent by the target access system.
According to the multi-data-source access method provided by the embodiment of the invention, the setting information of the user-defined data source to be accessed is obtained by obtaining the setting information of the target data source, so that the access is performed on the user-defined data source to be accessed, the access to the multi-data source is further realized, the access mode is more flexible, and the flexibility of calculating the access is improved. Furthermore, the environmental parameters of the target data source are set according to the setting information of the target data source, so that a target access system capable of accessing data in the target data source is determined according to the environmental parameters of the target data source, and an access request is sent to the target access system corresponding to the target data source, so that the target access system can access data in the corresponding target data source according to the access request, and then access to data sources of different ERP systems across systems and data sources is achieved, namely access to multiple data sources of a multiple ERP system is achieved, the problem of access to multiple versions and data sources across versions when organizational structures change and/or data sources of various versions of service systems change is thoroughly solved, and the access requests of different data sources are processed in the same report transaction.
In the technical scheme, the target data source is a data source which is prepared for fetching by the current report organization. The target data source corresponding to the target data source is a data fetching system capable of fetching data at the target data source. In one embodiment, the fetching system is an ERP system.
Specifically, for a group report system with multiple ERP systems and multiple data sources, a user-defined data source to be accessed is obtained, and then the access system corresponding to the user-defined data source to be accessed is obtained, and an access request is sent to the access system, so that the access mode is more flexible, the flexibility of access calculation is improved, the access capability of the group report system is stronger, the bottleneck of access of multiple sets of ERP systems among different organizations is broken through, a more effective and more convenient mode is provided for subsequent data collection and data analysis, the cost of subsequent data maintenance is reduced, and data sharing is realized.
In addition, according to the multiple data source access method in the above technical solution provided by the present invention, the following additional technical features may also be provided:
in the above technical solution, before the step of obtaining report organization information of the current system, the method further includes: setting mapping relation information between a current report organization and a target data source; according to the mapping relation information, sending a verification request to a target access system corresponding to the target data source so as to enable the target access system to carry out information verification; receiving a verification result sent by a target access system; and storing the setting information of the target data source based on the verification result of the verification passing.
In the technical scheme, before the step of obtaining report organization information of the current system, the multiple data source access method further comprises the step of storing setting information of the target data source. The setting information of the target data source is stored to realize self-defining the setting information of the data source to be accessed, thereby realizing the access of data sources across, thoroughly solving the access problem of data sources across versions and versions when the organization change and/or the data source change of the access of each version service system occurs, and realizing the access requests of different data sources in the same report transaction. Further, before the setting of the target data source is stored, the target data source and the current report organization are subjected to information verification through the target data acquisition system, so that the current report organization can acquire the data of the target data source. Specifically, when information verification is performed, mapping relationship information between a current report organization and a target data source is set, access address information of a target access system corresponding to the target data source is obtained according to the mapping relationship information, a verification request is sent to the target access system, and the target access system performs information verification on the target data source and the current report organization. And after the target access system finishes information verification, returning a verification result to the current system, and after the current system receives the verification result, storing the setting information of the target data source under the condition that the verification result is that the verification is passed, so that the user-defined data source to be accessed is realized, and the user-defined data source to be accessed is ensured to be the data source which can be accessed by the current system.
In any of the above technical solutions, the step of storing the setting information of the target data source specifically includes: encrypting the setting information of the target data source; storing the setting information of the target data source subjected to the encryption processing.
In the technical scheme, when the setting information of the target data source is stored, the setting information of the target data source is encrypted and then stored, so that the data security in the data transmission process and the security in network transmission during data fetching are ensured.
In any of the above technical solutions, the step of performing information verification by the target access system specifically includes: verifying the validity of the target data source; and verifying the access right of the current report organization.
In the technical scheme, the step of information verification by the target access system comprises verifying the validity of the target data source and verifying the access right of the current report organization. By verifying the validity of the target data source, the user-defined data source to be acquired can be ensured to be the valid data source, so that the data can be acquired by the current report organization. By verifying the access authority of the current report organization, the safety of data can be ensured, and the data source in the data source is prevented from being acquired by the access organization without the access authority. Furthermore, the information verification is carried out through the target access system, and the fact that the current report is organized in the self-defined data source to be accessed to be configured without errors can be confirmed, so that the accuracy and the efficiency of access are improved.
In any of the above technical solutions, before the step of sending the verification request to the target access system corresponding to the target data source, the method further includes: and verifying the validity of the access address information of the target access system based on that the current report organization and the target data source belong to different systems.
In the technical scheme, when the current report organization and the target data source belong to different business systems, that is, the access system corresponding to the current report organization is different from the access system corresponding to the target data source, at this time, data communication needs to be performed between the two different systems. Whether the configuration of the access system is accurate or not can be determined by verifying the validity of the access address information of the target access system, and the access address information of the target access system is reconfigured under the condition of wrong configuration, so that the subsequent information verification is ensured to be carried out smoothly, and the information verification efficiency is improved.
In any of the above technical solutions, the access request includes one or more of target data source information, current report organization information, user information corresponding to the current report organization, access formula information, and access parameter value information.
According to the technical scheme, the access request comprises one or more of target data source information, current report organization information, user information corresponding to current report organization, access formula information and access parameter value information, so that the target access system accesses the corresponding target data source according to the target data source information, the current report organization information and the user information corresponding to the current report organization, and returns an access result set to the current system corresponding to the current report organization needing to be accessed, thereby realizing the access across systems and data sources, and centralizing the acquired data in the current system so as to process the data of the report organization corresponding to the current system.
In any of the above technical solutions, the access request carries an access rule, so that the target access system can access the data according to the access rule.
According to the technical scheme, the access rule is set and sent to the target access system, so that the target access system can access according to the access rule, targeted access is achieved, and data acquired by the target access system can meet the calculation requirement of the current report organization corresponding to the current system. Specifically, when the access rule is set, the access rule can be set according to the current report organization information, so that the acquired data can meet the requirements of the current report organization for data processing.
According to a second aspect of the embodiments of the present invention, the present invention provides a multiple data source fetching apparatus, including: the data source setting module is used for setting a target data source to be acquired by the current system; the data source communication module is used for establishing communication connection between the current system and a target data acquisition system corresponding to a target data source; and the report form access module is used for accessing the target data source through the target access system and sending the access result set through the data source communication module.
The multi-data-source data acquisition device provided by the embodiment of the invention comprises a data source setting module, a data source communication module and a report data acquisition module. The target data source to be accessed of the current system is set through the data source setting module, the setting information of the user-defined data source to be accessed is obtained, namely, the setting information of the target data source is obtained, so that the environmental parameters of the target data source are set according to the setting information of the target data source, the user-defined data source to be accessed is accessed, the access to multiple data sources is further achieved, the access mode is more flexible, and the flexibility of the access calculation is improved. Further, the data source communication module is used for establishing communication connection between the current system and a target access system corresponding to the target data source, sending access requests to different systems through the data source communication module, receiving an access result set returned by the target access system after the target access system finishes access, and then returning the access result set to the current system. Furthermore, the report access module is used for accessing the target data source through the target access system and sending the access result set through the data source communication module. The data source setting module is used for setting the setting information of the target data source, and setting the environmental parameters of the target data source according to the setting information of the target data source, so that a target access system capable of accessing data in the target data source is determined according to the environmental parameters of the target data source, the report access module is enabled to send an access request to the target access system corresponding to the target data source through the data source communication module, access is carried out in the target access system to the corresponding target data source according to the access request, after the access is completed, an access result set is returned to the current system through the data source communication module, and then access to data sources of different ERP systems from different systems and from different data sources is achieved, namely, the access to multiple data sources of multiple systems is achieved, and the problem that when organizational structure change and/or data source change of each version of service system access occur is thoroughly solved, and the data fetching problem of the cross-version and the cross-data source is realized, so that the data fetching requests of different data sources are processed in the same report transaction.
According to a third aspect of the embodiments of the present invention, the present invention provides a multiple data source fetching system, including: a memory storing programs or instructions; and the processor executes the program or the instructions to realize the steps of the multiple data source access method in any technical scheme of the first aspect.
The embodiment of the invention provides a multi-data-source data fetching system which comprises a memory and a processor. The processor can implement the steps of the multiple data source access method in any one of the first aspect when executing the program or the instruction, so that all the beneficial technical effects of the multiple data source access method provided in any one of the first aspect are achieved, and no further description is given here.
According to a fourth aspect of the embodiments of the present invention, there is provided a readable storage medium, on which a program or instructions are stored, and the program or instructions, when executed by a processor, implement the steps of the multiple data source access method according to any one of the aspects of the first aspect.
The readable storage medium provided in the embodiment of the present invention can implement the steps of the multiple data source access method provided in any technical solution of the first aspect, and therefore, all the beneficial technical effects of the multiple data source access method provided in any technical solution of the first aspect are achieved, and details are not described here.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow diagram of a multiple data source fetching method according to one embodiment of the invention;
FIG. 2 illustrates a flow diagram of a multiple data source fetching method of yet another embodiment of the present invention;
FIG. 3 illustrates a flow diagram of a multiple data source fetching method of yet another embodiment of the present invention;
FIG. 4 is an architecture diagram of a multiple data source fetching device according to one embodiment of the present invention;
FIG. 5 is a schematic diagram of a multiple data source fetching system according to one embodiment of the present invention;
FIG. 6 is a business flow diagram of a data source setup module of one embodiment of the invention;
FIG. 7 illustrates a business flow diagram of a data source communication module of one embodiment of the invention;
FIG. 8 is a business process diagram of a report fetching module according to an embodiment of the invention;
fig. 9 is a schematic diagram illustrating the operation of a multiple data source fetching device according to an embodiment of the present invention.
Wherein, the corresponding relation between the reference signs and the component names is as follows:
the system comprises a 400-multiple-data-source data acquisition device, a 402-multiple-data-source setting module, a 404-multiple-data-source communication module, a 406-report data acquisition module, a 500-multiple-data-source data acquisition system, a 502 memory and a 504 processor.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
A multiple data source fetching method, a multiple data source fetching apparatus, a multiple data source fetching system, and a readable storage medium provided according to some embodiments of the present invention are described below with reference to fig. 1 to 9.
Example one
As shown in fig. 1, an embodiment provides a multiple data source access method, including:
102, acquiring setting information of a target data source;
104, setting the environmental parameters of the target data source according to the setting information of the target data source;
and step 108, receiving an access result set sent by the target access system.
According to the multi-data-source access method provided by the embodiment of the invention, the setting information of the user-defined data source to be accessed is obtained by obtaining the setting information of the target data source, so that the access is performed on the user-defined data source to be accessed, the access to the multi-data source is further realized, the access mode is more flexible, and the flexibility of calculating the access is improved. Furthermore, the environmental parameters of the target data source are set according to the setting information of the target data source, so that a target access system capable of accessing data in the target data source is determined according to the environmental parameters of the target data source, and an access request is sent to the target access system corresponding to the target data source, so that the target access system can access data in the corresponding target data source according to the access request, and then access to data sources of different ERP systems across systems and data sources is achieved, namely access to multiple data sources of a multiple ERP system is achieved, the problem of access to multiple versions and data sources across versions when organizational structures change and/or data sources of various versions of service systems change is thoroughly solved, and the access requests of different data sources are processed in the same report transaction.
In this embodiment, the target data source is the data source that the current report organization wants to access. The target data source corresponding to the target data source is a data fetching system capable of fetching data at the target data source. In one embodiment, the fetching system is an ERP system.
In an implementation mode, aiming at a group report system with multiple ERP systems and multiple data sources, a user-defined data source to be acquired is obtained, a corresponding target acquisition system is determined according to the user-defined data source to be acquired, and an acquisition request is sent to the target acquisition system, so that the acquisition mode is more flexible, the flexibility of the acquisition calculation is improved, the acquisition capability of the group report system is stronger, the bottleneck of acquisition of multiple sets of ERP systems among different organizations is broken through, a more effective and more convenient mode is provided for subsequent data summarization and data analysis, the cost of subsequent data maintenance is reduced, and data sharing is realized.
In another embodiment, the access request includes one or more of access organization information corresponding to the current report organization, target data source information, current report organization information, access user information corresponding to the current report organization, access formula information, and access parameter value information. The data acquisition request comprises one or more of target data source information, current report organization information, user information corresponding to the current report organization, data acquisition formula information and data acquisition parameter value information, so that the target data acquisition system can acquire the data from the corresponding target data source according to the target data source information, the current report organization information and the user information corresponding to the current report organization, and returns the acquisition result set to the current system corresponding to the current report organization needing to be acquired, thereby realizing the data acquisition across systems and data sources, and centralizing the acquired data into the current system so as to perform data processing on the report organization corresponding to the current system.
In another embodiment, the access request carries an access rule, so that the target access system can access the data according to the access rule. By setting the access rule and sending the access rule to the target access system, the target access system can access according to the access rule, so that targeted access is realized, and data acquired by the target access system can meet the calculation requirement of the current report organization corresponding to the current system. Specifically, when the access rule is set, the access rule can be set according to the current report organization information, so that the acquired data can meet the requirements of the current report organization for data processing.
Example two
As shown in fig. 2, on the basis of the first embodiment, the second embodiment provides a multiple data source access method, further defining that before the step of obtaining report organization information of the current system, the multiple data source access method further includes:
In this embodiment, before the step of obtaining report organization information of the current system, the multiple data source fetching method further includes storing setting information of the target data source. The setting information of the target data source is stored to realize self-defining the setting information of the data source to be accessed, thereby realizing the access of data sources across, thoroughly solving the access problem of data sources across versions and versions when the organization change and/or the data source change of the access of each version service system occurs, and realizing the access requests of different data sources in the same report transaction. Further, before the setting of the target data source is stored, the target data source and the current report organization are subjected to information verification through the target data acquisition system, so that the current report organization can acquire the data of the target data source. Specifically, when information verification is performed, mapping relationship information between a current report organization and a target data source is set, access address information of a target access system corresponding to the target data source is obtained according to the mapping relationship information, a verification request is sent to the target access system, and the target access system performs information verification on the target data source and the current report organization. And after the target access system finishes information verification, returning a verification result to the current system, and after the current system receives the verification result, storing the setting information of the target data source under the condition that the verification result is that the verification is passed, so that the user-defined data source to be accessed is realized, and the user-defined data source to be accessed is ensured to be the data source which can be accessed by the current system.
In one embodiment, when the data source to be accessed is pre-defined before accessing, the method may include one or more of creating access data source information, modifying access data source information, and importing access data source information.
In another embodiment, when setting information of a target data source, report organizations are taken as units, and each report organization can map different target data sources, so that cross-system access among multiple organizations and multiple clusters is completed. Aiming at report organizations under the same root node, when the same target data source needs to be set, for convenience of setting, the target data source for exporting the report organizations can be used, batch editing is carried out, and then setting information of the target data source is imported into other systems corresponding to the report organizations using the same target data source in batch.
EXAMPLE III
As shown in fig. 3, on the basis of any of the above embodiments, a third embodiment defines a step of storing setting information of a target data source, and specifically includes:
and step 304, storing the setting information of the target data source subjected to the encryption processing.
In this embodiment, when the setting information of the target data source is stored, the setting information of the target data source is encrypted and then stored, so that data security in a data transmission process and security in network transmission during data fetching are ensured.
In one embodiment, when the setting information of the target data source is stored, the current report organization information is stored at the same time, and the current report organization information and the setting information of the target data source are only symmetrically encrypted, so that the security of the data information is further improved. The current report organization information comprises one or more of codes of the current report organization, user names of the current report organization and password information of the current report organization.
Example four
On the basis of any one of the above embodiments, a fourth embodiment defines a step of performing information verification by the target access system, and specifically includes: verifying the validity of the target data source; and verifying the access right of the current report organization.
In this embodiment, the step of the target access system performing information verification includes verifying the validity of the target data source and verifying the access right of the current report organization. By verifying the validity of the target data source, the user-defined data source to be acquired can be ensured to be the valid data source, so that the data can be acquired by the current report organization. By verifying the access authority of the current report organization, the safety of data can be ensured, and the data source in the data source is prevented from being acquired by the access organization without the access authority. Furthermore, the information verification is carried out through the target access system, and the fact that the current report is organized in the self-defined data source to be accessed to be configured without errors can be confirmed, so that the accuracy and the efficiency of access are improved.
In one embodiment, the authentication request carries information to be authenticated, and the information to be authenticated includes: and one or more of access address information of the target access system, a target data source name, a target data source user name, a target data source password, current report organization information and business system user information corresponding to the current report organization.
In yet another embodiment, verifying the access rights of the current report organization comprises: and verifying whether the current report organization exists or not and verifying whether the business system user corresponding to the current report organization is legal or not.
In another embodiment, the verification includes one or more of the target data source is valid, the current report organization exists, and the business system user corresponding to the current report organization has access right.
Further, before the step of sending the verification request to the target access system corresponding to the target data source, the method further includes: and verifying the validity of the access address information of the target access system based on that the current report organization and the target data source belong to different systems.
In this embodiment, when the current report organization and the target data source belong to different business systems, that is, the access system corresponding to the current report organization is different from the access system corresponding to the target data source, at this time, data communication needs to be performed between the two different systems. Whether the configuration of the access system is accurate or not can be determined by verifying the validity of the access address information of the target access system, and the access address information of the target access system is reconfigured under the condition of wrong configuration, so that the subsequent information verification is ensured to be carried out smoothly, and the information verification efficiency is improved.
EXAMPLE five
As shown in fig. 4 and fig. 9, a fifth embodiment provides a multiple data source fetching device 400, including: a data source setting module 402, configured to set a target data source to be accessed by a current system; a data source communication module 404, configured to establish a communication connection between the current system and a target access system corresponding to a target data source; and the report access module 406 is configured to access the target data source through the target access system, and send the access result set through the data source communication module 404.
The multiple data source access device 400 provided by the embodiment of the present invention includes a data source setting module 402, a data source communication module 404, and a report access module 406. The target data source to be accessed of the current system is set through the data source setting module 402, the setting information of the user-defined data source to be accessed is obtained, that is, the setting information of the target data source is obtained, so that the environmental parameters of the target data source are set according to the setting information of the target data source, the user-defined data source to be accessed is accessed, the data access to multiple data sources is further realized, the access mode is more flexible, and the flexibility of the access calculation is improved. Further, the data source communication module 404 is configured to establish a communication connection between the current system and a target access system corresponding to the target data source, send an access request to different systems through the data source communication module 404, receive an access result set returned by the target access system after the target access system completes access, and then return the access result set to the current system. Further, the report access module 406 is configured to access the target data source through the target access system, and send the access result set through the data source communication module 404. The data source setting module 402 is used for setting the setting information of the target data source, and setting the environmental parameters of the target data source according to the setting information of the target data source, so as to determine a target access system capable of accessing data in the target data source according to the environmental parameters of the target data source, so that the report access module 406 sends an access request to the target access system corresponding to the target data source through the data source communication module, accesses the corresponding target data source according to the access request in the target access system, returns an access result set to the current system through the data source communication module 404 after the access is completed, and further realizes the access to the data sources of different ERP systems across systems and data sources, namely, realizes the access to multiple ERP systems and multiple data sources, and thoroughly solves the problem that organizational structure change and/or data source change of each version of service system access occur, and the data fetching problem of the cross-version and the cross-data source is realized, so that the data fetching requests of different data sources are processed in the same report transaction.
In this embodiment, the target data source is the data source that the current report organization wants to access. The target data source corresponding to the target data source is a data fetching system capable of fetching data at the target data source. In one embodiment, the fetching system is an ERP system.
In another embodiment, for a group report system with multiple ERP systems and multiple data sources, a data source setting module 402 is used to self-define a data source to be accessed, determine a corresponding target access system according to the self-defined data source to be accessed, and send an access request to the target access system, so that the access method is more flexible, the flexibility of access calculation is improved, the access capability of the group report system is stronger, the bottleneck of access of multiple sets of ERP systems among different organizations is broken through, a more effective and more convenient method is provided for subsequent data summarization and data analysis, the cost of subsequent data maintenance is reduced, and data sharing is realized.
In another embodiment, the access request includes target data source information, current report organization information, user information corresponding to the current report organization, and one or more of access formula information and access parameter value information. The data acquisition request comprises one or more of target data source information, current report organization information, user information corresponding to the current report organization, data acquisition formula information and data acquisition parameter value information, so that the target data acquisition system can acquire the data from the corresponding target data source according to the target data source information, the current report organization information and the user information corresponding to the current report organization, and returns the acquisition result set to the current system corresponding to the current report organization needing to be acquired, thereby realizing the data acquisition across systems and data sources, and centralizing the acquired data into the current system so as to perform data processing on the report organization corresponding to the current system.
In another embodiment, the access request carries an access rule, the access rule is set by the report access module 406, and the report access module 406 analyzes the access rule in the target access system, so that the target access system accesses the access rule, thereby accessing different service modules according to the access rule, and returning an access result set through the data source communication module. By setting the access rule and sending the access rule to the target access system, the target access system can access according to the access rule, so that targeted access is realized, and data acquired by the target access system can meet the calculation requirement of the current report organization corresponding to the current system. Specifically, when the access rule is set, the access rule can be set according to the current report organization information, so that the acquired data can meet the requirements of the current report organization for data processing.
In yet another embodiment, the data source setting module 402 sends a verification request to the target access system through the data source communication module 404 for information verification by the target access system. Specifically, the data source setting module 402 sets mapping relationship information between a current report organization and a target data source, acquires access address information of a target access system corresponding to the target data source according to the mapping relationship information, then sends a verification request to the target access system through the data source communication module 404, performs information verification on the target data source and the current report organization by the target access system, receives a verification result of the current access system through the data source communication module 404, and stores setting information of the target data source under the condition that the verification is passed, so that the target data source is used as a custom data source for subsequent access, thereby realizing a custom data source to be accessed, and ensuring that the custom data source to be accessed is a data source which can be accessed by the current system. The setting information of the target data source is stored to realize self-defining the setting information of the data source to be accessed, thereby realizing the access of data sources across, thoroughly solving the access problem of data sources across versions and versions when the organization change and/or the data source change of the access of each version service system occurs, and realizing the access requests of different data sources in the same report transaction. Further, before the setting of the target data source is stored, the target data source and the current report organization are subjected to information verification through the target data acquisition system, so that the current report organization can acquire the data of the target data source.
In one embodiment, when the data source to be accessed is pre-defined before accessing, the method may include one or more of creating access data source information, modifying access data source information, and importing access data source information.
In another embodiment, when setting information of a target data source, report organizations are taken as units, and each report organization can map different target data sources, so that cross-system access among multiple organizations and multiple clusters is completed. Aiming at report organizations under the same root node, when the same target data source needs to be set, for convenience of setting, the target data source for exporting the report organizations can be used, batch editing is carried out, and then setting information of the target data source is imported into other systems corresponding to the report organizations using the same target data source in batch.
In one embodiment, the current system and the target access system are different ERP systems. In another embodiment, the current system and the target access system are the same ERP system.
As shown in fig. 6, in one embodiment, the data source setting module 402 is mainly used to set a module that needs to map the fetched data source information. Specifically, the data source setting module 402 mainly has functions of creating access data source information, modifying the access data source information, querying the access data source information, verifying the access data source information, exporting the access data source information, importing the access data source information, and the like. Further, the data source setting module 402 may also delete the fetched data source information. And for the newly-built data source information, the data source setting information comprises one or more of setting access organization information, setting access user information and setting data source information. For the modified data source information, the setting information of the data source comprises one or more of modified access organization information, modified access user information and modified access data source information. For the imported data source information, the data source setting information includes creating, modifying or deleting one or more of the access organization information, the access user information and the data source information group respectively.
Further, the data source setting module 402 is further configured to perform data validity verification, that is, to verify validity of the target data source, verify access rights of the current report organization, and verify validity of access address information of the target access system when the current report organization and the target data source belong to different systems. Specifically, when information verification is performed, for cross-system access, that is, when a current report organization and a target data source belong to different business systems, access address information corresponding to the target access system needs to be configured, and whether the access address information can normally communicate needs to be verified. Furthermore, the configured target data source information and the access user information corresponding to the current report organization need to be verified, so that the data source information configuration is correct and the access user is legal.
Further, the data source setting module 402 is also used for data encryption. When the configured data source information is stored, that is, when the setting information of the target data source is stored, symmetric encryption processing is performed on the sensitive information (such as the information of the code, the user name, the password and the like of the access organization corresponding to the current report organization), so that the security in the data transmission process and the security in network transmission during the access are ensured.
In yet another embodiment, as shown in fig. 7, the data source communication module 404 is mainly used for data communication between different systems and different data sources. Specifically, any one or more of HTTP communication, webscoket communication, and database communication may be employed. Further, MQ system communication may also be implemented via a Kafuka et al system. By arranging the data source communication module 404, data communication between different middleware is facilitated, that is, communication between different data sources and different systems is facilitated, and the communication stability and the accuracy and the safety of communication data are improved. Further, when data communication is performed, a communication request is sent by a data requester, the data source communication module 404 processes data to be sent and sends the processed data to a data receiver, the data receiver receives the data and returns the processed data to the data source communication module 404, and the data source communication module 404 receives the data sent by the data receiver and returns the processed data to the data requester.
In another embodiment, as shown in fig. 8, the report fetching module 406 is mainly used to extract data to the corresponding business unit. Specifically, the report access module 406 needs to package the calculation parameters, and generate calculation work information and parameter information, where the calculation parameters include any one or more of access organization information, target data source information, current report organization information, access user information, access formula information, and access parameter value information corresponding to the current report organization. Further, the report access module 406 sends the encapsulated calculation parameter data to the target access system through the data source communication module 404, and the target access system performs operations such as data analysis, grouping, splitting and the like after acquiring the calculation parameter data, and then performs batch grouping access. Further, multiple threads may be used for fetching in the case of traffic decoupling, but it is necessary to ensure the accuracy of the fetching order. After the report access module 406 finishes accessing, the access result set is encapsulated into a set through the data source communication module 404 and then returned to the requester, that is, returned to the current system. And the access requester analyzes the access result set information, re-encapsulates the access result set information to each access unit, performs further calculation, and stores the access result set information in a warehouse.
EXAMPLE six
As shown in fig. 5, a sixth embodiment provides a multiple data source fetching system 500, including: a memory 502, the memory 502 storing programs or instructions; the processor 504, and the processor 504 executes the program or the instructions to implement the steps of the multiple data source accessing method in any of the above-mentioned technical solutions.
An embodiment of the invention provides a multiple data source access system 500 that includes a memory 502 and a processor 504. The processor 504 can implement the steps of the multiple data source access method in any of the above technical solutions when executing the program or the instructions, so that all the beneficial technical effects of the multiple data source access method provided in any of the above technical solutions are achieved, and are not described herein again.
EXAMPLE seven
The seventh embodiment provides a readable storage medium, on which a program or an instruction is stored, and the program or the instruction, when executed by a processor, implements the steps of the multiple data source fetching method in any one of the above-mentioned technical solutions.
The readable storage medium provided in the embodiment of the present invention can implement the steps of the multiple data source access method provided in any one of the above technical solutions, and therefore, all the beneficial technical effects of the multiple data source access method provided in any one of the above technical solutions are achieved, and are not described herein again.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A multiple data source access method, comprising:
acquiring setting information of a target data source;
setting the environmental parameters of the target data source according to the setting information of the target data source;
sending an access request to a target access system corresponding to the target data source according to the environmental parameters of the target data source, so that the target access system can access according to the access request;
and receiving the access result set sent by the target access system.
2. The multiple data source access method of claim 1, further comprising, before the step of obtaining report organization information of the current system:
setting mapping relation information between a current report organization and a target data source;
sending a verification request to a target access system corresponding to the target data source according to the mapping relation information so as to enable the target access system to carry out information verification;
receiving a verification result sent by the target access system;
and storing the setting information of the target data source based on the verification result of the verification passing.
3. The multiple data source access method of claim 2, wherein the step of storing the setting information of the target data source specifically comprises:
encrypting the setting information of the target data source;
and storing the setting information of the target data source subjected to the encryption processing.
4. The multiple data source access method of claim 2, wherein the step of the target access system performing information verification specifically comprises:
verifying the validity of the target data source;
and verifying the access right of the current report organization.
5. The multiple data source access method of claim 4, further comprising, prior to the step of verifying the validity of the target data source:
and verifying the validity of the access address information of the target access system based on that the current report organization and the target data source belong to different systems.
6. The multiple data source access method of claim 2,
the access request comprises one or more of target data source information, current report organization information, user information corresponding to the current report organization, access formula information and access parameter value information.
7. The multiple data source fetching method of any one of claims 1 to 6,
the access request carries an access rule, so that the target access system can access the data according to the access rule.
8. A multiple data source access device, comprising:
the data source setting module is used for setting a target data source to be acquired by the current system;
the data source communication module is used for establishing communication connection between the current system and a target access system corresponding to the target data source;
and the report form access module is used for accessing the target data source through the target access system and sending an access result set through the data source communication module.
9. A multiple data source access system, comprising:
a memory storing programs or instructions;
a processor executing the program or instructions to implement the steps of the multiple data source fetching method of any of claims 1-7.
10. A readable storage medium having stored thereon a program or instructions which, when executed by a processor, performs the steps of the multiple data source access method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011466524.1A CN112580307A (en) | 2020-12-14 | 2020-12-14 | Multi-data source access method, device, system and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011466524.1A CN112580307A (en) | 2020-12-14 | 2020-12-14 | Multi-data source access method, device, system and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112580307A true CN112580307A (en) | 2021-03-30 |
Family
ID=75134791
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011466524.1A Pending CN112580307A (en) | 2020-12-14 | 2020-12-14 | Multi-data source access method, device, system and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112580307A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114490762A (en) * | 2022-01-20 | 2022-05-13 | 北京宇信科技集团股份有限公司 | Data source access method, device, medium and equipment for decision engine |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473342A (en) * | 2013-09-23 | 2013-12-25 | 北京久其软件股份有限公司 | Report data generating method and system |
| CN106295377A (en) * | 2016-08-24 | 2017-01-04 | 成都万联传感网络技术有限公司 | A kind of medical treatment endowment data secure exchange agent apparatus and construction method thereof |
| CN108763530A (en) * | 2018-05-31 | 2018-11-06 | 中国农业银行股份有限公司 | A kind of data access method, device and electronic equipment |
| CN109656968A (en) * | 2018-11-15 | 2019-04-19 | 中国建设银行股份有限公司 | Data query method, apparatus and storage medium under distributed environment |
| CN110032594A (en) * | 2019-03-21 | 2019-07-19 | 厦门市美亚柏科信息股份有限公司 | The data pick-up method, apparatus and storage medium of the Various database of customizable |
| CN111046082A (en) * | 2019-12-12 | 2020-04-21 | 国家电网有限公司大数据中心 | Data source determination method, device, server and storage medium |
| CN111241177A (en) * | 2019-12-31 | 2020-06-05 | 中国联合网络通信集团有限公司 | Data acquisition method, system and network equipment |
| CN111414391A (en) * | 2020-03-25 | 2020-07-14 | 平安资产管理有限责任公司 | Method and system for accessing multiple data sources |
| CN111950927A (en) * | 2020-08-24 | 2020-11-17 | 清华大学 | Acquisition and management system for multisource heterogeneous big data of intelligent factory |
| CN111984719A (en) * | 2020-08-31 | 2020-11-24 | 平安医疗健康管理股份有限公司 | Data calling method, device, equipment and storage medium based on data source |
-
2020
- 2020-12-14 CN CN202011466524.1A patent/CN112580307A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473342A (en) * | 2013-09-23 | 2013-12-25 | 北京久其软件股份有限公司 | Report data generating method and system |
| CN106295377A (en) * | 2016-08-24 | 2017-01-04 | 成都万联传感网络技术有限公司 | A kind of medical treatment endowment data secure exchange agent apparatus and construction method thereof |
| CN108763530A (en) * | 2018-05-31 | 2018-11-06 | 中国农业银行股份有限公司 | A kind of data access method, device and electronic equipment |
| CN109656968A (en) * | 2018-11-15 | 2019-04-19 | 中国建设银行股份有限公司 | Data query method, apparatus and storage medium under distributed environment |
| CN110032594A (en) * | 2019-03-21 | 2019-07-19 | 厦门市美亚柏科信息股份有限公司 | The data pick-up method, apparatus and storage medium of the Various database of customizable |
| CN111046082A (en) * | 2019-12-12 | 2020-04-21 | 国家电网有限公司大数据中心 | Data source determination method, device, server and storage medium |
| CN111241177A (en) * | 2019-12-31 | 2020-06-05 | 中国联合网络通信集团有限公司 | Data acquisition method, system and network equipment |
| CN111414391A (en) * | 2020-03-25 | 2020-07-14 | 平安资产管理有限责任公司 | Method and system for accessing multiple data sources |
| CN111950927A (en) * | 2020-08-24 | 2020-11-17 | 清华大学 | Acquisition and management system for multisource heterogeneous big data of intelligent factory |
| CN111984719A (en) * | 2020-08-31 | 2020-11-24 | 平安医疗健康管理股份有限公司 | Data calling method, device, equipment and storage medium based on data source |
Non-Patent Citations (1)
| Title |
|---|
| 郑翔宏, 朱诗生: "多数据源中文报表智能生成系统的研究", 汕头大学学报(自然科学版), no. 02, 30 May 2002 (2002-05-30), pages 70 - 75 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114490762A (en) * | 2022-01-20 | 2022-05-13 | 北京宇信科技集团股份有限公司 | Data source access method, device, medium and equipment for decision engine |
| CN114490762B (en) * | 2022-01-20 | 2022-11-22 | 北京宇信科技集团股份有限公司 | Data source access method, device, medium and equipment for decision engine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109815657B (en) | Identity authentication method and device based on alliance chain, computer readable storage medium and terminal equipment | |
| CN108734028B (en) | Data management method based on block chain, block chain link point and storage medium | |
| CN110310205B (en) | Block chain data monitoring method, device, equipment and medium | |
| US20210049715A1 (en) | Blockchain-based data procesing method, apparatus, and electronic device | |
| CN110932859B (en) | User information processing method, device and equipment and readable storage medium | |
| CN105139210A (en) | Commodity traceability method and system | |
| CN109639723A (en) | A kind of micro services access method and server based on ERP system | |
| CN104468553A (en) | Method, device and system for login of public account | |
| CN111492355B (en) | Method and control system for controlling and/or monitoring a device | |
| CN110138767B (en) | Transaction request processing method, device, equipment and storage medium | |
| CN112905437B (en) | Method, device and storage medium for testing cases | |
| CN112464212A (en) | Data authority control reconstruction method based on mature complex service system | |
| CN105099983A (en) | Authorization method, authority setting method and devices | |
| CN104767761A (en) | Cloud storage platform access control method and device | |
| CN109902493A (en) | The delivery method and server of script | |
| CN106203551B (en) | A kind of Electronic Signature processing method of goods and materials contract services document | |
| CN112580307A (en) | Multi-data source access method, device, system and readable storage medium | |
| CN112363997B (en) | Data version management method, device and storage medium | |
| CN116993523A (en) | Configurable account checking method, device, equipment and storage medium | |
| CN109446054B (en) | Processing method and terminal equipment for override operation request based on big data | |
| CN115004666A (en) | Registration method, device, equipment and storage medium of Internet of things equipment | |
| CN115205032A (en) | Credit investigation query method, apparatus, device and storage medium | |
| CN114925033A (en) | Information uplink method, device, system and storage medium | |
| CN114039844A (en) | Internet of things equipment management method, system and device | |
| CN113472781A (en) | Service acquisition method, server and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |