CN116126870A - Heterogeneous system data analysis and integration method, system, equipment and readable medium - Google Patents

Heterogeneous system data analysis and integration method, system, equipment and readable medium Download PDF

Info

Publication number
CN116126870A
CN116126870A CN202310232420.1A CN202310232420A CN116126870A CN 116126870 A CN116126870 A CN 116126870A CN 202310232420 A CN202310232420 A CN 202310232420A CN 116126870 A CN116126870 A CN 116126870A
Authority
CN
China
Prior art keywords
calling
information
log
interface information
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310232420.1A
Other languages
Chinese (zh)
Inventor
姜岩君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur General Software Co Ltd
Original Assignee
Inspur General Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur General Software Co Ltd filed Critical Inspur General Software Co Ltd
Priority to CN202310232420.1A priority Critical patent/CN116126870A/en
Publication of CN116126870A publication Critical patent/CN116126870A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Stored Programmes (AREA)

Abstract

The invention discloses a heterogeneous system data analysis and integration method, which comprises the following steps of: acquiring a calling request relation, identifying a calling party and a called party, generating a calling template, and perfecting calling information in the calling template to carry out interface information configuration; responding to successful configuration of the interface information, and checking whether the interface information of the calling party and the called party is consistent in format; in response to the interface information being in a consistent format, dynamic invocation and data parsing is performed based on the interface information. The invention also discloses a docking system, computer equipment and a readable storage medium. The invention utilizes the functional interface of the docking system to configure the corresponding relation of the data structures of the two parties, can be used for a developer to dynamically call the interface by configuring related information when carrying out heterogeneous system data transmission, and improves the development efficiency of the developer.

Description

Heterogeneous system data analysis and integration method, system, equipment and readable medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, a system, an apparatus, and a readable medium for analyzing and integrating heterogeneous system data.
Background
Nowadays, many enterprises blindly go on-line various information systems due to lack of overall planning and design in advance, although convenience is brought to business and informatization level is improved, the information systems are not organized, public data such as users, organizations and the like cannot be shared among the systems, data circulation across the systems cannot be smoothly carried out, and great difficulty is brought to information system management and business integration.
At present, when data interaction between heterogeneous systems in projects is performed, a developer needs to perform personalized customization development according to a data interface and a data structure provided by an opposite party, and a great deal of effort is spent on opening up the correspondence of the interface, format analysis, entity generation, log recording and data structure relationship, and the reusability is poor.
Disclosure of Invention
In view of the above, an object of the embodiments of the present invention is to provide a method, a system, a device and a readable medium for analyzing and integrating heterogeneous system data, which utilizes a functional interface of a docking system to configure a correspondence between two data structures.
Based on the above objects, an aspect of the embodiments of the present invention provides a heterogeneous system data parsing and integration method, including performing the following steps through a docking system:
acquiring a call request relation, identifying a calling party and a called party at a functional interface of the docking system, generating a call template, and perfecting call information in the call template to carry out interface information configuration;
responding to successful configuration of the interface information, and checking whether the interface information of the calling party and the called party is consistent in format;
in response to the interface information being in a consistent format, dynamic invocation and data parsing is performed based on the interface information.
In some embodiments, the method further comprises: the method comprises the steps of perfecting log names, log paths and generating log level information generated after data analysis, generating a problem log based on the log level information, and generating a data log list in a docking system.
In some implementations, refining call information in the call template for interface information configuration includes:
automatic communication acquires information of a calling party and a called party so as to perfect calling information in a calling template;
the information of the calling party and the called party is manually supplemented to perfect the calling information in the calling template.
In some embodiments, further comprising: and in response to successful configuration of the interface information, storing the completed call template in the docking system to perform operations of editing, deleting and configuring the timing tasks.
In some embodiments, the call information includes: calling address, calling mode, request header information and JSON format required to be analyzed.
In some embodiments, performing the interface information configuration further comprises: the transfer parameters, the data structure and the class names required to be called by reflection are perfected in the docking system, so that the transfer is carried out according to the format organization parameters, the corresponding data entity is generated, and the data is received and logically processed.
In another aspect, the present invention provides a docking system, including:
the configuration module is configured to acquire a calling request relation, identify a calling party and a called party at a functional interface of the docking system, generate a calling template, and perfect calling information in the calling template to perform interface information configuration;
the checking module is configured to respond to successful configuration of the interface information and check whether the interface information of the calling party and the called party keep the format consistent;
and the calling module is configured for responding to the consistency of the format of the interface information, and carrying out dynamic calling and data analysis based on the interface information.
In some embodiments, the docking system further comprises:
the log generation module is configured to perfect log names, log paths and log level information generated after data analysis, generate a problem log based on the log level information and generate a data log table in the docking system.
In still another aspect of the embodiment of the present invention, there is also provided a computer apparatus, including: at least one processor; and a memory storing computer instructions executable on the processor, the instructions when executed by the processor performing the steps of the method described above.
In yet another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium storing a computer program which, when executed by a processor, implements the method steps as described above.
The invention has at least the following beneficial technical effects:
the invention provides a heterogeneous system data analysis and integration method, which utilizes the functional interface of a docking system to configure the corresponding relation of the data structures of both sides, reflects class names required to be executed for calling to realize data interaction, generates a problem log according to a designated log level, and records the result into a log table with the same name of a database.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are necessary for the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention and that other embodiments may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an embodiment of a heterogeneous system data parsing and integration method provided by the present invention;
FIG. 2 is a schematic diagram of an embodiment of a docking system provided by the present invention;
FIG. 3 is a schematic diagram of an embodiment of a computer device provided by the present invention;
fig. 4 is a schematic diagram of an embodiment of a computer readable storage medium provided by the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention will be described in further detail with reference to the accompanying drawings.
It should be noted that, in the embodiments of the present invention, all the expressions "first" and "second" are used to distinguish two entities with the same name but different entities or different parameters, and it is noted that the "first" and "second" are only used for convenience of expression, and should not be construed as limiting the embodiments of the present invention, and the following embodiments are not described one by one.
Based on the above objects, in a first aspect of the embodiments of the present invention, embodiments of heterogeneous system data parsing and integration methods are provided. Fig. 1 is a schematic diagram of an embodiment of a heterogeneous system data parsing and integration method provided by the present invention. As shown in fig. 1, the heterogeneous system data parsing and integration method according to the embodiment of the present invention includes executing the following steps through a docking system:
s1, acquiring a call request relation, identifying a calling party and a called party at a functional interface of the docking system, generating a call template, and perfecting call information in the call template to perform interface information configuration;
s2, responding to successful configuration of the interface information, and checking whether the interface information of the calling party and the called party is consistent in format;
and S3, responding to the consistency of the formats of the interface information, and carrying out dynamic calling and data analysis based on the interface information.
In some embodiments, the method further comprises: the method comprises the steps of perfecting log names, log paths and generating log level information generated after data analysis, generating a problem log based on the log level information, and generating a data log table in a docking system, wherein the data log table is used for recording calling parameters, calling time and return information.
In some embodiments, the method further comprises: and in response to successful configuration of the interface information, storing the completed call template in the docking system to perform operations of editing, deleting and configuring the timing tasks. If the interface information configuration is unsuccessful, returning to the previous step to perfect the calling information again.
In some embodiments, refining call information in the call template for interface information configuration includes:
automatic communication acquires information of a calling party and a called party so as to perfect calling information in a calling template;
the information of the calling party and the called party is manually supplemented to perfect the calling information in the calling template.
Further, the call information includes: calling address, calling mode, request header information and JSON format required to be analyzed.
Further, performing interface information configuration further includes: the transfer parameters, the data structure and the class names required to be called by reflection are perfected in the docking system, so that the transfer is carried out according to the format organization parameters, the corresponding data entity is generated, and the data is received and logically processed.
The interface information needs to be further configured with field correspondence, and in some preferred embodiments, the field correspondence is as follows:
extending attributes Transmission field Receiving a field
Standard number Standard EXTVARchar1
Certificate type Certificate EXTVARchar2
Material of material Material EXTVARchar3
Surface treatment SurfaceDealwith EXTVARchar4
Further, information such as calling information, calling modes, calling class names, data table names and the like is configured on the configuration interface, special logic needing to be additionally added is perfected in the recorded class names, and the configured class can be automatically called during execution, so that data interaction and data analysis are realized.
Further, when the result of the data interaction of the heterogeneous system is queried, if the result is failure, the execution can be performed again, if the result is successful, the detailed information of the data interaction is queried further, a calling scheme table is further configured, the detailed information of each calling scheme, the information of the data table name, the key field of the data table, the calling class name and the like which are required to be stored are configured, and finally the detailed information of the database table record data integration is generated.
It should be noted that, the steps in the embodiments of the heterogeneous system data parsing and integration method may be intersected, replaced, added and deleted, so that the reasonable permutation and combination transformation is also included in the protection scope of the present invention, and the protection scope of the present invention should not be limited to the embodiments.
In view of the above, a second aspect of the embodiments of the present invention provides a docking system for performing heterogeneous system data parsing and integration methods. Fig. 2 is a schematic diagram of an embodiment of a docking system provided by the present invention. As shown in fig. 2, the docking system of the embodiment of the present invention includes the following modules:
the configuration module 011, the configuration module 011 is configured to acquire the relation of the call request, identify the calling party and the called party and generate a call template, perfect the call information in the call template to perform interface information configuration;
a checking module 012, the checking module 012 is configured to check whether the interface information of the calling party and the called party is kept in a consistent format in response to successful configuration of the interface information;
and the calling module 013 is configured for responding to the consistency of the format of the interface information, and carrying out dynamic calling and data analysis based on the interface information.
The docking system of the embodiment of the invention further comprises a log generation module, wherein the log generation module is configured to perfect a log name, a log path and generated log level information generated after data analysis, generate a problem log based on the log level information and generate a data log table in the docking system.
Based on the above object, a third aspect of the embodiments of the present invention proposes a computer device. Fig. 3 is a schematic diagram of an embodiment of a computer device provided by the present invention. As shown in fig. 3, the computer device according to the embodiment of the present invention includes the following means: at least one processor 021; and a memory 022, the memory 022 storing computer instructions 023 executable on the processor, the instructions when executed by the processor implementing the steps of the above method.
The invention also provides a computer readable storage medium. Fig. 4 is a schematic diagram of an embodiment of a computer-readable storage medium provided by the present invention. As shown in fig. 4, the computer-readable storage medium 031 stores a computer program 032 which, when executed by a processor, performs the above method.
Finally, it should be noted that, as will be appreciated by those skilled in the art, all or part of the processes in the methods of the embodiments described above may be implemented by a computer program for instructing relevant hardware, and the program for analyzing and integrating data of a heterogeneous system may be stored in a computer readable storage medium, where the program when executed may include processes in the embodiments of the methods described above. The storage medium of the program may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (RAM), or the like. The computer program embodiments described above may achieve the same or similar effects as any of the method embodiments described above.
Furthermore, the method disclosed according to the embodiment of the present invention may also be implemented as a computer program executed by a processor, which may be stored in a computer-readable storage medium. The above-described functions defined in the methods disclosed in the embodiments of the present invention are performed when the computer program is executed by a processor.
Furthermore, the above-described method steps and system units may also be implemented using a controller and a computer-readable storage medium storing a computer program for causing the controller to implement the above-described steps or unit functions.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general purpose or special purpose computer or general purpose or special purpose processor. Further, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (D0L), or wireless technology such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, D0L, or wireless technology such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that as used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The foregoing embodiment of the present invention has been disclosed with reference to the number of embodiments for the purpose of description only, and does not represent the advantages or disadvantages of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, and the program may be stored in a computer readable storage medium, where the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will appreciate that: the above discussion of any embodiment is merely exemplary and is not intended to imply that the scope of the disclosure of embodiments of the invention, including the claims, is limited to such examples; combinations of features of the above embodiments or in different embodiments are also possible within the idea of an embodiment of the invention, and many other variations of the different aspects of the embodiments of the invention as described above exist, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the embodiments should be included in the protection scope of the embodiments of the present invention.

Claims (10)

1. The heterogeneous system data analysis and integration method is characterized by comprising the following steps of:
acquiring a call request relation, identifying a calling party and a called party at a functional interface of the docking system, generating a call template, and perfecting call information in the call template to carry out interface information configuration;
responding to the successful configuration of the interface information, and checking whether the interface information of the calling party and the called party is consistent in format;
and responding to the consistency of the format of the interface information, and carrying out dynamic calling and data analysis based on the interface information.
2. The heterogeneous system data parsing and integration method according to claim 1, further comprising:
and perfecting the log name, the log path and the generated log level information generated after the data analysis, generating a problem log based on the log level information, and generating a data log table in the docking system.
3. The heterogeneous system data parsing and integration method of claim 2, wherein perfecting call information in the call template for interface information configuration comprises:
automatically communicating to acquire information of the calling party and the called party so as to perfect the calling information in the calling template;
and manually supplementing the information of the calling party and the called party to perfect the calling information in the calling template.
4. The heterogeneous system data parsing and integration method according to claim 2, further comprising:
and responding to successful configuration of the interface information, and storing the completed call template in the docking system to edit, delete and configure timing tasks.
5. The heterogeneous system data parsing and integration method of claim 2, wherein the call information includes: calling address, calling mode, request header information and JSON format required to be analyzed.
6. The heterogeneous system data parsing and integration method according to claim 2, wherein the performing interface information configuration further comprises: and perfecting the transfer parameters, the data structure and the class names required to be called by reflection in the docking system so as to transfer according to the format organization parameters, generate corresponding data entities and receive and logically process the data.
7. A docking system, comprising:
the configuration module is configured to acquire a calling request relation, identify a calling party and a called party at a functional interface of the docking system, generate a calling template, and perfect calling information in the calling template to perform interface information configuration;
the checking module is configured to respond to the successful configuration of the interface information and check whether the interface information of the calling party and the called party keep the format consistent;
and the calling module is configured for responding to the consistency of the formats of the interface information, and carrying out dynamic calling and data analysis based on the interface information.
8. The docking system of claim 7, further comprising:
the log generation module is configured to perfect log names, log paths and log level information generated after data analysis, generate a problem log based on the log level information and generate a data log table in the docking system.
9. A computer device, comprising:
at least one processor; and
a memory storing computer instructions executable on the processor, which when executed by the processor, perform the steps of the method of any one of claims 1-6.
10. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method of any one of claims 1-6.
CN202310232420.1A 2023-03-09 2023-03-09 Heterogeneous system data analysis and integration method, system, equipment and readable medium Pending CN116126870A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310232420.1A CN116126870A (en) 2023-03-09 2023-03-09 Heterogeneous system data analysis and integration method, system, equipment and readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310232420.1A CN116126870A (en) 2023-03-09 2023-03-09 Heterogeneous system data analysis and integration method, system, equipment and readable medium

Publications (1)

Publication Number Publication Date
CN116126870A true CN116126870A (en) 2023-05-16

Family

ID=86311906

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310232420.1A Pending CN116126870A (en) 2023-03-09 2023-03-09 Heterogeneous system data analysis and integration method, system, equipment and readable medium

Country Status (1)

Country Link
CN (1) CN116126870A (en)

Similar Documents

Publication Publication Date Title
CN107609156B (en) Page construction method and device
CN102770854B (en) Automatic synchronization Conflict solving
CN110659018B (en) Method and device for realizing flow engine
CA2838277A1 (en) Method, sharing platform, and system for sharing image-editing action
WO2021052502A1 (en) Configuration change method and related apparatus
CN111324480B (en) Large-scale host transaction fault positioning system and method
CN110428319B (en) Data comparison platform, method, equipment and storage medium
CN112486719B (en) Method and equipment for RPC interface call failure processing
US20060112083A1 (en) Object relation information management program, method, and apparatus
CN116204438A (en) Test case generation method, automatic test method and related device
US8250104B2 (en) Life cycle based data coordination
CN116126870A (en) Heterogeneous system data analysis and integration method, system, equipment and readable medium
CN109587202B (en) Method, device and system for coprocessing between file verification and data processing
CN114003203B (en) Maintenance method, device and equipment for activity counting variable and readable medium
CN116033002A (en) Service field configuration method, device, equipment and readable storage medium
CN110874713A (en) Service state management method and device
CN114116679A (en) Multi-database environment operation and maintenance method and system
CN112114778A (en) Cross-platform dynamic library algorithm management system supporting horizontal extension
CN111722801B (en) Label-based storage volume attribute management method, device, equipment and medium
CN114116453B (en) Method, device, equipment and readable medium for testing case association configuration information
CN117850769A (en) Method, device, equipment and medium for generating universal code
CN111522783B (en) Data synchronization method, device, electronic equipment and computer readable storage medium
CN114785847B (en) Network control software development configuration method, terminal and storage medium
CN112965952B (en) Data asset processing method and device
CN115145933A (en) Database transaction processing method, related device and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination