CN116860847A - Unified health detection method and system for multi-source heterogeneous data sources - Google Patents

Unified health detection method and system for multi-source heterogeneous data sources Download PDF

Info

Publication number
CN116860847A
CN116860847A CN202310776959.3A CN202310776959A CN116860847A CN 116860847 A CN116860847 A CN 116860847A CN 202310776959 A CN202310776959 A CN 202310776959A CN 116860847 A CN116860847 A CN 116860847A
Authority
CN
China
Prior art keywords
data source
detection
program
dscactor
dscwebactor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310776959.3A
Other languages
Chinese (zh)
Inventor
卢居辉
甘朗杰
陈子沣
朱海勇
沈代明
陈财
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiamen Meiya Pico Information Co Ltd
Original Assignee
Xiamen Meiya Pico Information Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiamen Meiya Pico Information Co Ltd filed Critical Xiamen Meiya Pico Information Co Ltd
Priority to CN202310776959.3A priority Critical patent/CN116860847A/en
Publication of CN116860847A publication Critical patent/CN116860847A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/252Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/211Schema design and management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/986Document structures and storage, e.g. HTML extensions

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention provides a unified health detection method and a system thereof for multi-source heterogeneous data sources, wherein the unified health detection method comprises the following steps: responding to a data source request initiated by a third party application, wherein the request calls a data source detection control layer interface; the data source detection control layer interface calls a data source management service class interface after receiving the detection information request; after checking the ginseng according to a preset checking rule, performing a core interaction flow; and finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, and returning the data source detection result Map to the data source detection control layer interface, and finally returning to the third party application. The method is verified for many times in the recent intelligent city and other provincial actual combat modeling work, and in the actual modeling process, the multi-source connection test detection task request can be responded quickly by calling the unified health detection interface for the multi-source heterogeneous data source, so that the time-shrinking synergy effect is achieved for solving the connection detection problem of the multi-source database.

Description

Unified health detection method and system for multi-source heterogeneous data sources
Technical Field
The invention belongs to the technical field of databases, and particularly relates to a unified health detection method and system for multi-source heterogeneous data sources.
Background
The data resources become hot spots and trends of research and development in the field of big data. One difficulty faced by the major and unified approach to data resources is the problem of data source dispersion, because data is usually stored in different databases, file systems or network services, and these resources are located in different geographical locations and dispersed among different institutions, enterprises and departments, and the primary premise of processing multi-source data is to solve the problem of connection detection of multi-source databases.
Akka is an excellent distributed computing framework with multiple advantages of high scalability, high concurrency, high reliability, distributed computing, and responsive programming. Through the design based on the Actor model, akka can divide the application program into independent operation units, and the units can asynchronously receive and send messages and create more actors when necessary, so that the application program can be easily expanded to a plurality of nodes, and highly scalable application program is realized. Meanwhile, akka can also realize efficient concurrent programming, and improve the performance and throughput of an application program; the high reliability of the application program is ensured through a monitoring and recovering mechanism, and the problems of system breakdown, data loss and the like are avoided; supporting the deployment of an Actor on different nodes, and constructing a complex distributed application program; and a responsive programming model is supported, non-blocking IO operation is realized, and the response speed and scalability of the application program are improved. Therefore, the unified health detection architecture system for the multi-source heterogeneous data source can respond to detection requests of high concurrency and other scenes more quickly.
Although Akka has multiple advantages of high scalability, high concurrency, high reliability, distributed computing, and responsive programming, akka does not have the function of unified data source detection itself.
In view of the above, it is very significant to provide a unified health detection method and system for multi-source heterogeneous data sources.
Disclosure of Invention
In order to solve the problem that the existing Akka does not have the function of unified data source detection, the invention provides a unified health detection method and a system for multi-source heterogeneous data sources, which aim to solve the technical defect problems.
In a first aspect, the present invention provides a unified health detection method for heterogeneous multi-source data sources, the method comprising the steps of:
responding to a data source request initiated by a third party application, wherein the request calls a data source detection control layer interface;
the data source detection control layer interface calls a data source management service class interface after receiving the detection information request;
after checking the ginseng according to a preset checking rule, performing a core interaction flow;
and finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, and returning the data source detection result Map to the data source detection control layer interface, and finally returning to the third party application.
Preferably, the core interaction flow specifically includes:
generating an acterName according to a specified rule, starting a DSCWebActor instance containing the acterName and used for detecting a data source, and transmitting detection connection information CI;
and then setting a first timer to wait for the DSCActor to send a message that the data source detection program is started, returning to the corresponding exception if waiting for timeout, and interrupting the program.
Further preferably, performing the core interaction flow further includes:
constructing a DSCActor starting command, starting a data source detection program command with the IP address of the DSCWebActor instance and the ActorName, and establishing a connection channel with the DSCWebActor instance through the IP address and the ActorName by the program;
after the DSCActor instance is built, a second timer is set to wait for the DSCWebActor instance to send connection information CI, if waiting for overtime, the corresponding exception is returned, and the program is interrupted.
Further preferably, performing the core interaction flow further includes:
the DSCActor sends a message that the data source detection program is started to DSCWebActor, DSCWebActor, and after receiving the message that the data source detection program is started, the DSCActor closes the first timer;
then sending the detection connection information CI to DSCActor, DSCActor, and closing the second timer after receiving the detection connection information CI;
the DSCActor calls a unified data source detection interface DSCIC, the unified data source detection interface DSCIC carries out connection detection on corresponding data sources according to received connection information CI, and then a data source detection result Map is returned.
Preferably, the verifying the parameter according to the preset verification rule specifically includes:
if the data source type is empty, an exception is thrown;
if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
In a second aspect, an embodiment of the present invention further provides a unified health detection system for a multi-source heterogeneous data source, including:
the first calling module is configured to respond to a data source request initiated by a third party application, and the request calls a data source detection control layer interface;
the second calling module is configured to call the data source management service class interface after the data source detection control layer interface receives the detection information request;
the processing module is configured to perform core interaction flow after checking the ginseng according to a preset checking rule;
and the data return module is configured to return the data source detection result Map returned by the core interaction detection to the data source management service class interface, return the data source detection result Map to the data source detection control layer interface and finally return to the third party application.
Further preferably, the method further comprises:
the system comprises a DSCWebActor module, a data source detection module and a detection connection module, wherein the DSCWebActor module is configured to generate an ActorName according to a specified rule, start a DSCWebActor instance for data source detection comprising the ActorName, and transmit detection connection information CI;
the first timer module is configured to set a first timer to wait for a DSCActor to send a message that the data source detection program is started, and if the message is waiting for overtime, the corresponding exception is returned, and the program is interrupted;
the DSCActor module is configured to construct a DSCActor starting command, start a data source detection program command with the IP address of the DSCWebActor instance and the ActorName, and establish a connection channel with the DSCWebActor instance through the IP address and the ActorName;
and the second timer module is configured to set a second timer to wait for the DSCWebActor instance to send connection information CI after the DSCActor instance is constructed, and return a corresponding exception and interrupt a program if waiting for timeout.
Further preferably, the method further comprises:
the parameter transmission checking module is configured to check parameters according to a preset checking rule, and comprises that if the data source type is empty, an abnormality is thrown out; if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
In a third aspect, an embodiment of the present invention provides an electronic device, including: one or more processors; and storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the method as described in any of the implementations of the first aspect.
In a fourth aspect, embodiments of the present invention provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as described in any of the implementations of the first aspect.
Compared with the prior art, the invention has the beneficial effects that:
(1) The method and the system construct a unified health detection architecture system for multi-source heterogeneous data sources, completely realize the rapid detection of the data sources such as the initiation of third-party application tasks, different manufacturers, different components, different versions of the same component and the like, and return the detection result of the data sources to the Web page display of the third-party application, thereby playing a role in shortening time and enhancing efficiency for rapidly eliminating databases with abnormal connection and solving the problem of connection detection of the multi-source databases.
(2) The method is verified for many times in the recent intelligent city and other provincial actual combat modeling work in the day calculation application of the heaven and earth big data operating system; in the actual modeling process, the unified health detection interface facing the multi-source heterogeneous data source is called to quickly respond to the multi-source connection test detection task request, so that the time-shrinking synergy effect is achieved for solving the connection detection problem of the multi-source database.
Drawings
The accompanying drawings are included to provide a further understanding of the embodiments and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments and together with the description serve to explain the principles of the invention. Many of the intended advantages of other embodiments and embodiments will be readily appreciated as they become better understood by reference to the following detailed description. The elements of the drawings are not necessarily to scale relative to each other. Like reference numerals designate corresponding similar parts.
FIG. 1 is an exemplary device frame pattern to which an embodiment of the present invention may be applied;
FIG. 2 is a flow chart of a unified health check method for multi-source heterogeneous data sources according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of the overall architecture of a unified health detection method for multi-source heterogeneous data sources according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a unified health check system for multi-source heterogeneous data sources according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a computer apparatus suitable for use in implementing an embodiment of the invention.
Detailed Description
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof, and in which is shown by way of illustration specific embodiments in which the invention may be practiced. For this, directional terms, such as "top", "bottom", "left", "right", "upper", "lower", and the like, are used with reference to the orientation of the described figures. Because components of embodiments can be positioned in a number of different orientations, the directional terminology is used for purposes of illustration and is in no way limiting. It is to be understood that other embodiments may be utilized or logical changes may be made without departing from the scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.
It should be understood that the number of terminal devices, networks and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Fig. 1 illustrates an exemplary system architecture 100 for a method of processing information or an apparatus for processing information to which embodiments of the present invention may be applied.
As shown in fig. 1, a system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used as a medium to provide communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The user may interact with the server 105 via the network 104 using the terminal devices 101, 102, 103 to receive or send messages or the like. Various communication client applications, such as a web browser application, a shopping class application, a search class application, an instant messaging tool, a mailbox client, social platform software, etc., may be installed on the terminal devices 101, 102, 103.
The terminal devices 101, 102, 103 may be various electronic devices with communication capabilities including, but not limited to, smartphones, tablet computers, laptop and desktop computers, and the like.
The server 105 may be a server that provides various services, such as a background information processing server that processes verification request information transmitted by the terminal devices 101, 102, 103. The background information processing server may analyze the received verification request information and obtain a processing result (for example, verification success information for characterizing that the verification request is a legal request).
It should be noted that, the method for processing information provided by the embodiment of the present invention is generally performed by the server 105, and accordingly, the device for processing information is generally disposed in the server 105. In addition, the method for transmitting information provided by the embodiment of the present invention is generally performed by the terminal devices 101, 102, 103, and accordingly, the means for transmitting information is generally provided in the terminal devices 101, 102, 103.
The server may be hardware or software. When the server is hardware, the server may be implemented as a distributed server cluster formed by a plurality of servers, or may be implemented as a single server. When the server is software, it may be implemented as a plurality of software or software modules (for example, to provide a distributed service), or may be implemented as a single software or a plurality of software modules, which are not specifically limited herein.
Fig. 2 shows that the embodiment of the invention discloses a unified health detection method for multi-source heterogeneous data sources, and as shown in fig. 2, the method comprises the following steps:
s1, responding to a data source request initiated by a third party application, and requesting to call a data source detection control layer interface;
s2, after the data source detection control layer interface receives the detection information request, calling a data source management service class interface;
s3, checking the ginseng according to a preset checking rule, and then performing a core interaction flow;
and S4, finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, returning the data source detection result Map to the data source detection control layer interface, and finally returning the data source detection result Map to the third party application.
In this embodiment, a schematic diagram of the overall framework structure of the present invention is shown in fig. 3, and a specific method of the present invention will be described below according to the schematic diagram of fig. 3.
Step 1, a third party application initiates a data source detection request through a Web terminal, and the request can call a data source detection control layer interface (DSCCI);
step 2, after receiving the request of detection information, the interface of the data source detection control layer (DSCCI) invokes a data source management service class interface (DSCSI);
step 3, parameter verification is carried out on the ginseng:
3.1 If the data source type is empty, an exception is thrown;
3.2 If the data source type is not null, the detection information object transmitted by the Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
Step 4, core interaction:
4.1.1 Generating an ActorName according to the specified rule, starting a DSCWebActor instance containing the ActorName and used for detecting a data source, and transmitting detection Connection Information (CI);
4.1.2 Setting a timer to wait for DSCActor to send a message that the data source detection program is started, returning to the corresponding exception if waiting for timeout, and interrupting the program;
4.2.1 A DSCActor starting command is constructed, then the data source detection program command with the IP address and the ActorName of the DSCWebActor instance is started, and the program establishes a connection channel with the DSCWebActor instance through the IP address and the ActorName;
4.2.2 After the DSCActor instance is built, a timer is also set, the DSCWebActor instance waits for sending Connection Information (CI), if waiting for timeout, the corresponding exception is returned, and the program is interrupted;
4.3.1 The DSCActor sends a message of 'the data source detection program is started' to the DSCWebActor;
4.4.1 After receiving the message of "the data source detection program has been started", the DSCWebActor turns off the timer;
4.4.2 Then sending the detected Connection Information (CI) to the DSCActor;
4.5.1 After the DSCActor receives the detection Connection Information (CI), closing a timer;
4.5.2 The DSCActor then invokes a unified data source detection interface (DSCIC);
4.6.1 The unified data source detection interface (DSCIC) performs connection detection on the corresponding data source according to the received Connection Information (CI), and then returns a data source detection result Map (DSCR).
And step 5, finally, returning the data source detection result Map (DSCR) returned by the core interaction detection to a data source management service class interface (DSCSI), then returning to a data source detection control layer interface (DSCCI), and finally returning to a third party application Web client to display the detection result, wherein the whole data source detection process is finished.
The method of the invention is used in the heaven and earth big data operation system, and is verified for many times in the provincial actual combat modeling work of the smart city in recent years. In the actual modeling process, the unified health detection interface facing the multi-source heterogeneous data source is called to quickly respond to the multi-source connection test detection task request, so that the time-shrinking synergy effect is achieved for solving the connection detection problem of the multi-source database.
In a second aspect, the embodiment of the present invention further discloses a unified health detection system for multi-source heterogeneous data sources, as shown in fig. 4, which includes a first calling module 41, a second calling module 42, a processing module 43, a data returning module 44, a dscwbactor module 45, a first timer module 46, a dscactor module 47, a second timer module 48, and a parameter verification module 49.
In a specific embodiment, the first invoking module 41 is configured to respond to a data source request initiated by a third party application, and the request invokes a data source detection control layer interface; a second calling module 42, configured to call the data source management service class interface after the data source detection control layer interface receives the detection information request; the processing module 43 is configured to perform a core interaction flow after checking the parameter according to a preset checking rule; and the data return module 44 is configured to return the data source detection result Map returned by the core interaction detection to the data source management service class interface, and then to the data source detection control layer interface, and finally to the third party application.
Further comprises: the dscwbactor module 45 is configured to generate an actor name according to a specified rule, and start a dscwbactor instance for data source detection, which includes the actor name, and send in detection connection information CI; a first timer module 46 configured to set a first timer to wait for the DSCActor to send a message that the data source detection procedure has been started, return a corresponding exception if waiting for timeout, and interrupt the procedure; the DSCActor module 47 is configured to construct a DSCActor start command, and start a data source detection program command with the IP address of the dscwbactor instance and the actername, where the program establishes a connection channel with the dscwbactor instance through the IP address and the actername; the second timer module 48 is configured to set a second timer to wait for the dscwbactor instance to send the connection information CI after the DSCActor instance is constructed, and return a corresponding exception if waiting for timeout, and interrupt the program; the transmission checking module 49 is configured to check the transmission according to a preset checking rule, including throwing an exception if the data source type is empty; if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
Referring now to fig. 5, there is illustrated a schematic diagram of a computer apparatus 600 suitable for use in an electronic device (e.g., a server or terminal device as illustrated in fig. 1) for implementing an embodiment of the present invention. The electronic device shown in fig. 5 is only an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.
As shown in fig. 5, the computer apparatus 600 includes a Central Processing Unit (CPU) 601 and a Graphics Processor (GPU) 602, which can perform various appropriate actions and processes according to programs stored in a Read Only Memory (ROM) 603 or programs loaded from a storage section 609 into a Random Access Memory (RAM) 606. In the RAM 604, various programs and data required for the operation of the apparatus 600 are also stored. The CPU 601, GPU602, ROM 603, and RAM 604 are connected to each other through a bus 605. An input/output (I/O) interface 606 is also connected to the bus 605.
The following components are connected to the I/O interface 606: an input portion 607 including a keyboard, a mouse, and the like; an output portion 608 including a speaker, such as a Liquid Crystal Display (LCD), etc.; a storage portion 609 including a hard disk and the like; and a communication section 610 including a network interface card such as a LAN card, a modem, or the like. The communication section 610 performs communication processing via a network such as the internet. The drive 611 may also be connected to the I/O interface 606 as needed. A removable medium 612 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 611 as necessary, so that a computer program read out therefrom is mounted into the storage section 609 as necessary.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via the communication portion 610, and/or installed from the removable medium 612. The above-described functions defined in the method of the present invention are performed when the computer program is executed by a Central Processing Unit (CPU) 601 and a Graphics Processor (GPU) 602.
It should be noted that the computer readable medium according to the present invention may be a computer readable signal medium or a computer readable medium, or any combination of the two. The computer readable medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor apparatus, device, or means, or a combination of any of the foregoing. More specific examples of the computer-readable medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution apparatus, device, or apparatus. In the present invention, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may be any computer readable medium that is not a computer readable medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution apparatus, device, or apparatus. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based devices which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules involved in the embodiments of the present invention may be implemented in software or in hardware. The described modules may also be provided in a processor.
As another aspect, the present invention also provides a computer-readable medium that may be contained in the electronic device described in the above embodiment; or may exist alone without being incorporated into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: responding to a data source request initiated by a third party application, wherein the request calls a data source detection control layer interface; the data source detection control layer interface calls a data source management service class interface after receiving the detection information request; after checking the ginseng according to a preset checking rule, performing a core interaction flow; and finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, and returning the data source detection result Map to the data source detection control layer interface, and finally returning to the third party application.
The above description is only illustrative of the preferred embodiments of the present invention and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the invention referred to in the present invention is not limited to the specific combinations of the technical features described above, but also covers other technical features formed by any combination of the technical features described above or their equivalents without departing from the inventive concept described above. Such as the above-mentioned features and the technical features disclosed in the present invention (but not limited to) having similar functions are replaced with each other.

Claims (10)

1. A unified health detection method for multi-source heterogeneous data sources is characterized by comprising the following steps:
responding to a data source request initiated by a third party application, wherein the request calls a data source detection control layer interface;
the data source detection control layer interface calls a data source management service class interface after receiving the detection information request;
after checking the ginseng according to a preset checking rule, performing a core interaction flow;
and finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, and returning the data source detection result Map to the data source detection control layer interface, and finally returning to the third party application.
2. The unified health detection method for multi-source heterogeneous data sources according to claim 1, wherein the performing a core interaction flow specifically comprises:
generating an acterName according to a specified rule, starting a DSCWebActor instance containing the acterName and used for detecting a data source, and transmitting detection connection information CI;
and then setting a first timer to wait for the DSCActor to send a message that the data source detection program is started, returning to the corresponding exception if waiting for timeout, and interrupting the program.
3. The unified health detection method for multi-source heterogeneous data sources according to claim 2, wherein performing the core interaction flow further comprises:
constructing a DSCActor starting command, starting a data source detection program command with the IP address of the DSCWebActor instance and the ActorName, and establishing a connection channel with the DSCWebActor instance through the IP address and the ActorName by the program;
after the DSCActor instance is built, a second timer is set to wait for the DSCWebActor instance to send connection information CI, if waiting for overtime, the corresponding exception is returned, and the program is interrupted.
4. The unified health inspection method for multi-source heterogeneous data sources according to claim 3, wherein performing a core interaction flow further comprises:
the DSCActor sends a message that the data source detection program is started to DSCWebActor, DSCWebActor, and after receiving the message that the data source detection program is started, the DSCActor closes the first timer;
then sending the detection connection information CI to DSCActor, DSCActor, and closing the second timer after receiving the detection connection information CI;
the DSCActor calls a unified data source detection interface DSCIC, the unified data source detection interface DSCIC carries out connection detection on corresponding data sources according to received connection information CI, and then a data source detection result Map is returned.
5. The unified health detection method for multi-source heterogeneous data sources according to claim 1, wherein verifying the parameters according to a preset verification rule specifically comprises:
if the data source type is empty, an exception is thrown;
if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
6. A unified health check system for heterogeneous multi-source data sources, comprising:
the first calling module is configured to respond to a data source request initiated by a third party application, and the request calls a data source detection control layer interface;
the second calling module is configured to call the data source management service class interface after the data source detection control layer interface receives the detection information request;
the processing module is configured to perform core interaction flow after checking the ginseng according to a preset checking rule;
and the data return module is configured to return the data source detection result Map returned by the core interaction detection to the data source management service class interface, return the data source detection result Map to the data source detection control layer interface and finally return to the third party application.
7. The unified health check system for a multi-source heterogeneous data source according to claim 6, further comprising:
the system comprises a DSCWebActor module, a data source detection module and a detection connection module, wherein the DSCWebActor module is configured to generate an ActorName according to a specified rule, start a DSCWebActor instance for data source detection comprising the ActorName, and transmit detection connection information CI;
the first timer module is configured to set a first timer to wait for a DSCActor to send a message that the data source detection program is started, and if the message is waiting for overtime, the corresponding exception is returned, and the program is interrupted;
the DSCActor module is configured to construct a DSCActor starting command, start a data source detection program command with the IP address of the DSCWebActor instance and the ActorName, and establish a connection channel with the DSCWebActor instance through the IP address and the ActorName;
and the second timer module is configured to set a second timer to wait for the DSCWebActor instance to send connection information CI after the DSCActor instance is constructed, and return a corresponding exception and interrupt a program if waiting for timeout.
8. The unified health check system for a multi-source heterogeneous data source according to claim 7, further comprising:
the parameter transmission checking module is configured to check parameters according to a preset checking rule, and comprises that if the data source type is empty, an abnormality is thrown out; if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
9. An electronic device, comprising:
one or more processors;
a storage means for storing one or more programs;
when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1 to 5.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any one of claims 1 to 5.
CN202310776959.3A 2023-06-28 2023-06-28 Unified health detection method and system for multi-source heterogeneous data sources Pending CN116860847A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310776959.3A CN116860847A (en) 2023-06-28 2023-06-28 Unified health detection method and system for multi-source heterogeneous data sources

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310776959.3A CN116860847A (en) 2023-06-28 2023-06-28 Unified health detection method and system for multi-source heterogeneous data sources

Publications (1)

Publication Number Publication Date
CN116860847A true CN116860847A (en) 2023-10-10

Family

ID=88222666

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310776959.3A Pending CN116860847A (en) 2023-06-28 2023-06-28 Unified health detection method and system for multi-source heterogeneous data sources

Country Status (1)

Country Link
CN (1) CN116860847A (en)

Similar Documents

Publication Publication Date Title
CN113900834B (en) Data processing method, device, equipment and storage medium based on Internet of things technology
CA3059719C (en) Payment processing method, device, medium and electronic device
US11775473B2 (en) Seamless data movement and metadata management in a hybrid cloud setting using a configurable micro services based architecture
CN115357761A (en) Link tracking method and device, electronic equipment and storage medium
CN112445860B (en) Method and device for processing distributed transaction
CN113132400B (en) Business processing method, device, computer system and storage medium
CN115277855A (en) Request processing method and device, electronic equipment and storage medium
CN111414154A (en) Method and device for front-end development, electronic equipment and storage medium
CN112015383A (en) Login method and device
CN113191889A (en) Wind control configuration method, configuration system, electronic device and readable storage medium
JP2023065558A (en) Method of responding to operation, apparatus of responding to operation, electronic device, and storage medium
CN116860847A (en) Unified health detection method and system for multi-source heterogeneous data sources
CN115550141A (en) Event processing method and device, electronic equipment and readable storage medium
CN114780361A (en) Log generation method, device, computer system and readable storage medium
CN114282506A (en) Certificate generation method, system, electronic device and storage medium
CN114996557A (en) Service stability determination method, device, equipment and storage medium
CN109840073B (en) Method and device for realizing business process
CN113282391B (en) Cluster switching method, cluster switching device, electronic equipment and readable storage medium
CN117076559A (en) Big data offline processing method and system based on multiple computing engines
CN115378991B (en) Message processing method, device, equipment and computer storage medium
CN114202046B (en) Method, device, equipment and medium for generating two-dimension code based on SAP system
US12126729B2 (en) Method and apparatus for issuing smart contract
CN116167835A (en) Service processing method, device, electronic equipment and computer readable medium
CN118210778A (en) Database operation method, apparatus, device, storage medium, and program product
CN114885026A (en) Data interface request processing system, method, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination