CN116860847A - Unified health detection method and system for multi-source heterogeneous data sources - Google Patents
Unified health detection method and system for multi-source heterogeneous data sources Download PDFInfo
- Publication number
- CN116860847A CN116860847A CN202310776959.3A CN202310776959A CN116860847A CN 116860847 A CN116860847 A CN 116860847A CN 202310776959 A CN202310776959 A CN 202310776959A CN 116860847 A CN116860847 A CN 116860847A
- Authority
- CN
- China
- Prior art keywords
- data source
- detection
- program
- dscactor
- dscwebactor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 136
- 230000036541 health Effects 0.000 title claims abstract description 27
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000003993 interaction Effects 0.000 claims abstract description 24
- 241000208340 Araliaceae Species 0.000 claims abstract description 8
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims abstract description 8
- 235000003140 Panax quinquefolius Nutrition 0.000 claims abstract description 8
- 235000008434 ginseng Nutrition 0.000 claims abstract description 8
- 238000012545 processing Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 10
- 238000012795 verification Methods 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000005856 abnormality Effects 0.000 claims description 2
- 238000007689 inspection Methods 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 7
- 230000000694 effects Effects 0.000 abstract description 3
- 238000012360 testing method Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 4
- 239000000835 fiber Substances 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F16/986—Document structures and storage, e.g. HTML extensions
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a unified health detection method and a system thereof for multi-source heterogeneous data sources, wherein the unified health detection method comprises the following steps: responding to a data source request initiated by a third party application, wherein the request calls a data source detection control layer interface; the data source detection control layer interface calls a data source management service class interface after receiving the detection information request; after checking the ginseng according to a preset checking rule, performing a core interaction flow; and finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, and returning the data source detection result Map to the data source detection control layer interface, and finally returning to the third party application. The method is verified for many times in the recent intelligent city and other provincial actual combat modeling work, and in the actual modeling process, the multi-source connection test detection task request can be responded quickly by calling the unified health detection interface for the multi-source heterogeneous data source, so that the time-shrinking synergy effect is achieved for solving the connection detection problem of the multi-source database.
Description
Technical Field
The invention belongs to the technical field of databases, and particularly relates to a unified health detection method and system for multi-source heterogeneous data sources.
Background
The data resources become hot spots and trends of research and development in the field of big data. One difficulty faced by the major and unified approach to data resources is the problem of data source dispersion, because data is usually stored in different databases, file systems or network services, and these resources are located in different geographical locations and dispersed among different institutions, enterprises and departments, and the primary premise of processing multi-source data is to solve the problem of connection detection of multi-source databases.
Akka is an excellent distributed computing framework with multiple advantages of high scalability, high concurrency, high reliability, distributed computing, and responsive programming. Through the design based on the Actor model, akka can divide the application program into independent operation units, and the units can asynchronously receive and send messages and create more actors when necessary, so that the application program can be easily expanded to a plurality of nodes, and highly scalable application program is realized. Meanwhile, akka can also realize efficient concurrent programming, and improve the performance and throughput of an application program; the high reliability of the application program is ensured through a monitoring and recovering mechanism, and the problems of system breakdown, data loss and the like are avoided; supporting the deployment of an Actor on different nodes, and constructing a complex distributed application program; and a responsive programming model is supported, non-blocking IO operation is realized, and the response speed and scalability of the application program are improved. Therefore, the unified health detection architecture system for the multi-source heterogeneous data source can respond to detection requests of high concurrency and other scenes more quickly.
Although Akka has multiple advantages of high scalability, high concurrency, high reliability, distributed computing, and responsive programming, akka does not have the function of unified data source detection itself.
In view of the above, it is very significant to provide a unified health detection method and system for multi-source heterogeneous data sources.
Disclosure of Invention
In order to solve the problem that the existing Akka does not have the function of unified data source detection, the invention provides a unified health detection method and a system for multi-source heterogeneous data sources, which aim to solve the technical defect problems.
In a first aspect, the present invention provides a unified health detection method for heterogeneous multi-source data sources, the method comprising the steps of:
responding to a data source request initiated by a third party application, wherein the request calls a data source detection control layer interface;
the data source detection control layer interface calls a data source management service class interface after receiving the detection information request;
after checking the ginseng according to a preset checking rule, performing a core interaction flow;
and finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, and returning the data source detection result Map to the data source detection control layer interface, and finally returning to the third party application.
Preferably, the core interaction flow specifically includes:
generating an acterName according to a specified rule, starting a DSCWebActor instance containing the acterName and used for detecting a data source, and transmitting detection connection information CI;
and then setting a first timer to wait for the DSCActor to send a message that the data source detection program is started, returning to the corresponding exception if waiting for timeout, and interrupting the program.
Further preferably, performing the core interaction flow further includes:
constructing a DSCActor starting command, starting a data source detection program command with the IP address of the DSCWebActor instance and the ActorName, and establishing a connection channel with the DSCWebActor instance through the IP address and the ActorName by the program;
after the DSCActor instance is built, a second timer is set to wait for the DSCWebActor instance to send connection information CI, if waiting for overtime, the corresponding exception is returned, and the program is interrupted.
Further preferably, performing the core interaction flow further includes:
the DSCActor sends a message that the data source detection program is started to DSCWebActor, DSCWebActor, and after receiving the message that the data source detection program is started, the DSCActor closes the first timer;
then sending the detection connection information CI to DSCActor, DSCActor, and closing the second timer after receiving the detection connection information CI;
the DSCActor calls a unified data source detection interface DSCIC, the unified data source detection interface DSCIC carries out connection detection on corresponding data sources according to received connection information CI, and then a data source detection result Map is returned.
Preferably, the verifying the parameter according to the preset verification rule specifically includes:
if the data source type is empty, an exception is thrown;
if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
In a second aspect, an embodiment of the present invention further provides a unified health detection system for a multi-source heterogeneous data source, including:
the first calling module is configured to respond to a data source request initiated by a third party application, and the request calls a data source detection control layer interface;
the second calling module is configured to call the data source management service class interface after the data source detection control layer interface receives the detection information request;
the processing module is configured to perform core interaction flow after checking the ginseng according to a preset checking rule;
and the data return module is configured to return the data source detection result Map returned by the core interaction detection to the data source management service class interface, return the data source detection result Map to the data source detection control layer interface and finally return to the third party application.
Further preferably, the method further comprises:
the system comprises a DSCWebActor module, a data source detection module and a detection connection module, wherein the DSCWebActor module is configured to generate an ActorName according to a specified rule, start a DSCWebActor instance for data source detection comprising the ActorName, and transmit detection connection information CI;
the first timer module is configured to set a first timer to wait for a DSCActor to send a message that the data source detection program is started, and if the message is waiting for overtime, the corresponding exception is returned, and the program is interrupted;
the DSCActor module is configured to construct a DSCActor starting command, start a data source detection program command with the IP address of the DSCWebActor instance and the ActorName, and establish a connection channel with the DSCWebActor instance through the IP address and the ActorName;
and the second timer module is configured to set a second timer to wait for the DSCWebActor instance to send connection information CI after the DSCActor instance is constructed, and return a corresponding exception and interrupt a program if waiting for timeout.
Further preferably, the method further comprises:
the parameter transmission checking module is configured to check parameters according to a preset checking rule, and comprises that if the data source type is empty, an abnormality is thrown out; if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
In a third aspect, an embodiment of the present invention provides an electronic device, including: one or more processors; and storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the method as described in any of the implementations of the first aspect.
In a fourth aspect, embodiments of the present invention provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as described in any of the implementations of the first aspect.
Compared with the prior art, the invention has the beneficial effects that:
(1) The method and the system construct a unified health detection architecture system for multi-source heterogeneous data sources, completely realize the rapid detection of the data sources such as the initiation of third-party application tasks, different manufacturers, different components, different versions of the same component and the like, and return the detection result of the data sources to the Web page display of the third-party application, thereby playing a role in shortening time and enhancing efficiency for rapidly eliminating databases with abnormal connection and solving the problem of connection detection of the multi-source databases.
(2) The method is verified for many times in the recent intelligent city and other provincial actual combat modeling work in the day calculation application of the heaven and earth big data operating system; in the actual modeling process, the unified health detection interface facing the multi-source heterogeneous data source is called to quickly respond to the multi-source connection test detection task request, so that the time-shrinking synergy effect is achieved for solving the connection detection problem of the multi-source database.
Drawings
The accompanying drawings are included to provide a further understanding of the embodiments and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments and together with the description serve to explain the principles of the invention. Many of the intended advantages of other embodiments and embodiments will be readily appreciated as they become better understood by reference to the following detailed description. The elements of the drawings are not necessarily to scale relative to each other. Like reference numerals designate corresponding similar parts.
FIG. 1 is an exemplary device frame pattern to which an embodiment of the present invention may be applied;
FIG. 2 is a flow chart of a unified health check method for multi-source heterogeneous data sources according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of the overall architecture of a unified health detection method for multi-source heterogeneous data sources according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a unified health check system for multi-source heterogeneous data sources according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a computer apparatus suitable for use in implementing an embodiment of the invention.
Detailed Description
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof, and in which is shown by way of illustration specific embodiments in which the invention may be practiced. For this, directional terms, such as "top", "bottom", "left", "right", "upper", "lower", and the like, are used with reference to the orientation of the described figures. Because components of embodiments can be positioned in a number of different orientations, the directional terminology is used for purposes of illustration and is in no way limiting. It is to be understood that other embodiments may be utilized or logical changes may be made without departing from the scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.
It should be understood that the number of terminal devices, networks and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Fig. 1 illustrates an exemplary system architecture 100 for a method of processing information or an apparatus for processing information to which embodiments of the present invention may be applied.
As shown in fig. 1, a system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used as a medium to provide communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The user may interact with the server 105 via the network 104 using the terminal devices 101, 102, 103 to receive or send messages or the like. Various communication client applications, such as a web browser application, a shopping class application, a search class application, an instant messaging tool, a mailbox client, social platform software, etc., may be installed on the terminal devices 101, 102, 103.
The terminal devices 101, 102, 103 may be various electronic devices with communication capabilities including, but not limited to, smartphones, tablet computers, laptop and desktop computers, and the like.
The server 105 may be a server that provides various services, such as a background information processing server that processes verification request information transmitted by the terminal devices 101, 102, 103. The background information processing server may analyze the received verification request information and obtain a processing result (for example, verification success information for characterizing that the verification request is a legal request).
It should be noted that, the method for processing information provided by the embodiment of the present invention is generally performed by the server 105, and accordingly, the device for processing information is generally disposed in the server 105. In addition, the method for transmitting information provided by the embodiment of the present invention is generally performed by the terminal devices 101, 102, 103, and accordingly, the means for transmitting information is generally provided in the terminal devices 101, 102, 103.
The server may be hardware or software. When the server is hardware, the server may be implemented as a distributed server cluster formed by a plurality of servers, or may be implemented as a single server. When the server is software, it may be implemented as a plurality of software or software modules (for example, to provide a distributed service), or may be implemented as a single software or a plurality of software modules, which are not specifically limited herein.
Fig. 2 shows that the embodiment of the invention discloses a unified health detection method for multi-source heterogeneous data sources, and as shown in fig. 2, the method comprises the following steps:
s1, responding to a data source request initiated by a third party application, and requesting to call a data source detection control layer interface;
s2, after the data source detection control layer interface receives the detection information request, calling a data source management service class interface;
s3, checking the ginseng according to a preset checking rule, and then performing a core interaction flow;
and S4, finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, returning the data source detection result Map to the data source detection control layer interface, and finally returning the data source detection result Map to the third party application.
In this embodiment, a schematic diagram of the overall framework structure of the present invention is shown in fig. 3, and a specific method of the present invention will be described below according to the schematic diagram of fig. 3.
Step 1, a third party application initiates a data source detection request through a Web terminal, and the request can call a data source detection control layer interface (DSCCI);
step 2, after receiving the request of detection information, the interface of the data source detection control layer (DSCCI) invokes a data source management service class interface (DSCSI);
step 3, parameter verification is carried out on the ginseng:
3.1 If the data source type is empty, an exception is thrown;
3.2 If the data source type is not null, the detection information object transmitted by the Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
Step 4, core interaction:
4.1.1 Generating an ActorName according to the specified rule, starting a DSCWebActor instance containing the ActorName and used for detecting a data source, and transmitting detection Connection Information (CI);
4.1.2 Setting a timer to wait for DSCActor to send a message that the data source detection program is started, returning to the corresponding exception if waiting for timeout, and interrupting the program;
4.2.1 A DSCActor starting command is constructed, then the data source detection program command with the IP address and the ActorName of the DSCWebActor instance is started, and the program establishes a connection channel with the DSCWebActor instance through the IP address and the ActorName;
4.2.2 After the DSCActor instance is built, a timer is also set, the DSCWebActor instance waits for sending Connection Information (CI), if waiting for timeout, the corresponding exception is returned, and the program is interrupted;
4.3.1 The DSCActor sends a message of 'the data source detection program is started' to the DSCWebActor;
4.4.1 After receiving the message of "the data source detection program has been started", the DSCWebActor turns off the timer;
4.4.2 Then sending the detected Connection Information (CI) to the DSCActor;
4.5.1 After the DSCActor receives the detection Connection Information (CI), closing a timer;
4.5.2 The DSCActor then invokes a unified data source detection interface (DSCIC);
4.6.1 The unified data source detection interface (DSCIC) performs connection detection on the corresponding data source according to the received Connection Information (CI), and then returns a data source detection result Map (DSCR).
And step 5, finally, returning the data source detection result Map (DSCR) returned by the core interaction detection to a data source management service class interface (DSCSI), then returning to a data source detection control layer interface (DSCCI), and finally returning to a third party application Web client to display the detection result, wherein the whole data source detection process is finished.
The method of the invention is used in the heaven and earth big data operation system, and is verified for many times in the provincial actual combat modeling work of the smart city in recent years. In the actual modeling process, the unified health detection interface facing the multi-source heterogeneous data source is called to quickly respond to the multi-source connection test detection task request, so that the time-shrinking synergy effect is achieved for solving the connection detection problem of the multi-source database.
In a second aspect, the embodiment of the present invention further discloses a unified health detection system for multi-source heterogeneous data sources, as shown in fig. 4, which includes a first calling module 41, a second calling module 42, a processing module 43, a data returning module 44, a dscwbactor module 45, a first timer module 46, a dscactor module 47, a second timer module 48, and a parameter verification module 49.
In a specific embodiment, the first invoking module 41 is configured to respond to a data source request initiated by a third party application, and the request invokes a data source detection control layer interface; a second calling module 42, configured to call the data source management service class interface after the data source detection control layer interface receives the detection information request; the processing module 43 is configured to perform a core interaction flow after checking the parameter according to a preset checking rule; and the data return module 44 is configured to return the data source detection result Map returned by the core interaction detection to the data source management service class interface, and then to the data source detection control layer interface, and finally to the third party application.
Further comprises: the dscwbactor module 45 is configured to generate an actor name according to a specified rule, and start a dscwbactor instance for data source detection, which includes the actor name, and send in detection connection information CI; a first timer module 46 configured to set a first timer to wait for the DSCActor to send a message that the data source detection procedure has been started, return a corresponding exception if waiting for timeout, and interrupt the procedure; the DSCActor module 47 is configured to construct a DSCActor start command, and start a data source detection program command with the IP address of the dscwbactor instance and the actername, where the program establishes a connection channel with the dscwbactor instance through the IP address and the actername; the second timer module 48 is configured to set a second timer to wait for the dscwbactor instance to send the connection information CI after the DSCActor instance is constructed, and return a corresponding exception if waiting for timeout, and interrupt the program; the transmission checking module 49 is configured to check the transmission according to a preset checking rule, including throwing an exception if the data source type is empty; if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
Referring now to fig. 5, there is illustrated a schematic diagram of a computer apparatus 600 suitable for use in an electronic device (e.g., a server or terminal device as illustrated in fig. 1) for implementing an embodiment of the present invention. The electronic device shown in fig. 5 is only an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.
As shown in fig. 5, the computer apparatus 600 includes a Central Processing Unit (CPU) 601 and a Graphics Processor (GPU) 602, which can perform various appropriate actions and processes according to programs stored in a Read Only Memory (ROM) 603 or programs loaded from a storage section 609 into a Random Access Memory (RAM) 606. In the RAM 604, various programs and data required for the operation of the apparatus 600 are also stored. The CPU 601, GPU602, ROM 603, and RAM 604 are connected to each other through a bus 605. An input/output (I/O) interface 606 is also connected to the bus 605.
The following components are connected to the I/O interface 606: an input portion 607 including a keyboard, a mouse, and the like; an output portion 608 including a speaker, such as a Liquid Crystal Display (LCD), etc.; a storage portion 609 including a hard disk and the like; and a communication section 610 including a network interface card such as a LAN card, a modem, or the like. The communication section 610 performs communication processing via a network such as the internet. The drive 611 may also be connected to the I/O interface 606 as needed. A removable medium 612 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 611 as necessary, so that a computer program read out therefrom is mounted into the storage section 609 as necessary.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via the communication portion 610, and/or installed from the removable medium 612. The above-described functions defined in the method of the present invention are performed when the computer program is executed by a Central Processing Unit (CPU) 601 and a Graphics Processor (GPU) 602.
It should be noted that the computer readable medium according to the present invention may be a computer readable signal medium or a computer readable medium, or any combination of the two. The computer readable medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor apparatus, device, or means, or a combination of any of the foregoing. More specific examples of the computer-readable medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution apparatus, device, or apparatus. In the present invention, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may be any computer readable medium that is not a computer readable medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution apparatus, device, or apparatus. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based devices which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules involved in the embodiments of the present invention may be implemented in software or in hardware. The described modules may also be provided in a processor.
As another aspect, the present invention also provides a computer-readable medium that may be contained in the electronic device described in the above embodiment; or may exist alone without being incorporated into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: responding to a data source request initiated by a third party application, wherein the request calls a data source detection control layer interface; the data source detection control layer interface calls a data source management service class interface after receiving the detection information request; after checking the ginseng according to a preset checking rule, performing a core interaction flow; and finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, and returning the data source detection result Map to the data source detection control layer interface, and finally returning to the third party application.
The above description is only illustrative of the preferred embodiments of the present invention and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the invention referred to in the present invention is not limited to the specific combinations of the technical features described above, but also covers other technical features formed by any combination of the technical features described above or their equivalents without departing from the inventive concept described above. Such as the above-mentioned features and the technical features disclosed in the present invention (but not limited to) having similar functions are replaced with each other.
Claims (10)
1. A unified health detection method for multi-source heterogeneous data sources is characterized by comprising the following steps:
responding to a data source request initiated by a third party application, wherein the request calls a data source detection control layer interface;
the data source detection control layer interface calls a data source management service class interface after receiving the detection information request;
after checking the ginseng according to a preset checking rule, performing a core interaction flow;
and finally, returning the data source detection result Map returned by the core interaction detection to the data source management service class interface, and returning the data source detection result Map to the data source detection control layer interface, and finally returning to the third party application.
2. The unified health detection method for multi-source heterogeneous data sources according to claim 1, wherein the performing a core interaction flow specifically comprises:
generating an acterName according to a specified rule, starting a DSCWebActor instance containing the acterName and used for detecting a data source, and transmitting detection connection information CI;
and then setting a first timer to wait for the DSCActor to send a message that the data source detection program is started, returning to the corresponding exception if waiting for timeout, and interrupting the program.
3. The unified health detection method for multi-source heterogeneous data sources according to claim 2, wherein performing the core interaction flow further comprises:
constructing a DSCActor starting command, starting a data source detection program command with the IP address of the DSCWebActor instance and the ActorName, and establishing a connection channel with the DSCWebActor instance through the IP address and the ActorName by the program;
after the DSCActor instance is built, a second timer is set to wait for the DSCWebActor instance to send connection information CI, if waiting for overtime, the corresponding exception is returned, and the program is interrupted.
4. The unified health inspection method for multi-source heterogeneous data sources according to claim 3, wherein performing a core interaction flow further comprises:
the DSCActor sends a message that the data source detection program is started to DSCWebActor, DSCWebActor, and after receiving the message that the data source detection program is started, the DSCActor closes the first timer;
then sending the detection connection information CI to DSCActor, DSCActor, and closing the second timer after receiving the detection connection information CI;
the DSCActor calls a unified data source detection interface DSCIC, the unified data source detection interface DSCIC carries out connection detection on corresponding data sources according to received connection information CI, and then a data source detection result Map is returned.
5. The unified health detection method for multi-source heterogeneous data sources according to claim 1, wherein verifying the parameters according to a preset verification rule specifically comprises:
if the data source type is empty, an exception is thrown;
if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
6. A unified health check system for heterogeneous multi-source data sources, comprising:
the first calling module is configured to respond to a data source request initiated by a third party application, and the request calls a data source detection control layer interface;
the second calling module is configured to call the data source management service class interface after the data source detection control layer interface receives the detection information request;
the processing module is configured to perform core interaction flow after checking the ginseng according to a preset checking rule;
and the data return module is configured to return the data source detection result Map returned by the core interaction detection to the data source management service class interface, return the data source detection result Map to the data source detection control layer interface and finally return to the third party application.
7. The unified health check system for a multi-source heterogeneous data source according to claim 6, further comprising:
the system comprises a DSCWebActor module, a data source detection module and a detection connection module, wherein the DSCWebActor module is configured to generate an ActorName according to a specified rule, start a DSCWebActor instance for data source detection comprising the ActorName, and transmit detection connection information CI;
the first timer module is configured to set a first timer to wait for a DSCActor to send a message that the data source detection program is started, and if the message is waiting for overtime, the corresponding exception is returned, and the program is interrupted;
the DSCActor module is configured to construct a DSCActor starting command, start a data source detection program command with the IP address of the DSCWebActor instance and the ActorName, and establish a connection channel with the DSCWebActor instance through the IP address and the ActorName;
and the second timer module is configured to set a second timer to wait for the DSCWebActor instance to send connection information CI after the DSCActor instance is constructed, and return a corresponding exception and interrupt a program if waiting for timeout.
8. The unified health check system for a multi-source heterogeneous data source according to claim 7, further comprising:
the parameter transmission checking module is configured to check parameters according to a preset checking rule, and comprises that if the data source type is empty, an abnormality is thrown out; if the data source type is not null, the detection information object transmitted by the third party application Web terminal is subjected to unified formatting processing and is generated into a Json type message object.
9. An electronic device, comprising:
one or more processors;
a storage means for storing one or more programs;
when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1 to 5.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310776959.3A CN116860847A (en) | 2023-06-28 | 2023-06-28 | Unified health detection method and system for multi-source heterogeneous data sources |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310776959.3A CN116860847A (en) | 2023-06-28 | 2023-06-28 | Unified health detection method and system for multi-source heterogeneous data sources |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116860847A true CN116860847A (en) | 2023-10-10 |
Family
ID=88222666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310776959.3A Pending CN116860847A (en) | 2023-06-28 | 2023-06-28 | Unified health detection method and system for multi-source heterogeneous data sources |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116860847A (en) |
-
2023
- 2023-06-28 CN CN202310776959.3A patent/CN116860847A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019015272A1 (en) | Information processing method and device | |
| CN113900834B (en) | Data processing method, device, equipment and storage medium based on Internet of things technology | |
| CN113254445B (en) | Real-time data storage method, device, computer equipment and storage medium | |
| CA3059719C (en) | Payment processing method, device, medium and electronic device | |
| US20220292054A1 (en) | Seamless data movement and metadata management in a hybrid cloud setting using a configurable micro services based architecture | |
| CN115357761A (en) | Link tracking method and device, electronic equipment and storage medium | |
| CN113132400B (en) | Business processing method, device, computer system and storage medium | |
| CN115277855A (en) | Request processing method and device, electronic equipment and storage medium | |
| CN113191889A (en) | Wind control configuration method, configuration system, electronic device and readable storage medium | |
| CN116860847A (en) | Unified health detection method and system for multi-source heterogeneous data sources | |
| CN113472638B (en) | Edge gateway control method, system, device, electronic equipment and storage medium | |
| CN114780361A (en) | Log generation method, device, computer system and readable storage medium | |
| CN109840073B (en) | Method and device for realizing business process | |
| CN113781154A (en) | Information rollback method, system, electronic equipment and storage medium | |
| CN112929453A (en) | Method and device for sharing session data | |
| CN113282391B (en) | Cluster switching method, cluster switching device, electronic equipment and readable storage medium | |
| CN113760886B (en) | Method, apparatus, device and computer readable medium for providing data service | |
| CN117076559A (en) | Big data offline processing method and system based on multiple computing engines | |
| CN114844957B (en) | Link message conversion method, device, equipment, storage medium and program product | |
| CN116527615A (en) | Instant messaging method, device, electronic equipment and storage medium | |
| CN116167835A (en) | Service processing method, device, electronic equipment and computer readable medium | |
| CN118210778A (en) | Database operation method, apparatus, device, storage medium, and program product | |
| CN114885026A (en) | Data interface request processing system, method, equipment and storage medium | |
| CN117827320A (en) | Service execution method, device, equipment and storage medium thereof | |
| CN117853246A (en) | Policy processing method, policy processing device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |