CN111158744A - Cross-platform heterogeneous data integration method and device - Google Patents
Cross-platform heterogeneous data integration method and device Download PDFInfo
- Publication number
- CN111158744A CN111158744A CN201911393115.0A CN201911393115A CN111158744A CN 111158744 A CN111158744 A CN 111158744A CN 201911393115 A CN201911393115 A CN 201911393115A CN 111158744 A CN111158744 A CN 111158744A
- Authority
- CN
- China
- Prior art keywords
- data
- sonar
- jenkins
- code scanning
- static code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000010354 integration Effects 0.000 title claims abstract description 64
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000010276 construction Methods 0.000 claims abstract description 115
- 230000003068 static effect Effects 0.000 claims abstract description 96
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012423 maintenance Methods 0.000 abstract description 11
- 238000004891 communication Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 8
- 238000012360 testing method Methods 0.000 description 6
- 239000000872 buffer Substances 0.000 description 4
- 238000004806 packaging method and process Methods 0.000 description 4
- 238000013500 data storage Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000007596 consolidation process Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
The application provides a method and a device for integrating cross-platform heterogeneous data, wherein the method comprises the following steps: receiving Jenkins construction data and Sonar static code scanning data; determining association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype, and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points; sending the integrated Jenkins construction data and Sonar static code scanning data to a target database; if a code quality query instruction is received, target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in a target database are output, a uniform external query interface can be provided, the query efficiency and safety of the code quality data are improved, and the code fault early warning and maintenance efficiency is improved.
Description
Technical Field
The present application relates to the field of persistent integration technologies, and in particular, to a method and an apparatus for integrating cross-platform heterogeneous data.
Background
Continuous Integration (CI) refers to the Continuous submission, Integration, and construction of code in the development of a project. Through continuous integration, codes on various scattered development machines are gathered together to carry out operations such as construction and packaging. In the continuous integration process, Jenkins is the most popular continuous integration tool, job is created on a Jenkins platform, the project codes of the version library can be pulled, and the operations of construction, testing, packaging, deployment and the like can be executed. The SonarQube/Sonar is a static code scanning tool popular in the industry, can support the scanning of a plurality of language codes and the statistics of quality data, and provides a friendly display interface and a data acquisition interface. Currently, Sonar can realize the combination of Jenkins and Sonar by installing a SonarQube Scanner for Jenkins plug-in on a Jenkins platform. The basic mode of operation is shown in figure 1. Jenkins do not have database storage and cannot store historical information. And the Sonar information is written into the own database.
The project code is constructed in a Jenkins jobform, and Sonar static code scanning is executed as a step in the construction process, wherein static code scanning refers to directly scanning the code without compiling relative to dynamic code scanning, and mainly checks code normative and security, searches bugs and defects and the like. After the Sonar scanning succeeds, the information is written into an independent Sonar database (not directly related to Jenkins), and meanwhile, an information display page is generated on a Sonar platform and a corresponding url is generated. The url is provided on the Jenkins build page, linking to the Sonar page view.
The storage structures of Sonar and Jenkins are different, and the user interfaces are independent, so that although Sonar can be accessed from Jenkins, the Sonar and Jenkins are still two independent storage and presentation systems, and data cannot be collected and viewed from a unified entry. Jenkins only store information constructed for the last few times, and do not store all historical information, and the prior art only reads the information acquired after Jenkins themselves and cannot acquire historical data. In the aspect of Sonar, the conventional scheme is equivalent to that a Sonar database is exposed in a code, authority verification (login verification) is not needed when data is acquired, and the security is poor; the self-written interface is easy to damage the database structure or write error data, and the robustness of the self-written interface is difficult to reach the standard. The data of Sonar and Jenkins are heterogeneous and separated, and cannot be related together to be viewed uniformly.
Disclosure of Invention
Aiming at the problems in the prior art, the application provides a method and a device for integrating cross-platform heterogeneous data, which can provide a uniform external query interface, improve the efficiency and the safety of code quality data query, and further improve the efficiency of code fault early warning and maintenance.
In order to solve the technical problem, the present application provides the following technical solutions:
in a first aspect, the present application provides a method for integrating cross-platform heterogeneous data, including:
receiving Jenkins construction data and Sonar static code scanning data;
determining association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype, and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points;
sending the integrated Jenkins construction data and Sonar static code scanning data to a target database;
and if a code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
Further, the outputting of target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database includes: and displaying target Jenkins construction data corresponding to the code quality query instruction in the target database and target Sonar static code scanning data on the same output interface.
Further, the determining, according to the Jenkins jobtype, the association point of the Jenkins construction data and the Sonar static code scanning data, and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association point includes: integrating Jenkins construction data and Sonar static code scanning data which are the same in Jenkins jobtype into the same integration data based on the association points; correspondingly, the step of sending the integrated Jenkins construction data and Sonar static code scanning data to a target database comprises the following steps: storing each of the consolidated data into the target database.
Further, the receiving Jenkins construction data and Sonar static code scanning data comprises: and receiving Jenkins construction data collected by the custom Jenkins plug-in and Sonar static code scanning data collected by the Sonar interface.
In a second aspect, the present application provides an apparatus for integrating cross-platform heterogeneous data, including:
the receiving module is used for receiving Jenkins construction data and Sonar static code scanning data;
the data integration module is used for determining the association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points;
the sending module is used for sending the integrated Jenkins construction data and Sonar static code scanning data to a target database;
and the output module is used for outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database if the code quality query instruction is received.
Further, the output module includes: and the output display unit is used for displaying the target Jenkins construction data and the target Sonar static code scanning data corresponding to the code quality query instruction in the target database on the same output interface.
Further, the data integration module includes: the integration unit is used for integrating Jenkins construction data and Sonar static code scanning data which are the same in Jenkins jobtype into the same integration data based on the association points; correspondingly, the sending module includes: and the storage unit is used for storing each integrated data into the target database.
Further, the receiving module includes: and the receiving unit is used for receiving Jenkins construction data acquired by the user-defined Jenkins plug-in and Sonar static code scanning data acquired by the Sonar interface.
In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method for integrating cross-platform heterogeneous data when executing the program.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon computer instructions which, when executed, implement the steps of the method for integrating cross-platform heterogeneous data.
According to the technical scheme, the application provides a method and a device for integrating cross-platform heterogeneous data. Wherein, the method comprises the following steps: receiving Jenkins construction data and Sonar static code scanning data; determining association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype, and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points; sending the integrated Jenkins construction data and Sonar static code scanning data to a target database; if a code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in a target database, respectively acquiring data of two different sources and different structures, then integrating the data together to realize cross-platform heterogeneous data integration, providing a uniform external query interface, improving the efficiency and safety of code quality data query, and further improving the efficiency of code fault early warning and maintenance, specifically, a Jenkins plugin can capture historical construction information along with each task (job) construction execution, and stores the captured historical construction information in a third-party database to make up the shortage of Jenkins construction data storage in the prior art, wherein the third-party database is an integrated database; in addition, by calling the Sonar interface, the Sonar static code scanning data can be acquired and written into a table of a third-party database on the premise of ensuring the safety, not exposing and not damaging the original Sonar database, so that the robustness of the system is improved; the data are written into a third-party database to form a layer of package, integration of data of different sources and different structures is achieved, storage of two kinds of data, particularly storage of Jenkins construction data, can be optimized, a layer of package is formed, a user can conveniently obtain integrated information, code fault conditions can be monitored in real time, and code fault early warning and maintenance efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of the operational mode of a continuous integration process in the prior art;
FIG. 2 is a schematic flowchart of a method for integrating cross-platform heterogeneous data according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating a method for integrating cross-platform heterogeneous data according to another embodiment of the present application;
FIG. 4 is a schematic structural diagram of an apparatus for integrating cross-platform heterogeneous data in an embodiment of the present application;
FIG. 5 is a schematic block diagram of a method for integrating cross-platform heterogeneous data in an exemplary embodiment of the present application;
fig. 6 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Based on this, in order to provide a uniform external query interface, improve the efficiency and the security of code quality data query, and further improve the efficiency of code fault early warning and maintenance, an embodiment of the present application provides an integration apparatus for cross-platform heterogeneous data, which may be a client device, where the client device may include a smart phone, a tablet electronic device, a network set-top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), a vehicle-mounted device, an intelligent wearable device, and the like. Wherein, intelligence wearing equipment can include intelligent glasses, intelligent wrist-watch and intelligent bracelet etc..
In practical applications, the part of performing the integration of the cross-platform heterogeneous data may be completed in the client device. The selection may be specifically performed according to the processing capability of the client device, the limitation of the user usage scenario, and the like. This is not a limitation of the present application. The client device may further include a processor if all operations are performed in the client device.
The client device may have a communication module (i.e., a communication unit), and may be communicatively connected to a remote server to implement data transmission with the server. The server may include a server on the task scheduling center side, and in other implementation scenarios, the server may also include a server on an intermediate platform, for example, a server on a third-party server platform that is communicatively linked to the task scheduling center server. The server may include a single computer device, or may include a server cluster formed by a plurality of servers, or a server structure of a distributed apparatus.
The server and the client device may communicate using any suitable network protocol, including network protocols not yet developed at the filing date of this application. The network protocol may include, for example, a TCP/IP protocol, a UDP/IP protocol, an HTTP protocol, an HTTPS protocol, or the like. Of course, the network Protocol may also include, for example, an RPC Protocol (Remote Procedure Call Protocol), a REST Protocol (Representational State Transfer Protocol), and the like used above the above Protocol.
The following examples are intended to illustrate the details.
In order to provide a uniform external query interface, improve the efficiency and security of code quality data query, and further improve the efficiency of code fault early warning and maintenance, this embodiment provides an integration method of cross-platform heterogeneous data, in which the execution subject is an integration device of cross-platform heterogeneous data, and referring to fig. 2, the method specifically includes the following contents:
step 100: jenkins construction data and Sonar static code scanning data are received.
Specifically, Jenkins construction data acquired through a self-defined Jenkins plug-in and Sonar static code scanning data acquired through a Sonar interface are received. The Jenkins construction data comprises: the construction time, the code base submission information, the construction result, the output and the like can be written into an xml file; the Sonar static code scanning data can be obtained by statically scanning the Jenkins construction data, and are stored in a Sonar database corresponding to the Sonar platform, wherein the Sonar database can be a mysql database and is not directly related to the Jenkins platform.
Step 200: and determining the association point of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype, and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association point.
Specifically, matching Jenkins jobbased on the association points of Jenkins construction data and Sonar static code scanning data, and integrating Jenkins construction data and Sonar static code scanning data constructed each time to form a uniform external output structure; the Jenkins jobtypes of the same construction task are the same.
Step 300: and sending the integrated Jenkins construction data and Sonar static code scanning data to a target database.
Specifically, the integrated Jenkins construction data and Sonar static code scanning data are data related to the quality of target software.
Step 400: and if a code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
Specifically, the code quality query instruction may be collected via an output interface; the target Jenkins construction data and the target Sonar static code scanning data are integrated Jenkins construction data and Sonar static codes corresponding to the code quality query instruction.
In a specific application example of the present application, the method for integrating cross-platform heterogeneous data includes:
s001: a code build task start request of the target financial software is received.
S002: code packaging and constructing the target financial software to obtain construction information, and writing the construction information into an xml file, wherein the construction information comprises: the time of the target financial software code construction, code library submission information, construction results, output and the like.
S003: and scanning the static code of the construction information to obtain static code scanning data.
S004: and integrating the construction information and the static code scanning data in the same code construction task into code quality data.
S005: and sending the quality data of each code to a target database.
S006: and if a code quality query instruction is received, outputting target code quality data corresponding to the code quality query instruction in the target database to display the software quality condition of the target financial software.
The target code quality data is quality data generated in the continuous code integration process, and the quality data contains test data.
To further improve the efficiency of code quality query and the degree of visualization, in an embodiment of the present application, step 400 includes:
step 401: and displaying target Jenkins construction data corresponding to the code quality query instruction in the target database and target Sonar static code scanning data on the same output interface.
Specifically, the target Jenkins construction data and the target Sonar static code scanning data corresponding to the code quality query instruction are output to an integrated information display interface, so that the data can be uniformly processed and checked. The state of the code can be determined according to the target Jenkins construction data and the target Sonar static code scanning data displayed on the output interface, whether normative and safety problems exist or not, bugs, defects, potential faults and the like exist, the code fault early warning efficiency is further improved, and fault codes are timely processed according to fault early warning information.
In order to save the memory space and the cost of code testing on the basis of improving the efficiency and security of code quality query, referring to fig. 3, in an embodiment of the present application, step 200 includes:
step 201: integrating the Jenkins construction data and the Sonar static code scanning data with the same Jenkins jobtype into the same integration data based on the association points.
In particular, the consolidated data may be code test results. Correspondingly, step 300 includes:
step 301: storing each of the consolidated data into the target database.
Specifically, if a code quality query instruction is received, target integration data corresponding to the code quality query instruction in the target database is output, and the target integration data are target Jenkins construction data and target Sonar static code scanning data.
In order to improve the reliability of acquiring Jenkins construction data on the basis of improving the code quality query efficiency, in an embodiment of the present application, step 100 includes:
step 101: and receiving Jenkins construction data collected by the custom Jenkins plug-in and Sonar static code scanning data collected by the Sonar interface.
Specifically, the custom Jenkins plug-in can be set according to actual conditions, which is not limited in this application. The Sonar interface may be an interface (API) provided by Sonar officials.
In terms of software, in order to provide a uniform external query interface, improve efficiency and security of code quality data query, and further improve efficiency of code fault early warning and maintenance, an embodiment of the present application provides an integration apparatus for implementing all or part of cross-platform heterogeneous data in the integration method for cross-platform heterogeneous data, see fig. 4, where the integration apparatus for cross-platform heterogeneous data specifically includes the following contents:
the receiving module 10 is used for receiving Jenkins construction data and Sonar static code scanning data;
the data integration module 20 is configured to determine association points of the Jenkins construction data and the Sonar static code scanning data according to Jenkins jobtype, and perform data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points;
the sending module 30 is used for sending the integrated Jenkins construction data and Sonar static code scanning data to a target database;
and the output module 40 is configured to output target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database if the code quality query instruction is received.
In one embodiment of the present application, the output module 40 includes:
and the output display unit 41 is configured to display the target Jenkins construction data and the target Sonar static code scanning data corresponding to the code quality query instruction in the target database on the same output interface.
In an embodiment of the present application, the data integration module 20 includes:
and the integration unit is used for integrating the Jenkins construction data and the Sonar static code scanning data which are the same in Jenkins jobtype into the same integration data based on the association points.
Correspondingly, the sending module includes: and the storage unit is used for storing each integrated data into the target database.
In an embodiment of the present application, the receiving module includes: and the receiving unit is used for receiving Jenkins construction data acquired by the user-defined Jenkins plug-in and Sonar static code scanning data acquired by the Sonar interface.
The embodiment of the apparatus for integrating cross-platform heterogeneous data provided in this specification may be specifically configured to execute the processing procedure of the embodiment of the method for integrating cross-platform heterogeneous data, and the functions of the apparatus are not described herein again, and reference may be made to the detailed description of the embodiment of the method for integrating cross-platform heterogeneous data.
As can be seen from the above description, the embodiments of the present application provide a method and an apparatus for integrating cross-platform heterogeneous data, which can improve the efficiency and the security of providing a uniform external query interface, and improve the efficiency of code quality data query, thereby improving the efficiency of code fault early warning and maintenance; specifically, the visualization degree of a code test result can be improved, the memory space and the code test cost are saved, and the reliability of acquiring Jenkins construction data can be improved on the basis of ensuring the code quality query efficiency.
In order to further explain the scheme, the application also provides a specific application example of the method and the device for integrating the cross-platform heterogeneous data in software quality assurance.
In this specific application example, the device for integrating cross-platform heterogeneous data in software quality assurance includes: the system comprises a Jenkins data acquisition module, a Sonar data Sonar acquisition module and a data integration module.
And the Jenkins data acquisition module is used for reading the xml construction information and writing the xml construction information into the integration library.
And the Sonar data Sonar acquisition module is used for reading the information of the Sonar data Sonar library and writing the information into the integration library.
And the data integration module is used for providing an API (application program interface) (namely a unified external interface) for acquiring the information after the warehousing integration.
With reference to the above device for integrating cross-platform heterogeneous data in software quality assurance, referring to fig. 5, in this specific application example, the method for integrating cross-platform heterogeneous data in software quality assurance is specifically described as follows:
s1: acquiring Jenkins data of an xml structure by using a Jenkins plug-in; and acquiring the data stored in the database by calling the Sonar _ API.
Specifically, the Jenkins data acquisition module reads xml information through a Jenkins plug-in; the Sonar data Sonar acquisition module acquires Sonar information through the Sonar _ API; that is to say, can read Jenkins through Jenkins data acquisition module and construct the information, obtain the total Jenkins and construct the information.
S2: and (5) data matching, and performing data association on the same jobs.
Specifically, the original data is sent to a data integration module for data matching and integration, that is, the information association of the same joba is completed in the step, and the heterogeneous data of the two sources are merged together and stored. That is to say, the data integration module matches through the association points of the Sonar and the Jenkins information and the Jenkins jobs, and the constructed information is integrated together every time to form a unified external output structure.
S3: and (7) warehousing.
Specifically, the information read by the Jenkins data acquisition module and the Sonar data Sonar acquisition module is written into the integration database.
S4: an interface is provided to the outside.
In particular, the consolidation database provides an API for obtaining data. The external interface is not necessary for each time, because the original information and the integrated data structure acquired each time are the same, the subsequent multiple executions may only add information with the same structure, and the mode is the same, so the API provided for the external is not changed.
Further, after step S4, the method further includes: a user interface is accessed.
Specifically, an interactive interface (such as a data dashboard) is provided, an API provided by the integration database is called, and data is displayed to a user; customized data presentation interfaces can be provided, so that a user does not need to access native result presentation pages of Jenkins and Sonar platforms respectively.
As can be seen from the above description, the specific application example obtains Jenkins construction data Jenkins (xml storage) through a custom Jenkins plug-in; sonar static code scan data (database store, such as mysql) is obtained through the Sonar _ API, and then the two types of data are integrated and stored in a new database. If the data is to be viewed, the information in the integrated database can be read to perform higher-level operations, such as constructing an integrated information display page (instead of viewing the data separately using the original Jenkins and Sonar pages). The deficiency of Jenkins data storage can be made up, and historical construction information is stored into a third-party database; the Sonar information can be acquired and written into a third-party database on the premise of ensuring safety, not exposing and not destroying the original Sonar database by calling the form of the Sonar official API. The information can be written into a table of an integrated database, the information and the table can be optimized, particularly the data storage of Jenkins can be optimized, a layer of packaging is formed, and a user can conveniently obtain integrated information.
In terms of hardware, in order to provide a uniform external query interface, improve efficiency and security of code quality data query, and further improve efficiency of code fault early warning and maintenance, the present application provides an embodiment of an electronic device for implementing all or part of contents in the method for integrating cross-platform heterogeneous data, where the electronic device specifically includes the following contents:
a processor (processor), a memory (memory), a communication Interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for realizing information transmission between the cross-platform heterogeneous data integration device and relevant equipment such as a user terminal; the electronic device may be a desktop computer, a tablet computer, a mobile terminal, and the like, but the embodiment is not limited thereto. In this embodiment, the electronic device may be implemented with reference to the embodiment of the method for implementing integration of cross-platform heterogeneous data and the embodiment of the apparatus for implementing integration of cross-platform heterogeneous data in the embodiment, and the contents thereof are incorporated herein, and repeated details are not repeated here.
Fig. 6 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 6, the electronic device 9600 can include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this FIG. 6 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.
In one or more embodiments of the present application, the integrated configuration functionality of the cross-platform heterogeneous data may be integrated into the central processor 9100. The central processor 9100 may be configured to control as follows:
step 100: jenkins construction data and Sonar static code scanning data are received.
Step 200: and determining the association point of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype, and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association point.
Step 300: and sending the integrated Jenkins construction data and Sonar static code scanning data to a target database.
Step 400: and if a code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
As can be seen from the above description, the electronic device provided in the embodiment of the present application can provide a uniform external query interface, so as to improve the efficiency and the security of code quality data query, and further improve the efficiency of code fault early warning and maintenance.
In another embodiment, the integration device of the cross-platform heterogeneous data may be configured separately from the central processor 9100, for example, the integration device of the cross-platform heterogeneous data may be configured as a chip connected to the central processor 9100, and the integration function of the cross-platform heterogeneous data is realized through the control of the central processor.
As shown in fig. 6, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 also does not necessarily include all of the components shown in fig. 6; further, the electronic device 9600 may further include components not shown in fig. 6, which may be referred to in the art.
As shown in fig. 6, a central processor 9100, sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device, which central processor 9100 receives input and controls the operation of the various components of the electronic device 9600.
The memory 9140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to realize information storage or processing, or the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.
The memory 9140 can be a solid state memory, e.g., Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 9140 could also be some other type of device. Memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 being used for storing application programs and function programs or for executing a flow of operations of the electronic device 9600 by the central processor 9100.
The memory 9140 can also include a data store 9143, the data store 9143 being used to store data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers for the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, contact book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing ordinary telecommunications functions. The audio processor 9130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording locally through the microphone 9132 and enabling locally stored sounds to be played through the speaker 9131.
As can be seen from the above description, the electronic device provided in the embodiment of the present application can provide a uniform external query interface, so as to improve the efficiency and the security of code quality data query, and further improve the efficiency of code fault early warning and maintenance.
Embodiments of the present application further provide a computer-readable storage medium capable of implementing all steps in the method for integrating cross-platform heterogeneous data in the foregoing embodiments, where the computer-readable storage medium stores a computer program, and the computer program, when executed by a processor, implements all steps of the method for integrating cross-platform heterogeneous data in the foregoing embodiments, for example, the processor implements the following steps when executing the computer program:
step 100: jenkins construction data and Sonar static code scanning data are received.
Step 200: and determining the association point of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype, and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association point.
Step 300: and sending the integrated Jenkins construction data and Sonar static code scanning data to a target database.
Step 400: and if a code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
As can be seen from the above description, the computer-readable storage medium provided in the embodiment of the present application can provide a uniform external query interface, so as to improve the efficiency and the security of querying code quality data, and further improve the efficiency of early warning and maintaining code faults.
In the present application, each embodiment of the method is described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. Reference is made to the description of the method embodiments.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the present application are explained by applying specific embodiments in the present application, and the description of the above embodiments is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (10)
1. A method for integrating cross-platform heterogeneous data is characterized by comprising the following steps:
receiving Jenkins construction data and Sonar static code scanning data;
determining association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype, and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points;
sending the integrated Jenkins construction data and Sonar static code scanning data to a target database;
and if a code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
2. The method for integrating cross-platform heterogeneous data according to claim 1, wherein the outputting of target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database comprises:
and displaying target Jenkins construction data corresponding to the code quality query instruction in the target database and target Sonar static code scanning data on the same output interface.
3. The method for integrating cross-platform heterogeneous data according to claim 1, wherein the determining association points of the Jenkins construction data and the Sonar static code scanning data according to Jenkins jobtype and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points comprises:
integrating Jenkins construction data and Sonar static code scanning data which are the same in Jenkins jobtype into the same integration data based on the association points;
correspondingly, the step of sending the integrated Jenkins construction data and Sonar static code scanning data to a target database comprises the following steps:
storing each of the consolidated data into the target database.
4. The method for integrating cross-platform heterogeneous data according to claim 1, wherein the receiving Jenkins construction data and Sonar static code scanning data comprises: and receiving Jenkins construction data collected by the custom Jenkins plug-in and Sonar static code scanning data collected by the Sonar interface.
5. An apparatus for integrating cross-platform heterogeneous data, comprising:
the receiving module is used for receiving Jenkins construction data and Sonar static code scanning data;
the data integration module is used for determining the association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins jobtype and performing data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points;
the sending module is used for sending the integrated Jenkins construction data and Sonar static code scanning data to a target database;
and the output module is used for outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database if the code quality query instruction is received.
6. The device for integrating cross-platform heterogeneous data according to claim 5, wherein the output module comprises:
and the output display unit is used for displaying the target Jenkins construction data and the target Sonar static code scanning data corresponding to the code quality query instruction in the target database on the same output interface.
7. The device for integrating cross-platform heterogeneous data according to claim 5, wherein the data integration module comprises:
the integration unit is used for integrating Jenkins construction data and Sonar static code scanning data which are the same in Jenkins jobtype into the same integration data based on the association points;
correspondingly, the sending module includes:
and the storage unit is used for storing each integrated data into the target database.
8. The device for integrating cross-platform heterogeneous data according to claim 5, wherein the receiving module comprises:
and the receiving unit is used for receiving Jenkins construction data acquired by the user-defined Jenkins plug-in and Sonar static code scanning data acquired by the Sonar interface.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the steps of the method for integrating cross-platform heterogeneous data according to any one of claims 1 to 4.
10. A computer readable storage medium having stored thereon computer instructions, wherein said instructions when executed perform the steps of the method of integrating cross-platform heterogeneous data of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911393115.0A CN111158744B (en) | 2019-12-30 | 2019-12-30 | Cross-platform heterogeneous data integration method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911393115.0A CN111158744B (en) | 2019-12-30 | 2019-12-30 | Cross-platform heterogeneous data integration method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111158744A true CN111158744A (en) | 2020-05-15 |
| CN111158744B CN111158744B (en) | 2024-02-23 |
Family
ID=70559428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911393115.0A Active CN111158744B (en) | 2019-12-30 | 2019-12-30 | Cross-platform heterogeneous data integration method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111158744B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095408A (en) * | 2016-05-31 | 2016-11-09 | 浙江网新恒天软件有限公司 | A kind of system and method for data monitoring and Code automatic build and deployment |
| US20180082233A1 (en) * | 2016-09-21 | 2018-03-22 | Cognizant Technology Solutions India Pvt. Ltd. | System and method for automatically and efficiently monitoring software development life cycles |
| CN108984174A (en) * | 2018-07-03 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Cross-platform application creation method, device, server and storage medium |
| CN109241735A (en) * | 2018-09-27 | 2019-01-18 | 四川长虹电器股份有限公司 | A kind of continuous integrating method based on vulnerability scanning platform |
| CN109634612A (en) * | 2018-12-04 | 2019-04-16 | 浙江数链科技有限公司 | Continuous integrating method, system, computer equipment and storage medium |
| CN109739507A (en) * | 2018-12-28 | 2019-05-10 | 睿驰达新能源汽车科技（北京）有限公司 | A kind of code continuous integrating method and code continue delivery method |
| CN109783086A (en) * | 2018-12-14 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Application and development method, terminal device and medium based on continuous integrating platform |
-
2019
- 2019-12-30 CN CN201911393115.0A patent/CN111158744B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095408A (en) * | 2016-05-31 | 2016-11-09 | 浙江网新恒天软件有限公司 | A kind of system and method for data monitoring and Code automatic build and deployment |
| US20180082233A1 (en) * | 2016-09-21 | 2018-03-22 | Cognizant Technology Solutions India Pvt. Ltd. | System and method for automatically and efficiently monitoring software development life cycles |
| CN108984174A (en) * | 2018-07-03 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Cross-platform application creation method, device, server and storage medium |
| CN109241735A (en) * | 2018-09-27 | 2019-01-18 | 四川长虹电器股份有限公司 | A kind of continuous integrating method based on vulnerability scanning platform |
| CN109634612A (en) * | 2018-12-04 | 2019-04-16 | 浙江数链科技有限公司 | Continuous integrating method, system, computer equipment and storage medium |
| CN109783086A (en) * | 2018-12-14 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Application and development method, terminal device and medium based on continuous integrating platform |
| CN109739507A (en) * | 2018-12-28 | 2019-05-10 | 睿驰达新能源汽车科技（北京）有限公司 | A kind of code continuous integrating method and code continue delivery method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111158744B (en) | 2024-02-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107133180B (en) | Dynamic page testing method, testing device and storage medium | |
| CN110908875B (en) | Inspection method and device based on operation terminal | |
| CN110990228A (en) | Data interface monitoring method and device | |
| CN110764881A (en) | Distributed system background retry method and device | |
| CN112463634A (en) | Software testing method and device under micro-service architecture | |
| CN113157345A (en) | Automatic starting method and device for front-end engineering | |
| CN114138372A (en) | Front-end component loading method and device | |
| CN112729868A (en) | Vehicle diagnosis method, device, equipment and medium | |
| CN113342330A (en) | Front-end engineering generation method and device | |
| CN111367561B (en) | Remote development method and device for software program | |
| CN111767558A (en) | Data access monitoring method, device and system | |
| CN110427260B (en) | Host job scheduling method, device and system | |
| CN104836820A (en) | Method and system for client interaction, and client terminals | |
| CN111158744B (en) | Cross-platform heterogeneous data integration method and device | |
| CN113110829B (en) | Multi-UI component library data processing method and device | |
| CN114285657A (en) | Firewall security policy change verification method and device | |
| CN113434423A (en) | Interface test method and device | |
| CN113791984A (en) | Automatic interface testing method and device | |
| CN113050985A (en) | Front-end engineering dependence automatic registration method and device | |
| CN113626158A (en) | Event agent-based embedded point execution method and device | |
| CN113050936A (en) | Front-end data processing method and device based on integrated development environment | |
| CN111078209B (en) | Development processing method, device and equipment for business page | |
| CN113110828A (en) | Front-end prototype debugging method and device | |
| KR101318345B1 (en) | System and Method for Micro-page Provision | |
| CN115293906A (en) | Transaction recording and playing method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |