CN111158744B - Cross-platform heterogeneous data integration method and device - Google Patents
Cross-platform heterogeneous data integration method and device Download PDFInfo
- Publication number
- CN111158744B CN111158744B CN201911393115.0A CN201911393115A CN111158744B CN 111158744 B CN111158744 B CN 111158744B CN 201911393115 A CN201911393115 A CN 201911393115A CN 111158744 B CN111158744 B CN 111158744B
- Authority
- CN
- China
- Prior art keywords
- data
- jenkins
- sonar
- static code
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000010354 integration Effects 0.000 title claims description 62
- 238000010276 construction Methods 0.000 claims abstract description 112
- 230000003068 static effect Effects 0.000 claims abstract description 97
- 238000004590 computer program Methods 0.000 claims description 13
- 238000012423 maintenance Methods 0.000 abstract description 12
- 230000000875 corresponding effect Effects 0.000 description 18
- 238000004891 communication Methods 0.000 description 17
- 230000006870 function Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 8
- 238000012360 testing method Methods 0.000 description 6
- 238000013500 data storage Methods 0.000 description 5
- 239000000872 buffer Substances 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 238000004806 packaging method and process Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002459 sustained effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application provides a method and a device for integrating cross-platform heterogeneous data, wherein the method comprises the following steps: receiving Jenkins construction data and Sonar static code scanning data; determining association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and integrating the Jenkins construction data and the Sonar static code scanning data based on the association points; the integrated Jenkins construction data and the Sonar static code scanning data are sent to a target database; if the code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database, and providing a unified external query interface, so that the efficiency and the safety of code quality data query are improved, and further the efficiency of code fault early warning and maintenance is improved.
Description
Technical Field
The present disclosure relates to the field of continuous integration technologies, and in particular, to a method and an apparatus for integrating cross-platform heterogeneous data.
Background
Sustained integration (Continuous Integration, CI for short) refers to sustained code submission, integration, and construction in project development. Through continuous integration, codes on various scattered development machines are gathered together to perform operations such as construction, packaging and the like. In the continuous integration process, jenkins is a popular continuous integration tool, jobs are created on a Jenkins platform, project codes of a version library can be pulled, and operations such as construction, testing, packaging, deployment and the like can be performed. The SonarQube/Sonar is a popular static code scanning tool in the industry, can support scanning of multiple language codes and quality data statistics, and provides a friendly display interface and a data acquisition interface. Currently, sonar can realize the combination of Jenkins and Sonar by installing SonarQube Scanner for Jenkins plug-ins on a Jenkins platform. The basic operation mode is shown in fig. 1. Jenkins themselves have no database storage and cannot store history information. And Sonar's information is written into its own database.
The project code is constructed in a Jenkins job form, and Sonar static code scanning is executed as one step in the construction process, wherein static code scanning refers to directly scanning the code without compiling relative to dynamic code scanning, and mainly checking normalization and security of the code, finding loopholes, defects and the like. After the Sonar scanning is successful, the information is written into a separate Sonar database (which is not directly related to Jenkins), and meanwhile, an information display page is also generated on a Sonar platform, and corresponding url is generated. The url is provided on the Jenkins build page, linked to the Sonar page view.
The Sonar and Jenkins data storage structures are different and the user interface is also independent, although Sonar is accessible from Jenkins, they are still two independent storage and presentation systems and therefore cannot collect and view data from a unified portal. Jenkins only stores information constructed in the last few times, but not all historical information, and the prior art only reads information acquired after Jenkins is self, so that historical data cannot be acquired. In terms of Sonar, the existing scheme is equivalent to exposing a Sonar database in a code, and does not need permission verification (login verification) when acquiring data, so that the security is poor; the self-writing interface is easy to destroy the database structure or write error data, and the robustness of the self-writing interface is hard to reach the standard. The data of Sonar and Jenkins are heterogeneous and separate and cannot be correlated together for unified viewing.
Disclosure of Invention
Aiming at the problems in the prior art, the application provides a method and a device for integrating cross-platform heterogeneous data, which can provide a uniform external query interface, improve the efficiency and the safety of code quality data query, and further improve the efficiency of code fault early warning and maintenance.
In order to solve the technical problems, the application provides the following technical scheme:
in a first aspect, the present application provides a method for integrating cross-platform heterogeneous data, including:
receiving Jenkins construction data and Sonar static code scanning data;
determining association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and carrying out data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points;
the integrated Jenkins construction data and the Sonar static code scanning data are sent to a target database;
and if the code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
Further, the outputting the target Jenkins construction data and the target Sonar static code scanning data corresponding to the code quality query instruction in the target database includes: and displaying the target Jenkins construction data corresponding to the code quality inquiry instruction in the target database and the target Sonar static code scanning data on the same output interface.
Further, determining the association point of the Jenkins construction data and the Sonar static code scan data according to the Jenkins job type, and performing data integration on the Jenkins construction data and the Sonar static code scan data based on the association point, including: based on the association points, integrating the Jenkins construction data and the Sonar static code scanning data with the same Jenkins job type into the same integration data; correspondingly, the sending the integrated Jenkins construction data and the Sonar static code scanning data to the target database includes: and storing each integrated data into the target database.
Further, the receiving Jenkins build data and Sonar static code scan data includes: and receiving the Jenkins constructed data collected by the custom Jenkins plug-in and the Sonar static code scanning data collected by the Sonar interface.
In a second aspect, the present application provides an integration apparatus for cross-platform heterogeneous data, including:
the receiving module is used for receiving the Jenkins construction data and the Sonar static code scanning data;
the data integration module is used for determining the association point of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and integrating the Jenkins construction data and the Sonar static code scanning data based on the association point;
the sending module is used for sending the integrated Jenkins construction data and the Sonar static code scanning data to the target database;
and the output module is used for outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality inquiry instruction in the target database if the code quality inquiry instruction is received.
Further, the output module includes: and the output display unit is used for displaying the target Jenkins construction data corresponding to the code quality inquiry instruction in the target database and the target Sonar static code scanning data on the same output interface.
Further, the data integration module includes: the integration unit is used for integrating the Jenkins construction data and the Sonar static code scanning data with the same Jenkins job type into the same integration data based on the association points; correspondingly, the sending module comprises: and the storage unit is used for storing each integrated data into the target database.
Further, the receiving module includes: the receiving unit is used for receiving the Jenkins constructed data collected by the Jenkins plug-in unit and the Sonar static code scanning data collected by the Sonar interface.
In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the steps of the method for integrating cross-platform heterogeneous data when the processor executes the program.
In a fourth aspect, the present application provides a computer readable storage medium having stored thereon computer instructions which when executed perform the steps of the method of integrating cross-platform heterogeneous data.
According to the technical scheme, the application provides a method and a device for integrating cross-platform heterogeneous data. Wherein the method comprises the following steps: receiving Jenkins construction data and Sonar static code scanning data; determining association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and carrying out data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points; the integrated Jenkins construction data and the Sonar static code scanning data are sent to a target database; if a code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database, respectively acquiring data of two different sources and different structures, and integrating the data together to realize cross-platform heterogeneous data integration, so that a unified external query interface can be provided, the efficiency and the safety of code quality data query are improved, and further the efficiency of code fault early warning and maintenance is improved, specifically, a Jenkins plug-in unit can capture historical construction information along with each task (job) construction execution, and the captured historical construction information is stored in a third-party database to make up for the defect of Jenkins construction data storage in the prior art, wherein the third-party database is an integrated database; in addition, by calling the Sonar interface, on the premise of ensuring the safety, not exposing and not damaging the original Sonar database, the Sonar static code scanning data can be obtained and written into the table of the third-party database, so that the robustness of the system is improved; the data is written into the third party database to form a layer of package, so that integration of data with different sources and different structures is realized, storage of two kinds of data can be optimized, particularly storage of Jenkins constructed data is formed, a layer of package is formed, a user can conveniently obtain integrated information, code fault conditions are monitored in real time, and the efficiency of code fault early warning and maintenance is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of the operational mode of a prior art continuous integration process;
FIG. 2 is a flow chart of a method for integrating cross-platform heterogeneous data according to an embodiment of the present application;
FIG. 3 is a flow chart of a method for integrating cross-platform heterogeneous data according to another embodiment of the present application;
FIG. 4 is a schematic structural diagram of an integration apparatus for cross-platform heterogeneous data according to an embodiment of the present application;
FIG. 5 is a schematic block diagram of a method for integrating cross-platform heterogeneous data in a specific application example of the present application;
fig. 6 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application.
Detailed Description
In order to better understand the technical solutions in the present specification, the following description will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
Based on this, in order to provide a unified external query interface, improve efficiency and security of code quality data query, and further improve efficiency of code fault early warning and maintenance, the embodiment of the application provides an integration device of cross-platform heterogeneous data, which may be a client device, where the client device may include a smart phone, a tablet electronic device, a network set top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), a vehicle-mounted device, an intelligent wearable device, and the like. Wherein, intelligent wearing equipment can include intelligent glasses, intelligent wrist-watch and intelligent bracelet etc..
In practical applications, the portion of integrating cross-platform heterogeneous data may be done in the client device. Specifically, the selection may be made according to the processing capability of the client device, and restrictions of the use scenario of the user. The present application is not limited in this regard. If all operations are performed in the client device, the client device may further include a processor.
The client device may have a communication module (i.e. a communication unit) and may be connected to a remote server in a communication manner, so as to implement data transmission with the server. The server may include a server on the side of the task scheduling center, and in other implementations may include a server of an intermediate platform, such as a server of a third party server platform having a communication link with the task scheduling center server. The server may include a single computer device, a server cluster formed by a plurality of servers, or a server structure of a distributed device.
Any suitable network protocol may be used for communication between the server and the client device, including those not yet developed at the filing date of this application. The network protocols may include, for example, TCP/IP protocol, UDP/IP protocol, HTTP protocol, HTTPS protocol, etc. Of course, the network protocol may also include, for example, RPC protocol (Remote Procedure Call Protocol ), REST protocol (Representational State Transfer, representational state transfer protocol), etc. used above the above-described protocol.
The following examples are presented in detail.
In order to provide a unified external query interface, improve the efficiency and security of code quality data query, and further improve the efficiency of code fault early warning and maintenance, the embodiment provides a method for integrating cross-platform heterogeneous data, where an execution subject is an integrating device of cross-platform heterogeneous data, see fig. 2, and the method specifically includes the following contents:
step 100: and receiving Jenkins construction data and Sonar static code scanning data.
Specifically, jenkins construction data obtained through a custom Jenkins plug-in and Sonar static code scanning data obtained through a Sonar interface are received. The Jenkins construction data comprises: the construction time, code library submitting information, construction results, output and the like can be written into an xml file; the Sonar static code scanning data can be obtained by static scanning of the Jenkins construction data, and are stored in a Sonar database corresponding to a Sonar platform, wherein the Sonar database can be a mysql database and is not directly related to the Jenkins platform.
Step 200: and determining the association point of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and carrying out data integration on the Jenkins construction data and the Sonar static code scanning data based on the association point.
Specifically, based on the association points of the Jenkins construction data and the Sonar static code scanning data, matching the Jenkins job, and integrating the Jenkins construction data and the Sonar static code scanning data constructed each time to form a unified external output structure; the Jenkins job types of the same construction task are the same.
Step 300: and sending the integrated Jenkins construction data and the Sonar static code scanning data to a target database.
Specifically, the integrated Jenkins construction data and Sonar static code scan data are data related to the quality of the target software.
Step 400: and if the code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
Specifically, the code quality query instruction may be collected via an output interface; the target Jenkins construction data and the target Sonar static code scanning data are integrated Jenkins construction data and Sonar static codes corresponding to the code quality inquiry instructions.
In a specific application example of the present application, the method for integrating cross-platform heterogeneous data includes:
s001: and receiving a code construction task starting request of the target financial software.
S002: code packaging and construction are carried out on the target financial software to obtain construction information, and the construction information is written into an xml file, wherein the construction information comprises the following steps: time for constructing the target financial software code, code library submitting information, construction results, output and the like.
S003: and carrying out static code scanning on the construction information to obtain static code scanning data.
S004: the construction information and static code scan data in the same code construction task are integrated into a code quality data.
S005: and sending each code quality data to a target database.
S006: and if the code quality inquiry instruction is received, outputting target code quality data corresponding to the code quality inquiry instruction in the target database so as to display the software quality condition of the target financial software.
The target code quality data is quality data generated in the continuous code integration process, and the quality data comprises test data.
In order to further improve the code quality query efficiency and the visualization degree, in one embodiment of the present application, step 400 includes:
step 401: and displaying the target Jenkins construction data corresponding to the code quality inquiry instruction in the target database and the target Sonar static code scanning data on the same output interface.
Specifically, the target Jenkins construction data and the target Sonar static code scanning data corresponding to the code quality query instruction are output to an integrated information display interface, so that unified processing and viewing of the data are facilitated. According to the target Jenkins construction data and the target Sonar static code scanning data displayed on the output interface, the state of the code can be determined, whether the code has standardability and safety problems, loopholes, defects, potential faults and the like or not is judged, and further the efficiency of code fault early warning is improved, and fault codes are processed timely according to fault early warning information.
In order to save memory space and cost of code testing based on improving efficiency and security of code quality query, referring to fig. 3, in one embodiment of the present application, step 200 includes:
step 201: based on the association points, the Jenkins construction data and the Sonar static code scanning data with the same Jenkins job type are integrated into the same integrated data.
In particular, the integration data may be code test results. Correspondingly, step 300 comprises:
step 301: and storing each integrated data into the target database.
Specifically, if a code quality query instruction is received, outputting target integration data corresponding to the code quality query instruction in the target database, wherein the target integration data is the target Jenkins construction data and the target Sonar static code scanning data.
In order to improve reliability of acquiring Jenkins construction data based on improving code quality query efficiency, in one embodiment of the present application, step 100 includes:
step 101: and receiving the Jenkins constructed data collected by the custom Jenkins plug-in and the Sonar static code scanning data collected by the Sonar interface.
Specifically, the custom Jenkins plug-in may be set according to practical situations, which is not limited in this application. The Sonar interface may be an interface (API) provided by the Sonar authority.
In order to provide a unified external query interface and improve the efficiency and security of code quality data query and further improve the efficiency of code fault early warning and maintenance, the embodiment of the application provides a cross-platform heterogeneous data integration device for implementing all or part of contents in the cross-platform heterogeneous data integration method, see fig. 4, where the cross-platform heterogeneous data integration device specifically includes the following contents:
the receiving module 10 is used for receiving the Jenkins construction data and the Sonar static code scanning data;
the data integration module 20 is configured to determine a point of association between the Jenkins build data and the Sonar static code scan data according to a Jenkins job type, and integrate the Jenkins build data and the Sonar static code scan data based on the point of association;
the sending module 30 is configured to send the integrated Jenkins construction data and the Sonar static code scan data to a target database;
and the output module 40 is configured to output the target Jenkins construction data and the target Sonar static code scan data corresponding to the code quality query instruction in the target database if the code quality query instruction is received.
In one embodiment of the present application, the output module 40 includes:
and the output display unit 41 is configured to display, on the same output interface, target Jenkins construction data and target Sonar static code scan data corresponding to the code quality query instruction in the target database.
In one embodiment of the present application, the data integration module 20 includes:
and the integration unit is used for integrating the Jenkins construction data and the Sonar static code scanning data with the same Jenkins job type into the same integration data based on the association points.
Correspondingly, the sending module comprises: and the storage unit is used for storing each integrated data into the target database.
In one embodiment of the present application, the receiving module includes: the receiving unit is used for receiving the Jenkins constructed data collected by the Jenkins plug-in unit and the Sonar static code scanning data collected by the Sonar interface.
The embodiment of the cross-platform heterogeneous data integration device provided in the present disclosure may be specifically used to execute the processing flow of the embodiment of the cross-platform heterogeneous data integration method, and the functions thereof are not described herein again, and may refer to the detailed description of the embodiment of the cross-platform heterogeneous data integration method.
As can be seen from the foregoing description, the embodiments of the present application provide a method and an apparatus for integrating cross-platform heterogeneous data, which can improve providing a unified external query interface, improve efficiency and security of code quality data query, and further improve efficiency of code fault early warning and maintenance; specifically, the method can also improve the visualization degree of the code test result, save the memory space and the cost of the code test, and improve the reliability of acquiring the Jenkins construction data on the basis of ensuring the code quality query efficiency.
In order to further explain the scheme, the application also provides a specific application example of the method and the device for integrating the cross-platform heterogeneous data in the software quality assurance.
In this specific application example, the device for integrating cross-platform heterogeneous data in the software quality assurance includes: the system comprises a Jenkins data acquisition module, a Sonar data Sonar acquisition module and a data integration module.
And the Jenkins data acquisition module is used for reading the xml construction information and writing the xml construction information into the integration library.
And the Sonar data Sonar acquisition module is used for reading the Sonar database information of the Sonar data and writing the information into the integration database.
And the data integration module is used for providing an API (i.e. a unified external interface) for acquiring the information after the warehousing integration.
Referring to fig. 5, in this specific application example, the method for integrating the cross-platform heterogeneous data in the software quality assurance is specifically described as follows:
s1: obtaining Jenkins data of an xml structure by using a Jenkins plug-in; by calling the sonar_api, the data stored in the database is acquired.
Specifically, the Jenkins data acquisition module reads xml information through a Jenkins plug-in; the Sonar data Sonar acquisition module acquires Sonar information through a Sonar_API; that is, the Jenkins construction information can be read through the Jenkins data acquisition module, and the full amount of Jenkins construction information is obtained.
S2: data matching and data association are carried out on the same job.
Specifically, the original data is sent to a data integration module for data matching and integration, that is, the information association of the same job is completed at this step, and heterogeneous data of two sources are merged together and stored. That is, the data integration module matches the Jenkins job through the association points of the Sonar and Jenkins information, and the information constructed each time is integrated together to form a unified external output structure.
S3: and (5) warehousing.
Specifically, the information read by the Jenkins data acquisition module and the Sonar data Sonar acquisition module is written into the integrated database.
S4: an interface is provided to the outside.
Specifically, the consolidated database provides an API for obtaining data. The externally provided interface is not necessary every time, because the original information and the integrated data structure acquired every time are the same, the subsequent multiple execution may be just to add information with the same structure, and the modes are the same, so that the externally provided API is unchanged.
Further, after step S4, the method further comprises: a user interface is accessed.
Specifically, providing an interactive interface (such as a data dashboard), calling an API provided by the integrated database, and showing data to a user; the customized data display interface can be provided, so that a user does not need to access the native result display pages of the Jenkins and Sonar platforms respectively.
From the above description, the specific application example obtains Jenkins construction data Jenkins (xml storage) through a custom Jenkins plug-in; sonar static code scan data (database store, such as mysql) is obtained through Sonar_API, and then the two types of data are integrated and placed into a new database for storage. If the data is to be viewed, the information of the integrated database can be read to perform higher-level operations, such as building an integrated information presentation page (instead of viewing the data with the original Jenkins and Sonar pages, respectively). The method can make up for the deficiency of Jenkins data storage, and store the construction information of the past time into a third party database; the method can acquire Sonar information and write the information into a third party database on the premise of ensuring safety, not exposing and not damaging the original database of Sonar by calling the form of the Sonar official API. The information can be written into a table of an integrated database, and the data storage of the information and the integrated database, especially the data storage of Jenkins, can be optimized to form a layer of package, so that the user can conveniently acquire the integrated information.
In order to provide a unified external query interface and improve the efficiency and safety of code quality data query and further improve the efficiency of code fault early warning and maintenance, the application provides an embodiment of an electronic device for realizing all or part of contents in the cross-platform heterogeneous data integration method, wherein the electronic device specifically comprises the following contents:
a processor (processor), a memory (memory), a communication interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete communication with each other through the bus; the communication interface is used for realizing information transmission between the cross-platform heterogeneous data integrating device and related equipment such as a user terminal; the electronic device may be a desktop computer, a tablet computer, a mobile terminal, etc., and the embodiment is not limited thereto. In this embodiment, the electronic device may be implemented with reference to an embodiment of the method for implementing the cross-platform heterogeneous data integration method and an embodiment of the device for implementing the cross-platform heterogeneous data integration device, and the contents thereof are incorporated herein and are not repeated here.
Fig. 6 is a schematic block diagram of a system configuration of an electronic device 9600 of an embodiment of the present application. As shown in fig. 6, the electronic device 9600 may include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this fig. 6 is exemplary; other types of structures may also be used in addition to or in place of the structures to implement telecommunications functions or other functions.
In one or more embodiments of the present application, the integrated configuration functionality of the cross-platform heterogeneous data may be integrated into the central processor 9100. The central processor 9100 may be configured to perform the following control:
step 100: and receiving Jenkins construction data and Sonar static code scanning data.
Step 200: and determining the association point of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and carrying out data integration on the Jenkins construction data and the Sonar static code scanning data based on the association point.
Step 300: and sending the integrated Jenkins construction data and the Sonar static code scanning data to a target database.
Step 400: and if the code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
From the above description, the electronic device provided by the embodiment of the application can provide a unified external query interface, so that the efficiency and the safety of code quality data query are improved, and further the efficiency of code fault early warning and maintenance is improved.
In another embodiment, the integration device of the cross-platform heterogeneous data may be configured separately from the central processor 9100, for example, the integration device of the cross-platform heterogeneous data may be configured as a chip connected to the central processor 9100, and the integration function of the cross-platform heterogeneous data is implemented under the control of the central processor.
As shown in fig. 6, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 need not include all of the components shown in fig. 6; in addition, the electronic device 9600 may further include components not shown in fig. 6, and reference may be made to the related art.
As shown in fig. 6, the central processor 9100, sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, which central processor 9100 receives inputs and controls the operation of the various components of the electronic device 9600.
The memory 9140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information about failure may be stored, and a program for executing the information may be stored. And the central processor 9100 can execute the program stored in the memory 9140 to realize information storage or processing, and the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. The power supply 9170 is used to provide power to the electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, but not limited to, an LCD display.
The memory 9140 may be a solid state memory such as Read Only Memory (ROM), random Access Memory (RAM), SIM card, etc. But also a memory which holds information even when powered down, can be selectively erased and provided with further data, an example of which is sometimes referred to as EPROM or the like. The memory 9140 may also be some other type of device. The memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 storing application programs and function programs or a flow for executing operations of the electronic device 9600 by the central processor 9100.
The memory 9140 may also include a data store 9143, the data store 9143 for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, address book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. A communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, as in the case of conventional mobile communication terminals.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, etc., may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and to receive audio input from the microphone 9132 to implement usual telecommunications functions. The audio processor 9130 can include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100 so that sound can be recorded locally through the microphone 9132 and sound stored locally can be played through the speaker 9131.
As can be seen from the above description, the electronic device provided by the embodiment of the present application can provide a unified external query interface, so as to improve the efficiency and security of code quality data query, and further improve the efficiency of code fault early warning and maintenance.
The present application also provides a computer readable storage medium capable of implementing all the steps in the method for integrating cross-platform heterogeneous data in the above embodiment, where the computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements all the steps in the method for integrating cross-platform heterogeneous data in the above embodiment, for example, the processor implements the following steps when executing the computer program:
step 100: and receiving Jenkins construction data and Sonar static code scanning data.
Step 200: and determining the association point of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and carrying out data integration on the Jenkins construction data and the Sonar static code scanning data based on the association point.
Step 300: and sending the integrated Jenkins construction data and the Sonar static code scanning data to a target database.
Step 400: and if the code quality query instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality query instruction in the target database.
As can be seen from the above description, the computer readable storage medium provided in the embodiments of the present application can provide a unified external query interface, so as to improve the efficiency and security of code quality data query, and further improve the efficiency of code fault early warning and maintenance.
All embodiments of the method are described in a progressive manner, and identical and similar parts of all embodiments are mutually referred to, and each embodiment mainly describes differences from other embodiments. For relevance, see the description of the method embodiments.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principles and embodiments of the present application are described herein with reference to specific examples, the description of which is only for the purpose of aiding in the understanding of the methods of the present application and the core ideas thereof; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.
Claims (8)
1. A method for integrating cross-platform heterogeneous data, comprising:
receiving Jenkins construction data and Sonar static code scanning data, wherein the Jenkins construction data comprises the following components: construction time, code library submitting information, construction results and output;
determining association points of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and carrying out data integration on the Jenkins construction data and the Sonar static code scanning data based on the association points;
the integrated Jenkins construction data and the Sonar static code scanning data are sent to a target database;
if a code quality inquiry instruction is received, outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality inquiry instruction in the target database;
the receiving Jenkins construction data and Sonar static code scan data includes: and receiving the Jenkins constructed data collected by the custom Jenkins plug-in and the Sonar static code scanning data collected by the Sonar interface.
2. The method for integrating cross-platform heterogeneous data according to claim 1, wherein said outputting target Jenkins construction data and target Sonar static code scan data corresponding to the code quality query instruction in the target database includes:
and displaying the target Jenkins construction data corresponding to the code quality inquiry instruction in the target database and the target Sonar static code scanning data on the same output interface.
3. The method for integrating cross-platform heterogeneous data according to claim 1, wherein determining a correlation point between the Jenkins build data and the Sonar static code scan data according to Jenkins job type, and performing data integration on the Jenkins build data and the Sonar static code scan data based on the correlation point, comprises:
based on the association points, integrating the Jenkins construction data and the Sonar static code scanning data with the same Jenkins job type into the same integration data;
correspondingly, the sending the integrated Jenkins construction data and the Sonar static code scanning data to the target database includes:
and storing each integrated data into the target database.
4. An integration apparatus for cross-platform heterogeneous data, comprising:
the receiving module is used for receiving Jenkins construction data and Sonar static code scanning data, wherein the Jenkins construction data comprises: construction time, code library submitting information, construction results and output;
the data integration module is used for determining the association point of the Jenkins construction data and the Sonar static code scanning data according to the Jenkins job type, and integrating the Jenkins construction data and the Sonar static code scanning data based on the association point;
the sending module is used for sending the integrated Jenkins construction data and the Sonar static code scanning data to the target database;
the output module is used for outputting target Jenkins construction data and target Sonar static code scanning data corresponding to the code quality inquiry instruction in the target database if the code quality inquiry instruction is received;
the receiving module includes:
the receiving unit is used for receiving the Jenkins constructed data collected by the Jenkins plug-in unit and the Sonar static code scanning data collected by the Sonar interface.
5. The apparatus for integrating cross-platform heterogeneous data according to claim 4, wherein the output module comprises:
and the output display unit is used for displaying the target Jenkins construction data corresponding to the code quality inquiry instruction in the target database and the target Sonar static code scanning data on the same output interface.
6. The device for integrating cross-platform heterogeneous data according to claim 4, wherein the data integration module comprises:
the integration unit is used for integrating the Jenkins construction data and the Sonar static code scanning data with the same Jenkins job type into the same integration data based on the association points;
correspondingly, the sending module comprises:
and the storage unit is used for storing each integrated data into the target database.
7. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method of integrating cross-platform heterogeneous data according to any of claims 1 to 3 when the program is executed by the processor.
8. A computer readable storage medium having stored thereon computer instructions, which when executed, implement the steps of the method of integrating cross-platform heterogeneous data of any of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911393115.0A CN111158744B (en) | 2019-12-30 | 2019-12-30 | Cross-platform heterogeneous data integration method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911393115.0A CN111158744B (en) | 2019-12-30 | 2019-12-30 | Cross-platform heterogeneous data integration method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111158744A CN111158744A (en) | 2020-05-15 |
| CN111158744B true CN111158744B (en) | 2024-02-23 |
Family
ID=70559428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911393115.0A Active CN111158744B (en) | 2019-12-30 | 2019-12-30 | Cross-platform heterogeneous data integration method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111158744B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095408A (en) * | 2016-05-31 | 2016-11-09 | 浙江网新恒天软件有限公司 | A kind of system and method for data monitoring and Code automatic build and deployment |
| CN108984174A (en) * | 2018-07-03 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Cross-platform application creation method, device, server and storage medium |
| CN109241735A (en) * | 2018-09-27 | 2019-01-18 | 四川长虹电器股份有限公司 | A kind of continuous integrating method based on vulnerability scanning platform |
| CN109634612A (en) * | 2018-12-04 | 2019-04-16 | 浙江数链科技有限公司 | Continuous integrating method, system, computer equipment and storage medium |
| CN109739507A (en) * | 2018-12-28 | 2019-05-10 | 睿驰达新能源汽车科技（北京）有限公司 | A kind of code continuous integrating method and code continue delivery method |
| CN109783086A (en) * | 2018-12-14 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Application and development method, terminal device and medium based on continuous integrating platform |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10410152B2 (en) * | 2016-09-21 | 2019-09-10 | Cognizant Technology Solutions India Pvt. Ltd. | System and method for automatically and efficiently monitoring software development life cycles |
-
2019
- 2019-12-30 CN CN201911393115.0A patent/CN111158744B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095408A (en) * | 2016-05-31 | 2016-11-09 | 浙江网新恒天软件有限公司 | A kind of system and method for data monitoring and Code automatic build and deployment |
| CN108984174A (en) * | 2018-07-03 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Cross-platform application creation method, device, server and storage medium |
| CN109241735A (en) * | 2018-09-27 | 2019-01-18 | 四川长虹电器股份有限公司 | A kind of continuous integrating method based on vulnerability scanning platform |
| CN109634612A (en) * | 2018-12-04 | 2019-04-16 | 浙江数链科技有限公司 | Continuous integrating method, system, computer equipment and storage medium |
| CN109783086A (en) * | 2018-12-14 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Application and development method, terminal device and medium based on continuous integrating platform |
| CN109739507A (en) * | 2018-12-28 | 2019-05-10 | 睿驰达新能源汽车科技（北京）有限公司 | A kind of code continuous integrating method and code continue delivery method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111158744A (en) | 2020-05-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110908875B (en) | Inspection method and device based on operation terminal | |
| CN112463634B (en) | Software testing method and device under micro-service architecture | |
| CN111782470B (en) | Distributed container log data processing method and device | |
| CN110764881A (en) | Distributed system background retry method and device | |
| CN114138372B (en) | Front-end component loading method and device | |
| CN111679790A (en) | Remote software development storage space distribution method and device | |
| CN111931835A (en) | Image identification method, device and system | |
| CN114257532B (en) | Method and device for detecting state of server | |
| CN113050985B (en) | Front-end engineering dependency automatic registration method and device | |
| CN111767558B (en) | Data access monitoring method, device and system | |
| CN111367561B (en) | Remote development method and device for software program | |
| CN111158744B (en) | Cross-platform heterogeneous data integration method and device | |
| CN114285657B (en) | Firewall security policy change verification method and device | |
| CN114490402A (en) | Method and device for checking validity of message field | |
| CN111538660B (en) | Method and device for counting coverage rate of program codes in cloud container | |
| CN113791984A (en) | Automatic interface testing method and device | |
| CN113050936A (en) | Front-end data processing method and device based on integrated development environment | |
| CN108449625B (en) | Video screenshot method, device and terminal | |
| CN111953847A (en) | Client message risk reminding method, device and system | |
| CN113094270B (en) | Project automatic verification method and device | |
| CN111459538B (en) | Code synchronization method and device | |
| CN112823529B (en) | Video decoding method, device, electronic equipment and computer readable storage medium | |
| CN114880229A (en) | Batch file testing method and device | |
| CN115293906A (en) | Transaction recording and playing method, device and system | |
| CN118113273A (en) | Rendering engine plug-in data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |