CN113377341A

CN113377341A - Code analysis method and device, electronic equipment and computer readable medium

Info

Publication number: CN113377341A
Application number: CN202010161944.2A
Authority: CN
Inventors: 王烨; 周祥
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-03-10
Filing date: 2020-03-10
Publication date: 2021-09-10

Abstract

The embodiment of the application provides a code analysis method and device, electronic equipment and a computer readable medium, and relates to the technical field of Internet. Wherein the method comprises the following steps: receiving a code analysis request sent by a client through a data lake analysis service, wherein the code analysis request is used for indicating code analysis based on carried code analysis demand information; and performing code analysis on the codes in the code engineering file based on the code analysis demand information through the data lake analysis service to obtain an analysis result matched with the code analysis demand information. By the method and the device, codes in the code engineering file can be conveniently and effectively analyzed, and development efficiency and release efficiency of the codes in the code engineering file are effectively improved.

Description

Code analysis method and device, electronic equipment and computer readable medium

Technical Field

The embodiment of the application relates to the technical field of internet, in particular to a code analysis method and device, electronic equipment and a computer readable medium.

Background

Most of general large code development languages are produced for solving complex problems, the complex problems are separated into independent modules through software engineering ideas such as abstraction, decoupling and modularization step by step, the problems of various characteristic scenes are solved, and along with the development of open source communities, a large number of open source libraries and open source codes are usually provided for solving the problems. Software is continuously developed and iterated along with business requirements, so that a large number of versions appear. Meanwhile, the service scene faced by the developer is also complex, a lot of modularization splits can be carried out, various different libraries and classes, functions, methods and the like in the libraries are quoted, and in the actual work, the developer often faces many library dependence conflicts and is painful and indiscriminate. For example, library a and library B depend on library C at the same time, but the versions that depend on each differ, whereas the two versions differ greatly. Some piece of code depends on the function f of the library a, but the interface definition of the function f is different from the parameters in the code. In addition, there are other problems such as compatibility, homonymy conflict, and the like. In addition to relying on conflict problems, there are many other requirements on linguistic analysis. Therefore, how to effectively analyze the code becomes a technical problem to be solved.

In the prior art, the various problems described above often occur in the usage scenario of Java, a very general, object-oriented high-level language, which has even become a typical problem of the Java language. Java is a pure object-oriented language, and various class libraries and related dependencies are loaded through runtime, so that the Java cannot meet the problems of class conflicts with the same name and different method signatures in classes of different versions at runtime. For the problem of analysis of code developed in the Java language, there are some code analysis tools on the market. These tools belong to the excellent tools in the industry, and bring a good experience to developers. However, they have some disadvantages as tools, mainly: 1. the related memory index is constructed in the preprocessing process to accelerate the analysis to occupy a large amount of memory resources and computing resources, the preprocessing delay is large, the speed of each interaction of data acquired by a user through analysis and computation according to needs is slow, and the experience is poor. 2. Many tools are not free. 3. These tools can only run on a personal computer and cannot execute analysis code anytime and anywhere. 4. The analytical capabilities of the tool itself are limited. 5. The analyzed extremely valuable result set is not easy to store, and the effect and value of the analysis data are discounted. 6. A plurality of project files cannot be analyzed simultaneously in one process, so that correlation analysis is difficult to perform. Therefore, how to analyze the codes conveniently and effectively becomes a technical problem to be solved urgently at present.

Disclosure of Invention

The application aims to provide a code analysis method, a code analysis device, an electronic device and a computer readable medium, which are used for solving the technical problem of how to conveniently and effectively analyze codes in the prior art.

According to a first aspect of embodiments of the present application, a code analysis method is provided. The method comprises the following steps: receiving a code analysis request sent by a client through a data lake analysis service, wherein the code analysis request is used for indicating code analysis based on carried code analysis demand information; and performing code analysis on the codes in the code engineering file based on the code analysis demand information through the data lake analysis service to obtain an analysis result matched with the code analysis demand information.

According to a second aspect of embodiments of the present application, there is provided a code analysis apparatus. The device comprises: the system comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving a code analysis request sent by a client through a data lake analysis service, and the code analysis request is used for indicating code analysis based on carried code analysis demand information; and the analysis module is used for carrying out code analysis on the codes in the code engineering file based on the code analysis demand information through the data lake analysis service so as to obtain an analysis result matched with the code analysis demand information.

According to a third aspect of embodiments of the present application, there is provided a code analysis system. The system comprises: the client is used for generating a code analysis request based on code analysis demand information input by a user and sending the code analysis request to the data lake analysis service, wherein the code analysis request is used for indicating code analysis based on the carried code analysis demand information; and receiving the code analysis request sent by the client through the data lake analysis service, and performing code analysis on codes in a data table pulled from the data source based on the code analysis demand information to obtain an analysis result matched with the code analysis demand information.

According to a fourth aspect of embodiments of the present application, there is provided an electronic apparatus, including: one or more processors; a computer readable medium configured to store one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the code analysis method as described in the first aspect of the embodiments above.

According to a fifth aspect of embodiments of the present application, there is provided a computer-readable medium, on which a computer program is stored, which when executed by a processor, implements a code analysis method as described in the first aspect of the embodiments above.

According to the code analysis scheme provided by the embodiment of the application, a code analysis request sent by a client is received through a data lake analysis service, wherein the code analysis request is used for indicating code analysis based on carried code analysis demand information; and code analysis is carried out on the codes in the code engineering files based on the code analysis demand information carried by the code analysis request through the data lake analysis service so as to obtain an analysis result matched with the code analysis demand information.

Drawings

Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:

fig. 1A is a schematic structural diagram of a code analysis system according to an embodiment of the present application;

FIG. 1B is a flowchart illustrating steps of a code analysis method according to an embodiment of the present disclosure;

fig. 1C is a schematic view of a scene according to a first embodiment of the present application;

FIG. 2A is a flowchart illustrating steps of a code analysis method according to a second embodiment of the present application;

FIG. 2B is a diagram illustrating a code analysis process according to the second embodiment of the present application;

fig. 3 is a schematic structural diagram of a code analysis apparatus according to a third embodiment of the present application;

FIG. 4 is a schematic structural diagram of a code analysis apparatus according to a fourth embodiment of the present application;

fig. 5 is a schematic structural diagram of an electronic device in a fifth embodiment of the present application;

fig. 6 is a hardware structure of an electronic device according to a sixth embodiment of the present application.

Detailed Description

The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.

The embodiment of the application provides a code analysis method which can be based on a code analysis system comprising a client, a data lake analysis service in communication connection with the client and a data source in communication connection with the data lake analysis service. The client is used for generating a code analysis request based on code analysis demand information input by a user and sending the code analysis request to the data lake analysis service, wherein the code analysis request is used for indicating code analysis based on the carried code analysis demand information; and receiving the code analysis request sent by the client through the data lake analysis service, and performing code analysis on codes in a data table pulled from the data source based on the code analysis demand information to obtain an analysis result matched with the code analysis demand information. The data lake analysis service includes a front-end node pool composed of front-end nodes (which may also be referred to as front-end servers) and a compute node pool composed of compute nodes (which may also be referred to as compute servers).

Referring to fig. 1A, a schematic structural diagram of a code analysis system provided in an embodiment of the present application is a front-end node pool including one or more front-end nodes, where fig. 1A takes 3 front-end nodes as an example. In the computing node pool of the computing nodes, one or more computing nodes are included, and fig. 1A takes 5 computing nodes as an example. In practical application, the number of the front-end nodes can be increased or decreased, and the number of the computing nodes can also be increased or decreased.

The client may be configured to analyze a code in the data source, for example, the client may be an APP (Application) included in a terminal device (e.g., a Personal Computer (PC), a notebook Computer, a mobile terminal, etc.), or may be a browser included in the terminal device, and the type of the client is not particularly limited.

The load balancing device is configured to load balance the code analysis requests, for example, after a large number of code analysis requests are received, the load of the code analysis requests may be balanced to each front-end node, which is not limited to this process.

The data source is used for storing various types of data, and can provide the data stored in the data source to a client or a data lake analysis service. The type of data stored in the data source is not limited in the embodiment of the present application, and may be, for example, user data, commodity data, map data, video data, image data, audio data, code engineering files, and the like. The data source may be an Object Storage Service (OSS), a table Storage Service, a cloud database, and the like, which is not limited in this embodiment of the present disclosure.

Wherein a plurality of front-end nodes in the pool of front-end nodes are available for providing the same functionality, i.e. providing peer-to-peer services. Specifically, the front-end node is configured to receive a code analysis request sent by a client, perform SQL (Structured Query Language) analysis on the code analysis request, generate a distributed execution plan using an SQL analysis result, and distribute the distributed execution plan to the computing nodes, where the code analysis request is used to request analysis of a corresponding code. And then, the front-end node is also used for receiving the code analysis result returned by the computing node and sending the code analysis result to the client.

Wherein multiple compute nodes in a compute node pool may be used to provide the same functionality, i.e., provide peer-to-peer services. Specifically, the computing node is configured to receive a distributed execution plan distributed by the front-end node, analyze, based on the distributed execution plan, a code corresponding to the code analysis request, which is pulled from a data source, to obtain a code analysis result, and send the code analysis result to the front-end node.

On the basis of the code analysis system, referring to fig. 1B, a flowchart of steps of a code analysis method provided in an embodiment of the present application is shown, and the method may be applied to an application or system having a data lake analysis service, which is not limited in this embodiment of the present application. Specifically, the method may comprise the steps of:

in step S101, a code analysis request sent by a client is received through a data lake analysis service.

In the embodiment of the application, the data lake analysis service is a new cloud data computing analysis type product. A Serverless (Serverless) on-cloud interactive query analysis service is provided for users. The data in an object storage system, a table storage service and other cloud storage and cloud databases can be easily queried and analyzed through standard SQL on the cloud through the ETL service, and business analysis tools and applications are seamlessly integrated. The code analysis request is used for indicating code analysis based on the carried code analysis requirement information, and may be an SQL code analysis request. The code analysis requirement information may be understood as information for expressing the analysis requirement of the user on the code, for example, the user may write various operators and various functions to express the analysis requirement on the code by using the SQL language. For example, the code analysis requirement information may be to find all unreasonable naming specifications, find methods for which all parameter lists are too long, repeat the search of code segments, find complete class path conflicts, find classes and class names and method names with the same name method, count all dependent classes (deduplication), and so on. The code can be code written by using Java language, code written by using CPP language, code written by using C language, and the like. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, when receiving the code analysis request sent by the client through the data lake analysis service, the code analysis request sent by the client may be received through a front-end node in the data lake analysis service. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In step S102, code analysis is performed on the codes in the code engineering file by the data lake analysis service based on the code analysis requirement information to obtain an analysis result matching the code analysis requirement information.

In some optional embodiments, when the code in the code engineering file is analyzed by the data lake analysis service based on the code analysis requirement information, the code in the code engineering file is analyzed by the data lake analysis service to obtain the syntactic structure information of the code in the code engineering file; analyzing the syntactic structure information of the codes in the code engineering file based on the code analysis demand information through the data lake analysis service to obtain an analysis result matched with the code analysis demand information. Therefore, through the data lake analysis service, the syntactic structure information of the codes in the code engineering file is analyzed based on the code analysis requirement information, and an analysis result matched with the code analysis requirement information can be accurately obtained. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In a specific example, when the codes in the code engineering file are analyzed through the data lake analysis service, a corresponding code analysis tool is called to analyze the codes in the code engineering file through the data lake analysis service so as to obtain the syntactic structure information of the codes in the code engineering file. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In a specific example, when the data lake analysis service calls a corresponding code analysis tool to analyze the codes in the code engineering file, the data lake analysis service calls the corresponding code analysis tool to analyze the codes in the code engineering file through a computing node in the data lake analysis service, so as to obtain the syntactic structure information of the codes in the code engineering file. Wherein the syntax structure information may include a code field and code content corresponding to the code field. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In a specific example, when the syntactic structure information of the code in the code engineering file is analyzed by the data lake analysis service based on the code analysis requirement information, the syntactic structure information of the code in the code engineering file is analyzed by the computing node in the data lake analysis service based on the code analysis requirement information to obtain an analysis result matched with the code analysis requirement information. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, when code analysis is performed on codes in a code engineering file through the data lake analysis service based on the code analysis demand information, the code analysis request is parsed through a front-end node in the data lake analysis service to obtain a parsing result of the code analysis request, a distributed execution plan matched with the code analysis demand information is generated based on the parsing result, and then the distributed execution plan is distributed to a computing node in the data lake analysis service for execution; and receiving the distributed execution plan distributed by the front end node through a computing node in the data lake analysis service, analyzing codes in the code engineering file based on the distributed execution plan to obtain grammatical structure information of the codes in the code engineering file, and analyzing the grammatical structure information of the codes in the code engineering file to obtain an analysis result matched with the code analysis requirement information. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In an example, the execution sequence of the steps S101 and S102 is only an example given for convenience of description, and in practical applications, the execution sequence between the steps may also be changed, and the execution sequence is not limited. Moreover, in other embodiments, the steps of the respective methods do not have to be performed in the order shown and described herein, and the methods may include more or less steps than those described herein. Moreover, a single step described in this specification may be broken down into multiple steps for description in other embodiments; multiple steps described in this specification may be combined into a single step in other embodiments.

In practical application, a user can import an original code engineering file into a data lake analysis service through a client, then parse syntactic structure information of a code from the original code engineering file by using the data lake analysis service, and then analyze the syntactic structure information by using an SQL engine technology (distributed computing nodes) of the data lake analysis service. A user can use SQL language to write various operators and various functions to express analysis requirements, rapid analysis is achieved by using parallel computing capacity of data lake analysis service, correlation analysis is conducted by connecting other related data with the aid of multiple data source capacity of the data lake analysis service, and analysis results can be output to any place by using the data lake analysis service.

Many language designs and language concepts are communicated for the various languages in which the code is written. For example, taking a comparison between two object-oriented languages, CPP and Java, these languages have concepts of class, attribute, various types, method/function, method signature, code segment, keyword, parent class and subclass, abstract class/virtual class, and code structure of loop, branch, condition, exception, function return, etc. And the grammar structure information can be completely acquired through a parser tool of the corresponding language. Therefore, file analysis, dependency analysis and code content analysis of codes written in various languages can be solved and accelerated by using similar methods and ideas provided by the embodiment of the application, so that the development and release efficiency of the codes is greatly improved, the time cost is reduced, and the analysis value is expanded.

One scenario of the above process is schematically shown in fig. 1C, and a data lake analysis service platform (a platform providing the data lake analysis service in fig. 1A) is disposed between the client and the OSS, and the platform may be implemented by a plurality of nodes as shown in fig. 1A, and is not shown in detail in fig. 1C. The client sends the code analysis request to the data lake analysis service platform, and the data lake analysis service platform receives the code analysis request through the data lake analysis service of the data lake analysis service platform; then, sending a data pulling request to the OSS according to the code analysis demand information so as to pull the required code engineering file from the OSS, and further carrying out code analysis on the code engineering file by a data lake analysis service to obtain a corresponding analysis result; and then, feeding back the analysis result to the client.

According to the code analysis method provided by the embodiment of the application, a code analysis request sent by a client is received through a data lake analysis service, wherein the code analysis request is used for indicating code analysis based on carried code analysis demand information; and code analysis is carried out on the codes in the code engineering files based on the code analysis demand information carried by the code analysis request through the data lake analysis service so as to obtain an analysis result matched with the code analysis demand information.

The code analysis method of the present embodiment may be performed by any suitable device having data processing capabilities, including but not limited to: cameras, terminals, mobile terminals, PCs, servers, in-vehicle devices, entertainment devices, advertising devices, Personal Digital Assistants (PDAs), tablet computers, notebook computers, handheld game consoles, smart glasses, smart watches, wearable devices, virtual display devices or display enhancement devices (such as Google Glass, Oculus rise, Hololens, Gear VR), and the like.

Referring to fig. 2A, a flowchart illustrating steps of a code analysis method according to a second embodiment of the present application is shown.

Specifically, the code analysis method provided by this embodiment includes the following steps:

in step S201, a data table creation request sent by the client is received through the data lake analysis service.

In the embodiment of the application, the data table creation request is used for indicating that a data table for code analysis of codes in the code engineering file is created based on the carried data table type information and the address information of the code engineering file. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, when the data table creation request sent by the client is received through the data lake analysis service, the data table creation request sent by the client is received through a front-end node in the data lake analysis service. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In a specific example, after the user uploads the code engineering file to the relevant data source through the client, if the user has a need for code analysis of the code engineering file uploaded to the relevant data source, the data table creation control of the client may be clicked. In response to a click operation on the data table creation control of the client, the client sends a data table creation request to the data lake analysis service associated therewith. And then clicking a code analysis control of the client. In response to a click operation on the client's code analysis control, the client sends a code analysis request to the data lake analysis service associated therewith. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In step S202, the data table is created by the data lake analysis service based on the data table type information and the address information carried by the data table creation request, so as to perform code analysis on the codes in the code engineering file.

In this embodiment of the application, the data table may be created by a front end node in the data lake analysis service based on the data table type information and the address information carried by the data table creation request, so as to perform code analysis on the code in the code engineering file. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, when the data table is created by the data lake analysis service based on the data table type information and the address information carried by the data table creation request, a first data table having a code field is created by the data lake analysis service based on the data table type information carried by the data table creation request; through the data lake analysis service, the address information carried by the data table creation request is based on, the code engineering file is obtained, and the code engineering file is analyzed, so that the syntactic structure information of the codes in the code engineering file is obtained; and establishing a mapping relation between the code field in the first data table and the syntactic structure information through the data lake analysis service, and obtaining a second data table which has the code field and the code content of the code field for code analysis of the codes in the code engineering file. Therefore, by establishing the mapping relation between the code field in the first data table and the syntactic structure information, the second data table with the code content of both the code field and the code field can be obtained, and the second data table is used for carrying out code analysis on codes in the code engineering file in a follow-up and rapid mode. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, when the first data table with the code field is created by the data lake analysis service based on the data table type information carried by the data table creation request, the mapping relationship between the preconfigured data table type and the data table structure is queried by the data lake analysis service based on the data table type information carried by the data table creation request to obtain data table structure information corresponding to the data table type information, and the first data table with the code field is determined based on the data table structure information. Therefore, the first data table with the code field can be quickly created through the mapping relation between the pre-configured data table type and the data table structure, and the first data table with the code field does not need to be created through additionally writing or generating a table building statement. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In a specific example, when a first data table with a code field is created by the data lake analysis service based on the data table type information carried by the data table creation request, a front end node in the data lake analysis service queries a mapping relationship between a pre-configured data table type and a data table structure based on the data table type information carried by the data table creation request to obtain data table structure information corresponding to the data table type information, and determines the first data table with the code field based on the data table structure information. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, when the code engineering file is parsed to obtain the syntactic structure information of the code in the code engineering file, a corresponding code parsing tool is invoked to parse the code engineering file through a front-end node in the data lake analysis service to obtain the syntactic structure information of the code in the code engineering file. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, when the mapping relationship between the code field in the first data table and the syntactic structure information is established by the data lake analysis service, the code field in the first data table is compared with the code field in the syntactic structure information by a front-end node in the data lake analysis service, and if the code field in the first data table is the same as the code field in the syntactic structure information, the mapping relationship between the code field in the first data table and the code content corresponding to the code field in the syntactic structure information is established, so as to obtain a second data table having both the code field and the code content of the code field for code analysis of the code in the code engineering file. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, after the obtaining the second data table having both the code field and the code content of the code field, the method further comprises: and storing a second data table with the code fields and the code contents of the code fields in corresponding data sources by the data lake analysis service in a preset data format. The preset data format can be xml format, json format, queue format, arrow format and the like. Therefore, the second data table with the code content of the code field and the code field is stored in the corresponding data source by adopting the preset data format, and the codes in the code engineering file can be conveniently, subsequently and quickly subjected to code analysis based on the second data table. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In step S203, a code analysis request sent by the client is received through the data lake analysis service.

Since the embodiment of step S203 is similar to that of step S101, it is not described herein again.

In step S204, code analysis is performed on the codes in the data table based on the code analysis requirement information by the data lake analysis service to obtain an analysis result matching with the code analysis requirement information.

In some optional embodiments, when code analysis is performed on the code in the code engineering file based on the code analysis requirement information by the data lake analysis service, code analysis is performed on the code in the second data table pulled from the data source based on the code analysis requirement information by the data lake analysis service to obtain an analysis result matched with the code analysis requirement information. Therefore, code analysis can be rapidly realized by performing code analysis on the code in the second data table pulled from the data source. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In a specific example, when code analysis is performed on codes in the second data table pulled from the data source through the data lake analysis service based on the code analysis demand information, the code analysis request is analyzed through a front end node in the data lake analysis service to obtain an analysis result of the code analysis request, a distributed execution plan matched with the code analysis demand information is generated based on the analysis result, and then the distributed execution plan is distributed to a computing node in the data lake analysis service for execution; receiving the distributed execution plan distributed by the front end node through a computing node in the data lake analysis service, and performing code analysis on codes in the second data table pulled from the data source based on the distributed execution plan to obtain an analysis result matched with the code analysis demand information. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In some optional embodiments, after obtaining the analysis result matched with the code analysis requirement information, the method further includes: and dumping the analysis result to a target data source through the data lake analysis service. Thereby, through the data lake analysis service, the analysis results can be dumped to the target data source. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In an example, the execution sequence of the steps S201 to S204 is only an example given for convenience of description, and in practical applications, the execution sequence between the steps may also be changed, and the execution sequence is not limited. Moreover, in other embodiments, the steps of the respective methods do not have to be performed in the order shown and described herein, and the methods may include more or less steps than those described herein. Moreover, a single step described in this specification may be broken down into multiple steps for description in other embodiments; multiple steps described in this specification may be combined into a single step in other embodiments.

In a specific example, as shown in fig. 2B, the user uploads the code engineering file to the object storage system through the client, and the object storage system returns the address information of the code engineering file to the client. In response to a click operation on the data table creation control of the client, the client sends a data table creation request to the data lake analysis service associated therewith. The data lake analysis service receives the data table creation request, analyzes the corresponding code engineering file acquired from the object storage system based on the data table creation request to acquire the syntactic structure information of the code in the code engineering file, creates a data table with a code field, and then establishes the mapping relation between the code field in the data table and the syntactic structure information to acquire the data table with both the code field and the code content corresponding to the code field. After a data table having both a code field and code content corresponding to the code field is obtained, the data table is stored in the object storage system in a specific data format by a data lake analysis service. When the data lake analysis service receives a code analysis request sent by the client, the data lake analysis service pulls the corresponding data table from the object storage system for distributed computation to obtain an analysis result matched with the code analysis requirement information carried by the code analysis request, and the analysis result is returned to the client. Of course, the analysis results can also be dumped into the object storage system. By creating a data table in advance having both code fields and code contents corresponding to the code fields, the data lake analysis service can perform simple and fast calculation and analysis. The whole computing architecture of the data lake analysis service is distributed, so that the data pulling, correlation calculation, complex calculation, rich functions and the like are very efficient, and the complex calculation of various transformations, mappings, correlations, sequencing, grouping and the like can be very easily expressed based on the relationship of the database. It should be understood that the above description is only exemplary, and the embodiments of the present application are not limited in this respect.

In practical application, after the data lake analysis service creates the data table in advance, a user can rapidly analyze engineering codes in a database mode, such as dependence, conflict, irregular naming, repetition and the like, the SQL language has extremely strong expression capability and can complete various requirements, distributed computation in the data lake analysis service can realize analysis and computation which is very complex, consumes resources and inputs in a large scale, simultaneously, all platforms can be communicated and fused to participate in computation, and the analysis capability and the value after analysis are greatly improved.

According to the code analysis method provided by the embodiment of the application, a data table creation request sent by a client is received through a data lake analysis service, wherein the data table creation request is used for indicating a data table type information and an address information of a code engineering file carried by the data table creation request, a data table used for carrying out code analysis on codes in the code engineering file is created, the data table is created through the data lake analysis service based on the data table type information and the address information carried by the data table creation request, the codes in the code engineering file are analyzed through the data lake analysis service, the code analysis request sent by the client is received through the data lake analysis service, the codes in the data table are analyzed through the data lake analysis service based on the code analysis requirement information carried by the code analysis request, so as to obtain an analysis result matched with the code analysis requirement information, compared with the other existing modes, the code analysis is carried out on the codes in the data table for carrying out code analysis on the codes in the code engineering file through the data lake analysis service based on the code analysis requirement information carried by the received code analysis request, so that the codes in the code engineering file can be further quickly and effectively subjected to code analysis, and the development efficiency and the release efficiency of the codes in the code engineering file are further effectively improved.

Referring to fig. 3, a schematic structural diagram of a code analysis apparatus in the third embodiment of the present application is shown.

The code analysis device provided by the embodiment comprises: the first receiving module 301 is configured to receive, through a data lake analysis service, a code analysis request sent by a client, where the code analysis request is used to instruct code analysis based on carried code analysis demand information; the analysis module 302 is configured to perform code analysis on the codes in the code engineering file through the data lake analysis service based on the code analysis requirement information to obtain an analysis result matched with the code analysis requirement information.

The code analysis apparatus of this embodiment is used to implement the corresponding code analysis method in the foregoing method embodiments, and has the beneficial effects of the corresponding method embodiments, which are not described herein again.

Referring to fig. 4, a schematic structural diagram of a code analysis apparatus in the fourth embodiment of the present application is shown.

The code analysis device provided by the embodiment comprises: a first receiving module 403, configured to receive, through a data lake analysis service, a code analysis request sent by a client, where the code analysis request is used to instruct code analysis based on carried code analysis demand information; the analysis module 404 is configured to perform code analysis on the codes in the code engineering file through the data lake analysis service based on the code analysis requirement information to obtain an analysis result matched with the code analysis requirement information.

Optionally, before the first receiving module 403, the apparatus further includes: a second receiving module 401, configured to receive, through the data lake analysis service, a data table creation request sent by the client, where the data table creation request is used to indicate that a data table for performing code analysis on a code in the code engineering file is created based on carried data table type information and address information of the code engineering file; a creating module 402, configured to create, by the data lake analysis service, the data table based on the data table type information and the address information carried by the data table creation request, so as to perform code analysis on the code in the code engineering file.

Optionally, the creating module 402 includes: the creating sub-module 4021 is configured to create, by the data lake analysis service, a first data table having a code field based on the data table type information carried in the data table creation request; the parsing submodule 4022 is configured to acquire the code engineering file based on the address information carried by the data table creation request through the data lake analysis service, and parse the code engineering file to acquire grammatical structure information of a code in the code engineering file; the establishing sub-module 4023 is configured to establish a mapping relationship between the code field in the first data table and the syntactic structure information through the data lake analysis service, and obtain a second data table having both the code field and the code content of the code field, so as to perform code analysis on the code in the code engineering file.

Optionally, the creating sub-module 4021 is specifically configured to: and querying a mapping relation between a pre-configured data table type and a data table structure based on the data table type information carried by the data table creation request through the data lake analysis service to obtain data table structure information corresponding to the data table type information, and determining the first data table with the code field based on the data table structure information.

Optionally, after the establishing sub-module 4023, the creating module 402 further includes: the storage sub-module 4024 is configured to store, by the data lake analysis service, a second data table having the code content of both the code field and the code field in a corresponding data source by using a preset data format.

Optionally, the analysis module 404 includes: the analysis submodule 4041 is configured to perform, by the data lake analysis service, code analysis on the codes in the second data table pulled from the data source based on the code analysis demand information, so as to obtain an analysis result matched with the code analysis demand information.

Optionally, the analysis submodule 4041 is specifically configured to: analyzing the code analysis request through a front end node in the data lake analysis service to obtain an analysis result of the code analysis request, generating a distributed execution plan matched with the code analysis demand information based on the analysis result, and distributing the distributed execution plan to a computing node in the data lake analysis service for execution; receiving the distributed execution plan distributed by the front end node through a computing node in the data lake analysis service, and performing code analysis on codes in the second data table pulled from the data source based on the distributed execution plan to obtain an analysis result matched with the code analysis demand information.

Optionally, after the analyzing module 404, the apparatus further includes: a dump module 405, configured to dump the analysis result to a target data source through the data lake analysis service.

Fig. 5 is a schematic structural diagram of an electronic device in a fifth embodiment of the present application; the electronic device may include:

one or more processors 501;

a computer-readable medium 502, which may be configured to store one or more programs,

when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the code analysis method as described in the first or second embodiment.

Fig. 6 is a hardware structure of an electronic device according to a sixth embodiment of the present application; as shown in fig. 6, the hardware structure of the electronic device may include: a processor 601, a communication interface 602, a computer-readable medium 603, and a communication bus 604;

wherein the processor 601, the communication interface 602, and the computer readable medium 603 communicate with each other via a communication bus 604;

alternatively, the communication interface 602 may be an interface of a communication module, such as an interface of a GSM module;

the processor 601 may be specifically configured to: receiving a code analysis request sent by a client through a data lake analysis service, wherein the code analysis request is used for indicating code analysis based on carried code analysis demand information; and performing code analysis on the codes in the code engineering file based on the code analysis demand information through the data lake analysis service to obtain an analysis result matched with the code analysis demand information.

The Processor 601 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The computer-readable medium 603 may be, but is not limited to, a Random Access Memory (RAM), a Read-Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code configured to perform the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication section, and/or installed from a removable medium. The computer program, when executed by a Central Processing Unit (CPU), performs the above-described functions defined in the method of the present application. It should be noted that the computer readable medium described herein can be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access storage media (RAM), a read-only storage media (ROM), an erasable programmable read-only storage media (EPROM or flash memory), an optical fiber, a portable compact disc read-only storage media (CD-ROM), an optical storage media piece, a magnetic storage media piece, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

Computer program code configured to carry out operations for the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may operate over any of a variety of networks: including a Local Area Network (LAN) or a Wide Area Network (WAN) -to the user's computer, or alternatively, to an external computer (e.g., through the internet using an internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions configured to implement the specified logical function(s). In the above embodiments, specific precedence relationships are provided, but these precedence relationships are only exemplary, and in particular implementations, the steps may be fewer, more, or the execution order may be modified. That is, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules described in the embodiments of the present application may be implemented by software or hardware. The described modules may also be provided in a processor, which may be described as: a processor includes a first receiving module and an analyzing module. The names of these modules do not form a limitation on the modules themselves in some cases, for example, the first receiving module may also be described as a "module that receives a code analysis request sent by a client through a data lake analysis service".

As another aspect, the present application also provides a computer-readable medium on which a computer program is stored, the program, when executed by a processor, implementing the code analysis method as described in the first or second embodiment.

As another aspect, the present application also provides a computer-readable medium, which may be contained in the apparatus described in the above embodiments; or may be present separately and not assembled into the device. The computer readable medium carries one or more programs which, when executed by the apparatus, cause the apparatus to: receiving a code analysis request sent by a client through a data lake analysis service, wherein the code analysis request is used for indicating code analysis based on carried code analysis demand information; and performing code analysis on the codes in the code engineering file based on the code analysis demand information through the data lake analysis service to obtain an analysis result matched with the code analysis demand information.

The expressions "first", "second", "said first" or "said second" used in various embodiments of the present disclosure may modify various components regardless of order and/or importance, but these expressions do not limit the respective components. The above description is only configured for the purpose of distinguishing elements from other elements. For example, the first user equipment and the second user equipment represent different user equipment, although both are user equipment. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure.

When an element (e.g., a first element) is referred to as being "operably or communicatively coupled" or "connected" (operably or communicatively) to "another element (e.g., a second element) or" connected "to another element (e.g., a second element), it is understood that the element is directly connected to the other element or the element is indirectly connected to the other element via yet another element (e.g., a third element). In contrast, it is understood that when an element (e.g., a first element) is referred to as being "directly connected" or "directly coupled" to another element (a second element), no element (e.g., a third element) is interposed therebetween.

The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention herein disclosed is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the invention. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.

Claims

1. A method of code analysis, the method comprising:

receiving a code analysis request sent by a client through a data lake analysis service, wherein the code analysis request is used for indicating code analysis based on carried code analysis demand information;

and performing code analysis on the codes in the code engineering file based on the code analysis demand information through the data lake analysis service to obtain an analysis result matched with the code analysis demand information.

2. The method of claim 1, wherein prior to receiving, by the data lake analysis service, the code analysis request sent by the client, the method further comprises:

receiving a data table creation request sent by the client through the data lake analysis service, wherein the data table creation request is used for indicating that a data table used for performing code analysis on codes in the code engineering file is created based on carried data table type information and address information of the code engineering file;

and creating the data table through the data lake analysis service based on the data table type information and the address information carried by the data table creation request for code analysis of the codes in the code engineering file.

3. The method of claim 2, wherein the creating, by the data lake analysis service, the data table based on the data table type information and the address information carried by the data table creation request comprises:

creating a first data table with a code field based on the data table type information carried by the data table creation request through the data lake analysis service;

through the data lake analysis service, the address information carried by the data table creation request is based on, the code engineering file is obtained, and the code engineering file is analyzed, so that the syntactic structure information of the codes in the code engineering file is obtained;

and establishing a mapping relation between the code field in the first data table and the syntactic structure information through the data lake analysis service, and obtaining a second data table which has the code field and the code content of the code field for code analysis of the codes in the code engineering file.

4. The method of claim 3, wherein the creating, by the data lake analysis service, a first data table having a code field based on the data table type information carried by the data table creation request comprises:

and querying a mapping relation between a pre-configured data table type and a data table structure based on the data table type information carried by the data table creation request through the data lake analysis service to obtain data table structure information corresponding to the data table type information, and determining the first data table with the code field based on the data table structure information.

5. The method of claim 3, wherein after the obtaining a second data table having both the code field and the code content of the code field, the method further comprises:

and storing a second data table with the code fields and the code contents of the code fields in corresponding data sources by the data lake analysis service in a preset data format.

6. The method of claim 5, wherein the performing, by the data lake analysis service, code analysis on the code in the code engineering file based on the code analysis requirement information to obtain an analysis result matching the code analysis requirement information comprises:

and performing code analysis on the codes in the second data table pulled from the data source based on the code analysis demand information through the data lake analysis service to obtain an analysis result matched with the code analysis demand information.

7. The method of claim 6, wherein the performing, by the data lake analysis service, code analysis on the code in the second data table pulled from the data source based on the code analysis requirement information to obtain an analysis result matching the code analysis requirement information comprises:

analyzing the code analysis request through a front end node in the data lake analysis service to obtain an analysis result of the code analysis request, generating a distributed execution plan matched with the code analysis demand information based on the analysis result, and distributing the distributed execution plan to a computing node in the data lake analysis service for execution;

receiving the distributed execution plan distributed by the front end node through a computing node in the data lake analysis service, and performing code analysis on codes in the second data table pulled from the data source based on the distributed execution plan to obtain an analysis result matched with the code analysis demand information.

8. The method according to any one of claims 1-7, wherein after obtaining the analysis result matching the code analysis requirement information, the method further comprises:

and dumping the analysis result to a target data source through the data lake analysis service.

9. A code analysis apparatus, the apparatus comprising:

the system comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving a code analysis request sent by a client through a data lake analysis service, and the code analysis request is used for indicating code analysis based on carried code analysis demand information;

and the analysis module is used for carrying out code analysis on the codes in the code engineering file based on the code analysis demand information through the data lake analysis service so as to obtain an analysis result matched with the code analysis demand information.

10. The apparatus of claim 9, wherein the first receiving means is preceded by further comprising:

a second receiving module, configured to receive, through the data lake analysis service, a data table creation request sent by the client, where the data table creation request is used to indicate that a data table for performing code analysis on a code in the code engineering file is created based on carried data table type information and address information of the code engineering file;

and the creating module is used for creating the data table based on the data table type information and the address information carried by the data table creating request through the data lake analyzing service so as to analyze the codes in the code engineering file.

11. The apparatus of claim 10, wherein the creation module comprises:

the creating submodule is used for creating a first data table with a code field based on the data table type information carried by the data table creating request through the data lake analysis service;

the analysis submodule is used for acquiring the code engineering file based on the address information carried by the data table creation request through the data lake analysis service, and analyzing the code engineering file to acquire grammatical structure information of the codes in the code engineering file;

and the establishing submodule is used for establishing a mapping relation between the code field in the first data table and the syntactic structure information through the data lake analysis service, and obtaining a second data table which has the code field and the code content of the code field, so as to be used for carrying out code analysis on the codes in the code engineering file.

12. The apparatus according to claim 11, wherein the creating submodule is specifically configured to:

13. The apparatus of claim 11, wherein after the establishing the sub-module, the creating module further comprises:

and the storage submodule is used for storing a second data table which has the code fields and the code contents of the code fields in corresponding data sources by the data lake analysis service and adopting a preset data format.

14. The apparatus of claim 13, wherein the analysis module comprises:

and the analysis submodule is used for carrying out code analysis on the codes in the second data table pulled from the data source based on the code analysis demand information through the data lake analysis service so as to obtain an analysis result matched with the code analysis demand information.

15. The apparatus of claim 14, wherein the analysis submodule is specifically configured to:

16. The apparatus of any one of claims 9-15, wherein the analysis module is followed by the apparatus further comprising:

and the dumping module is used for dumping the analysis result to a target data source through the data lake analysis service.

17. A code analysis system, the system comprising:

a client, a data lake analysis service in communication connection with the client, and a data source in communication connection with the data lake analysis service,

the client is used for generating a code analysis request based on code analysis demand information input by a user and sending the code analysis request to the data lake analysis service, wherein the code analysis request is used for indicating code analysis based on the carried code analysis demand information;

and receiving the code analysis request sent by the client through the data lake analysis service, and performing code analysis on codes in a data table pulled from the data source based on the code analysis demand information to obtain an analysis result matched with the code analysis demand information.

18. An electronic device, the device comprising:

one or more processors;

a computer readable medium configured to store one or more programs,

when executed by the one or more processors, cause the one or more processors to implement a code analysis method as claimed in any one of claims 1-8.

19. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out a code analysis method as claimed in any one of claims 1 to 8.