CN115202663A

CN115202663A - Data processing method, device and storage medium

Info

Publication number: CN115202663A
Application number: CN202110402574.1A
Authority: CN
Inventors: 程超
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-04-14
Filing date: 2021-04-14
Publication date: 2022-10-18

Abstract

The embodiment of the application discloses a data processing method, a data processing device and a storage medium, wherein a directory structure hierarchy is generated by reading and decompressing a preset frame template file; acquiring a file list of a plurality of interface definition files, and circularly analyzing the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files; acquiring service information and interface attribute information in an interface definition file according to the first abstract syntax tree; and generating a frame code file based on the service information, the interface attribute information and the preset code template file, and moving the frame code file to a corresponding target directory in a directory structure hierarchy. Therefore, the operation of generating the frame code file for multiple times on multiple interface definition files is avoided, and the development efficiency is improved.

Description

Data processing method, device and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a data processing method, apparatus, and storage medium.

Background

Protocol Buffers (Google Protocol Buffers) is a tool library provided by Google with an efficient Protocol data exchange format, and generates codes of cross-language environments by defining data structures and service interfaces. Scaffold tools are project generation technologies supported by various tools. In the product development process, when a product needs different teams to perform function development, in order to ensure the consistency of a code structure and a format and reduce the workload of code writing, a framework code file can be uniformly generated through a scaffold tool and a Protobuf interface definition language file, namely a Proto file, and developers complete the development of each function based on the framework code file, so that the development speed is improved.

However, in the prior art, only a single Proto file can be used for generating the framework code, and at this time, the framework codes generated from Proto files one by one need to be manually integrated into one service framework, so that the manual integration has low operation efficiency and is easy to generate errors, and the improvement of the development efficiency is influenced.

Disclosure of Invention

The embodiment of the application provides a data processing method, a data processing device and a storage medium. The development efficiency of the product development project can be improved.

A method of data processing, comprising:

reading a preset frame template file and decompressing to generate a directory structure hierarchy;

acquiring a file list of a plurality of interface definition files, and circularly analyzing the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files;

acquiring service information and interface attribute information in the interface definition file according to the first abstract syntax tree;

and generating a frame code file based on the service information, the interface attribute information and a preset code template file, and moving the frame code file to a corresponding target directory in the directory structure hierarchy.

Correspondingly, an embodiment of the present application provides a data processing apparatus, including:

the decompression unit is used for reading the preset frame template file and decompressing to generate a directory structure hierarchy;

the analysis unit is used for acquiring a file list of a plurality of interface definition files, and circularly analyzing the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files;

a first obtaining unit, configured to obtain service information and interface attribute information in the interface definition file according to the first abstract syntax tree;

and the first generating unit is used for generating a frame code file based on the service information, the interface attribute information and a preset code template file, and moving the frame code file to a corresponding target directory in the directory structure hierarchy.

In an embodiment, the parsing unit includes:

the reading subunit is configured to cyclically read character data of a plurality of interface definition files in the file list, perform part-of-speech analysis on the character data, and generate tag data corresponding to the character data;

and the constructing subunit is used for carrying out syntactic analysis on the marked data and constructing a first abstract syntax tree of a plurality of interface definition files based on the marked data.

In an embodiment, the first generating unit includes:

the first acquiring subunit is used for acquiring a preset template code file;

and the generating subunit is used for replacing the corresponding variable information in the preset template code file according to the service information and the interface attribute information to generate a frame code file.

In an embodiment, the first generating unit includes:

a setting subunit, configured to perform priority setting on the frame code file;

and the first moving subunit is used for moving the frame code file to a target directory corresponding to the level according to the level of the priority of the frame code file.

In an embodiment, the first generating unit includes:

the marking subunit is used for marking the label information of the frame code file;

and the second moving subunit is used for moving the frame code file to a target directory corresponding to the label information according to the label information of the frame code file.

In an embodiment, the data processing apparatus further includes:

and the specifying unit is used for specifying the file paths of the preset frame template file, the interface definition file, the preset code template file and the structured query language script file through a command line tool.

In an embodiment, the data processing apparatus further includes:

the second acquisition unit is used for acquiring and analyzing the structured query language script file according to the file path of the structured query language script file to obtain data definition language information, wherein the data definition language information comprises table information, field information and type information;

a third obtaining unit, configured to obtain a database access object layer code template file in the preset code template file;

a second generating unit configured to generate a database access object layer code file based on the data definition language information and the database access object layer code template file;

and the mobile unit is used for moving the database access object layer code file to a database directory in the directory structure hierarchy.

In an embodiment, the second obtaining unit includes:

the second acquisition subunit is used for acquiring and analyzing the structured query language script file to obtain a second abstract syntax tree of the structured query language script file;

and the third acquisition subunit is used for acquiring the data definition language information of the structured query language script file according to the second abstract syntax tree.

In addition, a storage medium is provided in an embodiment of the present application, where the storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to perform steps in any data processing method provided in the embodiment of the present application.

In addition, the embodiment of the present application further provides a computer device, which includes a processor and a memory, where the memory stores an application program, and the processor is configured to run the application program in the memory to implement the data processing method provided in the embodiment of the present application.

Embodiments of the present application also provide a computer program product or a computer program, which includes computer instructions stored in a storage medium. The processor of the computer device reads the computer instructions from the storage medium, and executes the computer instructions, so that the computer device executes the steps in the data processing method provided by the embodiment of the application.

According to the embodiment of the application, a directory structure hierarchy is generated by reading and decompressing the preset frame template file; acquiring a file list of a plurality of interface definition files, and circularly analyzing the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files; acquiring service information and interface attribute information in an interface definition file according to the first abstract syntax tree; and generating a frame code file based on the service information, the interface attribute information and the preset code template file, and moving the frame code file to a corresponding target directory in a directory structure hierarchy. Therefore, the preset frame template file is decompressed to generate a directory structure hierarchy, the plurality of interface definition files are circularly analyzed to obtain the service information and the interface attribute information in the interface definition files, the frame code file is generated based on the service information, the interface attribute information and the preset code template file, and the generated frame code file is moved to a corresponding target directory in the directory structure hierarchy, so that the frame code is prevented from being generated one by one for the plurality of interface definition files, and the development efficiency is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic view of an implementation scenario of a data processing method according to an embodiment of the present application;

fig. 2 is a schematic flowchart of a data processing method according to an embodiment of the present application;

fig. 3 is a schematic flowchart of a data processing method according to an embodiment of the present application;

fig. 4 is another schematic flow chart of a data processing method according to an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a computer device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a data processing method, a data processing device and a storage medium. The data processing apparatus may be integrated into a computer device, and the computer device may be a server or a terminal.

For a better understanding of the embodiments of the present application, reference is made to the following terms:

scaffold: a meta-programming method for constructing database-supported software applications. Scaffolding is a project generation technique supported by various tools, in which programmers can write specifications describing how to use an application database. The compiler uses this specification to generate code that the application can use to create, read, update, and delete database entries, effectively treating the template as a "scaffold" that builds a more powerful application.

A frame: a Framework (Framework) is a reusable design of a whole or part of a system and is expressed as a group of abstract components and a method for interaction among component instances; another definition considers a framework as an application framework that can be customized by an application developer. A framework is a reusable design component that specifies the architecture of an application, sets forth dependencies, responsibility allocations, and control flows among the entire design, collaboration components, and represents a set of abstract classes and methods of collaboration among its instances.

A Command Line tool, namely, a Command-Line Interface (CLI) is the most widely used user Interface before graphical user interfaces are popularized, and generally does not support a mouse, and a user inputs an instruction through a keyboard and a computer executes the instruction after receiving the instruction. Also known as code generation tools.

Protobuf: protocol Buffers are a data description Language developed by Google corporation, and similar to Extensible Markup Language (XML), structured data can be serialized, and the method can be used in aspects of data storage, communication protocols and the like.

Abstract syntax tree: in computer science, an Abstract Syntax Tree (AST) or Syntax Tree (Syntax Tree) is an Abstract representation of the Syntax structure of a source code. It represents the syntactic structure of the programming language in the form of a tree, each node on the tree representing a structure in the source code.

RPC: remote Procedure Calls (RPCs) are a protocol that a program can use to request services from a program on another computer in the network. In RPC, the requesting program is a client program, and the program providing the service is a server. RPC (remote procedure call) is a technology widely used to support distributed applications (applications where different components are distributed on different computers). The primary purpose of RPC is to provide a way for components to communicate with each other, enabling them to make requests to each other and to pass the results of those requests.

SQL: structured Query Language (SQL) is a special purpose programming Language, a database Query and programming Language, used to access data and Query, update, and manage relational database systems.

DDL: a database schema Definition Language (DDL), also called Data Definition Language, belongs to one of SQL languages, and is a Language for describing real-world entities to be stored in a database.

DAO: database Access Object (DAO) is an Object-oriented database interface that exposes Microsoft Jet database engines and allows Visual Basic (VB, a common Object-based programming language developed by Microsoft corporation, a structured, modular, object-oriented, visualization programming language that contains event-driven mechanisms that assist in the development environment). Developers connect directly to the Access (relational Database management system, issued by microsoft) table, like connecting directly to other databases through Open Database Connectivity (ODBC). DAO is best suited for single system applications or small-scale local distributed usage.

Referring to fig. 1, for example, a data processing apparatus is integrated in a computer device, and fig. 1 is a schematic view of an implementation environment scene of a data processing method provided in an embodiment of the present application, where the data processing method includes a server a and a terminal B, where the server a may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server that provides basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a Network service, cloud communication, a middleware service, a domain name service, a security service, a Network acceleration service (CDN), and a big data and artificial intelligence platform. The server A can read and decompress a preset frame template file to generate a directory structure hierarchy; acquiring a file list of a plurality of interface definition files, and circularly analyzing the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files; acquiring service information and interface attribute information in an interface definition file according to the first abstract syntax tree; and generating a frame code file based on the service information, the interface attribute information and the preset code template file, and moving the frame code file to a corresponding target directory in a directory structure hierarchy.

The terminal B may be various computer devices capable of inputting data, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like, but is not limited thereto. The terminal B and the server a may be directly or indirectly connected through wired or wireless communication, and the server a may receive data uploaded by the terminal B to perform corresponding data processing operations, which is not limited herein.

It should be noted that the schematic diagram of the implementation environment scenario of the data processing method shown in fig. 1 is only an example, and the implementation environment scenario of the data processing method described in the embodiment of the present application is for more clearly explaining the technical solution of the embodiment of the present application, and does not constitute a limitation to the technical solution provided by the embodiment of the present application. As will be appreciated by those skilled in the art, with the evolution of data processing and the emergence of new business scenarios, the technical solutions provided in the present application are equally applicable to similar technical problems.

The following are detailed below. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.

The embodiment will be described in the context of a data processing apparatus, which may be specifically integrated in a computer device, where the computer device may be a server or a terminal, and the application is not limited herein.

Referring to fig. 2, fig. 2 is a schematic flow chart of a data processing method according to an embodiment of the present disclosure. The data processing method comprises the following steps:

in step 101, a preset frame template file is read and decompressed to generate a directory structure hierarchy.

In the product development process, different teams are generally required to cooperate to complete the development of product functions, however, different code writing habits may exist or different language environments are required to be used for writing codes for different teams, different function developments or different developers, so that in order to ensure the consistency of code structures and formats and reduce the workload of code writing, a framework code file can be generated uniformly through a scaffold tool and an interface definition language file of Protobuf, namely a Proto file, the framework code file includes interface information of service definition and contents of code encapsulation with high repeatability and the like, the developers can perform coding on the basis of the framework code file to complete the development of various functions, and the development speed is improved.

A Service (Service) is a function call provided by a lower layer to an immediately upper layer, and refers to an application, routine, or process that performs a specific function in order to support other programs, and provides a series of interfaces to implement corresponding functions. The interface is a connection point for exchanging information between two adjacent layers in the same node, and is an entrance for using lower layer services by an upper layer. A service may be composed of a plurality of modules, each module generally defines a Proto file, and therefore, a developer generally needs to define a plurality of Proto files when defining an interface, that is, when defining a service interface, but in the prior art, only a single Proto file is used to generate a framework code file, at this time, the developer needs to manually generate a plurality of Proto files one by one, and manually integrate all generated framework code files into a service framework, and the manual integration has low operation efficiency and is prone to errors, which affects improvement of development efficiency.

In order to solve the above problems, an embodiment of the present application provides a data processing method, where a preset frame template file is decompressed to generate a directory structure hierarchy, multiple Proto files are cyclically analyzed, a frame code file is generated according to the analyzed data and the preset code template file, and the generated frame code file is moved to a corresponding target directory in the directory structure hierarchy, so as to generate a frame of a product development project, thereby avoiding a need of performing generation operation of the frame code file on the multiple Proto files one by one in the prior art, reducing a process of integrating all generated frame code files into one service frame, reducing an error rate of manual operation, and further improving development efficiency of the project. Please refer to the following steps for a specific implementation process.

The method comprises the steps of generating a frame code file according to a plurality of Proto files, wherein the frame code file can be generated in a user-defined directory hierarchy in a unified mode through a user-defined frame template file, and therefore, the directory structure hierarchy can be generated by acquiring a preset frame template file, reading and decompressing the preset frame template file. In an embodiment, a path of a preset frame template file may be specified by a command line tool of a scaffold, and a path of another file required for generating a frame may also be specified by the command line tool of the scaffold, for example, a path of a plurality of interface definition files (Proto files) may also be specified, a path of a preset code template file for generating a frame code file may also be specified, a Port (Port) for service operation may also be specified, and meanwhile, a corresponding parameter may be set by the command line tool to implement a corresponding function, for example, a corresponding parameter may be set by the command line tool so that the execution of the command generates only a PB file, which is an executable binary file obtained by compiling the interface definition files. And after the corresponding file is specified and the parameters are set through a command line tool, the preset frame template file can be inquired through the path of the specified preset frame template file, and then the preset frame template file is read and decompressed to generate a directory structure hierarchy.

The preset frame template file is a tree-shaped directory structure compressed package file organized according to the directory structure hierarchy of the project, is used for defining the directory hierarchy of the frame to be generated, and can be set by a developer in a self-defined mode according to the requirement of the project. In an embodiment, the generated directory structure hierarchy may be moved to a specified folder, and after a frame of a product development project is generated, the frame may be packaged according to the directory hierarchy generated by a preset frame template file, so as to obtain a compressed package file of the frame of the project.

In step 102, a file list of the plurality of interface definition files is obtained, and the interface definition files are circularly analyzed according to the file list to obtain a first abstract syntax tree of the plurality of interface definition files.

In order to simultaneously generate frame code files according to a plurality of interface definition files and integrate the frame code files into one frame, paths of the interface definition files can be designated through a command line tool, a file list of the interface definition files can be obtained through the paths of the interface definition files, and the interface definition files are circularly analyzed according to the file list, wherein the interface definition files define contents such as a service interface and a Message (Message), the service interface can be an RPC (remote procedure Protocol) interface or a Hypertext Transfer Protocol (HTTP for short) interface, and the service interface can be used as a channel for Message transmission, the Message is structured data, a data structure is defined in the Message and comprises interface parameter information such as a data type, a field name, a field rule, a unique field identifier and a default value, and therefore, when the interface defined by the interface definition files is called, the data can be transmitted through the interface in a format of the data structure defined in the interface definition files.

In order to facilitate the program to read the code data in the plurality of interface definition files, the abstract syntax tree parser may perform cyclic parsing on the plurality of interface definition files, and further perform part-of-speech analysis, also called scanning (Scanner), on the code data defined in the interface definition files, that is, all words or characters in the interface definition files are converted into individual tags (Token) according to a predetermined rule. Meanwhile, it will remove the blank character, comment, etc., divide the code data in the whole interface definition file into a Token list finally, thus produce the correspondent label data, can carry on the syntactic analysis to the label data subsequently, namely convert the Token list that the lexical analysis gets into the form of tree form, meanwhile, the abstract syntax tree resolver will verify the grammar, and delete some unnecessary tokens, such as incomplete brackets, etc., in this way, get the first abstract syntax tree of a plurality of interface definition files. Each node of the first abstract syntax tree represents a syntax structure in the program code, for example, a packet, a type, a modifier, an operator, an interface, a return value, etc. may be a syntax structure.

In step 103, service information and interface attribute information in the interface definition file are obtained according to the first abstract syntax tree.

In order to generate the frame code file, on the basis of parsing and constructing the plurality of interface definition files to obtain a first abstract syntax tree of the plurality of interface definition files, service information and interface attribute information in the interface definition files are obtained by reading the first abstract syntax tree of the plurality of interface definition files, wherein the service information comprises information such as a service name, and the interface attribute information comprises an interface name defined in the interface definition file and interface parameter information such as a data type, a field name and a field rule defined in a data structure, and the operation of generating the frame code file is performed based on the obtained information.

In step 104, a frame code file is generated based on the service information, the interface attribute information and the preset code template file, and the frame code file is moved to a corresponding target directory in the directory structure hierarchy.

After the service information and the interface attribute information of the interface definition file are acquired, in order to generate a self-defined frame code file, a preset template code file can be acquired through a path specified by a command line tool, and corresponding variable information in the preset template code file is replaced according to the acquired service information and the interface attribute information, so that a corresponding frame code file is generated. Furthermore, when a developer calls an interface in the framework code file through the framework, data is transmitted in the interface in a format defined in the interface attribute information. The preset code template file is a template on which the frame code file is generated, the number of the preset code template files can be multiple, and correspondingly, the number of the generated frame code files is multiple.

In an embodiment, the generated frame code files may be set with priorities, for example, the priorities of the frame code files may be set according to the importance levels of the frame code files, that is, higher priority levels may be set for some frame code files with higher importance levels, and lower priority levels may be set for some frame code files with lower importance levels; the use times of the frame code files can be accumulated, the level of the highest priority is set for the frame code file with the most use times, and the level of the lowest priority is set for the frame code file with the least use times; the priority of the frame code file can be set according to the sequence of the use time of the frame code file, the highest priority level of the frame code file which is used most recently is set, the lowest priority level of the frame code file which is not used for the longest time is set, and the like, so that the frame code file is moved to a target directory corresponding to the priority level of the frame code file according to the priority level of the frame code file, and developers can maintain and quickly obtain the more important frame code file.

In an embodiment, the tag information may be a corresponding hierarchy in the framework, such as a Service layer (Service layer), a control layer (Controller layer), a database access object layer (DAO layer), a User layer (User layer, for managing relevant codes of a User), and the like, a name of a development team, a language type before format conversion, a type of an implemented function module, and the like, and the framework code file is moved to a target directory corresponding to the tag information according to the tag information of the framework code file, so that developers can quickly manage and acquire the framework code files with different tag information.

In an embodiment, in order to access the database through the framework to implement operations such as adding, deleting, modifying, querying and the like on the database, a corresponding database structure and an operation method may be defined through the structured query language script file, and then, according to the database structure and the operation method defined in the structured query language script file, a corresponding database access object layer code file may be generated through the corresponding database access object layer code template file, and a developer may access the database by calling the database access object layer code file. The database access object layer code template file is a template of a database access object layer code file to be generated, and comprises packaging of some basic codes and variable information to be replaced. Specifically, a path of a structured query language script file may be specified in a command line tool of a scaffold, the structured query language script file may be obtained and analyzed according to a file path of the structured query language script file, so as to obtain a second abstract syntax tree of the structured query language script file, and Data Definition Language (DDL) information of the structured query language script file may be obtained according to the second abstract syntax tree, where the data definition language information includes table information, field information, and type information, and may specifically include information such as a table name, a field type, and a field length, that is, information corresponding to a database structure and a database operation method defined by a DDL language in the structured query language script file, so as to obtain a database access object layer code template file in the preset code template file, generate a database access object layer code file based on the data definition language information and the database access object layer code template file, and move the database access object layer code file to a database directory in the directory structure. Therefore, the developer can access the database by accessing the object layer code file through the database in the framework.

As can be seen from the above, in the embodiment of the present application, the directory structure hierarchy is generated by reading the preset frame template file and decompressing; acquiring a file list of a plurality of interface definition files, and circularly analyzing the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files; acquiring service information and interface attribute information in an interface definition file according to the first abstract syntax tree; and generating a frame code file based on the service information, the interface attribute information and the preset code template file, and moving the frame code file to a corresponding target directory in a directory structure hierarchy. Therefore, the preset frame template file is decompressed to generate a directory structure hierarchy, the plurality of interface definition files are circularly analyzed to obtain the service information and the interface attribute information in the interface definition files, the frame code file is generated based on the service information, the interface attribute information and the preset code template file, and the generated frame code file is moved to a corresponding target directory in the directory structure hierarchy, so that the generation operation of frame codes for the plurality of interface definition files one by one is avoided, and the development efficiency is improved on the basis of improving the standardization of engineering development.

The method described in the above examples is further illustrated in detail below by way of example.

In this embodiment, the data processing apparatus will be described by taking an example in which the data processing apparatus is specifically integrated in a computer device. The data processing method takes a server as an execution subject and specifically describes by taking the example of generating a database access object layer code file. Specifically, please refer to fig. 3, where fig. 3 is a schematic flowchart of a data processing method according to an embodiment of the present application.

For a better description of the embodiments of the present application, please refer to fig. 3 and fig. 4 together. As shown in fig. 4, fig. 4 is another schematic flow chart of the data processing method according to the embodiment of the present application. The specific process is as follows:

in step 201, the server specifies the file paths of the preset frame template file, the interface definition file, the preset code template file and the structured query language script file through a command line tool, reads the preset frame template file and decompresses the preset frame template file to generate a directory structure hierarchy.

When a frame of a product development project is generated, files required for generating the frame need to be specified, so that a server acquires the specified files through a command line tool in a scaffold to generate the frame. Specifically, the server may specify a file path of a preset frame template file, an interface definition file, a preset code template file and a structured query language script file, which are required for generating a frame, through a command line tool, where the preset frame template file is used to generate a directory structure hierarchy of a project, and may perform a custom setting according to an idea of a developer or a requirement of a product development project; the interface definition file is used for defining service interfaces required by projects, and a plurality of interface definition files can exist; the preset code template file is used for combining with the interface definition file to generate a frame code file, is a template of the frame code file generated by the data processing method provided by the embodiment of the application, and can be set in a self-defined manner according to the requirements of product development projects; the Structured Query Language (SQL) script file is used for defining a database structure, an operation method and the like, and a database access object layer code file is generated according to the SQL script file and a corresponding template, so that a developer can access the database through a framework. Therefore, the preset frame template file is obtained through the appointed path of the preset frame template file, so that the preset frame template file is read and decompressed, and the directory structure hierarchy of the product development project is generated. The directory structure hierarchy includes a target directory and a database directory, the database directory may be used for storing a database access object layer code file, the target directory may be used for storing a frame code file, and a plurality of subdirectories may be arranged under the target directory and the database directory, which is not limited herein.

In step 202, the server obtains a file list of a plurality of interface definition files, circularly reads character data of the plurality of interface definition files in the file list, performs part-of-speech analysis on the character data, generates tag data corresponding to the character data, performs syntax analysis on the tag data, and constructs a first abstract syntax tree of the plurality of interface definition files based on the tag data.

In order to generate a frame code file of a frame, a server may obtain a file list of a plurality of interface definition files through a path of the interface definition file specified by a command line tool, and then cyclically read character data of the plurality of interface definition files in the file list, that is, read data related to an interface and a data structure defined in the interface definition file, in order to facilitate a program to read code data in the plurality of interface definition files, cyclically analyze the plurality of interface definition files through an abstract syntax tree analyzer, and specifically, perform part-of-speech analysis on the character data in the plurality of interface definition files, that is, convert all words or characters in the interface definition files into a plurality of tags (Token) according to a predetermined rule. Meanwhile, removing data such as blanks and comments in the character data, further dividing the character data in the whole interface definition file into a Token list, namely a one-dimensional array, so as to generate mark data corresponding to the character data, then performing syntactic analysis on the mark data, namely converting the Token list obtained by lexical analysis into a tree form, meanwhile, an abstract syntax tree parser can verify the grammar and delete some unnecessary tokens, such as incomplete brackets and the like, and constructing first abstract syntax trees of a plurality of interface definition files based on the mark data, so as to obtain the first abstract syntax trees of the plurality of interface definition files.

In step 203, the server obtains the service information and the interface attribute information in the interface definition file according to the first abstract syntax tree, obtains a preset template code file, and replaces corresponding variable information in the preset template code file according to the service information and the interface attribute information to generate a frame code file.

After the first abstract syntax tree of the plurality of interface definition files convenient for program reading is obtained, the first abstract syntax tree of the plurality of interface definition files is read, and service information and interface attribute information in the interface definition files are obtained, wherein the service information comprises information such as service names and the like, and the interface attribute information comprises information such as interface names defined in the interface definition files and interface parameter information such as data types, field names, field rules and the like defined in data structures. Meanwhile, the preset template code file can be acquired through a path of the preset template code file designated in the command line tool, and corresponding variable information in the preset template code file is replaced according to the acquired service information and interface attribute information, that is, relevant data such as interfaces defined in a plurality of interface definition files, defined data structures and the like are replaced in the preset template code file, and then the corresponding frame code file is generated. It should be noted that the preset template code file may include a database access object layer code template file, and in this step, corresponding operation is not performed on the database access object layer code template file. Therefore, when a developer calls an interface in the frame code file through the frame, data is transmitted in the interface in a format defined in the interface parameter information.

In step 204, the server sets the priority of the frame code file, and moves the frame code file to the target directory corresponding to the priority of the frame code file according to the priority of the frame code file.

After the frame code file is generated, the frame code file may be moved to a target directory corresponding to a directory structure hierarchy generated by the frame template file, and specifically, the generated frame code file may be set with a priority, for example, the priority of the frame code file may be set according to the importance level of the frame code file, that is, a higher priority level may be set for some frame code files with higher importance levels, and a lower priority level may be set for some frame code files with lower importance levels; or accumulating the use times of the frame code files, setting the highest priority level for the frame code file with the most use times, and setting the lowest priority level for the frame code file with the least use times; the priority of the frame code file can be set according to the sequence of the using time of the frame code file, the highest priority level of the frame code file which is used most recently is set, the lowest priority level of the frame code file which is not used for the longest time is set, and the like, so that the frame code file is moved to a target directory corresponding to the priority level according to the priority level of the frame code file, and developers can maintain and quickly acquire the frame code file with the highest priority level.

In an embodiment, the tag information may be a corresponding hierarchy in the framework, such as a Service layer (Service layer), a control layer (Controller layer), a database access object layer (DAO layer), a User layer (User layer), and the like, a name of a development team, a language type before format conversion, a type of an implemented function module, and the like, and the framework code file is moved to a target directory corresponding to the tag information according to the tag information of the framework code file, so that a developer can rapidly manage and acquire the framework code files with different tag information.

In step 205, the server obtains and parses the structured query language script file according to the file path of the structured query language script file to obtain a second abstract syntax tree of the structured query language script file, and obtains the data definition language information of the structured query language script file according to the second abstract syntax tree.

In the product development process, generally, the database needs to be accessed, correspondingly, for a frame of a product development project, the part of codes for operating the database can be packaged into a frame code file of a database access object layer according to the requirement, namely, the code file of the database access object layer is generated, so that a developer can realize the operations of adding, deleting, modifying, inquiring and the like on the database based on the frame, and meanwhile, the developer can continue to encode on the basis of the code file of the database access object layer, so that the repeated writing of related codes for accessing the database is reduced, and the workload is reduced. Specifically, the corresponding database interface may be defined by a structured query language script file, the structured query language script file may be written using a DDL language in an SQL language, the database structure and the operation method of the database may be defined by the DDL language, the operation method of the database may include operation methods such as creating, modifying, deleting, and querying, and then a corresponding database access object layer code file may be generated according to the database structure and the operation method of the database defined by the DDL language in the structured query language script file and a corresponding template file, and a developer may access the object layer code file by calling the generated database to implement access to the database.

In an embodiment, the structured query language script file may be parsed by an abstract syntax tree parser of an SQL language, that is, part of speech analysis is performed on code data of a DDL language in the structured query language script file, that is, all words or characters in the structured query language script file are converted into individual tags according to a predetermined rule. Meanwhile, removing blank symbols, comments and other data in the character data, further dividing the code data in the whole structured query language script file into a Token list, thereby generating labeled data corresponding to the code data, then performing syntax analysis on the labeled data, namely converting the Token list obtained by lexical analysis into a tree form, and constructing a second abstract syntax tree based on the labeled data of the structured query language script file.

Reading a second abstract syntax tree obtained according to the structured query language script file, and obtaining data definition language information defined in the structured query language script file according to the second abstract syntax tree, where the data definition language information includes table information, field information, and type information, for example, table name, field type, and field length, that is, information corresponding to a database structure and a database operation method defined by the DDL language in the structured query language script file.

In step 206, the server obtains a database access object layer code template file in the preset code template file, generates a database access object layer code file based on the data definition language information and the database access object layer code template file, and moves the database access object layer code file to a database directory in the directory structure hierarchy.

The server obtains a database access object layer code template file in the preset code template file, replaces corresponding variable information in the database access object layer code template file with data definition language information obtained by the structured query language script file, generates a database access object layer code file after replacement, and moves the database access object layer code file to a database directory in the directory structure hierarchy, so that the server can access the database by accessing the object layer code file through the database in the framework.

In an embodiment, the priority of the generated database access object layer code file may be set, for example, the priority of the database access object layer code file may be set according to the importance degree of the database access object layer code file, that is, a higher priority level may be set for some database access object layer code files with higher importance degrees, and a lower priority level may be set for some database access object layer code files with lower importance degrees; or accumulating the use times of the database access object layer code files, setting the highest priority level for the database access object layer code file with the most use times, and setting the lowest priority level for the database access object layer code file with the least use times; the priority of the database access object layer code file can be set according to the using time of the database access object layer code file, the highest priority level of the database access object layer code file which is used recently is set, the lowest priority level of the database access object layer code file which is not used for the longest time is set, and the like, so that the database access object layer code file is moved to the database directory corresponding to the priority level according to the priority level of the database access object layer code file, and developers can maintain and quickly obtain the database access object layer code file with higher priority.

In an embodiment, the label information may be used to mark the code file of the database access object layer, where the label information may be hierarchy information of the code file of the database access object layer, may be a language type before format conversion, and may also be a category of a functional module to be implemented, and according to the label information of the code file of the database access object layer, the code file of the database access object layer is moved to a database directory corresponding to the label information, so that developers may quickly manage and obtain the code files of the database access object layer with different label information.

As can be seen from the above, in the embodiment of the present application, the server specifies the file paths of the preset frame template file, the interface definition file, the preset code template file, and the structured query language script file through the command line tool, reads the preset frame template file, decompresses the preset frame template file, and generates the directory structure hierarchy; the method comprises the steps that a server obtains a file list of a plurality of interface definition files, character data of the interface definition files in the file list are read in a circulating mode, part of speech analysis is conducted on the character data, tag data corresponding to the character data are generated, syntax analysis is conducted on the tag data, and a first abstract syntax tree of the interface definition files is built on the basis of the tag data; the server acquires service information and interface attribute information in the interface definition file according to the first abstract syntax tree, acquires a preset template code file, and replaces corresponding variable information in the preset template code file according to the service information and the interface attribute information to generate a frame code file; the server sets the priority of the frame code file, and moves the frame code file to a target directory corresponding to the priority of the frame code file according to the priority of the frame code file; the server acquires and analyzes the structured query language script file according to the file path of the structured query language script file to obtain a second abstract syntax tree of the structured query language script file, and acquires data definition language information of the structured query language script file according to the second abstract syntax tree; the server acquires a database access object layer code template file in the preset code template file, generates a database access object layer code file based on the data definition language information and the database access object layer code template file, and moves the database access object layer code file to a database directory in the directory structure hierarchy. Therefore, a preset frame template file is decompressed to generate a directory structure hierarchy, a plurality of interface definition files are circularly analyzed to obtain service information and interface attribute information in the interface definition files, further, a frame code file is generated based on the service information, the interface attribute information and the preset code template file, the generated frame code file is moved to a corresponding target directory in the directory structure hierarchy, meanwhile, a structured query language script file is obtained and analyzed to obtain a second abstract syntax tree of the structured query language script file, data definition language information of the structured query language script file is obtained according to the second abstract syntax tree, a database access object layer code file is generated according to the data definition language information and the database access object layer code template file, so that developers can access data through the frame to generate a uniform frame, generation operation of frame codes for the plurality of interface definition files one by one is avoided, and development efficiency is improved on the basis of improving standardization of engineering development.

In order to better implement the above method, an embodiment of the present invention further provides a data processing apparatus, which may be integrated in a computer device, and the computer device may be a server.

For example, as shown in fig. 5, for a schematic structural diagram of a data processing apparatus provided in an embodiment of the present application, the data processing apparatus may include a decompression unit 301, a parsing unit 302, a first obtaining unit 303, and a first generating unit 304, as follows:

a decompression unit 301, configured to read a preset frame template file and decompress the preset frame template file to generate a directory structure hierarchy;

the parsing unit 302 is configured to obtain a file list of a plurality of interface definition files, and perform cyclic parsing on the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files;

a first obtaining unit 303, configured to obtain the service information and the interface attribute information in the interface definition file according to the first abstract syntax tree;

a first generating unit 304, configured to generate a frame code file based on the service information, the interface attribute information, and a preset code template file, and move the frame code file to a corresponding target directory in the directory structure hierarchy.

In an embodiment, the parsing unit 302 includes:

the reading subunit is used for circularly reading the character data of the plurality of interface definition files in the file list, performing part-of-speech analysis on the character data and generating mark data corresponding to the character data;

and the constructing subunit is used for carrying out syntactic analysis on the marked data and constructing a first abstract syntax tree of the plurality of interface definition files based on the marked data.

In an embodiment, the first generating unit 304 includes:

the first acquisition subunit is used for acquiring a preset template code file;

In an embodiment, the first generating unit 304 includes:

and the first moving subunit is used for moving the frame code file to the target directory corresponding to the level according to the level of the priority of the frame code file.

In an embodiment, the first generating unit 304 includes:

and the second moving subunit is used for moving the frame code file to the target directory corresponding to the label information according to the label information of the frame code file.

In one embodiment, the data processing apparatus further includes:

a second generating unit for generating a database access object layer code file based on the data definition language information and the database access object layer code template file;

and the moving unit is used for moving the database access object layer code file to a database target directory in the directory structure hierarchy.

In an embodiment, the second obtaining unit includes:

In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.

As can be seen from the above, in the embodiment of the present application, the decompression unit 301 reads the preset frame template file and decompresses the preset frame template file to generate the directory structure hierarchy; the parsing unit 302 obtains a file list of a plurality of interface definition files, and performs cyclic parsing on the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files; the first obtaining unit 303 obtains the service information and the interface attribute information in the interface definition file according to the first abstract syntax tree; the first generating unit 304 generates a frame code file based on the service information, the interface attribute information, and the preset code template file, and moves the frame code file to a corresponding target directory in the directory structure hierarchy. Therefore, the preset frame template file is decompressed to generate a directory structure hierarchy, the plurality of interface definition files are circularly analyzed to obtain the service information and the interface attribute information in the interface definition files, the frame code file is generated based on the service information, the interface attribute information and the preset code template file, and the generated frame code file is moved to a corresponding target directory in the directory structure hierarchy, so that the generation operation of frame codes on the plurality of interface definition files one by one is avoided, and the development efficiency is improved.

An embodiment of the present application further provides a computer device, as shown in fig. 6, which shows a schematic structural diagram of a computer device according to an embodiment of the present application, where the computer device may be a server, and specifically:

the computer device may include components such as a processor 401 of one or more processing cores, memory 402 of one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that the computer device configuration illustrated in FIG. 6 does not constitute a limitation of computer devices, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. Wherein:

the processor 401 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby monitoring the computer device as a whole. Alternatively, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.

The computer device further comprises a power supply 403 for supplying power to the various components, and preferably, the power supply 403 is logically connected to the processor 401 via a power management system, so that functions of managing charging, discharging, and power consumption are implemented via the power management system. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

The computer device may also include an input unit 404, the input unit 404 being operable to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

Although not shown, the computer device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 401 in the computer device loads the executable file corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 401 runs the application programs stored in the memory 402, thereby implementing various functions as follows:

reading a preset frame template file and decompressing to generate a directory structure hierarchy; acquiring a file list of a plurality of interface definition files, and circularly analyzing the interface definition files according to the file list to obtain first abstract syntax trees of the plurality of interface definition files; acquiring service information and interface attribute information in an interface definition file according to the first abstract syntax tree; and generating a frame code file based on the service information, the interface attribute information and the preset code template file, and moving the frame code file to a corresponding target directory in a directory structure hierarchy.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein. It should be noted that the computer device provided in the embodiment of the present application and the data processing method in the foregoing embodiment belong to the same concept, and specific implementation processes thereof are described in the foregoing method embodiment and are not described herein again.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, the present application provides a storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any one of the data processing methods provided by the present application. For example, the instructions may perform the steps of:

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

Wherein the storage medium may include: read Only Memory (ROM), random Access Memory (RAM), magnetic or optical disks, and the like.

Since the instructions stored in the storage medium may execute the steps in any data processing method provided in the embodiments of the present application, beneficial effects that can be achieved by any data processing method provided in the embodiments of the present application may be achieved, for details, see the foregoing embodiments, and are not described herein again.

According to an aspect of the application, there is provided, among other things, a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations provided by the embodiments described above.

The foregoing detailed description is directed to a data processing method, a data processing apparatus, and a storage medium provided in the embodiments of the present application, and specific examples are applied in the present application to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the methods and core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A data processing method, comprising:

2. The data processing method as claimed in claim 1, wherein said circularly parsing the interface definition file according to the file list to obtain a first abstract syntax tree of a plurality of interface definition files comprises:

circularly reading character data of a plurality of interface definition files in the file list, and performing part-of-speech analysis on the character data to generate mark data corresponding to the character data;

and carrying out syntactic analysis on the marked data, and constructing a first abstract syntax tree of a plurality of interface definition files based on the marked data.

3. The data processing method of claim 1, wherein the generating a frame code file based on the service information, the interface attribute information, and a preset code template file comprises:

acquiring a preset template code file;

and replacing corresponding variable information in the preset template code file according to the service information and the interface attribute information to generate a frame code file.

4. The data processing method of claim 1, wherein said moving the frame code file to a corresponding target directory in the directory structure hierarchy comprises:

setting the priority of the frame code file;

and moving the frame code file to a target directory corresponding to the priority level of the frame code file according to the priority level of the frame code file.

5. The data processing method of claim 1, wherein said moving the frame code file to a corresponding target directory in the directory structure hierarchy comprises:

marking the label information of the frame code file;

and moving the frame code file to a target directory corresponding to the label information according to the label information of the frame code file.

6. The data processing method of claim 1, wherein before reading the preset frame template file and decompressing to generate the directory structure hierarchy, the method further comprises:

and specifying file paths of a preset frame template file, an interface definition file, a preset code template file and a structured query language script file through a command line tool.

7. The data processing method of claim 6, wherein the method further comprises:

acquiring and analyzing the structured query language script file according to the file path of the structured query language script file to obtain data definition language information, wherein the data definition language information comprises table information, field information and type information;

acquiring a database access object layer code template file in the preset code template file;

generating a database access object layer code file based on the data definition language information and the database access object layer code template file so as to access the database through the database access object layer code file;

and moving the database access object layer code file to a database directory in the directory structure hierarchy.

8. The data processing method of claim 7, wherein the obtaining and parsing the structured query language script file to obtain data definition language information comprises:

acquiring and analyzing a structured query language script file to obtain a second abstract syntax tree of the structured query language script file;

and acquiring data definition language information of the structured query language script file according to the second abstract syntax tree.

9. A data processing apparatus, characterized by further comprising:

the decompression unit is used for reading and decompressing the preset frame template file to generate a directory structure hierarchy;

10. A storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps of the data processing method according to any one of claims 1 to 8.