CN111949607A - Method, system and device for monitoring UDT file - Google Patents

Method, system and device for monitoring UDT file Download PDF

Info

Publication number
CN111949607A
CN111949607A CN202010918185.XA CN202010918185A CN111949607A CN 111949607 A CN111949607 A CN 111949607A CN 202010918185 A CN202010918185 A CN 202010918185A CN 111949607 A CN111949607 A CN 111949607A
Authority
CN
China
Prior art keywords
monitoring
udt
file
data
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010918185.XA
Other languages
Chinese (zh)
Other versions
CN111949607B (en
Inventor
孟玉
李学永
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN202010918185.XA priority Critical patent/CN111949607B/en
Publication of CN111949607A publication Critical patent/CN111949607A/en
Application granted granted Critical
Publication of CN111949607B publication Critical patent/CN111949607B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/13File access structures, e.g. distributed indices
    • G06F16/134Distributed indices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/156Query results presentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1734Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Library & Information Science (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention provides a method, a system and a device for monitoring a UDT file, wherein the method comprises the following steps: the monitoring server receives a submission notice sent by the version management server; the monitoring server acquires the UDT file to be monitored according to the submission notification; the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server; and the monitoring server compares the target monitoring resource data to obtain a monitoring result. By intercepting the submission request of the UDT file by the version management server, the remote server has data analysis service provided by a preset engine, and the monitoring server performs comparison operation on the target monitoring UDT file, the Diff automatic monitoring on the UDT file submitted by the user is realized, the workload of developers is reduced, and the working efficiency is improved.

Description

Method, system and device for monitoring UDT file
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a method, a system, and a device for monitoring a UDT file.
Background
In the existing game project development, a large number of plan configuration tables (generally Excel tables) are usually used for storing some static external data, and programmers can analyze Excel data into a form readable by project codes by writing a guide table script, so that the analyzed external data can take effect in game codes and complete specific functions.
However, during the development process, the planning personnel and programmers may frequently change the planning configuration table, and since various errors are generated by manual operation, the errors need to be timely discovered and corrected. Generally, a cooperation tool is used to manage Diff (text file is compared, and the difference between the current modification and the latest data content is compared) files generated when a configuration table is managed, and errors can be found and modified only by acquiring the Diff files in time and checking and comparing the Diff files to obtain the modified content.
For a UE Engine (Unreal Engine), the planned configuration table may also be frequently modified and frequently have errors, but a built-in collaboration tool supported by the UE cannot well acquire a Diff file generated by the configuration table, and only can manually check the Diff file through an editor, and consumes a certain degree of labor cost, and risks such as untimely monitoring and missing modification easily occur.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a monitoring method of a UDT file, a monitoring system of a UDT file and a monitoring apparatus of a UDT file that overcome or at least partially solve the above problems.
In order to solve the above problem, an embodiment of the present invention discloses a method for monitoring a UDT file, which is applied to a monitoring server, wherein the monitoring server is in communication connection with a version management server and a remote server, and the method includes:
the monitoring server receives a submission notice sent by the version management server; the submission notification is generated by intercepting a submission request of the UDT file by the version management server;
the monitoring server acquires the UDT file to be monitored according to the submission notification;
the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by the remote server through data analysis service provided by a preset engine and performing data analysis and format conversion on the UDT file to be monitored;
and the monitoring server compares the target monitoring resource data to obtain a monitoring result.
Optionally, the submission notification includes version information; the UDT files to be monitored comprise current version UDT files and historical version UDT files; the monitoring server acquires the UDT file to be monitored according to the submission notification, and the method comprises the following steps:
the monitoring server generates a UDT file acquisition request according to the version information and sends the UDT file acquisition request to the version management server;
the monitoring server receives the current version UDT file and the previous version UDT file sent by the version management server; and the current version UDT file and the historical version file are UDT files acquired by the version management server according to the version information.
Optionally, the target monitoring resource data includes a first target monitoring resource data and a second target monitoring resource data; the monitoring server sends the UDT file to be monitored to a remote server, and receives target monitoring resource data sent by the remote server, and the method comprises the following steps:
the monitoring server sends the current version UDT file and the previous version UDT file to a remote server;
the monitoring server receives first target monitoring resource data and second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by performing data analysis and format conversion on the current version UDT file; and the second target monitoring resource data is data obtained by performing data analysis and format conversion on the UDT file of the previous version.
Optionally, the target monitoring resource data includes data in units of a single attribute row; the monitoring server compares the target monitoring resource data to obtain a monitoring result, and the method comprises the following steps:
the monitoring server converts data in the first target monitoring resource data with a single attribute as a row unit into data in a plurality of attribute as row units to obtain first data;
the monitoring server converts the data taking a single attribute as a row unit in the second target monitoring resource data into data taking a plurality of attributes as row units to obtain second data;
and the monitoring server compares the first data with the second data to obtain a monitoring result.
Optionally, the monitoring server has a comparison module; the monitoring server compares the first data with the second data to obtain a monitoring result, and the method comprises the following steps:
the monitoring server compares the first data with the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of line data and a plurality of attribute values corresponding to the line data;
and traversing a plurality of attribute values corresponding to the row of data and adding corresponding row identifiers by the monitoring server to obtain comparison information.
Optionally, the submission notification includes personnel information; after the monitoring server obtains the monitoring result according to the target resource data, the method further comprises the following steps:
the monitoring server generates a monitoring data item according to the monitoring result and stores the monitoring data item in a preset database;
the monitoring server generates a monitoring notification according to the monitoring result and sends the monitoring notification to related personnel according to the personnel information;
and when a result viewing request aiming at the monitoring result is received, the monitoring server acquires the monitoring data entry from the preset database according to the viewing request so that related personnel can view the monitoring data entry conveniently.
The embodiment of the invention also discloses a monitoring system of the UDT file, which comprises a version management server, a monitoring server and a remote server,
the version management server is used for intercepting a submission request and generating a submission notice when the submission request of a preset UDT file is detected, and sending the submission notice to the monitoring server;
the monitoring server is used for receiving a submission notification sent by the version management server, acquiring a UDT file to be monitored according to the submission notification, and sending the UDT file to be monitored to a remote server;
the remote server is used for carrying out data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain target monitoring resource data and sending the target monitoring resource data to the monitoring server;
the monitoring server is further used for receiving the target monitoring resource data sent by the remote server and carrying out comparison operation on the target monitoring resource data to obtain a monitoring result.
The embodiment of the invention also discloses a monitoring device of the UDT file, which is applied to a monitoring server, wherein the monitoring server is in communication connection with the version management server and the remote server, and the device comprises:
a submission notification receiving module, configured to receive a submission notification sent by the version management server; the submission notification is generated by intercepting a submission request of the UDT file by the version management server;
a module for acquiring the UDT file to be monitored, which is used for acquiring the UDT file to be monitored according to the submission notice;
the target monitoring resource data receiving module is used for sending the UDT file to be monitored to a remote server and receiving target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by the remote server through data analysis service provided by a preset engine and performing data analysis and format conversion on the UDT file to be monitored;
and the monitoring result acquisition module is used for carrying out comparison operation on the target monitoring resource data to obtain a monitoring result.
Optionally, the submission notification includes version information; the UDT files to be monitored comprise current version UDT files and historical version UDT files; the module for acquiring the UDT file to be monitored comprises:
a UDT file acquisition request sending submodule, configured to generate a UDT file acquisition request according to the version information, and send the UDT file acquisition request to the version management server;
the UDT file receiving submodule is used for receiving the current version UDT file and the previous version UDT file which are sent by the version management server; and the current version UDT file and the historical version file are UDT files acquired by the version management server according to the version information.
Optionally, the target monitoring resource data includes a first target monitoring resource data and a second target monitoring resource data; the target monitoring resource data receiving module comprises:
the UDT file sending submodule is used for sending the current version of the UDT file and the previous version of the UDT file to a remote server;
the target UDT file receiving submodule is used for receiving the first target monitoring resource data and the second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by performing data analysis and format conversion on the current version UDT file; and the second target monitoring resource data is data obtained by performing data analysis and format conversion on the UDT file of the previous version.
Optionally, the target monitoring resource data includes data in units of a single attribute row; the monitoring result acquisition module comprises:
the first data acquisition submodule is used for converting data in the first target monitoring resource data, which takes a single attribute as a row unit, into data in which multiple attributes are taken as row units, so as to obtain first data;
the second data acquisition submodule is used for converting the data taking a single attribute as a row unit in the second target monitoring resource data into the data taking a plurality of attributes as the row unit to obtain second data;
and the monitoring result acquisition submodule is used for carrying out comparison operation on the first data and the second data to obtain a monitoring result.
Optionally, the monitoring server has a comparison module; the monitoring result obtaining submodule comprises:
the comparison data acquisition unit is used for comparing the first data with the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of line data and a plurality of attribute values corresponding to the line data;
and the monitoring result acquisition unit is used for traversing a plurality of attribute values corresponding to the row of data and adding corresponding row identifiers to obtain comparison information.
Optionally, the submission notification includes personnel information; after the monitoring server obtains the monitoring result according to the target resource data, the method further comprises the following steps:
the monitoring data entry generating module is used for generating a monitoring data entry according to the monitoring result and storing the monitoring data entry into a preset database;
the monitoring notification sending module is used for generating a monitoring notification according to the monitoring result and sending the monitoring notification to related personnel according to the personnel information;
and the monitoring data entry acquisition module is used for acquiring the monitoring data entry from the preset database according to the viewing request when receiving a result viewing request aiming at the monitoring result so as to facilitate related personnel to view the monitoring data entry.
The embodiment of the invention also discloses an electronic device, which comprises: a processor, a memory and a computer program stored on said memory and capable of running on said processor, said computer program when executed by said processor implementing the steps of any of said UDT file monitoring methods.
The embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when the computer program is executed by a processor, the steps of the monitoring method of any one UDT file are realized.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, when the version management server detects a submission request aiming at the UDT file, the submission request can be intercepted, and a corresponding submission notice is generated and sent to the monitoring server; after receiving the submission notification sent by the version management server, the monitoring server can acquire the UDT file to be monitored from the version management server according to the submission notification and send the acquired UDT file to be monitored to the remote server, so that the remote server can perform data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain a target monitoring UDT file; and finally, the monitoring server can compare the target monitoring UDT file sent by the remote server to obtain a monitoring result. By intercepting the submission request of the UDT file by the version management server, the remote server has data analysis service provided by a preset engine, and the monitoring server performs comparison operation on the target monitoring UDT file, the Diff automatic monitoring on the UDT file submitted by the user is realized, the workload of developers is reduced, and the working efficiency is improved.
Drawings
FIG. 1 is a flowchart illustrating steps of a first embodiment of a method for monitoring a UDT file according to the present invention;
FIG. 2 is a flowchart illustrating steps of a second embodiment of a method for monitoring UDT files according to the present invention;
FIG. 3 is a diagram of an application scenario of a method for monitoring a UDT file in an embodiment of the present invention;
FIG. 4 is a flowchart illustrating the steps of a third embodiment of a method for monitoring UDT files according to the present invention;
FIG. 5 is a diagram illustrating an embodiment of a remote server storing UDT files to be monitored;
FIG. 6 is a block diagram of a monitoring system for UDT files according to an embodiment of the present invention;
FIG. 7 is a diagram illustrating generation of Diff information in an embodiment of the present invention;
FIG. 8 is a front and back end framework diagram of a monitoring system for UDT files in an embodiment of the present invention;
FIG. 9 is a schematic diagram of a deployment mode of a monitoring system for UDT files in an embodiment of the present invention;
FIG. 10 is a front-end operational schematic diagram of a monitoring system for UDT files in an embodiment of the present invention;
fig. 11 is a block diagram showing an embodiment of a monitoring apparatus for a UDT file according to the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
In the development process, planning personnel and programmers may frequently change the planning configuration table, and generally may acquire a Diff (referring to a comparison text file, which may be a difference between the current modification and the latest data content) file generated when the configuration table is managed by using a collaboration tool, so as to obtain the modified content by checking the comparison and timely find and modify errors.
For conventional non-UE items, whether codes, configuration tables, or resources, their Diff information may be obtained through Diff functions provided by collaboration tools, or with specialized Diff tools. The working principle can be mainly summarized as follows:
(1) maintaining an original file A on a collaboration server; (2) after modifying the local file A, the user uploads the modified file A'; (3) comparing the contents of the original file A and the modified file A 'by using a Diff tool, and obtaining a Diff result of A and A'; (4) automatically acquiring and displaying a Diff result and related information; (5) developers and testers can confirm the modified content through the Diff result.
Wherein, the above-mentioned (1) and (2) are the normal working contents for obtaining Diff information, and (4) and (5) are the secondary processing to Diff result, and present according to the more intuitive and understandable mode, in order to improve the working efficiency and accuracy of the developer and tester. For (3), there may be different Diff rules and acquisition methods, and the resulting Diff results may also be different. It should be noted that, because most of the conventional non-UE project files are plaintext, although different Diff rules and different obtaining methods may be provided, the comparison operation performed by using the Diff tool is mainly to perform simple and direct comparison on the plaintext, that is, in the case that the file content is a messy code, the Diff tool may also perform comparison processing on the messy code content as a normal character, and obtain an incorrect Diff result.
However, the UE engine claims an integrated development mode, i.e. all development methods and functions can be built on top of the engine and integrated in the UE editor. The planning configuration table may be managed in a UDT (UE data table) form, where the UDT data table is a data management class carried by a UE editor, and may store data in a UE resource file form, and the editor itself may also provide support for a User on a UI (User Interface) operation Interface, so as to facilitate the User to freely edit data on the editor; the UE resource file (uaset) is a UE-owned resource file format, which can store all types of resources in binary form, and only the UE itself can parse the uaset file.
For the UE project, no matter the blueprint, the configuration table, and the resource are managed by the UE editor, and the UE editor manages the data in the form of the UDT data table, that is, all files exist in the UDT data table in the format of a uasset file, which is a file encrypted by the UE and can be parsed only by the UE itself. Even if a built-in cooperation tool or a common Diff tool supported by the UE is adopted, the Diff file of the UDT data table cannot be well acquired, and the following problems may be specifically caused:
(1) depending on the UE engine, the Diff result must be obtained by an engine start tool; (2) the Diff result can be seen only by opening the UE editor, and the Diff result cannot be obtained under a non-graphical interface; (3) the format of the information in the obtained Diff results is related to the used cooperation tool, and the information is not visual; (4) the decoding problem of Chinese characters exists, and the messy code phenomenon generally exists; (5) the Diff information can not be acquired automatically; (6) diff results and information cannot be processed secondarily and cannot be used outside an engine; (7) limited by the cooperation tools of the UE and the third party, the function expansion is limited.
Based on the existing problems, one of the core ideas of the embodiments of the present invention is to perform an interception operation on a submission request for a UDT file by a version management server, where a remote server has a data parsing service provided by a preset engine, and a monitoring server performs a comparison operation on a target monitoring UDT file, and in a development mode based on UE integration, the remote server parses an encrypted UDT file to automatically obtain Diff information, and in a low-efficiency monitoring mode that does not require manual checking by a UE editor, implement automatic monitoring of Diff of a UDT file submitted by a user, and improve efficiency of monitoring a configuration table.
Referring to fig. 1, a flowchart illustrating a step of a first embodiment of a method for monitoring a UDT file according to the present invention is shown, and is applied to a monitoring server, where the monitoring server is in communication connection with a version management server and a remote server, and specifically includes the following steps:
step 101, the monitoring server receives a submission notification sent by the version management server; the submission notification is generated by intercepting a submission request of the UDT file by the version management server;
in an embodiment of the present invention, the monitoring server receives a submission notification sent by the version management server, so as to obtain the UDT file to be monitored according to the received submission notification; the submission notification received by the monitoring server may be a notification generated by intercepting a submission request after the version management server detects the submission request for the UDT file.
For local UDT file data, if Diff information aiming at the UDT file is to be generated, data of two new and old versions of the UDT file need to be compared, at the moment, a version management server can be adopted to backup copies of the UDT file data of different versions, namely, when a user submits the UDT file each time, the version management server can backup the submitted UDT file, and records and version numbers corresponding to the backed-up UDT file can be generated.
Specifically, the version management server detects that a submission request for a UDT file carries out an interception operation on the submission request, and the implementation of the interception operation can be implemented by hook (a platform of a message processing mechanism) of the version management server, that is, once the submission request is detected, a hook function can be triggered, and relevant submission information of the submitted UDT file is acquired through a hook interface.
It should be noted that the version management server adopted in the foregoing may be a server corresponding to a version management system deployed, and the version management system may be any system in which version information can be written and which is used for managing a copy of a file.
102, the monitoring server acquires the UDT file to be monitored according to the submission notification;
in an embodiment of the present invention, after receiving the submission notification sent by the version management server, the monitoring server may obtain the UDT file to be monitored according to the received submission notification, so as to send the UDT file to be monitored to the remote server, and receive the target monitoring UDT file after data processing.
In practical application, when detecting a submission request for submitting a UDT file for a user, a version management server may trigger a hook function to acquire relevant submission information of the submitted UDT file, where the acquired relevant submission information may include a file name, a submitter, operation information (including addition information or modification information), a submission time, a version number, and the like of the UDT file; after the relevant submission information of the UDT file is acquired, a submission notification may be generated according to the acquired submission information, and the submission notification is sent to the monitoring server, so as to inform the monitoring server that a new UDT file is submitted by the user.
In practical application, after receiving the submission notification from the version management server, the monitoring server may carry submission information related to the currently submitted UDT file, and the monitoring server may obtain the UDT file to be monitored through the version management server according to the carried submission information, so as to send the obtained UDT file to be monitored to the remote server.
103, the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by the remote server through data analysis service provided by a preset engine and performing data analysis and format conversion on the UDT file to be monitored;
in an embodiment of the present invention, after the monitoring server obtains the to-be-monitored UDT file according to the submission notification, the monitoring server may send the obtained to-be-monitored UDT file to the remote server, so that the remote server performs data analysis and data conversion on the to-be-monitored UDT file through a data analysis service provided by a preset engine, and obtains the analyzed and converted target monitoring UDT file.
In practical application, the UDT file to be monitored, which is obtained by the monitoring server through the version management server according to the submission notification, may be a UDT file in a uasset format, and since the uasset file is a file encrypted by the UE, only the UE itself may parse the uasset file, in order to perform a parsing operation on the UDT file to be monitored on the premise of not opening the UE editor, a simple version engine function calling mode provided by the UE engine itself may be adopted at this time, and a predefined function may be completed through a command line without starting the engine editor.
Here, the UE engine still needs to be started by a simple engine call, and at least 30s of time consumption is required for starting the engine, and the time consumption is continuously increased along with the function complexity associated with the engine itself. Since the time consuming consumption required for engine start-up is inevitable and uncontrollable, it is contemplated that engine function calls to the UE engine are made using network communication methods.
Specifically, the remote server may be set up to start the UE engine through a command line, and the UE engine will provide the server with a data parsing service for parsing the UDT file in the uaset format for a long time in the process of continuous operation of the remote server.
And because the UDT file in the uasset format is in a data format Defined by the UE itself, that is, the remote server parses the target UDT file through the data parsing service provided by the engine, and the parsed UDT file is in a data content in a UDT (user Defined Type data) form, the self-Defined data format is not favorable for directly acquiring Diff information thereof, at this time, the data in the UDT form acquired by parsing may be subjected to data conversion so as to be converted into another data format, such as Json, py, lua file, and the like, which is convenient for acquiring Diff information.
It should be noted that the above operations of data parsing and data conversion are performed on a built remote server, and are not limited by the UE editor, and the consumption of engine start is not visible to the user submitting the UDT file.
And 104, the monitoring server compares the target monitoring resource data to obtain a monitoring result.
In an embodiment of the present invention, after receiving the target monitoring UDT file after data parsing and data conversion by the remote server, the monitoring server may perform a comparison operation on the target monitoring UDT file having a data format that facilitates obtaining Diff information, so as to obtain a corresponding monitoring result and corresponding Diff information.
The monitoring server compares the target monitoring UDT file, can operate through a Diff acquisition module, and can also acquire Diff information by using a Difflib library of Python. The embodiments of the present invention are not limited thereto.
In the embodiment of the invention, when the version management server detects a submission request aiming at the UDT file, the submission request can be intercepted, and a corresponding submission notice is generated and sent to the monitoring server; after receiving the submission notification sent by the version management server, the monitoring server can acquire the UDT file to be monitored from the version management server according to the submission notification and send the acquired UDT file to be monitored to the remote server, so that the remote server can perform data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain a target monitoring UDT file; and finally, the monitoring server can compare the target monitoring UDT file sent by the remote server to obtain a monitoring result. By intercepting the submission request of the UDT file by the version management server, the remote server has data analysis service provided by a preset engine, and the monitoring server performs comparison operation on the target monitoring UDT file, the Diff automatic monitoring on the UDT file submitted by the user is realized, the workload of developers is reduced, and the working efficiency is improved.
Referring to fig. 2, a flowchart illustrating steps of a second embodiment of a method for monitoring a UDT file according to the present invention is shown, and is applied to a monitoring server, where the monitoring server is in communication connection with a version management server and a remote server, and specifically includes the following steps:
step 201, receiving a submission notification sent by a version management server and generated based on interception of a submission request of a UDT file;
in an embodiment of the present invention, the monitoring server receives a submission notification sent by the version management server, so as to obtain the UDT file to be monitored according to the received submission notification; the submission notification received by the monitoring server may be a notification generated by intercepting a submission request after the version management server detects the submission request for the UDT file.
Specifically, after the user finishes editing the UE resource file, the user submits the edited UE resource file to the version management system capable of writing the version information, at this time, after the version management server corresponding to the version management system receives the user submission request, the version management server can receive the edited UE resource file according to the user submission request, generate the latest version number, and store the relevant submission information of the submitted UE resource file, where the submission information may include submitter, log, UE resource file name, submission time, and the like.
In a preferred embodiment, the monitoring management server may register in the version management server in a manner of registering a configuration file, where the configuration file exists in a designated branch address of the version management server, so that the version management server may forward related information to the monitoring server, which is specifically shown in that, when the version management server detects that a user submits a UE resource file, after the user submits the UE resource file, a submission notification may be generated according to the submitted related information, and the submission notification is forwarded to a Web interface of the monitoring server, so that the monitoring server is notified that a new UDT file is submitted by the user, so that the monitoring server may capture the latest submission information of the user in real time.
Step 202, acquiring a UDT file to be monitored according to the submission notification;
in an embodiment of the present invention, after receiving the submission notification from the version management server, the monitoring server may carry submission information related to the currently submitted UDT file, and the monitoring server may obtain the UDT file to be monitored through the version server according to the carried submission information, so as to send the obtained UDT file to be monitored to the remote server.
In one embodiment of the invention, the submission notification includes version information; the UDT files to be monitored comprise current version UDT files and historical version UDT files; step 202 may include the following sub-steps:
substep S11, the monitoring server generates a UDT file acquisition request according to the version information, and sends the UDT file acquisition request to the version management server;
in an embodiment of the present invention, the monitoring server may generate a corresponding UDT file acquisition request according to the version information carried by the submission notification, and since the version management server may back up all submitted UDT files and may generate records and version numbers corresponding to the backed-up UDT files, the monitoring server may send the UDT file acquisition request to the version management server at this time, so as to acquire the corresponding UDT file to be monitored.
In order to generate Diff information for the UDT file, the UDT file acquisition request may be an acquisition request for two new and old versions of the UDT file, mainly a current version of the UDT file and a history version of the UDT file corresponding to the submission notification.
A substep S12, in which the monitoring server receives the current version UDT file and the previous version UDT file sent by the version management server; and the current version UDT file and the historical version file are UDT files acquired by the version management server according to the version information.
In practical application, after receiving a UDT file acquisition request generated by a monitoring server according to version information, a version management server may acquire a current version UDT file to be backed up and a copy of a previous version UDT file according to version information and corresponding records and version numbers when a user previously submits the UDT file, and send the acquired UDT file to be monitored, that is, the current version UDT file and the previous version UDT file, to the monitoring server.
It should be noted that the version management server may be configured to maintain all submitted files of a certain UDT file, and may trace back to any version, and the history version UDT file may be a last version UDT file compared with a current version, or may be a last several versions of UDT files, which is not limited in the embodiment of the present invention.
Step 203, sending the UDT file to be monitored, which is obtained according to the UDT file obtaining request, to a remote server, and receiving target monitoring resource data which is sent by the remote server and subjected to data analysis and format conversion through a data analysis service provided by a preset engine;
in an embodiment of the present invention, after the monitoring server obtains the to-be-monitored UDT file according to the submission notification, the monitoring server may send the obtained to-be-monitored UDT file to the remote server, so that the remote server performs data analysis and data conversion on the to-be-monitored UDT file through a data analysis service provided by a preset engine, and obtains the analyzed and converted target monitoring UDT file.
In an embodiment of the present invention, the target monitoring resource data includes a first target monitoring resource data and a second target monitoring resource data; step 203 may include the following sub-steps:
a substep S21, said monitoring server sending a current version UDT file and said previous version UDT file to a remote server;
in practical application, in order to generate Diff information for a UDT file, a UDT file to be monitored, which is acquired by a monitoring server according to a monitoring UDT file acquisition request, may be two UDT files for new and old versions, mainly a current version UDT file and a historical version UDT file corresponding to the notification of this submission; at this time, the monitoring server may transmit the current version UDT file as well as the historical version UDT file to the remote server.
Substep S22, the monitoring server receives the first target monitoring resource data and the second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by performing data analysis and format conversion on the current version UDT file; and the second target monitoring resource data is data obtained by performing data analysis and format conversion on the UDT file of the previous version.
In an embodiment of the present invention, the monitoring server sends the current version UDT file and the historical version UDT file to the remote server, so that the remote server performs data analysis and format conversion on the current version UDT file and the historical version UDT file by using a data analysis service provided by a preset engine.
Specifically, since the UE udt file cannot be parsed and read without the UE engine, the remote server may be set up to start the UE engine through a command line, and in the process of continuous operation of the remote server, the UE engine may provide a data parsing service for parsing the UE resource file to the server for a long time.
The UE engine may provide a Commandlet base class for the remote server, so that the remote server may start the UE engine through a command line and complete providing a predetermined function for the remote server. The Commandlet base may be used as follows:
1) the remote service defines the UMyTestCommandlet of the remote service and inherits the UMyTestCommandlet from UCommandlet; 2) developing a Main function in the defined UMyTestCommandlet, wherein the Main function is the only entry of the command line, and the entry parameter is the variable parameter of the command line; 3) executing a command:
UE editor-cmd.exe yourproject.uptroject-run ═ MyTest [ other params ], where UE editor-cmd.exe refers to the UE engine editor executable file location; project refers to the engineering location of the development project; -run-MyTest refers to the Commandlet class to be executed, i.e. the parameter corresponds to the class name of the custom class; other parameters may be other custom variable parameters, beginning with-self-extracting in the code, such as-TableName ═ xxx.
It should be noted that the remote server may start an engine function in the manner of the command line, where the engine function may be a service or a function of the UE engine, such as a data parsing function, a data conversion function, and the like.
In addition, the UE resource file has a self-Defined data format, that is, the remote server parses the target UDT file through a data parsing service provided by the engine, and the parsed UDT file is data content in the form of UDT (user Defined Type data). The data of the first two are very clean, but for the structure data, the UE replaces the parenthesis and the parenthesis with the parenthesis, which causes a great obstacle to the subsequent structure data conversion.
In a preferred embodiment, the JSON format may be used as a common communication standard, that is, the remote server may also start a data export auxiliary function possessed by the UE engine in the manner of the above command line, so as to export the UE resource data in the JSON format by using the data export function provided by the UE.
However, the JSON-formatted UE resource data derived by the data derivation function provided by the UE is relatively cluttered, contains too much self-contained identification information and format control, and cannot be directly used, and at this time, certain post-processing can be performed on the derived UE resource data. The processing content mainly comprises:
1) the head information of the UE after serialization comprises information such as resource path, table name, size and the like, and filtering deletion can be carried out at the moment; 2) the UE is used for format control of text display, but the escape characters occupy data volume and are continuously generated, which may cause errors in network data transmission, and filtering and deleting can be performed at the moment; 3) the multi-language localization additional information of part of fields is a function that UE supports multi-language versions, a section of localization coding field is added, and the strategy editing is meaningless, and filtering and deleting can be carried out at the moment; 4) the default values of partial blank fields, such as character strings, floating point numbers, Boolean values, structural bodies and the like, are different, the blank default values used in serialization of different types of cell data are different, the UE has default processing, and whether correct identification can be carried out or not needs to be confirmed at the moment; 5) the floating point number value has very long precision in the UE, and the content of not enough precision can add by oneself, and is not too controllable, proposes to control down the precision, can reduce the data bulk, promotes the numerical accuracy. It should be noted that, the derived JSON-formatted UE resource data may have other useless UE-owned serialization information, and may be filtered and deleted.
In the embodiment of the invention, after the remote server receives the current version UDT file and the historical version UDT file sent by the monitoring server, the remote server can start the data analysis function of the UE engine in a command line mode of the Commandlet base class, and perform data analysis on the current version UDT file and the historical version UDT file to respectively obtain the current version resource data and the historical version resource data, however, the current version resource data and the historical version resource data obtained after the data analysis are not beneficial to directly obtaining Diff information of the current version resource data and the historical version resource data; at this time, the remote server can also start a data export function of the UE engine in a command line mode to export the current version resource data and the historical version resource data into data in a JSON format, and filter and delete useless UE self-carried serialization information in the exported data to respectively obtain first target monitoring resource data and second target monitoring resource data.
Step 204, comparing the target monitoring resource data subjected to data analysis and data conversion to obtain a monitoring result;
in an embodiment of the present invention, after receiving the target monitoring UDT file after data parsing and data conversion by the remote server, the monitoring server may perform a comparison operation on the target monitoring UDT file having a data format that facilitates obtaining Diff information, so as to obtain a corresponding monitoring result and corresponding Diff information.
In one embodiment of the present invention, the target monitoring resource data includes data in units of a single attribute row; step 204 may include the following sub-steps:
in sub-step S31, the monitoring server converts the data in the first target monitoring resource data with a single attribute as a row unit into data in a plurality of attribute as row units, so as to obtain first data;
in sub-step S32, the monitoring server converts the data in the second target monitoring resource data with a single attribute as a row unit into data in a plurality of attribute as row units, so as to obtain second data;
in practical application, the monitoring server performs a comparison operation on the first target monitoring resource data and the second target monitoring resource data to obtain corresponding monitoring results and corresponding Diff information, and the first target monitoring resource data and the second target monitoring resource data in the JSON format received by the monitoring server are stored in a row unit with a single attribute as a default.
For example, the first target monitored resource data stored in a row unit of a single attribute may be as follows:
Figure BDA0002665775660000171
the second target monitored resource data stored in a row unit of a single attribute may be as follows:
Figure BDA0002665775660000172
Figure BDA0002665775660000181
for the above data, after performing a comparison operation on the first target monitoring resource data and the second target monitoring resource data in a row unit with a single attribute, Diff information of Json format data in a row unit with a single attribute can be generated, and a data difference between the two can be clearly seen, but in practical applications, the user editing data may include a plurality of attribute values in a row, and when viewing Diff information, a user generally positions which row has Diff first, and then pays attention to a difference of specific attributes in the row, so that the first target monitoring resource data and the second target monitoring resource in Json format stored in a row unit with a single attribute need to be converted into data in Json format with a plurality of attributes, and the first data and the second data are obtained respectively.
For example, the first data in units of a plurality of attributes may be as follows:
{"Name":"1002","HeroID":"180","Openingvoice":"[{\"VoiceID\":0,\"Voicesequence\":[{\"HeroID\":1002,\"Voice\}],"OpeningChatVoice":"[]","Battlevoice":"[{\"voicerD\":0,\"voicesequence\":[{"HerorD\":1002,\"Voice\}]},
the second data in a row unit of the plurality of attributes may be as follows:
{"Name":"1009","HeroID":"1009","Openingvoice":"[{\"VoiceID\":0,\"Voicesequence\":[{\"HeroID\":1009,\"Voice\}],"OpeningChatVoice":"[{\"VoiceID\":1009201,\"Voicesequence\":[{\"HeroID\":1009,\"Voice\}],"Battlevoice":"[{\"voicerD\":0,\"voicesequence\":[{"HerorD\":1009,\"Voice\}]}。
and a substep S33, comparing the first data and the second data by the monitoring server to obtain a monitoring result.
In practical application, after the first target monitoring resource data and the second target monitoring resource in the JSON format stored by taking a single attribute as a row unit are respectively converted into the first data and the second data in the JSON format by taking a plurality of attributes as a row unit, the monitoring server may perform comparison operation on the first data and the second data to obtain corresponding monitoring results and corresponding Diff information.
In one embodiment of the invention, the monitoring server has a comparison module; the sub-step S33 may include the following sub-steps:
in the substep S331, the monitoring server performs a comparison operation on the first data and the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of line data and a plurality of attribute values corresponding to the line data;
the monitoring server can realize the comparison operation of the first data and the second data by adopting a difflib library of the Python through the comparison module because the Python has a mature Diff algorithm library so as to obtain the comparison data.
Specifically, the specific use method of the difflib library of Python may be as follows:
Figure BDA0002665775660000191
wherein last Json lines refers to old Json data, i.e., second data;
cur _ Json _ lines refers to the current Json data, i.e., the first data; last _ file refers to the file name of the second data combination version number, e.g., a _2, serving as an identifier; cur _ file refers to the file name of the first data combination version number, e.g., A _1, also serving as an identifier; n denotes the information showing all rows of Diff, adjacent n rows, e.g. if n is 2 and Diff is in the fifth row, the final Diff result will show the third, fourth, fifth, sixth, seventh rows.
And a substep S332, traversing the attribute values corresponding to the row of data and adding corresponding row identifiers by the monitoring server to obtain comparison information.
In a preferred embodiment, after the first data and the second data are compared by using a difflib library of Python and the comparison data is obtained, the monitoring server may further traverse a plurality of attribute values corresponding to the row data and add corresponding row identifiers by using a comparison module to obtain comparison information.
Specifically, in the obtained comparison data, Diff information with a "-" sign and a "+" sign may be obtained, where the "-" sign may indicate a row that the current version does not have, that is, a row that the first data does not have, and the "+" sign may indicate a newly added row that the current version does not have, that is, a newly added row in the first data. The advantage is that the whole line information can be displayed, and the user can be helped to accurately position the line information of Diff. The disadvantage is that each specific attribute difference cannot be seen, and secondary processing is required. At this time, each attribute value may be traversed and processed correspondingly to obtain a clear monitoring result and corresponding Diff information, and the processing method may be as follows:
(1) first, the row ID, here the Name attribute, which marks the uniqueness of the row, can be compared, and if the value of the Name attribute is present in both "-" and "+" numbered Diff rows, this row is marked as x, which indicates a modification; then, sequentially traversing all attribute values of the row to see whether the values are the same, and if so, not processing the values; if not, adding a minus sign to the old attribute value, adding a plus sign to the current attribute value, and then splicing; (2) if the value of the Name attribute only exists in a Diff line with a "-" number, the line change is a deleted line, and all attributes of the line are marked with a "-" number in front; (3) if the value of the Name attribute is present only in the Diff line with a "+" sign, indicating that the diversion is a new line, all attributes of the line are preceded by a "+" sign.
And step 205, the monitoring server generates a monitoring data entry according to the monitoring result and stores the monitoring data entry in a preset database.
In an embodiment of the present invention, after obtaining the clear monitoring result and the corresponding Diff information, the monitoring server may generate a monitoring data entry from the monitoring result and the corresponding Diff information, and store the monitoring data entry in the preset database, so that the relevant person may obtain the monitoring data entry from the preset database.
Specifically, the monitoring server may store the monitoring result obtained from the Diff acquisition module and the corresponding Diff information in a preset database, where the preset database may be a MongoDB database, and the MongoDB database is a database designed specifically for scalability, high performance, and high availability. It can extend from single server deployment to large, complex multi-datacenter architectures. By utilizing the advantages of memory calculation, MongoDB can provide high-performance data read-write operation. The native copy and automatic failover functionality of MongoDB provides enterprise-level reliability and operational flexibility to applications.
The monitoring server stores the monitoring data items to the MongoDB database, and the MongoDB database is a distributed database and has a proper amount of level memory, so that the data can be stored in a physical memory (not only indexes and a small part of data), and the reading and writing of the data become very rapid; and the Json storage format is adopted for storage, so that the storage mode and operation are greatly simplified.
The monitoring data entries stored in the MongoDB database may have basic information, such as: id represents the uniqueness of the Diff entry; version is a version number generated by a user submitting a UDT; author and author _ name are the author mailbox and author name of the UDT submission; ctime is the time of user submission; action represents the UDT operation type, M is modification, A is newly added; log is the log filled in when the user submits the UDT; branch is branch information of the SVN; columns are the name of each attribute, and there may be a numerical subscript to indicate the number of columns; diff _ row _ info is stored Diff information where there may be a numerical index indicating in which column the attribute value is displayed; show _ list indicates which attribute columns are Diff, and the stored array subscripts are consistent with those in columns, so that partial display of the front end is facilitated; hide _ list indicates which attribute columns are not Diff, and the stored array subscript is consistent with that in columns, so that partial display of the front end is facilitated; file _ name is the submitted UDT filename; qa and qa _ email represent the mailbox and name of the tester; the created _ date and updated _ date indicate the Diff creation time and the last update time.
In a preferred embodiment, after obtaining the monitoring result and the corresponding Diff information, the monitoring server may further generate a monitoring notification according to the monitoring result, and send the monitoring notification to relevant personnel according to the personnel information, so as to notify the developers and the testers to confirm the modified content.
In a preferred embodiment, the monitoring server may further receive a result viewing request for the monitoring result, and at this time, the corresponding monitoring data entry may be acquired from the preset database according to the viewing request, so that the relevant person views the monitoring data entry.
In order to enable those skilled in the art to better understand the embodiment of the present application, an application scenario diagram of a monitoring method for a UDT file in the embodiment of the present invention is shown in fig. 3.
In the embodiment of the invention, when the version management server detects a submission request aiming at the UDT file, the submission request can be intercepted, and a corresponding submission notice is generated and sent to the monitoring server; after receiving the submission notification sent by the version management server, the monitoring server can acquire the UDT file to be monitored from the version management server according to the submission notification and send the acquired UDT file to be monitored to the remote server, so that the remote server can perform data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain a target monitoring UDT file; and finally, the monitoring server can compare the target monitoring UDT file sent by the remote server to obtain a monitoring result. By intercepting the submission request of the UDT file by the version management server, the remote server has data analysis service provided by a preset engine, and the monitoring server performs comparison operation on the target monitoring UDT file, the Diff automatic monitoring on the UDT file submitted by the user is realized, the workload of developers is reduced, and the working efficiency is improved.
Referring to fig. 4, a flowchart illustrating a third step of the monitoring method for a UDT file according to the third embodiment of the present invention is applied to a remote server, where the remote server is in communication connection with a monitoring server, and the method specifically includes the following steps:
step 401, the remote server receives a UDT file to be monitored sent by the monitoring server;
in an embodiment of the present invention, the remote server may receive the UDT file to be monitored sent by the monitoring server, so as to perform data analysis and format conversion on the UDT file to be monitored by using a data analysis service provided by a preset engine.
Specifically, the UDT file to be monitored received by the remote server may include a current version UDT file and a historical version UDT file, and when the remote server receives the current version UDT file and the historical version UDT file, in order to avoid that an old content is returned due to the influence of the characteristics of the UE engine by a conventional method for covering the same-name file, and that a file coverage failure may also be caused by the UE engine occupying the file, specifically, referring to fig. 5, a schematic diagram illustrating the remote server storing the UDT file to be monitored in the embodiment of the present invention is shown, and a storage path of the UDT may be changed by creating a new folder, so that the UE considers that the content of the corresponding source file returned is definitely the newest, thereby solving the problems of the UE engine file occupation and the old cache return.
Step 402, the remote server performs data analysis on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain target monitoring resource data;
step 403, the remote server sends the target monitoring resource data to the monitoring server, so that the monitoring server obtains a monitoring result according to the target monitoring resource data.
In the embodiment of the invention, when the version management server detects a submission request aiming at the UDT file, the submission request can be intercepted, and a corresponding submission notice is generated and sent to the monitoring server; after receiving the submission notification sent by the version management server, the monitoring server can acquire the UDT file to be monitored from the version management server according to the submission notification and send the acquired UDT file to be monitored to the remote server, so that the remote server can perform data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain a target monitoring UDT file; and finally, the monitoring server can compare the target monitoring UDT file sent by the remote server to obtain a monitoring result. By intercepting the submission request of the UDT file by the version management server, the remote server has data analysis service provided by a preset engine, and the monitoring server performs comparison operation on the target monitoring UDT file, the Diff automatic monitoring on the UDT file submitted by the user is realized, the workload of developers is reduced, and the working efficiency is improved.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 6, there is shown a block diagram of an embodiment of a monitoring system for UDT files according to the present invention, the system comprising a version management server 601, a monitoring server 602 and a remote server 603,
the version management server 601 is configured to intercept a submission request and generate a submission notification when the submission request for a preset UDT file is detected, and send the submission notification to the monitoring server;
the monitoring server 602 is configured to receive a submission notification sent by the version management server, acquire a to-be-monitored UDT file according to the submission notification, and send the to-be-monitored UDT file to a remote server;
the remote server 603 is configured to perform data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain target monitoring resource data, and send the target monitoring resource data to the monitoring server;
the monitoring server 602 is further configured to receive target monitoring resource data sent by the remote server, and perform comparison operation on the target monitoring resource data to obtain a monitoring result.
Specifically, referring to fig. 7, a schematic diagram of generating Diff information in the embodiment of the present invention is shown, and a process of specifically generating Diff information may be as follows:
first, in order to obtain Diff information, a file which can be compared is needed besides a current version file. At this time, the version management server can be adopted to trace back any version file submitted historically. Assuming that the current file name is A1, backtracking to the last submitted version file A2 through the version management server to obtain two different versions of comparison files A1 and A2; secondly, because the UDT file (namely the UEUDT file) can only be analyzed through the UE engine, the UDT file can be analyzed in a mode of externally analyzing the file, for example, a remote server with a data analysis function provided by the UE engine is set up; thirdly, the UDT files A1 and A2 are transmitted to a remote server which opens the UE file analysis by adopting an HTTP file transmission mode; the remote UE server receives the monitoring server, namely the UDT source file sent by the server corresponding to the Diff system; converting the contents of the UDT files A1 and A2 into readable data in a Json format by a file analysis function of a UE engine, and then sending the Json data back to the monitoring server in an HTTP mode; sixthly, monitoring data in the Json format received by the server, wherein the data in the Json format is stored in a row unit by taking a single attribute as a default; at this time, the Json format data can be converted into data with a plurality of attributes as row units, and then Diff data comparison is performed.
In a preferred embodiment, after obtaining the monitoring result and the corresponding Diff information, the monitoring server may further generate a monitoring notification according to the monitoring result, and send the monitoring notification to the relevant person according to the person information to notify the developer and the tester to confirm the modified content, and the monitoring server may further receive a result viewing request for the monitoring result, and at this time, may obtain a corresponding monitoring data entry from a preset database according to the viewing request, so that the relevant person views the monitoring data entry.
Referring to fig. 8, a front-end and back-end frame diagram of a monitoring system for a UDT file in the embodiment of the present invention is shown, where a boottrap 4 frame may be used as the front end of the monitoring system for a UDT file, and this part is implemented by HTML + JavaScript + Jquery + AJAX; the back end of the system can adopt a flash frame, which is a lightweight Web application frame, and the system uses a simple core and is convenient to expand, and in the embodiment of the invention, the following modules can be added:
(1) OpenID login authentication: all users access the Diff page only by authorized users after user authentication; (2) MongoDB: the database is MongoDB, and can quickly read data and return the data to the user; (3) and a Log center: the method is beneficial to recording user operation information and error information, and can have three grades log: error: recording when an operation error occurs; turning: recording when the operation is warned; nfo: recording the operation of a user; (4) and (3) task processing queue: the system is a daemon process, and each time the system receives a Diff processing request, the Diff processing request is put into the background processing queue, so that the access of other users to the webpage is not blocked; (5) the message notification system comprises: the system specially used for notifying the user, for example, has Diff generation, or when the Diff system operates abnormally, gives notice of short message and mail to the administrator or other users.
The deployment mode can adopt a deployment mode of virtualenv + Gunicorn + supervisor + nginx, and fig. 9 shows a schematic diagram of the deployment mode of a monitoring system of a UDT file in the embodiment of the present invention, wherein a Diff system generates an application process by Gunicorn startup, and both the operating environments of the Diff system and Gunicorn depend on virtualenv virtual environment; gunicorn application process, managed by Supervisor; the user request is sent to the Diff system processing request through the Nginx reverse proxy, if the static file downloading is carried out, the static file downloading can be directly carried out through the Nginx static file downloading, and the Diff system resources do not need to be occupied.
Referring to fig. 10, a front-end and back-end operation schematic diagram of a monitoring system for a UDT file in an embodiment of the present invention is shown, (1) a user initiates an HTTP access request through a browser; (2) after receiving the user request, the back end firstly carries out OpenID authentication on the user; (3) after the user inputs the correct OpenID identity information, the user can access the next step; (4) the Diff system retrieves the relevant data from the database according to the user access request; (5) formatting and outputting the data retrieved from the database, and finally returning the data to the user; (6) and at the user side, the browser displays the data returned by the server.
The Diff front-end page function display mainly comprises the following three aspects: (1) all unconfirmed Diff entries are displayed, so that the file name, the version number, the submission time, the submitter and log information of each submission can be clearly seen, and follow-up testers can be manually assigned; the rightmost 'confirmation' key is provided for the tester to use, the tester confirms that Diff has no problem, namely the tester can click 'confirmation', and the record can be transferred to 'history record'; the 'update all' and 'update most recent' in the upper right corner of the interface are provided for users, and Diff is generated manually for use, for example, when the users add other UDT files which want to be monitored, click 'update all' at this time, all history submission Diff of the files can be generated;
(2) a Diff specific content page; (3) all historical Diff entries for a single file, all historically submitted diffs for a single file, both confirmed and unconfirmed, are visible to the user for the convenience of targeted screening.
In the embodiment of the invention, the problem that the UDT file (namely the UEUDT file) and the Diff information can be checked only through an editor is solved, the operation complexity of a user is reduced, meanwhile, because the Diff is automatically acquired by a background, manual checking and follow-up are not needed, modification can be captured and acquired at the first time, the work load of developers is reduced, and the work efficiency is improved.
In the embodiment of the invention, because the modification of the UDT can affect the product function in the development process, when an error occurs, a developer needs to trace and modify Diff to inquire the cause of the problem. Under the condition of ensuring that any UDT modification is not missed, required Diff information is extracted and clearly displayed at the front end of the Web, developers can easily and quickly trace back the modified content through the information on the page, the error reason is searched, and the working efficiency is improved.
In the embodiment of the invention, because the modification of the UDT can affect the product function in the development process, the risk of errors exists. In daily work, a tester needs to determine whether the specific content of the UDT modified each time is correct, so that a developer does not solve the problem and cause errors under the conditions of blindness or misoperation. The method provides timely, effective, convenient and efficient automatic monitoring service for testers, and the testers only need to browse Diff information at the Web front end.
In the embodiment of the invention, the effect of automatically acquiring Diff information for the encrypted UDT file is achieved, the effect is the same as that of acquiring Diff and monitoring the traditional plaintext data, not only can the Diff and processing information be acquired in real time, but also the information can be perfectly inherited in user operation, information display, working habits and experiences, and no learning cost caused by change exists in a user level.
In the embodiment of the invention, the method is established on the UDT, so any change of the UDT can be directly effective without additional maintenance, and any extension does not need to consider the function influence of the UDT. Any needed secondary development can be carried out on the acquired Diff information, a needed extension function is provided, and functions of automatic error correction, error alarm and the like can be developed again in the future. The core function is simple to realize, strong in independence and high in degree of freedom, so that any other working requirements can be freely expanded in the future.
Referring to fig. 11, a block diagram of an embodiment of a monitoring apparatus for a UDT file according to the present invention is shown, and is applied to a monitoring server, where the monitoring server is communicatively connected to a version management server and a remote server, and specifically includes the following modules:
a submission notification receiving module 1101, configured to receive a submission notification sent by the version management server; the submission notification is generated by intercepting a submission request of the UDT file by the version management server;
a to-be-monitored UDT file obtaining module 1102, configured to obtain a to-be-monitored UDT file according to the submission notification;
a target monitoring resource data receiving module 1103, configured to send the UDT file to be monitored to a remote server, and receive target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by the remote server through data analysis service provided by a preset engine and performing data analysis and format conversion on the UDT file to be monitored;
and a monitoring result obtaining module 1104, configured to perform comparison operation on the target monitoring resource data to obtain a monitoring result.
In one embodiment of the invention, the submission notification includes version information; the UDT files to be monitored comprise current version UDT files and historical version UDT files; the module for acquiring the UDT file to be monitored can comprise the following sub-modules:
a UDT file acquisition request sending submodule, configured to generate a UDT file acquisition request according to the version information, and send the UDT file acquisition request to the version management server;
the UDT file receiving submodule is used for receiving the current version UDT file and the previous version UDT file which are sent by the version management server; and the current version UDT file and the historical version file are UDT files acquired by the version management server according to the version information.
In an embodiment of the present invention, the target monitoring resource data includes a first target monitoring resource data and a second target monitoring resource data; the target monitoring resource data receiving module may include the following sub-modules:
the UDT file sending submodule is used for sending the current version of the UDT file and the previous version of the UDT file to a remote server;
the target UDT file receiving submodule is used for receiving the first target monitoring resource data and the second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by performing data analysis and format conversion on the current version UDT file; and the second target monitoring resource data is data obtained by performing data analysis and format conversion on the UDT file of the previous version.
In one embodiment of the present invention, the target monitoring resource data includes data in units of a single attribute row; the monitoring result obtaining module may include the following sub-modules:
the first data acquisition submodule is used for converting data in the first target monitoring resource data, which takes a single attribute as a row unit, into data in which multiple attributes are taken as row units, so as to obtain first data;
the second data acquisition submodule is used for converting the data taking a single attribute as a row unit in the second target monitoring resource data into the data taking a plurality of attributes as the row unit to obtain second data;
and the monitoring result acquisition submodule is used for carrying out comparison operation on the first data and the second data to obtain a monitoring result.
In one embodiment of the invention, the monitoring server has a comparison module; the monitoring result obtaining sub-module may include the following units:
the comparison data acquisition unit is used for comparing the first data with the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of line data and a plurality of attribute values corresponding to the line data;
and the monitoring result acquisition unit is used for traversing a plurality of attribute values corresponding to the row of data and adding corresponding row identifiers to obtain comparison information.
In one embodiment of the invention, the submission notification includes personnel information; after the monitoring server obtains the monitoring result according to the target resource data, the method further comprises the following steps:
the monitoring data entry generating module is used for generating a monitoring data entry according to the monitoring result and storing the monitoring data entry into a preset database;
the monitoring notification sending module is used for generating a monitoring notification according to the monitoring result and sending the monitoring notification to related personnel according to the personnel information;
and the monitoring data entry acquisition module is used for acquiring the monitoring data entry from the preset database according to the viewing request when receiving a result viewing request aiming at the monitoring result so as to facilitate related personnel to view the monitoring data entry.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and the relevant points can be referred to the partial description of the method embodiment.
An embodiment of the present invention further provides an electronic device, including:
the monitoring method comprises a processor, a memory and a computer program which is stored in the memory and can run on the processor, wherein when the computer program is executed by the processor, each process of the monitoring method embodiment of the UDT file is realized, the same technical effect can be achieved, and in order to avoid repetition, the description is omitted here.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements each process of the foregoing monitoring method for a UDT file, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The foregoing describes in detail a method, a system and a device for monitoring a UDT file according to the present invention, and the present invention applies specific examples to explain the principles and embodiments of the present invention, and the descriptions of the foregoing examples are only used to help understand the method and core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A monitoring method of UDT files is applied to a monitoring server, and the monitoring server is in communication connection with a version management server and a remote server, and the method comprises the following steps:
the monitoring server receives a submission notice sent by the version management server; the submission notification is generated by intercepting a submission request of the UDT file by the version management server;
the monitoring server acquires the UDT file to be monitored according to the submission notification;
the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by the remote server through data analysis service provided by a preset engine and performing data analysis and format conversion on the UDT file to be monitored;
and the monitoring server compares the target monitoring resource data to obtain a monitoring result.
2. The method of claim 1, wherein the submission notification includes version information; the UDT files to be monitored comprise current version UDT files and historical version UDT files; the monitoring server acquires the UDT file to be monitored according to the submission notification, and the method comprises the following steps:
the monitoring server generates a UDT file acquisition request according to the version information and sends the UDT file acquisition request to the version management server;
the monitoring server receives the current version UDT file and the previous version UDT file sent by the version management server; and the current version UDT file and the historical version file are UDT files acquired by the version management server according to the version information.
3. The method of claim 2, wherein the target supervisory resource data comprises a first target supervisory resource data and a second target supervisory resource data; the monitoring server sends the UDT file to be monitored to a remote server, and receives target monitoring resource data sent by the remote server, and the method comprises the following steps:
the monitoring server sends the current version UDT file and the previous version UDT file to a remote server;
the monitoring server receives first target monitoring resource data and second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by performing data analysis and format conversion on the current version UDT file; and the second target monitoring resource data is data obtained by performing data analysis and format conversion on the UDT file of the previous version.
4. The method of claim 3, wherein the target supervisory resource data includes data in units of rows of a single attribute; the monitoring server compares the target monitoring resource data to obtain a monitoring result, and the method comprises the following steps:
the monitoring server converts data in the first target monitoring resource data with a single attribute as a row unit into data in a plurality of attribute as row units to obtain first data;
the monitoring server converts the data taking a single attribute as a row unit in the second target monitoring resource data into data taking a plurality of attributes as row units to obtain second data;
and the monitoring server compares the first data with the second data to obtain a monitoring result.
5. The method of claim 4, wherein the monitoring server has a comparison module; the monitoring server compares the first data with the second data to obtain a monitoring result, and the method comprises the following steps:
the monitoring server compares the first data with the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of line data and a plurality of attribute values corresponding to the line data;
and traversing a plurality of attribute values corresponding to the row of data and adding corresponding row identifiers by the monitoring server to obtain comparison information.
6. The method of claim 1, wherein the submission notification includes personnel information; after the monitoring server obtains the monitoring result according to the target resource data, the method further comprises the following steps:
the monitoring server generates a monitoring data item according to the monitoring result and stores the monitoring data item in a preset database;
the monitoring server generates a monitoring notification according to the monitoring result and sends the monitoring notification to related personnel according to the personnel information;
and when a result viewing request aiming at the monitoring result is received, the monitoring server acquires the monitoring data entry from the preset database according to the viewing request so that related personnel can view the monitoring data entry conveniently.
7. A monitoring system for UDT files, characterized in that the system comprises a version management server, a monitoring server and a remote server,
the version management server is used for intercepting a submission request and generating a submission notice when the submission request of a preset UDT file is detected, and sending the submission notice to the monitoring server;
the monitoring server is used for receiving a submission notification sent by the version management server, acquiring a UDT file to be monitored according to the submission notification, and sending the UDT file to be monitored to a remote server;
the remote server is used for carrying out data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain target monitoring resource data and sending the target monitoring resource data to the monitoring server;
the monitoring server is further used for receiving the target monitoring resource data sent by the remote server and carrying out comparison operation on the target monitoring resource data to obtain a monitoring result.
8. A monitoring device for UDT files, which is applied to a monitoring server, wherein the monitoring server is connected with a version management server and a remote server in a communication way, and the device comprises:
a submission notification receiving module, configured to receive a submission notification sent by the version management server; the submission notification is generated by intercepting a submission request of the UDT file by the version management server;
a module for acquiring the UDT file to be monitored, which is used for acquiring the UDT file to be monitored according to the submission notice;
the target monitoring resource data receiving module is used for sending the UDT file to be monitored to a remote server and receiving target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by the remote server through data analysis service provided by a preset engine and performing data analysis and format conversion on the UDT file to be monitored;
and the monitoring result acquisition module is used for carrying out comparison operation on the target monitoring resource data to obtain a monitoring result.
9. An electronic device, comprising: processor, memory and computer program stored on said memory and capable of running on said processor, said computer program when executed by said processor implementing the steps of the method of monitoring UDT files according to any of claims 1 to 6.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the method for monitoring UDT files according to any of the claims 1 to 6.
CN202010918185.XA 2020-09-03 2020-09-03 Method, system and device for monitoring UDT file Active CN111949607B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010918185.XA CN111949607B (en) 2020-09-03 2020-09-03 Method, system and device for monitoring UDT file

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010918185.XA CN111949607B (en) 2020-09-03 2020-09-03 Method, system and device for monitoring UDT file

Publications (2)

Publication Number Publication Date
CN111949607A true CN111949607A (en) 2020-11-17
CN111949607B CN111949607B (en) 2023-06-27

Family

ID=73367401

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010918185.XA Active CN111949607B (en) 2020-09-03 2020-09-03 Method, system and device for monitoring UDT file

Country Status (1)

Country Link
CN (1) CN111949607B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113608727A (en) * 2021-08-04 2021-11-05 网易(杭州)网络有限公司 Code processing method, device and system for visual programming
CN116863040A (en) * 2023-05-29 2023-10-10 上海幻维数码科技有限公司 Multi-person collaboration system based on engine building
CN117312434A (en) * 2023-10-08 2023-12-29 北京皓宽网络科技有限公司 Data exchange method and platform

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030093769A1 (en) * 2001-07-10 2003-05-15 Murari Kumar Apparatus and method for UPnP device code generation using XML
US6789074B1 (en) * 1998-11-25 2004-09-07 Hitachi, Ltd. Database processing method and apparatus, and medium for recording processing program thereof
CN101982955A (en) * 2010-11-19 2011-03-02 深圳华大基因科技有限公司 High-performance file transmission system and method thereof
CN106170804A (en) * 2013-11-11 2016-11-30 亚马逊技术有限公司 Document management and cooperative system
US20180018165A1 (en) * 2015-01-08 2018-01-18 Fasoo. Com Co., Ltd Source code transfer control method, computer program therefor, and recording medium therefor
US20180026854A1 (en) * 2016-07-25 2018-01-25 American Megatrends, Inc. Intuitive user interface (ui) for device or vendor independent network switch management via embedded management controller
US10031920B1 (en) * 2012-04-23 2018-07-24 Google Llc Third-party indexable text
US20180314518A1 (en) * 2017-04-28 2018-11-01 Servicenow, Inc. Systems and methods for tracking configuration file changes
US10311076B1 (en) * 2016-10-26 2019-06-04 Open Invention Network, Llc Automated file acquisition, identification, extraction and transformation
US20190191344A1 (en) * 2017-12-15 2019-06-20 Industrial Technology Research Institute Mobile edge platform servers and user equipment context migration management methods thereof

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6789074B1 (en) * 1998-11-25 2004-09-07 Hitachi, Ltd. Database processing method and apparatus, and medium for recording processing program thereof
US20030093769A1 (en) * 2001-07-10 2003-05-15 Murari Kumar Apparatus and method for UPnP device code generation using XML
CN101982955A (en) * 2010-11-19 2011-03-02 深圳华大基因科技有限公司 High-performance file transmission system and method thereof
US10031920B1 (en) * 2012-04-23 2018-07-24 Google Llc Third-party indexable text
CN106170804A (en) * 2013-11-11 2016-11-30 亚马逊技术有限公司 Document management and cooperative system
US20180018165A1 (en) * 2015-01-08 2018-01-18 Fasoo. Com Co., Ltd Source code transfer control method, computer program therefor, and recording medium therefor
US20180026854A1 (en) * 2016-07-25 2018-01-25 American Megatrends, Inc. Intuitive user interface (ui) for device or vendor independent network switch management via embedded management controller
US10311076B1 (en) * 2016-10-26 2019-06-04 Open Invention Network, Llc Automated file acquisition, identification, extraction and transformation
US20180314518A1 (en) * 2017-04-28 2018-11-01 Servicenow, Inc. Systems and methods for tracking configuration file changes
US20190191344A1 (en) * 2017-12-15 2019-06-20 Industrial Technology Research Institute Mobile edge platform servers and user equipment context migration management methods thereof

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113608727A (en) * 2021-08-04 2021-11-05 网易(杭州)网络有限公司 Code processing method, device and system for visual programming
CN113608727B (en) * 2021-08-04 2023-07-25 网易(杭州)网络有限公司 Code processing method, device and system for visual programming
CN116863040A (en) * 2023-05-29 2023-10-10 上海幻维数码科技有限公司 Multi-person collaboration system based on engine building
CN117312434A (en) * 2023-10-08 2023-12-29 北京皓宽网络科技有限公司 Data exchange method and platform
CN117312434B (en) * 2023-10-08 2024-03-19 北京皓宽网络科技有限公司 Data exchange method and platform

Also Published As

Publication number Publication date
CN111949607B (en) 2023-06-27

Similar Documents

Publication Publication Date Title
US11379657B2 (en) Systems and methods for automatic report generation and retaining of annotations in reporting documents after regeneration
CN111949607B (en) Method, system and device for monitoring UDT file
US10621211B2 (en) Language tag management on international data storage
CN108762743B (en) Data table operation code generation method and device
US9864736B2 (en) Information processing apparatus, control method, and recording medium
US20080262860A1 (en) System and Method for Supporting Software
CN110955428A (en) Page display method and device, electronic equipment and medium
CN112817817B (en) Buried point information query method, buried point information query device, computer equipment and storage medium
US20220374334A1 (en) Techniques for visual software test automation management
KR20190095099A (en) Transaction system error detection method, apparatus, storage medium and computer device
US20220374338A1 (en) Techniques for visual software test automation management
CN111967853A (en) Method, device, equipment and readable medium for reporting supervision data
JP5286946B2 (en) Information processing apparatus, input information restoration method and restoration program
CN115328759A (en) Form verification method and device
CN110908907A (en) Web page testing method, device, equipment and storage medium
CN113590172A (en) Code file publishing method, device, equipment and storage medium
JP2018112875A (en) Knowledge managing device, knowledge managing method and computer program
CN110968475A (en) Method and device for monitoring webpage, electronic equipment and readable storage medium
US20220244975A1 (en) Method and system for generating natural language content from recordings of actions performed to execute workflows in an application
JP2016133946A (en) Source code reviewing method and system therefor
CN114416641A (en) File data processing method and device, electronic equipment and storage medium
CN112765188A (en) Configuration information processing method, configuration management system, electronic device, and storage medium
US20160373402A1 (en) Information Management and Notification System
CN112307736A (en) Application project creating method, device, equipment and storage medium
CN113626409B (en) Test data processing method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant