CN111949607B - Method, system and device for monitoring UDT file - Google Patents

Method, system and device for monitoring UDT file Download PDF

Info

Publication number
CN111949607B
CN111949607B CN202010918185.XA CN202010918185A CN111949607B CN 111949607 B CN111949607 B CN 111949607B CN 202010918185 A CN202010918185 A CN 202010918185A CN 111949607 B CN111949607 B CN 111949607B
Authority
CN
China
Prior art keywords
monitoring
udt
file
data
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010918185.XA
Other languages
Chinese (zh)
Other versions
CN111949607A (en
Inventor
孟玉
李学永
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN202010918185.XA priority Critical patent/CN111949607B/en
Publication of CN111949607A publication Critical patent/CN111949607A/en
Application granted granted Critical
Publication of CN111949607B publication Critical patent/CN111949607B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/13File access structures, e.g. distributed indices
    • G06F16/134Distributed indices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/156Query results presentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1734Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Library & Information Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention provides a method, a system and a device for monitoring a UDT file, wherein the method comprises the following steps: the monitoring server receives a submission notification sent by the version management server; the monitoring server acquires a UDT file to be monitored according to the submission notice; the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server; and the monitoring server compares the target monitoring resource data to obtain a monitoring result. Through interception operation of the version management server on a submitting request aiming at the UDT file, the remote server has data analysis service provided by a preset engine and comparison operation of the monitoring server on the target monitoring UDT file, diff automatic monitoring of the UDT file submitted by a user is realized, workload of a developer is reduced, and working efficiency is improved.

Description

Method, system and device for monitoring UDT file
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a method for monitoring a UDT file, a system for monitoring a UDT file, and a device for monitoring a UDT file.
Background
In existing game project development, a large number of planning configuration tables (generally Excel tables) are generally used to store some static external data, and a programmer can parse the Excel data into a form readable by a project code by writing a guide script, so that the parsed external data is effective in the game code and achieves a specific function.
However, during the development process, the planners and programmers may make frequent changes to the configuration table, and since manual operations often generate various errors, it is necessary to find and correct the errors in time. Diff (refer to a comparison text file, and the comparison can be the difference between the current modification and the last data content) files generated when the configuration table is managed by using a collaboration tool, and errors can be found and modified only by timely acquiring the Diff files and obtaining the modification content through checking the comparison.
For the UE Engine (virtual Engine), the configuration table may be frequently modified and errors frequently occur, however, the built-in collaboration tool supported by the UE cannot well obtain the Diff file generated by the configuration table, and only can be manually checked through the editor, and it consumes a certain degree of labor cost, so that risks such as untimely monitoring and missing modification easily occur.
Disclosure of Invention
In view of the foregoing, embodiments of the present invention have been made to provide a method for monitoring a UDT file, a system for monitoring a UDT file, and a device for monitoring a UDT file, which overcome or at least partially solve the foregoing problems.
In order to solve the above problems, an embodiment of the present invention discloses a monitoring method of a UDT file, which is applied to a monitoring server, where the monitoring server is communicatively connected with a version management server and a remote server, and the method includes:
the monitoring server receives a submission notification sent by the version management server; the submitting notification is a notification generated by intercepting a submitting request of the UDT file by the version management server;
the monitoring server acquires a UDT file to be monitored according to the submission notice;
the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by carrying out data analysis and format conversion on the UDT file to be monitored by the remote server through a data analysis service provided by a preset engine;
And the monitoring server compares the target monitoring resource data to obtain a monitoring result.
Optionally, the submission notification includes version information; the UDT file to be monitored comprises a current version UDT file and a historical version UDT file; the monitoring server obtains the UDT file to be monitored according to the submitting notice, and the method comprises the following steps:
the monitoring server generates a UDT file acquisition request according to the version information and sends the UDT file acquisition request to the version management server;
the monitoring server receives a current version UDT file and a previous version UDT file sent by the version management server; the current version UDT file and the history version file are UDT files acquired by the version management server according to the version information.
Optionally, the target monitoring resource data includes first target monitoring resource data and second target monitoring resource data; the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server, and the method comprises the following steps:
the monitoring server sends a current version UDT file and the previous version UDT file to a remote server;
The monitoring server receives first target monitoring resource data and second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by carrying out data analysis and format conversion on the current version UDT file; the second target monitoring resource data is data after data analysis and format conversion of the previous version UDT file.
Optionally, the target monitoring resource data includes data in a unit of a single attribute; the monitoring server performs comparison operation on the target monitoring resource data to obtain a monitoring result, and the method comprises the following steps:
the monitoring server converts data taking a single attribute as a row unit in the first target monitoring resource data into data taking a plurality of attributes as a row unit to obtain first data;
the monitoring server converts the data taking the single attribute as a row unit in the second target monitoring resource data into the data taking a plurality of attributes as a row unit to obtain second data;
and the monitoring server compares the first data with the second data to obtain a monitoring result.
Optionally, the monitoring server has a comparison module; the monitoring server performs a comparison operation on the first data and the second data to obtain a monitoring result, and the monitoring result comprises:
The monitoring server compares the first data with the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of row data and a plurality of attribute values corresponding to the row data;
and traversing the attribute values corresponding to the row data by the monitoring server and adding corresponding row identifiers to obtain comparison information.
Optionally, the submission notification includes personnel information; after the monitoring server obtains the monitoring result according to the target resource data, the method further comprises the following steps:
the monitoring server generates a monitoring data item according to the monitoring result and stores the monitoring data item in a preset database;
the monitoring server generates a monitoring notice according to the monitoring result and sends the monitoring notice to related personnel according to the personnel information;
when a result checking request aiming at the monitoring result is received, the monitoring server acquires the monitoring data item from the preset database according to the checking request so as to enable related personnel to check the monitoring data item.
The embodiment of the invention also discloses a monitoring system of the UDT file, which comprises a version management server, a monitoring server and a remote server,
The version management server is used for intercepting a submitting request of a preset UDT file and generating a submitting notification when the submitting request is detected, and sending the submitting notification to the monitoring server;
the monitoring server is used for receiving the submitting notification sent by the version management server, acquiring a UDT file to be monitored according to the submitting notification, and sending the UDT file to be monitored to a remote server;
the remote server is used for carrying out data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain target monitoring resource data, and sending the target monitoring resource data to the monitoring server;
the monitoring server is also used for receiving the target monitoring resource data sent by the remote server and comparing the target monitoring resource data to obtain a monitoring result.
The embodiment of the invention also discloses a monitoring device of the UDT file, which is applied to a monitoring server, wherein the monitoring server is in communication connection with a version management server and a remote server, and the device comprises:
the submission notification receiving module is used for receiving the submission notification sent by the version management server; the submitting notification is a notification generated by intercepting a submitting request of the UDT file by the version management server;
The UDT file obtaining module to be monitored is used for obtaining the UDT file to be monitored according to the submitting notice;
the target monitoring resource data receiving module is used for sending the UDT file to be monitored to a remote server and receiving target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by carrying out data analysis and format conversion on the UDT file to be monitored by the remote server through a data analysis service provided by a preset engine;
and the monitoring result acquisition module is used for comparing the target monitoring resource data to obtain a monitoring result.
Optionally, the submission notification includes version information; the UDT file to be monitored comprises a current version UDT file and a historical version UDT file; the UDT file acquisition module to be monitored comprises:
a UDT file acquisition request sending sub-module, configured to generate a UDT file acquisition request according to the version information, and send the UDT file acquisition request to the version management server;
a UDT file receiving sub-module, configured to receive a current version UDT file and a previous version UDT file sent by the version management server; the current version UDT file and the history version file are UDT files acquired by the version management server according to the version information.
Optionally, the target monitoring resource data includes first target monitoring resource data and second target monitoring resource data; the target monitoring resource data receiving module comprises:
a UDT file sending sub-module, configured to send a current version UDT file and the previous version UDT file to a remote server;
the target UDT file receiving sub-module is used for receiving the first target monitoring resource data and the second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by carrying out data analysis and format conversion on the current version UDT file; the second target monitoring resource data is data after data analysis and format conversion of the previous version UDT file.
Optionally, the target monitoring resource data includes data in a unit of a single attribute; the monitoring result acquisition module comprises:
the first data acquisition sub-module is used for converting the data taking a single attribute as a row unit in the first target monitoring resource data into the data taking a plurality of attributes as a row unit to obtain first data;
the second data acquisition sub-module is used for converting the data taking the single attribute as a row unit in the second target monitoring resource data into the data taking a plurality of attributes as a row unit to obtain second data;
And the monitoring result acquisition sub-module is used for comparing the first data with the second data to obtain a monitoring result.
Optionally, the monitoring server has a comparison module; the monitoring result obtaining submodule comprises:
the comparison data acquisition unit is used for comparing the first data with the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of row data and a plurality of attribute values corresponding to the row data;
and the monitoring result acquisition unit is used for traversing a plurality of attribute values corresponding to the row data and adding corresponding row identifiers to obtain comparison information.
Optionally, the submission notification includes personnel information; after the monitoring server obtains the monitoring result according to the target resource data, the method further comprises the following steps:
the monitoring data item generation module is used for generating monitoring data items according to the monitoring result and storing the monitoring data items into a preset database;
the monitoring notification sending module is used for generating a monitoring notification according to the monitoring result and sending the monitoring notification to related personnel according to the personnel information;
and the monitoring data item acquisition module is used for acquiring the monitoring data item from the preset database according to the viewing request when a result viewing request aiming at the monitoring result is received, so that related personnel can view the monitoring data item.
The embodiment of the invention also discloses an electronic device, which comprises: a processor, a memory, and a computer program stored on the memory and capable of running on the processor, which when executed by the processor, implements the steps of the method of monitoring a UDT file of any of the above.
The embodiment of the invention also discloses a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program realizes the steps of the monitoring method of the UDT file when being executed by a processor.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, when the version management server detects the submitting request aiming at the UDT file, the submitting request can be intercepted, and corresponding submitting notification is generated and sent to the monitoring server; after receiving the submission notification sent by the version management server, the monitoring server can acquire the UDT file to be monitored from the version management server according to the submission notification, and send the acquired UDT file to be monitored to the remote server, so that the remote server performs data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain a target UDT file; finally, the monitoring server can compare the target monitoring UDT file sent by the remote server to obtain a monitoring result. Through interception operation of the version management server on a submitting request aiming at the UDT file, the remote server has data analysis service provided by a preset engine and comparison operation of the monitoring server on the target monitoring UDT file, diff automatic monitoring of the UDT file submitted by a user is realized, workload of a developer is reduced, and working efficiency is improved.
Drawings
FIG. 1 is a flowchart illustrating steps of a first embodiment of a method for monitoring a UDT file according to the present invention;
FIG. 2 is a flowchart illustrating steps of a second embodiment of a method for monitoring a UDT file according to the present invention;
FIG. 3 is an application scenario diagram of a method for monitoring UDT files in an embodiment of the present invention;
FIG. 4 is a flowchart illustrating steps of a third embodiment of a method for monitoring a UDT file according to the present invention;
FIG. 5 is a schematic diagram of a remote server storing UDT files to be monitored in an embodiment of the present invention;
FIG. 6 is a block diagram of a monitoring system embodiment of a UDT file of the present invention;
FIG. 7 is a schematic diagram of generating Diff information in an embodiment of the invention;
FIG. 8 is a front-end and back-end frame diagram of a monitoring system for UDT files in an embodiment of the invention;
FIG. 9 is a schematic diagram of a deployment mode of a monitoring system for UDT files in an embodiment of the present invention;
FIG. 10 is a front-end and back-end operational schematic diagram of a monitoring system for UDT files in an embodiment of the invention;
FIG. 11 is a block diagram of a monitoring device embodiment of a UDT file of the present invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
In the development process, the planner and the programmer may change the configuration table frequently, and typically, diff (referred to as a comparison text file, and the comparison may be the difference between the current modification and the last data content) files generated when the configuration table is managed by using the collaboration tool may be obtained, so that the modification content is obtained through checking and comparing, and errors are found and modified in time.
For traditional non-UE projects, either codes, configuration tables, or resources, their Diff information may be obtained through Diff functions provided by the collaboration tool, or by using a specialized Diff tool. The working principle of the device can be summarized as follows:
(1) Maintaining an original file A on a collaboration server; (2) After the user modifies the local file A, uploading the modified file A'; (3) Comparing the contents of the original file A and the modified file A 'by using a Diff tool, and obtaining a Diff result of A and A'; (4) automatically acquiring and displaying Diff results and related information; (5) The developer and tester can confirm the modified content through Diff results.
The (1) and (2) are normal working contents for obtaining Diff information, and the (4) and (5) are secondary processing for Diff results and are presented in a more visual and easily understood manner, so that working efficiency and accuracy of developers and testers are improved. For (3), different Diff rules and acquisition methods are possible, and the Diff results obtained may also be different. It should be noted that, because most of the conventional non-UE project files are plaintext, although different Diff rules and obtaining methods may be provided, the comparison operation performed by using the Diff tool mainly performs simple and direct comparison on the plaintext, that is, in the case that the file content is messy, the Diff tool may also perform comparison processing on the messy code content as normal characters, and obtain an erroneous Diff result.
However, the UE engine claims an integrated development model, i.e. all development methods and functions can be built on top of the engine and integrated in the UE editor. The planning configuration table can be managed in a UDT (UdataTable) form, the UDT data table is a data management class of a UE editor, the data can be stored in a UE resource file form, and the editor can also provide support for a User to operate an Interface in a UI (User Interface) so as to facilitate the User to freely edit the data on the editor; the UE resource file (uasset) is a resource file format that the UE has, which can store all types of resources in binary form, and only the UE itself can parse the uasset file.
For the UE project, no matter the blueprint, the configuration table and the resources are managed by the UE editor, and the UE editor manages the data in the form of a UDT data table, namely all files exist in the UDT data table in the format of a uasset file, wherein the uasset file is encrypted by the UE, and only the UE can analyze the uasset file. Even if a built-in collaboration tool or a common Diff tool supported by UE is adopted, the Diff file of the UDT data table cannot be acquired well, and the following problems specifically exist:
(1) Depending on the UE engine, diff results must be obtained by an engine start tool; (2) The UE editor must be opened to see Diff results, which cannot be obtained under a non-graphical interface; (3) The information format in the obtained Diff result is related to the used collaboration tool, and the information is not intuitive; (4) The decoding problem of Chinese characters exists, and the phenomenon of messy codes exists generally; (5) the Diff information cannot be automatically acquired; (6) Diff results and information cannot be processed twice and used outside the engine; (7) The functionality expansion is limited by the cooperation tools of the UE and the third party.
Based on the above-mentioned existing problems, one of the core ideas of the embodiments of the present invention is to intercept a request for submitting a UDT file by a version management server, where the remote server has a data analysis service provided by a preset engine, and a comparison operation of a monitoring server on a target monitoring UDT file, where in a development mode based on UE integration, the encrypted UDT file is analyzed to automatically obtain Diff information, and in a case where a low-efficiency monitoring mode manually checked by a UE editor is not required, the Diff automation monitoring of the UDT file submitted by a user is implemented, and the efficiency of monitoring a configuration table is improved.
Referring to fig. 1, a flowchart of steps of a first embodiment of a method for monitoring a UDT file of the present invention is shown, and the method is applied to a monitoring server, where the monitoring server is communicatively connected to a version management server and a remote server, and specifically may include the following steps:
step 101, the monitoring server receives a submission notification sent by the version management server; the submitting notification is a notification generated by intercepting a submitting request of the UDT file by the version management server;
in one embodiment of the invention, the monitoring server receives a commit notification sent by the version management server so as to acquire the UDT file to be monitored according to the received commit notification; the notification of the submission received by the monitoring server may be a notification generated by intercepting the submission request after the version management server detects the submission request for the UDT file.
For local UDT file data, to generate Diff information for the UDT file, data of two UDT files of new and old versions need to be compared, and at this time, a version management server may be used to backup copies of UDT file data of different versions, that is, each time a user submits a UDT file, the version management server may backup the submitted UDT file, and may generate a record and a version number corresponding to the backed UDT file.
Specifically, the version management server detects that the submitting request aiming at the UDT file carries out intercepting operation on the submitting request, the intercepting operation can be realized through a hook (a platform of a message processing mechanism) of the version management server, namely, once the submitting request is detected, a hook function can be triggered, and relevant submitting information of the submitted UDT file is obtained through a hook interface.
It should be noted that, the version management server used above may be a corresponding server deployed with a version management system, and the version management system may be any system that can write version information and is used to manage copies of files.
Step 102, the monitoring server acquires a UDT file to be monitored according to the submitting notice;
in one embodiment of the present invention, after receiving the commit notification sent by the version management server, the monitoring server may obtain the UDT file to be monitored according to the received commit notification, so as to send the UDT file to be monitored to the remote server, and receive the target monitoring UDT file after data processing.
In practical application, when detecting a submitting request for a user to submit a UDT file, the version management server can trigger a hook function to acquire relevant submitting information of the submitted UDT file, wherein the acquired relevant submitting information can comprise a file name, a submitting person, operation information (comprising newly added information or modified information), submitting time, version number and the like of the UDT file; after the related commit information of the UDT file is obtained, a commit notification can be generated according to the obtained commit information and sent to the monitoring server to inform the monitoring server that the new UDT file is committed by the user.
In practical application, after receiving the submission notification of the version management server, the monitoring server may carry the submission information related to the submitted UDT file, and the monitoring server may obtain the UDT file to be monitored through the version server according to the carried submission information, so as to send the obtained UDT file to be monitored to the remote server.
Step 103, the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by carrying out data analysis and format conversion on the UDT file to be monitored by the remote server through a data analysis service provided by a preset engine;
in one embodiment of the present invention, after the monitoring server obtains the UDT file to be monitored according to the submission notification, the obtained UDT file to be monitored may be sent to the remote server, so that the remote server performs data analysis and data conversion on the UDT file to be monitored through a data analysis service provided by the preset engine, and obtains the target monitoring UDT file after analysis and conversion.
In practical application, the monitoring server may obtain the UDT file to be monitored in the uasset format according to the submission notification through the version management server, and since the uasset file is encrypted by the UE, only the UE itself may parse the uasset file, so that in order to parse the UDT file to be monitored without opening the UE editor, a simple version engine function calling manner provided by the UE engine itself may be adopted at this time, and a predefined function may be completed through a command line without starting the engine editor.
The UE engine is called by a simple version of the engine, the engine needs to be started, and at least 30s of consumed time is required for starting the engine, and the consumed time also continuously increases along with the functional complexity associated with the engine. Since the required consumption of time for engine start is necessary and uncontrollable, it can be considered that engine function call to the UE engine is completed by adopting a network communication method.
In particular, a remote server may be set up for starting the UE engine via a command line, and during the continuous operation of the remote server, the UE engine will provide the server with a data parsing service for parsing the UDT file in the uasset format for a long period of time.
And, since the UDT file in the uasset format is a data format defined by the UE, that is, the remote server parses the target UDT file through the data parsing service provided by the engine, the UDT file obtained by parsing is data content in UDT (User Defined Type Data) form, and the self-defined data format is unfavorable for directly obtaining Diff information, at this time, data in the form of the UDT obtained by parsing can be converted into another data format, such as Json, py, lua files, so as to obtain Diff information conveniently.
It should be noted that the above operations of data parsing and data conversion are performed on a remote server that is built, without any limitation by the UE editor, and the consumption of engine start is not visible to the user submitting the UDT file.
And 104, the monitoring server compares the target monitoring resource data to obtain a monitoring result.
In one embodiment of the present invention, after receiving the target monitoring UDT file after the data analysis and the data conversion by the remote server, the monitoring server may perform a comparison operation on the target monitoring UDT file having a data format that facilitates obtaining the Diff information, so as to obtain a corresponding monitoring result and corresponding Diff information.
The monitoring server performs comparison operation on the target monitoring UDT file, and can operate through a Diff acquisition module or can acquire Diff information through using a Difflib library of Python. The embodiments of the present invention are not limited in this regard.
In the embodiment of the invention, when the version management server detects the submitting request aiming at the UDT file, the submitting request can be intercepted, and corresponding submitting notification is generated and sent to the monitoring server; after receiving the submission notification sent by the version management server, the monitoring server can acquire the UDT file to be monitored from the version management server according to the submission notification, and send the acquired UDT file to be monitored to the remote server, so that the remote server performs data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain a target UDT file; finally, the monitoring server can compare the target monitoring UDT file sent by the remote server to obtain a monitoring result. Through interception operation of the version management server on a submitting request aiming at the UDT file, the remote server has data analysis service provided by a preset engine and comparison operation of the monitoring server on the target monitoring UDT file, diff automatic monitoring of the UDT file submitted by a user is realized, workload of a developer is reduced, and working efficiency is improved.
Referring to fig. 2, a flowchart of a step of a second embodiment of a method for monitoring a UDT file of the present invention is shown, and the method is applied to a monitoring server, where the monitoring server is communicatively connected to a version management server and a remote server, and specifically may include the following steps:
step 201, receiving a commit notification which is sent by a version management server and is generated based on interception of a commit request of a UDT file;
in one embodiment of the invention, the monitoring server receives a commit notification sent by the version management server so as to acquire the UDT file to be monitored according to the received commit notification; the notification of the submission received by the monitoring server may be a notification generated by intercepting the submission request after the version management server detects the submission request for the UDT file.
Specifically, after completing editing of the UE resource file, the user submits the edited UE resource file to the version management system capable of writing version information, and at this time, after receiving a user submitting request, the version management server corresponding to the version management system may receive the edited UE resource file according to the user submitting request, generate a latest version number, and save relevant submitting information of submitting the UE resource file at this time, where the submitting information may include a submitting person, log, a UE resource file name, and a submitting time.
In a preferred embodiment, the monitoring management server may register in the version management server in a registration manner of a configuration file, where the configuration file exists in a designated branch address of the version management server, so that the version management server may forward relevant information to the monitoring server, and specifically, when the version management server detects that the user submits the UE resource file, the version management server may generate a submission notification according to the relevant information submitted by the user after submitting the UE resource file, and forward the submission notification to a Web interface of the monitoring server, so as to inform the monitoring server that a new UDT file is submitted by the user, so that the monitoring server may capture the latest submission information of the user in real time.
Step 202, obtaining a UDT file to be monitored according to a submission notice;
in one embodiment of the present invention, after receiving the commit notification of the version management server, the monitoring server may carry commit information related to the currently submitted UDT file, and the monitoring server may obtain, by using the version server, the UDT file to be monitored according to the carried commit information, so as to send the obtained UDT file to be monitored to the remote server.
In one embodiment of the invention, the commit notification includes version information; the UDT file to be monitored comprises a current version UDT file and a historical version UDT file; step 202 may comprise the following sub-steps:
s11, the monitoring server generates a UDT file acquisition request according to the version information and sends the UDT file acquisition request to the version management server;
in one embodiment of the present invention, the monitoring server may generate a corresponding UDT file obtaining request according to version information carried by the commit notification, and since the version management server may backup all the submitted UDT files and may generate a record and a version number corresponding to the backup UDT files, the monitoring server may send the UDT file obtaining request to the version management server to obtain the corresponding UDT files to be monitored.
In order to generate Diff information for a UDT file, the UDT file acquisition request may be an acquisition request for two UDT files of an old version and a new version, mainly a current version UDT file and a history version UDT file corresponding to the present commit notification.
A substep S12, wherein the monitoring server receives the current version UDT file and the previous version UDT file sent by the version management server; the current version UDT file and the history version file are UDT files acquired by the version management server according to the version information.
In practical application, after receiving a request for obtaining a UDT file generated by a monitoring server according to version information, the version management server may obtain, according to the version information, a current version UDT file and a copy of a previous version UDT file that are backed up, where the corresponding record and version number are when the user submitted the UDT file before, and send the obtained UDT file to be monitored, that is, the current version UDT file and the previous version UDT file, to the monitoring server.
It should be noted that, the version management server may be used to maintain all submitted files of a certain UDT file, and may trace back to any version, and the historical version UDT file may be a last version UDT file compared with the current version, or may be a UDT file of a plurality of versions.
Step 203, sending a to-be-monitored UDT file acquired according to a UDT file acquisition request to a remote server, and receiving target monitoring resource data after data analysis and format conversion, which are sent by the remote server, by a data analysis service provided by a preset engine;
in one embodiment of the present invention, after the monitoring server obtains the UDT file to be monitored according to the submission notification, the obtained UDT file to be monitored may be sent to the remote server, so that the remote server performs data analysis and data conversion on the UDT file to be monitored through a data analysis service provided by the preset engine, and obtains the target monitoring UDT file after analysis and conversion.
In one embodiment of the present invention, the target monitoring resource data includes first target monitoring resource data and second target monitoring resource data; step 203 may comprise the following sub-steps:
a substep S21, wherein the monitoring server sends a current version UDT file and the previous version UDT file to a remote server;
in practical application, in order to generate Diff information for a UDT file, a UDT file to be monitored, which is acquired by a monitoring server according to a monitoring UDT file acquisition request, may be two UDT files for new and old versions, mainly a current version UDT file and a history version UDT file corresponding to the present submission notification; at this point, the monitoring server may send the current version UDT file and the historical version UDT file to the remote server.
Step S22, the monitoring server receives first target monitoring resource data and second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by carrying out data analysis and format conversion on the current version UDT file; the second target monitoring resource data is data after data analysis and format conversion of the previous version UDT file.
In one embodiment of the invention, the monitoring server sends the current version UDT file and the historical version UDT file to the remote server, so that the remote server adopts a data analysis service provided by a preset engine to conduct data analysis and format conversion on the current version UDT file and the historical version UDT file.
Specifically, since the UE udt file cannot be parsed and read out from the UE engine, a remote server may be set up for starting the UE engine through a command line, and in the process that the remote server continuously operates, the UE engine will provide a data parsing service for parsing the UE resource file for the server for a long period of time.
The UE engine may provide a Command base class for the remote server, so that the remote server may start the UE engine through the command line and complete providing a predetermined function for the remote server. The method of using the Command base class may be as follows:
1) The remote service defines own class UMyTestCommandlet and inherits from UCommandlet; 2) Developing a Main function in the defined UMyTestCommand, which is the only entry of the command line, wherein the entry parameter is the variable parameter of the command line; 3) Executing a command:
UE editor-cmd.exe you project-run = MyTest [ other parameters ], where UE editor-cmd.exe refers to the UE engine editor executable file location; yourpject. Uproject refers to the engineering location of the development project; run=mytest refers to the Commandlet class to be executed, i.e. the class name of the custom class to which the parameter corresponds; the other parameters may be other custom variable parameters, beginning with self-extraction in code, such as-tablename=xxx.
The remote server may start an engine function by means of the command line, where the engine function may be a service or a function of the UE engine, for example, a data analysis function, a data conversion function, and the like.
In addition, the UE resource file has a self-defined data format, namely, the remote server analyzes the target UDT file through the data analysis service provided by the engine, the analyzed UDT file is data content in a UDT (User Defined Type Data) form, and the UE engine can directly identify and process the data in the UDT form and also provides a UDT serialization output interface, so that an auxiliary function of data export is provided for an editor, including an interface for exporting a common character string, a CSV format character string and a JSON character string. The former two data are clean, but for the structural data, the UE uniformly replaces the brackets and the middle brackets of the structural data with the brackets, so that the subsequent structural data conversion is greatly hindered.
In a preferred embodiment, the JSON format may be selected as a common communication standard, that is, the remote server may also initiate an auxiliary function of data export of the UE engine in the manner of the command line, so as to export the UE resource data in the JSON format by using the data export function provided by the UE.
However, the JSON format UE resource data derived by the data derivation function provided by the UE is relatively messy, contains too much self-contained identification information and format control, and cannot be directly used, and at this time, certain post-processing can be performed on the derived UE resource data. The processing content mainly comprises:
1) The header information of the UE after serialization comprises information such as a resource path, a table name, a size and the like, and filtering and deleting can be performed at the moment; 2) Various line feed, backspace and carriage return transfer characters, wherein the UE is used for controlling the format of text display, but the escape characters occupy data volume and continuously appear, so that errors can be caused when the network transmits data, and filtering and deleting can be performed at the moment; 3) The multi-language localization additional information of the partial fields is a function of supporting multi-language versions by the UE, a section of localization coding fields are added, and the method is meaningless for countermeasure scratch editing, and can be used for filtering and deleting at the moment; 4) Default values of partial blank fields, such as character strings, floating point numbers, boolean values, structures, etc., and the blank default values used in serialization of these different types of cell data are different, and the UE has default processing, and needs to confirm whether the cell data can be correctly identified at this time; 5) The value of the floating point number is of very long precision in the UE, the content with insufficient precision can be automatically added, the content is not very controllable, the precision is recommended to be controlled down, the data volume can be reduced, and the numerical accuracy is improved. It should be noted that, the derived JSON UE resource data may have other useless UE own serialization information, which may be filtered and deleted.
In the embodiment of the invention, after receiving the current version UDT file and the historical version UDT file sent by the monitoring server, the remote server can start the data analysis function of the UE engine in a command line mode of the Command base class, and conduct data analysis on the current version UDT file and the historical version UDT file to obtain current version resource data and historical version resource data respectively, however, the current version resource data and the historical version resource data obtained after the data analysis are unfavorable for directly obtaining Diff information of the current version UDT file and the historical version resource data; at this time, the remote server can start the data export function of the UE engine in a command line manner to export the current version resource data and the history version resource data into JSON format data, and filter and delete the sequence information of the UE in the exported data, so as to obtain the first target monitoring resource data and the second target monitoring resource data respectively.
Step 204, comparing the target monitoring resource data after data analysis and data conversion to obtain a monitoring result;
in one embodiment of the present invention, after receiving the target monitoring UDT file after the data analysis and the data conversion by the remote server, the monitoring server may perform a comparison operation on the target monitoring UDT file having a data format that facilitates obtaining the Diff information, so as to obtain a corresponding monitoring result and corresponding Diff information.
In one embodiment of the present invention, the target monitoring resource data includes data in a unit of a single attribute as a row; step 204 may include the sub-steps of:
step S31, the monitoring server converts the data taking a single attribute as a row unit in the first target monitoring resource data into the data taking a plurality of attributes as a row unit to obtain first data;
step S32, the monitoring server converts the data taking the single attribute as a row unit in the second target monitoring resource data into the data taking a plurality of attributes as a row unit to obtain second data;
in practical application, the monitoring server performs a comparison operation on the first target monitoring resource data and the second target monitoring resource data to obtain a corresponding monitoring result and corresponding Diff information, however, the first target monitoring resource data and the second target monitoring resource data in the JSON format received by the monitoring server are stored by taking a single attribute as a row unit by default.
For example, the first target monitoring resource data stored in a single attribute as a row unit may be as follows:
Figure BDA0002665775660000171
the second target monitoring resource data stored in a unit of a single attribute as a row may be as follows:
Figure BDA0002665775660000172
Figure BDA0002665775660000181
/>
For the above data, after the first target monitoring resource data and the second target monitoring resource data which are in a single attribute as a line unit are compared, diff information of Json format data which are in a single attribute as a line unit can be generated, and data differences between the two can be clearly seen, but in practical application, user editing data can comprise a plurality of attribute values in a line, and when viewing Diff information, a user generally locates which line has Diff first and then focuses on the difference of specific attributes in the line, so that the first target monitoring resource data and the second target monitoring resource in Json format which are stored in a single attribute as a line unit are required to be converted into Json format data which are in a plurality of attribute as a line unit, and the first data and the second data are respectively obtained.
For example, the first data in units of a plurality of attributes may be as follows:
{"Name":"1002","HeroID":"180","Openingvoice":"[{\"VoiceID\":0,\"Voicesequence\":[{\"HeroID\":1002,\"Voice\}],"OpeningChatVoice":"[]","Battlevoice":"[{\"voicerD\":0,\"voicesequence\":[{"HerorD\":1002,\"Voice\}]},
the second data in units of a plurality of attributes may be as follows:
{"Name":"1009","HeroID":"1009","Openingvoice":"[{\"VoiceID\":0,\"Voicesequence\":[{\"HeroID\":1009,\"Voice\}],"OpeningChatVoice":"[{\"VoiceID\":1009201,\"Voicesequence\":[{\"HeroID\":1009,\"Voice\}],"Battlevoice":"[{\"voicerD\":0,\"voicesequence\":[{"HerorD\":1009,\"Voice\}]}。
and step S33, the monitoring server compares the first data with the second data to obtain a monitoring result.
In practical application, after the first target monitoring resource data and the second target monitoring resource in the JSON format stored by taking a single attribute as a row unit are respectively converted into the first data and the second data in the JSON format by taking a plurality of attributes as a row unit, the monitoring server can compare the first data and the second data to obtain a corresponding monitoring result and corresponding Diff information.
In one embodiment of the invention, the monitoring server has a comparison module; the substep S33 may include the substeps of:
sub-step S331, the monitoring server performs contrast operation on the first data and the second data through the contrast module to obtain contrast data; the comparison data comprises a plurality of row data and a plurality of attribute values corresponding to the row data;
the monitoring server can realize the comparison operation of the first data and the second data by adopting a difflib library of the Python through the comparison module because the Python has a mature Diff algorithm library.
Specifically, the specific use method of the difflib library of Python can be as follows:
Figure BDA0002665775660000191
wherein last_json_lines refers to old Json data, i.e., second data;
cur_json_lines refers to current Json data, i.e., first data; last_file refers to the file name of the second data combination version number, e.g., a_2, which serves as an identification; cur_file refers to the file name of the first data combination version number, e.g., a_1, which also serves as an identifier; n represents information showing all rows of Diff, adjacent n rows, e.g., if n=2 and Diff is in the fifth row, the final Diff result will show the third, fourth, fifth, sixth, and seventh rows.
And step S332, traversing the attribute values corresponding to the row data by the monitoring server and adding corresponding row identifiers to obtain comparison information.
In a preferred embodiment, after comparing the first data and the second data by using the difflib library of Python, and obtaining the comparison data, the monitoring server may further traverse a plurality of attribute values corresponding to the data by using the comparison module and add corresponding row identifiers to obtain the comparison information.
Specifically, in the above obtained comparison data, diff information with "-" and "+" signs may be obtained, where "-" signs may indicate rows that the current version does not exist, i.e., rows that the first data does not exist, and "+" signs may indicate rows that the current version is newly added, i.e., rows that the first data is newly added. The method has the advantages that the whole line of information can be displayed, and the user can be helped to accurately position the line information of Diff. The disadvantage is that individual differences in specific properties are not visible and require further secondary processing. At this time, each attribute value may be traversed and processed accordingly, so as to obtain a clear monitoring result and corresponding Diff information, where the processing manner may be as follows:
(1) First, a row ID may be compared, here a Name attribute, which marks the uniqueness of the row, if the value of the Name attribute exists in the Diff row with "-" and "+" signs at the same time, indicating that the row is a modified row, the row being marked as a x, indicating that it is modified; then traversing all attribute values of the row in turn to see whether the values are the same, and if so, not processing; if the attribute values are not the same, adding a "-" sign to the old attribute value, adding a "+" sign to the current attribute value, and then splicing; (2) If the value of the Name attribute is only present in the Diff line of the "-" number, indicating that the line is a delete line, all attributes of the line are preceded by a "-" number; (3) If the value of the Name attribute is only present in the Diff line of the "+" sign, it indicates that the line is a new line, all attributes of the line being preceded by a "+" sign.
And step 205, the monitoring server generates a monitoring data item according to the monitoring result and stores the monitoring data item in a preset database.
In one embodiment of the present invention, after obtaining a clear monitoring result and corresponding Diff information, the monitoring server may generate a monitoring data entry with the monitoring result and the corresponding Diff information, and store the monitoring data entry in a preset database, so that a related person may obtain the monitoring data entry from the preset database.
Specifically, the monitoring server may store the monitoring result obtained from the Diff obtaining module and the corresponding Diff information into a preset database, where the preset database may be a mongo db database, which is a database designed specifically for scalability, high performance and high availability. It can extend from single server deployments to large, complex multi-data center architectures. The MongoDB can provide high-performance data read-write operation by utilizing the advantages of memory calculation. The MongoDB's local copy and automatic failover functionality allows enterprise-level reliability and operational flexibility for applications.
The monitoring server stores the monitoring data items into the MongoDB database, and the MongoDB database is a distributed database and is provided with a proper amount of memory, so that the monitoring server can store data in a physical memory (instead of only indexes and small amounts of data) so that the data can be read and written very quickly; and the Json storage format is adopted for storage, so that the storage mode and operation are greatly simplified.
Wherein the monitoring data entry stored to the mongo db database may have basic information such as: _id represents the uniqueness of the Diff entry; version is the version number generated by the user submitting the UDT; author and author_name are author mailbox and author name submitted by the UDT; ctime is the time of user submission; action represents UDT operation type, M is modification, A is new addition; log is the log filled when the user submits the UDT; branch is branch information of SVN; column is the name of each attribute, and there may be a numerical subscript to indicate what column; diff_row_info is stored Diff information, where there may be a numerical subscript to indicate in which column the attribute value is displayed; the show_list indicates which attribute columns are Diff-present, and the stored array subscript is consistent with that in columns, so that front-end region display is facilitated; the hide_list indicates which attribute columns are without Diff, and the stored array subscripts are consistent with those in columns, so that front end region display is convenient; file_name is the submitted UDT file name; qa and qa_email represent the mailbox and name of the tester; the created_date and updated_date represent the Diff creation time and last update time.
In a preferred embodiment, after obtaining the monitoring result and the corresponding Diff information, the monitoring server may also generate a monitoring notification according to the monitoring result, and send the monitoring notification to the related personnel according to the personnel information, so as to notify the developer and the tester to confirm the modified content.
In a preferred embodiment, the monitoring server may further receive a result viewing request for the monitoring result, where a corresponding monitoring data entry may be obtained from the preset database according to the viewing request, so that the relevant person views the monitoring data entry.
In order to enable those skilled in the art to better understand the embodiments of the present application, reference may be made to fig. 3, which shows an application scenario diagram of a method for monitoring a UDT file in an embodiment of the present invention.
In the embodiment of the invention, when the version management server detects the submitting request aiming at the UDT file, the submitting request can be intercepted, and corresponding submitting notification is generated and sent to the monitoring server; after receiving the submission notification sent by the version management server, the monitoring server can acquire the UDT file to be monitored from the version management server according to the submission notification, and send the acquired UDT file to be monitored to the remote server, so that the remote server performs data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain a target UDT file; finally, the monitoring server can compare the target monitoring UDT file sent by the remote server to obtain a monitoring result. Through interception operation of the version management server on a submitting request aiming at the UDT file, the remote server has data analysis service provided by a preset engine and comparison operation of the monitoring server on the target monitoring UDT file, diff automatic monitoring of the UDT file submitted by a user is realized, workload of a developer is reduced, and working efficiency is improved.
Referring to fig. 4, a flowchart illustrating steps of a third embodiment of a method for monitoring a UDT file of the present invention is applied to a remote server, where the remote server is communicatively connected to a monitoring server, and may specifically include the following steps:
step 401, the remote server receives a UDT file to be monitored sent by the monitoring server;
in one embodiment of the present invention, the remote server may receive the UDT file to be monitored sent by the monitoring server, so as to perform data parsing and format conversion on the UDT file to be monitored by using a data parsing service provided by the preset engine.
Specifically, the UDT file to be monitored received by the remote server may include a current version UDT file and a historical version UDT file, when the remote server receives the current version UDT file and the historical version UDT file, in order to avoid that the traditional method for covering the same name file returns old content due to the influence of the own characteristics of the UE engine or fails to cover the file due to the occupation of the UE engine, referring to fig. 5, a schematic diagram of the remote server storing the UDT file to be monitored in the embodiment of the present invention is shown, and the storage path of the UDT can be changed by creating a new folder, so that the UE considers that the returned corresponding source file content is always up to date, thereby solving the problems of occupation of the UE engine file and returning to the old cache.
Step 402, the remote server performs data analysis on the to-be-monitored UDT file through a data analysis service provided by a preset engine to obtain target monitoring resource data;
and step 403, the remote server sends the target monitoring resource data to the monitoring server so that the monitoring server obtains a monitoring result according to the target monitoring resource data.
In the embodiment of the invention, when the version management server detects the submitting request aiming at the UDT file, the submitting request can be intercepted, and corresponding submitting notification is generated and sent to the monitoring server; after receiving the submission notification sent by the version management server, the monitoring server can acquire the UDT file to be monitored from the version management server according to the submission notification, and send the acquired UDT file to be monitored to the remote server, so that the remote server performs data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain a target UDT file; finally, the monitoring server can compare the target monitoring UDT file sent by the remote server to obtain a monitoring result. Through interception operation of the version management server on a submitting request aiming at the UDT file, the remote server has data analysis service provided by a preset engine and comparison operation of the monitoring server on the target monitoring UDT file, diff automatic monitoring of the UDT file submitted by a user is realized, workload of a developer is reduced, and working efficiency is improved.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Referring to fig. 6, there is shown a block diagram of an embodiment of a monitoring system for a UDT file of the present invention, the system comprising a version management server 601, a monitoring server 602 and a remote server 603,
the version management server 601 is configured to intercept a commit request for a preset UDT file and generate a commit notification when the commit request is detected, and send the commit notification to the monitoring server;
the monitoring server 602 is configured to receive a submission notification sent by the version management server, obtain a UDT file to be monitored according to the submission notification, and send the UDT file to be monitored to a remote server;
The remote server 603 is configured to perform data analysis and format conversion on the to-be-monitored UDT file through a data analysis service provided by a preset engine to obtain target monitoring resource data, and send the target monitoring resource data to the monitoring server;
the monitoring server 602 is further configured to receive the target monitoring resource data sent by the remote server, and perform a comparison operation on the target monitoring resource data to obtain a monitoring result.
Specifically, referring to fig. 7, a schematic diagram illustrating generation of Diff information in an embodiment of the present invention is shown, and a specific process of generating Diff information may be as follows:
(1) in order to obtain Diff information, a comparable file is needed in addition to the current version file. At this time, a version management server can be adopted to trace back to any version file submitted by history. Assuming that the current file name is A1, backtracking to a last submitted version file A2 through a version management server to obtain comparison files A1 and A2 of two different versions; (2) because the UDT file (namely the UEUDT file) can be analyzed only by the UE engine, the UDT file can be analyzed in a mode of externally placing file analysis, for example, a remote server with a data analysis function provided by the UE engine is built; (3) transmitting the UDT files A1 and A2 to a remote started UE file analysis server by adopting an HTTP file transmission mode; (4) the remote UE server receives the monitoring server, namely the UDT source file sent by the server corresponding to the Diff system; (5) converting the content of the UDT files A1 and A2 into readable Json format data through a file analysis function of the UE engine, and then sending the Json data back to a monitoring server in an HTTP mode; (6) the data in the Json format received by the monitoring server is stored by taking a single attribute as a row unit by default; (7) at this time, the Json format data may be converted into data with a plurality of attributes as a row unit, and then the Diff data may be compared.
In a preferred embodiment, after obtaining the monitoring result and the corresponding Diff information, the monitoring server may further generate a monitoring notification according to the monitoring result, and send the monitoring notification to the related personnel according to personnel information, so as to notify the developer and the tester to confirm the modified content, and the monitoring server may further receive a result checking request for the monitoring result, where a corresponding monitoring data entry may be obtained from a preset database according to the checking request, so that the related personnel can check the monitoring data entry.
Referring to fig. 8, a front-end and back-end frame diagram of a monitoring system of a UDT file in an embodiment of the present invention is shown, where a Bootstrap4 frame may be used at the front end of the monitoring system of the UDT file, and the portion is implemented by html+javascript+jquery+ajax; the back end can adopt a flash framework, is a lightweight Web application framework, uses a simple core, is convenient to expand, and in the embodiment of the invention, the following modules can be added:
(1) OpenID login authentication: all users access, and the authorized users can access the Diff page only after user authentication; (2) MongoDB: the database is MongoDB, can read data rapidly, return to users; (3) Log center: the method is helpful for recording user operation information and error reporting information, and can have three grades log: error: recording when an error occurs in operation; warning: recording when the running generates a warning; nfo: recording the operation of a user; (4) task processing queues: the system is a daemon process, and the Diff processing request is put into the background processing queue every time the system receives the Diff processing request, so that the access of other users to the webpage is not blocked; (5) message notification system: and the system is specially used for notifying the user, such as Diff generation or notification of short messages and mails to an administrator or other users when the Diff system is abnormal.
The deployment mode of the system can adopt the deployment mode of virtual+Guicorn+super+nginx, and referring to FIG. 9, a schematic diagram of the deployment mode of a monitoring system of a UDT file in the embodiment of the invention is shown, a Diff system is started by Guicorn to generate an application process, and the operation environments of the Diff system and Guicorn depend on a virtual environment of virtual; the Gunicorn application process is managed through the Supervisor; the user request is sent to the Diff system to process the request through the Nginx reverse proxy, if the request is static file download, the user request can be directly downloaded through the Nginx static file without occupying Diff system resources.
Referring to fig. 10, a front-end and back-end working schematic diagram of a monitoring system for a UDT file in an embodiment of the present invention is shown, (1) a user initiates an HTTP access request through a browser; (2) After receiving a user request, the rear end firstly carries out the identity verification of the OpenID on the user; (3) After the user inputs correct OpenID identity information, the party can access the OpenID identity information in the next step; (4) The Diff system retrieves related data from a database according to a user access request; (5) The data retrieved from the database is formatted and output, and finally returned to the user; (6) At the user end, the browser displays the data returned by the server.
The Diff front end page function display mainly comprises the following three aspects: (1) All unacknowledged Diff entries are displayed, the file name, version number and submitting time of each submission can be clearly seen, the submitter and log information can be manually assigned to follow-up testers; the right-most 'confirm' button is provided for a tester to use, the tester confirms that Diff has no problem, and can click 'confirm', and the record is transferred to 'history record'; the "update all" and "update most recent" in the upper right corner of the interface are provided to the user, and are used for manually generating Diff, for example, the user joins other UDT files which want to be monitored, and clicking on "update all" at this time can generate all historical submission Diff of the files;
(2) Diff specific content pages; (3) All historical Diff entries of a single file can be seen, and all historically submitted diffs of a single file, including confirmed and unconfirmed, are convenient for a user to conduct targeted screening.
According to the embodiment of the invention, the problem that the UDT file (namely the UEUDT file) and the Diff information can be checked only through the editor is solved, the operation complexity of a user is reduced, meanwhile, the Diff is automatically acquired by the background, manual check and follow-up are not needed, the Diff information can be acquired and modified in the first time, the workload of a developer is reduced, and the working efficiency is improved.
In the embodiment of the invention, modification of the UDT can influence the product function in the development process, and when an error occurs, a developer needs to trace and modify the Diff to inquire the reason of the problem. Under the condition that no UDT modification is omitted, the required Diff information is extracted and clearly displayed at the front end of the Web, and a developer can easily and quickly trace back the modified content through the information on the page, so that error reasons are searched, and the working efficiency is improved.
In the embodiment of the invention, the modification of the UDT can influence the function of the product in the development process, so that the error risk exists. In daily work, a tester needs to confirm whether the specific content of each modification of the UDT is correct or not so as to avoid the problem that a developer changes without knowledge or misoperation, and cause errors. The method provides timely, effective, convenient and efficient automatic monitoring service for testers, and the testers only need to browse Diff information at the front end of the Web.
According to the embodiment of the invention, the automatic acquisition of the Diff information for the encrypted UDT file is realized, the same effect as that of the traditional clear text data acquisition Diff and monitoring is achieved, the Diff and processing information can be acquired in real time, the user operation, information display, working habit and experience are perfectly inherited, and the learning cost caused by change is avoided at the user level.
In the embodiment of the invention, the method is established on the UDT, so that any change of the UDT can be directly effective, no additional maintenance is needed, and any expansion does not need to consider the functional influence of the UDT. Any required secondary development can be performed on the obtained Diff information, a required expansion function is provided, and functions such as automatic error correction and error alarm can be developed again in the future. The core functions are easy to realize, have strong independence and high degree of freedom, so that any other working demands exist in the future, and the core functions can be freely expanded.
Referring to fig. 11, there is shown a block diagram of an embodiment of a monitoring device for a UDT file of the present invention, which is applied to a monitoring server, where the monitoring server is communicatively connected to a version management server and a remote server, and may specifically include the following modules:
a commit notification receiving module 1101, configured to receive a commit notification sent by the version management server; the submitting notification is a notification generated by intercepting a submitting request of the UDT file by the version management server;
the to-be-monitored UDT file obtaining module 1102 is configured to obtain a to-be-monitored UDT file according to the submission notification;
the target monitoring resource data receiving module 1103 is configured to send the UDT file to be monitored to a remote server, and receive target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by carrying out data analysis and format conversion on the UDT file to be monitored by the remote server through a data analysis service provided by a preset engine;
And the monitoring result acquisition module 1104 is used for comparing the target monitoring resource data to obtain a monitoring result.
In one embodiment of the invention, the commit notification includes version information; the UDT file to be monitored comprises a current version UDT file and a historical version UDT file; the UDT file acquisition module to be monitored can comprise the following sub-modules:
a UDT file acquisition request sending sub-module, configured to generate a UDT file acquisition request according to the version information, and send the UDT file acquisition request to the version management server;
a UDT file receiving sub-module, configured to receive a current version UDT file and a previous version UDT file sent by the version management server; the current version UDT file and the history version file are UDT files acquired by the version management server according to the version information.
In one embodiment of the present invention, the target monitoring resource data includes first target monitoring resource data and second target monitoring resource data; the target monitoring resource data receiving module may include the following sub-modules:
a UDT file sending sub-module, configured to send a current version UDT file and the previous version UDT file to a remote server;
The target UDT file receiving sub-module is used for receiving the first target monitoring resource data and the second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by carrying out data analysis and format conversion on the current version UDT file; the second target monitoring resource data is data after data analysis and format conversion of the previous version UDT file.
In one embodiment of the present invention, the target monitoring resource data includes data in a unit of a single attribute as a row; the monitoring result acquisition module may include the following sub-modules:
the first data acquisition sub-module is used for converting the data taking a single attribute as a row unit in the first target monitoring resource data into the data taking a plurality of attributes as a row unit to obtain first data;
the second data acquisition sub-module is used for converting the data taking the single attribute as a row unit in the second target monitoring resource data into the data taking a plurality of attributes as a row unit to obtain second data;
and the monitoring result acquisition sub-module is used for comparing the first data with the second data to obtain a monitoring result.
In one embodiment of the invention, the monitoring server has a comparison module; the monitoring result obtaining sub-module may include the following units:
the comparison data acquisition unit is used for comparing the first data with the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of row data and a plurality of attribute values corresponding to the row data;
and the monitoring result acquisition unit is used for traversing a plurality of attribute values corresponding to the row data and adding corresponding row identifiers to obtain comparison information.
In one embodiment of the invention, the submission notification includes personnel information; after the monitoring server obtains the monitoring result according to the target resource data, the method further comprises the following steps:
the monitoring data item generation module is used for generating monitoring data items according to the monitoring result and storing the monitoring data items into a preset database;
the monitoring notification sending module is used for generating a monitoring notification according to the monitoring result and sending the monitoring notification to related personnel according to the personnel information;
and the monitoring data item acquisition module is used for acquiring the monitoring data item from the preset database according to the viewing request when a result viewing request aiming at the monitoring result is received, so that related personnel can view the monitoring data item.
For the device embodiments, since they are substantially similar to the method embodiments, the description is simple, and references to the parts of the description of the method embodiments are only necessary.
The embodiment of the invention also provides electronic equipment, which comprises:
the method comprises a processor, a memory and a computer program which is stored in the memory and can run on the processor, wherein the computer program realizes all the processes of the embodiment of the monitoring method of the UDT file when being executed by the processor, can achieve the same technical effects, and is not repeated here.
The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, realizes the processes of the above embodiment of the monitoring method for the UDT file, and can achieve the same technical effects, and in order to avoid repetition, the description is omitted here.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The above description of the method for monitoring the UDT file, the system for monitoring the UDT file and the device for monitoring the UDT file provided by the present invention applies specific examples to illustrate the principles and embodiments of the present invention, and the above examples are only used to help understand the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims (10)

1. A method for monitoring a UDT file, applied to a monitoring server, the monitoring server being communicatively connected to a version management server and a remote server, the method comprising:
the monitoring server receives a submission notification sent by the version management server; the submitting notification is a notification generated by intercepting a submitting request of the UDT file by the version management server, and the submitting notification comprises version information;
the monitoring server acquires a UDT file to be monitored according to the submission notice; the UDT file to be monitored comprises a current version UDT file and a historical version UDT file;
The monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by carrying out data analysis and format conversion on the UDT file to be monitored by the remote server through a data analysis service provided by a preset engine;
and the monitoring server compares the target monitoring resource data to obtain a monitoring result.
2. The method of claim 1, wherein the monitoring server obtaining the UDT file to be monitored based on the commit notification, comprising:
the monitoring server generates a UDT file acquisition request according to the version information and sends the UDT file acquisition request to the version management server;
the monitoring server receives a current version UDT file and a historical version UDT file which are sent by the version management server; the current version UDT file and the history version UDT file are UDT files acquired by the version management server according to the version information.
3. The method of claim 2, wherein the target monitoring resource data comprises first target monitoring resource data and second target monitoring resource data; the monitoring server sends the UDT file to be monitored to a remote server and receives target monitoring resource data sent by the remote server, and the method comprises the following steps:
The monitoring server sends a current version UDT file and the historical version UDT file to a remote server;
the monitoring server receives first target monitoring resource data and second target monitoring resource data sent by the remote server; the first target monitoring resource data is data obtained by carrying out data analysis and format conversion on the current version UDT file; and the second target monitoring resource data is data obtained by carrying out data analysis and format conversion on the historical version UDT file.
4. A method according to claim 3, wherein the target monitoring resource data comprises data in units of rows of a single attribute; the monitoring server performs comparison operation on the target monitoring resource data to obtain a monitoring result, and the method comprises the following steps:
the monitoring server converts data taking a single attribute as a row unit in the first target monitoring resource data into data taking a plurality of attributes as a row unit to obtain first data;
the monitoring server converts the data taking the single attribute as a row unit in the second target monitoring resource data into the data taking a plurality of attributes as a row unit to obtain second data;
And the monitoring server compares the first data with the second data to obtain a monitoring result.
5. The method of claim 4, wherein the monitoring server has a contrast module; the monitoring server performs a comparison operation on the first data and the second data to obtain a monitoring result, and the monitoring result comprises:
the monitoring server compares the first data with the second data through the comparison module to obtain comparison data; the comparison data comprises a plurality of row data and a plurality of attribute values corresponding to the row data;
and traversing the attribute values corresponding to the row data by the monitoring server and adding corresponding row identifiers to obtain comparison information.
6. The method of claim 1, wherein the submission notification includes personnel information; after the monitoring server obtains the monitoring result according to the target monitoring resource data, the method further comprises the following steps:
the monitoring server generates a monitoring data item according to the monitoring result and stores the monitoring data item in a preset database;
the monitoring server generates a monitoring notice according to the monitoring result and sends the monitoring notice to related personnel according to the personnel information;
When a result checking request aiming at the monitoring result is received, the monitoring server acquires the monitoring data item from the preset database according to the checking request so as to enable related personnel to check the monitoring data item.
7. A monitoring system of UDT files is characterized in that the system comprises a version management server, a monitoring server and a remote server,
the version management server is used for intercepting a submitting request of a preset UDT file and generating a submitting notification when the submitting request is detected, and sending the submitting notification to the monitoring server, wherein the submitting notification comprises version information;
the monitoring server is used for receiving the submitting notification sent by the version management server, acquiring a UDT file to be monitored according to the submitting notification, and sending the UDT file to be monitored to a remote server; the UDT file to be monitored comprises a current version UDT file and a historical version UDT file;
the remote server is used for carrying out data analysis and format conversion on the UDT file to be monitored through a data analysis service provided by a preset engine to obtain target monitoring resource data, and sending the target monitoring resource data to the monitoring server;
The monitoring server is also used for receiving the target monitoring resource data sent by the remote server and comparing the target monitoring resource data to obtain a monitoring result.
8. A monitoring device for a UDT file, applied to a monitoring server, said monitoring server being communicatively connected to a version management server and to a remote server, said device comprising:
the submission notification receiving module is used for receiving the submission notification sent by the version management server; the submitting notification is a notification generated by intercepting a submitting request of the UDT file by the version management server, and the submitting notification comprises version information;
the UDT file obtaining module to be monitored is used for obtaining the UDT file to be monitored according to the submitting notice; the UDT file to be monitored comprises a current version UDT file and a historical version UDT file;
the target monitoring resource data receiving module is used for sending the UDT file to be monitored to a remote server and receiving target monitoring resource data sent by the remote server; the target monitoring resource data is data obtained by carrying out data analysis and format conversion on the UDT file to be monitored by the remote server through a data analysis service provided by a preset engine;
And the monitoring result acquisition module is used for comparing the target monitoring resource data to obtain a monitoring result.
9. An electronic device, comprising: a processor, a memory and a computer program stored on the memory and capable of running on the processor, which when executed by the processor performs the steps of the method of monitoring a UDT file as claimed in any one of claims 1 to 6.
10. A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, which when executed by a processor, implements the steps of the method for monitoring a UDT file as claimed in any one of claims 1 to 6.
CN202010918185.XA 2020-09-03 2020-09-03 Method, system and device for monitoring UDT file Active CN111949607B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010918185.XA CN111949607B (en) 2020-09-03 2020-09-03 Method, system and device for monitoring UDT file

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010918185.XA CN111949607B (en) 2020-09-03 2020-09-03 Method, system and device for monitoring UDT file

Publications (2)

Publication Number Publication Date
CN111949607A CN111949607A (en) 2020-11-17
CN111949607B true CN111949607B (en) 2023-06-27

Family

ID=73367401

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010918185.XA Active CN111949607B (en) 2020-09-03 2020-09-03 Method, system and device for monitoring UDT file

Country Status (1)

Country Link
CN (1) CN111949607B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113608727B (en) * 2021-08-04 2023-07-25 网易(杭州)网络有限公司 Code processing method, device and system for visual programming
CN116863040A (en) * 2023-05-29 2023-10-10 上海幻维数码科技有限公司 Multi-person collaboration system based on engine building
CN117312434B (en) * 2023-10-08 2024-03-19 北京皓宽网络科技有限公司 Data exchange method and platform

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6789074B1 (en) * 1998-11-25 2004-09-07 Hitachi, Ltd. Database processing method and apparatus, and medium for recording processing program thereof
CN101982955A (en) * 2010-11-19 2011-03-02 深圳华大基因科技有限公司 High-performance file transmission system and method thereof
CN106170804A (en) * 2013-11-11 2016-11-30 亚马逊技术有限公司 Document management and cooperative system
US10031920B1 (en) * 2012-04-23 2018-07-24 Google Llc Third-party indexable text
US10311076B1 (en) * 2016-10-26 2019-06-04 Open Invention Network, Llc Automated file acquisition, identification, extraction and transformation

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7017148B2 (en) * 2001-07-10 2006-03-21 Intel Corporation Apparatus and method for UPnP device code generation using XML
KR101579493B1 (en) * 2015-01-08 2015-12-23 주식회사 파수닷컴 Staging control method for source code, Computer program for the same, Recording medium storing computer program for the same
US10664551B2 (en) * 2016-07-25 2020-05-26 American Megatrends International, Llc Intuitive user interface (UI) for device or vendor independent network switch management via embedded management controller
US10191736B2 (en) * 2017-04-28 2019-01-29 Servicenow, Inc. Systems and methods for tracking configuration file changes
US10517020B2 (en) * 2017-12-15 2019-12-24 Industrial Technology Research Institute Mobile edge platform servers and user equipment context migration management methods thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6789074B1 (en) * 1998-11-25 2004-09-07 Hitachi, Ltd. Database processing method and apparatus, and medium for recording processing program thereof
CN101982955A (en) * 2010-11-19 2011-03-02 深圳华大基因科技有限公司 High-performance file transmission system and method thereof
US10031920B1 (en) * 2012-04-23 2018-07-24 Google Llc Third-party indexable text
CN106170804A (en) * 2013-11-11 2016-11-30 亚马逊技术有限公司 Document management and cooperative system
US10311076B1 (en) * 2016-10-26 2019-06-04 Open Invention Network, Llc Automated file acquisition, identification, extraction and transformation

Also Published As

Publication number Publication date
CN111949607A (en) 2020-11-17

Similar Documents

Publication Publication Date Title
US10613971B1 (en) Autonomous testing of web-based applications
CN111949607B (en) Method, system and device for monitoring UDT file
US20210318851A1 (en) Systems and Methods for Dataset Merging using Flow Structures
US11379657B2 (en) Systems and methods for automatic report generation and retaining of annotations in reporting documents after regeneration
EP2778929B1 (en) Test script generation system
US11321669B2 (en) Creating a customized email that includes an action link generated based on form data
US20080262860A1 (en) System and Method for Supporting Software
US10514910B2 (en) Automatically mapping data while designing process flows
AU2017207388B2 (en) Multi-technology visual integrated data management and analytics development and deployment environment
US20160306690A1 (en) Integrated test design, automation, and analysis
US11086765B2 (en) Test reuse exchange and automation system and method
CN110928763A (en) Test method, test device, storage medium and computer equipment
US9442718B1 (en) System for assisting in locating changes in source code version control system
CN114303134A (en) Method, apparatus and computer readable medium for maintaining visual consistency
CN108073511B (en) Test code generation method and device
CN110865806B (en) Code processing method, device, server and storage medium
CN117875288A (en) Form page generation method and device and electronic equipment
CN110716804A (en) Method and device for automatically deleting useless resources, storage medium and electronic equipment
US10885013B2 (en) Automated application lifecycle tracking using batch processing
CN112817817B (en) Buried point information query method, buried point information query device, computer equipment and storage medium
US9104573B1 (en) Providing relevant diagnostic information using ontology rules
JP6865042B2 (en) Knowledge management equipment, knowledge management methods and computer programs
Singh Analysis of bug tracking tools
US20220374342A1 (en) Techniques for decoupled management of software test execution planning and corresponding software test execution runs
US20220374340A1 (en) Techniques for decoupled management of software test execution planning and corresponding software test execution runs

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant