CN115827681A

CN115827681A - Data management and control method and device, terminal equipment and computer readable storage medium

Info

Publication number: CN115827681A
Application number: CN202211658447.9A
Authority: CN
Inventors: 胡田野
Original assignee: Shenzhen Hengyang Data Co ltd
Current assignee: Shenzhen Hengyang Data Co ltd
Priority date: 2022-12-22
Filing date: 2022-12-22
Publication date: 2023-03-21

Abstract

The application is applicable to the technical field of data processing, and provides a data management and control method, a data management and control device, terminal equipment and a computer readable storage medium. The data management and control method specifically comprises the following steps: acquiring original data and an initial management and control strategy, wherein the initial management and control strategy comprises initial screening conditions for screening initial features; performing data management and control on the original data to extract strategy updating data meeting the initial screening conditions from the original data; taking data characteristics except the initial characteristics in the data characteristics of the strategy updating data as key data characteristics; and updating the initial management and control strategy according to the key data characteristics to obtain an updated management and control strategy, wherein the updated management and control strategy is used for performing data management and control on the newly acquired original data. The embodiment of the application can actively update the management and control strategy, realize active management and control on novel network data, and then comprehensively and effectively manage and control various types of network data.

Description

Data management and control method and device, terminal equipment and computer readable storage medium

Technical Field

The present application belongs to the technical field of data processing, and in particular, to a data management and control method, an apparatus, a terminal device, and a computer-readable storage medium.

Background

Along with the continuous development of the internet, more and more network data are generated, and in order to purify the internet surfing environment and ensure the internet surfing experience of a user, the network data needs to be managed and controlled.

Along with the continuous growth of network data volume, novel network data can constantly appear, and traditional management and control measure can't carry out effectual management and control to novel network data comprehensively effectively, can only passively wait for user or staff to discover and reflect after the problem can look for new management and control measure and come to carry out the management and control to novel network data, can't carry out initiative management and control to novel network data.

Disclosure of Invention

Embodiments of the present application provide a data management and control method and apparatus, a terminal device, and a computer-readable storage medium, which can solve the problem that it is difficult for traditional management and control measures to actively manage and control new network data.

In a first aspect, an embodiment of the present application provides a data management and control method, where the method includes: acquiring original data and an initial management and control strategy, wherein the initial management and control strategy comprises initial screening conditions for screening initial features; performing data management and control on the original data to extract strategy updating data meeting the initial screening conditions from the original data; taking data features other than the initial features in the data features of the strategy updating data as key data features; and updating the initial management and control strategy according to the key data characteristics to obtain an updated management and control strategy, wherein the updated management and control strategy is used for performing data management and control on the newly acquired original data.

In a second aspect, an embodiment of the present application provides a data management and control apparatus, including: the device comprises an acquisition unit, a processing unit and a management and control unit, wherein the acquisition unit is used for acquiring original data and an initial management and control strategy, and the initial management and control strategy comprises initial screening conditions for screening initial features; the management and control unit is used for performing data management and control on the original data so as to extract strategy updating data meeting the initial screening condition from the original data; a characteristic output unit, configured to use, as a key data characteristic, a data characteristic other than the initial characteristic in the data characteristics of the policy update data; and the updating unit is used for updating the initial management and control strategy according to the key data characteristics to obtain an updated management and control strategy, and the updated management and control strategy is used for performing data management and control on the newly acquired original data.

In a third aspect, an embodiment of the present application provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the data management and control method when executing the computer program.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements the steps of the data management and control method.

In a fifth aspect, the present application provides a computer program product, which when running on a terminal device, causes the terminal device to execute the above data management and control method.

Compared with the prior art, the embodiment of the application has the advantages that: the method comprises the steps of extracting strategy updating data from a large amount of original data through initial screening conditions in initial management and control strategies, screening initial characteristics through the initial screening conditions, screening traditional data of which the initial characteristics accord with the initial screening conditions, simultaneously screening novel network data of which the initial characteristics meet the initial screening conditions, wherein the novel network data usually contain data characteristics unique to the novel network data different from the traditional data except the initial characteristics, therefore, the data characteristics unique to the novel network data are taken as key data characteristics, updating the initial management and control strategies based on the key data characteristics to obtain the updated management and control strategies, and the updated management and control strategies can effectively manage and control the novel network data, so that the management and control strategies can be actively updated, active management and control on the novel network data are realized, and then, all types of network data are comprehensively and effectively managed and controlled.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 is a schematic view of an implementation flow of a data management and control method provided in an embodiment of the present application;

fig. 2 is a schematic flowchart of a first specific implementation of a data management and control method according to an embodiment of the present application;

fig. 3 is a schematic flowchart of a second specific implementation of a data management and control method according to an embodiment of the present application;

fig. 4 is a schematic flowchart of a third specific implementation of a data management and control method according to an embodiment of the present application;

fig. 5 is a schematic flowchart of a fourth specific implementation of a data management and control method according to an embodiment of the present application;

fig. 6 is a schematic flowchart of a fifth specific implementation of a data management and control method according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a data management and control apparatus according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a data management and control apparatus according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any inventive step, are intended to be protected by the present application.

It is noted that the terms "comprises," "comprising," and "having" and any variations thereof in the description and claims of this application and the drawings described above are intended to cover non-exclusive inclusions. For example, a process, method, terminal, product, or apparatus that comprises a list of steps or elements is not limited to the listed steps or elements but may alternatively include other steps or elements not listed or inherent to such process, method, product, or apparatus. In the claims, the description, and the drawings of the specification of the present application, relational terms such as "first" and "second", and the like, are used solely to distinguish one entity/action/object from another entity/action/object without necessarily requiring or implying any such real-time relationship or order between such entities/actions/objects.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The internet is full of data generated by internet users, and network content needs to be supervised and controlled in order to purify the network environment, optimize the service quality and ensure the internet experience of the users. On one hand, data conditions in the network need to be controlled, such as flow statistics rules based on dimensions of time, operators, regions, network service providers, users and the like, and identification of normal or abnormal data, and on the basis of support of the data, guidance can be provided for optimization of a network architecture, so that prediction of network development is closer to reality; on the other hand, different data needs to be differentially processed, for example, a certain type of network service is prohibited, or the internet access behavior of a certain user is tracked, or desensitization is performed on specific sensitive information, so that illegal behaviors on the network can be more effectively attacked.

In the prior art, the steps of managing and controlling network data are as follows: the method comprises the steps of receiving network data and manually issuing a control strategy, wherein the control strategy generally comprises control data characteristics and control actions, and the control strategy is generally specific to the more specific network data. And the system manages and controls the network data according with the characteristics of the management and control data according to the issued management and control strategy. However, a problem exists in this way, with the rapid development of network data, new network data which is different from the characteristics of the control data and needs to be controlled as well can be continuously emerged, the new network data cannot be controlled because the characteristics of the control data are not met, and only the user can wait for the illegal feedback of the network data, and then the network data is analyzed to make a new control strategy. That is, only the network data can be passively controlled, the network data cannot be actively controlled, and the control effect is poor.

Or a management and control strategy with wide management and control data characteristics is formulated, and most network data can be monitored. But there are problems with doing so: the data processing capacity is very large, the accuracy is low, and the control effect is not good.

In order to solve the problem that the traditional management and control measures cannot comprehensively and effectively perform effective management and control on novel network data, only passive management and control can be performed, and active management and control on the novel network data cannot be performed, the embodiment of the application extracts unique key data features of the novel network data by utilizing the traditional management and control strategy, and then updates the traditional management and control strategy, and realizes the management and control on the novel network data while realizing the self-adaptive updating of the management and control strategy.

In order to explain the technical means of the present application, the following description will be given by way of specific examples.

Fig. 1 shows a schematic implementation flow diagram of a data management and control method provided in an embodiment of the present application, where the method may be applied to a terminal device.

Specifically, the data management and control method may include the following steps S101 to S104.

Step S101: and acquiring original data and an initial management and control strategy.

The initial control strategy comprises initial screening conditions for screening the initial features.

In the embodiment of the present application, the raw data is acquired by the data access unit, and is various data acquired from a network, for example, the raw data may be network data generated by acquiring data on a mobile device, or network data acquired from the internet by a web crawler. And performing feature extraction on the original data to obtain data features of the original features, wherein the data features comprise the initial features. The initial characteristic is one or more of a plurality of data characteristics in the original data and is used for judging whether the corresponding original data meets the initial screening condition. The original data includes data that needs to be managed and data that does not need to be managed, and also includes new type network data and old type network data, and the old type network data refers to network data with known data characteristics.

The initial control measurement strategy is used for controlling the old network data; and the novel network data is the network data with unknown data characteristics, and because the novel network data is unknown, the staff can not issue a control strategy according to the data characteristics of the novel network data, and can not control the novel network data. The initial management and control policy includes initial screening conditions for screening initial features and corresponding management and control actions, the initial screening conditions include set data features, the set data features are determined according to specific data features in data to be managed and controlled, and when some kind of data to be managed and controlled have one or more same data features, the same data features may be used as the data features set in the initial screening conditions to manage and control the kind of data. When one or more data features exist in the data features of a certain piece of data and the data features accord with the initial screening conditions, the data features accord with the initial screening conditions and are the initial features, and when the initial features of the certain piece of data are consistent with the data features set in the initial screening conditions, the terminal device can execute management and control actions corresponding to the initial screening conditions, such as returning to an original link, discarding, copying and the like.

Step S102: and performing data management and control on the original data so as to extract strategy updating data meeting the initial screening conditions from the original data.

In the embodiment of the application, firstly, feature extraction is carried out on original data, data features of the original data are compared with data features set in initial screening conditions, whether the initial features consistent with the data features set in the initial screening conditions exist in the data features of the original data or not is detected, if the initial features do not exist, the original data do not meet the initial screening conditions, and the original data do not need to be controlled, so that the original data can be returned to an original link through a data access unit; if the data exists, the original data meets the initial screening condition, which indicates that the original data needs to be subjected to data management and control, and the original data can be managed and controlled according to the management and control action corresponding to the initial screening condition, so that the managed and controlled data is obtained. The managed and controlled data comprise strategy updating data, and the strategy updating data are used for updating the initial management and control strategy so that the initial management and control strategy is continuously evolved and is suitable for novel network data, and active management and control of the network data are achieved.

Step S103: and taking the data characteristics of the strategy updating data except the initial characteristics as key data characteristics.

In the embodiment of the application, the new type and old type network data are included in the policy update data, and for the old type network data, because the old type network data is controlled by the initial control policy, the initial control policy does not need to be updated; for the new network data in the policy update data, the new network data is managed by the initial management and control policy because the new network data has the initial characteristics that are consistent with the data characteristics set in the initial screening conditions. However, for other new type network data of the same type as the new type network data, the initial characteristics may not exist in the other new type network data, and therefore, the other new type network data cannot be managed by the management and control policy corresponding to the initial screening condition, that is, the data characteristics common to the new type network data and the other new type network data of the same type may not be the initial characteristics satisfying the initial screening condition.

For ease of understanding, the following are specifically exemplified: it is assumed that the policy update data includes a new type of network data a, where a includes two data features a and b, where the data feature a is a specific data feature of the new type of network data a, and b is not a specific data feature of a, that is, an initial feature, and the initial screening condition also includes a data feature b, so that the data feature b in the a satisfies the data feature b in the initial screening condition, and thus the a is managed and controlled by the initial management and control policy. And the novel network data B of the same type as the network data A only comprises the data characteristics a and does not comprise the data characteristics B, so that the network data B cannot meet the initial screening condition and cannot be controlled by the initial control strategy. To manage the new type of network data A, B, the common data feature a must be used as the set data feature of the initial screening condition, so that all the new type of network data including the data feature a is managed, and therefore, in this embodiment, the data feature a is used as the key data feature.

The key data features are different from the initial features in the policy updating data, are also specific to new network data in the policy updating data, and can be used for updating the initial management and control policy.

Step S104: and updating the initial management and control strategy according to the key data characteristics to obtain an updated management and control strategy.

The updated management and control strategy can be used for data management and control of newly acquired original data.

In the embodiment of the application, after the key data features of the novel network data are obtained, the initial management and control policy may be updated according to the key data features, for example, the key data features are used as the data features set in the initial screening conditions to obtain new initial screening conditions, which replace the original initial screening conditions, and then the corresponding initial management and control policy is updated, and the novel network data with the key data features may be managed and controlled according to the updated management and control policy.

The embodiment of the application extracts strategy updating data from a large amount of original data through the initial screening condition in the initial management and control strategy, the initial characteristic is screened through the initial screening condition, when the traditional data with the initial characteristic meeting the initial screening condition is screened out, the novel network data with the initial characteristic meeting the initial screening condition can be screened out, the novel network data usually contain the data characteristic unique to the novel network data different from the traditional data except the initial characteristic, therefore, the data characteristic unique to the novel network data is taken as the key data characteristic, the initial management and control strategy is updated based on the key data characteristic to obtain the updating management and control strategy, the updated management and control strategy can effectively manage and control the novel network data, the management and control strategy can be actively updated, the active management and control of the novel network data are realized, and then, the network data of various types are comprehensively and effectively managed and controlled.

As shown in fig. 2, in some specific embodiments of the present application, the initial management and control policy may include a feature output policy, and the taking of data features other than the initial features as key data features in the data features of the policy update data may specifically include:

step S203, inputting the data characteristics of the strategy updating data into the characteristic output model corresponding to the characteristic output strategy to obtain corresponding key data characteristics.

In an embodiment of the present application, there may be multiple initial management and control policies, which correspond to different management and control actions, and one of the initial management and control policies is a feature output policy. When the initial management and control strategy needs to be updated, the data characteristics of strategy update data can be extracted first, and the steps of characteristic extraction are as follows: and identifying the protocol content of the strategy updating data in sequence according to the protocol standard, wherein the protocol content comprises data characteristics such as message length, protocol field, application type and the like. After the data features are extracted, the data features can be input into the feature output model corresponding to the feature output strategy according to the feature output strategy, and corresponding key data features are output and obtained.

Different feature output strategies correspond to different feature output models, and the different feature output strategies are suitable for different control scenes. And the characteristic output strategy also comprises evolution parameters and termination conditions, and when the characteristic output model is trained, a large amount of strategy updating data is used as the input of the characteristic output model to be trained to train the model so as to obtain the trained characteristic output model. In the training process, the training evolution process of the characteristic output model can be controlled according to the evolution parameters, and the degree to which the characteristic output model is trained and evolved is controlled according to the termination condition to output the key data characteristics. The feature output models are various and respectively correspond to different feature output strategies, and comprise a keyword model, a session model, a user behavior model and the like.

The keyword model can be used in a scenario of management and control through keyword features, such as illegal speech supervision. The specific characteristic output process is as follows: according to the feature output strategy, data features such as keyword content, keyword position, word frequency, keyword derivative words or derivative words in strategy updating data are extracted, the data features are input into a keyword model, and key data features related to the keywords in the strategy updating data can be output through a model algorithm such as a linear regression algorithm.

The session model can be used for scenes of management and control through session characteristics, such as illegal transaction supervision. The specific characteristic output process is as follows: and extracting data characteristics such as session message statistics, session occurrence time, session duration, session roles, message formatting, message content formatting and the like in the strategy updating data according to the characteristic output strategy, inputting the data characteristics into a session model, and outputting key data characteristics related to the session in the strategy updating data through a model algorithm.

The user behavior model can be used in a scenario of management and control through user categories, such as potentially dangerous user identification. The specific characteristic output process is as follows: and extracting data characteristics such as user behavior rules and user data rules in the strategy updating data according to the characteristic output strategy, and outputting key data characteristics related to the user behavior in the strategy updating data through a model algorithm.

As shown in fig. 3, in some embodiments of the application, the updating the initial management and control policy according to the key data feature to obtain an updated management and control policy may specifically include:

and step S304, updating the initial screening conditions according to the key data characteristics to obtain an updated management and control strategy.

In the embodiment of the application, after the key data features are obtained, it is first determined which key data features can be used as the data features set by the updated management and control policy, for example, the obtained key data features include key data features consistent with the initial features and key data features inconsistent with the initial features, so that the key data features consistent with the initial features can be removed, the key data features inconsistent with the initial features are used as the data features set in the initial screening condition, and the updated management and control policy is further determined.

For example: the key data features may be used to replace the data features set in the initial screening conditions (where the set data features are consistent with the initial features in the corresponding old type of network data), resulting in new initial screening conditions. When the initial characteristics in the novel original data are consistent with the key data characteristics, performing control action on the novel original data, and irrelevant to the data characteristics set in the old initial screening conditions; the key data features and the data features set in the initial screening conditions can be combined to obtain new initial screening conditions, and the new set data features in the new initial screening conditions become the key data features and the old set data features. When the initial features in the original data satisfy the key data features or old set data features, the control action can be executed on the original data. Or when the initial characteristics in the original data simultaneously satisfy the key data characteristics and the old set data characteristics, the control action can be executed on the original data.

In addition, the key data features may be further filtered (for example, duplicate removal) to obtain filtered data features, and an updated management and control policy is determined according to the filtered data features, specifically, the filtered data features may be combined with a specified management and control action to form the updated management and control policy.

For the same policy update data, based on data analysis needs of different dimensions, the emphasis of the initial management and control policy is also different, for example, some initial management and control policies focus on management and control analysis of keywords, and some initial management and control policies focus on management and control analysis of user behaviors. Similarly, the initial management and control policies with different emphasis points also need to be updated continuously to deal with new network data.

To achieve this objective, as shown in fig. 4, in some specific embodiments of the present application, the updating the initial management and control policy according to the key data feature to obtain an updated management and control policy specifically includes:

step S404, updating the initial management and control strategy according to each type of key data characteristics to obtain a plurality of updated management and control strategies.

And each updated management and control strategy corresponds to one type of key data characteristics.

In an embodiment of the application, different types of key data features may be extracted from policy update data according to initial management and control policies with different emphasis points, one type of key data feature corresponds to one initial management and control policy, and then each type of key data feature may be used to update the corresponding initial management and control policy, so as to obtain multiple updated management and control policies.

For example: the key data characteristics related to the keywords can be extracted from the strategy updating data according to the initial management and control strategy of the key words with emphasis, then the initial management and control strategy of the key words with emphasis is updated according to the key data characteristics, and the updated initial management and control strategy of the key words with emphasis is obtained, so that the updated initial management and control strategy of the key words with emphasis can better manage and control the key words of the novel network data.

In the prior art, in the process of managing, controlling and analyzing network data, because the data size is very large and the analyzing mode is single (generally, a strategy is adopted to analyze the network data), the data cannot be comprehensively analyzed, and the obtained analyzed data are mixed together, which is not beneficial to more finely managing, controlling and analyzing the network data.

In order to solve the technical problems that data cannot be comprehensively analyzed and obtained analysis data are mixed together when network management and control are performed in the prior art, which is not favorable for performing finer management and control analysis on network data, as shown in fig. 5, in some embodiments of the present application, the performing data management and control on the original data to extract policy update data meeting the initial screening condition from the original data may include: and carrying out data management and control on the original data according to different initial screening conditions in sequence to obtain strategy updating data.

In the embodiment of the application, the original data can be screened according to different initial screening conditions to obtain corresponding different strategy updating data. For example, different data management and control can be performed on multiple sets of the same original data according to different screening conditions and corresponding management and control strategies in a certain management and control process, so that different strategy update data can be obtained, and the network data can be finely managed and controlled according to actual needs.

Similarly, in order to solve the technical problems that data cannot be comprehensively analyzed when network management and control are performed in the prior art, and obtained analysis data are mixed together, which is not beneficial to performing finer management and control analysis on network data, as shown in fig. 6, in some embodiments of the present application, a terminal device may perform targeted management and control through steps S601 to S602, where steps S601 to S602 specifically are:

step S601, copying the to-be-processed data after performing at least one data management and control on the original data into multiple copies.

Step S602, respectively performing data processing on each to-be-processed data according to different data processing strategies to obtain data processed by different data processing strategies.

In an embodiment of the present application, the initial management and control policy includes a data processing policy, and the data processing policy includes a specific management and control action.

Firstly, performing first data management and control on obtained original data to obtain data after first processing, specifically: the original data which does not meet the initial screening condition, namely the normal data, can be returned to the original link, and when the original data is used for intercepting a scene, the original data which meets the initial screening condition in the discarding strategy can be directly discarded, so that the data volume entering the next data management and control step is reduced, of course, the first management and control can also execute a copying action, the original data is returned to the original link, and the copied original data enters the second management and control for monitoring the scene. Meanwhile, in this embodiment, the initial screening condition in the initial management and control policy is set more loosely, that is, the data characteristics set in the initial screening condition are the data characteristics that most of the network data have, that is, most of the network data can both satisfy the initial screening condition, and therefore, a part of the new network data is also managed and controlled.

A second administration may then be performed on the first processed data. According to the data characteristics of the data after the first processing, different data processing is carried out on the data after the first processing by combining with a control strategy used for the second control, and data to be processed are obtained. When the data characteristics of the data to be processed meet the initial screening conditions of the copy policy, the data to be processed is copied into multiple copies, and the number of times of copying depends on the need of performing data management and control analysis with different emphasis points. In addition, in the second data management and control, according to the data after the first processing, the management and control policy corresponding to the satisfied initial screening condition may execute a corresponding management and control action, for example, discard and return to the original link.

Then, a third management and control may be performed on multiple identical pieces of data to be processed, and corresponding management and control actions may be performed according to the data processing policies corresponding to the initial screening conditions that are satisfied by the data to be processed, for example, a management and control action corresponding to a reduction policy may be performed on one piece of data to be processed that satisfies the reduction policy.

The data processing strategy comprises one or more of an acquisition strategy, an association strategy, a reduction strategy, a marking strategy, an early warning strategy, a characteristic output strategy and a discarding strategy.

When the network data needs to be stored, the acquisition strategy can be used for judging whether the data to be processed meets the initial screening condition in the acquisition strategy, and if so, the network data and the corresponding relation between the network data and the executed management and control strategy can be stored in a file form.

When a plurality of pieces of apparently unrelated network data need to be jointly analyzed under a certain specific condition, for example, control plane data and user plane data of a network protocol are jointly analyzed, an association policy may be used to determine whether the data to be processed satisfies an initial screening condition in the association policy, and if so, a plurality of pieces of network data may be jointly analyzed.

When the effective information in the network data needs to be extracted and recovered, for example, the mail is restored, whether the data to be processed meets the initial screening condition in the restoration strategy can be judged by using the restoration strategy, if yes, the restoration operation can be executed on the data to be processed, and the data content is extracted from the network data and is displayed in a human-readable manner.

When a certain piece of network data needs to be specially marked, the marking strategy can be used for judging whether the data to be processed meets the initial screening condition in the marking strategy, and if so, the certain piece of network data can be specially marked, for example, different colors are added to the certain piece of network data.

When the sensitive data needs to be prompted, the early warning strategy can be used for judging whether the data to be processed meets the initial screening condition in the early warning strategy, and if so, warning information can be sent to specific receiving equipment or a user.

To sum up, the embodiment of the application reduces the amount of useless data needing to be managed and analyzed in the next management and control step through the first management and control and the second management and control, so that the management and control analysis on the data needing to be managed and controlled is more comprehensive. Meanwhile, in the second management and control process, the data to be processed can be copied to obtain a plurality of same data to be processed, and in the third management and control process, different initial management and control strategies can be used for performing different management and control analyses on the same data to be processed. Compared with the prior art, when the management and control analysis is performed on a network data, no emphasis is placed, a large number of management and control analysis results are mixed together, and the fine analysis cannot be performed. According to the method and the device, the data to be processed can be isolated, different management and control analysis can be carried out on the same management and control data by using different third management and control strategies, and different management and control analysis data with different emphasis points are obtained, so that the management and control data with different emphasis points are used for carrying out refined analysis, the data can be comprehensively analyzed, guidance is provided for optimization of a network architecture, and prediction of network development is closer to reality.

In some specific embodiments, the above data management and control of the raw data, extracting policy update data satisfying the initial screening condition from the original data, and may further include:

and converting the raw data of different protocols into raw data of a uniform format.

In the embodiment of the application, before the original data is managed and controlled, the original data of different protocols needs to be converted into data of a uniform format, so that the network data can be uniformly managed and controlled in the subsequent data management and control.

Illustratively, the management and control process of the raw data is as follows: in the first data management and control, the original data meeting the initial screening condition may be subjected to the first data management and control to obtain data after the first processing. In the second data management and control, for the data after the first processing that meets the initial screening condition, the corresponding management and control action may be executed according to the corresponding management and control policy, so as to obtain the data to be processed. For the data to be processed meeting the copy strategy, a plurality of copies of the data to be processed can be obtained through copying. In the third data management and control, for a plurality of sets of data to be processed which are the same and meet different initial screening conditions, each set of data to be processed can execute corresponding management and control actions according to different data processing strategies, so that the data become strategy updating data with different emphasis points, and finally, a plurality of sets of strategy updating data with different emphasis points are obtained. In the strategy updating process, feature extraction can be performed on different strategy updating data, the extracted different data features are input into corresponding feature output models, corresponding key data features are output, and the initial management and control strategy can be updated according to the key data features to obtain an updated management and control strategy.

It should be noted that, for simplicity of description, the foregoing method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts, as some steps may, in accordance with the present application, occur in other orders.

Fig. 7 shows a system structure diagram of a data management and control apparatus according to an embodiment of the present application, where the data management and control apparatus 7 is configured on a terminal device, and specifically, the data management and control apparatus 7 may include:

an obtaining unit 701, configured to obtain original data and an initial management and control policy, where the initial management and control policy includes an initial screening condition for screening an initial feature;

a management and control unit 702, configured to perform data management and control on the original data to extract policy update data that meets the initial screening condition from the original data;

a feature output unit 703, configured to use, as a key data feature, a data feature other than the initial feature in the data features of the policy update data;

an updating unit 704, configured to update the initial management and control policy according to the key data feature to obtain an updated management and control policy, where the updated management and control policy is used to perform data management and control on the newly acquired original data.

In some embodiments of the present application, the feature output unit 703 may be further configured to: and inputting the data characteristics of the strategy updating data into the characteristic output model corresponding to the characteristic output strategy to obtain corresponding key data characteristics.

In some embodiments of the present application, the updating unit 704 may further be configured to: and updating the initial screening conditions according to the key data characteristics to obtain an updated management and control strategy.

In some embodiments of the present application, the updating unit 704 may further be configured to: and respectively updating the initial management and control strategy according to each type of key data characteristics to obtain a plurality of updated management and control strategies.

In some embodiments of the present application, the governing unit 702 may further be configured to: and carrying out data management and control on the original data according to different initial screening conditions in sequence to obtain strategy updating data.

In some embodiments of the present application, the governing unit 702 may further be configured to: copying the data to be processed after at least one data control on the original data into a plurality of copies; and respectively carrying out data processing on each part of data to be processed according to different data processing strategies to obtain data processed by different data processing strategies.

In some embodiments of the present application, the governing unit 702 may further be configured to: and converting the raw data of different protocols into raw data of a uniform format.

As shown in fig. 8, for example, the management unit 702 includes:

a first control unit 7021, configured to copy to-be-processed data obtained by performing data control on original data at least once into multiple copies;

and the second control unit 7022 is configured to perform data processing on each to-be-processed data according to different data processing policies, respectively, to obtain data processed by different data processing policies.

The data processing strategy comprises one or more of an acquisition strategy, an association strategy, a reduction strategy, a marking strategy, an early warning strategy, a characteristic output strategy and a discarding strategy;

the data management and control device further comprises:

an obtaining unit 703, configured to obtain original data and an initial management and control policy, where the initial management and control policy includes an initial screening condition for screening an initial feature;

a feature output unit 704 configured to take, as a key data feature, a data feature other than the initial feature in the data features of the policy update data;

the updating unit 705 is configured to update the initial management and control policy according to the key data feature, so as to obtain an updated management and control policy.

The updated management and control strategy is used for carrying out data management and control on the newly acquired original data;

the policy access unit 706 is configured to receive the management and control policy and the acquisition information, and send the management and control policy to the management unit 707;

the management unit 707 is configured to receive a management and control policy, and send the management and control policy to the obtaining unit 703, the first management and control unit 7021, the second management and control unit 7022, the feature output unit 704, the updating unit 705, and the acquiring unit 708;

the acquisition unit 708 is used for acquiring acquisition information generated in the data management and control process;

a message processing unit 709, configured to receive the acquisition information and the updated management and control policy, send the updated management and control policy to the management unit 707, and send the acquisition information and the updated management and control policy to the policy access unit 706 and the database unit 710;

and the database unit 710 is configured to receive the collected information and the updated management and control policy, and store the collected information and the updated management and control policy.

It should be noted that, after the first management and control unit 7021 copies the to-be-processed data, which is obtained by performing data management and control on the original data at least once, into multiple copies, the multiple copies of the to-be-processed data may be sent to different second management and control units 7022 (which may be one or more second management and control units 7022), and different second management and control units 7022 may perform different data management and control on the to-be-processed data by using different data processing policies, so as to obtain data processed by different data processing policies.

It should be noted that, for convenience and simplicity of description, the specific working process of the data management and control device 7 may refer to the corresponding process of the method described in fig. 1 to fig. 3, and is not described herein again.

Fig. 9 is a schematic diagram of a terminal device according to an embodiment of the present application. The terminal device 10 may include: a processor 901, a memory 902, and a computer program 903, such as a data management program, stored in the memory 902 and operable on the processor 901. When the processor 901 executes the computer program 903, the steps in the above embodiments of the data management and control method, such as steps S101 to S104 shown in fig. 1, are implemented. Alternatively, the processor 901 implements the functions of the modules/units in the above device embodiments when executing the computer program 903, for example, the obtaining unit 701, the managing unit 702, the feature output unit 703, and the updating unit 704 shown in fig. 7.

The computer program may be divided into one or more modules/units, which are stored in the memory 902 and executed by the processor 901 to accomplish the present application. The one or more modules/units may be a series of computer program instruction segments capable of performing certain functions, which are used to describe the execution of the computer program in the terminal device.

The terminal device may include, but is not limited to, a processor 901, a memory 902. Those skilled in the art will appreciate that fig. 9 is merely an example of a terminal device and does not constitute a limitation of the terminal device, and may include more or fewer components than those shown, or some components may be combined, or different components, e.g., the terminal device may also include input-output devices, network access devices, buses, etc.

The Processor 901 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The storage 902 may be an internal storage unit of the terminal device, such as a hard disk or a memory of the terminal device. The memory 902 may also be an external storage device of the terminal device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the terminal device. Further, the memory 902 may also include both an internal storage unit and an external storage device of the terminal device. The memory 902 is used for storing the computer programs and other programs and data required by the terminal device. The memory 902 may also be used to temporarily store data that has been output or is to be output.

It should be noted that, for convenience and simplicity of description, the structure of the terminal device may also refer to the detailed description of the structure in the method embodiment, and is not described herein again.

It should be clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional units and modules is only used for illustration, and in practical applications, the above function distribution may be performed by different functional units and modules as needed, that is, the internal structure of the apparatus may be divided into different functional units or modules to perform all or part of the above described functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. For the specific working processes of the units and modules in the system, reference may be made to the corresponding processes in the foregoing method embodiments, which are not described herein again.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one type of logical function division, and other division manners may be available in actual implementation, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer readable storage medium and can realize the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.

The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the embodiments of the present application, and they should be construed as being included in the present application.

Claims

1. A method for data management, the method comprising:

acquiring original data and an initial management and control strategy, wherein the initial management and control strategy comprises initial screening conditions for screening initial features;

performing data management and control on the original data to extract strategy updating data meeting the initial screening condition from the original data;

taking data characteristics, other than the initial characteristics, in the data characteristics of the strategy updating data as key data characteristics;

and updating the initial management and control strategy according to the key data characteristics to obtain an updated management and control strategy, wherein the updated management and control strategy is used for performing data management and control on the newly acquired original data.

2. The data management and control method according to claim 1, wherein the initial management and control policy includes a feature output policy, and the using, as a key data feature, a data feature other than the initial feature among the data features of the policy update data includes:

and inputting the data characteristics of the strategy updating data into a characteristic output model corresponding to the characteristic output strategy to obtain corresponding key data characteristics.

3. The data management and control method according to claim 1, wherein the updating the initial management and control policy according to the key data feature to obtain an updated management and control policy includes:

and updating the initial screening conditions according to the key data characteristics to obtain an updated management and control strategy.

4. The data management and control method according to claim 1, wherein the updating the initial management and control policy according to the key data feature to obtain an updated management and control policy includes:

and updating the initial management and control strategy according to each type of key data characteristics to obtain a plurality of updated management and control strategies, wherein each updated management and control strategy corresponds to one type of key data characteristics.

5. The data management and control method according to claim 1, wherein the performing data management and control on the raw data to extract policy update data that satisfies the initial screening condition from the raw data includes:

and carrying out data management and control on the original data according to different initial screening conditions in sequence to obtain the strategy updating data.

6. The data management and control method according to claim 5, wherein in the process of performing data management and control on the original data sequentially according to different initial screening conditions to obtain the policy update data, the method further includes:

copying the data to be processed after the original data is subjected to at least one data management and control into a plurality of copies;

and respectively carrying out data processing on each part of the data to be processed according to different data processing strategies to obtain data processed by different data processing strategies, wherein the data processing strategies comprise one or more of an acquisition strategy, an association strategy, a reduction strategy, a marking strategy, an early warning strategy, a characteristic output strategy and a discarding strategy.

7. The data management and control method according to any one of claims 1 to 6, before performing data management and control on the original data to extract policy update data that satisfies the initial screening condition from the original data, further comprising:

8. A data management and control device, comprising:

the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring original data and an initial management and control strategy, and the initial management and control strategy comprises initial screening conditions for screening initial features;

the management and control unit is used for performing data management and control on the original data so as to extract strategy updating data meeting the initial screening condition from the original data;

a characteristic output unit, configured to use, as a key data characteristic, a data characteristic other than the initial characteristic in the data characteristics of the policy update data;

and the updating unit is used for updating the initial management and control strategy according to the key data characteristics to obtain an updated management and control strategy, and the updated management and control strategy is used for performing data management and control on the newly acquired original data.

9. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the data governance method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the data management method according to any one of claims 1 to 7.