CN116418893A

CN116418893A - Data management method and corresponding device

Info

Publication number: CN116418893A
Application number: CN202111679430.7A
Authority: CN
Inventors: 井天成
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-12-31
Filing date: 2021-12-31
Publication date: 2023-07-11
Also published as: WO2023125380A1

Abstract

The application discloses a data management method, which is applied to network equipment, wherein the network equipment is switching equipment or a network interface device installed in the switching equipment or a data node, such as: network cards, accelerator cards, etc. The method comprises the following steps: the network device analyzes the service message through the message analysis rule in the acquired data management rule to determine target data associated with the service message, further counts service requests related to the target data, and when the statistical result of the service requests related to the target data meets the response condition, the network device performs corresponding operation on the service message received by the network device and/or on the target data (hot spot data) according to the response policy. According to the scheme, the network equipment is used for managing the hot spot data, so that resource conflict can not be generated between the hot spot data and the service related to the target data, and the probability of overlarge pressure of the service equipment caused by overload access of the hot spot data can be reduced.

Description

Data management method and corresponding device

Technical Field

The present disclosure relates to the field of communication technologies and data storage technologies, and in particular, to a method and a corresponding device for data management.

Background

With the increase of data volume, for service systems such as centralized storage, distributed databases, centralized databases, etc., identification and quick access of some data are all key indicators of service performance, such as: identification and quick access to hotspot data directly affect the user's business experience. In the processing process of file storage and database storage, hierarchical storage can be performed according to the accessed frequency of data, so that the storage cost is reduced on the basis of ensuring the performance.

In a hierarchical scenario, some of the common data may be stored in a cache, which facilitates quick access to the common data. However, if there are a large number of users suddenly needing to access the same data, the traffic is too concentrated, so that many physical resources such as network bandwidth, physical storage space, database connection and the like cannot be supported. The data which are too concentrated in access cannot be quickly identified at present, and service operation is affected.

Disclosure of Invention

The application provides a data management method for quickly identifying target data in a network and performing corresponding operation. The embodiment of the application also provides a corresponding device, a computer readable storage medium, a computer program product and the like.

A first aspect of the present application provides a method of data management, the method being applied to a network device, the network device being a switching device or a network interface apparatus installed in a switching device or a data node, the method comprising: the network equipment acquires a data management rule, wherein the data management rule comprises a message analysis rule, a response condition and a response strategy; the network equipment analyzes the service message from the client according to the message analysis rule to determine target data associated with the service message, wherein the target data is application layer data; the network equipment counts service requests related to the target data, and the service requests are obtained from service messages; when the statistical result of the service request related to the target data meets the response condition, the network equipment performs corresponding operation on the service message received by the network equipment and/or the target data according to the response strategy.

In this application, the data system in which the network device is located may be a distributed system or a centralized system, which may include a distributed database service system, and a centralized system may include a centralized database service system, as well as other systems involving underlying storage.

In this application, the switching device may be a device for implementing data forwarding in a network, such as a switch, a router, or a gateway device, for example: storage area network (storage area network, SAN) switches, ethernet switches, fabric switches or other physical switching devices, as well as virtual switches. The data nodes may be physical machines, virtual Machines (VMs), or other forms of resources for data storage. The network interface device may be a network card, accelerator card, data processing unit (data processing unit, DPU) or a network interface, such as: and a switch interface. The client may be a terminal device or an application installed on a terminal device.

In the present application, the data management rule may be preconfigured on the network device, or may be received from a rule management device or a service server related to the target data.

In this application, a service packet refers to a packet of data related to a service. The traffic messages may be transmitted in the network using transmission control protocol/internet protocol (Transmission Control Protocol/Internet Protocol, TCP/IP), remote direct memory access (remote direct memory access, RDMA) protocol, or other communication protocol.

In the application, the target data associated with the service message can be directly analyzed from the service message, or can be searched according to the identification (such as index information or address information of the target data) analyzed from the service message.

In this application, a service request related to target data refers to a request for performing a read operation or a write operation on the target data, and the type of the service request may be parsed from a service packet.

In the present application, the message parsing rule refers to a rule for parsing a service message, and may be: the first step needs to analyze the content, the second step needs to analyze the content, etc., the message analysis rule can specify the field needing to analyze.

In the present application, the response condition refers to a condition that needs to be satisfied to trigger the response policy to take effect.

In this application, a response policy refers to a quality of service (quality of service, qos) adjustment policy or a resource adjustment policy made for a service packet or target data.

It should be noted that, the quality of service in the embodiments of the present application refers to network quality of service.

As can be seen from the above first aspect, the network device can identify and process the target data, which does not occupy the resources of the service server for providing the service related to the target data, and does not generate resource conflict with the service related to the target data, and the network device can identify and then perform corresponding operation in advance when the service request related to the target data is transmitted in the network, so that the probability of causing excessive pressure of the service server due to overload access to the target data can be reduced.

In a possible implementation manner of the first aspect, the response condition includes a statistical rule and a response relation; the statistical rule comprises statistical duration, and the response relation comprises the relation that the number of business requests counted according to the statistical duration and the target threshold value should be met. The statistics of the service request related to the target data include: the number of service requests associated with the target data is within the statistical duration.

In another possible implementation manner of the first aspect, the statistical result meeting the response condition includes: according to the indication of the response relation, the number of service requests related to the target data exceeds a target threshold value in the statistical duration, and if the number exceeds the target threshold value and the target data is not the existing hot spot data, the target data is indicated to be the newly generated hot spot data; alternatively, the statistical result satisfying the response condition includes: and according to the indication of the response relation, indicating that the number of service requests related to the target data is lower than the target threshold value in the statistical duration, and if the number is lower than the target threshold value and the target data is the existing hot spot data, indicating that the hot spot attribute of the target data disappears.

In this application, the statistical duration refers to a time length for counting service requests, such as: 1 minute, 2 minutes, 5 minutes, or other values. The response relationship refers to a relationship between the number of service requests counted according to the statistical duration and a target threshold (for example, the number exceeds the target threshold or is lower than the target threshold, it is to be noted that only one relationship exists in one response relationship, and the relationship is either greater than the target threshold or smaller than the target threshold). When the response relationship is greater than the target threshold, for example, such as: the statistical duration is 1 minute, the target threshold is 1 ten thousand times, and if the statistical result is that the number of business requests related to the target data counted for one minute is 1.2 ten thousand times and the target data is not the existing hot spot data, the statistical result satisfies the response condition. When the response relation is less than the target threshold value as an example, if the statistical result is that the number of service requests related to the target data counted for one minute is 0.7 ten thousand times, when the target data is the existing hot spot data, it is indicated that the statistical result also satisfies the response condition.

In the present application, the process of generating the hot spot data or eliminating the hot spot data may be counted, if it is counted that the service request for the target data which is not the hot spot data in one minute exceeds the target threshold, the process may be understood as the process of generating the hot spot data, and if the service request for the target data which is the hot spot data in one minute is counted to be lower than the target threshold, the process of eliminating the hot spot data may be understood as the process of eliminating the hot spot data. Of course, the target thresholds in the response relationship used for hotspot data generation and hotspot data disappearance may be different.

In this application, hotspot data refers to data with an activity amount exceeding a certain threshold for a period of time, such as: the data with more times such as being accessed, clicked, browsed, focused and downloaded can be various data such as hot selling goods, hot news, hot application, hot programs, node music and the like.

In this application, statistical hotspot data may be used, for example: least recently used (least recently used, LRU), least recently used (least frequently used, LFU), and first-in-first-out (first in first out, FIFO), among other algorithms.

In the possible implementation manner, the network device can quickly identify and process the hot spot data, does not occupy the resources of the service server for providing the service related to the target data and does not generate resource conflict with the service related to the target data, and moreover, the network device can identify and then perform corresponding operation in advance when the hot spot data is transmitted in the network, so that the probability of overlarge pressure of the service server caused by overload access of the hot spot data can be reduced.

In a possible implementation manner of the first aspect, the response condition includes a plurality of sets of statistical rules and response relations, statistical durations in different statistical rules are different, and target thresholds in response relations corresponding to different statistical rules are different; different adjustment strategies in response strategies corresponding to different statistical rules.

In this application, the statistical duration included in the statistical rule and the target threshold in the response relationship are generally corresponding. Such as: the statistical time period is 1 minute, the target threshold value is 10000 times, the statistical time period is 2 minutes, the target threshold value is 20000 times, the statistical time period is 5 minutes, and the target threshold value is 50000 times. Of course, this is merely an example, and in practice, the relationship between the statistical time durations in the different statistical rules and the target threshold in the corresponding response relationship is not necessarily proportionally varied. Although only the statistical rule is described herein as including the statistical duration, in practice, other parameters may be included in the statistical rule, such as: the identification of the statistical object may be, for example, a service address of the service corresponding to the target data, for example: the address of the device where the target data is located, the virtual interface address of the VM, or other information that may represent the service address, for example, a key value (key) of redis, or url address of video, index of file, etc. When different response conditions are adopted for data on different devices, the identification of the statistical object can be set in the statistical rule, and if: the same set of response conditions are adopted for all data, and the identification of the statistical object is not required to be set.

In the possible implementation manner, by configuring a plurality of groups of statistical rules and response relations in the response conditions, different adjustment strategies can be effectively started, so that the adjusted resources for processing the target data are more matched with the access quantity of the current client to the target data, the problem of service overload or downtime caused by insufficient resources can be avoided, and the utilization rate of the resources can be improved.

In a possible implementation manner of the first aspect, the response policy includes: a service quality adjustment strategy for the service message of the target priority and an adjustment strategy for expanding or shrinking the resources of the target data are carried out; wherein the target priority is included in the response policy.

In a possible implementation manner of the first aspect, the steps are as follows: the network device performs corresponding operations on the service message received by the network device and/or on the target data according to the response strategy, and the method comprises the following steps: when the target data is newly generated hot spot data, the network equipment reduces the service quality of the service message with the target priority according to the service quality adjustment strategy, and/or performs the operation of expanding the resources on the target data according to the adjustment strategy of expanding the resources; when the hot spot attribute of the target data disappears, the network equipment increases the service quality of the service message of the target service priority according to the service quality adjustment strategy, and/or performs the operation of reducing the capacity of the resource on the target data according to the adjustment strategy of the capacity of the resource.

In the application, the network device can receive service messages with different priorities, when hot spot data is generated, in order to avoid the impact of the hot spot data on the service with high priority, the service messages with high priority can be processed preferentially, and in order to ensure the processing of the service messages with high priority, the service quality of the service messages with target priority can be reduced according to the target priority specified in the response strategy (such as reducing the bandwidth, the time delay or the packet loss rate of the service messages with target priority). And/or, performing resource expansion for the hot spot data, namely adding the resources of the hot spot data, so that the impact of the hot spot data on high-priority service can be relieved.

In the present application, the resources for expansion or contraction of hotspot data include network resources, computing resources, storage resources, and the like.

In the application, when the hotspot data disappear, the hotspot data disappear to indicate that the resources occupied by the hotspot data are emptied before, and at this time, the service quality of the service messages with the target priority can be improved, so that the service messages with the target priority can be better processed. And/or, the resource capacity is reduced for the hot spot data, namely, the resource of the hot spot data is reduced, so that the utilization rate of the resource can be improved.

In a possible implementation manner of the first aspect, the steps are as follows: the network device analyzes the service message from the client according to the message analysis rule to determine the target data associated with the service message, and the method comprises the following steps: the network equipment analyzes the five-tuple of the service message according to the message analysis rule to determine the service type of the service message; the network device analyzes the indication field according to the message analysis rule to determine the target data of the service type or the index information of the target data, wherein the index information is used for determining the target data.

In the present application, the five-tuple includes a destination address, through which the service type of the service packet can be determined, for example: the destination address may be an IP address of a game server, an IP address of a video server, an IP address of a music server, an IP address of an e-commerce server, etc. The indication field in the service message may be located in a message header or a message payload, where the indication field may be index information of certain target data, and the index information may be a specific address of the target data, or a name or an identifier of the target data, etc.

In a possible implementation manner of the first aspect, when the response policy indicates that an adjustment policy of resource expansion or resource contraction is performed by a control node for managing the data node; the steps are as follows: the operation of expanding the resources of the target data according to the adjustment strategy of expanding the resources comprises the following steps: the network equipment sends a capacity expansion notification to the control node, wherein the capacity expansion notification is used for indicating the control node to perform resource capacity expansion for target data; alternatively, the steps described above: the operation of carrying out resource capacity reduction on the target data according to the adjustment strategy of the resource capacity reduction comprises the following steps: the network device sends a capacity shrinking notification to the control node, wherein the capacity shrinking notification is used for indicating the control node to shrink the capacity of the resource for the target data.

In this possible implementation manner, the control node refers to a device that globally manages resources in a system where the network device is located, and the control node may perform resource expansion on the target data according to the received expansion notification, and may perform resource expansion on the target data according to the received expansion notification, because the control node coordinates resources of the entire system, and may perform better resource expansion or resource expansion on the target data.

In a possible implementation manner of the first aspect, the data node further comprises a first control device; executing an adjustment strategy of resource capacity expansion or resource capacity reduction by the first control device when the response strategy indicates; the steps are as follows: the operation of expanding the resources of the target data according to the adjustment strategy of expanding the resources comprises the following steps: the network equipment sends a capacity expansion notification to the first control device, wherein the capacity expansion notification is used for indicating the first control device to perform resource capacity expansion for target data; alternatively, the steps described above: the operation of carrying out resource capacity reduction on the target data according to the adjustment strategy of the resource capacity reduction comprises the following steps: the network equipment sends a capacity reduction notification to the first control device, wherein the capacity reduction notification is used for indicating the first control device to carry out resource capacity reduction for the target data.

In this possible implementation manner, the first control device in the data node completes the process of expanding the resource or shrinking the resource of the target data.

In a possible implementation manner of the first aspect, the network device is a network interface device installed on the switching device; the switching device further comprises a second control device, when the response strategy indicates that the control device executes the adjustment strategy of the resource capacity expansion or the resource capacity contraction; the steps are as follows: the operation of expanding the resources of the target data according to the adjustment strategy of expanding the resources comprises the following steps: the network interface device sends a capacity expansion notification to the second control device, wherein the capacity expansion notification is used for indicating the second control device to perform resource capacity expansion for the target data; alternatively, the steps described above: the operation of carrying out resource capacity reduction on the target data according to the adjustment strategy of the resource capacity reduction comprises the following steps: the network interface device sends a capacity reduction notification to the second control device, wherein the capacity reduction notification is used for instructing the second control device to carry out resource capacity reduction for the target data.

In the possible implementation manner, the second control device on the switching device completes the process of expanding or shrinking the resources of the target data, so that control nodes in the system are not required to be configured, and the network structure is simplified.

In a possible implementation manner of the first aspect, the steps are as follows: the network device obtains a data management rule, including: the network device acquires the data management rule from a service server or rule management means, the service server being a server associated with the target data.

A second aspect of the present application provides a network device having functionality to implement the method of the first aspect or any one of the possible implementations of the first aspect. The functions can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above, such as: the device comprises an acquisition unit, a first processing unit, a second processing unit and an operation unit, wherein the first processing unit and the second processing unit can also be realized by one processing unit.

A third aspect of the present application provides a network device comprising at least one processor, a memory, an input/output (I/O) interface, and computer-executable instructions stored in the memory and executable on the processor, the processor performing the method according to the first aspect or any one of the possible implementations of the first aspect when the network device-executable instructions are executed by the processor.

A fourth aspect of the present application provides a computer-readable storage medium storing one or more computer-executable instructions which, when executed by a processor, perform a method as described above or any one of the possible implementations of the first aspect.

A fifth aspect of the present application provides a computer program product storing one or more computer-executable instructions which, when executed by one or more processors, perform a method as described above in the first aspect or any one of the possible implementations of the first aspect.

A sixth aspect of the present application provides a network card, where the network card includes an input interface, an output interface and at least one processor, where the input interface is configured to receive a service packet, the at least one processor is configured to support the network card to implement a function related to the first aspect or any one of possible implementations of the first aspect, and the output interface is configured to send a capacity expansion notification or a capacity contraction notification. In one possible design, the network card may also include memory, storage for program instructions and data necessary for the network device.

Drawings

FIG. 1 is a schematic diagram of a distributed system according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a centralized system according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of an embodiment of a method for data management according to an embodiment of the present application;

FIG. 4 is a schematic diagram of another embodiment of a method of data management provided by an embodiment of the present application;

fig. 5 is a schematic structural diagram of a service packet according to an embodiment of the present application;

FIG. 6 is a schematic diagram of another embodiment of a method of data management provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of another embodiment of a method of data management provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of another embodiment of a method of data management provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of another embodiment of a method of data management provided by an embodiment of the present application;

fig. 10 is another schematic structural diagram of a service packet provided in an embodiment of the present application;

fig. 11 is a schematic structural diagram of a network device according to an embodiment of the present application;

fig. 12 is another schematic structural diagram of a network device according to an embodiment of the present application.

Detailed Description

Embodiments of the present application will now be described with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some, but not all embodiments of the present application. As a person of ordinary skill in the art can know, with the development of technology and the appearance of new scenes, the technical solutions provided in the embodiments of the present application are applicable to similar technical problems.

The terms first, second and the like in the description and in the claims of the present application and in the above-described figures, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be implemented in other sequences than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiment of the application provides a data management method which is used for quickly identifying target data in a network and performing corresponding operation. The embodiment of the application also provides a corresponding device, a computer readable storage medium, a computer program product and the like. The following will describe in detail.

The method provided by the embodiment of the application can be implemented on a network device, and the data system where the network device is located can be a distributed system or a centralized system, and the distributed system can include a distributed database service system, and the centralized system can include a centralized database service system and other systems related to underlying storage.

Fig. 1 is a schematic view of a distributed system according to an embodiment of the present application.

As shown in fig. 1, in the scenario of the distributed system provided in the embodiment of the present application, a client may access the distributed system through a network, where the distributed system includes a service entry node, a switching device, a control node, and a plurality of data nodes. Wherein the service ingress node is communicatively coupled to the switching device, and the switching device is communicatively coupled to the control node and each of the data nodes. It should be noted that, the distributed system may not include a control node, and the function of the control node is implemented by the switching device.

The service entry node corresponds to an interface for connecting a network of clients with the distributed system, and a plurality of switching devices (only one switching device is shown in fig. 1) can be connected below one service entry node. The service entry node may implement load balancing for each switching device. The data nodes may communicate with the control node via a switching device, and the control node may also send messages to each data node via the switching device.

A service message refers to a message of data related to a service. The traffic messages may be transmitted in the network using transmission control protocol/internet protocol (Transmission Control Protocol/Internet Protocol, TCP/IP), remote direct memory access (remote direct memory access, RDMA) protocol, or other communication protocol.

The switching device may be a device for implementing data forwarding in a network, such as a switch, a router or a gateway device, for example: storage area network (storage area network, SAN) switches, ethernet switches, fabric switches, or other physical switching devices, may also be virtual devices such as: virtual switches.

The data nodes may be physical machines, virtual Machines (VMs), or other forms of resources for data storage, such as: data storage (data storage) or non-volatile memory, including but not limited to solid state disks (solid state drives, SSDs), disk arrays, or other types of non-transitory computer readable media, may also include conventional dynamic random access memory (dynamic random access memory, DRAM) and new persistent memory (persistent memory, PMem). Nonvolatile memory includes semiconductor memory devices such as erasable programmable read-only memory (erasable programmable read only memory, EPROM), electrically erasable read-only memory (electrically erasable programmable read only memory, EEPROM) and flash memory (flash memory); magnetic disks, such as internal hard disks (internal hard disk) or removable disks (removable disks), magneto-optical disks (magneto optical disk), and CD-ROMs and DVD-ROMs.

The control node may be a physical machine or a virtual machine for managing global resources in the distributed system, including computing resources, storage resources, network resources, and the like.

The client may be a terminal device or an application installed on a terminal device. A terminal device (also referred to as a User Equipment (UE)) is a device with a wireless transceiving function, which may be deployed on land, including indoor or outdoor, handheld or vehicle-mounted; can also be deployed on the water surface (such as ships, etc.); but may also be deployed in the air (e.g., on aircraft, balloon, satellite, etc.). The terminal may be a mobile phone, a tablet (pad), a computer with wireless transceiving function, a Virtual Reality (VR) terminal, an augmented reality (augmented reality, AR) terminal, a wireless terminal in industrial control (industrial control), a wireless terminal in unmanned driving (self driving), an autopilot device, a wireless terminal in remote medical (remote medical), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation security (transportation safety), a wireless terminal in smart city (smart city), a wireless terminal in smart home (smart home), etc.

Fig. 2 is a schematic diagram of a scenario of a centralized system according to an embodiment of the present application.

As shown in fig. 2, in the scenario of the centralized system provided in the embodiment of the present application, a client may access the centralized system through a network, where the centralized system includes a plurality of centralized services, where each centralized service includes a service entry node and a data node, and the data node manages computing resources, storage resources, network resources, and the like in the centralized service.

The service entry node corresponds to an interface between a network connecting the client and the centralized system, and is configured to receive a service packet from the client and transmit the service packet to a corresponding data node.

In the above, the structure of the distributed system and the centralized system is described, and the method for data management provided in the embodiment of the present application may be applied to the distributed system shown in fig. 1 and the centralized system shown in fig. 2. The following describes a method for data management according to an embodiment of the present application with reference to the accompanying drawings. The method of data management is applied to a network device, which may be a switching device in the above-described distributed system or centralized system or a network interface apparatus installed in the switching device or the data node.

The network interface device may be a network card, an accelerator card, a data processing unit (data processing unit, DPU) or a network interface, such as: and a switch interface.

As shown in fig. 3, an embodiment of a method for data management provided in an embodiment of the present application includes:

101. the network device acquires a data management rule, wherein the data management rule comprises a message analysis rule, a response condition and a response policy.

The data management rule may be preconfigured on the network device or may be received from a rule management apparatus or a service server associated with the target data, the service server being a server associated with the target data.

The message parsing rule refers to a rule for parsing a service message, and may be: the first step needs to analyze the content, the second step needs to analyze the content, etc., the message analysis rule can specify the field needing to analyze.

The response condition refers to a condition to be satisfied for triggering the response policy to take effect.

The response policy refers to a quality of service (quality of service, qos) adjustment policy or a resource adjustment policy made for the traffic message or the target data.

102. And the network equipment analyzes the service message from the client according to the message analysis rule to determine target data associated with the service message, wherein the target data is application layer data.

The target data associated with the service message can be directly analyzed from the service message, or can be searched according to the identification (such as index information or address information of the target data) analyzed from the service message.

This step 102 may include: the network equipment analyzes the five-tuple of the service message according to the message analysis rule to determine the service type of the service message; the network device analyzes the indication field according to the message analysis rule to determine the target data of the service type or the index information of the target data, wherein the index information is used for determining the target data.

The five-tuple includes a destination address, and the service type of the service message can be determined through the destination address, for example: the destination address may be an IP address of a game server, an IP address of a video server, an IP address of a music server, an IP address of an e-commerce server, etc. The indication field in the service message may be located in a message header or a message payload, where the indication field may be index information of certain target data, and the index information may be a specific address of the target data, or a name or an identifier of the target data, etc.

103. The network device counts service requests associated with the target data, the service requests being derived from the service messages.

The service request related to the target data refers to a request for performing a read operation or a write operation on the target data, etc., and the type of the service request can be parsed from the service message.

104. When the statistical result of the service request related to the target data meets the response condition, the network equipment performs corresponding operation on the service message received by the network equipment and/or the target data according to the response strategy.

In the embodiment of the application, the network equipment can identify and process the target data, does not occupy the resources of the service server for providing the service related to the target data and does not generate resource conflict with the service related to the target data, and moreover, the network equipment can identify in advance and then perform corresponding operation when the service request related to the target data is transmitted in the network, so that the probability of overlarge pressure of the service server caused by overload access of the target data can be reduced.

Optionally, in an embodiment of the present application, the response condition includes a statistical rule and a response relationship; the statistical rule comprises statistical duration, and the response relation comprises the relation that the number of business requests counted according to the statistical duration and the target threshold value should be met.

The statistics of the service request related to the target data include: the number of service requests associated with the target data is within the statistical duration.

The statistical result meeting the response condition includes: according to the indication of the response relation, the number of service requests related to the target data exceeds a target threshold value in the statistical duration, and if the number exceeds the target threshold value and the target data is not the existing hot spot data, the target data is indicated to be the newly generated hot spot data; alternatively, the statistical result satisfying the response condition includes: and according to the indication of the response relation, indicating that the number of service requests related to the target data is lower than the target threshold value in the statistical duration, and if the number is lower than the target threshold value and the target data is the existing hot spot data, indicating that the hot spot attribute of the target data disappears.

Wherein, the statistical duration refers to a time length for counting the service request, such as: 1 minute, 2 minutes, 5 minutes, or other values.

The response relationship refers to a relationship between the number of service requests counted according to the statistical duration and a target threshold (for example, the number exceeds the target threshold or is lower than the target threshold, it is to be noted that only one relationship exists in one response relationship, and the relationship is either greater than the target threshold or smaller than the target threshold). When the response relationship is exemplified as being greater than the target threshold, such as: the statistical duration is 1 minute, the target threshold is 1 ten thousand times, and if the statistical result is that the number of business requests related to the target data counted for one minute is 1.2 ten thousand times and the target data is not the existing hot spot data, the statistical result satisfies the response condition. When the response relation is exemplified by less than the target threshold, if the statistics result is that the number of service requests related to the target data counted for one minute is 0.7 ten thousand times, when the target data is the existing hot spot data, it is indicated that the statistics result also satisfies the response condition.

A record table of hotspot data may be maintained on the network device, in which data information that has become hotspot data is marked.

In this embodiment of the present application, the relationship between the statistical rule, the response relationship, the statistical result, and whether the statistical result satisfies the response condition may be understood by referring to table 1 below in conjunction with the above example.

Table 1:

as can be seen from table 1 above, the response relationship may be different although the statistical time periods are the same, and whether the response condition is satisfied needs to be considered as to whether the target data is the existing hotspot data. The statistical rules may be marked as rules that are used for existing hotspot data or rules that are used for hotspot data that are not already present. Also, table 1 is only an exemplary illustration, and in fact, in a scene where hot spot data disappears, the statistical duration may be set to be larger than a scene where hot spot data is generated, for example: the statistical duration of the scene generated by the hot spot data is set to be 1 minute, and the statistical duration of the scene where the hot spot data disappears is set to be 3 minutes or 5 minutes, however, the specific value is not limited in the embodiment of the present application. In addition, a detection period can be set for a scene where the hot spot data disappears, and the service request of the hot spot data is continuously detected to be reduced in several periods, so that the data is subjected to resource capacity reduction processing or other adjustment in terms of service quality.

In this embodiment of the present application, a process of generating hot spot data or eliminating hot spot data may be counted, if it is counted that a service request for one minute of target data that is not hot spot data exceeds a target threshold, the process may be understood as a process of generating hot spot data, and if it is counted that a service request for one minute of target data that is hot spot data is less than a target threshold, the process of eliminating hot spot data may be understood as a process of eliminating hot spot data. Of course, the target thresholds in the response relationship used for hotspot data generation and hotspot data disappearance may be different.

In this embodiment of the present application, hotspot data refers to data with an activity amount exceeding a certain threshold for a period of time, for example: the data with more times such as being accessed, clicked, browsed, focused and downloaded can be various data such as hot selling goods, hot news, hot application, hot programs, node music and the like. Statistical hotspot data may be employed, for example: least recently used (least recently used, LRU), least recently used (least frequently used, LFU), and first-in-first-out (first in first out, FIFO), among other algorithms.

Optionally, in the embodiment of the present application, the response condition includes a plurality of sets of statistical rules and response relationships, statistical durations in different statistical rules are different, and target thresholds in response relationships corresponding to different statistical rules are different; different adjustment strategies in response strategies corresponding to different statistical rules.

In the embodiment of the present application, the statistical duration included in the statistical rule and the target threshold in the response relationship are generally corresponding. Such as: the statistical time period is 1 minute, the target threshold value is 10000 times, the statistical time period is 2 minutes, the target threshold value is 20000 times, the statistical time period is 5 minutes, and the target threshold value is 50000 times. Of course, this is merely an example, and in practice, the relationship between the statistical time durations in the different statistical rules and the target threshold in the corresponding response relationship is not necessarily proportionally varied. Although only the statistical rule is described herein as including the statistical duration, in practice, other parameters may be included in the statistical rule, such as: the identification of the statistical object may be, for example, a service address of the service corresponding to the target data, for example: the address of the device where the target data is located, the virtual interface address of the VM, or other information that may represent the service address, for example, a key value (key) of redis, or url address of video, index of file, etc. When different response conditions are adopted for data on different devices, the identification of the statistical object can be set in the statistical rule, and if: the same set of response conditions are adopted for all data, and the identification of the statistical object is not required to be set.

According to the method and the device for processing the target data, different adjustment strategies can be effectively started by configuring a plurality of groups of statistical rules and response relations in the response conditions, so that the adjusted resources for processing the target data are more matched with the access quantity of the current client to the target data, and the utilization rate of the resources is improved.

Optionally, in an embodiment of the present application, the response policy includes: a service quality adjustment strategy for the service message of the target priority and an adjustment strategy for expanding or shrinking the resources of the target data are carried out; wherein the target priority is included in the response policy.

In connection with this response strategy, the above step 104 may include two cases, one is a process procedure when the hotspot data is generated, and one is a process procedure when the hotspot data is disappeared, which will be described below.

1. Hot spot data is generated.

When the target data is newly generated hot spot data, the network equipment reduces the service quality of the service message with the target priority according to the service quality adjustment strategy, and/or performs the operation of expanding the resources on the target data according to the adjustment strategy of expanding the resources;

in the embodiment of the application, the network device may receive service messages with different priorities, and when hot spot data is generated, in order to avoid impact of the hot spot data on the service with high priority, the service messages with high priority may be processed preferentially, and in order to process the service messages with guaranteed high priority, the service quality of the service messages with target priority may be reduced according to the target priority specified in the response policy (e.g. bandwidth, delay or packet loss rate of the service messages with target priority are reduced). And/or, performing resource expansion for the hot spot data, namely adding the resources of the hot spot data, so that the impact of the hot spot data on high-priority service can be relieved.

In this embodiment of the present application, the resources for expansion or contraction of hotspot data include network resources, computing resources, storage resources, and the like.

2. The hotspot data vanishes.

When the hot spot attribute of the target data disappears, the network equipment increases the service quality of the service message of the target service priority according to the service quality adjustment strategy, and/or performs the operation of reducing the capacity of the resource on the target data according to the adjustment strategy of the capacity of the resource.

In the embodiment of the present application, when the hotspot data disappears, the hotspot data disappears to indicate that the resources occupied by the hotspot data are emptied before, so that the service quality of the service messages with the target priority can be improved, which is favorable for better processing the service messages with the target priority. And/or, the resource capacity is reduced for the hot spot data, namely, the resource of the hot spot data is reduced, so that the utilization rate of the resource can be improved.

Above, when a plurality of sets of statistical rules and response relations are included in the response condition, the statistical rules of different sets may correspond to adjustment policies in different response policies, and the correspondence relation may be understood with reference to the example in table 2 below.

Table 2:

as can be seen from the examples of table 2, the response policies performed are different when the number of service requests counted by different statistical durations exceeds the corresponding target threshold. Of course, the contents in table 1 are only examples, and only provide an idea that different statistical rules correspond to different response strategies, and other implementations within the idea can be understood as schemes of the present application.

It should be noted that, in the above table 2, when the resource expansion or the resource contraction is performed, different statistical rules may also perform the resource expansion or the resource contraction according to different specifications, for example: the statistical duration is 2 minutes, when the resource expansion is executed, 1 data node can be added for processing the hot spot data, the statistical duration is 5 minutes, and when the resource expansion is executed, 2 data nodes can be added for processing the hot spot data, however, only an idea is provided herein, and the specification of specific resource expansion or resource contraction is not limited in the application.

In addition, in the embodiment of the present application, the management process of the target data is slightly different in different scenes, and the management process of the target data in each scene is described below.

In the scenario of the distributed system shown in fig. 1, the network device may be a switching device or a network interface device installed on a switching device or a data node, and fig. 4 is described by taking an example that the network device is installed on a network card on the data node, as shown in fig. 4, another embodiment of a method for data management provided in an embodiment of the present application includes:

201. the network card receives the service message from the client.

The network card has previously acquired the data management rule described earlier, as shown in fig. 4, from the rule management means.

202. And the network card analyzes the service message from the client according to the message analysis rule so as to determine the target data associated with the service message.

The message parsing process may be understood with reference to fig. 5, as shown in fig. 5, where a service message includes a Header (Eth Header, IP Header, and TCP Header), and a message payload (RESP payload) portion, the Header may be parsed according to a message parsing rule, a destination address of data requested by the service message may be determined according to an IP address, and then the message payload portion may be parsed, and it may be determined that the message payload portion includes a read request for target data, and index information of the target data, and the target data may be obtained from a server of the IP address according to the index information.

203. And the network card counts the service requests related to the target data according to the statistical time length in the statistical rule.

When the target data is not recorded in the hot spot data record table, the target data is not hot spot data, and then a response condition which is not the hot spot data or a statistical rule and a corresponding response relation of the hot spot data can be selected. And counting the number of service requests related to the target data in the counting time period, and when the number is larger than the target threshold value, indicating that the target data is newly generated hot spot data.

When the target data is recorded in the hot spot data record table, the target data is the hot spot data, and then the response condition of the hot spot data or the statistical rule and the corresponding response relation of the hot spot data can be selected. And then counting the number of service requests related to the target data in the counting time period, and when the data is smaller than the target threshold value, indicating that the hot spot attribute of the target data has disappeared.

204. When the statistical result of the service request related to the target data meets the response condition, the network card reduces the service quality of the service message with the target priority, or the network card increases the service quality of the service message with the target priority.

Aiming at the newly generated hot spot data, the network card can lower the service quality of the service message with the target priority. Aiming at the target data with the disappeared hot spot attribute, the network card can increase the service quality of the service message with the target priority.

205. The network card sends the capacity expansion notification or the capacity contraction notification to the control node through the switching equipment.

The capacity expansion notification is used for indicating the control node to perform resource capacity expansion for the target data.

The capacity reduction notification is used for indicating the control node to carry out resource capacity reduction for the target data.

If the scene of the hot spot data is generated, the network card sends a capacity expansion notification, and if the scene of the hot spot data is disappeared, the network card sends a capacity contraction notification.

206. And the control node performs resource capacity expansion according to the capacity expansion notification as target data, or performs resource capacity reduction according to the capacity reduction notification as target data.

The resource expansion process may be that the control node sends a notification to a certain data node, indicating that the data node also serves as a node for processing the target data.

The process of resource scaling may be that the control node sends a notification to a certain data node indicating that the data node is no longer a node for processing the target data.

Because the control node coordinates the resources of the whole network, better resource expansion or resource contraction can be made for the target data.

The process of implementing the above hotspot data management using the network card on the data node as the network device is described above in connection with fig. 4, and when the network device is a network interface device on the switching device, the above process can be understood with reference to fig. 6.

In the context of a distributed system, the management of hot spot data when the network device is a network interface on a switching device, such as a switch interface, is described below in connection with fig. 6.

As shown in fig. 6, another embodiment of a method for data management provided in an embodiment of the present application includes:

301. a network interface on the switching device receives the service message from the client.

302. And the network interface analyzes the service message from the client according to the message analysis rule so as to determine the target data associated with the service message.

303. The network interface counts the service requests related to the target data according to the statistical time length in the statistical rule.

304. When the statistical result of the service request related to the target data meets the response condition, the network interface reduces the service quality of the service message with the target priority or the network interface increases the service quality of the service message with the target priority.

305. The network interface sends a capacity expansion notification or a capacity contraction notification to the control node.

306. And the control node performs resource capacity expansion according to the capacity expansion notification as target data, or performs resource capacity reduction according to the capacity reduction notification as target data.

The above explanation of the steps performed by the network interface in fig. 6 may be understood with reference to the explanation of the steps 201 to 206 in fig. 4, and the description will not be repeated here.

The process of implementing the above-described management of hotspot data by using a network interface on a switching device as a network device is described above in connection with fig. 6, and when the network device is a switching device, the process is the same as the process of fig. 6, and can be understood with reference to the process of fig. 6.

The scheme described in fig. 6 above is a process of implementing the expansion or contraction of the resources by the control node when the network device is a network interface of the switching device. Alternatively, a control device may be installed on the switching device, and the process of expanding the resource or shrinking the resource may be implemented by the control device, and the process of this scenario may be understood with reference to fig. 7.

As shown in fig. 7, steps 401 to 404 of the scenario can be understood with reference to steps 301 to 304 of the fig. 6 part, unlike fig. 6, steps 405 and 406.

405. The network interface transmits the capacity expansion notification or the capacity contraction notification to the control device.

406. The control device performs resource capacity expansion according to the capacity expansion notification as target data, or performs resource capacity reduction according to the capacity reduction notification as target data.

The control means in the distributed scenario may also be referred to as second control means.

The specific implementation of step 406 may be understood with reference to the corresponding description in step 206 above.

The above describes the process of managing hot spot data when the network device in the distributed system is a network card on a data node, a network interface on a switching device, and the following describes the process of managing hot spot data in a scenario of a centralized system with reference to the accompanying drawings.

As shown in fig. 8, in the scenario of a centralized system, the network device is a network interface device installed on a data node, and the data node further includes a control device.

As shown in fig. 8, another embodiment of a method for data management provided in an embodiment of the present application includes:

steps 501 to 504 in this embodiment can be understood by referring to steps 201 to 204 in fig. 4, except for steps 505 and 506.

505. The network card sends a capacity expansion notification or a capacity contraction notification to the control device.

506. The control device performs resource capacity expansion according to the capacity expansion notification as target data, or performs resource capacity reduction according to the capacity reduction notification as target data.

The control means in the centralized scenario may also be referred to as first control means.

In the centralized system, the amount of resources of each data node is usually very large, and the resources of idle resources or services on the data node can be adjusted to serve the hot spot data, or the idle resources generated by the disappearance of the hot spot data can be recovered.

The scheme provided by the embodiment of the application can also be applied to a Redis service scene, and an application process in the Redis service scene can be understood by referring to FIG. 9, and as shown in FIG. 9, in the Redis service scene, a Redis cluster comprises a service entry node, a service proxy node (one of which can be selected as a control node) and a Redis data node. The service entry node is mainly responsible for the distribution processing of the service, the service proxy node is mainly responsible for the management of service links and data caching, and the Redis data node mainly provides data read-write service.

In the Redis cluster, taking a video scene as an example, data of a video A, data of a video B and data of a video C are respectively distributed in three Redis data nodes, and each Redis data node executes a data identification and statistics process by a network card, wherein the specific process comprises the following steps:

601. the network card in the Redis data node of the video A receives the service message.

602. The network card analyzes the service message according to the message analysis rule.

The format of the service message can be understood with reference to fig. 10, after the network card parses the message header, determines the IP address of the server where the video a is located, then parses the message payload, determines the index information of the video a, and can find the specific content in the corresponding video a according to the index information.

603. And the network card counts the service request related to the video A according to the statistical rule in the response condition.

604. When the video A is the newly generated hot spot data, the network card reduces the service quality of the service message of the service priority designated in the response strategy.

605. The network card sends a capacity expansion notification to a service proxy node serving as a control node.

606. The control node sends a notification to another free Redis data node indicating that the Redis data node provides data processing services for video A.

It should be noted that, in fig. 4 to fig. 9, the process of expanding or shrinking the target data is referred to, the device performing the expansion or shrinking may be a control node, or may be the first control device or the second control device, the process of executing the expansion or shrinking by which device may be indicated in the response policy, and the network device may send an expansion notification or a shrinking notification to the device for executing the expansion or shrinking indicated in the response policy, and then the device completes the expansion or shrinking process.

The above provides centralized and distributed storage or database service, changes the traditional method for carrying out hot spot statistics in the main control business process, issues the statistics and identification of the hot spot to network equipment for operation, can replace the data identification and statistics scenes needing to be carried out for other basic services except the storage or database by using the technology of the application, can fully utilize network resources for carrying out the statistics identification of the data on the premise of reducing business computing resource conflict, and can also identify and count model data through the scheme in the process of artificial intelligent AI model training.

The method for data management provided by the embodiment of the application is described above in connection with different scenarios, and the network device provided by the embodiment of the application is described below in connection with the accompanying drawings.

As shown in fig. 11, a network device 70 provided in an embodiment of the present application may be a switching device or a network interface device installed in a switching device or a data node, where an embodiment of the network device 70 includes:

the acquiring unit 701 is configured to acquire a data management rule, where the data management rule includes a message parsing rule, a response condition, and a response policy. The acquisition unit 701 may perform step 101 in the above-described method embodiment.

The first processing unit 702 is configured to parse the service packet from the client according to the packet parsing rule acquired by the acquiring unit 701, so as to determine target data associated with the service packet, where the target data is application layer data. The first processing unit 702 may perform

steps

102, 202, 302, 402 and 502 in the method embodiments described above.

The second processing unit 703 is configured to count service requests related to the target data analyzed by the first processing unit 702, where the service requests are obtained from the service message. The second processing unit 703 may perform steps 103, 203, 303, 403 and 503 in the above-described method embodiments.

And an operation unit 704, configured to perform a corresponding operation on the service packet received by the network device and/or on the target data according to the response policy when the statistics result of the service request related to the target data counted by the second processing unit 703 meets the response condition. The operation unit 704 may perform the steps 104, 105, 204, 205, 304, 305, 404, 405, 504 and 505 in the above-described method embodiments.

Optionally, the response conditions include statistical rules and response relationships; the statistical rule comprises statistical duration, and the response relation comprises the relation that the number of business requests counted according to the statistical duration and the target threshold value should be met.

Optionally, the statistics satisfying the response condition includes: according to the indication of the response relation, the number of service requests related to the target data exceeds a target threshold value in the statistical duration, and if the number exceeds the target threshold value and the target data is not the existing hot spot data, the target data is indicated to be the newly generated hot spot data; alternatively, the statistical result satisfying the response condition includes: and according to the indication of the response relation, indicating that the number of service requests related to the target data is lower than the target threshold value in the statistical duration, and if the number is lower than the target threshold value and the target data is the existing hot spot data, indicating that the hot spot attribute of the target data disappears.

Optionally, the response condition includes multiple sets of statistical rules and response relations, statistical durations in different statistical rules are different, and target thresholds in response relations corresponding to different statistical rules are different.

Different adjustment strategies in response strategies corresponding to different statistical rules.

Optionally, the response policy includes: a service quality adjustment strategy for the service message of the target priority and an adjustment strategy for expanding or shrinking the resources of the target data are carried out; wherein the target priority is included in the response policy.

Optionally, the operation unit 704 is configured to:

and when the target data is the newly generated hot spot data, reducing the service quality of the service message with the target priority according to the service quality adjustment strategy, and/or performing the operation of expanding the resources on the target data according to the adjustment strategy of expanding the resources.

When the hot spot attribute of the target data disappears, the service quality of the service message of the target service priority is increased according to the service quality adjustment strategy, and/or the operation of resource capacity reduction is carried out on the target data according to the adjustment strategy of the resource capacity reduction.

Optionally, the first processing unit 702 is configured to: analyzing the five-tuple of the service message according to the message analysis rule to determine the service type of the service message; and analyzing the indication field according to the message analysis rule to determine the target data of the service type or the index information of the target data, wherein the index information is used for determining the target data.

Optionally, the operation unit 704 is configured to send, when the response policy indicates that the control node for managing the data node performs an adjustment policy of resource capacity expansion or resource capacity reduction, a capacity expansion notification to the control node, where the capacity expansion notification is used to instruct the control node to perform resource capacity expansion for the target data; or sending a capacity shrinking notification to the control node, wherein the capacity shrinking notification is used for indicating the control node to shrink the resource for the target data.

Optionally, the operation unit 704, for the data node, further comprises a first control device; executing an adjustment strategy of resource capacity expansion or resource capacity reduction by the first control device when the response strategy indicates; sending a capacity expansion notification to the first control device, wherein the capacity expansion notification is used for indicating the first control device to perform resource capacity expansion for target data; or sending a capacity reduction notification to the first control device, wherein the capacity reduction notification is used for instructing the first control device to carry out resource capacity reduction for the target data.

Optionally, the operation unit 704 is configured to use the network device as a network interface device installed on the switching device; the switching device further comprises a second control device, and when the response strategy indicates that the second control device executes the adjustment strategy of the resource capacity expansion or the resource capacity reduction, the second control device is sent with a capacity expansion notification, and the capacity expansion notification is used for indicating the second control device to perform the resource capacity expansion for the target data; or sending a capacity reduction notification to the second control device, wherein the capacity reduction notification is used for instructing the second control device to carry out resource capacity reduction for the target data.

Alternatively, the acquiring unit 701 is configured to acquire the data management rule from a service server or a rule management device, where the service server is a server related to the target data.

In the foregoing, the network device provided in the embodiments of the present application may be understood by referring to the corresponding content of the foregoing method embodiment part, and the detailed description is not repeated here.

Fig. 12 is a schematic diagram of a possible logic structure of the network device 80 according to the foregoing embodiment provided in the embodiment of the present application. The network device 80 includes: a processor 801, a communication interface 802, a memory 803, and a bus 804. The processor 801, the communication interface 802, and the memory 803 are connected to each other through a bus 804.

The communication interface 802 is used to support communication by the network device 80, and the communication interface 802 may be a network card or a network interface. As steps 101, 201, 301, 401 and 501 in fig. 3 to 10 are performed.

In embodiments of the present application, the processor 801 is used to control and manage the actions of the network device 80, e.g., the processor 801 is used to perform steps 102-106,202-206, 302-306, 402-406,502-506 in fig. 3-10 and/or other processes for the techniques described herein.

A memory 803 for storing program codes and data of the network device 80.

The processor 801 may be a central processing unit, a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various exemplary logic blocks, modules, and circuits described in connection with this disclosure. A processor may also be a combination that performs a computational function, such as a combination comprising one or more microprocessors, a combination of a digital signal processor and a microprocessor, and so forth. Bus 804 may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, among others. The buses may be divided into address buses, data buses, control buses, etc. For ease of illustration, only one thick line is shown in fig. 12, but not only one bus or one type of bus.

In another embodiment of the present application, there is also provided a computer-readable storage medium having stored therein computer-executable instructions that, when executed by at least one processor of a device, perform the method described in the above-described embodiments of fig. 3 to 10.

In another embodiment of the present application, there is also provided a computer program product comprising computer-executable instructions stored in a computer-readable storage medium; the at least one processor of the device may read the computer-executable instructions from the computer-readable storage medium, and execution of the computer-executable instructions by the at least one processor causes the device to perform the method described in some of the embodiments of fig. 3-10 above.

In another embodiment of the present application, a network card is further provided, where the network card includes an input interface, an output interface, and at least one processor, where the input interface is configured to receive a service packet, the at least one processor is configured to support a network device to implement the method described in the foregoing embodiments of fig. 3 to fig. 7, and the output interface is configured to send a capacity expansion notification or a capacity contraction notification when it is counted that the service packet is hot spot data. In one possible design, the network card may also include memory, storage for program instructions and data necessary for the network device.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present application.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the several embodiments provided in the embodiments of the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of elements is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or, what contributes to the prior art, or part of the technical solution may be embodied in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Claims

1. A method of data management, the method being applied to a network device, the network device being a switching device or a network interface apparatus installed in the switching device or a data node, the method comprising:

the network equipment acquires a data management rule, wherein the data management rule comprises a message analysis rule, a response condition and a response strategy;

the network equipment analyzes the service message from the client according to the message analysis rule to determine target data associated with the service message, wherein the target data is application layer data;

the network equipment counts service requests related to the target data, and the service requests are obtained from the service message;

and when the statistical result of the service request related to the target data meets a response condition, the network equipment performs corresponding operation on the service message received by the network equipment and/or the target data according to the response strategy.

2. The method of claim 1, wherein the response conditions include statistical rules and response relationships; the statistical rule comprises statistical time length, and the response relation comprises a relation which is calculated according to the statistical time length and is required to be met by the number of service requests and a target threshold;

The statistics of the service request related to the target data include: the number of service requests associated with the target data within the statistical duration.

3. The method of claim 2, wherein the step of determining the position of the substrate comprises,

the statistics result meeting the response condition comprises: according to the indication of the response relation, the number of the service requests related to the target data in the statistical duration exceeds the target threshold, and if the number exceeds the target threshold and the target data is not the existing hot spot data, the target data is indicated to be the newly generated hot spot data; or alternatively, the process may be performed,

the statistics result meeting the response condition comprises: and according to the indication of the response relation, if the number of the service requests related to the target data in the statistical duration is lower than the target threshold, indicating that the hotspot attribute of the target data disappears if the number is lower than the target threshold and the target data is the existing hotspot data.

4. A method according to claim 2 or 3, wherein the response condition comprises a plurality of sets of statistical rules and response relations, statistical durations in different statistical rules are different, and target thresholds in response relations corresponding to different statistical rules are different;

Different adjustment strategies in the response strategies corresponding to different statistical rules.

5. The method of any of claims 2-4, wherein the response policy comprises: a service quality adjustment strategy for the service message of the target priority and an adjustment strategy for the target data for expanding or shrinking the resources; wherein the target priority is included in the response policy.

6. The method according to claim 5, wherein the network device performs corresponding operations on the service message received by the network device and/or on the target data according to the response policy, including:

when the target data is the newly generated hot spot data, the network equipment reduces the service quality of the service message with the target priority according to the service quality adjustment strategy, and/or performs the operation of expanding the resources on the target data according to the resource capacity adjustment strategy;

when the hot spot attribute of the target data disappears, the network equipment increases the service quality of the service message of the target service priority according to the service quality adjustment strategy, and/or performs the operation of resource capacity reduction on the target data according to the adjustment strategy of the resource capacity reduction.

7. The method according to any one of claims 1-6, wherein the network device parsing the service message from the client according to the message parsing rule to determine target data associated with the service message, including:

the network equipment analyzes the five-tuple of the service message according to the message analysis rule to determine the service type of the service message;

the network device analyzes the indication field according to the message analysis rule to determine the target data of the service type or the index information of the target data, wherein the index information is used for determining the target data.

8. The method according to claim 6, wherein when the response policy indicates that an adjustment policy of the resource expansion or the resource contraction is performed by a control node for managing the data node;

the operation of expanding the resource according to the adjustment strategy of expanding the resource comprises the following steps:

the network equipment sends a capacity expansion notification to the control node, wherein the capacity expansion notification is used for indicating the control node to perform resource capacity expansion for the target data;

or alternatively, the process may be performed,

the operation of performing resource contraction on the target data according to the adjustment strategy of the resource contraction comprises the following steps:

And the network equipment sends a capacity reduction notification to the control node, wherein the capacity reduction notification is used for indicating the control node to carry out resource capacity reduction for the target data.

9. The method of claim 6, wherein the data node further comprises a first control device; when the response policy indicates that the first control device executes the adjustment policy of the resource expansion or the resource contraction;

the network equipment sends a capacity expansion notification to the first control device, wherein the capacity expansion notification is used for indicating the first control device to perform resource capacity expansion for the target data;

or alternatively, the process may be performed,

the network device sends a capacity reduction notification to the first control device, wherein the capacity reduction notification is used for indicating the first control device to carry out resource capacity reduction for the target data.

10. The method of claim 6, wherein the network device is a network interface apparatus mounted on the switching device; the switching device further comprises a second control means for executing the adjustment strategy of the resource expansion or the resource contraction when the response strategy indicates to be executed by the control means;

the network interface device sends a capacity expansion notification to the second control device, wherein the capacity expansion notification is used for indicating the second control device to perform resource capacity expansion for the target data;

or alternatively, the process may be performed,

the network interface device sends a capacity reduction notification to the second control device, wherein the capacity reduction notification is used for indicating the second control device to carry out resource capacity reduction for the target data.

11. The method according to any of claims 1-10, wherein the network device obtains a data management rule, comprising:

the network device acquires the data management rule from a service server or a rule management device, the service server being a server related to the target data.

12. A network device, wherein the network device is a switching device or a network interface apparatus installed in the switching device or a data node, the network device comprising:

the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring data management rules, and the data management rules comprise message analysis rules, response conditions and response strategies;

The first processing unit is used for analyzing the business message from the client according to the message analysis rule acquired by the acquisition unit so as to determine target data associated with the business message, wherein the target data is application layer data;

the second processing unit is used for counting service requests related to the target data analyzed by the first processing unit, and the service requests are obtained from the service messages;

and the operation unit is used for carrying out corresponding operation on the service message received by the network equipment and/or the target data according to the response strategy when the statistical result of the service request which is counted by the second processing unit and is related to the target data meets the response condition.

13. The network device of claim 12, wherein the response conditions include statistical rules and response relationships; the statistical rule comprises statistical time length, and the response relation comprises a relation which is calculated according to the statistical time length and is required to be met by the number of service requests and a target threshold;

14. The network device of claim 13, wherein the network device,

15. The network device according to claim 13 or 14, wherein the response condition includes a plurality of sets of statistical rules and response relations, statistical durations in different statistical rules are different, and target thresholds in response relations corresponding to different statistical rules are different;

16. The network device of any of claims 13-15, wherein the response policy comprises: a service quality adjustment strategy for the service message of the target priority and an adjustment strategy for the target data for expanding or shrinking the resources; wherein the target priority is included in the response policy.

17. The network device of claim 16, wherein the network device,

the operation unit is used for:

when the target data is the newly generated hot spot data, the service quality of the service message of the target priority is reduced according to the service quality adjustment strategy, and/or the operation of expanding the resources is carried out on the target data according to the resource capacity adjustment strategy;

and when the hot spot attribute of the target data disappears, the service quality of the service message of the target service priority is regulated according to the service quality regulation strategy, and/or the operation of resource capacity reduction is carried out on the target data according to the regulation strategy of the resource capacity reduction.

18. The network device according to any of the claims 12-17, characterized in that,

the first processing unit is used for:

analyzing the five-tuple of the service message according to the message analysis rule to determine the service type of the service message;

Analyzing the indication field according to the message analysis rule to determine the target data of the service type or the index information of the target data, wherein the index information is used for determining the target data.

19. The network device according to claim 17, wherein the operation unit is configured to send, when the response policy indicates that an adjustment policy of the resource expansion or the resource contraction is performed by a control node for managing the data node, an expansion notification to the control node, the expansion notification being configured to instruct the control node to perform resource expansion for the target data; or sending a capacity reduction notification to the control node, wherein the capacity reduction notification is used for indicating the control node to carry out resource capacity reduction for the target data.

20. The network device of claim 17, wherein the operating unit, for the data node, further comprises a first control means; when the response strategy indicates that the first control device executes the adjustment strategy of the resource capacity expansion or the resource capacity reduction, sending a capacity expansion notification to the first control device, wherein the capacity expansion notification is used for indicating the first control device to perform resource capacity expansion for the target data; or sending a capacity reduction notification to the first control device, wherein the capacity reduction notification is used for instructing the first control device to carry out resource capacity reduction on the target data.

21. The network device according to claim 17, wherein the operation unit is configured to be a network interface apparatus mounted on the switching device; the switching device further comprises a second control device, when the response policy indicates that the second control device executes the adjustment policy of the resource capacity expansion or the resource capacity reduction, a capacity expansion notification is sent to the second control device, and the capacity expansion notification is used for indicating the second control device to perform resource capacity expansion for the target data; or sending a capacity reduction notification to the second control device, wherein the capacity reduction notification is used for instructing the second control device to carry out resource capacity reduction on the target data.

22. The network device of any one of claims 12-21,

the acquiring unit is configured to acquire the data management rule from a service server or a rule management device, where the service server is a server related to the target data.

23. A network device comprising one or more processors and a storage medium storing a computer program;

the computer program implementing the method of any of claims 1-11 when executed by the one or more processors.

24. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by one or more processors, implements the method according to any of claims 1-11.

25. A computer program product comprising a computer program for implementing the method of any one of claims 1-11 when executed by one or more processors.

26. A data system comprising a switching device, a data node, network interface means mounted on each of the switching device and the data node, the switching device or the network interface means mounted on the data node being adapted to implement the method of any of claims 1-11.