CN114138348A - Service recovery priority evaluation method and equipment, storage medium and product - Google Patents
Service recovery priority evaluation method and equipment, storage medium and product Download PDFInfo
- Publication number
- CN114138348A CN114138348A CN202111352902.8A CN202111352902A CN114138348A CN 114138348 A CN114138348 A CN 114138348A CN 202111352902 A CN202111352902 A CN 202111352902A CN 114138348 A CN114138348 A CN 114138348A
- Authority
- CN
- China
- Prior art keywords
- evaluation value
- tolerable
- service
- priority
- qos
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000011156 evaluation Methods 0.000 title claims abstract description 397
- 238000011084 recovery Methods 0.000 title claims abstract description 106
- 238000000034 method Methods 0.000 claims description 34
- 238000004590 computer program Methods 0.000 claims description 16
- 238000004891 communication Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000007547 defect Effects 0.000 description 2
- 238000009472 formulation Methods 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012797 qualification Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
- G06F9/4418—Suspend and resume; Hibernate and awake
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
Abstract
The invention provides a service restoration priority evaluation method and equipment, a storage medium and a product, wherein the service restoration priority evaluation method comprises the following steps: respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of a target service; and determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value. That is, the invention realizes the purpose of establishing disaster recovery priority by introducing the service recovery QoS target and the service recovery QoE target and combining the service recovery QoS target and the service recovery QoE target with the RTO target and the RPO target, thereby ensuring reasonable allocation of disaster recovery resources, establishing a more objective and comprehensive disaster recovery strategy and ensuring the service quality and the experience quality after service recovery to the maximum extent.
Description
Technical Field
The present invention relates to the field of data security technologies, and in particular, to a method and an apparatus for evaluating service restoration priority, a storage medium, and a product.
Background
Disaster recovery refers to the process of recovering normal business operations by re-starting data, hardware and software devices of an information system after natural or man-made disasters. How to make a disaster recovery strategy for a disaster is always an industry research hotspot.
The existing method analyzes the loss influence of service interruption through a financial influence evaluation value and a non-financial influence evaluation value, analyzes and obtains a service Recovery Time Object (RTO) and a Recovery data Point Object (RPO) according to the tolerable maximum interruption Time and the maximum data loss Time of the service, and further determines the disaster Recovery priority level of a service system so as to establish a disaster Recovery strategy.
However, in the existing method, only two indexes, namely RTO and RPO, are considered when a disaster recovery strategy is formulated, and influences of time delay, bandwidth, jitter, packet loss and the like are not considered, so that the distribution of disaster resources is unreasonable and the objectivity of the disaster recovery strategy is low.
Disclosure of Invention
The invention provides a service recovery priority evaluation method, equipment, a storage medium and a product, which are used for solving the defects of unreasonable distribution of disaster resources and low objectivity of a disaster recovery strategy caused by the fact that the disaster recovery strategy is made only based on two indexes of RTO and RPO in the prior art and achieving the purpose of ensuring reasonable distribution of the disaster recovery resources by making a more comprehensive and objective disaster recovery priority.
The invention provides a service recovery priority evaluation method, which comprises the following steps:
respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of a target service;
and determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value.
According to the service restoration priority evaluation method provided by the present invention, determining the target restoration priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable minimum QoS evaluation value, and the tolerable minimum QoE evaluation value includes:
respectively determining an RTO priority weight of the RTO evaluation value, an RPO priority weight of the RPO evaluation value, a QoS priority weight of the lowest tolerable QoS evaluation value and a QoE priority weight of the lowest tolerable QoE evaluation value;
and determining the target recovery priority of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the lowest tolerable QoS evaluation value, the QoS priority weight, the lowest tolerable QoE evaluation value and the QoE priority weight.
According to the service restoration priority evaluation method provided by the present invention, determining the target restoration priority of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the tolerable minimum QoS evaluation value, the QoS priority weight, the tolerable minimum QoE evaluation value, and the QoE priority weight, includes:
calculating a target service recovery priority rating of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the lowest tolerable QoS evaluation value, the QoS priority weight, the lowest tolerable QoE evaluation value and the QoE priority weight;
and determining a target recovery priority corresponding to the target service recovery priority score based on the corresponding relation between the preset service recovery priority score and the service recovery priority.
According to a service restoration priority evaluation method provided by the present invention, calculating a target service restoration priority score of a target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the tolerable minimum QoS evaluation value, the QoS priority weight, the tolerable minimum QoE evaluation value, and the QoE priority weight includes:
using a formula
Determining a target service recovery priority score of the target service;
wherein SP represents a target service restoration priority score of the target service, RTO represents an RTO evaluation value of the target service, α represents an RTO priority weight of the RTO evaluation value, RPO represents an RPO evaluation value of the target service, β represents an RPO priority weight of the RPO evaluation value, and QoS represents a lowest tolerable QoS evaluation value of the target service,
a QoS priority weight representing the lowest tolerable QoS assessment value, a QoE representing the lowest tolerable QoS assessment value of the target traffic, and a δ representing a QoE priority weight of the lowest tolerable QoS assessment value.
According to the method for evaluating service restoration priority provided by the present invention, the obtaining of the RTO evaluation value, the RPO evaluation value, the lowest tolerable QoS evaluation value, and the lowest tolerable QoE evaluation value of the target service respectively includes:
determining a loss evaluation value of the target service for the interrupt event;
and acquiring an RTO (real time over) evaluation value, an RPO evaluation value, a tolerable lowest QoS (quality of service) evaluation value and a tolerable lowest QoE evaluation value of the target service based on the loss evaluation value.
According to the service restoration priority evaluation method provided by the present invention, the obtaining of the RTO evaluation value, the RPO evaluation value, the tolerable minimum QoS evaluation value, and the tolerable minimum QoE evaluation value of the target service based on the loss evaluation value includes:
acquiring a service tolerable interruption time range, a service tolerable data loss time range, a tolerable maximum time delay, a tolerable maximum packet loss rate, a tolerable bandwidth range and a tolerable service quality grading range which respectively correspond to the loss evaluation values;
determining an RTO evaluation value of the target service based on the service tolerable interruption time range;
determining an RPO evaluation value of the target service based on the service tolerable data loss time range;
determining a tolerable lowest QoS evaluation value of the target service based on the tolerable maximum time delay, the tolerable maximum packet loss rate and the tolerable bandwidth range;
and determining a tolerable lowest QoE evaluation value of the target service based on the tolerable service quality scoring range.
The invention also provides a service recovery priority evaluation device, which comprises:
the acquisition module is used for respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of the target service;
and the determining module is used for determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the lowest tolerable QoS evaluation value and the lowest tolerable QoE evaluation value.
The present invention also provides an electronic device, including a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the service restoration priority evaluation method according to any one of the above methods.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the service restoration priority assessment method as described in any of the above.
The present invention also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the service restoration priority evaluation method as described in any of the above.
The invention provides a service recovery priority evaluation method and equipment, a storage medium and a product, wherein the service recovery priority evaluation method comprises the following steps: respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of a target service; and determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value. That is, the invention realizes the purpose of establishing disaster recovery priority by introducing the service recovery QoS target and the service recovery QoE target and combining the service recovery QoS target and the service recovery QoE target with the RTO target and the RPO target, thereby ensuring reasonable allocation of disaster recovery resources, establishing a more objective and comprehensive disaster recovery strategy and ensuring the service quality and the experience quality after service recovery to the maximum extent.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of a service restoration priority evaluation method provided by the present invention;
fig. 2 is a schematic structural diagram of a service restoration priority evaluation system provided in the present invention;
fig. 3 is a schematic structural diagram of a service restoration priority evaluation apparatus provided in the present invention;
fig. 4 is a schematic structural diagram of an electronic device provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The conventional service restoration priority evaluation method analyzes the loss influence of service interruption by using a financial influence evaluation value and a non-financial influence evaluation value, analyzes a service restoration time target (RTO) and a restoration data point target (RPO) according to the tolerable maximum interruption time and the maximum data loss time of a service, and further determines the disaster restoration priority level of a service system so as to formulate a disaster restoration strategy as shown in table 1. However, in the prior art, in the process of establishing the Service restoration priority, the influence of Quality of Service (QoS) and Quality of Experience (QoE) of the Service, such as time delay, bandwidth, jitter, packet loss rate, etc., is not considered, so that the allocation of the disaster recovery resources and the establishment of the disaster recovery policy are influenced, and finally, the restored Service cannot meet the basic QoS and QoE requirements.
TABLE 1
| Disaster recovery capability level | RTO | RPO |
| 1 | Over 2 days | 1 to 7 days |
| 2 | After 24 hours | 1 to 7 days |
| 3 | Over 12 hours | Several hours to 1 hour |
| 4 | Several hours to 2 days | Several hours to 1 hour |
| 5 | Several minutes to 2 days | 0 to 30 minutes |
| 6 | Several minutes | 0 |
Based on the problems, the invention introduces the QoS (quality of service) recovery target and the QoE (quality of experience) recovery target, combines the QoS recovery target with the RTO (real time offset) target, the RPO target and other targets, formulates a more comprehensive and objective disaster recovery priority, ensures reasonable allocation of disaster recovery resources and formulation of disaster recovery strategies, and ensures the QoS and the QoE after service recovery to the maximum extent.
Therefore, the present invention provides a service restoration priority evaluation method, where an execution subject of the service restoration priority evaluation method may be a service restoration priority evaluation device, and the service restoration priority evaluation device may be implemented as part or all of a terminal device in a software, hardware, or a combination of software and hardware. Alternatively, the terminal device may be a Personal Computer (PC), a portable device, a notebook Computer, a smart phone, a tablet Computer, a portable wearable device, and other electronic devices, such as a tablet Computer, a mobile phone, and the like. The present invention is not limited to the specific form of the terminal device.
It should be noted that the execution subject of the method embodiments described below may be part or all of the terminal device described above. The following method embodiments take the execution subject as an example of the terminal device.
Referring to fig. 1, a schematic flow chart of a service restoration priority evaluation method provided by the present invention is shown, as shown in fig. 1, the service restoration priority evaluation method includes the following steps:
Specifically, for a target service to be restored, a terminal device may first evaluate a loss influence on the target service over time after the target service is interrupted, and then further determine, based on the loss influence, an RTO evaluation value, an RPO evaluation value, a tolerable minimum QoS evaluation value, and a tolerable minimum QoE evaluation value of the target service, respectively.
It should be noted that, when determining the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value of the target service, in addition to considering the loss effect caused by the target service terminal over time, the delay, bandwidth, jitter, packet loss rate and image quality score of the target service are also considered, so that the reliability and accuracy of the determined tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value are higher.
And step 120, determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the lowest tolerable QoS evaluation value and the lowest tolerable QoE evaluation value.
Specifically, when the terminal device obtains the RTO evaluation value, the RPO evaluation value, the tolerable minimum QoS evaluation value, and the tolerable minimum QoE evaluation value of the target service, the target recovery priority of the target service may be further determined in combination with the RTO evaluation value, the RPO evaluation value, the tolerable minimum QoS evaluation value, and the tolerable minimum QoE evaluation value, so as to avoid the defects of unreasonable distribution of disaster resources and low objectivity of the disaster recovery policy caused by formulating the disaster recovery policy based on only two indexes, namely the RTO and the RPO, in the existing method, thereby facilitating to formulate a more comprehensive and objective disaster recovery policy.
The service recovery priority evaluation method provided by the invention comprises the steps of firstly respectively obtaining an RTO evaluation value, an RPO evaluation value, a tolerable minimum QoS evaluation value and a tolerable minimum QoE evaluation value of a target service; and then determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable minimum QoS evaluation value and the tolerable minimum QoE evaluation value. That is, the invention realizes the purpose of establishing disaster recovery priority by introducing the service recovery QoS target and the service recovery QoE target and combining the service recovery QoS target and the service recovery QoE target with the RTO target and the RPO target, thereby ensuring reasonable allocation of disaster recovery resources, establishing a more objective and comprehensive disaster recovery strategy and ensuring the service quality and the experience quality after service recovery to the maximum extent.
Optionally, the specific execution process of step 120 includes:
firstly, respectively determining RTO priority weight of the RTO evaluation value, RPO priority weight of the RPO evaluation value, QoS priority weight of the lowest tolerable QoS evaluation value and QoE priority weight of the lowest tolerable QoE evaluation value; and then determining the target recovery priority of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the lowest tolerable QoS evaluation value, the QoS priority weight, the lowest tolerable QoE evaluation value and the QoE priority weight.
Specifically, according to different service types of the target service, an RTO priority weight of the RTO evaluation value, an RPO priority weight of the RPO evaluation value, a QoS priority weight of the tolerable lowest QoS evaluation value, and a QoE priority weight of the tolerable lowest QoE evaluation value may be preset. For example, when the target service is a transaction service, the RTO evaluation value and the RPO evaluation value may be respectively configured to have higher weights, that is, the RTO priority weight and the RPO priority weight have larger values than the QoS priority weight and the QoE priority weight; when the target service is a video service, the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value may be set to have a larger proportion of each other, that is, when the target service is a video service, the QoS priority weight and the QoE priority weight are larger than the RTO priority weight and the RPO priority weight. And then further determining the target recovery priority of the target service based on the RTO evaluation value and the RTO priority weight thereof, the RPO evaluation value and the RPO priority weight thereof, the lowest tolerable QoS evaluation value and the QoS priority weight thereof, and the lowest tolerable QoE evaluation value and the QoE priority weight thereof.
The service recovery priority evaluation method provided by the invention realizes the purpose of determining the target recovery priority of the target service through the RTO evaluation value and the RTO priority weight thereof, the RPO evaluation value and the RPO priority weight thereof, the lowest tolerable QoS evaluation value and the QoS priority weight thereof, and the lowest tolerable QoE evaluation value and the QoE priority weight thereof of the target service, thereby effectively improving the reliability and the accuracy of the target recovery priority.
Optionally, determining a target restoration priority of the target service according to the RTO assessment value, the RTO priority weight, the RPO assessment value, the RPO priority weight, the tolerable minimum QoS assessment value, the QoS priority weight, the tolerable minimum QoE assessment value, and the QoE priority weight, includes:
firstly, calculating a target service recovery priority grade of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the lowest tolerable QoS evaluation value, the QoS priority weight, the lowest tolerable QoE evaluation value and the QoE priority weight; and then determining a target recovery priority corresponding to the target service recovery priority score based on the corresponding relation between the preset service recovery priority score and the service recovery priority.
Specifically, when determining the RTO evaluation value and the RTO priority weight thereof, the RPO evaluation value and the RPO priority weight thereof, the tolerable lowest QoS evaluation value and the QoS priority weight thereof, and the tolerable lowest QoE evaluation value and the QoE priority weight thereof of the target service, the terminal device may calculate the target service restoration priority score of the target service by using equation (1).
Wherein SP denotes a target service restoration priority score of the target service, RTO denotes an RTO evaluation value of the target service, α denotes an RTO priority weight of the RTO evaluation value, RPO denotes an RPO evaluation value of the target service, β denotes an RPO priority weight of the RPO evaluation value, QoS denotes a tolerable lowest QoS evaluation value of the target service,
a QoS priority weight representing a lowest tolerable QoS assessment value, QoE representing a lowest tolerable QoE assessment value of the target service, δ representing a QoE priority weight of the lowest tolerable QoE assessment value;
then, based on the corresponding relationship between the preset service restoration priority score and the service restoration priority, a target restoration priority corresponding to the target service restoration priority score is determined, for example, when the corresponding relationship between the service restoration priority score and the service restoration priority is shown in table 2, and the calculated target service restoration priority score of the target service is 2.15, α is 35%, β is 35%,
When δ is 10%, the target restoration priority of the target traffic may be determined to be medium.
TABLE 2
The service restoration priority evaluation method provided by the invention calculates the target service restoration priority score of the target service and then determines the target restoration priority corresponding to the target service restoration priority score, so that the determined target restoration priority is more comprehensive and objective, and more reasonable disaster recovery resource distribution and disaster recovery strategy formulation are ensured.
Optionally, the obtaining an RTO evaluation value, an RPO evaluation value, a tolerable minimum QoS evaluation value, and a tolerable minimum QoE evaluation value of the target service respectively includes:
firstly, determining a loss evaluation value of a target service for an interruption event; and then, based on the loss evaluation value, obtaining an RTO evaluation value, an RPO evaluation value, a tolerable lowest QoS evaluation value and a tolerable lowest QoE evaluation value of the target service.
Wherein, the loss evaluation value of the target service for the interruption event can be a loss grade.
Specifically, considering the objectivity of each index evaluation value, the loss evaluation value of the target service for the outage event may be determined, that is, the terminal device may obtain the service activity information collected from each service department, and then determine the loss level of the target service for the outage event from two dimensions of the financial loss influence evaluation and the non-financial loss influence evaluation, for example, a subjective evaluation method may be used to analyze the loss level of the target service from the financial loss influence evaluation dimensions including operation time, user scale, service operation and economic profit, the financial and non-financial loss influence evaluation dimensions including enterprise reputation, industry supervision, service operation qualification, legal/litigation risk, client satisfaction, social stability, and the like, and the financial loss influence evaluation and the non-financial loss influence level are mainly classified into 6 levels, the process comprises the following steps:
financial loss effects: assuming that the target service is interrupted for 30 minutes, 1 hour, 4 hours, 8 hours and 1 day, the financial loss of the target service in various time periods after the interruption is evaluated, including qualitative and quantitative losses in terms of operation time, user scale, service income, operation profit and the like.
Non-financial loss effects: assuming that the target business is interrupted for 30 minutes, 1 hour, 4 hours, 8 hours and 1 day, evaluating the non-financial loss condition of the target business in each time period after the interruption, including the influence on the reputation of an enterprise, whether the requirements of a bank monitoring department are met, the influence on business operation qualification, law/litigation risks, the influence on customer satisfaction, client loss, the influence on the confidence of investors, the influence on national security, social stability and the like.
Then, acquiring a subjective evaluation result of the business department for carrying out subjective evaluation on the 6-level financial loss influence and the non-financial loss influence, and converting the influence grade into a business loss influence score based on the subjective evaluation result, wherein the method comprises the following steps: unacceptable: score 5, very severe: score 4, severe: score 3, general: 2 min, slight: 1 minute, no influence: 0 minute; and then determining a loss evaluation value of the target service for the interruption event based on the loss level.
Further, determining an RTO (real time operation) evaluation value and an RPO (resilient packet optimization) evaluation value of the target service based on a loss evaluation value of the target service for the interruption event and the existing disaster recovery resource construction condition; and determining the lowest tolerable QoS evaluation value and the lowest tolerable QoE evaluation value of the target service according to the loss evaluation value of the target service for the interrupt event.
The service restoration priority evaluation method provided by the invention determines the loss evaluation value of the target service for the interrupt event, and then obtains the RTO evaluation value, the RPO evaluation value, the tolerable minimum QoS evaluation value and the tolerable minimum QoE evaluation value of the target service based on the loss evaluation value, thereby realizing the objectivity and rationality of determining the service restoration RTO target, the service restoration RPO target, the service restoration QoS target and the service restoration QoE target, and providing a powerful basis for ensuring the experience quality and the service quality of service restoration to the maximum extent.
Optionally, the obtaining, based on the loss evaluation value, an RTO evaluation value, an RPO evaluation value, a tolerable minimum QoS evaluation value, and a tolerable minimum QoE evaluation value of the target service includes:
firstly, acquiring a service tolerable interruption time range, a service tolerable data loss time range, a tolerable maximum time delay, a tolerable maximum packet loss rate, a tolerable bandwidth range and a tolerable service quality grading range which respectively correspond to the loss evaluation value; then, determining an RTO evaluation value of the target service based on the service tolerable interruption time range; determining an RPO evaluation value of the target service based on the service tolerable data loss time range; determining a tolerable lowest QoS evaluation value of the target service based on the tolerable maximum time delay, the tolerable maximum packet loss rate and the tolerable bandwidth range; and determining a tolerable lowest QoE evaluation value of the target service based on the tolerable service quality scoring range.
Specifically, from different dimensions of the loss evaluation value of the target service for the interruption event, a tolerable range corresponding to each index may be determined, and then the evaluation value of each index is determined according to different tolerable ranges, where the specific process includes: determining a service tolerable interruption time range of the target service by combining the loss evaluation value of the target service for the interruption event, and further determining an RTO evaluation value corresponding to the service tolerable interruption time range according to a corresponding relationship between the preset loss evaluation value and the RTO as shown in table 3. For example, the tolerable maximum interruption degree of the target service is determined to be "serious" in combination with the loss evaluation value of the target service for the interruption event, and the loss level of the target service is "serious" 2 hours after the interruption occurs, and the RTO evaluation value of the target service is two hours.
TABLE 3
Determining a service tolerable data loss time range of the target service by combining the loss evaluation value of the target service for the interrupt event, and further determining an RPO evaluation value corresponding to the service tolerable data loss time range according to a preset corresponding relationship between the loss evaluation value and the RPO as shown in table 4. For example, the tolerable maximum interruption level of the target service is "severe", and after 30 minutes of data loss, the loss level of the target service is "severe", and the RPO estimation value of the target service is 30 minutes.
TABLE 4
In combination with the loss evaluation value of the target service for the interrupt event, the tolerable maximum delay, the tolerable maximum packet loss rate, and the tolerable bandwidth range of the target service are determined, and then the tolerable minimum QoS evaluation value corresponding to the tolerable maximum delay, the tolerable maximum packet loss rate, and the tolerable bandwidth range of the target service can be further determined according to the corresponding relationship between the preset loss evaluation value and the QoS as shown in table 5. For example, the tolerable maximum interruption degree of the target service is "severe", and when the delay is greater than 5ms, the bandwidth is less than 1000M, and the packet loss rate is greater than 5%, the loss level of the target service is "severe", and the tolerable minimum QoS evaluation values of the target service are delay < ═ 5ms, bandwidth is greater than 1000M, and the packet loss rate < > 5%.
TABLE 5
In combination with the loss assessment value of the target service for the outage event, a tolerable service quality scoring range of the target service is determined, and then according to the corresponding relationship between the loss assessment value and the QoE shown in table 6, a tolerable lowest QoE assessment value corresponding to the tolerable service quality scoring range can be further determined. For example, the tolerable maximum interruption degree of the target service is "severe", and when a tolerable image quality Score (MOS,) <4, the loss level of the target service is "severe", the tolerable minimum QoE evaluation value of the target service is 4.
TABLE 6
It should be noted that, in the present invention, a specific process of determining a service tolerable interruption time range, a service tolerable data loss time range, a tolerable maximum delay, a tolerable maximum packet loss rate, a tolerable bandwidth range, and a tolerable service quality score range of a target service based on a loss evaluation value of the target service for an interruption event may be determined manually in an online or offline manner according to an actual situation, and is not specifically limited herein.
In addition, the loss evaluation value of the target service for the interruption event may not be determined, but the service tolerable interruption time range, the service tolerable data loss time range, the tolerable maximum time delay, the tolerable maximum packet loss rate, the tolerable bandwidth range and the tolerable service quality scoring range of the target service may be directly obtained, and similarly, the specific process of directly obtaining the service tolerable interruption time range, the service tolerable data loss time range, the tolerable maximum time delay, the tolerable maximum packet loss rate, the tolerable bandwidth range and the tolerable service quality scoring range of the target service may also be determined according to the actual condition online or online, and is not specifically limited herein.
The service recovery priority evaluation method provided by the invention firstly obtains and determines a service tolerable interruption time range, a service tolerable data loss time range, a tolerable maximum time delay, a tolerable maximum packet loss rate, a tolerable bandwidth range and a tolerable service quality scoring range which are respectively corresponding to a loss evaluation value of a target service for an interruption event, and determines an RTO evaluation value, an RPO evaluation value, a tolerable minimum QoS evaluation value and a tolerable minimum QoE evaluation value of the target service, so that the accuracy and reliability of the RTO evaluation value, the RPO evaluation value, the tolerable minimum QoS evaluation value and the tolerable minimum QoE evaluation value are improved, and a foundation is laid for subsequently determining a more comprehensive and more objective service recovery priority.
The service restoration priority evaluation system provided by the present invention is described below, and the service restoration priority evaluation system described below and the service restoration priority evaluation method described above may be referred to in correspondence with each other.
Fig. 2 illustrates a service restoration priority evaluation system, and as shown in fig. 2, the service restoration priority evaluation system 200 includes: service impact analysis unit a service impact analysis unit 210, a service restoration time target (RTO) evaluation unit 220, a service restoration data point target (RPO) evaluation unit 230, a service restoration QoS target evaluation unit 240, a service restoration QoE target evaluation unit 250, and a service restoration priority evaluation unit 260, where the service impact analysis unit a service impact analysis unit 210 is configured to determine a loss evaluation value of a target service for an interrupt event; a service recovery time target (RTO) evaluation unit 220, configured to obtain an RTO evaluation value of a target service; a service restoration data point target (RPO) evaluation unit 230 configured to obtain an RPO evaluation value of a target service; a service restoration QoS target evaluation unit 240, configured to obtain a lowest tolerable QoS evaluation value of the target service; a service restoration QoE target evaluation unit 250, configured to obtain a lowest tolerable QoE evaluation value of the target service; a service restoration priority evaluating unit 260, configured to determine a target restoration priority of the target service according to the RTO evaluation value, the RPO evaluation value, the lowest tolerable QoS evaluation value, and the lowest tolerable QoE evaluation value. The service restoration priority evaluation device provided by the present invention is described below, and the service restoration priority evaluation device described below and the service restoration priority evaluation method described above may be referred to in correspondence with each other.
Fig. 3 illustrates a service restoration priority evaluation apparatus, and as shown in fig. 3, the service restoration priority evaluation apparatus 300 includes: an obtaining module 310, configured to obtain an RTO evaluation value, an RPO evaluation value, a tolerable minimum QoS evaluation value, and a tolerable minimum QoE evaluation value of the target service, respectively; a determining module 320, configured to determine a target restoration priority of the target service according to the RTO evaluation value, the RPO evaluation value, the lowest tolerable QoS evaluation value, and the lowest tolerable QoE evaluation value.
Optionally, the determining module 320 may be specifically configured to determine an RTO priority weight of the RTO evaluation value, an RPO priority weight of the RPO evaluation value, a QoS priority weight of the lowest tolerable QoS evaluation value, and a QoE priority weight of the lowest tolerable QoS evaluation value, respectively; and determining the target recovery priority of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the lowest tolerable QoS evaluation value, the QoS priority weight, the lowest tolerable QoE evaluation value and the QoE priority weight.
Optionally, the determining module 320 may be further specifically configured to calculate a target service restoration priority score of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the tolerable minimum QoS evaluation value, the QoS priority weight, the tolerable minimum QoE evaluation value, and the QoE priority weight; and determining a target recovery priority corresponding to the target service recovery priority score based on the corresponding relation between the preset service recovery priority score and the service recovery priority.
Optionally, the determining module 320 may be further configured to use a formula
Determining a target service recovery priority score of the target service; wherein SP represents a target service restoration priority score of the target service, RTO represents an RTO evaluation value of the target service, α represents an RTO priority weight of the RTO evaluation value, RPO represents an RPO evaluation value of the target service, β represents an RPO priority weight of the RPO evaluation value, and QoS represents a lowest tolerable QoS evaluation value of the target service,
a QoS priority weight representing the lowest tolerable QoS assessment value, a QoE representing the lowest tolerable QoS assessment value of the target traffic, and a δ representing a QoE priority weight of the lowest tolerable QoS assessment value.
Optionally, the determining module 320 may be further configured to determine a loss evaluation value of the target service for the outage event;
optionally, the obtaining module 310 may be specifically configured to obtain, based on the loss assessment value, an RTO assessment value, an RPO assessment value, a tolerable minimum QoS assessment value, and a tolerable minimum QoE assessment value of the target service.
Optionally, the obtaining module 310 may be further specifically configured to obtain a service tolerable interruption time range, a service tolerable data loss time range, a tolerable maximum time delay, a tolerable maximum packet loss rate, a tolerable bandwidth range, and a tolerable service quality score range, which correspond to the loss evaluation value respectively.
Optionally, the determining module 320 may be further configured to determine, based on the service tolerable interruption time range, an RTO evaluation value of the target service; determining an RPO evaluation value of the target service based on the service tolerable data loss time range; determining a tolerable lowest QoS evaluation value of the target service based on the tolerable maximum time delay, the tolerable maximum packet loss rate and the tolerable bandwidth range; and determining a tolerable lowest QoE evaluation value of the target service based on the tolerable service quality scoring range.
Fig. 4 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 4: a processor (processor)410, a communication interface (communication interface)420, a memory (memory)430 and a communication bus 440, wherein the processor 410, the communication interface 420 and the memory 430 are communicated with each other via the communication bus 440. Processor 410 may invoke logic instructions in memory 430 to perform a traffic restoration priority assessment method comprising: respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of a target service; and determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value.
In addition, the logic instructions in the memory 430 may be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
In another aspect, the present invention also provides a computer program product, the computer program product including a computer program, the computer program being stored on a non-transitory computer-readable storage medium, wherein when the computer program is executed by a processor, a computer is capable of executing the service restoration priority evaluation method provided by the above methods, the method including: respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of a target service; and determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value.
In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program, which when executed by a processor, implements a method for service restoration priority evaluation provided by the above methods, the method comprising: respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of a target service; and determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for evaluating service restoration priority, comprising:
respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of a target service;
and determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the tolerable lowest QoS evaluation value and the tolerable lowest QoE evaluation value.
2. The method for evaluating service restoration priority according to claim 1, wherein the determining a target restoration priority of the target service according to the RTO evaluation value, the RPO evaluation value, the lowest tolerable QoS evaluation value, and the lowest tolerable QoE evaluation value comprises:
respectively determining an RTO priority weight of the RTO evaluation value, an RPO priority weight of the RPO evaluation value, a QoS priority weight of the lowest tolerable QoS evaluation value and a QoE priority weight of the lowest tolerable QoE evaluation value;
and determining the target recovery priority of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the lowest tolerable QoS evaluation value, the QoS priority weight, the lowest tolerable QoE evaluation value and the QoE priority weight.
3. The method of claim 2, wherein determining the target recovery priority of the target service according to the RTO assessment value, the RTO priority weight, the RPO assessment value, the RPO priority weight, the tolerable minimum QoS assessment value, the QoS priority weight, the tolerable minimum QoE assessment value, and the QoE priority weight comprises:
calculating a target service recovery priority rating of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the lowest tolerable QoS evaluation value, the QoS priority weight, the lowest tolerable QoE evaluation value and the QoE priority weight;
and determining a target recovery priority corresponding to the target service recovery priority score based on the corresponding relation between the preset service recovery priority score and the service recovery priority.
4. The method for evaluating service restoration priority according to claim 3, wherein the calculating a target service restoration priority score of the target service according to the RTO evaluation value, the RTO priority weight, the RPO evaluation value, the RPO priority weight, the tolerable lowest QoS evaluation value, the QoS priority weight, the tolerable lowest QoE evaluation value, and the QoE priority weight comprises:
using a formula
Determining a target service recovery priority score of the target service;
wherein SP represents a target service restoration priority score of the target service, RTO represents an RTO evaluation value of the target service, α represents an RTO priority weight of the RTO evaluation value, RPO represents an RPO evaluation value of the target service, β represents an RPO priority weight of the RPO evaluation value, and QoS represents a lowest tolerable QoS evaluation value of the target service,
a QoS priority weight representing the lowest tolerable QoS assessment value, a QoE representing the lowest tolerable QoS assessment value of the target traffic, and a δ representing a QoE priority weight of the lowest tolerable QoS assessment value.
5. The method for evaluating service restoration priority according to claim 1, wherein the obtaining an RTO evaluation value, an RPO evaluation value, a lowest tolerable QoS evaluation value, and a lowest tolerable QoE evaluation value of the target service respectively comprises:
determining a loss evaluation value of the target service for the interrupt event;
and acquiring an RTO (real time over) evaluation value, an RPO evaluation value, a tolerable lowest QoS (quality of service) evaluation value and a tolerable lowest QoE evaluation value of the target service based on the loss evaluation value.
6. The method for evaluating service restoration priority according to claim 5, wherein the obtaining an RTO assessment value, an RPO assessment value, a lowest tolerable QoS assessment value, and a lowest tolerable QoE assessment value for the target service based on the loss assessment value comprises:
acquiring a service tolerable interruption time range, a service tolerable data loss time range, a tolerable maximum time delay, a tolerable maximum packet loss rate, a tolerable bandwidth range and a tolerable service quality grading range which respectively correspond to the loss evaluation values;
determining an RTO evaluation value of the target service based on the service tolerable interruption time range;
determining an RPO evaluation value of the target service based on the service tolerable data loss time range;
determining a tolerable lowest QoS evaluation value of the target service based on the tolerable maximum time delay, the tolerable maximum packet loss rate and the tolerable bandwidth range;
and determining a tolerable lowest QoE evaluation value of the target service based on the tolerable service quality scoring range.
7. A service restoration priority evaluation apparatus, comprising:
the acquisition module is used for respectively acquiring an RTO (remote terminal operation) evaluation value, an RPO evaluation value, a tolerable minimum QoS (quality of service) evaluation value and a tolerable minimum QoE evaluation value of the target service;
and the determining module is used for determining the target recovery priority of the target service according to the RTO evaluation value, the RPO evaluation value, the lowest tolerable QoS evaluation value and the lowest tolerable QoE evaluation value.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program performs the steps of the service restoration priority assessment method according to any of claims 1 to 6.
9. A non-transitory computer readable storage medium, having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the steps of the traffic restoration priority assessment method according to any of claims 1 to 6.
10. A computer program product comprising a computer program, wherein the computer program when executed by a processor implements the steps of the traffic restoration priority assessment method according to any of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111352902.8A CN114138348A (en) | 2021-11-16 | 2021-11-16 | Service recovery priority evaluation method and equipment, storage medium and product |
| PCT/CN2021/139548 WO2023087473A1 (en) | 2021-11-16 | 2021-12-20 | Service recovery priority evaluation method, device, storage medium, and product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111352902.8A CN114138348A (en) | 2021-11-16 | 2021-11-16 | Service recovery priority evaluation method and equipment, storage medium and product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114138348A true CN114138348A (en) | 2022-03-04 |
Family
ID=80393350
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111352902.8A Pending CN114138348A (en) | 2021-11-16 | 2021-11-16 | Service recovery priority evaluation method and equipment, storage medium and product |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114138348A (en) |
| WO (1) | WO2023087473A1 (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101635638A (en) * | 2008-07-25 | 2010-01-27 | 中兴通讯股份有限公司 | Disaster tolerance system and disaster tolerance method thereof |
| CN103582029A (en) * | 2012-07-24 | 2014-02-12 | 华为技术有限公司 | Policy control method and device |
| US20160308709A1 (en) * | 2013-12-26 | 2016-10-20 | Telefonica, S.A | Method and system for restoring qos degradations in mpls networks |
| CN106209422A (en) * | 2016-06-28 | 2016-12-07 | 中国银联股份有限公司 | Reduce the method and apparatus of Disaster Preparation Center's system switching unavailable time |
| CN108322406A (en) * | 2017-12-28 | 2018-07-24 | 广东电网有限责任公司电力调度控制中心 | A kind of SDN data plane failure restoration methods based on link performance and flow point class |
| CN109804704A (en) * | 2016-08-10 | 2019-05-24 | Idac控股公司 | Connectivity supervision and recovery |
| CN109801003A (en) * | 2019-03-18 | 2019-05-24 | 关继铮 | A kind of business impact analysis method based on AHP |
| CN112585922A (en) * | 2018-08-20 | 2021-03-30 | 索尼公司 | Method and system for utilizing event specific priority in network controlled uplink media transmission for collaborative media production |
| CN112732490A (en) * | 2021-01-14 | 2021-04-30 | 国网上海市电力公司 | Information determination method, device, equipment and storage medium |
| CN113037560A (en) * | 2021-03-18 | 2021-06-25 | 同盾科技有限公司 | Service flow switching method and device, storage medium and electronic equipment |
| CN113347111A (en) * | 2021-05-12 | 2021-09-03 | 金茂数字科技有限公司 | Flow adjusting method and management system based on user experience |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104378220A (en) * | 2013-08-14 | 2015-02-25 | 中兴通讯股份有限公司 | Method, device, user terminal and network server for evaluating user experience quality |
| CN112165714A (en) * | 2020-10-24 | 2021-01-01 | 国铁吉讯科技有限公司 | Network evaluation method, device and storage medium |
-
2021
- 2021-11-16 CN CN202111352902.8A patent/CN114138348A/en active Pending
- 2021-12-20 WO PCT/CN2021/139548 patent/WO2023087473A1/en unknown
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101635638A (en) * | 2008-07-25 | 2010-01-27 | 中兴通讯股份有限公司 | Disaster tolerance system and disaster tolerance method thereof |
| CN103582029A (en) * | 2012-07-24 | 2014-02-12 | 华为技术有限公司 | Policy control method and device |
| US20160308709A1 (en) * | 2013-12-26 | 2016-10-20 | Telefonica, S.A | Method and system for restoring qos degradations in mpls networks |
| CN106209422A (en) * | 2016-06-28 | 2016-12-07 | 中国银联股份有限公司 | Reduce the method and apparatus of Disaster Preparation Center's system switching unavailable time |
| CN109804704A (en) * | 2016-08-10 | 2019-05-24 | Idac控股公司 | Connectivity supervision and recovery |
| CN108322406A (en) * | 2017-12-28 | 2018-07-24 | 广东电网有限责任公司电力调度控制中心 | A kind of SDN data plane failure restoration methods based on link performance and flow point class |
| CN112585922A (en) * | 2018-08-20 | 2021-03-30 | 索尼公司 | Method and system for utilizing event specific priority in network controlled uplink media transmission for collaborative media production |
| CN109801003A (en) * | 2019-03-18 | 2019-05-24 | 关继铮 | A kind of business impact analysis method based on AHP |
| CN112732490A (en) * | 2021-01-14 | 2021-04-30 | 国网上海市电力公司 | Information determination method, device, equipment and storage medium |
| CN113037560A (en) * | 2021-03-18 | 2021-06-25 | 同盾科技有限公司 | Service flow switching method and device, storage medium and electronic equipment |
| CN113347111A (en) * | 2021-05-12 | 2021-09-03 | 金茂数字科技有限公司 | Flow adjusting method and management system based on user experience |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023087473A1 (en) | 2023-05-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109102394A (en) | Methods of risk assessment, device and computer readable storage medium | |
| CN108124271B (en) | Network quality evaluation method and device based on user perception | |
| CN110401660B (en) | False flow identification method and device, processing equipment and storage medium | |
| CN111932268A (en) | Enterprise risk identification method and device | |
| CN109428910A (en) | A kind of data processing method, apparatus and system | |
| EP4143689A1 (en) | Blockchain network risk management universal blockchain data model | |
| Ganegoda et al. | A scaling model for severity of operational losses using generalized additive models for location scale and shape (GAMLSS) | |
| CN110866698A (en) | Device for assessing service score of service provider | |
| Tiwari et al. | Service adaptive broking mechanism using MROSP algorithm | |
| US20140279378A1 (en) | Model performance simulator | |
| CN111932064A (en) | Method for establishing risk assessment grade | |
| CN109711984B (en) | Pre-loan risk monitoring method and device based on collection urging | |
| CN114138348A (en) | Service recovery priority evaluation method and equipment, storage medium and product | |
| JP6771513B2 (en) | Devices and methods for calculating default probability and programs for it | |
| CN110930238A (en) | Method, device, equipment and computer readable medium for improving audit task efficiency | |
| CN110706098A (en) | Accurate poverty alleviation system and method based on block chain | |
| CN110033151B (en) | Relation risk evaluation method and device, electronic equipment and computer storage medium | |
| CN111681090A (en) | Account grouping method and device of business system, terminal equipment and storage medium | |
| CN112419050B (en) | Credit evaluation method and device based on telephone communication network and social behavior | |
| CN115017875B (en) | Enterprise information processing method, device, system, equipment and medium | |
| CN109102391A (en) | Financial institution's ranking method, device and computer readable storage medium | |
| CN112148491B (en) | Data processing method and device | |
| CN114943488B (en) | Meteorological disaster early warning signal efficiency evaluation method | |
| US20210217118A1 (en) | Presentation device, presentation method, and presentation program | |
| CN117273899A (en) | Method and device for sending processing result, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 1308, 13th floor, East Tower, 33 Fuxing Road, Haidian District, Beijing 100035 Applicant after: China Telecom Digital Intelligence Technology Co.,Ltd. Address before: Room 1308, 13th floor, East Tower, 33 Fuxing Road, Haidian District, Beijing 100035 Applicant before: CHINA TELECOM GROUP SYSTEM INTEGRATION Co.,Ltd. |