CN115239115A - Low-earth-orbit satellite control station network measurement and control data transmission resource efficiency evaluation method - Google Patents
Low-earth-orbit satellite control station network measurement and control data transmission resource efficiency evaluation method Download PDFInfo
- Publication number
- CN115239115A CN115239115A CN202210840944.4A CN202210840944A CN115239115A CN 115239115 A CN115239115 A CN 115239115A CN 202210840944 A CN202210840944 A CN 202210840944A CN 115239115 A CN115239115 A CN 115239115A
- Authority
- CN
- China
- Prior art keywords
- index
- efficiency
- measurement
- task
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/1851—Systems using a satellite or space-based relay
- H04B7/18519—Operations control, administration or maintenance
Abstract
The invention discloses an efficiency evaluation method for a satellite control station network measurement and control data transmission resource, which realizes the evaluation of the use efficiency of the ground measurement and control data transmission resource. The performance evaluation method comprises the following steps: constructing a satellite control station network measurement and control data transmission resource efficiency evaluation system; determining the importance degree of the index; calculating the efficiency itemized indexes of each topic; calculating comprehensive performance indexes of each topic; and calculating the comprehensive efficiency index of the station network measurement and control data transmission resource. The method aims at the comprehensive utilization of space-ground-based resources and system efficiency, establishes an evaluation system, an analysis evaluation index, an evaluation method and an evaluation model for the efficiency of the measurement and control receiving resources of the satellite management and control station network, and realizes the comprehensive efficiency evaluation of the satellite management and control station network.
Description
Technical Field
The invention relates to the field of space ground system measurement and control and operation control, in particular to an efficiency evaluation method for measuring and controlling data transmission resources of a low-orbit satellite management and control station network.
Background
With the construction of aerospace measurement, operation and control station networks in recent years, more attention is paid to the evaluation of the application benefit and the receiving task efficiency of station network measurement, control and data transmission resources. A great deal of work is carried out on the aspects of application requirement research, task analysis, index system construction, comprehensive efficiency evaluation and the like. However, from the practical application effect, the problems of incomplete application task, incomplete index system, unrealistic index model, weak practicability of the comprehensive evaluation method and the like still exist in the field of resource efficiency evaluation of aerospace measurement, operation and control station networks. Firstly, a receiving task to be evaluated is not clear, an evaluation task modeling is not standard, and the aspects of the use condition of measurement and control data transmission resources and the satisfaction condition of user requirements cannot be comprehensively and accurately covered; secondly, an evaluation index system is not clearly divided in a multi-level and multi-dimensional station network system, so that the reliability of an evaluation result is reduced; the re-evaluation index modeling is not scientific, the capability constraint of the ground station in practice is not considered, and the efficiency of the station network in actual operation is difficult to accurately evaluate; the existing analytic hierarchy process highly depends on professional levels and professional skills of experts, is strong in subjectivity, and is not strong in practicability of a comprehensive evaluation method.
Therefore, an aerospace measurement, control, operation and control station network resource efficiency evaluation system with completeness, self-consistency, balance and computability is required to be constructed, a multi-level measurement, control and reception resource efficiency evaluation index system level is combed from the aspects of measurement, control and reception efficiency, data transmission efficiency, system operability, system reliability and the like, aerospace measurement, control and reception resource efficiency evaluation index system level is accurately and stably represented, the aerospace measurement, operation and control station network resource efficiency is specially and comprehensively evaluated, evaluation results are analyzed and verified conveniently, the system is improved and perfected according to discovered problems or weak links, and important technical support is provided for station network construction planning demonstration and measurement, control and data transmission resource application benefit exertion.
Disclosure of Invention
The invention aims to solve the technical problem of providing a measurement and control data transmission resource efficiency evaluation method for a low-earth-orbit satellite management and control station network, which aims at comprehensive utilization of station network resources, establishes a station network resource evaluation method, an index system and an evaluation model, realizes dynamic quantitative evaluation of the application efficiency of the measurement and control data transmission resources, supports evaluation of station network task satisfaction conditions and optimization of operation modes, and provides support for construction of the low-earth-orbit satellite management and control station network.
In order to achieve the purpose, the invention adopts the technical scheme that:
a low-orbit satellite control station network measurement and control data transmission resource efficiency evaluation method is characterized by comprising the following steps:
(1) Constructing a satellite control station network measurement and control data transmission resource efficiency evaluation system, which comprises three-level capability layer indexes, wherein the first-level capability layer index is a top-level capability index, the second-level capability layer indexes comprise system task thematic efficiency, measurement and control receiving thematic efficiency, data transmission thematic efficiency, system operability thematic efficiency and system reliability thematic efficiency, and the three-level capability layer indexes are generated by refining and decomposing based on five second-level capability layer indexes;
(2) Determining an index importance degree weight coefficient, inquiring experts in the field of the station network by adopting an expert consultation and survey mode, and grading the importance degree of each index and each index variable;
(3) Calculating the performance itemized indexes of the system task topic;
(4) Calculating system task thematic efficiency index weight, and calculating a system task thematic efficiency comprehensive index according to the system task thematic efficiency index weight on the basis of the system task thematic efficiency subentry index obtained in the previous step;
(5) Calculating a measurement and control receiving efficiency subentry index;
(6) Calculating the measurement and control receiving thematic efficiency index weight, and calculating a measurement and control receiving thematic efficiency comprehensive index according to the measurement and control receiving thematic efficiency index weight based on the measurement and control receiving efficiency subentry index obtained in the last step;
(7) Calculating the performance itemized indexes of the data transmission topics;
(8) Calculating the data transmission thematic efficiency index weight, and calculating a data transmission thematic efficiency comprehensive index according to the data transmission thematic efficiency index weight on the basis of the data transmission thematic efficiency subentry index obtained in the last step;
(9) Calculating the thematic efficiency subentry index of the system;
(10) Calculating the system runnability thematic performance index weight, calculating a system runnability performance comprehensive index based on the system runnability thematic performance subentry index obtained in the last step and according to the system runnability thematic performance index weight;
(11) Calculating the system reliability thematic efficiency itemized indexes;
(12) Calculating the system reliability thematic efficiency index weight, and calculating a system reliability and efficiency comprehensive index according to the system reliability thematic efficiency index weight based on the system reliability thematic efficiency subentry index obtained in the last step;
(13) And calculating the comprehensive efficiency index weight of the station network measurement and control data transmission resources, and calculating the comprehensive efficiency index of the station network measurement and control data transmission resources according to the comprehensive efficiency index weight of the station network measurement and control data transmission resources based on the five secondary index results obtained by the previous calculation.
Compared with the prior art, the invention has the following beneficial effects:
the invention provides a method for evaluating the efficiency of measurement and control data transmission resources of a low-orbit satellite control station network, which is characterized in that a station network system is subjected to capacity vector decomposition, index capacities which have obvious effect on the system efficiency and have large influence are selected for evaluation, and the evaluation method is divided into 5 primary index capacities such as a system level capacity, a measurement and control receiving capacity and 22 secondary index capacities such as measurement and control receiving duration and task satisfaction from the aspect of capacity space vector decomposition, so that an index system for the measurement and control data transmission resources of the aerospace control station network is established. The method effectively solves the problem of construction of the efficiency evaluation system of the measurement, control and data transmission integration of the ground station network, realizes the optimized layout construction of the measurement, control and reception station network and the optimization of the use mode of the measurement, control and reception station network, and can effectively improve the use efficiency of the ground station network resources.
Drawings
Fig. 1 is a flowchart of a method for evaluating the efficiency of measurement and control data transmission resources of a network of a low earth orbit satellite management and control station provided by the invention.
Fig. 2 is a system diagram for evaluating the efficiency of the measurement and control data transmission resource of the satellite management and control station network.
FIG. 3 is a diagram of the performance index composition of the system task topic of the present invention.
FIG. 4 is a diagram of the performance index composition of the measurement and control reception topic of the present invention.
FIG. 5 is a diagram of a performance indicator for data transmission topic according to the present invention.
FIG. 6 is a diagram of the performance index composition of the system runnability theme of the present invention.
FIG. 7 is a diagram of the performance index composition of the system reliability topic of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following detailed description of the method for implementing the complex steps of the present invention is provided with reference to the accompanying drawings.
A low earth orbit satellite management and control station network measurement and control data transmission resource efficiency evaluation method comprises the following steps: constructing a satellite control station network measurement and control data transmission resource efficiency evaluation system; determining the importance degree of the index; calculating the performance subentry indexes of the system task topic; calculating comprehensive indexes of the special efficiency of the system tasks; measuring and controlling to receive thematic efficiency subentry index calculation; measuring and controlling to receive comprehensive performance index calculation of the special subject; calculating the performance subentry index of the data transmission topic; calculating the comprehensive performance index of the data transmission topic; the system can operate thematic efficiency subentry index calculation; the system can operate the comprehensive index calculation of the special efficiency; calculating the performance itemized indexes of the system reliability special topic; calculating the comprehensive performance index of the system reliability topic; and calculating the comprehensive efficiency index of the station network measurement and control data transmission resources. The method aims at comprehensive utilization of space-ground-based resources, and system efficiency, establishes an evaluation system, an analysis evaluation index, an evaluation method and an evaluation model for measuring and controlling receiving resource efficiency of the spacecraft management and control station network, and realizes comprehensive efficiency evaluation of the satellite management and control station network.
The method comprises the following specific steps:
(1) The method comprises the steps of constructing a satellite control station network measurement and control data transmission resource efficiency evaluation system, comprising three-level capability layer indexes, selecting index capabilities which have obvious system efficiency effect and large influence, evaluating, and constructing the aerospace control station network measurement and control data transmission resource evaluation index system by dividing the system performance into 5 second-level index capabilities such as system level capability, measurement and control receiving capability and 22 third-level index capabilities such as measurement and control receiving duration and task satisfaction from the aspect of capability space vector decomposition.
(2) And determining an index importance degree weight coefficient, wherein the weight is a measure of the contribution degree of the elements to the total target. Through weight analysis, the status and the influence degree of each index in the system capability evaluation can be obtained. And inquiring experts in the field of the station network by adopting an expert consultation and survey mode, and grading the importance degree of each index and the index variable.
(3) And calculating the task special efficiency subentry index of the system from the aspects of measuring and controlling the utilization rate of receiving resources, measuring and controlling the receiving time, the task satisfaction degree, the emergency response time satisfaction degree and the like.
(4) And calculating the comprehensive performance index of the system task topic. Firstly, calculating system task special efficiency index weight, constructing a judgment matrix based on index importance expert scoring data of 4 three-level index capabilities such as measurement and control receiving resource utilization rate, measurement and control receiving duration, task satisfaction degree, emergency response time satisfaction degree and the like, and calculating a system task special efficiency index weight vector by adopting an index weight calculation method to obtain the system task special efficiency index weight. And then, based on the four system task performance indexes obtained in the last step, calculating a comprehensive system task performance index by adopting system task topic performance index weight and a calculation method.
(5) Calculating the subitems of the measurement and control receiving efficiency, and calculating the subitems of the measurement and control receiving efficiency from the five aspects of G/T value conformity, tracking precision conformity, data demodulation capacity, polarization capacity, data recording capacity and the like.
(6) And calculating, measuring and controlling a comprehensive index of the efficiency of the received special topic. Firstly, calculating the measurement and control receiving thematic efficiency index weight, constructing a judgment matrix based on index importance expert scoring data with 5 three-level index capabilities such as G/T value conformity, tracking precision conformity, data demodulation capability and the like, and calculating the measurement and control receiving thematic efficiency weight vector by adopting an index weight calculation method to obtain the measurement and control receiving thematic efficiency index weight. And then, based on the five measurement and control receiving thematic efficiency subentry indexes obtained in the last step, calculating a measurement and control receiving thematic efficiency comprehensive index by adopting measurement and control receiving thematic efficiency index weight and a calculation method.
(7) And calculating the partial indexes of the special efficiency of data transmission from two aspects of network bandwidth utilization rate, data transmission accuracy rate and the like.
(8) And calculating the comprehensive performance index of the data transmission topic. Firstly, calculating the performance index weight of the data transmission topic, constructing a judgment matrix based on the data of index importance expert grading of 2 three-level index capabilities of network bandwidth utilization rate and data transmission accuracy, and calculating the performance weight vector of the data transmission topic by adopting an index weight calculation method to obtain the performance index weight of the data transmission topic. Then, based on the 2 data transmission topic performance itemized indexes obtained in the previous step, a data transmission topic performance index weight and a calculation method are adopted to calculate a data transmission topic performance comprehensive index.
(9) The computing system can operate the thematic efficiency subentry indexes, and the system can operate the thematic efficiency subentry indexes in the six aspects of comprehensive task completion rate, key task completion rate, measurement and control receiving station load balance degree, antenna load balance degree, channel load balance degree, recorder load balance degree and the like.
(10) The computing system may run a topical performance integration index. Firstly, calculating the index performance index weight of the system runnability special subject, constructing a judgment matrix by integrating index importance expert scores of six three-level index capabilities such as task completion rate, key task completion rate and the like, and calculating a system runnability special subject performance weight vector by adopting an index weight calculation method to obtain the index weight of the system runnability special subject. And then, calculating the comprehensive index of the system runnability performance by adopting system runnability thematic performance index weight and a calculation method based on the obtained performance subentry indexes of the six systems in the last step.
(11) And calculating the system reliability thematic efficiency itemized indexes from five aspects of system total fault condition, system total fault time conformity, receiving task completion degree, transmission task completion degree, measurement and control task completion degree and the like.
(12) And calculating the comprehensive performance index of the reliability topic of the system. Firstly, calculating index importance expert grading data of five three-level index capabilities, such as system reliability thematic efficiency index weight, system total fault condition, system total fault time conformity and the like to construct a judgment matrix, and calculating a system reliability thematic efficiency weight vector by adopting an index weight calculation method to obtain the system reliability thematic efficiency index weight. And then, based on the five system reliability thematic efficiency subentries obtained in the last step, calculating a system reliability and efficiency comprehensive index by adopting system reliability thematic efficiency index weight and a calculation method.
(13) The computing station network measures and controls the comprehensive efficiency index of the data transmission resource. Firstly, calculating the comprehensive efficiency index weight of station network measurement and control data transmission resources, constructing a judgment matrix based on index importance expert scoring data of five secondary index capabilities such as system task efficiency, measurement and control receiving special subjects and the like, and calculating a system task efficiency weight vector by adopting an index weight calculation method to obtain the system task efficiency index weight. Then, based on the five secondary index results obtained by the previous calculation, the method comprises the following steps: the comprehensive performance index of the system task thematic efficiency, the comprehensive performance index of the measurement and control receiving thematic efficiency, the comprehensive performance index of the data transmission thematic efficiency, the comprehensive performance index of the system operational thematic efficiency and the comprehensive performance index of the system reliability are calculated by adopting the station network measurement and control data transmission resource comprehensive performance index weight and the calculation method.
The following is a more specific example:
as shown in fig. 1, a method for evaluating the efficiency of measurement and control data transmission resources of a network of a low-earth-orbit satellite management and control station includes the following steps:
step 1: system for evaluating efficiency of measurement and control data transmission resources of satellite management and control station network
And constructing a satellite management and control station network measurement and control data transmission resource efficiency evaluation system which comprises three-level capacity layer indexes as shown in figure 2. The first level capability layer index is a top level capability index, namely the comprehensive efficiency of the measurement and control data transmission resource is obtained by comprehensively calculating the second level capability layer index.
The second level capability level index mainly follows the system task thematic efficiency B 1 And measure and control receiving special subject efficiency B 2 Data transmission topic efficiency B 3 System runnability topic performance B 4 System reliability thematic efficiency B 5 Five aspects were evaluated. And each secondary energy layer index is obtained by comprehensively calculating the three-level energy layer indexes.
The three-level capability layer index is generated by carrying out refinement decomposition on the basis of five second-level capability layer indexes. Wherein the performance of the system task topic is measuredControlling data transfer resource usage C 1 And measuring and controlling receiving time length C 2 User demand satisfaction situation C 3 Emergency response time conformity C 4 And evaluating and analyzing in an equiangular manner. Measuring and controlling receiving topic efficiency from G/T value conformity C 5 And the tracking accuracy conformity degree C 6 Data demodulation capability C 7 Polarizing ability C 8 Data recording capability C 9 And the five aspects are evaluated and analyzed. Network bandwidth utilization rate C for data transmission topic efficiency 10 Data transmission accuracy rate C 11 And carrying out evaluation analysis according to the two aspects. System reliability thematic efficiency is from comprehensive task completion rate C 12 Key task completion rate C 13 Load balance degree C of measurement and control receiving station 14 Antenna load balance degree C 15 Demodulator load balance degree C 16 Recorder load balance degree C 17 And evaluating and analyzing in an isocratic mode. System reliability topic efficiency is from system total fault condition C 18 Total system time to failure compliance C 19 Receiving task completion degree C 20 Completion degree of transmission task C 21 And measuring and controlling task completion degree C 22 And the five aspects are evaluated and analyzed.
And 2, step: determining an index importance weighting factor
In order to comprehensively and accurately evaluate the efficiency of the station network measurement and control data transmission resources, the weight of each level index needs to be determined. The determination of the weight is an important ring in the evaluation process and has great influence on the whole evaluation result. The weighted value of each index in the data transmission resource efficiency evaluation index system is measured and controlled by adopting an analytic hierarchy process computing station network.
And inquiring experts in the field of the station network by adopting an expert consultation and survey mode, and grading the importance degree of each index and each index variable. The score requirements of each index and each index variable are as follows: the selectable score of the importance degree of the index is 0-100, wherein 100 indicates that the index is extremely important, 0 indicates that the index is not important, and the index is more important as the score is higher. After the expert consults the table, the 40 experts are consulted. The expert scores of each index are graded item by item, and the average value is calculated item by item, namely the final expert score is shown in table 1.
Table 1 station network measurement and control data transmission resource comprehensive efficiency a 1 Lower level index importance expert scoring
And 3, step 3: task efficiency itemized index of computing system
And evaluating the task efficiency index of the system from the four aspects of the utilization rate of the measurement and control receiving resource, the measurement and control receiving time, the task satisfaction degree and the emergency response time according to the usage mode of the measurement and control data transmission resource. The composition of the system task topic performance is shown in FIG. 3.
(1) Measuring and controlling receiving resource utilization rate
Measurement and control receiving resource utilization rate C 1 The index expresses the utilization condition of the station network measurement and control receiving resources in a period of time, shows whether the equipment resources of the measurement and control receiving station are fully applied or not, and is defined as the ratio of the total time of the equipment of the measurement and control receiving station in service to the total time of ephemeris.
T normal : measuring and controlling the total normal working time of the equipment to which the receiving station belongs;
T total : and measuring and controlling the total time of the equipment to which the receiving station belongs to providing service in the ephemeris time.
(2) Measuring and controlling receive duration
Measuring and controlling receiving time length C 2 The time length is defined as the measurement and control receiving time length of all measurement and control receiving stations in the station network in a period of time. One of the final purposes of the system is to inject satellite measurement and control instructions and receive satellite downlink data, and the measurement and control receiving time length index can directly reflect the station networkThe system has the measurement and control receiving capability and evaluates important indexes of whether the layout of the measurement and control receiving station is optimized.
T fact : actual measurement and control of the receive duration over a period of time;
T theory : and the domestic station observes and controls the extreme value of the receiving time.
(3) Degree of task satisfaction
Degree of task satisfaction C 3 The method is defined as the arrangement condition of the measurement and control receiving task application, namely the ratio of the number of tasks arranged to be received by measurement and control to the number of the task application arranged to be received by measurement and control.
The task satisfaction reflects the satisfaction condition of the system for the measurement and control receiving task application, and the higher the index is, the better the measurement and control receiving task application satisfaction of the user is.
N apply : measuring and controlling the number of received task applications;
N schedule : and measuring and controlling the arrangement number of the receiving tasks.
(4) Emergency response time compliance
Emergency response time compliance C 4 The time for the final data to reach the destination is defined as the time from the acceptance of the emergency task through the links of task planning, data receiving, data transmission and the like, and the reaction is the speed of the task execution reaction of the system under the emergency condition.
In order to correctly and objectively evaluate the emergency response time index, system operation data in a period of time are selected, the time average value of the data reaching the destination after the emergency task is accepted is calculated, the time average value is divided by the emergency response time index and then multiplied by 100, whether the emergency response time meets the index requirement can be obtained, and the final score is less than or equal to 100 because the full score is 100. If the measured emergency response time is better than the indicator requirement, the indicator is counted as full score.
Wherein:
actualTime i : emergency response time;
design time: designing indexes of emergency response time;
n: the total number of emergency tasks;
i: i is more than or equal to 1 and less than or equal to n for the recorded times of the emergency response time.
And 4, step 4: comprehensive performance index of task topic of computing system
First, the system task topic performance index weight is calculated.
Constructing a system task efficiency index B according to data in expert consultation results in table 1 1 The data used for the construction of the judgment matrix is shown in table 2.
TABLE 2 System task topic Performance index B 1 Expert consultation results
| Serial number | Index name | Mean value |
| 1 | Measuring and controlling data transmission resource usage (C) 1 ) | 88.95 |
| 2 | Measuring and controlling receive duration (C) 2 ) | 50.60 |
| 3 | User demand fulfillment scenario (C) 3 ) | 94.60 |
| 4 | Emergency response time (C) 4 ) | 68.625 |
Calculating the index B according to the above calculation method 1 Judgment matrix C corresponding to expert consultation result B1 Judgment matrix C B1 See table 3.
TABLE 3 decision matrix C B1
| C 1 | C 2 | C 3 | C 4 | |
| C 1 | 1 | 7/4 | 1 | 9/7 |
| C 2 | 4/7 | 1 | 8/15 | 3/4 |
| C 3 | 1 | 15/8 | 1 | 11/8 |
| C 4 | 7/9 | 4/3 | 8/11 | 1 |
Index B 1 The weight calculation process of (2):
(1) Calculating a judgment matrix C B1 Maximum eigenvalue of
Obtaining a judgment matrix C through matrix calculation B1 Has a maximum eigenvalue lambda of 4.0006.
(2) Finding out the eigenvector corresponding to the maximum eigenvalue
The eigenvector corresponding to the maximum eigenvalue λ =4.0006 obtained by matrix calculation is Q = [0.5805 0.3277 0.6006.4416 ].
(3) Weight calculation
The feature vector Q is normalized to be the feature vector W.
Calculating to obtain: w = [0.2976 0.1680.3079 0.2264];
(4) Performing consistency verification of the judgment matrix
Substituting the value of λ of 4.0006 into the calculation to obtain C I ＝2.1247×10-4，R I (4)＝0.90。
C is calculated according to the formula (4-1) R ＝2.3608×10-4＜0.01。
And judging that the matrix meets the consistency requirement according to the calculation result.
Therefore, the system task performance index B can be obtained 1 The weight vector of (1) is W = [ 0.29760.1680.3079 0.2264 = [ 0.29760.1680.3079 =]. Therefore, measuring and controlling the data transmission resource use condition C 1 And measuring and controlling receiving time length C 2 User demand satisfaction situation C 3 And the emergency response time conformity C 4 The weight vectors of (a) are: 0.2976, 0.1680, 0.3079 and 0.2264.
Then, based on the four-item index of the system task efficiency obtained in the last step (measuring and controlling the data transmission resource use condition C) 1 And measuring and controlling receiving time length C 2 User demand satisfaction situation C 3 Emergency response time conformity C 4 ) Calculating the system task efficiency comprehensive result, index B, by using the previously calculated system task efficiency index weight 1 The calculation formula is as follows:
B 1 ＝0.2976C 1 +0.168C 2 +0.3079C 3 +0.2264C 4 formula (5)
And 5: calculating, measuring and controlling receiving thematic efficiency subentry index
According to the using mode of the measurement and control receiving station, measurement and control receiving efficiency indexes are reflected from the five aspects of G/T value conformity, tracking precision conformity, data demodulation capacity, polarization capacity, data recording capacity and the like, and the components of the measurement and control receiving special efficiency indexes are shown in figure 4.
(1) G/T value conformity
The G/T value conformity is the integral comprehensive reaction of the receiving branch (including antenna gain, noise temperature and receiver noise temperature) of the measurement and control receiving station. The specific calculation formula of the G/T value is
Where Gr is the antenna gain, ta is the antenna noise temperature translated to the receiver input, and Te is the receiver noise temperature.
Wherein:
M G/T : test values for G/T values;
I G/T : G/T value.
If M is G/T Greater than or equal to I G/T Then C is 5 The value was 100 points; otherwise, M is calculated G/T Relative to G/T The deviation of (2).
(2) Tracking accuracy conformity
The tracking accuracy refers to the maximum deviation between the tracking pointing direction of the receiving antenna and the position of a receiving target. In the actual data receiving process, due to the existence of the tracking deviation, the receiving gain of the data receiving antenna in the actual receiving process is smaller than the maximum gain of the antenna, and the difference between the two is generally called the tracking loss. Different tracking accuracy corresponds to different tracking losses, the higher the tracking accuracy of the receiving antenna is, the smaller the deviation between the tracking position of the antenna and the actual position of the receiving target is, and the smaller the tracking loss is. A smaller tracking accuracy means a larger tracking loss of the antenna, which results in a larger gain loss of the receiving antenna, which is equivalent to a lower G/T value of the system.
The tracking accuracy is generally described in terms of relative error. The relative error of the tracking precision refers to the ratio of the error value between the tracking direction of the system antenna and the actual position of the tracked target to the beam width of the system antenna, and is recorded as delta.
Generally, the relative error of the tracking accuracy is different from 1/10 to 1/2, and generally, the antenna tracking capability is greatly reduced when the relative error is larger than 1/2.
The relative error of tracking precision is data of exponential change, and the calculation formula adopts an exponential function. The calculation formula is as follows:
C 6 ＝100×e -2.73×Δ formula (7)
(3) Data demodulation capability
Data demodulation capability is primarily evaluated from the demodulation rate. The demodulation code rate refers to the range of code rates of the received signal that can be accommodated.
To evaluate the demodulation capability corresponding to different code rates, different weights are designed for different code rate ranges. The specific weights are as follows:
low code rate S 1 :1kbps to 10Mbps and the weight is 0.1;
medium code rate S 2 :10 Mbps-100 Mbps and the weight is 0.2;
high code rate S 3 :100 Mbps-600 Mbps and weight of 0.3;
ultra high code rate S 4 More than 600Mbps, and the weight is 0.4.
If the demodulator has the demodulation capability of the corresponding rate, the score is 100, and if the demodulator does not have the demodulation capability, the score is 0. Therefore, the calculation formula of the data demodulation capability is:
C 7 ＝S 1 ×0.2+S 2 ×0.2+S 3 ×0.3+S 4 x 0.3 equation (8)
(4) Ability to polarize
And (5) adopting polarization isolation conformity to characterize the receiving polarization capability. Polarization isolation is defined as the ratio of the received power in a given direction from the polarized wave in which information is expected to be transmitted to the power received by another orthogonal polarized wave.
The deviation of the polarization isolation from the index value is calculated as an evaluation value for the index. Polarizing power C 8 The calculation formula of (c) is as follows:
C 8 ＝100×e -1.11M formula (9)
And M is a polarization isolation test value.
(5) Data recording capability
Data recording capability index C 9 Is the rate of the satellite data received falling. The data recording capability index shows the adaptability of the receiving system to the data downloaded by the satellite.
The data recording capability is evaluated for two paths of data respectively. For each path, the meeting index is 100 points, and every 10Mbps reduction, 1 point is subtracted, and the lowest point is 0 point. The calculation formula for C9 is as follows:
wherein:
V I1 : a first path of data record index value;
V M1 : recording a test value by the first path of data;
V I2 : recording an index value by the second path of data;
V M2 : and recording the test value by the second path of data.
Step 6: calculating, measuring and controlling receiving efficiency comprehensive index
Firstly, calculating the weight of the efficiency index of the test control receiving topic.
Constructing, measuring, controlling and receiving thematic efficiency index B according to data in expert consultation results in table 1 2 The data used for the decision matrix construction are shown in table 4.
TABLE 4 index B 2 Expert consultation results
| Serial number | Index name | Mean value |
| 1 | G/T value conformity (C) 5 ) | 89.9 |
| 2 | Tracking accuracy conformity (C) 6 ) | 50.025 |
| 3 | Data demodulation capability (C) 7 ) | 49.725 |
| 4 | Ability to polarize (C) 8 ) | 39.75 |
| 5 | Data recording capability (C) 9 ) | 29.7 |
Calculating the index B according to the above calculation method 2 Judgment matrix C corresponding to expert consultation result B2 Judgment matrix C B2 See table 5.
TABLE 5 decision matrix C B2
Index B 2 The weight calculation process of (2):
(1) Calculating a judgment matrix C B2 Maximum eigenvalue of
Obtaining a judgment matrix C through matrix calculation B2 Has a maximum eigenvalue lambda of 5.
(2) Finding out the eigenvector corresponding to the maximum eigenvalue
The eigenvector corresponding to the maximum eigenvalue λ =5 obtained by matrix calculation is Q = [0.7206 0.4003.4003.3203.2402 ].
(3) Weight calculation
The feature vector Q is normalized to be the feature vector W.
Calculating to obtain: w = [0.3462 0.1923.1923.1530.1154 ];
(4) Performing consistency verification of the judgment matrix
Substituting the value of 5 for lambda into the calculated C I ＝0，R I (5)＝1.12。
C is calculated according to the formula (1) R ＝0＜0.01。
And judging that the matrix meets the consistency requirement according to the calculation result.
Thus, the index B can be obtained 2 Is W = [0.3462 0.1923 0.19230.1538 0.1154 = [ weight vector of (2) ]]. Therefore, the G/T value coincidence degree C 5 And the conformity of tracking accuracy C 6 Data demodulation capability C 7 Polarizing ability C 8 Data recording capability C 9 ：0.3462、0.1923、0.1923、0.1538、0.1154。
Then, based on the five-item index (G/T value conformity C) of the measurement and control receiving efficiency obtained in the last step 5 And the tracking accuracy conformity degree C 6 Data demodulation capability C 7 Polarizing ability C 8 Data recording capability C 9 ) Calculating the overall efficiency comprehensive result of the measurement and control receiving by adopting the previously calculated measurement and control receiving resource comprehensive efficiency index weight 2 The calculation formula is as follows:
B 2 ＝0.3462C 5 +0.1923C 6 +0.1923C 7 +0.1538C 8 +0.1154C 9 formula (11)
And 7: calculating topical performance itemized index of data transmission
Key factors in data transmission are considered, and the performance indexes of the data transmission topic are reflected from two aspects of network bandwidth utilization rate, data transmission accuracy rate and the like. The composition of the performance indicators for data transmission topics is shown in fig. 5.
(1) Network bandwidth utilization
The network bandwidth utilization rate is the ratio of the data volume received and transmitted per second to the network bandwidth, and is used for reflecting the bandwidth utilization condition of the transmission data network link.
The network bandwidth utilization rate is an index for evaluating network load, and the larger the network bandwidth utilization rate is, the better the network utilization condition is.
The method for calculating the network bandwidth utilization rate comprises the following steps: average transmission rate/network of transmission tasksTotal physical bandwidth of the link. Network bandwidth utilization rate evaluation index C of network link 10 The calculation formula of (c) is:
C 10 ＝R mean /BandWidth formula (12)
R mean Is the average transmission rate of the transmission task;
the BandWidth is the total physical BandWidth of the network link.
(2) Data transmission accuracy
Data transmission accuracy rate C 11 The method is defined as the accuracy of software control data after transmission on a physical link, and represents the requirement of the system on the data transmission accuracy.
The data transmission accuracy is 100 minutes when the data transmission accuracy is 100%, and 0 minutes when the data transmission accuracy is less than 100%. Therefore, data transmission accuracy rate C 11 The calculation formula of (2) is as follows:
where x represents the tested data transmission accuracy.
And 8: calculating data transmission topic efficiency comprehensive index
Constructing a data transmission topic efficiency index B according to data in the expert consultation result shown in Table 1 3 The judgment matrix of (1) and the data used for the construction of the judgment matrix are shown in Table 6.
TABLE 6 index B 3 Expert consultation results
| Serial number | Index name | Mean value |
| 1 | Network bandwidth utilization (C) 10 ) | 29.375 |
| 2 | Data transmission accuracy (C) 11 ) | 89.625 |
Calculating the index B according to the above calculation method 3 Judgment matrix C corresponding to expert consultation result B3 Judgment matrix C B3 See table 7.
TABLE 7 decision matrix C B3
| C 10 | C 11 | |
| C 10 | 1 | 1/3 |
| C 11 | 3 | 1 |
Index B 3 The weight calculation process of (2):
(1) Calculating a judgment matrix C B3 Maximum eigenvalue of
Calculated by matrixTo the judgment matrix C B3 Has a maximum eigenvalue λ of 2.
(2) Finding out the eigenvector corresponding to the maximum eigenvalue
When the maximum eigenvalue λ =2 is obtained by matrix calculation, the corresponding eigenvector is Q = [0.3162 0.9487].
(3) Weight calculation
The feature vector Q is normalized to be the feature vector W.
Calculating to obtain: w = [0.250.75];
(4) Performing consistency verification of the judgment matrix
Because the judgment matrix is a two-dimensional matrix, the judgment matrix always has complete consistency.
Thus, the index B can be obtained 3 Is W = [0.250.75 = []. Therefore, the network bandwidth utilization rate C 10 Data transmission accuracy rate C 11 The weight vectors of (a) are: 0.25, 0.75.
Then, based on the four-item index of the data transmission topic efficiency (network bandwidth utilization rate C) obtained in the last step 10 Data transmission accuracy rate C 11 ) Calculating the comprehensive result of the special efficiency of data transmission by using the previously calculated index weight of the special efficiency of data transmission, index B 3 The calculation formula is as follows:
B 3 ＝0.25C 10 +0.75C 11 formula (14)
And step 9: computing system runnability topic performance itemized index
According to the service operation mode of the system, the system operability special efficiency index can be reflected from the hexagonal aspects of comprehensive task completion rate, key task completion rate, measurement and control receiving station load balance degree, antenna load balance degree, demodulator load balance degree, recorder load balance degree and the like. System runnability topic performance index B 4 The composition of (2) is shown in FIG. 6.
(1) Overall task completion rate
Comprehensive task completion rate C 12 The total number of tasks successfully executed by all the measurement and control receiving stations in the station network in a period of time and all tasks required to be executedThe ratio of the total number of services. The overall task completion rate reflects the overall task completion.
In order to evaluate the comprehensive task completion rate index correctly and objectively, system operation data in a period of time are selected, the total task quantity and the number of completed tasks are counted, and the ratio of the two quantities is multiplied by 100 to obtain the comprehensive task completion rate index evaluation value. The calculation formula of the comprehensive task completion rate index is as follows:
C 12 ＝N c /N t x100 formula (15)
N t For the number of tasks that need to be performed, N c The number of tasks that are successfully executed.
(2) Completion rate of critical tasks
Completion rate of critical tasks C 13 The definition of (2) is the ratio of the total number of all important tasks successfully executed by all measurement and control receiving stations in the station network to the total number of all important tasks required to be executed in a period of time. The critical task completion rate reflects the important task completion.
In order to evaluate the key task completion rate index correctly and objectively, system operation data in a period of time is selected, the number of important tasks and the number of completed important tasks are counted, and the ratio of the two numbers is multiplied by 100 to obtain the key task completion rate index evaluation value. The calculation formula of the key task completion rate index is as follows:
C 13 ＝N i /N t x 100 formula (16)
N t For the number of important tasks that need to be performed, N i The number of important tasks to be successfully performed.
(3) Measuring and controlling load balance degree of receiving station
And the load balance degree of the measurement and control receiving station reflects the difference between the load condition of the measurement and control receiving station and the ideal load condition during task allocation.
In an ideal situation, the receiving duration of each receiving station should be load balanced, but in actual operation, due to differences between the receiving capability and the ground transmission capability of each measurement and control receiving station, the workload rates of each receiving station are not exactly the same but are different. In order to scientifically and reasonably evaluate the load rate of the measurement and control receiving station, a receiving weight needs to be defined for each measurement and control receiving station, and the receiving weight is used as a target of load balancing.
In order to describe the load condition of the measurement and control receiving station, the load rate balance degree of the measurement and control receiving station is used as a quantitative index, and the mean value of the load rate offset degrees of all the measurement and control receiving stations is calculated and used as an evaluation value of the load balance degree index of the measurement and control receiving station.
The calculation formula is as follows:
the time length of the task executed by the measurement and control receiving station i is recorded as t i The reception weight is denoted as a i N is the number of the measurement and control receiving stations, and i is more than or equal to 1 and less than or equal to n.
(4) Degree of antenna load balance
The difference between the load condition of the antenna equipment in the measurement and control receiving station and the load balance during the antenna load balance degree reaction task allocation is defined as the ratio of the working time of a single antenna in a certain measurement and control receiving station to the total working time of all antennas of the measurement and control receiving station.
Ideally, the operation time lengths of all the antennas should be load balanced, but in practice, due to the difference in the capabilities of the antennas, the operation load ratios of each antenna are not exactly the same but different. In order to scientifically and reasonably evaluate the work load rate of all the antennas, a use weight needs to be defined for each antenna, and the use weight is used as a target of load balancing.
In order to describe the load condition of the measurement and control receiving station, the antenna load rate deviation is used as a quantization index, and the mean value of all the antenna load rate deviation is calculated and used as the evaluation value of the antenna load rate index.
The time length of the antenna i for executing the task is recorded as t i And the use weight is denoted as a i And n is the number of the antennas, i is more than or equal to 1 and less than or equal to n, the calculation formula of the antenna load rate is as follows:
(5) Demodulator load balancing
When the demodulator load balance degree reflects task allocation, the difference between the load condition of demodulator equipment in the measurement and control receiving station and the load balance is defined as the ratio of the working time of a single demodulator in a certain measurement and control receiving station to the total working time of all demodulators in the measurement and control receiving station.
Ideally, the operation time lengths of all demodulators should be load balanced, but in practice, the difference in the capabilities of the demodulator devices will cause the operation load rate of each demodulator not to be exactly the same but to be different. In order to scientifically and reasonably evaluate the loading rate of the demodulators, a use weight needs to be defined for each demodulator, and the use weight is used as a target of load balancing.
In order to describe the loading condition of the demodulator device, the load rate deviation of the demodulator is taken as a quantization index, and the average value of the load rate deviation of all the demodulators is calculated and taken as the evaluation value of the load rate index of the antenna.
The duration of the task executed by demodulator i is recorded as t i The use weight is denoted as a i N is the number of demodulator devices, i is more than or equal to 1 and less than or equal to n, the calculation formula of the load rate of the demodulator is as follows:
(6) Recorder load balancing
The difference between the load condition of recorder equipment in the measurement and control receiving station and the load balance during the task allocation is defined as the ratio of the working time of a single recorder of a certain measurement and control receiving station to the total working time of all the recorders of the measurement and control receiving station.
Ideally, the operating time of each recorder should be relatively load balanced, but in practice, the load rate of each recorder is not exactly the same but different due to differences in the capabilities of the recorders. In order to scientifically and reasonably evaluate the recorder load rate, a use weight needs to be defined for each recorder, and the use weight is used as a target of load balancing.
In order to describe the load condition of the recorder, the load rate deviation degree of the recorder is used as a quantization index, and the mean value of the load rate deviation degrees of all the recorders is calculated and used as an evaluation value of the load rate index of the recorder.
The duration of the task executed by the recorder i is recorded as t i And the use weight is denoted as a i N is the number of recorders, i is more than or equal to 1 and less than or equal to n, the load factor calculation formula of the recorders is as follows:
step 10: comprehensive performance index of computer system
Constructing a system operability special subject performance index B according to data in the expert consultation result shown in Table 1 4 The data used for the construction of the judgment matrix is shown in table 8.
TABLE 8 index B 4 Expert consultation results
Calculating the index B according to the above calculation method 4 Judgment matrix C corresponding to expert consultation result B4 Judgment matrix C B4 See table 9.
TABLE 9 decision matrix C B4
| C 12 | C 13 | C 14 | C 15 | C 16 | C 17 | |
| C 12 | 1 | 1 | 8/5 | 9/7 | 2 | 2 |
| C 13 | 1 | 1 | 11/7 | 9/7 | 2 | 2 |
| C 14 | 5/8 | 7/11 | 1 | 4/5 | 4/3 | 5/4 |
| C 15 | 7/9 | 7/9 | 5/4 | 1 | 8/5 | 11/7 |
| C 16 | 1/2 | 1/2 | 3/4 | 5/8 | 1 | 1 |
| C 17 | 1/2 | 1/2 | 4/5 | 7/11 | 1 | 1 |
Index B 4 The weight calculation process of (2):
(1) Calculating a judgment matrix C B4 Maximum eigenvalue of
Obtaining a judgment matrix C through matrix calculation B4 Has a maximum eigenvalue lambda of 6.0004.
(2) Finding out the eigenvector corresponding to the maximum eigenvalue
And obtaining a corresponding eigenvector Q = [ -0.5345-0.5329-0.3385-0.4187-0.2632-0.2668] when the maximum eigenvalue lambda =6.0004 through matrix calculation.
(3) Weight calculation
The feature vector Q is normalized to be the feature vector W.
Calculating to obtain: w = [0.2270 0.2263.1438.1778.1118 0.1133];
(4) Performing consistency verification of the judgment matrix
Substituting the value of λ of 6.0004 into the calculation yields CI =8.6041 × 10 -5 ，RI(6)＝1.24。
Calculated according to equation (1) CR =6.9388 × 10 -5 ＜0.01。
And judging that the matrix meets the consistency requirement according to the calculation result.
Thus, the index B can be obtained 4 The weight vector of (1) is W = [0.2270 0.2263.1438.1778 0.1118 0.1133]. Therefore, the overall task completion rate C 12 Key task completion rate C 13 Load balance degree C of measurement and control receiving station 14 Antenna load balance degree C 15 Demodulator load balance degree C 16 Recorder load balance degree C 17 The weight vectors of (a) are respectively: 0.2270, 0.2263, 0.1438, 0.1778, 0.1118, 0.1133.
Then, based on the six-item index of the system operability performance (comprehensive task completion rate C) obtained in the last step 12 Key task completion rate C 13 Load balance degree C of measurement and control receiving station 14 Antenna load balance degree C 15 Demodulator load balance degree C 16 Recorder load balance degree C 17 ) Calculating the comprehensive result of the system runnability performance, index B, by using the calculated weights of the indexes of the system runnability performance 4 The calculation formula is as follows:
B 4 ＝0.2270C 12 +0.2263C 13 +0.1438C 14 +0.1778C 15 +0.1118C 16 +0.1133C 17 formula (21)
Step 11: computing system reliability thematic efficiency subentry index
According to the service use mode of system operation, the system reliability thematic efficiency index can be reflected from five aspects of system total fault condition, system total fault time conformity, receiving task completion degree, transmission task completion degree, measurement and control task completion degree and the like. The composition of the system reliability topic performance index is shown in fig. 7.
(1) Total failure condition of system
And counting all faults of the station network system in a period of time, including measurement and control receiving faults, data recording faults, data transmission faults and the like of each measurement and control receiving station.
The system failure frequency reflects the probability of system failure, and the less the failure frequency, the more stable the system and the higher the reliability.
And according to different fault types, different scores are given. And 5 points are counted by receiving the faults, 3 points are counted by recording the faults, and 2 points are counted by transmitting the faults. And according to a fault list summarized by the fault statistical table, scoring according to the specification, and finally subtracting the total score by 100 to obtain a result value of the index.
The calculation formula is as follows:
C 18 ＝max(100-(5×N 1 +3×N 2 +2×N 3 ) 0) formula (22)
N 1 To receive the number of failures, N 2 Recording the number of failures for the data, N 3 The number of transmission failures.
(2) Total system failure time compliance
The system total failure time conformity index C19 mainly represents the deviation between the measured value and the designed value of the mean time between failures MTBF of the station network resource scheduling management system. The higher the conformity of the total fault time of the system is, the more the design requirement of the index is met.
In order to scientifically and objectively evaluate the reliability and thematic performance of the system, the difference of different systems on the reliability requirement needs to be considered, so that the deviation of the failure-free time and the design requirement is selected as the evaluation value of the reliability and thematic performance index of the system.
The calculation formula is as follows:
MTBF m is on average noneTest results of time-to-failure, MTBF d And designing indexes for the average fault-free time.
(3) Receiving task completion
The completion of the reception task indicates the execution of the reception task of the station network system for a certain period of time. The higher the completion degree of the receiving task, the more stable the system is, and the higher the reliability is.
The calculation formula is as follows:
N c for receiving the number of successful tasks, N t Is the total number of times the task is received.
(4) Completion of transmission task
The transmission task completion degree indicates the execution condition of the transmission task of the station network system in a period of time. The higher the transmission task completion degree is, the more stable the system is, and the higher the reliability is.
The calculation formula is as follows:
N c for the number of successful transmission tasks, N t Is the total number of transmission tasks.
(5) Measuring and controlling task completion degree
The measurement and control task completion degree represents the execution condition of the measurement and control task of the station network system in a period of time. The higher the measurement and control task completion degree is, the more stable the system is, and the higher the reliability is.
The calculation formula is as follows:
N c for measuring and controlling the number of successful tasks, N t The total number of tasks is measured and controlled.
Step 12: comprehensive performance index of computing system reliability topic
A decision matrix is constructed from the data in the expert consult results of Table 1, and the data used for the decision matrix construction is shown in Table 10.
TABLE 10 index B 3 Expert consultation results
| Serial number | Index name | Mean value |
| 1 | Total system fault condition (C) 18 ) | 38.50 |
| 2 | Total system failure time compliance (C) 19 ) | 91.175 |
| 3 | Receiving task completion degree (C) 20 ) | 87.35 |
| 4 | Transmission task completion degree (C) 21 ) | 28.375 |
| 5 | Measuring and controlling task completion (C) 22 ) | 89.50 |
Calculating the index B according to the above calculation method 5 Judgment matrix C corresponding to expert consultation result B5 Judgment matrix C B5 See table 11.
TABLE 11 decision matrix C B5
Index B 5 The weight calculation process of (2):
(1) Calculating a judgment matrix C B5 Maximum eigenvalue of
Obtaining a judgment matrix C through matrix calculation B5 Has a maximum eigenvalue λ of 5.0005.
(2) Finding out the eigenvector corresponding to the maximum eigenvalue
When the maximum eigenvalue λ =5.0005 is obtained by matrix calculation, the corresponding eigenvector is Q = [ -0.2373-0.5568-0.5438-0.1770-0.5537].
(3) Weight calculation
The feature vector Q is normalized to be the feature vector W.
Calculating to obtain: w = [ 0.1147.2692 0.2629.0856 0.2676];
(4) Performing consistency verification of the judgment matrix
Substituting a value of 5.0005 for λ into the calculation yields CI =1.2181 × 10 -4 ，RI(5)＝1.12。
Calculated according to equation (1) CR =1.0876 × 10 -4 ＜0.01。
And judging that the matrix meets the consistency requirement according to the calculation result.
Thus, the index B can be obtained 5 The weight vector of (1) is W = [0.1147 0.2692 0.2629.0856 0.2676 = [0.1147 0.2692.2629 =]. Therefore, the total failure condition C of the system 18 And the total failure time conformity degree C of the system 19 Receiving task completion degree C 20 Completion degree of transmission taskC 21 And measuring and controlling task completion degree C 22 The weight vectors of (a) are: 0.1147, 0.2692, 0.2629, 0.0856, 0.2676.
Then, the five-item index of the system reliability thematic efficiency (the total fault condition C of the system) obtained based on the previous step 18 Total system time to failure compliance C 19 Receiving task completion degree C 20 Completion degree of transmission task C 21 And measuring and controlling task completion degree C 22 ) Calculating the system reliability thematic efficiency comprehensive result, index B, by using the calculated system reliability thematic efficiency index weight 5 The calculation formula is as follows:
B 5 ＝0.1147C 18 +0.2692C 19 +0.2629C 20 +0.0856C 21 +0.2676C 22 formula (27)
Step 13: data transmission resource comprehensive efficiency index for measurement and control of computing station network
Firstly, the station network measures and controls the comprehensive efficiency index weight of the data transmission resource.
And constructing a judgment matrix according to the data in the expert consultation result shown in the table 1, wherein the data used for constructing the judgment matrix are shown in a table 12.
TABLE 12 first-class capability layer index A 1 Expert consultation results
| Serial number | Index name | Mean value |
| 1 | System task efficiency (B) 1 ) | 89.35 |
| 2 | Data reception topic performance (B) 2 ) | 79.575 |
| 3 | Special efficiency of data transmission (B) 3 ) | 42.60 |
| 4 | System runnability topic Performance (B) 4 ) | 58.375 |
| 5 | System reliability topic efficiency (B) 5 ) | 60.125 |
In the decision matrix B ij The index i is compared with the index j. For example B 13 Represents the system task performance index (B) 1 ) And data transmission topic efficiency (B) 3 ) The ratio of (a) to (b). According to the results in table 1, the system task performance index expert scored 89.35 points, and the data transmission topic performance expert scored 42.6 points. Therefore, the performance index of the system task is more important than the performance index of the data transmission topic. The construction of the decision matrix was done using a comparative scale of 1-9, see Table 13.
TABLE 13 comparative scaling of decision matrices
| Scale | Of significance |
| 1 | Two elements being equally important |
| 3 | The former being of lesser importance than the latter |
| 5 | The former being significantly more important than the latter |
| 7 | The former being more important than the latter |
| 9 | The former being of extreme importance than the latter |
| 2，4，6，8 | Intermediate value of the above-mentioned adjacent judgment |
When the system task performance index is 1, the ratio of the system task performance index to the data transmission topic performance index (B) 1 /B 3 ) Should be: b is 1 /B 3 =89.35/42.6=2, i.e. B 11 ＝1、B 13 ＝2、B 31 And (5) =1/2. By analogy, the index A can be obtained 1 See table 14.
TABLE 14 decision matrix B
| B 1 | B 2 | B 3 | B 4 | B 5 | |
| B 1 | 1 | 9/8 | 2 | 3/2 | 3/2 |
| B 2 | 8/9 | 1 | 15/8 | 4/3 | 4/3 |
| B 3 | 1/2 | 8/15 | 1 | 3/4 | 5/7 |
| B 4 | 2/3 | 3/4 | 4/3 | 1 | 1 |
| B 5 | 2/3 | 3/4 | 7/5 | 1 | 1 |
Index A 1 And (3) calculating the weight:
(1) Calculating the maximum eigenvalue of the judgment matrix B
And obtaining the maximum eigenvalue lambda of the judgment matrix B to be 5.0004 through matrix calculation.
(2) Finding out the eigenvector corresponding to the maximum eigenvalue
When the maximum eigenvalue λ =5.0004 is obtained by matrix calculation, the corresponding eigenvector is Q = [ -0.5827-0.5235-0.2855-0.3885-0.3923].
(3) Weight calculation
The feature vector Q is normalized to be the feature vector W.
Calculating to obtain: w = [0.2682 0.2410.1314 0.1788.1806 ].
(4) Performing consistency verification of the judgment matrix
Consistency verification index C R The calculation formula of (2) is as follows:
wherein
n is the number of sub-indices, R I Correcting constant values for consistency, and R I ＝[000.580.901.121.241.321.411.451.491.51]. Substituting the value of λ of 5.0004 into the calculation to obtain C I ＝1.0451×10 -4 ，R I (5)＝1.12。
C is calculated according to the formula (28) R ＝9.3315×10 -5 ＜0.01。
And judging that the matrix meets the consistency requirement according to the calculation result.
Therefore, can meanMark A 1 The weight vector of (1) is W = [0.2682 0.2410.1314 0.1788 0.1806]. Therefore, the system task performance index B 1 Data receiving thematic efficiency index B 2 Data transmission topic performance index B 3 And system operability special subject performance index B 4 System reliability thematic efficiency index B 5 The weight vectors of (a) are: 0.2682, 0.241, 0.1314, 0.1788, 0.1806.
Then, based on the five second-level index results (system task thematic efficiency index B) obtained by the previous calculation 1 Data receiving thematic efficiency index B 2 Data transmission topic performance index B 3 And system operability special subject performance index B 4 System reliability thematic efficiency index B 5 ) The station network measurement and control data transmission resource comprehensive efficiency index weight calculated in the foregoing is adopted, and the station network measurement and control data transmission resource comprehensive efficiency comprehensive result, index B, is calculated 5 The calculation formula is as follows:
A 1 ＝0.2682B 1 +0.241B 2 +0.1314B 3 +0.1314B 4 +0.1806B 5 formula (29)
In a word, the invention aims at the comprehensive utilization of space-ground resources and system efficiency, establishes an evaluation system, an analysis evaluation index, an evaluation method and an evaluation model for the measurement and control receiving resource efficiency of the satellite management and control station network, and can realize the comprehensive efficiency evaluation of the satellite management and control station network.
Claims (8)
1. A low earth orbit satellite management and control station network measurement and control data transmission resource efficiency evaluation method is characterized by comprising the following steps:
(1) Constructing a satellite control station network measurement and control data transmission resource efficiency evaluation system, which comprises three-level capability layer indexes, wherein the first-level capability layer index is a top-level capability index, the second-level capability layer indexes comprise system task thematic efficiency, measurement and control receiving thematic efficiency, data transmission thematic efficiency, system operability thematic efficiency and system reliability thematic efficiency, and the three-level capability layer indexes are generated by refining and decomposing based on five second-level capability layer indexes;
(2) Determining an index importance degree weight coefficient, inquiring experts in the field of the station network by adopting an expert consultation and survey mode, and grading the importance degree of each index and index variable;
(3) Calculating the system task thematic efficiency subentry index;
(4) Calculating system task thematic efficiency index weight, and calculating a system task thematic efficiency comprehensive index according to the system task thematic efficiency index weight on the basis of the system task thematic efficiency subentry index obtained in the previous step;
(5) Calculating a measure and control receiving efficiency subentry index;
(6) Calculating the measurement and control receiving thematic efficiency index weight, and calculating a measurement and control receiving thematic efficiency comprehensive index according to the measurement and control receiving thematic efficiency index weight based on the measurement and control receiving efficiency subentry index obtained in the last step;
(7) Calculating the performance itemized indexes of the data transmission topics;
(8) Calculating the data transmission special topic efficiency index weight, and calculating a data transmission special topic efficiency comprehensive index according to the data transmission special topic efficiency index weight based on the data transmission special topic efficiency subentry index obtained in the last step;
(9) Calculating the thematic efficiency subentry index of the system;
(10) Calculating the system runnability thematic performance index weight, calculating a system runnability performance comprehensive index based on the system runnability thematic performance subentry index obtained in the last step and according to the system runnability thematic performance index weight;
(11) Calculating the system reliability thematic efficiency subentry index;
(12) Calculating system reliability thematic efficiency index weight, and calculating a system reliability efficiency comprehensive index according to the system reliability thematic efficiency index weight on the basis of the system reliability thematic efficiency subentry index obtained in the last step;
(13) And calculating the comprehensive efficiency index weight of the station network measurement and control data transmission resources, and calculating the comprehensive efficiency index of the station network measurement and control data transmission resources according to the comprehensive efficiency index weight of the station network measurement and control data transmission resources based on the five secondary index results obtained by the previous calculation.
2. The method for evaluating the efficiency of the measurement, control and data transmission resources of the network of the low-earth-orbit satellite management and control station according to claim 1, wherein in the step 1, the indexes of the third-level energy layer are generated by performing detailed decomposition based on five indexes of the second-level energy layer, and the specific mode is as follows:
(1) System task topic efficiency B 1 Slave measurement and control data transmission resource use condition C 1 And measuring and controlling receiving time length C 2 User demand satisfaction situation C 3 Emergency response time conformity C 4 Evaluating and analyzing;
(2) Observe and control receiving thematic efficiency B 2 From G/T value coincidence degree C 5 And the tracking accuracy conformity degree C 6 Data demodulation capability C 7 Polarizing ability C 8 Data recording capability C 9 Fifthly, evaluation and analysis are carried out;
(3) Data transmission topic efficiency B 3 Slave network bandwidth utilization C 10 Data transmission accuracy rate C 11 Carrying out evaluation analysis on two aspects;
(4) System reliability topic efficiency B 4 From the comprehensive task completion rate C 12 Key task completion rate C 13 And measuring and controlling load balance degree C of receiving station 14 Antenna load balance degree C 15 Demodulator load balance degree C 16 Recorder load balance degree C 17 Evaluating and analyzing the six aspects;
(5) System reliability topic efficiency B 5 Slave system master failure condition C 18 And the total failure time conformity degree C of the system 19 Receiving task completion degree C 20 Completion degree of transmission task C 21 And measuring and controlling task completion degree C 22 And fifthly, evaluation analysis is carried out.
3. The method for evaluating the efficiency of the measurement, control and data transmission resources of the network of the low earth orbit satellite management and control station according to claim 2, wherein the specific method in the step 3 is as follows:
(1) The utilization rate of the measurement and control receiving resources is an index for measuring the service intensity of the measurement and control receiving station, the utilization condition of the measurement and control receiving resources of a station network within a period of time is expressed, and the calculation mode is as follows:
T normal : measuring and controlling the total normal working time of the equipment to which the receiving station belongs;
T total : measuring and controlling the total time of the equipment to which the receiving station belongs for providing service in the ephemeris time;
(2) The measurement and control receiving time length is the measurement and control receiving time length of all the measurement and control receiving stations in the station network in a period, and the calculation mode is as follows:
T fact : actual measurement and control of the receive duration over a period of time;
T theory : the domestic station measures and controls the extreme value of the receiving time;
(3) The task satisfaction is the arrangement condition of measuring and controlling the received task application, and the calculation mode is as follows:
N apply : measuring and controlling the number of received task applications;
N schedule : measuring and controlling the arrangement quantity of the receiving tasks;
(4) The emergency response time conformity reaction system is used for the task execution reaction speed under the emergency condition, and the calculation mode is as follows:
wherein:
actualTime i : emergency response time;
design time: designing indexes of emergency response time;
n: the total number of emergency tasks;
i: i is more than or equal to 1 and less than or equal to n for the recorded times of the emergency response time.
4. The method for evaluating the efficiency of the measurement, control and data transmission resources of the network of the low-earth-orbit satellite management and control station according to claim 2, wherein the specific method in the step 5 is as follows:
(1) The G/T value conformity is the integral comprehensive reaction of the receiving branch of the measurement and control receiving station, and the calculation mode is as follows:
M G/T : test values for G/T values;
I G/T : an index value of the G/T value;
the G/T value is calculated by the formula
Wherein Gr is antenna gain, ta is antenna noise temperature converted to an input port of the receiver, and Te is noise temperature of the receiver;
(2) The tracking precision refers to the maximum deviation between the tracking direction of the receiving antenna and the position of a receiving target, and the calculation method is as follows:
C 6 ＝100×e -2.73×Δ
wherein, Δ is a relative error of the tracking precision, and is a ratio of an error value of the tracking direction of the system antenna and the actual position of the tracking target to the beam width of the system antenna;
(3) The data demodulation capability is evaluated from the demodulation code rate, wherein the demodulation code rate refers to the code rate range of the received signal which can be adapted to;
to evaluate the demodulation capability corresponding to different code rates, different weights are designed for different code rate ranges:
low code rate S 1 :1kbps to 10Mbps with a weight of 0.1；
Medium code rate S 2 :10Mbps to 100Mbps, and the weight is 0.2;
high code rate S 3 :100 Mbps-600 Mbps and weight of 0.3;
ultra high code rate S 4 More than 600Mbps, and the weight is 0.4.
If the demodulator has the demodulation capability of corresponding speed, the time is recorded as 100 minutes, and if the demodulator does not have the demodulation capability of corresponding speed, the time is recorded as 0 minute; the calculation formula of the data demodulation capacity is as follows:
C 7 ＝S 1 ×0.2+S 2 ×0.2+S 3 ×0.3+S 4 ×0.3
(4) The polarization capability is characterized by polarization isolation conformity; polarization isolation is defined as the ratio of the received power to the power received by another orthogonal polarized wave from the polarized wave intended to transmit information in a given direction;
and calculating the deviation of the polarization isolation degree to the index value as an evaluation value of the index, wherein the calculation formula is as follows:
C 8 ＝100×e -1.11M
m is a polarization isolation test value;
(5) Data recording capability index C 9 For the landing rate of the received satellite data, the calculation formula is as follows:
C 9 ＝0.5×(max(100-0.1×(v I1 -v M1 ),0))+0.5×(max(100-0.1×(v I2 -v M2 ),0))
V I1 : a first path of data record index value;
V M1 : recording a test value by the first path of data;
V I2 : recording an index value by the second path of data;
V M2 : and recording the test value by the second path of data.
5. The method for evaluating the efficiency of the measurement, control and data transmission resources of the network of the low earth orbit satellite management and control station according to claim 2, wherein the specific method in the step 7 is as follows:
(1) Network bandwidth utilization
The network bandwidth utilization rate is the ratio of the data volume received and transmitted per second to the network bandwidth and is used for reflecting the bandwidth utilization condition of a transmission data network link;
network bandwidth utilization index C 10 The calculation formula of (c) is:
C 10 ＝R mean /BandWidth
R mean is the average transmission rate of the transmission task;
the BandWidth is the total physical BandWidth of the network link;
(2) Data transmission accuracy
Data transmission accuracy rate C 11 The method is defined as the accuracy of software control data after transmission on a physical link, and represents the requirement of the system on the data transmission accuracy;
the data transmission accuracy rate is 100 minutes when the data transmission accuracy rate is 100 percent, and 0 minute when the data transmission accuracy rate is less than 100 percent; data transmission accuracy rate C 11 The calculation formula of (c) is:
where x represents the tested data transmission accuracy.
6. The method for evaluating the efficiency of the measurement, control and data transmission resources of the network of the low earth orbit satellite management and control station according to claim 2, wherein the specific manner of the step 9 is as follows:
(1) Overall task completion rate
Comprehensive task completion rate C 12 The ratio of the total number of the successfully executed tasks of all the measurement and control receiving stations in the station network to the total number of all the tasks needing to be executed in a period of time is represented, and the overall task completion rate reflects the total task completion condition; the calculation formula of the comprehensive task completion rate index is as follows:
C 12 ＝N c /N t ×100
N t for the number of tasks that need to be performed, N c Number of tasks that were successfully executed;
(2) Completion rate of critical tasks
Critical task completion rate C 13 The method comprises the following steps of defining the ratio of the total number of all important tasks successfully executed by all measurement and control receiving stations in a station network to the total number of all important tasks needing to be executed in a period of time, wherein the key task completion rate reflects the completion condition of the important tasks;
the calculation formula of the key task completion rate index is as follows:
C 13 ＝N i /N t ×100
N t for the number of important tasks that need to be performed, N i The number of important tasks to be successfully executed;
(3) Measuring and controlling load balance degree of receiving station
When the load balance degree of the measurement and control receiving station reflects the task distribution, the difference between the load condition of the measurement and control receiving station and the ideal load condition is obtained, and the load rate calculation formula of the measurement and control receiving station is as follows:
the time length of the task executed by the measurement and control receiving station i is recorded as t i Receive weight is denoted as a i N is the number of the measurement and control receiving stations, and i is more than or equal to 1 and less than or equal to n;
(4) Degree of antenna load balance
When the antenna load balance degree reflects the task allocation, the difference between the load condition of antenna equipment in the measurement and control receiving station and the load balance is defined as the ratio of the working time of a single antenna in a certain measurement and control receiving station to the total working time of all antennas in the measurement and control receiving station; the calculation formula is as follows:
the duration of the task executed by the antenna i is recorded as t i The use weight is denoted as a i N is the number of the antennas, and i is more than or equal to 1 and less than or equal to n;
(5) Demodulator load balancing
The demodulator load balance degree reflects the difference between the load condition of demodulator equipment in the measurement and control receiving station and the load balance during task allocation, and is defined as the ratio of the working time of a single demodulator in a certain measurement and control receiving station to the total working time of all demodulators in the measurement and control receiving station; the calculation formula is as follows:
the duration of the task executed by demodulator i is recorded as t i The use weight is denoted as a i N is the number of demodulator devices, i is more than or equal to 1 and less than or equal to n;
(6) Recorder load balancing
The difference between the load condition of recorder equipment in the measurement and control receiving station and the load balance during task allocation is defined as the ratio of the working time of a single recorder of a certain measurement and control receiving station to the total working time of all the recorders of the measurement and control receiving station; the calculation formula is as follows:
the duration of the task executed by the recorder i is recorded as t i And the use weight is denoted as a i N is the number of recorders, and i is more than or equal to 1 and less than or equal to n.
7. The method for evaluating the efficiency of the measurement, control and data transmission resources of the network of the low earth orbit satellite management and control station according to claim 2, wherein the specific manner of the step 11 is as follows:
(1) Total failure condition of system
Counting all faults of the station network system in a period of time, including measurement and control receiving faults, data recording faults and data transmission faults of each measurement and control receiving station;
the system failure frequency reflects the probability of system failure, and the less the failure frequency is, the more stable the system is and the higher the reliability is;
the calculation formula is as follows:
C 18 ＝max(100-(5×N 1 +3×N 2 +2×N 3 ),0)
N 1 to receive the number of failures, N 2 Recording the number of failures, N, for the data 3 The number of transmission failures;
(2) Total system failure time compliance
The system total fault time conformity index mainly represents the deviation between the measured value and the design value of the Mean Time Between Failures (MTBF) of the station network system; the higher the system total fault time conformity is, the more the system total fault time conformity is in accordance with the design requirement of the index;
the calculation formula is as follows:
MTBF m MTBF is the mean time between failure test d Designing an index for the average time without failure;
(3) Receiving task completion
The completion of the receiving task indicates the execution condition of the receiving task of the station network system in a period of time; the higher the completion degree of the received task is, the more stable the system is, and the higher the reliability is;
the calculation formula is as follows:
N c for receiving the number of successful tasks, N t The total number of receiving tasks;
(4) Completion of transmission task
The transmission task completion degree represents the execution condition of the transmission task of the station network system in a period of time; the higher the transmission task completion degree is, the more stable the system is, and the higher the reliability is;
the calculation formula is as follows:
N c to passNumber of successful task transfers, N t The total number of transmission tasks;
(5) Measuring and controlling task completion degree
The measurement and control task completion degree represents the execution condition of the measurement and control task of the station network system in a period of time; the higher the measurement and control task completion degree is, the more stable the system is, and the higher the reliability is;
the calculation formula is as follows:
N c for measuring and controlling the number of successful tasks, N t The total number of tasks is measured and controlled.
8. The method for evaluating the efficiency of measurement and control data transmission resources of the network of the low earth orbit satellite management and control station as claimed in claim 1, wherein in the steps 4, 6, 8, 10 and 12, the calculation method of the five thematic efficiency comprehensive indexes of the system task thematic efficiency, the measurement and control receiving thematic efficiency, the data transmission thematic efficiency, the system operability thematic efficiency and the system reliability thematic efficiency is as follows:
(1) Constructing a judgment matrix according to data in the expert consultation result;
(2) Calculating the maximum characteristic value of the judgment matrix;
(3) Finding out a characteristic vector corresponding to the maximum characteristic value;
(4) Obtaining a characteristic vector W by standardizing the characteristic vector Q;
(5) Performing consistency verification on the judgment matrix to obtain an index weight vector;
(6) And carrying out weighted summation based on the index weight and the subentry index to obtain comprehensive evaluation indexes of the special efficiency.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210840944.4A CN115239115A (en) | 2022-07-18 | 2022-07-18 | Low-earth-orbit satellite control station network measurement and control data transmission resource efficiency evaluation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210840944.4A CN115239115A (en) | 2022-07-18 | 2022-07-18 | Low-earth-orbit satellite control station network measurement and control data transmission resource efficiency evaluation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115239115A true CN115239115A (en) | 2022-10-25 |
Family
ID=83672899
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210840944.4A Pending CN115239115A (en) | 2022-07-18 | 2022-07-18 | Low-earth-orbit satellite control station network measurement and control data transmission resource efficiency evaluation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115239115A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115529249A (en) * | 2022-11-28 | 2022-12-27 | 中国西安卫星测控中心 | Task demand-oriented spaceflight measurement and control data transmission resource configuration evaluation method |
| CN116011889A (en) * | 2023-03-22 | 2023-04-25 | 中国人民解放军国防科技大学 | Multi-satellite measurement and control plan efficiency evaluation method, system and device |
| CN117811961A (en) * | 2024-03-01 | 2024-04-02 | 南京航空航天大学 | Heterogeneous constellation observation efficiency evaluation method facing to offshore moving target |
-
2022
- 2022-07-18 CN CN202210840944.4A patent/CN115239115A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115529249A (en) * | 2022-11-28 | 2022-12-27 | 中国西安卫星测控中心 | Task demand-oriented spaceflight measurement and control data transmission resource configuration evaluation method |
| CN115529249B (en) * | 2022-11-28 | 2023-02-17 | 中国西安卫星测控中心 | Task demand-oriented spaceflight measurement and control data transmission resource configuration evaluation method |
| CN116011889A (en) * | 2023-03-22 | 2023-04-25 | 中国人民解放军国防科技大学 | Multi-satellite measurement and control plan efficiency evaluation method, system and device |
| CN117811961A (en) * | 2024-03-01 | 2024-04-02 | 南京航空航天大学 | Heterogeneous constellation observation efficiency evaluation method facing to offshore moving target |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115239115A (en) | Low-earth-orbit satellite control station network measurement and control data transmission resource efficiency evaluation method | |
| Bluck et al. | Are galactic star formation and quenching governed by local, global, or environmental phenomena? | |
| CN105550323B (en) | Load balance prediction method and prediction analyzer for distributed database | |
| CN107454105B (en) | Multidimensional network security assessment method based on AHP and grey correlation | |
| CN111680388B (en) | Task electronic system reliability data quantification method and device and computer equipment | |
| CN104331773A (en) | Comprehensive assessment method for power network planning schemes | |
| CN109117651B (en) | Metering data safety protection method | |
| CN113886207A (en) | Method and device for predicting performance of storage system based on convolutional neural network | |
| CN103378903A (en) | Optical network evaluation method | |
| Shao et al. | A comprehensive G-Lz-ADC effectiveness evaluation model for the single communication satellite system in the context of poor information | |
| CN106886620B (en) | Spacecraft test resource optimal configuration method | |
| Qi et al. | An improved adaptive spherical unscented Kalman filtering method for the accurate state‐of‐charge estimation of lithium‐ion batteries | |
| CN114493087A (en) | Satellite efficiency evaluation method and device and electronic equipment | |
| CN115186013B (en) | Data acquisition and analysis method based on aviation equipment | |
| CN108459991A (en) | A method of obtaining equipment dependability data | |
| CN115860526A (en) | Comprehensive performance evaluation method of communication network based on comprehensive fuzzy evaluation | |
| Li et al. | Accelerated reliability demonstration testing design based on reliability allocation of environmental stresses | |
| CN112616160B (en) | Intelligent short-wave frequency cross-frequency-band real-time prediction method and system | |
| Wu et al. | Research on Health State Evaluation Method of Ground-Based TT&C Network | |
| Hu et al. | An edge server placement algorithm based on genetic algorithm | |
| CN116011889B (en) | Multi-satellite measurement and control plan efficiency evaluation method, system and device | |
| CN117692940B (en) | Microwave system performance detection method based on microwave link | |
| Thalia et al. | Comparative performance analysis of information system security using crisp and fuzzy AHP methods | |
| CN113672856A (en) | Hierarchical analysis and evaluation method for distribution network uninterrupted operation capability influence factors | |
| Wang et al. | Fast Assessment of Requests Schedulability in Data Relay Satellite Systems: A Multi-layer Neural Network Method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |