CN101827346A - Automatic test method and device for charge system - Google Patents
Automatic test method and device for charge system Download PDFInfo
- Publication number
- CN101827346A CN101827346A CN200910047257A CN200910047257A CN101827346A CN 101827346 A CN101827346 A CN 101827346A CN 200910047257 A CN200910047257 A CN 200910047257A CN 200910047257 A CN200910047257 A CN 200910047257A CN 101827346 A CN101827346 A CN 101827346A
- Authority
- CN
- China
- Prior art keywords
- wholesale price
- metering data
- charge system
- test cases
- measured
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Meter Arrangements (AREA)
Abstract
The invention discloses an automatic test method and an automatic test device for a charge system. The method comprise that: the automatic test device for the charge system acquires the generated test case, wherein the test case is generated according to charging data subjected to daily actual processing; the automatic test device for the charge system analyzes the test cases to acquire an operating mode of the original charge system, first charging data before rating and first charging data after rating in the test case, and sequentially inputs the first charging data before rating into a charge system to be tested to acquire second charging data after rating of the charge system to be tested, which is output by performing the rating processing by adopting the same operating mode as the operating mode of the original charge system; and the automatic test device for the charge system compares the second charging data after rating with the first charging data after rating to determine whether the charging of the charge system to be tested is accurate. The automatic test method for the charge system can realize automatic generation of the test case and the automatic test on the charge system, and has high test efficiency and accuracy.
Description
Technical field
The present invention relates to the business support field, refer to a kind of charge system automatic test approach and device that is used for the telecommunication service operation support especially.
Background technology
In the telecommunication service OSS, charge system can be carried out wholesale price to user's ticket according to subscriber data.Improve afterwards or the test of the performance (comprising billing accuracy etc.) of the new charge system of exploitation for charge system, certain methods is also arranged at present, but generally all derive from traditional automatic test, the characteristics at charge system are not optimized.Charge system method of testing commonly used comprises following two kinds:
Method one comprises the following steps:
1, starts original charge system, import subscriber data in batches to original charge system.
2, to original charge system input appointment ticket corresponding with subscriber data, original charge system is carried out wholesale price to the ticket of input.
3, obtain subscriber data and corresponding ticket after original charge system wholesale price.
4, start new charge system, to new charge system import in batches with step 1 in identical subscriber data.
5, specify the identical ticket of ticket in the input of new charge system and step 2, new charge system is carried out wholesale price to the ticket of importing.
6,, compare with subscriber data that obtains in the step 3 and corresponding ticket with subscriber data after the new charge system wholesale price and corresponding ticket.
By new charge system ticket is handled the ruuning situation of verifying new charge system, by the billing accuracy of the new charge system of comparison checking.
Method two comprises the following steps:
1, the tester carries out the design of test cases, with information such as subscriber data, tickets, and the typing test cases.
2, start original charge system, automatic or manual is provided with subscriber data in original charge system, imports corresponding ticket, and ticket is carried out wholesale price.
3, subscriber data and the corresponding ticket after the original charge system wholesale price of backup.
4, start new charge system, automatic or manual is provided with subscriber data in new charge system, imports corresponding ticket, and ticket is carried out wholesale price.
5, the subscriber data and the ticket that back up in the subscriber data after the new charge system wholesale price and corresponding ticket and the step 3 are compared.
In the method one because subscriber data is to import in batches, in original charge system and/or new charge system, there is parallel processing, then might be because the processing speed difference of each treatment progress of parallel processing, after a process is handled a record, can obtain next bar record continues to handle, because the genesis sequence to ticket after the wholesale price of original charge system and new charge system does not mate, thereby cause the order of ticket writing in the ticket after original charge system and the wholesale price that new charge system obtains may be different, therefore what cause being in ticket writing correspondence after the wholesale price of same order most probably when comparing is not ticket writing before the same wholesale price, as seen, this comparison method is more coarse, accuracy is lower.
In the method two, test cases relies on tester's manual typing, and efficient is lower, when testing, depends on manual input to a great extent, reflects the ticket distribution situation of actual wholesale price if desired, then needs to do very many statistical analysis work.Cause workload big, testing efficiency is low, and accuracy is not lower yet.
The present application people finds, various charge system method of testing of the prior art all can't realize the automatic test of charge system, can not generate test cases automatically based on the ticket of wholesale price of daily processing, when new charge system has increased the record clauses and subclauses with respect to original charge system, can not realize that test cases is simple, the automatic adjustment of adaptivity, adapting to new charge system, and realize test to new charge system.
Summary of the invention
The embodiment of the invention provides a kind of charge system automatic test approach and device, has solved to realize the charge system problem of test automatically in the prior art, has improved testing efficiency and test accuracy.
A kind of charge system automatic test approach comprises:
Acquisition module is used to obtain the test cases of generation, and described test cases is to generate according to the metering data of daily actual treatment, wherein comprises operational mode, first metering data before the wholesale price and first metering data after the wholesale price of former charge system;
Parsing module is used for described test cases is resolved, first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price;
Scheduler module, be used for first metering data before the described wholesale price is imported charge system to be measured successively, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the wholesale price of wholesale price processing back output;
Comparing module is used for second metering data after the described wholesale price and first metering data after the described wholesale price are compared, and determines whether the charging of described charge system to be measured is accurate.
Said apparatus of the present invention also comprises:
Generation module is used for generating test cases according to the metering data of setting screening conditions that meets that the metering data from daily processing extracts;
The test cases storehouse is used to store the described test cases that described generation module generates;
Described acquisition module specifically is used for directly obtaining the test cases of generation from described generation module; Or obtain the test cases of storing in the described test cases storehouse that generates in advance.
In the said apparatus of the present invention, described generation module specifically comprises:
Screen the unit, be used to obtain the metering data of daily actual treatment, screen according to the screening conditions that set in advance;
First generation unit is used for the metering data that meets described screening conditions selected according to described screening sieve unit, directly generates described test cases;
Second generation unit, be used for according to set with the corresponding adaptation rule of described charge system to be measured, the metering data that meets described screening conditions that described screening sieve unit is selected upgrades, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading.
Said apparatus of the present invention also comprises:
Adaptation module, be used for when determining described test cases and described charge system to be measured and be not complementary, according to set with the corresponding adaptation rule of described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price is not provided with and/or adding described wholesale price and the metering data after the wholesale price are default value, coupling metering data before the wholesale price that obtains being complementary with described charge system to be measured and the coupling metering data after the wholesale price;
Described scheduler module, be used for the coupling metering data before the described wholesale price is imported charge system to be measured successively, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the described wholesale price of wholesale price processing back output;
Described comparing module is used for second metering data after the described wholesale price and the coupling metering data after the described wholesale price are compared, and determines whether the charging of described charge system is accurate.
A kind of charge system automatic test approach comprises:
The charge system automatic testing equipment obtains the test cases of generation, described test cases is to generate according to the metering data of daily actual treatment, wherein comprises operational mode, first metering data before the wholesale price and first metering data after the wholesale price of former charge system;
Described charge system automatic testing equipment is resolved described test cases, first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price;
First metering data of charge system automatic testing equipment before with described wholesale price imported charge system to be measured successively, obtains described charge system to be measured and adopts the operational mode identical with described former charge system operational mode to carry out second metering data after wholesale price is handled the wholesale price of exporting the back;
The charge system automatic testing equipment after with described wholesale price second metering data and first metering data after the described wholesale price compare, determine whether the charging of described charge system to be measured accurate.
According to said method of the present invention, generate test cases, specifically comprise:
Obtain the metering data of daily actual treatment, screen according to the screening conditions that set in advance;
The metering data that meets described screening conditions according to filtering out directly generates described test cases; Or according to set with the corresponding adaptation rule of described charge system to be measured, the metering data that meets described screening conditions that filters out is upgraded, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading.
According to said method of the present invention, the metering data that meets described screening conditions that described basis filters out directly generates described test cases, specifically comprises:
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price, obtain subscriber data and corresponding ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price, and obtain former charge system operational mode;
With first metering data of the original charging data before the described wholesale price before as described wholesale price, with first metering data of the metering data after the described wholesale price after, generate the operational mode, first metering data before the wholesale price and the test cases of first metering data after the wholesale price that comprise described charge system as wholesale price.
According to said method of the present invention, according to set with the corresponding adaptation rule of described charge system to be measured, the metering data that meets described screening conditions that filters out is upgraded, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading, specifically comprise:
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price, obtain subscriber data and corresponding wholesale price ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price, and obtain former charge system operational mode;
According to set with the corresponding adaptation rule of described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price is not provided with and/or adding described wholesale price and the metering data after the wholesale price are default value, obtain renewal metering data before the wholesale price and the renewal metering data after the wholesale price;
With first metering data of the renewal metering data before the wholesale price that obtains before as described wholesale price, with first metering data of the renewal metering data after the wholesale price that obtains after, generate the operational mode, first metering data before the wholesale price and the test cases of first metering data after the wholesale price that comprise described charge system as wholesale price.
According to said method of the present invention, the screening conditions of described setting comprise one of following parameters that comprises in the metering data at least:
At least a relevant billing parameter at least a user profile in the operational mode of charge system, the subscriber data, the ticket.
According to said method of the present invention, after the described parsing test cases, first metering data before the described wholesale price is imported before the charge system to be measured successively, also comprise: determine whether described test cases and described charge system to be measured are complementary, and when coupling, continue to carry out first metering data before the wholesale price is imported this step of charge system to be measured successively; When not matching, described method also comprises in definite result:
According to set with the corresponding adaptation rule of described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price is not provided with and/or adding described wholesale price and the metering data after the wholesale price are default value, coupling metering data before the wholesale price that obtains being complementary with described charge system to be measured and the coupling metering data after the wholesale price;
Coupling metering data before the described wholesale price is imported charge system to be measured successively carry out wholesale price, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the described wholesale price of wholesale price processing back output;
Second metering data after the described wholesale price and the coupling metering data after the described wholesale price are compared, determine whether the charging of described charge system to be measured is accurate.
According to said method of the present invention, whether described definite described test cases and described charge system to be measured are complementary, and specifically comprise:
At least one operational factor that in the operational mode of judging described charge system, comprises, at least a user profile in the subscriber data that comprises in first metering data before the described wholesale price, at least a relevant billing parameter in the ticket that comprises in first metering data before the described wholesale price, at least a relevant billing parameter in the ticket that comprises at least a user profile in the subscriber data that comprises in first metering data after the described wholesale price or first metering data after the described wholesale price, when not being complementary, determine that described test cases and described charge system to be measured are not complementary with the record clauses and subclauses that are provided with in the described charge system to be measured; Otherwise coupling.
According to said method of the present invention, the described test cases that obtains generation specifically comprises:
Metering data according to daily actual treatment generates test cases, directly obtains the described test cases of generation; Or
Obtain the test cases that the metering data according to daily actual treatment of storage in advance generates in the test cases storehouse.
Charge system automatic test approach and device that the embodiment of the invention provides, by obtaining the test cases of generation, and the test cases that obtains resolved first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price; Wherein, test cases is to generate according to the metering data of setting screening conditions that meets that extracts from the metering data of daily processing.First metering data before the wholesale price is imported charge system to be measured successively, after charge system to be measured adopts the operational mode identical with above-mentioned former charge system operational mode to carry out wholesale price, obtain second metering data after the wholesale price; Second metering data after the wholesale price and first metering data after the wholesale price are compared, determine whether the charging of charge system is accurate.Said method not only can be realized the automatic generation of test cases, and can realize the automatic test to charge system to be measured, and its test cases derives from the metering data of daily processing, is used for the test of charge system to be measured, and its data are true, reliable; And can carry out calling automatically, resolve, according to identical pattern data being carried out the wholesale price processing, reached the automatic comparison after charge system to be measured is handled of test cases, testing efficiency and test accuracy are all very high.
Description of drawings
Fig. 1 is the flow chart of charge system automatic test approach in the embodiment of the invention;
Fig. 2 is the adaptive principle schematic of test cases in the embodiment of the invention;
Fig. 3 is the structural representation of charge system automatic testing equipment in the embodiment of the invention.
Embodiment
The charge system automatic test approach that the embodiment of the invention provides, from the handled metering data of the charge system of day-to-day operation, extract and meet the metering data that imposes a condition and generate test cases automatically, offer charge system to be measured charge (wholesale price) by the test cases that calls generation, and with the test cases that generates in the charging result comparison that comprises, verify the billing accuracy of charge system to be measured, test the ruuning situation of charge system to be measured.Its flow process as shown in Figure 1, execution in step is as follows:
Step S101: generate test cases.Wherein, test cases is to generate according to the metering data of the daily actual treatment of obtaining is automatic.
Especially, test cases can be according to the screening conditions that set in advance, filters out to meet the metering data generation of setting screening conditions from the metering data of the daily processing of charge system normally used.
Test cases can generate the test cases generation by the metering data according to daily actual treatment when test needs, and directly uses; Also can generate some test cases and storage in advance, prepare against when testing in the future and use.
Step S102: the test cases that obtains generation.
The test cases that obtains generation comprises: directly obtain the test cases of generation, or obtain the test cases of storing in the test cases storehouse that generates in advance.
Step S103: the test cases that gets access to is resolved first metering data before the former charge system operational mode that is wherein comprised, the wholesale price and first metering data after the wholesale price.
When more than one of the test cases that obtains, adopt the mode of resolving one by one, obtain first metering data before each self-contained former charge system operational mode, the wholesale price and first metering data after the wholesale price respectively.
Step S104: first metering data before the wholesale price that parses is imported charge system to be measured.
First metering data before the wholesale price comprises: the Original CDR of subscriber data before the wholesale price that comprises in the test cases and correspondence etc.
Step S105: charge system to be measured adopts and the identical operational mode of former charge system operational mode that parses, and first metering data before the wholesale price of importing is carried out wholesale price, obtains second metering data after the wholesale price.
Need to prove: when charge system is handled metering data, according to the ticket after the order generation wholesale price of charge system operational mode defined, thereby make by the operational mode of charge system to be measured and former charge system is mated, realize to access ticket writing after the wholesale price of sequence consensus at the metering data before the identical wholesale price.
Step S106: second metering data after the charge system output wholesale price to be measured.
Second metering data after the wholesale price comprises: the ticket after the wholesale price of subscriber data after the charge system wholesale price to be measured and correspondence.
Step S107: first metering data after second metering data after the wholesale price that obtains and the wholesale price that parses in the test cases is compared.
Subscriber data and ticket after the wholesale price that is about to parse in subscriber data after the charge system wholesale price to be measured and the ticket after the corresponding wholesale price and the test cases are compared, with the operation conditions of definite charge system to be measured and the accuracy of charging.
The process that step S101 generates test cases specifically comprises:
Obtain the metering data of daily actual treatment, screen according to setting in advance screening conditions, what filter out meets the metering data of setting screening conditions.Can in every day actual treatment ticket,, filter out the ticket of the screening conditions that meet setting, the pairing charging data record of the ticket of setting screening conditions that meets that filters out is got off according to the screening conditions of typing in advance.Generate test cases according to the metering data of meeting of filtering out setting screening conditions and can comprise following two kinds of situations:
(1) according to the metering data of setting screening conditions that meets that filters out, directly generates test cases.
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price.Obtain subscriber data and corresponding ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price.And obtain former charge system operational mode.
With first metering data of the original charging data before the wholesale price before as wholesale price, with first metering data of the metering data after the wholesale price after, generate the operational mode, first metering data before the wholesale price and the test cases of the various metering datas such as first metering data after the wholesale price that comprise charge system as wholesale price.
In the embodiment of the invention metering data that test cases comprised that generates is called five-tuple, wherein, subscriber data before the wholesale price and corresponding ticket can be referred to as first metering data before the wholesale price, and subscriber data after the wholesale price and corresponding ticket can be referred to as first metering data after the wholesale price.As seen, five-tuple just is meant the related data that wholesale price relates to, and comprising:
(i) operational mode of charge system.
The operational mode of charge system comprises: according to the system time order generate ticket after the wholesale price, press the ticket time sequencing generate ticket after the wholesale price, by ticket or the like after the processing time order generation wholesale price.
The (ii) subscriber data before the wholesale price.
The scope that subscriber data comprises is very extensive, can comprise in the following message one or more:
Users' self such as user brand, product, user gradation, customer relationship curing information; Users' self such as user's no-charge call the number of minutes variable information; To brand, product, user gradation, the customer relationship of end subscriber, the curing of expansion such as user place customer group or available information or the like.
The (iii) Original CDR before the wholesale price.
At least comprise user this employed business and operating position in the Original CDR, operating position can comprise: use duration, data traffic or the like.Can also comprise: system time, ticket time, bill services type, ticket roaming type or the like
The (iv) subscriber data after the wholesale price.
Subscriber data after the wholesale price also can comprise one or more in the information of listing in above-mentioned (1).
Some variations may take place in the subscriber data that the subscriber data after the wholesale price is compared before the wholesale price, and for example: after the ticket wholesale price of user's communication, information such as no-charge call the number of minutes of user may change.
(the v) ticket after the wholesale price.
At least the expense that business produced that comprises this use of user in the ticket after the wholesale price, i.e. the ticket amount of money.
A five-tuple is exactly a complete test cases.For example: can set up a generation module, and use mode such as database to store the test cases of generation.
(2) when variation has taken place with respect to the charge system that generates test cases in charge system to be measured, according to the adaptation rule of setting corresponding with charge system to be measured, the metering data of setting screening conditions that meets that filters out is upgraded, obtain and treat the metering data after the renewal that examining system is complementary, and generate test cases according to the metering data after upgrading.
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price.Obtain subscriber data and corresponding wholesale price ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price.And obtain former charge system operational mode.
The adaptation rule corresponding with charge system to be measured according to setting upgrades original charging data before the wholesale price and the metering data after the wholesale price.Be specially: the record clauses and subclauses that comprise in original charging data before the wholesale price of obtaining and the metering data after the wholesale price are compared with the record clauses and subclauses of charge system setting to be measured.When inequality, if the record clauses and subclauses that the record clauses and subclauses that comprise in original charging data before the wholesale price of obtaining and the metering data after the wholesale price are provided with more than charge system to be measured, then the record clauses and subclauses that are not provided with of the charge system to be measured that comprises in original charging data before the wholesale price that gets access to of deletion and the metering data after the wholesale price; If and/or the record clauses and subclauses that comprise in original charging data before the wholesale price of obtaining and the metering data after the wholesale price are less than the record clauses and subclauses that charge system to be measured is provided with, with the record clauses and subclauses of adding the charge system setting to be measured that it did not comprise in original charging data before wholesale price and the metering data after the wholesale price is default value, obtains preceding renewal metering data of wholesale price and the renewal metering data after the wholesale price.
With first metering data of the renewal metering data before the wholesale price that obtains before as wholesale price, with first metering data of the renewal metering data after the wholesale price that obtains after, generate the operational mode, first metering data before the wholesale price and the test cases of the various metering datas such as first metering data after the wholesale price that comprise charge system as wholesale price.
The variation of above-mentioned charge system can comprise: variation has taken place at least one system operational parameters that comprises in the operational mode of charge system to be measured with respect to the above-mentioned charge system of charge system that generates test cases, variation has taken place at least a user profile in the subscriber data that comprises in first metering data before the wholesale price, variation has taken place at least a relevant billing parameter in the ticket that comprises in first metering data before the wholesale price, variation has taken place at least a user profile in the subscriber data that comprises in first metering data after the wholesale price, or variation or the like has taken place at least a relevant billing parameter in the ticket that comprises in first metering data after the wholesale price; Can also comprise that especially variation has taken place the charge system operational mode.
Increased column etc. in for example a certain the metering data.When then upgrading metering data, the value of the column that increases in this metering data that has taken place to change is made as default value etc.
Concrete screening conditions can be the environmental variances of charge system, i.e. the operational factor that comprises in the operational mode of charge system; Also can be at least a relevant billing parameter in the ticket, for example: system time, ticket time, bill services type, ticket roaming type, ticket amount of money or the like; Can also be at least a user profile in the subscriber data, for example: user brand, product, user gradation, customer relationship, user's no-charge call the number of minutes or the like.
For example: certain operator newly releases after the product of cluster conversation, and original test cases storehouse needs to expand, and promptly needs to generate new test cases.Then can in the case generation module, be configured, screening conditions are provided with as follows:
Air time: 2008.8.10:00～2008.9.10:00;
Ticket matching product: group's cluster basic product, the preferential bag of group's cluster A, the preferential bag of group's cluster B;
Screening time of implementation: 2008.8.10:00～2008.9.12:00.
Generally in order to include the delay ticket in, screening time can proper extension.For example above-mentioned prolongation two hours was exactly in order to include the delay ticket in.
After configuration is finished, charge system is when carrying out normal wholesale price, can start screening sequence, if match the ticket that meets screening conditions, system can call test cases automatically and go into library, the pairing five-tuple of ticket that will meet screening conditions carries out layout, generates test cases, in the typing test cases storehouse.Like this, all of in August, 2008 meet the cluster ticket of setting screening conditions and all have been included into the test cases storehouse, and the integrality of test cases is guaranteed in mode very accurately and efficiently.
Among the step S 103 test cases that gets access to is resolved first metering data before the former charge system operational mode of the meter that is wherein comprised, the wholesale price and first metering data after the wholesale price.Specifically comprise:
By test cases is resolved, original input data when restoring normal wholesale price, comprise first metering data before the former charge system operational mode, wholesale price (comprise the wholesale price that comprises in the test cases before subscriber data and corresponding Original CDR) etc., offer charge system to be measured as original input data; Parsing first metering data after the wholesale price (comprise the wholesale price that comprises in the test cases after subscriber data and corresponding ticket) uses as normal data as a result the time at follow-up contrastive test.
And the system parameterss such as former charge system operational mode by parsing, guarantee that charge system to be measured is consistent with the internal environment and the external environment condition of the charge system that generates test cases.
First metering data among the step S104 before the wholesale price of input charge system to be measured comprises subscriber data before the wholesale price that parses in the test cases and corresponding Original CDR etc.
Among the step S105, when generating second metering data after the wholesale price, be that the order according to former charge system operational mode defined generates.
When comparing among the step S107, ticket after the wholesale price that comprises in ticket after the wholesale price that charge system to be measured is generated according to the order of former charge system operational mode defined and each test cases is compared one by one, obtains the charge system to be measured shared proportion of ticket accurately that charges.
After the step S103, before the step S104, can also comprise: determine whether test cases and described charge system to be measured are complementary, and when coupling, continue to carry out former step S104; When determining test cases and charge system to be measured and not being complementary, according to the adaptation rule of setting corresponding with charge system to be measured before to wholesale price first metering data and first metering data after the wholesale price carry out adaptive, coupling metering data before the wholesale price that obtains being complementary and the coupling metering data after the wholesale price with charge system to be measured.
Wherein, carry out adaptive being specially: the record clauses and subclauses that comprise in original charging data before the wholesale price of obtaining and the metering data after the wholesale price are compared with the record clauses and subclauses of charge system setting to be measured.When inequality, if the record clauses and subclauses that comprise in original charging data before the wholesale price of obtaining and the metering data after the wholesale price, are then deleted the record clauses and subclauses that the charge system to be measured that comprises in original charging data before the wholesale price and the metering data after the wholesale price is not provided with more than the record clauses and subclauses that charge system to be measured is provided with; If and/or the record clauses and subclauses that comprise are less than the record clauses and subclauses that charge system to be measured is provided with in original charging data before the wholesale price of obtaining and the metering data after the wholesale price, are default value with the record clauses and subclauses of adding the charge system setting to be measured that it did not comprise in original charging data before wholesale price and the metering data after the wholesale price.
The principle of the metering data comparison after the test cases charge system wholesale price adaptive and to be measured is illustrated as shown in Figure 2:
According to the adaptation rule of setting corresponding with charge system to be measured, respectively the subscriber data before the wholesale price that comprises in the operational mode of charge system, first metering data before the wholesale price and the Original CDR before the wholesale price are carried out adaptively, obtain subscriber data adaptive before the wholesale price and the adaptive Original CDR before the wholesale price; After adaptive Original CDR before charge system to be measured is to wholesale price charges, obtain adaptive subscriber data after the wholesale price and the adaptive ticket after the wholesale price.Respectively with adaptive subscriber data after the wholesale price and the adaptive ticket after the wholesale price, compare with subscriber data after the wholesale price that comprises in first metering data after the wholesale price and the ticket after the wholesale price, when comparison, consider the adaptation rule corresponding of above-mentioned setting with charge system to be measured.
At least one operational factor that in the operational mode of judging charge system, comprises, at least a user profile in the subscriber data that comprises in first metering data before the wholesale price, at least a relevant billing parameter in the ticket that comprises in first metering data before the wholesale price, at least a relevant billing parameter in the ticket that comprises at least a user profile in the subscriber data that comprises in first metering data after the wholesale price or first metering data after the wholesale price, when not being complementary, determine that this test cases and charge system to be measured are not complementary with the record clauses and subclauses for the treatment of to be provided with in the examining system.
Especially, when charge system to be measured in column setting (being the parameter that comprises in a certain the metering data) variation has taken place with respect to the charge system of extracting test cases, that is to say: variation has taken place in the record clauses and subclauses of setting, for example: when having increased column newly, need carry out adaptive migration to test cases.
For example: charge system to be measured is changed with respect to the charge system that generates test cases: when subscriber data has increased a column newly, the test cases that is generated can't be directly used in charge system to be measured, it is tested, then need to carry out the adaptive migration of test cases.
The embodiment of the invention can realize original test cases is carried out adaptive simply automatically.
Variation has taken place in the transformation by charge system which parameter in the five-tuple as can be known, according to the adaptation rule of setting, after resolving test cases, the value of newly-increased column is set.For example: the value that newly-increased column is set is unified default value.When the metering data after the wholesale price that parses in metering data after the follow-up wholesale price that test is obtained and the test cases is compared, consider this adaptation rule, i.e. other set points that new projects are default value or obtain by default value in the metering data after the wholesale price.For example: for having increased free talk time, the value of these new projects also can be that default value deducts message minute etc.
Among the step S104, need that then the coupling metering data before the wholesale price is imported charge system to be measured successively and carry out wholesale price, obtain second metering data after the charge system employing to be measured operational mode identical with former charge system operational mode carried out the wholesale price of wholesale price processing back output.
Among the step S107, then need second metering data after the wholesale price and the coupling metering data after the wholesale price are compared, determine whether the charging of described charge system to be measured is accurate.
Above-mentioned charge system automatic test approach according to the embodiment of the invention provides can make up a kind of charge system automatic testing equipment, as shown in Figure 3, comprising: acquisition module 101, parsing module 102, scheduler module 103 and comparing module 104.
Parsing module 102 is used for the test cases that acquisition module 101 gets access to is resolved, first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price.
Comparing module 104, first metering data after the wholesale price that second metering data after the wholesale price that is used for scheduler module 103 is obtained and parsing module 102 parse is compared, and determines whether the charging of charge system to be measured is accurate.
Above-mentioned charge system automatic testing equipment also comprises: generation module 105 and test cases storehouse 106.
Preferable, generation module 105 further can comprise: screening unit 1051, first generation unit 1052 or second generation unit 1053.
Test cases storehouse 106 is used to store the test cases that generation module 105 generates.
Above-mentioned charge system automatic testing equipment, also comprise: adaptation module 107, be used for when determining test cases and charge system to be measured and be not complementary, according to the adaptation rule of setting corresponding with charge system to be measured before to the wholesale price that comprises in the test cases first metering data and first metering data after the wholesale price carry out adaptive, deletion before the wholesale price original charging data and the metering data after the wholesale price in the record clauses and subclauses that are not provided with of the charge system described to be measured that comprises and/or be default value with the record clauses and subclauses of adding the charge system setting to be measured that does not comprise in original charging data before the wholesale price and the metering data after the wholesale price, coupling metering data before the wholesale price that obtains being complementary and the coupling metering data after the wholesale price with charge system to be measured.
Comparing module 104 also is used for second metering data after the wholesale price and the coupling metering data after the wholesale price are compared, and determines whether the charging of charge system is accurate.
Above-mentioned charge system automatic test approach and device that the embodiment of the invention provides, screen by metering data daily actual treatment, obtain and meet the metering data generation test cases of setting screening conditions, realized the automatic generation of test cases, the mistake of having avoided the human-edited to occur has easily improved efficient and accuracy.Make to be used to treat that the metering data of examining system derives from the daily deal with data of the charge system of having used, data are objective, true, and the reliability height has high fidelity and confidence level.
Above-mentioned charge system automatic test approach and device that the embodiment of the invention provides, can realize automatic test to all types of service, by obtaining the test cases of generation, and the test cases that obtains resolved first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price; Adopt and the identical operational mode of above-mentioned former charge system operational mode, first metering data before the wholesale price is imported charge system to be measured successively carry out wholesale price, obtain second metering data after the wholesale price; Second metering data after the wholesale price and first metering data after the wholesale price are compared, determine whether the charging of charge system is accurate.Can realize automatic test to charge system to be measured, and can carry out calling automatically, resolve, according to identical pattern data being carried out the wholesale price processing, reached the automatic comparison after charge system to be measured is handled of test cases, testing efficiency and test accuracy are all very high.By the pattern matching of charge system, make the record that is able to metering data after second data after the wholesale price and the wholesale price can be good at coupling in proper order, thereby can access test result more accurately.
And when charge system to be measured has been carried out change with the charge system that generates test cases relatively, can carry out adaptive migration, to adapt to the requirement of charge system to be measured according to the test cases that generates.Adaptive migration can be at the test cases of storing in the test cases storehouse, and the test cases after will upgrading after carrying out adaptive migration is stored in the test cases storehouse; Adaptive migration also can be found to carry out when itself and charge system to be measured do not match after obtaining test cases, and flexibility height, adaptability are strong.
The above; only be the preferable embodiment of the present invention; but protection scope of the present invention is not limited thereto; anyly be familiar with those skilled in the art in the technical scope that the present invention discloses; the variation that can expect easily, replace or be applied to other similar devices, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of claims.
Claims (12)
1. a charge system automatic testing equipment is characterized in that, comprising:
Acquisition module is used to obtain the test cases of generation, and described test cases is to generate according to the metering data of daily actual treatment, wherein comprises operational mode, first metering data before the wholesale price and first metering data after the wholesale price of former charge system;
Parsing module is used for described test cases is resolved, first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price;
Scheduler module, be used for first metering data before the described wholesale price is imported charge system to be measured successively, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the wholesale price of wholesale price processing back output;
Comparing module is used for second metering data after the described wholesale price and first metering data after the described wholesale price are compared, and determines whether the charging of described charge system to be measured is accurate.
2. device as claimed in claim 1 is characterized in that, also comprises:
Generation module is used for generating test cases according to the metering data of setting screening conditions that meets that the metering data from daily processing extracts;
The test cases storehouse is used to store the described test cases that described generation module generates;
Described acquisition module specifically is used for directly obtaining the test cases of generation from described generation module; Or obtain the test cases of storing in the described test cases storehouse that generates in advance.
3. device as claimed in claim 2 is characterized in that, described generation module specifically comprises:
Screen the unit, be used to obtain the metering data of daily actual treatment, screen according to the screening conditions that set in advance;
First generation unit is used for the metering data that meets described screening conditions selected according to described screening sieve unit, directly generates described test cases;
Second generation unit, be used for according to set with the corresponding adaptation rule of described charge system to be measured, the metering data that meets described screening conditions that described screening sieve unit is selected upgrades, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading.
4. as the arbitrary described device of claim 1-3, it is characterized in that, also comprise:
Adaptation module, be used for when determining described test cases and described charge system to be measured and be not complementary, according to set with the corresponding adaptation rule of described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price is not provided with and/or adding described wholesale price and the metering data after the wholesale price are default value, coupling metering data before the wholesale price that obtains being complementary with described charge system to be measured and the coupling metering data after the wholesale price;
Described scheduler module, be used for the coupling metering data before the described wholesale price is imported charge system to be measured successively, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the described wholesale price of wholesale price processing back output;
Described comparing module is used for second metering data after the described wholesale price and the coupling metering data after the described wholesale price are compared, and determines whether the charging of described charge system is accurate.
5. a charge system automatic test approach is characterized in that, comprising:
The charge system automatic testing equipment obtains the test cases of generation, described test cases is to generate according to the metering data of daily actual treatment, wherein comprises operational mode, first metering data before the wholesale price and first metering data after the wholesale price of former charge system;
Described charge system automatic testing equipment is resolved described test cases, first metering data before the operational mode of the former charge system that is wherein comprised, the wholesale price and first metering data after the wholesale price;
First metering data of charge system automatic testing equipment before with described wholesale price imported charge system to be measured successively, obtains described charge system to be measured and adopts the operational mode identical with described former charge system operational mode to carry out second metering data after wholesale price is handled the wholesale price of exporting the back;
The charge system automatic testing equipment after with described wholesale price second metering data and first metering data after the described wholesale price compare, determine whether the charging of described charge system to be measured accurate.
6. method as claimed in claim 5 is characterized in that, generates test cases, specifically comprises:
Obtain the metering data of daily actual treatment, screen according to the screening conditions that set in advance;
The metering data that meets described screening conditions according to filtering out directly generates described test cases; Or according to set with the corresponding adaptation rule of described charge system to be measured, the metering data that meets described screening conditions that filters out is upgraded, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading.
7. method as claimed in claim 6 is characterized in that, the metering data that meets described screening conditions that described basis filters out directly generates described test cases, specifically comprises:
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price, obtain subscriber data and corresponding ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price, and obtain former charge system operational mode;
With first metering data of the original charging data before the described wholesale price before as described wholesale price, with first metering data of the metering data after the described wholesale price after, generate the operational mode, first metering data before the wholesale price and the test cases of first metering data after the wholesale price that comprise described charge system as wholesale price.
8. method as claimed in claim 6, it is characterized in that, according to set with the corresponding adaptation rule of described charge system to be measured, the metering data that meets described screening conditions that filters out is upgraded, obtain and the described metering data for the treatment of after the renewal that examining system is complementary, and generate described test cases according to the metering data after upgrading, specifically comprise:
Obtain preceding subscriber data and the corresponding Original CDR of wholesale price that comprises in the metering data that meets screening conditions, obtain the preceding original charging data of wholesale price, obtain subscriber data and corresponding wholesale price ticket after the wholesale price that comprises in the metering data that meets screening conditions, obtain the metering data after the wholesale price, and obtain former charge system operational mode;
According to set with the corresponding adaptation rule of described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price is not provided with and/or adding described wholesale price and the metering data after the wholesale price are default value, obtain renewal metering data before the wholesale price and the renewal metering data after the wholesale price;
With first metering data of the renewal metering data before the wholesale price that obtains before as described wholesale price, with first metering data of the renewal metering data after the wholesale price that obtains after, generate the operational mode, first metering data before the wholesale price and the test cases of first metering data after the wholesale price that comprise described charge system as wholesale price.
9. as claim 7 or 8 described methods, it is characterized in that the screening conditions of described setting comprise one of following parameters that comprises in the metering data at least:
At least a relevant billing parameter at least a user profile in the operational mode of charge system, the subscriber data, the ticket.
10. as the arbitrary described method of claim 5-8, it is characterized in that, after the described parsing test cases, first metering data before the described wholesale price is imported before the charge system to be measured successively, also comprise: determine whether described test cases and described charge system to be measured are complementary, and when coupling, continue to carry out first metering data before the wholesale price is imported this step of charge system to be measured successively; When not matching, described method also comprises in definite result:
According to set with the corresponding adaptation rule of described charge system to be measured, the record clauses and subclauses of the charge system setting described to be measured that does not comprise in original charging data before deleting the record clauses and subclauses that the charge system described to be measured that comprises in original charging data before the described wholesale price and the metering data after the wholesale price is not provided with and/or adding described wholesale price and the metering data after the wholesale price are default value, coupling metering data before the wholesale price that obtains being complementary with described charge system to be measured and the coupling metering data after the wholesale price;
Coupling metering data before the described wholesale price is imported charge system to be measured successively carry out wholesale price, obtain second metering data after the described charge system employing to be measured operational mode identical with described former charge system operational mode carried out the described wholesale price of wholesale price processing back output;
Second metering data after the described wholesale price and the coupling metering data after the described wholesale price are compared, determine whether the charging of described charge system to be measured is accurate.
11. method as claimed in claim 10 is characterized in that, whether described definite described test cases and described charge system to be measured are complementary, and specifically comprise:
At least one operational factor that in the operational mode of judging described charge system, comprises, at least a user profile in the subscriber data that comprises in first metering data before the described wholesale price, at least a relevant billing parameter in the ticket that comprises in first metering data before the described wholesale price, at least a relevant billing parameter in the ticket that comprises at least a user profile in the subscriber data that comprises in first metering data after the described wholesale price or first metering data after the described wholesale price, when not being complementary, determine that described test cases and described charge system to be measured are not complementary with the record clauses and subclauses that are provided with in the described charge system to be measured; Otherwise coupling.
12. method as claimed in claim 11 is characterized in that, the described test cases that obtains generation specifically comprises:
Metering data according to daily actual treatment generates test cases, directly obtains the described test cases of generation; Or
Obtain the test cases that the metering data according to daily actual treatment of storage in advance generates in the test cases storehouse.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200910047257 CN101827346B (en) | 2009-03-04 | 2009-03-04 | Automatic test method and device for charge system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200910047257 CN101827346B (en) | 2009-03-04 | 2009-03-04 | Automatic test method and device for charge system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101827346A true CN101827346A (en) | 2010-09-08 |
| CN101827346B CN101827346B (en) | 2013-07-17 |
Family
ID=42691001
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200910047257 Active CN101827346B (en) | 2009-03-04 | 2009-03-04 | Automatic test method and device for charge system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101827346B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102231876A (en) * | 2011-06-24 | 2011-11-02 | 华为软件技术有限公司 | Compatibility test method and device of billing system |
| CN104780074A (en) * | 2015-02-02 | 2015-07-15 | 广州天源迪科信息技术有限公司 | Multi-protocol intelligent message simulation system and method |
| TWI493336B (en) * | 2013-03-20 | 2015-07-21 | Chunghwa Telecom Co Ltd | Application of new case feedback in automated software verification system and its method |
| CN105139184A (en) * | 2015-08-10 | 2015-12-09 | 北京思特奇信息技术股份有限公司 | Diversified data calculation method and diversified data calculation system |
| CN105374131A (en) * | 2015-10-28 | 2016-03-02 | 深圳怡化电脑股份有限公司 | Method and device for automatic testing |
| CN105405220A (en) * | 2015-10-28 | 2016-03-16 | 深圳怡化电脑股份有限公司 | Method and device for automated test |
| WO2017116338A1 (en) | 2015-12-30 | 2017-07-06 | Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi | A verification system for charging changes |
| WO2018171324A1 (en) * | 2017-03-21 | 2018-09-27 | 华为技术有限公司 | Tariff data determination method and device |
| CN109871309A (en) * | 2017-12-04 | 2019-06-11 | 中国移动通信集团公司 | A kind of charge system test cases generation method and system |
| CN110706010A (en) * | 2018-07-09 | 2020-01-17 | 北京京东尚科信息技术有限公司 | Charging model monitoring method and system, computer system and computer readable medium |
| CN111309758A (en) * | 2020-01-19 | 2020-06-19 | 北京金堤科技有限公司 | Charging data verification and comparison method and device |
| CN111367875A (en) * | 2018-12-25 | 2020-07-03 | 中移信息技术有限公司 | Call bill file processing method, system, equipment and medium |
| CN111858291A (en) * | 2019-04-30 | 2020-10-30 | 华为技术有限公司 | Root cause determination method, equipment and system for data abnormity in charging system migration test |
| CN113452533A (en) * | 2020-03-24 | 2021-09-28 | 中国移动通信集团山东有限公司 | Charging self-inspection and self-healing method and device, computer equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1409514A (en) * | 2002-09-10 | 2003-04-09 | 信息产业部通信计量中心 | Charge detector |
| CN1521994A (en) * | 2003-02-14 | 2004-08-18 | 华为技术有限公司 | Method for implementing automatic test of intelligent service |
| WO2007048348A1 (en) * | 2005-10-27 | 2007-05-03 | Huawei Technologies Co., Ltd. | Method and system for realizing advertisement service charging |
-
2009
- 2009-03-04 CN CN 200910047257 patent/CN101827346B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1409514A (en) * | 2002-09-10 | 2003-04-09 | 信息产业部通信计量中心 | Charge detector |
| CN1521994A (en) * | 2003-02-14 | 2004-08-18 | 华为技术有限公司 | Method for implementing automatic test of intelligent service |
| WO2007048348A1 (en) * | 2005-10-27 | 2007-05-03 | Huawei Technologies Co., Ltd. | Method and system for realizing advertisement service charging |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102231876A (en) * | 2011-06-24 | 2011-11-02 | 华为软件技术有限公司 | Compatibility test method and device of billing system |
| TWI493336B (en) * | 2013-03-20 | 2015-07-21 | Chunghwa Telecom Co Ltd | Application of new case feedback in automated software verification system and its method |
| CN104780074A (en) * | 2015-02-02 | 2015-07-15 | 广州天源迪科信息技术有限公司 | Multi-protocol intelligent message simulation system and method |
| CN104780074B (en) * | 2015-02-02 | 2018-04-06 | 广州天源迪科信息技术有限公司 | Multi-protocols smart message analogue system and method |
| CN105139184A (en) * | 2015-08-10 | 2015-12-09 | 北京思特奇信息技术股份有限公司 | Diversified data calculation method and diversified data calculation system |
| CN105374131A (en) * | 2015-10-28 | 2016-03-02 | 深圳怡化电脑股份有限公司 | Method and device for automatic testing |
| CN105405220A (en) * | 2015-10-28 | 2016-03-16 | 深圳怡化电脑股份有限公司 | Method and device for automated test |
| WO2017116338A1 (en) | 2015-12-30 | 2017-07-06 | Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi | A verification system for charging changes |
| WO2018171324A1 (en) * | 2017-03-21 | 2018-09-27 | 华为技术有限公司 | Tariff data determination method and device |
| US10750031B2 (en) | 2017-03-21 | 2020-08-18 | Huawei Technologies Co., Ltd. | Tariff data determining method and apparatus for creating the same |
| CN109871309A (en) * | 2017-12-04 | 2019-06-11 | 中国移动通信集团公司 | A kind of charge system test cases generation method and system |
| CN110706010A (en) * | 2018-07-09 | 2020-01-17 | 北京京东尚科信息技术有限公司 | Charging model monitoring method and system, computer system and computer readable medium |
| CN110706010B (en) * | 2018-07-09 | 2024-04-16 | 北京京东尚科信息技术有限公司 | Charging model monitoring method and system, computer system and computer readable medium |
| CN111367875A (en) * | 2018-12-25 | 2020-07-03 | 中移信息技术有限公司 | Call bill file processing method, system, equipment and medium |
| CN111858291A (en) * | 2019-04-30 | 2020-10-30 | 华为技术有限公司 | Root cause determination method, equipment and system for data abnormity in charging system migration test |
| CN111858291B (en) * | 2019-04-30 | 2022-04-22 | 华为技术有限公司 | Root cause determination method, equipment and system for data abnormity in charging system migration test |
| CN111309758A (en) * | 2020-01-19 | 2020-06-19 | 北京金堤科技有限公司 | Charging data verification and comparison method and device |
| CN111309758B (en) * | 2020-01-19 | 2024-02-13 | 北京金堤科技有限公司 | Charging data verification comparison method and device |
| CN113452533A (en) * | 2020-03-24 | 2021-09-28 | 中国移动通信集团山东有限公司 | Charging self-inspection and self-healing method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101827346B (en) | 2013-07-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101827346B (en) | Automatic test method and device for charge system | |
| CN109871309B (en) | Method and system for generating test case of charging system | |
| CN103150696A (en) | Method and device for selecting potential customer of target value-added service | |
| CN108632047B (en) | Method and device for determining tariff data | |
| CA2677534C (en) | Tariff management test automation | |
| CN103593465A (en) | Method and device for diagnosing abnormality of application popularization channel | |
| CN101730043A (en) | Pricing test method and system | |
| CN111240983A (en) | Method and device for realizing automatic test of telecommunication charging service | |
| EP2090089B1 (en) | Method and system for monitoring traffic revenue flows for communications companies | |
| CN105245396A (en) | Fee verification method and fee verification system | |
| CN102572806A (en) | Mobile terminal adapting system and method based on Msky platform | |
| CN102880549A (en) | Method and device for production test | |
| CN102025555A (en) | Method and device for testing IP multimedia sub-system performance | |
| CN101227349B (en) | Device and method for automatically testing system change | |
| CN105139184A (en) | Diversified data calculation method and diversified data calculation system | |
| CN103902450A (en) | Analyzing method and system of advertisement piece normal behavior in mobile application | |
| CN113452533B (en) | Charging self-inspection and self-healing method and device, computer equipment and storage medium | |
| CN113011869A (en) | Test data generation method and device and computer readable storage medium | |
| CN110166636A (en) | Device, method and the storage medium of pressure test | |
| CN112364058B (en) | Auditing method and device for commodity price configuration | |
| WO2014200427A1 (en) | Verification method and system | |
| CN108763300B (en) | Data query method and device | |
| CN115328979A (en) | Automatic data processing system and method | |
| AU2012241129B2 (en) | Tariff management test automation | |
| CN116703382A (en) | Verification method and device of charging program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |