CN100592691C - Automatic comparison method and system for the consistency test of the network management interface information model - Google Patents

Automatic comparison method and system for the consistency test of the network management interface information model Download PDF

Info

Publication number
CN100592691C
CN100592691C CN200710000530A CN200710000530A CN100592691C CN 100592691 C CN100592691 C CN 100592691C CN 200710000530 A CN200710000530 A CN 200710000530A CN 200710000530 A CN200710000530 A CN 200710000530A CN 100592691 C CN100592691 C CN 100592691C
Authority
CN
China
Prior art keywords
contrast
test
template file
data
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN200710000530A
Other languages
Chinese (zh)
Other versions
CN101009608A (en
Inventor
易学明
张琳峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Telecom Corp Ltd
Original Assignee
China Telecom Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Telecom Corp Ltd filed Critical China Telecom Corp Ltd
Priority to CN200710000530A priority Critical patent/CN100592691C/en
Publication of CN101009608A publication Critical patent/CN101009608A/en
Priority to HK08100012.6A priority patent/HK1109526A1/en
Application granted granted Critical
Publication of CN100592691C publication Critical patent/CN100592691C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The disclosed automatic comparison method for model conformance of network manager interface information comprises: forming the template file for testing; obtaining uploaded data from element to extract test items; comparing precisely or fuzzy these items with template file, and outputting the result.

Description

The automatic control methods and the system of network management interface information model uniformity test
Technical field
The present invention relates generally to mobile communications network management, more particularly, relate to a kind of automatic control methods of network management interface information model uniformity test, wherein, described network management interface model is the network management interface model in the 3G system particularly.
Background technology
The information model uniformity test is a most numerous and diverse and most important part in the whole 3G network management interface test.The information model uniformity test comprises resource allocation model measurement and the test of performance resource model.In 3G webmaster field, the corresponding MO (managed object, Managed Object) of each network element.For example, the managed object that HLR (attaching position register, Home LocationRegister) is corresponding is HlrFunction, and it can regard a class as, and has following attribute:
hlrFunctionId String
hlrNumber String
maxNumImsi int
......。
In a nonrestrictive example, the purpose of resource allocation model uniformity test sees whether there is described HlrFunction object class exactly, will check also simultaneously whether the attribute in this object class follows the attribute unanimity that defines in the standard.
In network management, also need to allow the network element of being managed gather some data from network side.These data are used to carry out statistics and analysis, so that determine the whether normative requirement of performance of network element.For example, for HLR, at 3GPP (3 RdGeneration Partnership Project) in the standard, the data that require it to gather have: get route number of attempt (attGetRoutingInfo), get route number of success (succGetRoutingInfo), the number of success that Provides Roaming Number (succProvideRoamingNumber) ....
The purpose of performance resource model uniformity test is exactly to see that data that network element gathers are whether with the unanimity of code requirement.
In the prior art, the network management interface information model uniformity test is nearly all by manually finishing.In the uniformity test of prior art, not that the data of automatically network element being uploaded are carried out processed, but judge whether compliant of data that network element provides by the mode of artificial comparison, wherein, at first in network element, obtain initial data, then described initial data and test specification are compared, to judge consistency.Usually, the data volume that need compare is very huge.For example, in the uniformity test of TD-SCDMA system, the resource allocation model has more than 400 test item, and the performance resource model has more than 300 test item.Therefore, simple artificial comparison is a kind of mode of very loaded down with trivial details and inefficiency, and thereby is easy to produce mistake in implementation process.
Therefore, need a kind of method of comparing automatically of being used for,, thereby simplify test job so that the network management interface information model uniformity test is intelligent more at uniformity test.
Yet the network management interface test macro of prior art does not all also have fine solution to improve the intellectuality of information model uniformity test and the problem of automaticity.
Therefore, for efficient and the precision simplifying the test of 3G network management interface and improve test job, the intellectuality and the automaticity that improve the information model uniformity test are very significant.
Summary of the invention
The intelligent comparison method that the purpose of this invention is to provide a kind of 3G network management interface information model uniformity test, so that improve the intellectuality and the automaticity of network management interface test macro, thereby simplify the network management interface test, improve the efficient and the precision of test job and reduce error rate.
According to an aspect of the present invention, a kind of automatic control methods that is used for the network management interface information model uniformity test is provided, it may further comprise the steps: be formed for the template file of uniformity test, this template file comprises the data that are used for the resource allocation model measurement and/or is used to carry out the data of performance resource model test; Obtain from network element and to upload data, this uploads the various performance datas that packet purse rope unit gathers the response data and/or the network element of configuration result; From uploading the extracting data test item; Judge whether to start fuzzy way of contrast, if, test item and template file are blured contrast, if not, test item and template file are accurately contrasted.
According to another aspect of the present invention, a kind of automatic comparison system that is used for the network management interface information model uniformity test is provided, described system comprises: the template file storage part, its storage is used for the template file of uniformity test, and this template file comprises the data that are used for the resource allocation model measurement and/or is used to carry out the data of performance resource model test; Network element file acquisition unit is used for obtaining from network element and uploads data, and this uploads the various performance datas that packet purse rope unit gathers the response data and/or the network element of configuration result; Sweep test item extraction unit is used for scanning and uploads data, so that from wherein extracting test item, the test item that extracts is passed to accurate contrast portion and/or fuzzy contrast portion; Contrast portion comprises fuzzy contrast portion and accurate contrast portion; Fuzzy contrast portion is used for the template file that the template file storage part is stored and is blured contrast with the test item that extracts; Accurately contrast portion is used for the template file that the template file storage part is stored and is accurately contrasted with the test item that extracts; And the test result efferent, be used to export comparing result.Described system can also comprise file validation inspection portion, is used to judge the legitimacy of uploading data.
Alternatively, described system also comprises: template file configuration portion is used for generating template file or generating template file automatically according to content measurement according to outer input data, and the template file that is generated is stored in the template file storage part.
The method according to this invention and system handle the initial data that obtains from network element, the information of needs contrast is extracted from initial data, then these information and template file are compared, thereby obtain test result, wherein, described template file is that produce automatically according to test specification or artificial the setting.The method according to this invention and system have saved the process of artificial comparison, simplify the test job purpose thereby reach.In addition, the present invention also provides accurate contrast and two kinds of way of contrast of fuzzy contrast, and this makes the present invention intelligent more.And, in fuzzy contrast, can make comparison process more flexible by the rule that fuzzy contrast is set.
Description of drawings
With reference to accompanying drawing, according to following detailed, can be expressly understood the present invention more, wherein:
Fig. 1 is a flow chart according to an embodiment of the invention;
Fig. 2 is a flow chart according to another embodiment of the invention; And
Fig. 3 is the block diagram of system according to another embodiment of the invention.
Concrete true mode
For the sake of simplicity and for the purpose of clear, the unit in the accompanying drawing needn't proportionally be drawn, and in different accompanying drawings, same reference numbers is represented identical unit.In addition, concisely and not can aspect unnecessary, make the present invention fuzzy for what describe, and omit description and details about known steps and unit.
Those of ordinary skill in the art should be understood that the general description of front and following detailed give an example to invention and illustrate, rather than in order to limit the invention.
The various aspects of books invention are described below with reference to Fig. 1,2 and 3.
In Fig. 1, the flow chart of method 100 according to an embodiment of the invention has been described.
At step S101, the template file that is formed for testing.Described template file can comprise data that are used to be configured the resource model test or the data that are used to carry out the test of performance resource model, perhaps can comprise these two, in addition, can also comprise the data that are used for other uniformity test.Can form described template file by the thinkable variety of way of those of ordinary skills, for example, can perhaps can generate template file automatically according to required test contents by consistency testing system by forming template file by tester's hand input-data.
At step S102, consistency testing system obtains to upload data file from network element.Consistency testing system can obtain to upload data file from network element by variety of way.For example, consistency testing system can obtain to upload data file by wired, wireless, removable storage medium or the thinkable various alternate manners of those skilled in the art.For example, but and without limitation, the described various performance datas that data file can comprise that network element is gathered the response data and the network element of configuration result etc. of uploading.
At step S103, whether data file is uploaded in judgement legal.Whether for example, uploading data file by inspection is the file of xml form, and judges whether upload data file legal: if the xml form, it is legal then to upload data file; Otherwise, illegal.If judge that it is legal uploading data file, proceeds to step S104; Otherwise process finishes.
At step S104, judgement is to start fuzzy way of contrast or accurate way of contrast.Concrete which kind of way of contrast that adopts depends on concrete test case fully.If the standard that the equipment of producer adopts is duplicate with the requirement of test specification, just adopt accurately contrast.If the standard that producer adopts is variant with test specification, just adopt fuzzy contrast.In practice, the standard of producer's employing often appears with the inconsistent situation of test specification.Under such situation, for some test items, can there be some difference in the content of content that producer provides and test specification regulation, but these difference only are pro forma, and substantially, said two devices is consistent.At this moment, adopting fuzzy contrast can avoid producing unnecessary erroneous judgement breaks.Can determine to blur contrast in several ways still is accurately to contrast.For example, but also without limitation, can select way of contrast by graphic user interface, also can wait to judge which kind of mode of employing automatically according to the requirement of uploading data file, test by consistency testing system by the tester.Then, if want to blur contrast, then process proceeds to step S107; Otherwise process proceeds to step S105.
At step S105, consistency testing system scans uploading data file, with from wherein extracting test item.Then, step proceeds to S106.
At step S106, consistency testing system compares test item and the template file that is extracted automatically, thereby produces the result of contrast.Then process proceeds to step S110.
If judge and adopt fuzzy contrast, then after step S104, enter step S107.At step S107, consistency testing system scans uploading data file, with from wherein extracting test item.Then, step proceeds to S108.
At step S108, fuzzy way of contrast is configured.For example, fuzzy contrast rule file is configured, wherein, can specify under which kind of situation test result for consistent and under which kind of situation test result be inconsistent.As a nonrestrictive example, fuzzy contrast rule file can be stored with the xml form.Then, process proceeds to step S109.
At step S109, consistency testing system is compared the test item and the template file that are extracted, and judges according to the rule that is disposed in the fuzzy contrast rule file whether test item is consistent with template file.
For example, in uniformity test to the resource allocation model, it is String that test specification requires the types value of the attribute hlrFunctionId of HlrFunction, but this property value that producer provides but is string, the two equally all is the expression string value, but the former begins with capitalization, and the latter then begins with lowercase.If the accurate situation of contrast, consistency testing system will judge that the property value that network element provides is inconsistent with the property value of code requirement so.But in fact, those skilled in the art will appreciate that the two is consistent.If adopt fuzzy contrast, then just can avoid this erroneous judgement disconnected.
As another nonrestrictive example, in performance resource model uniformity test, the name of certain test item that test specification requires is called: hlrBasicMeasurement; Yet the title that network element provides but is hlrBasicMeas, and the two refers to identical things, substantially is consistent therefore, and just suffix is different.If adopt accurately contrast, then will be judged to this situation inconsistent.Yet, under the situation of fuzzy contrast, can avoid this erroneous judgement disconnected.Consistency testing system produces comparing result as described above.Then, process proceeds to step S110.
At step S110, the comparing result that consistency testing system output is produced.Can be as required the output format of test result be provided with.The output format of test result for example, can be set by the tester.For example, be provided with by graphic user interface by the tester.In addition, system can also have the output format of acquiescence.If the tester does not format, then test result will be with the output format output of system default.Test result data can be come out by printer prints, perhaps test result data is outputed in the test result file, the form of described file for example can be Microsoft Excel file format, MicrosoftWord file format, xml file format or thinkable any other file format of those skilled in the art.
Method 200 according to an improved embodiment of the present invention has been described in Fig. 2.Step S201-S210 in Fig. 2 corresponds respectively to the step S101-S110 among Fig. 1.Difference between the two is, in Fig. 2, execution in step S205 (or S207) before execution in step S204, that is, judgement be accurately contrast or blur contrast before from upload data file, extract test item.Because no matter be accurately contrast or fuzzy contrast, the test item step that all is absolutely necessary is extracted in extraction from upload data file, therefore, in some cases, for example,, the step of extracting test item is merged the complexity that helps simplifying realization, thereby can raise the efficiency and save cost in some cases all under the situation at identical test item in accurate contrast and fuzzy contrast.
Fig. 3 is that explanation is used to realize the block diagram according to the system 300 of improved embodiment of the present invention.System 300 can realize top according to the described method 200 of Fig. 2.
In the system of Fig. 3,, can template file be set by template file configuration portion, and set template file is stored in the template file storage part as nonrestrictive example.Template file configuration portion can be provided with template file by receive template data from the outside, also can produce template file automatically according to required test contents.
Network element file acquisition unit is obtained from network element and is uploaded data file.Can obtain to upload data file from network element by variety of way.For example, can obtain to upload data file by wired, wireless, removable storage medium or the thinkable various alternate manners of those skilled in the art.
Network element file acquisition unit passes to file validation inspection portion with the data file of uploading that is obtained.Whether data file is uploaded in the judgement of file validation inspection portion legal.Then, file validation inspection portion passes to sweep test item extraction unit with the legal data file of uploading.Sweep test item extraction unit is uploaded data file and is scanned, and with from wherein extracting test item, and the test item that is extracted is passed to accurate contrast portion or fuzzy contrast portion or the two.
Alternatively, the way of contrast judging part can be according to the way of contrast from exterior arrangement, and for example according to the way of contrast by tester's configuration, and judgement accurately contrasts or fuzzy contrast.Alternatively, the way of contrast judging part also can wait to judge which kind of way of contrast of employing automatically according to the requirement of uploading data file, test.Alternatively, the way of contrast judging part also can have the setting of acquiescence, under the situation that does not have outside input, can adopt the setting of acquiescence.
According to the way of contrast judgment result, and start the operation of accurate contrast portion or the operation of fuzzy contrast portion.If judge and adopt accurately contrast, then accurately contrast portion compares test item that is extracted and the template file that is stored in the template file storage part; Otherwise, carry out contrast by fuzzy contrast portion.
Can dispose the fuzzy contrast rule file that is used for fuzzy contrast by fuzzy comparative arrangement portion, wherein, can specify under which kind of situation test result for consistent and under which kind of situation test result be inconsistent.As a nonrestrictive example, fuzzy contrast rule file can be stored with the xml form.Fuzzy contrast portion compares test item that is extracted and the template file that is stored in the template file storage part, and judges according to the rule that is disposed in the fuzzy contrast rule file whether test item is consistent with template file.
Fuzzy contrast portion or accurately the result that will contrast of contrast portion export to the output format control part.Output format is provided with the output format that portion can be provided with test result as required.The output format of test result for example, can be set by the tester.For example, be provided with by graphic user interface by the tester.In addition, output format is provided with the output format that portion can also have acquiescence.If the tester does not format, then adopt the output format of system default.The output format control part is provided with the set output format of portion according to output format and outputs test result.For example, the output format control part can output to printer interface with test result, by printer test result is printed.Alternatively, the output format control part can output to test result the file leading-out portion, thereby with the form output of test result with file, further use for test macro or tester, for example, by computer the test result file of output is analyzed, perhaps test result file is significantly studied or the like for the tester on display.
In addition, those of ordinary skill in the art should be appreciated that resource allocation model uniformity test and performance resource model uniformity test can be independent of each other, for example, can only be configured the uniformity test or the performance resource model of resource model.Certainly, as those skilled in the art institute is thinkable, also can be configured resource model uniformity test and performance resource model uniformity test simultaneously.
Can realize method and system of the present invention by variety of way.For example, can by software, hardware, firmware with and combination in any realize method and system of the present invention.In addition, in certain embodiments, the program that the present invention can also be presented as on recording medium to be write down, it comprises the machine readable instructions that is used to realize the method according to this invention.
Although specific embodiment of the present invention is described in detail above by example,, those of ordinary skill in the art should be appreciated that above-mentioned example only is illustrative and be not to be limitation of the present invention.Those of ordinary skill in the art should be understood that can make modification to the foregoing description under the situation that does not break away from the spirit and scope of the present invention.Scope of the present invention is limited to the appended claims.

Claims (9)

1. automatic control methods that is used for the network management interface information model uniformity test, it may further comprise the steps:
Be formed for the template file of uniformity test, described template file comprises the data that are used for the resource allocation model measurement and/or is used to carry out the data of performance resource model test;
Obtain from network element and to upload data, describedly upload the various performance datas that packet purse rope unit gathers the response data and/or the network element of configuration result;
From uploading the extracting data test item;
Judge whether to start fuzzy way of contrast, if, the fuzzy rule that contrasts then is set, test item and template file are blured contrast, if not, then test item and template file are accurately contrasted; And
The output comparing result.
2. method according to claim 1 wherein, was also comprising before uploading the extracting data test item:
Whether data are uploaded in judgement legal, if it is legal to upload data, then continue, otherwise process finishes.
3. method according to claim 1, wherein, described template file is artificial that be provided with or generate automatically according to test specification.
4. automatic comparison system that is used for the network management interface information model uniformity test, described system comprises:
The template file storage part, its storage is used for the template file of uniformity test, and described template file comprises the data that are used for the resource allocation model measurement and/or is used to carry out the data of performance resource model test;
Network element file acquisition unit is used for obtaining from network element and uploads data, describedly uploads the various performance datas that packet purse rope unit gathers the response data and/or the network element of configuration result;
Sweep test item extraction unit is used for scanning and uploads data, so that from wherein extracting test item, the test item that extracts is passed to accurate contrast portion and/or fuzzy contrast portion;
Contrast portion is used for the template file that the template file storage part is stored and is compared with the test item that extracts; And
The test result efferent is used to export comparing result;
Wherein, described contrast portion comprises described fuzzy contrast portion and accurate contrast portion;
Described fuzzy contrast portion is used for the template file that the template file storage part is stored and is blured contrast with the test item that extracts;
Described accurate contrast portion is used for the template file that the template file storage part is stored and is accurately contrasted with the test item that extracts.
5. automatic comparison system according to claim 4 wherein, also comprises the way of contrast judging part, is used for judging according to the way of contrast of exterior arrangement accurately contrasting or fuzzy contrast; According to the way of contrast judgment result, start the operation of described accurate contrast portion or the operation of fuzzy contrast portion.
6. automatic comparison system according to claim 4 wherein, also comprises the way of contrast judging part, is used for judging which kind of way of contrast of employing automatically according to the requirement of uploading data file, test; According to the way of contrast judgment result, start the operation of described accurate contrast portion or the operation of fuzzy contrast portion.
7. automatic comparison system according to claim 4 also comprises: fuzzy comparative arrangement portion is provided with the fuzzy rule that contrasts.
8. automatic comparison system according to claim 4, also comprise: template file configuration portion, be used for generating template file or generating template file automatically, and the template file that is generated is stored in the template file storage part according to test specification according to outer input data.
9. automatic comparison system according to claim 4 also comprises file validation inspection portion;
Described file validation inspection portion is used to receive the data of uploading that described network element file acquisition unit obtained, and judges whether upload data legal, and will be legal upload data passes to sweep test item extraction unit.
CN200710000530A 2007-01-10 2007-01-10 Automatic comparison method and system for the consistency test of the network management interface information model Active CN100592691C (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN200710000530A CN100592691C (en) 2007-01-10 2007-01-10 Automatic comparison method and system for the consistency test of the network management interface information model
HK08100012.6A HK1109526A1 (en) 2007-01-10 2008-01-02 An automatic comparison method and system about network management interface testing implementation conformance statements

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200710000530A CN100592691C (en) 2007-01-10 2007-01-10 Automatic comparison method and system for the consistency test of the network management interface information model

Publications (2)

Publication Number Publication Date
CN101009608A CN101009608A (en) 2007-08-01
CN100592691C true CN100592691C (en) 2010-02-24

Family

ID=38697769

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200710000530A Active CN100592691C (en) 2007-01-10 2007-01-10 Automatic comparison method and system for the consistency test of the network management interface information model

Country Status (2)

Country Link
CN (1) CN100592691C (en)
HK (1) HK1109526A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101867501B (en) * 2010-05-25 2011-12-28 北京宜富泰网络测试实验室有限公司 Method and system for automatically testing consistence of SNMP (Simple Network Management Protocol) interface information model
CN103051467A (en) * 2011-10-17 2013-04-17 中兴通讯股份有限公司 Automatic detecting method and device of northbound interface
CN104731814B (en) * 2013-12-23 2017-12-08 北京宸瑞科技股份有限公司 Data flexibly compare analysis system and method
US10009329B2 (en) 2015-06-23 2018-06-26 Microsoft Technology Licensing, Llc Learned roving authentication profiles
CN115795322B (en) * 2023-01-31 2023-09-26 北京全路通信信号研究设计院集团有限公司 Railway configuration data comparison method, device, electronic equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1196146A (en) * 1995-08-16 1998-10-14 泰斯特瑞有限公司 Network analysis system
CN1369791A (en) * 2001-02-14 2002-09-18 英业达股份有限公司 Method for testing communication equipment of computer
CN1462132A (en) * 2002-05-30 2003-12-17 安捷伦科技有限公司 Testing network communication
US6697870B1 (en) * 2000-01-28 2004-02-24 Networks Associates Technology, Inc. Method and apparatus for real-time protocol analysis using an auto-throttling front end process
CN1630255A (en) * 2003-12-17 2005-06-22 安捷伦科技有限公司 Systems and methods for analyzing the selection of measurements of a communication network
CN1703015A (en) * 2004-05-25 2005-11-30 安捷伦科技有限公司 Real-time network analysis software
CN1753540A (en) * 2004-09-24 2006-03-29 安捷伦科技有限公司 Method of remotely monitoring and troubleshooting multiple radio network controllers

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1196146A (en) * 1995-08-16 1998-10-14 泰斯特瑞有限公司 Network analysis system
US6697870B1 (en) * 2000-01-28 2004-02-24 Networks Associates Technology, Inc. Method and apparatus for real-time protocol analysis using an auto-throttling front end process
CN1369791A (en) * 2001-02-14 2002-09-18 英业达股份有限公司 Method for testing communication equipment of computer
CN1462132A (en) * 2002-05-30 2003-12-17 安捷伦科技有限公司 Testing network communication
CN1630255A (en) * 2003-12-17 2005-06-22 安捷伦科技有限公司 Systems and methods for analyzing the selection of measurements of a communication network
CN1703015A (en) * 2004-05-25 2005-11-30 安捷伦科技有限公司 Real-time network analysis software
CN1753540A (en) * 2004-09-24 2006-03-29 安捷伦科技有限公司 Method of remotely monitoring and troubleshooting multiple radio network controllers

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
网络协议栈软件的自动化测试研究与实现. 刘渊,范晓岚,王开云,姜建国.计算机工程与应用,第2005年第15期. 2005
网络协议栈软件的自动化测试研究与实现. 刘渊,范晓岚,王开云,姜建国.计算机工程与应用,第15期. 2005 *

Also Published As

Publication number Publication date
HK1109526A1 (en) 2008-06-06
CN101009608A (en) 2007-08-01

Similar Documents

Publication Publication Date Title
CN104679658B (en) The test method and system of WEB page
CN100592691C (en) Automatic comparison method and system for the consistency test of the network management interface information model
US9152521B2 (en) Systems and methods for testing content of mobile communication devices
CN106776294B (en) Automatic android mobile phone testing method and system
CN110673847A (en) Configuration page generation method and device, electronic equipment and readable storage medium
US8881973B2 (en) Connection setting method using barcode pattern, connection setting system and user equipment thereof
CN111198815B (en) Compatibility testing method and device for user interface
CN107832217A (en) A kind of automated testing method and device
CN107704282A (en) A kind of loading method and device applied to embedded system
CN106447295A (en) Sign-off file template generation method and apparatus thereof
JP2017010277A (en) Work analysis system and work analysis method
CN104156199B (en) A kind of automatic continuous integrated approach of software and system
CN109002390A (en) A kind of test case dynamic state of parameters configuration method and device
CN105988943B (en) A kind of method and device driving wireless adapter
CN109828764A (en) Generation, method for burn-recording and its equipment of recordable paper
CN109902083A (en) Method, apparatus, computer storage medium and the terminal of a kind of pair of mark processing
CN103914377B (en) Interface test method and device
CN106446848B (en) A kind of sign-off file identification method and device
CN112507685B (en) YANG file verification method and device, electronic equipment and storage medium
CN105468514B (en) Test method and device based on data combination
CN103699482A (en) Method and device for testing reasonableness of controls
CN104239214B (en) A kind of method and apparatus of configuration testing script
WO2013017054A1 (en) Method and apparatus for automatically generating case scripts
CN115695267B (en) Data interface-oriented testing and verifying method and device
US8464212B2 (en) Method, apparatus and storage medium for customizing application

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1109526

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1109526

Country of ref document: HK