CN109471791A - A kind of demand response communication consistency testing system and method - Google Patents
A kind of demand response communication consistency testing system and method Download PDFInfo
- Publication number
- CN109471791A CN109471791A CN201811115458.6A CN201811115458A CN109471791A CN 109471791 A CN109471791 A CN 109471791A CN 201811115458 A CN201811115458 A CN 201811115458A CN 109471791 A CN109471791 A CN 109471791A
- Authority
- CN
- China
- Prior art keywords
- test
- report
- template
- sample
- submodule
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 464
- 238000000034 method Methods 0.000 title claims abstract description 81
- 230000004044 response Effects 0.000 title claims abstract description 69
- 238000004891 communication Methods 0.000 title abstract description 26
- 230000008569 process Effects 0.000 claims abstract description 62
- 238000010998 test method Methods 0.000 claims abstract description 13
- 238000012544 monitoring process Methods 0.000 claims description 30
- 238000007792 addition Methods 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 11
- 238000012217 deletion Methods 0.000 claims description 11
- 230000037430 deletion Effects 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000010276 construction Methods 0.000 claims description 6
- 230000010354 integration Effects 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 claims 1
- 238000011161 development Methods 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 27
- 238000004590 computer program Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 238000012790 confirmation Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
Abstract
The present invention relates to a kind of demand response communication consistency testing system and methods, comprising: configurations module, test and management module and report output module；The configurations module is arranged for the assembling of definition, test template to test case, system constant, and use-case is expanded and modified；The test and management module is monitored for providing test process configuration and test execution entrance and test process；The report output module generates test report for comparing test record and preset test by standard.A kind of demand response communication consistency testing system provided by the invention and method, when solving the establishments of normative documents such as starting demand response information exchange specification, uniformity test specification, the problem of lacking corresponding test macro, test method, removes the obstacles and provides safeguard for the development of demand response.
Description
Technical field
The invention belongs to demand response technical fields, and in particular to a kind of demand response communication consistency testing system and side
Method.
Background technique
DSM work starting is more early, and demand response business also enters relatively stable developing stage, but
In terms of demand response business automation implementation, however it remains many problems, what Lao Lunsi Berkeley laboratory was researched and developed thus opens
It puts the automatic demand response of formula (OpenADR) specification gradually to promote and apply, open automatic demand response (OpenADR) specification
Aim to solve the problem that the main website and user's side system, terminal device information interaction energy of different vendor during demand response service implementation
The problem of power difference, while corresponding testing tool is had developed by OpenADR alliance organization units concerned, it has promulgated corresponding consistent
Property test specification, so as to using OpenADR specification demand response system, terminal carry out communication uniformity test detection verifying
Work, has ensured interconnecting for different vendor's demand response product.
With continuing for the policies such as the deep promotion of power system reform, especially Power Market Construction, the relieving of sale of electricity side
Put into effect with the continuous development of related pilot work, be the sustainable development of demand response business established important foundation.Demand response
System operational process is complicated, and participation main body is numerous, and internal system different levels system, the information exchange of terminal are frequent, how to protect
The high efficiency interactive between each system, equipment is demonstrate,proved, becomes the facilitation of demand response business, the key point that automation is implemented.For
Demand response business scale, automation are implemented carrying out and OpenADR the urgent need of demand response communication consistency
The similar work of alliance, starts the establishment of the normative documents such as demand response information exchange specification, uniformity test specification, but by
In lacking corresponding test macro, test method, the development of demand response communication uniformity test work is seriously hindered.
Summary of the invention
When establishment to solve the normative documents such as above-mentioned starting demand response information exchange specification, uniformity test specification,
The problem of lacking corresponding test macro, test method, the present invention provides a kind of demand responses to communicate consistency testing system,
The system comprises: configurations module, test and management module and report output module；
The configurations module is configured for the test case to test macro, test template is assembled, is
System constant is configured；
The test and management module is matched for providing test process for the configured test macro of configurations module
Set with test execution entrance, and to sample carry out test process monitoring, obtain test record；
The report management module generates test for comparing test record and preset test by standard
Report.
Preferably, the configurations module include test case configuration submodule, test template configuration submodule and and
Parameter configuration submodule；
Test case configuration submodule is used for: the service construction that Information Exchange Agreement is provided in advance at use-case, and
The use-case is set into test grade；
The test template configuration submodule is used for: the test grade based on use-case setting carries out the use-case
Integration forms and has gradational test template；
The test template includes: foundation forms, standard form, high-level template and self-defined template；
The parameter configuration submodule is used for: test case based on building and the test template being integrally formed, to test
The constant that other in system meet system operation is configured.
Preferably, the test and management module includes sample management submodule, testing process management submodule and survey
Try process monitoring submodule；
The sample management submodule is used for: it is based on configured use-case, template and parameter in configurations module,
Additions and deletions are carried out to the sample tested and change the management looked into；
The additions and deletions change the content looked into include: demand response system software, the number of hardware and software device, consigner, mailbox,
Vendor name, phone, mailbox, protocol version, description basic parameter；
The testing process management submodule is used for: based on the management to sample, being configured simultaneously to sample
Test execution operation is carried out to the sample postponed；
It is described to sample carry out configuration include: when the attribute of sample be host node when, the content of configuration is
Whether test template selection, protocol version selection encrypt selection, the setting of the address UN, poll time offset setting, work as sample
Attribute when being the next node, the content of configuration be test template selection, protocol version selection, whether encrypt selection, whether into
Row consistency checking；
The content of the test execution operation includes: beginning, pause and end operation；
The test process monitoring submodule is used for: being monitored to the sample after test execution operation, institute
The content for stating monitoring is shown by the page, and forms record.
Preferably, the report management module includes report management submodule and report generation submodule；
Report template management submodule is used for: based on the monitoring content shown by the page, to will test
The sample of report output carries out the selection of test report template；
The report generation submodule is used for: the test report template based on selection, raw after the completion of the test execution
At the test report of sample；
The content of the test report include: the record of test process, test errors type, it is preset test pass through mark
Quasi- and measurand；
The report output submodule is used for: the test report template based on selection, the survey that the sample is generated
Examination report carries out information displaying；
The information of the displaying includes: information measured, tested end title, report name, tests whether to lead to.
It preferably, further include technological debugging module；
The technological debugging module is used to be based on the corresponding survey in unqualified part when the result of test report is unqualified
Example on probation is tested, and exports test report.
Preferably, the technological debugging module includes message analysis submodule and debugging operations submodule；
The debugging operations submodule is used for: being adjusted based on the corresponding test case of error message in the test report
Examination test, and generate debugging test report；
The message analysis submodule is used for: finding corresponding test case based on error message in the test report；
The content of the test sample error is found by the test case found and is modified, will pass through one
The test of cause property.
A kind of demand response communication conformance test method, which comprises
The test case of test macro, test template and system constant are configured by configurations module；
Test process configuration, test execution entrance and test are carried out by test and management module to the test macro set
The monitoring of process, obtains test record；
The test record is compared with preset test by standard by the test record in report management module
Compared with generation test report.
Preferably, described be configured to test case, test template and system constant by configurations module includes:
The service construction that test case submodule in the configurations module in advance provides Information Exchange Agreement at
Use-case, and the use-case is set into test grade；
Test template in the configurations module configures test case of the submodule based on setting, and the test is used
Example is integrated, and is formed and has gradational test template；
The test that in the configurations module parameter configuration submodule the test case based on building and is integrally formed
Template, the constant for meeting system operation to other in test macro are configured；
Wherein, the test template includes: foundation forms, standard form, high-level template and self-defined template.
Preferably, the described pair of system set is entered by test and management module progress test process configuration, test execution
Mouth is monitored with test process, and obtaining test record includes:
In the test and management module sample management submodule be based on configurations module in configured use-case,
Template and parameter carry out additions and deletions to the sample tested and change the management looked into；
The additions and deletions change the content looked into include: demand response system software, the number of hardware and software device, consigner, mailbox,
Vendor name, phone, mailbox, protocol version, description basic parameter；
Testing process management submodule in the test and management module is based on the management to sample, to sample
It carries out configuration and carries out test execution operation to the sample postponed；
It is described to sample carry out configuration include: when the attribute of sample be host node when, the content of configuration is
Whether test template selection, protocol version selection encrypt selection, the setting of the address UN, poll time offset setting, work as sample
Attribute when being the next node, the content of configuration be test template selection, protocol version selection, whether encrypt selection, whether into
Row consistency checking；
The content of the test execution operation includes: beginning, pause and end operation；
Test process monitoring submodule in the test and management module is to the sample after test execution operation
It is monitored, the content of the monitoring is shown by the page, and forms record.
Preferably, the test record is compared with preset test by standard by report output module, it is raw
At test report, comprising:
Report template management submodule in the report management module is based on the monitoring content shown by the page, to general
The sample for carrying out test report output carries out the selection of test report template；
Test report template of the report generation submodule based on selection in the report management module is held in the test
The test report of sample is generated after the completion of row；
The content of the test report include: the record of test process, test errors type, it is preset test pass through mark
Quasi- and measurand；
Test report template of the report output submodule based on selection in the report management module, by the detected sample
The test report that product generate carries out information displaying；
The information of the displaying includes: information measured, tested end title, report name, tests whether to lead to.
Preferably, the method also includes:
When the result of test report be it is unqualified when, technological debugging module be based on the corresponding test case in unqualified part into
Row test, and export test report.
Moreover compared with the immediate prior art, the application is also had the following beneficial effects:
1, a kind of demand response communication consistency testing system provided by the invention and method, configurations module, test
Management module and report output module, the configurations module, are configured for the test case to test macro, are tested
Template is assembled, system constant is configured, the test and management module, for being that the configurations module is configured
Test macro provides test process configuration and test execution entrance, and carries out test process monitoring to sample, is tested
Record, the report management module generate test report for comparing test record and preset test by standard
It accuses, when solving the establishments of normative documents such as starting demand response information exchange specification, uniformity test specification, lacks corresponding
The problem of test macro, test method, removes the obstacles and provides safeguard for the development of demand response.
2, a kind of demand response communication consistency testing system provided by the invention and method, can preferably instruct consistent
Property test macro it is reasonable operation and configuration, when user carry out automatic test encounter problems when, allow user carry out communication tune
Examination helps user preferably to solve the problems, such as.
3, a kind of demand response communication consistency testing system provided by the invention and method, meet communication consistency and survey
The basic function of demand response and the data acquisition of examination, avoids design redundancy, the communication between UN and DN can be neatly realized
And interoperation test.
Detailed description of the invention
Fig. 1 is method system schematic diagram of the invention；
Fig. 2 test macro composed structure；
Fig. 3 communicates Conformance Test Software overall architecture figure；
Fig. 4 automatic test authority module relational graph；
Fig. 5 debugging test authority module relational graph；
Fig. 6 automatic testing process；
Fig. 7 debugs testing process.
Specific embodiment
Below with reference to specific embodiment, explanation is further explained to inventive step of the invention:
Embodiment 1
As shown in Figure 1
The system comprises: configurations module, test and management module and report output module；
The configurations module is arranged for the assembling of definition, test template to test case, system constant, with
And use-case is expanded and is modified；
The test and management module is monitored for providing test process configuration and test execution entrance and test process；
The report output module generates test for comparing test record and preset test by standard
Report.
For concrete function as shown in Fig. 2, system is divided into but also is divided into two kinds of access authority not only, first three module corresponds to automation
Permission is tested, technological debugging module corresponds to debugging test permission.System is supported through local area network local test and passes through public affairs
The remote testing of internet altogether；System had not only supported the uniformity test of demand response system, but also supported to demand response terminal
Uniformity test.System totally uses Three-tider architecture framework, is divided into UN, DN and DN resource layer as shown in Figure 3, can be neatly realized
Communication and interoperation test between UN and DN
The DN or UN be it is self-determining by the attribute of sample, when the attribute of sample is DN, test system
System is exactly UN, otherwise, on the contrary.
Below with reference to specific embodiment, detailed explanation is carried out to system of the invention:
Configurations module includes that test case configures, test template configures, three functions of parameter configuration, can be to test
The definition of use-case, the assembling of test template and the setting of system constant, are built-in with common use-case and template, can also carry out to use-case
It expands and modifies.
Test case configuration feature is used to the service of Information Exchange Agreement being embodied in an executable use-case, to clothes
Business is defined in detail, and interactive step is carried out fine layout.Use-case supports all services of Information Exchange Agreement, supports simultaneously
The unrestricted choice of use-case and update.
The service includes: registration, event, report, participation, inquiry；
The registration service includes:
When starting registration, inquired first from DN using inquiry registration request (QueryRegistrationRequest) to UN
Related registration information, UN respond (CreateRegistrationResponse) to DN return information using creation registration.
When creation registration, creation registration request (CreateRegistrationRequest) is sent from DN to UN first, is removed
Relevant registration information, wherein further including the information such as the transmission mode between DN and UN, UN is in the creation registration for receiving DN
After request, creation registration response (CreateRegistrationResponse) is responded to DN, including interrogation frequency, is passed
The information such as defeated protocol type, service type.
Cancel register request (CancelRegistrationRequest) can be used to other side's cancel register in DN or UN,
The UN or DN for receiving cancel register request utilize cancel register response (CancelRegistrationResponse) confirmation pair
The cancel register request of side.
The Event Service includes:
Event Service includes that query event request and query event respond this pair of service, and DN is according to the regular hour frequency
Dependent event information is inquired to UN using query event request (QueryEventRequest), UN is responded using query event
(QueryEventResponse) to DN return information, if there is demand response plan, contain event information in reply, otherwise not
Contain.
Report services include register report, creation report, cancel report, resource report, real-time report, six pairs of curve report
Service, in which:
Before starting report, phase is inquired to UN using register report request (RegisterReportRequest) from DN first
Registration information is closed, the service is also used to carry out register report request when DN self information changes；Register report is received to ask
The UN asked responds (RegisterReportResponse) to DN return information using register report.
When creation report, creation report request (CreateReportRequest) is sent from UN to DN first, including
The information such as report style；DN responds creation report response after receiving creation report request, to UN
(CreateReportResponse)。
When cancelling report, UN, which is cancelled using cancellation report request (CancelReportRequest) to DN, to be reported, is received
The DN for cancelling report request utilizes the cancellation report request for cancelling report response (CancelReportResponse) confirmation UN.
DN requests resource report to UN using resource report request (ResourceReportRequest), receives resource
The UN of report request replys the request of DN using data report response (DataReportResponse).
DN is reported using real-time report request (MomentDataReportRequest) to UN request real time data, is received
UN to real time data report request is responded using data report response (DataReportResponse).
DN is reported using curve report request (IntervalDataReportRequest) to UN request curve data, is connect
The UN for receiving curve data report request is responded using data report response (DataReportResponse).
Participate in servicing includes that creation participates in, cancels two pairs of services of participation, in which:
DN can freely select to participate in the demand response plan of UN, demand response implementing plan mistake according to the wish of oneself
Cheng Zhong, after the publication of demand response event, DN responds capacity according to self-demand, participates in request using creation
(CreateOptRequest), actively the demand response event of the DN is reported to participate in wish to UN；UN participates in response using creation
(CreateOptResponse) DN is responded.
DN can be used cancellation and participate in that (CancelOptRequest) is requested to request cancellation to participate in demand response plan to UN,
UN participates in request using the cancellation for participating in response (CancelOptResponse) confirmation DN is cancelled.
The inquiry service includes:
DN periodically to UN send inquiry (Poll), UN response DN inquiry service include re-register, cancel register, publication
Report, six pairs of query-response services are cancelled in event, creation report, in which:
Re-register: DN sends inquiry (Poll) to UN, and UN sends (ReregistrationRequest) to DN and infuses again
Volume request, DN send (DrResponse) response to UN, and DN sends (CreateRegistrationRequest) creation note to UN
Volume, UN send (CreateRegistrationResponse) to DN and reply, and show this end of inquiry.
Cancel register: DN sends inquiry (Poll) to UN, and UN sends (CancelRegistrationRequest) to DN and takes
Disappear registration request, and DN sends (CancelRegistrationResponse) to UN and confirms cancel register, shows this inquiry knot
Beam.
Publication event: DN sends inquiry (Poll) to UN, and UN sends (DistributeEventRequest) publication to DN
Event, DN send (CreateEventResponse) to UN and acknowledge receipt of event, show this end of inquiry.
Creation report: DN sends inquiry (Poll) to UN, and UN sends (CreateReportRequest) creation report to DN
Request, DN send (CreateReportResponse) confirmation creation report to UN, show this end of inquiry.
Cancel report: DN sends inquiry (Poll) to UN, and UN sends (CancelReportRequest) to DN and cancels report
Request, DN send (CancelReportResponse) confirmation to UN and cancel report, show this end of inquiry.
Query-response: DN sends inquiry (Poll) to UN, if UN does not have any of the above change, UN is sent to DN
(PollResponse) it is replied, shows this end of inquiry.
Test template configuration feature is for defining an executable test case set, and test template is by use-case according to not
Same standard is brought into different test templates, allows to directly select execution when test execution, thus simplify test process,
Test template is supported to update simultaneously.
Parameter configuration function meets the configuration of system constant, such as UN title, polling interval, responsible party's typing and time-out time
Setting etc..Such constant parameter serves whole system, plays a crucial role during the test.
Explanation to parameter management module:
Test and management module is the nucleus module of consistency testing system, comprising sample management, testing process management,
Test process monitors three functions, provides test process configuration and test execution entrance and test process monitoring function.
The offer of sample management function carries out additions and deletions respectively to tested DN or UN and changes the management looked into, while supporting multiple
Test sample is tested.
Testing process management function is used to carry out DN and UN the necessary configuration of test execution and process operates, wherein including
Simple test configurations and test execution function, for carrying out most necessary configuration to test, the template at such as tested end, version and
The information such as communication pattern, the operation such as the beginning that can be directly tested, pause, end, and can check testing progress.
Test process monitoring function can be tested intuitively in reaction test process, dynamic monitoring for the monitoring to test process
Step simultaneously generates test log.
Explanation to report output module:
Report output module includes report template management, three report generation, report output functions, being capable of binding test note
It records and tests and obtain test result by information such as standards, and test report offer user is provided and checks and downloads.
Report template management function is capable of providing the template of report, and selects the template of report.
Report Generation Function Based test execution complete or at the end of, according to the record of test process, test errors type,
It tests the contents such as standard, the measurand information passed through and automatically generates test report.
The essential information that report output function provides test event is shown, such as tested to hold title, report name, communication mould
Formula, test whether by etc. contents, while providing the inquiry and download function of test report.
Corresponding three above module is automatic test permission, and it is debugging test power that technological debugging module is corresponding
Limit.
Automatic test permission mainly provides automatic test personnel and operates with, and module relationship is as shown in figure 4, can
The test that test is automated.The test case configuration feature of configurations module is responsible for the service of Information Exchange Agreement
Classification is encapsulated as use-case, and built-in use-case library abundant, test template configuration feature match use-case according to different classification standards
It is set to different templates, such as foundation forms, standard form, high-level template, and user is supported to custom-configure function.User can
According to testing requirement, selects any template to carry out automatic test to tested end and monitor implementation procedure.After the completion of execution, according to
By standard and test record specified in template, test result is finally obtained, generate test report.
Debugging test permission serves mainly to facilitate test user and communicates or interoperate debugging, module relationship such as Fig. 5
It is shown, it, then can be according to the open debugging test permission of user demand if test product does not pass through automatic test.Debugging test permission
Profession, flexible communication interaction function are provided, supports that message is customized, communicates the functions such as customized and packet parsing, can help
It tests the quick positioning product problem of user and carries out problem reinspection.Debugging test permission is according to Information Exchange Agreement communication specification
Debugging interface is divided into the debugging of PULL mode and PUSH mode is debugged, is directed to different tests pair under each pattern again by particularity
It is debugged as being divided into UN debugging with DN.
Explanation to debugging module:
Technological debugging module includes two functions of message analysis and debugging operations, is capable of providing tested user self-help debugging
Function and operation.
Debugging operations function can provide different debugging operations from the difference of two kinds of communication patterns of PUSH according to PULL, and
It is debugged respectively for different debugger objects (DN or UN)；There is provided that message is customized and the customized function of testing process simultaneously
Can, facilitate user independently to debug.
Message analysis function provides Information Exchange Agreement special packet and parses function, is straightaway text by packet parsing
Word expression way.
Embodiment 2
The invention further relates to a kind of demand responses to communicate conformance test method:
Step 1: the test case of test macro, test template and system constant are set by configurations module
It sets；
Step 2: test process configuration, test execution entrance are carried out by test and management module to the test macro set
With the monitoring of test process, test record is obtained；
Step 3: the test record is passed through into standard with preset test by the test record in report management module
It is compared, generates test report.
Test case, test template and system constant are configured by configurations module and include:
The service construction that test case submodule in configurations module in advance provides Information Exchange Agreement at use-case,
And the use-case is set into test grade；
Test template in configurations module configures test case of the submodule based on setting, by the test case into
Row integration, forms and has gradational test template；
The test template that in configurations module parameter configuration submodule the test case based on building and is integrally formed,
The constant for meeting system operation to other in test macro is configured；
Wherein, the test template includes: foundation forms, standard form, high-level template and self-defined template.
Test process configuration, test execution entrance and test process are carried out by test and management module to the system set
Monitoring, obtaining test record includes:
Sample management submodule in test and management module is based on configured use-case, template in configurations module
And parameter, additions and deletions are carried out to the sample tested and change the management looked into；
It includes: demand response system software, the number of hardware and software device, consigner, mailbox, producer that additions and deletions, which change the content looked into,
Title, phone, mailbox, protocol version, description basic parameter；
Testing process management submodule in test and management module carries out sample based on the management to sample
It configures and carries out test execution operation to the sample postponed；
Carrying out configuration to sample includes: when the attribute of sample is host node, and the content of configuration is test
Whether stencil-chosen, protocol version selection encrypt selection, the setting of the address UN, poll time offset setting, when the category of sample
Property for the next node when, the content of configuration is test template selection, protocol version selection, whether encrypts selection, whether carries out one
The verifying of cause property；
The content of test execution operation includes: beginning, pause and end operation；
Test process monitoring submodule in test and management module carries out the sample after test execution operation
Monitoring, the content of the monitoring is shown by the page, and forms record.
Test record is compared with preset test by standard by report output module, generates test report,
Include:
The report template management submodule in management module is reported based on the monitoring content shown by the page, to will be into
The sample of row test report output carries out the selection of test report template；
Test report template of the report generation submodule based on selection in management module is reported, after the completion of test execution
Generate the test report of sample；
The content of test report include: the record of test process, the type of test errors, preset test by standard and
Measurand；
Report test report template of the report output submodule based on selection in management module, the sample is raw
At test report carry out information displaying；
The information of displaying includes: information measured, tested end title, report name, tests whether to lead to.
Method further include:
When the result of test report be it is unqualified when, technological debugging module be based on the corresponding test case in unqualified part into
Row test, and export test report.
Embodiment 3
Conformance test method includes automated testing method and adjustment method, wherein automated testing method such as Fig. 6 institute
Show, can be indicated with following below scheme:
Step 1: being adapted to sample, sample is passed through into local area network or public internet access system
In system；
Step 2: being configured in " test case configuration " to test case set；
Step 3: selecting in " test template configuration " the template of test；
Step 4: being configured in " parameter configuration " to system constant；
Enter step 5: clicking " test and management ", increase sample newly in " sample management ", simultaneously " test stream
Thread management " generates a data；
Step 6: clicking " testing process management ", test configurations are carried out, detailed configuration then is carried out to DN and UN.DN
Test configurations content includes test template selection, protocol version selection, whether encrypts selection, whether carries out consistency checking.Its
DN template of the selection of middle test template in " template configuration ".Information when protocol version is according to creation DN is selected
It selects, if only supporting a kind of version, is defaulted as the version；Selection operation is provided if supporting two kinds of version.If whether encrypting not
Configuration is then defaulted as not encrypting.Communication pattern is determined by tested DN, therefore does not need to configure, by automatic identification after test starts
And it generates in the table；UN test configurations content includes test template selection, protocol version selection, whether encrypts selection, UN
Location setting, communication pattern selection, poll time offset setting.Wherein UN of the selection of test template in " template configuration "
Template.Information when protocol version is according to creation DN is selected, if only supporting a kind of version, is defaulted as the version；If branch
It holds two kinds of version and selection operation is then provided.Whether encrypt and is defaulted as not encrypting if not configuring.Communication pattern is according to each test
PULL the PUSH mode used carries out flexible choice.Poll time offset is that the polling interval being arranged for UN is arranged
Shift time.Other than carrying out detailed configuration, can also ease of Use be carried out to common test configurations, directly select mould in the table
Plate, version and communication pattern.
Start to execute in " testing process management " step 7: clicking, starts progress bar after executing and sent out according to testing progress
Changing.
Step 8: test can be suspended or be stopped in " test process monitoring ".Pause test, progress bar are not sent out
It is raw to change, operation of the backstage pause to test, but test process information retains；Stop test, before reconfiguring test information
It prompts " must first stop testing ", after test stops, backstage stops the operation to test.
Step 9: automatically generating test report from the background after the completion of test and generating a record in " report output ", it can
To be checked, and downloading is provided, the test being stopped halfway can also generate report.
Following test methods are debugging test, as shown in fig. 7, can be indicated with following below scheme:
Step 1: selection " debugging operations ", after selecting communication pattern and debugger object (DN or UN), it is customized to carry out message
It is customized with testing process, and executed.
It is straightaway literal expression side by packet parsing step 2: being selected " message analysis " after debugging test execution
Formula.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
The above is only the embodiment of the present invention, are not intended to restrict the invention, all in the spirit and principles in the present invention
Within, any modification, equivalent substitution, improvement and etc. done, be all contained in apply pending scope of the presently claimed invention it
It is interior.
Claims (11)
1. a kind of demand response communicates consistency testing system, which is characterized in that the system comprises: configurations module is surveyed
Try management module and report output module；
The configurations module is configured for the test case to test macro, test template is assembled, system is normal
Amount is configured；
The test and management module, for for the configured test macro of configurations module provide test process configuration and
Test execution entrance, and test process monitoring is carried out to sample, obtain test record；
The report management module generates test report for comparing test record and preset test by standard.
2. a kind of demand response as described in claim 1 communicates consistency testing system, which is characterized in that the configurations
Module include test case configuration submodule, test template configuration submodule and with parameter configuration submodule；
Test case configuration submodule is used for: the service construction in advance providing Information Exchange Agreement is at use-case, and by institute
State use-case setting test grade；
The test template configuration submodule is used for: the test grade based on use-case setting integrates the use-case,
It is formed and has gradational test template；
The test template includes: foundation forms, standard form, high-level template and self-defined template；
The parameter configuration submodule is used for: test case based on building and the test template being integrally formed, to test macro
In other meet system operation constants configured.
3. a kind of demand response as described in claim 1 communicates consistency testing system, which is characterized in that the test and management
Module includes sample management submodule, testing process management submodule and test process monitoring submodule；
Sample management submodule is used for: based on configured use-case, template and parameter in configurations module, into
The sample of row test carries out additions and deletions and changes the management looked into；
It includes: demand response system software, the number of hardware and software device, consigner, mailbox, producer that the additions and deletions, which change the content looked into,
Title, phone, mailbox, protocol version, description basic parameter；
Testing process management submodule is used for: based on the management to sample, carrying out configuration to sample and to matching
The sample postponed carries out test execution operation；
Described to carry out configuration to sample include: when the attribute of sample is host node, and the content of configuration is test
Whether stencil-chosen, protocol version selection encrypt selection, the setting of the address UN, poll time offset setting, when the category of sample
Property for the next node when, the content of configuration is test template selection, protocol version selection, whether encrypts selection, whether carries out one
The verifying of cause property；
The content of the test execution operation includes: beginning, pause and end operation；
The test process monitoring submodule is used for: being monitored to the sample after test execution operation, the prison
The content of survey is shown by the page, and forms record.
4. a kind of demand response as described in claim 1 communicates consistency testing system, which is characterized in that the report management
Module includes report management submodule and report generation submodule；
Report template management submodule is used for: based on the monitoring content shown by the page, to will carry out test report
The sample of output carries out the selection of test report template；
The report generation submodule is used for: the test report template based on selection generates quilt after the completion of the test execution
The test report of sample；
The content of the test report include: the record of test process, the type of test errors, preset test by standard and
Measurand；
The report output submodule is used for: the test report template based on selection, the test report that the sample is generated
It accuses and carries out information displaying；
The information of the displaying includes: information measured, tested end title, report name, tests whether to lead to.
5. a kind of demand response as described in claim 1 communicates consistency testing system, which is characterized in that further include technology tune
Die trial block；
The technological debugging module is used to use when the result of test report is unqualified based on the corresponding test in unqualified part
Example is tested, and exports test report.
6. a kind of demand response as claimed in claim 4 communicates consistency testing system, which is characterized in that the technological debugging
Module includes message analysis submodule and debugging operations submodule；
The debugging operations submodule is used for: carrying out debugging survey based on the corresponding test case of error message in the test report
Examination, and generate debugging test report；
The message analysis submodule is used for: finding corresponding test case based on error message in the test report；
The content of the test sample error is found by the test case found and is modified, will pass through consistency
Test.
7. a kind of demand response communicates conformance test method, which is characterized in that the described method includes:
The test case of test macro, test template and system constant are configured by configurations module；
Test process configuration, test execution entrance and test process are carried out by test and management module to the test macro set
Monitoring, obtain test record；
The test record is compared with preset test by standard by the test record in report management module, it is raw
At test report.
8. a kind of demand response as claimed in claim 7 communicates conformance test method, which is characterized in that described pair of test is used
Example, test template and system constant are configured by configurations module and include:
The service construction that test case submodule in the configurations module in advance provides Information Exchange Agreement at use-case,
And the use-case is set into test grade；
Test template in the configurations module configures test case of the submodule based on setting, by the test case into
Row integration, forms and has gradational test template；
The test template that in the configurations module parameter configuration submodule the test case based on building and is integrally formed,
The constant for meeting system operation to other in test macro is configured；
Wherein, the test template includes: foundation forms, standard form, high-level template and self-defined template.
9. a kind of demand response as claimed in claim 7 communicates conformance test method, which is characterized in that described pair sets
System test process configuration is carried out by test and management module, test execution entrance and test process monitor, obtain test and remember
Record includes:
Sample management submodule in the test and management module is based on configured use-case, template in configurations module
And parameter, additions and deletions are carried out to the sample tested and change the management looked into；
It includes: demand response system software, the number of hardware and software device, consigner, mailbox, producer that the additions and deletions, which change the content looked into,
Title, phone, mailbox, protocol version, description basic parameter；
Testing process management submodule in the test and management module carries out sample based on the management to sample
It configures and carries out test execution operation to the sample postponed；
Described to carry out configuration to sample include: when the attribute of sample is host node, and the content of configuration is test
Whether stencil-chosen, protocol version selection encrypt selection, the setting of the address UN, poll time offset setting, when the category of sample
Property for the next node when, the content of configuration is test template selection, protocol version selection, whether encrypts selection, whether carries out one
The verifying of cause property；
The content of the test execution operation includes: beginning, pause and end operation；
Test process monitoring submodule in the test and management module carries out the sample after test execution operation
Monitoring, the content of the monitoring is shown by the page, and forms record.
10. a kind of demand response as claimed in claim 7 communicates conformance test method, which is characterized in that by the test
Record is compared with preset test by standard by report output module, generates test report, comprising:
Report template management submodule in the report management module is based on the monitoring content shown by the page, to will be into
The sample of row test report output carries out the selection of test report template；
Test report template of the report generation submodule based on selection in the report management module, it is complete in the test execution
At the rear test report for generating sample；
The content of the test report include: the record of test process, the type of test errors, preset test by standard and
Measurand；
Test report template of the report output submodule based on selection in the report management module, the sample is raw
At test report carry out information displaying；
The information of the displaying includes: information measured, tested end title, report name, tests whether to lead to.
11. a kind of demand response as claimed in claim 7 communicates conformance test method, which is characterized in that the method is also
Include:
When the result of test report is unqualified, technological debugging module is based on the corresponding test case in unqualified part and is surveyed
Examination, and export test report.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811115458.6A CN109471791A (en) | 2018-09-25 | 2018-09-25 | A kind of demand response communication consistency testing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811115458.6A CN109471791A (en) | 2018-09-25 | 2018-09-25 | A kind of demand response communication consistency testing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109471791A true CN109471791A (en) | 2019-03-15 |
Family
ID=65663164
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811115458.6A Pending CN109471791A (en) | 2018-09-25 | 2018-09-25 | A kind of demand response communication consistency testing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109471791A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110166328A (en) * | 2019-07-05 | 2019-08-23 | 南方电网科学研究院有限责任公司 | A kind of test device of demand response equipment |
| CN110380939A (en) * | 2019-08-08 | 2019-10-25 | 重庆邮电大学 | The conformance test method and system of local communication protocol in a kind of power information acquisition system |
| CN112433948A (en) * | 2020-11-30 | 2021-03-02 | 上海天旦网络科技发展有限公司 | Simulation test system and method based on network data analysis |
| CN113708997A (en) * | 2021-08-23 | 2021-11-26 | 国电南瑞科技股份有限公司 | Simulation detection system and method suitable for cloud-edge interaction protocol consistency detection of power distribution Internet of things |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186457A (en) * | 2011-12-29 | 2013-07-03 | 阿里巴巴集团控股有限公司 | Method and device for automatically generating test case |
| CN103746879A (en) * | 2013-12-28 | 2014-04-23 | 国家电网公司 | Testing system and method for consistency of IPv6 (Internet Protocol Version 6) protocol |
-
2018
- 2018-09-25 CN CN201811115458.6A patent/CN109471791A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186457A (en) * | 2011-12-29 | 2013-07-03 | 阿里巴巴集团控股有限公司 | Method and device for automatically generating test case |
| CN103746879A (en) * | 2013-12-28 | 2014-04-23 | 国家电网公司 | Testing system and method for consistency of IPv6 (Internet Protocol Version 6) protocol |
Non-Patent Citations (2)
| Title |
|---|
| 何子亨: "OpenADR通信协议一致性测试系统设计", 中国优秀硕士学位论文全文数据库信息科技辑, no. 3, 15 March 2018 (2018-03-15), pages 1 - 51 * |
| 陈京生;李彬;曹望璋;李德智;陈宋宋;崔高颖;: "基于OpenADR的用电互联一致性测试系统研究", 电测与仪表, no. 03, 10 February 2018 (2018-02-10) * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110166328A (en) * | 2019-07-05 | 2019-08-23 | 南方电网科学研究院有限责任公司 | A kind of test device of demand response equipment |
| CN110166328B (en) * | 2019-07-05 | 2021-07-16 | 南方电网科学研究院有限责任公司 | Testing device of demand response equipment |
| CN110380939A (en) * | 2019-08-08 | 2019-10-25 | 重庆邮电大学 | The conformance test method and system of local communication protocol in a kind of power information acquisition system |
| CN110380939B (en) * | 2019-08-08 | 2022-03-29 | 重庆邮电大学 | Consistency test method and system for local communication protocol in electricity consumption information acquisition system |
| CN112433948A (en) * | 2020-11-30 | 2021-03-02 | 上海天旦网络科技发展有限公司 | Simulation test system and method based on network data analysis |
| CN113708997A (en) * | 2021-08-23 | 2021-11-26 | 国电南瑞科技股份有限公司 | Simulation detection system and method suitable for cloud-edge interaction protocol consistency detection of power distribution Internet of things |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109471791A (en) | A kind of demand response communication consistency testing system and method | |
| CN103678093B (en) | A kind of automated test frame and method of testing | |
| CN107341098A (en) | Software performance testing method, platform, equipment and storage medium | |
| CN109302522A (en) | Test method, device and computer system and medium | |
| CN110162977A (en) | A kind of Android vehicle-mounted terminal system leakage location and method | |
| CN106484610A (en) | A kind of Beta method and apparatus | |
| CN106559438A (en) | A kind of program method for uploading and device based on objective network platform | |
| CN104639653A (en) | Self-adaptive method and system based on cloud architecture | |
| US20100145978A1 (en) | Techniques to provide unified logging services | |
| CN104036365A (en) | Method for constructing enterprise-level data service platform | |
| CN103379000B (en) | A kind of concurrent testing method and testing service device | |
| CN106254093A (en) | A kind of automatic test restorative procedure and system thereof | |
| CN113706110B (en) | FPGA test tool integrated test management platform | |
| CN108270640A (en) | A kind of intelligence battalion is with information integrated system Information Interoperability conformance test method | |
| CN106933709A (en) | A kind of method of testing and device | |
| CN107992519A (en) | The multi-source heterogeneous data verification system and method for a kind of smart grid-oriented big data | |
| CN108345449A (en) | A kind of information processing method, device, storage medium and computer equipment | |
| CN104615928B (en) | Measurement and examination method, verification system and server | |
| CN102546296B (en) | Automatic detecting method and device for electric power industry information system networking safety evaluation | |
| CN108108460A (en) | A kind of standardized work flows intelligent management system framework and system | |
| CN110209584A (en) | A kind of automatic generation of test data and relevant apparatus | |
| CN111414614B (en) | Override detection method and auxiliary device | |
| CN112700083A (en) | Method and device for constructing scene of resource comprehensive utilization and service index system | |
| CN111078547A (en) | Automatic testing framework system for PYTHON general APP software | |
| CN105871998A (en) | Data displaying method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |