Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L43/00—Arrangements for monitoring or testing data switching networks
  • H04L43/50—Testing arrangements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L43/00—Arrangements for monitoring or testing data switching networks
  • H04L43/20—Arrangements for monitoring or testing data switching networks the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV

Definitions

• the invention relates to the field of communication systems and testing their configurations and respective network func tions, and more particularly is directed to a test system for auditing testing of network functions of a communication sys tem, a node for establishing at least one parameterized test case, a node for testing of network functions of a communica tion system, and a method for audited testing of network functions .
• Data networks typically implement features through network functions.
• computational devices such as customer nodes, user equipment, mobile terminals, industrial control devices, industrial machine devices, or Internet-of-Things devices usually access and/or connect to a data network via one or more network functions, which are provided by the net work to the respective device, node or equipment.
• a data network provides the network functions by one or more communication systems, which implement some or all of the provided network functions.
• the da ta network may provide several functions and parameters to devices or customer nodes, such as a data transfer function, a channel for voice transmission, a function for configuring communication nodes, a communication service management func tion and their respective parameters, as well as several pa rameters defining a state, mode or setup of the data network and/or of the device/customer node/equipment; such parameters are, e.g., communication protocols, data transfer rates, an address space of the data network, an address of the customer node and/or physical configurations or layers of the data network .
• network functions their functional specifica tions, the devices or nodes accessing the data network or, respectively, the communication system and further agreements between a service provider providing these network functions and customers using these network functions are usually de fined in a written contract.
• the data network or parts of it, in particular some of the communication systems, may be provided by another party. Therefore, multiple stake holders - e.g. a network provider, a network operator and a customer or network subscriber - take part in using and providing network functions.
• a first aspect of the present invention is directed to a test system for auditing testing of network functions of a commu nication system or a data network comprising a communication system.
• the test system comprises a test case repository node that is adapted to provide one or more test cases for the network functions.
• the test system further comprises a node for establishing at least one parameterized test case.
• the node for establishing at least one parameterized test case comprises a retrieval module, a parameterization module, and an auditing module.
• the retrieval module is adapted to re trieve at least one of the test cases from the test case re pository node.
• the parameterization module is adapted to ap ply one or more test parameters to the at least one of the test cases, thereby establishing the at least one parameter ized test case.
• the auditing module is adapted to write, to a distributed database, a test specification comprising an identifier of the at least one parameterized test case.
• a "distributed data base” is a database that is distributed over a multitude of computational nodes, wherein transactions to the database de pend on a consensus between the computational nodes, and wherein the computational nodes may be geographically spread across multiple sites, locations, countries or organizations.
• a consensus may be established by a consensus algorithm, like proof of work, proof of stake, or a voting system.
• the distributed database may be implemented as a blockchain .
• test case is a col lection of data that contains elements which are required for performing a test of one or more network functions.
• a test case may be parameterized, i.e. be a parameterized test case, wherein one or more test parameters of this test case are set to specific values in order to perform the test ing of one or more specific network functions and/or of a specific communication system or a specific part of it.
• test case repository node advantageously allows to re trieve the test cases from a specific and thus well-defined node, i.e. the test case repository node. Moreover, addition al test cases may be stored in the test case repository node, thereby facilitating the introduction of additional test cas es.
• test case may be stored and retrieved from the test case repository node in a predefined, template-based and/or generic representation, wherein the specific parame ters for performing the test case - such as IP addresses, network nodes or communication protocols - are applied to the test case when specifically required, whereby the number of test cases may be reduced, while facilitating testing a mul- titude of different communication systems, network nodes, and/or their configurations or configured network functions.
• An advantage of the auditing module may particularly be that the test case may be identified by the identifier of the test specification, which facilitates auditing of the testing of the network functions, because the test case to be performed is stored in the distributed database, and thus may be tam perproof.
• an advantage of the test system may particularly be, that the testing of network functions may be audited by using - i.e. by retrieving and later on perform ing/conducting - specific and identifiable test cases and by retrieving - e.g. later on - which test case has been con ducted and how it performed from the distributed database.
• the test system may further comprise a node for testing the communication system, wherein the node comprises a deployment module and/or a monitoring module.
• the deployment module is adapted to transmit a de ployment signal, the deployment signal being indicative of the at least one parameterized test case, thereby triggering execution of the at least one parameterized test case by the communication system.
• the monitoring module is adapted to re ceive test data generated by the execution of the at least one parameterized test case.
• the at least one param eterized test case may advantageously be deployed and execut ed by the communication system in an automated manner. Com pared to an end-to-end test, which requires setting up each specific test on both "ends", i.e.
• an advantage of the node for testing the communi cation system may particularly be, that the at least one pa rameterized test case may be conducted in an automated man ner, whereby ensuring proper operation of data net
• the test system may further comprise a reporting module.
• the reporting module is adapted to write, to the distributed database, a test re port based on the test data.
• results of the at least one parameterized test case such as a validation of system performance and technical performance indicators may be stored may be stored as the test report in a tamperproof man ner, and thus, in particular, rendering the testing of the network functions (by means of this test case) auditable.
• the test report may be retrieved from the distributed database for later evaluation and/or as a proof of providing network functions according to a specific service level agreement .
• the reporting module is further adapted to sign, by a digital signature for the node for testing the communication system, the test re port. This may beneficially improve the traceability of the testing of the network functions.
• the test data may comprise monitoring data, which indicates a course of the execution of the at least one parameterized test case, and/or measurement data, which indicates a performance of one or more tested network functions of the network functions of the communication sys tem.
• monitoring data may particularly be, that the execution of the at least one parameterized test case may be traced.
• measurement data may particularly be that the performance of the tested network functions may be monitored, whereby compliance or non- compliance with a service level agreement may be proved and/or technical performance indicators such as data through put may be documented.
• the reporting module is adapted to establish the test report based on the monitoring data, the measurement data, and the one or more test parame ters.
• a test coverage may be written to the distrib uted database, and thus, when testing one or more of the net work functions provided by the communication system, their performance as well as methods for testing their performance may, in a traceable and tamperproof manner, be traced, audit ed, and stored for later evaluation and/or as a proof.
• the at least one test case com prises at least one test procedure for testing at least one of the network functions of the communication system and de fines a course of execution of the at least one test proce dure. Thereby, conducting the testing of the at least one of the network functions may be a facilitated.
• the at least one test case further comprises at least one traffic generator and at least one measurement probe.
• the at least one test procedure is adapted to test a data throughput capacity of the at least one of the network functions and/or a respective timing - such as latency - by applying traffic data, which is generat ed by means of the at least one traffic generator, to the at least one of the network functions at a first node of the communication system and by measuring, at the first or at a second node of the communication system, a resulting traffic data or a resulting timing by means of the at least one meas urement probe. This may advantageously improve auditing the testing of the network functions.
• An advantage of the traffic generator of the at least one test case may particularly be, that the traffic for testing data throughput and/or respec tive timing is determined and audited and thus specified and traceable for later evaluation.
• An advantage of the at least one measurement probe of the at least one test case may par ticularly be that the means of probing the reciting traffic data or reciting timing may be deployed to one of the nodes of the communication system in an automated manner and/or may be determined and thus test data generated by this at least one test procedure and, in particular, measured by the at least one measurement probe is auditable and its meaning can be evaluated in a defined manner.
• the at least one test case comprises a test procedure, a further test procedure, a traf fic generator, a measurement probe, and/or a respective de scription .
• the at least one test case may advantageously com prise some or all elements required for performing the test ing of the network functions.
• the testing of the network functions or some of the network functions may be au tomated, wherein respective test cases are deployed to one or more nodes of the communication system or a data network, those network functions are to be tested.
• comprising respective test procedures etc. may advantageously allow to adapt the at least one test case or to provide respective test cases depending on the required level of details of testing and resulting performance indicators.
• the at least one of the net work functions of the communication system is a virtual net- work function.
• the communication system or a data network, in particular comprising the communication system may be adapted to provide two or more network functions as virtual network functions.
• a "virtual net work function” may refer to a software implementation of a network function.
• Such a virtual network function may run on the communication system/a communication system of a data network, wherein the data network and/or the communication system is adapted for providing virtual network functions, and wherein the network function may be deployed to such a communication system.
• the communication system may comprise one or more communication nodes, wherein the virtual network function to be deployed on the communication system runs as a software implementation on one or more of these nodes, in particular, instead of having custom hardware devices for each network function.
• a virtual network function may be one of a firewall, an intrusion detection de vice, a load balancer, a control channel, a data channel and a data connection between at least two nodes of a data net work .
• a "service-level agree ment" at least represents a configuration of a network func tion and at least one node which accesses the data network and/or the communication system.
• the node may be a customer node.
• the service level agreement may specify certain hardware requirements and/or agreements, identifiers of selected network functions and/or certain functional parameters, which may have been agreed upon be tween a provider and a customer.
• Such hardware requirements may comprise transfer rates, digital bandwidth capacity, la tency, a level of redundancy, and/or a location of communica tion nodes or customer nodes, which may exchange data via a network function.
• Such functional parameters may comprise ad dress spaces, port ranges or parts, data handling or filter ing capacity for data traffic over network functions, logical configurations of a data network or communication system, and/or computing capacity or memory capacity for the network functions.
• the network function may be a vir tual network function or a network function based on a hard ware device.
• the preceding specifications may be allocated to one or more service levels, which may differ in terms of the preceding specifications. Therefore, network functions may be activated or deactivated based on respective service level agreements, which advantageously facilitates providing network functions and adapting communication ser vices to - possibly changing - requirements.
• An advantage of virtual network functions may particularly be that network functions provided by the data network and/or the communication system may be adapted or changed without changing the underlying hardware.
• the at least one test case for the at least one network function that is implemented as a virtual network function also the perfor mance of the virtual network function and/or the compliance with a respective service level agreement may be validated and tested in an automated, traceable and/or auditable man ner, whereby, in particular, flexibility of providing network functions and/or reliability of using network functions is increased .
• the communication system or a data network comprising the communication system may be con figured to provide one or more network functions, in particu lar virtual network functions, based on a network configura tion. Furthermore, this network configuration may be speci fied in a service level agreement.
• the retrieval module is fur ther adapted to read, from the distributed database, a net work configuration according to which the communication sys tem provides its network functions. Furthermore, the retriev al module is further adapted to select the at least one of the test cases based on the network configuration, and to re- quest, from the test case repository node, the at least one test case. Thereby, the at least one test case may be specif ically requested for the network configuration of the commu nication system.
• the auditing module is further adapted to sign, by a digital signature for the node for es tablishing at least one parameterized test case, the test specification.
• the origin of the parameterized test case may be proven in a cryptographically safe way, whereby auditability and traceability of the testing is improved.
• the test case repository node comprises a digital signature module and a provider module.
• the digital signature module is adapted to transmit a signa ture key request signal to the distributed database and to receive a signing key from the distributed database.
• the signature key request signal is adapted to trigger the distributed database to provide the signature key for the at least one test case and to store a respective validation key, in particular to write the respec tive validation key to the distributed database.
• the provider module is adapted to provide the at least one test case and to sign, by a digital signature for the test case repository node, the at least one test case, wherein the digital signature is based on the signing key received by the digital signature module.
• the at least one test case originates from the test case repository node, whereby traceability of pre paring/setting-up the testing of the network functions - e.g. by retrieving and parameterizing the at least one test case - may be improved.
• traceability of pre paring/setting-up the testing of the network functions - e.g. by retrieving and parameterizing the at least one test case - may be improved.
• the auditing of the testing - in particular the preparation of the testing - may be audited in an improved manner by cryptographically validating the digital signature, wherein the authenticity of the respective validation key is ensured by the distributed database.
• An advantage of providing the signature key for the at least one case may particularly be, that the provider mod ule can provide/sign only test cases for which the distribut ed database provides a (specific) signature key, whereby se curity and/or reliability may be enhanced.
• the distributed database may determine whether the at least one case is applicable - i.e. may, in particular, proof the proper functioning - of the communica tion system. This may particularly be based on a network con figuration of the communication system and the signature key request signal being specific for the at least one test case.
• the provider module may be adapted to embed the digital signature for the test case repository node and/or the signing key received from the distributed database for the at least one test case into the at least one test case.
• the retrieval module may be adapted to retrieve the at least one test case including the digital signature or the signing key from the test case repository node.
• the auditing module may be further adapted to establish, based on the signing key re ceived via the test case repository node from the distributed database, the digital signature for the node for establishing at least one parameterized test case or, alternatively, the auditing module may be further adapted to use the digital signature for the test case repository node as the digital signature for the node for establishing at least one parame terized test case - i.e. both digital signatures are based on the same signing key or are even, in the alternative, identi cal.
• the reporting module may further be adapted to establish the digital signature for the node for testing the communication system based on the sign ing key retrieved from the distributed database or, alterna tively, use the digital signature for the test case reposito ry node as the digital signature for the node for testing the communication system.
• An advantage of using the same digital signature or of establishing digital signatures based on the same signing key - i.e. the signing key received from the distributed database - may particularly be that these digital signatures may be validated by the respective validation key stored in the distributed database, whereby providing a tam perproof testing may be simplified.
• some or all digital signatures - e.g. for the node for test ing the communication system, for the node for establishing at least one parameterized test case, and for the test case repository node - may each be established based on a specific signing key.
• a specific validation key for some or all of the specific signing keys may be stored in the distributed data base and/or a chain of trust may be implemented.
• the distributed database may imple ment a root of trust as a base for the chain of trust.
• the auditing module may further be adapted to establish the identifier of the at least one parameterized test case by computing a hash value of the at least one parameterized test case.
• the auditing module may fur ther be adapted to write, to the distributed database, also an identifier of the test parameters and/or a representation of the test parameters. This may facilitate auditing of the testing of the network functions.
• the identifier of the at least one parameterized test case may comprise or consist of two parts, wherein a first part is an identifier for the at least one of the test case and a second part is an identifier for the test parameters.
• the at least one test case may be identified (and thus traced) in its generic form - i.e. non-parameterized form - by the first part, while still re taining traceability/auditability for the at least one para- metrized test case by the second part (combined with the first part) .
• the identifier of the at least one param eterized test case and/or an identifier of the test parame ters may beneficially combine with signing the at least one (parameterized) test case, whereby the test case and result ing test data e.g. by executing the test case are linked together in a traceable and, in particular cryptographically, tamper proof manner.
• a second aspect of the invention is directed to a node for establishing at least one parameterized test case.
• the node comprises a retrieval module, a parameterization module, and an auditing module.
• the retrieval module is adapted to estab lish at least one test case for testing of network functions of a communication system.
• the parameterization module is adapted to apply one or more test parameters to the at least one test case, thereby establishing the at least one parame terized test case.
• the auditing module is adapted to write, to a distributed database, a test specification comprising an identifier of the at least one parameterized test case.
• the test specification may further comprise the one or more test parameters and/or an identifier of the test parameters.
• the identifier for the test parameters may be computed as a hash value of the test parameters.
• a third aspect of the invention is directed to a node for testing of network functions of a communication system.
• the node comprises a deployment module and a monitoring module.
• the deployment module is adapted to transmit a deployment signal.
• the deployment signal is indicative of at least one parameterized test case.
• the monitoring module is adapted to receive test data generated by the execution of the at least one parameterized test case.
• the node for testing of network functions of a communication system may further comprise a reporting module.
• some embodiments of the communication system are adapted to execute the at least one test case, when receiving a respective deployment signal.
• a first part of the at least one test case may be deployed to the first node and a second part of the at least one test case may be deployed to the second node, wherein the first and the second node is adapted to, in par ticular synchronously, execute respective parts of the at least one test case.
• Some embodiments of the communication system may share a mu tual time source to facilitate synchronous execution of the case or parts of it.
• the node for testing of network functions of a communication system may further comprise a time source module.
• communication systems or nodes of them executing the at least one parameterized test case may use the time source module as a mutual time source.
• a fourth aspect of the invention is directed to a method for audited testing of network functions of a communication sys tem.
• the method comprises retrieving, from a test case repos itory node for one or more test cases for the network func tions, at least one of the test cases.
• the method further comprises establishing an at least one parameterized test case by applying one or more test parameters to the at least one test case.
• the method further comprises writing, to a distributed database, a test specification comprising an identifier of the at least one parameterized test case.
• the method further comprises transmitting a deployment signal, which is indicative of the at least one parameterized test case and which is adapted to trigger execution of the at least one parameterized test case by the communication sys tem.
• any method comprises monitoring the execution of the at least one parameterized test case by receiving test data generated by the execution.
• signing by a digital signature may be implemented by a cryptographic scheme employing a pri vate key and a public key.
• the public key may be stored in the distributed data base as a (respective) validation key.
• the private key may be used as a signing key and/or may be transmitted to further, trusted nodes or mod ules .
• the distributed database may be adapted to store the respective signing keys and/or valida tion keys in particular private keys and/or public keys in a protected, secured manner.
• the keys may be protected by a cryptographical security mechanism.
• the distributed database may be adapted to provide access to the respective signing keys and/or validation keys in particular private keys and/or public keys depending on an access grant.
• the access grant may be established by an access procedure such as checking a username and/or password against a mapping between usernames/passwords and access per missions .
• Fig. 1 represents a flow chart of a method for audited
• FIG. 2 is a signalling diagram for audited testing of net work functions within a data network according to an embodiment .
• Fig. 3 schematically illustrates a data network comprising a test system, communication systems and distribut ed database according to an embodiment.
• Fig. 4 represents a flowchart of a method for audited
• Fig. 1 shows a flowchart of a method 200 for audited testing of network functions of a communication system, the method according to an embodiment of the invention.
• the method 200 comprises the meth od steps 220, 222, 224, 226 and 228.
• the method starts at the start of the method 202 and ends at the end of the method 204.
• one or more of the method steps, in partic ular a sequence of method steps and/or the whole method 200, may repeatedly be performed.
• At method step 220 at least one test case is retrieved from a test case repository note for one or more test cases for the network functions.
• an at least one parameterized test case is es tablished by applying one or more test parameters to the at least one test case.
• a test specification comprising an iden tifier of the at least one parameterized test case is written to a distributed database.
• a deployment signal is transmitted to the commu nication system, wherein the deployment signal is indicative of the at least one parameterized test case and is adapted to trigger execution of the at least one parameterized test case by the communication system.
• the execution of the at least one parameterized test case is monitored by receiving test data generated by the execution.
• a signalling diagram 300 according to an embodiment of the invention is shown that schematically illustrates the signalling between a communication system 70, a test sys tem 100, a test case repository node 140 and a customer 420.
• a data network comprises the com munication system 70.
• the data network may also comprise the test system 100 and/or the test case repository node 140.
• the customer 420 may be a subscriber of the data network.
• the communication system 70 may comprise or consist of a first communication node 72.
• the test system 100 comprises a node 110 for estab lishing at least one parameterized test case and testing the communication system by means of the at least one parameter ized test case.
• the test system 100 comprises a distributed database 23, whereas the test case repository node 140 is external to the test system.
• the distributed database 23 may be external to the test system 100 and may be provided by the data network or, alternative ly, may be external to the data network, which may advanta geously allow to use a generic distributed database such as Ethereum.
• the distributed database 23 be ing part of the test system 100 may advantageously allow to adapt the distributed database 23 to specific needs such as a restricted access to it.
• An advantage of the test case repos itory node 140 being external to the test system 100 may par ticularly be, that the data repository node 140 may be set up, operated and/or deployed independently and/or by another stakeholder, which may allow different stakeholders to pro vide test cases and/or even to set up different test case re pository nodes.
• the test system 100 may comprise the test case repository node 140, whereby security may be enhanced .
• the customer 420 may initiate an audit ed testing of network functions of the communication system 70 by sending a test request signal 304 to the node 110.
• the testing may be initiated in an automated manner, wherein such testing is started periodi cally - e.g. based on predefined times or time intervals - or event-based - e.g. upon a change of a configuration of the data network and/or the communication system 70.
• the node 110 transmits, automatically or upon receiving the test request signal 304, a configuration request signal 320 to the distributed database 23.
• the distributed database 23 is, in some advantageous modifi cations, adopted to keep track of a network configuration ac cording to which the communication system 70 provides its network functions.
• the communication system 70 (or the data network comprising the communication system) is adapted to provide its respective network functions based on a respective network configuration stored in the distributed database 23, whereby deploying network functions and/or providing network functions to customers or providers based on individual and possibly changing requirements may be fa cilitated.
• the network con figuration according to which the communication system 70 provides its network functions may be implemented by data of a service level agreement, e.g. between the customer 420 and an operator of the communication system 70.
• one or more of the network functions provided by the communication system 70 are implemented as virtual network functions, whereby dynamic adaption to multiple service level agreements is facilitated.
• the node 110 receives the network configuration according to which the communication system 70 provides its network func tions, in form of a configuration specification signal 332.
• the node 110 may request at least one of the test cases from the test case repository node 140 for one or more test cases, which is specific for the network configuration, by sending a test case request signal 324.
• the test case repository node 140 requests a public test sig nature by transmitting a test signature request signal 340 to the distributed database 23.
• the signal 340 may be specific for the requested test case and thus the network configuration.
• the distributed database Upon receiving a signal 340, the distributed database establishes the public test signature and stores a corresponding private key for the test signature and transmits a public test signature signal 342 to the test case repository node 140.
• public and private signature is meant to eluci date, in particular, the use of the public signature and the private signature, wherein the public signature may be trans mitted to several nodes and/or systems for signing the at least one test case and/or respective results, whereas the private signature is stored in the distributed database and is used to validate the signed at least one test case and/or the signed results, which may be performed solely within the distributed database or also by other nodes, systems or other entities such as the customer 420.
• the test case repository node 140 receives the public test signature signal 342 and embeds the public test signature in to the at least one test case and signs the at least one test case.
• This signed test case i.e. the at least one test case with the embedded test signature and being signed is trans mitted by the test case repository node 140 in form of a test case signal 344.
• the node 110 receives the test case signal 344 and may, in some advantageous modifications, parameterize the test case.
• a generic test case may be provided by the test case repository node 140, in some advantageous modifications. According to some further modifi cations, such a generic test case may be adapted by parame- terizing it. Likewise, the test case may, in some advanta geous modifications, be not signed and/or could not comprise a test signature. Another advantageous modification may es tablish the at least one parameterized test case by providing the at least one parameterized test case in a form that is already parameterized, e.g. by the test case repository node 140, wherein e.g. the test case repository node 140 stores test cases for respective parameters and/or or configurations of the communication system 70.
• the node 110 After establishing the at least one parameterized test case, the node 110 transmits a test case specification signal 322 to the distributed database 23, thereby writing a test speci fication comprising an identifier of the at least one parame terized test case to the distributed database, which facili tates auditing of the testing of the network functions in that it can be traced what and proven that the specific at least one test case has been established for testing the net work functions.
• the node 110 computes a hash value as the identifier of the at least one parameterized test case.
• the node 110 transmits a deployment signal 366 to the commu nication system 70, the deployment signal 366 being indica tive of the at least one parameterized test case, thereby triggering execution of the at least one parameterized test case by the communication system.
• the communication system Upon receiving the deployment signal 366, the communication system transmits a set-up signal 370 to its node 72, thereby setting up the at least one parameterized test case and starting the execution of the at least one parameterized test case at the communication node 72.
• the communication system 70 While the at least one test case is executed or after its ex ecution, the communication system 70, in particular, the com munication node 72, sends a monitoring signal 368 to the node 110, which represents test data generated by the execution of the at least one parameterized test case.
• the node 110 Based on the monitoring signal 368, the node 110 evaluates the test data, which may comprise monitoring data and meas urements of one or more of the network functions, which have been tested, and documents the test results in form of a test report. According to some advantageous modifications, the test node 110 may sign the test results, i.e. the test re port, by the public test signature.
• test report signal 362 the (signed) test report is written to the distributed database 23.
• the customer 420 receives a validating key sig nal 302, which may comprise the private key for test signa ture, and a test result signal 308 being indicative of the measurements conducted during the testing of the network functions and/or the course of execution of these measure ments and which may comprise the test report. Furthermore, the customer 420 may validate the test result signal 308 and/or the test report by the validating key signal 302.
• the distributed data base 23 may validate the origin of the test report, in par ticular, upon receiving the test report signal 362 and/or prior to storing the test report, based on its private key for the test signature.
• the testing may also be initiated and, in an advantageous modification, be evaluated by an industrial sys tem that is using the communication system for network commu nication.
• the industrial system may be additional to the customer, may replace the customer (in the signalling di- agram) , or may be a proxy of the customer i.e. the customer may set-up and/or operate the industrial system and, in par ticular, use the industrial system for an industrial process such as manufacturing.
• the industrial system may comprise a customer node that is adapted to communicate via/with the communication system 70 - e.g. in order to provide acquired data from an industrial process and/or to receive control data for controlling the industrial process.
• the cus tomer node may be part of the communication system and may, in particular, be identified with the communication node 72.
• the industrial system may run a SCADA (Supervisory Control and Data Acquisition) appli cation in particular on the customer node or the communica tion node 72.
• SCADA Supervisory Control and Data Acquisition
• the SCADA application may automatically initiate the testing by sending a signal ac cordant to signal 304.
• the SCADA application may evaluate the results of the testing by receiving a signal accordant to signal 308 and (possibly) a signal accordant to signal 302, wherein the SCADA applica tion determines whether the network functions provided by the commination system 70 and proofed by the test results i.e. the measurements conducted during the testing of the network functions and/or the course of execution of these measure ments and which may comprise the test report are according to requested parameters and/or sufficient for monitoring and/or controlling the industrial process by the SCADA appli cation .
• Fig. 3 schematically illustrates a data network 10 comprising a test system 100, a distributed database 23, a communication system 60, and a further communication system 70; the data network and/or some or all of the illustrated parts of it each according to an embodiment of the invention.
• the distributed database 23 is implemented as joint distributed infrastructure network in- eluding multiple infrastructure nodes (e.g. blockchain full nodes) .
• the dis tributed database may be implemented as a blockchain support ing smart contracts like Ethereum.
• the distributed database 23 may be adapted to transmit and/or receive the respective signals, which have been described with reference to Fig. 2.
• the distributed da tabase 23 may be adapted to establish and store a pub
• the dis tributed database may be adapted to store the private key by writing it, to the distributed database, in a form encoded by a cryptographical security mechanism.
• the communication system 60 com prises a first communication node 62 and a second communica tion node 64.
• the communication system 60 is adapted to pro vide, as a network function, a data transfer between the first and the second node 62, 64 via the Internet 42.
• the communication system 70 com prises a communication node 72 and/or comprises only one com munication node 72.
• the communication node 72 is adapted to provide, as a network function, wireless data transfer via the Internet 42, and may in some advantageous modifications, be adapted to provide data transfer between the communication node 72, and at least one of the communication nodes 62 and 64.
• the test system 100 comprises a node 120 for establishing at least one parameterized test case, a test case repository node 140, and a node 160 for testing the communication system 60 or 70.
• the node 120 comprises a retrieval module 124 that is adapted to retrieve at least one of the test cases from the test case repository 140.
• the re- trieval module 124 is adapted to send signals, which are sim ilar to those described with reference to Fig. 2, such as to establish and/or retrieve the at least one test case such as a configuration request signal 320, a configuration specifi cation signal 332, a test case request signal 324, and a test case signal 344.
• a parameterization module 126 of the node 120 is adapted to apply one or more test parameters to the at least one of the test cases, thereby establishing the at least one parameter ized test case.
• An auditing module 122 of the node 120 is adapted to write, to the distributed database 23, a test specification comprising an identifier of the at least one parameterized test case.
• the auditing module 122 may compute a hash value of the at least one parameter ized test case and transmit a test case specification signal 322 - similar to the one illustrated with reference to Fig. 2 - to distributed database 23.
• the node 160 comprises a deployment module 166, which is adapted to transmit a deployment signal 366, the deployment signal being indicative of the at least one parameterized test case, thereby triggering execution of the at least one test case by the communication system 60 or 70.
• the deployment module 166 may be adapted to transmit the deployment signal directly or indi rectly to one or more of the nodes of the communication sys tems, e.g. to one or more of the communication nodes 62, 64, and/or 72.
• the node 160 comprises a monitoring module 168.
• the monitoring module 168 is adapted to receive test data generated by the execution of the at least one parameterized test case.
• the monitoring module 168 is adapted to receive the test data in form of a monitoring signal 368, e.g. as illustrated with reference to Fig. 2.
• the node 160 comprises a reporting module 162, the reporting module being adapted to write, to the distrib uted database 23, a test report based on the test data, e.g. by transmitting a test report signal 362.
• the re porting module 162 may be adapted, in some advantageous modi fications, to sign the test report by a digital signature.
• the test case repository node 140 may com prise a digital signature module.
• the digital signature mod ule 142 is adapted to transmit a signature key request signal to the distributed database 23 and to receive a signing key from the distributed database.
• the signature key request sig nal which may be the test signature request signal 340 of Fig. 2, is adapted to trigger the distributed database 23 to provide the signature key for the at least one test case and to start a respective validation key.
• the test case repository note 140 comprises a data storage device 146 that is adapted to store the one or more test cas es.
• the at least one test case may be (readily) stored in the data storage device 146.
• the node 140 comprises a provider module 144 that is adapted to provide the at least one test case. Further more, in an advantageous modification for signing by a digi tal signature, the provider module 144 is further adapted to sign, by a digital signature for the test case repository node based on the signing key, the at least one test case.
• the communication system 60 is adapted to receive, from the deployment module 166, the de ployment signal 366 and to set up and start the at least one parameterized test case.
• the at least one parameterized test case comprises a traffic gen erator, a measurement probe as well as a first and a second test procedure.
• the first test procedure is to be executed on the first communication node 62 and generates by means of the traffic generator traffic data which is to be trans ferred via the network function provided by the communication system 60 from the first node 62 to the second node 64.
• That second test procedure is to be executed on the second node 64 and receives the data via the network function from the first node 62 and measures by means of the measurement probe the resulting traffic data, whereby transfer characteristics such as data throughput, latency and possible data loss may be es tablished .
• Fig. 4 shows a flowchart of a method 260 for testing of net work functions by means of an at least one parameterized test case 240, each according to an embodiment of the invention.
• the method 260 may be linked to / combined with the method 200 described with reference to Fig. 1, therefore also the method step 226, e.g. transmitting a deployment signal, and the method step 228, e.g. monitoring the execution of the at least one parameterized test case, are shown in Fig. 4.
• Fig. 4 schematically illustrates a node 160 for testing of network functions of a communication system, a first communication node 62 and a second communication node 64 as well as the at least one parameterized test case 240.
• the at least one parameterized test case 240 is deployed to the first node 62 and the second node 64 at method step 226.
• the at least one parameterized test case comprises a traffic generator 242 with respective test parameters 243 and a measurement probe 244 with respec tive test parameters 245.
• the method 260 for testing net work functions in particular for testing the network func tions of a communication system comprising the nodes 62 and 64 and providing a data transfer between these nodes as a network function to be tested, comprises the method steps 262, 264, 266, and 268 as well as the method condition 270.
• the at least one parameter ized test case 240 may also comprise a test procedure which implements the method 260.
• the first communication node 62 sets up the traffic generator 242 by applying the respective test pa rameters 243, which may comprise one or more of: an IP ad dress of the second communication node 64, an amount of traf fic, and a minimum or maximum data rate.
• the second communication node 64 sets up the measurement probe 244 by applying the test parameters 245, wherein the test parameters may specify one or more of: an IP address of the communication node 62 for receiving da ta, a specific interface, and a specific port.
• the traffic generator 242 generates traf fic data and transmits it via the network function to the second communication node 64.
• the measurement probe 244 receives the generated traffic data and measures timing, data throughput and/or quality of the data.
• the method condition 270 it is determined, whether an ad ditional run of the test procedure, e.g. the preceding method steps, or another test procedure is to be performed. If this is the case - which is indicated by ⁇ y> - e.g. the preceding method steps are repeated starting from method steps 262 and 264. Otherwise - which is indicated by ⁇ n> - the execution of the at least one parameterized test case is monitored by re DCving test data generated by the execution, at method step 228.
• the communication system 60 or 70 may comprise the test system or parts of it, whereby the communication system may be enabled to perform a self-test.
• the communication system may comprise node 110, node 120, node 140 and/or node 160.

Applications Claiming Priority (2)

Publications (1)

Family

ID=64017295

Family Applications (2)

Family Applications Before (1)

Country Status (2)

Families Citing this family (2)

Family Cites Families (4)

• 2018
  • 2018-10-23 EP EP18202058.6A patent/EP3644558A1/de not_active Withdrawn
• 2019
  • 2019-10-07 WO PCT/EP2019/077094 patent/WO2020083631A1/en unknown
  • 2019-10-07 EP EP19794888.8A patent/EP3854034A1/de active Pending

Also Published As

Similar Documents

Legal Events