EP1812865A2 - Method for manipulating software-tests - Google Patents

Method for manipulating software-tests

Info

Publication number
EP1812865A2
EP1812865A2 EP05792118A EP05792118A EP1812865A2 EP 1812865 A2 EP1812865 A2 EP 1812865A2 EP 05792118 A EP05792118 A EP 05792118A EP 05792118 A EP05792118 A EP 05792118A EP 1812865 A2 EP1812865 A2 EP 1812865A2
Authority
EP
European Patent Office
Prior art keywords
tests
test
concerns
previous
software
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP05792118A
Other languages
German (de)
French (fr)
Inventor
Peter Zimmerer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Publication of EP1812865A2 publication Critical patent/EP1812865A2/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)
  • Stored Programmes (AREA)

Abstract

The invention essentially relates to the specification and implementation of tests on a higher abstraction plane using a declarative description with the aid of aspects (cross-cutting concerns). According to the invention, specific tests are provided with aspects" that result automatically in new, extended, more powerful tests. This leads advantageously to the simplification of the specification of tests, a re-usability and extensibility of tests and to a simpler coupling and combination of tests. For example, functional tests can be provided with the aspect time , which automatically results in performance tests.

Description

Beschreibungdescription
Verfahren zur Handhabung von Software-TestsMethod for handling software tests
Die Erfindung betrifft ein Verfahren zur Handhabung, also bspw. zur Beschreibung, Spezifikation und Implementierung von Software-Tests, wie bspw. funktionale Tests, Performance Tests, Last-und Stresstests, Langzeittests, Tests mit gleichzeitiger Analyse des Ressourcenverbrauchs, wie bspw. Laufzeit und Speicherbedarf, Sicherheits-Tests usw.The invention relates to a method for handling, so for example for the description, specification and implementation of software tests, such as functional tests, performance tests, load and stress tests, long-term tests, tests with simultaneous analysis of resource consumption, such as Memory requirements, security tests, etc.
Die Ausdrucksmöglichkeiten für die Beschreibung, Spezifikation und Implementierung von Tests sind bislang relativ beschränkt. Bisher werden diese verschiedenen Testarten typischer Weise einzeln mühsam feingranular spezifiziert und in Testskripten detailliert von Hand in eine entsprechendes Programm umgesetzt.The expressive possibilities for the description, specification and implementation of tests are so far relatively limited. So far, these different types of tests are typically individually laboriously granularly specified and implemented in test scripts in detail by hand in a corresponding program.
Aus der Internetseite mt^ej^t ist zwar eine AOTL (Aspect-Oriented Test Description Language) bekannt als eine Erweiterung eines Testautomatisierungsframeworks (JUnit, siehe http://www.junit.org) basierend auf JML (Java ModelingFrom the website Although an AOTL (Aspect-Oriented Test Description Language) is known as an extension of a test automation framework (JUnit, see http://www.junit.org) based on JML (Java Modeling
Language, http://www.cs.iastate.edu/~leavens/JML/) . Es wird jedoch ausschließlich in konventioneller Weise zur Generierung von Unit Test Code und zur Generierung eines recht beschränkten Testorakels (der Sollwerte) verwendet.Language, http://www.cs.iastate.edu/~leavens/JML/). However, it is only used conventionally to generate unit test code and to generate a fairly limited test oracle (the setpoints).
Die der Erfindung zu Grunde liegende Aufgabe besteht nun darin, ein verbessertes bzw. umfassenderes Verfahren zur Handhabung von Software-Tests anzugeben, das sich nicht nur auf die Generierung von Unit Test Code und einfachen Testorakeln bzw. Sollwerten, also auf eine spezielle Testphase und eine spezielle Testaktivität beschränkt. Diese Aufgabe wird durch die Merkmale des Patentanspruchs 1 erfmdungsgemaß gelöst . Die weiteren Ansprüche betreffen bevorzugte Ausgestaltungen des erfmdungsgemäßen Verfahrens .The object underlying the invention is now to provide an improved or more comprehensive method for handling software tests, which is not limited to the generation of unit test code and simple test oracles, ie to a special test phase and a limited to special test activity. This object is achieved erfmdungsgemaß by the features of claim 1. The further claims relate to preferred embodiments of the inventive method.
Die Erfindung besteht im Wesentlichen darin, dass allgemein eine Spezifikation und Implementierung von Tests auf einem höheren Abstraktionsniveau mittels deklarativer Beschreibung durch Nutzung von so genannten „Aspekten" (cross-cuttmg concerns) erfolgt, wobei bestimmte Tests mit solchen „Aspekten" versehen werden, die dann automatisch m neuen erweiterten und mächtigeren Tests resultieren. Dies führt in vorteilhafter Weise zu einer Vereinfachung der Spezifikation von Tests, zu einer Wiederverwendbarkeit und Erweiterbarkeit von Tests sowie zu einer einfachen Kopplung und Kombination von Tests. Beispielsweise können so funktionale Tests mit dem Aspekt „Zeit" versehen werden und resultieren dann automatisch m Performance Tests.Essentially, the invention consists in generally specifying and implementing tests at a higher level of abstraction by means of declarative description through the use of so-called "cross-cuttmg concerns", whereby certain tests are provided with such "aspects" which then automatically result in new extended and more powerful tests. This advantageously leads to a simplification of the specification of tests, to a reusability and extensibility of tests as well as to a simple coupling and combination of tests. For example, functional tests can be given the aspect of "time" and automatically result in m performance tests.
Bei erfindungsgemäßen Verfahren erfolgt eine Spezifikation und Implementierung von Tests auf einem höherenIn methods according to the invention, a specification and implementation of tests takes place at a higher level
Abstraktionsniveau mittels deklarativer Beschreibung durch Nutzung von Aspekten ähnlich denen wie sie vom so genannten „AOP bzw. aspect oπentated programmmg" aus der Software- Programmierung bekannt sind, das zur vorteilhaften konzentrierten Realisierung von bestimmtenLevel of abstraction by means of declarative description through the use of aspects similar to those known from the so-called "AOP or aspect oπentated program" from software programming, for the advantageous concentrated realization of certain
Querschnittsbelangen (cross-cuttmg concerns) dient.Cross-cuttmg concerns) serves.
Die Aspekte werden, wie auch beim „AOP" über einen so genannten „Aspect Weaver" in bereits bestehende Grundtests eingefügt, d.h. es findet eine Instrumentierung dieserAs with the "AOP", the aspects are inserted into already existing basic tests via a so-called "Aspect Weaver", i. it finds an instrumentation of this
Grundtests statt. Die resultierenden neuen Tests werden dann mittels Compiler oder Interpreter zum Ablauf gebracht, z.B. in einer Testausführungsumgebung.Basic tests held. The resulting new tests are then run by compiler or interpreter, e.g. in a test execution environment.
Funktionale Tests werden so erfindungsgemäß bspw. durchFunctional tests are inventively, for example, by
Hinzufügen des Aspekts „Timing Info" zu Performance Tests, durch Hinzufugen bspw. eines Aspekts „100.000h" zu einem Langzeittest bzw. zu einem entsprechenden Last- und Stresstest oder durch Hinzufügen von Sicherheits-Aspekts zu Safetytests oder Secuπtytests.Adding the timing info aspect to performance testing by adding, for example, an aspect 100,000h to one Long-term test or a corresponding load and stress test or by adding safety aspects to safety tests or safety tests.
Schließlich können erfindungsgemaß sogar aus positiven Tests bspw. durch Hinzufügen eines Aspekts "Exception/Error Paths" negative Tests oder Randwerte-Tests auf einfache Weise gebildet werden.Finally, according to the invention, negative tests or boundary value tests can be formed in a simple manner even from positive tests, for example by adding an aspect "exception / error paths".
Vorteileadvantages
• Eine Vereinfachung sowohl der Spezifikation als auch der Implementierung von Tests durch Einsatz eines höheren Abstraktionsniveaus mittels deklarativer Beschreibung unter Nutzung von Aspekten, da nicht mehr ^edes Detail einzeln spezifiziert und von Hand programmiert werden muss.• A simplification of both the specification and the implementation of tests by using a higher level of abstraction by means of declarative description using aspects, since no more detail must be individually specified and programmed by hand.
• Eine Wiederverwendung und Erweiterung von Tests ist einfach möglich.• Reuse and expansion of tests is easy.
• Eine Kopplung und Kombination von Tests ist hiermit einfach möglich, was zu einer höheren Mächtigkeit der resultierenden Tests führt.• Coupling and combination of tests is easily possible, resulting in a higher power of the resulting tests.
• Eine Spezifikation und Implementierung komplexerer Tests ist möglich. • Specification and implementation of more complex tests is possible.

Claims

Patentansprüche claims
1. Verfahren zur Handhabung von Software-Tests, bei dem mindestens eine jeweilige Spezifikation und Implementierung eines neuen Software-Tests dadurch erfolgt, dass ein testübergreifende Belange repräsentierender jeweiliger Aspekt mit einem AOP Aspect Weaver in die zu testende Software eingewoben wird, diese entsprechend instrumentiert und daraus ein Grundtest entsteht oder dass zu einem bisherigen Grundtest mindestens ein testübergreifende Belange repräsentierender weiterer Aspekt derart hinzugefügt wird, dass der weitere Aspekt mit einem AOP Aspect Weaver in den bisherigen Grundtest eingewoben wird und diesen entsprechend zusätzlich instrumentiert.1. A method for handling software tests, in which at least one respective specification and implementation of a new software test is performed by interweaving a cross-test concern-relevant aspect with an AOP Aspect Weaver in the software under test, instrumenting these accordingly and From this, a basic test is created or that at least one further aspect that represents more than one test is added to a previous basic test in such a way that the further aspect is woven into the previous basic test with an AOP Aspect Weaver and instrumented accordingly.
2. Verfahren nach Anspruch 1, bei dem Performance Tests dadurch gebildet werden, dass zu bisherigen funktionalen Tests ein Aspekt hinzugefügt wird, der Timing Informationen repräsentiert.2. The method of claim 1, wherein the performance tests are formed by adding an aspect to previous functional tests that represents timing information.
3. Verfahren nach Anspruch 1, bei dem ein Langzeittest bzw. ein entsprechender Last- und Stresstest dadurch gebildet wird, dass zu bisherigen funktionalen Tests ein Aspekt hinzugefügt wird, der Langzeittestbelange repräsentiert.3. The method of claim 1, wherein a long-term test or a corresponding load and stress test is formed by adding to existing functional tests an aspect that represents long-term test concerns.
4. Verfahren nach Anspruch 1, bei dem ein Sicherheitstest dadurch gebildet wird, dass zu bisherigen funktionalen Tests ein Aspekt hinzugefügt wird, der Sicherheitsbelange repräsentiert.4. The method of claim 1, wherein a security test is formed by adding to previous functional tests an aspect that represents security concerns.
5. Verfahren nach Anspruch 1, bei dem ein negativer Test oder ein Randwerte-Test dadurch gebildet wird, dass zu einem entsprechenden positiven Test ein Aspekt hinzugefügt wird, der Ausnahme- und Fehlerbelange repräsentiert. 5. The method of claim 1, wherein a negative test or a boundary value test is formed by adding to an appropriate positive test an aspect representing exception and fault concerns.
EP05792118A 2004-11-15 2005-09-13 Method for manipulating software-tests Ceased EP1812865A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102004055052 2004-11-15
PCT/EP2005/054545 WO2006051013A2 (en) 2004-11-15 2005-09-13 Method for manipulating software-tests

Publications (1)

Publication Number Publication Date
EP1812865A2 true EP1812865A2 (en) 2007-08-01

Family

ID=36203270

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05792118A Ceased EP1812865A2 (en) 2004-11-15 2005-09-13 Method for manipulating software-tests

Country Status (3)

Country Link
US (1) US20080005723A1 (en)
EP (1) EP1812865A2 (en)
WO (1) WO2006051013A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111090588A (en) * 2019-12-12 2020-05-01 京东数字科技控股有限公司 Test method, device, system, electronic equipment and storage medium

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004041822A1 (en) * 2004-08-27 2006-03-02 Robert Bosch Gmbh Function unit for carrying out logical test cases on a test system coupled to a unit to be tested and corresponding method
US7582403B2 (en) * 2006-07-17 2009-09-01 E. I. Du Pont De Nemours And Company Metal compositions, thermal imaging donors and patterned multilayer compositions derived therefrom
US20110224939A1 (en) * 2010-03-10 2011-09-15 Jayaswal Manish K Integrated tool for persisting development environment test scenario information
US8856935B2 (en) 2012-02-07 2014-10-07 International Business Machines Corporation Automatic synthesis of unit tests for security testing
JP6384324B2 (en) * 2013-04-26 2018-09-05 東洋紡株式会社 Polyester films, laminates and packaging bags for sealants
US9390269B2 (en) 2013-09-30 2016-07-12 Globalfoundries Inc. Security testing using semantic modeling
WO2018112852A1 (en) * 2016-12-22 2018-06-28 深圳配天智能技术研究院有限公司 Ladderlogic programming language-based numerical control apparatus, numerical control system, and debugging method therefor
CN108572910A (en) * 2017-03-14 2018-09-25 百度在线网络技术（北京）有限公司 Experimental method and device for client
CN110147326B (en) * 2019-05-23 2023-05-26 四川新网银行股份有限公司 Microservice automatic test method based on Redis database

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6442750B1 (en) * 1999-07-20 2002-08-27 Xerox Corporation Design by contract with aspect-oriented programming
US6467086B1 (en) * 1999-07-20 2002-10-15 Xerox Corporation Aspect-oriented programming
GB2358988B (en) * 2000-02-07 2004-03-17 Mitel Corp Feature implementation and provisioning by injection
GB0229669D0 (en) * 2002-12-19 2003-01-29 Ibm A method for capturing computer application diagnostics
US20050262193A1 (en) * 2003-08-27 2005-11-24 Ascential Software Corporation Logging service for a services oriented architecture in a data integration platform
US20050234969A1 (en) * 2003-08-27 2005-10-20 Ascential Software Corporation Services oriented architecture for handling metadata in a data integration platform
US7328282B2 (en) * 2003-10-23 2008-02-05 International Business Machines Corporation Aspect oriented web service invocation
US8561034B2 (en) * 2006-06-22 2013-10-15 Infosys Technologies, Ltd. Software fault injection in java enterprise applications

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2006051013A2 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111090588A (en) * 2019-12-12 2020-05-01 京东数字科技控股有限公司 Test method, device, system, electronic equipment and storage medium

Also Published As

Publication number Publication date
WO2006051013A3 (en) 2007-04-26
US20080005723A1 (en) 2008-01-03
WO2006051013A2 (en) 2006-05-18

Similar Documents

Publication Publication Date Title
WO2006051013A2 (en) Method for manipulating software-tests
DE112006001222T5 (en) Semiconductor test program debug device
DE10393511T5 (en) Program development support device, program execution device, compilation method, and diagnostic method
DE102017217281A1 (en) Method and arrangement for evaluating and testing software development systems
DE102019209541A1 (en) Method and device for fulfilling a development task
EP0708941A1 (en) Process for testing an object-oriented programme
Barhum Mechanisms of the interaction between continuous and short fibres in textile-reinforced concrete (TRC)
CN108255718A (en) A kind of method for being multiplexed software use-case
DE102011079786A1 (en) Method and device for testing a program stored on a memory of an electrical appliance
Arslantürkoglu Risk-Based Seismic Assessment of Existing Unreinforced Masonry Buildings in Switzerland
Gouda The viability of certification systems in actualizing sustainable urban development
Reichling et al. Ground source heat pumps in Germany–Assessment of potential based on hydrogeological techniques and borehole information
WO2004025521A2 (en) Method and device for an equivalence comparison of digital circuits
Garcia Ulloa Improving Conservation Perspectives of Land-Use Change Policies in the Tropics
Bronstein et al. Dynamic loading of aircraft structures-Optimizing the design of structural elements
DE102008056434A1 (en) Method for verifying systems assembled from software components, involves bringing together software components to system abstractions for verification, where verifying conditions for software components are loaded
DE102012205207A1 (en) Method for creating a test program for an automatic test station
DE102022206900A1 (en) Method for testing a computer program in several compositions of computer program modules
DE102020205980A1 (en) Method and device for simulating a technical system
DE202014101210U1 (en) 2-component mixing head with flushing connection
Joo A Study on an innovative model of qualification based on NCS within cooperate
EP2110749B1 (en) Method for controlling connection pins of an emulation-capable component and assembly to carry out the method
DE102020007252A1 (en) Method for converting a non-executing file into an executable simulation model
DE102007036664A1 (en) Computer-controlled user terminals testing method, involves indicating status of user terminal test through display device independent of test run, test completed, input by user, or error
DE102019004398A1 (en) Obfuscation of a software application

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20070326

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17Q First examination report despatched

Effective date: 20071113

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIEMENS AKTIENGESELLSCHAFT

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SIEMENS AKTIENGESELLSCHAFT

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20160916