RU2678717C9 - Method for building a software system for automating and visualizing testing of embedded software for electronic devices - Google Patents

Abstract

FIELD: computer equipment.SUBSTANCE: invention relates to computing tools and can be used to build software systems for automating and visualizing testing of embedded software for bus-structured and modular equipment. System consists of a unified environment for writing, editing and executing tests, models of functional devices interacting with an electronic device with embedded software through expansion cards, a database, means of automated information analysis and database population.EFFECT: unified software system, reduced time of development and preparation of the software system, improved efficiency and easy software testing.1 cl, 1 dwg

Description

The invention relates to computing, in particular to software systems for automating and visualizing testing of embedded software (software) of electronic devices (EC).

The utility model "Hardware-software complex for automation, control, visualization and monitoring of technological processes" is known. Hardware-software complex for automation, control, visualization and monitoring of technological processes, contains workstations connected via a local area network (LAN), workstations automated workstations and servers based on personal electronic computers (PCs), as well as data transfer systems control device and functional modules designed to provide process control based on a software package and for physical impact input of process control devices, reading of the sensor process control and communicate the status of the I / O controllers. It has a centralized decision-making architecture that contains the main control unit and its subordinate functional modules based on industrial microcontrollers, integrated through an instrument interface, and is equipped with a software unit for visualizing process parameters (Patent for utility model RU #: 90588).

In this invention, the complex is based on hardware components that cannot always be easily and quickly modified, and the presence of a physical connection between the exchange of functional modules limits their interaction, i.e. there is no possibility of expanding the functions of their interaction in the event of the emergence of new requirements for such a complex.

The invention is known as the Debug Complex, which consists in the fact that the program debug complex contains a controlling computer, a control panel and a general-purpose computer, a group of input information simulators connected by inputs to a general-purpose computer, and outputs to a control computer, the synchronizing output of which connected to the sync input of the control panel, which is connected via the first bus to the control computer, and through the second to a general-purpose computer, signaling the course of which is combined with the control input of the control computer and connected to the output of the control panel (patent RU 2448363 C1).

In this invention, the emphasis is also placed on the interaction of hardware, without describing the interaction and building the software component of the debugging complex, which ultimately complicates its implementation and, as a result, will increase both labor costs and testing time.

The closest to the proposed solution to the technical essence is the invention "METHOD AND SYSTEM OF AUTOMATION OF SOFTWARE TESTING", namely, that the software testing automation system includes at least one user device and / or tester, at least one base data, at least one database of tests and software and hardware complex, made with the ability to: test software for test plans by Interactive interaction of the tester with the user interface of the software under test, recording the specified user actions automatically in predetermined terms of the level of the business logic of the software under test, storing the results in the test database as test scenarios, recording changes in the database produced during the execution of the specified test cases. scenarios, in automatic mode in predetermined terms, assigning to these changes the attribute “Reference changes” and storing the results in the test database, after modifying the software for performing its regression testing, playing test scripts from the test database in automatic mode, recording changes in the database made when executing the specified test scripts, in automatic mode in predetermined terms, assigning these changes to the changes “Actual changes” and storing the results in the test database, performing verification for each test scenario, comparing “Reference changes” and “Actual changes ”and saving the results of the comparison in the test database, forming a list of test scenarios that did not pass verification, while changes that did not pass verification imply discrepancies between“ Reference changes ”and“ Actual changes ”and were made additionally with the ability to: identify the main business processes performed using the software under test, drawing up a detailed test plan for the identified business processes, fixing the options for interactive testing Single user interface test software (patent RF №2013126869 / 08), which has been selected as a prototype.

The disadvantage of the prototype is:

- The lack of uniform and clear requirements for software models (simulators) of interaction with the electronic device of the software being tested will lead to complication of the implementation of the software package and limiting the possibilities for its development;

- Lack of visualization tools (as the main tool for providing test results) for operational and flexible monitoring of the status of modeling tools, as well as their data and entities.

The objectives of the invention are:

- unification of the software package, by developing uniform rules (methods) for the implementation and modularity of building components of the complex (models) and isolating their data and structures from each other and interacting with each other through a common memory buffer;

- reduction of development time and preparation of the software complex and models of functional devices due to the use of a single template of the interaction function and model dialog boxes and the development of uniform rules for their construction and implementation, as well as automation of information generation for visualization in the database based on the source data for the development of the test BY;

- improving the efficiency and facilitating software testing by presenting and visualizing the state of data and entities of each model as a set of interfaces called in real time at any stage of test execution.

The tasks are achieved by the fact that the software package consists of a unified software environment for writing and executing tests, including tools for writing, editing and executing tests, automated analysis and processing of information, visualization of data and entities in the testing process and at the stage of preparing for it, storing test sets and connecting them to the complex at any stage of testing, dynamic reconfiguration and management at any time by the software complex and its components, highlighted common buffer for interaction of connected models, protection and restoration of the complex in the presence of unforeseen failures during its operation, dynamically connected models of functional devices implemented as independent unified software modules with a predetermined uniform set of methods and functions containing means for presenting and visualizing data state and entities, developed according to uniform rules of construction and implementation, database of data presentation and entities, automated tools ovannogo filling the database with information based on the analysis of the documentation for which the tested software is developed.

In the drawing (Fig. 1) a block diagram of the implementation of the software package is presented.

The software package is implemented as follows:

The software package consists of a unified environment for writing, editing and executing tests, models of functional devices interacting with an electronic device with firmware using expansion cards, a database, automated information analysis tools, and populating a database.

A common software environment for writing and executing tests is implemented as a single user interface that contains tools for writing, editing and executing tests, tools for analyzing and processing information, tools for visualizing data and entities of both our own and functional device models at any stage of testing, management tools storing test kits and connecting them to the complex at any stage of testing, means of dynamic reconfiguration and control at any time, program complex and any component in its composition, the protection and recovery of the complex in the presence of unexpected failures during its operation. A common software environment for writing and executing tests provides for allocating a memory buffer for intermodel interaction, with the possibility of expanding such interaction as new requirements for models become available or new models are added to the complex.

Functional device models are implemented as independent unified software modules with a predetermined single set of methods and functions and visualization tools and presentation of the state of their internal data and entities, developed according to uniform rules of construction and implementation, and controlled by the software environment for running tests in real time at any stage testing.

The database contains information that includes the parameters of the software package and the information necessary to visualize and provide data and entities of the software package at any stage of the test. A database is implemented as a set of related tables in accordance with a specific type of purpose and use, with reference to certain types of software being tested.

Means of automated analysis of information and filling in the database perform analysis of the documentation describing the interaction device with the software being tested and filling the database in order of the data belonging to its type of purpose and use and internal binding between them.

The program complex works as follows:

In the database management program, the main information on the tested software of the electronic device (device ownership and software identifier that is unique for any software of the electronic device) is entered.

Based on the software identifier, a typed Microsoft Excell file (* .xls) is created with tables for filling in the data, which records information from the software documentation of the electronic device (software development ID) in the corresponding tables of the typed file.

The database management program automatically fills the database with information, tying it to the software identifier, as well as assigning identifiers for each record in the database with data binding to each other, in accordance with the construction of database tables.

The user launches a unified software environment (ENP) for writing, editing and executing tests. The ENP on startup determines the availability of the test case storage server and connects to it in read / write access mode (by default, read-only access mode, for unauthorized changing data on it). Further, it configures internal structures and data, allocates a common buffer for intermodel interaction and, based on the software identifier, connects the corresponding functional device models, passing each model of their configuration parameters (data of the previous configuration, current selected software identifier, descriptor of the memory buffer for intermodel interaction , and other parameters necessary to configure the model and run the stream (s), simulating (their) model operation).

There are two modes in the ENP: “Editor” and “Work”, both modes are selected by the corresponding tabs.

In the "Editor" mode, the user creates test sequences (cyclograms), edits them and saves them in the working directory. The working directory forms the ENP in accordance with the selected current configuration, i.e. creating the appropriate directories for belonging to the type of electronic device and the index of the software being tested.

In the “Work” mode, a tool for performing test sets is presented, in several modes: single-pass, infinite looping, and step-by-step execution, as well as tools that act as breakpoints for running a test set to a specified position.

The ENP implements the storage test management functions using the server:

- copy / move the current test case to the server, and a chain of directories corresponding to the working one will be created on the server and one more directory with the version number for which this set was developed and tested will be added;

- copy / move the test set from the server while selecting from the list of available sets by belonging to the software versions;

- open the directory in the explorer containing the test set;

- view the full list of tests, both in the working directory and on the server.

In the event of an unexpected failure or crash of the ENP, the next time it starts up, it restores unsaved test sets and execution protocols, and configuration parameters of the ENP.

The ENP contains access and model control elements implemented in the form of a context menu that appears when you click on the corresponding model icon. This menu is available at any stage of working with the ENP, including the test execution mode, to influence the testing progress in real time.

Through this context menu, the user can access the model to perform the following interaction functions:

- adjustment of internal parameters (frequency of the flow, addresses of devices and data necessary both for setting up the hardware of interaction with the electronic device, and internal structures, data and model entities);

- flow control model. The model stream performs the functions of simulating the logic of a functional device;

- implementation of the function of interaction with the model (recording of control actions both for issuing to an electronic device, and for controlling the internal state of data and model entities, reading the state);

- visualization of data and model entities (data are presented both in the form of codes themselves, and in the form of various types of presentation: icons, icons, graphs, images, etc.).

Also, each model logs information in its local buffer for the entire period of the ENP operation (reception of commands, signals, effects from both the electronic device and the ENP), which allows to control at any stage what happened to each model, for example how it was recorded not passing the test, which facilitates the analysis of the state of the tested software during the test.

To edit tests in the ENP is presented a basic set of operations for testing, with the possibility of its expansion:

- normal message - access to the model for writing or reading data;

- system message - execution of user actions (mode switching, model control, etc.);

- pause - stop the testing process for a pause;

- control of data words - bit-by-bit control of the information obtained during the test;

- comment (not in the report) - display of the text in the sequence diagram (it does not enter the report when executed);

- warning — displays a message on the screen with the cyclogram execution stopped until the message is closed;

- cyclogram - selection of the enclosed cyclogram;

- service comment - display of the text in the sequence diagram, and when it is executed, is displayed in the protocol;

- event waiting - organization of the event waiting timer in the selected model, indicating the number of expected events. Allows you to synchronize the progress of the test software with the progress of the test, which provides the most accurate interaction and impact on the software being tested;

- control of the array - control of the information obtained during the test with reference to the place (position) of the controlled data in the array;

- control of data in the array - control of information obtained during the test, without reference to the place (position) of the controlled data in the array;

- control of data words on a range - control of information received during the test, for entering a specified range.

The test visualization tools available to the user for testing are presented in the form of a graphic accompaniment set that includes the basic tools: color highlighting types of operations, highlighting testing progress, highlighting non-passing operations, highlighting certain information that did not pass control, etc., and complex means of presenting information (for example, mapping the position of the Sun in space when modeling instruments in the mode of solar orientation of a spacecraft, relative to rd it through the device "presence sensor sun", and latch the display of each point of this path in the plane orientation and display of all the parameters in real time).

The unification of a software package is achieved by developing uniform rules (methods) for the implementation and modularity of building components of a complex (models) and isolating their data and structures from each other and interacting with each other through a common memory buffer.

Reduction of the development time and preparation of the software complex and functional device models is achieved through the use of a single template for the interaction function and model dialog boxes and the development of common rules for their construction and implementation, as well as automated tools for analyzing information and filling in the database.

Improving the efficiency and ease of software testing is provided by visualizing the presentation of the state of each model's data in the form of dialog boxes or “metaphors” - thematic plots reflecting the general testing progress and the state of data and entities called in real time at any stage of test execution.

With the use of this complex, the embedded software of the control units of the onboard control complex of prospective spacecraft manufactured by ISS JSC was tested. Due to a unified approach to building a software package and a single template for interaction functions and model dialog boxes, a significant reduction in the programmer’s workload during the implementation of the complex and its preparation for software testing was noted, as well as the possibility was shown for further expansion of its functionality in the future. The availability of test visualization tools implemented in the software package ensured the flexibility and ease of software testing, reducing the laboriousness of specialists and reducing the total testing time.

Of the patent information materials known to the applicant, no signs were found that are similar to the set of features of the claimed invention.

Claims (1)

Complex automation and visualization testing of embedded software of electronic devices, which consists in the fact that the software package is designed to test software, create test scenarios and store them in the database as a reference, build a database of tests, obtain actual values, compare reference and actual values and with the ability to identify the main business processes that are performed using the tested software making a detailed plan for testing the identified business processes, fixing options for user interaction with the user interface of the software being tested, characterized in that the software package includes a unified software environment for writing and executing tests, containing tools for writing, editing and executing tests, automated analysis and information processing , visualization of data and entities in the process of testing and at the stage of preparation for it, storage of test sets and connecting them to the complex at any stage of testing, dynamic reconfiguration and control at any time by the software complex and any components included in its composition, allocating a common buffer for the interaction of connected models and their arbitrary reconfiguration, both in manual mode and during the execution of tests, protection and restoration of the complex in the presence of unforeseen failures in the course of its operation, dynamically connected models of functional devices, implemented as independent unified These software modules with a predefined uniform set of methods and functions and visualization tools and presentation of the state of their internal data and entities, developed according to uniform rules for building and implementing a unified template and called from a single software environment for writing and executing tests, a database for storing data representations and entities, means of automated database filling with information based on the analysis of the documentation on which the software being tested is developed provision of.

Images