JP2009223412A - Software verification support device, software verification support method, and software verification support program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce a verifier's labor, to shorten a development period and to attain the high accuracy of verification simultaneously in software verification. <P>SOLUTION: This software verification support device 100 icludes a display part 201, an execution part 202, a specifying part 203 and a display control part 204. The display part 201 displays a GUI (graphical user interface) screen on software to be verified. The execution part 202 executes GUI processing of the software when the GUI screen is displayed. The specifying part 203 specifies a GUI element related to the GUI processing executed by the execution part 202, from the GUI screen. The display control part 204 controls the GUI screen to make an emphasized display of a display area including the GUI element specified by the specifying part 203, out of the GUI screen. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a software verification support apparatus, a software verification support method, and a software verification support program that support verification (debugging) of software to be verified.

  Conventionally, in verification of software having GUI (Graphical User Interface) processing (hereinafter referred to as “GUI software”), the validity of the program of the software and the GUI processing based on the program are displayed on the GUI screen as designed. It is necessary to verify two points of validity (hereinafter referred to as “GUI screen validity”). The validity of the software program is verified by using, for example, a software verification support tool for assisting in finding and correcting a bug in the program, that is, a so-called debugger (see, for example, Patent Document 1 below). .

  On the other hand, since the verification of the validity of the GUI screen may not be able to be verified by the debugger, the verification is performed by actually executing the program and visually checking the GUI screen.

  FIG. 13 is an explanatory diagram illustrating an example of software verification according to the related art. An example shown in FIG. 13 is verification of software in which the GUI element 1303 is not displayed among the GUI elements 1301 to 1303 on the GUI screen 1300. First, for example, a verifier executes a software program to be verified. The validity of the executed program is verified by the debugger.

  Next, the verifier visually checks whether the GUI processing for hiding the GUI element 1303 is performed on the GUI screen 1300 as designed. In this way, the verifier verifies the validity of the GUI screen by comparing the program with the change on the GUI screen, whether the program operates normally and GUI processing is performed, and the GUI screen is as designed. .

JP 2004-192293 A

  However, in the above-described prior art, when the GUI software is verified, the validity of the program and the validity of the GUI screen are independently verified. It depends on the skill level of the verifier. That is, a verifier with a low skill level cannot estimate a GUI element related to GUI processing (for example, hidden), which increases the burden on the verifier and prolongs the development period. there were. Also, a verifier with a high level of skill would guess GUI elements related to GUI processing based on experience and intuition, but because the GUI processing is enormous, the burden on the verifier increases and the design period is long. There was a problem of becoming. Further, as described above, the operation depending on the guess of the verifier is complicated, and the oversight of the verifier occurs, so that there is a problem that the verification accuracy is lowered.

  In addition, verification of the validity of the program and verification of the validity of the GUI screen are performed independently. Therefore, when a problem is found on the GUI screen, the GUI processing that causes the problem is performed for a number of programs. There is a problem in that the development is inefficient because much time and effort are required, such as the need to search from the inside, and the corresponding GUI processing cannot be immediately found.

  In addition, when such verification is simplified without taking time and effort, a defect that cannot be immediately discovered may be overlooked. For example, there is a high possibility of overlooking a defect that cannot be found immediately, such as when an unnecessary GUI element that is not in the design is hidden under another GUI element. When unnecessary GUI elements remain, there is a problem that when software is incorporated, hardware resources of the computer apparatus are wasted, leading to performance degradation.

  In order to solve the above-described problems caused by the prior art, the present invention simultaneously realizes the validity of the GUI screen in association with the validity of the program, thereby reducing the labor of the verifier, shortening the development period, Another object of the present invention is to provide a software verification support apparatus, a software verification support method, and a software verification support program that can simultaneously improve the accuracy of verification.

  In order to solve the above-described problems and achieve the object, a software verification support apparatus according to the present invention includes a display unit that displays a GUI screen related to software to be verified, and the software when the GUI screen is displayed. Executing means for executing the GUI process; specifying means for specifying a GUI element related to the GUI process executed by the executing means from the GUI screen; controlling the GUI screen; and The display control means for highlighting the display area including the GUI element specified by the specifying means.

  According to the present invention, the GUI element related to the executed GUI process can be visually clarified while executing the GUI process.

  Further, in the above-described invention, a GUI element that changes due to execution of the GUI process may be specified from the GUI screen.

  According to the present invention, it is possible to visually clarify GUI elements that change by being directly or indirectly influenced by the executed GUI processing while executing the GUI processing.

  In the above-described invention, a GUI element that disappears when the GUI process is executed among the GUI elements in the GUI screen may be specified.

  According to the present invention, GUI elements that are directly affected by the executed GUI process and disappear can be clarified visually while executing the GUI process.

  In the invention described above, a GUI element that newly appears when the GUI processing is executed may be specified from the GUI screen.

  According to the present invention, GUI elements that are directly influenced by the executed GUI processing and appear newly can be visually clarified while executing the GUI processing.

  Further, in the above-described invention, a GUI element whose character string, color, shape, or size is changed by executing the GUI process among the GUI elements in the GUI screen may be specified. .

  According to the present invention, a GUI element that is directly influenced by the GUI processing and changes in character string, color, shape, or size can be visually clarified while executing the GUI processing.

  In the above-described invention, a GUI element that moves or rotates when the GUI process is executed among the GUI elements in the GUI screen may be specified.

  According to the present invention, a GUI element that is directly influenced by the GUI process and moves or rotates can be visually clarified while executing the GUI process.

  In the above-described invention, a GUI element that appears due to a GUI element that disappears or moves when the GUI process is executed among GUI elements in the GUI screen may be specified.

  According to the present invention, it is possible to visually clarify GUI elements that appear indirectly influenced by the GUI processing while executing the GUI processing.

  Further, in the above-described invention, a GUI element hidden or hidden by a GUI element that appears or moves when the GUI process is executed among the GUI elements in the GUI screen may be specified.

  According to the present invention, a GUI element that is indirectly influenced by the GUI processing and is hidden can be visually clarified while executing the GUI processing.

  In the invention described above, after the GUI process is executed, another GUI process different from the GUI process is executed, and the specifying unit is configured to display the display area (hereinafter referred to as “first display”) by the display control unit. The GUI element related to the other GUI processing is specified from the GUI screen on which “display area” is highlighted, and the display control means controls the GUI screen to control the first display area. The second display area including the GUI element specified by the specifying means is highlighted in the GUI screen on which is highlighted.

  According to the present invention, GUI elements corresponding to a plurality of GUI processes can be visually clarified while executing the GUI process.

  Further, in the above-described invention, there is provided reception means for receiving an instruction to execute the other GUI process, and the execution means executes another GUI process for which the execution instruction has been received by the reception means. To do.

  According to the present invention, another GUI process can be executed at any timing of the verifier.

  In the invention described above, the GUI screen is controlled to cancel the highlighting of the first display area.

  According to the present invention, highlighting can be canceled as necessary.

  In the invention described above, the GUI screen is controlled to highlight the first and second display areas so as to be relatively different from each other.

  According to the present invention, highlighting is performed so as to be relatively different, and GUI elements corresponding to the respective GUI processes can be clarified more visually.

  According to the software verification support apparatus, the software verification support method, and the software verification support program according to the present invention, it is possible to simultaneously verify the validity of the GUI screen in association with the verification of the validity of the program. There is an effect that reduction, shortening of the development period, and high accuracy of verification can be achieved at the same time.

  Exemplary embodiments of a software verification support apparatus, a software verification support method, and a software verification support program according to the present invention will be described below in detail with reference to the accompanying drawings.

(Outline of software verification support device)
First, an outline of a software verification support apparatus according to an embodiment of the present invention will be described. The software verification support apparatus according to the embodiment of the present invention is realized, for example, by installing a program prepared in advance in a computer apparatus such as a personal computer and executing the program.

  The software verification support apparatus is executed by highlighting a display area including a GUI element related to the executed GUI process when the GUI process is executed on the GUI screen related to the software to be verified. A GUI process and a GUI element related to the GUI process can be verified at the same time, thereby improving the efficiency of software verification.

(Hardware configuration of software verification support device)
Next, a hardware configuration of the software verification support apparatus according to the embodiment of the present invention will be described. FIG. 1 is a block diagram showing a hardware configuration of a software verification support apparatus according to an embodiment of the present invention.

  In FIG. 1, a software verification support apparatus 100 includes a CPU 101, a ROM 102, a RAM 103, an HDD (hard disk drive) 104, an HD (hard disk) 105, an R / W (reader / writer) 106, and a removable recording. As an example of the medium, a DVD 107, a display 108, an I / F (interface) 109, a keyboard 110, a mouse 111, a scanner 112, and a printer 113 are provided. Each component is connected by a bus 120.

  The CPU 101 controls the entire computer device. The ROM 102 records a program such as a boot program. The RAM 103 is used as a work area for the CPU 101. The HDD 104 controls reading / writing of data with respect to the HD 105 according to the control of the CPU 101. The HD 105 records data written under the control of the HDD 104.

  The R / W 106 controls reading / writing of data with respect to the DVD 107 according to the control of the CPU 101. The DVD 107 records data written under the control of the R / W 106, and allows the computer device to read data recorded on the DVD 107.

  In addition to the DVD 107, the removable recording medium may be a CD-ROM (CD-R, CD-RW), MO (Magneto Optical Disk), FD (flexible disk), memory card, or the like. The display 108 displays data such as a document, an image, and function information as well as a cursor, an icon, or a tool box. As this display 108, for example, a CRT, a TFT liquid crystal display, a plasma display, or the like can be adopted.

  The I / F 109 is connected to a network such as the Internet through a communication line, and is connected to other devices via this network. The I / F 109 controls a network and an internal interface, and controls data input / output from an external device. For example, a modem or a LAN adapter may be employed as the I / F 109.

  The keyboard 110 includes keys for inputting characters, numbers, various instructions, and the like, and inputs data. Moreover, a touch panel type input pad or a numeric keypad may be used. The mouse 111 performs cursor movement, range selection, window movement, size change, and the like. A trackball or a joystick may be used as long as they have the same function as a pointing device.

  The scanner 112 optically reads an image and takes in the image data into the computer apparatus. The scanner 112 may have an OCR function. The printer 113 prints image data and document data. For example, a laser printer or an ink jet printer can be employed as the printer 113.

(Functional configuration of software verification support device)
Next, a functional configuration of the software verification support apparatus according to the embodiment of the present invention will be described. FIG. 2 is a block diagram showing a functional configuration of the software verification support apparatus according to the embodiment of the present invention. As shown in FIG. 2, the software verification support apparatus 100 according to the embodiment of the present invention includes a display unit 201, an execution unit 202, a specifying unit 203, and a display control unit 204.

  The display unit 201 has a function of displaying a GUI screen regarding software to be verified. The GUI screen related to the software to be verified is, for example, a screen displayed by a program of software to be verified. On the GUI screen, for example, GUI elements such as graphics (so-called icons) symbolizing instructions and commands and graphics (so-called text boxes) displaying character strings are displayed (for example, FIG. 9-1). -9-9)). The display unit 201 is realized by the display 108, for example.

  The execution unit 202 has a function of executing various operations related to the software verification support apparatus 100. Specifically, the execution unit 202 executes, for example, software verification support or GUI processing of software to be verified. For example, the execution unit 202 executes the GUI process of software when the display unit 201 displays the GUI screen.

  Here, the GUI process is a process related to display of a GUI element, such as a process of changing a certain GUI element or a process of moving a certain GUI element. Specifically, the GUI processing is executed by the CPU 101 reading the program described in the program and recorded in the ROM 102 or the like.

  The specifying unit 203 has a function of specifying a GUI element related to the GUI process executed by the execution unit 202. For example, the specifying unit 203 specifies a GUI element that is not displayed when the GUI process is executed. Here, “non-display” means that the GUI element displayed on the GUI screen becomes invisible. Specifically, for example, the GUI element to be processed by executing the GUI process is erased from the VRAM, made transparent by changing the alpha value, or concealed by the Z buffer method.

  Further, the specifying unit 203 may specify a GUI element that newly appears when the GUI process is executed. Here, “appearance” means that a GUI element that has not been displayed becomes visible. Specifically, for example, the GUI element to be processed by the GUI process is drawn on the VRAM, colored by changing the alpha value, or front-facing using the Z buffer method.

  For example, when a GUI process related to the setting of an alarm function for sounding a predetermined time on a mobile phone is executed, a GUI element (for example, a bell mark) representing an alarm appears on the GUI screen displayed on the display. . Further, for example, when a GUI process related to canceling the setting of the alarm function is executed, a GUI element representing an alarm is not displayed on the GUI screen.

  Further, the specifying unit 203 may specify a GUI element whose character string, color, shape, or size changes due to execution of the GUI process. Here, the change in the character string, color, shape, or size specifically means that the character string of the GUI element such as a text box is changed to a different character string, or the RGB of the displayed GUI element is changed. For example, the color of the GUI element may be different.

  For example, when a GUI process related to a timekeeping function for the current time is being executed, a GUI element indicating the time (for example, XX: △△, XX: hour, △△ is minute) is displayed on the GUI screen. . The GUI element representing the time is updated to a new time (for example, 12:34 to 12:35) every time one minute elapses.

  The specifying unit 203 may specify a GUI element that moves or rotates when the GUI process is executed. Here, the movement is to change the coordinates on the GUI screen of the GUI element displayed on the GUI screen. For example, the mouse pointer displayed on the GUI screen moves on the GUI screen when GUI processing related to mouse operation is executed.

  Here, the rotation means changing the angle at which the GUI element is displayed. For example, on a GUI screen of music playback software for playing music, a GUI element representing a knob for adjusting the displayed volume is rotated when a GUI process related to volume increase / decrease by a user operation is executed.

  Further, the specifying unit 203 may specify a GUI element that appears when a hidden GUI element is hidden or moved. Here, the concealment is specifically a state in which two GUI elements are overlapped on the GUI screen, and the other GUI element is hidden by the GUI element placed on one upper surface. . That is, the specifying unit 203 specifies the other GUI element that appears when one GUI element arranged on the upper surface is hidden or moved.

  Further, the specifying unit 203 may specify a GUI element that is hidden by a GUI element that appears or moves. That is, the specifying unit 203 specifies the other GUI element that is hidden by overlapping with the other GUI element when one GUI element appears or moves on the other GUI element.

  For example, when an input of a predetermined key (for example, right click) is accepted when the mouse pointer is on a certain GUI element, GUI processing related to the display of the context menu of the GUI element is executed, and the vicinity of the mouse pointer A context menu is displayed. The context menu is always displayed in the foreground on the GUI screen, and GUI elements that overlap the context menu are hidden by the context menu.

  Further, when any command displayed in the context menu is selected, the context menu is not displayed on the GUI screen due to the GUI processing. Along with this, the hidden GUI element appears again on the GUI screen.

  The display control unit 204 has a function of highlighting and displaying the display area including the GUI element specified by the specifying unit 203 on the display unit 201. The highlighted display is to display a display area including the specified GUI element so as to be different from the display by the executed GUI process. For example, the display area including the specified GUI element is turned on or blinked so that the verifier can easily recognize it. The display control unit 204 is realized, for example, by causing the CPU 101 to execute various programs recorded in the ROM 102 or the like.

(Processing procedure of software verification support device)
Next, a processing procedure of the software verification support apparatus according to the embodiment of the present invention will be described. FIG. 3 is a flowchart showing a processing procedure of the software verification support apparatus according to the embodiment of the present invention. The flowchart illustrated in FIG. 3 is started when, for example, a verification start instruction is received by a verifier.

  First, the software verification support apparatus 100 according to the embodiment of the present invention determines whether there is an unprocessed GUI process, for example, when an instruction to start verification is received by the verifier (step S301). An unprocessed GUI process is, for example, a GUI process that has not yet been verified.

  If it is determined in step S301 that there is an unprocessed GUI process (step S301: Yes), the GUI process is executed based on the software program to be verified (step S302). Specifically, the execution unit 202 executes a GUI process for verifying from software programs to be verified.

  In step S302, after the GUI process is executed, a GUI element related to the executed GUI process is specified (step S303). Specifically, the specifying unit 203 specifies a GUI element related to the GUI process from the GUI process executed by the execution unit 202.

  In step S303, after a related GUI element is specified, a GUI screen in which a display area including the specified GUI element is highlighted is displayed (step S304). Specifically, the display control unit 204 controls the display unit 201 to highlight the display area including the GUI element specified by the specifying unit 203 and display the highlighted GUI screen.

  In step S304, after highlighting, the process returns to step S301, and it is determined again whether there is an unprocessed GUI process. If it is determined that there is an unprocessed GUI process, the same process is repeated. If it is determined that there is no unprocessed GUI process (step S301: No), the series of processes is terminated. To do.

(Specific display example by software verification support device)
(Highlighting by software verification support device)
Next, a specific display example by the software verification support apparatus will be described. First, highlighting by the software verification support apparatus according to the embodiment of the present invention will be described. 4 and 5 are explanatory views (No. 1) and (No. 2) for explaining emphasis display by the software verification support apparatus according to the embodiment of the present invention. 4 and 5 show an example in which a GUI process for hiding related GUI elements is executed and the related GUI elements are changed to non-display as an example.

  First, in FIG. 4, the software verification support apparatus 100 executes a GUI process for hiding the GUI element 401 for the displayed GUI element 401. When the software verification support apparatus 100 executes the GUI process, a new GUI element 401a in which the GUI element 401 is not displayed is created. In addition, a rectangular lighting element 402 having a predetermined color is created in the display area including the GUI element 401.

  After the GUI element 401a and the lighting element 402 are created, the GUI element 401a and the lighting element 402 are combined. Here, the composition is to superimpose two created elements. The combined GUI element 401 a and the lighting element 402 are displayed on the GUI screen as the highlighting element (lighting) 403. The highlighted element (lighted) 403 is displayed for a predetermined time (for example, 100 ms after being displayed).

  After a highlighted display element (lighting) 403 is displayed and a predetermined time has elapsed, a blinking element 404 is created on the outline of the lighting element 402 in FIG. The blinking element 404 is created by a dotted line having the same color as the lighting element 402, for example. After the blinking element 404 is created, the GUI element 401a and the blinking element 404 are combined and displayed on the GUI screen as a highlighting element (flashing) 405. The highlighted element (blinking) 405 is displayed so as to blink at a predetermined time interval (for example, at an interval of 500 ms).

  As described above, the highlight display by the software verification support apparatus 100 according to the embodiment of the present invention is performed by displaying the highlight display element (lighting) 403 and the highlight display element (flashing) 405. The highlighted element (lighted) 403 and the highlighted element (flashing) 405 are displayed on the front of the GUI screen, that is, without being hidden by the GUI element.

(Display color setting)
The software verification support apparatus 100 according to the embodiment of the present invention can associate the processing contents of the GUI processing with the display color corresponding to the processing contents in advance. Thereby, the lighting element 402 and the blinking element 404 can be displayed using different display colors depending on the processing content.

  FIG. 6 is an explanatory diagram for explaining a state in which the processing content of the GUI processing is associated with the display color corresponding thereto. As shown in FIG. 6, corresponding display colors are associated according to the processing contents of the GUI processing. For example, the software verification support apparatus 100 according to the embodiment of the present invention is a GUI process that highlights a display area in yellow in the case of a GUI process that displays / hides a GUI element, and moves the GUI element. Are associated so that the display area is highlighted in green.

  These display colors may be set in advance by the software verification support apparatus 100 manufacturing side, or may be arbitrarily set by the verifier. In addition to the colors designated by RGB for each display color, an alpha value representing the transparency can be set, and the alpha value can be arbitrarily changed. The alpha value is a known technique and is not described in detail, but is information on transparency.

  When the alpha value is set, the software verification support apparatus 100 can perform highlighting using alpha blending. Alpha blending is to display a semi-transparent image (for example, highlighting) and another image (for example, a GUI element) in a superimposed manner, although detailed description is omitted because it is a known technique. Thereby, for example, even when highlighted, the GUI element arranged under the highlighted display becomes visible.

(User interface of software verification support device)
Next, a user interface of the software verification apparatus according to the embodiment of the present invention will be described. 7 and 8 are explanatory views (No. 1) and (No. 2) showing the user interface of the software verification support apparatus according to the embodiment of the present invention.

  As shown in FIGS. 7 and 8, the user interface 700 of the software verification apparatus 100 according to the embodiment of the present invention includes a display window 701, a menu 702, and operation buttons 703. The user interface 700 is displayed on the display 108, for example.

  The display window 701 displays a GUI screen related to the software to be verified. On the GUI screen, GUI elements, highlighted display elements (lighted), highlighted display elements (flashing), and the like are displayed.

  In the menu 702, various commands given to the software verification support apparatus 100 are classified in advance and displayed hierarchically. The command is, for example, processing executed by the software verification support apparatus 100. For example, as shown in FIG. 7 and FIG. 8, “file” and “debug” are first displayed on the user interface 700 as a menu of the highest hierarchy. Here, for example, as shown in FIG. 8, when “debug” is selected, the commands classified as “debug” are “start”, “start (step execution)”, “interrupt”, and “ “Clear” is displayed by a pull-down menu.

  The verifier can cause the software verification support apparatus 100 to execute a desired process by selecting a command from the menu 702. Note that typical commands for the verification support of the software verification support apparatus 100 will be described later.

  The operation buttons 703 are so-called shortcut keys that are associated with the corresponding commands and can directly execute the corresponding commands without selecting the commands from the menu 702. The operation button 703 is associated with, for example, a command frequently used by the verifier. The operation buttons 703 shown in FIG. 7 are set in association with commands of “start”, “interrupt”, “start (step execution)”, “step execution”, and “clear”, respectively, from the left.

(Representative command of software verification support device)
Next, typical commands for the verification support of the software verification support apparatus will be described. “Start” highlights and verifies the software. That is, by “start”, the display area including the related GUI element is highlighted as the GUI process is executed. “Suspend” interrupts the verification of the software started by selecting “Start”.

  “Start (Step Execution)” executes GUI processing step by step (for example, program one line at a time) and highlights a display area including GUI elements related to the executed one-step GUI processing. To verify the software. In step execution, GUI processing is executed step by step based on a software program to be verified. “Clear” cancels highlighting of the highlighted display area.

(Specific display example displayed on the user interface)
Next, a specific display example displayed on the above-described user interface 700 will be described. FIGS. 9-1 to 9-8 are explanatory views (No. 1) to (No. 8) showing specific display examples displayed on the user interface of the software verification support apparatus according to the embodiment of the present invention.

(Display example when a new GUI element is displayed)
First, a display example when a new GUI element is displayed will be described with reference to FIG. FIG. 9A is an explanatory diagram (part 1) of a specific display example displayed on the user interface of the software verification support apparatus according to the embodiment of the present invention. As illustrated in FIG. 9A, a GUI window 900 relating to software to be verified is displayed in the display window 701 of the user interface 700. In addition, the GUI screen 900 displays a rectangular GUI element 901 and a triangular GUI element 902.

  Here, for example, when a circular GUI element 903 is displayed as a new GUI element, the circular GUI element 903 is displayed and the display area 903a including the circular GUI element 903 is highlighted. That is, a circular GUI element 903 is displayed, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 903a. Further, as shown in FIG. 6, when the display color associated with the display / non-display of the GUI element is “yellow”, the highlight element (lighted) and the highlight element (flashing) are yellow. Displayed.

(Display example when hiding the displayed GUI element)
Next, a display example when the displayed GUI element is not displayed will be described with reference to FIG. FIG. 9-2 is an explanatory diagram (part 2) of a specific display example displayed on the user interface of the software verification support apparatus according to the embodiment of the present invention. As illustrated in FIG. 9B, the display window 701 of the user interface 700 displays a GUI screen 900 related to software to be verified. In addition, the GUI screen 900 displays a rectangular GUI element 901, a triangular GUI element 902, and a circular GUI element 903.

  Here, for example, when the circular GUI element 903 is not displayed among the displayed GUI elements, the circular GUI element 903 is not displayed, and the display area includes the circular GUI element 903. 903a is highlighted. That is, the circular GUI element 903 is not displayed, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 903a. Further, as shown in FIG. 6, when the display color associated with the display / non-display of the GUI element is “yellow”, the highlight element (lighted) and the highlight element (flashing) are yellow. Displayed.

(Display example when the displayed GUI element is moved)
Next, a display example when the displayed GUI element is moved will be described with reference to FIG. FIG. 9-3 is an explanatory diagram (part 3) of a specific display example displayed on the user interface of the software verification support apparatus according to the embodiment of the present invention. As illustrated in FIG. 9C, the display window 701 of the user interface 700 displays a GUI screen 900 related to software to be verified. In addition, the GUI screen 900 displays a rectangular GUI element 901, a triangular GUI element 902, and a circular GUI element 903. These GUI elements 901 to 903 are displayed in a stationary state.

  Here, for example, when the circular GUI element 903 is moved among the displayed GUI elements, the circular GUI element 903 is moved, and the display area 903a including the circular GUI element 903 is highlighted. Is done. That is, the circular GUI element 903 is moved to a predetermined position, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 903a. Further, as shown in FIG. 6, when the display color associated with the movement of the GUI element is “green”, the highlighted element (lighted) and the highlighted element (flashing) are displayed using green. The

(Display example when changing the shape of the displayed GUI element)
Next, a display example when the shape of the displayed GUI element is changed will be described with reference to FIGS. 9-4 is explanatory drawing (the 4) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. As shown in FIG. 9-4, a GUI window 900 related to software to be verified is displayed in the display window 701 of the user interface 700. In addition, the GUI screen 900 displays a rectangular GUI element 901, a triangular GUI element 902, and a circular GUI element 903.

  Here, for example, when the shape of the triangular GUI element 902 among the displayed GUI elements is changed, the shape of the triangular GUI element 902 is changed and the star-shaped GUI element 904 is displayed. A display area 904a including the star-shaped GUI element 904 is highlighted. That is, the triangular GUI element 902 is changed into a star-shaped GUI element 904, and at the same time, the above-described highlight display element (lighted) and highlight display element (flashing) are displayed in the display area 904a. Further, as shown in FIG. 6, when the display color associated with the change in the shape of the GUI element is “red”, the highlighted element (lighted) and the highlighted element (flashing) are red. Is displayed.

(Display example when the displayed GUI element is rotated)
Next, a display example when the displayed GUI element is rotated will be described with reference to FIG. 9-5 is explanatory drawing (the 5) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. As illustrated in FIG. 9-5, a GUI window 900 related to software to be verified is displayed in the display window 701 of the user interface 700. In addition, the GUI screen 900 displays a rectangular GUI element 901, a triangular GUI element 902, and a circular GUI element 903. These GUI elements 901 to 903 are displayed in a stationary state.

  Here, for example, when the triangular GUI element 902 among the displayed GUI elements is rotated, the triangular GUI element 902 is rotated and the display area 902a including the triangular GUI element 902 is highlighted. Is displayed. That is, the triangular GUI element 902 is rotated by a predetermined angle, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 902a. Further, as shown in FIG. 6, when the display color associated with the rotation of the GUI element is “blue”, the highlighted element (lighted) and the highlighted element (flashing) are displayed using blue. The

(Display example when the size of the displayed GUI element is changed (enlarged))
Next, a display example when the size of the displayed GUI element is changed (enlarged) will be described with reference to FIG. FIGS. 9-6 is explanatory drawing (the 6) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. As shown in FIG. 9-6, a GUI window 900 related to software to be verified is displayed in the display window 701 of the user interface 700. In addition, the GUI screen 900 displays a rectangular GUI element 901, a triangular GUI element 902, and a circular GUI element 903.

  Here, for example, when the size of the circular GUI element 903 among the displayed GUI elements is enlarged, the size of the circular GUI element 903 is enlarged and the display area including the circular GUI element 903 is displayed. 903a is highlighted. That is, the circular GUI element 903 is enlarged to the circular GUI element 903b, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 903a. As shown in FIG. 6, when the display color associated with the enlargement / reduction of the GUI element is “orange”, the highlighted display element (lit) and the highlighted display element (flashing) use orange. Displayed.

(Display example when the size of the displayed GUI element is changed (reduced))
Next, a display example when the size of the displayed GUI element is changed (reduced) will be described with reference to FIG. FIG. 9-7 is an explanatory diagram (part 7) of a specific display example displayed on the user interface of the software verification support apparatus according to the embodiment of the present invention. As shown in FIG. 9-7, a GUI window 900 related to the software to be verified is displayed in the display window 701 of the user interface 700. In addition, the GUI screen 900 displays a rectangular GUI element 901, a triangular GUI element 902, and a circular GUI element 903.

  Here, for example, when the size of the circular GUI element 903 among the displayed GUI elements is reduced, the size of the circular GUI element 903 is reduced and the display area including the circular GUI element 903 is displayed. 903c is highlighted. That is, the circular GUI element 903 is reduced to the circular GUI element 903d, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 903c. As shown in FIG. 6, when the display color associated with the enlargement / reduction of the GUI element is “orange”, the highlighted display element (lit) and the highlighted display element (flashing) use orange. Displayed.

(Display example when the character string of the displayed GUI element (text) is changed)
Next, a display example when the character string of the displayed GUI element (text) is changed will be described with reference to FIGS. FIG. 9-8 is an explanatory diagram (part 8) of a specific display example displayed on the user interface of the software verification support apparatus according to the embodiment of the present invention. As shown in FIG. 9-8, the display window 701 of the user interface 700 displays a GUI screen 900 related to the software to be verified. Also, on the GUI screen 900, a GUI element 905 of a text box, a triangular GUI element 902, and a circular GUI element 903 are displayed as GUI elements.

  Here, for example, when the character string displayed in the GUI element 905 of the text box is changed, the character string displayed in the GUI element 905 of the text box is changed, and the GUI element 905 of the text box is changed. A display area 905a including is highlighted. That is, the character string displayed in the GUI element 905 of the text box is changed to a predetermined character string, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 905a. Further, as shown in FIG. 6, when the display color associated with the change of the text display is “pink”, the highlighted element (lighted) and the highlighted element (flashing) are displayed using pink. Is done. If the character string displayed in the GUI element 905 of the text box is changed using the flow character function, the character string is displayed using purple.

(Display example when a GUI element newly appears due to the influence of another GUI element)
Next, a display example when a new GUI element appears due to the influence of a GUI element that is not displayed or moved will be described with reference to FIGS. 9-9 is explanatory drawing (the 9) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. As shown in FIG. 9-9, the display window 701 of the user interface 700 displays a GUI screen 900 related to the software to be verified. In addition, the GUI screen 900 displays a rectangular GUI element 901, a triangular GUI element 902, and a circular GUI element 903 as GUI elements. In addition, a star-shaped GUI element 906 is disposed under the circular GUI element 903.

  Here, for example, when the circular GUI element 903 is not displayed, a star-shaped GUI element 906 arranged under the circular GUI element 903 appears, and a display area including the star-shaped GUI element 906 is displayed. 906a is highlighted. That is, when the circular GUI element 903 is not displayed, the star-shaped GUI element 906 appears, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 906a. Further, as shown in FIG. 6, when the display color associated with the display / non-display of the GUI element is “yellow”, the highlight element (lighted) and the highlight element (flashing) are yellow. Displayed. The display area including the circular GUI element 903 that is not displayed may be highlighted.

(Display example when the GUI element is hidden by the influence of other GUI elements)
Next, a display example when the GUI element is concealed due to the influence of the appearing or moving GUI element will be described with reference to FIGS. 9-10 is explanatory drawing (the 10) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. As shown in FIG. 9-10, the display window 701 of the user interface 700 displays a GUI screen 900 related to the software to be verified. Also, the GUI screen 900 displays a rectangular GUI element 901, a triangular GUI element 902, and a star-shaped GUI element 906 as GUI elements.

  Here, for example, when the circular GUI element 903 is displayed on the star-shaped GUI element 906, the star-shaped GUI element 906 is arranged under the circular GUI element 903 and is hidden, and the star-shaped GUI element 906 is displayed. A display area 906a including the GUI element 906 is highlighted. That is, by displaying the circular GUI element 903, the star-shaped GUI element 906 is hidden, and at the same time, the above-described highlighted display element (lighted) and highlighted display element (flashing) are displayed in the display area 906a. Further, as shown in FIG. 6, when the display color associated with the display / non-display of the GUI element is “yellow”, the highlight element (lighted) and the highlight element (flashing) are yellow. Displayed. Note that a display area including the displayed circular GUI element 903 may be highlighted.

(Specific Processing Procedure of Software Verification Support Device (Part 1))
Next, a specific processing procedure of the software verification support apparatus 100 according to the embodiment of the present invention will be described. FIG. 10 is a flowchart (part 1) showing a specific processing procedure of the software verification support apparatus according to the embodiment of the present invention. The flowchart shown in FIG. 10 is started when, for example, the start of debugging is instructed by the verifier.

  First, the software verification support apparatus 100 according to the embodiment of the present invention waits until an event occurs (step S1001: No loop). The event is, for example, various commands (for example, “start” or “start (step execution”) described above) for executing GUI processing for verification.

  If it is determined in step S1001 that an event has occurred (step S1001: Yes), then the highlight flag for all GUI elements is turned OFF (step S1002). Specifically, it is determined whether there is a highlighted display area on the GUI screen. If there is a highlighted display area on the GUI screen, the highlighted display area is canceled. To do. If there is no highlighted display area, the process proceeds to the next step as it is.

  In step S1002, the highlight flag of all GUI elements is turned off, and then the GUI screen in which the highlight display of all GUI elements is turned off is saved (step S1003).

  In step S1003, after saving the GUI screen, it is determined whether there is an unprocessed GUI process (step S1004). In addition, for example, among the GUI processes of the software to be verified, the range of the GUI process to be verified (for example, the first to the tenth GUI processes) is specified, and the unprocessed GUI process within the specified range It may be determined whether or not there is.

  If it is determined in step S1004 that there is an unprocessed GUI process (step S1004: Yes), the GUI process is executed based on the software program to be verified (step S1005).

  In step S1005, after the GUI process is executed based on the software program to be verified, the GUI element related to the GUI process is specified, and the highlight flag of the specified GUI element is set to ON (step S1006). ). Specifically, as described with reference to FIG. 9A, in the case of GUI processing for displaying a circular GUI element 903, a circular GUI element 903 newly displayed as a related GUI element. And the highlight flag of the display area 904 including the circular GUI element 903 is turned ON.

  In step S1006, the related GUI element is specified, and after the highlight flag is turned on, the GUI screen in a state where the highlight flag is turned on is drawn in the virtual VRAM (step S1007). The virtual VRAM is a buffer area for temporarily recording a rendered GUI screen before transferring it to a VRAM (Video RAM). After drawing in the virtual VRAM, the process returns to step S1004 to determine again whether there is an unprocessed GUI process. If it is determined that there is no unprocessed GUI process, the GUI drawn in the virtual VRAM is determined. The screen is transferred to the VRAM (step S1008), and the series of processes is terminated.

(Specific processing procedure of the software verification support apparatus (part 2))
Further, the software verification support apparatus 100 according to the embodiment of the present invention causes the GUI process to be executed step by step at an arbitrary timing of the verifier using the above-described step execution command, and is synchronized with the execution of the GUI process. Thus, the display area including the related GUI element can be highlighted.

  FIG. 11 is a flowchart (part 2) showing a specific processing procedure of the software verification support apparatus according to the embodiment of the present invention. The flowchart shown in FIG. 11 is started when, for example, the start of debugging is instructed by a verifier. Here, the same processes as those in the flowchart shown in FIG. 10 are denoted by the same reference numerals, and the description thereof is omitted.

  In step S1007, after the GUI screen with the highlight flag turned ON is drawn in the virtual VRAM, it is determined whether or not an instruction to start step execution has been accepted (step S1101: No loop). When an instruction to start step execution is accepted (step S1101: Yes), the GUI screen with the highlight flag turned on is transferred to the VRAM and displayed on the display 108, and then the process returns to step S1004 and again. Then, it is determined whether or not there is an unprocessed GUI process. If it is determined that there is no unprocessed GUI process, the series of processes is terminated as it is.

(Comparison with the previous screen)
Further, the software verification support apparatus 100 according to the embodiment of the present invention executes the GUI screen and the GUI process before executing the GUI process by saving the GUI screen before executing the GUI process. Later GUI screens can be displayed side by side. Accordingly, the verifier can perform verification by comparing the GUI screen before executing the GUI processing displayed side by side with the GUI screen after executing the GUI processing.

  FIG. 12 is an explanatory diagram (part 11) illustrating a specific display example displayed on the user interface of the software verification support apparatus according to the embodiment of the present invention. As shown in FIG. 12, a GUI window 900 related to the software to be verified is displayed in the display window 701 of the user interface 700.

  At this time, the verifier can display the GUI screen before executing the GUI process side by side with the GUI screen 900 according to a predetermined instruction set in advance. For example, by simultaneously pressing the “Ctrl key” and the “← key” provided on the keyboard 110 described above, the GUI screen 1200 before executing the GUI processing is shifted from the back of the GUI screen 900 toward the left side. It gradually appears as if it slides, and is displayed side by side on the left side of the GUI screen 900. On the GUI screen 1200 before the GUI processing is executed, a rectangular GUI element 901, a triangular GUI element 902, and a circular GUI element 903 are displayed as GUI elements.

  As a result, the verifier compares the GUI screen 1200 before executing the GUI processing with the GUI screen 900 after executing the GUI processing, so that the circular GUI element 903 is hidden by the GUI processing. This can be easily confirmed.

  Further, the GUI screen 1200 before executing the GUI processing is displayed on the GUI screen, for example, “Ctrl key” and “↑ key” on the upper side, and “Ctrl key” and “↓ key” on the lower side. The position to be performed can be set in advance. Thereby, the GUI screen 1200 before executing the GUI process can be displayed at an arbitrary position of the physical verifier. Further, as the GUI screen 900 is highlighted, the verification may be performed by simultaneously referring to the highlighted display and the GUI screen 1200 before executing the GUI processing.

  As described above, according to the software verification support apparatus 100 according to the embodiment of the present invention, the GUI element related to the executed GUI process is specified, and the display area including the specified GUI element is highlighted. Therefore, the verifier can verify the executed GUI process and the GUI element related to the GUI process at the same time, and can accurately know the relationship between the GUI process and the GUI element at the same time. Can be performed accurately and in a short time.

  Specifically, according to the software verification support apparatus 100 according to the embodiment of the present invention, GUI elements that have disappeared, GUI elements that newly appear, character strings, colors, and shapes by executing GUI processing Alternatively, the display area including a GUI element whose size changes or a GUI element which moves or rotates is highlighted, so that these GUI elements can be easily verified simultaneously.

  In addition, according to the software verification support apparatus 100 according to the embodiment of the present invention, the verifier is more intuitive by highlighting using different display colors according to the processing content of the executed GUI processing. In addition, since the relationship between the GUI process and the GUI element can be accurately known, the software can be verified accurately and in a short time.

  Further, in the present embodiment, the GUI element that is directly changed by executing the GUI process as the GUI element to be highlighted is not limited to this. For example, by executing the GUI process, a display area including a GUI element that appears due to a GUI element that disappears or moves may be highlighted.

  Further, by executing the GUI process, a display area including a GUI element hidden by a GUI element that appears or moves may be highlighted. As a result, it is indirectly changed by the influence of the GUI element that has been changed by executing the GUI process (for example, non-shielded by being blocked by the GUI element that has been changed by executing the GUI process). Other GUI elements (displayed) can also be highlighted.

  As a result, the verifier can accurately know the relationship between the GUI process and the GUI element that is indirectly influenced by the GUI process, so that the software can be verified accurately and in a short time. In addition, since the display area including the hidden GUI element is highlighted, it is possible to verify the hidden GUI element without overlooking it. Thereby, useless GUI elements can be reduced from the software, and the performance can be improved.

  Further, according to the software verification support apparatus 100 according to the embodiment of the present invention, it is possible to easily and simultaneously verify GUI elements corresponding to a plurality of GUI processes. As a result, the verifier can accurately know the relationship between each GUI process and each GUI element, so that the software can be verified accurately and in a short time.

  Further, according to the software verification support apparatus 100 according to the embodiment of the present invention, since the GUI process is executed using step execution, another GUI process is executed at an arbitrary timing of the verifier. Software can be verified at any timing. Thereby, software verification can be performed accurately.

  Further, in the software verification support apparatus 100 according to the embodiment of the present invention, the highlighted display is displayed using the highlighted display element (lighted) and the highlighted display element (flashing). However, the present invention is not limited to this. Absent. The highlighted display only needs to be easily visible to the verifier, and any display method may be used as long as it is satisfied.

  As described above, according to the software verification support apparatus, the software verification support method, and the software verification support program according to the present invention, the verification of the validity of the GUI screen is realized simultaneously with the verification of the validity of the program. As a result, it is possible to simultaneously reduce the labor of the verifier, shorten the development period, and increase the accuracy of the verification.

  The software verification support method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The program may be a medium that can be distributed through a network such as the Internet.

  As described above, the software verification support apparatus, the software verification support method, and the software verification support program according to the present invention are useful when supporting software verification, and are particularly suitable for verification of software using a GUI. ing.

It is a block diagram which shows the hardware constitutions of the software verification assistance apparatus concerning embodiment of this invention. It is a block diagram which shows the functional structure of the software verification assistance apparatus concerning embodiment of this invention. It is a flowchart which shows the process sequence of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 1) explaining the highlight display by the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 2) explaining the highlight display by the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing explaining the state which linked | related the processing content of GUI processing, and the display color corresponding to it. It is explanatory drawing (the 1) which shows the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 2) which shows the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 1) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 2) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 3) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 4) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 5) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 6) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 7) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 8) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 9) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 10) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is a flowchart (the 1) which shows the specific process sequence of the software verification assistance apparatus concerning embodiment of this invention. It is a flowchart (the 2) which shows the specific process sequence of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing (the 11) which shows the specific example of a display displayed on the user interface of the software verification assistance apparatus concerning embodiment of this invention. It is explanatory drawing which shows an example of the verification of the software by a prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Software verification assistance apparatus 201 Display part 202 Execution part 203 Specification part 204 Display control part

Claims (14)

Display means for displaying a GUI screen related to the software to be verified;
Execution means for executing GUI processing of the software when the GUI screen is displayed;
A specifying means for specifying a GUI element related to the GUI processing executed by the execution means from the GUI screen;
Display control means for controlling the GUI screen to highlight a display area including the GUI element specified by the specifying means in the GUI screen;
A software verification support apparatus comprising: The specifying means is:
The software verification support apparatus according to claim 1, wherein a GUI element that changes due to execution of the GUI process is identified from the GUI screen. The specifying means is:
3. The software verification support apparatus according to claim 2, wherein a GUI element that disappears when the GUI process is executed is specified from GUI elements in the GUI screen. 4. The specifying means is:
The software verification support apparatus according to claim 2, wherein a GUI element that newly appears as a result of execution of the GUI process is specified from the GUI screen. The specifying means is:
3. The software verification according to claim 2, wherein a GUI element whose character string, color, shape, or size changes as a result of execution of the GUI processing is specified from among the GUI elements in the GUI screen. Support device. The specifying means is:
3. The software verification support apparatus according to claim 2, wherein GUI elements that move or rotate when the GUI process is executed are specified from among the GUI elements in the GUI screen. The specifying means is:
2. The software verification support apparatus according to claim 1, wherein a GUI element that appears due to a GUI element that disappears or moves as a result of execution of the GUI process is specified from the GUI elements in the GUI screen. The specifying means is:
2. The software verification support apparatus according to claim 1, wherein a GUI element that is concealed by a GUI element that appears or moves as a result of execution of the GUI process is specified from the GUI elements in the GUI screen. . The execution means includes
After execution of the GUI process, another GUI process different from the GUI process is executed,
The specifying means is:
From the GUI screen in which the display area (hereinafter referred to as “first display area”) is highlighted by the display control means, a GUI element related to the other GUI processing is specified,
The display control means includes
The GUI screen is controlled to highlight the second display area including the GUI element specified by the specifying means in the GUI screen in which the first display area is highlighted. The software verification support apparatus according to any one of 1 to 8. Receiving means for receiving an instruction to execute the other GUI process;
The execution means includes
The software verification support apparatus according to claim 9, wherein another GUI process whose execution instruction is received by the reception unit is executed. The display control means includes
The software verification support apparatus according to claim 9 or 10, wherein the GUI screen is controlled to cancel the highlighting of the first display area. The display control means includes
The software verification support apparatus according to claim 9 or 10, wherein the GUI screen is controlled to highlight the first and second display areas so as to be relatively different from each other. An execution step of executing a GUI process of the software when a GUI screen related to the software to be verified is displayed;
A specifying step for specifying a GUI element related to the GUI processing executed by the execution step from the GUI screen;
A display step of highlighting a display area including the GUI element specified by the specifying step in the GUI screen;
A software verification support method characterized by including: Computer
Execution means for executing a GUI process of the software when a GUI screen related to the software to be verified is displayed;
A specifying means for specifying a GUI element related to the GUI processing executed by the execution means from the GUI screen;
Display control means for highlighting a display area including the GUI element specified by the specifying means in the GUI screen;
Software verification support program characterized by functioning as

Images