JP2008052538A - Software development support device and software development support method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a software development support device and a software development support method, allowing efficient collection of information useful for the development of software without depending on environment of a device executing the software. <P>SOLUTION: A video input part 11 inputs a video signal from a computer. An arithmetic part 13 performs image processing of the video signal input to the video input part 11 to detect the video signal including specific information. A storage part 14 stores the video signal wherein the specific information is detected. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a software development support apparatus and a software development support method that support development of software having a graphical user interface (GUI) function.

  Software having a GUI function is required to operate stably without causing abnormal termination or hang-up for any operation. Therefore, in the software inspection process, in addition to normal operations, load tests such as continuous input of abnormal values and meaningless operations are performed, and when an unexpected failure such as abnormal termination occurs, It is necessary to improve the robustness of the software as much as possible by the delivery date by identifying and correcting the problem part of the software by relying on the operation procedure that caused it.

  When an operation is performed according to a predetermined inspection procedure and a failure occurs, the operation procedure that caused the failure is clear. However, if a problem occurs due to accidental operation or failure to follow the operation procedure, it becomes difficult to identify the operation that caused the problem, making it impossible to make a quick software correction, It becomes difficult to ensure sufficient robustness by the time.

  As a method for solving this, for example, there are the following methods. In the technique described in Patent Document 1, dedicated software for monitoring is made resident in the same computer that executes software, and the content displayed on the computer monitor screen is periodically or at every screen update timing. The data is saved in sequence, and when a problem occurs, the saved screen data is searched. This helps to identify the operating procedure that triggered the failure and assists in software development.

In the technique described in Patent Document 2, video data output from a computer is recorded on a video device, and when a problem occurs, the recorded video is confirmed to perform an operation that has triggered the problem. Trying to help identify the procedure.
JP 9-44379 A Japanese Patent No. 2630238

  However, some software defects may occur depending on subtle processing timing and the load status of hardware such as CPU, memory, and bus. For this reason, for example, in the state where the monitoring software is resident, no problem occurs. However, after the software is shipped, the problem may occur in an environment where the monitoring software is not operating.

  In many cases, software defects cannot be completely resolved before shipment, and a defect report may be received from the user after shipment. In that case, relying on the user's testimony, the user will search for the operating procedure that caused the problem and identify and correct the problem part of the software. However, the user's memory is often ambiguous, so the problem occurs. It is difficult to specify the operation procedure that triggered the process, and much time is required for the analysis.

  As a measure for the above, there is a method of shipping the monitoring software resident in the computer as in the software inspection process, but depending on the situation of the shipping destination, the load on the CPU, the capacity of the memory / storage device, etc. Due to restrictions, this method may not be adopted. In addition, when the OS hangs up due to a software defect, it is impossible to collect information related to the problem.

  On the other hand, regarding the method of recording an image output from a computer on a video device, video data is recorded regardless of whether or not a malfunction has occurred. Therefore, if a malfunction actually occurs, a large amount of recorded video data is recorded. It is necessary to search for the location where the problem occurred from among the above, which makes it difficult to operate. Therefore, this method does not efficiently collect information related to defects.

  The present invention has been made in view of the above-described problems, and is software development support capable of efficiently collecting information useful for software development without depending on the environment of a device that executes software. An object is to provide a device and a software development support method.

  The present invention has been made in order to solve the above-described problems. An input means for inputting a video signal output from a device that executes software having a graphical user interface function, image processing on the video signal, Software comprising: image processing means for detecting information contained in set setting information from the video signal; and storage means for storing the video signal from which information contained in the setting information is detected Development support device.

  In the software development support device of the present invention, a step of inputting a video signal output from a device that executes software having a graphical user interface function, image processing of the video signal, and inclusion in preset setting information A software development support method comprising: detecting information to be detected from the video signal; and storing the video signal from which the information included in the setting information is detected.

  According to the present invention, since the video signal in which the information included in the setting information is detected is stored in the storage unit in the software development support device independent of the device that executes the software, the environment of the device that executes the software Thus, it is possible to efficiently collect information useful for software development without depending on.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows the connection relationship of a software development support apparatus according to an embodiment of the present invention. The software development support apparatus 1 according to the present embodiment is inserted between a computer 2 that executes software having a GUI function and a monitor 3 that displays video. The video signal output from the computer 2 is input to the software development support apparatus 1, and the signal is output from the software development support apparatus 1 to the monitor 3 as it is. In the present embodiment, the software development support apparatus 1 is inserted between the computer 2 and the monitor 3, but the video signal from the computer 2 may be branched and input to the software development support apparatus 1. .

  If the video signal standards between the computer 2 and the monitor 3 are the same, any software having a GUI function can be executed by the computer 2 and any OS can be operated by the computer 2. Even so, it is possible to collect information relating to software defects simply by inserting the software development support apparatus 1.

  FIG. 2 shows the configuration of the software development support apparatus 1. The video input unit 11 inputs a video signal from the computer 2. The video output unit 12 outputs a video signal to the monitor 3. It is possible to switch between outputting the video signal input to the video input unit 11 as it is or outputting the video signal stored in the storage unit 14.

  The arithmetic unit 13 performs various processes in addition to detecting a video signal including specific information (hereinafter referred to as a scene) by performing image processing on the video signal input to the video input unit 11. The storage unit 14 includes a recording medium and stores a video signal. The calculation unit 13 refers to setting information including information on a detection target in order to detect a scene when a software defect occurs by image processing. The storage unit 14 also stores this setting information.

  The operation unit 15 includes a keyboard, a mouse, and the like operated by the user, and outputs a signal corresponding to the operation result. The operation unit 15 is operated when switching the output of a video signal, registering a scene to be detected, registering a process to be performed when a scene is detected, copying or deleting stored data, and the like. Based on the signal output from the operation unit 15, the calculation unit 13 performs various processes.

  In FIG. 1, the monitor 3 is connected to the software development support apparatus 1, but the software development support apparatus 1 may be provided with a display unit. When the software development support apparatus 1 is not provided with a display unit, the size of the software development support apparatus 1 can be made compact. When the software development support apparatus 1 is provided with a display unit, various settings such as scene settings can be performed without using an external display apparatus, and the stored video signal is reproduced to display an image. Can be confirmed.

  Next, the operation of the software development support apparatus 1 according to the present embodiment will be described. FIG. 3 shows a schematic processing procedure of the software development support apparatus 1. Only the main operation of the software development support apparatus 1 will be described, and the description of the detailed part that can be changed in design will be omitted. For example, in the following description, processing related to the output of the video signal from the software development support apparatus 1 to the monitor 3 is omitted.

  First, the operation mode of the software development support apparatus 1 becomes the scene setting mode, and various settings related to the scene to be detected are performed (step S301). At this time, the calculation unit 13 detects a user operation based on the signal output from the operation unit 15 and stores setting information based on the content of the operation in the storage unit 14.

  When the setting relating to the scene to be detected is completed, the operation mode of the software development support apparatus 1 becomes the scene detection mode, and the video signal is input to the video input unit 11 and output to the calculation unit 13 (step S302). The computing unit 13 performs an image process on the input video signal, and performs an operation of detecting information to be detected set in step S301 from the video signal (that is, detecting a scene) (step S303).

  In this embodiment, as a method for detecting a scene, there are a method for detecting an image of a specific pattern from an input video, a method for detecting a specific color from the input video, and a method of detecting a specific character from the input video. Selectable. In the method of detecting an image of a specific pattern from an input video, the occurrence of a malfunction is detected by detecting an image of a specific pattern displayed when an abnormal operation is performed from the input video. In this method, the calculation unit 13 detects a scene by pattern matching between image information indicating a specific pattern image and video information.

  Further, in the method of detecting a specific color from the input video, a state in which almost the entire screen is occupied by the specific color when an abnormal operation is performed (a screen when the computer 2 is restarted or the like) is detected. Thus, the occurrence of a malfunction is detected. In this method, the calculation unit 13 compares the color information indicating a specific color with the color information of the video signal, and determines whether or not a predetermined area in the screen is occupied by the specific color, thereby determining the scene. Is detected.

  Also, in the method of detecting specific characters from the input video, it is possible to detect specific characters ("System Administrator", "Contact", "Fatal", etc.) displayed on the screen when an abnormal operation is performed. To detect the occurrence of a malfunction. In this method, the calculation unit 13 detects a scene by detecting character information indicating a specific character from a video signal using a known image processing technique. The setting unit of the character to be detected may be any of a word unit, a phrase unit, a sentence unit, and the like. When the processing capability of the calculation unit 13 is high, it is possible to perform character recognition on the video image of the entire screen, so that it is not necessary to specify the location where the character exists.

  As described above, it is possible to detect not only a specific pattern image but also a specific color and character, thereby increasing the variety of scene types. As a result, more information useful for software development can be collected, and the detection accuracy of occurrence of defects can be improved.

  Subsequently, the calculation unit 13 determines whether a scene is detected based on the scene detection result in step S303 (step S304). When the scene is detected, the calculation unit 13 stores the input video signal in the storage unit 14 (step S305). Thereafter, the process returns to step S302 again.

  If no scene is detected, the calculation unit 13 determines whether or not to end the scene detection operation (step S306). This determination is performed based on, for example, detecting whether or not the user has input an end instruction. When the scene detection operation ends, a series of operations ends. When the scene detection operation is continued, the process returns to step S302 again.

  More specifically, the video signal is stored as follows. In this embodiment, a still image input to the software development support device 1 in time series, that is, a video signal forming a moving image is temporarily stored in a ring-shaped area (ring buffer) of the storage unit 14 in order. When this ring-shaped area is filled with data, the oldest data is erased, and new data is stored in the area where the data was stored.

  When a specific scene is detected, data corresponding to a preset video signal for a specified period is cut out from the ring-shaped area and stored in another area of the storage unit 14. When a specific scene is detected, saving to a ring-shaped area is started, and when another specific scene is detected, data corresponding to a preset video signal for a specified period is stored. It may be cut out from the ring-shaped region and stored in another region of the storage unit 14.

  Next, a method for registering (setting) a scene to be detected will be described. FIG. 4 shows an example of an image displayed on the monitor 3 when a scene is registered. FIG. 4 shows images when a method for detecting a specific pattern from an input video and a method for detecting a specific color from an input video are prepared as methods for detecting a scene. The input column 401 is a column for inputting a registered name for scene identification.

  Selection of a method for detecting a scene is performed by checking check boxes 402 and 403. When selecting a method for detecting an image of a specific pattern from the input video, the check box 402 is set to ON. In the pattern image display field 404, an image of a pattern to be detected by this method is displayed. When selecting a method for detecting a specific color from the input video, the check box 403 is set to ON. In the color display column 405, a color to be detected by this method is displayed. Both image information and color information can be newly registered using the input video.

  Settings relating to the operation when a scene is detected are performed as follows. The input column 406 is a column for inputting a start delay time. When a specific scene is detected, the storage unit 14 starts storing in the ring-shaped area after a delay of the start delay time from that point. Input fields 407 and 408 are fields for inputting a forward time and a backward time, respectively. The video signal stored in the ring-shaped area between the time point before the front time and the time point after the back time from the time when the specific scene is detected is cut out and stored in another area. When the check box 409 is set to ON, when the video signal storage for a predetermined period based on the time input in the input fields 407 and 408 is completed, the video signal is stored in the ring-shaped storage area. Stopped.

  The input column 410 is a column for inputting a location (an area in the recording medium of the storage unit 14) where video signals for a predetermined period are stored. When a specific scene is detected, the video signal is stored in the area input in the input field 410.

  The various types of information described above are registered by operating the add button 411 and stored as setting information in the storage unit 14. The registered information can be identified by the registered name input in the input field 31, and the registered name is displayed in the registered list 412. Information can be deleted from the registered list 412 by operating the add button 413. Since the scene can be registered by the simple operation as described above, it is possible to quickly collect information even at the site of the shipping destination.

  As described above, in the present embodiment, a software development support device that is independent from a device that executes software is provided, and a video signal is stored when information such as a specific image set in advance is detected from the video signal. It is characterized by. Since the device that executes the software and the software development support device are separated from each other, it does not impose a burden on the device that executes the software (that is, it does not depend on the environment of the device that executes the software), and causes the occurrence of a problem. Operating procedures and displayed images can be recorded.

  Therefore, in the software development stage before shipment, the software can be inspected in an environment close to the usage state of the software after shipment. Further, even after shipment, information can be collected without degrading the processing performance of the device that executes the software. Furthermore, it is not necessary to prepare a special mechanism for the device that executes the software or the software itself.

  Further, since the video signal is stored when specific information set in advance is detected from the video signal, information useful for software development can be efficiently collected.

  The embodiment of the present invention has been described in detail above with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design changes and the like without departing from the gist of the present invention. For example, video from a camera and audio from a microphone may be input to the software development support apparatus.

  By installing a camera at a position where both the monitor and the user can take an image, and saving the image taken by that camera, it is possible to identify the person who performed the operation that caused the problem and the operation procedure This makes it easier to conduct interviews with users. In addition, by detecting the user's irritation by processing the sound from the microphone, it is possible to capture a sign of the occurrence of a problem or a state where the condition is not obvious but is not clear.

It is a block diagram which shows the connection relation of the software development assistance apparatus by one Embodiment of this invention. It is a block diagram which shows the structure of the software development assistance apparatus by one Embodiment of this invention. It is a flowchart which shows the rough process sequence of the software development assistance apparatus by one Embodiment of this invention. It is a reference diagram showing an image displayed when setting a scene in an embodiment of the present invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Software development support apparatus, 2 ... Computer, 3 ... Monitor, 11 ... Video input part (input means), 12 ... Video output part, 13 ... Operation part (Image processing) Means), 14... Storage unit (storage means), 15.

Claims (5)

Input means for inputting a video signal output from a device executing software having a graphical user interface function;
Image processing means for performing image processing on the video signal and detecting information included in preset setting information from the video signal;
Storage means for storing the video signal in which information included in the setting information is detected;
A software development support apparatus characterized by comprising:   2. The software development support apparatus according to claim 1, wherein the setting information includes image information indicating an image of a specific pattern.   The software development support apparatus according to claim 1, wherein color information indicating a specific color is included in the setting information.   The software development support apparatus according to claim 1, wherein character information indicating a specific character is included in the setting information. Inputting a video signal output from a device executing software having a graphical user interface function;
Image-processing the video signal, detecting information included in preset setting information from the video signal;
Storing the video signal in which information included in the setting information is detected;
A software development support method characterized by comprising:

Images