JP2007328509A - Information processor and information processing method, program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform an inexpensive and accurate automatic test. <P>SOLUTION: A reading part 500 reads and executes a scenario stored in a scenario DB, and generates test data(signal), and a model generation part 501 generates image data of a reference image used for the verification of a test result. A pattern matching part 502 compares the image data of an image outputted by a test object device according to the transmitted signal with the image data of the reference image. A score calculation part 503 calculates scores showing the degree of matching between the reference image and the display image, and a position specification part 504 detects the difference of display positions of components. A deficiency analyzing part 505 analyzes the deficiency of the image, and a point of a difference detection part 506 detects a point of a difference between the reference image and the display image based on the analytic result. A decision part 507 decides the acceptance or non-acceptance of the test result based on information supplied from the score calculation part 503, the position specification part 504 and the point of difference detection part 506. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an information processing apparatus and method, a program, and a recording medium, and more particularly, to an information processing apparatus and method, a program, and a recording medium that enable a reliable automatic test to be performed at low cost.

  In recent years, the function scale of embedded software for electronic devices has increased, and the embedded software has become complicated and diversified. For example, the development scale of embedded software is rapidly increasing in various fields such as automobiles, mobile phones, and information home appliances.

  In order to keep the quality of electronic devices in which embedded software is incorporated, it is necessary to perform sufficient tests before these devices are put on the market. Traditionally, embedded software testing has been performed based on operations by the person performing the test and judgment by the person, but in recent years, automatic test software for embedded software running on a personal computer (PC) Also, systems that use test robots, and devices that simulate signals to input devices for devices with embedded software have been developed.

  In addition, a technique for automatically operating an input device of a test target device has been proposed (see, for example, Patent Document 1). In addition, a proposal for creating a script for executing an automatic test has also been made (for example, see Patent Document 2).

JP 09-91031 A

Japanese Patent Laid-Open No. 2005-100068

  However, by operating a button or switch on a device that has built-in software, and checking the image displayed on the display or the sound output from the speaker in response to the operation, Compared with the test, for example, in the test by the automatic test software that runs on the embedded software to be tested, the signal and data generated without using hardware such as buttons and switches are directly input to the embedded software, Since the processing result data by the embedded software is only verified, the conventional automatic test may not be able to detect faults caused by parts other than the embedded software program, such as hardware and various interface settings. is there.

  On the other hand, the automatic test using a robot is not easy to introduce because the cost of the robot itself is high, and it is necessary to secure the installation location of the robot and to consider safety.

  Also, for example, automatic test software for PC embedded software cannot be applied to devices other than PCs, and it is necessary to develop automatic test software for each device with embedded software built in. The cost of testing increases.

  Furthermore, when determining whether or not the operation of the device under test during an automatic test is appropriate, the operation of the device may change depending on the content of the operation, and what operation is appropriate As a result, it is not possible to set an effective algorithm for deciding whether or not to judge that the automatic test result is not correctly judged.

  For example, when embedded software that performs complex processing is introduced into a small device such as a mobile phone, the operation menu is often hierarchized, and is output corresponding to the operation of each button according to the function to be used. The meanings of commands are completely different. Therefore, for example, it is not possible to uniquely define the processing result corresponding to the pressing of a predetermined button, and the test data and its It is necessary to create verification data corresponding to the test, and it takes a lot of time and cost to correctly create all test data and verification data that can accurately verify the function of the embedded software. It can be.

  Automatic testing that inputs a pseudo signal to the input device of a device with built-in software sends a signal directly to the signal line inside the hardware, etc. If the completed device cannot be tested In addition, when a new product is created, major changes such as hardware modifications may be required.

  In addition, in order to further improve the quality of equipment with built-in software, the test should also be performed assuming peripheral devices that can be used by the equipment under test and cases where the state of the connection cable is changed. Although it is desirable to perform the test, the conventional automatic test cannot be performed in consideration of peripheral devices and cables.

  The present invention has been made in view of such a situation, and makes it possible to perform a reliable automatic test at low cost.

  One aspect of the present invention is an information processing apparatus that performs a test for verifying whether or not a test target apparatus is operating normally, and when a user operates the test target apparatus, The data for generating the same signal as the signal generated in step 1 is input as test data, and the data to be output along with the test data in which the test target device is input. When operating normally, a normal data generation unit that generates output data, and when the test data is input, acquire data actually output by the test target device, and the acquired data is the normal data A comparison unit for comparing with data generated by the data generation unit, and whether or not the test target device has been normally operated based on a comparison result by the comparison unit. An information processing apparatus and a determination unit constant to.

  A scenario database that stores a series of test data input to the test target device as a scenario, and a normal database that stores data that is output when the test target device is operating normally. can do.

  The test data may be converted into the same signal as a signal generated inside the test target device by conversion software installed in the test target device.

  When the test target device is operated, a signal generated inside the test target device can be converted by the conversion software and stored in the scenario database as the scenario.

  The scenario database may be classified and stored according to functions provided by the scenario in the test.

  The other end of the two connection circuits, one end of which is connected to the power source, is connected to the device under test and to itself, and a signal set in advance to the connection circuit is output, so that the power to the device under test is The supply can be controlled.

  One aspect of the present invention is an information processing method for an information processing apparatus that performs a test for verifying whether or not a test target apparatus is operating normally, and the test is performed when a user operates the test target apparatus. Data for generating the same signal as the signal generated inside the target device is input as test data, and is output along with the test data input by the test target device. When operating normally, generate data to be output, and when the test data is input, acquire data actually output by the test target device, and the acquired normal data generation unit It is an information processing method including a step of comparing with the generated data and determining whether or not the test target device has been normally operated based on a result of the comparison.

  One aspect of the present invention is a program that causes an information processing apparatus that performs a test for verifying whether or not a test target apparatus is operating normally to perform information processing, and the user operates the test target apparatus The data for generating the same signal as the signal generated inside the test target device is controlled as the test data, and is output along with the test data input by the test target device. When the test target device is operating normally, it controls the generation of output data, and when the test data is input, controls the acquisition of the data that the test target device actually outputs, A comparison between the acquired data and the generated data is controlled, and a determination is made to control whether or not the test target device is operating normally based on the comparison result. Tsu computer, including the flop is readable program.

  In one aspect of the present invention, when a user operates a test target device, data for generating the same signal as a signal generated inside the test target device is input as test data. Data to be output along with the input test data, and when the test target device is operating normally, output data is generated, and when the test data is input, the test target device Data to be actually output is acquired, the acquired data and the data generated by the normal data generation unit are compared, and based on the result of the comparison, whether or not the test target device has been operated normally is determined. Determined.

  According to the present invention, a reliable automatic test can be performed at low cost.

  Embodiments of the present invention will be described below. Correspondences between constituent elements of the present invention and the embodiments described in the specification or the drawings are exemplified as follows. This description is intended to confirm that the embodiments supporting the present invention are described in the specification or the drawings. Therefore, even if there is an embodiment which is described in the specification or the drawings but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is not the case. It does not mean that the form does not correspond to the constituent requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

  An information processing apparatus according to an aspect of the present invention is an information processing apparatus that performs a test for verifying whether or not a test target apparatus is operating normally, and includes a test target apparatus (for example, the test target apparatus illustrated in FIG. 1). 102), when a user operates, a data input unit (for example, the reading unit 500 in FIG. 5) that inputs data for generating the same signal as the signal generated inside the test target device as test data; The data to be output along with the test data input by the test target device (for example, the test target device 102 in FIG. 1), and the data to be output is generated when the test target device is operating normally. When the test data is input with the normal data generation unit (for example, the model generation unit 501 in FIG. 5), the data actually output by the test target device is acquired and collected. A comparison unit (for example, the pattern matching unit 502 in FIG. 5) that compares the generated data with the data generated by the normal data generation unit, and the test target device operates normally based on the comparison result by the comparison unit And a determination unit (for example, the determination unit 507 in FIG. 5) for determining whether or not it has been performed.

  This information processing apparatus includes a scenario database (for example, scenario DB 164 in FIG. 1) that stores a series of test data input to the test target apparatus as a scenario, and when the test target apparatus is operating normally. A normal database (for example, the expected value DB 163 in FIG. 1) that stores data to be output can be further provided.

  In this information processing apparatus, the test data is converted into the same signal as the signal generated inside the test target apparatus by conversion software (for example, software 301 in FIG. 3) installed in the test target apparatus. Can be.

  In this information processing apparatus, the other ends of two connection circuits (for example, connection circuits 411 and 412 in FIG. 4) whose one ends are connected to a power source (for example, the AC adapter 402 in FIG. 4) are respectively connected to the test target apparatus. It is possible to control power supply to the test target device by outputting a signal set in advance to the connection circuit connected to itself.

  An information processing method according to one aspect of the present invention is an information processing method for an information processing apparatus that performs a test for verifying whether or not a test target apparatus is operating normally. When the user operates the test target device 102), data for generating the same signal as the signal generated inside the test target device is input as test data (for example, the process of step S101 in FIG. 12). ), Data to be output along with the test data input by the test target device (for example, the test target device 102 in FIG. 1), and when the test target device is operating normally, the output data is Generate (for example, the process of step S103 in FIG. 12), and when the test data is input, acquire data actually output by the test target device (for example, 12 in step S104), the acquired data is compared with the data generated by the normal data generation unit (for example, the process in step S105 in FIG. 12), and based on the result of the comparison, the test target device Includes a step of determining whether or not the device has operated normally (for example, the process of step S106 in FIG. 12).

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration example according to an embodiment of an automatic test system 100 to which the present invention is applied.

  In the figure, an automatic software test apparatus 101 can automatically perform a test of embedded software of a test target apparatus 102. The test target device 102 is, for example, a device such as an electronic device, a mobile phone, and an information home appliance installed in a car, and is a device that is actually manufactured and sold.

  In this example, the test target device 102 is configured as, for example, a mobile phone and the like, and includes a communication unit 141 that performs communication by a predetermined method, an image output unit 142 that outputs a signal for displaying an image on an external device, A display unit 143 configured as a display such as an LCD (Liquid Crystal Display) is provided. Further, for example, a peripheral device 144 having a predetermined interface such as USB (Universal Serial Bus), IEEE1394 (Institute of Electrical and Electronic Engineers 1394) is provided.

  Furthermore, the test target device 102 is configured as an operation button, a keyboard, or the like, and includes an input unit 146 that inputs a signal corresponding to a user command or the like, a CPU (Central Processing Unit), a memory, and the like. A calculation unit 147 that executes calculation processing of a predetermined method, a memory, a hard disk, and the like are provided, and a storage unit 148 that stores various data as necessary is provided.

  The communication unit 141 to the storage unit 148 are connected to each other via the control unit 145.

  On the other hand, the automatic software test apparatus 101 is provided with a communication unit 125, an image processing unit 126, an image capture unit 127, and a peripheral device 129 that function as an interface with the test target device 102.

  The communication unit 125 receives a transmission signal output from the communication unit 141 of the test target apparatus 102 or transmits a signal to be received by the communication unit 141.

  The image capturing unit 127 is configured to be able to acquire a signal output from the image output unit 142 or capture an image displayed on the display unit 143, and the acquired signal or captured image is captured. The data corresponding to the received image is supplied to the image processing unit 126. The image capturing unit 127 has a function of converting an image of a predetermined timing generated based on a video signal such as a video signal, an S terminal video signal, an analog high-definition signal, or a digital high-definition signal into data, and acquiring the data. For example, it is configured as a frame grabber or capture board.

  The image processing unit 126 generates image data for analyzing the image output from the test target device 102 based on the data supplied from the image capturing unit 127 and outputs the image data to the control unit 128. Yes. Note that the image processing unit 126 directly acquires signals, data, and the like related to images output from the test target device 102 without using the image output unit 142 or the display unit 143 from the control unit 145. .

  The image processing unit 126 performs processing such as image rotation, enlargement, and reduction on images in various formats such as Bitmap, PNG, JPG, and Gif as necessary to extract differences between the two images. It is configured to have a function of extracting a specific image with respect to a certain image by a threshold of luminance or color. Further, the image processing unit 126 has a function of extracting image features, for example, and applies a preset algorithm for feature extraction based on information such as shape, color, and brightness in the image. In order to identify and extract a specific display object in the image, or to determine whether an image of a predetermined shape is displayed in the image, it distinguishes between a low luminance part and a high luminance part, The contour of the display object is taken, and shape pattern matching is performed to determine whether the image matches a certain shape.

  The peripheral device 129 outputs a signal for controlling the peripheral device 144 through a preset interface, acquires a signal output from the peripheral device 144, and supplies the signal to the control unit 128.

  The control unit 128 is configured to operate based on a command supplied from an input unit 121 that is configured with, for example, a keyboard and inputs a signal corresponding to a user command, and the like from the communication unit 125 to the peripheral device 129. The supplied signal or data is subjected to predetermined processing and supplied to the calculation unit 122 to the display unit 124. The control unit 128 includes a CPU, a memory, and the like, and is configured to execute software such as a program.

  The calculation unit 122 executes a test of the embedded software of the test target device 102 by performing predetermined calculation on the data supplied from the control unit 128 by using information stored in the database 103. The test result is output to the control unit 128. The arithmetic unit 122 is a circuit that performs arithmetic processing such as four arithmetic operations or logical operations, an accumulator that temporarily stores operation results, a flag register that stores state information such as positive / negative or carry of the operation results, and the like. It is configured to include a device, a CPU, and the like that constitute a memory for temporary storage.

  The storage unit 123 is configured by a memory, a hard disk, and the like, and stores data necessary for processing of the calculation unit 122, test result data, and the like as necessary.

  The display unit 124 is configured as a display such as an LCD (Liquid Crystal Display), and appropriately displays information related to execution of processing by the calculation unit 122, information on test results, an image output from the test target device 102, or the like.

  The database 103 stores information necessary for testing the embedded software of the test target device 102. The database 103 is divided into a device information DB 161, a log DB 162, an expected value DB 163, a scenario DB 164, and a failure management DB 165.

  The device information DB 161 stores, for example, information for specifying a test target device to be tested by an automatic soft test device, information indicating functions and features of the test target device, and the like.

  The log DB 162 stores a log that is output from the automatic software test apparatus 101 and includes test result data and the like.

  The expected value DB 163 is displayed by processing of the embedded software of the test target device 102 corresponding to the test data output from the automatic software test device 101 (for example, a command supplied via the peripheral device 129). Information for specifying a processing result expected for the test target apparatus 102, such as an image to be output and sound to be output, is stored. Details of the expected value DB 163 will be described later.

  The scenario DB 164 stores a scenario (test scenario) for generating a series of test data to be output from the automatic software test apparatus 101. Details of the scenario will be described later.

  The failure management DB 165 stores information related to the failure of the embedded software of the test target device 102 discovered as a result of the test executed by the automatic software test device 101.

  FIG. 2 is a configuration example of the control unit 145 of the test target apparatus 102, and an example in which a signal supplied to the built-in microcomputer 211 is stored as data in a signal format output to an interface such as a USB by the RAM 201. FIG. When the input unit 146 of the test target apparatus 102 is operated, signal information by manual operation supplied to the microcomputer 211 is also recorded in the RAM 201. In this way, the automatic software test apparatus 101 reads the data recorded in the RAM 201, so that the automatic software test apparatus 101 can obtain data related to a signal supplied to the microcomputer 211 when a person operates the apparatus to be tested. Record. At this time, data obtained from the test target device 102 is recorded in a scenario DB 164 described later.

  In this way, the test data output from the automatic software test apparatus 101, for example, a command supplied via the peripheral apparatus 129, can be received from the peripheral apparatus 144 via the interface such as USB. Can be converted into a signal of a predetermined format by the RAM 201 and supplied to the microcomputer 211. The microcomputer 211 is as if the input unit 146 is based on the signal transmitted from the automatic software test apparatus 101. Can be operated as if a command was supplied by operating.

  That is, as shown in FIG. 3, when test data is input from the automatic software test apparatus 101, the software 301 installed in the test target apparatus 102 interrupts the OS 311 of the embedded software of the test target apparatus 102. In general, instead of the command supplied from the input unit 146, a command supplied from an interface such as USB is supplied to the driver 312 and the application program 313. In this way, the automatic soft test apparatus 101 can automatically perform the same test as when a person operates the test target apparatus 102.

  Note that the software 301 may be pre-installed in the test target apparatus 102 prior to the execution of the test by the automatic software test apparatus 101, and may be deleted after the test is completed.

  Further, the test data output from the automatic soft test apparatus 101 may be supplied from the communication unit 141 or the like without using the peripheral device 144. Furthermore, data transmitted and received between the automatic soft test apparatus 101 and the test target apparatus 102 may be encrypted or decrypted by a predetermined encryption algorithm.

  Further, for example, an LED (Light Emitting Diode) is connected to the peripheral device 144 so that the LED is issued when test data is input, and a series of operations in the automatic test system 100 is indicated by a blinking signal or the like. Also good.

  FIG. 4 is a diagram for explaining a power supply method in the automatic test system 100.

  In the figure, power is supplied from an AC outlet 401 to an automatic soft test apparatus 101 and a test target apparatus 102 via an AC adapter 402.

  The connection circuits 411 and 412 are configured by MOSFET (metallic oxide semiconductor field effect transistor) or the like, and one of the terminals of the connection circuits 411 and 412 is connected to the AC adapter 402, respectively. That is, the terminal 421a is connected to the AC adapter 402, the terminal 421b is connected to the test target apparatus 102, and the terminal 421c is connected to the automatic soft test apparatus 101. The terminal 422a is connected to the AC adapter 402, the terminal 422b is connected to the test target device 102, and the terminal 422c is connected to the automatic soft test device 101.

  The AC adapter 402 has two plus and minus power supply lines. For example, the plus side is connected to the terminal 421a and the minus side is connected to the terminal 422a. In this way, it is possible to control the supply of power to the test target device 102 by transmitting a digital signal equal to or higher than the voltage value Vcc from the automatic soft test device 101.

  For example, when a signal having a voltage Vcc or higher is transmitted from the automatic soft test apparatus 101 to the terminal 421c, the power supply to the test target apparatus 102 is cut off because the MOSFET of the connection circuit 411 is turned off. Further, when a voltage 0 is output from the automatic soft test apparatus 101 to the terminal 421c, a current flows due to light emission of the photo LED on the gate side of the MOSFET of the connection circuit 411, and a current flows between the drain and source of the MOSFET. As a result, power is supplied to the test target device.

  Note that a flashing signal indicating the energization state of the connection circuits 411 and 412 is generated by the light emission of the light emitting diodes 431 and 432 to the user.

  As described above, in the automatic test system 100 according to the present invention, power is supplied to the test target device 102 or power is supplied without connecting or disconnecting the power source (for example, outlet) of the test target device 102. Can be refused. Therefore, it is possible to automatically execute a test as if the power button of the test target device 102 was turned on / off or an outlet or the like was inserted / removed without the user performing such an operation.

  Here, the power supply line is connected to the connection circuits 411 and 412, and power is supplied to the test target device 102 without connecting / disconnecting the power source (for example, an outlet) of the test target device 102, or Although an example in which the supply of power is cut off has been described, the user performs operations such as connecting the signal supply line to the connection circuits 411 and 412 with the same configuration, and connecting and disconnecting the signal line of the test target device 102. It is also possible to automatically execute a test in which a predetermined signal is supplied to the test target device 102 or the signal supply is cut off.

  Next, a test by the automatic soft test apparatus 101 and verification of the test result will be described. FIG. 5 is a block diagram illustrating a functional configuration example of software executed in the control unit 128 of the automatic software test apparatus 101.

  In the drawing, a reading unit 500 reads information necessary for a test from the database 103 and transmits a test data signal to the test target device 102. That is, the reading unit 500 reads and executes a script called a scenario stored in the scenario DB 164, and generates test data and a signal corresponding to the test data. Further, the reading unit 500 reads out and supplies data necessary for each process performed thereafter from the database 103.

  The model generation unit 501 becomes an image used for verification of the test result based on information (for example, character size (number of points, vertical / horizontal magnification, etc.)) supplied from the database 103 via the reading unit 500. Image data of a reference image is generated. Here, the reference image is, for example, an image that the test target apparatus 102 should originally display on the display unit 143 or the like corresponding to the input test data, and the test target apparatus 102 is operating normally. The image to be displayed.

  The model generation unit 501 generates a reference image based on the expected value DB 163 of the database 103. FIG. 6 is a diagram illustrating an example of the expected value DB 163.

  In this example, the expected value DB 163 is configured as a record in which screen information corresponding to the screen ID is described using a “screen ID” that identifies a screen displayed by the test target device 102 as a key. In the attribute “function name” in the figure, data indicating whether the function of the screen is “UI” (user interface) or just the display screen “VIEW” is stored. The attribute “screen type ID” stores data that classifies the type of the screen, and the attribute “background” stores data that specifies the color of the background (for example, “Blue”).

  In the attribute “character color”, data for classifying the character color to be displayed (for example, “White”) is stored, and in the attribute “display area”, an area in which the screen is displayed is represented by, for example, “ (X1, Y1)-(X2, Y2)), and the attribute “Alignment” stores data indicating that the character alignment is “center” or “right”. The For the attribute "Language". Data for specifying the language of the character string to be displayed is described.

  In addition, the expected value DB 163 includes a button DB in which information on buttons used as a GUI for a displayed screen is recorded. FIG. 7 is a diagram illustrating a configuration example of the button DB. In this example, the button DB is configured as a record in which information on the color, state, and design corresponding to the button is described using the “name” of the button as a key.

  The expected value DB 163 includes a reference image DB in which information on character strings displayed on the screen is recorded. FIG. 8 is a diagram illustrating a configuration example of the reference image DB. In this example, the reference image DB is configured as a record in which “name” and “image” of the character string are described using “STR_ID” that is the ID of the character string as a key. Here, “image” is stored as image data of a JPEG image. For example, an “image” of a record whose “STR_ID” is “1” is an image as shown in FIG.

  FIG. 10 is a diagram for explaining a mechanism for generating a reference image from the expected value DB 163. In the figure, “screen name”, “function ID”, and “character string setting ID” corresponding to the screen ID are specified by the screen table, and the button image to be displayed refers to the button DB based on the screen ID. Is generated. Further, the character string setting table is searched based on the “character string setting ID”, the “character string setting number” is specified, and the reference image DB is referred to generate the character string image. Further, the “character string position setting table” is searched based on the “character string position ID”, and the color table is searched based on the “color ID”. Further, the language table is searched based on “language ID” to identify “language name”, the alignment position table is searched based on “alignment method ID”, and “alignment position name” is specified.

  The model generation unit 501 refers to the data stored in the attributes “screen name”, “function name”, “background”, “display area”,..., Based on the scenario recorded in the scenario DB. And get.

  The pattern matching unit 502 is an image output by the test target device 102 in response to the test data signal transmitted from the reading unit 500, for example, a display image displayed on the display unit 143 of the test target device 102. The image data acquired through the image processing unit 126 and analyzing the display image is compared with the image data of the reference image generated by the model generation unit 501.

  At this time, the pattern matching unit 502 replaces, for example, the setting of which color component of RGB to be compared, the shading of each display part in the reference image and the display image as numerical values, and the reference image and the display image based on the numerical values. The difference between is calculated. For example, when the display color of the reference image of the portion to be compared is red, the binarization process is performed only on the red component of the display image, and the red region included in the display image is cut out and compared. The processing may be performed.

  The score calculation unit 503 calculates a score representing the degree of matching between the reference image and the display image.

  Further, the position specifying unit 504 detects a difference in display positions of components such as buttons in the reference image and the display image. The defect analysis unit 505 analyzes the defect of the display image based on the detection result by the position specifying unit 504, the position of the center of gravity of each component displayed in the reference image, and supplies the analysis result to the difference detection unit 506. The difference detection unit 506 detects a difference between the reference image and the display image based on the analysis result of the defect analysis unit 505.

  The determination unit 507 determines whether the test result is OK or NG based on the information supplied from the score calculation unit 503, the position specification unit 504, and the difference detection unit 506, that is, corresponds to the input test data. It is determined whether a legitimate image (or an abnormal image) is displayed. In the determination by the determination unit 507, for example, it is possible to set a determination method such as determining that a difference in units of one pixel is abnormal or determining that a difference of up to two pixels is normal by a scenario stored in the scenario DB 164 It is made to become.

  The test by the automatic software test apparatus 101 described above is executed based on a script called a scenario stored in the scenario DB 164. FIG. 11 is a diagram illustrating an example of a scenario. That is, the control unit 128 of the automatic software test apparatus 101 reads the scenario shown in FIG. 11 and executes the process.

  By executing “Dim Result as integer” on the 10th line in the figure, a variable declaration “Result” is made as an integer type variable. Next, since the 20th line is blank, it is skipped and “JOB_Report_SetName (“ C: \ test.log ”)” on the 30th line is executed, and a predetermined execution process is called from the scenario DB 164. In this process, a file (C: \ test.log) for storing the test result as a log is generated and stored in the log DB 162.

  When “JOB_Init_Product (“ T-1000 ”)” on the 40th line is executed, a predetermined execution process is called from the scenario DB 164 and information on the product “T-1000” corresponding to the test target device 102 is, for example, The device information DB 161 is searched and acquired by a query search using an SQL sentence. Thereby, information necessary for controlling the test target apparatus 102 is acquired.

  Next, “JOB_Action_KeyPush (“ A ”)” on the 60th line is executed, a predetermined execution process is called from the scenario DB 164, and a process when a GUI of the type “A” is pressed by operating the input unit 146 Is executed by the test target device 102. At this time, information necessary for executing the script of “JOB_Action_KeyPush” is added based on the information related to the product “T-1000”.

  By executing this script, as described above with reference to FIG. 2 or FIG. 3, the signal output from the automatic software test apparatus 101 is supplied to the test target apparatus 102 via an interface such as USB, and the RAM 201 has a predetermined format. And is supplied to the microcomputer 211. In other words, the software 301 installed in the test target device 102 normally supplies a command supplied from an interface such as USB to the driver 312 and the application program 313 instead of the command supplied from the input unit 146.

  Then, based on the signal transmitted from the automatic software test apparatus 101, the microcomputer 211 operates as if the input unit 146 is operated (in this case, the GUI operation “A”) and a command is supplied. .

  Next, on the 70th line, the test result is determined along with the execution of the previous “JOB_Action_KeyPush (“ A ”)”. At this time, as described above, the determination by the determination unit 507 is performed. For example, when setting a judgment method such as making a difference in 1 pixel units abnormal or making a difference up to 2 pixels normal, depending on the scenario, for example, `` JOB_Init_CheckImage (Hantei = 1 , 0,0,0) ”, etc., and a predetermined determination condition (Hantei = 1,0,0,0) may be designated.

  As a result of the determination by the determination unit 507, when it is determined that the image is normally displayed, 1 is substituted into the variable “Result”.

  Next, in the 90th line, the value of the variable “Result” is determined, and if it is 1 (normal), the 100th line is executed and the image data of the display screen is stored in the log DB 162. That is, through the processing so far, for example, a record “JOB_Report_Msg (“ A Pushed ”)” is recorded in the log DB 162, and the argument “A Pushed” is stored in the test target apparatus 102 as “A Pushed”. The GUI “A” can be pressed normally, and the response display is recorded as evidence of normal display.

  Here, an example of a scenario in which a plurality of functions are called has been described. However, for example, a scenario may be one in which only one function is called. Further, another scenario may be called from one scenario as necessary.

  Next, automatic test processing by the automatic software test apparatus 101 will be described with reference to the flowchart of FIG.

  In step S101, the reading unit 500 reads a scenario from the scenario DB 164.

  In step S102, the reading unit 500 generates a signal (a signal corresponding to the test data) to be transmitted to the test target device 102 based on the scenario read in the process of step S101, and generates this signal as the test target device. 102.

  In step S103, the model generation unit 501 generates data for verifying the test result. At this time, for example, the image data of the reference image described above is generated.

  In step S104, the pattern matching unit 502 acquires information output from the test target device 102 in response to the test signal generated in the process of step S102. At this time, for example, a display image displayed on the display unit 143 of the test target apparatus 102 is acquired via the image processing unit 126, for example.

  In step S105, the pattern matching unit 502 compares the data generated in the process of step S103 with the information acquired in the process of step S104. At this time, for example, the image data of the reference image described above and the image data of the display image are compared, and the processing result data from the score calculation unit 503, the position specification unit 504, and the difference detection unit 506 is sent to the determination unit 507. Supplied.

  In step S106, the determination unit 507 determines whether the test result is OK (normal) or NG (abnormal) based on the comparison result obtained in step S105.

  In step S107, the determination unit 507 records the test result in the log DB 162.

  In this way, the automatic test process is executed.

  By the way, it is convenient that the scenario recorded in the scenario DB 164 can be reused in a plurality of test cases. In the present invention, a scenario (a series of scripts) is classified and recorded according to usage and function.

  Here, an example will be described in which scenarios are classified into seven types of “Action”, “Search”, “Analysis”, “Check”, “Initialize”, “Report”, and “Exception”. “Action” is a scenario having a function for performing a predetermined operation, “Search” is a scenario having a function for finding a target object, and “Analysis” is an analysis / analysis of information obtained as a result of the operation. The scenario has a function to analyze. In addition, “Check” is a scenario having a function of determining information obtained as a result of the operation, “Initialize” is a scenario having a function of performing preliminary setting of the test target device 102, and “Report” is A scenario having a function of recording a log or the like is assumed, and “Exception” is a scenario to deal with when an unexpected state occurs.

  For example, a function or scenario for executing a process of pressing a certain button on the touch panel of the test target device 102 is classified as “Action”. When a menu list of the user interface of the test target device 102 and one item in the list are designated, a scenario that moves to the screen item is classified as “Search”. In addition, a scenario for executing processing such as whether to cut out all the screens or extract a certain part for information to be compared when operating the menu, passing through several screen transitions, and arriving at the target screen, or Scenarios that execute processing for comparing the obtained data with preset data are classified as Check. A scenario for executing a process for setting a comparison and determination criterion in a scenario classified as Check is classified as “Analysis”.

  Thus, by classifying and managing scenarios, for example, a scenario DB added or modified by one user can be used by other users.

  For example, in the automatic software test apparatus 101, a flowchart as shown in FIG. 13 is prepared in advance as a template for executing a scenario, and the user selects an appropriate scenario from the classified scenarios. Scenarios should be incorporated.

  In the example of FIG. 13, the initial state is set by “Initialize” in step S201, the test target apparatus 102 is operated to the target situation by “Search” in step S202, and the target situation is correctly determined by the determination in the process of step S203. Judge whether it was possible to create. If it is determined that the target situation has been correctly created, an action to be tested is given by “Action” in step S204, the reaction result is analyzed or analyzed by “Analysis” in step S205, and analyzed or analyzed by “Check” in step S206. It is determined whether the test result is normal or abnormal based on the analysis result, and the test result is recorded by “Report” in step S207.

  If it is determined by the determination in step S203 that the target situation has not been correctly created, exception processing is executed by “Exception” in step S208.

  The procedure shown in the flowchart of FIG. 13 is a common procedure that passes through any test, and can be used for any device to be tested 102. In this way, even when creating a new scenario by classifying and saving the scenario, it is possible to create a scenario efficiently in a short time by quoting the scenarios created in the past. I can do it.

  Furthermore, based on the flowchart of FIG. 13, test data generated by incorporating a scenario into each step may be stored in the scenario DB 164 as a new scenario. By doing so, it becomes possible to further promote the reuse of the generated scenario.

  Next, an actual automatic test will be specifically described. 14 to 17 are diagrams illustrating a series of operation results when a GUI operation is performed on a certain product. In this product, first, when the “Menu” button 601 in FIG. 14 is pressed, the screen in FIG. 15 is displayed. Next, when the “Fnc3” button 611 in FIG. 15 is pressed, the screen in FIG. 16 is displayed. Next, when the “OK” button 621 in FIG. 16 is pressed, the screen in FIG. 17 is displayed, and “■ ●” is displayed in the “Icon” display portion 631 in the upper left.

  The above is an operation result (screen transition) when this product is operating normally.

  When this product is set as a test target device, the operation described with reference to FIGS. 14 to 17 is executed, and finally a test for verifying the display content of the display unit 631 is performed, the initial state is set by “Initialize”. For example, by executing a function such as “PowerOn” as a function for the purpose, power is supplied to the test target device. At this time, power is supplied as described above with reference to FIG. 4, and the screen of FIG. 14 is displayed on the display unit of the test target device.

  Next, as a process corresponding to “Search”, first, the currently displayed screen is analyzed, and the screen ID in the expected value DB 163 is specified by determining where the GUI button is displayed. To do. Next, a process for searching for a button that can be moved from the identified screen to the target screen of FIG. 17 is executed. As a process corresponding to “Search”, an existing scenario including a function for executing such a process is applied.

  Then, a scenario including a function for executing a process of pressing the Menu button 601, pressing the Fnc3 button 611, pressing the OK button 621 is applied as a process corresponding to “Action” to check the display content of the display unit 631. As a process corresponding to “Analysis”, a scenario consisting of a function for setting the error tolerance of the pixel position etc. is called, and as a process corresponding to “Check”, based on the analysis result of the display content of the screen Then, a scenario including a function for determining whether or not “■ ●” is displayed on the display unit 631 is called. Further, the test result is recorded as a log in the log DB 162 by processing the scenario corresponding to “Report”.

  In this way, the embedded software test of the test target apparatus 102 is performed by the automatic software test apparatus 101.

  In the above description, the example in which the embedded software test of the test target device 102 is performed by verifying the image output from the test target device 102 corresponding to the input test data has been described. The sound output from the test target device 102 corresponding to the data may be verified. In such a case, for example, the expected value DB 163 stores information for generating a reference audio signal, the model generation unit 501 generates a reference audio signal, and the pattern matching unit 502 uses the reference audio signal, What is necessary is just to perform the process etc. which compare with the audio | voice signal acquired from the test object apparatus 102. FIG.

  The series of processes described above can be executed by hardware, or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. For example, a general-purpose personal computer 500 as shown in FIG. 18 is installed from a network or a recording medium.

  In FIG. 18, a CPU (Central Processing Unit) 801 executes various processes according to a program stored in a ROM (Read Only Memory) 802 or a program loaded from a storage unit 808 to a RAM (Random Access Memory) 803. To do. The RAM 803 also appropriately stores data necessary for the CPU 801 to execute various processes.

  The CPU 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input / output interface 805 is also connected to the bus 804.

  The input / output interface 805 includes an input unit 806 including a keyboard and a mouse, a display including a CRT (Cathode Ray Tube) and an LCD (Liquid Crystal display), an output unit 807 including a speaker, and a hard disk. A communication unit 809 including a storage unit 808, a network interface card such as a modem, a LAN card, and the like is connected. A communication unit 809 performs communication processing via a network including the Internet.

  A drive 810 is connected to the input / output interface 805 as necessary, and a removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted, and a computer program read from them is loaded. It is installed in the storage unit 808 as necessary.

  When the above-described series of processing is executed by software, a program constituting the software is installed from a network such as the Internet or a recording medium such as a removable medium 811.

  The recording medium shown in FIG. 18 is a magnetic disk (including a floppy disk (registered trademark)) on which a program is recorded, which is distributed to distribute the program to the user, separately from the apparatus main body. Removable media consisting of optical disks (including CD-ROM (compact disk-read only memory), DVD (digital versatile disk)), magneto-optical disks (including MD (mini-disk) (registered trademark)), or semiconductor memory This includes not only those configured by 811 but also those configured by a ROM 802 storing a program, a hard disk included in the storage unit 808, and the like that are distributed to the user in a state of being pre-installed in the apparatus main body.

  The steps of executing the series of processes described above in this specification are performed in parallel or individually even if they are not necessarily processed in time series, as well as processes performed in time series in the order described. It also includes processing.

It is a block diagram which shows the structural example which concerns on one Embodiment of the automatic test system to which this invention is applied. It is a figure which shows the structural example of the control part of a test object apparatus. It is a figure explaining the process of the software of a test object apparatus. It is a figure explaining the system of the electric power supply in the automatic test system of FIG. It is a block diagram which shows the functional structural example of the software performed by the control part of an automatic soft test apparatus. It is a figure which shows the example of expected value DB. It is a figure which shows the example of button DB. It is a figure which shows the example of reference | standard image DB. It is a figure which shows the example of the image recorded on the reference | standard image DB of FIG. It is a figure explaining the mechanism in which a standard picture is generated based on expectation value DB. It is a figure which shows the example of a scenario. It is a flowchart explaining an automatic test process. It is a flowchart which shows the example of a template in the case of performing an automatic test using the classified scenario. It is a figure which shows the example of the screen of a test object apparatus. It is a figure which shows the example of the screen of a test object apparatus. It is a figure which shows the example of the screen of a test object apparatus. It is a figure which shows the example of the screen of a test object apparatus. And FIG. 16 is a block diagram illustrating a configuration example of a personal computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 Automatic test system, 101 Automatic soft test apparatus, 102 Test object apparatus, 103 Database, 125 Communication part, 126 Image processing part, 127 Image acquisition apparatus, 128 Control part, 129 Peripheral apparatus, 141 Communication part, 142 Image processing part , 143 Display unit, 144 Peripheral device, 161 Device information DB, 162 Log DB, 163 Expected value DB, 164 Scenario DB, 165 Fault management DB, 411 Connection circuit, 412 Connection circuit, 500 Reading unit, 501 Model generation unit, 502 Pattern matching unit, 503 score calculation unit, 504 position specifying unit, 505 defect analysis unit, 506 difference detection unit, 507 determination unit

Claims (9)

An information processing apparatus that performs a test for verifying whether or not the test target device is operating normally,
When a user operates the test target device, a data input unit that inputs data for generating the same signal as the signal generated inside the test target device, as test data;
A data to be output along with the test data input by the test target device, and when the test target device is operating normally, a normal data generation unit that generates output data;
When the test data is input, a comparison unit that acquires data actually output by the test target device and compares the acquired data with data generated by the normal data generation unit;
An information processing apparatus comprising: a determination unit that determines whether or not the test target device has normally operated based on a result of comparison by the comparison unit. A scenario database for storing a series of test data input to the test target device as a scenario;
The information processing apparatus according to claim 1, further comprising: a normal database that stores output data when the test target apparatus is operating normally. The information processing apparatus according to claim 1, wherein the test data is converted into the same signal as a signal generated inside the test target apparatus by conversion software installed in the test target apparatus. The information processing apparatus according to claim 3, wherein when the test target apparatus is operated, a signal generated inside the test target apparatus is converted by the conversion software and stored as the scenario in the scenario database. The information processing apparatus according to claim 1, wherein the scenario database classifies and stores the scenario according to a function provided by the scenario in the test. The other end of the two connection circuits, one end of which is connected to the power source, is connected to the device under test and to itself, and a signal set in advance to the connection circuit is output, so that the power to the device under test is The information processing apparatus according to claim 1, wherein supply is controlled. An information processing method for an information processing device that performs a test for verifying whether or not a test target device is operating normally,
When the user operates the test target device, data for generating the same signal as the signal generated inside the test target device is input as test data,
Data to be output along with the test data input by the test target device, and when the test target device is operating normally, generate output data,
When the test data is input, obtain data actually output by the device under test,
Compare the acquired data with the data generated by the normal data generation unit,
An information processing method including a step of determining whether or not the test target device has normally operated based on a result of the comparison. A program that causes an information processing device that performs a test to verify whether or not a test target device is operating normally to execute information processing,
When the user operates the test target device, the input of data for generating the same signal as the signal generated inside the test target device is controlled as test data,
Data to be output along with the test data input by the test target device, and when the test target device is operating normally, control generation of output data,
When the test data is input, control the acquisition of data actually output by the device under test,
Controlling the comparison between the acquired data and the generated data;
A computer-readable program including a step of controlling whether or not the device under test has been normally operated based on the result of the comparison.   A recording medium on which the program according to claim 8 is recorded.

Images